2023-10-08T15:23:50.117 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-08T15:23:50.117 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --owner scheduled_yuriw@teuthology --description fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cephfs_misc_tests} --archive /home/teuthworker/archive/yuriw-2023-10-08_15:12:05-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418272 --name yuriw-2023-10-08_15:12:05-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi -- /home/teuthworker/archive/yuriw-2023-10-08_15:12:05-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418272/orig.config.yaml 2023-10-08T15:23:50.159 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-08T15:23:50.242 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-10-08_15:12:05-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418272 branch: wip-yuri-testing-2023-10-06-0949-quincy description: fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cephfs_misc_tests} email: null first_in_suite: false job_id: '7418272' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-10-08_15:12:05-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 30 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-yuri-testing-2023-10-06-0949-quincy ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - evicting unresponsive client - POOL_APP_NOT_ENABLED - has not responded to cap revoke by MDS for over - MDS_CLIENT_LATE_RELEASE - responding to mclientcaps - RECENT_CRASH sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri-testing-2023-10-06-0949-quincy sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 owner: scheduled_yuriw@teuthology priority: 74 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 - - client.0 - - client.1 - - client.2 seed: 8174 sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: wip-yuri-testing-2023-10-06-0949-quincy suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_08cac0187919fc3a247efdf445f652e2fb30a647/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 targets: smithi003.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi050.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi089.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi098.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi153.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_misc teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-08_15:12:05 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-08T15:23:50.242 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_08cac0187919fc3a247efdf445f652e2fb30a647/qa; will attempt to use it 2023-10-08T15:23:50.243 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_08cac0187919fc3a247efdf445f652e2fb30a647/qa/tasks 2023-10-08T15:23:50.243 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-08T15:23:50.244 INFO:teuthology.task.internal:Checking packages... 2023-10-08T15:23:50.268 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '08cac0187919fc3a247efdf445f652e2fb30a647' 2023-10-08T15:23:50.269 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-08T15:23:50.269 INFO:teuthology.packaging:ref: None 2023-10-08T15:23:50.269 INFO:teuthology.packaging:tag: None 2023-10-08T15:23:50.269 INFO:teuthology.packaging:branch: wip-yuri-testing-2023-10-06-0949-quincy 2023-10-08T15:23:50.269 INFO:teuthology.packaging:sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-08T15:23:50.269 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-yuri-testing-2023-10-06-0949-quincy 2023-10-08T15:23:50.494 INFO:teuthology.task.internal:Found packages for ceph version 17.2.6-1320-g08cac018-1focal 2023-10-08T15:23:50.494 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-08T15:23:50.501 INFO:teuthology.task.internal:no buildpackages task found 2023-10-08T15:23:50.501 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-08T15:23:50.532 INFO:teuthology.task.internal:Saving configuration 2023-10-08T15:23:50.549 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-08T15:23:50.566 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-08T15:23:50.591 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi003.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-08_15:12:05-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418272', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 15:17:40.295167', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-10-08T15:23:50.617 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi050.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-08_15:12:05-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418272', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 15:17:40.293426', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-10-08T15:23:50.640 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi089.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-08_15:12:05-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418272', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 15:17:40.298079', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-10-08T15:23:50.675 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi098.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-08_15:12:05-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418272', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 15:17:40.296901', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-10-08T15:23:50.696 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi153.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-08_15:12:05-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418272', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 15:17:40.291411', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-10-08T15:23:50.696 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-08T15:23:50.702 INFO:teuthology.task.internal:roles: ubuntu@smithi003.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2023-10-08T15:23:50.702 INFO:teuthology.task.internal:roles: ubuntu@smithi050.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2023-10-08T15:23:50.702 INFO:teuthology.task.internal:roles: ubuntu@smithi089.front.sepia.ceph.com - ['client.0'] 2023-10-08T15:23:50.703 INFO:teuthology.task.internal:roles: ubuntu@smithi098.front.sepia.ceph.com - ['client.1'] 2023-10-08T15:23:50.703 INFO:teuthology.task.internal:roles: ubuntu@smithi153.front.sepia.ceph.com - ['client.2'] 2023-10-08T15:23:50.703 INFO:teuthology.run_tasks:Running task console_log... 2023-10-08T15:23:50.881 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fda7527cb80>, signals=[15]) 2023-10-08T15:23:50.882 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-08T15:23:50.888 INFO:teuthology.task.internal:Opening connections... 2023-10-08T15:23:50.889 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi003.front.sepia.ceph.com 2023-10-08T15:23:50.891 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:23:50.939 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi050.front.sepia.ceph.com 2023-10-08T15:23:50.939 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:23:50.987 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi089.front.sepia.ceph.com 2023-10-08T15:23:50.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:23:51.033 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi098.front.sepia.ceph.com 2023-10-08T15:23:51.034 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:23:51.080 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi153.front.sepia.ceph.com 2023-10-08T15:23:51.081 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:23:51.126 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-08T15:23:51.133 DEBUG:teuthology.orchestra.run.smithi003:> uname -m 2023-10-08T15:23:51.141 INFO:teuthology.orchestra.run.smithi003.stdout:x86_64 2023-10-08T15:23:51.142 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release 2023-10-08T15:23:51.188 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="Ubuntu" 2023-10-08T15:23:51.189 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-08T15:23:51.189 INFO:teuthology.orchestra.run.smithi003.stdout:ID=ubuntu 2023-10-08T15:23:51.189 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE=debian 2023-10-08T15:23:51.189 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-08T15:23:51.189 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="20.04" 2023-10-08T15:23:51.189 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-08T15:23:51.189 INFO:teuthology.orchestra.run.smithi003.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-08T15:23:51.189 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-08T15:23:51.189 INFO:teuthology.orchestra.run.smithi003.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-08T15:23:51.189 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_CODENAME=focal 2023-10-08T15:23:51.190 INFO:teuthology.orchestra.run.smithi003.stdout:UBUNTU_CODENAME=focal 2023-10-08T15:23:51.190 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server 2023-10-08T15:23:51.217 DEBUG:teuthology.orchestra.run.smithi050:> uname -m 2023-10-08T15:23:51.225 INFO:teuthology.orchestra.run.smithi050.stdout:x86_64 2023-10-08T15:23:51.225 DEBUG:teuthology.orchestra.run.smithi050:> cat /etc/os-release 2023-10-08T15:23:51.274 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="Ubuntu" 2023-10-08T15:23:51.274 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-08T15:23:51.274 INFO:teuthology.orchestra.run.smithi050.stdout:ID=ubuntu 2023-10-08T15:23:51.274 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE=debian 2023-10-08T15:23:51.274 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-08T15:23:51.274 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="20.04" 2023-10-08T15:23:51.275 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-08T15:23:51.275 INFO:teuthology.orchestra.run.smithi050.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-08T15:23:51.275 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-08T15:23:51.275 INFO:teuthology.orchestra.run.smithi050.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-08T15:23:51.275 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_CODENAME=focal 2023-10-08T15:23:51.275 INFO:teuthology.orchestra.run.smithi050.stdout:UBUNTU_CODENAME=focal 2023-10-08T15:23:51.275 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2023-10-08T15:23:51.300 DEBUG:teuthology.orchestra.run.smithi089:> uname -m 2023-10-08T15:23:51.307 INFO:teuthology.orchestra.run.smithi089.stdout:x86_64 2023-10-08T15:23:51.308 DEBUG:teuthology.orchestra.run.smithi089:> cat /etc/os-release 2023-10-08T15:23:51.355 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="Ubuntu" 2023-10-08T15:23:51.355 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-08T15:23:51.355 INFO:teuthology.orchestra.run.smithi089.stdout:ID=ubuntu 2023-10-08T15:23:51.356 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE=debian 2023-10-08T15:23:51.356 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-08T15:23:51.356 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="20.04" 2023-10-08T15:23:51.356 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-08T15:23:51.356 INFO:teuthology.orchestra.run.smithi089.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-08T15:23:51.356 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-08T15:23:51.356 INFO:teuthology.orchestra.run.smithi089.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-08T15:23:51.356 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_CODENAME=focal 2023-10-08T15:23:51.356 INFO:teuthology.orchestra.run.smithi089.stdout:UBUNTU_CODENAME=focal 2023-10-08T15:23:51.356 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server 2023-10-08T15:23:51.375 DEBUG:teuthology.orchestra.run.smithi098:> uname -m 2023-10-08T15:23:51.383 INFO:teuthology.orchestra.run.smithi098.stdout:x86_64 2023-10-08T15:23:51.383 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2023-10-08T15:23:51.389 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="Ubuntu" 2023-10-08T15:23:51.389 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-08T15:23:51.390 INFO:teuthology.orchestra.run.smithi098.stdout:ID=ubuntu 2023-10-08T15:23:51.390 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE=debian 2023-10-08T15:23:51.390 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-08T15:23:51.390 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="20.04" 2023-10-08T15:23:51.390 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-08T15:23:51.390 INFO:teuthology.orchestra.run.smithi098.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-08T15:23:51.390 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-08T15:23:51.390 INFO:teuthology.orchestra.run.smithi098.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-08T15:23:51.390 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_CODENAME=focal 2023-10-08T15:23:51.390 INFO:teuthology.orchestra.run.smithi098.stdout:UBUNTU_CODENAME=focal 2023-10-08T15:23:51.391 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2023-10-08T15:23:51.408 DEBUG:teuthology.orchestra.run.smithi153:> uname -m 2023-10-08T15:23:51.415 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64 2023-10-08T15:23:51.415 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release 2023-10-08T15:23:51.463 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="Ubuntu" 2023-10-08T15:23:51.464 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-08T15:23:51.464 INFO:teuthology.orchestra.run.smithi153.stdout:ID=ubuntu 2023-10-08T15:23:51.464 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE=debian 2023-10-08T15:23:51.464 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-08T15:23:51.464 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="20.04" 2023-10-08T15:23:51.464 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-08T15:23:51.464 INFO:teuthology.orchestra.run.smithi153.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-08T15:23:51.464 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-08T15:23:51.464 INFO:teuthology.orchestra.run.smithi153.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-08T15:23:51.464 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_CODENAME=focal 2023-10-08T15:23:51.465 INFO:teuthology.orchestra.run.smithi153.stdout:UBUNTU_CODENAME=focal 2023-10-08T15:23:51.465 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2023-10-08T15:23:51.483 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-08T15:23:51.493 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-08T15:23:51.533 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-08T15:23:51.533 DEBUG:teuthology.orchestra.run.smithi003:> test '!' -e /home/ubuntu/cephtest 2023-10-08T15:23:51.535 DEBUG:teuthology.orchestra.run.smithi050:> test '!' -e /home/ubuntu/cephtest 2023-10-08T15:23:51.537 DEBUG:teuthology.orchestra.run.smithi089:> test '!' -e /home/ubuntu/cephtest 2023-10-08T15:23:51.539 DEBUG:teuthology.orchestra.run.smithi098:> test '!' -e /home/ubuntu/cephtest 2023-10-08T15:23:51.542 DEBUG:teuthology.orchestra.run.smithi153:> test '!' -e /home/ubuntu/cephtest 2023-10-08T15:23:51.548 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-08T15:23:51.569 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-08T15:23:51.569 DEBUG:teuthology.orchestra.run.smithi003:> test -z $(ls -A /var/lib/ceph) 2023-10-08T15:23:51.571 DEBUG:teuthology.orchestra.run.smithi050:> test -z $(ls -A /var/lib/ceph) 2023-10-08T15:23:51.573 DEBUG:teuthology.orchestra.run.smithi089:> test -z $(ls -A /var/lib/ceph) 2023-10-08T15:23:51.575 DEBUG:teuthology.orchestra.run.smithi098:> test -z $(ls -A /var/lib/ceph) 2023-10-08T15:23:51.577 DEBUG:teuthology.orchestra.run.smithi153:> test -z $(ls -A /var/lib/ceph) 2023-10-08T15:23:51.603 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-08T15:23:51.724 INFO:teuthology.run_tasks:Running task kernel... 2023-10-08T15:23:51.738 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-10-08T15:23:51.738 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'client.1': {'kdb': True, 'sha1': 'distro'}, 'client.2': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-10-08T15:23:51.738 DEBUG:teuthology.orchestra.run.smithi003:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-08T15:23:51.739 DEBUG:teuthology.orchestra.run.smithi050:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-08T15:23:51.739 DEBUG:teuthology.orchestra.run.smithi089:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-08T15:23:51.739 DEBUG:teuthology.orchestra.run.smithi098:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-08T15:23:51.740 DEBUG:teuthology.orchestra.run.smithi153:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-08T15:23:51.745 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T15:23:51.746 DEBUG:teuthology.orchestra.run.smithi089:> uname -r 2023-10-08T15:23:51.747 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T15:23:51.747 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T15:23:51.747 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T15:23:51.747 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T15:23:51.749 DEBUG:teuthology.orchestra.run.smithi153:> uname -r 2023-10-08T15:23:51.749 DEBUG:teuthology.orchestra.run.smithi003:> uname -r 2023-10-08T15:23:51.749 DEBUG:teuthology.orchestra.run.smithi050:> uname -r 2023-10-08T15:23:51.750 DEBUG:teuthology.orchestra.run.smithi098:> uname -r 2023-10-08T15:23:51.756 INFO:teuthology.orchestra.run.smithi089.stdout:5.4.0-124-generic 2023-10-08T15:23:51.756 INFO:teuthology.task.kernel:Running kernel on smithi089: 5.4.0-124-generic 2023-10-08T15:23:51.756 DEBUG:teuthology.orchestra.run.smithi089:> sudo apt-get clean 2023-10-08T15:23:51.758 INFO:teuthology.orchestra.run.smithi098.stdout:5.4.0-124-generic 2023-10-08T15:23:51.759 INFO:teuthology.orchestra.run.smithi003.stdout:5.4.0-124-generic 2023-10-08T15:23:51.759 INFO:teuthology.orchestra.run.smithi153.stdout:5.4.0-124-generic 2023-10-08T15:23:51.759 INFO:teuthology.task.kernel:Running kernel on smithi098: 5.4.0-124-generic 2023-10-08T15:23:51.759 DEBUG:teuthology.orchestra.run.smithi098:> sudo apt-get clean 2023-10-08T15:23:51.759 INFO:teuthology.task.kernel:Running kernel on smithi003: 5.4.0-124-generic 2023-10-08T15:23:51.759 DEBUG:teuthology.orchestra.run.smithi003:> sudo apt-get clean 2023-10-08T15:23:51.760 INFO:teuthology.task.kernel:Running kernel on smithi153: 5.4.0-124-generic 2023-10-08T15:23:51.760 DEBUG:teuthology.orchestra.run.smithi153:> sudo apt-get clean 2023-10-08T15:23:51.798 INFO:teuthology.orchestra.run.smithi050.stdout:5.4.0-124-generic 2023-10-08T15:23:51.798 INFO:teuthology.task.kernel:Running kernel on smithi050: 5.4.0-124-generic 2023-10-08T15:23:51.798 DEBUG:teuthology.orchestra.run.smithi050:> sudo apt-get clean 2023-10-08T15:23:51.901 DEBUG:teuthology.orchestra.run.smithi003:> sudo apt-get update 2023-10-08T15:23:51.903 DEBUG:teuthology.orchestra.run.smithi153:> sudo apt-get update 2023-10-08T15:23:51.905 DEBUG:teuthology.orchestra.run.smithi050:> sudo apt-get update 2023-10-08T15:23:51.907 DEBUG:teuthology.orchestra.run.smithi089:> sudo apt-get update 2023-10-08T15:23:51.915 DEBUG:teuthology.orchestra.run.smithi098:> sudo apt-get update 2023-10-08T15:23:52.071 INFO:teuthology.orchestra.run.smithi089.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-10-08T15:23:52.077 INFO:teuthology.orchestra.run.smithi003.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-10-08T15:23:52.083 INFO:teuthology.orchestra.run.smithi098.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-08T15:23:52.097 INFO:teuthology.orchestra.run.smithi050.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-10-08T15:23:52.099 INFO:teuthology.orchestra.run.smithi089.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-08T15:23:52.101 INFO:teuthology.orchestra.run.smithi089.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-10-08T15:23:52.104 INFO:teuthology.orchestra.run.smithi098.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-10-08T15:23:52.104 INFO:teuthology.orchestra.run.smithi098.stdout:Get:3 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-10-08T15:23:52.105 INFO:teuthology.orchestra.run.smithi003.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-08T15:23:52.107 INFO:teuthology.orchestra.run.smithi003.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-10-08T15:23:52.120 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-08T15:23:52.135 INFO:teuthology.orchestra.run.smithi153.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-10-08T15:23:52.150 INFO:teuthology.orchestra.run.smithi098.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-10-08T15:23:52.173 INFO:teuthology.orchestra.run.smithi089.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-10-08T15:23:52.190 INFO:teuthology.orchestra.run.smithi003.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-10-08T15:23:52.193 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-08T15:23:52.201 INFO:teuthology.orchestra.run.smithi153.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-10-08T15:23:52.206 INFO:teuthology.orchestra.run.smithi153.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-10-08T15:23:52.274 INFO:teuthology.orchestra.run.smithi050.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-10-08T15:23:52.462 INFO:teuthology.orchestra.run.smithi098.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [893 kB] 2023-10-08T15:23:52.484 INFO:teuthology.orchestra.run.smithi089.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,500 kB] 2023-10-08T15:23:52.507 INFO:teuthology.orchestra.run.smithi003.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,500 kB] 2023-10-08T15:23:52.525 INFO:teuthology.orchestra.run.smithi153.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [893 kB] 2023-10-08T15:23:52.526 INFO:teuthology.orchestra.run.smithi050.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,500 kB] 2023-10-08T15:23:52.552 INFO:teuthology.orchestra.run.smithi098.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,890 kB] 2023-10-08T15:23:52.590 INFO:teuthology.orchestra.run.smithi098.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [473 kB] 2023-10-08T15:23:52.593 INFO:teuthology.orchestra.run.smithi098.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.1 kB] 2023-10-08T15:23:52.594 INFO:teuthology.orchestra.run.smithi098.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [34.6 kB] 2023-10-08T15:23:52.595 INFO:teuthology.orchestra.run.smithi098.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,383 kB] 2023-10-08T15:23:52.597 INFO:teuthology.orchestra.run.smithi098.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [660 kB] 2023-10-08T15:23:52.607 INFO:teuthology.orchestra.run.smithi089.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [660 kB] 2023-10-08T15:23:52.614 INFO:teuthology.orchestra.run.smithi098.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [334 kB] 2023-10-08T15:23:52.617 INFO:teuthology.orchestra.run.smithi098.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [572 B] 2023-10-08T15:23:52.617 INFO:teuthology.orchestra.run.smithi098.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [749 kB] 2023-10-08T15:23:52.617 INFO:teuthology.orchestra.run.smithi089.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [390 kB] 2023-10-08T15:23:52.617 INFO:teuthology.orchestra.run.smithi050.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-10-08T15:23:52.620 INFO:teuthology.orchestra.run.smithi089.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,890 kB] 2023-10-08T15:23:52.621 INFO:teuthology.orchestra.run.smithi098.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,121 kB] 2023-10-08T15:23:52.622 INFO:teuthology.orchestra.run.smithi089.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2023-10-08T15:23:52.622 INFO:teuthology.orchestra.run.smithi089.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,267 kB] 2023-10-08T15:23:52.629 INFO:teuthology.orchestra.run.smithi098.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [268 kB] 2023-10-08T15:23:52.631 INFO:teuthology.orchestra.run.smithi153.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,890 kB] 2023-10-08T15:23:52.631 INFO:teuthology.orchestra.run.smithi098.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.6 kB] 2023-10-08T15:23:52.631 INFO:teuthology.orchestra.run.smithi098.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.8 kB] 2023-10-08T15:23:52.632 INFO:teuthology.orchestra.run.smithi098.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,436 B] 2023-10-08T15:23:52.632 INFO:teuthology.orchestra.run.smithi098.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,484 B] 2023-10-08T15:23:52.641 INFO:teuthology.orchestra.run.smithi098.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2023-10-08T15:23:52.642 INFO:teuthology.orchestra.run.smithi089.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [33.3 kB] 2023-10-08T15:23:52.642 INFO:teuthology.orchestra.run.smithi089.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [317 kB] 2023-10-08T15:23:52.644 INFO:teuthology.orchestra.run.smithi089.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [572 B] 2023-10-08T15:23:52.644 INFO:teuthology.orchestra.run.smithi089.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [890 kB] 2023-10-08T15:23:52.651 INFO:teuthology.orchestra.run.smithi089.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [616 kB] 2023-10-08T15:23:52.655 INFO:teuthology.orchestra.run.smithi089.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [186 kB] 2023-10-08T15:23:52.656 INFO:teuthology.orchestra.run.smithi089.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.1 kB] 2023-10-08T15:23:52.657 INFO:teuthology.orchestra.run.smithi089.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [23.6 kB] 2023-10-08T15:23:52.657 INFO:teuthology.orchestra.run.smithi089.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,196 B] 2023-10-08T15:23:52.662 INFO:teuthology.orchestra.run.smithi003.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [660 kB] 2023-10-08T15:23:52.663 INFO:teuthology.orchestra.run.smithi003.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [893 kB] 2023-10-08T15:23:52.666 INFO:teuthology.orchestra.run.smithi098.stdout:Get:22 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,500 kB] 2023-10-08T15:23:52.669 INFO:teuthology.orchestra.run.smithi089.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,504 B] 2023-10-08T15:23:52.669 INFO:teuthology.orchestra.run.smithi089.stdout:Get:21 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2023-10-08T15:23:52.673 INFO:teuthology.orchestra.run.smithi003.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [390 kB] 2023-10-08T15:23:52.674 INFO:teuthology.orchestra.run.smithi153.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [473 kB] 2023-10-08T15:23:52.678 INFO:teuthology.orchestra.run.smithi003.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2023-10-08T15:23:52.678 INFO:teuthology.orchestra.run.smithi153.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.1 kB] 2023-10-08T15:23:52.678 INFO:teuthology.orchestra.run.smithi153.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,383 kB] 2023-10-08T15:23:52.679 INFO:teuthology.orchestra.run.smithi003.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [33.3 kB] 2023-10-08T15:23:52.679 INFO:teuthology.orchestra.run.smithi003.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,267 kB] 2023-10-08T15:23:52.696 INFO:teuthology.orchestra.run.smithi003.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [317 kB] 2023-10-08T15:23:52.698 INFO:teuthology.orchestra.run.smithi050.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [660 kB] 2023-10-08T15:23:52.699 INFO:teuthology.orchestra.run.smithi003.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [572 B] 2023-10-08T15:23:52.699 INFO:teuthology.orchestra.run.smithi003.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [616 kB] 2023-10-08T15:23:52.703 INFO:teuthology.orchestra.run.smithi003.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [890 kB] 2023-10-08T15:23:52.704 INFO:teuthology.orchestra.run.smithi153.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [34.6 kB] 2023-10-08T15:23:52.705 INFO:teuthology.orchestra.run.smithi153.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [334 kB] 2023-10-08T15:23:52.706 INFO:teuthology.orchestra.run.smithi098.stdout:Get:23 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [390 kB] 2023-10-08T15:23:52.709 INFO:teuthology.orchestra.run.smithi050.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [390 kB] 2023-10-08T15:23:52.709 INFO:teuthology.orchestra.run.smithi003.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [186 kB] 2023-10-08T15:23:52.710 INFO:teuthology.orchestra.run.smithi098.stdout:Get:24 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2023-10-08T15:23:52.710 INFO:teuthology.orchestra.run.smithi098.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2023-10-08T15:23:52.710 INFO:teuthology.orchestra.run.smithi098.stdout:Get:26 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,267 kB] 2023-10-08T15:23:52.710 INFO:teuthology.orchestra.run.smithi153.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [572 B] 2023-10-08T15:23:52.710 INFO:teuthology.orchestra.run.smithi153.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [749 kB] 2023-10-08T15:23:52.711 INFO:teuthology.orchestra.run.smithi003.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.1 kB] 2023-10-08T15:23:52.711 INFO:teuthology.orchestra.run.smithi003.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [23.6 kB] 2023-10-08T15:23:52.712 INFO:teuthology.orchestra.run.smithi003.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,196 B] 2023-10-08T15:23:52.712 INFO:teuthology.orchestra.run.smithi003.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,504 B] 2023-10-08T15:23:52.715 INFO:teuthology.orchestra.run.smithi050.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2023-10-08T15:23:52.715 INFO:teuthology.orchestra.run.smithi050.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,267 kB] 2023-10-08T15:23:52.718 INFO:teuthology.orchestra.run.smithi089.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [893 kB] 2023-10-08T15:23:52.724 INFO:teuthology.orchestra.run.smithi098.stdout:Get:27 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [33.3 kB] 2023-10-08T15:23:52.725 INFO:teuthology.orchestra.run.smithi098.stdout:Get:28 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [317 kB] 2023-10-08T15:23:52.727 INFO:teuthology.orchestra.run.smithi153.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,121 kB] 2023-10-08T15:23:52.727 INFO:teuthology.orchestra.run.smithi098.stdout:Get:29 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [572 B] 2023-10-08T15:23:52.727 INFO:teuthology.orchestra.run.smithi098.stdout:Get:30 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [890 kB] 2023-10-08T15:23:52.728 INFO:teuthology.orchestra.run.smithi089.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [473 kB] 2023-10-08T15:23:52.728 INFO:teuthology.orchestra.run.smithi098.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2023-10-08T15:23:52.729 INFO:teuthology.orchestra.run.smithi003.stdout:Get:21 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2023-10-08T15:23:52.729 INFO:teuthology.orchestra.run.smithi098.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2023-10-08T15:23:52.730 INFO:teuthology.orchestra.run.smithi098.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-10-08T15:23:52.730 INFO:teuthology.orchestra.run.smithi098.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2023-10-08T15:23:52.731 INFO:teuthology.orchestra.run.smithi098.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-10-08T15:23:52.733 INFO:teuthology.orchestra.run.smithi098.stdout:Get:36 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [616 kB] 2023-10-08T15:23:52.734 INFO:teuthology.orchestra.run.smithi089.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.1 kB] 2023-10-08T15:23:52.734 INFO:teuthology.orchestra.run.smithi089.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,383 kB] 2023-10-08T15:23:52.737 INFO:teuthology.orchestra.run.smithi098.stdout:Get:37 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [186 kB] 2023-10-08T15:23:52.738 INFO:teuthology.orchestra.run.smithi098.stdout:Get:38 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.1 kB] 2023-10-08T15:23:52.741 INFO:teuthology.orchestra.run.smithi098.stdout:Get:39 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [23.6 kB] 2023-10-08T15:23:52.741 INFO:teuthology.orchestra.run.smithi098.stdout:Get:40 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,196 B] 2023-10-08T15:23:52.745 INFO:teuthology.orchestra.run.smithi153.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [268 kB] 2023-10-08T15:23:52.747 INFO:teuthology.orchestra.run.smithi153.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.6 kB] 2023-10-08T15:23:52.749 INFO:teuthology.orchestra.run.smithi089.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [34.6 kB] 2023-10-08T15:23:52.750 INFO:teuthology.orchestra.run.smithi089.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [334 kB] 2023-10-08T15:23:52.752 INFO:teuthology.orchestra.run.smithi089.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [572 B] 2023-10-08T15:23:52.752 INFO:teuthology.orchestra.run.smithi089.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,121 kB] 2023-10-08T15:23:52.756 INFO:teuthology.orchestra.run.smithi050.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [33.3 kB] 2023-10-08T15:23:52.757 INFO:teuthology.orchestra.run.smithi050.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [317 kB] 2023-10-08T15:23:52.758 INFO:teuthology.orchestra.run.smithi098.stdout:Get:41 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,504 B] 2023-10-08T15:23:52.758 INFO:teuthology.orchestra.run.smithi098.stdout:Get:42 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2023-10-08T15:23:52.759 INFO:teuthology.orchestra.run.smithi153.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,436 B] 2023-10-08T15:23:52.759 INFO:teuthology.orchestra.run.smithi153.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.8 kB] 2023-10-08T15:23:52.759 INFO:teuthology.orchestra.run.smithi153.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,484 B] 2023-10-08T15:23:52.760 INFO:teuthology.orchestra.run.smithi153.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2023-10-08T15:23:52.760 INFO:teuthology.orchestra.run.smithi089.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [749 kB] 2023-10-08T15:23:52.761 INFO:teuthology.orchestra.run.smithi050.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [572 B] 2023-10-08T15:23:52.762 INFO:teuthology.orchestra.run.smithi050.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [616 kB] 2023-10-08T15:23:52.764 INFO:teuthology.orchestra.run.smithi089.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [268 kB] 2023-10-08T15:23:52.766 INFO:teuthology.orchestra.run.smithi050.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [890 kB] 2023-10-08T15:23:52.767 INFO:teuthology.orchestra.run.smithi089.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.6 kB] 2023-10-08T15:23:52.767 INFO:teuthology.orchestra.run.smithi089.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,436 B] 2023-10-08T15:23:52.767 INFO:teuthology.orchestra.run.smithi089.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.8 kB] 2023-10-08T15:23:52.773 INFO:teuthology.orchestra.run.smithi050.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [186 kB] 2023-10-08T15:23:52.774 INFO:teuthology.orchestra.run.smithi050.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.1 kB] 2023-10-08T15:23:52.778 INFO:teuthology.orchestra.run.smithi153.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2023-10-08T15:23:52.778 INFO:teuthology.orchestra.run.smithi153.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2023-10-08T15:23:52.779 INFO:teuthology.orchestra.run.smithi153.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2023-10-08T15:23:52.779 INFO:teuthology.orchestra.run.smithi153.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2023-10-08T15:23:52.779 INFO:teuthology.orchestra.run.smithi153.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-10-08T15:23:52.779 INFO:teuthology.orchestra.run.smithi153.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-10-08T15:23:52.779 INFO:teuthology.orchestra.run.smithi050.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,196 B] 2023-10-08T15:23:52.780 INFO:teuthology.orchestra.run.smithi050.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [23.6 kB] 2023-10-08T15:23:52.780 INFO:teuthology.orchestra.run.smithi050.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,504 B] 2023-10-08T15:23:52.780 INFO:teuthology.orchestra.run.smithi050.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2023-10-08T15:23:52.780 INFO:teuthology.orchestra.run.smithi089.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,484 B] 2023-10-08T15:23:52.781 INFO:teuthology.orchestra.run.smithi089.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2023-10-08T15:23:52.781 INFO:teuthology.orchestra.run.smithi089.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2023-10-08T15:23:52.781 INFO:teuthology.orchestra.run.smithi089.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2023-10-08T15:23:52.781 INFO:teuthology.orchestra.run.smithi089.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2023-10-08T15:23:52.796 INFO:teuthology.orchestra.run.smithi089.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-10-08T15:23:52.797 INFO:teuthology.orchestra.run.smithi089.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2023-10-08T15:23:52.797 INFO:teuthology.orchestra.run.smithi003.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,890 kB] 2023-10-08T15:23:52.797 INFO:teuthology.orchestra.run.smithi089.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-10-08T15:23:52.857 INFO:teuthology.orchestra.run.smithi003.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [473 kB] 2023-10-08T15:23:52.861 INFO:teuthology.orchestra.run.smithi153.stdout:Get:27 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,500 kB] 2023-10-08T15:23:52.862 INFO:teuthology.orchestra.run.smithi003.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.1 kB] 2023-10-08T15:23:52.862 INFO:teuthology.orchestra.run.smithi003.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,383 kB] 2023-10-08T15:23:52.875 INFO:teuthology.orchestra.run.smithi050.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [893 kB] 2023-10-08T15:23:52.883 INFO:teuthology.orchestra.run.smithi003.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [34.6 kB] 2023-10-08T15:23:52.884 INFO:teuthology.orchestra.run.smithi003.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [334 kB] 2023-10-08T15:23:52.887 INFO:teuthology.orchestra.run.smithi003.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [572 B] 2023-10-08T15:23:52.887 INFO:teuthology.orchestra.run.smithi003.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [749 kB] 2023-10-08T15:23:52.892 INFO:teuthology.orchestra.run.smithi003.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,121 kB] 2023-10-08T15:23:52.902 INFO:teuthology.orchestra.run.smithi003.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [268 kB] 2023-10-08T15:23:52.905 INFO:teuthology.orchestra.run.smithi003.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.6 kB] 2023-10-08T15:23:52.905 INFO:teuthology.orchestra.run.smithi003.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.8 kB] 2023-10-08T15:23:52.906 INFO:teuthology.orchestra.run.smithi003.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,436 B] 2023-10-08T15:23:52.906 INFO:teuthology.orchestra.run.smithi003.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,484 B] 2023-10-08T15:23:52.906 INFO:teuthology.orchestra.run.smithi003.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2023-10-08T15:23:52.925 INFO:teuthology.orchestra.run.smithi003.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2023-10-08T15:23:52.926 INFO:teuthology.orchestra.run.smithi003.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2023-10-08T15:23:52.926 INFO:teuthology.orchestra.run.smithi003.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2023-10-08T15:23:52.927 INFO:teuthology.orchestra.run.smithi003.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2023-10-08T15:23:52.927 INFO:teuthology.orchestra.run.smithi003.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-10-08T15:23:52.927 INFO:teuthology.orchestra.run.smithi003.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-10-08T15:23:53.205 INFO:teuthology.orchestra.run.smithi050.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,890 kB] 2023-10-08T15:23:53.337 INFO:teuthology.orchestra.run.smithi153.stdout:Get:28 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [660 kB] 2023-10-08T15:23:53.352 INFO:teuthology.orchestra.run.smithi153.stdout:Get:29 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [390 kB] 2023-10-08T15:23:53.360 INFO:teuthology.orchestra.run.smithi153.stdout:Get:30 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2023-10-08T15:23:53.361 INFO:teuthology.orchestra.run.smithi153.stdout:Get:31 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [33.3 kB] 2023-10-08T15:23:53.361 INFO:teuthology.orchestra.run.smithi153.stdout:Get:32 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,267 kB] 2023-10-08T15:23:53.380 INFO:teuthology.orchestra.run.smithi050.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [473 kB] 2023-10-08T15:23:53.393 INFO:teuthology.orchestra.run.smithi050.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.1 kB] 2023-10-08T15:23:53.394 INFO:teuthology.orchestra.run.smithi050.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [34.6 kB] 2023-10-08T15:23:53.395 INFO:teuthology.orchestra.run.smithi050.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,383 kB] 2023-10-08T15:23:53.436 INFO:teuthology.orchestra.run.smithi153.stdout:Get:33 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [317 kB] 2023-10-08T15:23:53.443 INFO:teuthology.orchestra.run.smithi153.stdout:Get:34 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [572 B] 2023-10-08T15:23:53.443 INFO:teuthology.orchestra.run.smithi153.stdout:Get:35 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [890 kB] 2023-10-08T15:23:53.464 INFO:teuthology.orchestra.run.smithi153.stdout:Get:36 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [616 kB] 2023-10-08T15:23:53.464 INFO:teuthology.orchestra.run.smithi050.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [334 kB] 2023-10-08T15:23:53.469 INFO:teuthology.orchestra.run.smithi050.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [572 B] 2023-10-08T15:23:53.633 INFO:teuthology.orchestra.run.smithi050.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [749 kB] 2023-10-08T15:23:53.641 INFO:teuthology.orchestra.run.smithi153.stdout:Get:37 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [186 kB] 2023-10-08T15:23:54.059 INFO:teuthology.orchestra.run.smithi153.stdout:Get:38 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.1 kB] 2023-10-08T15:23:54.065 INFO:teuthology.orchestra.run.smithi153.stdout:Get:39 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [23.6 kB] 2023-10-08T15:23:54.072 INFO:teuthology.orchestra.run.smithi153.stdout:Get:40 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,196 B] 2023-10-08T15:23:54.075 INFO:teuthology.orchestra.run.smithi153.stdout:Get:41 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,504 B] 2023-10-08T15:23:54.076 INFO:teuthology.orchestra.run.smithi153.stdout:Get:42 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2023-10-08T15:23:54.217 INFO:teuthology.orchestra.run.smithi050.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,121 kB] 2023-10-08T15:23:54.325 INFO:teuthology.orchestra.run.smithi050.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [268 kB] 2023-10-08T15:23:54.345 INFO:teuthology.orchestra.run.smithi050.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.6 kB] 2023-10-08T15:23:54.348 INFO:teuthology.orchestra.run.smithi050.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.8 kB] 2023-10-08T15:23:54.349 INFO:teuthology.orchestra.run.smithi050.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,436 B] 2023-10-08T15:23:54.350 INFO:teuthology.orchestra.run.smithi050.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,484 B] 2023-10-08T15:23:54.351 INFO:teuthology.orchestra.run.smithi050.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2023-10-08T15:23:54.351 INFO:teuthology.orchestra.run.smithi050.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2023-10-08T15:23:54.353 INFO:teuthology.orchestra.run.smithi050.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2023-10-08T15:23:54.356 INFO:teuthology.orchestra.run.smithi050.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2023-10-08T15:23:54.521 INFO:teuthology.orchestra.run.smithi050.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-10-08T15:23:54.684 INFO:teuthology.orchestra.run.smithi050.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2023-10-08T15:23:54.735 INFO:teuthology.orchestra.run.smithi050.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-10-08T15:23:56.423 INFO:teuthology.orchestra.run.smithi089.stdout:Fetched 17.6 MB in 3s (6,886 kB/s) 2023-10-08T15:23:56.470 INFO:teuthology.orchestra.run.smithi098.stdout:Fetched 17.6 MB in 3s (6,941 kB/s) 2023-10-08T15:23:56.578 INFO:teuthology.orchestra.run.smithi153.stdout:Fetched 17.6 MB in 3s (6,781 kB/s) 2023-10-08T15:23:56.848 INFO:teuthology.orchestra.run.smithi003.stdout:Fetched 17.6 MB in 3s (6,415 kB/s) 2023-10-08T15:23:56.949 INFO:teuthology.orchestra.run.smithi050.stdout:Fetched 17.6 MB in 3s (6,278 kB/s) 2023-10-08T15:23:57.865 INFO:teuthology.orchestra.run.smithi089.stdout:Reading package lists... 2023-10-08T15:23:57.891 DEBUG:teuthology.orchestra.run.smithi089:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-08T15:23:57.901 INFO:teuthology.orchestra.run.smithi098.stdout:Reading package lists... 2023-10-08T15:23:57.926 DEBUG:teuthology.orchestra.run.smithi098:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-08T15:23:57.943 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2023-10-08T15:23:57.958 INFO:teuthology.orchestra.run.smithi089.stdout:Reading package lists... 2023-10-08T15:23:57.968 DEBUG:teuthology.orchestra.run.smithi153:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-08T15:23:58.005 INFO:teuthology.orchestra.run.smithi098.stdout:Reading package lists... 2023-10-08T15:23:58.045 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2023-10-08T15:23:58.141 INFO:teuthology.orchestra.run.smithi089.stdout:Building dependency tree... 2023-10-08T15:23:58.141 INFO:teuthology.orchestra.run.smithi089.stdout:Reading state information... 2023-10-08T15:23:58.205 INFO:teuthology.orchestra.run.smithi098.stdout:Building dependency tree... 2023-10-08T15:23:58.206 INFO:teuthology.orchestra.run.smithi098.stdout:Reading state information... 2023-10-08T15:23:58.246 INFO:teuthology.orchestra.run.smithi153.stdout:Building dependency tree... 2023-10-08T15:23:58.247 INFO:teuthology.orchestra.run.smithi153.stdout:Reading state information... 2023-10-08T15:23:58.312 INFO:teuthology.orchestra.run.smithi089.stdout:The following additional packages will be installed: 2023-10-08T15:23:58.312 INFO:teuthology.orchestra.run.smithi089.stdout: linux-generic linux-headers-5.4.0-164 linux-headers-5.4.0-164-generic 2023-10-08T15:23:58.312 INFO:teuthology.orchestra.run.smithi089.stdout: linux-headers-generic linux-image-5.4.0-164-generic 2023-10-08T15:23:58.312 INFO:teuthology.orchestra.run.smithi003.stdout:Reading package lists... 2023-10-08T15:23:58.312 INFO:teuthology.orchestra.run.smithi089.stdout: linux-modules-5.4.0-164-generic linux-modules-extra-5.4.0-164-generic 2023-10-08T15:23:58.313 INFO:teuthology.orchestra.run.smithi089.stdout:Suggested packages: 2023-10-08T15:23:58.313 INFO:teuthology.orchestra.run.smithi089.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2023-10-08T15:23:58.313 INFO:teuthology.orchestra.run.smithi089.stdout:Recommended packages: 2023-10-08T15:23:58.313 INFO:teuthology.orchestra.run.smithi089.stdout: thermald 2023-10-08T15:23:58.338 DEBUG:teuthology.orchestra.run.smithi003:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-08T15:23:58.365 INFO:teuthology.orchestra.run.smithi089.stdout:The following NEW packages will be installed: 2023-10-08T15:23:58.366 INFO:teuthology.orchestra.run.smithi089.stdout: linux-headers-5.4.0-164 linux-headers-5.4.0-164-generic 2023-10-08T15:23:58.366 INFO:teuthology.orchestra.run.smithi089.stdout: linux-image-5.4.0-164-generic linux-modules-5.4.0-164-generic 2023-10-08T15:23:58.366 INFO:teuthology.orchestra.run.smithi089.stdout: linux-modules-extra-5.4.0-164-generic 2023-10-08T15:23:58.367 INFO:teuthology.orchestra.run.smithi089.stdout:The following packages will be upgraded: 2023-10-08T15:23:58.368 INFO:teuthology.orchestra.run.smithi089.stdout: linux-generic linux-headers-generic linux-image-generic 2023-10-08T15:23:58.395 INFO:teuthology.orchestra.run.smithi098.stdout:The following additional packages will be installed: 2023-10-08T15:23:58.395 INFO:teuthology.orchestra.run.smithi098.stdout: linux-generic linux-headers-5.4.0-164 linux-headers-5.4.0-164-generic 2023-10-08T15:23:58.395 INFO:teuthology.orchestra.run.smithi098.stdout: linux-headers-generic linux-image-5.4.0-164-generic 2023-10-08T15:23:58.396 INFO:teuthology.orchestra.run.smithi098.stdout: linux-modules-5.4.0-164-generic linux-modules-extra-5.4.0-164-generic 2023-10-08T15:23:58.397 INFO:teuthology.orchestra.run.smithi098.stdout:Suggested packages: 2023-10-08T15:23:58.397 INFO:teuthology.orchestra.run.smithi098.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2023-10-08T15:23:58.397 INFO:teuthology.orchestra.run.smithi098.stdout:Recommended packages: 2023-10-08T15:23:58.397 INFO:teuthology.orchestra.run.smithi098.stdout: thermald 2023-10-08T15:23:58.412 INFO:teuthology.orchestra.run.smithi003.stdout:Reading package lists... 2023-10-08T15:23:58.432 INFO:teuthology.orchestra.run.smithi153.stdout:The following additional packages will be installed: 2023-10-08T15:23:58.432 INFO:teuthology.orchestra.run.smithi153.stdout: linux-generic linux-headers-5.4.0-164 linux-headers-5.4.0-164-generic 2023-10-08T15:23:58.432 INFO:teuthology.orchestra.run.smithi153.stdout: linux-headers-generic linux-image-5.4.0-164-generic 2023-10-08T15:23:58.433 INFO:teuthology.orchestra.run.smithi153.stdout: linux-modules-5.4.0-164-generic linux-modules-extra-5.4.0-164-generic 2023-10-08T15:23:58.433 INFO:teuthology.orchestra.run.smithi153.stdout:Suggested packages: 2023-10-08T15:23:58.434 INFO:teuthology.orchestra.run.smithi153.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2023-10-08T15:23:58.434 INFO:teuthology.orchestra.run.smithi153.stdout:Recommended packages: 2023-10-08T15:23:58.434 INFO:teuthology.orchestra.run.smithi153.stdout: thermald 2023-10-08T15:23:58.460 INFO:teuthology.orchestra.run.smithi050.stdout:Reading package lists... 2023-10-08T15:23:58.471 INFO:teuthology.orchestra.run.smithi098.stdout:The following NEW packages will be installed: 2023-10-08T15:23:58.472 INFO:teuthology.orchestra.run.smithi098.stdout: linux-headers-5.4.0-164 linux-headers-5.4.0-164-generic 2023-10-08T15:23:58.472 INFO:teuthology.orchestra.run.smithi098.stdout: linux-image-5.4.0-164-generic linux-modules-5.4.0-164-generic 2023-10-08T15:23:58.472 INFO:teuthology.orchestra.run.smithi098.stdout: linux-modules-extra-5.4.0-164-generic 2023-10-08T15:23:58.473 INFO:teuthology.orchestra.run.smithi098.stdout:The following packages will be upgraded: 2023-10-08T15:23:58.474 INFO:teuthology.orchestra.run.smithi098.stdout: linux-generic linux-headers-generic linux-image-generic 2023-10-08T15:23:58.487 DEBUG:teuthology.orchestra.run.smithi050:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-08T15:23:58.497 INFO:teuthology.orchestra.run.smithi153.stdout:The following NEW packages will be installed: 2023-10-08T15:23:58.497 INFO:teuthology.orchestra.run.smithi153.stdout: linux-headers-5.4.0-164 linux-headers-5.4.0-164-generic 2023-10-08T15:23:58.497 INFO:teuthology.orchestra.run.smithi153.stdout: linux-image-5.4.0-164-generic linux-modules-5.4.0-164-generic 2023-10-08T15:23:58.498 INFO:teuthology.orchestra.run.smithi153.stdout: linux-modules-extra-5.4.0-164-generic 2023-10-08T15:23:58.499 INFO:teuthology.orchestra.run.smithi153.stdout:The following packages will be upgraded: 2023-10-08T15:23:58.499 INFO:teuthology.orchestra.run.smithi153.stdout: linux-generic linux-headers-generic linux-image-generic 2023-10-08T15:23:58.527 INFO:teuthology.orchestra.run.smithi098.stdout:3 upgraded, 5 newly installed, 0 to remove and 271 not upgraded. 2023-10-08T15:23:58.527 INFO:teuthology.orchestra.run.smithi098.stdout:Need to get 77.0 MB of archives. 2023-10-08T15:23:58.527 INFO:teuthology.orchestra.run.smithi098.stdout:After this operation, 380 MB of additional disk space will be used. 2023-10-08T15:23:58.528 INFO:teuthology.orchestra.run.smithi098.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-164-generic amd64 5.4.0-164.181 [14.9 MB] 2023-10-08T15:23:58.550 INFO:teuthology.orchestra.run.smithi089.stdout:3 upgraded, 5 newly installed, 0 to remove and 271 not upgraded. 2023-10-08T15:23:58.550 INFO:teuthology.orchestra.run.smithi089.stdout:Need to get 77.0 MB of archives. 2023-10-08T15:23:58.550 INFO:teuthology.orchestra.run.smithi089.stdout:After this operation, 380 MB of additional disk space will be used. 2023-10-08T15:23:58.550 INFO:teuthology.orchestra.run.smithi089.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-164-generic amd64 5.4.0-164.181 [14.9 MB] 2023-10-08T15:23:58.556 INFO:teuthology.orchestra.run.smithi153.stdout:3 upgraded, 5 newly installed, 0 to remove and 271 not upgraded. 2023-10-08T15:23:58.556 INFO:teuthology.orchestra.run.smithi153.stdout:Need to get 77.0 MB of archives. 2023-10-08T15:23:58.556 INFO:teuthology.orchestra.run.smithi153.stdout:After this operation, 380 MB of additional disk space will be used. 2023-10-08T15:23:58.556 INFO:teuthology.orchestra.run.smithi153.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-164-generic amd64 5.4.0-164.181 [14.9 MB] 2023-10-08T15:23:58.558 INFO:teuthology.orchestra.run.smithi050.stdout:Reading package lists... 2023-10-08T15:23:58.618 INFO:teuthology.orchestra.run.smithi003.stdout:Building dependency tree... 2023-10-08T15:23:58.619 INFO:teuthology.orchestra.run.smithi003.stdout:Reading state information... 2023-10-08T15:23:58.771 INFO:teuthology.orchestra.run.smithi050.stdout:Building dependency tree... 2023-10-08T15:23:58.772 INFO:teuthology.orchestra.run.smithi050.stdout:Reading state information... 2023-10-08T15:23:58.812 INFO:teuthology.orchestra.run.smithi003.stdout:The following additional packages will be installed: 2023-10-08T15:23:58.812 INFO:teuthology.orchestra.run.smithi003.stdout: linux-generic linux-headers-5.4.0-164 linux-headers-5.4.0-164-generic 2023-10-08T15:23:58.812 INFO:teuthology.orchestra.run.smithi003.stdout: linux-headers-generic linux-image-5.4.0-164-generic 2023-10-08T15:23:58.812 INFO:teuthology.orchestra.run.smithi003.stdout: linux-modules-5.4.0-164-generic linux-modules-extra-5.4.0-164-generic 2023-10-08T15:23:58.813 INFO:teuthology.orchestra.run.smithi003.stdout:Suggested packages: 2023-10-08T15:23:58.813 INFO:teuthology.orchestra.run.smithi003.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2023-10-08T15:23:58.813 INFO:teuthology.orchestra.run.smithi003.stdout:Recommended packages: 2023-10-08T15:23:58.813 INFO:teuthology.orchestra.run.smithi003.stdout: thermald 2023-10-08T15:23:58.878 INFO:teuthology.orchestra.run.smithi003.stdout:The following NEW packages will be installed: 2023-10-08T15:23:58.879 INFO:teuthology.orchestra.run.smithi003.stdout: linux-headers-5.4.0-164 linux-headers-5.4.0-164-generic 2023-10-08T15:23:58.879 INFO:teuthology.orchestra.run.smithi003.stdout: linux-image-5.4.0-164-generic linux-modules-5.4.0-164-generic 2023-10-08T15:23:58.879 INFO:teuthology.orchestra.run.smithi003.stdout: linux-modules-extra-5.4.0-164-generic 2023-10-08T15:23:58.880 INFO:teuthology.orchestra.run.smithi003.stdout:The following packages will be upgraded: 2023-10-08T15:23:58.880 INFO:teuthology.orchestra.run.smithi003.stdout: linux-generic linux-headers-generic linux-image-generic 2023-10-08T15:23:58.927 INFO:teuthology.orchestra.run.smithi098.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-164-generic amd64 5.4.0-164.181 [10.5 MB] 2023-10-08T15:23:58.953 INFO:teuthology.orchestra.run.smithi003.stdout:3 upgraded, 5 newly installed, 0 to remove and 271 not upgraded. 2023-10-08T15:23:58.954 INFO:teuthology.orchestra.run.smithi003.stdout:Need to get 77.0 MB of archives. 2023-10-08T15:23:58.954 INFO:teuthology.orchestra.run.smithi003.stdout:After this operation, 380 MB of additional disk space will be used. 2023-10-08T15:23:58.954 INFO:teuthology.orchestra.run.smithi003.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-164-generic amd64 5.4.0-164.181 [14.9 MB] 2023-10-08T15:23:58.964 INFO:teuthology.orchestra.run.smithi050.stdout:The following additional packages will be installed: 2023-10-08T15:23:58.964 INFO:teuthology.orchestra.run.smithi050.stdout: linux-generic linux-headers-5.4.0-164 linux-headers-5.4.0-164-generic 2023-10-08T15:23:58.964 INFO:teuthology.orchestra.run.smithi050.stdout: linux-headers-generic linux-image-5.4.0-164-generic 2023-10-08T15:23:58.964 INFO:teuthology.orchestra.run.smithi050.stdout: linux-modules-5.4.0-164-generic linux-modules-extra-5.4.0-164-generic 2023-10-08T15:23:58.965 INFO:teuthology.orchestra.run.smithi050.stdout:Suggested packages: 2023-10-08T15:23:58.966 INFO:teuthology.orchestra.run.smithi050.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2023-10-08T15:23:58.966 INFO:teuthology.orchestra.run.smithi050.stdout:Recommended packages: 2023-10-08T15:23:58.966 INFO:teuthology.orchestra.run.smithi050.stdout: thermald 2023-10-08T15:23:59.013 INFO:teuthology.orchestra.run.smithi153.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-164-generic amd64 5.4.0-164.181 [10.5 MB] 2023-10-08T15:23:59.015 INFO:teuthology.orchestra.run.smithi050.stdout:The following NEW packages will be installed: 2023-10-08T15:23:59.016 INFO:teuthology.orchestra.run.smithi050.stdout: linux-headers-5.4.0-164 linux-headers-5.4.0-164-generic 2023-10-08T15:23:59.016 INFO:teuthology.orchestra.run.smithi050.stdout: linux-image-5.4.0-164-generic linux-modules-5.4.0-164-generic 2023-10-08T15:23:59.016 INFO:teuthology.orchestra.run.smithi050.stdout: linux-modules-extra-5.4.0-164-generic 2023-10-08T15:23:59.017 INFO:teuthology.orchestra.run.smithi050.stdout:The following packages will be upgraded: 2023-10-08T15:23:59.018 INFO:teuthology.orchestra.run.smithi050.stdout: linux-generic linux-headers-generic linux-image-generic 2023-10-08T15:23:59.032 INFO:teuthology.orchestra.run.smithi098.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-164-generic amd64 5.4.0-164.181 [39.2 MB] 2023-10-08T15:23:59.070 INFO:teuthology.orchestra.run.smithi050.stdout:3 upgraded, 5 newly installed, 0 to remove and 271 not upgraded. 2023-10-08T15:23:59.070 INFO:teuthology.orchestra.run.smithi050.stdout:Need to get 77.0 MB of archives. 2023-10-08T15:23:59.071 INFO:teuthology.orchestra.run.smithi050.stdout:After this operation, 380 MB of additional disk space will be used. 2023-10-08T15:23:59.071 INFO:teuthology.orchestra.run.smithi050.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-164-generic amd64 5.4.0-164.181 [14.9 MB] 2023-10-08T15:23:59.197 INFO:teuthology.orchestra.run.smithi153.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-164-generic amd64 5.4.0-164.181 [39.2 MB] 2023-10-08T15:23:59.360 INFO:teuthology.orchestra.run.smithi050.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-164-generic amd64 5.4.0-164.181 [10.5 MB] 2023-10-08T15:23:59.457 INFO:teuthology.orchestra.run.smithi050.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-164-generic amd64 5.4.0-164.181 [39.2 MB] 2023-10-08T15:23:59.687 INFO:teuthology.orchestra.run.smithi089.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-164-generic amd64 5.4.0-164.181 [10.5 MB] 2023-10-08T15:23:59.932 INFO:teuthology.orchestra.run.smithi050.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.164.161 [1,896 B] 2023-10-08T15:23:59.932 INFO:teuthology.orchestra.run.smithi050.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.164.161 [2,592 B] 2023-10-08T15:23:59.932 INFO:teuthology.orchestra.run.smithi050.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-164 all 5.4.0-164.181 [11.0 MB] 2023-10-08T15:23:59.948 INFO:teuthology.orchestra.run.smithi098.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.164.161 [1,896 B] 2023-10-08T15:23:59.948 INFO:teuthology.orchestra.run.smithi098.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.164.161 [2,592 B] 2023-10-08T15:23:59.949 INFO:teuthology.orchestra.run.smithi098.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-164 all 5.4.0-164.181 [11.0 MB] 2023-10-08T15:23:59.957 INFO:teuthology.orchestra.run.smithi089.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-164-generic amd64 5.4.0-164.181 [39.2 MB] 2023-10-08T15:24:00.028 INFO:teuthology.orchestra.run.smithi050.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-164-generic amd64 5.4.0-164.181 [1,360 kB] 2023-10-08T15:24:00.038 INFO:teuthology.orchestra.run.smithi050.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.164.161 [2,468 B] 2023-10-08T15:24:00.048 INFO:teuthology.orchestra.run.smithi153.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.164.161 [1,896 B] 2023-10-08T15:24:00.048 INFO:teuthology.orchestra.run.smithi153.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.164.161 [2,592 B] 2023-10-08T15:24:00.048 INFO:teuthology.orchestra.run.smithi153.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-164 all 5.4.0-164.181 [11.0 MB] 2023-10-08T15:24:00.104 INFO:teuthology.orchestra.run.smithi003.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-164-generic amd64 5.4.0-164.181 [10.5 MB] 2023-10-08T15:24:00.223 INFO:teuthology.orchestra.run.smithi003.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-164-generic amd64 5.4.0-164.181 [39.2 MB] 2023-10-08T15:24:00.433 INFO:teuthology.orchestra.run.smithi153.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-164-generic amd64 5.4.0-164.181 [1,360 kB] 2023-10-08T15:24:00.491 INFO:teuthology.orchestra.run.smithi153.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.164.161 [2,468 B] 2023-10-08T15:24:00.547 INFO:teuthology.orchestra.run.smithi098.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-164-generic amd64 5.4.0-164.181 [1,360 kB] 2023-10-08T15:24:00.637 INFO:teuthology.orchestra.run.smithi098.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.164.161 [2,468 B] 2023-10-08T15:24:00.758 INFO:teuthology.orchestra.run.smithi050.stdout:Fetched 77.0 MB in 1s (76.0 MB/s) 2023-10-08T15:24:00.912 INFO:teuthology.orchestra.run.smithi003.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.164.161 [1,896 B] 2023-10-08T15:24:00.912 INFO:teuthology.orchestra.run.smithi003.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.164.161 [2,592 B] 2023-10-08T15:24:00.912 INFO:teuthology.orchestra.run.smithi003.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-164 all 5.4.0-164.181 [11.0 MB] 2023-10-08T15:24:00.958 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package linux-modules-5.4.0-164-generic. 2023-10-08T15:24:01.013 INFO:teuthology.orchestra.run.smithi003.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-164-generic amd64 5.4.0-164.181 [1,360 kB] 2023-10-08T15:24:01.025 INFO:teuthology.orchestra.run.smithi003.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.164.161 [2,468 B] 2023-10-08T15:24:01.193 INFO:teuthology.orchestra.run.smithi153.stdout:Fetched 77.0 MB in 2s (38.8 MB/s) 2023-10-08T15:24:01.265 INFO:teuthology.orchestra.run.smithi089.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.164.161 [1,896 B] 2023-10-08T15:24:01.265 INFO:teuthology.orchestra.run.smithi089.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.164.161 [2,592 B] 2023-10-08T15:24:01.266 INFO:teuthology.orchestra.run.smithi089.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-164 all 5.4.0-164.181 [11.0 MB] 2023-10-08T15:24:01.343 INFO:teuthology.orchestra.run.smithi098.stdout:Fetched 77.0 MB in 2s (35.7 MB/s) 2023-10-08T15:24:01.411 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package linux-modules-5.4.0-164-generic. 2023-10-08T15:24:01.534 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package linux-modules-5.4.0-164-generic. 2023-10-08T15:24:01.611 INFO:teuthology.orchestra.run.smithi089.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-164-generic amd64 5.4.0-164.181 [1,360 kB] 2023-10-08T15:24:01.651 INFO:teuthology.orchestra.run.smithi089.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.164.161 [2,468 B] 2023-10-08T15:24:01.729 INFO:teuthology.orchestra.run.smithi003.stdout:Fetched 77.0 MB in 2s (36.0 MB/s) 2023-10-08T15:24:01.916 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package linux-modules-5.4.0-164-generic. 2023-10-08T15:24:02.336 INFO:teuthology.orchestra.run.smithi089.stdout:Fetched 77.0 MB in 3s (23.5 MB/s) 2023-10-08T15:24:02.522 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package linux-modules-5.4.0-164-generic. 2023-10-08T15:24:02.681 INFO:teuthology.orchestra.run.smithi050.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-10-08T15:24:02.687 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../0-linux-modules-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-08T15:24:02.822 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking linux-modules-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:24:03.139 INFO:teuthology.orchestra.run.smithi153.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-10-08T15:24:03.144 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../0-linux-modules-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-08T15:24:03.242 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-modules-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:24:03.249 INFO:teuthology.orchestra.run.smithi098.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-10-08T15:24:03.254 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../0-linux-modules-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-08T15:24:03.331 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking linux-modules-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:24:03.670 INFO:teuthology.orchestra.run.smithi003.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-10-08T15:24:03.675 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../0-linux-modules-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-08T15:24:03.805 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking linux-modules-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:24:04.233 INFO:teuthology.orchestra.run.smithi089.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-10-08T15:24:04.238 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../0-linux-modules-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-08T15:24:04.353 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking linux-modules-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:24:04.873 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package linux-image-5.4.0-164-generic. 2023-10-08T15:24:04.893 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../1-linux-image-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-08T15:24:04.994 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:24:05.167 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package linux-image-5.4.0-164-generic. 2023-10-08T15:24:05.181 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../1-linux-image-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-08T15:24:05.251 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package linux-image-5.4.0-164-generic. 2023-10-08T15:24:05.264 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../1-linux-image-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-08T15:24:05.292 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:24:05.361 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:24:05.905 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package linux-image-5.4.0-164-generic. 2023-10-08T15:24:05.920 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../1-linux-image-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-08T15:24:06.012 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:24:06.068 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-164-generic. 2023-10-08T15:24:06.083 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-08T15:24:06.126 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking linux-modules-extra-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:24:06.345 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package linux-image-5.4.0-164-generic. 2023-10-08T15:24:06.359 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../1-linux-image-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-08T15:24:06.403 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-164-generic. 2023-10-08T15:24:06.418 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-08T15:24:06.455 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:24:06.470 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-164-generic. 2023-10-08T15:24:06.478 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-modules-extra-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:24:06.484 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-08T15:24:06.529 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking linux-modules-extra-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:24:07.141 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-164-generic. 2023-10-08T15:24:07.155 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-08T15:24:07.191 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking linux-modules-extra-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:24:07.582 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-164-generic. 2023-10-08T15:24:07.597 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-08T15:24:07.648 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking linux-modules-extra-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:24:11.140 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../3-linux-generic_5.4.0.164.161_amd64.deb ... 2023-10-08T15:24:11.211 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../3-linux-generic_5.4.0.164.161_amd64.deb ... 2023-10-08T15:24:11.274 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../3-linux-generic_5.4.0.164.161_amd64.deb ... 2023-10-08T15:24:11.284 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking linux-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-08T15:24:11.334 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-08T15:24:11.401 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking linux-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-08T15:24:11.653 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.164.161_amd64.deb ... 2023-10-08T15:24:11.686 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.164.161_amd64.deb ... 2023-10-08T15:24:11.763 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.164.161_amd64.deb ... 2023-10-08T15:24:11.779 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking linux-image-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-08T15:24:11.812 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-image-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-08T15:24:11.888 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking linux-image-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-08T15:24:12.126 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package linux-headers-5.4.0-164. 2023-10-08T15:24:12.141 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../5-linux-headers-5.4.0-164_5.4.0-164.181_all.deb ... 2023-10-08T15:24:12.165 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package linux-headers-5.4.0-164. 2023-10-08T15:24:12.180 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../5-linux-headers-5.4.0-164_5.4.0-164.181_all.deb ... 2023-10-08T15:24:12.184 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking linux-headers-5.4.0-164 (5.4.0-164.181) ... 2023-10-08T15:24:12.233 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package linux-headers-5.4.0-164. 2023-10-08T15:24:12.248 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../5-linux-headers-5.4.0-164_5.4.0-164.181_all.deb ... 2023-10-08T15:24:12.257 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-headers-5.4.0-164 (5.4.0-164.181) ... 2023-10-08T15:24:12.291 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking linux-headers-5.4.0-164 (5.4.0-164.181) ... 2023-10-08T15:24:12.480 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../3-linux-generic_5.4.0.164.161_amd64.deb ... 2023-10-08T15:24:12.603 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../3-linux-generic_5.4.0.164.161_amd64.deb ... 2023-10-08T15:24:12.605 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking linux-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-08T15:24:12.754 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking linux-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-08T15:24:12.956 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.164.161_amd64.deb ... 2023-10-08T15:24:13.087 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.164.161_amd64.deb ... 2023-10-08T15:24:13.117 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking linux-image-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-08T15:24:13.208 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking linux-image-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-08T15:24:13.478 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package linux-headers-5.4.0-164. 2023-10-08T15:24:13.493 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../5-linux-headers-5.4.0-164_5.4.0-164.181_all.deb ... 2023-10-08T15:24:13.536 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking linux-headers-5.4.0-164 (5.4.0-164.181) ... 2023-10-08T15:24:13.927 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package linux-headers-5.4.0-164. 2023-10-08T15:24:13.944 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../5-linux-headers-5.4.0-164_5.4.0-164.181_all.deb ... 2023-10-08T15:24:14.010 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking linux-headers-5.4.0-164 (5.4.0-164.181) ... 2023-10-08T15:24:17.648 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package linux-headers-5.4.0-164-generic. 2023-10-08T15:24:17.671 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../6-linux-headers-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-08T15:24:17.714 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking linux-headers-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:24:17.745 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package linux-headers-5.4.0-164-generic. 2023-10-08T15:24:17.769 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../6-linux-headers-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-08T15:24:17.812 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-headers-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:24:18.074 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package linux-headers-5.4.0-164-generic. 2023-10-08T15:24:18.099 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../6-linux-headers-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-08T15:24:18.140 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking linux-headers-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:24:19.256 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package linux-headers-5.4.0-164-generic. 2023-10-08T15:24:19.278 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../6-linux-headers-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-08T15:24:19.331 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking linux-headers-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:24:19.647 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package linux-headers-5.4.0-164-generic. 2023-10-08T15:24:19.709 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../6-linux-headers-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-08T15:24:19.713 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking linux-headers-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:24:20.380 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.164.161_amd64.deb ... 2023-10-08T15:24:20.516 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking linux-headers-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-08T15:24:20.546 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.164.161_amd64.deb ... 2023-10-08T15:24:20.668 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-headers-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-08T15:24:20.842 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up linux-headers-5.4.0-164 (5.4.0-164.181) ... 2023-10-08T15:24:20.979 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up linux-headers-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:24:21.025 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-headers-5.4.0-164 (5.4.0-164.181) ... 2023-10-08T15:24:21.066 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.164.161_amd64.deb ... 2023-10-08T15:24:21.105 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up linux-modules-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:24:21.148 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-headers-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:24:21.187 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking linux-headers-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-08T15:24:21.299 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-modules-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:24:21.550 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up linux-headers-5.4.0-164 (5.4.0-164.181) ... 2023-10-08T15:24:21.702 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up linux-headers-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:24:21.828 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up linux-modules-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:24:22.273 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.164.161_amd64.deb ... 2023-10-08T15:24:22.316 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:24:22.376 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking linux-headers-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-08T15:24:22.455 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.164.161_amd64.deb ... 2023-10-08T15:24:22.525 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:24:22.566 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking linux-headers-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-08T15:24:22.880 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up linux-headers-5.4.0-164 (5.4.0-164.181) ... 2023-10-08T15:24:22.882 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up linux-headers-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:24:22.908 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up linux-headers-5.4.0-164 (5.4.0-164.181) ... 2023-10-08T15:24:22.998 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up linux-modules-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:24:23.046 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up linux-headers-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:24:23.139 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:24:23.172 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up linux-modules-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:24:23.666 INFO:teuthology.orchestra.run.smithi153.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-164-generic 2023-10-08T15:24:23.666 INFO:teuthology.orchestra.run.smithi153.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-164-generic 2023-10-08T15:24:23.810 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-headers-generic (5.4.0.164.161) ... 2023-10-08T15:24:23.846 INFO:teuthology.orchestra.run.smithi098.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-164-generic 2023-10-08T15:24:23.847 INFO:teuthology.orchestra.run.smithi098.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-164-generic 2023-10-08T15:24:23.970 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-modules-extra-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:24:24.135 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up linux-headers-generic (5.4.0.164.161) ... 2023-10-08T15:24:24.252 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:24:24.269 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up linux-modules-extra-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:24:24.339 INFO:teuthology.orchestra.run.smithi050.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-164-generic 2023-10-08T15:24:24.340 INFO:teuthology.orchestra.run.smithi050.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-164-generic 2023-10-08T15:24:24.483 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up linux-headers-generic (5.4.0.164.161) ... 2023-10-08T15:24:24.643 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up linux-modules-extra-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:24:25.163 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-image-generic (5.4.0.164.161) ... 2023-10-08T15:24:25.658 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:24:25.659 INFO:teuthology.orchestra.run.smithi003.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-164-generic 2023-10-08T15:24:25.659 INFO:teuthology.orchestra.run.smithi003.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-164-generic 2023-10-08T15:24:25.659 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up linux-image-generic (5.4.0.164.161) ... 2023-10-08T15:24:25.659 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up linux-generic (5.4.0.164.161) ... 2023-10-08T15:24:25.659 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-generic (5.4.0.164.161) ... 2023-10-08T15:24:25.659 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:24:25.659 INFO:teuthology.orchestra.run.smithi153.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-10-08T15:24:25.660 INFO:teuthology.orchestra.run.smithi153.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-164-generic 2023-10-08T15:24:25.715 INFO:teuthology.orchestra.run.smithi098.stdout:Processing triggers for linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:24:25.792 INFO:teuthology.orchestra.run.smithi098.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-10-08T15:24:25.792 INFO:teuthology.orchestra.run.smithi098.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-164-generic 2023-10-08T15:24:26.203 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up linux-image-generic (5.4.0.164.161) ... 2023-10-08T15:24:26.329 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up linux-generic (5.4.0.164.161) ... 2023-10-08T15:24:26.429 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up linux-headers-generic (5.4.0.164.161) ... 2023-10-08T15:24:26.434 INFO:teuthology.orchestra.run.smithi089.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-164-generic 2023-10-08T15:24:26.434 INFO:teuthology.orchestra.run.smithi089.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-164-generic 2023-10-08T15:24:26.456 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:24:26.554 INFO:teuthology.orchestra.run.smithi050.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-10-08T15:24:26.554 INFO:teuthology.orchestra.run.smithi050.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-164-generic 2023-10-08T15:24:26.568 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up linux-headers-generic (5.4.0.164.161) ... 2023-10-08T15:24:26.581 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up linux-modules-extra-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:24:26.719 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up linux-modules-extra-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:24:27.874 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up linux-image-generic (5.4.0.164.161) ... 2023-10-08T15:24:27.879 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up linux-image-generic (5.4.0.164.161) ... 2023-10-08T15:24:28.000 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up linux-generic (5.4.0.164.161) ... 2023-10-08T15:24:28.022 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up linux-generic (5.4.0.164.161) ... 2023-10-08T15:24:28.151 INFO:teuthology.orchestra.run.smithi003.stdout:Processing triggers for linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:24:28.182 INFO:teuthology.orchestra.run.smithi089.stdout:Processing triggers for linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:24:28.226 INFO:teuthology.orchestra.run.smithi003.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-10-08T15:24:28.226 INFO:teuthology.orchestra.run.smithi003.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-164-generic 2023-10-08T15:24:28.255 INFO:teuthology.orchestra.run.smithi089.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-10-08T15:24:28.255 INFO:teuthology.orchestra.run.smithi089.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-164-generic 2023-10-08T15:24:47.329 INFO:teuthology.orchestra.run.smithi153.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-10-08T15:24:47.330 INFO:teuthology.orchestra.run.smithi153.stdout:Sourcing file `/etc/default/grub' 2023-10-08T15:24:47.343 INFO:teuthology.orchestra.run.smithi153.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-08T15:24:47.352 INFO:teuthology.orchestra.run.smithi153.stdout:Generating grub configuration file ... 2023-10-08T15:24:47.696 INFO:teuthology.orchestra.run.smithi153.stdout:Found linux image: /boot/vmlinuz-5.4.0-164-generic 2023-10-08T15:24:47.717 INFO:teuthology.orchestra.run.smithi153.stdout:Found initrd image: /boot/initrd.img-5.4.0-164-generic 2023-10-08T15:24:47.774 INFO:teuthology.orchestra.run.smithi098.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-10-08T15:24:47.774 INFO:teuthology.orchestra.run.smithi098.stdout:Sourcing file `/etc/default/grub' 2023-10-08T15:24:47.797 INFO:teuthology.orchestra.run.smithi098.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-08T15:24:47.832 INFO:teuthology.orchestra.run.smithi098.stdout:Generating grub configuration file ... 2023-10-08T15:24:48.125 INFO:teuthology.orchestra.run.smithi153.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-08T15:24:48.137 INFO:teuthology.orchestra.run.smithi153.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-08T15:24:48.180 INFO:teuthology.orchestra.run.smithi098.stdout:Found linux image: /boot/vmlinuz-5.4.0-164-generic 2023-10-08T15:24:48.202 INFO:teuthology.orchestra.run.smithi098.stdout:Found initrd image: /boot/initrd.img-5.4.0-164-generic 2023-10-08T15:24:48.569 INFO:teuthology.orchestra.run.smithi098.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-08T15:24:48.580 INFO:teuthology.orchestra.run.smithi098.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-08T15:24:49.725 INFO:teuthology.orchestra.run.smithi050.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-10-08T15:24:49.725 INFO:teuthology.orchestra.run.smithi050.stdout:Sourcing file `/etc/default/grub' 2023-10-08T15:24:49.743 INFO:teuthology.orchestra.run.smithi050.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-08T15:24:49.798 INFO:teuthology.orchestra.run.smithi050.stdout:Generating grub configuration file ... 2023-10-08T15:24:50.071 INFO:teuthology.orchestra.run.smithi089.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-10-08T15:24:50.071 INFO:teuthology.orchestra.run.smithi089.stdout:Sourcing file `/etc/default/grub' 2023-10-08T15:24:50.078 INFO:teuthology.orchestra.run.smithi089.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-08T15:24:50.093 INFO:teuthology.orchestra.run.smithi089.stdout:Generating grub configuration file ... 2023-10-08T15:24:50.150 INFO:teuthology.orchestra.run.smithi050.stdout:Found linux image: /boot/vmlinuz-5.4.0-164-generic 2023-10-08T15:24:50.169 INFO:teuthology.orchestra.run.smithi050.stdout:Found initrd image: /boot/initrd.img-5.4.0-164-generic 2023-10-08T15:24:50.397 INFO:teuthology.orchestra.run.smithi153.stdout:done 2023-10-08T15:24:50.448 INFO:teuthology.orchestra.run.smithi089.stdout:Found linux image: /boot/vmlinuz-5.4.0-164-generic 2023-10-08T15:24:50.482 INFO:teuthology.orchestra.run.smithi089.stdout:Found initrd image: /boot/initrd.img-5.4.0-164-generic 2023-10-08T15:24:50.618 INFO:teuthology.orchestra.run.smithi050.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-08T15:24:50.630 INFO:teuthology.orchestra.run.smithi050.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-08T15:24:50.725 INFO:teuthology.orchestra.run.smithi003.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-10-08T15:24:50.725 INFO:teuthology.orchestra.run.smithi003.stdout:Sourcing file `/etc/default/grub' 2023-10-08T15:24:50.738 INFO:teuthology.orchestra.run.smithi003.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-08T15:24:50.749 INFO:teuthology.orchestra.run.smithi003.stdout:Generating grub configuration file ... 2023-10-08T15:24:50.799 DEBUG:teuthology.orchestra.run.smithi153:> dpkg -s linux-image-generic 2023-10-08T15:24:50.839 INFO:teuthology.orchestra.run.smithi153.stdout:Package: linux-image-generic 2023-10-08T15:24:50.839 INFO:teuthology.orchestra.run.smithi153.stdout:Status: install ok installed 2023-10-08T15:24:50.839 INFO:teuthology.orchestra.run.smithi153.stdout:Priority: optional 2023-10-08T15:24:50.839 INFO:teuthology.orchestra.run.smithi153.stdout:Section: kernel 2023-10-08T15:24:50.840 INFO:teuthology.orchestra.run.smithi153.stdout:Installed-Size: 20 2023-10-08T15:24:50.840 INFO:teuthology.orchestra.run.smithi153.stdout:Maintainer: Ubuntu Kernel Team 2023-10-08T15:24:50.840 INFO:teuthology.orchestra.run.smithi153.stdout:Architecture: amd64 2023-10-08T15:24:50.840 INFO:teuthology.orchestra.run.smithi153.stdout:Source: linux-meta 2023-10-08T15:24:50.840 INFO:teuthology.orchestra.run.smithi153.stdout:Version: 5.4.0.164.161 2023-10-08T15:24:50.840 INFO:teuthology.orchestra.run.smithi153.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-10-08T15:24:50.840 INFO:teuthology.orchestra.run.smithi153.stdout:Depends: linux-image-5.4.0-164-generic, linux-modules-extra-5.4.0-164-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-08T15:24:50.840 INFO:teuthology.orchestra.run.smithi153.stdout:Recommends: thermald 2023-10-08T15:24:50.840 INFO:teuthology.orchestra.run.smithi153.stdout:Description: Generic Linux kernel image 2023-10-08T15:24:50.840 INFO:teuthology.orchestra.run.smithi153.stdout: This package will always depend on the latest generic kernel image 2023-10-08T15:24:50.840 INFO:teuthology.orchestra.run.smithi153.stdout: available. 2023-10-08T15:24:50.841 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-164-generic 2023-10-08T15:24:50.841 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-08T15:24:50.841 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-08T15:24:50.841 INFO:teuthology.task.kernel:Installing distro kernel on client.2... 2023-10-08T15:24:50.841 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi153.front.sepia.ceph.com, path=None, version=distro) 2023-10-08T15:24:50.841 DEBUG:teuthology.orchestra.run.smithi153:> sudo apt-get clean 2023-10-08T15:24:50.902 INFO:teuthology.orchestra.run.smithi089.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-08T15:24:50.913 INFO:teuthology.orchestra.run.smithi089.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-08T15:24:50.918 DEBUG:teuthology.orchestra.run.smithi153:> sudo apt-get update 2023-10-08T15:24:51.017 INFO:teuthology.orchestra.run.smithi098.stdout:done 2023-10-08T15:24:51.050 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-10-08T15:24:51.050 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-08T15:24:51.063 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-10-08T15:24:51.083 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-10-08T15:24:51.128 INFO:teuthology.orchestra.run.smithi003.stdout:Found linux image: /boot/vmlinuz-5.4.0-164-generic 2023-10-08T15:24:51.153 INFO:teuthology.orchestra.run.smithi003.stdout:Found initrd image: /boot/initrd.img-5.4.0-164-generic 2023-10-08T15:24:51.427 DEBUG:teuthology.orchestra.run.smithi098:> dpkg -s linux-image-generic 2023-10-08T15:24:51.479 INFO:teuthology.orchestra.run.smithi098.stdout:Package: linux-image-generic 2023-10-08T15:24:51.480 INFO:teuthology.orchestra.run.smithi098.stdout:Status: install ok installed 2023-10-08T15:24:51.480 INFO:teuthology.orchestra.run.smithi098.stdout:Priority: optional 2023-10-08T15:24:51.480 INFO:teuthology.orchestra.run.smithi098.stdout:Section: kernel 2023-10-08T15:24:51.480 INFO:teuthology.orchestra.run.smithi098.stdout:Installed-Size: 20 2023-10-08T15:24:51.480 INFO:teuthology.orchestra.run.smithi098.stdout:Maintainer: Ubuntu Kernel Team 2023-10-08T15:24:51.480 INFO:teuthology.orchestra.run.smithi098.stdout:Architecture: amd64 2023-10-08T15:24:51.480 INFO:teuthology.orchestra.run.smithi098.stdout:Source: linux-meta 2023-10-08T15:24:51.480 INFO:teuthology.orchestra.run.smithi098.stdout:Version: 5.4.0.164.161 2023-10-08T15:24:51.480 INFO:teuthology.orchestra.run.smithi098.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-10-08T15:24:51.480 INFO:teuthology.orchestra.run.smithi098.stdout:Depends: linux-image-5.4.0-164-generic, linux-modules-extra-5.4.0-164-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-08T15:24:51.481 INFO:teuthology.orchestra.run.smithi098.stdout:Recommends: thermald 2023-10-08T15:24:51.481 INFO:teuthology.orchestra.run.smithi098.stdout:Description: Generic Linux kernel image 2023-10-08T15:24:51.481 INFO:teuthology.orchestra.run.smithi098.stdout: This package will always depend on the latest generic kernel image 2023-10-08T15:24:51.481 INFO:teuthology.orchestra.run.smithi098.stdout: available. 2023-10-08T15:24:51.482 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-164-generic 2023-10-08T15:24:51.482 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-08T15:24:51.482 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-08T15:24:51.482 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2023-10-08T15:24:51.482 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi098.front.sepia.ceph.com, path=None, version=distro) 2023-10-08T15:24:51.482 DEBUG:teuthology.orchestra.run.smithi098:> sudo apt-get clean 2023-10-08T15:24:51.534 INFO:teuthology.orchestra.run.smithi003.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-08T15:24:51.545 INFO:teuthology.orchestra.run.smithi003.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-08T15:24:51.576 DEBUG:teuthology.orchestra.run.smithi098:> sudo apt-get update 2023-10-08T15:24:51.713 INFO:teuthology.orchestra.run.smithi098.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-10-08T15:24:51.713 INFO:teuthology.orchestra.run.smithi098.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-08T15:24:51.722 INFO:teuthology.orchestra.run.smithi098.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-10-08T15:24:51.742 INFO:teuthology.orchestra.run.smithi098.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-10-08T15:24:52.788 INFO:teuthology.orchestra.run.smithi050.stdout:done 2023-10-08T15:24:52.810 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2023-10-08T15:24:52.834 DEBUG:teuthology.orchestra.run.smithi153:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-08T15:24:52.902 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2023-10-08T15:24:53.082 INFO:teuthology.orchestra.run.smithi153.stdout:Building dependency tree... 2023-10-08T15:24:53.083 INFO:teuthology.orchestra.run.smithi153.stdout:Reading state information... 2023-10-08T15:24:53.259 DEBUG:teuthology.orchestra.run.smithi050:> dpkg -s linux-image-generic 2023-10-08T15:24:53.293 INFO:teuthology.orchestra.run.smithi153.stdout:linux-image-generic is already the newest version (5.4.0.164.161). 2023-10-08T15:24:53.293 INFO:teuthology.orchestra.run.smithi153.stdout:0 upgraded, 0 newly installed, 0 to remove and 271 not upgraded. 2023-10-08T15:24:53.295 DEBUG:teuthology.orchestra.run.smithi153:> dpkg -s linux-image-generic 2023-10-08T15:24:53.299 INFO:teuthology.orchestra.run.smithi050.stdout:Package: linux-image-generic 2023-10-08T15:24:53.299 INFO:teuthology.orchestra.run.smithi050.stdout:Status: install ok installed 2023-10-08T15:24:53.299 INFO:teuthology.orchestra.run.smithi050.stdout:Priority: optional 2023-10-08T15:24:53.299 INFO:teuthology.orchestra.run.smithi050.stdout:Section: kernel 2023-10-08T15:24:53.300 INFO:teuthology.orchestra.run.smithi050.stdout:Installed-Size: 20 2023-10-08T15:24:53.300 INFO:teuthology.orchestra.run.smithi050.stdout:Maintainer: Ubuntu Kernel Team 2023-10-08T15:24:53.300 INFO:teuthology.orchestra.run.smithi050.stdout:Architecture: amd64 2023-10-08T15:24:53.300 INFO:teuthology.orchestra.run.smithi050.stdout:Source: linux-meta 2023-10-08T15:24:53.300 INFO:teuthology.orchestra.run.smithi050.stdout:Version: 5.4.0.164.161 2023-10-08T15:24:53.300 INFO:teuthology.orchestra.run.smithi050.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-10-08T15:24:53.300 INFO:teuthology.orchestra.run.smithi050.stdout:Depends: linux-image-5.4.0-164-generic, linux-modules-extra-5.4.0-164-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-08T15:24:53.300 INFO:teuthology.orchestra.run.smithi050.stdout:Recommends: thermald 2023-10-08T15:24:53.300 INFO:teuthology.orchestra.run.smithi050.stdout:Description: Generic Linux kernel image 2023-10-08T15:24:53.300 INFO:teuthology.orchestra.run.smithi050.stdout: This package will always depend on the latest generic kernel image 2023-10-08T15:24:53.300 INFO:teuthology.orchestra.run.smithi050.stdout: available. 2023-10-08T15:24:53.301 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-164-generic 2023-10-08T15:24:53.301 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-08T15:24:53.302 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-08T15:24:53.302 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-10-08T15:24:53.302 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi050.front.sepia.ceph.com, path=None, version=distro) 2023-10-08T15:24:53.302 DEBUG:teuthology.orchestra.run.smithi050:> sudo apt-get clean 2023-10-08T15:24:53.312 INFO:teuthology.orchestra.run.smithi153.stdout:Package: linux-image-generic 2023-10-08T15:24:53.312 INFO:teuthology.orchestra.run.smithi153.stdout:Status: install ok installed 2023-10-08T15:24:53.312 INFO:teuthology.orchestra.run.smithi153.stdout:Priority: optional 2023-10-08T15:24:53.312 INFO:teuthology.orchestra.run.smithi153.stdout:Section: kernel 2023-10-08T15:24:53.312 INFO:teuthology.orchestra.run.smithi153.stdout:Installed-Size: 20 2023-10-08T15:24:53.313 INFO:teuthology.orchestra.run.smithi153.stdout:Maintainer: Ubuntu Kernel Team 2023-10-08T15:24:53.313 INFO:teuthology.orchestra.run.smithi153.stdout:Architecture: amd64 2023-10-08T15:24:53.313 INFO:teuthology.orchestra.run.smithi153.stdout:Source: linux-meta 2023-10-08T15:24:53.313 INFO:teuthology.orchestra.run.smithi153.stdout:Version: 5.4.0.164.161 2023-10-08T15:24:53.313 INFO:teuthology.orchestra.run.smithi153.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-10-08T15:24:53.313 INFO:teuthology.orchestra.run.smithi153.stdout:Depends: linux-image-5.4.0-164-generic, linux-modules-extra-5.4.0-164-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-08T15:24:53.314 INFO:teuthology.orchestra.run.smithi153.stdout:Recommends: thermald 2023-10-08T15:24:53.314 INFO:teuthology.orchestra.run.smithi153.stdout:Description: Generic Linux kernel image 2023-10-08T15:24:53.314 INFO:teuthology.orchestra.run.smithi153.stdout: This package will always depend on the latest generic kernel image 2023-10-08T15:24:53.314 INFO:teuthology.orchestra.run.smithi153.stdout: available. 2023-10-08T15:24:53.315 DEBUG:teuthology.orchestra.run.smithi153:> mktemp 2023-10-08T15:24:53.321 INFO:teuthology.orchestra.run.smithi153.stdout:/tmp/tmp.BRU8NFkGc8 2023-10-08T15:24:53.321 DEBUG:teuthology.orchestra.run.smithi153:> sudo cp /boot/grub/grub.cfg /tmp/tmp.BRU8NFkGc8 2023-10-08T15:24:53.335 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0666 /tmp/tmp.BRU8NFkGc8 2023-10-08T15:24:53.431 DEBUG:teuthology.orchestra.run.smithi050:> sudo apt-get update 2023-10-08T15:24:53.436 DEBUG:teuthology.orchestra.remote:smithi153:/tmp/tmp.BRU8NFkGc8 is 9KB 2023-10-08T15:24:53.450 DEBUG:teuthology.orchestra.run.smithi153:> rm -fr /tmp/tmp.BRU8NFkGc8 2023-10-08T15:24:53.453 INFO:teuthology.orchestra.run.smithi098.stdout:Reading package lists... 2023-10-08T15:24:53.458 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-10-08T15:24:53.472 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-10-08T15:24:53.472 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-10-08T15:24:53.472 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-10-08T15:24:53.479 DEBUG:teuthology.orchestra.run.smithi098:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-08T15:24:53.547 INFO:teuthology.orchestra.run.smithi098.stdout:Reading package lists... 2023-10-08T15:24:53.550 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-164-generic 2023-10-08T15:24:53.551 DEBUG:teuthology.orchestra.run.smithi153:> sudo update-grub 2023-10-08T15:24:53.627 INFO:teuthology.orchestra.run.smithi089.stdout:done 2023-10-08T15:24:53.647 INFO:teuthology.orchestra.run.smithi003.stdout:done 2023-10-08T15:24:53.691 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-08T15:24:53.691 INFO:teuthology.orchestra.run.smithi050.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-10-08T15:24:53.748 INFO:teuthology.orchestra.run.smithi098.stdout:Building dependency tree... 2023-10-08T15:24:53.749 INFO:teuthology.orchestra.run.smithi098.stdout:Reading state information... 2023-10-08T15:24:53.760 INFO:teuthology.orchestra.run.smithi050.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-10-08T15:24:53.971 INFO:teuthology.orchestra.run.smithi098.stdout:linux-image-generic is already the newest version (5.4.0.164.161). 2023-10-08T15:24:53.972 INFO:teuthology.orchestra.run.smithi098.stdout:0 upgraded, 0 newly installed, 0 to remove and 271 not upgraded. 2023-10-08T15:24:53.973 DEBUG:teuthology.orchestra.run.smithi098:> dpkg -s linux-image-generic 2023-10-08T15:24:53.995 INFO:teuthology.orchestra.run.smithi098.stdout:Package: linux-image-generic 2023-10-08T15:24:53.995 INFO:teuthology.orchestra.run.smithi098.stdout:Status: install ok installed 2023-10-08T15:24:53.995 INFO:teuthology.orchestra.run.smithi098.stdout:Priority: optional 2023-10-08T15:24:53.996 INFO:teuthology.orchestra.run.smithi098.stdout:Section: kernel 2023-10-08T15:24:53.996 INFO:teuthology.orchestra.run.smithi098.stdout:Installed-Size: 20 2023-10-08T15:24:53.996 INFO:teuthology.orchestra.run.smithi098.stdout:Maintainer: Ubuntu Kernel Team 2023-10-08T15:24:53.996 INFO:teuthology.orchestra.run.smithi098.stdout:Architecture: amd64 2023-10-08T15:24:53.996 INFO:teuthology.orchestra.run.smithi098.stdout:Source: linux-meta 2023-10-08T15:24:53.996 INFO:teuthology.orchestra.run.smithi098.stdout:Version: 5.4.0.164.161 2023-10-08T15:24:53.996 INFO:teuthology.orchestra.run.smithi098.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-10-08T15:24:53.996 INFO:teuthology.orchestra.run.smithi098.stdout:Depends: linux-image-5.4.0-164-generic, linux-modules-extra-5.4.0-164-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-08T15:24:53.996 INFO:teuthology.orchestra.run.smithi098.stdout:Recommends: thermald 2023-10-08T15:24:53.996 INFO:teuthology.orchestra.run.smithi098.stdout:Description: Generic Linux kernel image 2023-10-08T15:24:53.996 INFO:teuthology.orchestra.run.smithi098.stdout: This package will always depend on the latest generic kernel image 2023-10-08T15:24:53.997 INFO:teuthology.orchestra.run.smithi098.stdout: available. 2023-10-08T15:24:53.997 DEBUG:teuthology.orchestra.run.smithi098:> mktemp 2023-10-08T15:24:54.041 INFO:teuthology.orchestra.run.smithi098.stdout:/tmp/tmp.LaNgjcdc9Y 2023-10-08T15:24:54.042 DEBUG:teuthology.orchestra.run.smithi098:> sudo cp /boot/grub/grub.cfg /tmp/tmp.LaNgjcdc9Y 2023-10-08T15:24:54.047 DEBUG:teuthology.orchestra.run.smithi089:> dpkg -s linux-image-generic 2023-10-08T15:24:54.054 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 0666 /tmp/tmp.LaNgjcdc9Y 2023-10-08T15:24:54.089 INFO:teuthology.orchestra.run.smithi089.stdout:Package: linux-image-generic 2023-10-08T15:24:54.089 INFO:teuthology.orchestra.run.smithi089.stdout:Status: install ok installed 2023-10-08T15:24:54.089 INFO:teuthology.orchestra.run.smithi089.stdout:Priority: optional 2023-10-08T15:24:54.089 INFO:teuthology.orchestra.run.smithi089.stdout:Section: kernel 2023-10-08T15:24:54.089 INFO:teuthology.orchestra.run.smithi089.stdout:Installed-Size: 20 2023-10-08T15:24:54.089 INFO:teuthology.orchestra.run.smithi089.stdout:Maintainer: Ubuntu Kernel Team 2023-10-08T15:24:54.089 INFO:teuthology.orchestra.run.smithi089.stdout:Architecture: amd64 2023-10-08T15:24:54.089 INFO:teuthology.orchestra.run.smithi089.stdout:Source: linux-meta 2023-10-08T15:24:54.089 INFO:teuthology.orchestra.run.smithi089.stdout:Version: 5.4.0.164.161 2023-10-08T15:24:54.090 INFO:teuthology.orchestra.run.smithi089.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-10-08T15:24:54.090 INFO:teuthology.orchestra.run.smithi089.stdout:Depends: linux-image-5.4.0-164-generic, linux-modules-extra-5.4.0-164-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-08T15:24:54.090 INFO:teuthology.orchestra.run.smithi089.stdout:Recommends: thermald 2023-10-08T15:24:54.090 INFO:teuthology.orchestra.run.smithi089.stdout:Description: Generic Linux kernel image 2023-10-08T15:24:54.090 INFO:teuthology.orchestra.run.smithi089.stdout: This package will always depend on the latest generic kernel image 2023-10-08T15:24:54.090 INFO:teuthology.orchestra.run.smithi089.stdout: available. 2023-10-08T15:24:54.091 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-164-generic 2023-10-08T15:24:54.091 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-08T15:24:54.091 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-08T15:24:54.091 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2023-10-08T15:24:54.091 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi089.front.sepia.ceph.com, path=None, version=distro) 2023-10-08T15:24:54.091 DEBUG:teuthology.orchestra.run.smithi089:> sudo apt-get clean 2023-10-08T15:24:54.104 INFO:teuthology.orchestra.run.smithi050.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-10-08T15:24:54.105 DEBUG:teuthology.orchestra.run.smithi003:> dpkg -s linux-image-generic 2023-10-08T15:24:54.139 DEBUG:teuthology.orchestra.remote:smithi098:/tmp/tmp.LaNgjcdc9Y is 9KB 2023-10-08T15:24:54.151 INFO:teuthology.orchestra.run.smithi003.stdout:Package: linux-image-generic 2023-10-08T15:24:54.151 INFO:teuthology.orchestra.run.smithi003.stdout:Status: install ok installed 2023-10-08T15:24:54.151 INFO:teuthology.orchestra.run.smithi003.stdout:Priority: optional 2023-10-08T15:24:54.151 INFO:teuthology.orchestra.run.smithi003.stdout:Section: kernel 2023-10-08T15:24:54.151 INFO:teuthology.orchestra.run.smithi003.stdout:Installed-Size: 20 2023-10-08T15:24:54.152 INFO:teuthology.orchestra.run.smithi003.stdout:Maintainer: Ubuntu Kernel Team 2023-10-08T15:24:54.152 INFO:teuthology.orchestra.run.smithi003.stdout:Architecture: amd64 2023-10-08T15:24:54.152 INFO:teuthology.orchestra.run.smithi003.stdout:Source: linux-meta 2023-10-08T15:24:54.152 INFO:teuthology.orchestra.run.smithi003.stdout:Version: 5.4.0.164.161 2023-10-08T15:24:54.152 INFO:teuthology.orchestra.run.smithi003.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-10-08T15:24:54.152 INFO:teuthology.orchestra.run.smithi003.stdout:Depends: linux-image-5.4.0-164-generic, linux-modules-extra-5.4.0-164-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-08T15:24:54.152 INFO:teuthology.orchestra.run.smithi003.stdout:Recommends: thermald 2023-10-08T15:24:54.153 INFO:teuthology.orchestra.run.smithi003.stdout:Description: Generic Linux kernel image 2023-10-08T15:24:54.153 INFO:teuthology.orchestra.run.smithi003.stdout: This package will always depend on the latest generic kernel image 2023-10-08T15:24:54.153 INFO:teuthology.orchestra.run.smithi003.stdout: available. 2023-10-08T15:24:54.153 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-164-generic 2023-10-08T15:24:54.153 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-08T15:24:54.153 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-08T15:24:54.153 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-10-08T15:24:54.153 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi003.front.sepia.ceph.com, path=None, version=distro) 2023-10-08T15:24:54.154 DEBUG:teuthology.orchestra.run.smithi003:> sudo apt-get clean 2023-10-08T15:24:54.157 DEBUG:teuthology.orchestra.run.smithi098:> rm -fr /tmp/tmp.LaNgjcdc9Y 2023-10-08T15:24:54.164 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-10-08T15:24:54.173 DEBUG:teuthology.orchestra.run.smithi089:> sudo apt-get update 2023-10-08T15:24:54.222 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-10-08T15:24:54.223 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-10-08T15:24:54.223 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-10-08T15:24:54.226 DEBUG:teuthology.orchestra.run.smithi003:> sudo apt-get update 2023-10-08T15:24:54.263 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-164-generic 2023-10-08T15:24:54.263 DEBUG:teuthology.orchestra.run.smithi098:> sudo update-grub 2023-10-08T15:24:54.306 INFO:teuthology.orchestra.run.smithi089.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-08T15:24:54.315 INFO:teuthology.orchestra.run.smithi089.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-10-08T15:24:54.335 INFO:teuthology.orchestra.run.smithi089.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-10-08T15:24:54.424 INFO:teuthology.orchestra.run.smithi089.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-10-08T15:24:54.485 INFO:teuthology.orchestra.run.smithi003.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-08T15:24:54.485 INFO:teuthology.orchestra.run.smithi003.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-10-08T15:24:54.515 INFO:teuthology.orchestra.run.smithi050.stdout:Fetched 336 kB in 1s (378 kB/s) 2023-10-08T15:24:54.556 INFO:teuthology.orchestra.run.smithi003.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-10-08T15:24:54.867 INFO:teuthology.orchestra.run.smithi153.stderr:Sourcing file `/etc/default/grub' 2023-10-08T15:24:54.875 INFO:teuthology.orchestra.run.smithi153.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-08T15:24:54.887 INFO:teuthology.orchestra.run.smithi153.stderr:Generating grub configuration file ... 2023-10-08T15:24:54.901 INFO:teuthology.orchestra.run.smithi003.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-10-08T15:24:55.002 INFO:teuthology.orchestra.run.smithi089.stdout:Fetched 114 kB in 1s (179 kB/s) 2023-10-08T15:24:55.128 INFO:teuthology.orchestra.run.smithi153.stderr:Found linux image: /boot/vmlinuz-5.4.0-164-generic 2023-10-08T15:24:55.140 INFO:teuthology.orchestra.run.smithi153.stderr:Found initrd image: /boot/initrd.img-5.4.0-164-generic 2023-10-08T15:24:55.310 INFO:teuthology.orchestra.run.smithi003.stdout:Fetched 336 kB in 1s (382 kB/s) 2023-10-08T15:24:55.466 INFO:teuthology.orchestra.run.smithi098.stderr:Sourcing file `/etc/default/grub' 2023-10-08T15:24:55.471 INFO:teuthology.orchestra.run.smithi098.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-08T15:24:55.480 INFO:teuthology.orchestra.run.smithi098.stderr:Generating grub configuration file ... 2023-10-08T15:24:55.498 INFO:teuthology.orchestra.run.smithi153.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-08T15:24:55.510 INFO:teuthology.orchestra.run.smithi153.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-08T15:24:55.612 INFO:teuthology.orchestra.run.smithi050.stdout:Reading package lists... 2023-10-08T15:24:55.639 DEBUG:teuthology.orchestra.run.smithi050:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-08T15:24:55.711 INFO:teuthology.orchestra.run.smithi050.stdout:Reading package lists... 2023-10-08T15:24:55.747 INFO:teuthology.orchestra.run.smithi098.stderr:Found linux image: /boot/vmlinuz-5.4.0-164-generic 2023-10-08T15:24:55.759 INFO:teuthology.orchestra.run.smithi098.stderr:Found initrd image: /boot/initrd.img-5.4.0-164-generic 2023-10-08T15:24:55.903 INFO:teuthology.orchestra.run.smithi050.stdout:Building dependency tree... 2023-10-08T15:24:55.903 INFO:teuthology.orchestra.run.smithi050.stdout:Reading state information... 2023-10-08T15:24:56.048 INFO:teuthology.orchestra.run.smithi089.stdout:Reading package lists... 2023-10-08T15:24:56.074 DEBUG:teuthology.orchestra.run.smithi089:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-08T15:24:56.100 INFO:teuthology.orchestra.run.smithi098.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-08T15:24:56.111 INFO:teuthology.orchestra.run.smithi098.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-08T15:24:56.122 INFO:teuthology.orchestra.run.smithi050.stdout:linux-image-generic is already the newest version (5.4.0.164.161). 2023-10-08T15:24:56.122 INFO:teuthology.orchestra.run.smithi050.stdout:0 upgraded, 0 newly installed, 0 to remove and 271 not upgraded. 2023-10-08T15:24:56.124 DEBUG:teuthology.orchestra.run.smithi050:> dpkg -s linux-image-generic 2023-10-08T15:24:56.143 INFO:teuthology.orchestra.run.smithi089.stdout:Reading package lists... 2023-10-08T15:24:56.147 INFO:teuthology.orchestra.run.smithi050.stdout:Package: linux-image-generic 2023-10-08T15:24:56.147 INFO:teuthology.orchestra.run.smithi050.stdout:Status: install ok installed 2023-10-08T15:24:56.147 INFO:teuthology.orchestra.run.smithi050.stdout:Priority: optional 2023-10-08T15:24:56.147 INFO:teuthology.orchestra.run.smithi050.stdout:Section: kernel 2023-10-08T15:24:56.147 INFO:teuthology.orchestra.run.smithi050.stdout:Installed-Size: 20 2023-10-08T15:24:56.147 INFO:teuthology.orchestra.run.smithi050.stdout:Maintainer: Ubuntu Kernel Team 2023-10-08T15:24:56.147 INFO:teuthology.orchestra.run.smithi050.stdout:Architecture: amd64 2023-10-08T15:24:56.147 INFO:teuthology.orchestra.run.smithi050.stdout:Source: linux-meta 2023-10-08T15:24:56.147 INFO:teuthology.orchestra.run.smithi050.stdout:Version: 5.4.0.164.161 2023-10-08T15:24:56.147 INFO:teuthology.orchestra.run.smithi050.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-10-08T15:24:56.148 INFO:teuthology.orchestra.run.smithi050.stdout:Depends: linux-image-5.4.0-164-generic, linux-modules-extra-5.4.0-164-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-08T15:24:56.148 INFO:teuthology.orchestra.run.smithi050.stdout:Recommends: thermald 2023-10-08T15:24:56.148 INFO:teuthology.orchestra.run.smithi050.stdout:Description: Generic Linux kernel image 2023-10-08T15:24:56.148 INFO:teuthology.orchestra.run.smithi050.stdout: This package will always depend on the latest generic kernel image 2023-10-08T15:24:56.148 INFO:teuthology.orchestra.run.smithi050.stdout: available. 2023-10-08T15:24:56.148 DEBUG:teuthology.orchestra.run.smithi050:> mktemp 2023-10-08T15:24:56.153 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.bgAjYZXTeS 2023-10-08T15:24:56.153 DEBUG:teuthology.orchestra.run.smithi050:> sudo cp /boot/grub/grub.cfg /tmp/tmp.bgAjYZXTeS 2023-10-08T15:24:56.215 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.bgAjYZXTeS 2023-10-08T15:24:56.248 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.bgAjYZXTeS is 9KB 2023-10-08T15:24:56.261 DEBUG:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.bgAjYZXTeS 2023-10-08T15:24:56.267 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-10-08T15:24:56.320 INFO:teuthology.orchestra.run.smithi089.stdout:Building dependency tree... 2023-10-08T15:24:56.321 INFO:teuthology.orchestra.run.smithi089.stdout:Reading state information... 2023-10-08T15:24:56.322 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-08T15:24:56.323 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-10-08T15:24:56.323 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-10-08T15:24:56.357 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-164-generic 2023-10-08T15:24:56.357 DEBUG:teuthology.orchestra.run.smithi050:> sudo update-grub 2023-10-08T15:24:56.405 INFO:teuthology.orchestra.run.smithi003.stdout:Reading package lists... 2023-10-08T15:24:56.432 DEBUG:teuthology.orchestra.run.smithi003:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-08T15:24:56.499 INFO:teuthology.orchestra.run.smithi003.stdout:Reading package lists... 2023-10-08T15:24:56.526 INFO:teuthology.orchestra.run.smithi089.stdout:linux-image-generic is already the newest version (5.4.0.164.161). 2023-10-08T15:24:56.526 INFO:teuthology.orchestra.run.smithi089.stdout:0 upgraded, 0 newly installed, 0 to remove and 271 not upgraded. 2023-10-08T15:24:56.527 DEBUG:teuthology.orchestra.run.smithi089:> dpkg -s linux-image-generic 2023-10-08T15:24:56.546 INFO:teuthology.orchestra.run.smithi089.stdout:Package: linux-image-generic 2023-10-08T15:24:56.546 INFO:teuthology.orchestra.run.smithi089.stdout:Status: install ok installed 2023-10-08T15:24:56.546 INFO:teuthology.orchestra.run.smithi089.stdout:Priority: optional 2023-10-08T15:24:56.546 INFO:teuthology.orchestra.run.smithi089.stdout:Section: kernel 2023-10-08T15:24:56.546 INFO:teuthology.orchestra.run.smithi089.stdout:Installed-Size: 20 2023-10-08T15:24:56.546 INFO:teuthology.orchestra.run.smithi089.stdout:Maintainer: Ubuntu Kernel Team 2023-10-08T15:24:56.547 INFO:teuthology.orchestra.run.smithi089.stdout:Architecture: amd64 2023-10-08T15:24:56.547 INFO:teuthology.orchestra.run.smithi089.stdout:Source: linux-meta 2023-10-08T15:24:56.547 INFO:teuthology.orchestra.run.smithi089.stdout:Version: 5.4.0.164.161 2023-10-08T15:24:56.547 INFO:teuthology.orchestra.run.smithi089.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-10-08T15:24:56.547 INFO:teuthology.orchestra.run.smithi089.stdout:Depends: linux-image-5.4.0-164-generic, linux-modules-extra-5.4.0-164-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-08T15:24:56.547 INFO:teuthology.orchestra.run.smithi089.stdout:Recommends: thermald 2023-10-08T15:24:56.547 INFO:teuthology.orchestra.run.smithi089.stdout:Description: Generic Linux kernel image 2023-10-08T15:24:56.547 INFO:teuthology.orchestra.run.smithi089.stdout: This package will always depend on the latest generic kernel image 2023-10-08T15:24:56.547 INFO:teuthology.orchestra.run.smithi089.stdout: available. 2023-10-08T15:24:56.548 DEBUG:teuthology.orchestra.run.smithi089:> mktemp 2023-10-08T15:24:56.553 INFO:teuthology.orchestra.run.smithi089.stdout:/tmp/tmp.KjxmKuv5sn 2023-10-08T15:24:56.553 DEBUG:teuthology.orchestra.run.smithi089:> sudo cp /boot/grub/grub.cfg /tmp/tmp.KjxmKuv5sn 2023-10-08T15:24:56.555 INFO:teuthology.orchestra.run.smithi153.stderr:done 2023-10-08T15:24:56.557 DEBUG:teuthology.orchestra.run.smithi153:> sudo shutdown -r now 2023-10-08T15:24:56.563 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0666 /tmp/tmp.KjxmKuv5sn 2023-10-08T15:24:56.649 DEBUG:teuthology.orchestra.remote:smithi089:/tmp/tmp.KjxmKuv5sn is 9KB 2023-10-08T15:24:56.663 DEBUG:teuthology.orchestra.run.smithi089:> rm -fr /tmp/tmp.KjxmKuv5sn 2023-10-08T15:24:56.669 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-10-08T15:24:56.705 INFO:teuthology.orchestra.run.smithi003.stdout:Building dependency tree... 2023-10-08T15:24:56.705 INFO:teuthology.orchestra.run.smithi003.stdout:Reading state information... 2023-10-08T15:24:56.722 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-08T15:24:56.723 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-10-08T15:24:56.723 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-10-08T15:24:56.759 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-164-generic 2023-10-08T15:24:56.759 DEBUG:teuthology.orchestra.run.smithi089:> sudo update-grub 2023-10-08T15:24:56.934 INFO:teuthology.orchestra.run.smithi003.stdout:linux-image-generic is already the newest version (5.4.0.164.161). 2023-10-08T15:24:56.934 INFO:teuthology.orchestra.run.smithi003.stdout:0 upgraded, 0 newly installed, 0 to remove and 271 not upgraded. 2023-10-08T15:24:56.936 DEBUG:teuthology.orchestra.run.smithi003:> dpkg -s linux-image-generic 2023-10-08T15:24:56.955 INFO:teuthology.orchestra.run.smithi003.stdout:Package: linux-image-generic 2023-10-08T15:24:56.955 INFO:teuthology.orchestra.run.smithi003.stdout:Status: install ok installed 2023-10-08T15:24:56.955 INFO:teuthology.orchestra.run.smithi003.stdout:Priority: optional 2023-10-08T15:24:56.955 INFO:teuthology.orchestra.run.smithi003.stdout:Section: kernel 2023-10-08T15:24:56.955 INFO:teuthology.orchestra.run.smithi003.stdout:Installed-Size: 20 2023-10-08T15:24:56.955 INFO:teuthology.orchestra.run.smithi003.stdout:Maintainer: Ubuntu Kernel Team 2023-10-08T15:24:56.955 INFO:teuthology.orchestra.run.smithi003.stdout:Architecture: amd64 2023-10-08T15:24:56.955 INFO:teuthology.orchestra.run.smithi003.stdout:Source: linux-meta 2023-10-08T15:24:56.955 INFO:teuthology.orchestra.run.smithi003.stdout:Version: 5.4.0.164.161 2023-10-08T15:24:56.955 INFO:teuthology.orchestra.run.smithi003.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-10-08T15:24:56.956 INFO:teuthology.orchestra.run.smithi003.stdout:Depends: linux-image-5.4.0-164-generic, linux-modules-extra-5.4.0-164-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-08T15:24:56.956 INFO:teuthology.orchestra.run.smithi003.stdout:Recommends: thermald 2023-10-08T15:24:56.956 INFO:teuthology.orchestra.run.smithi003.stdout:Description: Generic Linux kernel image 2023-10-08T15:24:56.956 INFO:teuthology.orchestra.run.smithi003.stdout: This package will always depend on the latest generic kernel image 2023-10-08T15:24:56.956 INFO:teuthology.orchestra.run.smithi003.stdout: available. 2023-10-08T15:24:56.956 DEBUG:teuthology.orchestra.run.smithi003:> mktemp 2023-10-08T15:24:56.962 INFO:teuthology.orchestra.run.smithi003.stdout:/tmp/tmp.oMnao8QmKS 2023-10-08T15:24:56.963 DEBUG:teuthology.orchestra.run.smithi003:> sudo cp /boot/grub/grub.cfg /tmp/tmp.oMnao8QmKS 2023-10-08T15:24:56.975 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 0666 /tmp/tmp.oMnao8QmKS 2023-10-08T15:24:57.060 DEBUG:teuthology.orchestra.remote:smithi003:/tmp/tmp.oMnao8QmKS is 9KB 2023-10-08T15:24:57.073 DEBUG:teuthology.orchestra.run.smithi003:> rm -fr /tmp/tmp.oMnao8QmKS 2023-10-08T15:24:57.079 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-10-08T15:24:57.089 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-10-08T15:24:57.090 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-10-08T15:24:57.090 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-10-08T15:24:57.123 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-164-generic 2023-10-08T15:24:57.123 DEBUG:teuthology.orchestra.run.smithi003:> sudo update-grub 2023-10-08T15:24:57.541 INFO:teuthology.orchestra.run.smithi098.stderr:done 2023-10-08T15:24:57.543 DEBUG:teuthology.orchestra.run.smithi098:> sudo shutdown -r now 2023-10-08T15:24:57.811 INFO:teuthology.orchestra.run.smithi050.stderr:Sourcing file `/etc/default/grub' 2023-10-08T15:24:57.817 INFO:teuthology.orchestra.run.smithi050.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-08T15:24:57.830 INFO:teuthology.orchestra.run.smithi050.stderr:Generating grub configuration file ... 2023-10-08T15:24:58.157 INFO:teuthology.orchestra.run.smithi050.stderr:Found linux image: /boot/vmlinuz-5.4.0-164-generic 2023-10-08T15:24:58.168 INFO:teuthology.orchestra.run.smithi050.stderr:Found initrd image: /boot/initrd.img-5.4.0-164-generic 2023-10-08T15:24:58.169 INFO:teuthology.orchestra.run.smithi089.stderr:Sourcing file `/etc/default/grub' 2023-10-08T15:24:58.180 INFO:teuthology.orchestra.run.smithi089.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-08T15:24:58.191 INFO:teuthology.orchestra.run.smithi089.stderr:Generating grub configuration file ... 2023-10-08T15:24:58.439 INFO:teuthology.orchestra.run.smithi089.stderr:Found linux image: /boot/vmlinuz-5.4.0-164-generic 2023-10-08T15:24:58.451 INFO:teuthology.orchestra.run.smithi089.stderr:Found initrd image: /boot/initrd.img-5.4.0-164-generic 2023-10-08T15:24:58.545 INFO:teuthology.orchestra.run.smithi003.stderr:Sourcing file `/etc/default/grub' 2023-10-08T15:24:58.556 INFO:teuthology.orchestra.run.smithi003.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-08T15:24:58.570 INFO:teuthology.orchestra.run.smithi003.stderr:Generating grub configuration file ... 2023-10-08T15:24:58.610 INFO:teuthology.orchestra.run.smithi050.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-08T15:24:58.622 INFO:teuthology.orchestra.run.smithi050.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-08T15:24:58.814 INFO:teuthology.orchestra.run.smithi003.stderr:Found linux image: /boot/vmlinuz-5.4.0-164-generic 2023-10-08T15:24:58.826 INFO:teuthology.orchestra.run.smithi003.stderr:Found initrd image: /boot/initrd.img-5.4.0-164-generic 2023-10-08T15:24:58.850 INFO:teuthology.orchestra.run.smithi089.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-08T15:24:58.862 INFO:teuthology.orchestra.run.smithi089.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-08T15:24:59.217 INFO:teuthology.orchestra.run.smithi003.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-08T15:24:59.229 INFO:teuthology.orchestra.run.smithi003.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-08T15:24:59.764 INFO:teuthology.orchestra.run.smithi050.stderr:done 2023-10-08T15:24:59.766 DEBUG:teuthology.orchestra.run.smithi050:> sudo shutdown -r now 2023-10-08T15:25:00.236 INFO:teuthology.orchestra.run.smithi003.stderr:done 2023-10-08T15:25:00.238 DEBUG:teuthology.orchestra.run.smithi003:> sudo shutdown -r now 2023-10-08T15:25:00.505 INFO:teuthology.orchestra.run.smithi089.stderr:done 2023-10-08T15:25:00.507 DEBUG:teuthology.orchestra.run.smithi089:> sudo shutdown -r now 2023-10-08T15:25:26.586 INFO:teuthology.task.kernel:Checking client client.2 for new kernel version... 2023-10-08T15:25:26.587 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-10-08T15:25:26.587 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:25:27.546 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-10-08T15:25:27.546 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2023-10-08T15:25:27.547 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:25:29.770 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-10-08T15:25:29.770 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-10-08T15:25:29.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:25:30.242 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-10-08T15:25:30.242 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-10-08T15:25:30.243 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:25:30.510 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-10-08T15:25:30.511 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-10-08T15:25:30.511 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:25:44.954 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-10-08T15:25:45.982 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-10-08T15:25:48.282 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.50 2023-10-08T15:25:48.794 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-10-08T15:25:49.050 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-10-08T15:25:53.958 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-10-08T15:25:53.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:25:54.984 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2023-10-08T15:25:54.985 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:25:57.022 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-10-08T15:25:57.284 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-10-08T15:25:57.285 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:25:57.796 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-10-08T15:25:57.796 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:25:58.046 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-10-08T15:25:58.051 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-10-08T15:25:58.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:26:00.858 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-10-08T15:26:01.114 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-10-08T15:26:09.030 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-10-08T15:26:09.031 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:26:10.048 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2023-10-08T15:26:10.049 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:26:12.863 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-10-08T15:26:12.863 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:26:13.115 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-10-08T15:26:13.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:26:15.930 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-10-08T15:26:27.454 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-10-08T15:26:28.478 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-10-08T15:26:30.934 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-10-08T15:26:30.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:26:31.550 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-10-08T15:26:34.014 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-10-08T15:26:42.462 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-10-08T15:26:42.463 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:26:42.842 DEBUG:teuthology.orchestra.run.smithi153:> true 2023-10-08T15:26:43.479 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2023-10-08T15:26:43.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:26:43.681 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-10-08T15:26:43.681 INFO:teuthology.task.kernel:Checking kernel version of client.2, want "5.4.0-164-generic"... 2023-10-08T15:26:43.682 DEBUG:teuthology.orchestra.run.smithi153:> uname -r 2023-10-08T15:26:43.687 INFO:teuthology.orchestra.run.smithi153.stdout:5.4.0-164-generic 2023-10-08T15:26:43.688 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-164-generic vs 5.4.0-164-generic 2023-10-08T15:26:43.688 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-08T15:26:43.688 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-10-08T15:26:43.693 DEBUG:teuthology.orchestra.run.smithi098:> true 2023-10-08T15:26:44.340 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com' 2023-10-08T15:26:44.341 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.4.0-164-generic"... 2023-10-08T15:26:44.341 DEBUG:teuthology.orchestra.run.smithi098:> uname -r 2023-10-08T15:26:44.347 INFO:teuthology.orchestra.run.smithi098.stdout:5.4.0-164-generic 2023-10-08T15:26:44.347 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-164-generic vs 5.4.0-164-generic 2023-10-08T15:26:44.347 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-08T15:26:44.347 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-10-08T15:26:44.689 INFO:teuthology.task.kernel:Enabling kdb on client.2... 2023-10-08T15:26:44.689 DEBUG:teuthology.orchestra.run.smithi153:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-08T15:26:44.785 INFO:teuthology.orchestra.run.smithi153.stdout:ttyS1 2023-10-08T15:26:44.821 DEBUG:teuthology.parallel:result is None 2023-10-08T15:26:45.347 INFO:teuthology.task.kernel:Enabling kdb on client.1... 2023-10-08T15:26:45.348 DEBUG:teuthology.orchestra.run.smithi098:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-08T15:26:45.435 INFO:teuthology.orchestra.run.smithi098.stdout:ttyS1 2023-10-08T15:26:45.464 DEBUG:teuthology.parallel:result is None 2023-10-08T15:26:46.551 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-10-08T15:26:46.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:26:46.752 DEBUG:teuthology.orchestra.run.smithi089:> true 2023-10-08T15:26:47.316 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-10-08T15:26:47.316 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.4.0-164-generic"... 2023-10-08T15:26:47.317 DEBUG:teuthology.orchestra.run.smithi089:> uname -r 2023-10-08T15:26:47.322 INFO:teuthology.orchestra.run.smithi089.stdout:5.4.0-164-generic 2023-10-08T15:26:47.323 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-164-generic vs 5.4.0-164-generic 2023-10-08T15:26:47.323 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-08T15:26:47.323 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-10-08T15:26:48.324 INFO:teuthology.task.kernel:Enabling kdb on client.0... 2023-10-08T15:26:48.366 DEBUG:teuthology.orchestra.run.smithi089:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-08T15:26:48.450 INFO:teuthology.orchestra.run.smithi089.stdout:ttyS1 2023-10-08T15:26:48.623 DEBUG:teuthology.parallel:result is None 2023-10-08T15:26:52.015 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-10-08T15:26:52.015 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:26:57.287 DEBUG:teuthology.orchestra.remote:timed out 2023-10-08T15:27:09.288 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-10-08T15:27:09.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:27:09.493 DEBUG:teuthology.orchestra.run.smithi050:> true 2023-10-08T15:27:10.049 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-10-08T15:27:10.049 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.4.0-164-generic"... 2023-10-08T15:27:10.049 DEBUG:teuthology.orchestra.run.smithi050:> uname -r 2023-10-08T15:27:10.056 INFO:teuthology.orchestra.run.smithi050.stdout:5.4.0-164-generic 2023-10-08T15:27:10.056 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-164-generic vs 5.4.0-164-generic 2023-10-08T15:27:10.056 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-08T15:27:10.056 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-10-08T15:27:10.458 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-10-08T15:27:11.057 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-10-08T15:27:11.139 DEBUG:teuthology.orchestra.run.smithi050:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-08T15:27:11.230 INFO:teuthology.orchestra.run.smithi050.stdout:ttyS1 2023-10-08T15:27:11.262 DEBUG:teuthology.parallel:result is None 2023-10-08T15:27:31.459 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-10-08T15:27:31.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:27:31.660 DEBUG:teuthology.orchestra.run.smithi003:> true 2023-10-08T15:27:32.223 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-10-08T15:27:32.223 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-164-generic"... 2023-10-08T15:27:32.223 DEBUG:teuthology.orchestra.run.smithi003:> uname -r 2023-10-08T15:27:32.230 INFO:teuthology.orchestra.run.smithi003.stdout:5.4.0-164-generic 2023-10-08T15:27:32.230 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-164-generic vs 5.4.0-164-generic 2023-10-08T15:27:32.230 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-08T15:27:32.230 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-10-08T15:27:33.231 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-10-08T15:27:33.231 DEBUG:teuthology.orchestra.run.smithi003:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-08T15:27:33.339 INFO:teuthology.orchestra.run.smithi003.stdout:ttyS1 2023-10-08T15:27:33.364 DEBUG:teuthology.parallel:result is None 2023-10-08T15:27:33.365 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-08T15:27:33.372 INFO:teuthology.task.internal:Creating test directory... 2023-10-08T15:27:33.372 DEBUG:teuthology.orchestra.run.smithi003:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-08T15:27:33.374 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-08T15:27:33.376 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-08T15:27:33.379 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-08T15:27:33.382 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-08T15:27:33.389 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-08T15:27:33.411 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-08T15:27:33.462 INFO:teuthology.task.internal:Creating archive directory... 2023-10-08T15:27:33.462 DEBUG:teuthology.orchestra.run.smithi003:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-08T15:27:33.464 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-08T15:27:33.466 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-08T15:27:33.468 DEBUG:teuthology.orchestra.run.smithi098:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-08T15:27:33.470 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-08T15:27:33.504 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-08T15:27:33.510 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-08T15:27:33.510 DEBUG:teuthology.orchestra.run.smithi003:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-08T15:27:33.512 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-08T15:27:33.528 INFO:teuthology.orchestra.run.smithi003.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T15:27:33.529 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-08T15:27:33.531 DEBUG:teuthology.orchestra.run.smithi098:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-08T15:27:33.533 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-08T15:27:33.539 INFO:teuthology.orchestra.run.smithi003.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T15:27:33.547 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T15:27:33.551 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T15:27:33.554 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T15:27:33.559 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T15:27:33.562 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T15:27:33.564 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T15:27:33.565 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T15:27:33.575 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T15:27:33.577 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-08T15:27:33.587 INFO:teuthology.task.internal:Configuring sudo... 2023-10-08T15:27:33.588 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-08T15:27:33.590 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-08T15:27:33.592 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-08T15:27:33.594 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-08T15:27:33.596 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-08T15:27:33.611 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-08T15:27:33.621 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-08T15:27:33.621 DEBUG:teuthology.orchestra.run.smithi003:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-08T15:27:33.623 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-08T15:27:33.649 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-08T15:27:33.654 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-08T15:27:33.657 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-08T15:27:33.664 DEBUG:teuthology.orchestra.run.smithi003:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T15:27:33.676 DEBUG:teuthology.orchestra.run.smithi003:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T15:27:33.683 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-10-08T15:27:33.683 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-08T15:27:33.705 DEBUG:teuthology.orchestra.run.smithi050:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T15:27:33.712 DEBUG:teuthology.orchestra.run.smithi050:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T15:27:33.762 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-08T15:27:33.762 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-08T15:27:33.785 DEBUG:teuthology.orchestra.run.smithi089:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T15:27:33.793 DEBUG:teuthology.orchestra.run.smithi089:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T15:27:33.843 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-08T15:27:33.843 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-08T15:27:33.875 DEBUG:teuthology.orchestra.run.smithi098:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T15:27:33.882 DEBUG:teuthology.orchestra.run.smithi098:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T15:27:33.889 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-10-08T15:27:33.889 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-08T15:27:33.958 DEBUG:teuthology.orchestra.run.smithi153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T15:27:33.965 DEBUG:teuthology.orchestra.run.smithi153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T15:27:33.972 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-10-08T15:27:33.972 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-08T15:27:34.040 DEBUG:teuthology.orchestra.run.smithi003:> sudo service rsyslog restart 2023-10-08T15:27:34.042 DEBUG:teuthology.orchestra.run.smithi050:> sudo service rsyslog restart 2023-10-08T15:27:34.044 DEBUG:teuthology.orchestra.run.smithi089:> sudo service rsyslog restart 2023-10-08T15:27:34.046 DEBUG:teuthology.orchestra.run.smithi098:> sudo service rsyslog restart 2023-10-08T15:27:34.048 DEBUG:teuthology.orchestra.run.smithi153:> sudo service rsyslog restart 2023-10-08T15:27:34.108 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-08T15:27:34.116 INFO:teuthology.task.internal:Starting timer... 2023-10-08T15:27:34.116 INFO:teuthology.run_tasks:Running task pcp... 2023-10-08T15:27:34.165 INFO:teuthology.run_tasks:Running task selinux... 2023-10-08T15:27:34.214 DEBUG:teuthology.task.selinux:Excluding smithi003: OS 'ubuntu' does not support SELinux 2023-10-08T15:27:34.214 DEBUG:teuthology.task.selinux:Excluding smithi050: OS 'ubuntu' does not support SELinux 2023-10-08T15:27:34.214 DEBUG:teuthology.task.selinux:Excluding smithi089: OS 'ubuntu' does not support SELinux 2023-10-08T15:27:34.215 DEBUG:teuthology.task.selinux:Excluding smithi098: OS 'ubuntu' does not support SELinux 2023-10-08T15:27:34.215 DEBUG:teuthology.task.selinux:Excluding smithi153: OS 'ubuntu' does not support SELinux 2023-10-08T15:27:34.215 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-08T15:27:34.215 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-10-08T15:27:34.215 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-08T15:27:34.215 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-08T15:27:34.264 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-10-08T15:27:34.270 INFO:teuthology.repo_utils:Fetching main from origin 2023-10-08T15:27:34.405 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-08T15:27:34.420 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-08T15:27:34.421 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi003.front.sepia.ceph.com,smithi050.front.sepia.ceph.com,smithi089.front.sepia.ceph.com,smithi098.front.sepia.ceph.com,smithi153.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-08T15:33:23.625 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi003.front.sepia.ceph.com'), Remote(name='ubuntu@smithi050.front.sepia.ceph.com'), Remote(name='ubuntu@smithi089.front.sepia.ceph.com'), Remote(name='ubuntu@smithi098.front.sepia.ceph.com'), Remote(name='ubuntu@smithi153.front.sepia.ceph.com')] 2023-10-08T15:33:23.626 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-10-08T15:33:23.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:33:23.677 DEBUG:teuthology.orchestra.run.smithi003:> true 2023-10-08T15:33:23.801 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-10-08T15:33:23.801 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-10-08T15:33:23.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:33:23.850 DEBUG:teuthology.orchestra.run.smithi050:> true 2023-10-08T15:33:23.979 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-10-08T15:33:23.980 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-10-08T15:33:23.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:33:24.026 DEBUG:teuthology.orchestra.run.smithi089:> true 2023-10-08T15:33:24.143 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-10-08T15:33:24.144 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2023-10-08T15:33:24.144 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:33:24.192 DEBUG:teuthology.orchestra.run.smithi098:> true 2023-10-08T15:33:24.308 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com' 2023-10-08T15:33:24.309 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-10-08T15:33:24.309 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:33:24.358 DEBUG:teuthology.orchestra.run.smithi153:> true 2023-10-08T15:33:24.483 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-10-08T15:33:24.485 INFO:teuthology.run_tasks:Running task clock... 2023-10-08T15:33:24.495 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-08T15:33:24.495 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-08T15:33:24.496 DEBUG:teuthology.orchestra.run.smithi003:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T15:33:24.498 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-08T15:33:24.498 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T15:33:24.500 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-08T15:33:24.500 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T15:33:24.503 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-08T15:33:24.503 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T15:33:24.505 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-08T15:33:24.505 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T15:33:24.529 INFO:teuthology.orchestra.run.smithi003.stdout: 8 Oct 15:33:24 ntpd[22724]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-10-08T15:33:24.529 INFO:teuthology.orchestra.run.smithi003.stdout: 8 Oct 15:33:24 ntpd[22724]: Command line: ntpd -gq 2023-10-08T15:33:24.530 INFO:teuthology.orchestra.run.smithi003.stdout: 8 Oct 15:33:24 ntpd[22724]: proto: precision = 0.160 usec (-22) 2023-10-08T15:33:24.530 INFO:teuthology.orchestra.run.smithi003.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-08T15:33:24.531 INFO:teuthology.orchestra.run.smithi003.stdout: 8 Oct 15:33:24 ntpd[22724]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-08T15:33:24.531 INFO:teuthology.orchestra.run.smithi003.stderr:restrict ::: KOD does nothing without LIMITED. 2023-10-08T15:33:24.532 INFO:teuthology.orchestra.run.smithi003.stdout: 8 Oct 15:33:24 ntpd[22724]: restrict ::: KOD does nothing without LIMITED. 2023-10-08T15:33:24.532 INFO:teuthology.orchestra.run.smithi003.stdout: 8 Oct 15:33:24 ntpd[22724]: Listen and drop on 0 v6wildcard [::]:123 2023-10-08T15:33:24.532 INFO:teuthology.orchestra.run.smithi003.stdout: 8 Oct 15:33:24 ntpd[22724]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-10-08T15:33:24.532 INFO:teuthology.orchestra.run.smithi003.stdout: 8 Oct 15:33:24 ntpd[22724]: Listen normally on 2 lo 127.0.0.1:123 2023-10-08T15:33:24.532 INFO:teuthology.orchestra.run.smithi003.stdout: 8 Oct 15:33:24 ntpd[22724]: Listen normally on 3 ens1f0 172.21.15.3:123 2023-10-08T15:33:24.532 INFO:teuthology.orchestra.run.smithi003.stdout: 8 Oct 15:33:24 ntpd[22724]: Listen normally on 4 lo [::1]:123 2023-10-08T15:33:24.533 INFO:teuthology.orchestra.run.smithi003.stdout: 8 Oct 15:33:24 ntpd[22724]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:15dc%4]:123 2023-10-08T15:33:24.533 INFO:teuthology.orchestra.run.smithi003.stdout: 8 Oct 15:33:24 ntpd[22724]: Listening on routing socket on fd #22 for interface updates 2023-10-08T15:33:24.534 INFO:teuthology.orchestra.run.smithi050.stdout: 8 Oct 15:33:24 ntpd[22834]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-10-08T15:33:24.534 INFO:teuthology.orchestra.run.smithi050.stdout: 8 Oct 15:33:24 ntpd[22834]: Command line: ntpd -gq 2023-10-08T15:33:24.535 INFO:teuthology.orchestra.run.smithi089.stdout: 8 Oct 15:33:24 ntpd[22920]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-10-08T15:33:24.535 INFO:teuthology.orchestra.run.smithi089.stdout: 8 Oct 15:33:24 ntpd[22920]: Command line: ntpd -gq 2023-10-08T15:33:24.535 INFO:teuthology.orchestra.run.smithi050.stdout: 8 Oct 15:33:24 ntpd[22834]: proto: precision = 0.103 usec (-23) 2023-10-08T15:33:24.536 INFO:teuthology.orchestra.run.smithi089.stdout: 8 Oct 15:33:24 ntpd[22920]: proto: precision = 0.082 usec (-23) 2023-10-08T15:33:24.537 INFO:teuthology.orchestra.run.smithi050.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-08T15:33:24.537 INFO:teuthology.orchestra.run.smithi089.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-08T15:33:24.537 INFO:teuthology.orchestra.run.smithi050.stdout: 8 Oct 15:33:24 ntpd[22834]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-08T15:33:24.538 INFO:teuthology.orchestra.run.smithi089.stdout: 8 Oct 15:33:24 ntpd[22920]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-08T15:33:24.538 INFO:teuthology.orchestra.run.smithi050.stderr:restrict ::: KOD does nothing without LIMITED. 2023-10-08T15:33:24.538 INFO:teuthology.orchestra.run.smithi089.stderr:restrict ::: KOD does nothing without LIMITED. 2023-10-08T15:33:24.540 INFO:teuthology.orchestra.run.smithi050.stdout: 8 Oct 15:33:24 ntpd[22834]: restrict ::: KOD does nothing without LIMITED. 2023-10-08T15:33:24.540 INFO:teuthology.orchestra.run.smithi050.stdout: 8 Oct 15:33:24 ntpd[22834]: Listen and drop on 0 v6wildcard [::]:123 2023-10-08T15:33:24.540 INFO:teuthology.orchestra.run.smithi050.stdout: 8 Oct 15:33:24 ntpd[22834]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-10-08T15:33:24.540 INFO:teuthology.orchestra.run.smithi050.stdout: 8 Oct 15:33:24 ntpd[22834]: Listen normally on 2 lo 127.0.0.1:123 2023-10-08T15:33:24.540 INFO:teuthology.orchestra.run.smithi050.stdout: 8 Oct 15:33:24 ntpd[22834]: Listen normally on 3 ens1f0 172.21.15.50:123 2023-10-08T15:33:24.540 INFO:teuthology.orchestra.run.smithi050.stdout: 8 Oct 15:33:24 ntpd[22834]: Listen normally on 4 lo [::1]:123 2023-10-08T15:33:24.540 INFO:teuthology.orchestra.run.smithi050.stdout: 8 Oct 15:33:24 ntpd[22834]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1584%4]:123 2023-10-08T15:33:24.540 INFO:teuthology.orchestra.run.smithi050.stdout: 8 Oct 15:33:24 ntpd[22834]: Listening on routing socket on fd #22 for interface updates 2023-10-08T15:33:24.540 INFO:teuthology.orchestra.run.smithi089.stdout: 8 Oct 15:33:24 ntpd[22920]: restrict ::: KOD does nothing without LIMITED. 2023-10-08T15:33:24.541 INFO:teuthology.orchestra.run.smithi089.stdout: 8 Oct 15:33:24 ntpd[22920]: Listen and drop on 0 v6wildcard [::]:123 2023-10-08T15:33:24.541 INFO:teuthology.orchestra.run.smithi089.stdout: 8 Oct 15:33:24 ntpd[22920]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-10-08T15:33:24.541 INFO:teuthology.orchestra.run.smithi089.stdout: 8 Oct 15:33:24 ntpd[22920]: Listen normally on 2 lo 127.0.0.1:123 2023-10-08T15:33:24.541 INFO:teuthology.orchestra.run.smithi089.stdout: 8 Oct 15:33:24 ntpd[22920]: Listen normally on 3 enp3s0f1 172.21.15.89:123 2023-10-08T15:33:24.541 INFO:teuthology.orchestra.run.smithi089.stdout: 8 Oct 15:33:24 ntpd[22920]: Listen normally on 4 lo [::1]:123 2023-10-08T15:33:24.541 INFO:teuthology.orchestra.run.smithi089.stdout: 8 Oct 15:33:24 ntpd[22920]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d501%5]:123 2023-10-08T15:33:24.541 INFO:teuthology.orchestra.run.smithi089.stdout: 8 Oct 15:33:24 ntpd[22920]: Listening on routing socket on fd #22 for interface updates 2023-10-08T15:33:24.542 INFO:teuthology.orchestra.run.smithi098.stdout: 8 Oct 15:33:24 ntpd[22880]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-10-08T15:33:24.542 INFO:teuthology.orchestra.run.smithi098.stdout: 8 Oct 15:33:24 ntpd[22880]: Command line: ntpd -gq 2023-10-08T15:33:24.542 INFO:teuthology.orchestra.run.smithi098.stdout: 8 Oct 15:33:24 ntpd[22880]: proto: precision = 0.106 usec (-23) 2023-10-08T15:33:24.542 INFO:teuthology.orchestra.run.smithi098.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-08T15:33:24.543 INFO:teuthology.orchestra.run.smithi098.stdout: 8 Oct 15:33:24 ntpd[22880]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-08T15:33:24.543 INFO:teuthology.orchestra.run.smithi098.stderr:restrict ::: KOD does nothing without LIMITED. 2023-10-08T15:33:24.544 INFO:teuthology.orchestra.run.smithi098.stdout: 8 Oct 15:33:24 ntpd[22880]: restrict ::: KOD does nothing without LIMITED. 2023-10-08T15:33:24.544 INFO:teuthology.orchestra.run.smithi098.stdout: 8 Oct 15:33:24 ntpd[22880]: Listen and drop on 0 v6wildcard [::]:123 2023-10-08T15:33:24.544 INFO:teuthology.orchestra.run.smithi098.stdout: 8 Oct 15:33:24 ntpd[22880]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-10-08T15:33:24.544 INFO:teuthology.orchestra.run.smithi098.stdout: 8 Oct 15:33:24 ntpd[22880]: Listen normally on 2 lo 127.0.0.1:123 2023-10-08T15:33:24.544 INFO:teuthology.orchestra.run.smithi098.stdout: 8 Oct 15:33:24 ntpd[22880]: Listen normally on 3 enp3s0f1 172.21.15.98:123 2023-10-08T15:33:24.544 INFO:teuthology.orchestra.run.smithi098.stdout: 8 Oct 15:33:24 ntpd[22880]: Listen normally on 4 lo [::1]:123 2023-10-08T15:33:24.544 INFO:teuthology.orchestra.run.smithi098.stdout: 8 Oct 15:33:24 ntpd[22880]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d26b%5]:123 2023-10-08T15:33:24.545 INFO:teuthology.orchestra.run.smithi098.stdout: 8 Oct 15:33:24 ntpd[22880]: Listening on routing socket on fd #22 for interface updates 2023-10-08T15:33:24.560 INFO:teuthology.orchestra.run.smithi153.stdout: 8 Oct 15:33:24 ntpd[22872]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-10-08T15:33:24.561 INFO:teuthology.orchestra.run.smithi153.stdout: 8 Oct 15:33:24 ntpd[22872]: Command line: ntpd -gq 2023-10-08T15:33:24.561 INFO:teuthology.orchestra.run.smithi153.stdout: 8 Oct 15:33:24 ntpd[22872]: proto: precision = 0.147 usec (-23) 2023-10-08T15:33:24.561 INFO:teuthology.orchestra.run.smithi153.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-08T15:33:24.562 INFO:teuthology.orchestra.run.smithi153.stdout: 8 Oct 15:33:24 ntpd[22872]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-08T15:33:24.562 INFO:teuthology.orchestra.run.smithi153.stderr:restrict ::: KOD does nothing without LIMITED. 2023-10-08T15:33:24.563 INFO:teuthology.orchestra.run.smithi153.stdout: 8 Oct 15:33:24 ntpd[22872]: restrict ::: KOD does nothing without LIMITED. 2023-10-08T15:33:24.564 INFO:teuthology.orchestra.run.smithi153.stdout: 8 Oct 15:33:24 ntpd[22872]: Listen and drop on 0 v6wildcard [::]:123 2023-10-08T15:33:24.564 INFO:teuthology.orchestra.run.smithi153.stdout: 8 Oct 15:33:24 ntpd[22872]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-10-08T15:33:24.564 INFO:teuthology.orchestra.run.smithi153.stdout: 8 Oct 15:33:24 ntpd[22872]: Listen normally on 2 lo 127.0.0.1:123 2023-10-08T15:33:24.564 INFO:teuthology.orchestra.run.smithi153.stdout: 8 Oct 15:33:24 ntpd[22872]: Listen normally on 3 enp3s0f1 172.21.15.153:123 2023-10-08T15:33:24.564 INFO:teuthology.orchestra.run.smithi153.stdout: 8 Oct 15:33:24 ntpd[22872]: Listen normally on 4 lo [::1]:123 2023-10-08T15:33:24.564 INFO:teuthology.orchestra.run.smithi153.stdout: 8 Oct 15:33:24 ntpd[22872]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6deb%5]:123 2023-10-08T15:33:24.564 INFO:teuthology.orchestra.run.smithi153.stdout: 8 Oct 15:33:24 ntpd[22872]: Listening on routing socket on fd #22 for interface updates 2023-10-08T15:33:25.536 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:25 ntpd[22834]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:25.537 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:25 ntpd[22834]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:25.537 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:25 ntpd[22834]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:25.537 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:25 ntpd[22834]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:25.537 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:25 ntpd[22834]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:25.537 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:25 ntpd[22834]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:25.537 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:25 ntpd[22834]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T15:33:25.537 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:25 ntpd[22834]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T15:33:25.537 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:25 ntpd[22834]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:25.537 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:25 ntpd[22834]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:25.538 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:25 ntpd[22834]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T15:33:25.538 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:25 ntpd[22834]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T15:33:25.539 INFO:teuthology.orchestra.run.smithi098.stderr: 8 Oct 15:33:25 ntpd[22880]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:25.539 INFO:teuthology.orchestra.run.smithi098.stderr: 8 Oct 15:33:25 ntpd[22880]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:25.539 INFO:teuthology.orchestra.run.smithi098.stderr: 8 Oct 15:33:25 ntpd[22880]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:25.539 INFO:teuthology.orchestra.run.smithi098.stderr: 8 Oct 15:33:25 ntpd[22880]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:25.540 INFO:teuthology.orchestra.run.smithi098.stderr: 8 Oct 15:33:25 ntpd[22880]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T15:33:25.540 INFO:teuthology.orchestra.run.smithi098.stderr: 8 Oct 15:33:25 ntpd[22880]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T15:33:25.541 INFO:teuthology.orchestra.run.smithi089.stderr: 8 Oct 15:33:25 ntpd[22920]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:25.541 INFO:teuthology.orchestra.run.smithi089.stderr: 8 Oct 15:33:25 ntpd[22920]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:25.541 INFO:teuthology.orchestra.run.smithi089.stderr: 8 Oct 15:33:25 ntpd[22920]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:25.541 INFO:teuthology.orchestra.run.smithi089.stderr: 8 Oct 15:33:25 ntpd[22920]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:25.541 INFO:teuthology.orchestra.run.smithi089.stderr: 8 Oct 15:33:25 ntpd[22920]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:25.541 INFO:teuthology.orchestra.run.smithi089.stderr: 8 Oct 15:33:25 ntpd[22920]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:25.541 INFO:teuthology.orchestra.run.smithi089.stderr: 8 Oct 15:33:25 ntpd[22920]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:25.541 INFO:teuthology.orchestra.run.smithi089.stderr: 8 Oct 15:33:25 ntpd[22920]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:25.541 INFO:teuthology.orchestra.run.smithi089.stderr: 8 Oct 15:33:25 ntpd[22920]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T15:33:25.542 INFO:teuthology.orchestra.run.smithi089.stderr: 8 Oct 15:33:25 ntpd[22920]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T15:33:25.542 INFO:teuthology.orchestra.run.smithi089.stderr: 8 Oct 15:33:25 ntpd[22920]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:25.542 INFO:teuthology.orchestra.run.smithi089.stderr: 8 Oct 15:33:25 ntpd[22920]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:25.542 INFO:teuthology.orchestra.run.smithi089.stderr: 8 Oct 15:33:25 ntpd[22920]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T15:33:25.542 INFO:teuthology.orchestra.run.smithi089.stderr: 8 Oct 15:33:25 ntpd[22920]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T15:33:25.560 INFO:teuthology.orchestra.run.smithi153.stderr: 8 Oct 15:33:25 ntpd[22872]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:25.560 INFO:teuthology.orchestra.run.smithi153.stderr: 8 Oct 15:33:25 ntpd[22872]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:25.560 INFO:teuthology.orchestra.run.smithi153.stderr: 8 Oct 15:33:25 ntpd[22872]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:25.560 INFO:teuthology.orchestra.run.smithi153.stderr: 8 Oct 15:33:25 ntpd[22872]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:25.561 INFO:teuthology.orchestra.run.smithi153.stderr: 8 Oct 15:33:25 ntpd[22872]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T15:33:25.561 INFO:teuthology.orchestra.run.smithi153.stderr: 8 Oct 15:33:25 ntpd[22872]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T15:33:26.532 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:26 ntpd[22724]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:26.532 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:26 ntpd[22724]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:26.532 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:26 ntpd[22724]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:26.532 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:26 ntpd[22724]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:26.532 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:26 ntpd[22724]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:26.532 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:26 ntpd[22724]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:26.532 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:26 ntpd[22724]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:26.532 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:26 ntpd[22724]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:26.532 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:26 ntpd[22724]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:26.533 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:26 ntpd[22724]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:26.533 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:26 ntpd[22724]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T15:33:26.533 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:26 ntpd[22724]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T15:33:26.533 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:26 ntpd[22724]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:26.533 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:26 ntpd[22724]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:26.533 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:26 ntpd[22724]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T15:33:26.533 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:26 ntpd[22724]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T15:33:26.533 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:26 ntpd[22724]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:26.534 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:26 ntpd[22724]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:26.534 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:26 ntpd[22724]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T15:33:26.534 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:26 ntpd[22724]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T15:33:26.560 INFO:teuthology.orchestra.run.smithi153.stderr: 8 Oct 15:33:26 ntpd[22872]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:26.560 INFO:teuthology.orchestra.run.smithi153.stderr: 8 Oct 15:33:26 ntpd[22872]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:27.536 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:27 ntpd[22834]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:27.537 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:27 ntpd[22834]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:27.537 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:27 ntpd[22834]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:27.537 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:27 ntpd[22834]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:27.537 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:27 ntpd[22834]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:27.537 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:27 ntpd[22834]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:27.537 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:27 ntpd[22834]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:27.537 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:27 ntpd[22834]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:27.537 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:27 ntpd[22834]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T15:33:27.537 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:27 ntpd[22834]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T15:33:27.538 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:27 ntpd[22834]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:27.538 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:27 ntpd[22834]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:27.538 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:27 ntpd[22834]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T15:33:27.538 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:27 ntpd[22834]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T15:33:27.538 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:27 ntpd[22834]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:27.538 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:27 ntpd[22834]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:27.538 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:27 ntpd[22834]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T15:33:27.538 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:27 ntpd[22834]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T15:33:27.540 INFO:teuthology.orchestra.run.smithi098.stderr: 8 Oct 15:33:27 ntpd[22880]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:27.540 INFO:teuthology.orchestra.run.smithi098.stderr: 8 Oct 15:33:27 ntpd[22880]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:27.540 INFO:teuthology.orchestra.run.smithi098.stderr: 8 Oct 15:33:27 ntpd[22880]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:27.540 INFO:teuthology.orchestra.run.smithi098.stderr: 8 Oct 15:33:27 ntpd[22880]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:27.540 INFO:teuthology.orchestra.run.smithi098.stderr: 8 Oct 15:33:27 ntpd[22880]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T15:33:27.540 INFO:teuthology.orchestra.run.smithi098.stderr: 8 Oct 15:33:27 ntpd[22880]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T15:33:27.541 INFO:teuthology.orchestra.run.smithi089.stderr: 8 Oct 15:33:27 ntpd[22920]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:27.541 INFO:teuthology.orchestra.run.smithi089.stderr: 8 Oct 15:33:27 ntpd[22920]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:27.542 INFO:teuthology.orchestra.run.smithi089.stderr: 8 Oct 15:33:27 ntpd[22920]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:27.542 INFO:teuthology.orchestra.run.smithi089.stderr: 8 Oct 15:33:27 ntpd[22920]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:27.542 INFO:teuthology.orchestra.run.smithi089.stderr: 8 Oct 15:33:27 ntpd[22920]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:27.542 INFO:teuthology.orchestra.run.smithi089.stderr: 8 Oct 15:33:27 ntpd[22920]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:27.542 INFO:teuthology.orchestra.run.smithi089.stderr: 8 Oct 15:33:27 ntpd[22920]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T15:33:27.542 INFO:teuthology.orchestra.run.smithi089.stderr: 8 Oct 15:33:27 ntpd[22920]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T15:33:27.542 INFO:teuthology.orchestra.run.smithi089.stderr: 8 Oct 15:33:27 ntpd[22920]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:27.542 INFO:teuthology.orchestra.run.smithi089.stderr: 8 Oct 15:33:27 ntpd[22920]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:27.542 INFO:teuthology.orchestra.run.smithi089.stderr: 8 Oct 15:33:27 ntpd[22920]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T15:33:27.542 INFO:teuthology.orchestra.run.smithi089.stderr: 8 Oct 15:33:27 ntpd[22920]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T15:33:27.560 INFO:teuthology.orchestra.run.smithi153.stderr: 8 Oct 15:33:27 ntpd[22872]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:27.560 INFO:teuthology.orchestra.run.smithi153.stderr: 8 Oct 15:33:27 ntpd[22872]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:27.561 INFO:teuthology.orchestra.run.smithi153.stderr: 8 Oct 15:33:27 ntpd[22872]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:27.561 INFO:teuthology.orchestra.run.smithi153.stderr: 8 Oct 15:33:27 ntpd[22872]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:27.561 INFO:teuthology.orchestra.run.smithi153.stderr: 8 Oct 15:33:27 ntpd[22872]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T15:33:27.561 INFO:teuthology.orchestra.run.smithi153.stderr: 8 Oct 15:33:27 ntpd[22872]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T15:33:28.531 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:28 ntpd[22724]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:28.531 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:28 ntpd[22724]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:28.531 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:28 ntpd[22724]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:28.531 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:28 ntpd[22724]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:28.532 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:28 ntpd[22724]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:28.532 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:28 ntpd[22724]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:28.532 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:28 ntpd[22724]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:28.532 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:28 ntpd[22724]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:28.532 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:28 ntpd[22724]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T15:33:28.532 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:28 ntpd[22724]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T15:33:28.532 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:28 ntpd[22724]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:28.532 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:28 ntpd[22724]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:28.532 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:28 ntpd[22724]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T15:33:28.532 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:28 ntpd[22724]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T15:33:28.532 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:28 ntpd[22724]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:28.533 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:28 ntpd[22724]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:28.533 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:28 ntpd[22724]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T15:33:28.533 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:28 ntpd[22724]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T15:33:28.534 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:28 ntpd[22834]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:28.535 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:28 ntpd[22834]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:28.536 INFO:teuthology.orchestra.run.smithi089.stderr: 8 Oct 15:33:28 ntpd[22920]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:28.536 INFO:teuthology.orchestra.run.smithi089.stderr: 8 Oct 15:33:28 ntpd[22920]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:28.536 INFO:teuthology.orchestra.run.smithi089.stderr: 8 Oct 15:33:28 ntpd[22920]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:28.536 INFO:teuthology.orchestra.run.smithi089.stderr: 8 Oct 15:33:28 ntpd[22920]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:28.536 INFO:teuthology.orchestra.run.smithi089.stderr: 8 Oct 15:33:28 ntpd[22920]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T15:33:28.536 INFO:teuthology.orchestra.run.smithi089.stderr: 8 Oct 15:33:28 ntpd[22920]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T15:33:28.561 INFO:teuthology.orchestra.run.smithi153.stderr: 8 Oct 15:33:28 ntpd[22872]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:28.561 INFO:teuthology.orchestra.run.smithi153.stderr: 8 Oct 15:33:28 ntpd[22872]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:28.561 INFO:teuthology.orchestra.run.smithi153.stderr: 8 Oct 15:33:28 ntpd[22872]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:28.561 INFO:teuthology.orchestra.run.smithi153.stderr: 8 Oct 15:33:28 ntpd[22872]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:28.561 INFO:teuthology.orchestra.run.smithi153.stderr: 8 Oct 15:33:28 ntpd[22872]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:28.561 INFO:teuthology.orchestra.run.smithi153.stderr: 8 Oct 15:33:28 ntpd[22872]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:28.561 INFO:teuthology.orchestra.run.smithi153.stderr: 8 Oct 15:33:28 ntpd[22872]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T15:33:28.561 INFO:teuthology.orchestra.run.smithi153.stderr: 8 Oct 15:33:28 ntpd[22872]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T15:33:28.561 INFO:teuthology.orchestra.run.smithi153.stderr: 8 Oct 15:33:28 ntpd[22872]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:28.561 INFO:teuthology.orchestra.run.smithi153.stderr: 8 Oct 15:33:28 ntpd[22872]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:28.561 INFO:teuthology.orchestra.run.smithi153.stderr: 8 Oct 15:33:28 ntpd[22872]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T15:33:28.562 INFO:teuthology.orchestra.run.smithi153.stderr: 8 Oct 15:33:28 ntpd[22872]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T15:33:29.536 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:29 ntpd[22834]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:29.537 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:29 ntpd[22834]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:29.537 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:29 ntpd[22834]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:29.537 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:29 ntpd[22834]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:29.537 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:29 ntpd[22834]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:29.537 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:29 ntpd[22834]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:29.537 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:29 ntpd[22834]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:29.537 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:29 ntpd[22834]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:29.537 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:29 ntpd[22834]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T15:33:29.537 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:29 ntpd[22834]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T15:33:29.537 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:29 ntpd[22834]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:29.538 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:29 ntpd[22834]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:29.538 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:29 ntpd[22834]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T15:33:29.538 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:29 ntpd[22834]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T15:33:29.538 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:29 ntpd[22834]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:29.538 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:29 ntpd[22834]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:29.538 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:29 ntpd[22834]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T15:33:29.538 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:29 ntpd[22834]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T15:33:29.541 INFO:teuthology.orchestra.run.smithi089.stderr: 8 Oct 15:33:29 ntpd[22920]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:29.541 INFO:teuthology.orchestra.run.smithi089.stderr: 8 Oct 15:33:29 ntpd[22920]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:29.541 INFO:teuthology.orchestra.run.smithi089.stderr: 8 Oct 15:33:29 ntpd[22920]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:29.541 INFO:teuthology.orchestra.run.smithi089.stderr: 8 Oct 15:33:29 ntpd[22920]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:29.541 INFO:teuthology.orchestra.run.smithi089.stderr: 8 Oct 15:33:29 ntpd[22920]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:29.541 INFO:teuthology.orchestra.run.smithi089.stderr: 8 Oct 15:33:29 ntpd[22920]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:29.541 INFO:teuthology.orchestra.run.smithi089.stderr: 8 Oct 15:33:29 ntpd[22920]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T15:33:29.541 INFO:teuthology.orchestra.run.smithi089.stderr: 8 Oct 15:33:29 ntpd[22920]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T15:33:29.541 INFO:teuthology.orchestra.run.smithi089.stderr: 8 Oct 15:33:29 ntpd[22920]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:29.541 INFO:teuthology.orchestra.run.smithi089.stderr: 8 Oct 15:33:29 ntpd[22920]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:29.542 INFO:teuthology.orchestra.run.smithi089.stderr: 8 Oct 15:33:29 ntpd[22920]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T15:33:29.542 INFO:teuthology.orchestra.run.smithi089.stderr: 8 Oct 15:33:29 ntpd[22920]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T15:33:29.543 INFO:teuthology.orchestra.run.smithi098.stderr: 8 Oct 15:33:29 ntpd[22880]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:29.543 INFO:teuthology.orchestra.run.smithi098.stderr: 8 Oct 15:33:29 ntpd[22880]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:29.543 INFO:teuthology.orchestra.run.smithi098.stderr: 8 Oct 15:33:29 ntpd[22880]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:29.543 INFO:teuthology.orchestra.run.smithi098.stderr: 8 Oct 15:33:29 ntpd[22880]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:29.543 INFO:teuthology.orchestra.run.smithi098.stderr: 8 Oct 15:33:29 ntpd[22880]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:29.543 INFO:teuthology.orchestra.run.smithi098.stderr: 8 Oct 15:33:29 ntpd[22880]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:29.543 INFO:teuthology.orchestra.run.smithi098.stderr: 8 Oct 15:33:29 ntpd[22880]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:29.543 INFO:teuthology.orchestra.run.smithi098.stderr: 8 Oct 15:33:29 ntpd[22880]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:29.543 INFO:teuthology.orchestra.run.smithi098.stderr: 8 Oct 15:33:29 ntpd[22880]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:29.543 INFO:teuthology.orchestra.run.smithi098.stderr: 8 Oct 15:33:29 ntpd[22880]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:29.544 INFO:teuthology.orchestra.run.smithi098.stderr: 8 Oct 15:33:29 ntpd[22880]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T15:33:29.544 INFO:teuthology.orchestra.run.smithi098.stderr: 8 Oct 15:33:29 ntpd[22880]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T15:33:29.544 INFO:teuthology.orchestra.run.smithi098.stderr: 8 Oct 15:33:29 ntpd[22880]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:29.544 INFO:teuthology.orchestra.run.smithi098.stderr: 8 Oct 15:33:29 ntpd[22880]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:29.544 INFO:teuthology.orchestra.run.smithi098.stderr: 8 Oct 15:33:29 ntpd[22880]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T15:33:29.544 INFO:teuthology.orchestra.run.smithi098.stderr: 8 Oct 15:33:29 ntpd[22880]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T15:33:29.544 INFO:teuthology.orchestra.run.smithi098.stderr: 8 Oct 15:33:29 ntpd[22880]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:29.544 INFO:teuthology.orchestra.run.smithi098.stderr: 8 Oct 15:33:29 ntpd[22880]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:29.544 INFO:teuthology.orchestra.run.smithi098.stderr: 8 Oct 15:33:29 ntpd[22880]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T15:33:29.544 INFO:teuthology.orchestra.run.smithi098.stderr: 8 Oct 15:33:29 ntpd[22880]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T15:33:29.560 INFO:teuthology.orchestra.run.smithi153.stderr: 8 Oct 15:33:29 ntpd[22872]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:29.560 INFO:teuthology.orchestra.run.smithi153.stderr: 8 Oct 15:33:29 ntpd[22872]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:29.562 INFO:teuthology.orchestra.run.smithi153.stderr: 8 Oct 15:33:29 ntpd[22872]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:29.562 INFO:teuthology.orchestra.run.smithi153.stderr: 8 Oct 15:33:29 ntpd[22872]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:29.562 INFO:teuthology.orchestra.run.smithi153.stderr: 8 Oct 15:33:29 ntpd[22872]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T15:33:29.562 INFO:teuthology.orchestra.run.smithi153.stderr: 8 Oct 15:33:29 ntpd[22872]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T15:33:30.531 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:30 ntpd[22724]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:30.531 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:30 ntpd[22724]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:30.531 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:30 ntpd[22724]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:30.532 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:30 ntpd[22724]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:30.532 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:30 ntpd[22724]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:30.532 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:30 ntpd[22724]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:30.532 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:30 ntpd[22724]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:30.532 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:30 ntpd[22724]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:30.532 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:30 ntpd[22724]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T15:33:30.532 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:30 ntpd[22724]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T15:33:30.532 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:30 ntpd[22724]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:30.532 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:30 ntpd[22724]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:30.532 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:30 ntpd[22724]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T15:33:30.532 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:30 ntpd[22724]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T15:33:30.533 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:30 ntpd[22724]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:30.533 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:30 ntpd[22724]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:30.533 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:30 ntpd[22724]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T15:33:30.533 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:30 ntpd[22724]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T15:33:30.536 INFO:teuthology.orchestra.run.smithi089.stderr: 8 Oct 15:33:30 ntpd[22920]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:30.536 INFO:teuthology.orchestra.run.smithi089.stderr: 8 Oct 15:33:30 ntpd[22920]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:30.536 INFO:teuthology.orchestra.run.smithi089.stderr: 8 Oct 15:33:30 ntpd[22920]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:30.536 INFO:teuthology.orchestra.run.smithi089.stderr: 8 Oct 15:33:30 ntpd[22920]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:30.536 INFO:teuthology.orchestra.run.smithi089.stderr: 8 Oct 15:33:30 ntpd[22920]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T15:33:30.536 INFO:teuthology.orchestra.run.smithi089.stderr: 8 Oct 15:33:30 ntpd[22920]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T15:33:30.561 INFO:teuthology.orchestra.run.smithi153.stderr: 8 Oct 15:33:30 ntpd[22872]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:30.561 INFO:teuthology.orchestra.run.smithi153.stderr: 8 Oct 15:33:30 ntpd[22872]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:30.561 INFO:teuthology.orchestra.run.smithi153.stderr: 8 Oct 15:33:30 ntpd[22872]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:30.561 INFO:teuthology.orchestra.run.smithi153.stderr: 8 Oct 15:33:30 ntpd[22872]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:30.561 INFO:teuthology.orchestra.run.smithi153.stderr: 8 Oct 15:33:30 ntpd[22872]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:30.562 INFO:teuthology.orchestra.run.smithi153.stderr: 8 Oct 15:33:30 ntpd[22872]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:30.562 INFO:teuthology.orchestra.run.smithi153.stderr: 8 Oct 15:33:30 ntpd[22872]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T15:33:30.562 INFO:teuthology.orchestra.run.smithi153.stderr: 8 Oct 15:33:30 ntpd[22872]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T15:33:30.562 INFO:teuthology.orchestra.run.smithi153.stderr: 8 Oct 15:33:30 ntpd[22872]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:30.562 INFO:teuthology.orchestra.run.smithi153.stderr: 8 Oct 15:33:30 ntpd[22872]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:30.562 INFO:teuthology.orchestra.run.smithi153.stderr: 8 Oct 15:33:30 ntpd[22872]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T15:33:30.562 INFO:teuthology.orchestra.run.smithi153.stderr: 8 Oct 15:33:30 ntpd[22872]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T15:33:31.535 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:31 ntpd[22834]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:31.536 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:31 ntpd[22834]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:31.536 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:31 ntpd[22834]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:31.536 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:31 ntpd[22834]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:31.536 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:31 ntpd[22834]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:31.536 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:31 ntpd[22834]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:31.536 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:31 ntpd[22834]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:31.536 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:31 ntpd[22834]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:31.536 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:31 ntpd[22834]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T15:33:31.536 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:31 ntpd[22834]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T15:33:31.537 INFO:teuthology.orchestra.run.smithi050.stdout: 8 Oct 15:33:31 ntpd[22834]: ntpd: time slew -0.000589 s 2023-10-08T15:33:31.537 INFO:teuthology.orchestra.run.smithi050.stdout:ntpd: time slew -0.000589s 2023-10-08T15:33:31.537 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:31 ntpd[22834]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-10-08T15:33:31.537 INFO:teuthology.orchestra.run.smithi050.stderr: 8 Oct 15:33:31 ntpd[22834]: can't open /var/log/ntpstats/loopstats.20231008: Permission denied 2023-10-08T15:33:31.539 INFO:teuthology.orchestra.run.smithi089.stderr: 8 Oct 15:33:31 ntpd[22920]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:31.539 INFO:teuthology.orchestra.run.smithi089.stderr: 8 Oct 15:33:31 ntpd[22920]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:31.539 INFO:teuthology.orchestra.run.smithi089.stderr: 8 Oct 15:33:31 ntpd[22920]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:31.540 INFO:teuthology.orchestra.run.smithi089.stderr: 8 Oct 15:33:31 ntpd[22920]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:31.540 INFO:teuthology.orchestra.run.smithi089.stderr: 8 Oct 15:33:31 ntpd[22920]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:31.540 INFO:teuthology.orchestra.run.smithi089.stderr: 8 Oct 15:33:31 ntpd[22920]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:31.540 INFO:teuthology.orchestra.run.smithi089.stderr: 8 Oct 15:33:31 ntpd[22920]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T15:33:31.540 INFO:teuthology.orchestra.run.smithi089.stderr: 8 Oct 15:33:31 ntpd[22920]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T15:33:31.540 INFO:teuthology.orchestra.run.smithi089.stdout: 8 Oct 15:33:31 ntpd[22920]: ntpd: time slew +0.000194 s 2023-10-08T15:33:31.540 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd: time slew +0.000194s 2023-10-08T15:33:31.541 INFO:teuthology.orchestra.run.smithi089.stderr: 8 Oct 15:33:31 ntpd[22920]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-10-08T15:33:31.541 INFO:teuthology.orchestra.run.smithi089.stderr: 8 Oct 15:33:31 ntpd[22920]: can't open /var/log/ntpstats/loopstats.20231008: Permission denied 2023-10-08T15:33:31.542 INFO:teuthology.orchestra.run.smithi098.stderr: 8 Oct 15:33:31 ntpd[22880]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:31.542 INFO:teuthology.orchestra.run.smithi098.stderr: 8 Oct 15:33:31 ntpd[22880]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:31.542 INFO:teuthology.orchestra.run.smithi098.stderr: 8 Oct 15:33:31 ntpd[22880]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:31.542 INFO:teuthology.orchestra.run.smithi098.stderr: 8 Oct 15:33:31 ntpd[22880]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:31.542 INFO:teuthology.orchestra.run.smithi098.stderr: 8 Oct 15:33:31 ntpd[22880]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:31.542 INFO:teuthology.orchestra.run.smithi098.stderr: 8 Oct 15:33:31 ntpd[22880]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:31.543 INFO:teuthology.orchestra.run.smithi098.stderr: 8 Oct 15:33:31 ntpd[22880]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:31.543 INFO:teuthology.orchestra.run.smithi098.stderr: 8 Oct 15:33:31 ntpd[22880]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:31.543 INFO:teuthology.orchestra.run.smithi098.stderr: 8 Oct 15:33:31 ntpd[22880]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T15:33:31.543 INFO:teuthology.orchestra.run.smithi098.stderr: 8 Oct 15:33:31 ntpd[22880]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T15:33:31.543 INFO:teuthology.orchestra.run.smithi098.stderr: 8 Oct 15:33:31 ntpd[22880]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:31.543 INFO:teuthology.orchestra.run.smithi098.stderr: 8 Oct 15:33:31 ntpd[22880]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:31.543 INFO:teuthology.orchestra.run.smithi098.stderr: 8 Oct 15:33:31 ntpd[22880]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T15:33:31.543 INFO:teuthology.orchestra.run.smithi098.stderr: 8 Oct 15:33:31 ntpd[22880]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T15:33:31.543 INFO:teuthology.orchestra.run.smithi098.stderr: 8 Oct 15:33:31 ntpd[22880]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:31.543 INFO:teuthology.orchestra.run.smithi098.stderr: 8 Oct 15:33:31 ntpd[22880]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:31.543 INFO:teuthology.orchestra.run.smithi098.stderr: 8 Oct 15:33:31 ntpd[22880]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T15:33:31.543 INFO:teuthology.orchestra.run.smithi098.stderr: 8 Oct 15:33:31 ntpd[22880]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T15:33:31.544 INFO:teuthology.orchestra.run.smithi098.stdout: 8 Oct 15:33:31 ntpd[22880]: ntpd: time slew +0.001656 s 2023-10-08T15:33:31.544 INFO:teuthology.orchestra.run.smithi098.stdout:ntpd: time slew +0.001656s 2023-10-08T15:33:31.544 INFO:teuthology.orchestra.run.smithi098.stderr: 8 Oct 15:33:31 ntpd[22880]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-10-08T15:33:31.544 INFO:teuthology.orchestra.run.smithi098.stderr: 8 Oct 15:33:31 ntpd[22880]: can't open /var/log/ntpstats/loopstats.20231008: Permission denied 2023-10-08T15:33:31.560 INFO:teuthology.orchestra.run.smithi153.stderr: 8 Oct 15:33:31 ntpd[22872]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:31.560 INFO:teuthology.orchestra.run.smithi153.stderr: 8 Oct 15:33:31 ntpd[22872]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:31.561 INFO:teuthology.orchestra.run.smithi153.stderr: 8 Oct 15:33:31 ntpd[22872]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:31.561 INFO:teuthology.orchestra.run.smithi153.stderr: 8 Oct 15:33:31 ntpd[22872]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:31.563 INFO:teuthology.orchestra.run.smithi153.stderr: 8 Oct 15:33:31 ntpd[22872]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T15:33:31.563 INFO:teuthology.orchestra.run.smithi153.stderr: 8 Oct 15:33:31 ntpd[22872]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T15:33:31.563 INFO:teuthology.orchestra.run.smithi153.stdout: 8 Oct 15:33:31 ntpd[22872]: ntpd: time slew +0.000017 s 2023-10-08T15:33:31.565 INFO:teuthology.orchestra.run.smithi153.stdout:ntpd: time slew +0.000017s 2023-10-08T15:33:31.566 INFO:teuthology.orchestra.run.smithi153.stderr: 8 Oct 15:33:31 ntpd[22872]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-10-08T15:33:31.566 INFO:teuthology.orchestra.run.smithi153.stderr: 8 Oct 15:33:31 ntpd[22872]: can't open /var/log/ntpstats/loopstats.20231008: Permission denied 2023-10-08T15:33:31.600 INFO:teuthology.orchestra.run.smithi050.stdout: remote refid st t when poll reach delay offset jitter 2023-10-08T15:33:31.600 INFO:teuthology.orchestra.run.smithi050.stdout:============================================================================== 2023-10-08T15:33:31.600 INFO:teuthology.orchestra.run.smithi050.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-08T15:33:31.600 INFO:teuthology.orchestra.run.smithi050.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-08T15:33:31.600 INFO:teuthology.orchestra.run.smithi050.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-08T15:33:31.600 INFO:teuthology.orchestra.run.smithi050.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-08T15:33:31.604 INFO:teuthology.orchestra.run.smithi089.stdout: remote refid st t when poll reach delay offset jitter 2023-10-08T15:33:31.604 INFO:teuthology.orchestra.run.smithi089.stdout:============================================================================== 2023-10-08T15:33:31.604 INFO:teuthology.orchestra.run.smithi089.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-08T15:33:31.604 INFO:teuthology.orchestra.run.smithi089.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-08T15:33:31.605 INFO:teuthology.orchestra.run.smithi089.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-08T15:33:31.605 INFO:teuthology.orchestra.run.smithi089.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-08T15:33:31.614 INFO:teuthology.orchestra.run.smithi098.stdout: remote refid st t when poll reach delay offset jitter 2023-10-08T15:33:31.614 INFO:teuthology.orchestra.run.smithi098.stdout:============================================================================== 2023-10-08T15:33:31.614 INFO:teuthology.orchestra.run.smithi098.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-08T15:33:31.614 INFO:teuthology.orchestra.run.smithi098.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-08T15:33:31.614 INFO:teuthology.orchestra.run.smithi098.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-08T15:33:31.615 INFO:teuthology.orchestra.run.smithi098.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-08T15:33:31.620 INFO:teuthology.orchestra.run.smithi153.stdout: remote refid st t when poll reach delay offset jitter 2023-10-08T15:33:31.620 INFO:teuthology.orchestra.run.smithi153.stdout:============================================================================== 2023-10-08T15:33:31.620 INFO:teuthology.orchestra.run.smithi153.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-08T15:33:31.621 INFO:teuthology.orchestra.run.smithi153.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-08T15:33:31.621 INFO:teuthology.orchestra.run.smithi153.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-08T15:33:31.621 INFO:teuthology.orchestra.run.smithi153.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-08T15:33:32.530 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:32 ntpd[22724]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:32.531 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:32 ntpd[22724]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:32.531 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:32 ntpd[22724]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:32.531 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:32 ntpd[22724]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:32.531 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:32 ntpd[22724]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:32.531 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:32 ntpd[22724]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:32.531 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:32 ntpd[22724]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T15:33:32.531 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:32 ntpd[22724]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T15:33:32.531 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:32 ntpd[22724]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T15:33:32.531 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:32 ntpd[22724]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T15:33:32.532 INFO:teuthology.orchestra.run.smithi003.stdout: 8 Oct 15:33:32 ntpd[22724]: ntpd: time slew +0.000983 s 2023-10-08T15:33:32.532 INFO:teuthology.orchestra.run.smithi003.stdout:ntpd: time slew +0.000983s 2023-10-08T15:33:32.532 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:32 ntpd[22724]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-10-08T15:33:32.532 INFO:teuthology.orchestra.run.smithi003.stderr: 8 Oct 15:33:32 ntpd[22724]: can't open /var/log/ntpstats/loopstats.20231008: Permission denied 2023-10-08T15:33:32.601 INFO:teuthology.orchestra.run.smithi003.stdout: remote refid st t when poll reach delay offset jitter 2023-10-08T15:33:32.602 INFO:teuthology.orchestra.run.smithi003.stdout:============================================================================== 2023-10-08T15:33:32.602 INFO:teuthology.orchestra.run.smithi003.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-08T15:33:32.602 INFO:teuthology.orchestra.run.smithi003.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-08T15:33:32.602 INFO:teuthology.orchestra.run.smithi003.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-08T15:33:32.602 INFO:teuthology.orchestra.run.smithi003.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-08T15:33:32.602 INFO:teuthology.run_tasks:Running task install... 2023-10-08T15:33:32.611 DEBUG:teuthology.task.install:project ceph 2023-10-08T15:33:32.611 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}} 2023-10-08T15:33:32.611 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'} 2023-10-08T15:33:32.612 INFO:teuthology.task.install:Using flavor: default 2023-10-08T15:33:32.618 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-08T15:33:32.618 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-08T15:33:32.619 DEBUG:teuthology.orchestra.run.smithi003:> sudo apt-key list | grep Ceph 2023-10-08T15:33:32.619 DEBUG:teuthology.orchestra.run.smithi050:> sudo apt-key list | grep Ceph 2023-10-08T15:33:32.620 DEBUG:teuthology.orchestra.run.smithi089:> sudo apt-key list | grep Ceph 2023-10-08T15:33:32.620 DEBUG:teuthology.orchestra.run.smithi098:> sudo apt-key list | grep Ceph 2023-10-08T15:33:32.621 DEBUG:teuthology.orchestra.run.smithi153:> sudo apt-key list | grep Ceph 2023-10-08T15:33:32.718 INFO:teuthology.orchestra.run.smithi089.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-10-08T15:33:32.719 INFO:teuthology.orchestra.run.smithi098.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-10-08T15:33:32.726 INFO:teuthology.orchestra.run.smithi153.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-10-08T15:33:32.729 INFO:teuthology.orchestra.run.smithi050.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-10-08T15:33:32.742 INFO:teuthology.orchestra.run.smithi003.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-10-08T15:33:32.777 INFO:teuthology.orchestra.run.smithi089.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-10-08T15:33:32.777 INFO:teuthology.orchestra.run.smithi089.stdout:uid [ unknown] Ceph.com (release key) 2023-10-08T15:33:32.778 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-10-08T15:33:32.778 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2023-10-08T15:33:32.779 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-08T15:33:32.783 INFO:teuthology.orchestra.run.smithi098.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-10-08T15:33:32.783 INFO:teuthology.orchestra.run.smithi098.stdout:uid [ unknown] Ceph.com (release key) 2023-10-08T15:33:32.783 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-10-08T15:33:32.783 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2023-10-08T15:33:32.784 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-08T15:33:32.787 INFO:teuthology.orchestra.run.smithi153.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-10-08T15:33:32.787 INFO:teuthology.orchestra.run.smithi153.stdout:uid [ unknown] Ceph.com (release key) 2023-10-08T15:33:32.787 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-10-08T15:33:32.787 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2023-10-08T15:33:32.787 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-08T15:33:32.791 INFO:teuthology.orchestra.run.smithi050.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-10-08T15:33:32.791 INFO:teuthology.orchestra.run.smithi050.stdout:uid [ unknown] Ceph.com (release key) 2023-10-08T15:33:32.792 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-10-08T15:33:32.792 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2023-10-08T15:33:32.792 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-08T15:33:32.803 INFO:teuthology.orchestra.run.smithi003.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-10-08T15:33:32.804 INFO:teuthology.orchestra.run.smithi003.stdout:uid [ unknown] Ceph.com (release key) 2023-10-08T15:33:32.811 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-10-08T15:33:32.812 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2023-10-08T15:33:32.812 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-08T15:33:32.930 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default/ 2023-10-08T15:33:32.930 INFO:teuthology.task.install.deb:Package version is 17.2.6-1320-g08cac018-1focal 2023-10-08T15:33:32.935 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default/ 2023-10-08T15:33:32.936 INFO:teuthology.task.install.deb:Package version is 17.2.6-1320-g08cac018-1focal 2023-10-08T15:33:32.944 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default/ 2023-10-08T15:33:32.944 INFO:teuthology.task.install.deb:Package version is 17.2.6-1320-g08cac018-1focal 2023-10-08T15:33:32.963 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default/ 2023-10-08T15:33:32.963 INFO:teuthology.task.install.deb:Package version is 17.2.6-1320-g08cac018-1focal 2023-10-08T15:33:33.000 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default/ 2023-10-08T15:33:33.000 INFO:teuthology.task.install.deb:Package version is 17.2.6-1320-g08cac018-1focal 2023-10-08T15:33:33.241 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-10-08T15:33:33.241 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-10-08T15:33:33.255 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-10-08T15:33:33.255 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-10-08T15:33:33.258 DEBUG:teuthology.orchestra.run.smithi003:> sudo apt-get update 2023-10-08T15:33:33.261 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-08T15:33:33.262 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-10-08T15:33:33.271 DEBUG:teuthology.orchestra.run.smithi098:> sudo apt-get update 2023-10-08T15:33:33.278 DEBUG:teuthology.orchestra.run.smithi050:> sudo apt-get update 2023-10-08T15:33:33.285 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-08T15:33:33.285 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-10-08T15:33:33.301 DEBUG:teuthology.orchestra.run.smithi089:> sudo apt-get update 2023-10-08T15:33:33.325 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-10-08T15:33:33.326 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-10-08T15:33:33.342 DEBUG:teuthology.orchestra.run.smithi153:> sudo apt-get update 2023-10-08T15:33:33.393 INFO:teuthology.orchestra.run.smithi003.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-10-08T15:33:33.393 INFO:teuthology.orchestra.run.smithi003.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-08T15:33:33.400 INFO:teuthology.orchestra.run.smithi003.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-10-08T15:33:33.405 INFO:teuthology.orchestra.run.smithi098.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-10-08T15:33:33.414 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-10-08T15:33:33.414 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-08T15:33:33.417 INFO:teuthology.orchestra.run.smithi003.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-10-08T15:33:33.425 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-10-08T15:33:33.442 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-10-08T15:33:33.449 INFO:teuthology.orchestra.run.smithi089.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-08T15:33:33.457 INFO:teuthology.orchestra.run.smithi089.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-10-08T15:33:33.477 INFO:teuthology.orchestra.run.smithi089.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-10-08T15:33:33.524 INFO:teuthology.orchestra.run.smithi098.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-08T15:33:33.527 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-08T15:33:33.533 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-10-08T15:33:33.550 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-10-08T15:33:33.562 INFO:teuthology.orchestra.run.smithi089.stdout:Hit:4 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-10-08T15:33:33.606 INFO:teuthology.orchestra.run.smithi098.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-10-08T15:33:33.635 INFO:teuthology.orchestra.run.smithi003.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal InRelease 2023-10-08T15:33:33.646 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:4 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-10-08T15:33:33.663 INFO:teuthology.orchestra.run.smithi098.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal InRelease 2023-10-08T15:33:33.697 INFO:teuthology.orchestra.run.smithi098.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-10-08T15:33:33.702 INFO:teuthology.orchestra.run.smithi089.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal InRelease 2023-10-08T15:33:33.707 INFO:teuthology.orchestra.run.smithi003.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-10-08T15:33:33.729 INFO:teuthology.orchestra.run.smithi050.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal InRelease 2023-10-08T15:33:33.742 INFO:teuthology.orchestra.run.smithi098.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-10-08T15:33:33.769 INFO:teuthology.orchestra.run.smithi089.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-10-08T15:33:33.771 INFO:teuthology.orchestra.run.smithi153.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal InRelease 2023-10-08T15:33:33.773 INFO:teuthology.orchestra.run.smithi003.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal Release.gpg 2023-10-08T15:33:33.801 INFO:teuthology.orchestra.run.smithi098.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal Release.gpg 2023-10-08T15:33:33.805 INFO:teuthology.orchestra.run.smithi050.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-10-08T15:33:33.817 INFO:teuthology.orchestra.run.smithi089.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal Release.gpg 2023-10-08T15:33:33.825 INFO:teuthology.orchestra.run.smithi153.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-10-08T15:33:33.831 INFO:teuthology.orchestra.run.smithi003.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2023-10-08T15:33:33.864 INFO:teuthology.orchestra.run.smithi098.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main i386 Packages [3,366 B] 2023-10-08T15:33:33.874 INFO:teuthology.orchestra.run.smithi089.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2023-10-08T15:33:33.883 INFO:teuthology.orchestra.run.smithi153.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal Release.gpg 2023-10-08T15:33:33.885 INFO:teuthology.orchestra.run.smithi050.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal Release.gpg 2023-10-08T15:33:33.909 INFO:teuthology.orchestra.run.smithi003.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main i386 Packages [3,366 B] 2023-10-08T15:33:33.938 INFO:teuthology.orchestra.run.smithi098.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2023-10-08T15:33:33.938 INFO:teuthology.orchestra.run.smithi153.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2023-10-08T15:33:33.958 INFO:teuthology.orchestra.run.smithi050.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main i386 Packages [3,366 B] 2023-10-08T15:33:33.996 INFO:teuthology.orchestra.run.smithi089.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main i386 Packages [3,366 B] 2023-10-08T15:33:34.050 INFO:teuthology.orchestra.run.smithi050.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2023-10-08T15:33:34.059 INFO:teuthology.orchestra.run.smithi098.stdout:Fetched 28.4 kB in 1s (44.8 kB/s) 2023-10-08T15:33:34.064 INFO:teuthology.orchestra.run.smithi003.stdout:Fetched 28.4 kB in 1s (44.3 kB/s) 2023-10-08T15:33:34.074 INFO:teuthology.orchestra.run.smithi153.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main i386 Packages [3,366 B] 2023-10-08T15:33:34.094 INFO:teuthology.orchestra.run.smithi089.stdout:Fetched 28.4 kB in 1s (45.1 kB/s) 2023-10-08T15:33:34.175 INFO:teuthology.orchestra.run.smithi153.stdout:Fetched 28.4 kB in 1s (45.1 kB/s) 2023-10-08T15:33:34.222 INFO:teuthology.orchestra.run.smithi050.stdout:Fetched 28.4 kB in 1s (36.6 kB/s) 2023-10-08T15:33:35.094 INFO:teuthology.orchestra.run.smithi098.stdout:Reading package lists... 2023-10-08T15:33:35.116 INFO:teuthology.orchestra.run.smithi089.stdout:Reading package lists... 2023-10-08T15:33:35.118 DEBUG:teuthology.orchestra.run.smithi098:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.2.6-1320-g08cac018-1focal cephadm=17.2.6-1320-g08cac018-1focal ceph-mds=17.2.6-1320-g08cac018-1focal ceph-mgr=17.2.6-1320-g08cac018-1focal ceph-common=17.2.6-1320-g08cac018-1focal ceph-fuse=17.2.6-1320-g08cac018-1focal ceph-test=17.2.6-1320-g08cac018-1focal ceph-volume=17.2.6-1320-g08cac018-1focal radosgw=17.2.6-1320-g08cac018-1focal python3-rados=17.2.6-1320-g08cac018-1focal python3-rgw=17.2.6-1320-g08cac018-1focal python3-cephfs=17.2.6-1320-g08cac018-1focal python3-rbd=17.2.6-1320-g08cac018-1focal libcephfs2=17.2.6-1320-g08cac018-1focal libcephfs-dev=17.2.6-1320-g08cac018-1focal librados2=17.2.6-1320-g08cac018-1focal librbd1=17.2.6-1320-g08cac018-1focal rbd-fuse=17.2.6-1320-g08cac018-1focal python3-cephfs=17.2.6-1320-g08cac018-1focal cephfs-shell=17.2.6-1320-g08cac018-1focal cephfs-top=17.2.6-1320-g08cac018-1focal cephfs-mirror=17.2.6-1320-g08cac018-1focal 2023-10-08T15:33:35.132 INFO:teuthology.orchestra.run.smithi003.stdout:Reading package lists... 2023-10-08T15:33:35.142 DEBUG:teuthology.orchestra.run.smithi089:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.2.6-1320-g08cac018-1focal cephadm=17.2.6-1320-g08cac018-1focal ceph-mds=17.2.6-1320-g08cac018-1focal ceph-mgr=17.2.6-1320-g08cac018-1focal ceph-common=17.2.6-1320-g08cac018-1focal ceph-fuse=17.2.6-1320-g08cac018-1focal ceph-test=17.2.6-1320-g08cac018-1focal ceph-volume=17.2.6-1320-g08cac018-1focal radosgw=17.2.6-1320-g08cac018-1focal python3-rados=17.2.6-1320-g08cac018-1focal python3-rgw=17.2.6-1320-g08cac018-1focal python3-cephfs=17.2.6-1320-g08cac018-1focal python3-rbd=17.2.6-1320-g08cac018-1focal libcephfs2=17.2.6-1320-g08cac018-1focal libcephfs-dev=17.2.6-1320-g08cac018-1focal librados2=17.2.6-1320-g08cac018-1focal librbd1=17.2.6-1320-g08cac018-1focal rbd-fuse=17.2.6-1320-g08cac018-1focal python3-cephfs=17.2.6-1320-g08cac018-1focal cephfs-shell=17.2.6-1320-g08cac018-1focal cephfs-top=17.2.6-1320-g08cac018-1focal cephfs-mirror=17.2.6-1320-g08cac018-1focal 2023-10-08T15:33:35.157 DEBUG:teuthology.orchestra.run.smithi003:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.2.6-1320-g08cac018-1focal cephadm=17.2.6-1320-g08cac018-1focal ceph-mds=17.2.6-1320-g08cac018-1focal ceph-mgr=17.2.6-1320-g08cac018-1focal ceph-common=17.2.6-1320-g08cac018-1focal ceph-fuse=17.2.6-1320-g08cac018-1focal ceph-test=17.2.6-1320-g08cac018-1focal ceph-volume=17.2.6-1320-g08cac018-1focal radosgw=17.2.6-1320-g08cac018-1focal python3-rados=17.2.6-1320-g08cac018-1focal python3-rgw=17.2.6-1320-g08cac018-1focal python3-cephfs=17.2.6-1320-g08cac018-1focal python3-rbd=17.2.6-1320-g08cac018-1focal libcephfs2=17.2.6-1320-g08cac018-1focal libcephfs-dev=17.2.6-1320-g08cac018-1focal librados2=17.2.6-1320-g08cac018-1focal librbd1=17.2.6-1320-g08cac018-1focal rbd-fuse=17.2.6-1320-g08cac018-1focal python3-cephfs=17.2.6-1320-g08cac018-1focal cephfs-shell=17.2.6-1320-g08cac018-1focal cephfs-top=17.2.6-1320-g08cac018-1focal cephfs-mirror=17.2.6-1320-g08cac018-1focal 2023-10-08T15:33:35.184 INFO:teuthology.orchestra.run.smithi098.stdout:Reading package lists... 2023-10-08T15:33:35.213 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2023-10-08T15:33:35.218 INFO:teuthology.orchestra.run.smithi089.stdout:Reading package lists... 2023-10-08T15:33:35.232 INFO:teuthology.orchestra.run.smithi003.stdout:Reading package lists... 2023-10-08T15:33:35.239 DEBUG:teuthology.orchestra.run.smithi153:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.2.6-1320-g08cac018-1focal cephadm=17.2.6-1320-g08cac018-1focal ceph-mds=17.2.6-1320-g08cac018-1focal ceph-mgr=17.2.6-1320-g08cac018-1focal ceph-common=17.2.6-1320-g08cac018-1focal ceph-fuse=17.2.6-1320-g08cac018-1focal ceph-test=17.2.6-1320-g08cac018-1focal ceph-volume=17.2.6-1320-g08cac018-1focal radosgw=17.2.6-1320-g08cac018-1focal python3-rados=17.2.6-1320-g08cac018-1focal python3-rgw=17.2.6-1320-g08cac018-1focal python3-cephfs=17.2.6-1320-g08cac018-1focal python3-rbd=17.2.6-1320-g08cac018-1focal libcephfs2=17.2.6-1320-g08cac018-1focal libcephfs-dev=17.2.6-1320-g08cac018-1focal librados2=17.2.6-1320-g08cac018-1focal librbd1=17.2.6-1320-g08cac018-1focal rbd-fuse=17.2.6-1320-g08cac018-1focal python3-cephfs=17.2.6-1320-g08cac018-1focal cephfs-shell=17.2.6-1320-g08cac018-1focal cephfs-top=17.2.6-1320-g08cac018-1focal cephfs-mirror=17.2.6-1320-g08cac018-1focal 2023-10-08T15:33:35.300 INFO:teuthology.orchestra.run.smithi050.stdout:Reading package lists... 2023-10-08T15:33:35.308 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2023-10-08T15:33:35.326 DEBUG:teuthology.orchestra.run.smithi050:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.2.6-1320-g08cac018-1focal cephadm=17.2.6-1320-g08cac018-1focal ceph-mds=17.2.6-1320-g08cac018-1focal ceph-mgr=17.2.6-1320-g08cac018-1focal ceph-common=17.2.6-1320-g08cac018-1focal ceph-fuse=17.2.6-1320-g08cac018-1focal ceph-test=17.2.6-1320-g08cac018-1focal ceph-volume=17.2.6-1320-g08cac018-1focal radosgw=17.2.6-1320-g08cac018-1focal python3-rados=17.2.6-1320-g08cac018-1focal python3-rgw=17.2.6-1320-g08cac018-1focal python3-cephfs=17.2.6-1320-g08cac018-1focal python3-rbd=17.2.6-1320-g08cac018-1focal libcephfs2=17.2.6-1320-g08cac018-1focal libcephfs-dev=17.2.6-1320-g08cac018-1focal librados2=17.2.6-1320-g08cac018-1focal librbd1=17.2.6-1320-g08cac018-1focal rbd-fuse=17.2.6-1320-g08cac018-1focal python3-cephfs=17.2.6-1320-g08cac018-1focal cephfs-shell=17.2.6-1320-g08cac018-1focal cephfs-top=17.2.6-1320-g08cac018-1focal cephfs-mirror=17.2.6-1320-g08cac018-1focal 2023-10-08T15:33:35.362 INFO:teuthology.orchestra.run.smithi098.stdout:Building dependency tree... 2023-10-08T15:33:35.363 INFO:teuthology.orchestra.run.smithi098.stdout:Reading state information... 2023-10-08T15:33:35.398 INFO:teuthology.orchestra.run.smithi050.stdout:Reading package lists... 2023-10-08T15:33:35.420 INFO:teuthology.orchestra.run.smithi089.stdout:Building dependency tree... 2023-10-08T15:33:35.421 INFO:teuthology.orchestra.run.smithi089.stdout:Reading state information... 2023-10-08T15:33:35.437 INFO:teuthology.orchestra.run.smithi003.stdout:Building dependency tree... 2023-10-08T15:33:35.438 INFO:teuthology.orchestra.run.smithi003.stdout:Reading state information... 2023-10-08T15:33:35.487 INFO:teuthology.orchestra.run.smithi153.stdout:Building dependency tree... 2023-10-08T15:33:35.488 INFO:teuthology.orchestra.run.smithi153.stdout:Reading state information... 2023-10-08T15:33:35.534 INFO:teuthology.orchestra.run.smithi098.stdout:The following packages were automatically installed and are no longer required: 2023-10-08T15:33:35.536 INFO:teuthology.orchestra.run.smithi098.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-08T15:33:35.536 INFO:teuthology.orchestra.run.smithi098.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-08T15:33:35.536 INFO:teuthology.orchestra.run.smithi098.stdout:The following additional packages will be installed: 2023-10-08T15:33:35.536 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-10-08T15:33:35.536 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-10-08T15:33:35.536 INFO:teuthology.orchestra.run.smithi098.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-10-08T15:33:35.536 INFO:teuthology.orchestra.run.smithi098.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-10-08T15:33:35.536 INFO:teuthology.orchestra.run.smithi098.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-10-08T15:33:35.538 INFO:teuthology.orchestra.run.smithi098.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-10-08T15:33:35.538 INFO:teuthology.orchestra.run.smithi098.stdout: python-natsort-doc python-pastedeploy-tpl python3-atomicwrites python3-attr 2023-10-08T15:33:35.538 INFO:teuthology.orchestra.run.smithi098.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-10-08T15:33:35.538 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-argparse python3-ceph-common python3-cherrypy3 python3-cmd2 2023-10-08T15:33:35.538 INFO:teuthology.orchestra.run.smithi098.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-10-08T15:33:35.538 INFO:teuthology.orchestra.run.smithi098.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-10-08T15:33:35.539 INFO:teuthology.orchestra.run.smithi098.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-10-08T15:33:35.539 INFO:teuthology.orchestra.run.smithi098.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-10-08T15:33:35.539 INFO:teuthology.orchestra.run.smithi098.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-10-08T15:33:35.539 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-10-08T15:33:35.539 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-10-08T15:33:35.539 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2023-10-08T15:33:35.539 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2023-10-08T15:33:35.539 INFO:teuthology.orchestra.run.smithi098.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-08T15:33:35.539 INFO:teuthology.orchestra.run.smithi098.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-08T15:33:35.539 INFO:teuthology.orchestra.run.smithi098.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-10-08T15:33:35.539 INFO:teuthology.orchestra.run.smithi098.stdout: qttranslations5-l10n socat xmlstarlet 2023-10-08T15:33:35.539 INFO:teuthology.orchestra.run.smithi098.stdout:Suggested packages: 2023-10-08T15:33:35.540 INFO:teuthology.orchestra.run.smithi098.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-10-08T15:33:35.540 INFO:teuthology.orchestra.run.smithi098.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-10-08T15:33:35.540 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-10-08T15:33:35.540 INFO:teuthology.orchestra.run.smithi098.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-10-08T15:33:35.540 INFO:teuthology.orchestra.run.smithi098.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-10-08T15:33:35.540 INFO:teuthology.orchestra.run.smithi098.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-10-08T15:33:35.540 INFO:teuthology.orchestra.run.smithi098.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-10-08T15:33:35.540 INFO:teuthology.orchestra.run.smithi098.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-10-08T15:33:35.540 INFO:teuthology.orchestra.run.smithi098.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-10-08T15:33:35.540 INFO:teuthology.orchestra.run.smithi098.stdout:Recommended packages: 2023-10-08T15:33:35.540 INFO:teuthology.orchestra.run.smithi098.stdout: btrfs-tools 2023-10-08T15:33:35.593 INFO:teuthology.orchestra.run.smithi089.stdout:The following packages were automatically installed and are no longer required: 2023-10-08T15:33:35.594 INFO:teuthology.orchestra.run.smithi089.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-08T15:33:35.595 INFO:teuthology.orchestra.run.smithi089.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-08T15:33:35.595 INFO:teuthology.orchestra.run.smithi089.stdout:The following additional packages will be installed: 2023-10-08T15:33:35.595 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-10-08T15:33:35.595 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-10-08T15:33:35.595 INFO:teuthology.orchestra.run.smithi089.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-10-08T15:33:35.595 INFO:teuthology.orchestra.run.smithi089.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-10-08T15:33:35.595 INFO:teuthology.orchestra.run.smithi089.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-10-08T15:33:35.596 INFO:teuthology.orchestra.run.smithi089.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-10-08T15:33:35.596 INFO:teuthology.orchestra.run.smithi089.stdout: python-natsort-doc python-pastedeploy-tpl python3-atomicwrites python3-attr 2023-10-08T15:33:35.596 INFO:teuthology.orchestra.run.smithi089.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-10-08T15:33:35.596 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-argparse python3-ceph-common python3-cherrypy3 python3-cmd2 2023-10-08T15:33:35.596 INFO:teuthology.orchestra.run.smithi089.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-10-08T15:33:35.596 INFO:teuthology.orchestra.run.smithi089.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-10-08T15:33:35.596 INFO:teuthology.orchestra.run.smithi089.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-10-08T15:33:35.596 INFO:teuthology.orchestra.run.smithi089.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-10-08T15:33:35.597 INFO:teuthology.orchestra.run.smithi089.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-10-08T15:33:35.597 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-10-08T15:33:35.597 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-10-08T15:33:35.597 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2023-10-08T15:33:35.597 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2023-10-08T15:33:35.597 INFO:teuthology.orchestra.run.smithi089.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-08T15:33:35.597 INFO:teuthology.orchestra.run.smithi089.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-08T15:33:35.597 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-10-08T15:33:35.597 INFO:teuthology.orchestra.run.smithi089.stdout: qttranslations5-l10n socat xmlstarlet 2023-10-08T15:33:35.598 INFO:teuthology.orchestra.run.smithi089.stdout:Suggested packages: 2023-10-08T15:33:35.598 INFO:teuthology.orchestra.run.smithi089.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-10-08T15:33:35.598 INFO:teuthology.orchestra.run.smithi089.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-10-08T15:33:35.598 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-10-08T15:33:35.598 INFO:teuthology.orchestra.run.smithi089.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-10-08T15:33:35.598 INFO:teuthology.orchestra.run.smithi089.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-10-08T15:33:35.598 INFO:teuthology.orchestra.run.smithi089.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-10-08T15:33:35.598 INFO:teuthology.orchestra.run.smithi089.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-10-08T15:33:35.599 INFO:teuthology.orchestra.run.smithi089.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-10-08T15:33:35.599 INFO:teuthology.orchestra.run.smithi089.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-10-08T15:33:35.599 INFO:teuthology.orchestra.run.smithi089.stdout:Recommended packages: 2023-10-08T15:33:35.599 INFO:teuthology.orchestra.run.smithi089.stdout: btrfs-tools 2023-10-08T15:33:35.603 INFO:teuthology.orchestra.run.smithi050.stdout:Building dependency tree... 2023-10-08T15:33:35.603 INFO:teuthology.orchestra.run.smithi050.stdout:Reading state information... 2023-10-08T15:33:35.628 INFO:teuthology.orchestra.run.smithi003.stdout:The following packages were automatically installed and are no longer required: 2023-10-08T15:33:35.629 INFO:teuthology.orchestra.run.smithi003.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-08T15:33:35.629 INFO:teuthology.orchestra.run.smithi003.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-08T15:33:35.629 INFO:teuthology.orchestra.run.smithi003.stdout:The following additional packages will be installed: 2023-10-08T15:33:35.629 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-10-08T15:33:35.629 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-10-08T15:33:35.630 INFO:teuthology.orchestra.run.smithi003.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-10-08T15:33:35.630 INFO:teuthology.orchestra.run.smithi003.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-10-08T15:33:35.630 INFO:teuthology.orchestra.run.smithi003.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-10-08T15:33:35.631 INFO:teuthology.orchestra.run.smithi003.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-10-08T15:33:35.631 INFO:teuthology.orchestra.run.smithi003.stdout: python-natsort-doc python-pastedeploy-tpl python3-atomicwrites python3-attr 2023-10-08T15:33:35.631 INFO:teuthology.orchestra.run.smithi003.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-10-08T15:33:35.632 INFO:teuthology.orchestra.run.smithi003.stdout: python3-ceph-argparse python3-ceph-common python3-cherrypy3 python3-cmd2 2023-10-08T15:33:35.632 INFO:teuthology.orchestra.run.smithi003.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-10-08T15:33:35.632 INFO:teuthology.orchestra.run.smithi003.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-10-08T15:33:35.632 INFO:teuthology.orchestra.run.smithi003.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-10-08T15:33:35.632 INFO:teuthology.orchestra.run.smithi003.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-10-08T15:33:35.632 INFO:teuthology.orchestra.run.smithi003.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-10-08T15:33:35.632 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-10-08T15:33:35.632 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-10-08T15:33:35.632 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2023-10-08T15:33:35.632 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2023-10-08T15:33:35.632 INFO:teuthology.orchestra.run.smithi003.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-08T15:33:35.633 INFO:teuthology.orchestra.run.smithi003.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-08T15:33:35.633 INFO:teuthology.orchestra.run.smithi003.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-10-08T15:33:35.633 INFO:teuthology.orchestra.run.smithi003.stdout: qttranslations5-l10n socat xmlstarlet 2023-10-08T15:33:35.633 INFO:teuthology.orchestra.run.smithi003.stdout:Suggested packages: 2023-10-08T15:33:35.633 INFO:teuthology.orchestra.run.smithi003.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-10-08T15:33:35.633 INFO:teuthology.orchestra.run.smithi003.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-10-08T15:33:35.633 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-10-08T15:33:35.633 INFO:teuthology.orchestra.run.smithi003.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-10-08T15:33:35.633 INFO:teuthology.orchestra.run.smithi003.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-10-08T15:33:35.633 INFO:teuthology.orchestra.run.smithi003.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-10-08T15:33:35.633 INFO:teuthology.orchestra.run.smithi003.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-10-08T15:33:35.634 INFO:teuthology.orchestra.run.smithi003.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-10-08T15:33:35.634 INFO:teuthology.orchestra.run.smithi003.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-10-08T15:33:35.634 INFO:teuthology.orchestra.run.smithi003.stdout:Recommended packages: 2023-10-08T15:33:35.634 INFO:teuthology.orchestra.run.smithi003.stdout: btrfs-tools 2023-10-08T15:33:35.657 INFO:teuthology.orchestra.run.smithi153.stdout:The following packages were automatically installed and are no longer required: 2023-10-08T15:33:35.657 INFO:teuthology.orchestra.run.smithi098.stdout:The following NEW packages will be installed: 2023-10-08T15:33:35.657 INFO:teuthology.orchestra.run.smithi098.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-10-08T15:33:35.657 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-10-08T15:33:35.657 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-10-08T15:33:35.661 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-10-08T15:33:35.661 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-10-08T15:33:35.662 INFO:teuthology.orchestra.run.smithi098.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-10-08T15:33:35.662 INFO:teuthology.orchestra.run.smithi098.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-10-08T15:33:35.662 INFO:teuthology.orchestra.run.smithi098.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-10-08T15:33:35.662 INFO:teuthology.orchestra.run.smithi098.stdout: nvme-cli python-natsort-doc python-pastedeploy-tpl python3-atomicwrites 2023-10-08T15:33:35.662 INFO:teuthology.orchestra.run.smithi098.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-10-08T15:33:35.662 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2023-10-08T15:33:35.662 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2023-10-08T15:33:35.662 INFO:teuthology.orchestra.run.smithi098.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2023-10-08T15:33:35.662 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2023-10-08T15:33:35.662 INFO:teuthology.orchestra.run.smithi098.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-10-08T15:33:35.663 INFO:teuthology.orchestra.run.smithi098.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-10-08T15:33:35.663 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-10-08T15:33:35.663 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-10-08T15:33:35.663 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-10-08T15:33:35.663 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-10-08T15:33:35.663 INFO:teuthology.orchestra.run.smithi098.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-10-08T15:33:35.663 INFO:teuthology.orchestra.run.smithi098.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-08T15:33:35.663 INFO:teuthology.orchestra.run.smithi098.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-08T15:33:35.663 INFO:teuthology.orchestra.run.smithi098.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-10-08T15:33:35.663 INFO:teuthology.orchestra.run.smithi098.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-10-08T15:33:35.663 INFO:teuthology.orchestra.run.smithi098.stdout:The following packages will be upgraded: 2023-10-08T15:33:35.664 INFO:teuthology.orchestra.run.smithi098.stdout: librados2 librbd1 2023-10-08T15:33:35.664 INFO:teuthology.orchestra.run.smithi153.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-08T15:33:35.664 INFO:teuthology.orchestra.run.smithi153.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-08T15:33:35.664 INFO:teuthology.orchestra.run.smithi153.stdout:The following additional packages will be installed: 2023-10-08T15:33:35.664 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-10-08T15:33:35.665 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-10-08T15:33:35.665 INFO:teuthology.orchestra.run.smithi153.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-10-08T15:33:35.665 INFO:teuthology.orchestra.run.smithi153.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-10-08T15:33:35.665 INFO:teuthology.orchestra.run.smithi153.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-10-08T15:33:35.665 INFO:teuthology.orchestra.run.smithi153.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-10-08T15:33:35.665 INFO:teuthology.orchestra.run.smithi153.stdout: python-natsort-doc python-pastedeploy-tpl python3-atomicwrites python3-attr 2023-10-08T15:33:35.665 INFO:teuthology.orchestra.run.smithi153.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-10-08T15:33:35.665 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-argparse python3-ceph-common python3-cherrypy3 python3-cmd2 2023-10-08T15:33:35.665 INFO:teuthology.orchestra.run.smithi153.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-10-08T15:33:35.665 INFO:teuthology.orchestra.run.smithi153.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-10-08T15:33:35.665 INFO:teuthology.orchestra.run.smithi153.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-10-08T15:33:35.666 INFO:teuthology.orchestra.run.smithi153.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-10-08T15:33:35.666 INFO:teuthology.orchestra.run.smithi153.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-10-08T15:33:35.666 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-10-08T15:33:35.666 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-10-08T15:33:35.666 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2023-10-08T15:33:35.666 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2023-10-08T15:33:35.666 INFO:teuthology.orchestra.run.smithi153.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-08T15:33:35.666 INFO:teuthology.orchestra.run.smithi153.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-08T15:33:35.666 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-10-08T15:33:35.666 INFO:teuthology.orchestra.run.smithi153.stdout: qttranslations5-l10n socat xmlstarlet 2023-10-08T15:33:35.666 INFO:teuthology.orchestra.run.smithi153.stdout:Suggested packages: 2023-10-08T15:33:35.667 INFO:teuthology.orchestra.run.smithi153.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-10-08T15:33:35.667 INFO:teuthology.orchestra.run.smithi153.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-10-08T15:33:35.667 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-10-08T15:33:35.667 INFO:teuthology.orchestra.run.smithi153.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-10-08T15:33:35.667 INFO:teuthology.orchestra.run.smithi153.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-10-08T15:33:35.667 INFO:teuthology.orchestra.run.smithi153.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-10-08T15:33:35.667 INFO:teuthology.orchestra.run.smithi153.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-10-08T15:33:35.667 INFO:teuthology.orchestra.run.smithi153.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-10-08T15:33:35.667 INFO:teuthology.orchestra.run.smithi153.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-10-08T15:33:35.667 INFO:teuthology.orchestra.run.smithi153.stdout:Recommended packages: 2023-10-08T15:33:35.667 INFO:teuthology.orchestra.run.smithi153.stdout: btrfs-tools 2023-10-08T15:33:35.717 INFO:teuthology.orchestra.run.smithi089.stdout:The following NEW packages will be installed: 2023-10-08T15:33:35.717 INFO:teuthology.orchestra.run.smithi089.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-10-08T15:33:35.717 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-10-08T15:33:35.717 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-10-08T15:33:35.717 INFO:teuthology.orchestra.run.smithi089.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-10-08T15:33:35.718 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-10-08T15:33:35.718 INFO:teuthology.orchestra.run.smithi089.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-10-08T15:33:35.718 INFO:teuthology.orchestra.run.smithi089.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-10-08T15:33:35.719 INFO:teuthology.orchestra.run.smithi089.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-10-08T15:33:35.719 INFO:teuthology.orchestra.run.smithi089.stdout: nvme-cli python-natsort-doc python-pastedeploy-tpl python3-atomicwrites 2023-10-08T15:33:35.719 INFO:teuthology.orchestra.run.smithi089.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-10-08T15:33:35.719 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2023-10-08T15:33:35.719 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2023-10-08T15:33:35.719 INFO:teuthology.orchestra.run.smithi089.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2023-10-08T15:33:35.719 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2023-10-08T15:33:35.719 INFO:teuthology.orchestra.run.smithi089.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-10-08T15:33:35.719 INFO:teuthology.orchestra.run.smithi089.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-10-08T15:33:35.720 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-10-08T15:33:35.720 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-10-08T15:33:35.720 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-10-08T15:33:35.720 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-10-08T15:33:35.720 INFO:teuthology.orchestra.run.smithi089.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-10-08T15:33:35.720 INFO:teuthology.orchestra.run.smithi089.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-08T15:33:35.720 INFO:teuthology.orchestra.run.smithi089.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-08T15:33:35.720 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-10-08T15:33:35.720 INFO:teuthology.orchestra.run.smithi089.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-10-08T15:33:35.720 INFO:teuthology.orchestra.run.smithi089.stdout:The following packages will be upgraded: 2023-10-08T15:33:35.721 INFO:teuthology.orchestra.run.smithi089.stdout: librados2 librbd1 2023-10-08T15:33:35.723 INFO:teuthology.orchestra.run.smithi098.stdout:2 upgraded, 114 newly installed, 0 to remove and 253 not upgraded. 2023-10-08T15:33:35.723 INFO:teuthology.orchestra.run.smithi098.stdout:Need to get 210 MB of archives. 2023-10-08T15:33:35.724 INFO:teuthology.orchestra.run.smithi098.stdout:After this operation, 981 MB of additional disk space will be used. 2023-10-08T15:33:35.724 INFO:teuthology.orchestra.run.smithi098.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-10-08T15:33:35.741 INFO:teuthology.orchestra.run.smithi098.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-10-08T15:33:35.748 INFO:teuthology.orchestra.run.smithi098.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-10-08T15:33:35.759 INFO:teuthology.orchestra.run.smithi003.stdout:The following NEW packages will be installed: 2023-10-08T15:33:35.759 INFO:teuthology.orchestra.run.smithi003.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-10-08T15:33:35.759 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-10-08T15:33:35.759 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-10-08T15:33:35.759 INFO:teuthology.orchestra.run.smithi003.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-10-08T15:33:35.761 INFO:teuthology.orchestra.run.smithi003.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-10-08T15:33:35.761 INFO:teuthology.orchestra.run.smithi003.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-10-08T15:33:35.761 INFO:teuthology.orchestra.run.smithi003.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-10-08T15:33:35.761 INFO:teuthology.orchestra.run.smithi003.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-10-08T15:33:35.761 INFO:teuthology.orchestra.run.smithi003.stdout: nvme-cli python-natsort-doc python-pastedeploy-tpl python3-atomicwrites 2023-10-08T15:33:35.762 INFO:teuthology.orchestra.run.smithi003.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-10-08T15:33:35.762 INFO:teuthology.orchestra.run.smithi003.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2023-10-08T15:33:35.762 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2023-10-08T15:33:35.762 INFO:teuthology.orchestra.run.smithi003.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2023-10-08T15:33:35.762 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2023-10-08T15:33:35.762 INFO:teuthology.orchestra.run.smithi003.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-10-08T15:33:35.762 INFO:teuthology.orchestra.run.smithi003.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-10-08T15:33:35.762 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-10-08T15:33:35.762 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-10-08T15:33:35.762 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-10-08T15:33:35.763 INFO:teuthology.orchestra.run.smithi003.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-10-08T15:33:35.763 INFO:teuthology.orchestra.run.smithi003.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-10-08T15:33:35.763 INFO:teuthology.orchestra.run.smithi003.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-08T15:33:35.763 INFO:teuthology.orchestra.run.smithi003.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-08T15:33:35.763 INFO:teuthology.orchestra.run.smithi003.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-10-08T15:33:35.763 INFO:teuthology.orchestra.run.smithi003.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-10-08T15:33:35.763 INFO:teuthology.orchestra.run.smithi003.stdout:The following packages will be upgraded: 2023-10-08T15:33:35.763 INFO:teuthology.orchestra.run.smithi003.stdout: librados2 librbd1 2023-10-08T15:33:35.774 INFO:teuthology.orchestra.run.smithi098.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-10-08T15:33:35.780 INFO:teuthology.orchestra.run.smithi153.stdout:The following NEW packages will be installed: 2023-10-08T15:33:35.780 INFO:teuthology.orchestra.run.smithi153.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-10-08T15:33:35.780 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-10-08T15:33:35.780 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-10-08T15:33:35.782 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-10-08T15:33:35.782 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-10-08T15:33:35.782 INFO:teuthology.orchestra.run.smithi153.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-10-08T15:33:35.782 INFO:teuthology.orchestra.run.smithi153.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-10-08T15:33:35.783 INFO:teuthology.orchestra.run.smithi153.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-10-08T15:33:35.783 INFO:teuthology.orchestra.run.smithi153.stdout: nvme-cli python-natsort-doc python-pastedeploy-tpl python3-atomicwrites 2023-10-08T15:33:35.783 INFO:teuthology.orchestra.run.smithi153.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-10-08T15:33:35.783 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2023-10-08T15:33:35.783 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2023-10-08T15:33:35.783 INFO:teuthology.orchestra.run.smithi153.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2023-10-08T15:33:35.783 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2023-10-08T15:33:35.783 INFO:teuthology.orchestra.run.smithi153.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-10-08T15:33:35.783 INFO:teuthology.orchestra.run.smithi153.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-10-08T15:33:35.783 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-10-08T15:33:35.783 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-10-08T15:33:35.784 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-10-08T15:33:35.784 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-10-08T15:33:35.784 INFO:teuthology.orchestra.run.smithi153.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-10-08T15:33:35.784 INFO:teuthology.orchestra.run.smithi153.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-08T15:33:35.784 INFO:teuthology.orchestra.run.smithi153.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-08T15:33:35.784 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-10-08T15:33:35.784 INFO:teuthology.orchestra.run.smithi153.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-10-08T15:33:35.784 INFO:teuthology.orchestra.run.smithi153.stdout:The following packages will be upgraded: 2023-10-08T15:33:35.785 INFO:teuthology.orchestra.run.smithi153.stdout: librados2 librbd1 2023-10-08T15:33:35.785 INFO:teuthology.orchestra.run.smithi050.stdout:The following packages were automatically installed and are no longer required: 2023-10-08T15:33:35.786 INFO:teuthology.orchestra.run.smithi050.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-08T15:33:35.786 INFO:teuthology.orchestra.run.smithi050.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-08T15:33:35.786 INFO:teuthology.orchestra.run.smithi050.stdout:The following additional packages will be installed: 2023-10-08T15:33:35.786 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-10-08T15:33:35.786 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-10-08T15:33:35.787 INFO:teuthology.orchestra.run.smithi050.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-10-08T15:33:35.787 INFO:teuthology.orchestra.run.smithi050.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-10-08T15:33:35.787 INFO:teuthology.orchestra.run.smithi050.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-10-08T15:33:35.787 INFO:teuthology.orchestra.run.smithi089.stdout:2 upgraded, 114 newly installed, 0 to remove and 253 not upgraded. 2023-10-08T15:33:35.787 INFO:teuthology.orchestra.run.smithi089.stdout:Need to get 210 MB of archives. 2023-10-08T15:33:35.788 INFO:teuthology.orchestra.run.smithi089.stdout:After this operation, 981 MB of additional disk space will be used. 2023-10-08T15:33:35.788 INFO:teuthology.orchestra.run.smithi089.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-10-08T15:33:35.788 INFO:teuthology.orchestra.run.smithi050.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-10-08T15:33:35.788 INFO:teuthology.orchestra.run.smithi050.stdout: python-natsort-doc python-pastedeploy-tpl python3-atomicwrites python3-attr 2023-10-08T15:33:35.788 INFO:teuthology.orchestra.run.smithi050.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-10-08T15:33:35.788 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-argparse python3-ceph-common python3-cherrypy3 python3-cmd2 2023-10-08T15:33:35.788 INFO:teuthology.orchestra.run.smithi050.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-10-08T15:33:35.789 INFO:teuthology.orchestra.run.smithi050.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-10-08T15:33:35.789 INFO:teuthology.orchestra.run.smithi050.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-10-08T15:33:35.789 INFO:teuthology.orchestra.run.smithi050.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-10-08T15:33:35.789 INFO:teuthology.orchestra.run.smithi050.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-10-08T15:33:35.789 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-10-08T15:33:35.789 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-10-08T15:33:35.789 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2023-10-08T15:33:35.789 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2023-10-08T15:33:35.789 INFO:teuthology.orchestra.run.smithi050.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-08T15:33:35.789 INFO:teuthology.orchestra.run.smithi050.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-08T15:33:35.789 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-10-08T15:33:35.790 INFO:teuthology.orchestra.run.smithi050.stdout: qttranslations5-l10n socat xmlstarlet 2023-10-08T15:33:35.790 INFO:teuthology.orchestra.run.smithi050.stdout:Suggested packages: 2023-10-08T15:33:35.790 INFO:teuthology.orchestra.run.smithi050.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-10-08T15:33:35.790 INFO:teuthology.orchestra.run.smithi050.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-10-08T15:33:35.790 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-10-08T15:33:35.790 INFO:teuthology.orchestra.run.smithi050.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-10-08T15:33:35.790 INFO:teuthology.orchestra.run.smithi050.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-10-08T15:33:35.790 INFO:teuthology.orchestra.run.smithi050.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-10-08T15:33:35.790 INFO:teuthology.orchestra.run.smithi050.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-10-08T15:33:35.790 INFO:teuthology.orchestra.run.smithi050.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-10-08T15:33:35.791 INFO:teuthology.orchestra.run.smithi050.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-10-08T15:33:35.791 INFO:teuthology.orchestra.run.smithi050.stdout:Recommended packages: 2023-10-08T15:33:35.791 INFO:teuthology.orchestra.run.smithi050.stdout: btrfs-tools 2023-10-08T15:33:35.802 INFO:teuthology.orchestra.run.smithi098.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-10-08T15:33:35.804 INFO:teuthology.orchestra.run.smithi098.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-10-08T15:33:35.806 INFO:teuthology.orchestra.run.smithi098.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.2.6-1320-g08cac018-1focal [3,501 kB] 2023-10-08T15:33:35.808 INFO:teuthology.orchestra.run.smithi089.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-10-08T15:33:35.813 INFO:teuthology.orchestra.run.smithi098.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-10-08T15:33:35.816 INFO:teuthology.orchestra.run.smithi098.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-10-08T15:33:35.816 INFO:teuthology.orchestra.run.smithi089.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-10-08T15:33:35.831 INFO:teuthology.orchestra.run.smithi003.stdout:2 upgraded, 114 newly installed, 0 to remove and 253 not upgraded. 2023-10-08T15:33:35.831 INFO:teuthology.orchestra.run.smithi003.stdout:Need to get 210 MB of archives. 2023-10-08T15:33:35.831 INFO:teuthology.orchestra.run.smithi003.stdout:After this operation, 981 MB of additional disk space will be used. 2023-10-08T15:33:35.831 INFO:teuthology.orchestra.run.smithi003.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-10-08T15:33:35.833 INFO:teuthology.orchestra.run.smithi098.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-10-08T15:33:35.834 INFO:teuthology.orchestra.run.smithi098.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-10-08T15:33:35.839 INFO:teuthology.orchestra.run.smithi098.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-10-08T15:33:35.846 INFO:teuthology.orchestra.run.smithi089.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-10-08T15:33:35.852 INFO:teuthology.orchestra.run.smithi003.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-10-08T15:33:35.861 INFO:teuthology.orchestra.run.smithi003.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-10-08T15:33:35.865 INFO:teuthology.orchestra.run.smithi089.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.2.6-1320-g08cac018-1focal [3,501 kB] 2023-10-08T15:33:35.865 INFO:teuthology.orchestra.run.smithi098.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-10-08T15:33:35.868 INFO:teuthology.orchestra.run.smithi098.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-10-08T15:33:35.874 INFO:teuthology.orchestra.run.smithi098.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-10-08T15:33:35.876 INFO:teuthology.orchestra.run.smithi098.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-10-08T15:33:35.876 INFO:teuthology.orchestra.run.smithi098.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-10-08T15:33:35.878 INFO:teuthology.orchestra.run.smithi098.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-10-08T15:33:35.878 INFO:teuthology.orchestra.run.smithi098.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-10-08T15:33:35.879 INFO:teuthology.orchestra.run.smithi098.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-10-08T15:33:35.880 INFO:teuthology.orchestra.run.smithi098.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-10-08T15:33:35.880 INFO:teuthology.orchestra.run.smithi089.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-10-08T15:33:35.884 INFO:teuthology.orchestra.run.smithi089.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-10-08T15:33:35.886 INFO:teuthology.orchestra.run.smithi098.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-10-08T15:33:35.887 INFO:teuthology.orchestra.run.smithi098.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-10-08T15:33:35.890 INFO:teuthology.orchestra.run.smithi003.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-10-08T15:33:35.894 INFO:teuthology.orchestra.run.smithi089.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-10-08T15:33:35.897 INFO:teuthology.orchestra.run.smithi089.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-10-08T15:33:35.903 INFO:teuthology.orchestra.run.smithi098.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-10-08T15:33:35.904 INFO:teuthology.orchestra.run.smithi098.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-10-08T15:33:35.905 INFO:teuthology.orchestra.run.smithi098.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-10-08T15:33:35.905 INFO:teuthology.orchestra.run.smithi098.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-10-08T15:33:35.906 INFO:teuthology.orchestra.run.smithi098.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-10-08T15:33:35.907 INFO:teuthology.orchestra.run.smithi098.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-10-08T15:33:35.908 INFO:teuthology.orchestra.run.smithi098.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-10-08T15:33:35.909 INFO:teuthology.orchestra.run.smithi050.stdout:The following NEW packages will be installed: 2023-10-08T15:33:35.909 INFO:teuthology.orchestra.run.smithi050.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-10-08T15:33:35.909 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-10-08T15:33:35.909 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-10-08T15:33:35.909 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-10-08T15:33:35.910 INFO:teuthology.orchestra.run.smithi098.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-10-08T15:33:35.911 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-10-08T15:33:35.911 INFO:teuthology.orchestra.run.smithi050.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-10-08T15:33:35.911 INFO:teuthology.orchestra.run.smithi050.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-10-08T15:33:35.911 INFO:teuthology.orchestra.run.smithi050.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-10-08T15:33:35.912 INFO:teuthology.orchestra.run.smithi050.stdout: nvme-cli python-natsort-doc python-pastedeploy-tpl python3-atomicwrites 2023-10-08T15:33:35.912 INFO:teuthology.orchestra.run.smithi050.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-10-08T15:33:35.912 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2023-10-08T15:33:35.912 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2023-10-08T15:33:35.912 INFO:teuthology.orchestra.run.smithi050.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2023-10-08T15:33:35.912 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2023-10-08T15:33:35.912 INFO:teuthology.orchestra.run.smithi050.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-10-08T15:33:35.912 INFO:teuthology.orchestra.run.smithi050.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-10-08T15:33:35.912 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-10-08T15:33:35.912 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-10-08T15:33:35.912 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-10-08T15:33:35.913 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-10-08T15:33:35.913 INFO:teuthology.orchestra.run.smithi050.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-10-08T15:33:35.913 INFO:teuthology.orchestra.run.smithi050.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-08T15:33:35.913 INFO:teuthology.orchestra.run.smithi050.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-08T15:33:35.913 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-10-08T15:33:35.913 INFO:teuthology.orchestra.run.smithi050.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-10-08T15:33:35.913 INFO:teuthology.orchestra.run.smithi050.stdout:The following packages will be upgraded: 2023-10-08T15:33:35.913 INFO:teuthology.orchestra.run.smithi050.stdout: librados2 librbd1 2023-10-08T15:33:35.917 INFO:teuthology.orchestra.run.smithi089.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-10-08T15:33:35.919 INFO:teuthology.orchestra.run.smithi089.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-10-08T15:33:35.920 INFO:teuthology.orchestra.run.smithi098.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-10-08T15:33:35.920 INFO:teuthology.orchestra.run.smithi098.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-10-08T15:33:35.924 INFO:teuthology.orchestra.run.smithi003.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-10-08T15:33:35.925 INFO:teuthology.orchestra.run.smithi089.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-10-08T15:33:35.926 INFO:teuthology.orchestra.run.smithi003.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-10-08T15:33:35.929 INFO:teuthology.orchestra.run.smithi153.stdout:2 upgraded, 114 newly installed, 0 to remove and 253 not upgraded. 2023-10-08T15:33:35.929 INFO:teuthology.orchestra.run.smithi153.stdout:Need to get 210 MB of archives. 2023-10-08T15:33:35.929 INFO:teuthology.orchestra.run.smithi153.stdout:After this operation, 981 MB of additional disk space will be used. 2023-10-08T15:33:35.929 INFO:teuthology.orchestra.run.smithi153.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.2.6-1320-g08cac018-1focal [3,501 kB] 2023-10-08T15:33:35.936 INFO:teuthology.orchestra.run.smithi098.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-10-08T15:33:35.937 INFO:teuthology.orchestra.run.smithi098.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-10-08T15:33:35.937 INFO:teuthology.orchestra.run.smithi098.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-10-08T15:33:35.938 INFO:teuthology.orchestra.run.smithi098.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-10-08T15:33:35.939 INFO:teuthology.orchestra.run.smithi003.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-10-08T15:33:35.940 INFO:teuthology.orchestra.run.smithi098.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-10-08T15:33:35.940 INFO:teuthology.orchestra.run.smithi003.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-10-08T15:33:35.943 INFO:teuthology.orchestra.run.smithi098.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-10-08T15:33:35.944 INFO:teuthology.orchestra.run.smithi098.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-10-08T15:33:35.945 INFO:teuthology.orchestra.run.smithi098.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-10-08T15:33:35.953 INFO:teuthology.orchestra.run.smithi098.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-10-08T15:33:35.954 INFO:teuthology.orchestra.run.smithi098.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-10-08T15:33:35.957 INFO:teuthology.orchestra.run.smithi089.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-10-08T15:33:35.959 INFO:teuthology.orchestra.run.smithi089.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-10-08T15:33:35.963 INFO:teuthology.orchestra.run.smithi003.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-10-08T15:33:35.965 INFO:teuthology.orchestra.run.smithi003.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-10-08T15:33:35.967 INFO:teuthology.orchestra.run.smithi089.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-10-08T15:33:35.969 INFO:teuthology.orchestra.run.smithi098.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-10-08T15:33:35.970 INFO:teuthology.orchestra.run.smithi098.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-10-08T15:33:35.970 INFO:teuthology.orchestra.run.smithi089.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-10-08T15:33:35.971 INFO:teuthology.orchestra.run.smithi098.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-10-08T15:33:35.971 INFO:teuthology.orchestra.run.smithi089.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-10-08T15:33:35.973 INFO:teuthology.orchestra.run.smithi089.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-10-08T15:33:35.973 INFO:teuthology.orchestra.run.smithi003.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-10-08T15:33:35.974 INFO:teuthology.orchestra.run.smithi089.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-10-08T15:33:35.974 INFO:teuthology.orchestra.run.smithi089.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-10-08T15:33:35.975 INFO:teuthology.orchestra.run.smithi089.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-10-08T15:33:35.976 INFO:teuthology.orchestra.run.smithi153.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-10-08T15:33:35.976 INFO:teuthology.orchestra.run.smithi050.stdout:2 upgraded, 114 newly installed, 0 to remove and 253 not upgraded. 2023-10-08T15:33:35.976 INFO:teuthology.orchestra.run.smithi050.stdout:Need to get 210 MB of archives. 2023-10-08T15:33:35.976 INFO:teuthology.orchestra.run.smithi050.stdout:After this operation, 981 MB of additional disk space will be used. 2023-10-08T15:33:35.976 INFO:teuthology.orchestra.run.smithi050.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-10-08T15:33:35.984 INFO:teuthology.orchestra.run.smithi003.stdout:Get:12 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.2.6-1320-g08cac018-1focal [3,501 kB] 2023-10-08T15:33:35.986 INFO:teuthology.orchestra.run.smithi089.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-10-08T15:33:35.987 INFO:teuthology.orchestra.run.smithi089.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-10-08T15:33:35.994 INFO:teuthology.orchestra.run.smithi050.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-10-08T15:33:36.001 INFO:teuthology.orchestra.run.smithi050.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-10-08T15:33:36.006 INFO:teuthology.orchestra.run.smithi003.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-10-08T15:33:36.007 INFO:teuthology.orchestra.run.smithi089.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-10-08T15:33:36.007 INFO:teuthology.orchestra.run.smithi089.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-10-08T15:33:36.008 INFO:teuthology.orchestra.run.smithi003.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-10-08T15:33:36.009 INFO:teuthology.orchestra.run.smithi089.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-10-08T15:33:36.010 INFO:teuthology.orchestra.run.smithi089.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-10-08T15:33:36.010 INFO:teuthology.orchestra.run.smithi089.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-10-08T15:33:36.012 INFO:teuthology.orchestra.run.smithi089.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-10-08T15:33:36.013 INFO:teuthology.orchestra.run.smithi089.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-10-08T15:33:36.015 INFO:teuthology.orchestra.run.smithi089.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-10-08T15:33:36.016 INFO:teuthology.orchestra.run.smithi003.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-10-08T15:33:36.018 INFO:teuthology.orchestra.run.smithi003.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-10-08T15:33:36.019 INFO:teuthology.orchestra.run.smithi003.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-10-08T15:33:36.021 INFO:teuthology.orchestra.run.smithi003.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-10-08T15:33:36.021 INFO:teuthology.orchestra.run.smithi003.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-10-08T15:33:36.022 INFO:teuthology.orchestra.run.smithi003.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-10-08T15:33:36.023 INFO:teuthology.orchestra.run.smithi003.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-10-08T15:33:36.026 INFO:teuthology.orchestra.run.smithi089.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-10-08T15:33:36.027 INFO:teuthology.orchestra.run.smithi050.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-10-08T15:33:36.029 INFO:teuthology.orchestra.run.smithi089.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-10-08T15:33:36.034 INFO:teuthology.orchestra.run.smithi003.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-10-08T15:33:36.034 INFO:teuthology.orchestra.run.smithi003.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-10-08T15:33:36.046 INFO:teuthology.orchestra.run.smithi089.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-10-08T15:33:36.046 INFO:teuthology.orchestra.run.smithi089.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-10-08T15:33:36.047 INFO:teuthology.orchestra.run.smithi089.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-10-08T15:33:36.048 INFO:teuthology.orchestra.run.smithi089.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-10-08T15:33:36.050 INFO:teuthology.orchestra.run.smithi089.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-10-08T15:33:36.053 INFO:teuthology.orchestra.run.smithi089.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-10-08T15:33:36.053 INFO:teuthology.orchestra.run.smithi003.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-10-08T15:33:36.054 INFO:teuthology.orchestra.run.smithi003.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-10-08T15:33:36.054 INFO:teuthology.orchestra.run.smithi089.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-10-08T15:33:36.055 INFO:teuthology.orchestra.run.smithi089.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-10-08T15:33:36.056 INFO:teuthology.orchestra.run.smithi050.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-10-08T15:33:36.056 INFO:teuthology.orchestra.run.smithi003.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-10-08T15:33:36.057 INFO:teuthology.orchestra.run.smithi003.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-10-08T15:33:36.058 INFO:teuthology.orchestra.run.smithi050.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-10-08T15:33:36.058 INFO:teuthology.orchestra.run.smithi098.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-10-08T15:33:36.058 INFO:teuthology.orchestra.run.smithi003.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-10-08T15:33:36.059 INFO:teuthology.orchestra.run.smithi153.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-10-08T15:33:36.059 INFO:teuthology.orchestra.run.smithi003.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-10-08T15:33:36.061 INFO:teuthology.orchestra.run.smithi003.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-10-08T15:33:36.062 INFO:teuthology.orchestra.run.smithi003.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-10-08T15:33:36.065 INFO:teuthology.orchestra.run.smithi089.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-10-08T15:33:36.067 INFO:teuthology.orchestra.run.smithi050.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-10-08T15:33:36.067 INFO:teuthology.orchestra.run.smithi089.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-10-08T15:33:36.070 INFO:teuthology.orchestra.run.smithi050.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-10-08T15:33:36.072 INFO:teuthology.orchestra.run.smithi003.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-10-08T15:33:36.073 INFO:teuthology.orchestra.run.smithi003.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-10-08T15:33:36.073 INFO:teuthology.orchestra.run.smithi098.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-10-08T15:33:36.075 INFO:teuthology.orchestra.run.smithi098.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-10-08T15:33:36.085 INFO:teuthology.orchestra.run.smithi089.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-10-08T15:33:36.085 INFO:teuthology.orchestra.run.smithi089.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-10-08T15:33:36.086 INFO:teuthology.orchestra.run.smithi089.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-10-08T15:33:36.087 INFO:teuthology.orchestra.run.smithi050.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-10-08T15:33:36.087 INFO:teuthology.orchestra.run.smithi098.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-10-08T15:33:36.087 INFO:teuthology.orchestra.run.smithi098.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-10-08T15:33:36.088 INFO:teuthology.orchestra.run.smithi050.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-10-08T15:33:36.093 INFO:teuthology.orchestra.run.smithi050.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-10-08T15:33:36.094 INFO:teuthology.orchestra.run.smithi153.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-10-08T15:33:36.102 INFO:teuthology.orchestra.run.smithi003.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-10-08T15:33:36.103 INFO:teuthology.orchestra.run.smithi003.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-10-08T15:33:36.104 INFO:teuthology.orchestra.run.smithi003.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-10-08T15:33:36.105 INFO:teuthology.orchestra.run.smithi003.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-10-08T15:33:36.107 INFO:teuthology.orchestra.run.smithi003.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-10-08T15:33:36.110 INFO:teuthology.orchestra.run.smithi003.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-10-08T15:33:36.111 INFO:teuthology.orchestra.run.smithi003.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-10-08T15:33:36.112 INFO:teuthology.orchestra.run.smithi003.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-10-08T15:33:36.120 INFO:teuthology.orchestra.run.smithi050.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-10-08T15:33:36.122 INFO:teuthology.orchestra.run.smithi050.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-10-08T15:33:36.128 INFO:teuthology.orchestra.run.smithi050.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-10-08T15:33:36.130 INFO:teuthology.orchestra.run.smithi050.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-10-08T15:33:36.130 INFO:teuthology.orchestra.run.smithi050.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-10-08T15:33:36.132 INFO:teuthology.orchestra.run.smithi050.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-10-08T15:33:36.134 INFO:teuthology.orchestra.run.smithi050.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-10-08T15:33:36.134 INFO:teuthology.orchestra.run.smithi050.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-10-08T15:33:36.135 INFO:teuthology.orchestra.run.smithi050.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-10-08T15:33:36.138 INFO:teuthology.orchestra.run.smithi003.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-10-08T15:33:36.140 INFO:teuthology.orchestra.run.smithi003.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-10-08T15:33:36.141 INFO:teuthology.orchestra.run.smithi050.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-10-08T15:33:36.141 INFO:teuthology.orchestra.run.smithi050.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-10-08T15:33:36.153 INFO:teuthology.orchestra.run.smithi098.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-10-08T15:33:36.154 INFO:teuthology.orchestra.run.smithi098.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-10-08T15:33:36.157 INFO:teuthology.orchestra.run.smithi098.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-10-08T15:33:36.157 INFO:teuthology.orchestra.run.smithi050.stdout:Get:23 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.2.6-1320-g08cac018-1focal [3,501 kB] 2023-10-08T15:33:36.158 INFO:teuthology.orchestra.run.smithi098.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-10-08T15:33:36.158 INFO:teuthology.orchestra.run.smithi098.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-10-08T15:33:36.158 INFO:teuthology.orchestra.run.smithi050.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-10-08T15:33:36.158 INFO:teuthology.orchestra.run.smithi050.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-10-08T15:33:36.159 INFO:teuthology.orchestra.run.smithi098.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-10-08T15:33:36.159 INFO:teuthology.orchestra.run.smithi050.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-10-08T15:33:36.160 INFO:teuthology.orchestra.run.smithi098.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-10-08T15:33:36.160 INFO:teuthology.orchestra.run.smithi050.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-10-08T15:33:36.161 INFO:teuthology.orchestra.run.smithi050.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-10-08T15:33:36.162 INFO:teuthology.orchestra.run.smithi050.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-10-08T15:33:36.163 INFO:teuthology.orchestra.run.smithi050.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-10-08T15:33:36.165 INFO:teuthology.orchestra.run.smithi050.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-10-08T15:33:36.170 INFO:teuthology.orchestra.run.smithi098.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-10-08T15:33:36.171 INFO:teuthology.orchestra.run.smithi003.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-10-08T15:33:36.171 INFO:teuthology.orchestra.run.smithi003.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-10-08T15:33:36.173 INFO:teuthology.orchestra.run.smithi003.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-10-08T15:33:36.174 INFO:teuthology.orchestra.run.smithi098.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-10-08T15:33:36.174 INFO:teuthology.orchestra.run.smithi050.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-10-08T15:33:36.175 INFO:teuthology.orchestra.run.smithi050.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-10-08T15:33:36.176 INFO:teuthology.orchestra.run.smithi098.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-10-08T15:33:36.187 INFO:teuthology.orchestra.run.smithi098.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-10-08T15:33:36.187 INFO:teuthology.orchestra.run.smithi098.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-10-08T15:33:36.190 INFO:teuthology.orchestra.run.smithi098.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-10-08T15:33:36.191 INFO:teuthology.orchestra.run.smithi050.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-10-08T15:33:36.192 INFO:teuthology.orchestra.run.smithi050.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-10-08T15:33:36.192 INFO:teuthology.orchestra.run.smithi050.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-10-08T15:33:36.193 INFO:teuthology.orchestra.run.smithi098.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-10-08T15:33:36.193 INFO:teuthology.orchestra.run.smithi098.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-10-08T15:33:36.193 INFO:teuthology.orchestra.run.smithi050.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-10-08T15:33:36.195 INFO:teuthology.orchestra.run.smithi050.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-10-08T15:33:36.198 INFO:teuthology.orchestra.run.smithi050.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-10-08T15:33:36.200 INFO:teuthology.orchestra.run.smithi050.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-10-08T15:33:36.200 INFO:teuthology.orchestra.run.smithi050.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-10-08T15:33:36.208 INFO:teuthology.orchestra.run.smithi050.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-10-08T15:33:36.209 INFO:teuthology.orchestra.run.smithi050.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-10-08T15:33:36.212 INFO:teuthology.orchestra.run.smithi098.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-10-08T15:33:36.215 INFO:teuthology.orchestra.run.smithi098.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-10-08T15:33:36.217 INFO:teuthology.orchestra.run.smithi153.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-10-08T15:33:36.225 INFO:teuthology.orchestra.run.smithi050.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-10-08T15:33:36.225 INFO:teuthology.orchestra.run.smithi050.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-10-08T15:33:36.226 INFO:teuthology.orchestra.run.smithi050.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-10-08T15:33:36.253 INFO:teuthology.orchestra.run.smithi098.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-10-08T15:33:36.253 INFO:teuthology.orchestra.run.smithi098.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-10-08T15:33:36.254 INFO:teuthology.orchestra.run.smithi098.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-10-08T15:33:36.254 INFO:teuthology.orchestra.run.smithi098.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-10-08T15:33:36.255 INFO:teuthology.orchestra.run.smithi098.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-10-08T15:33:36.255 INFO:teuthology.orchestra.run.smithi098.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-10-08T15:33:36.267 INFO:teuthology.orchestra.run.smithi098.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-10-08T15:33:36.267 INFO:teuthology.orchestra.run.smithi098.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-10-08T15:33:36.268 INFO:teuthology.orchestra.run.smithi098.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-10-08T15:33:36.270 INFO:teuthology.orchestra.run.smithi098.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-10-08T15:33:36.271 INFO:teuthology.orchestra.run.smithi089.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-10-08T15:33:36.286 INFO:teuthology.orchestra.run.smithi098.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-10-08T15:33:36.288 INFO:teuthology.orchestra.run.smithi098.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-10-08T15:33:36.288 INFO:teuthology.orchestra.run.smithi098.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-10-08T15:33:36.292 INFO:teuthology.orchestra.run.smithi098.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-10-08T15:33:36.293 INFO:teuthology.orchestra.run.smithi098.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-10-08T15:33:36.311 INFO:teuthology.orchestra.run.smithi050.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-10-08T15:33:36.327 INFO:teuthology.orchestra.run.smithi050.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-10-08T15:33:36.328 INFO:teuthology.orchestra.run.smithi050.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-10-08T15:33:36.342 INFO:teuthology.orchestra.run.smithi050.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-10-08T15:33:36.356 INFO:teuthology.orchestra.run.smithi153.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-10-08T15:33:36.359 INFO:teuthology.orchestra.run.smithi089.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-10-08T15:33:36.361 INFO:teuthology.orchestra.run.smithi089.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-10-08T15:33:36.365 INFO:teuthology.orchestra.run.smithi153.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-10-08T15:33:36.383 INFO:teuthology.orchestra.run.smithi089.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-10-08T15:33:36.383 INFO:teuthology.orchestra.run.smithi089.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-10-08T15:33:36.384 INFO:teuthology.orchestra.run.smithi089.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-10-08T15:33:36.384 INFO:teuthology.orchestra.run.smithi089.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-10-08T15:33:36.385 INFO:teuthology.orchestra.run.smithi089.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-10-08T15:33:36.386 INFO:teuthology.orchestra.run.smithi089.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-10-08T15:33:36.386 INFO:teuthology.orchestra.run.smithi089.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-10-08T15:33:36.396 INFO:teuthology.orchestra.run.smithi089.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-10-08T15:33:36.407 INFO:teuthology.orchestra.run.smithi089.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-10-08T15:33:36.408 INFO:teuthology.orchestra.run.smithi089.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-10-08T15:33:36.410 INFO:teuthology.orchestra.run.smithi153.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-10-08T15:33:36.412 INFO:teuthology.orchestra.run.smithi089.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-10-08T15:33:36.413 INFO:teuthology.orchestra.run.smithi050.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-10-08T15:33:36.414 INFO:teuthology.orchestra.run.smithi050.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-10-08T15:33:36.414 INFO:teuthology.orchestra.run.smithi050.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-10-08T15:33:36.415 INFO:teuthology.orchestra.run.smithi089.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-10-08T15:33:36.415 INFO:teuthology.orchestra.run.smithi050.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-10-08T15:33:36.416 INFO:teuthology.orchestra.run.smithi050.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-10-08T15:33:36.416 INFO:teuthology.orchestra.run.smithi003.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-10-08T15:33:36.417 INFO:teuthology.orchestra.run.smithi089.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-10-08T15:33:36.417 INFO:teuthology.orchestra.run.smithi050.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-10-08T15:33:36.418 INFO:teuthology.orchestra.run.smithi089.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-10-08T15:33:36.418 INFO:teuthology.orchestra.run.smithi050.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-10-08T15:33:36.419 INFO:teuthology.orchestra.run.smithi050.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-10-08T15:33:36.420 INFO:teuthology.orchestra.run.smithi089.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-10-08T15:33:36.421 INFO:teuthology.orchestra.run.smithi153.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-10-08T15:33:36.422 INFO:teuthology.orchestra.run.smithi089.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-10-08T15:33:36.427 INFO:teuthology.orchestra.run.smithi089.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-10-08T15:33:36.430 INFO:teuthology.orchestra.run.smithi050.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-10-08T15:33:36.438 INFO:teuthology.orchestra.run.smithi050.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-10-08T15:33:36.438 INFO:teuthology.orchestra.run.smithi003.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-10-08T15:33:36.440 INFO:teuthology.orchestra.run.smithi050.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-10-08T15:33:36.440 INFO:teuthology.orchestra.run.smithi003.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-10-08T15:33:36.442 INFO:teuthology.orchestra.run.smithi050.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-10-08T15:33:36.442 INFO:teuthology.orchestra.run.smithi050.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-10-08T15:33:36.446 INFO:teuthology.orchestra.run.smithi050.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-10-08T15:33:36.450 INFO:teuthology.orchestra.run.smithi050.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-10-08T15:33:36.450 INFO:teuthology.orchestra.run.smithi050.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-10-08T15:33:36.454 INFO:teuthology.orchestra.run.smithi089.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-10-08T15:33:36.457 INFO:teuthology.orchestra.run.smithi003.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-10-08T15:33:36.457 INFO:teuthology.orchestra.run.smithi003.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-10-08T15:33:36.458 INFO:teuthology.orchestra.run.smithi089.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-10-08T15:33:36.458 INFO:teuthology.orchestra.run.smithi003.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-10-08T15:33:36.459 INFO:teuthology.orchestra.run.smithi003.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-10-08T15:33:36.460 INFO:teuthology.orchestra.run.smithi003.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-10-08T15:33:36.461 INFO:teuthology.orchestra.run.smithi003.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-10-08T15:33:36.463 INFO:teuthology.orchestra.run.smithi003.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-10-08T15:33:36.466 INFO:teuthology.orchestra.run.smithi050.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-10-08T15:33:36.468 INFO:teuthology.orchestra.run.smithi050.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-10-08T15:33:36.488 INFO:teuthology.orchestra.run.smithi003.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-10-08T15:33:36.488 INFO:teuthology.orchestra.run.smithi003.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-10-08T15:33:36.504 INFO:teuthology.orchestra.run.smithi153.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-10-08T15:33:36.506 INFO:teuthology.orchestra.run.smithi050.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-10-08T15:33:36.507 INFO:teuthology.orchestra.run.smithi050.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-10-08T15:33:36.508 INFO:teuthology.orchestra.run.smithi050.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-10-08T15:33:36.508 INFO:teuthology.orchestra.run.smithi050.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-10-08T15:33:36.508 INFO:teuthology.orchestra.run.smithi050.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-10-08T15:33:36.509 INFO:teuthology.orchestra.run.smithi153.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-10-08T15:33:36.509 INFO:teuthology.orchestra.run.smithi050.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-10-08T15:33:36.514 INFO:teuthology.orchestra.run.smithi089.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-10-08T15:33:36.515 INFO:teuthology.orchestra.run.smithi089.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-10-08T15:33:36.516 INFO:teuthology.orchestra.run.smithi089.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-10-08T15:33:36.516 INFO:teuthology.orchestra.run.smithi089.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-10-08T15:33:36.516 INFO:teuthology.orchestra.run.smithi089.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-10-08T15:33:36.517 INFO:teuthology.orchestra.run.smithi003.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-10-08T15:33:36.517 INFO:teuthology.orchestra.run.smithi089.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-10-08T15:33:36.521 INFO:teuthology.orchestra.run.smithi050.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-10-08T15:33:36.521 INFO:teuthology.orchestra.run.smithi050.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-10-08T15:33:36.521 INFO:teuthology.orchestra.run.smithi050.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-10-08T15:33:36.522 INFO:teuthology.orchestra.run.smithi003.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-10-08T15:33:36.525 INFO:teuthology.orchestra.run.smithi003.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-10-08T15:33:36.526 INFO:teuthology.orchestra.run.smithi003.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-10-08T15:33:36.527 INFO:teuthology.orchestra.run.smithi003.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-10-08T15:33:36.530 INFO:teuthology.orchestra.run.smithi003.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-10-08T15:33:36.532 INFO:teuthology.orchestra.run.smithi153.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-10-08T15:33:36.532 INFO:teuthology.orchestra.run.smithi003.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-10-08T15:33:36.533 INFO:teuthology.orchestra.run.smithi003.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-10-08T15:33:36.536 INFO:teuthology.orchestra.run.smithi098.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.2.6-1320-g08cac018-1focal [3,552 kB] 2023-10-08T15:33:36.544 INFO:teuthology.orchestra.run.smithi050.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-10-08T15:33:36.546 INFO:teuthology.orchestra.run.smithi050.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-10-08T15:33:36.548 INFO:teuthology.orchestra.run.smithi050.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-10-08T15:33:36.548 INFO:teuthology.orchestra.run.smithi050.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-10-08T15:33:36.551 INFO:teuthology.orchestra.run.smithi050.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-10-08T15:33:36.552 INFO:teuthology.orchestra.run.smithi050.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-10-08T15:33:36.557 INFO:teuthology.orchestra.run.smithi089.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-10-08T15:33:36.557 INFO:teuthology.orchestra.run.smithi089.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-10-08T15:33:36.557 INFO:teuthology.orchestra.run.smithi089.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-10-08T15:33:36.558 INFO:teuthology.orchestra.run.smithi089.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-10-08T15:33:36.562 INFO:teuthology.orchestra.run.smithi003.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-10-08T15:33:36.565 INFO:teuthology.orchestra.run.smithi003.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-10-08T15:33:36.586 INFO:teuthology.orchestra.run.smithi089.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-10-08T15:33:36.588 INFO:teuthology.orchestra.run.smithi089.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-10-08T15:33:36.588 INFO:teuthology.orchestra.run.smithi089.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-10-08T15:33:36.591 INFO:teuthology.orchestra.run.smithi089.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-10-08T15:33:36.592 INFO:teuthology.orchestra.run.smithi089.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-10-08T15:33:36.614 INFO:teuthology.orchestra.run.smithi089.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.2.6-1320-g08cac018-1focal [3,552 kB] 2023-10-08T15:33:36.631 INFO:teuthology.orchestra.run.smithi003.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-10-08T15:33:36.632 INFO:teuthology.orchestra.run.smithi003.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-10-08T15:33:36.632 INFO:teuthology.orchestra.run.smithi003.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-10-08T15:33:36.633 INFO:teuthology.orchestra.run.smithi003.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-10-08T15:33:36.633 INFO:teuthology.orchestra.run.smithi003.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-10-08T15:33:36.634 INFO:teuthology.orchestra.run.smithi003.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-10-08T15:33:36.645 INFO:teuthology.orchestra.run.smithi003.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-10-08T15:33:36.646 INFO:teuthology.orchestra.run.smithi003.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-10-08T15:33:36.671 INFO:teuthology.orchestra.run.smithi003.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-10-08T15:33:36.671 INFO:teuthology.orchestra.run.smithi003.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-10-08T15:33:36.674 INFO:teuthology.orchestra.run.smithi003.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-10-08T15:33:36.675 INFO:teuthology.orchestra.run.smithi003.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-10-08T15:33:36.676 INFO:teuthology.orchestra.run.smithi003.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-10-08T15:33:36.679 INFO:teuthology.orchestra.run.smithi003.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-10-08T15:33:36.680 INFO:teuthology.orchestra.run.smithi003.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-10-08T15:33:36.778 INFO:teuthology.orchestra.run.smithi153.stdout:Get:13 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.2.6-1320-g08cac018-1focal [3,552 kB] 2023-10-08T15:33:36.821 INFO:teuthology.orchestra.run.smithi153.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-10-08T15:33:36.937 INFO:teuthology.orchestra.run.smithi098.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.2.6-1320-g08cac018-1focal [760 kB] 2023-10-08T15:33:37.042 INFO:teuthology.orchestra.run.smithi098.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.2.6-1320-g08cac018-1focal [414 kB] 2023-10-08T15:33:37.108 INFO:teuthology.orchestra.run.smithi098.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.2.6-1320-g08cac018-1focal [22.6 kB] 2023-10-08T15:33:37.109 INFO:teuthology.orchestra.run.smithi098.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.2.6-1320-g08cac018-1focal [200 kB] 2023-10-08T15:33:37.118 INFO:teuthology.orchestra.run.smithi098.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.2.6-1320-g08cac018-1focal [47.2 kB] 2023-10-08T15:33:37.119 INFO:teuthology.orchestra.run.smithi098.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.2.6-1320-g08cac018-1focal [386 kB] 2023-10-08T15:33:37.156 INFO:teuthology.orchestra.run.smithi089.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.2.6-1320-g08cac018-1focal [760 kB] 2023-10-08T15:33:37.175 INFO:teuthology.orchestra.run.smithi098.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.2.6-1320-g08cac018-1focal [5,568 kB] 2023-10-08T15:33:37.254 INFO:teuthology.orchestra.run.smithi153.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-10-08T15:33:37.331 INFO:teuthology.orchestra.run.smithi089.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.2.6-1320-g08cac018-1focal [414 kB] 2023-10-08T15:33:37.366 INFO:teuthology.orchestra.run.smithi089.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.2.6-1320-g08cac018-1focal [22.6 kB] 2023-10-08T15:33:37.367 INFO:teuthology.orchestra.run.smithi089.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.2.6-1320-g08cac018-1focal [200 kB] 2023-10-08T15:33:37.375 INFO:teuthology.orchestra.run.smithi089.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.2.6-1320-g08cac018-1focal [47.2 kB] 2023-10-08T15:33:37.397 INFO:teuthology.orchestra.run.smithi089.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.2.6-1320-g08cac018-1focal [386 kB] 2023-10-08T15:33:37.405 INFO:teuthology.orchestra.run.smithi153.stdout:Get:16 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.2.6-1320-g08cac018-1focal [760 kB] 2023-10-08T15:33:37.435 INFO:teuthology.orchestra.run.smithi153.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-10-08T15:33:37.467 INFO:teuthology.orchestra.run.smithi153.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-10-08T15:33:37.472 INFO:teuthology.orchestra.run.smithi153.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-10-08T15:33:37.484 INFO:teuthology.orchestra.run.smithi089.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.2.6-1320-g08cac018-1focal [5,568 kB] 2023-10-08T15:33:37.497 INFO:teuthology.orchestra.run.smithi153.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-10-08T15:33:37.502 INFO:teuthology.orchestra.run.smithi153.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-10-08T15:33:37.505 INFO:teuthology.orchestra.run.smithi153.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-10-08T15:33:37.518 INFO:teuthology.orchestra.run.smithi153.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-10-08T15:33:37.520 INFO:teuthology.orchestra.run.smithi153.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-10-08T15:33:37.521 INFO:teuthology.orchestra.run.smithi153.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-10-08T15:33:37.549 INFO:teuthology.orchestra.run.smithi153.stdout:Get:26 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.2.6-1320-g08cac018-1focal [414 kB] 2023-10-08T15:33:37.644 INFO:teuthology.orchestra.run.smithi153.stdout:Get:27 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.2.6-1320-g08cac018-1focal [22.6 kB] 2023-10-08T15:33:37.645 INFO:teuthology.orchestra.run.smithi153.stdout:Get:28 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.2.6-1320-g08cac018-1focal [200 kB] 2023-10-08T15:33:37.655 INFO:teuthology.orchestra.run.smithi153.stdout:Get:29 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.2.6-1320-g08cac018-1focal [47.2 kB] 2023-10-08T15:33:37.686 INFO:teuthology.orchestra.run.smithi153.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-10-08T15:33:37.721 INFO:teuthology.orchestra.run.smithi153.stdout:Get:31 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.2.6-1320-g08cac018-1focal [386 kB] 2023-10-08T15:33:37.846 INFO:teuthology.orchestra.run.smithi050.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.2.6-1320-g08cac018-1focal [3,552 kB] 2023-10-08T15:33:37.850 INFO:teuthology.orchestra.run.smithi153.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-10-08T15:33:37.864 INFO:teuthology.orchestra.run.smithi153.stdout:Get:33 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.2.6-1320-g08cac018-1focal [5,568 kB] 2023-10-08T15:33:37.991 INFO:teuthology.orchestra.run.smithi153.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-10-08T15:33:38.010 INFO:teuthology.orchestra.run.smithi153.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-10-08T15:33:38.022 INFO:teuthology.orchestra.run.smithi153.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-10-08T15:33:38.098 INFO:teuthology.orchestra.run.smithi153.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-10-08T15:33:38.120 INFO:teuthology.orchestra.run.smithi153.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-10-08T15:33:38.148 INFO:teuthology.orchestra.run.smithi098.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.2.6-1320-g08cac018-1focal [116 kB] 2023-10-08T15:33:38.159 INFO:teuthology.orchestra.run.smithi098.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.2.6-1320-g08cac018-1focal [479 kB] 2023-10-08T15:33:38.160 INFO:teuthology.orchestra.run.smithi153.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-10-08T15:33:38.190 INFO:teuthology.orchestra.run.smithi153.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-10-08T15:33:38.194 INFO:teuthology.orchestra.run.smithi153.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-10-08T15:33:38.281 INFO:teuthology.orchestra.run.smithi098.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.2.6-1320-g08cac018-1focal [27.8 MB] 2023-10-08T15:33:38.289 INFO:teuthology.orchestra.run.smithi153.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-10-08T15:33:38.453 INFO:teuthology.orchestra.run.smithi153.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-10-08T15:33:38.531 INFO:teuthology.orchestra.run.smithi050.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.2.6-1320-g08cac018-1focal [760 kB] 2023-10-08T15:33:38.618 INFO:teuthology.orchestra.run.smithi050.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.2.6-1320-g08cac018-1focal [414 kB] 2023-10-08T15:33:38.637 INFO:teuthology.orchestra.run.smithi153.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-10-08T15:33:38.651 INFO:teuthology.orchestra.run.smithi089.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.2.6-1320-g08cac018-1focal [116 kB] 2023-10-08T15:33:38.668 INFO:teuthology.orchestra.run.smithi050.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.2.6-1320-g08cac018-1focal [22.6 kB] 2023-10-08T15:33:38.669 INFO:teuthology.orchestra.run.smithi050.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.2.6-1320-g08cac018-1focal [200 kB] 2023-10-08T15:33:38.684 INFO:teuthology.orchestra.run.smithi089.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.2.6-1320-g08cac018-1focal [479 kB] 2023-10-08T15:33:38.686 INFO:teuthology.orchestra.run.smithi153.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-10-08T15:33:38.707 INFO:teuthology.orchestra.run.smithi050.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.2.6-1320-g08cac018-1focal [47.2 kB] 2023-10-08T15:33:38.709 INFO:teuthology.orchestra.run.smithi050.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.2.6-1320-g08cac018-1focal [386 kB] 2023-10-08T15:33:38.753 INFO:teuthology.orchestra.run.smithi050.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.2.6-1320-g08cac018-1focal [5,568 kB] 2023-10-08T15:33:38.769 INFO:teuthology.orchestra.run.smithi089.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.2.6-1320-g08cac018-1focal [27.8 MB] 2023-10-08T15:33:38.774 INFO:teuthology.orchestra.run.smithi003.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.2.6-1320-g08cac018-1focal [3,552 kB] 2023-10-08T15:33:38.817 INFO:teuthology.orchestra.run.smithi153.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-10-08T15:33:38.922 INFO:teuthology.orchestra.run.smithi153.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-10-08T15:33:38.951 INFO:teuthology.orchestra.run.smithi153.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-10-08T15:33:38.954 INFO:teuthology.orchestra.run.smithi153.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-10-08T15:33:38.978 INFO:teuthology.orchestra.run.smithi153.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-10-08T15:33:39.000 INFO:teuthology.orchestra.run.smithi153.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-10-08T15:33:39.016 INFO:teuthology.orchestra.run.smithi153.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-10-08T15:33:39.018 INFO:teuthology.orchestra.run.smithi153.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-10-08T15:33:39.110 INFO:teuthology.orchestra.run.smithi153.stdout:Get:54 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.2.6-1320-g08cac018-1focal [116 kB] 2023-10-08T15:33:39.116 INFO:teuthology.orchestra.run.smithi153.stdout:Get:55 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.2.6-1320-g08cac018-1focal [479 kB] 2023-10-08T15:33:39.186 INFO:teuthology.orchestra.run.smithi153.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-10-08T15:33:39.235 INFO:teuthology.orchestra.run.smithi153.stdout:Get:57 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.2.6-1320-g08cac018-1focal [27.8 MB] 2023-10-08T15:33:39.267 INFO:teuthology.orchestra.run.smithi050.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.2.6-1320-g08cac018-1focal [116 kB] 2023-10-08T15:33:39.271 INFO:teuthology.orchestra.run.smithi050.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.2.6-1320-g08cac018-1focal [479 kB] 2023-10-08T15:33:39.323 INFO:teuthology.orchestra.run.smithi050.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.2.6-1320-g08cac018-1focal [27.8 MB] 2023-10-08T15:33:40.167 INFO:teuthology.orchestra.run.smithi153.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-10-08T15:33:40.190 INFO:teuthology.orchestra.run.smithi153.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-10-08T15:33:40.192 INFO:teuthology.orchestra.run.smithi153.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-10-08T15:33:40.264 INFO:teuthology.orchestra.run.smithi153.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-10-08T15:33:40.264 INFO:teuthology.orchestra.run.smithi153.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-10-08T15:33:40.264 INFO:teuthology.orchestra.run.smithi153.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-10-08T15:33:40.265 INFO:teuthology.orchestra.run.smithi153.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-10-08T15:33:40.265 INFO:teuthology.orchestra.run.smithi153.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-10-08T15:33:40.266 INFO:teuthology.orchestra.run.smithi153.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-10-08T15:33:40.266 INFO:teuthology.orchestra.run.smithi153.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-10-08T15:33:40.430 INFO:teuthology.orchestra.run.smithi153.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-10-08T15:33:40.597 INFO:teuthology.orchestra.run.smithi153.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-10-08T15:33:40.679 INFO:teuthology.orchestra.run.smithi153.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-10-08T15:33:40.912 INFO:teuthology.orchestra.run.smithi153.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-10-08T15:33:40.958 INFO:teuthology.orchestra.run.smithi153.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-10-08T15:33:40.985 INFO:teuthology.orchestra.run.smithi153.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-10-08T15:33:40.995 INFO:teuthology.orchestra.run.smithi153.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-10-08T15:33:41.043 INFO:teuthology.orchestra.run.smithi153.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-10-08T15:33:41.072 INFO:teuthology.orchestra.run.smithi153.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-10-08T15:33:41.074 INFO:teuthology.orchestra.run.smithi153.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-10-08T15:33:41.193 INFO:teuthology.orchestra.run.smithi153.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-10-08T15:33:41.367 INFO:teuthology.orchestra.run.smithi153.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-10-08T15:33:41.367 INFO:teuthology.orchestra.run.smithi050.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.2.6-1320-g08cac018-1focal [6,450 kB] 2023-10-08T15:33:41.396 INFO:teuthology.orchestra.run.smithi003.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.2.6-1320-g08cac018-1focal [760 kB] 2023-10-08T15:33:41.671 INFO:teuthology.orchestra.run.smithi050.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.2.6-1320-g08cac018-1focal [221 kB] 2023-10-08T15:33:41.705 INFO:teuthology.orchestra.run.smithi050.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 17.2.6-1320-g08cac018-1focal [152 kB] 2023-10-08T15:33:41.709 INFO:teuthology.orchestra.run.smithi050.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.2.6-1320-g08cac018-1focal [1,590 kB] 2023-10-08T15:33:41.791 INFO:teuthology.orchestra.run.smithi050.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.2.6-1320-g08cac018-1focal [7,846 kB] 2023-10-08T15:33:41.852 INFO:teuthology.orchestra.run.smithi003.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.2.6-1320-g08cac018-1focal [414 kB] 2023-10-08T15:33:42.105 INFO:teuthology.orchestra.run.smithi003.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.2.6-1320-g08cac018-1focal [22.6 kB] 2023-10-08T15:33:42.113 INFO:teuthology.orchestra.run.smithi003.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.2.6-1320-g08cac018-1focal [200 kB] 2023-10-08T15:33:42.191 INFO:teuthology.orchestra.run.smithi153.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-10-08T15:33:42.193 INFO:teuthology.orchestra.run.smithi153.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-10-08T15:33:42.193 INFO:teuthology.orchestra.run.smithi153.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-10-08T15:33:42.194 INFO:teuthology.orchestra.run.smithi153.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-10-08T15:33:42.195 INFO:teuthology.orchestra.run.smithi153.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-10-08T15:33:42.197 INFO:teuthology.orchestra.run.smithi153.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-10-08T15:33:42.214 INFO:teuthology.orchestra.run.smithi153.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-10-08T15:33:42.214 INFO:teuthology.orchestra.run.smithi153.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-10-08T15:33:42.214 INFO:teuthology.orchestra.run.smithi153.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-10-08T15:33:42.245 INFO:teuthology.orchestra.run.smithi003.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.2.6-1320-g08cac018-1focal [47.2 kB] 2023-10-08T15:33:42.269 INFO:teuthology.orchestra.run.smithi003.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.2.6-1320-g08cac018-1focal [386 kB] 2023-10-08T15:33:42.270 INFO:teuthology.orchestra.run.smithi050.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.2.6-1320-g08cac018-1focal [28.7 MB] 2023-10-08T15:33:42.272 INFO:teuthology.orchestra.run.smithi153.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-10-08T15:33:42.438 INFO:teuthology.orchestra.run.smithi153.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-10-08T15:33:42.526 INFO:teuthology.orchestra.run.smithi003.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.2.6-1320-g08cac018-1focal [5,568 kB] 2023-10-08T15:33:42.723 INFO:teuthology.orchestra.run.smithi153.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-10-08T15:33:42.744 INFO:teuthology.orchestra.run.smithi153.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-10-08T15:33:42.895 INFO:teuthology.orchestra.run.smithi153.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-10-08T15:33:42.912 INFO:teuthology.orchestra.run.smithi153.stdout:Get:94 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-10-08T15:33:44.114 INFO:teuthology.orchestra.run.smithi050.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.2.6-1320-g08cac018-1focal [3,920 B] 2023-10-08T15:33:44.115 INFO:teuthology.orchestra.run.smithi050.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.2.6-1320-g08cac018-1focal [869 kB] 2023-10-08T15:33:44.129 INFO:teuthology.orchestra.run.smithi050.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.2.6-1320-g08cac018-1focal [2,408 kB] 2023-10-08T15:33:44.160 INFO:teuthology.orchestra.run.smithi098.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.2.6-1320-g08cac018-1focal [6,450 kB] 2023-10-08T15:33:44.173 INFO:teuthology.orchestra.run.smithi050.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.2.6-1320-g08cac018-1focal [79.1 kB] 2023-10-08T15:33:44.175 INFO:teuthology.orchestra.run.smithi050.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.2.6-1320-g08cac018-1focal [117 kB] 2023-10-08T15:33:44.197 INFO:teuthology.orchestra.run.smithi050.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.2.6-1320-g08cac018-1focal [1,760 kB] 2023-10-08T15:33:44.298 INFO:teuthology.orchestra.run.smithi050.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.2.6-1320-g08cac018-1focal [7,875 kB] 2023-10-08T15:33:44.751 INFO:teuthology.orchestra.run.smithi050.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.2.6-1320-g08cac018-1focal [4,040 B] 2023-10-08T15:33:44.752 INFO:teuthology.orchestra.run.smithi050.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.2.6-1320-g08cac018-1focal [56.3 MB] 2023-10-08T15:33:45.568 INFO:teuthology.orchestra.run.smithi098.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.2.6-1320-g08cac018-1focal [221 kB] 2023-10-08T15:33:45.596 INFO:teuthology.orchestra.run.smithi098.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 17.2.6-1320-g08cac018-1focal [152 kB] 2023-10-08T15:33:45.653 INFO:teuthology.orchestra.run.smithi098.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.2.6-1320-g08cac018-1focal [1,590 kB] 2023-10-08T15:33:45.674 INFO:teuthology.orchestra.run.smithi003.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.2.6-1320-g08cac018-1focal [116 kB] 2023-10-08T15:33:45.725 INFO:teuthology.orchestra.run.smithi003.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.2.6-1320-g08cac018-1focal [479 kB] 2023-10-08T15:33:45.941 INFO:teuthology.orchestra.run.smithi089.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.2.6-1320-g08cac018-1focal [6,450 kB] 2023-10-08T15:33:45.960 INFO:teuthology.orchestra.run.smithi003.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.2.6-1320-g08cac018-1focal [27.8 MB] 2023-10-08T15:33:46.004 INFO:teuthology.orchestra.run.smithi098.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.2.6-1320-g08cac018-1focal [7,846 kB] 2023-10-08T15:33:47.248 INFO:teuthology.orchestra.run.smithi153.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.2.6-1320-g08cac018-1focal [6,450 kB] 2023-10-08T15:33:47.525 INFO:teuthology.orchestra.run.smithi089.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.2.6-1320-g08cac018-1focal [221 kB] 2023-10-08T15:33:47.552 INFO:teuthology.orchestra.run.smithi089.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 17.2.6-1320-g08cac018-1focal [152 kB] 2023-10-08T15:33:47.615 INFO:teuthology.orchestra.run.smithi089.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.2.6-1320-g08cac018-1focal [1,590 kB] 2023-10-08T15:33:47.823 INFO:teuthology.orchestra.run.smithi098.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.2.6-1320-g08cac018-1focal [28.7 MB] 2023-10-08T15:33:48.013 INFO:teuthology.orchestra.run.smithi089.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.2.6-1320-g08cac018-1focal [7,846 kB] 2023-10-08T15:33:48.451 INFO:teuthology.orchestra.run.smithi050.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 17.2.6-1320-g08cac018-1focal [229 kB] 2023-10-08T15:33:48.455 INFO:teuthology.orchestra.run.smithi050.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 17.2.6-1320-g08cac018-1focal [240 kB] 2023-10-08T15:33:48.461 INFO:teuthology.orchestra.run.smithi050.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 17.2.6-1320-g08cac018-1focal [22.0 kB] 2023-10-08T15:33:48.462 INFO:teuthology.orchestra.run.smithi050.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 17.2.6-1320-g08cac018-1focal [13.1 kB] 2023-10-08T15:33:48.462 INFO:teuthology.orchestra.run.smithi050.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.2.6-1320-g08cac018-1focal [21.9 kB] 2023-10-08T15:33:48.463 INFO:teuthology.orchestra.run.smithi050.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.2.6-1320-g08cac018-1focal [17.0 MB] 2023-10-08T15:33:48.976 INFO:teuthology.orchestra.run.smithi153.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.2.6-1320-g08cac018-1focal [221 kB] 2023-10-08T15:33:49.051 INFO:teuthology.orchestra.run.smithi153.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 17.2.6-1320-g08cac018-1focal [152 kB] 2023-10-08T15:33:49.079 INFO:teuthology.orchestra.run.smithi153.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.2.6-1320-g08cac018-1focal [1,590 kB] 2023-10-08T15:33:49.482 INFO:teuthology.orchestra.run.smithi050.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.2.6-1320-g08cac018-1focal [79.6 kB] 2023-10-08T15:33:49.501 INFO:teuthology.orchestra.run.smithi153.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.2.6-1320-g08cac018-1focal [7,846 kB] 2023-10-08T15:33:49.793 INFO:teuthology.orchestra.run.smithi089.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.2.6-1320-g08cac018-1focal [28.7 MB] 2023-10-08T15:33:50.161 INFO:teuthology.orchestra.run.smithi050.stdout:Fetched 210 MB in 14s (15.4 MB/s) 2023-10-08T15:33:50.324 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pyperclip. 2023-10-08T15:33:50.379 INFO:teuthology.orchestra.run.smithi050.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141736 files and directories currently installed.) 2023-10-08T15:33:50.383 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-10-08T15:33:50.430 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-10-08T15:33:50.689 INFO:teuthology.orchestra.run.smithi153.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.2.6-1320-g08cac018-1focal [28.7 MB] 2023-10-08T15:33:50.733 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-wcwidth. 2023-10-08T15:33:50.750 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-10-08T15:33:50.791 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-08T15:33:51.111 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-cmd2. 2023-10-08T15:33:51.127 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-10-08T15:33:51.169 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-10-08T15:33:51.471 INFO:teuthology.orchestra.run.smithi098.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.2.6-1320-g08cac018-1focal [3,920 B] 2023-10-08T15:33:51.545 INFO:teuthology.orchestra.run.smithi098.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.2.6-1320-g08cac018-1focal [869 kB] 2023-10-08T15:33:51.561 INFO:teuthology.orchestra.run.smithi098.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.2.6-1320-g08cac018-1focal [2,408 kB] 2023-10-08T15:33:51.656 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-10-08T15:33:51.672 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-10-08T15:33:51.732 INFO:teuthology.orchestra.run.smithi098.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.2.6-1320-g08cac018-1focal [79.1 kB] 2023-10-08T15:33:51.735 INFO:teuthology.orchestra.run.smithi098.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.2.6-1320-g08cac018-1focal [117 kB] 2023-10-08T15:33:51.738 INFO:teuthology.orchestra.run.smithi098.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.2.6-1320-g08cac018-1focal [1,760 kB] 2023-10-08T15:33:51.756 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-08T15:33:51.884 INFO:teuthology.orchestra.run.smithi098.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.2.6-1320-g08cac018-1focal [7,875 kB] 2023-10-08T15:33:52.214 INFO:teuthology.orchestra.run.smithi003.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.2.6-1320-g08cac018-1focal [6,450 kB] 2023-10-08T15:33:52.297 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../004-librbd1_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:33:52.419 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking librbd1 (17.2.6-1320-g08cac018-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-08T15:33:52.550 INFO:teuthology.orchestra.run.smithi098.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.2.6-1320-g08cac018-1focal [4,040 B] 2023-10-08T15:33:52.550 INFO:teuthology.orchestra.run.smithi098.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.2.6-1320-g08cac018-1focal [56.3 MB] 2023-10-08T15:33:53.134 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../005-librados2_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:33:53.204 INFO:teuthology.orchestra.run.smithi003.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.2.6-1320-g08cac018-1focal [221 kB] 2023-10-08T15:33:53.244 INFO:teuthology.orchestra.run.smithi003.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 17.2.6-1320-g08cac018-1focal [152 kB] 2023-10-08T15:33:53.257 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking librados2 (17.2.6-1320-g08cac018-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-08T15:33:53.268 INFO:teuthology.orchestra.run.smithi003.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.2.6-1320-g08cac018-1focal [1,590 kB] 2023-10-08T15:33:53.544 INFO:teuthology.orchestra.run.smithi003.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.2.6-1320-g08cac018-1focal [7,846 kB] 2023-10-08T15:33:53.977 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libcephfs2. 2023-10-08T15:33:53.997 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../006-libcephfs2_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:33:54.035 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libcephfs2 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:33:54.236 INFO:teuthology.orchestra.run.smithi089.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.2.6-1320-g08cac018-1focal [3,920 B] 2023-10-08T15:33:54.312 INFO:teuthology.orchestra.run.smithi089.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.2.6-1320-g08cac018-1focal [869 kB] 2023-10-08T15:33:54.330 INFO:teuthology.orchestra.run.smithi089.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.2.6-1320-g08cac018-1focal [2,408 kB] 2023-10-08T15:33:54.363 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-rados. 2023-10-08T15:33:54.380 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../007-python3-rados_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:33:54.430 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-rados (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:33:54.780 INFO:teuthology.orchestra.run.smithi089.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.2.6-1320-g08cac018-1focal [79.1 kB] 2023-10-08T15:33:54.799 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-10-08T15:33:54.815 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../008-python3-ceph-argparse_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T15:33:54.816 INFO:teuthology.orchestra.run.smithi089.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.2.6-1320-g08cac018-1focal [117 kB] 2023-10-08T15:33:54.833 INFO:teuthology.orchestra.run.smithi089.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.2.6-1320-g08cac018-1focal [1,760 kB] 2023-10-08T15:33:54.858 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-ceph-argparse (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:33:54.979 INFO:teuthology.orchestra.run.smithi003.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.2.6-1320-g08cac018-1focal [28.7 MB] 2023-10-08T15:33:55.108 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-cephfs. 2023-10-08T15:33:55.127 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../009-python3-cephfs_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:33:55.167 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-cephfs (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:33:55.183 INFO:teuthology.orchestra.run.smithi089.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.2.6-1320-g08cac018-1focal [7,875 kB] 2023-10-08T15:33:55.507 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-ceph-common. 2023-10-08T15:33:55.525 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../010-python3-ceph-common_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T15:33:55.565 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-ceph-common (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:33:55.812 INFO:teuthology.orchestra.run.smithi153.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.2.6-1320-g08cac018-1focal [3,920 B] 2023-10-08T15:33:55.825 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-prettytable. 2023-10-08T15:33:55.842 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2023-10-08T15:33:55.872 INFO:teuthology.orchestra.run.smithi153.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.2.6-1320-g08cac018-1focal [869 kB] 2023-10-08T15:33:55.908 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-10-08T15:33:55.940 INFO:teuthology.orchestra.run.smithi153.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.2.6-1320-g08cac018-1focal [2,408 kB] 2023-10-08T15:33:56.152 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-rbd. 2023-10-08T15:33:56.171 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../012-python3-rbd_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:33:56.211 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-rbd (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:33:56.473 INFO:teuthology.orchestra.run.smithi153.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.2.6-1320-g08cac018-1focal [79.1 kB] 2023-10-08T15:33:56.493 INFO:teuthology.orchestra.run.smithi153.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.2.6-1320-g08cac018-1focal [117 kB] 2023-10-08T15:33:56.535 INFO:teuthology.orchestra.run.smithi153.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.2.6-1320-g08cac018-1focal [1,760 kB] 2023-10-08T15:33:56.589 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-10-08T15:33:56.609 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../013-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-10-08T15:33:56.627 INFO:teuthology.orchestra.run.smithi098.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 17.2.6-1320-g08cac018-1focal [229 kB] 2023-10-08T15:33:56.632 INFO:teuthology.orchestra.run.smithi098.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 17.2.6-1320-g08cac018-1focal [240 kB] 2023-10-08T15:33:56.637 INFO:teuthology.orchestra.run.smithi098.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 17.2.6-1320-g08cac018-1focal [22.0 kB] 2023-10-08T15:33:56.647 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-08T15:33:56.699 INFO:teuthology.orchestra.run.smithi098.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 17.2.6-1320-g08cac018-1focal [13.1 kB] 2023-10-08T15:33:56.700 INFO:teuthology.orchestra.run.smithi098.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.2.6-1320-g08cac018-1focal [21.9 kB] 2023-10-08T15:33:56.700 INFO:teuthology.orchestra.run.smithi098.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.2.6-1320-g08cac018-1focal [17.0 MB] 2023-10-08T15:33:56.718 INFO:teuthology.orchestra.run.smithi089.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.2.6-1320-g08cac018-1focal [4,040 B] 2023-10-08T15:33:56.719 INFO:teuthology.orchestra.run.smithi089.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.2.6-1320-g08cac018-1focal [56.3 MB] 2023-10-08T15:33:56.877 INFO:teuthology.orchestra.run.smithi153.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.2.6-1320-g08cac018-1focal [7,875 kB] 2023-10-08T15:33:56.994 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-10-08T15:33:57.013 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../014-librabbitmq4_0.10.0-1_amd64.deb ... 2023-10-08T15:33:57.044 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-10-08T15:33:57.414 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-10-08T15:33:57.430 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../015-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-10-08T15:33:57.472 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-08T15:33:57.554 INFO:teuthology.orchestra.run.smithi098.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.2.6-1320-g08cac018-1focal [79.6 kB] 2023-10-08T15:33:57.875 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-10-08T15:33:57.891 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../016-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-10-08T15:33:57.914 INFO:teuthology.orchestra.run.smithi153.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.2.6-1320-g08cac018-1focal [4,040 B] 2023-10-08T15:33:57.915 INFO:teuthology.orchestra.run.smithi153.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.2.6-1320-g08cac018-1focal [56.3 MB] 2023-10-08T15:33:57.933 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-10-08T15:33:58.191 INFO:teuthology.orchestra.run.smithi098.stdout:Fetched 210 MB in 22s (9,589 kB/s) 2023-10-08T15:33:58.270 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-10-08T15:33:58.287 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../017-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-10-08T15:33:58.342 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-pyperclip. 2023-10-08T15:33:58.353 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-10-08T15:33:58.399 INFO:teuthology.orchestra.run.smithi098.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141736 files and directories currently installed.) 2023-10-08T15:33:58.404 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-10-08T15:33:58.449 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-10-08T15:33:58.710 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-wcwidth. 2023-10-08T15:33:58.730 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-10-08T15:33:58.760 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-08T15:33:58.815 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-10-08T15:33:58.831 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../018-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-08T15:33:58.883 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T15:33:59.071 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-cmd2. 2023-10-08T15:33:59.088 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-10-08T15:33:59.129 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-10-08T15:33:59.368 INFO:teuthology.orchestra.run.smithi003.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.2.6-1320-g08cac018-1focal [3,920 B] 2023-10-08T15:33:59.385 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-10-08T15:33:59.401 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../019-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-08T15:33:59.439 INFO:teuthology.orchestra.run.smithi003.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.2.6-1320-g08cac018-1focal [869 kB] 2023-10-08T15:33:59.443 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T15:33:59.452 INFO:teuthology.orchestra.run.smithi003.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.2.6-1320-g08cac018-1focal [2,408 kB] 2023-10-08T15:33:59.465 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-10-08T15:33:59.483 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-10-08T15:33:59.566 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-08T15:33:59.677 INFO:teuthology.orchestra.run.smithi003.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.2.6-1320-g08cac018-1focal [79.1 kB] 2023-10-08T15:33:59.684 INFO:teuthology.orchestra.run.smithi003.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.2.6-1320-g08cac018-1focal [117 kB] 2023-10-08T15:33:59.697 INFO:teuthology.orchestra.run.smithi003.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.2.6-1320-g08cac018-1focal [1,760 kB] 2023-10-08T15:33:59.884 INFO:teuthology.orchestra.run.smithi003.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.2.6-1320-g08cac018-1focal [7,875 kB] 2023-10-08T15:33:59.928 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../004-librbd1_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:33:59.938 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-10-08T15:33:59.954 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../020-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-08T15:33:59.996 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T15:34:00.028 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking librbd1 (17.2.6-1320-g08cac018-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-08T15:34:00.399 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-10-08T15:34:00.415 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../021-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-10-08T15:34:00.457 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-10-08T15:34:00.714 INFO:teuthology.orchestra.run.smithi003.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.2.6-1320-g08cac018-1focal [4,040 B] 2023-10-08T15:34:00.714 INFO:teuthology.orchestra.run.smithi003.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.2.6-1320-g08cac018-1focal [56.3 MB] 2023-10-08T15:34:00.724 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../005-librados2_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:00.849 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking librados2 (17.2.6-1320-g08cac018-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-08T15:34:00.852 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package librgw2. 2023-10-08T15:34:00.870 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../022-librgw2_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:00.910 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking librgw2 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:01.553 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libcephfs2. 2023-10-08T15:34:01.569 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../006-libcephfs2_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:01.603 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libcephfs2 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:01.713 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-rgw. 2023-10-08T15:34:01.733 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../023-python3-rgw_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:01.772 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-rgw (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:01.931 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-rados. 2023-10-08T15:34:01.946 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../007-python3-rados_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:01.995 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-rados (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:02.150 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package liboath0. 2023-10-08T15:34:02.166 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-10-08T15:34:02.208 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-10-08T15:34:02.358 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-10-08T15:34:02.378 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../008-python3-ceph-argparse_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T15:34:02.416 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-ceph-argparse (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:02.536 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libradosstriper1. 2023-10-08T15:34:02.552 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../025-libradosstriper1_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:02.594 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libradosstriper1 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:02.652 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-cephfs. 2023-10-08T15:34:02.670 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../009-python3-cephfs_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:02.719 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-cephfs (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:02.840 INFO:teuthology.orchestra.run.smithi153.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 17.2.6-1320-g08cac018-1focal [229 kB] 2023-10-08T15:34:02.844 INFO:teuthology.orchestra.run.smithi153.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 17.2.6-1320-g08cac018-1focal [240 kB] 2023-10-08T15:34:02.849 INFO:teuthology.orchestra.run.smithi153.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 17.2.6-1320-g08cac018-1focal [22.0 kB] 2023-10-08T15:34:02.906 INFO:teuthology.orchestra.run.smithi153.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 17.2.6-1320-g08cac018-1focal [13.1 kB] 2023-10-08T15:34:02.907 INFO:teuthology.orchestra.run.smithi153.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.2.6-1320-g08cac018-1focal [21.9 kB] 2023-10-08T15:34:02.907 INFO:teuthology.orchestra.run.smithi153.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.2.6-1320-g08cac018-1focal [17.0 MB] 2023-10-08T15:34:03.039 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-ceph-common. 2023-10-08T15:34:03.054 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../010-python3-ceph-common_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T15:34:03.081 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-common. 2023-10-08T15:34:03.089 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-ceph-common (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:03.101 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../026-ceph-common_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:03.130 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-common (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:03.366 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-prettytable. 2023-10-08T15:34:03.386 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2023-10-08T15:34:03.424 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-10-08T15:34:03.700 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-rbd. 2023-10-08T15:34:03.718 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../012-python3-rbd_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:03.753 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-rbd (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:04.065 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-10-08T15:34:04.083 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../013-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-10-08T15:34:04.115 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-08T15:34:04.253 INFO:teuthology.orchestra.run.smithi089.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 17.2.6-1320-g08cac018-1focal [229 kB] 2023-10-08T15:34:04.258 INFO:teuthology.orchestra.run.smithi089.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 17.2.6-1320-g08cac018-1focal [240 kB] 2023-10-08T15:34:04.262 INFO:teuthology.orchestra.run.smithi089.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 17.2.6-1320-g08cac018-1focal [22.0 kB] 2023-10-08T15:34:04.263 INFO:teuthology.orchestra.run.smithi089.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 17.2.6-1320-g08cac018-1focal [13.1 kB] 2023-10-08T15:34:04.301 INFO:teuthology.orchestra.run.smithi089.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.2.6-1320-g08cac018-1focal [21.9 kB] 2023-10-08T15:34:04.302 INFO:teuthology.orchestra.run.smithi089.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.2.6-1320-g08cac018-1focal [17.0 MB] 2023-10-08T15:34:04.457 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-10-08T15:34:04.477 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../014-librabbitmq4_0.10.0-1_amd64.deb ... 2023-10-08T15:34:04.508 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-10-08T15:34:04.835 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-10-08T15:34:04.851 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../015-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-10-08T15:34:04.893 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-08T15:34:05.192 INFO:teuthology.orchestra.run.smithi153.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.2.6-1320-g08cac018-1focal [79.6 kB] 2023-10-08T15:34:05.289 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-10-08T15:34:05.304 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../016-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-10-08T15:34:05.347 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-10-08T15:34:05.642 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-10-08T15:34:05.661 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../017-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-10-08T15:34:05.692 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-10-08T15:34:05.807 INFO:teuthology.orchestra.run.smithi153.stdout:Fetched 210 MB in 29s (7,138 kB/s) 2023-10-08T15:34:05.878 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-base. 2023-10-08T15:34:05.895 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../027-ceph-base_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:05.938 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-base (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:05.965 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pyperclip. 2023-10-08T15:34:06.024 INFO:teuthology.orchestra.run.smithi153.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141736 files and directories currently installed.) 2023-10-08T15:34:06.028 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-10-08T15:34:06.072 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-10-08T15:34:06.179 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-10-08T15:34:06.195 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../018-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-08T15:34:06.247 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T15:34:06.366 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-wcwidth. 2023-10-08T15:34:06.386 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-10-08T15:34:06.424 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-08T15:34:06.711 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-cmd2. 2023-10-08T15:34:06.730 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-10-08T15:34:06.769 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-10-08T15:34:06.799 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-10-08T15:34:06.816 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../019-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-08T15:34:06.856 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T15:34:06.882 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-cryptography. 2023-10-08T15:34:06.898 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../028-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-10-08T15:34:06.931 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-08T15:34:07.127 INFO:teuthology.orchestra.run.smithi089.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.2.6-1320-g08cac018-1focal [79.6 kB] 2023-10-08T15:34:07.156 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-10-08T15:34:07.172 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-10-08T15:34:07.280 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-08T15:34:07.344 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-openssl. 2023-10-08T15:34:07.361 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../029-python3-openssl_19.0.0-1build1_all.deb ... 2023-10-08T15:34:07.402 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-10-08T15:34:07.854 INFO:teuthology.orchestra.run.smithi089.stdout:Fetched 210 MB in 31s (6,684 kB/s) 2023-10-08T15:34:07.927 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-10-08T15:34:07.944 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../020-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-08T15:34:07.985 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T15:34:08.082 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-pyperclip. 2023-10-08T15:34:08.138 INFO:teuthology.orchestra.run.smithi089.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141736 files and directories currently installed.) 2023-10-08T15:34:08.142 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-10-08T15:34:08.189 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-10-08T15:34:08.342 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../004-librbd1_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:08.355 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-10-08T15:34:08.372 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../021-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-10-08T15:34:08.430 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-10-08T15:34:08.431 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-10-08T15:34:08.449 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../030-ceph-mgr-modules-core_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T15:34:08.468 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking librbd1 (17.2.6-1320-g08cac018-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-08T15:34:08.488 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mgr-modules-core (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:08.491 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-wcwidth. 2023-10-08T15:34:08.510 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-10-08T15:34:08.583 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-08T15:34:08.738 INFO:teuthology.orchestra.run.smithi003.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 17.2.6-1320-g08cac018-1focal [229 kB] 2023-10-08T15:34:08.742 INFO:teuthology.orchestra.run.smithi003.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 17.2.6-1320-g08cac018-1focal [240 kB] 2023-10-08T15:34:08.747 INFO:teuthology.orchestra.run.smithi003.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 17.2.6-1320-g08cac018-1focal [22.0 kB] 2023-10-08T15:34:08.766 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package librgw2. 2023-10-08T15:34:08.782 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../022-librgw2_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:08.804 INFO:teuthology.orchestra.run.smithi003.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 17.2.6-1320-g08cac018-1focal [13.1 kB] 2023-10-08T15:34:08.804 INFO:teuthology.orchestra.run.smithi003.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.2.6-1320-g08cac018-1focal [21.9 kB] 2023-10-08T15:34:08.805 INFO:teuthology.orchestra.run.smithi003.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.2.6-1320-g08cac018-1focal [17.0 MB] 2023-10-08T15:34:08.824 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking librgw2 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:08.829 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-cmd2. 2023-10-08T15:34:08.844 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-10-08T15:34:08.869 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-bcrypt. 2023-10-08T15:34:08.878 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-10-08T15:34:08.886 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../031-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-10-08T15:34:08.926 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-08T15:34:09.154 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../005-librados2_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:09.229 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-cherrypy3. 2023-10-08T15:34:09.230 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-10-08T15:34:09.247 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-10-08T15:34:09.249 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../032-python3-cherrypy3_8.9.1-6_all.deb ... 2023-10-08T15:34:09.280 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking librados2 (17.2.6-1320-g08cac018-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-08T15:34:09.287 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-10-08T15:34:09.330 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-08T15:34:09.569 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-rgw. 2023-10-08T15:34:09.587 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../023-python3-rgw_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:09.618 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-rgw (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:09.624 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-natsort. 2023-10-08T15:34:09.643 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../033-python3-natsort_7.0.1-1_all.deb ... 2023-10-08T15:34:09.687 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../004-librbd1_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:09.707 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-10-08T15:34:09.810 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking librbd1 (17.2.6-1320-g08cac018-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-08T15:34:09.976 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libcephfs2. 2023-10-08T15:34:09.992 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../006-libcephfs2_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:10.005 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package liboath0. 2023-10-08T15:34:10.019 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-jwt. 2023-10-08T15:34:10.023 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-10-08T15:34:10.034 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libcephfs2 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:10.036 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../034-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-10-08T15:34:10.063 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-10-08T15:34:10.077 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-08T15:34:10.324 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libradosstriper1. 2023-10-08T15:34:10.342 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../025-libradosstriper1_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:10.355 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-logutils. 2023-10-08T15:34:10.361 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-rados. 2023-10-08T15:34:10.371 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../035-python3-logutils_0.3.3-7_all.deb ... 2023-10-08T15:34:10.374 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libradosstriper1 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:10.377 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../007-python3-rados_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:10.413 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-10-08T15:34:10.420 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-rados (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:10.472 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../005-librados2_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:10.589 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking librados2 (17.2.6-1320-g08cac018-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-08T15:34:10.716 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-markupsafe. 2023-10-08T15:34:10.734 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../036-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-10-08T15:34:10.774 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-10-08T15:34:10.782 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-10-08T15:34:10.798 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../008-python3-ceph-argparse_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T15:34:10.840 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-ceph-argparse (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:10.861 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package ceph-common. 2023-10-08T15:34:10.876 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../026-ceph-common_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:10.919 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking ceph-common (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:11.066 INFO:teuthology.orchestra.run.smithi003.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.2.6-1320-g08cac018-1focal [79.6 kB] 2023-10-08T15:34:11.067 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-cephfs. 2023-10-08T15:34:11.084 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../009-python3-cephfs_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:11.085 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-mako. 2023-10-08T15:34:11.105 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../037-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-10-08T15:34:11.126 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-cephfs (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:11.144 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-08T15:34:11.260 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libcephfs2. 2023-10-08T15:34:11.278 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../006-libcephfs2_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:11.318 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libcephfs2 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:11.464 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-simplegeneric. 2023-10-08T15:34:11.480 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-ceph-common. 2023-10-08T15:34:11.482 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../038-python3-simplegeneric_0.8.1-3_all.deb ... 2023-10-08T15:34:11.498 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../010-python3-ceph-common_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T15:34:11.522 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-10-08T15:34:11.538 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-ceph-common (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:11.629 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-rados. 2023-10-08T15:34:11.645 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../007-python3-rados_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:11.679 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-rados (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:11.718 INFO:teuthology.orchestra.run.smithi003.stdout:Fetched 210 MB in 35s (5,946 kB/s) 2023-10-08T15:34:11.816 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-singledispatch. 2023-10-08T15:34:11.835 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../039-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-10-08T15:34:11.839 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-prettytable. 2023-10-08T15:34:11.859 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2023-10-08T15:34:11.866 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-10-08T15:34:11.871 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-pyperclip. 2023-10-08T15:34:11.897 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-10-08T15:34:11.929 INFO:teuthology.orchestra.run.smithi003.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141736 files and directories currently installed.) 2023-10-08T15:34:11.933 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-10-08T15:34:11.978 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-10-08T15:34:12.015 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-10-08T15:34:12.031 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../008-python3-ceph-argparse_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T15:34:12.073 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-ceph-argparse (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:12.133 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-rbd. 2023-10-08T15:34:12.149 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../012-python3-rbd_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:12.161 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-webob. 2023-10-08T15:34:12.177 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../040-python3-webob_1%3a1.8.5-2_all.deb ... 2023-10-08T15:34:12.191 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-rbd (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:12.252 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-10-08T15:34:12.272 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-wcwidth. 2023-10-08T15:34:12.289 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-10-08T15:34:12.322 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-08T15:34:12.348 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-cephfs. 2023-10-08T15:34:12.366 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../009-python3-cephfs_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:12.409 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-cephfs (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:12.561 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-10-08T15:34:12.572 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-soupsieve. 2023-10-08T15:34:12.577 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../013-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-10-08T15:34:12.588 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../041-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-10-08T15:34:12.617 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-cmd2. 2023-10-08T15:34:12.619 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-08T15:34:12.630 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-08T15:34:12.633 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-10-08T15:34:12.675 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-10-08T15:34:12.705 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-ceph-common. 2023-10-08T15:34:12.723 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../010-python3-ceph-common_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T15:34:12.781 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-ceph-common (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:12.956 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-10-08T15:34:12.957 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-bs4. 2023-10-08T15:34:12.975 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../042-python3-bs4_4.8.2-1_all.deb ... 2023-10-08T15:34:12.975 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../014-librabbitmq4_0.10.0-1_amd64.deb ... 2023-10-08T15:34:13.014 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-10-08T15:34:13.016 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-10-08T15:34:13.036 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-10-08T15:34:13.054 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-10-08T15:34:13.089 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-prettytable. 2023-10-08T15:34:13.105 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2023-10-08T15:34:13.137 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-08T15:34:13.147 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-10-08T15:34:13.369 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-waitress. 2023-10-08T15:34:13.375 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-10-08T15:34:13.386 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../043-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-10-08T15:34:13.392 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../015-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-10-08T15:34:13.400 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-rbd. 2023-10-08T15:34:13.418 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../012-python3-rbd_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:13.430 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-08T15:34:13.433 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-08T15:34:13.458 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-rbd (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:13.481 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../004-librbd1_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:13.567 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package ceph-base. 2023-10-08T15:34:13.582 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking librbd1 (17.2.6-1320-g08cac018-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-08T15:34:13.586 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../027-ceph-base_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:13.627 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking ceph-base (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:13.761 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-10-08T15:34:13.779 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../013-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-10-08T15:34:13.797 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-tempita. 2023-10-08T15:34:13.803 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-10-08T15:34:13.811 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-08T15:34:13.814 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6_all.deb ... 2023-10-08T15:34:13.820 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../016-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-10-08T15:34:13.853 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-10-08T15:34:13.855 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-10-08T15:34:14.182 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-10-08T15:34:14.189 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-10-08T15:34:14.199 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-paste. 2023-10-08T15:34:14.202 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../017-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-10-08T15:34:14.209 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../014-librabbitmq4_0.10.0-1_amd64.deb ... 2023-10-08T15:34:14.218 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../045-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-10-08T15:34:14.248 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-10-08T15:34:14.255 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../005-librados2_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:14.257 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-10-08T15:34:14.273 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-10-08T15:34:14.379 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking librados2 (17.2.6-1320-g08cac018-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-08T15:34:14.551 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-10-08T15:34:14.566 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../015-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-10-08T15:34:14.578 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-10-08T15:34:14.595 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-10-08T15:34:14.609 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-08T15:34:14.636 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-10-08T15:34:14.638 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-cryptography. 2023-10-08T15:34:14.655 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../028-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-10-08T15:34:14.696 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-08T15:34:14.718 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-10-08T15:34:14.738 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../018-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-08T15:34:14.787 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T15:34:14.945 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-10-08T15:34:14.963 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../016-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-10-08T15:34:14.963 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pastedeploy. 2023-10-08T15:34:14.980 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.0-1_all.deb ... 2023-10-08T15:34:15.004 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-10-08T15:34:15.022 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-10-08T15:34:15.049 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libcephfs2. 2023-10-08T15:34:15.065 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../006-libcephfs2_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:15.084 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-openssl. 2023-10-08T15:34:15.100 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../029-python3-openssl_19.0.0-1build1_all.deb ... 2023-10-08T15:34:15.107 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libcephfs2 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:15.142 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-10-08T15:34:15.305 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-10-08T15:34:15.323 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../019-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-08T15:34:15.325 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-webtest. 2023-10-08T15:34:15.332 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-10-08T15:34:15.341 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../048-python3-webtest_2.0.32-2_all.deb ... 2023-10-08T15:34:15.348 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../017-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-10-08T15:34:15.363 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T15:34:15.390 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-10-08T15:34:15.408 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-10-08T15:34:15.444 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-10-08T15:34:15.460 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../030-ceph-mgr-modules-core_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T15:34:15.468 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-rados. 2023-10-08T15:34:15.485 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../007-python3-rados_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:15.502 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking ceph-mgr-modules-core (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:15.526 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-rados (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:15.708 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-10-08T15:34:15.719 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pecan. 2023-10-08T15:34:15.727 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../020-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-08T15:34:15.736 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-10-08T15:34:15.766 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T15:34:15.769 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-10-08T15:34:15.824 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-bcrypt. 2023-10-08T15:34:15.840 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../031-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-10-08T15:34:15.874 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-08T15:34:15.880 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-10-08T15:34:15.886 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-10-08T15:34:15.897 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../008-python3-ceph-argparse_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T15:34:15.901 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../018-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-08T15:34:15.939 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-ceph-argparse (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:15.953 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T15:34:16.157 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-werkzeug. 2023-10-08T15:34:16.175 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../050-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-10-08T15:34:16.186 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-10-08T15:34:16.194 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-cherrypy3. 2023-10-08T15:34:16.199 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-cephfs. 2023-10-08T15:34:16.202 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../021-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-10-08T15:34:16.211 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../032-python3-cherrypy3_8.9.1-6_all.deb ... 2023-10-08T15:34:16.215 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-08T15:34:16.216 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../009-python3-cephfs_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:16.244 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-10-08T15:34:16.252 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-10-08T15:34:16.266 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-cephfs (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:16.455 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-10-08T15:34:16.472 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../019-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-08T15:34:16.547 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T15:34:16.577 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-10-08T15:34:16.580 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package librgw2. 2023-10-08T15:34:16.581 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-natsort. 2023-10-08T15:34:16.594 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-ceph-common. 2023-10-08T15:34:16.595 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../051-libsqlite3-mod-ceph_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:16.597 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../022-librgw2_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:16.599 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../033-python3-natsort_7.0.1-1_all.deb ... 2023-10-08T15:34:16.611 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../010-python3-ceph-common_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T15:34:16.635 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libsqlite3-mod-ceph (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:16.639 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking librgw2 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:16.639 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-10-08T15:34:16.653 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-ceph-common (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:16.942 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-10-08T15:34:16.957 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../020-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-08T15:34:16.976 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-jwt. 2023-10-08T15:34:16.992 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../034-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-10-08T15:34:17.000 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T15:34:17.005 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mgr. 2023-10-08T15:34:17.021 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../052-ceph-mgr_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:17.034 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-08T15:34:17.045 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-prettytable. 2023-10-08T15:34:17.063 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mgr (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:17.064 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2023-10-08T15:34:17.103 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-10-08T15:34:17.354 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-logutils. 2023-10-08T15:34:17.355 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-rbd. 2023-10-08T15:34:17.370 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-10-08T15:34:17.371 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../035-python3-logutils_0.3.3-7_all.deb ... 2023-10-08T15:34:17.375 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../012-python3-rbd_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:17.385 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../021-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-10-08T15:34:17.392 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-rgw. 2023-10-08T15:34:17.409 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../023-python3-rgw_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:17.412 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-10-08T15:34:17.414 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-rbd (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:17.428 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-10-08T15:34:17.451 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-rgw (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:17.550 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mon. 2023-10-08T15:34:17.569 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../053-ceph-mon_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:17.607 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mon (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:17.740 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-markupsafe. 2023-10-08T15:34:17.756 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../036-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-10-08T15:34:17.776 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-10-08T15:34:17.796 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../013-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-10-08T15:34:17.798 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-10-08T15:34:17.803 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package liboath0. 2023-10-08T15:34:17.806 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package librgw2. 2023-10-08T15:34:17.820 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-10-08T15:34:17.821 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../022-librgw2_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:17.834 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-08T15:34:17.862 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-10-08T15:34:17.864 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking librgw2 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:18.101 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-mako. 2023-10-08T15:34:18.119 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../037-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-10-08T15:34:18.159 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-08T15:34:18.187 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-10-08T15:34:18.204 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../014-librabbitmq4_0.10.0-1_amd64.deb ... 2023-10-08T15:34:18.214 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libradosstriper1. 2023-10-08T15:34:18.232 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../025-libradosstriper1_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:18.245 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-10-08T15:34:18.264 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libradosstriper1 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:18.505 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-simplegeneric. 2023-10-08T15:34:18.521 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../038-python3-simplegeneric_0.8.1-3_all.deb ... 2023-10-08T15:34:18.563 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-10-08T15:34:18.615 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-10-08T15:34:18.632 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../015-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-10-08T15:34:18.642 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-rgw. 2023-10-08T15:34:18.662 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../023-python3-rgw_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:18.665 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-08T15:34:18.691 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-rgw (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:18.718 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-common. 2023-10-08T15:34:18.738 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../026-ceph-common_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:18.776 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-common (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:18.865 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-singledispatch. 2023-10-08T15:34:18.869 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-osd. 2023-10-08T15:34:18.883 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../039-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-10-08T15:34:18.887 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../054-ceph-osd_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:18.924 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-10-08T15:34:18.928 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-osd (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:19.038 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package liboath0. 2023-10-08T15:34:19.043 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-10-08T15:34:19.053 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-10-08T15:34:19.060 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../016-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-10-08T15:34:19.095 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-10-08T15:34:19.101 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-10-08T15:34:19.251 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-webob. 2023-10-08T15:34:19.268 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../040-python3-webob_1%3a1.8.5-2_all.deb ... 2023-10-08T15:34:19.309 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-10-08T15:34:19.440 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libradosstriper1. 2023-10-08T15:34:19.456 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../025-libradosstriper1_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:19.471 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-10-08T15:34:19.489 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../017-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-10-08T15:34:19.498 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libradosstriper1 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:19.529 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-10-08T15:34:19.638 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-soupsieve. 2023-10-08T15:34:19.655 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../041-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-10-08T15:34:19.696 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-08T15:34:19.910 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-common. 2023-10-08T15:34:19.926 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-10-08T15:34:19.927 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../026-ceph-common_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:19.944 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../018-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-08T15:34:19.959 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-common (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:19.993 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T15:34:20.049 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-bs4. 2023-10-08T15:34:20.065 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../042-python3-bs4_4.8.2-1_all.deb ... 2023-10-08T15:34:20.115 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-10-08T15:34:20.444 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-waitress. 2023-10-08T15:34:20.463 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../043-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-10-08T15:34:20.503 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-10-08T15:34:20.505 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-08T15:34:20.520 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../019-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-08T15:34:20.561 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T15:34:20.847 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-tempita. 2023-10-08T15:34:20.864 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6_all.deb ... 2023-10-08T15:34:20.905 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-10-08T15:34:20.931 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-10-08T15:34:20.949 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../020-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-08T15:34:20.989 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T15:34:21.208 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-paste. 2023-10-08T15:34:21.224 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../045-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-10-08T15:34:21.266 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-10-08T15:34:21.351 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-10-08T15:34:21.369 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../021-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-10-08T15:34:21.381 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-base. 2023-10-08T15:34:21.399 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../027-ceph-base_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:21.410 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-10-08T15:34:21.450 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-base (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:21.611 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-10-08T15:34:21.627 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-10-08T15:34:21.669 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-10-08T15:34:21.788 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package librgw2. 2023-10-08T15:34:21.805 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../022-librgw2_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:21.847 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking librgw2 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:21.897 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph. 2023-10-08T15:34:21.917 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../055-ceph_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:21.947 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:21.964 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-pastedeploy. 2023-10-08T15:34:21.983 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.0-1_all.deb ... 2023-10-08T15:34:22.022 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-10-08T15:34:22.258 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-fuse. 2023-10-08T15:34:22.275 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../056-ceph-fuse_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:22.341 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-fuse (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:22.358 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-webtest. 2023-10-08T15:34:22.376 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../048-python3-webtest_2.0.32-2_all.deb ... 2023-10-08T15:34:22.416 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-10-08T15:34:22.522 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-cryptography. 2023-10-08T15:34:22.538 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../028-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-10-08T15:34:22.580 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-08T15:34:22.592 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-rgw. 2023-10-08T15:34:22.611 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../023-python3-rgw_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:22.728 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-pecan. 2023-10-08T15:34:22.740 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-base. 2023-10-08T15:34:22.744 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-10-08T15:34:22.752 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mds. 2023-10-08T15:34:22.758 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-rgw (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:22.758 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../027-ceph-base_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:22.773 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../057-ceph-mds_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:22.786 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-10-08T15:34:22.810 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mds (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:22.831 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-base (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:23.052 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-openssl. 2023-10-08T15:34:23.067 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../029-python3-openssl_19.0.0-1build1_all.deb ... 2023-10-08T15:34:23.110 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-10-08T15:34:23.144 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package liboath0. 2023-10-08T15:34:23.157 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-werkzeug. 2023-10-08T15:34:23.161 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-10-08T15:34:23.175 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../050-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-10-08T15:34:23.215 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-08T15:34:23.228 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-10-08T15:34:23.356 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package cephadm. 2023-10-08T15:34:23.372 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../058-cephadm_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:23.404 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-10-08T15:34:23.413 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking cephadm (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:23.421 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../030-ceph-mgr-modules-core_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T15:34:23.462 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mgr-modules-core (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:23.547 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libradosstriper1. 2023-10-08T15:34:23.564 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../025-libradosstriper1_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:23.605 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libradosstriper1 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:23.850 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-bcrypt. 2023-10-08T15:34:23.870 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../031-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-10-08T15:34:23.908 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-08T15:34:24.000 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package ceph-common. 2023-10-08T15:34:24.019 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../026-ceph-common_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:24.020 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-10-08T15:34:24.036 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../051-libsqlite3-mod-ceph_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:24.050 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking ceph-common (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:24.050 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-jinja2. 2023-10-08T15:34:24.066 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../059-python3-jinja2_2.10.1-2_all.deb ... 2023-10-08T15:34:24.129 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-cryptography. 2023-10-08T15:34:24.132 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-10-08T15:34:24.146 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../028-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-10-08T15:34:24.152 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libsqlite3-mod-ceph (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:24.178 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-08T15:34:24.203 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-cherrypy3. 2023-10-08T15:34:24.223 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../032-python3-cherrypy3_8.9.1-6_all.deb ... 2023-10-08T15:34:24.261 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-10-08T15:34:24.461 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-10-08T15:34:24.478 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../060-ceph-mgr-cephadm_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T15:34:24.519 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mgr-cephadm (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:24.531 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package ceph-mgr. 2023-10-08T15:34:24.547 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../052-ceph-mgr_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:24.565 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-openssl. 2023-10-08T15:34:24.584 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../029-python3-openssl_19.0.0-1build1_all.deb ... 2023-10-08T15:34:24.588 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking ceph-mgr (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:24.614 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-natsort. 2023-10-08T15:34:24.615 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-10-08T15:34:24.631 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../033-python3-natsort_7.0.1-1_all.deb ... 2023-10-08T15:34:24.672 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-10-08T15:34:24.872 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-repoze.lru. 2023-10-08T15:34:24.888 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../061-python3-repoze.lru_0.7-2_all.deb ... 2023-10-08T15:34:24.902 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-10-08T15:34:24.918 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../030-ceph-mgr-modules-core_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T15:34:24.930 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-10-08T15:34:24.934 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-jwt. 2023-10-08T15:34:24.951 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../034-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-10-08T15:34:24.985 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-mgr-modules-core (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:24.992 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-08T15:34:25.067 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package ceph-mon. 2023-10-08T15:34:25.086 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../053-ceph-mon_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:25.117 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking ceph-mon (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:25.183 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libjs-underscore. 2023-10-08T15:34:25.199 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../062-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-10-08T15:34:25.241 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-08T15:34:25.287 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-logutils. 2023-10-08T15:34:25.306 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../035-python3-logutils_0.3.3-7_all.deb ... 2023-10-08T15:34:25.345 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-10-08T15:34:25.365 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-bcrypt. 2023-10-08T15:34:25.383 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../031-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-10-08T15:34:25.423 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-08T15:34:25.535 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-10-08T15:34:25.552 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../063-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-10-08T15:34:25.593 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-08T15:34:25.673 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-markupsafe. 2023-10-08T15:34:25.688 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../036-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-10-08T15:34:25.731 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-10-08T15:34:25.751 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-cherrypy3. 2023-10-08T15:34:25.767 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../032-python3-cherrypy3_8.9.1-6_all.deb ... 2023-10-08T15:34:25.809 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-10-08T15:34:25.913 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-routes. 2023-10-08T15:34:25.932 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../064-python3-routes_2.4.1-2_all.deb ... 2023-10-08T15:34:26.004 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-10-08T15:34:26.033 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-mako. 2023-10-08T15:34:26.052 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../037-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-10-08T15:34:26.092 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-08T15:34:26.171 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-natsort. 2023-10-08T15:34:26.188 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../033-python3-natsort_7.0.1-1_all.deb ... 2023-10-08T15:34:26.229 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-10-08T15:34:26.312 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package ceph-osd. 2023-10-08T15:34:26.328 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../054-ceph-osd_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:26.332 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-10-08T15:34:26.348 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../065-ceph-mgr-dashboard_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T15:34:26.370 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking ceph-osd (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:26.390 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mgr-dashboard (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:26.412 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-simplegeneric. 2023-10-08T15:34:26.431 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../038-python3-simplegeneric_0.8.1-3_all.deb ... 2023-10-08T15:34:26.470 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-10-08T15:34:26.541 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-jwt. 2023-10-08T15:34:26.558 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../034-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-10-08T15:34:26.616 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-08T15:34:26.739 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package ceph-base. 2023-10-08T15:34:26.759 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../027-ceph-base_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:26.781 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-singledispatch. 2023-10-08T15:34:26.797 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../039-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-10-08T15:34:26.807 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking ceph-base (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:26.839 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-10-08T15:34:26.877 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-logutils. 2023-10-08T15:34:26.895 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../035-python3-logutils_0.3.3-7_all.deb ... 2023-10-08T15:34:26.919 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-decorator. 2023-10-08T15:34:26.927 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-10-08T15:34:26.938 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../066-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-10-08T15:34:26.977 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-10-08T15:34:27.142 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-webob. 2023-10-08T15:34:27.159 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../040-python3-webob_1%3a1.8.5-2_all.deb ... 2023-10-08T15:34:27.200 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-10-08T15:34:27.272 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-markupsafe. 2023-10-08T15:34:27.288 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../036-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-10-08T15:34:27.296 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-10-08T15:34:27.312 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../067-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-10-08T15:34:27.330 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-10-08T15:34:27.354 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-08T15:34:27.553 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-soupsieve. 2023-10-08T15:34:27.569 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../041-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-10-08T15:34:27.611 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-08T15:34:27.657 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-mako. 2023-10-08T15:34:27.665 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-scipy. 2023-10-08T15:34:27.675 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../037-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-10-08T15:34:27.682 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../068-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-10-08T15:34:27.716 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-08T15:34:27.723 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-10-08T15:34:27.859 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-cryptography. 2023-10-08T15:34:27.876 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../028-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-10-08T15:34:27.914 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-bs4. 2023-10-08T15:34:27.917 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-08T15:34:27.929 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../042-python3-bs4_4.8.2-1_all.deb ... 2023-10-08T15:34:27.972 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-10-08T15:34:27.996 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-simplegeneric. 2023-10-08T15:34:28.015 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../038-python3-simplegeneric_0.8.1-3_all.deb ... 2023-10-08T15:34:28.046 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-10-08T15:34:28.333 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-waitress. 2023-10-08T15:34:28.349 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../043-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-10-08T15:34:28.350 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-singledispatch. 2023-10-08T15:34:28.367 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../039-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-10-08T15:34:28.394 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-08T15:34:28.407 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-10-08T15:34:28.555 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-openssl. 2023-10-08T15:34:28.575 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../029-python3-openssl_19.0.0-1build1_all.deb ... 2023-10-08T15:34:28.613 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-10-08T15:34:28.703 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-tempita. 2023-10-08T15:34:28.722 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6_all.deb ... 2023-10-08T15:34:28.735 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-webob. 2023-10-08T15:34:28.752 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../040-python3-webob_1%3a1.8.5-2_all.deb ... 2023-10-08T15:34:28.761 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-10-08T15:34:28.793 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-10-08T15:34:28.882 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-10-08T15:34:28.900 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../030-ceph-mgr-modules-core_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T15:34:28.957 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking ceph-mgr-modules-core (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:28.966 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-10-08T15:34:28.985 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../069-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-10-08T15:34:29.014 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-paste. 2023-10-08T15:34:29.024 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-08T15:34:29.031 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../045-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-10-08T15:34:29.072 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-10-08T15:34:29.122 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-soupsieve. 2023-10-08T15:34:29.137 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../041-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-10-08T15:34:29.171 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-08T15:34:29.290 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package ceph. 2023-10-08T15:34:29.310 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../055-ceph_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:29.348 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking ceph (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:29.379 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-bcrypt. 2023-10-08T15:34:29.395 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../031-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-10-08T15:34:29.416 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-10-08T15:34:29.433 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-10-08T15:34:29.436 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-08T15:34:29.474 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-bs4. 2023-10-08T15:34:29.475 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-10-08T15:34:29.491 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../042-python3-bs4_4.8.2-1_all.deb ... 2023-10-08T15:34:29.524 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-10-08T15:34:29.586 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-joblib. 2023-10-08T15:34:29.601 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package ceph-fuse. 2023-10-08T15:34:29.602 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../070-python3-joblib_0.14.0-3_all.deb ... 2023-10-08T15:34:29.619 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../056-ceph-fuse_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:29.644 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-10-08T15:34:29.650 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking ceph-fuse (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:29.739 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-cherrypy3. 2023-10-08T15:34:29.757 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../032-python3-cherrypy3_8.9.1-6_all.deb ... 2023-10-08T15:34:29.769 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pastedeploy. 2023-10-08T15:34:29.787 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.0-1_all.deb ... 2023-10-08T15:34:29.797 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-10-08T15:34:29.819 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-10-08T15:34:29.902 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-waitress. 2023-10-08T15:34:29.920 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../043-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-10-08T15:34:29.964 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-08T15:34:30.022 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-sklearn. 2023-10-08T15:34:30.039 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../071-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-10-08T15:34:30.072 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-08T15:34:30.112 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package ceph-mds. 2023-10-08T15:34:30.128 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../057-ceph-mds_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:30.147 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-webtest. 2023-10-08T15:34:30.151 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-natsort. 2023-10-08T15:34:30.166 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../048-python3-webtest_2.0.32-2_all.deb ... 2023-10-08T15:34:30.170 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../033-python3-natsort_7.0.1-1_all.deb ... 2023-10-08T15:34:30.179 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking ceph-mds (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:30.205 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-10-08T15:34:30.209 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-10-08T15:34:30.323 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-tempita. 2023-10-08T15:34:30.340 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6_all.deb ... 2023-10-08T15:34:30.381 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-10-08T15:34:30.504 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-jwt. 2023-10-08T15:34:30.516 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pecan. 2023-10-08T15:34:30.523 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../034-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-10-08T15:34:30.532 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-10-08T15:34:30.562 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-08T15:34:30.574 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-10-08T15:34:30.684 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-paste. 2023-10-08T15:34:30.700 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../045-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-10-08T15:34:30.742 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-10-08T15:34:30.774 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package cephadm. 2023-10-08T15:34:30.780 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-10-08T15:34:30.794 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../058-cephadm_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:30.797 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../072-ceph-mgr-diskprediction-local_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T15:34:30.832 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking cephadm (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:30.838 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mgr-diskprediction-local (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:30.898 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-logutils. 2023-10-08T15:34:30.914 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../035-python3-logutils_0.3.3-7_all.deb ... 2023-10-08T15:34:30.920 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-werkzeug. 2023-10-08T15:34:30.937 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../050-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-10-08T15:34:30.956 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-10-08T15:34:30.995 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-08T15:34:31.096 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-10-08T15:34:31.113 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-10-08T15:34:31.143 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-jinja2. 2023-10-08T15:34:31.154 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-10-08T15:34:31.159 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../059-python3-jinja2_2.10.1-2_all.deb ... 2023-10-08T15:34:31.201 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-10-08T15:34:31.251 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-markupsafe. 2023-10-08T15:34:31.267 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../036-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-10-08T15:34:31.309 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-10-08T15:34:31.357 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-10-08T15:34:31.374 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../051-libsqlite3-mod-ceph_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:31.415 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libsqlite3-mod-ceph (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:31.449 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-pastedeploy. 2023-10-08T15:34:31.465 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.0-1_all.deb ... 2023-10-08T15:34:31.507 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-10-08T15:34:31.562 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-10-08T15:34:31.580 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../060-ceph-mgr-cephadm_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T15:34:31.612 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-mako. 2023-10-08T15:34:31.629 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking ceph-mgr-cephadm (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:31.631 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../037-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-10-08T15:34:31.670 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-08T15:34:31.777 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mgr. 2023-10-08T15:34:31.793 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../052-ceph-mgr_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:31.810 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-webtest. 2023-10-08T15:34:31.826 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../048-python3-webtest_2.0.32-2_all.deb ... 2023-10-08T15:34:31.834 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mgr (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:31.893 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-10-08T15:34:31.974 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-repoze.lru. 2023-10-08T15:34:31.990 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../061-python3-repoze.lru_0.7-2_all.deb ... 2023-10-08T15:34:31.990 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-simplegeneric. 2023-10-08T15:34:32.006 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../038-python3-simplegeneric_0.8.1-3_all.deb ... 2023-10-08T15:34:32.008 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-cachetools. 2023-10-08T15:34:32.027 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../073-python3-cachetools_4.0.0-1_all.deb ... 2023-10-08T15:34:32.032 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-10-08T15:34:32.048 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-10-08T15:34:32.066 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-10-08T15:34:32.213 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-pecan. 2023-10-08T15:34:32.231 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-10-08T15:34:32.259 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libjs-underscore. 2023-10-08T15:34:32.271 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-10-08T15:34:32.278 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../062-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-10-08T15:34:32.318 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-08T15:34:32.330 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mon. 2023-10-08T15:34:32.347 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../053-ceph-mon_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:32.369 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pyasn1. 2023-10-08T15:34:32.375 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-singledispatch. 2023-10-08T15:34:32.387 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../074-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-10-08T15:34:32.387 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mon (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:32.392 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../039-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-10-08T15:34:32.427 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-10-08T15:34:32.434 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-10-08T15:34:32.595 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-10-08T15:34:32.611 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../063-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-10-08T15:34:32.635 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-werkzeug. 2023-10-08T15:34:32.653 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-08T15:34:32.654 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../050-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-10-08T15:34:32.693 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-08T15:34:32.737 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-webob. 2023-10-08T15:34:32.747 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-10-08T15:34:32.753 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../040-python3-webob_1%3a1.8.5-2_all.deb ... 2023-10-08T15:34:32.766 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../075-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-10-08T15:34:32.795 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-10-08T15:34:32.805 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-08T15:34:32.981 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-routes. 2023-10-08T15:34:32.999 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../064-python3-routes_2.4.1-2_all.deb ... 2023-10-08T15:34:33.055 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-10-08T15:34:33.072 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-10-08T15:34:33.074 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../051-libsqlite3-mod-ceph_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:33.113 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libsqlite3-mod-ceph (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:33.139 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-soupsieve. 2023-10-08T15:34:33.149 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-rsa. 2023-10-08T15:34:33.156 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../041-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-10-08T15:34:33.167 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../076-python3-rsa_4.0-3_all.deb ... 2023-10-08T15:34:33.198 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-08T15:34:33.207 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-rsa (4.0-3) ... 2023-10-08T15:34:33.393 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-10-08T15:34:33.411 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../065-ceph-mgr-dashboard_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T15:34:33.442 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking ceph-mgr-dashboard (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:33.483 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-bs4. 2023-10-08T15:34:33.491 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-osd. 2023-10-08T15:34:33.491 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-mgr. 2023-10-08T15:34:33.500 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../042-python3-bs4_4.8.2-1_all.deb ... 2023-10-08T15:34:33.506 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../054-ceph-osd_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:33.508 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../052-ceph-mgr_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:33.527 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-google-auth. 2023-10-08T15:34:33.542 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-10-08T15:34:33.544 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../077-python3-google-auth_1.5.1-2_all.deb ... 2023-10-08T15:34:33.548 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-osd (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:33.549 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-mgr (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:33.610 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-10-08T15:34:33.903 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-waitress. 2023-10-08T15:34:33.921 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../043-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-10-08T15:34:33.930 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-blinker. 2023-10-08T15:34:33.948 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../078-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-10-08T15:34:33.954 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-decorator. 2023-10-08T15:34:33.964 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-08T15:34:33.971 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../066-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-10-08T15:34:33.988 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-08T15:34:34.021 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-10-08T15:34:34.053 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-mon. 2023-10-08T15:34:34.071 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../053-ceph-mon_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:34.111 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-mon (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:34.291 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-oauthlib. 2023-10-08T15:34:34.298 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-tempita. 2023-10-08T15:34:34.307 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-10-08T15:34:34.308 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../079-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-10-08T15:34:34.314 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6_all.deb ... 2023-10-08T15:34:34.326 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../067-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-10-08T15:34:34.349 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-08T15:34:34.356 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-10-08T15:34:34.365 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-08T15:34:34.684 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-paste. 2023-10-08T15:34:34.695 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-10-08T15:34:34.701 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../045-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-10-08T15:34:34.701 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-scipy. 2023-10-08T15:34:34.711 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../080-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-10-08T15:34:34.717 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../068-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-10-08T15:34:34.742 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-10-08T15:34:34.753 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-08T15:34:34.759 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-10-08T15:34:35.053 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-10-08T15:34:35.073 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-10-08T15:34:35.111 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-10-08T15:34:35.191 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-websocket. 2023-10-08T15:34:35.208 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../081-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-10-08T15:34:35.223 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-osd. 2023-10-08T15:34:35.240 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../054-ceph-osd_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:35.249 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-10-08T15:34:35.273 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-osd (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:35.431 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-pastedeploy. 2023-10-08T15:34:35.447 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.0-1_all.deb ... 2023-10-08T15:34:35.489 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-10-08T15:34:35.570 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-kubernetes. 2023-10-08T15:34:35.589 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../082-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-10-08T15:34:35.628 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-10-08T15:34:35.775 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-webtest. 2023-10-08T15:34:35.795 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../048-python3-webtest_2.0.32-2_all.deb ... 2023-10-08T15:34:35.833 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-10-08T15:34:36.028 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-10-08T15:34:36.047 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../069-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-10-08T15:34:36.086 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-08T15:34:36.161 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-pecan. 2023-10-08T15:34:36.180 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-10-08T15:34:36.219 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-10-08T15:34:36.242 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-10-08T15:34:36.260 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../083-ceph-mgr-k8sevents_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T15:34:36.300 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mgr-k8sevents (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:36.335 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph. 2023-10-08T15:34:36.352 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../055-ceph_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:36.393 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:36.557 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-werkzeug. 2023-10-08T15:34:36.574 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../050-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-10-08T15:34:36.607 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-joblib. 2023-10-08T15:34:36.615 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-08T15:34:36.626 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../070-python3-joblib_0.14.0-3_all.deb ... 2023-10-08T15:34:36.628 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libonig5:amd64. 2023-10-08T15:34:36.645 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../084-libonig5_6.9.4-1_amd64.deb ... 2023-10-08T15:34:36.665 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-10-08T15:34:36.686 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-10-08T15:34:36.737 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-fuse. 2023-10-08T15:34:36.756 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../056-ceph-fuse_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:36.795 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-fuse (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:36.960 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-10-08T15:34:36.979 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../051-libsqlite3-mod-ceph_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:37.018 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libsqlite3-mod-ceph (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:37.064 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libjq1:amd64. 2023-10-08T15:34:37.068 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-sklearn. 2023-10-08T15:34:37.080 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../085-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-08T15:34:37.084 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../071-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-10-08T15:34:37.122 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-08T15:34:37.126 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-08T15:34:37.182 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mds. 2023-10-08T15:34:37.200 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../057-ceph-mds_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:37.240 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mds (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:37.380 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package ceph-mgr. 2023-10-08T15:34:37.397 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../052-ceph-mgr_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:37.438 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking ceph-mgr (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:37.458 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package jq. 2023-10-08T15:34:37.477 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../086-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-08T15:34:37.516 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-10-08T15:34:37.777 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package socat. 2023-10-08T15:34:37.797 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../087-socat_1.7.3.3-2_amd64.deb ... 2023-10-08T15:34:37.818 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package cephadm. 2023-10-08T15:34:37.835 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking socat (1.7.3.3-2) ... 2023-10-08T15:34:37.838 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../058-cephadm_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:37.876 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking cephadm (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:37.902 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-10-08T15:34:37.922 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../072-ceph-mgr-diskprediction-local_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T15:34:37.958 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package ceph-mon. 2023-10-08T15:34:37.959 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking ceph-mgr-diskprediction-local (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:37.974 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../053-ceph-mon_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:38.015 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking ceph-mon (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:38.034 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph. 2023-10-08T15:34:38.052 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../055-ceph_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:38.093 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:38.179 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-jinja2. 2023-10-08T15:34:38.196 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../059-python3-jinja2_2.10.1-2_all.deb ... 2023-10-08T15:34:38.205 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package xmlstarlet. 2023-10-08T15:34:38.223 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../088-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-10-08T15:34:38.237 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-10-08T15:34:38.263 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-10-08T15:34:38.462 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-fuse. 2023-10-08T15:34:38.478 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../056-ceph-fuse_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:38.520 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-fuse (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:38.565 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-10-08T15:34:38.583 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../060-ceph-mgr-cephadm_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T15:34:38.618 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-test. 2023-10-08T15:34:38.623 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mgr-cephadm (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:38.638 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../089-ceph-test_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:38.684 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-test (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:38.949 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-mds. 2023-10-08T15:34:38.965 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../057-ceph-mds_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:39.001 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-repoze.lru. 2023-10-08T15:34:39.020 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../061-python3-repoze.lru_0.7-2_all.deb ... 2023-10-08T15:34:39.057 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-mds (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:39.059 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-10-08T15:34:39.088 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-cachetools. 2023-10-08T15:34:39.104 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../073-python3-cachetools_4.0.0-1_all.deb ... 2023-10-08T15:34:39.146 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-10-08T15:34:39.177 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package ceph-osd. 2023-10-08T15:34:39.194 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../054-ceph-osd_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:39.258 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking ceph-osd (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:39.312 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libjs-underscore. 2023-10-08T15:34:39.329 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../062-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-10-08T15:34:39.378 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-08T15:34:39.482 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-pyasn1. 2023-10-08T15:34:39.500 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../074-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-10-08T15:34:39.540 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-10-08T15:34:39.610 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package cephadm. 2023-10-08T15:34:39.627 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../058-cephadm_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:39.656 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-10-08T15:34:39.668 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking cephadm (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:39.675 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../063-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-10-08T15:34:39.714 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-08T15:34:39.868 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-10-08T15:34:39.885 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../075-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-10-08T15:34:39.926 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-08T15:34:40.005 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-jinja2. 2023-10-08T15:34:40.023 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../059-python3-jinja2_2.10.1-2_all.deb ... 2023-10-08T15:34:40.033 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-routes. 2023-10-08T15:34:40.049 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../064-python3-routes_2.4.1-2_all.deb ... 2023-10-08T15:34:40.088 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-10-08T15:34:40.091 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-10-08T15:34:40.254 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-rsa. 2023-10-08T15:34:40.270 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../076-python3-rsa_4.0-3_all.deb ... 2023-10-08T15:34:40.312 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-rsa (4.0-3) ... 2023-10-08T15:34:40.382 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-10-08T15:34:40.402 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../060-ceph-mgr-cephadm_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T15:34:40.428 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-10-08T15:34:40.440 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-mgr-cephadm (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:40.447 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../065-ceph-mgr-dashboard_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T15:34:40.486 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mgr-dashboard (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:40.649 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-google-auth. 2023-10-08T15:34:40.667 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../077-python3-google-auth_1.5.1-2_all.deb ... 2023-10-08T15:34:40.707 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-10-08T15:34:40.802 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-repoze.lru. 2023-10-08T15:34:40.822 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../061-python3-repoze.lru_0.7-2_all.deb ... 2023-10-08T15:34:40.860 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-10-08T15:34:40.956 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-decorator. 2023-10-08T15:34:40.973 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../066-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-10-08T15:34:41.014 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-10-08T15:34:41.044 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-blinker. 2023-10-08T15:34:41.061 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../078-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-10-08T15:34:41.102 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-08T15:34:41.130 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libjs-underscore. 2023-10-08T15:34:41.150 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../062-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-10-08T15:34:41.188 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-08T15:34:41.342 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-10-08T15:34:41.357 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../067-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-10-08T15:34:41.400 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-08T15:34:41.404 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-oauthlib. 2023-10-08T15:34:41.421 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../079-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-10-08T15:34:41.463 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-08T15:34:41.465 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-10-08T15:34:41.481 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../063-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-10-08T15:34:41.524 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-08T15:34:41.719 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-scipy. 2023-10-08T15:34:41.736 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../068-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-10-08T15:34:41.777 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-10-08T15:34:41.808 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-10-08T15:34:41.825 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../080-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-10-08T15:34:41.860 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-routes. 2023-10-08T15:34:41.866 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-08T15:34:41.876 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../064-python3-routes_2.4.1-2_all.deb ... 2023-10-08T15:34:41.918 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-10-08T15:34:42.005 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package ceph. 2023-10-08T15:34:42.022 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../055-ceph_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:42.055 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking ceph (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:42.288 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-10-08T15:34:42.296 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-websocket. 2023-10-08T15:34:42.304 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../065-ceph-mgr-dashboard_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T15:34:42.314 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../081-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-10-08T15:34:42.346 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-mgr-dashboard (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:42.354 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-10-08T15:34:42.374 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package ceph-fuse. 2023-10-08T15:34:42.392 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../056-ceph-fuse_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:42.432 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking ceph-fuse (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:42.658 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-kubernetes. 2023-10-08T15:34:42.678 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../082-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-10-08T15:34:42.716 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-10-08T15:34:42.852 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package ceph-mds. 2023-10-08T15:34:42.867 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-decorator. 2023-10-08T15:34:42.869 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../057-ceph-mds_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:42.883 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../066-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-10-08T15:34:42.910 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking ceph-mds (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:42.925 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-10-08T15:34:43.028 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-10-08T15:34:43.045 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../069-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-10-08T15:34:43.102 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-08T15:34:43.269 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-10-08T15:34:43.289 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../067-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-10-08T15:34:43.327 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-08T15:34:43.339 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-10-08T15:34:43.356 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../083-ceph-mgr-k8sevents_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T15:34:43.397 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking ceph-mgr-k8sevents (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:43.454 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package cephadm. 2023-10-08T15:34:43.471 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../058-cephadm_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:43.512 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking cephadm (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:43.622 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-joblib. 2023-10-08T15:34:43.639 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-scipy. 2023-10-08T15:34:43.640 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../070-python3-joblib_0.14.0-3_all.deb ... 2023-10-08T15:34:43.656 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../068-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-10-08T15:34:43.680 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-10-08T15:34:43.697 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-10-08T15:34:43.701 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libonig5:amd64. 2023-10-08T15:34:43.719 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../084-libonig5_6.9.4-1_amd64.deb ... 2023-10-08T15:34:43.758 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-10-08T15:34:43.782 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-jinja2. 2023-10-08T15:34:43.798 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../059-python3-jinja2_2.10.1-2_all.deb ... 2023-10-08T15:34:43.844 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-volume. 2023-10-08T15:34:43.862 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../090-ceph-volume_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T15:34:43.865 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-10-08T15:34:43.913 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-volume (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:44.059 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-sklearn. 2023-10-08T15:34:44.079 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../071-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-10-08T15:34:44.117 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-08T15:34:44.128 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libjq1:amd64. 2023-10-08T15:34:44.144 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../085-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-08T15:34:44.186 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-08T15:34:44.193 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-10-08T15:34:44.209 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../060-ceph-mgr-cephadm_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T15:34:44.243 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking ceph-mgr-cephadm (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:44.435 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package cephfs-mirror. 2023-10-08T15:34:44.452 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../091-cephfs-mirror_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:44.464 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package jq. 2023-10-08T15:34:44.480 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../086-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-08T15:34:44.518 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking cephfs-mirror (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:44.522 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-10-08T15:34:44.554 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-repoze.lru. 2023-10-08T15:34:44.572 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../061-python3-repoze.lru_0.7-2_all.deb ... 2023-10-08T15:34:44.634 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-10-08T15:34:44.808 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package socat. 2023-10-08T15:34:44.824 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../087-socat_1.7.3.3-2_amd64.deb ... 2023-10-08T15:34:44.825 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-10-08T15:34:44.841 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../072-ceph-mgr-diskprediction-local_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T15:34:44.866 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking socat (1.7.3.3-2) ... 2023-10-08T15:34:44.873 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libjs-underscore. 2023-10-08T15:34:44.883 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mgr-diskprediction-local (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:44.892 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../062-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-10-08T15:34:44.913 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-colorama. 2023-10-08T15:34:44.929 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../092-python3-colorama_0.4.3-1build1_all.deb ... 2023-10-08T15:34:44.931 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-08T15:34:44.971 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-10-08T15:34:45.115 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-10-08T15:34:45.132 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../069-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-10-08T15:34:45.173 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-08T15:34:45.178 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package xmlstarlet. 2023-10-08T15:34:45.196 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../088-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-10-08T15:34:45.208 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-10-08T15:34:45.225 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../063-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-10-08T15:34:45.236 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-10-08T15:34:45.266 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-08T15:34:45.269 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package cephfs-shell. 2023-10-08T15:34:45.289 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../093-cephfs-shell_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T15:34:45.327 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking cephfs-shell (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:45.571 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package cephfs-top. 2023-10-08T15:34:45.589 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../094-cephfs-top_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T15:34:45.611 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-routes. 2023-10-08T15:34:45.621 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package ceph-test. 2023-10-08T15:34:45.629 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../064-python3-routes_2.4.1-2_all.deb ... 2023-10-08T15:34:45.629 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking cephfs-top (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:45.639 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../089-ceph-test_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:45.677 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-10-08T15:34:45.679 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking ceph-test (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:45.727 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-joblib. 2023-10-08T15:34:45.743 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../070-python3-joblib_0.14.0-3_all.deb ... 2023-10-08T15:34:45.785 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-10-08T15:34:45.907 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package fonts-mathjax. 2023-10-08T15:34:45.924 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../095-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-10-08T15:34:45.965 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-10-08T15:34:46.005 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-10-08T15:34:46.011 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-cachetools. 2023-10-08T15:34:46.021 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../065-ceph-mgr-dashboard_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T15:34:46.031 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../073-python3-cachetools_4.0.0-1_all.deb ... 2023-10-08T15:34:46.063 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking ceph-mgr-dashboard (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:46.069 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-10-08T15:34:46.181 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-sklearn. 2023-10-08T15:34:46.200 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../071-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-10-08T15:34:46.239 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-08T15:34:46.321 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pyasn1. 2023-10-08T15:34:46.337 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../074-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-10-08T15:34:46.371 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-10-08T15:34:46.493 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libcephfs-dev. 2023-10-08T15:34:46.509 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../096-libcephfs-dev_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:46.542 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-decorator. 2023-10-08T15:34:46.550 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libcephfs-dev (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:46.558 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../066-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-10-08T15:34:46.600 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-10-08T15:34:46.699 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-10-08T15:34:46.716 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../075-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-10-08T15:34:46.791 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-08T15:34:46.903 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-10-08T15:34:46.914 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-10-08T15:34:46.923 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../067-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-10-08T15:34:46.934 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../072-ceph-mgr-diskprediction-local_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T15:34:46.945 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package nvme-cli. 2023-10-08T15:34:46.966 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../097-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-10-08T15:34:46.981 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-mgr-diskprediction-local (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:46.986 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-08T15:34:47.021 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-10-08T15:34:47.102 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-rsa. 2023-10-08T15:34:47.122 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../076-python3-rsa_4.0-3_all.deb ... 2023-10-08T15:34:47.160 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-rsa (4.0-3) ... 2023-10-08T15:34:47.288 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-scipy. 2023-10-08T15:34:47.308 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../068-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-10-08T15:34:47.346 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-10-08T15:34:47.350 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libjs-mathjax. 2023-10-08T15:34:47.370 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../098-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-10-08T15:34:47.408 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-10-08T15:34:47.455 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-google-auth. 2023-10-08T15:34:47.472 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../077-python3-google-auth_1.5.1-2_all.deb ... 2023-10-08T15:34:47.513 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-10-08T15:34:47.857 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-blinker. 2023-10-08T15:34:47.876 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../078-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-10-08T15:34:47.915 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-08T15:34:48.184 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-cachetools. 2023-10-08T15:34:48.203 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../073-python3-cachetools_4.0.0-1_all.deb ... 2023-10-08T15:34:48.218 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-oauthlib. 2023-10-08T15:34:48.238 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../079-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-10-08T15:34:48.242 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-10-08T15:34:48.276 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-08T15:34:48.578 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-pyasn1. 2023-10-08T15:34:48.594 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../074-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-10-08T15:34:48.626 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-10-08T15:34:48.636 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-10-08T15:34:48.646 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../080-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-10-08T15:34:48.663 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-10-08T15:34:48.681 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../069-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-10-08T15:34:48.688 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-08T15:34:48.721 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-08T15:34:48.973 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-10-08T15:34:48.991 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../075-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-10-08T15:34:49.037 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python-natsort-doc. 2023-10-08T15:34:49.056 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-08T15:34:49.057 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../099-python-natsort-doc_7.0.1-1_all.deb ... 2023-10-08T15:34:49.076 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-websocket. 2023-10-08T15:34:49.094 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../081-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-10-08T15:34:49.095 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-10-08T15:34:49.126 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-10-08T15:34:49.300 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-joblib. 2023-10-08T15:34:49.317 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../070-python3-joblib_0.14.0-3_all.deb ... 2023-10-08T15:34:49.351 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-rsa. 2023-10-08T15:34:49.358 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-10-08T15:34:49.370 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../076-python3-rsa_4.0-3_all.deb ... 2023-10-08T15:34:49.409 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-rsa (4.0-3) ... 2023-10-08T15:34:49.414 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-atomicwrites. 2023-10-08T15:34:49.429 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-kubernetes. 2023-10-08T15:34:49.432 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../100-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-10-08T15:34:49.448 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../082-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-10-08T15:34:49.487 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-10-08T15:34:49.514 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-10-08T15:34:49.736 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-sklearn. 2023-10-08T15:34:49.753 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../071-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-10-08T15:34:49.754 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-google-auth. 2023-10-08T15:34:49.774 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../077-python3-google-auth_1.5.1-2_all.deb ... 2023-10-08T15:34:49.794 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-08T15:34:49.812 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-10-08T15:34:49.817 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-attr. 2023-10-08T15:34:49.835 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../101-python3-attr_19.3.0-2_all.deb ... 2023-10-08T15:34:49.875 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-10-08T15:34:50.068 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-10-08T15:34:50.085 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../083-ceph-mgr-k8sevents_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T15:34:50.126 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mgr-k8sevents (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:50.158 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-blinker. 2023-10-08T15:34:50.176 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../078-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-10-08T15:34:50.215 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-08T15:34:50.220 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-webencodings. 2023-10-08T15:34:50.237 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-10-08T15:34:50.278 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-08T15:34:50.446 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libonig5:amd64. 2023-10-08T15:34:50.461 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-10-08T15:34:50.466 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../084-libonig5_6.9.4-1_amd64.deb ... 2023-10-08T15:34:50.477 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../072-ceph-mgr-diskprediction-local_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T15:34:50.512 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-10-08T15:34:50.518 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking ceph-mgr-diskprediction-local (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:50.527 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-oauthlib. 2023-10-08T15:34:50.543 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../079-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-10-08T15:34:50.581 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-html5lib. 2023-10-08T15:34:50.585 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-08T15:34:50.593 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package ceph-volume. 2023-10-08T15:34:50.599 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2023-10-08T15:34:50.610 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../090-ceph-volume_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T15:34:50.639 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-10-08T15:34:50.651 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking ceph-volume (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:50.865 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libjq1:amd64. 2023-10-08T15:34:50.882 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../085-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-08T15:34:50.923 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-08T15:34:50.939 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-10-08T15:34:50.956 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../080-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-10-08T15:34:50.997 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-08T15:34:51.009 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-10-08T15:34:51.030 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-10-08T15:34:51.048 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package cephfs-mirror. 2023-10-08T15:34:51.064 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../091-cephfs-mirror_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:51.067 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-08T15:34:51.106 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking cephfs-mirror (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:51.206 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package jq. 2023-10-08T15:34:51.226 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../086-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-08T15:34:51.264 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-10-08T15:34:51.394 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-websocket. 2023-10-08T15:34:51.414 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../081-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-10-08T15:34:51.442 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-colorama. 2023-10-08T15:34:51.452 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-10-08T15:34:51.460 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../092-python3-colorama_0.4.3-1build1_all.deb ... 2023-10-08T15:34:51.520 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-10-08T15:34:51.550 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package socat. 2023-10-08T15:34:51.554 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-packaging. 2023-10-08T15:34:51.568 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../087-socat_1.7.3.3-2_amd64.deb ... 2023-10-08T15:34:51.572 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../105-python3-packaging_20.3-1_all.deb ... 2023-10-08T15:34:51.608 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking socat (1.7.3.3-2) ... 2023-10-08T15:34:51.612 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-packaging (20.3-1) ... 2023-10-08T15:34:51.664 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-cachetools. 2023-10-08T15:34:51.681 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../073-python3-cachetools_4.0.0-1_all.deb ... 2023-10-08T15:34:51.722 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-10-08T15:34:51.798 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-kubernetes. 2023-10-08T15:34:51.803 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package cephfs-shell. 2023-10-08T15:34:51.813 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../082-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-10-08T15:34:51.820 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../093-cephfs-shell_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T15:34:51.856 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-10-08T15:34:51.861 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking cephfs-shell (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:51.916 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pastescript. 2023-10-08T15:34:51.920 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package xmlstarlet. 2023-10-08T15:34:51.935 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2023-10-08T15:34:51.937 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../088-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-10-08T15:34:51.974 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-10-08T15:34:51.978 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-10-08T15:34:51.982 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-pyasn1. 2023-10-08T15:34:51.999 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../074-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-10-08T15:34:52.032 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-10-08T15:34:52.115 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package cephfs-top. 2023-10-08T15:34:52.131 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../094-cephfs-top_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T15:34:52.172 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking cephfs-top (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:52.294 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pluggy. 2023-10-08T15:34:52.312 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-2_all.deb ... 2023-10-08T15:34:52.335 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-10-08T15:34:52.338 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-test. 2023-10-08T15:34:52.352 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-10-08T15:34:52.355 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../075-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-10-08T15:34:52.356 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../089-ceph-test_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:52.385 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-08T15:34:52.398 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-test (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:52.467 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package fonts-mathjax. 2023-10-08T15:34:52.487 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../095-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-10-08T15:34:52.495 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-10-08T15:34:52.512 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../083-ceph-mgr-k8sevents_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T15:34:52.525 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-10-08T15:34:52.553 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-mgr-k8sevents (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:52.646 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-rsa. 2023-10-08T15:34:52.663 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../076-python3-rsa_4.0-3_all.deb ... 2023-10-08T15:34:52.696 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-rsa (4.0-3) ... 2023-10-08T15:34:52.697 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-psutil. 2023-10-08T15:34:52.715 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../108-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-10-08T15:34:52.755 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-10-08T15:34:52.907 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libonig5:amd64. 2023-10-08T15:34:52.924 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../084-libonig5_6.9.4-1_amd64.deb ... 2023-10-08T15:34:52.966 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-10-08T15:34:52.999 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-google-auth. 2023-10-08T15:34:53.019 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../077-python3-google-auth_1.5.1-2_all.deb ... 2023-10-08T15:34:53.022 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libcephfs-dev. 2023-10-08T15:34:53.043 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../096-libcephfs-dev_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:53.076 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-10-08T15:34:53.094 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-py. 2023-10-08T15:34:53.107 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libcephfs-dev (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:53.112 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../109-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-10-08T15:34:53.153 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-10-08T15:34:53.343 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libjq1:amd64. 2023-10-08T15:34:53.360 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../085-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-08T15:34:53.394 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-blinker. 2023-10-08T15:34:53.401 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-08T15:34:53.410 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../078-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-10-08T15:34:53.452 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-08T15:34:53.489 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pyinotify. 2023-10-08T15:34:53.494 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package nvme-cli. 2023-10-08T15:34:53.506 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-10-08T15:34:53.510 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../097-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-10-08T15:34:53.547 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-08T15:34:53.570 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-10-08T15:34:53.679 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package jq. 2023-10-08T15:34:53.696 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../086-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-08T15:34:53.746 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-10-08T15:34:53.754 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-oauthlib. 2023-10-08T15:34:53.775 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../079-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-10-08T15:34:53.813 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-08T15:34:53.867 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pytest. 2023-10-08T15:34:53.884 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../111-python3-pytest_4.6.9-1_all.deb ... 2023-10-08T15:34:53.923 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libjs-mathjax. 2023-10-08T15:34:53.940 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../098-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-10-08T15:34:53.958 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-10-08T15:34:53.981 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-10-08T15:34:54.024 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package socat. 2023-10-08T15:34:54.040 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../087-socat_1.7.3.3-2_amd64.deb ... 2023-10-08T15:34:54.082 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking socat (1.7.3.3-2) ... 2023-10-08T15:34:54.283 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-10-08T15:34:54.295 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-simplejson. 2023-10-08T15:34:54.303 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../080-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-10-08T15:34:54.312 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../112-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-10-08T15:34:54.341 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-08T15:34:54.353 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-08T15:34:54.737 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package xmlstarlet. 2023-10-08T15:34:54.753 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../088-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-10-08T15:34:54.754 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-websocket. 2023-10-08T15:34:54.771 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../081-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-10-08T15:34:54.794 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-10-08T15:34:54.812 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-10-08T15:34:55.056 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-10-08T15:34:55.075 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../113-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-10-08T15:34:55.108 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-kubernetes. 2023-10-08T15:34:55.113 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-10-08T15:34:55.125 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../082-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-10-08T15:34:55.165 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-10-08T15:34:55.166 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-test. 2023-10-08T15:34:55.182 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../089-ceph-test_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:55.224 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-test (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:55.788 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-10-08T15:34:55.805 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../083-ceph-mgr-k8sevents_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T15:34:55.846 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking ceph-mgr-k8sevents (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:55.877 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package radosgw. 2023-10-08T15:34:55.895 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../114-radosgw_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:55.935 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking radosgw (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:56.045 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python-natsort-doc. 2023-10-08T15:34:56.066 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../099-python-natsort-doc_7.0.1-1_all.deb ... 2023-10-08T15:34:56.103 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-10-08T15:34:56.149 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libonig5:amd64. 2023-10-08T15:34:56.168 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../084-libonig5_6.9.4-1_amd64.deb ... 2023-10-08T15:34:56.232 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-10-08T15:34:56.456 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-atomicwrites. 2023-10-08T15:34:56.473 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../100-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-10-08T15:34:56.514 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-10-08T15:34:56.585 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libjq1:amd64. 2023-10-08T15:34:56.602 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../085-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-08T15:34:56.643 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-08T15:34:56.817 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-attr. 2023-10-08T15:34:56.833 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../101-python3-attr_19.3.0-2_all.deb ... 2023-10-08T15:34:56.875 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-10-08T15:34:56.929 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package jq. 2023-10-08T15:34:56.947 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../086-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-08T15:34:57.008 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-10-08T15:34:57.228 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-webencodings. 2023-10-08T15:34:57.245 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package socat. 2023-10-08T15:34:57.245 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-10-08T15:34:57.262 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../087-socat_1.7.3.3-2_amd64.deb ... 2023-10-08T15:34:57.286 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-08T15:34:57.294 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking socat (1.7.3.3-2) ... 2023-10-08T15:34:57.437 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-volume. 2023-10-08T15:34:57.453 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../090-ceph-volume_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T15:34:57.494 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-volume (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:57.572 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-html5lib. 2023-10-08T15:34:57.589 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2023-10-08T15:34:57.614 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package xmlstarlet. 2023-10-08T15:34:57.630 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-10-08T15:34:57.634 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../088-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-10-08T15:34:57.673 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-10-08T15:34:57.805 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package rbd-fuse. 2023-10-08T15:34:57.823 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../115-rbd-fuse_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:57.863 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking rbd-fuse (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:57.908 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package cephfs-mirror. 2023-10-08T15:34:57.925 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../091-cephfs-mirror_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:57.991 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking cephfs-mirror (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:57.992 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-10-08T15:34:58.009 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-10-08T15:34:58.010 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package ceph-test. 2023-10-08T15:34:58.026 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../089-ceph-test_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:58.050 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-08T15:34:58.060 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking ceph-test (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:58.167 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-attr (19.3.0-2) ... 2023-10-08T15:34:58.331 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-colorama. 2023-10-08T15:34:58.349 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../092-python3-colorama_0.4.3-1build1_all.deb ... 2023-10-08T15:34:58.389 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-10-08T15:34:58.553 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-packaging. 2023-10-08T15:34:58.570 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../105-python3-packaging_20.3-1_all.deb ... 2023-10-08T15:34:58.597 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-10-08T15:34:58.611 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-packaging (20.3-1) ... 2023-10-08T15:34:58.633 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package cephfs-shell. 2023-10-08T15:34:58.649 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../093-cephfs-shell_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T15:34:58.691 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking cephfs-shell (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:58.715 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-10-08T15:34:58.841 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-10-08T15:34:58.898 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-pastescript. 2023-10-08T15:34:58.919 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2023-10-08T15:34:58.956 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-10-08T15:34:58.971 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package cephfs-top. 2023-10-08T15:34:58.988 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../094-cephfs-top_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T15:34:59.029 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking cephfs-top (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:59.067 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up cephadm (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:59.260 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-pluggy. 2023-10-08T15:34:59.280 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-2_all.deb ... 2023-10-08T15:34:59.297 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package fonts-mathjax. 2023-10-08T15:34:59.314 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../095-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-10-08T15:34:59.334 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-10-08T15:34:59.355 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-10-08T15:34:59.655 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-psutil. 2023-10-08T15:34:59.673 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../108-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-10-08T15:34:59.698 INFO:teuthology.orchestra.run.smithi050.stdout:Adding system user cephadm....done 2023-10-08T15:34:59.704 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-10-08T15:34:59.858 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libcephfs-dev. 2023-10-08T15:34:59.859 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-10-08T15:34:59.879 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../096-libcephfs-dev_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:34:59.916 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libcephfs-dev (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:34:59.985 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-08T15:35:00.073 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-py. 2023-10-08T15:35:00.091 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../109-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-10-08T15:35:00.133 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-10-08T15:35:00.302 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package nvme-cli. 2023-10-08T15:35:00.323 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../097-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-10-08T15:35:00.370 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-volume. 2023-10-08T15:35:00.378 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-10-08T15:35:00.390 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../090-ceph-volume_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T15:35:00.428 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-volume (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:00.428 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-10-08T15:35:00.470 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-pyinotify. 2023-10-08T15:35:00.488 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-10-08T15:35:00.528 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-08T15:35:00.691 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libjs-mathjax. 2023-10-08T15:35:00.708 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../098-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-10-08T15:35:00.721 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-10-08T15:35:00.774 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-10-08T15:35:00.797 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-pytest. 2023-10-08T15:35:00.814 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../111-python3-pytest_4.6.9-1_all.deb ... 2023-10-08T15:35:00.872 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-10-08T15:35:00.880 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-10-08T15:35:00.884 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package cephfs-mirror. 2023-10-08T15:35:00.900 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../091-cephfs-mirror_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:35:00.942 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking cephfs-mirror (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:00.998 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-10-08T15:35:01.190 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-simplejson. 2023-10-08T15:35:01.205 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../112-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-10-08T15:35:01.237 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-08T15:35:01.271 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-colorama. 2023-10-08T15:35:01.288 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../092-python3-colorama_0.4.3-1build1_all.deb ... 2023-10-08T15:35:01.308 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-10-08T15:35:01.328 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-10-08T15:35:01.507 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-10-08T15:35:01.525 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../113-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-10-08T15:35:01.565 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-10-08T15:35:01.625 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package cephfs-shell. 2023-10-08T15:35:01.643 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../093-cephfs-shell_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T15:35:01.684 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking cephfs-shell (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:01.744 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-08T15:35:01.972 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package cephfs-top. 2023-10-08T15:35:01.988 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../094-cephfs-top_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T15:35:02.038 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking cephfs-top (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:02.070 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-10-08T15:35:02.253 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package radosgw. 2023-10-08T15:35:02.272 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../114-radosgw_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:35:02.291 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package fonts-mathjax. 2023-10-08T15:35:02.308 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../095-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-10-08T15:35:02.311 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking radosgw (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:02.349 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-10-08T15:35:02.359 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python-natsort-doc. 2023-10-08T15:35:02.362 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-10-08T15:35:02.378 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../099-python-natsort-doc_7.0.1-1_all.deb ... 2023-10-08T15:35:02.408 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-10-08T15:35:02.639 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-08T15:35:02.753 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-atomicwrites. 2023-10-08T15:35:02.770 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../100-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-10-08T15:35:02.811 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-10-08T15:35:02.836 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libcephfs-dev. 2023-10-08T15:35:02.852 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../096-libcephfs-dev_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:35:02.894 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libcephfs-dev (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:02.940 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-08T15:35:03.049 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package ceph-volume. 2023-10-08T15:35:03.066 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../090-ceph-volume_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T15:35:03.107 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking ceph-volume (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:03.113 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-attr. 2023-10-08T15:35:03.130 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../101-python3-attr_19.3.0-2_all.deb ... 2023-10-08T15:35:03.172 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-10-08T15:35:03.224 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-ceph-argparse (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:03.306 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package nvme-cli. 2023-10-08T15:35:03.324 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../097-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-10-08T15:35:03.380 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-10-08T15:35:03.500 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-webencodings. 2023-10-08T15:35:03.519 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-10-08T15:35:03.521 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package cephfs-mirror. 2023-10-08T15:35:03.541 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../091-cephfs-mirror_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:35:03.559 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-08T15:35:03.589 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking cephfs-mirror (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:03.600 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-08T15:35:03.684 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-10-08T15:35:03.752 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libjs-mathjax. 2023-10-08T15:35:03.769 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../098-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-10-08T15:35:03.810 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-10-08T15:35:03.903 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-html5lib. 2023-10-08T15:35:03.921 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2023-10-08T15:35:03.957 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-colorama. 2023-10-08T15:35:03.961 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-10-08T15:35:03.969 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-10-08T15:35:03.974 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../092-python3-colorama_0.4.3-1build1_all.deb ... 2023-10-08T15:35:04.015 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-10-08T15:35:04.114 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package rbd-fuse. 2023-10-08T15:35:04.131 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../115-rbd-fuse_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:35:04.172 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking rbd-fuse (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:04.262 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-08T15:35:04.273 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-10-08T15:35:04.288 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package cephfs-shell. 2023-10-08T15:35:04.292 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-10-08T15:35:04.305 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../093-cephfs-shell_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T15:35:04.330 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-08T15:35:04.346 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking cephfs-shell (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:04.477 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-attr (19.3.0-2) ... 2023-10-08T15:35:04.580 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-10-08T15:35:04.706 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-10-08T15:35:04.740 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package cephfs-top. 2023-10-08T15:35:04.760 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../094-cephfs-top_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T15:35:04.772 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-10-08T15:35:04.784 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-packaging. 2023-10-08T15:35:04.798 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking cephfs-top (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:04.804 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../105-python3-packaging_20.3-1_all.deb ... 2023-10-08T15:35:04.842 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-packaging (20.3-1) ... 2023-10-08T15:35:04.898 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-10-08T15:35:05.024 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-10-08T15:35:05.051 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package fonts-mathjax. 2023-10-08T15:35:05.067 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../095-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-10-08T15:35:05.085 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-10-08T15:35:05.109 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-10-08T15:35:05.145 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pastescript. 2023-10-08T15:35:05.162 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2023-10-08T15:35:05.203 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-10-08T15:35:05.226 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up cephadm (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:05.404 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-10-08T15:35:05.440 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-natsort-doc. 2023-10-08T15:35:05.458 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../099-python-natsort-doc_7.0.1-1_all.deb ... 2023-10-08T15:35:05.497 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-10-08T15:35:05.565 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pluggy. 2023-10-08T15:35:05.582 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-2_all.deb ... 2023-10-08T15:35:05.623 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-10-08T15:35:05.636 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libcephfs-dev. 2023-10-08T15:35:05.654 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../096-libcephfs-dev_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:35:05.681 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-08T15:35:05.694 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libcephfs-dev (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:05.851 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-atomicwrites. 2023-10-08T15:35:05.871 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../100-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-10-08T15:35:05.874 INFO:teuthology.orchestra.run.smithi098.stdout:Adding system user cephadm....done 2023-10-08T15:35:05.909 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-10-08T15:35:05.921 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-psutil. 2023-10-08T15:35:05.939 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../108-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-10-08T15:35:05.979 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-10-08T15:35:06.036 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-10-08T15:35:06.065 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-10-08T15:35:06.089 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package nvme-cli. 2023-10-08T15:35:06.106 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../097-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-10-08T15:35:06.137 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-08T15:35:06.165 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-10-08T15:35:06.245 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-attr. 2023-10-08T15:35:06.264 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../101-python3-attr_19.3.0-2_all.deb ... 2023-10-08T15:35:06.303 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-10-08T15:35:06.307 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-py. 2023-10-08T15:35:06.325 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../109-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-10-08T15:35:06.357 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-10-08T15:35:06.358 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-10-08T15:35:06.506 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-10-08T15:35:06.510 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libjs-mathjax. 2023-10-08T15:35:06.526 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../098-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-10-08T15:35:06.569 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-10-08T15:35:06.666 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-webencodings. 2023-10-08T15:35:06.681 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-10-08T15:35:06.718 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pyinotify. 2023-10-08T15:35:06.722 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-08T15:35:06.734 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-10-08T15:35:06.739 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-10-08T15:35:06.776 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-08T15:35:06.799 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-10-08T15:35:06.935 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-10-08T15:35:07.027 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-html5lib. 2023-10-08T15:35:07.045 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2023-10-08T15:35:07.069 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-packaging (20.3-1) ... 2023-10-08T15:35:07.070 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pytest. 2023-10-08T15:35:07.085 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-10-08T15:35:07.086 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-10-08T15:35:07.091 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../111-python3-pytest_4.6.9-1_all.deb ... 2023-10-08T15:35:07.128 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-10-08T15:35:07.387 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-10-08T15:35:07.388 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-10-08T15:35:07.447 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-10-08T15:35:07.464 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-10-08T15:35:07.505 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-08T15:35:07.507 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-simplejson. 2023-10-08T15:35:07.516 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-10-08T15:35:07.524 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../112-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-10-08T15:35:07.565 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-08T15:35:07.642 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-08T15:35:07.782 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-08T15:35:07.852 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-10-08T15:35:07.869 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../113-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-10-08T15:35:07.910 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-10-08T15:35:07.967 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-packaging. 2023-10-08T15:35:07.968 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-10-08T15:35:07.988 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../105-python3-packaging_20.3-1_all.deb ... 2023-10-08T15:35:08.024 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-packaging (20.3-1) ... 2023-10-08T15:35:08.075 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-10-08T15:35:08.228 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python-natsort-doc. 2023-10-08T15:35:08.247 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../099-python-natsort-doc_7.0.1-1_all.deb ... 2023-10-08T15:35:08.286 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-10-08T15:35:08.329 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-pastescript. 2023-10-08T15:35:08.347 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2023-10-08T15:35:08.359 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-10-08T15:35:08.386 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-10-08T15:35:08.386 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-10-08T15:35:08.639 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package radosgw. 2023-10-08T15:35:08.647 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-atomicwrites. 2023-10-08T15:35:08.652 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-08T15:35:08.659 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../114-radosgw_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:35:08.664 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../100-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-10-08T15:35:08.696 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-08T15:35:08.697 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking radosgw (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:08.705 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-10-08T15:35:08.715 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-pluggy. 2023-10-08T15:35:08.733 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-2_all.deb ... 2023-10-08T15:35:08.807 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-10-08T15:35:08.937 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-08T15:35:09.000 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-attr. 2023-10-08T15:35:09.018 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../101-python3-attr_19.3.0-2_all.deb ... 2023-10-08T15:35:09.058 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-10-08T15:35:09.073 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-08T15:35:09.118 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-psutil. 2023-10-08T15:35:09.139 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../108-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-10-08T15:35:09.185 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-10-08T15:35:09.188 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-ceph-argparse (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:09.419 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-webencodings. 2023-10-08T15:35:09.435 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up socat (1.7.3.3-2) ... 2023-10-08T15:35:09.436 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-10-08T15:35:09.477 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-08T15:35:09.490 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-08T15:35:09.555 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-py. 2023-10-08T15:35:09.573 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../109-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-10-08T15:35:09.586 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-ceph-common (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:09.612 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-10-08T15:35:09.615 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-10-08T15:35:09.773 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-html5lib. 2023-10-08T15:35:09.793 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2023-10-08T15:35:09.822 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-10-08T15:35:09.900 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-10-08T15:35:09.912 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T15:35:09.996 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-pyinotify. 2023-10-08T15:35:10.013 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-10-08T15:35:10.039 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-10-08T15:35:10.053 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-08T15:35:10.184 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-10-08T15:35:10.184 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-08T15:35:10.202 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-10-08T15:35:10.241 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-08T15:35:10.390 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-08T15:35:10.398 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-pytest. 2023-10-08T15:35:10.414 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../111-python3-pytest_4.6.9-1_all.deb ... 2023-10-08T15:35:10.456 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-10-08T15:35:10.469 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-10-08T15:35:10.478 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package rbd-fuse. 2023-10-08T15:35:10.498 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../115-rbd-fuse_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:35:10.524 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-10-08T15:35:10.536 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking rbd-fuse (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:10.595 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-10-08T15:35:10.650 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-10-08T15:35:10.686 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-packaging. 2023-10-08T15:35:10.706 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../105-python3-packaging_20.3-1_all.deb ... 2023-10-08T15:35:10.744 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-packaging (20.3-1) ... 2023-10-08T15:35:10.793 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-simplejson. 2023-10-08T15:35:10.810 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../112-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-10-08T15:35:10.830 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-attr (19.3.0-2) ... 2023-10-08T15:35:10.851 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-08T15:35:10.952 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-08T15:35:10.963 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-10-08T15:35:11.081 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-pastescript. 2023-10-08T15:35:11.099 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2023-10-08T15:35:11.116 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-10-08T15:35:11.139 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-10-08T15:35:11.154 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-10-08T15:35:11.171 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../113-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-10-08T15:35:11.212 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-10-08T15:35:11.239 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-10-08T15:35:11.267 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-10-08T15:35:11.287 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T15:35:11.395 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-10-08T15:35:11.446 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-08T15:35:11.468 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-pluggy. 2023-10-08T15:35:11.488 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-2_all.deb ... 2023-10-08T15:35:11.515 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-08T15:35:11.525 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-10-08T15:35:11.555 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-10-08T15:35:11.571 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up cephadm (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:11.862 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-psutil. 2023-10-08T15:35:11.865 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-10-08T15:35:11.879 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../108-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-10-08T15:35:11.883 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-10-08T15:35:11.920 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-10-08T15:35:11.976 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package radosgw. 2023-10-08T15:35:11.998 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../114-radosgw_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:35:12.034 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking radosgw (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:12.141 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-10-08T15:35:12.168 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-10-08T15:35:12.200 INFO:teuthology.orchestra.run.smithi153.stdout:Adding system user cephadm....done 2023-10-08T15:35:12.210 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-py. 2023-10-08T15:35:12.228 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../109-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-10-08T15:35:12.259 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-10-08T15:35:12.361 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-10-08T15:35:12.451 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-08T15:35:12.487 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-08T15:35:12.494 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-10-08T15:35:12.562 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-pyinotify. 2023-10-08T15:35:12.577 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-10-08T15:35:12.581 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-10-08T15:35:12.621 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-08T15:35:12.779 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-packaging (20.3-1) ... 2023-10-08T15:35:12.814 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-10-08T15:35:12.912 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-10-08T15:35:12.929 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-pytest. 2023-10-08T15:35:12.944 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../111-python3-pytest_4.6.9-1_all.deb ... 2023-10-08T15:35:12.981 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-10-08T15:35:13.055 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-10-08T15:35:13.107 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-10-08T15:35:13.200 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-10-08T15:35:13.213 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-08T15:35:13.233 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-10-08T15:35:13.327 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-08T15:35:13.343 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package python3-simplejson. 2023-10-08T15:35:13.359 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-10-08T15:35:13.364 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../112-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-10-08T15:35:13.401 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-08T15:35:13.522 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-10-08T15:35:13.611 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-10-08T15:35:13.685 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-10-08T15:35:13.687 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-10-08T15:35:13.707 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../113-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-10-08T15:35:13.745 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-10-08T15:35:13.849 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package rbd-fuse. 2023-10-08T15:35:13.849 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../115-rbd-fuse_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:35:13.878 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking rbd-fuse (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:13.898 INFO:teuthology.orchestra.run.smithi050.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-10-08T15:35:14.013 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-10-08T15:35:14.104 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-08T15:35:14.176 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-10-08T15:35:14.231 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-attr (19.3.0-2) ... 2023-10-08T15:35:14.289 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-08T15:35:14.301 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-08T15:35:14.388 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-10-08T15:35:14.499 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package radosgw. 2023-10-08T15:35:14.514 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-10-08T15:35:14.518 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../114-radosgw_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:35:14.557 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking radosgw (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:14.628 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-10-08T15:35:14.657 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-08T15:35:14.665 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-10-08T15:35:14.672 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-10-08T15:35:14.791 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-10-08T15:35:14.957 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-08T15:35:14.986 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up cephadm (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:14.987 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-08T15:35:15.038 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up socat (1.7.3.3-2) ... 2023-10-08T15:35:15.113 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-08T15:35:15.147 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-ceph-common (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:15.216 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-08T15:35:15.256 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-10-08T15:35:15.449 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T15:35:15.509 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-ceph-argparse (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:15.574 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-08T15:35:15.583 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-10-08T15:35:15.641 INFO:teuthology.orchestra.run.smithi089.stdout:Adding system user cephadm....done 2023-10-08T15:35:15.818 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-08T15:35:15.819 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-10-08T15:35:15.875 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up librados2 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:15.948 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-08T15:35:15.948 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-10-08T15:35:15.948 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-08T15:35:16.001 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-10-08T15:35:16.052 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-10-08T15:35:16.204 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-10-08T15:35:16.212 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-10-08T15:35:16.281 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-10-08T15:35:16.328 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package rbd-fuse. 2023-10-08T15:35:16.346 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../115-rbd-fuse_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T15:35:16.385 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking rbd-fuse (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:16.482 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-08T15:35:16.497 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-08T15:35:16.574 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-10-08T15:35:16.677 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-attr (19.3.0-2) ... 2023-10-08T15:35:16.700 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-10-08T15:35:16.774 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-10-08T15:35:16.809 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T15:35:16.859 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-10-08T15:35:16.901 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-10-08T15:35:16.958 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-08T15:35:17.044 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-10-08T15:35:17.086 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-10-08T15:35:17.170 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-10-08T15:35:17.178 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-10-08T15:35:17.269 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-10-08T15:35:17.296 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-10-08T15:35:17.421 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-10-08T15:35:17.488 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up cephadm (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:17.523 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libsqlite3-mod-ceph (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:17.553 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-10-08T15:35:17.605 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-08T15:35:17.650 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-08T15:35:17.689 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-10-08T15:35:17.809 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-10-08T15:35:17.854 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-08T15:35:17.881 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-10-08T15:35:18.007 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-08T15:35:18.133 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-10-08T15:35:18.135 INFO:teuthology.orchestra.run.smithi003.stdout:Adding system user cephadm....done 2023-10-08T15:35:18.157 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-10-08T15:35:18.194 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-10-08T15:35:18.206 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-10-08T15:35:18.288 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-10-08T15:35:18.414 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-08T15:35:18.417 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-10-08T15:35:18.442 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-08T15:35:18.498 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-10-08T15:35:18.503 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-10-08T15:35:18.710 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-08T15:35:18.743 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-08T15:35:18.788 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T15:35:18.791 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-10-08T15:35:18.852 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-10-08T15:35:18.897 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-10-08T15:35:18.986 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-ceph-argparse (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:19.045 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-10-08T15:35:19.312 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-08T15:35:19.312 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libcephfs2 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:19.313 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-packaging (20.3-1) ... 2023-10-08T15:35:19.313 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-10-08T15:35:19.313 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-10-08T15:35:19.327 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-10-08T15:35:19.398 INFO:teuthology.orchestra.run.smithi098.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-10-08T15:35:19.408 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-08T15:35:19.438 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-10-08T15:35:19.454 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-10-08T15:35:19.606 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-10-08T15:35:19.654 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-10-08T15:35:19.664 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-10-08T15:35:19.714 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-10-08T15:35:19.731 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-08T15:35:19.752 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libradosstriper1 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:19.765 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-08T15:35:19.878 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-08T15:35:19.991 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-08T15:35:20.016 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-10-08T15:35:20.092 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-10-08T15:35:20.097 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-08T15:35:20.222 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-08T15:35:20.292 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-10-08T15:35:20.390 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-10-08T15:35:20.436 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-10-08T15:35:20.442 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-10-08T15:35:20.443 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-08T15:35:20.569 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-08T15:35:20.691 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-10-08T15:35:20.695 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-10-08T15:35:20.743 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-08T15:35:20.828 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-10-08T15:35:20.984 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-08T15:35:21.022 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-08T15:35:21.113 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-08T15:35:21.121 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-10-08T15:35:21.277 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-08T15:35:21.285 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up librbd1 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:21.298 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up librados2 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:21.399 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-10-08T15:35:21.407 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-08T15:35:21.410 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-08T15:35:21.465 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up socat (1.7.3.3-2) ... 2023-10-08T15:35:21.570 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-10-08T15:35:21.583 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-ceph-common (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:21.603 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-ceph-argparse (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:21.679 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-10-08T15:35:21.776 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-10-08T15:35:21.814 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-rsa (4.0-3) ... 2023-10-08T15:35:21.892 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T15:35:21.895 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-08T15:35:21.997 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-10-08T15:35:22.027 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-10-08T15:35:22.077 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-10-08T15:35:22.157 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-10-08T15:35:22.273 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-10-08T15:35:22.283 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-10-08T15:35:22.370 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-08T15:35:22.420 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-10-08T15:35:22.496 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-10-08T15:35:22.557 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-08T15:35:22.622 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-10-08T15:35:22.670 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mgr-modules-core (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:22.713 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-packaging (20.3-1) ... 2023-10-08T15:35:22.821 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-fuse (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:22.846 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libsqlite3-mod-ceph (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:22.859 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-10-08T15:35:22.889 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-08T15:35:22.956 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-08T15:35:22.985 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-10-08T15:35:22.998 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-10-08T15:35:23.035 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-08T15:35:23.036 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-08T15:35:23.057 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-10-08T15:35:23.149 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-10-08T15:35:23.232 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T15:35:23.266 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-08T15:35:23.358 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-08T15:35:23.361 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-10-08T15:35:23.450 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-10-08T15:35:23.456 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libcephfs-dev (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:23.484 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-10-08T15:35:23.546 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-10-08T15:35:23.582 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-08T15:35:23.639 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-10-08T15:35:23.751 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-10-08T15:35:23.794 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-10-08T15:35:23.875 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-10-08T15:35:23.932 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-08T15:35:23.981 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-10-08T15:35:24.028 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T15:35:24.070 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-10-08T15:35:24.153 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-10-08T15:35:24.226 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-10-08T15:35:24.282 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-08T15:35:24.284 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-10-08T15:35:24.388 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-08T15:35:24.488 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libcephfs2 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:24.513 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-10-08T15:35:24.585 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-10-08T15:35:24.598 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-08T15:35:24.613 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-rados (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:24.709 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-08T15:35:24.750 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up librgw2 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:24.781 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-10-08T15:35:24.876 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up cephfs-top (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:24.933 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libradosstriper1 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:24.953 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-10-08T15:35:25.002 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-rbd (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:25.059 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-08T15:35:25.077 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up socat (1.7.3.3-2) ... 2023-10-08T15:35:25.111 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up rbd-fuse (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:25.133 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-08T15:35:25.245 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-ceph-common (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:25.262 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-packaging (20.3-1) ... 2023-10-08T15:35:25.271 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-routes (2.4.1-2) ... 2023-10-08T15:35:25.385 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-08T15:35:25.433 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-10-08T15:35:25.555 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-10-08T15:35:25.574 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-10-08T15:35:25.701 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-10-08T15:35:25.799 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T15:35:25.826 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-08T15:35:25.871 INFO:teuthology.orchestra.run.smithi153.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-10-08T15:35:25.917 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-10-08T15:35:26.111 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-10-08T15:35:26.128 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-10-08T15:35:26.232 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-rgw (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:26.237 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-08T15:35:26.251 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-08T15:35:26.358 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-cephfs (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:26.378 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-10-08T15:35:26.458 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up librbd1 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:26.484 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up cephfs-shell (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:26.504 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-10-08T15:35:26.554 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-10-08T15:35:26.563 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-10-08T15:35:26.584 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-08T15:35:26.635 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-10-08T15:35:26.710 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-10-08T15:35:26.781 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-08T15:35:26.836 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-10-08T15:35:26.847 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-08T15:35:26.923 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-08T15:35:26.995 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-rsa (4.0-3) ... 2023-10-08T15:35:27.076 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-08T15:35:27.081 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T15:35:27.193 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-10-08T15:35:27.206 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-08T15:35:27.207 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-08T15:35:27.297 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-10-08T15:35:27.342 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-10-08T15:35:27.407 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-10-08T15:35:27.511 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-08T15:35:27.569 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up socat (1.7.3.3-2) ... 2023-10-08T15:35:27.572 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-common (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:27.677 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-10-08T15:35:27.695 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-ceph-common (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:27.785 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up ceph-mgr-modules-core (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:27.804 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up librados2 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:27.911 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up ceph-fuse (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:27.963 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-10-08T15:35:28.005 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-10-08T15:35:28.046 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T15:35:28.132 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-08T15:35:28.132 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-08T15:35:28.144 INFO:teuthology.orchestra.run.smithi050.stdout:Adding group ceph....done 2023-10-08T15:35:28.155 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-10-08T15:35:28.304 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-08T15:35:28.430 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-10-08T15:35:28.515 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-08T15:35:28.529 INFO:teuthology.orchestra.run.smithi050.stdout:Adding system user ceph....done 2023-10-08T15:35:28.570 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libcephfs-dev (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:28.641 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-10-08T15:35:28.696 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-08T15:35:28.705 INFO:teuthology.orchestra.run.smithi050.stdout:Setting system user ceph properties....done 2023-10-08T15:35:28.706 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-10-08T15:35:28.732 INFO:teuthology.orchestra.run.smithi050.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-10-08T15:35:28.769 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-10-08T15:35:28.884 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-10-08T15:35:28.998 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-10-08T15:35:29.007 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-08T15:35:29.070 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-08T15:35:29.196 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-10-08T15:35:29.292 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-10-08T15:35:29.316 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-10-08T15:35:29.397 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T15:35:29.419 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libsqlite3-mod-ceph (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:29.498 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-08T15:35:29.545 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-08T15:35:29.599 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-10-08T15:35:29.632 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up cephfs-mirror (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:29.669 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-rados (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:29.670 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-10-08T15:35:29.681 INFO:teuthology.orchestra.run.smithi089.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-10-08T15:35:29.795 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up librgw2 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:29.875 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-08T15:35:29.876 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-08T15:35:29.921 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up cephfs-top (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:29.928 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-10-08T15:35:29.934 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-10-08T15:35:30.054 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-08T15:35:30.072 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-rbd (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:30.072 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-10-08T15:35:30.198 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up rbd-fuse (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:30.252 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-10-08T15:35:30.303 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-test (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:30.310 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-routes (2.4.1-2) ... 2023-10-08T15:35:30.365 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-10-08T15:35:30.397 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-10-08T15:35:30.429 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up radosgw (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:30.586 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-08T15:35:30.649 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T15:35:30.695 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-08T15:35:30.695 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-08T15:35:30.712 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-10-08T15:35:30.749 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-08T15:35:30.800 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-10-08T15:35:30.875 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-08T15:35:30.985 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-10-08T15:35:31.030 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-10-08T15:35:31.034 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-10-08T15:35:31.135 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libcephfs2 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:31.252 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-08T15:35:31.283 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-base (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:31.297 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-rgw (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:31.314 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-08T15:35:31.352 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-08T15:35:31.423 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-cephfs (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:31.549 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up cephfs-shell (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:31.598 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libradosstriper1 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:31.607 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-10-08T15:35:31.628 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up librados2 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:31.646 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-10-08T15:35:31.692 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-10-08T15:35:31.730 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-08T15:35:31.754 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-10-08T15:35:31.936 INFO:teuthology.orchestra.run.smithi003.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-10-08T15:35:32.056 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-08T15:35:32.068 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mds (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:32.185 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-10-08T15:35:32.332 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-08T15:35:32.332 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-08T15:35:32.344 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-08T15:35:32.604 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up ceph-common (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:32.679 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-10-08T15:35:32.778 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mgr (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:33.011 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-08T15:35:33.011 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-08T15:35:33.047 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-08T15:35:33.090 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up librbd1 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:33.173 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-08T15:35:33.181 INFO:teuthology.orchestra.run.smithi098.stdout:Adding group ceph....done 2023-10-08T15:35:33.210 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libsqlite3-mod-ceph (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:33.213 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-08T15:35:33.274 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-10-08T15:35:33.339 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-10-08T15:35:33.345 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-08T15:35:33.421 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-osd (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:33.471 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-10-08T15:35:33.490 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-10-08T15:35:33.568 INFO:teuthology.orchestra.run.smithi098.stdout:Adding system user ceph....done 2023-10-08T15:35:33.600 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-08T15:35:33.616 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-rsa (4.0-3) ... 2023-10-08T15:35:33.754 INFO:teuthology.orchestra.run.smithi098.stdout:Setting system user ceph properties....done 2023-10-08T15:35:33.776 INFO:teuthology.orchestra.run.smithi098.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-10-08T15:35:33.873 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-10-08T15:35:33.904 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-08T15:35:33.904 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-08T15:35:33.909 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-10-08T15:35:33.918 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up librados2 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:33.926 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-10-08T15:35:34.035 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-10-08T15:35:34.044 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-10-08T15:35:34.157 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-10-08T15:35:34.239 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-10-08T15:35:34.323 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mgr-k8sevents (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:34.442 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T15:35:34.447 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mgr-modules-core (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:34.449 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mgr-diskprediction-local (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:34.568 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-10-08T15:35:34.572 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-fuse (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:34.617 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mon (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:34.802 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-08T15:35:34.803 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-08T15:35:34.847 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-08T15:35:34.847 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-08T15:35:34.936 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libcephfs2 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:35.050 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up cephfs-mirror (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:35.062 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-08T15:35:35.224 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libcephfs-dev (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:35.268 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mgr-cephadm (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:35.283 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-08T15:35:35.283 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-08T15:35:35.374 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-08T15:35:35.397 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libradosstriper1 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:35.411 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:35.523 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-08T15:35:35.537 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mgr-dashboard (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:35.668 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-10-08T15:35:35.671 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-volume (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:35.761 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up ceph-test (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:35.801 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-08T15:35:35.833 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libsqlite3-mod-ceph (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:35.933 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-08T15:35:35.959 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-08T15:35:35.978 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-10-08T15:35:35.983 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-08T15:35:36.003 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up radosgw (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:36.085 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-10-08T15:35:36.274 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-08T15:35:36.275 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-08T15:35:36.277 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-08T15:35:36.333 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-rados (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:36.468 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up librgw2 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:36.512 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-10-08T15:35:36.593 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up cephfs-top (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:36.703 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-rbd (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:36.821 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-10-08T15:35:36.829 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up rbd-fuse (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:36.905 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up ceph-base (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:36.947 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up librbd1 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:36.955 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-routes (2.4.1-2) ... 2023-10-08T15:35:37.073 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-08T15:35:37.114 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T15:35:37.182 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-10-08T15:35:37.240 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-10-08T15:35:37.248 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-10-08T15:35:37.317 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-10-08T15:35:37.333 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-10-08T15:35:37.459 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-rsa (4.0-3) ... 2023-10-08T15:35:37.541 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-rgw (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:37.583 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libcephfs2 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:37.675 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-cephfs (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:37.734 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-08T15:35:37.761 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-10-08T15:35:37.765 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up ceph-mds (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:37.801 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up cephfs-shell (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:37.905 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-10-08T15:35:37.927 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-10-08T15:35:37.994 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-08T15:35:37.994 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-08T15:35:38.061 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libradosstriper1 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:38.178 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-08T15:35:38.275 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-mgr-modules-core (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:38.427 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-fuse (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:38.435 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up ceph-mgr (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:38.530 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-08T15:35:38.654 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-08T15:35:38.654 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-08T15:35:38.692 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-08T15:35:38.692 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-08T15:35:38.816 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-common (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:39.128 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up ceph-osd (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:39.136 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libcephfs-dev (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:39.262 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-08T15:35:39.280 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-10-08T15:35:39.369 INFO:teuthology.orchestra.run.smithi153.stdout:Adding group ceph....done 2023-10-08T15:35:39.556 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-10-08T15:35:39.610 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up librbd1 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:39.649 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-08T15:35:39.649 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-08T15:35:39.738 INFO:teuthology.orchestra.run.smithi153.stdout:Adding system user ceph....done 2023-10-08T15:35:39.745 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-08T15:35:39.870 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-10-08T15:35:39.874 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-10-08T15:35:39.908 INFO:teuthology.orchestra.run.smithi050.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-08T15:35:39.911 DEBUG:teuthology.orchestra.run.smithi050:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2023-10-08T15:35:39.914 INFO:teuthology.orchestra.run.smithi153.stdout:Setting system user ceph properties....done 2023-10-08T15:35:39.939 INFO:teuthology.orchestra.run.smithi153.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-10-08T15:35:39.989 INFO:teuthology.orchestra.run.smithi050.stdout:Reading package lists... 2023-10-08T15:35:39.996 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-10-08T15:35:40.088 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-10-08T15:35:40.096 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up ceph-mgr-k8sevents (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:40.147 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-rsa (4.0-3) ... 2023-10-08T15:35:40.197 INFO:teuthology.orchestra.run.smithi050.stdout:Building dependency tree... 2023-10-08T15:35:40.198 INFO:teuthology.orchestra.run.smithi050.stdout:Reading state information... 2023-10-08T15:35:40.231 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up ceph-mgr-diskprediction-local (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:40.259 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-rados (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:40.374 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up ceph-mon (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:40.385 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up librgw2 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:40.400 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-10-08T15:35:40.406 INFO:teuthology.orchestra.run.smithi050.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-10-08T15:35:40.406 INFO:teuthology.orchestra.run.smithi050.stdout:flex is already the newest version (2.6.4-6.2). 2023-10-08T15:35:40.406 INFO:teuthology.orchestra.run.smithi050.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-10-08T15:35:40.406 INFO:teuthology.orchestra.run.smithi050.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-10-08T15:35:40.406 INFO:teuthology.orchestra.run.smithi050.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-10-08T15:35:40.407 INFO:teuthology.orchestra.run.smithi050.stdout:The following packages were automatically installed and are no longer required: 2023-10-08T15:35:40.407 INFO:teuthology.orchestra.run.smithi050.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-08T15:35:40.407 INFO:teuthology.orchestra.run.smithi050.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-08T15:35:40.407 INFO:teuthology.orchestra.run.smithi050.stdout:The following additional packages will be installed: 2023-10-08T15:35:40.407 INFO:teuthology.orchestra.run.smithi050.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2023-10-08T15:35:40.408 INFO:teuthology.orchestra.run.smithi050.stdout: libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 2023-10-08T15:35:40.408 INFO:teuthology.orchestra.run.smithi050.stdout: libuuid1 modemmanager network-manager-pptp ppp pptp-linux usb-modeswitch 2023-10-08T15:35:40.408 INFO:teuthology.orchestra.run.smithi050.stdout: usb-modeswitch-data wpasupplicant 2023-10-08T15:35:40.409 INFO:teuthology.orchestra.run.smithi050.stdout:Suggested packages: 2023-10-08T15:35:40.410 INFO:teuthology.orchestra.run.smithi050.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils comgt wvdial 2023-10-08T15:35:40.410 INFO:teuthology.orchestra.run.smithi050.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2023-10-08T15:35:40.449 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-10-08T15:35:40.458 INFO:teuthology.orchestra.run.smithi050.stdout:The following NEW packages will be installed: 2023-10-08T15:35:40.458 INFO:teuthology.orchestra.run.smithi050.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-10-08T15:35:40.459 INFO:teuthology.orchestra.run.smithi050.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy 2023-10-08T15:35:40.459 INFO:teuthology.orchestra.run.smithi050.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-10-08T15:35:40.459 INFO:teuthology.orchestra.run.smithi050.stdout: ppp pptp-linux usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-08T15:35:40.460 INFO:teuthology.orchestra.run.smithi050.stdout:The following packages will be upgraded: 2023-10-08T15:35:40.462 INFO:teuthology.orchestra.run.smithi050.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2023-10-08T15:35:40.528 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up cephfs-top (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:40.550 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-10-08T15:35:40.587 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-08T15:35:40.587 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-08T15:35:40.663 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-rbd (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:40.668 INFO:teuthology.orchestra.run.smithi050.stdout:6 upgraded, 23 newly installed, 0 to remove and 247 not upgraded. 2023-10-08T15:35:40.668 INFO:teuthology.orchestra.run.smithi050.stdout:Need to get 10.4 MB of archives. 2023-10-08T15:35:40.669 INFO:teuthology.orchestra.run.smithi050.stdout:After this operation, 33.5 MB of additional disk space will be used. 2023-10-08T15:35:40.669 INFO:teuthology.orchestra.run.smithi050.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-10-08T15:35:40.792 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up rbd-fuse (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:40.843 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up cephfs-mirror (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:40.929 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up ceph-mgr-modules-core (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:40.934 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-routes (2.4.1-2) ... 2023-10-08T15:35:41.033 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up ceph-mgr-cephadm (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:41.054 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up ceph-fuse (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:41.098 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-08T15:35:41.098 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-08T15:35:41.244 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-10-08T15:35:41.287 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-08T15:35:41.287 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-08T15:35:41.291 INFO:teuthology.orchestra.run.smithi050.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-10-08T15:35:41.293 INFO:teuthology.orchestra.run.smithi050.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-10-08T15:35:41.294 INFO:teuthology.orchestra.run.smithi050.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2023-10-08T15:35:41.306 INFO:teuthology.orchestra.run.smithi050.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2023-10-08T15:35:41.309 INFO:teuthology.orchestra.run.smithi050.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.19 [1,321 kB] 2023-10-08T15:35:41.407 INFO:teuthology.orchestra.run.smithi050.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-10-08T15:35:41.409 INFO:teuthology.orchestra.run.smithi050.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-10-08T15:35:41.417 INFO:teuthology.orchestra.run.smithi050.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2023-10-08T15:35:41.422 INFO:teuthology.orchestra.run.smithi050.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-10-08T15:35:41.422 INFO:teuthology.orchestra.run.smithi050.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-10-08T15:35:41.427 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up ceph (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:41.536 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-test (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:41.570 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-rgw (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:41.578 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up ceph-mgr-dashboard (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:41.589 INFO:teuthology.orchestra.run.smithi050.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2023-10-08T15:35:41.663 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up radosgw (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:41.697 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-cephfs (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:41.721 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up ceph-volume (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:41.722 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libcephfs-dev (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:41.823 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up cephfs-shell (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:41.848 INFO:teuthology.orchestra.run.smithi098.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-08T15:35:41.857 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-08T15:35:41.861 INFO:teuthology.orchestra.run.smithi050.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-10-08T15:35:41.949 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-10-08T15:35:41.958 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-08T15:35:41.958 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-08T15:35:41.991 INFO:teuthology.orchestra.run.smithi050.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-10-08T15:35:41.995 INFO:teuthology.orchestra.run.smithi050.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-10-08T15:35:42.008 INFO:teuthology.orchestra.run.smithi098.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-08T15:35:42.091 INFO:teuthology.orchestra.run.smithi050.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-10-08T15:35:42.095 INFO:teuthology.orchestra.run.smithi050.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-10-08T15:35:42.125 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-10-08T15:35:42.178 INFO:teuthology.orchestra.run.smithi050.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-10-08T15:35:42.252 INFO:teuthology.orchestra.run.smithi050.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-10-08T15:35:42.252 INFO:teuthology.orchestra.run.smithi050.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.19 [1,584 kB] 2023-10-08T15:35:42.301 INFO:teuthology.orchestra.run.smithi098.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-08T15:35:42.341 INFO:teuthology.orchestra.run.smithi050.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-10-08T15:35:42.341 INFO:teuthology.orchestra.run.smithi050.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-10-08T15:35:42.426 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-10-08T15:35:42.536 INFO:teuthology.orchestra.run.smithi050.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-10-08T15:35:42.615 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-base (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:42.782 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-rados (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:42.852 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-common (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:42.883 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up librgw2 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:42.984 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up cephfs-top (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:43.018 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-10-08T15:35:43.118 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-rbd (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:43.178 INFO:teuthology.orchestra.run.smithi050.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-10-08T15:35:43.253 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up rbd-fuse (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:43.291 INFO:teuthology.orchestra.run.smithi050.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-10-08T15:35:43.306 INFO:teuthology.orchestra.run.smithi050.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-10-08T15:35:43.308 INFO:teuthology.orchestra.run.smithi050.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-10-08T15:35:43.310 INFO:teuthology.orchestra.run.smithi050.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-10-08T15:35:43.311 INFO:teuthology.orchestra.run.smithi050.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-10-08T15:35:43.381 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-routes (2.4.1-2) ... 2023-10-08T15:35:43.415 INFO:teuthology.orchestra.run.smithi089.stdout:Adding group ceph....done 2023-10-08T15:35:43.459 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mds (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:43.650 INFO:teuthology.orchestra.run.smithi050.stdout:Preconfiguring packages ... 2023-10-08T15:35:43.680 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-10-08T15:35:43.700 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-08T15:35:43.700 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-08T15:35:43.785 INFO:teuthology.orchestra.run.smithi050.stdout:Fetched 10.4 MB in 3s (3,670 kB/s) 2023-10-08T15:35:43.850 INFO:teuthology.orchestra.run.smithi089.stdout:Adding system user ceph....done 2023-10-08T15:35:43.990 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-rgw (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:44.035 INFO:teuthology.orchestra.run.smithi089.stdout:Setting system user ceph properties....done 2023-10-08T15:35:44.049 INFO:teuthology.orchestra.run.smithi050.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152664 files and directories currently installed.) 2023-10-08T15:35:44.054 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-08T15:35:44.054 INFO:teuthology.orchestra.run.smithi089.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-10-08T15:35:44.102 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mgr (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:44.107 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-cephfs (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:44.191 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-08T15:35:44.205 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-10-08T15:35:44.208 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up cephfs-shell (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:44.310 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-10-08T15:35:44.314 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-08T15:35:44.314 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-08T15:35:44.510 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-10-08T15:35:44.745 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-osd (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:44.973 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up cephfs-mirror (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:45.203 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-08T15:35:45.203 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-08T15:35:45.213 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-08T15:35:45.213 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-08T15:35:45.257 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up ceph-common (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:45.312 INFO:teuthology.orchestra.run.smithi098.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-10-08T15:35:45.380 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-10-08T15:35:45.641 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-test (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:45.785 INFO:teuthology.orchestra.run.smithi003.stdout:Adding group ceph....done 2023-10-08T15:35:45.789 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mgr-k8sevents (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:45.791 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up radosgw (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:45.916 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mgr-diskprediction-local (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:45.951 INFO:teuthology.orchestra.run.smithi098.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-08T15:35:45.953 DEBUG:teuthology.orchestra.run.smithi098:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2023-10-08T15:35:46.024 INFO:teuthology.orchestra.run.smithi098.stdout:Reading package lists... 2023-10-08T15:35:46.054 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-08T15:35:46.054 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-08T15:35:46.058 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mon (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:46.145 INFO:teuthology.orchestra.run.smithi003.stdout:Adding system user ceph....done 2023-10-08T15:35:46.227 INFO:teuthology.orchestra.run.smithi098.stdout:Building dependency tree... 2023-10-08T15:35:46.228 INFO:teuthology.orchestra.run.smithi098.stdout:Reading state information... 2023-10-08T15:35:46.267 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-08T15:35:46.267 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-08T15:35:46.346 INFO:teuthology.orchestra.run.smithi003.stdout:Setting system user ceph properties....done 2023-10-08T15:35:46.370 INFO:teuthology.orchestra.run.smithi003.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-10-08T15:35:46.426 INFO:teuthology.orchestra.run.smithi098.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-10-08T15:35:46.426 INFO:teuthology.orchestra.run.smithi098.stdout:flex is already the newest version (2.6.4-6.2). 2023-10-08T15:35:46.426 INFO:teuthology.orchestra.run.smithi098.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-10-08T15:35:46.426 INFO:teuthology.orchestra.run.smithi098.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-10-08T15:35:46.426 INFO:teuthology.orchestra.run.smithi098.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-10-08T15:35:46.426 INFO:teuthology.orchestra.run.smithi098.stdout:The following packages were automatically installed and are no longer required: 2023-10-08T15:35:46.427 INFO:teuthology.orchestra.run.smithi098.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-08T15:35:46.427 INFO:teuthology.orchestra.run.smithi098.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-08T15:35:46.427 INFO:teuthology.orchestra.run.smithi098.stdout:The following additional packages will be installed: 2023-10-08T15:35:46.427 INFO:teuthology.orchestra.run.smithi098.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2023-10-08T15:35:46.428 INFO:teuthology.orchestra.run.smithi098.stdout: libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 2023-10-08T15:35:46.428 INFO:teuthology.orchestra.run.smithi098.stdout: libuuid1 modemmanager network-manager-pptp ppp pptp-linux usb-modeswitch 2023-10-08T15:35:46.428 INFO:teuthology.orchestra.run.smithi098.stdout: usb-modeswitch-data wpasupplicant 2023-10-08T15:35:46.429 INFO:teuthology.orchestra.run.smithi098.stdout:Suggested packages: 2023-10-08T15:35:46.429 INFO:teuthology.orchestra.run.smithi098.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils comgt wvdial 2023-10-08T15:35:46.429 INFO:teuthology.orchestra.run.smithi098.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2023-10-08T15:35:46.474 INFO:teuthology.orchestra.run.smithi098.stdout:The following NEW packages will be installed: 2023-10-08T15:35:46.475 INFO:teuthology.orchestra.run.smithi098.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-10-08T15:35:46.475 INFO:teuthology.orchestra.run.smithi098.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy 2023-10-08T15:35:46.475 INFO:teuthology.orchestra.run.smithi098.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-10-08T15:35:46.476 INFO:teuthology.orchestra.run.smithi098.stdout: ppp pptp-linux usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-08T15:35:46.477 INFO:teuthology.orchestra.run.smithi098.stdout:The following packages will be upgraded: 2023-10-08T15:35:46.478 INFO:teuthology.orchestra.run.smithi098.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2023-10-08T15:35:46.522 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-10-08T15:35:46.532 INFO:teuthology.orchestra.run.smithi098.stdout:6 upgraded, 23 newly installed, 0 to remove and 247 not upgraded. 2023-10-08T15:35:46.532 INFO:teuthology.orchestra.run.smithi098.stdout:Need to get 10.4 MB of archives. 2023-10-08T15:35:46.532 INFO:teuthology.orchestra.run.smithi098.stdout:After this operation, 33.5 MB of additional disk space will be used. 2023-10-08T15:35:46.533 INFO:teuthology.orchestra.run.smithi098.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-10-08T15:35:46.665 INFO:teuthology.orchestra.run.smithi098.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-10-08T15:35:46.665 INFO:teuthology.orchestra.run.smithi098.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-10-08T15:35:46.666 INFO:teuthology.orchestra.run.smithi098.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2023-10-08T15:35:46.670 INFO:teuthology.orchestra.run.smithi098.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2023-10-08T15:35:46.672 INFO:teuthology.orchestra.run.smithi098.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.19 [1,321 kB] 2023-10-08T15:35:46.676 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mgr-cephadm (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:46.688 INFO:teuthology.orchestra.run.smithi098.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-10-08T15:35:46.689 INFO:teuthology.orchestra.run.smithi098.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-10-08T15:35:46.690 INFO:teuthology.orchestra.run.smithi098.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2023-10-08T15:35:46.692 INFO:teuthology.orchestra.run.smithi098.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-10-08T15:35:46.692 INFO:teuthology.orchestra.run.smithi098.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-10-08T15:35:46.698 INFO:teuthology.orchestra.run.smithi098.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2023-10-08T15:35:46.699 INFO:teuthology.orchestra.run.smithi098.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-10-08T15:35:46.700 INFO:teuthology.orchestra.run.smithi098.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-10-08T15:35:46.701 INFO:teuthology.orchestra.run.smithi098.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-10-08T15:35:46.710 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-base (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:46.714 INFO:teuthology.orchestra.run.smithi098.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-10-08T15:35:46.715 INFO:teuthology.orchestra.run.smithi098.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-10-08T15:35:46.720 INFO:teuthology.orchestra.run.smithi098.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-10-08T15:35:46.727 INFO:teuthology.orchestra.run.smithi098.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-10-08T15:35:46.728 INFO:teuthology.orchestra.run.smithi098.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.19 [1,584 kB] 2023-10-08T15:35:46.743 INFO:teuthology.orchestra.run.smithi098.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-10-08T15:35:46.743 INFO:teuthology.orchestra.run.smithi098.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-10-08T15:35:46.750 INFO:teuthology.orchestra.run.smithi098.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-10-08T15:35:46.752 INFO:teuthology.orchestra.run.smithi050.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152664 files and directories currently installed.) 2023-10-08T15:35:46.757 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-08T15:35:46.760 INFO:teuthology.orchestra.run.smithi098.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-10-08T15:35:46.776 INFO:teuthology.orchestra.run.smithi098.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-10-08T15:35:46.778 INFO:teuthology.orchestra.run.smithi098.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-10-08T15:35:46.778 INFO:teuthology.orchestra.run.smithi098.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-10-08T15:35:46.779 INFO:teuthology.orchestra.run.smithi098.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-10-08T15:35:46.779 INFO:teuthology.orchestra.run.smithi098.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-10-08T15:35:46.819 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:46.847 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-10-08T15:35:46.881 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-08T15:35:46.945 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mgr-dashboard (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:47.084 INFO:teuthology.orchestra.run.smithi098.stdout:Preconfiguring packages ... 2023-10-08T15:35:47.087 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-volume (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:47.117 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-10-08T15:35:47.207 INFO:teuthology.orchestra.run.smithi098.stdout:Fetched 10.4 MB in 0s (35.4 MB/s) 2023-10-08T15:35:47.214 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-08T15:35:47.338 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-08T15:35:47.366 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-08T15:35:47.492 INFO:teuthology.orchestra.run.smithi098.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152664 files and directories currently installed.) 2023-10-08T15:35:47.496 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-08T15:35:47.505 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-08T15:35:47.555 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-mds (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:47.594 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up cephfs-mirror (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:47.648 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-08T15:35:47.667 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-08T15:35:47.778 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-08T15:35:47.778 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-08T15:35:47.852 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-08T15:35:47.852 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-08T15:35:47.864 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-10-08T15:35:48.233 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-mgr (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:48.279 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up ceph-test (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:48.323 INFO:teuthology.orchestra.run.smithi050.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152664 files and directories currently installed.) 2023-10-08T15:35:48.328 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-08T15:35:48.405 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up radosgw (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:48.438 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-10-08T15:35:48.461 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-08T15:35:48.461 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-08T15:35:48.713 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-08T15:35:48.713 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-08T15:35:48.781 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-10-08T15:35:48.827 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-08T15:35:48.925 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-osd (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:48.977 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-10-08T15:35:49.340 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up ceph-base (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:49.414 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-08T15:35:49.414 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-08T15:35:49.450 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-10-08T15:35:49.606 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.19) over (1.1.1f-1ubuntu2.16) ... 2023-10-08T15:35:49.722 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-10-08T15:35:49.868 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-mgr-k8sevents (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:50.019 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-mgr-diskprediction-local (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:50.061 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-10-08T15:35:50.075 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2023-10-08T15:35:50.110 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-10-08T15:35:50.159 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up ceph-mds (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:50.170 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-mon (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:50.209 INFO:teuthology.orchestra.run.smithi098.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152664 files and directories currently installed.) 2023-10-08T15:35:50.214 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-08T15:35:50.329 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-08T15:35:50.396 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-08T15:35:50.396 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-08T15:35:50.403 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-08T15:35:50.404 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-08T15:35:50.472 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package dump. 2023-10-08T15:35:50.494 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2023-10-08T15:35:50.530 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking dump (0.4b46-6) ... 2023-10-08T15:35:50.603 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-10-08T15:35:50.736 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-08T15:35:50.846 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-mgr-cephadm (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:50.852 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up ceph-mgr (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:50.859 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package indent. 2023-10-08T15:35:50.878 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2023-10-08T15:35:50.917 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2023-10-08T15:35:50.928 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-08T15:35:50.990 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:51.088 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-08T15:35:51.088 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-08T15:35:51.149 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-mgr-dashboard (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:51.212 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-10-08T15:35:51.231 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2023-10-08T15:35:51.249 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-10-08T15:35:51.262 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-10-08T15:35:51.346 INFO:teuthology.orchestra.run.smithi153.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-08T15:35:51.348 DEBUG:teuthology.orchestra.run.smithi153:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2023-10-08T15:35:51.418 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2023-10-08T15:35:51.563 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up ceph-osd (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:51.593 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-volume (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:51.620 INFO:teuthology.orchestra.run.smithi153.stdout:Building dependency tree... 2023-10-08T15:35:51.621 INFO:teuthology.orchestra.run.smithi153.stdout:Reading state information... 2023-10-08T15:35:51.720 INFO:teuthology.orchestra.run.smithi089.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-08T15:35:51.819 INFO:teuthology.orchestra.run.smithi153.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-10-08T15:35:51.819 INFO:teuthology.orchestra.run.smithi153.stdout:flex is already the newest version (2.6.4-6.2). 2023-10-08T15:35:51.819 INFO:teuthology.orchestra.run.smithi153.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-10-08T15:35:51.820 INFO:teuthology.orchestra.run.smithi153.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-10-08T15:35:51.820 INFO:teuthology.orchestra.run.smithi153.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-10-08T15:35:51.820 INFO:teuthology.orchestra.run.smithi153.stdout:The following packages were automatically installed and are no longer required: 2023-10-08T15:35:51.821 INFO:teuthology.orchestra.run.smithi153.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-08T15:35:51.821 INFO:teuthology.orchestra.run.smithi153.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-08T15:35:51.821 INFO:teuthology.orchestra.run.smithi153.stdout:The following additional packages will be installed: 2023-10-08T15:35:51.821 INFO:teuthology.orchestra.run.smithi153.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2023-10-08T15:35:51.821 INFO:teuthology.orchestra.run.smithi153.stdout: libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 2023-10-08T15:35:51.822 INFO:teuthology.orchestra.run.smithi153.stdout: libuuid1 modemmanager network-manager-pptp ppp pptp-linux usb-modeswitch 2023-10-08T15:35:51.822 INFO:teuthology.orchestra.run.smithi153.stdout: usb-modeswitch-data wpasupplicant 2023-10-08T15:35:51.823 INFO:teuthology.orchestra.run.smithi153.stdout:Suggested packages: 2023-10-08T15:35:51.823 INFO:teuthology.orchestra.run.smithi153.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils comgt wvdial 2023-10-08T15:35:51.823 INFO:teuthology.orchestra.run.smithi153.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2023-10-08T15:35:51.870 INFO:teuthology.orchestra.run.smithi153.stdout:The following NEW packages will be installed: 2023-10-08T15:35:51.871 INFO:teuthology.orchestra.run.smithi089.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-08T15:35:51.871 INFO:teuthology.orchestra.run.smithi153.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-10-08T15:35:51.872 INFO:teuthology.orchestra.run.smithi153.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy 2023-10-08T15:35:51.872 INFO:teuthology.orchestra.run.smithi153.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-10-08T15:35:51.872 INFO:teuthology.orchestra.run.smithi153.stdout: ppp pptp-linux usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-08T15:35:51.873 INFO:teuthology.orchestra.run.smithi153.stdout:The following packages will be upgraded: 2023-10-08T15:35:51.874 INFO:teuthology.orchestra.run.smithi153.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2023-10-08T15:35:51.933 INFO:teuthology.orchestra.run.smithi098.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152664 files and directories currently installed.) 2023-10-08T15:35:51.938 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-08T15:35:52.020 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-08T15:35:52.021 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-08T15:35:52.058 INFO:teuthology.orchestra.run.smithi153.stdout:6 upgraded, 23 newly installed, 0 to remove and 247 not upgraded. 2023-10-08T15:35:52.058 INFO:teuthology.orchestra.run.smithi153.stdout:Need to get 10.4 MB of archives. 2023-10-08T15:35:52.058 INFO:teuthology.orchestra.run.smithi153.stdout:After this operation, 33.5 MB of additional disk space will be used. 2023-10-08T15:35:52.058 INFO:teuthology.orchestra.run.smithi153.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-10-08T15:35:52.072 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-10-08T15:35:52.165 INFO:teuthology.orchestra.run.smithi089.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-08T15:35:52.194 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-10-08T15:35:52.211 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-10-08T15:35:52.251 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-10-08T15:35:52.440 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up ceph-mgr-k8sevents (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:52.504 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-10-08T15:35:52.521 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-08T15:35:52.540 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up ceph-mgr-diskprediction-local (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:52.554 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-08T15:35:52.572 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-08T15:35:52.667 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up ceph-mon (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:52.682 INFO:teuthology.orchestra.run.smithi153.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-10-08T15:35:52.684 INFO:teuthology.orchestra.run.smithi153.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-10-08T15:35:52.685 INFO:teuthology.orchestra.run.smithi153.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2023-10-08T15:35:52.697 INFO:teuthology.orchestra.run.smithi153.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2023-10-08T15:35:52.700 INFO:teuthology.orchestra.run.smithi153.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.19 [1,321 kB] 2023-10-08T15:35:52.711 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-10-08T15:35:52.799 INFO:teuthology.orchestra.run.smithi153.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-10-08T15:35:52.801 INFO:teuthology.orchestra.run.smithi153.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-10-08T15:35:52.809 INFO:teuthology.orchestra.run.smithi153.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2023-10-08T15:35:52.813 INFO:teuthology.orchestra.run.smithi153.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-10-08T15:35:52.814 INFO:teuthology.orchestra.run.smithi153.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-10-08T15:35:52.892 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-08T15:35:52.892 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-08T15:35:52.924 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-10-08T15:35:52.941 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T15:35:52.981 INFO:teuthology.orchestra.run.smithi153.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2023-10-08T15:35:52.982 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-10-08T15:35:53.193 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-10-08T15:35:53.243 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libmbim-proxy. 2023-10-08T15:35:53.252 INFO:teuthology.orchestra.run.smithi153.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-10-08T15:35:53.262 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T15:35:53.293 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up ceph-mgr-cephadm (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:53.301 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-10-08T15:35:53.324 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.19) over (1.1.1f-1ubuntu2.16) ... 2023-10-08T15:35:53.380 INFO:teuthology.orchestra.run.smithi153.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-10-08T15:35:53.385 INFO:teuthology.orchestra.run.smithi153.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-10-08T15:35:53.445 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up ceph (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:53.480 INFO:teuthology.orchestra.run.smithi153.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-10-08T15:35:53.484 INFO:teuthology.orchestra.run.smithi153.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-10-08T15:35:53.567 INFO:teuthology.orchestra.run.smithi153.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-10-08T15:35:53.570 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up ceph-mgr-dashboard (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:53.629 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-10-08T15:35:53.641 INFO:teuthology.orchestra.run.smithi153.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-10-08T15:35:53.642 INFO:teuthology.orchestra.run.smithi153.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.19 [1,584 kB] 2023-10-08T15:35:53.647 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T15:35:53.687 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-10-08T15:35:53.713 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up ceph-volume (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T15:35:53.730 INFO:teuthology.orchestra.run.smithi153.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-10-08T15:35:53.730 INFO:teuthology.orchestra.run.smithi153.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-10-08T15:35:53.854 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-10-08T15:35:53.865 INFO:teuthology.orchestra.run.smithi003.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-08T15:35:53.870 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2023-10-08T15:35:53.928 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-10-08T15:35:53.929 INFO:teuthology.orchestra.run.smithi153.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-10-08T15:35:54.016 INFO:teuthology.orchestra.run.smithi003.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-08T15:35:54.049 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libndp0:amd64. 2023-10-08T15:35:54.066 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-10-08T15:35:54.107 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-10-08T15:35:54.256 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package dump. 2023-10-08T15:35:54.276 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2023-10-08T15:35:54.293 INFO:teuthology.orchestra.run.smithi003.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-08T15:35:54.314 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking dump (0.4b46-6) ... 2023-10-08T15:35:54.435 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libnm0:amd64. 2023-10-08T15:35:54.453 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-10-08T15:35:54.493 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-10-08T15:35:54.567 INFO:teuthology.orchestra.run.smithi153.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-10-08T15:35:54.655 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package indent. 2023-10-08T15:35:54.675 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2023-10-08T15:35:54.680 INFO:teuthology.orchestra.run.smithi153.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-10-08T15:35:54.696 INFO:teuthology.orchestra.run.smithi153.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-10-08T15:35:54.697 INFO:teuthology.orchestra.run.smithi153.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-10-08T15:35:54.699 INFO:teuthology.orchestra.run.smithi153.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-10-08T15:35:54.700 INFO:teuthology.orchestra.run.smithi153.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-10-08T15:35:54.718 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2023-10-08T15:35:54.872 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-10-08T15:35:54.891 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../14-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T15:35:54.930 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-10-08T15:35:55.029 INFO:teuthology.orchestra.run.smithi153.stdout:Preconfiguring packages ... 2023-10-08T15:35:55.033 INFO:teuthology.orchestra.run.smithi089.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-10-08T15:35:55.038 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-10-08T15:35:55.055 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2023-10-08T15:35:55.097 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-10-08T15:35:55.175 INFO:teuthology.orchestra.run.smithi153.stdout:Fetched 10.4 MB in 3s (3,700 kB/s) 2023-10-08T15:35:55.266 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libqmi-proxy. 2023-10-08T15:35:55.283 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../15-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T15:35:55.324 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-10-08T15:35:55.450 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-10-08T15:35:55.466 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-10-08T15:35:55.478 INFO:teuthology.orchestra.run.smithi153.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152664 files and directories currently installed.) 2023-10-08T15:35:55.485 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-08T15:35:55.517 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-10-08T15:35:55.576 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-10-08T15:35:55.595 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../16-libssl-dev_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-10-08T15:35:55.634 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-08T15:35:55.647 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-08T15:35:55.652 INFO:teuthology.orchestra.run.smithi089.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-08T15:35:55.654 DEBUG:teuthology.orchestra.run.smithi089:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2023-10-08T15:35:55.728 INFO:teuthology.orchestra.run.smithi089.stdout:Reading package lists... 2023-10-08T15:35:55.761 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-10-08T15:35:55.781 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-08T15:35:55.819 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-08T15:35:55.932 INFO:teuthology.orchestra.run.smithi089.stdout:Building dependency tree... 2023-10-08T15:35:55.933 INFO:teuthology.orchestra.run.smithi089.stdout:Reading state information... 2023-10-08T15:35:56.131 INFO:teuthology.orchestra.run.smithi089.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-10-08T15:35:56.131 INFO:teuthology.orchestra.run.smithi089.stdout:flex is already the newest version (2.6.4-6.2). 2023-10-08T15:35:56.132 INFO:teuthology.orchestra.run.smithi089.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-10-08T15:35:56.132 INFO:teuthology.orchestra.run.smithi089.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-10-08T15:35:56.132 INFO:teuthology.orchestra.run.smithi089.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-10-08T15:35:56.132 INFO:teuthology.orchestra.run.smithi089.stdout:The following packages were automatically installed and are no longer required: 2023-10-08T15:35:56.133 INFO:teuthology.orchestra.run.smithi089.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-08T15:35:56.133 INFO:teuthology.orchestra.run.smithi089.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-08T15:35:56.133 INFO:teuthology.orchestra.run.smithi089.stdout:The following additional packages will be installed: 2023-10-08T15:35:56.133 INFO:teuthology.orchestra.run.smithi089.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2023-10-08T15:35:56.133 INFO:teuthology.orchestra.run.smithi089.stdout: libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 2023-10-08T15:35:56.134 INFO:teuthology.orchestra.run.smithi089.stdout: libuuid1 modemmanager network-manager-pptp ppp pptp-linux usb-modeswitch 2023-10-08T15:35:56.134 INFO:teuthology.orchestra.run.smithi089.stdout: usb-modeswitch-data wpasupplicant 2023-10-08T15:35:56.135 INFO:teuthology.orchestra.run.smithi089.stdout:Suggested packages: 2023-10-08T15:35:56.135 INFO:teuthology.orchestra.run.smithi089.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils comgt wvdial 2023-10-08T15:35:56.135 INFO:teuthology.orchestra.run.smithi089.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2023-10-08T15:35:56.155 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-10-08T15:35:56.157 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-10-08T15:35:56.173 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../17-libteamdctl0_1.30-1_amd64.deb ... 2023-10-08T15:35:56.176 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T15:35:56.181 INFO:teuthology.orchestra.run.smithi089.stdout:The following NEW packages will be installed: 2023-10-08T15:35:56.181 INFO:teuthology.orchestra.run.smithi089.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-10-08T15:35:56.181 INFO:teuthology.orchestra.run.smithi089.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy 2023-10-08T15:35:56.182 INFO:teuthology.orchestra.run.smithi089.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-10-08T15:35:56.182 INFO:teuthology.orchestra.run.smithi089.stdout: ppp pptp-linux usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-08T15:35:56.183 INFO:teuthology.orchestra.run.smithi089.stdout:The following packages will be upgraded: 2023-10-08T15:35:56.184 INFO:teuthology.orchestra.run.smithi089.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2023-10-08T15:35:56.213 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-10-08T15:35:56.231 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-10-08T15:35:56.367 INFO:teuthology.orchestra.run.smithi089.stdout:6 upgraded, 23 newly installed, 0 to remove and 247 not upgraded. 2023-10-08T15:35:56.367 INFO:teuthology.orchestra.run.smithi089.stdout:Need to get 10.4 MB of archives. 2023-10-08T15:35:56.367 INFO:teuthology.orchestra.run.smithi089.stdout:After this operation, 33.5 MB of additional disk space will be used. 2023-10-08T15:35:56.368 INFO:teuthology.orchestra.run.smithi089.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-10-08T15:35:56.484 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libmbim-proxy. 2023-10-08T15:35:56.501 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T15:35:56.550 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-10-08T15:35:56.642 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package modemmanager. 2023-10-08T15:35:56.660 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../18-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T15:35:56.710 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-10-08T15:35:56.878 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-10-08T15:35:56.895 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T15:35:56.953 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-10-08T15:35:56.985 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-10-08T15:35:56.991 INFO:teuthology.orchestra.run.smithi089.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-10-08T15:35:56.993 INFO:teuthology.orchestra.run.smithi089.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-10-08T15:35:56.994 INFO:teuthology.orchestra.run.smithi089.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2023-10-08T15:35:57.007 INFO:teuthology.orchestra.run.smithi089.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2023-10-08T15:35:57.008 INFO:teuthology.orchestra.run.smithi089.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.19 [1,321 kB] 2023-10-08T15:35:57.108 INFO:teuthology.orchestra.run.smithi089.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-10-08T15:35:57.110 INFO:teuthology.orchestra.run.smithi089.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-10-08T15:35:57.117 INFO:teuthology.orchestra.run.smithi089.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2023-10-08T15:35:57.122 INFO:teuthology.orchestra.run.smithi089.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-10-08T15:35:57.125 INFO:teuthology.orchestra.run.smithi089.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-10-08T15:35:57.290 INFO:teuthology.orchestra.run.smithi089.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2023-10-08T15:35:57.304 INFO:teuthology.orchestra.run.smithi003.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-10-08T15:35:57.424 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package wpasupplicant. 2023-10-08T15:35:57.445 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../19-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-10-08T15:35:57.558 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libndp0:amd64. 2023-10-08T15:35:57.562 INFO:teuthology.orchestra.run.smithi089.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-10-08T15:35:57.577 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-10-08T15:35:57.616 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-10-08T15:35:57.691 INFO:teuthology.orchestra.run.smithi089.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-10-08T15:35:57.696 INFO:teuthology.orchestra.run.smithi089.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-10-08T15:35:57.792 INFO:teuthology.orchestra.run.smithi089.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-10-08T15:35:57.796 INFO:teuthology.orchestra.run.smithi089.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-10-08T15:35:57.834 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-10-08T15:35:57.879 INFO:teuthology.orchestra.run.smithi089.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-10-08T15:35:57.934 INFO:teuthology.orchestra.run.smithi003.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-08T15:35:57.939 DEBUG:teuthology.orchestra.run.smithi003:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2023-10-08T15:35:57.953 INFO:teuthology.orchestra.run.smithi089.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-10-08T15:35:57.953 INFO:teuthology.orchestra.run.smithi089.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.19 [1,584 kB] 2023-10-08T15:35:57.970 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libnm0:amd64. 2023-10-08T15:35:57.987 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-10-08T15:35:58.014 INFO:teuthology.orchestra.run.smithi003.stdout:Reading package lists... 2023-10-08T15:35:58.028 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-10-08T15:35:58.042 INFO:teuthology.orchestra.run.smithi089.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-10-08T15:35:58.042 INFO:teuthology.orchestra.run.smithi089.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-10-08T15:35:58.223 INFO:teuthology.orchestra.run.smithi003.stdout:Building dependency tree... 2023-10-08T15:35:58.224 INFO:teuthology.orchestra.run.smithi003.stdout:Reading state information... 2023-10-08T15:35:58.237 INFO:teuthology.orchestra.run.smithi089.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-10-08T15:35:58.290 INFO:teuthology.orchestra.run.smithi153.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152664 files and directories currently installed.) 2023-10-08T15:35:58.295 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-08T15:35:58.389 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-10-08T15:35:58.409 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../14-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T15:35:58.433 INFO:teuthology.orchestra.run.smithi003.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-10-08T15:35:58.433 INFO:teuthology.orchestra.run.smithi003.stdout:flex is already the newest version (2.6.4-6.2). 2023-10-08T15:35:58.433 INFO:teuthology.orchestra.run.smithi003.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-10-08T15:35:58.434 INFO:teuthology.orchestra.run.smithi003.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-10-08T15:35:58.434 INFO:teuthology.orchestra.run.smithi003.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-10-08T15:35:58.434 INFO:teuthology.orchestra.run.smithi003.stdout:The following packages were automatically installed and are no longer required: 2023-10-08T15:35:58.434 INFO:teuthology.orchestra.run.smithi003.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-08T15:35:58.434 INFO:teuthology.orchestra.run.smithi003.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-08T15:35:58.435 INFO:teuthology.orchestra.run.smithi003.stdout:The following additional packages will be installed: 2023-10-08T15:35:58.435 INFO:teuthology.orchestra.run.smithi003.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2023-10-08T15:35:58.435 INFO:teuthology.orchestra.run.smithi003.stdout: libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 2023-10-08T15:35:58.436 INFO:teuthology.orchestra.run.smithi003.stdout: libuuid1 modemmanager network-manager-pptp ppp pptp-linux usb-modeswitch 2023-10-08T15:35:58.436 INFO:teuthology.orchestra.run.smithi003.stdout: usb-modeswitch-data wpasupplicant 2023-10-08T15:35:58.437 INFO:teuthology.orchestra.run.smithi003.stdout:Suggested packages: 2023-10-08T15:35:58.437 INFO:teuthology.orchestra.run.smithi003.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils comgt wvdial 2023-10-08T15:35:58.437 INFO:teuthology.orchestra.run.smithi003.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2023-10-08T15:35:58.444 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-08T15:35:58.447 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-10-08T15:35:58.487 INFO:teuthology.orchestra.run.smithi003.stdout:The following NEW packages will be installed: 2023-10-08T15:35:58.487 INFO:teuthology.orchestra.run.smithi003.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-10-08T15:35:58.487 INFO:teuthology.orchestra.run.smithi003.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy 2023-10-08T15:35:58.488 INFO:teuthology.orchestra.run.smithi003.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-10-08T15:35:58.488 INFO:teuthology.orchestra.run.smithi003.stdout: ppp pptp-linux usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-08T15:35:58.489 INFO:teuthology.orchestra.run.smithi003.stdout:The following packages will be upgraded: 2023-10-08T15:35:58.490 INFO:teuthology.orchestra.run.smithi003.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2023-10-08T15:35:58.515 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package network-manager. 2023-10-08T15:35:58.532 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../20-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-10-08T15:35:58.598 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-10-08T15:35:58.674 INFO:teuthology.orchestra.run.smithi003.stdout:6 upgraded, 23 newly installed, 0 to remove and 247 not upgraded. 2023-10-08T15:35:58.674 INFO:teuthology.orchestra.run.smithi003.stdout:Need to get 10.4 MB of archives. 2023-10-08T15:35:58.674 INFO:teuthology.orchestra.run.smithi003.stdout:After this operation, 33.5 MB of additional disk space will be used. 2023-10-08T15:35:58.674 INFO:teuthology.orchestra.run.smithi003.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-10-08T15:35:58.800 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libqmi-proxy. 2023-10-08T15:35:58.818 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../15-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T15:35:58.867 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-10-08T15:35:58.875 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-08T15:35:58.876 INFO:teuthology.orchestra.run.smithi089.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-10-08T15:35:58.990 INFO:teuthology.orchestra.run.smithi089.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-10-08T15:35:59.005 INFO:teuthology.orchestra.run.smithi089.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-10-08T15:35:59.007 INFO:teuthology.orchestra.run.smithi089.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-10-08T15:35:59.008 INFO:teuthology.orchestra.run.smithi089.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-10-08T15:35:59.009 INFO:teuthology.orchestra.run.smithi089.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-10-08T15:35:59.043 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-08T15:35:59.120 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-10-08T15:35:59.137 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../16-libssl-dev_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-10-08T15:35:59.178 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-08T15:35:59.272 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ppp. 2023-10-08T15:35:59.293 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../21-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-10-08T15:35:59.297 INFO:teuthology.orchestra.run.smithi003.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-10-08T15:35:59.298 INFO:teuthology.orchestra.run.smithi003.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-10-08T15:35:59.300 INFO:teuthology.orchestra.run.smithi003.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2023-10-08T15:35:59.312 INFO:teuthology.orchestra.run.smithi003.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2023-10-08T15:35:59.315 INFO:teuthology.orchestra.run.smithi003.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.19 [1,321 kB] 2023-10-08T15:35:59.335 INFO:teuthology.orchestra.run.smithi089.stdout:Preconfiguring packages ... 2023-10-08T15:35:59.369 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-10-08T15:35:59.413 INFO:teuthology.orchestra.run.smithi003.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-10-08T15:35:59.415 INFO:teuthology.orchestra.run.smithi003.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-10-08T15:35:59.422 INFO:teuthology.orchestra.run.smithi003.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2023-10-08T15:35:59.428 INFO:teuthology.orchestra.run.smithi003.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-10-08T15:35:59.428 INFO:teuthology.orchestra.run.smithi003.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-10-08T15:35:59.470 INFO:teuthology.orchestra.run.smithi089.stdout:Fetched 10.4 MB in 3s (3,700 kB/s) 2023-10-08T15:35:59.564 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-10-08T15:35:59.595 INFO:teuthology.orchestra.run.smithi003.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2023-10-08T15:35:59.690 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-10-08T15:35:59.709 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../17-libteamdctl0_1.30-1_amd64.deb ... 2023-10-08T15:35:59.748 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-10-08T15:35:59.767 INFO:teuthology.orchestra.run.smithi089.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152664 files and directories currently installed.) 2023-10-08T15:35:59.771 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-08T15:35:59.832 INFO:teuthology.orchestra.run.smithi153.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152664 files and directories currently installed.) 2023-10-08T15:35:59.837 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-08T15:35:59.864 INFO:teuthology.orchestra.run.smithi003.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-10-08T15:35:59.928 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-08T15:35:59.944 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package pptp-linux. 2023-10-08T15:35:59.961 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../22-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-10-08T15:35:59.975 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-10-08T15:35:59.993 INFO:teuthology.orchestra.run.smithi003.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-10-08T15:35:59.999 INFO:teuthology.orchestra.run.smithi003.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-10-08T15:36:00.002 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-10-08T15:36:00.094 INFO:teuthology.orchestra.run.smithi003.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-10-08T15:36:00.098 INFO:teuthology.orchestra.run.smithi003.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-10-08T15:36:00.135 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package modemmanager. 2023-10-08T15:36:00.153 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../18-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T15:36:00.180 INFO:teuthology.orchestra.run.smithi003.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-10-08T15:36:00.204 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-10-08T15:36:00.254 INFO:teuthology.orchestra.run.smithi003.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-10-08T15:36:00.255 INFO:teuthology.orchestra.run.smithi003.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.19 [1,584 kB] 2023-10-08T15:36:00.344 INFO:teuthology.orchestra.run.smithi003.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-10-08T15:36:00.344 INFO:teuthology.orchestra.run.smithi003.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-10-08T15:36:00.372 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package network-manager-pptp. 2023-10-08T15:36:00.393 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../23-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-10-08T15:36:00.448 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-10-08T15:36:00.476 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-08T15:36:00.538 INFO:teuthology.orchestra.run.smithi003.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-10-08T15:36:00.614 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-10-08T15:36:00.700 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-10-08T15:36:00.720 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../24-usb-modeswitch-data_20191128-3_all.deb ... 2023-10-08T15:36:00.758 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-10-08T15:36:00.858 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package wpasupplicant. 2023-10-08T15:36:00.877 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../19-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-10-08T15:36:00.916 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-10-08T15:36:01.057 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-10-08T15:36:01.077 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-10-08T15:36:01.153 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package usb-modeswitch. 2023-10-08T15:36:01.173 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../25-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-10-08T15:36:01.178 INFO:teuthology.orchestra.run.smithi003.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-10-08T15:36:01.222 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-10-08T15:36:01.291 INFO:teuthology.orchestra.run.smithi003.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-10-08T15:36:01.302 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.19) over (1.1.1f-1ubuntu2.16) ... 2023-10-08T15:36:01.307 INFO:teuthology.orchestra.run.smithi003.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-10-08T15:36:01.308 INFO:teuthology.orchestra.run.smithi003.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-10-08T15:36:01.310 INFO:teuthology.orchestra.run.smithi003.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-10-08T15:36:01.311 INFO:teuthology.orchestra.run.smithi003.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-10-08T15:36:01.430 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package network-manager. 2023-10-08T15:36:01.448 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../20-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-10-08T15:36:01.513 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-10-08T15:36:01.531 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-08T15:36:01.649 INFO:teuthology.orchestra.run.smithi003.stdout:Preconfiguring packages ... 2023-10-08T15:36:01.791 INFO:teuthology.orchestra.run.smithi003.stdout:Fetched 10.4 MB in 3s (3,706 kB/s) 2023-10-08T15:36:01.884 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-10-08T15:36:01.984 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-10-08T15:36:02.007 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-10-08T15:36:02.025 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2023-10-08T15:36:02.071 INFO:teuthology.orchestra.run.smithi003.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152664 files and directories currently installed.) 2023-10-08T15:36:02.074 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-10-08T15:36:02.076 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-08T15:36:02.085 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-10-08T15:36:02.221 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package ppp. 2023-10-08T15:36:02.231 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-08T15:36:02.240 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../21-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-10-08T15:36:02.435 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package dump. 2023-10-08T15:36:02.453 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2023-10-08T15:36:02.464 INFO:teuthology.orchestra.run.smithi089.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152664 files and directories currently installed.) 2023-10-08T15:36:02.469 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-08T15:36:02.493 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking dump (0.4b46-6) ... 2023-10-08T15:36:02.512 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-08T15:36:02.512 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-08T15:36:02.521 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-10-08T15:36:02.600 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-08T15:36:02.797 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package indent. 2023-10-08T15:36:02.816 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2023-10-08T15:36:02.855 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2023-10-08T15:36:02.947 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-10-08T15:36:03.031 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-08T15:36:03.178 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package pptp-linux. 2023-10-08T15:36:03.195 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../22-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-10-08T15:36:03.198 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-10-08T15:36:03.217 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-10-08T15:36:03.231 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-08T15:36:03.235 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2023-10-08T15:36:03.236 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-10-08T15:36:03.278 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-10-08T15:36:03.324 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-08T15:36:03.378 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-10-08T15:36:03.450 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-10-08T15:36:03.563 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-10-08T15:36:03.601 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-10-08T15:36:03.603 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-10-08T15:36:03.606 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package network-manager-pptp. 2023-10-08T15:36:03.621 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-10-08T15:36:03.623 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../23-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-10-08T15:36:03.661 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-10-08T15:36:03.682 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-10-08T15:36:03.727 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-10-08T15:36:03.939 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-10-08T15:36:03.951 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-10-08T15:36:03.956 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-08T15:36:03.968 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../24-usb-modeswitch-data_20191128-3_all.deb ... 2023-10-08T15:36:03.997 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-08T15:36:04.010 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-10-08T15:36:04.019 INFO:teuthology.orchestra.run.smithi089.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152664 files and directories currently installed.) 2023-10-08T15:36:04.056 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-08T15:36:04.156 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-10-08T15:36:04.342 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-10-08T15:36:04.385 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T15:36:04.388 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package usb-modeswitch. 2023-10-08T15:36:04.392 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-10-08T15:36:04.406 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../25-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-10-08T15:36:04.457 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-10-08T15:36:04.629 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-08T15:36:04.670 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libmbim-proxy. 2023-10-08T15:36:04.689 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-10-08T15:36:04.690 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T15:36:04.728 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-10-08T15:36:04.774 INFO:teuthology.orchestra.run.smithi003.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152664 files and directories currently installed.) 2023-10-08T15:36:04.778 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-08T15:36:04.785 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-08T15:36:04.794 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-10-08T15:36:04.921 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-08T15:36:04.925 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up dump (0.4b46-6) ... 2023-10-08T15:36:05.020 INFO:teuthology.orchestra.run.smithi050.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-10-08T15:36:05.085 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-10-08T15:36:05.089 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-10-08T15:36:05.106 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T15:36:05.119 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-10-08T15:36:05.148 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-10-08T15:36:05.211 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-10-08T15:36:05.245 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-10-08T15:36:05.299 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-10-08T15:36:05.319 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-08T15:36:05.337 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2023-10-08T15:36:05.371 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-10-08T15:36:05.433 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.19) over (1.1.1f-1ubuntu2.16) ... 2023-10-08T15:36:05.496 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-10-08T15:36:05.501 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-08T15:36:05.534 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libndp0:amd64. 2023-10-08T15:36:05.553 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-10-08T15:36:05.592 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-10-08T15:36:05.681 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-10-08T15:36:05.795 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-10-08T15:36:05.799 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-08T15:36:05.799 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-08T15:36:05.807 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-08T15:36:05.912 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libnm0:amd64. 2023-10-08T15:36:05.930 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-10-08T15:36:05.933 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-10-08T15:36:05.936 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-10-08T15:36:05.954 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2023-10-08T15:36:05.995 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-10-08T15:36:05.995 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-10-08T15:36:06.084 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-10-08T15:36:06.236 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-08T15:36:06.246 INFO:teuthology.orchestra.run.smithi003.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152664 files and directories currently installed.) 2023-10-08T15:36:06.250 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-08T15:36:06.258 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-10-08T15:36:06.362 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-10-08T15:36:06.373 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-10-08T15:36:06.373 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package dump. 2023-10-08T15:36:06.384 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-10-08T15:36:06.390 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../14-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T15:36:06.390 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2023-10-08T15:36:06.431 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-10-08T15:36:06.431 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking dump (0.4b46-6) ... 2023-10-08T15:36:06.502 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-08T15:36:06.587 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-10-08T15:36:06.628 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-10-08T15:36:06.726 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package indent. 2023-10-08T15:36:06.745 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2023-10-08T15:36:06.754 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-10-08T15:36:06.767 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libqmi-proxy. 2023-10-08T15:36:06.784 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2023-10-08T15:36:06.785 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../15-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T15:36:06.867 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-10-08T15:36:06.880 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-10-08T15:36:07.074 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-08T15:36:07.074 INFO:teuthology.orchestra.run.smithi050.stdout:The following network interfaces were found in /etc/network/interfaces 2023-10-08T15:36:07.074 INFO:teuthology.orchestra.run.smithi050.stdout:which means they are currently configured by ifupdown: 2023-10-08T15:36:07.074 INFO:teuthology.orchestra.run.smithi050.stdout:- ens1f0 2023-10-08T15:36:07.075 INFO:teuthology.orchestra.run.smithi050.stdout:If you want to manage those interfaces with NetworkManager instead 2023-10-08T15:36:07.075 INFO:teuthology.orchestra.run.smithi050.stdout:remove their configuration from /etc/network/interfaces. 2023-10-08T15:36:07.075 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-08T15:36:07.232 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-10-08T15:36:07.463 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-10-08T15:36:07.464 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-10-08T15:36:07.484 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2023-10-08T15:36:07.484 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../16-libssl-dev_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-10-08T15:36:07.521 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-08T15:36:07.555 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-10-08T15:36:07.585 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-08T15:36:07.681 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-10-08T15:36:07.707 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-10-08T15:36:07.859 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-10-08T15:36:08.579 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-10-08T15:36:08.579 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.19) over (1.1.1f-1ubuntu2.16) ... 2023-10-08T15:36:08.580 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-10-08T15:36:08.580 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-10-08T15:36:08.581 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up dump (0.4b46-6) ... 2023-10-08T15:36:08.581 INFO:teuthology.orchestra.run.smithi098.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-10-08T15:36:08.581 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-10-08T15:36:08.581 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-10-08T15:36:08.581 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2023-10-08T15:36:08.581 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-10-08T15:36:08.581 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-10-08T15:36:08.582 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-10-08T15:36:08.582 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-10-08T15:36:08.582 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-08T15:36:08.582 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-08T15:36:08.582 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-10-08T15:36:08.582 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../17-libteamdctl0_1.30-1_amd64.deb ... 2023-10-08T15:36:08.582 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-10-08T15:36:08.582 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package modemmanager. 2023-10-08T15:36:08.582 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../18-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T15:36:08.582 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-10-08T15:36:08.634 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-10-08T15:36:08.659 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-10-08T15:36:09.035 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-10-08T15:36:09.035 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-08T15:36:09.035 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-08T15:36:09.035 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-10-08T15:36:09.035 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-10-08T15:36:09.035 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T15:36:09.035 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-10-08T15:36:09.036 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-10-08T15:36:09.036 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2023-10-08T15:36:09.036 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-10-08T15:36:09.045 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-10-08T15:36:09.071 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-10-08T15:36:09.197 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-10-08T15:36:09.197 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package wpasupplicant. 2023-10-08T15:36:09.197 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-10-08T15:36:09.210 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../19-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-10-08T15:36:09.244 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libmbim-proxy. 2023-10-08T15:36:09.244 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package dump. 2023-10-08T15:36:09.250 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-10-08T15:36:09.262 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2023-10-08T15:36:09.263 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T15:36:09.301 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-10-08T15:36:09.302 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking dump (0.4b46-6) ... 2023-10-08T15:36:09.390 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-08T15:36:09.469 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-10-08T15:36:09.469 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-10-08T15:36:09.516 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-10-08T15:36:09.606 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package indent. 2023-10-08T15:36:09.764 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2023-10-08T15:36:09.764 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2023-10-08T15:36:09.814 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-10-08T15:36:09.814 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T15:36:09.815 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-10-08T15:36:09.815 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package network-manager. 2023-10-08T15:36:09.823 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../20-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-10-08T15:36:09.888 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-10-08T15:36:09.974 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-10-08T15:36:09.983 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-10-08T15:36:10.004 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2023-10-08T15:36:10.042 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-10-08T15:36:10.074 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-10-08T15:36:10.124 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libndp0:amd64. 2023-10-08T15:36:10.143 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-10-08T15:36:10.182 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-10-08T15:36:10.188 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-10-08T15:36:10.228 INFO:teuthology.orchestra.run.smithi098.stdout:The following network interfaces were found in /etc/network/interfaces 2023-10-08T15:36:10.228 INFO:teuthology.orchestra.run.smithi098.stdout:which means they are currently configured by ifupdown: 2023-10-08T15:36:10.229 INFO:teuthology.orchestra.run.smithi098.stdout:- enp3s0f1 2023-10-08T15:36:10.229 INFO:teuthology.orchestra.run.smithi098.stdout:If you want to manage those interfaces with NetworkManager instead 2023-10-08T15:36:10.229 INFO:teuthology.orchestra.run.smithi098.stdout:remove their configuration from /etc/network/interfaces. 2023-10-08T15:36:10.229 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-10-08T15:36:10.230 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-08T15:36:10.342 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-10-08T15:36:10.374 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-08T15:36:10.403 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-10-08T15:36:10.421 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-10-08T15:36:10.462 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-10-08T15:36:10.494 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libnm0:amd64. 2023-10-08T15:36:10.512 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-10-08T15:36:10.552 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-10-08T15:36:10.604 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ppp. 2023-10-08T15:36:10.623 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../21-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-10-08T15:36:10.642 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-10-08T15:36:10.653 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-08T15:36:10.731 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-10-08T15:36:10.751 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-08T15:36:10.789 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-08T15:36:10.922 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-10-08T15:36:10.988 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-10-08T15:36:11.005 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../14-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T15:36:11.047 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-10-08T15:36:11.169 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-10-08T15:36:11.184 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-10-08T15:36:11.202 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T15:36:11.242 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-10-08T15:36:11.251 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package pptp-linux. 2023-10-08T15:36:11.269 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../22-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-10-08T15:36:11.310 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-10-08T15:36:11.408 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libqmi-proxy. 2023-10-08T15:36:11.425 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../15-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T15:36:11.466 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-10-08T15:36:11.512 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libmbim-proxy. 2023-10-08T15:36:11.530 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T15:36:11.561 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-10-08T15:36:11.645 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-10-08T15:36:11.688 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package network-manager-pptp. 2023-10-08T15:36:11.706 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../23-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-10-08T15:36:11.752 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-10-08T15:36:11.764 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-10-08T15:36:11.769 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../16-libssl-dev_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-10-08T15:36:11.779 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-10-08T15:36:11.810 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-08T15:36:11.914 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-10-08T15:36:11.922 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-08T15:36:11.931 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T15:36:11.972 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-10-08T15:36:12.016 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-10-08T15:36:12.036 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../24-usb-modeswitch-data_20191128-3_all.deb ... 2023-10-08T15:36:12.048 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-10-08T15:36:12.074 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-10-08T15:36:12.175 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-10-08T15:36:12.300 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-10-08T15:36:12.317 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libndp0:amd64. 2023-10-08T15:36:12.337 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-10-08T15:36:12.339 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-10-08T15:36:12.356 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../17-libteamdctl0_1.30-1_amd64.deb ... 2023-10-08T15:36:12.375 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-10-08T15:36:12.396 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-10-08T15:36:12.536 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package usb-modeswitch. 2023-10-08T15:36:12.556 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../25-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-10-08T15:36:12.608 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-10-08T15:36:12.608 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-10-08T15:36:12.780 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-10-08T15:36:12.800 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package modemmanager. 2023-10-08T15:36:12.817 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../18-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T15:36:12.869 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-10-08T15:36:13.073 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libnm0:amd64. 2023-10-08T15:36:13.091 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-10-08T15:36:13.117 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-08T15:36:13.130 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-10-08T15:36:13.154 INFO:teuthology.orchestra.run.smithi098.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-10-08T15:36:13.263 INFO:teuthology.orchestra.run.smithi098.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-10-08T15:36:13.380 INFO:teuthology.orchestra.run.smithi098.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-08T15:36:13.418 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-10-08T15:36:13.500 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-10-08T15:36:13.598 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-10-08T15:36:13.598 INFO:teuthology.orchestra.run.smithi098.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-08T15:36:13.598 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../14-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T15:36:13.599 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-10-08T15:36:13.686 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-10-08T15:36:13.775 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package wpasupplicant. 2023-10-08T15:36:13.793 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../19-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-10-08T15:36:13.809 INFO:teuthology.orchestra.run.smithi098.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-08T15:36:13.833 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-10-08T15:36:13.878 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libqmi-proxy. 2023-10-08T15:36:13.897 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../15-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T15:36:13.969 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-10-08T15:36:14.073 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-08T15:36:14.074 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-08T15:36:14.222 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-10-08T15:36:14.241 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../16-libssl-dev_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-10-08T15:36:14.280 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-08T15:36:14.372 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package network-manager. 2023-10-08T15:36:14.389 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../20-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-10-08T15:36:14.479 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-10-08T15:36:14.506 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-10-08T15:36:14.632 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-10-08T15:36:14.681 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-10-08T15:36:14.761 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-10-08T15:36:14.767 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-08T15:36:14.778 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../17-libteamdctl0_1.30-1_amd64.deb ... 2023-10-08T15:36:14.808 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-10-08T15:36:14.814 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-10-08T15:36:14.893 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-10-08T15:36:15.002 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-10-08T15:36:15.145 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-10-08T15:36:15.195 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package modemmanager. 2023-10-08T15:36:15.212 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../18-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T15:36:15.229 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ppp. 2023-10-08T15:36:15.246 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../21-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-10-08T15:36:15.264 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-10-08T15:36:15.500 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-10-08T15:36:15.682 INFO:teuthology.orchestra.run.smithi050.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-08T15:36:15.685 DEBUG:teuthology.parallel:result is None 2023-10-08T15:36:15.826 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package pptp-linux. 2023-10-08T15:36:15.844 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../22-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-10-08T15:36:15.884 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-10-08T15:36:15.884 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package wpasupplicant. 2023-10-08T15:36:15.902 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../19-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-10-08T15:36:15.942 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-10-08T15:36:16.103 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-10-08T15:36:16.279 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package network-manager-pptp. 2023-10-08T15:36:16.530 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package network-manager. 2023-10-08T15:36:16.531 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../23-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-10-08T15:36:16.531 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-10-08T15:36:16.531 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up dump (0.4b46-6) ... 2023-10-08T15:36:16.531 INFO:teuthology.orchestra.run.smithi153.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-10-08T15:36:16.531 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-10-08T15:36:16.533 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../20-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-10-08T15:36:16.596 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-10-08T15:36:17.072 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-10-08T15:36:17.072 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../24-usb-modeswitch-data_20191128-3_all.deb ... 2023-10-08T15:36:17.072 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-10-08T15:36:17.072 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-10-08T15:36:17.072 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2023-10-08T15:36:17.072 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-10-08T15:36:17.072 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-10-08T15:36:17.093 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package usb-modeswitch. 2023-10-08T15:36:17.110 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../25-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-10-08T15:36:17.160 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-08T15:36:17.166 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-10-08T15:36:17.313 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package ppp. 2023-10-08T15:36:17.319 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-10-08T15:36:17.333 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../21-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-10-08T15:36:17.445 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-10-08T15:36:17.469 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-08T15:36:17.592 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-10-08T15:36:17.614 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-08T15:36:17.670 INFO:teuthology.orchestra.run.smithi098.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-10-08T15:36:17.740 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-10-08T15:36:17.787 INFO:teuthology.orchestra.run.smithi098.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-10-08T15:36:17.796 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-10-08T15:36:17.917 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-10-08T15:36:17.943 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package pptp-linux. 2023-10-08T15:36:17.962 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../22-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-10-08T15:36:18.001 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-10-08T15:36:18.042 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-10-08T15:36:18.489 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-08T15:36:18.533 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-08T15:36:18.781 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package network-manager-pptp. 2023-10-08T15:36:18.799 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../23-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-10-08T15:36:18.940 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-10-08T15:36:18.940 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-08T15:36:18.941 INFO:teuthology.orchestra.run.smithi153.stdout:The following network interfaces were found in /etc/network/interfaces 2023-10-08T15:36:18.941 INFO:teuthology.orchestra.run.smithi153.stdout:which means they are currently configured by ifupdown: 2023-10-08T15:36:18.941 INFO:teuthology.orchestra.run.smithi153.stdout:- enp3s0f1 2023-10-08T15:36:18.941 INFO:teuthology.orchestra.run.smithi153.stdout:If you want to manage those interfaces with NetworkManager instead 2023-10-08T15:36:18.941 INFO:teuthology.orchestra.run.smithi153.stdout:remove their configuration from /etc/network/interfaces. 2023-10-08T15:36:18.941 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-08T15:36:18.971 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-10-08T15:36:19.024 INFO:teuthology.orchestra.run.smithi098.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-08T15:36:19.047 DEBUG:teuthology.parallel:result is None 2023-10-08T15:36:19.095 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-10-08T15:36:19.097 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-10-08T15:36:19.100 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-10-08T15:36:19.119 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../24-usb-modeswitch-data_20191128-3_all.deb ... 2023-10-08T15:36:19.167 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-10-08T15:36:19.273 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-08T15:36:19.391 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-10-08T15:36:19.416 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-10-08T15:36:19.517 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-10-08T15:36:19.565 INFO:teuthology.orchestra.run.smithi003.stdout:Selecting previously unselected package usb-modeswitch. 2023-10-08T15:36:19.582 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing to unpack .../25-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-10-08T15:36:19.633 INFO:teuthology.orchestra.run.smithi003.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-10-08T15:36:19.643 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-10-08T15:36:19.922 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-10-08T15:36:19.938 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-08T15:36:20.236 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-10-08T15:36:20.362 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-10-08T15:36:20.418 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-10-08T15:36:20.489 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-10-08T15:36:20.553 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-10-08T15:36:20.653 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-10-08T15:36:20.695 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-08T15:36:20.821 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-10-08T15:36:20.883 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up dump (0.4b46-6) ... 2023-10-08T15:36:20.887 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-08T15:36:20.887 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-08T15:36:20.972 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-10-08T15:36:20.978 INFO:teuthology.orchestra.run.smithi089.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-10-08T15:36:21.043 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-10-08T15:36:21.098 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-10-08T15:36:21.168 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-10-08T15:36:21.320 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2023-10-08T15:36:21.350 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-10-08T15:36:21.368 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-10-08T15:36:21.369 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-10-08T15:36:21.446 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-10-08T15:36:21.475 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-10-08T15:36:21.601 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-08T15:36:21.622 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-10-08T15:36:21.740 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-08T15:36:21.753 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-10-08T15:36:21.878 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-10-08T15:36:21.900 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-10-08T15:36:21.901 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-10-08T15:36:22.010 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-10-08T15:36:22.013 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-10-08T15:36:22.025 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-10-08T15:36:22.136 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-08T15:36:22.193 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-08T15:36:22.287 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-08T15:36:22.353 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-10-08T15:36:22.572 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-08T15:36:22.980 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-10-08T15:36:23.083 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-08T15:36:23.083 INFO:teuthology.orchestra.run.smithi089.stdout:The following network interfaces were found in /etc/network/interfaces 2023-10-08T15:36:23.083 INFO:teuthology.orchestra.run.smithi089.stdout:which means they are currently configured by ifupdown: 2023-10-08T15:36:23.083 INFO:teuthology.orchestra.run.smithi089.stdout:- enp3s0f1 2023-10-08T15:36:23.083 INFO:teuthology.orchestra.run.smithi089.stdout:If you want to manage those interfaces with NetworkManager instead 2023-10-08T15:36:23.084 INFO:teuthology.orchestra.run.smithi089.stdout:remove their configuration from /etc/network/interfaces. 2023-10-08T15:36:23.084 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-08T15:36:23.227 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up dump (0.4b46-6) ... 2023-10-08T15:36:23.243 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-10-08T15:36:23.314 INFO:teuthology.orchestra.run.smithi003.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-10-08T15:36:23.379 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-10-08T15:36:23.505 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-10-08T15:36:23.564 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-10-08T15:36:23.631 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2023-10-08T15:36:23.791 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-10-08T15:36:23.992 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-10-08T15:36:24.093 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-10-08T15:36:24.118 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-08T15:36:24.244 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-10-08T15:36:24.362 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-10-08T15:36:24.538 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-08T15:36:24.606 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-10-08T15:36:24.664 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-10-08T15:36:24.750 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-10-08T15:36:24.893 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-08T15:36:25.043 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-10-08T15:36:25.169 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-10-08T15:36:25.278 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-10-08T15:36:25.399 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:36:25.399 INFO:teuthology.orchestra.run.smithi003.stdout:The following network interfaces were found in /etc/network/interfaces 2023-10-08T15:36:25.399 INFO:teuthology.orchestra.run.smithi003.stdout:which means they are currently configured by ifupdown: 2023-10-08T15:36:25.399 INFO:teuthology.orchestra.run.smithi003.stdout:- ens1f0 2023-10-08T15:36:25.399 INFO:teuthology.orchestra.run.smithi003.stdout:If you want to manage those interfaces with NetworkManager instead 2023-10-08T15:36:25.399 INFO:teuthology.orchestra.run.smithi003.stdout:remove their configuration from /etc/network/interfaces. 2023-10-08T15:36:25.399 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:36:25.556 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-10-08T15:36:25.556 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-10-08T15:36:25.565 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-10-08T15:36:25.883 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-10-08T15:36:26.082 INFO:teuthology.orchestra.run.smithi089.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-10-08T15:36:26.182 INFO:teuthology.orchestra.run.smithi089.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-10-08T15:36:26.308 INFO:teuthology.orchestra.run.smithi089.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-08T15:36:26.410 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-10-08T15:36:26.460 INFO:teuthology.orchestra.run.smithi089.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-08T15:36:26.483 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-10-08T15:36:26.608 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-10-08T15:36:26.770 INFO:teuthology.orchestra.run.smithi089.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-08T15:36:26.859 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-10-08T15:36:26.986 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-10-08T15:36:27.162 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-08T15:36:27.288 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-10-08T15:36:27.414 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-10-08T15:36:27.430 INFO:teuthology.orchestra.run.smithi153.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-08T15:36:27.433 DEBUG:teuthology.parallel:result is None 2023-10-08T15:36:27.540 INFO:teuthology.orchestra.run.smithi003.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-10-08T15:36:27.818 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-10-08T15:36:27.818 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-10-08T15:36:28.326 INFO:teuthology.orchestra.run.smithi003.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-10-08T15:36:28.435 INFO:teuthology.orchestra.run.smithi003.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-10-08T15:36:28.586 INFO:teuthology.orchestra.run.smithi003.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-08T15:36:28.746 INFO:teuthology.orchestra.run.smithi003.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-08T15:36:29.190 INFO:teuthology.orchestra.run.smithi003.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-08T15:36:30.639 INFO:teuthology.orchestra.run.smithi089.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-10-08T15:36:30.741 INFO:teuthology.orchestra.run.smithi089.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-10-08T15:36:31.614 INFO:teuthology.orchestra.run.smithi089.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-08T15:36:31.616 DEBUG:teuthology.parallel:result is None 2023-10-08T15:36:33.217 INFO:teuthology.orchestra.run.smithi003.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-10-08T15:36:33.350 INFO:teuthology.orchestra.run.smithi003.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-10-08T15:36:34.139 INFO:teuthology.orchestra.run.smithi003.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-08T15:36:34.142 DEBUG:teuthology.parallel:result is None 2023-10-08T15:36:34.142 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-08T15:36:34.281 DEBUG:teuthology.orchestra.run.smithi003:> dpkg-query -W -f '${Version}' ceph 2023-10-08T15:36:34.304 INFO:teuthology.orchestra.run.smithi003.stdout:17.2.6-1320-g08cac018-1focal 2023-10-08T15:36:34.305 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1320-g08cac018-1focal 2023-10-08T15:36:34.305 INFO:teuthology.task.install:The correct ceph version 17.2.6-1320-g08cac018-1focal is installed. 2023-10-08T15:36:34.305 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-08T15:36:34.557 DEBUG:teuthology.orchestra.run.smithi050:> dpkg-query -W -f '${Version}' ceph 2023-10-08T15:36:34.580 INFO:teuthology.orchestra.run.smithi050.stdout:17.2.6-1320-g08cac018-1focal 2023-10-08T15:36:34.581 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1320-g08cac018-1focal 2023-10-08T15:36:34.581 INFO:teuthology.task.install:The correct ceph version 17.2.6-1320-g08cac018-1focal is installed. 2023-10-08T15:36:34.581 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-08T15:36:34.812 DEBUG:teuthology.orchestra.run.smithi089:> dpkg-query -W -f '${Version}' ceph 2023-10-08T15:36:34.835 INFO:teuthology.orchestra.run.smithi089.stdout:17.2.6-1320-g08cac018-1focal 2023-10-08T15:36:34.835 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1320-g08cac018-1focal 2023-10-08T15:36:34.835 INFO:teuthology.task.install:The correct ceph version 17.2.6-1320-g08cac018-1focal is installed. 2023-10-08T15:36:34.836 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-08T15:36:34.969 DEBUG:teuthology.orchestra.run.smithi098:> dpkg-query -W -f '${Version}' ceph 2023-10-08T15:36:34.992 INFO:teuthology.orchestra.run.smithi098.stdout:17.2.6-1320-g08cac018-1focal 2023-10-08T15:36:34.992 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1320-g08cac018-1focal 2023-10-08T15:36:34.992 INFO:teuthology.task.install:The correct ceph version 17.2.6-1320-g08cac018-1focal is installed. 2023-10-08T15:36:34.992 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-08T15:36:35.128 DEBUG:teuthology.orchestra.run.smithi153:> dpkg-query -W -f '${Version}' ceph 2023-10-08T15:36:35.151 INFO:teuthology.orchestra.run.smithi153.stdout:17.2.6-1320-g08cac018-1focal 2023-10-08T15:36:35.152 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1320-g08cac018-1focal 2023-10-08T15:36:35.152 INFO:teuthology.task.install:The correct ceph version 17.2.6-1320-g08cac018-1focal is installed. 2023-10-08T15:36:35.152 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-08T15:36:35.152 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-10-08T15:36:35.152 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-08T15:36:35.169 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-08T15:36:35.169 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-08T15:36:35.186 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-08T15:36:35.186 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-08T15:36:35.202 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-10-08T15:36:35.202 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-08T15:36:35.219 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-10-08T15:36:35.219 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-08T15:36:35.236 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-08T15:36:35.236 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-10-08T15:36:35.236 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/usr/bin/daemon-helper 2023-10-08T15:36:35.253 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-08T15:36:35.262 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-08T15:36:35.262 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/daemon-helper 2023-10-08T15:36:35.279 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-08T15:36:35.290 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-08T15:36:35.290 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/daemon-helper 2023-10-08T15:36:35.306 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-08T15:36:35.363 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-10-08T15:36:35.364 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/daemon-helper 2023-10-08T15:36:35.379 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-08T15:36:35.441 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-10-08T15:36:35.444 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/daemon-helper 2023-10-08T15:36:35.461 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-08T15:36:35.519 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-08T15:36:35.519 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-10-08T15:36:35.519 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-08T15:36:35.533 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-08T15:36:35.546 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-08T15:36:35.546 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-08T15:36:35.562 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-08T15:36:35.619 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-08T15:36:35.619 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-08T15:36:35.635 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-08T15:36:35.646 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-10-08T15:36:35.646 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-08T15:36:35.662 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-08T15:36:35.675 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-10-08T15:36:35.675 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-08T15:36:35.692 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-08T15:36:35.705 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-08T15:36:35.706 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-10-08T15:36:35.706 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/usr/bin/stdin-killer 2023-10-08T15:36:35.722 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-08T15:36:35.778 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-08T15:36:35.778 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/stdin-killer 2023-10-08T15:36:35.793 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-08T15:36:35.850 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-08T15:36:35.851 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/stdin-killer 2023-10-08T15:36:35.866 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-08T15:36:35.923 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-10-08T15:36:35.924 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/stdin-killer 2023-10-08T15:36:35.939 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-08T15:36:35.997 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-10-08T15:36:35.997 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/stdin-killer 2023-10-08T15:36:36.014 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-08T15:36:36.073 INFO:teuthology.run_tasks:Running task ceph... 2023-10-08T15:36:36.139 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-08T15:36:36.139 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 777 /var/log/ceph 2023-10-08T15:36:36.141 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 777 /var/log/ceph 2023-10-08T15:36:36.144 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 777 /var/log/ceph 2023-10-08T15:36:36.146 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 777 /var/log/ceph 2023-10-08T15:36:36.148 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 777 /var/log/ceph 2023-10-08T15:36:36.164 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-08T15:36:36.164 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-08T15:36:36.200 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-08T15:36:36.202 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-08T15:36:36.204 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-08T15:36:36.207 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-08T15:36:36.222 INFO:tasks.ceph:Creating extra log directories... 2023-10-08T15:36:36.222 DEBUG:teuthology.orchestra.run.smithi003:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-08T15:36:36.225 DEBUG:teuthology.orchestra.run.smithi050:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-08T15:36:36.227 DEBUG:teuthology.orchestra.run.smithi089:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-08T15:36:36.229 DEBUG:teuthology.orchestra.run.smithi098:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-08T15:36:36.231 DEBUG:teuthology.orchestra.run.smithi153:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-08T15:36:36.288 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-08T15:36:36.288 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-08T15:36:36.288 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-08T15:36:36.289 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-10-08T15:36:36.289 DEBUG:teuthology.orchestra.run.smithi003:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-08T15:36:36.296 DEBUG:teuthology.orchestra.run.smithi003:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-08T15:36:36.380 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-08T15:36:36.380 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-08T15:36:36.387 DEBUG:teuthology.orchestra.run.smithi050:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-08T15:36:36.424 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-08T15:36:36.424 DEBUG:teuthology.orchestra.run.smithi089:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-08T15:36:36.431 DEBUG:teuthology.orchestra.run.smithi089:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-08T15:36:36.470 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-10-08T15:36:36.470 DEBUG:teuthology.orchestra.run.smithi098:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-08T15:36:36.477 DEBUG:teuthology.orchestra.run.smithi098:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-08T15:36:36.554 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-10-08T15:36:36.554 DEBUG:teuthology.orchestra.run.smithi153:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-08T15:36:36.561 DEBUG:teuthology.orchestra.run.smithi153:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-08T15:36:36.606 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-08T15:36:36.607 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'POOL_APP_NOT_ENABLED', 'has not responded to cap revoke by MDS for over', 'MDS_CLIENT_LATE_RELEASE', 'responding to mclientcaps', 'RECENT_CRASH'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-08T15:36:36.607 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-10-08_15:12:05-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418272', 'branch': 'wip-yuri-testing-2023-10-06-0949-quincy', 'description': 'fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cephfs_misc_tests}', 'email': None, 'first_in_suite': False, 'job_id': '7418272', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-10-08_15:12:05-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 30}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-yuri-testing-2023-10-06-0949-quincy'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'POOL_APP_NOT_ENABLED', 'has not responded to cap revoke by MDS for over', 'MDS_CLIENT_LATE_RELEASE', 'responding to mclientcaps', 'RECENT_CRASH'], 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri-testing-2023-10-06-0949-quincy', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 74, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'], ['client.0'], ['client.1'], ['client.2']], 'seed': 8174, 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'wip-yuri-testing-2023-10-06-0949-quincy', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_08cac0187919fc3a247efdf445f652e2fb30a647/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '08cac0187919fc3a247efdf445f652e2fb30a647', 'targets': {'smithi003.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi050.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi089.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi098.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi153.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'POOL_APP_NOT_ENABLED', 'has not responded to cap revoke by MDS for over', 'MDS_CLIENT_LATE_RELEASE', 'responding to mclientcaps', 'RECENT_CRASH'], 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_misc']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-10-08_15:12:05', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-08T15:36:36.608 DEBUG:teuthology.orchestra.run.smithi003:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-08T15:36:36.611 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-08T15:36:36.613 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-08T15:36:36.615 DEBUG:teuthology.orchestra.run.smithi098:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-08T15:36:36.618 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-08T15:36:36.648 DEBUG:teuthology.orchestra.run.smithi003:> sudo install -d -m0777 -- /var/run/ceph 2023-10-08T15:36:36.651 DEBUG:teuthology.orchestra.run.smithi050:> sudo install -d -m0777 -- /var/run/ceph 2023-10-08T15:36:36.654 DEBUG:teuthology.orchestra.run.smithi089:> sudo install -d -m0777 -- /var/run/ceph 2023-10-08T15:36:36.656 DEBUG:teuthology.orchestra.run.smithi098:> sudo install -d -m0777 -- /var/run/ceph 2023-10-08T15:36:36.658 DEBUG:teuthology.orchestra.run.smithi153:> sudo install -d -m0777 -- /var/run/ceph 2023-10-08T15:36:36.674 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-10-08T15:36:36.674 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/scratch_devs of=/dev/stdout 2023-10-08T15:36:36.713 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-08T15:36:36.713 DEBUG:teuthology.orchestra.run.smithi003:> stat /dev/vg_nvme/lv_1 2023-10-08T15:36:36.720 INFO:teuthology.orchestra.run.smithi003.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-08T15:36:36.721 INFO:teuthology.orchestra.run.smithi003.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T15:36:36.721 INFO:teuthology.orchestra.run.smithi003.stdout:Device: 6h/6d Inode: 358 Links: 1 2023-10-08T15:36:36.721 INFO:teuthology.orchestra.run.smithi003.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T15:36:36.721 INFO:teuthology.orchestra.run.smithi003.stdout:Access: 2023-10-08 15:31:49.610450276 +0000 2023-10-08T15:36:36.721 INFO:teuthology.orchestra.run.smithi003.stdout:Modify: 2023-10-08 15:31:49.334456640 +0000 2023-10-08T15:36:36.721 INFO:teuthology.orchestra.run.smithi003.stdout:Change: 2023-10-08 15:31:49.334456640 +0000 2023-10-08T15:36:36.721 INFO:teuthology.orchestra.run.smithi003.stdout: Birth: - 2023-10-08T15:36:36.721 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-08T15:36:36.735 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records in 2023-10-08T15:36:36.735 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records out 2023-10-08T15:36:36.735 INFO:teuthology.orchestra.run.smithi003.stderr:512 bytes copied, 0.000398944 s, 1.3 MB/s 2023-10-08T15:36:36.736 DEBUG:teuthology.orchestra.run.smithi003:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-08T15:36:36.787 DEBUG:teuthology.orchestra.run.smithi003:> stat /dev/vg_nvme/lv_2 2023-10-08T15:36:36.795 INFO:teuthology.orchestra.run.smithi003.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-08T15:36:36.795 INFO:teuthology.orchestra.run.smithi003.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T15:36:36.795 INFO:teuthology.orchestra.run.smithi003.stdout:Device: 6h/6d Inode: 365 Links: 1 2023-10-08T15:36:36.796 INFO:teuthology.orchestra.run.smithi003.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T15:36:36.796 INFO:teuthology.orchestra.run.smithi003.stdout:Access: 2023-10-08 15:31:49.838445018 +0000 2023-10-08T15:36:36.796 INFO:teuthology.orchestra.run.smithi003.stdout:Modify: 2023-10-08 15:31:49.834445111 +0000 2023-10-08T15:36:36.796 INFO:teuthology.orchestra.run.smithi003.stdout:Change: 2023-10-08 15:31:49.834445111 +0000 2023-10-08T15:36:36.796 INFO:teuthology.orchestra.run.smithi003.stdout: Birth: - 2023-10-08T15:36:36.796 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-08T15:36:36.811 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records in 2023-10-08T15:36:36.812 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records out 2023-10-08T15:36:36.812 INFO:teuthology.orchestra.run.smithi003.stderr:512 bytes copied, 0.000392671 s, 1.3 MB/s 2023-10-08T15:36:36.813 DEBUG:teuthology.orchestra.run.smithi003:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-08T15:36:36.863 DEBUG:teuthology.orchestra.run.smithi003:> stat /dev/vg_nvme/lv_3 2023-10-08T15:36:36.869 INFO:teuthology.orchestra.run.smithi003.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-08T15:36:36.869 INFO:teuthology.orchestra.run.smithi003.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T15:36:36.869 INFO:teuthology.orchestra.run.smithi003.stdout:Device: 6h/6d Inode: 372 Links: 1 2023-10-08T15:36:36.869 INFO:teuthology.orchestra.run.smithi003.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T15:36:36.869 INFO:teuthology.orchestra.run.smithi003.stdout:Access: 2023-10-08 15:31:50.594427585 +0000 2023-10-08T15:36:36.869 INFO:teuthology.orchestra.run.smithi003.stdout:Modify: 2023-10-08 15:31:50.318433949 +0000 2023-10-08T15:36:36.870 INFO:teuthology.orchestra.run.smithi003.stdout:Change: 2023-10-08 15:31:50.318433949 +0000 2023-10-08T15:36:36.870 INFO:teuthology.orchestra.run.smithi003.stdout: Birth: - 2023-10-08T15:36:36.870 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-08T15:36:36.882 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records in 2023-10-08T15:36:36.882 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records out 2023-10-08T15:36:36.882 INFO:teuthology.orchestra.run.smithi003.stderr:512 bytes copied, 0.000374526 s, 1.4 MB/s 2023-10-08T15:36:36.883 DEBUG:teuthology.orchestra.run.smithi003:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-08T15:36:36.935 DEBUG:teuthology.orchestra.run.smithi003:> stat /dev/vg_nvme/lv_4 2023-10-08T15:36:36.943 INFO:teuthology.orchestra.run.smithi003.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-08T15:36:36.943 INFO:teuthology.orchestra.run.smithi003.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T15:36:36.943 INFO:teuthology.orchestra.run.smithi003.stdout:Device: 6h/6d Inode: 377 Links: 1 2023-10-08T15:36:36.943 INFO:teuthology.orchestra.run.smithi003.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T15:36:36.943 INFO:teuthology.orchestra.run.smithi003.stdout:Access: 2023-10-08 15:31:50.802422787 +0000 2023-10-08T15:36:36.943 INFO:teuthology.orchestra.run.smithi003.stdout:Modify: 2023-10-08 15:31:50.798422879 +0000 2023-10-08T15:36:36.943 INFO:teuthology.orchestra.run.smithi003.stdout:Change: 2023-10-08 15:31:50.798422879 +0000 2023-10-08T15:36:36.944 INFO:teuthology.orchestra.run.smithi003.stdout: Birth: - 2023-10-08T15:36:36.944 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-08T15:36:36.958 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records in 2023-10-08T15:36:36.958 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records out 2023-10-08T15:36:36.958 INFO:teuthology.orchestra.run.smithi003.stderr:512 bytes copied, 0.000398377 s, 1.3 MB/s 2023-10-08T15:36:36.959 DEBUG:teuthology.orchestra.run.smithi003:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-08T15:36:36.968 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-08T15:36:36.968 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-08T15:36:36.968 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/scratch_devs of=/dev/stdout 2023-10-08T15:36:36.975 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-08T15:36:36.975 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_1 2023-10-08T15:36:37.026 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-08T15:36:37.026 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T15:36:37.026 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 6h/6d Inode: 360 Links: 1 2023-10-08T15:36:37.026 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T15:36:37.026 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2023-10-08 15:31:50.041320904 +0000 2023-10-08T15:36:37.026 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2023-10-08 15:31:49.773327070 +0000 2023-10-08T15:36:37.026 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2023-10-08 15:31:49.773327070 +0000 2023-10-08T15:36:37.027 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: - 2023-10-08T15:36:37.027 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-08T15:36:37.037 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2023-10-08T15:36:37.038 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2023-10-08T15:36:37.038 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.00029874 s, 1.7 MB/s 2023-10-08T15:36:37.039 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-08T15:36:37.047 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_2 2023-10-08T15:36:37.097 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-08T15:36:37.097 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T15:36:37.098 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 6h/6d Inode: 365 Links: 1 2023-10-08T15:36:37.098 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T15:36:37.098 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2023-10-08 15:31:50.529309677 +0000 2023-10-08T15:36:37.098 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2023-10-08 15:31:50.269315658 +0000 2023-10-08T15:36:37.098 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2023-10-08 15:31:50.269315658 +0000 2023-10-08T15:36:37.098 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: - 2023-10-08T15:36:37.098 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-08T15:36:37.109 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2023-10-08T15:36:37.109 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2023-10-08T15:36:37.109 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000305661 s, 1.7 MB/s 2023-10-08T15:36:37.110 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-08T15:36:37.118 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_3 2023-10-08T15:36:37.166 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-08T15:36:37.166 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T15:36:37.166 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 6h/6d Inode: 372 Links: 1 2023-10-08T15:36:37.166 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T15:36:37.166 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2023-10-08 15:31:50.997298910 +0000 2023-10-08T15:36:37.167 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2023-10-08 15:31:50.717305351 +0000 2023-10-08T15:36:37.167 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2023-10-08 15:31:50.717305351 +0000 2023-10-08T15:36:37.167 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: - 2023-10-08T15:36:37.167 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-08T15:36:37.179 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2023-10-08T15:36:37.179 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2023-10-08T15:36:37.179 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000318396 s, 1.6 MB/s 2023-10-08T15:36:37.180 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-08T15:36:37.189 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_4 2023-10-08T15:36:37.238 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-08T15:36:37.238 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T15:36:37.238 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 6h/6d Inode: 379 Links: 1 2023-10-08T15:36:37.238 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T15:36:37.238 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2023-10-08 15:31:51.509287131 +0000 2023-10-08T15:36:37.239 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2023-10-08 15:31:51.225293665 +0000 2023-10-08T15:36:37.239 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2023-10-08 15:31:51.225293665 +0000 2023-10-08T15:36:37.239 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: - 2023-10-08T15:36:37.239 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-08T15:36:37.251 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2023-10-08T15:36:37.251 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2023-10-08T15:36:37.252 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000262994 s, 1.9 MB/s 2023-10-08T15:36:37.252 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-08T15:36:37.262 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-08T15:36:37.262 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi003.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi050.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-08T15:36:37.262 INFO:tasks.ceph:Generating config... 2023-10-08T15:36:37.264 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-08T15:36:37.264 INFO:tasks.ceph:[client] debug client = 20 2023-10-08T15:36:37.264 INFO:tasks.ceph:[client] debug ms = 1 2023-10-08T15:36:37.264 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-08T15:36:37.264 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-08T15:36:37.265 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-08T15:36:37.265 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-08T15:36:37.265 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-08T15:36:37.265 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-08T15:36:37.265 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-08T15:36:37.265 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-08T15:36:37.265 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-08T15:36:37.265 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-08T15:36:37.265 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-08T15:36:37.265 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-08T15:36:37.265 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-08T15:36:37.266 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-08T15:36:37.266 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-08T15:36:37.266 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-08T15:36:37.266 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-08T15:36:37.266 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-08T15:36:37.266 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2023-10-08T15:36:37.266 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-08T15:36:37.266 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-10-08T15:36:37.267 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-10-08T15:36:37.267 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-08T15:36:37.267 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-08T15:36:37.267 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-10-08T15:36:37.267 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-08T15:36:37.267 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-08T15:36:37.268 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-08T15:36:37.268 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-08T15:36:37.268 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-08T15:36:37.268 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-08T15:36:37.268 INFO:tasks.ceph:Setting up mon.a... 2023-10-08T15:36:37.268 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-08T15:36:37.303 INFO:teuthology.orchestra.run.smithi003.stdout:creating /etc/ceph/ceph.keyring 2023-10-08T15:36:37.306 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-08T15:36:37.389 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-08T15:36:37.404 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.3'), ('mon.b', '172.21.15.50'), ('mon.c', '[v2:172.21.15.50:3301,v1:172.21.15.50:6790]')] 2023-10-08T15:36:37.405 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.3,172.21.15.50,[v2:172.21.15.50:3301,v1:172.21.15.50:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-08T15:36:37.406 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-10-08T15:36:37.406 DEBUG:teuthology.orchestra.run.smithi003:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-08T15:36:37.412 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.3 --add b 172.21.15.50 --addv c '[v2:172.21.15.50:3301,v1:172.21.15.50:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-08T15:36:37.449 INFO:teuthology.orchestra.run.smithi003.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-08T15:36:37.450 INFO:teuthology.orchestra.run.smithi003.stdout:monmaptool: generated fsid 7635972e-cd66-4a8f-a231-378db8b3847a 2023-10-08T15:36:37.450 INFO:teuthology.orchestra.run.smithi003.stdout:setting min_mon_release = octopus 2023-10-08T15:36:37.451 INFO:teuthology.orchestra.run.smithi003.stdout:epoch 0 2023-10-08T15:36:37.451 INFO:teuthology.orchestra.run.smithi003.stdout:fsid 7635972e-cd66-4a8f-a231-378db8b3847a 2023-10-08T15:36:37.451 INFO:teuthology.orchestra.run.smithi003.stdout:last_changed 2023-10-08T15:36:37.447592+0000 2023-10-08T15:36:37.451 INFO:teuthology.orchestra.run.smithi003.stdout:created 2023-10-08T15:36:37.447592+0000 2023-10-08T15:36:37.451 INFO:teuthology.orchestra.run.smithi003.stdout:min_mon_release 15 (octopus) 2023-10-08T15:36:37.451 INFO:teuthology.orchestra.run.smithi003.stdout:election_strategy: 1 2023-10-08T15:36:37.451 INFO:teuthology.orchestra.run.smithi003.stdout:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-10-08T15:36:37.451 INFO:teuthology.orchestra.run.smithi003.stdout:1: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.b 2023-10-08T15:36:37.451 INFO:teuthology.orchestra.run.smithi003.stdout:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2023-10-08T15:36:37.452 INFO:teuthology.orchestra.run.smithi003.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-08T15:36:37.453 DEBUG:teuthology.orchestra.run.smithi003:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-08T15:36:37.458 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 7635972e-cd66-4a8f-a231-378db8b3847a... 2023-10-08T15:36:37.460 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-08T15:36:37.505 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-08T15:36:37.508 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-08T15:36:37.510 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-08T15:36:37.516 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-08T15:36:37.540 INFO:teuthology.orchestra.run.smithi003.stdout:[global] 2023-10-08T15:36:37.540 INFO:teuthology.orchestra.run.smithi003.stdout: chdir = "" 2023-10-08T15:36:37.540 INFO:teuthology.orchestra.run.smithi003.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-08T15:36:37.540 INFO:teuthology.orchestra.run.smithi003.stdout: auth supported = cephx 2023-10-08T15:36:37.540 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:36:37.540 INFO:teuthology.orchestra.run.smithi003.stdout: filestore xattr use omap = true 2023-10-08T15:36:37.541 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:36:37.541 INFO:teuthology.orchestra.run.smithi003.stdout: mon clock drift allowed = 1.000 2023-10-08T15:36:37.541 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:36:37.541 INFO:teuthology.orchestra.run.smithi003.stdout: osd crush chooseleaf type = 0 2023-10-08T15:36:37.541 INFO:teuthology.orchestra.run.smithi003.stdout: auth debug = true 2023-10-08T15:36:37.541 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:36:37.541 INFO:teuthology.orchestra.run.smithi003.stdout: ms die on old message = true 2023-10-08T15:36:37.541 INFO:teuthology.orchestra.run.smithi003.stdout: ms die on bug = true 2023-10-08T15:36:37.542 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:36:37.542 INFO:teuthology.orchestra.run.smithi003.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-08T15:36:37.542 INFO:teuthology.orchestra.run.smithi003.stdout: mon pg warn max object skew = 0 2023-10-08T15:36:37.542 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:36:37.542 INFO:teuthology.orchestra.run.smithi003.stdout: # disable pg_autoscaler by default for new pools 2023-10-08T15:36:37.542 INFO:teuthology.orchestra.run.smithi003.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-08T15:36:37.542 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:36:37.542 INFO:teuthology.orchestra.run.smithi003.stdout: osd pool default size = 2 2023-10-08T15:36:37.542 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:36:37.542 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd allow primary affinity = true 2023-10-08T15:36:37.542 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd allow pg remap = true 2023-10-08T15:36:37.543 INFO:teuthology.orchestra.run.smithi003.stdout: mon warn on legacy crush tunables = false 2023-10-08T15:36:37.543 INFO:teuthology.orchestra.run.smithi003.stdout: mon warn on crush straw calc version zero = false 2023-10-08T15:36:37.543 INFO:teuthology.orchestra.run.smithi003.stdout: mon warn on no sortbitwise = false 2023-10-08T15:36:37.543 INFO:teuthology.orchestra.run.smithi003.stdout: mon warn on osd down out interval zero = false 2023-10-08T15:36:37.543 INFO:teuthology.orchestra.run.smithi003.stdout: mon warn on too few osds = false 2023-10-08T15:36:37.543 INFO:teuthology.orchestra.run.smithi003.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-08T15:36:37.543 INFO:teuthology.orchestra.run.smithi003.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-08T15:36:37.543 INFO:teuthology.orchestra.run.smithi003.stdout: mon_allow_pool_size_one = true 2023-10-08T15:36:37.543 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:36:37.543 INFO:teuthology.orchestra.run.smithi003.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-08T15:36:37.544 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:36:37.544 INFO:teuthology.orchestra.run.smithi003.stdout: osd default data pool replay window = 5 2023-10-08T15:36:37.544 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:36:37.544 INFO:teuthology.orchestra.run.smithi003.stdout: mon allow pool delete = true 2023-10-08T15:36:37.544 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:36:37.544 INFO:teuthology.orchestra.run.smithi003.stdout: mon cluster log file level = debug 2023-10-08T15:36:37.544 INFO:teuthology.orchestra.run.smithi003.stdout: debug asserts on shutdown = true 2023-10-08T15:36:37.544 INFO:teuthology.orchestra.run.smithi003.stdout: mon health detail to clog = false 2023-10-08T15:36:37.545 INFO:teuthology.orchestra.run.smithi003.stdout: mon host = "172.21.15.3,172.21.15.50,[v2:172.21.15.50:3301,v1:172.21.15.50:6790]" 2023-10-08T15:36:37.545 INFO:teuthology.orchestra.run.smithi003.stdout: fsid = 7635972e-cd66-4a8f-a231-378db8b3847a 2023-10-08T15:36:37.545 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:36:37.545 INFO:teuthology.orchestra.run.smithi003.stdout:[osd] 2023-10-08T15:36:37.545 INFO:teuthology.orchestra.run.smithi003.stdout: osd journal size = 100 2023-10-08T15:36:37.545 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:36:37.545 INFO:teuthology.orchestra.run.smithi003.stdout: osd scrub load threshold = 5.0 2023-10-08T15:36:37.545 INFO:teuthology.orchestra.run.smithi003.stdout: osd scrub max interval = 600 2023-10-08T15:36:37.546 INFO:teuthology.orchestra.run.smithi003.stdout: osd mclock profile = high_recovery_ops 2023-10-08T15:36:37.546 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:36:37.546 INFO:teuthology.orchestra.run.smithi003.stdout: osd recover clone overlap = true 2023-10-08T15:36:37.546 INFO:teuthology.orchestra.run.smithi003.stdout: osd recovery max chunk = 1048576 2023-10-08T15:36:37.546 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:36:37.546 INFO:teuthology.orchestra.run.smithi003.stdout: osd debug shutdown = true 2023-10-08T15:36:37.546 INFO:teuthology.orchestra.run.smithi003.stdout: osd debug op order = true 2023-10-08T15:36:37.546 INFO:teuthology.orchestra.run.smithi003.stdout: osd debug verify stray on activate = true 2023-10-08T15:36:37.546 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:36:37.546 INFO:teuthology.orchestra.run.smithi003.stdout: osd open classes on start = true 2023-10-08T15:36:37.547 INFO:teuthology.orchestra.run.smithi003.stdout: osd debug pg log writeout = true 2023-10-08T15:36:37.547 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:36:37.547 INFO:teuthology.orchestra.run.smithi003.stdout: osd deep scrub update digest min age = 30 2023-10-08T15:36:37.547 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:36:37.547 INFO:teuthology.orchestra.run.smithi003.stdout: osd map max advance = 10 2023-10-08T15:36:37.547 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:36:37.547 INFO:teuthology.orchestra.run.smithi003.stdout: journal zero on create = true 2023-10-08T15:36:37.547 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:36:37.547 INFO:teuthology.orchestra.run.smithi003.stdout: filestore ondisk finisher threads = 3 2023-10-08T15:36:37.547 INFO:teuthology.orchestra.run.smithi003.stdout: filestore apply finisher threads = 3 2023-10-08T15:36:37.547 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:36:37.547 INFO:teuthology.orchestra.run.smithi003.stdout: bdev debug aio = true 2023-10-08T15:36:37.548 INFO:teuthology.orchestra.run.smithi003.stdout: osd debug misdirected ops = true 2023-10-08T15:36:37.549 INFO:teuthology.orchestra.run.smithi003.stdout: bluestore block size = 96636764160 2023-10-08T15:36:37.549 INFO:teuthology.orchestra.run.smithi003.stdout: bluestore compression mode = aggressive 2023-10-08T15:36:37.549 INFO:teuthology.orchestra.run.smithi003.stdout: bluestore fsck on mount = True 2023-10-08T15:36:37.549 INFO:teuthology.orchestra.run.smithi003.stdout: debug bluefs = 20 2023-10-08T15:36:37.549 INFO:teuthology.orchestra.run.smithi003.stdout: debug bluestore = 20 2023-10-08T15:36:37.549 INFO:teuthology.orchestra.run.smithi003.stdout: debug ms = 1 2023-10-08T15:36:37.549 INFO:teuthology.orchestra.run.smithi003.stdout: debug osd = 20 2023-10-08T15:36:37.549 INFO:teuthology.orchestra.run.smithi003.stdout: debug rocksdb = 10 2023-10-08T15:36:37.549 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd backfillfull_ratio = 0.85 2023-10-08T15:36:37.549 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd full ratio = 0.9 2023-10-08T15:36:37.549 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd nearfull ratio = 0.8 2023-10-08T15:36:37.549 INFO:teuthology.orchestra.run.smithi003.stdout: osd failsafe full ratio = 0.95 2023-10-08T15:36:37.550 INFO:teuthology.orchestra.run.smithi003.stdout: osd objectstore = bluestore 2023-10-08T15:36:37.550 INFO:teuthology.orchestra.run.smithi003.stdout: osd op complaint time = 180 2023-10-08T15:36:37.550 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:36:37.550 INFO:teuthology.orchestra.run.smithi003.stdout:[mgr] 2023-10-08T15:36:37.550 INFO:teuthology.orchestra.run.smithi003.stdout: debug ms = 1 2023-10-08T15:36:37.550 INFO:teuthology.orchestra.run.smithi003.stdout: debug mgr = 20 2023-10-08T15:36:37.550 INFO:teuthology.orchestra.run.smithi003.stdout: debug mon = 20 2023-10-08T15:36:37.550 INFO:teuthology.orchestra.run.smithi003.stdout: debug auth = 20 2023-10-08T15:36:37.550 INFO:teuthology.orchestra.run.smithi003.stdout: mon reweight min pgs per osd = 4 2023-10-08T15:36:37.550 INFO:teuthology.orchestra.run.smithi003.stdout: mon reweight min bytes per osd = 10 2023-10-08T15:36:37.550 INFO:teuthology.orchestra.run.smithi003.stdout: mgr/telemetry/nag = false 2023-10-08T15:36:37.551 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:36:37.551 INFO:teuthology.orchestra.run.smithi003.stdout:[mon] 2023-10-08T15:36:37.551 INFO:teuthology.orchestra.run.smithi003.stdout: debug ms = 1 2023-10-08T15:36:37.551 INFO:teuthology.orchestra.run.smithi003.stdout: debug mon = 20 2023-10-08T15:36:37.551 INFO:teuthology.orchestra.run.smithi003.stdout: debug paxos = 20 2023-10-08T15:36:37.551 INFO:teuthology.orchestra.run.smithi003.stdout: debug auth = 20 2023-10-08T15:36:37.551 INFO:teuthology.orchestra.run.smithi003.stdout: mon data avail warn = 5 2023-10-08T15:36:37.551 INFO:teuthology.orchestra.run.smithi003.stdout: mon mgr mkfs grace = 240 2023-10-08T15:36:37.551 INFO:teuthology.orchestra.run.smithi003.stdout: mon reweight min pgs per osd = 4 2023-10-08T15:36:37.551 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd reporter subtree level = osd 2023-10-08T15:36:37.551 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd prime pg temp = true 2023-10-08T15:36:37.551 INFO:teuthology.orchestra.run.smithi003.stdout: mon reweight min bytes per osd = 10 2023-10-08T15:36:37.552 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:36:37.552 INFO:teuthology.orchestra.run.smithi003.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-08T15:36:37.552 INFO:teuthology.orchestra.run.smithi003.stdout: auth mon ticket ttl = 660 # 11m 2023-10-08T15:36:37.552 INFO:teuthology.orchestra.run.smithi003.stdout: auth service ticket ttl = 240 # 4m 2023-10-08T15:36:37.552 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:36:37.552 INFO:teuthology.orchestra.run.smithi003.stdout: # don't complain about insecure global_id in the test suite 2023-10-08T15:36:37.552 INFO:teuthology.orchestra.run.smithi003.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-08T15:36:37.552 INFO:teuthology.orchestra.run.smithi003.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-08T15:36:37.552 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:36:37.552 INFO:teuthology.orchestra.run.smithi003.stdout: # 1m isn't quite enough 2023-10-08T15:36:37.552 INFO:teuthology.orchestra.run.smithi003.stdout: mon_down_mkfs_grace = 2m 2023-10-08T15:36:37.553 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:36:37.553 INFO:teuthology.orchestra.run.smithi003.stdout: mon_warn_on_filestore_osds = false 2023-10-08T15:36:37.553 INFO:teuthology.orchestra.run.smithi003.stdout: mon op complaint time = 120 2023-10-08T15:36:37.553 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:36:37.553 INFO:teuthology.orchestra.run.smithi003.stdout:[client] 2023-10-08T15:36:37.553 INFO:teuthology.orchestra.run.smithi003.stdout: rgw cache enabled = true 2023-10-08T15:36:37.553 INFO:teuthology.orchestra.run.smithi003.stdout: rgw enable ops log = true 2023-10-08T15:36:37.553 INFO:teuthology.orchestra.run.smithi003.stdout: rgw enable usage log = true 2023-10-08T15:36:37.553 INFO:teuthology.orchestra.run.smithi003.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-08T15:36:37.553 INFO:teuthology.orchestra.run.smithi003.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-08T15:36:37.553 INFO:teuthology.orchestra.run.smithi003.stdout: client mount timeout = 600 2023-10-08T15:36:37.554 INFO:teuthology.orchestra.run.smithi003.stdout: debug client = 20 2023-10-08T15:36:37.554 INFO:teuthology.orchestra.run.smithi003.stdout: debug ms = 1 2023-10-08T15:36:37.554 INFO:teuthology.orchestra.run.smithi003.stdout: rados mon op timeout = 900 2023-10-08T15:36:37.554 INFO:teuthology.orchestra.run.smithi003.stdout: rados osd op timeout = 900 2023-10-08T15:36:37.554 INFO:teuthology.orchestra.run.smithi003.stdout:[mon.a] 2023-10-08T15:36:37.554 INFO:teuthology.orchestra.run.smithi003.stdout:[mon.b] 2023-10-08T15:36:37.554 INFO:teuthology.orchestra.run.smithi003.stdout:[mon.c] 2023-10-08T15:36:37.554 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.a] 2023-10-08T15:36:37.554 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.b] 2023-10-08T15:36:37.554 INFO:teuthology.orchestra.run.smithi003.stdout:[mds] 2023-10-08T15:36:37.554 INFO:teuthology.orchestra.run.smithi003.stdout: debug mds = 20 2023-10-08T15:36:37.554 INFO:teuthology.orchestra.run.smithi003.stdout: debug ms = 1 2023-10-08T15:36:37.555 INFO:teuthology.orchestra.run.smithi003.stdout: mds debug frag = True 2023-10-08T15:36:37.555 INFO:teuthology.orchestra.run.smithi003.stdout: mds debug scatterstat = True 2023-10-08T15:36:37.555 INFO:teuthology.orchestra.run.smithi003.stdout: mds op complaint time = 180 2023-10-08T15:36:37.555 INFO:teuthology.orchestra.run.smithi003.stdout: mds verify scatter = True 2023-10-08T15:36:37.555 INFO:teuthology.orchestra.run.smithi003.stdout: osd op complaint time = 180 2023-10-08T15:36:37.555 INFO:teuthology.orchestra.run.smithi003.stdout: rados mon op timeout = 900 2023-10-08T15:36:37.555 INFO:teuthology.orchestra.run.smithi003.stdout: rados osd op timeout = 900 2023-10-08T15:36:37.557 INFO:teuthology.orchestra.run.smithi153.stdout:[global] 2023-10-08T15:36:37.557 INFO:teuthology.orchestra.run.smithi153.stdout: chdir = "" 2023-10-08T15:36:37.557 INFO:teuthology.orchestra.run.smithi153.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-08T15:36:37.557 INFO:teuthology.orchestra.run.smithi153.stdout: auth supported = cephx 2023-10-08T15:36:37.557 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-08T15:36:37.557 INFO:teuthology.orchestra.run.smithi153.stdout: filestore xattr use omap = true 2023-10-08T15:36:37.558 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-08T15:36:37.558 INFO:teuthology.orchestra.run.smithi153.stdout: mon clock drift allowed = 1.000 2023-10-08T15:36:37.558 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-08T15:36:37.558 INFO:teuthology.orchestra.run.smithi153.stdout: osd crush chooseleaf type = 0 2023-10-08T15:36:37.558 INFO:teuthology.orchestra.run.smithi153.stdout: auth debug = true 2023-10-08T15:36:37.558 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-08T15:36:37.558 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on old message = true 2023-10-08T15:36:37.558 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on bug = true 2023-10-08T15:36:37.558 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-08T15:36:37.558 INFO:teuthology.orchestra.run.smithi153.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-08T15:36:37.559 INFO:teuthology.orchestra.run.smithi153.stdout: mon pg warn max object skew = 0 2023-10-08T15:36:37.559 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-08T15:36:37.559 INFO:teuthology.orchestra.run.smithi153.stdout: # disable pg_autoscaler by default for new pools 2023-10-08T15:36:37.559 INFO:teuthology.orchestra.run.smithi153.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-08T15:36:37.559 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-08T15:36:37.559 INFO:teuthology.orchestra.run.smithi153.stdout: osd pool default size = 2 2023-10-08T15:36:37.559 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-08T15:36:37.559 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd allow primary affinity = true 2023-10-08T15:36:37.559 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd allow pg remap = true 2023-10-08T15:36:37.559 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on legacy crush tunables = false 2023-10-08T15:36:37.559 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on crush straw calc version zero = false 2023-10-08T15:36:37.560 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on no sortbitwise = false 2023-10-08T15:36:37.560 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on osd down out interval zero = false 2023-10-08T15:36:37.560 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on too few osds = false 2023-10-08T15:36:37.560 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-08T15:36:37.560 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-08T15:36:37.560 INFO:teuthology.orchestra.run.smithi153.stdout: mon_allow_pool_size_one = true 2023-10-08T15:36:37.560 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-08T15:36:37.560 INFO:teuthology.orchestra.run.smithi153.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-08T15:36:37.560 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-08T15:36:37.560 INFO:teuthology.orchestra.run.smithi153.stdout: osd default data pool replay window = 5 2023-10-08T15:36:37.560 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-08T15:36:37.560 INFO:teuthology.orchestra.run.smithi153.stdout: mon allow pool delete = true 2023-10-08T15:36:37.561 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-08T15:36:37.561 INFO:teuthology.orchestra.run.smithi153.stdout: mon cluster log file level = debug 2023-10-08T15:36:37.561 INFO:teuthology.orchestra.run.smithi153.stdout: debug asserts on shutdown = true 2023-10-08T15:36:37.561 INFO:teuthology.orchestra.run.smithi153.stdout: mon health detail to clog = false 2023-10-08T15:36:37.561 INFO:teuthology.orchestra.run.smithi153.stdout: mon host = "172.21.15.3,172.21.15.50,[v2:172.21.15.50:3301,v1:172.21.15.50:6790]" 2023-10-08T15:36:37.561 INFO:teuthology.orchestra.run.smithi153.stdout: fsid = 7635972e-cd66-4a8f-a231-378db8b3847a 2023-10-08T15:36:37.561 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-08T15:36:37.561 INFO:teuthology.orchestra.run.smithi153.stdout:[osd] 2023-10-08T15:36:37.561 INFO:teuthology.orchestra.run.smithi153.stdout: osd journal size = 100 2023-10-08T15:36:37.561 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-08T15:36:37.561 INFO:teuthology.orchestra.run.smithi153.stdout: osd scrub load threshold = 5.0 2023-10-08T15:36:37.562 INFO:teuthology.orchestra.run.smithi153.stdout: osd scrub max interval = 600 2023-10-08T15:36:37.562 INFO:teuthology.orchestra.run.smithi153.stdout: osd mclock profile = high_recovery_ops 2023-10-08T15:36:37.562 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-08T15:36:37.562 INFO:teuthology.orchestra.run.smithi153.stdout: osd recover clone overlap = true 2023-10-08T15:36:37.562 INFO:teuthology.orchestra.run.smithi153.stdout: osd recovery max chunk = 1048576 2023-10-08T15:36:37.562 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-08T15:36:37.562 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug shutdown = true 2023-10-08T15:36:37.562 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug op order = true 2023-10-08T15:36:37.562 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug verify stray on activate = true 2023-10-08T15:36:37.562 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-08T15:36:37.562 INFO:teuthology.orchestra.run.smithi153.stdout: osd open classes on start = true 2023-10-08T15:36:37.562 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug pg log writeout = true 2023-10-08T15:36:37.563 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-08T15:36:37.563 INFO:teuthology.orchestra.run.smithi153.stdout: osd deep scrub update digest min age = 30 2023-10-08T15:36:37.563 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-08T15:36:37.563 INFO:teuthology.orchestra.run.smithi153.stdout: osd map max advance = 10 2023-10-08T15:36:37.563 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-08T15:36:37.563 INFO:teuthology.orchestra.run.smithi153.stdout: journal zero on create = true 2023-10-08T15:36:37.563 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-08T15:36:37.563 INFO:teuthology.orchestra.run.smithi153.stdout: filestore ondisk finisher threads = 3 2023-10-08T15:36:37.563 INFO:teuthology.orchestra.run.smithi153.stdout: filestore apply finisher threads = 3 2023-10-08T15:36:37.563 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-08T15:36:37.563 INFO:teuthology.orchestra.run.smithi153.stdout: bdev debug aio = true 2023-10-08T15:36:37.563 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug misdirected ops = true 2023-10-08T15:36:37.564 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore block size = 96636764160 2023-10-08T15:36:37.564 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore compression mode = aggressive 2023-10-08T15:36:37.564 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore fsck on mount = True 2023-10-08T15:36:37.564 INFO:teuthology.orchestra.run.smithi153.stdout: debug bluefs = 20 2023-10-08T15:36:37.564 INFO:teuthology.orchestra.run.smithi153.stdout: debug bluestore = 20 2023-10-08T15:36:37.564 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2023-10-08T15:36:37.564 INFO:teuthology.orchestra.run.smithi153.stdout: debug osd = 20 2023-10-08T15:36:37.564 INFO:teuthology.orchestra.run.smithi153.stdout: debug rocksdb = 10 2023-10-08T15:36:37.564 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd backfillfull_ratio = 0.85 2023-10-08T15:36:37.564 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd full ratio = 0.9 2023-10-08T15:36:37.564 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd nearfull ratio = 0.8 2023-10-08T15:36:37.564 INFO:teuthology.orchestra.run.smithi153.stdout: osd failsafe full ratio = 0.95 2023-10-08T15:36:37.565 INFO:teuthology.orchestra.run.smithi153.stdout: osd objectstore = bluestore 2023-10-08T15:36:37.565 INFO:teuthology.orchestra.run.smithi153.stdout: osd op complaint time = 180 2023-10-08T15:36:37.565 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-08T15:36:37.565 INFO:teuthology.orchestra.run.smithi153.stdout:[mgr] 2023-10-08T15:36:37.565 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2023-10-08T15:36:37.565 INFO:teuthology.orchestra.run.smithi153.stdout: debug mgr = 20 2023-10-08T15:36:37.565 INFO:teuthology.orchestra.run.smithi153.stdout: debug mon = 20 2023-10-08T15:36:37.565 INFO:teuthology.orchestra.run.smithi153.stdout: debug auth = 20 2023-10-08T15:36:37.565 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min pgs per osd = 4 2023-10-08T15:36:37.565 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min bytes per osd = 10 2023-10-08T15:36:37.565 INFO:teuthology.orchestra.run.smithi153.stdout: mgr/telemetry/nag = false 2023-10-08T15:36:37.565 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-08T15:36:37.566 INFO:teuthology.orchestra.run.smithi153.stdout:[mon] 2023-10-08T15:36:37.566 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2023-10-08T15:36:37.566 INFO:teuthology.orchestra.run.smithi153.stdout: debug mon = 20 2023-10-08T15:36:37.566 INFO:teuthology.orchestra.run.smithi153.stdout: debug paxos = 20 2023-10-08T15:36:37.566 INFO:teuthology.orchestra.run.smithi153.stdout: debug auth = 20 2023-10-08T15:36:37.566 INFO:teuthology.orchestra.run.smithi153.stdout: mon data avail warn = 5 2023-10-08T15:36:37.566 INFO:teuthology.orchestra.run.smithi153.stdout: mon mgr mkfs grace = 240 2023-10-08T15:36:37.566 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min pgs per osd = 4 2023-10-08T15:36:37.566 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd reporter subtree level = osd 2023-10-08T15:36:37.566 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd prime pg temp = true 2023-10-08T15:36:37.566 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min bytes per osd = 10 2023-10-08T15:36:37.567 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-08T15:36:37.567 INFO:teuthology.orchestra.run.smithi153.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-08T15:36:37.567 INFO:teuthology.orchestra.run.smithi153.stdout: auth mon ticket ttl = 660 # 11m 2023-10-08T15:36:37.567 INFO:teuthology.orchestra.run.smithi153.stdout: auth service ticket ttl = 240 # 4m 2023-10-08T15:36:37.567 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-08T15:36:37.567 INFO:teuthology.orchestra.run.smithi153.stdout: # don't complain about insecure global_id in the test suite 2023-10-08T15:36:37.567 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-08T15:36:37.567 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-08T15:36:37.567 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-08T15:36:37.567 INFO:teuthology.orchestra.run.smithi153.stdout: # 1m isn't quite enough 2023-10-08T15:36:37.567 INFO:teuthology.orchestra.run.smithi153.stdout: mon_down_mkfs_grace = 2m 2023-10-08T15:36:37.568 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-08T15:36:37.568 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_filestore_osds = false 2023-10-08T15:36:37.568 INFO:teuthology.orchestra.run.smithi153.stdout: mon op complaint time = 120 2023-10-08T15:36:37.568 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-08T15:36:37.568 INFO:teuthology.orchestra.run.smithi153.stdout:[client] 2023-10-08T15:36:37.568 INFO:teuthology.orchestra.run.smithi153.stdout: rgw cache enabled = true 2023-10-08T15:36:37.568 INFO:teuthology.orchestra.run.smithi153.stdout: rgw enable ops log = true 2023-10-08T15:36:37.568 INFO:teuthology.orchestra.run.smithi153.stdout: rgw enable usage log = true 2023-10-08T15:36:37.568 INFO:teuthology.orchestra.run.smithi153.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-08T15:36:37.568 INFO:teuthology.orchestra.run.smithi153.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-08T15:36:37.568 INFO:teuthology.orchestra.run.smithi153.stdout: client mount timeout = 600 2023-10-08T15:36:37.568 INFO:teuthology.orchestra.run.smithi153.stdout: debug client = 20 2023-10-08T15:36:37.569 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2023-10-08T15:36:37.569 INFO:teuthology.orchestra.run.smithi153.stdout: rados mon op timeout = 900 2023-10-08T15:36:37.569 INFO:teuthology.orchestra.run.smithi153.stdout: rados osd op timeout = 900 2023-10-08T15:36:37.569 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.a] 2023-10-08T15:36:37.569 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.b] 2023-10-08T15:36:37.569 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.c] 2023-10-08T15:36:37.569 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.a] 2023-10-08T15:36:37.569 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.b] 2023-10-08T15:36:37.569 INFO:teuthology.orchestra.run.smithi153.stdout:[mds] 2023-10-08T15:36:37.569 INFO:teuthology.orchestra.run.smithi153.stdout: debug mds = 20 2023-10-08T15:36:37.569 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2023-10-08T15:36:37.570 INFO:teuthology.orchestra.run.smithi153.stdout: mds debug frag = True 2023-10-08T15:36:37.570 INFO:teuthology.orchestra.run.smithi153.stdout: mds debug scatterstat = True 2023-10-08T15:36:37.570 INFO:teuthology.orchestra.run.smithi153.stdout: mds op complaint time = 180 2023-10-08T15:36:37.570 INFO:teuthology.orchestra.run.smithi153.stdout: mds verify scatter = True 2023-10-08T15:36:37.570 INFO:teuthology.orchestra.run.smithi153.stdout: osd op complaint time = 180 2023-10-08T15:36:37.570 INFO:teuthology.orchestra.run.smithi153.stdout: rados mon op timeout = 900 2023-10-08T15:36:37.570 INFO:teuthology.orchestra.run.smithi153.stdout: rados osd op timeout = 900 2023-10-08T15:36:37.570 INFO:teuthology.orchestra.run.smithi098.stdout:[global] 2023-10-08T15:36:37.570 INFO:teuthology.orchestra.run.smithi098.stdout: chdir = "" 2023-10-08T15:36:37.570 INFO:teuthology.orchestra.run.smithi098.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-08T15:36:37.570 INFO:teuthology.orchestra.run.smithi098.stdout: auth supported = cephx 2023-10-08T15:36:37.571 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-10-08T15:36:37.571 INFO:teuthology.orchestra.run.smithi098.stdout: filestore xattr use omap = true 2023-10-08T15:36:37.571 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-10-08T15:36:37.571 INFO:teuthology.orchestra.run.smithi098.stdout: mon clock drift allowed = 1.000 2023-10-08T15:36:37.571 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-10-08T15:36:37.571 INFO:teuthology.orchestra.run.smithi098.stdout: osd crush chooseleaf type = 0 2023-10-08T15:36:37.571 INFO:teuthology.orchestra.run.smithi098.stdout: auth debug = true 2023-10-08T15:36:37.571 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-10-08T15:36:37.571 INFO:teuthology.orchestra.run.smithi098.stdout: ms die on old message = true 2023-10-08T15:36:37.571 INFO:teuthology.orchestra.run.smithi098.stdout: ms die on bug = true 2023-10-08T15:36:37.571 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-10-08T15:36:37.572 INFO:teuthology.orchestra.run.smithi098.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-08T15:36:37.572 INFO:teuthology.orchestra.run.smithi098.stdout: mon pg warn max object skew = 0 2023-10-08T15:36:37.572 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-10-08T15:36:37.572 INFO:teuthology.orchestra.run.smithi098.stdout: # disable pg_autoscaler by default for new pools 2023-10-08T15:36:37.572 INFO:teuthology.orchestra.run.smithi098.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-08T15:36:37.572 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-10-08T15:36:37.572 INFO:teuthology.orchestra.run.smithi098.stdout: osd pool default size = 2 2023-10-08T15:36:37.572 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-10-08T15:36:37.572 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd allow primary affinity = true 2023-10-08T15:36:37.572 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd allow pg remap = true 2023-10-08T15:36:37.572 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on legacy crush tunables = false 2023-10-08T15:36:37.572 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on crush straw calc version zero = false 2023-10-08T15:36:37.573 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on no sortbitwise = false 2023-10-08T15:36:37.573 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on osd down out interval zero = false 2023-10-08T15:36:37.573 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on too few osds = false 2023-10-08T15:36:37.573 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-08T15:36:37.573 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-08T15:36:37.573 INFO:teuthology.orchestra.run.smithi098.stdout: mon_allow_pool_size_one = true 2023-10-08T15:36:37.573 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-10-08T15:36:37.573 INFO:teuthology.orchestra.run.smithi098.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-08T15:36:37.573 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-10-08T15:36:37.573 INFO:teuthology.orchestra.run.smithi098.stdout: osd default data pool replay window = 5 2023-10-08T15:36:37.573 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-10-08T15:36:37.574 INFO:teuthology.orchestra.run.smithi098.stdout: mon allow pool delete = true 2023-10-08T15:36:37.574 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-10-08T15:36:37.574 INFO:teuthology.orchestra.run.smithi098.stdout: mon cluster log file level = debug 2023-10-08T15:36:37.574 INFO:teuthology.orchestra.run.smithi098.stdout: debug asserts on shutdown = true 2023-10-08T15:36:37.574 INFO:teuthology.orchestra.run.smithi098.stdout: mon health detail to clog = false 2023-10-08T15:36:37.574 INFO:teuthology.orchestra.run.smithi098.stdout: mon host = "172.21.15.3,172.21.15.50,[v2:172.21.15.50:3301,v1:172.21.15.50:6790]" 2023-10-08T15:36:37.574 INFO:teuthology.orchestra.run.smithi098.stdout: fsid = 7635972e-cd66-4a8f-a231-378db8b3847a 2023-10-08T15:36:37.574 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-10-08T15:36:37.574 INFO:teuthology.orchestra.run.smithi098.stdout:[osd] 2023-10-08T15:36:37.574 INFO:teuthology.orchestra.run.smithi098.stdout: osd journal size = 100 2023-10-08T15:36:37.574 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-10-08T15:36:37.574 INFO:teuthology.orchestra.run.smithi098.stdout: osd scrub load threshold = 5.0 2023-10-08T15:36:37.575 INFO:teuthology.orchestra.run.smithi098.stdout: osd scrub max interval = 600 2023-10-08T15:36:37.575 INFO:teuthology.orchestra.run.smithi098.stdout: osd mclock profile = high_recovery_ops 2023-10-08T15:36:37.575 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-10-08T15:36:37.575 INFO:teuthology.orchestra.run.smithi098.stdout: osd recover clone overlap = true 2023-10-08T15:36:37.575 INFO:teuthology.orchestra.run.smithi098.stdout: osd recovery max chunk = 1048576 2023-10-08T15:36:37.575 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-10-08T15:36:37.575 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug shutdown = true 2023-10-08T15:36:37.575 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug op order = true 2023-10-08T15:36:37.575 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug verify stray on activate = true 2023-10-08T15:36:37.575 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-10-08T15:36:37.575 INFO:teuthology.orchestra.run.smithi098.stdout: osd open classes on start = true 2023-10-08T15:36:37.576 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug pg log writeout = true 2023-10-08T15:36:37.576 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-10-08T15:36:37.576 INFO:teuthology.orchestra.run.smithi098.stdout: osd deep scrub update digest min age = 30 2023-10-08T15:36:37.576 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-10-08T15:36:37.576 INFO:teuthology.orchestra.run.smithi098.stdout: osd map max advance = 10 2023-10-08T15:36:37.576 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-10-08T15:36:37.576 INFO:teuthology.orchestra.run.smithi098.stdout: journal zero on create = true 2023-10-08T15:36:37.576 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-10-08T15:36:37.576 INFO:teuthology.orchestra.run.smithi098.stdout: filestore ondisk finisher threads = 3 2023-10-08T15:36:37.576 INFO:teuthology.orchestra.run.smithi098.stdout: filestore apply finisher threads = 3 2023-10-08T15:36:37.576 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-10-08T15:36:37.576 INFO:teuthology.orchestra.run.smithi098.stdout: bdev debug aio = true 2023-10-08T15:36:37.576 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug misdirected ops = true 2023-10-08T15:36:37.577 INFO:teuthology.orchestra.run.smithi098.stdout: bluestore block size = 96636764160 2023-10-08T15:36:37.577 INFO:teuthology.orchestra.run.smithi098.stdout: bluestore compression mode = aggressive 2023-10-08T15:36:37.577 INFO:teuthology.orchestra.run.smithi098.stdout: bluestore fsck on mount = True 2023-10-08T15:36:37.577 INFO:teuthology.orchestra.run.smithi098.stdout: debug bluefs = 20 2023-10-08T15:36:37.577 INFO:teuthology.orchestra.run.smithi098.stdout: debug bluestore = 20 2023-10-08T15:36:37.577 INFO:teuthology.orchestra.run.smithi098.stdout: debug ms = 1 2023-10-08T15:36:37.577 INFO:teuthology.orchestra.run.smithi098.stdout: debug osd = 20 2023-10-08T15:36:37.577 INFO:teuthology.orchestra.run.smithi098.stdout: debug rocksdb = 10 2023-10-08T15:36:37.577 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd backfillfull_ratio = 0.85 2023-10-08T15:36:37.577 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd full ratio = 0.9 2023-10-08T15:36:37.577 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd nearfull ratio = 0.8 2023-10-08T15:36:37.577 INFO:teuthology.orchestra.run.smithi098.stdout: osd failsafe full ratio = 0.95 2023-10-08T15:36:37.578 INFO:teuthology.orchestra.run.smithi098.stdout: osd objectstore = bluestore 2023-10-08T15:36:37.578 INFO:teuthology.orchestra.run.smithi098.stdout: osd op complaint time = 180 2023-10-08T15:36:37.578 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-10-08T15:36:37.578 INFO:teuthology.orchestra.run.smithi098.stdout:[mgr] 2023-10-08T15:36:37.578 INFO:teuthology.orchestra.run.smithi098.stdout: debug ms = 1 2023-10-08T15:36:37.578 INFO:teuthology.orchestra.run.smithi098.stdout: debug mgr = 20 2023-10-08T15:36:37.578 INFO:teuthology.orchestra.run.smithi098.stdout: debug mon = 20 2023-10-08T15:36:37.578 INFO:teuthology.orchestra.run.smithi098.stdout: debug auth = 20 2023-10-08T15:36:37.578 INFO:teuthology.orchestra.run.smithi098.stdout: mon reweight min pgs per osd = 4 2023-10-08T15:36:37.578 INFO:teuthology.orchestra.run.smithi098.stdout: mon reweight min bytes per osd = 10 2023-10-08T15:36:37.578 INFO:teuthology.orchestra.run.smithi098.stdout: mgr/telemetry/nag = false 2023-10-08T15:36:37.579 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-10-08T15:36:37.579 INFO:teuthology.orchestra.run.smithi098.stdout:[mon] 2023-10-08T15:36:37.579 INFO:teuthology.orchestra.run.smithi098.stdout: debug ms = 1 2023-10-08T15:36:37.579 INFO:teuthology.orchestra.run.smithi098.stdout: debug mon = 20 2023-10-08T15:36:37.579 INFO:teuthology.orchestra.run.smithi098.stdout: debug paxos = 20 2023-10-08T15:36:37.579 INFO:teuthology.orchestra.run.smithi098.stdout: debug auth = 20 2023-10-08T15:36:37.579 INFO:teuthology.orchestra.run.smithi098.stdout: mon data avail warn = 5 2023-10-08T15:36:37.579 INFO:teuthology.orchestra.run.smithi098.stdout: mon mgr mkfs grace = 240 2023-10-08T15:36:37.579 INFO:teuthology.orchestra.run.smithi098.stdout: mon reweight min pgs per osd = 4 2023-10-08T15:36:37.579 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd reporter subtree level = osd 2023-10-08T15:36:37.579 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd prime pg temp = true 2023-10-08T15:36:37.579 INFO:teuthology.orchestra.run.smithi098.stdout: mon reweight min bytes per osd = 10 2023-10-08T15:36:37.580 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-10-08T15:36:37.580 INFO:teuthology.orchestra.run.smithi098.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-08T15:36:37.580 INFO:teuthology.orchestra.run.smithi098.stdout: auth mon ticket ttl = 660 # 11m 2023-10-08T15:36:37.580 INFO:teuthology.orchestra.run.smithi098.stdout: auth service ticket ttl = 240 # 4m 2023-10-08T15:36:37.580 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-10-08T15:36:37.580 INFO:teuthology.orchestra.run.smithi098.stdout: # don't complain about insecure global_id in the test suite 2023-10-08T15:36:37.580 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-08T15:36:37.580 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-08T15:36:37.580 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-10-08T15:36:37.581 INFO:teuthology.orchestra.run.smithi098.stdout: # 1m isn't quite enough 2023-10-08T15:36:37.581 INFO:teuthology.orchestra.run.smithi098.stdout: mon_down_mkfs_grace = 2m 2023-10-08T15:36:37.581 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-10-08T15:36:37.581 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_filestore_osds = false 2023-10-08T15:36:37.581 INFO:teuthology.orchestra.run.smithi098.stdout: mon op complaint time = 120 2023-10-08T15:36:37.581 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-10-08T15:36:37.581 INFO:teuthology.orchestra.run.smithi098.stdout:[client] 2023-10-08T15:36:37.581 INFO:teuthology.orchestra.run.smithi098.stdout: rgw cache enabled = true 2023-10-08T15:36:37.581 INFO:teuthology.orchestra.run.smithi098.stdout: rgw enable ops log = true 2023-10-08T15:36:37.581 INFO:teuthology.orchestra.run.smithi098.stdout: rgw enable usage log = true 2023-10-08T15:36:37.581 INFO:teuthology.orchestra.run.smithi098.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-08T15:36:37.581 INFO:teuthology.orchestra.run.smithi098.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-08T15:36:37.582 INFO:teuthology.orchestra.run.smithi098.stdout: client mount timeout = 600 2023-10-08T15:36:37.582 INFO:teuthology.orchestra.run.smithi098.stdout: debug client = 20 2023-10-08T15:36:37.582 INFO:teuthology.orchestra.run.smithi098.stdout: debug ms = 1 2023-10-08T15:36:37.582 INFO:teuthology.orchestra.run.smithi098.stdout: rados mon op timeout = 900 2023-10-08T15:36:37.582 INFO:teuthology.orchestra.run.smithi098.stdout: rados osd op timeout = 900 2023-10-08T15:36:37.582 INFO:teuthology.orchestra.run.smithi098.stdout:[mon.a] 2023-10-08T15:36:37.582 INFO:teuthology.orchestra.run.smithi098.stdout:[mon.b] 2023-10-08T15:36:37.582 INFO:teuthology.orchestra.run.smithi098.stdout:[mon.c] 2023-10-08T15:36:37.582 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.a] 2023-10-08T15:36:37.582 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.b] 2023-10-08T15:36:37.582 INFO:teuthology.orchestra.run.smithi098.stdout:[mds] 2023-10-08T15:36:37.583 INFO:teuthology.orchestra.run.smithi098.stdout: debug mds = 20 2023-10-08T15:36:37.583 INFO:teuthology.orchestra.run.smithi098.stdout: debug ms = 1 2023-10-08T15:36:37.583 INFO:teuthology.orchestra.run.smithi098.stdout: mds debug frag = True 2023-10-08T15:36:37.583 INFO:teuthology.orchestra.run.smithi098.stdout: mds debug scatterstat = True 2023-10-08T15:36:37.583 INFO:teuthology.orchestra.run.smithi098.stdout: mds op complaint time = 180 2023-10-08T15:36:37.583 INFO:teuthology.orchestra.run.smithi098.stdout: mds verify scatter = True 2023-10-08T15:36:37.583 INFO:teuthology.orchestra.run.smithi098.stdout: osd op complaint time = 180 2023-10-08T15:36:37.583 INFO:teuthology.orchestra.run.smithi098.stdout: rados mon op timeout = 900 2023-10-08T15:36:37.583 INFO:teuthology.orchestra.run.smithi098.stdout: rados osd op timeout = 900 2023-10-08T15:36:37.584 INFO:teuthology.orchestra.run.smithi089.stdout:[global] 2023-10-08T15:36:37.585 INFO:teuthology.orchestra.run.smithi089.stdout: chdir = "" 2023-10-08T15:36:37.585 INFO:teuthology.orchestra.run.smithi089.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-08T15:36:37.585 INFO:teuthology.orchestra.run.smithi089.stdout: auth supported = cephx 2023-10-08T15:36:37.585 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-08T15:36:37.585 INFO:teuthology.orchestra.run.smithi089.stdout: filestore xattr use omap = true 2023-10-08T15:36:37.585 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-08T15:36:37.585 INFO:teuthology.orchestra.run.smithi089.stdout: mon clock drift allowed = 1.000 2023-10-08T15:36:37.585 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-08T15:36:37.585 INFO:teuthology.orchestra.run.smithi089.stdout: osd crush chooseleaf type = 0 2023-10-08T15:36:37.585 INFO:teuthology.orchestra.run.smithi089.stdout: auth debug = true 2023-10-08T15:36:37.585 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-08T15:36:37.586 INFO:teuthology.orchestra.run.smithi089.stdout: ms die on old message = true 2023-10-08T15:36:37.586 INFO:teuthology.orchestra.run.smithi089.stdout: ms die on bug = true 2023-10-08T15:36:37.586 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-08T15:36:37.586 INFO:teuthology.orchestra.run.smithi089.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-08T15:36:37.586 INFO:teuthology.orchestra.run.smithi089.stdout: mon pg warn max object skew = 0 2023-10-08T15:36:37.586 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-08T15:36:37.586 INFO:teuthology.orchestra.run.smithi089.stdout: # disable pg_autoscaler by default for new pools 2023-10-08T15:36:37.586 INFO:teuthology.orchestra.run.smithi089.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-08T15:36:37.586 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-08T15:36:37.586 INFO:teuthology.orchestra.run.smithi089.stdout: osd pool default size = 2 2023-10-08T15:36:37.586 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-08T15:36:37.586 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd allow primary affinity = true 2023-10-08T15:36:37.587 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd allow pg remap = true 2023-10-08T15:36:37.587 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on legacy crush tunables = false 2023-10-08T15:36:37.587 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on crush straw calc version zero = false 2023-10-08T15:36:37.587 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on no sortbitwise = false 2023-10-08T15:36:37.587 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on osd down out interval zero = false 2023-10-08T15:36:37.587 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on too few osds = false 2023-10-08T15:36:37.587 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-08T15:36:37.587 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-08T15:36:37.587 INFO:teuthology.orchestra.run.smithi089.stdout: mon_allow_pool_size_one = true 2023-10-08T15:36:37.587 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-08T15:36:37.587 INFO:teuthology.orchestra.run.smithi089.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-08T15:36:37.588 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-08T15:36:37.588 INFO:teuthology.orchestra.run.smithi089.stdout: osd default data pool replay window = 5 2023-10-08T15:36:37.588 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-08T15:36:37.588 INFO:teuthology.orchestra.run.smithi089.stdout: mon allow pool delete = true 2023-10-08T15:36:37.588 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-08T15:36:37.588 INFO:teuthology.orchestra.run.smithi089.stdout: mon cluster log file level = debug 2023-10-08T15:36:37.588 INFO:teuthology.orchestra.run.smithi089.stdout: debug asserts on shutdown = true 2023-10-08T15:36:37.588 INFO:teuthology.orchestra.run.smithi089.stdout: mon health detail to clog = false 2023-10-08T15:36:37.588 INFO:teuthology.orchestra.run.smithi089.stdout: mon host = "172.21.15.3,172.21.15.50,[v2:172.21.15.50:3301,v1:172.21.15.50:6790]" 2023-10-08T15:36:37.588 INFO:teuthology.orchestra.run.smithi089.stdout: fsid = 7635972e-cd66-4a8f-a231-378db8b3847a 2023-10-08T15:36:37.588 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-08T15:36:37.588 INFO:teuthology.orchestra.run.smithi089.stdout:[osd] 2023-10-08T15:36:37.589 INFO:teuthology.orchestra.run.smithi089.stdout: osd journal size = 100 2023-10-08T15:36:37.589 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-08T15:36:37.589 INFO:teuthology.orchestra.run.smithi089.stdout: osd scrub load threshold = 5.0 2023-10-08T15:36:37.589 INFO:teuthology.orchestra.run.smithi089.stdout: osd scrub max interval = 600 2023-10-08T15:36:37.589 INFO:teuthology.orchestra.run.smithi089.stdout: osd mclock profile = high_recovery_ops 2023-10-08T15:36:37.589 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-08T15:36:37.589 INFO:teuthology.orchestra.run.smithi089.stdout: osd recover clone overlap = true 2023-10-08T15:36:37.589 INFO:teuthology.orchestra.run.smithi089.stdout: osd recovery max chunk = 1048576 2023-10-08T15:36:37.589 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-08T15:36:37.589 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug shutdown = true 2023-10-08T15:36:37.589 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug op order = true 2023-10-08T15:36:37.589 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug verify stray on activate = true 2023-10-08T15:36:37.590 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-08T15:36:37.590 INFO:teuthology.orchestra.run.smithi089.stdout: osd open classes on start = true 2023-10-08T15:36:37.590 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug pg log writeout = true 2023-10-08T15:36:37.590 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-08T15:36:37.590 INFO:teuthology.orchestra.run.smithi089.stdout: osd deep scrub update digest min age = 30 2023-10-08T15:36:37.590 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-08T15:36:37.590 INFO:teuthology.orchestra.run.smithi089.stdout: osd map max advance = 10 2023-10-08T15:36:37.590 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-08T15:36:37.590 INFO:teuthology.orchestra.run.smithi089.stdout: journal zero on create = true 2023-10-08T15:36:37.590 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-08T15:36:37.590 INFO:teuthology.orchestra.run.smithi089.stdout: filestore ondisk finisher threads = 3 2023-10-08T15:36:37.590 INFO:teuthology.orchestra.run.smithi089.stdout: filestore apply finisher threads = 3 2023-10-08T15:36:37.591 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-08T15:36:37.591 INFO:teuthology.orchestra.run.smithi089.stdout: bdev debug aio = true 2023-10-08T15:36:37.591 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug misdirected ops = true 2023-10-08T15:36:37.591 INFO:teuthology.orchestra.run.smithi089.stdout: bluestore block size = 96636764160 2023-10-08T15:36:37.591 INFO:teuthology.orchestra.run.smithi089.stdout: bluestore compression mode = aggressive 2023-10-08T15:36:37.591 INFO:teuthology.orchestra.run.smithi089.stdout: bluestore fsck on mount = True 2023-10-08T15:36:37.591 INFO:teuthology.orchestra.run.smithi089.stdout: debug bluefs = 20 2023-10-08T15:36:37.591 INFO:teuthology.orchestra.run.smithi089.stdout: debug bluestore = 20 2023-10-08T15:36:37.591 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2023-10-08T15:36:37.591 INFO:teuthology.orchestra.run.smithi089.stdout: debug osd = 20 2023-10-08T15:36:37.591 INFO:teuthology.orchestra.run.smithi089.stdout: debug rocksdb = 10 2023-10-08T15:36:37.592 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd backfillfull_ratio = 0.85 2023-10-08T15:36:37.592 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd full ratio = 0.9 2023-10-08T15:36:37.592 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd nearfull ratio = 0.8 2023-10-08T15:36:37.592 INFO:teuthology.orchestra.run.smithi089.stdout: osd failsafe full ratio = 0.95 2023-10-08T15:36:37.592 INFO:teuthology.orchestra.run.smithi089.stdout: osd objectstore = bluestore 2023-10-08T15:36:37.592 INFO:teuthology.orchestra.run.smithi089.stdout: osd op complaint time = 180 2023-10-08T15:36:37.592 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-08T15:36:37.592 INFO:teuthology.orchestra.run.smithi089.stdout:[mgr] 2023-10-08T15:36:37.592 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2023-10-08T15:36:37.592 INFO:teuthology.orchestra.run.smithi089.stdout: debug mgr = 20 2023-10-08T15:36:37.592 INFO:teuthology.orchestra.run.smithi089.stdout: debug mon = 20 2023-10-08T15:36:37.592 INFO:teuthology.orchestra.run.smithi089.stdout: debug auth = 20 2023-10-08T15:36:37.593 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min pgs per osd = 4 2023-10-08T15:36:37.593 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min bytes per osd = 10 2023-10-08T15:36:37.593 INFO:teuthology.orchestra.run.smithi089.stdout: mgr/telemetry/nag = false 2023-10-08T15:36:37.593 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-08T15:36:37.593 INFO:teuthology.orchestra.run.smithi089.stdout:[mon] 2023-10-08T15:36:37.593 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2023-10-08T15:36:37.593 INFO:teuthology.orchestra.run.smithi089.stdout: debug mon = 20 2023-10-08T15:36:37.593 INFO:teuthology.orchestra.run.smithi089.stdout: debug paxos = 20 2023-10-08T15:36:37.593 INFO:teuthology.orchestra.run.smithi089.stdout: debug auth = 20 2023-10-08T15:36:37.593 INFO:teuthology.orchestra.run.smithi089.stdout: mon data avail warn = 5 2023-10-08T15:36:37.593 INFO:teuthology.orchestra.run.smithi089.stdout: mon mgr mkfs grace = 240 2023-10-08T15:36:37.593 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min pgs per osd = 4 2023-10-08T15:36:37.594 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd reporter subtree level = osd 2023-10-08T15:36:37.594 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd prime pg temp = true 2023-10-08T15:36:37.594 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min bytes per osd = 10 2023-10-08T15:36:37.594 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-08T15:36:37.594 INFO:teuthology.orchestra.run.smithi089.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-08T15:36:37.594 INFO:teuthology.orchestra.run.smithi089.stdout: auth mon ticket ttl = 660 # 11m 2023-10-08T15:36:37.594 INFO:teuthology.orchestra.run.smithi089.stdout: auth service ticket ttl = 240 # 4m 2023-10-08T15:36:37.594 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-08T15:36:37.594 INFO:teuthology.orchestra.run.smithi089.stdout: # don't complain about insecure global_id in the test suite 2023-10-08T15:36:37.594 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-08T15:36:37.594 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-08T15:36:37.594 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-08T15:36:37.595 INFO:teuthology.orchestra.run.smithi089.stdout: # 1m isn't quite enough 2023-10-08T15:36:37.595 INFO:teuthology.orchestra.run.smithi089.stdout: mon_down_mkfs_grace = 2m 2023-10-08T15:36:37.595 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-08T15:36:37.595 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_filestore_osds = false 2023-10-08T15:36:37.595 INFO:teuthology.orchestra.run.smithi089.stdout: mon op complaint time = 120 2023-10-08T15:36:37.595 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-08T15:36:37.595 INFO:teuthology.orchestra.run.smithi089.stdout:[client] 2023-10-08T15:36:37.595 INFO:teuthology.orchestra.run.smithi089.stdout: rgw cache enabled = true 2023-10-08T15:36:37.595 INFO:teuthology.orchestra.run.smithi089.stdout: rgw enable ops log = true 2023-10-08T15:36:37.595 INFO:teuthology.orchestra.run.smithi089.stdout: rgw enable usage log = true 2023-10-08T15:36:37.595 INFO:teuthology.orchestra.run.smithi089.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-08T15:36:37.596 INFO:teuthology.orchestra.run.smithi089.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-08T15:36:37.596 INFO:teuthology.orchestra.run.smithi089.stdout: client mount timeout = 600 2023-10-08T15:36:37.596 INFO:teuthology.orchestra.run.smithi089.stdout: debug client = 20 2023-10-08T15:36:37.596 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2023-10-08T15:36:37.596 INFO:teuthology.orchestra.run.smithi089.stdout: rados mon op timeout = 900 2023-10-08T15:36:37.596 INFO:teuthology.orchestra.run.smithi089.stdout: rados osd op timeout = 900 2023-10-08T15:36:37.596 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.a] 2023-10-08T15:36:37.596 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.b] 2023-10-08T15:36:37.596 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.c] 2023-10-08T15:36:37.596 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.a] 2023-10-08T15:36:37.596 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.b] 2023-10-08T15:36:37.596 INFO:teuthology.orchestra.run.smithi089.stdout:[mds] 2023-10-08T15:36:37.596 INFO:teuthology.orchestra.run.smithi089.stdout: debug mds = 20 2023-10-08T15:36:37.597 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2023-10-08T15:36:37.597 INFO:teuthology.orchestra.run.smithi089.stdout: mds debug frag = True 2023-10-08T15:36:37.597 INFO:teuthology.orchestra.run.smithi089.stdout: mds debug scatterstat = True 2023-10-08T15:36:37.597 INFO:teuthology.orchestra.run.smithi089.stdout: mds op complaint time = 180 2023-10-08T15:36:37.597 INFO:teuthology.orchestra.run.smithi089.stdout: mds verify scatter = True 2023-10-08T15:36:37.597 INFO:teuthology.orchestra.run.smithi089.stdout: osd op complaint time = 180 2023-10-08T15:36:37.597 INFO:teuthology.orchestra.run.smithi089.stdout: rados mon op timeout = 900 2023-10-08T15:36:37.597 INFO:teuthology.orchestra.run.smithi089.stdout: rados osd op timeout = 900 2023-10-08T15:36:37.597 INFO:teuthology.orchestra.run.smithi050.stdout:[global] 2023-10-08T15:36:37.597 INFO:teuthology.orchestra.run.smithi050.stdout: chdir = "" 2023-10-08T15:36:37.597 INFO:teuthology.orchestra.run.smithi050.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-08T15:36:37.598 INFO:teuthology.orchestra.run.smithi050.stdout: auth supported = cephx 2023-10-08T15:36:37.598 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-08T15:36:37.598 INFO:teuthology.orchestra.run.smithi050.stdout: filestore xattr use omap = true 2023-10-08T15:36:37.598 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-08T15:36:37.598 INFO:teuthology.orchestra.run.smithi050.stdout: mon clock drift allowed = 1.000 2023-10-08T15:36:37.598 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-08T15:36:37.598 INFO:teuthology.orchestra.run.smithi050.stdout: osd crush chooseleaf type = 0 2023-10-08T15:36:37.598 INFO:teuthology.orchestra.run.smithi050.stdout: auth debug = true 2023-10-08T15:36:37.598 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-08T15:36:37.598 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on old message = true 2023-10-08T15:36:37.598 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on bug = true 2023-10-08T15:36:37.599 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-08T15:36:37.599 INFO:teuthology.orchestra.run.smithi050.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-08T15:36:37.599 INFO:teuthology.orchestra.run.smithi050.stdout: mon pg warn max object skew = 0 2023-10-08T15:36:37.599 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-08T15:36:37.599 INFO:teuthology.orchestra.run.smithi050.stdout: # disable pg_autoscaler by default for new pools 2023-10-08T15:36:37.599 INFO:teuthology.orchestra.run.smithi050.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-08T15:36:37.599 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-08T15:36:37.599 INFO:teuthology.orchestra.run.smithi050.stdout: osd pool default size = 2 2023-10-08T15:36:37.599 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-08T15:36:37.599 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd allow primary affinity = true 2023-10-08T15:36:37.599 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd allow pg remap = true 2023-10-08T15:36:37.599 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on legacy crush tunables = false 2023-10-08T15:36:37.600 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on crush straw calc version zero = false 2023-10-08T15:36:37.600 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on no sortbitwise = false 2023-10-08T15:36:37.600 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on osd down out interval zero = false 2023-10-08T15:36:37.600 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on too few osds = false 2023-10-08T15:36:37.600 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-08T15:36:37.600 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-08T15:36:37.600 INFO:teuthology.orchestra.run.smithi050.stdout: mon_allow_pool_size_one = true 2023-10-08T15:36:37.600 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-08T15:36:37.600 INFO:teuthology.orchestra.run.smithi050.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-08T15:36:37.600 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-08T15:36:37.600 INFO:teuthology.orchestra.run.smithi050.stdout: osd default data pool replay window = 5 2023-10-08T15:36:37.600 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-08T15:36:37.601 INFO:teuthology.orchestra.run.smithi050.stdout: mon allow pool delete = true 2023-10-08T15:36:37.601 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-08T15:36:37.601 INFO:teuthology.orchestra.run.smithi050.stdout: mon cluster log file level = debug 2023-10-08T15:36:37.601 INFO:teuthology.orchestra.run.smithi050.stdout: debug asserts on shutdown = true 2023-10-08T15:36:37.601 INFO:teuthology.orchestra.run.smithi050.stdout: mon health detail to clog = false 2023-10-08T15:36:37.601 INFO:teuthology.orchestra.run.smithi050.stdout: mon host = "172.21.15.3,172.21.15.50,[v2:172.21.15.50:3301,v1:172.21.15.50:6790]" 2023-10-08T15:36:37.601 INFO:teuthology.orchestra.run.smithi050.stdout: fsid = 7635972e-cd66-4a8f-a231-378db8b3847a 2023-10-08T15:36:37.601 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-08T15:36:37.601 INFO:teuthology.orchestra.run.smithi050.stdout:[osd] 2023-10-08T15:36:37.601 INFO:teuthology.orchestra.run.smithi050.stdout: osd journal size = 100 2023-10-08T15:36:37.601 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-08T15:36:37.601 INFO:teuthology.orchestra.run.smithi050.stdout: osd scrub load threshold = 5.0 2023-10-08T15:36:37.602 INFO:teuthology.orchestra.run.smithi050.stdout: osd scrub max interval = 600 2023-10-08T15:36:37.602 INFO:teuthology.orchestra.run.smithi050.stdout: osd mclock profile = high_recovery_ops 2023-10-08T15:36:37.602 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-08T15:36:37.602 INFO:teuthology.orchestra.run.smithi050.stdout: osd recover clone overlap = true 2023-10-08T15:36:37.602 INFO:teuthology.orchestra.run.smithi050.stdout: osd recovery max chunk = 1048576 2023-10-08T15:36:37.602 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-08T15:36:37.602 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug shutdown = true 2023-10-08T15:36:37.602 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug op order = true 2023-10-08T15:36:37.602 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug verify stray on activate = true 2023-10-08T15:36:37.602 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-08T15:36:37.602 INFO:teuthology.orchestra.run.smithi050.stdout: osd open classes on start = true 2023-10-08T15:36:37.602 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug pg log writeout = true 2023-10-08T15:36:37.603 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-08T15:36:37.603 INFO:teuthology.orchestra.run.smithi050.stdout: osd deep scrub update digest min age = 30 2023-10-08T15:36:37.603 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-08T15:36:37.603 INFO:teuthology.orchestra.run.smithi050.stdout: osd map max advance = 10 2023-10-08T15:36:37.603 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-08T15:36:37.603 INFO:teuthology.orchestra.run.smithi050.stdout: journal zero on create = true 2023-10-08T15:36:37.603 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-08T15:36:37.603 INFO:teuthology.orchestra.run.smithi050.stdout: filestore ondisk finisher threads = 3 2023-10-08T15:36:37.603 INFO:teuthology.orchestra.run.smithi050.stdout: filestore apply finisher threads = 3 2023-10-08T15:36:37.603 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-08T15:36:37.603 INFO:teuthology.orchestra.run.smithi050.stdout: bdev debug aio = true 2023-10-08T15:36:37.603 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug misdirected ops = true 2023-10-08T15:36:37.603 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore block size = 96636764160 2023-10-08T15:36:37.604 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore compression mode = aggressive 2023-10-08T15:36:37.604 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore fsck on mount = True 2023-10-08T15:36:37.604 INFO:teuthology.orchestra.run.smithi050.stdout: debug bluefs = 20 2023-10-08T15:36:37.604 INFO:teuthology.orchestra.run.smithi050.stdout: debug bluestore = 20 2023-10-08T15:36:37.604 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2023-10-08T15:36:37.604 INFO:teuthology.orchestra.run.smithi050.stdout: debug osd = 20 2023-10-08T15:36:37.604 INFO:teuthology.orchestra.run.smithi050.stdout: debug rocksdb = 10 2023-10-08T15:36:37.604 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd backfillfull_ratio = 0.85 2023-10-08T15:36:37.604 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd full ratio = 0.9 2023-10-08T15:36:37.604 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd nearfull ratio = 0.8 2023-10-08T15:36:37.604 INFO:teuthology.orchestra.run.smithi050.stdout: osd failsafe full ratio = 0.95 2023-10-08T15:36:37.604 INFO:teuthology.orchestra.run.smithi050.stdout: osd objectstore = bluestore 2023-10-08T15:36:37.605 INFO:teuthology.orchestra.run.smithi050.stdout: osd op complaint time = 180 2023-10-08T15:36:37.605 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-08T15:36:37.605 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr] 2023-10-08T15:36:37.605 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2023-10-08T15:36:37.605 INFO:teuthology.orchestra.run.smithi050.stdout: debug mgr = 20 2023-10-08T15:36:37.605 INFO:teuthology.orchestra.run.smithi050.stdout: debug mon = 20 2023-10-08T15:36:37.605 INFO:teuthology.orchestra.run.smithi050.stdout: debug auth = 20 2023-10-08T15:36:37.605 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min pgs per osd = 4 2023-10-08T15:36:37.605 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min bytes per osd = 10 2023-10-08T15:36:37.605 INFO:teuthology.orchestra.run.smithi050.stdout: mgr/telemetry/nag = false 2023-10-08T15:36:37.605 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-08T15:36:37.605 INFO:teuthology.orchestra.run.smithi050.stdout:[mon] 2023-10-08T15:36:37.606 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2023-10-08T15:36:37.606 INFO:teuthology.orchestra.run.smithi050.stdout: debug mon = 20 2023-10-08T15:36:37.606 INFO:teuthology.orchestra.run.smithi050.stdout: debug paxos = 20 2023-10-08T15:36:37.606 INFO:teuthology.orchestra.run.smithi050.stdout: debug auth = 20 2023-10-08T15:36:37.606 INFO:teuthology.orchestra.run.smithi050.stdout: mon data avail warn = 5 2023-10-08T15:36:37.606 INFO:teuthology.orchestra.run.smithi050.stdout: mon mgr mkfs grace = 240 2023-10-08T15:36:37.606 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min pgs per osd = 4 2023-10-08T15:36:37.606 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd reporter subtree level = osd 2023-10-08T15:36:37.606 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd prime pg temp = true 2023-10-08T15:36:37.606 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min bytes per osd = 10 2023-10-08T15:36:37.606 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-08T15:36:37.606 INFO:teuthology.orchestra.run.smithi050.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-08T15:36:37.607 INFO:teuthology.orchestra.run.smithi050.stdout: auth mon ticket ttl = 660 # 11m 2023-10-08T15:36:37.607 INFO:teuthology.orchestra.run.smithi050.stdout: auth service ticket ttl = 240 # 4m 2023-10-08T15:36:37.607 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-08T15:36:37.607 INFO:teuthology.orchestra.run.smithi050.stdout: # don't complain about insecure global_id in the test suite 2023-10-08T15:36:37.607 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-08T15:36:37.607 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-08T15:36:37.607 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-08T15:36:37.607 INFO:teuthology.orchestra.run.smithi050.stdout: # 1m isn't quite enough 2023-10-08T15:36:37.607 INFO:teuthology.orchestra.run.smithi050.stdout: mon_down_mkfs_grace = 2m 2023-10-08T15:36:37.607 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-08T15:36:37.607 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_filestore_osds = false 2023-10-08T15:36:37.607 INFO:teuthology.orchestra.run.smithi050.stdout: mon op complaint time = 120 2023-10-08T15:36:37.608 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-08T15:36:37.608 INFO:teuthology.orchestra.run.smithi050.stdout:[client] 2023-10-08T15:36:37.608 INFO:teuthology.orchestra.run.smithi050.stdout: rgw cache enabled = true 2023-10-08T15:36:37.608 INFO:teuthology.orchestra.run.smithi050.stdout: rgw enable ops log = true 2023-10-08T15:36:37.608 INFO:teuthology.orchestra.run.smithi050.stdout: rgw enable usage log = true 2023-10-08T15:36:37.608 INFO:teuthology.orchestra.run.smithi050.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-08T15:36:37.608 INFO:teuthology.orchestra.run.smithi050.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-08T15:36:37.608 INFO:teuthology.orchestra.run.smithi050.stdout: client mount timeout = 600 2023-10-08T15:36:37.608 INFO:teuthology.orchestra.run.smithi050.stdout: debug client = 20 2023-10-08T15:36:37.608 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2023-10-08T15:36:37.608 INFO:teuthology.orchestra.run.smithi050.stdout: rados mon op timeout = 900 2023-10-08T15:36:37.608 INFO:teuthology.orchestra.run.smithi050.stdout: rados osd op timeout = 900 2023-10-08T15:36:37.609 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.a] 2023-10-08T15:36:37.609 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.b] 2023-10-08T15:36:37.609 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.c] 2023-10-08T15:36:37.609 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.a] 2023-10-08T15:36:37.609 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.b] 2023-10-08T15:36:37.609 INFO:teuthology.orchestra.run.smithi050.stdout:[mds] 2023-10-08T15:36:37.609 INFO:teuthology.orchestra.run.smithi050.stdout: debug mds = 20 2023-10-08T15:36:37.609 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2023-10-08T15:36:37.609 INFO:teuthology.orchestra.run.smithi050.stdout: mds debug frag = True 2023-10-08T15:36:37.609 INFO:teuthology.orchestra.run.smithi050.stdout: mds debug scatterstat = True 2023-10-08T15:36:37.609 INFO:teuthology.orchestra.run.smithi050.stdout: mds op complaint time = 180 2023-10-08T15:36:37.609 INFO:teuthology.orchestra.run.smithi050.stdout: mds verify scatter = True 2023-10-08T15:36:37.609 INFO:teuthology.orchestra.run.smithi050.stdout: osd op complaint time = 180 2023-10-08T15:36:37.610 INFO:teuthology.orchestra.run.smithi050.stdout: rados mon op timeout = 900 2023-10-08T15:36:37.610 INFO:teuthology.orchestra.run.smithi050.stdout: rados osd op timeout = 900 2023-10-08T15:36:37.611 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-08T15:36:37.611 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-08T15:36:37.659 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-08T15:36:37.659 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-10-08T15:36:37.659 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-08T15:36:37.666 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-10-08T15:36:37.666 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-08T15:36:37.672 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi003.front.sepia.ceph.com 2023-10-08T15:36:37.672 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-10-08T15:36:37.672 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-08T15:36:37.672 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-08T15:36:37.694 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-10-08T15:36:37.694 DEBUG:teuthology.orchestra.run.smithi003:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-08T15:36:37.741 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi050.front.sepia.ceph.com 2023-10-08T15:36:37.741 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-08T15:36:37.741 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-08T15:36:37.741 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-08T15:36:37.767 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-08T15:36:37.768 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-08T15:36:37.773 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi089.front.sepia.ceph.com 2023-10-08T15:36:37.773 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-08T15:36:37.773 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-08T15:36:37.773 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-08T15:36:37.800 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-08T15:36:37.800 DEBUG:teuthology.orchestra.run.smithi089:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-08T15:36:37.847 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi098.front.sepia.ceph.com 2023-10-08T15:36:37.847 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-10-08T15:36:37.847 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-08T15:36:37.847 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-08T15:36:37.874 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-10-08T15:36:37.874 DEBUG:teuthology.orchestra.run.smithi098:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-08T15:36:37.923 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi153.front.sepia.ceph.com 2023-10-08T15:36:37.924 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-10-08T15:36:37.924 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-08T15:36:37.924 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-08T15:36:37.950 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-10-08T15:36:37.950 DEBUG:teuthology.orchestra.run.smithi153:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-08T15:36:37.955 INFO:tasks.ceph:Setting up mon nodes... 2023-10-08T15:36:37.956 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-08T15:36:37.956 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-08T15:36:38.002 INFO:teuthology.orchestra.run.smithi003.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-08T15:36:38.005 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-08T15:36:38.049 INFO:teuthology.orchestra.run.smithi050.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-08T15:36:38.051 INFO:tasks.ceph:Setting up mds nodes... 2023-10-08T15:36:38.051 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-08T15:36:38.097 INFO:teuthology.orchestra.run.smithi003.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-08T15:36:38.100 DEBUG:teuthology.orchestra.run.smithi003:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-08T15:36:38.110 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-08T15:36:38.156 INFO:teuthology.orchestra.run.smithi050.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-08T15:36:38.160 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-08T15:36:38.175 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-08T15:36:38.176 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-08T15:36:38.213 INFO:teuthology.orchestra.run.smithi089.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-08T15:36:38.226 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-08T15:36:38.263 INFO:teuthology.orchestra.run.smithi098.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-08T15:36:38.276 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-10-08T15:36:38.311 INFO:teuthology.orchestra.run.smithi153.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-10-08T15:36:38.323 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-08T15:36:38.323 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi003.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi050.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-08T15:36:38.324 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-08T15:36:38.339 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-08T15:36:38.339 INFO:tasks.ceph:role: osd.0 2023-10-08T15:36:38.339 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi003.front.sepia.ceph.com 2023-10-08T15:36:38.340 DEBUG:teuthology.orchestra.run.smithi003:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-08T15:36:38.859 INFO:teuthology.orchestra.run.smithi003.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T15:36:38.859 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T15:36:38.859 INFO:teuthology.orchestra.run.smithi003.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T15:36:38.859 INFO:teuthology.orchestra.run.smithi003.stdout: = reflink=1 2023-10-08T15:36:38.859 INFO:teuthology.orchestra.run.smithi003.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T15:36:38.859 INFO:teuthology.orchestra.run.smithi003.stdout: = sunit=0 swidth=0 blks 2023-10-08T15:36:38.860 INFO:teuthology.orchestra.run.smithi003.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T15:36:38.860 INFO:teuthology.orchestra.run.smithi003.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T15:36:38.860 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T15:36:38.860 INFO:teuthology.orchestra.run.smithi003.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T15:36:38.861 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi003.front.sepia.ceph.com -o noatime 2023-10-08T15:36:38.861 DEBUG:teuthology.orchestra.run.smithi003:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-08T15:36:38.936 DEBUG:teuthology.orchestra.run.smithi003:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-08T15:36:38.948 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T15:36:38.949 INFO:teuthology.orchestra.run.smithi003.stderr:sudo: /sbin/restorecon: command not found 2023-10-08T15:36:38.949 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-08T15:36:38.960 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-08T15:36:38.961 INFO:tasks.ceph:role: osd.1 2023-10-08T15:36:38.961 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi003.front.sepia.ceph.com 2023-10-08T15:36:38.961 DEBUG:teuthology.orchestra.run.smithi003:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-08T15:36:39.475 INFO:teuthology.orchestra.run.smithi003.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T15:36:39.475 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T15:36:39.475 INFO:teuthology.orchestra.run.smithi003.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T15:36:39.476 INFO:teuthology.orchestra.run.smithi003.stdout: = reflink=1 2023-10-08T15:36:39.476 INFO:teuthology.orchestra.run.smithi003.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T15:36:39.476 INFO:teuthology.orchestra.run.smithi003.stdout: = sunit=0 swidth=0 blks 2023-10-08T15:36:39.476 INFO:teuthology.orchestra.run.smithi003.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T15:36:39.476 INFO:teuthology.orchestra.run.smithi003.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T15:36:39.476 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T15:36:39.476 INFO:teuthology.orchestra.run.smithi003.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T15:36:39.477 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi003.front.sepia.ceph.com -o noatime 2023-10-08T15:36:39.477 DEBUG:teuthology.orchestra.run.smithi003:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-08T15:36:39.545 DEBUG:teuthology.orchestra.run.smithi003:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-08T15:36:39.558 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T15:36:39.558 INFO:teuthology.orchestra.run.smithi003.stderr:sudo: /sbin/restorecon: command not found 2023-10-08T15:36:39.558 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-08T15:36:39.568 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-08T15:36:39.568 INFO:tasks.ceph:role: osd.2 2023-10-08T15:36:39.568 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi003.front.sepia.ceph.com 2023-10-08T15:36:39.568 DEBUG:teuthology.orchestra.run.smithi003:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-08T15:36:40.065 INFO:teuthology.orchestra.run.smithi003.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T15:36:40.065 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T15:36:40.065 INFO:teuthology.orchestra.run.smithi003.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T15:36:40.065 INFO:teuthology.orchestra.run.smithi003.stdout: = reflink=1 2023-10-08T15:36:40.065 INFO:teuthology.orchestra.run.smithi003.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T15:36:40.065 INFO:teuthology.orchestra.run.smithi003.stdout: = sunit=0 swidth=0 blks 2023-10-08T15:36:40.065 INFO:teuthology.orchestra.run.smithi003.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T15:36:40.065 INFO:teuthology.orchestra.run.smithi003.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T15:36:40.066 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T15:36:40.066 INFO:teuthology.orchestra.run.smithi003.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T15:36:40.067 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi003.front.sepia.ceph.com -o noatime 2023-10-08T15:36:40.067 DEBUG:teuthology.orchestra.run.smithi003:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-08T15:36:40.127 DEBUG:teuthology.orchestra.run.smithi003:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-08T15:36:40.139 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T15:36:40.139 INFO:teuthology.orchestra.run.smithi003.stderr:sudo: /sbin/restorecon: command not found 2023-10-08T15:36:40.140 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-08T15:36:40.197 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-08T15:36:40.197 INFO:tasks.ceph:role: osd.3 2023-10-08T15:36:40.197 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi003.front.sepia.ceph.com 2023-10-08T15:36:40.197 DEBUG:teuthology.orchestra.run.smithi003:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-08T15:36:40.700 INFO:teuthology.orchestra.run.smithi003.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T15:36:40.700 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T15:36:40.700 INFO:teuthology.orchestra.run.smithi003.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T15:36:40.700 INFO:teuthology.orchestra.run.smithi003.stdout: = reflink=1 2023-10-08T15:36:40.701 INFO:teuthology.orchestra.run.smithi003.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T15:36:40.701 INFO:teuthology.orchestra.run.smithi003.stdout: = sunit=0 swidth=0 blks 2023-10-08T15:36:40.701 INFO:teuthology.orchestra.run.smithi003.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T15:36:40.701 INFO:teuthology.orchestra.run.smithi003.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T15:36:40.701 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T15:36:40.701 INFO:teuthology.orchestra.run.smithi003.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T15:36:40.703 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi003.front.sepia.ceph.com -o noatime 2023-10-08T15:36:40.703 DEBUG:teuthology.orchestra.run.smithi003:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-08T15:36:40.762 DEBUG:teuthology.orchestra.run.smithi003:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-08T15:36:40.774 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T15:36:40.774 INFO:teuthology.orchestra.run.smithi003.stderr:sudo: /sbin/restorecon: command not found 2023-10-08T15:36:40.775 DEBUG:teuthology.orchestra.run.smithi003:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T15:36:40.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:36:40.840+0000 7fe2bd6243c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-08T15:36:40.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:36:40.840+0000 7fe2bd6243c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-08T15:36:40.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:36:40.840+0000 7fe2bd6243c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-08T15:36:40.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:36:40.840+0000 7fe2bd6243c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-08T15:36:40.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:36:40.840+0000 7fe2bd6243c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-08T15:36:40.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:36:40.840+0000 7fe2bd6243c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-08T15:36:41.662 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:36:41.656+0000 7fe2bd6243c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T15:36:42.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:36:42.436+0000 7fe2bd6243c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T15:36:43.220 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:36:43.216+0000 7fe2bd6243c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T15:36:44.087 DEBUG:teuthology.orchestra.run.smithi003:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-08T15:36:44.100 DEBUG:teuthology.orchestra.run.smithi003:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T15:36:44.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:36:44.132+0000 7f690fe1e3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-08T15:36:44.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:36:44.132+0000 7f690fe1e3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-08T15:36:44.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:36:44.132+0000 7f690fe1e3c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-08T15:36:44.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:36:44.132+0000 7f690fe1e3c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-08T15:36:44.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:36:44.132+0000 7f690fe1e3c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-08T15:36:44.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:36:44.132+0000 7f690fe1e3c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-08T15:36:44.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:36:44.688+0000 7f690fe1e3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T15:36:45.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:36:45.476+0000 7f690fe1e3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T15:36:46.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:36:46.256+0000 7f690fe1e3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T15:36:47.127 DEBUG:teuthology.orchestra.run.smithi003:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-08T15:36:47.187 DEBUG:teuthology.orchestra.run.smithi003:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T15:36:47.224 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:36:47.220+0000 7fdaa04dc3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-08T15:36:47.224 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:36:47.220+0000 7fdaa04dc3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-08T15:36:47.224 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:36:47.220+0000 7fdaa04dc3c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-08T15:36:47.224 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:36:47.220+0000 7fdaa04dc3c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-08T15:36:47.224 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:36:47.220+0000 7fdaa04dc3c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-08T15:36:47.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:36:47.220+0000 7fdaa04dc3c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-08T15:36:47.779 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:36:47.776+0000 7fdaa04dc3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T15:36:48.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:36:48.564+0000 7fdaa04dc3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T15:36:49.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:36:49.348+0000 7fdaa04dc3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T15:36:50.199 DEBUG:teuthology.orchestra.run.smithi003:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-08T15:36:50.214 DEBUG:teuthology.orchestra.run.smithi003:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T15:36:50.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:36:50.288+0000 7f832d6523c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-08T15:36:50.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:36:50.288+0000 7f832d6523c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-08T15:36:50.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:36:50.288+0000 7f832d6523c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-08T15:36:50.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:36:50.288+0000 7f832d6523c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-08T15:36:50.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:36:50.288+0000 7f832d6523c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-08T15:36:50.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:36:50.292+0000 7f832d6523c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-08T15:36:50.867 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:36:50.864+0000 7f832d6523c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T15:36:51.656 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:36:51.652+0000 7f832d6523c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T15:36:52.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:36:52.440+0000 7f832d6523c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T15:36:53.298 DEBUG:teuthology.orchestra.run.smithi003:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-08T15:36:53.315 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-08T15:36:53.331 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-08T15:36:53.331 INFO:tasks.ceph:role: osd.4 2023-10-08T15:36:53.331 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi050.front.sepia.ceph.com 2023-10-08T15:36:53.331 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-08T15:36:53.419 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T15:36:53.419 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T15:36:53.419 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T15:36:53.419 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 2023-10-08T15:36:53.419 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T15:36:53.419 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2023-10-08T15:36:53.419 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T15:36:53.420 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T15:36:53.420 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T15:36:53.420 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T15:36:53.421 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2023-10-08T15:36:53.421 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-08T15:36:53.444 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-08T15:36:53.454 INFO:teuthology.orchestra.run.smithi050.stderr:sudo: /sbin/restorecon: command not found 2023-10-08T15:36:53.455 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T15:36:53.456 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-08T15:36:53.518 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-08T15:36:53.518 INFO:tasks.ceph:role: osd.5 2023-10-08T15:36:53.518 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi050.front.sepia.ceph.com 2023-10-08T15:36:53.518 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-08T15:36:53.559 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T15:36:53.560 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T15:36:53.560 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T15:36:53.560 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 2023-10-08T15:36:53.560 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T15:36:53.560 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2023-10-08T15:36:53.560 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T15:36:53.560 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T15:36:53.560 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T15:36:53.560 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T15:36:53.561 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2023-10-08T15:36:53.562 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-08T15:36:53.623 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-08T15:36:53.632 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T15:36:53.632 INFO:teuthology.orchestra.run.smithi050.stderr:sudo: /sbin/restorecon: command not found 2023-10-08T15:36:53.633 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-08T15:36:53.644 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-08T15:36:53.644 INFO:tasks.ceph:role: osd.6 2023-10-08T15:36:53.644 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi050.front.sepia.ceph.com 2023-10-08T15:36:53.644 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-08T15:36:53.730 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T15:36:53.730 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T15:36:53.731 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T15:36:53.731 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 2023-10-08T15:36:53.731 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T15:36:53.731 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2023-10-08T15:36:53.731 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T15:36:53.731 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T15:36:53.731 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T15:36:53.731 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T15:36:53.732 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2023-10-08T15:36:53.732 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-08T15:36:53.752 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-08T15:36:53.760 INFO:teuthology.orchestra.run.smithi050.stderr:sudo: /sbin/restorecon: command not found 2023-10-08T15:36:53.761 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T15:36:53.761 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-08T15:36:53.772 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-08T15:36:53.772 INFO:tasks.ceph:role: osd.7 2023-10-08T15:36:53.772 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi050.front.sepia.ceph.com 2023-10-08T15:36:53.772 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-08T15:36:53.810 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T15:36:53.811 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T15:36:53.811 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T15:36:53.811 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 2023-10-08T15:36:53.811 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T15:36:53.811 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2023-10-08T15:36:53.811 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T15:36:53.811 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T15:36:53.811 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T15:36:53.811 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T15:36:53.812 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2023-10-08T15:36:53.812 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-08T15:36:53.877 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-08T15:36:53.884 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T15:36:53.884 INFO:teuthology.orchestra.run.smithi050.stderr:sudo: /sbin/restorecon: command not found 2023-10-08T15:36:53.884 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T15:36:53.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:36:53.945+0000 7f4ee47663c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-08T15:36:53.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:36:53.945+0000 7f4ee47663c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-08T15:36:53.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:36:53.945+0000 7f4ee47663c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-08T15:36:53.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:36:53.945+0000 7f4ee47663c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-08T15:36:53.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:36:53.945+0000 7f4ee47663c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-08T15:36:53.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:36:53.945+0000 7f4ee47663c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-08T15:36:54.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:36:54.501+0000 7f4ee47663c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T15:36:55.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:36:55.285+0000 7f4ee47663c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T15:36:56.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:36:56.065+0000 7f4ee47663c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T15:36:56.936 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-08T15:36:56.949 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T15:36:57.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:36:57.029+0000 7f11683af3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-08T15:36:57.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:36:57.029+0000 7f11683af3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-08T15:36:57.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:36:57.029+0000 7f11683af3c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-08T15:36:57.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:36:57.029+0000 7f11683af3c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-08T15:36:57.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:36:57.029+0000 7f11683af3c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-08T15:36:57.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:36:57.029+0000 7f11683af3c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-08T15:36:57.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:36:57.589+0000 7f11683af3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T15:36:58.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:36:58.373+0000 7f11683af3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T15:36:59.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:36:59.161+0000 7f11683af3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T15:37:00.024 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-08T15:37:00.040 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T15:37:00.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:00.073+0000 7f1490b0c3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-08T15:37:00.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:00.073+0000 7f1490b0c3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-08T15:37:00.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:00.073+0000 7f1490b0c3c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-08T15:37:00.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:00.073+0000 7f1490b0c3c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-08T15:37:00.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:00.073+0000 7f1490b0c3c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-08T15:37:00.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:00.073+0000 7f1490b0c3c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-08T15:37:00.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:00.633+0000 7f1490b0c3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T15:37:01.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:01.421+0000 7f1490b0c3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T15:37:02.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:02.201+0000 7f1490b0c3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T15:37:03.051 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-08T15:37:03.067 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T15:37:03.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:03.149+0000 7f74e843d3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-08T15:37:03.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:03.149+0000 7f74e843d3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-08T15:37:03.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:03.149+0000 7f74e843d3c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-08T15:37:03.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:03.149+0000 7f74e843d3c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-08T15:37:03.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:03.149+0000 7f74e843d3c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-08T15:37:03.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:03.149+0000 7f74e843d3c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-08T15:37:03.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:03.705+0000 7f74e843d3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T15:37:04.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:04.485+0000 7f74e843d3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T15:37:05.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:05.273+0000 7f74e843d3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T15:37:06.139 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-08T15:37:06.155 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-08T15:37:06.155 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-10-08T15:37:06.155 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-08T15:37:06.173 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-10-08T15:37:06.173 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-08T15:37:06.230 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-10-08T15:37:06.230 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-08T15:37:06.241 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-10-08T15:37:06.241 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-08T15:37:06.253 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-10-08T15:37:06.253 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-08T15:37:06.314 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-10-08T15:37:06.314 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-08T15:37:06.324 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-08T15:37:06.324 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-08T15:37:06.340 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-08T15:37:06.341 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-08T15:37:06.398 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-08T15:37:06.398 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-08T15:37:06.410 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-08T15:37:06.410 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-08T15:37:06.421 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-08T15:37:06.422 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-08T15:37:06.434 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-08T15:37:06.435 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-08T15:37:06.491 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-08T15:37:06.491 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-08T15:37:06.498 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-10-08T15:37:06.499 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-08T15:37:06.506 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-10-08T15:37:06.506 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-10-08T15:37:06.514 INFO:tasks.ceph:Adding keys to all mons... 2023-10-08T15:37:06.515 DEBUG:teuthology.orchestra.run.smithi003:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-08T15:37:06.517 DEBUG:teuthology.orchestra.run.smithi050:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-08T15:37:06.530 INFO:teuthology.orchestra.run.smithi003.stdout:[mgr.y] 2023-10-08T15:37:06.530 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQCGzCJl8moPABAAjH5iVWRLyeITsMX/nAZoTQ== 2023-10-08T15:37:06.530 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.a] 2023-10-08T15:37:06.530 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQCGzCJlniy3BRAAQseQmhA2EOYYPCLL1hMj/g== 2023-10-08T15:37:06.530 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.0] 2023-10-08T15:37:06.530 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQCIzCJl5cInMhAAIWzN1t0FivwbJgXlK5WXCg== 2023-10-08T15:37:06.530 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.1] 2023-10-08T15:37:06.530 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQCMzCJlZQwWCBAAzzoTedkZwE7oFh4KXjrWZg== 2023-10-08T15:37:06.530 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.2] 2023-10-08T15:37:06.531 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQCPzCJlNZM0DRAAgBBNMGbDp8a6VU+mZCpMvQ== 2023-10-08T15:37:06.531 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.3] 2023-10-08T15:37:06.531 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQCSzCJltf1tERAAzUJYRvgmxgEtp/IkRsxqmg== 2023-10-08T15:37:06.531 INFO:teuthology.orchestra.run.smithi003.stdout:[mgr.x] 2023-10-08T15:37:06.531 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQCGzCJlrnryAhAAe5CNtQTuBHbbPrdMxY2lqA== 2023-10-08T15:37:06.531 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.b] 2023-10-08T15:37:06.531 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQCGzCJl1lNhCRAA/A3Dz/i7z2OM/Mwr00ZSFg== 2023-10-08T15:37:06.531 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.4] 2023-10-08T15:37:06.531 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQCVzCJlJb2bOBAAZ4hEdc2vznsMuAZpBZlj6Q== 2023-10-08T15:37:06.531 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.5] 2023-10-08T15:37:06.531 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQCZzCJlRu4PAhAAgAt508VAQXQwI2L8QyJsag== 2023-10-08T15:37:06.532 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.6] 2023-10-08T15:37:06.532 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQCczCJl+1qsBBAArN1IsbopNLd43wJCb73a/A== 2023-10-08T15:37:06.532 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.7] 2023-10-08T15:37:06.532 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQCfzCJlMwQhCRAAv/YJwsTJz1eOHFJA/34fDQ== 2023-10-08T15:37:06.532 INFO:teuthology.orchestra.run.smithi003.stdout:[client.0] 2023-10-08T15:37:06.532 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQCGzCJlsNS9DBAAAGWd2+fzzFMSRkr2JgMssw== 2023-10-08T15:37:06.532 INFO:teuthology.orchestra.run.smithi003.stdout:[client.1] 2023-10-08T15:37:06.532 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQCGzCJlDRibDxAAgu6Q6umK/yUGAg4R/9Yj+w== 2023-10-08T15:37:06.532 INFO:teuthology.orchestra.run.smithi003.stdout:[client.2] 2023-10-08T15:37:06.532 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQCGzCJlqKuGEhAAUqGYxYztxx87maQJT2LL/g== 2023-10-08T15:37:06.534 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr.y] 2023-10-08T15:37:06.534 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCGzCJl8moPABAAjH5iVWRLyeITsMX/nAZoTQ== 2023-10-08T15:37:06.534 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.a] 2023-10-08T15:37:06.534 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCGzCJlniy3BRAAQseQmhA2EOYYPCLL1hMj/g== 2023-10-08T15:37:06.534 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.0] 2023-10-08T15:37:06.534 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCIzCJl5cInMhAAIWzN1t0FivwbJgXlK5WXCg== 2023-10-08T15:37:06.534 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.1] 2023-10-08T15:37:06.534 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCMzCJlZQwWCBAAzzoTedkZwE7oFh4KXjrWZg== 2023-10-08T15:37:06.535 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.2] 2023-10-08T15:37:06.535 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCPzCJlNZM0DRAAgBBNMGbDp8a6VU+mZCpMvQ== 2023-10-08T15:37:06.535 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.3] 2023-10-08T15:37:06.535 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCSzCJltf1tERAAzUJYRvgmxgEtp/IkRsxqmg== 2023-10-08T15:37:06.535 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr.x] 2023-10-08T15:37:06.535 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCGzCJlrnryAhAAe5CNtQTuBHbbPrdMxY2lqA== 2023-10-08T15:37:06.535 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.b] 2023-10-08T15:37:06.535 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCGzCJl1lNhCRAA/A3Dz/i7z2OM/Mwr00ZSFg== 2023-10-08T15:37:06.535 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.4] 2023-10-08T15:37:06.535 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCVzCJlJb2bOBAAZ4hEdc2vznsMuAZpBZlj6Q== 2023-10-08T15:37:06.535 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.5] 2023-10-08T15:37:06.535 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCZzCJlRu4PAhAAgAt508VAQXQwI2L8QyJsag== 2023-10-08T15:37:06.536 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.6] 2023-10-08T15:37:06.536 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCczCJl+1qsBBAArN1IsbopNLd43wJCb73a/A== 2023-10-08T15:37:06.536 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.7] 2023-10-08T15:37:06.536 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCfzCJlMwQhCRAAv/YJwsTJz1eOHFJA/34fDQ== 2023-10-08T15:37:06.536 INFO:teuthology.orchestra.run.smithi050.stdout:[client.0] 2023-10-08T15:37:06.536 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCGzCJlsNS9DBAAAGWd2+fzzFMSRkr2JgMssw== 2023-10-08T15:37:06.536 INFO:teuthology.orchestra.run.smithi050.stdout:[client.1] 2023-10-08T15:37:06.536 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCGzCJlDRibDxAAgu6Q6umK/yUGAg4R/9Yj+w== 2023-10-08T15:37:06.536 INFO:teuthology.orchestra.run.smithi050.stdout:[client.2] 2023-10-08T15:37:06.536 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCGzCJlqKuGEhAAUqGYxYztxx87maQJT2LL/g== 2023-10-08T15:37:06.537 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-08T15:37:06.580 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-08T15:37:06.610 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:37:06.612 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:37:06.616 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:37:06.618 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:37:06.620 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:37:06.627 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T15:37:06.715 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T15:37:06.765 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T15:37:06.768 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T15:37:06.810 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T15:37:06.812 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T15:37:06.857 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T15:37:06.859 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T15:37:06.943 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T15:37:06.945 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T15:37:06.989 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-08T15:37:06.990 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-08T15:37:07.078 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T15:37:07.080 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T15:37:07.128 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T15:37:07.130 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T15:37:07.174 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T15:37:07.216 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T15:37:07.263 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T15:37:07.265 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T15:37:07.309 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T15:37:07.348 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T15:37:07.397 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T15:37:07.400 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T15:37:07.449 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T15:37:07.451 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T15:37:07.494 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T15:37:07.540 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T15:37:07.586 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-08T15:37:07.586 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-08T15:37:07.602 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-08T15:37:07.655 DEBUG:teuthology.orchestra.run.smithi003:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-08T15:37:07.668 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-08T15:37:07.684 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-08T15:37:07.740 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-08T15:37:07.753 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-08T15:37:07.811 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-08T15:37:07.868 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-08T15:37:07.883 DEBUG:teuthology.orchestra.run.smithi003:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-08T15:37:07.886 DEBUG:teuthology.orchestra.run.smithi050:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-08T15:37:07.890 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-08T15:37:07.891 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-08T15:37:07.891 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-08T15:37:07.893 INFO:tasks.ceph.mon.a:Started 2023-10-08T15:37:07.893 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-08T15:37:07.893 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-08T15:37:07.933 INFO:tasks.ceph.mon.b:Started 2023-10-08T15:37:07.933 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-08T15:37:07.933 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-08T15:37:07.935 INFO:tasks.ceph.mon.c:Started 2023-10-08T15:37:07.935 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-08T15:37:07.936 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-08T15:37:07.936 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-08T15:37:07.938 INFO:tasks.ceph.mgr.y:Started 2023-10-08T15:37:07.939 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-08T15:37:07.939 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-08T15:37:07.941 INFO:tasks.ceph.mgr.x:Started 2023-10-08T15:37:07.942 INFO:tasks.ceph:Setting crush tunables to default 2023-10-08T15:37:07.942 DEBUG:teuthology.orchestra.run.smithi003:> sudo ceph --cluster ceph osd crush tunables default 2023-10-08T15:37:08.052 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.049+0000 7fc98a809700 1 Processor -- start 2023-10-08T15:37:08.052 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.049+0000 7fc98a809700 1 -- start start 2023-10-08T15:37:08.054 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.049+0000 7fc98a809700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc98414ac30 0x7fc98414bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:08.054 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.049+0000 7fc98a809700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc98406d200 0x7fc98406d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:08.054 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.049+0000 7fc98a809700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc98406c7b0 con 0x7fc98414b000 2023-10-08T15:37:08.054 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.049+0000 7fc98a809700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9840a7e60 con 0x7fc98406d200 2023-10-08T15:37:08.054 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.049+0000 7fc98a809700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc98414c490 con 0x7fc98414ac30 2023-10-08T15:37:08.054 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.049+0000 7fc989807700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc98414ac30 0x7fc98414bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:08.054 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.049+0000 7fc989006700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fc98414b000 0x7fc984068390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:55356/0 (socket says 172.21.15.3:55356) 2023-10-08T15:37:08.054 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.049+0000 7fc989807700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc98414ac30 0x7fc98414bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.3:43162/0 (socket says 172.21.15.3:43162) 2023-10-08T15:37:08.055 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.049+0000 7fc989807700 1 -- 172.21.15.3:0/2236150560 learned_addr learned my addr 172.21.15.3:0/2236150560 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:08.055 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.049+0000 7fc98a008700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc98406d200 0x7fc98406d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:08.055 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.049+0000 7fc989807700 1 -- 172.21.15.3:0/2236150560 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc98414ac30 msgr2=0x7fc98414bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-08T15:37:08.055 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.049+0000 7fc989807700 1 -- 172.21.15.3:0/2236150560 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc98414ac30 msgr2=0x7fc98414bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-08T15:37:08.055 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.049+0000 7fc989807700 1 --2- 172.21.15.3:0/2236150560 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc98414ac30 0x7fc98414bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-08T15:37:08.055 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.049+0000 7fc989807700 1 --2- 172.21.15.3:0/2236150560 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc98414ac30 0x7fc98414bf50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T15:37:08.055 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.049+0000 7fc98a008700 1 -- 172.21.15.3:0/2236150560 >> v2:172.21.15.50:3300/0 conn(0x7fc98406d200 msgr2=0x7fc98406d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-08T15:37:08.055 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.049+0000 7fc98a008700 1 -- 172.21.15.3:0/2236150560 >> v2:172.21.15.50:3300/0 conn(0x7fc98406d200 msgr2=0x7fc98406d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-08T15:37:08.055 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.049+0000 7fc98a008700 1 --2- 172.21.15.3:0/2236150560 >> v2:172.21.15.50:3300/0 conn(0x7fc98406d200 0x7fc98406d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-08T15:37:08.055 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.049+0000 7fc98a008700 1 --2- 172.21.15.3:0/2236150560 >> v2:172.21.15.50:3300/0 conn(0x7fc98406d200 0x7fc98406d660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T15:37:08.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.253+0000 7fc989807700 1 --2- 172.21.15.3:0/2236150560 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc98414ac30 0x7fc98414bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:08.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.253+0000 7fc98a008700 1 --2- 172.21.15.3:0/2236150560 >> v2:172.21.15.50:3300/0 conn(0x7fc98406d200 0x7fc98406d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:08.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.253+0000 7fc989807700 1 -- 172.21.15.3:0/2236150560 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc98414ac30 msgr2=0x7fc98414bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-08T15:37:08.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.253+0000 7fc989807700 1 -- 172.21.15.3:0/2236150560 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc98414ac30 msgr2=0x7fc98414bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-08T15:37:08.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.253+0000 7fc989807700 1 --2- 172.21.15.3:0/2236150560 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc98414ac30 0x7fc98414bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-08T15:37:08.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.253+0000 7fc989807700 1 --2- 172.21.15.3:0/2236150560 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc98414ac30 0x7fc98414bf50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T15:37:08.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.253+0000 7fc98a008700 1 -- 172.21.15.3:0/2236150560 >> v2:172.21.15.50:3300/0 conn(0x7fc98406d200 msgr2=0x7fc98406d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-08T15:37:08.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.253+0000 7fc98a008700 1 -- 172.21.15.3:0/2236150560 >> v2:172.21.15.50:3300/0 conn(0x7fc98406d200 msgr2=0x7fc98406d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-08T15:37:08.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.253+0000 7fc98a008700 1 --2- 172.21.15.3:0/2236150560 >> v2:172.21.15.50:3300/0 conn(0x7fc98406d200 0x7fc98406d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-08T15:37:08.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.253+0000 7fc98a008700 1 --2- 172.21.15.3:0/2236150560 >> v2:172.21.15.50:3300/0 conn(0x7fc98406d200 0x7fc98406d660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T15:37:08.261 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.257+0000 7fc988805700 1 -- 172.21.15.3:0/2236150560 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3564554564 0 0) 0x7fc98406c7b0 con 0x7fc98414b000 2023-10-08T15:37:08.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.257+0000 7fc988805700 1 -- 172.21.15.3:0/2236150560 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc970003570 con 0x7fc98414b000 2023-10-08T15:37:08.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.261+0000 7fc988805700 1 -- 172.21.15.3:0/2236150560 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2852801469 0 0) 0x7fc970003570 con 0x7fc98414b000 2023-10-08T15:37:08.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.261+0000 7fc988805700 1 -- 172.21.15.3:0/2236150560 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc98414ac30 msgr2=0x7fc98414bf50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T15:37:08.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.261+0000 7fc988805700 1 --2- 172.21.15.3:0/2236150560 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc98414ac30 0x7fc98414bf50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:08.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.261+0000 7fc988805700 1 -- 172.21.15.3:0/2236150560 >> v2:172.21.15.50:3300/0 conn(0x7fc98406d200 msgr2=0x7fc98406d660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T15:37:08.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.261+0000 7fc988805700 1 --2- 172.21.15.3:0/2236150560 >> v2:172.21.15.50:3300/0 conn(0x7fc98406d200 0x7fc98406d660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:08.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.261+0000 7fc988805700 1 -- 172.21.15.3:0/2236150560 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc98406ca00 con 0x7fc98414b000 2023-10-08T15:37:08.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.261+0000 7fc988805700 1 -- 172.21.15.3:0/2236150560 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2285686191 0 0) 0x7fc978001470 con 0x7fc98414b000 2023-10-08T15:37:08.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.261+0000 7fc988805700 1 -- 172.21.15.3:0/2236150560 >> v1:172.21.15.3:6789/0 conn(0x7fc98414b000 legacy=0x7fc984068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:08.265 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.261+0000 7fc988805700 1 --2- 172.21.15.3:0/2236150560 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc98414ac30 0x7fc970003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:08.265 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.261+0000 7fc988805700 1 --2- 172.21.15.3:0/2236150560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc970004090 0x7fc970004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:08.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.261+0000 7fc988805700 1 --2- 172.21.15.3:0/2236150560 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc970004d50 0x7fc9700051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:08.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.261+0000 7fc988805700 1 -- 172.21.15.3:0/2236150560 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9840a7e60 con 0x7fc970004d50 2023-10-08T15:37:08.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.261+0000 7fc988805700 1 -- 172.21.15.3:0/2236150560 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc98414c490 con 0x7fc970004090 2023-10-08T15:37:08.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.261+0000 7fc988805700 1 -- 172.21.15.3:0/2236150560 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc97000bbf0 con 0x7fc98414ac30 2023-10-08T15:37:08.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.261+0000 7fc989006700 1 --2- 172.21.15.3:0/2236150560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc970004090 0x7fc970004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:08.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.261+0000 7fc98a008700 1 --2- 172.21.15.3:0/2236150560 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc970004d50 0x7fc9700051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:08.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.261+0000 7fc989807700 1 --2- 172.21.15.3:0/2236150560 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc98414ac30 0x7fc970003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:08.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.261+0000 7fc98a008700 1 -- 172.21.15.3:0/2236150560 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc98414ac30 msgr2=0x7fc970003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:08.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.261+0000 7fc98a008700 1 --2- 172.21.15.3:0/2236150560 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc98414ac30 0x7fc970003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:08.267 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.261+0000 7fc98a008700 1 -- 172.21.15.3:0/2236150560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc970004090 msgr2=0x7fc970004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:08.267 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.261+0000 7fc98a008700 1 --2- 172.21.15.3:0/2236150560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc970004090 0x7fc970004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:08.267 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.261+0000 7fc98a008700 1 -- 172.21.15.3:0/2236150560 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc970003570 con 0x7fc970004d50 2023-10-08T15:37:08.267 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.261+0000 7fc98a008700 1 --2- 172.21.15.3:0/2236150560 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc970004d50 0x7fc9700051c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc97c009590 tx=0x7fc97c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=324beb5de363da10 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:08.269 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.265+0000 7fc988805700 1 -- 172.21.15.3:0/2236150560 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97c009a30 con 0x7fc970004d50 2023-10-08T15:37:08.270 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.265+0000 7fc988805700 1 -- 172.21.15.3:0/2236150560 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc97c00f050 con 0x7fc970004d50 2023-10-08T15:37:08.270 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.265+0000 7fc988805700 1 -- 172.21.15.3:0/2236150560 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97c015470 con 0x7fc970004d50 2023-10-08T15:37:08.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.269+0000 7fc98a809700 1 -- 172.21.15.3:0/2236150560 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc970004d50 msgr2=0x7fc9700051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:08.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.269+0000 7fc98a809700 1 --2- 172.21.15.3:0/2236150560 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc970004d50 0x7fc9700051c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc97c009590 tx=0x7fc97c00b040 comp rx=0 tx=0).stop 2023-10-08T15:37:08.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.269+0000 7fc98a008700 1 -- 172.21.15.3:0/2236150560 reap_dead start 2023-10-08T15:37:08.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.269+0000 7fc98a809700 1 -- 172.21.15.3:0/2236150560 shutdown_connections 2023-10-08T15:37:08.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.269+0000 7fc98a809700 1 -- 172.21.15.3:0/2236150560 >> 172.21.15.3:0/2236150560 conn(0x7fc9840c1df0 msgr2=0x7fc9840c21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:08.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.269+0000 7fc98a809700 1 -- 172.21.15.3:0/2236150560 shutdown_connections 2023-10-08T15:37:08.272 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.269+0000 7fc98a809700 1 -- 172.21.15.3:0/2236150560 wait complete. 2023-10-08T15:37:08.274 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.273+0000 7fc98a809700 1 Processor -- start 2023-10-08T15:37:08.274 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.273+0000 7fc98a809700 1 -- start start 2023-10-08T15:37:08.276 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.273+0000 7fc98a809700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc970004d50 0x7fc9840b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:08.276 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.273+0000 7fc98a809700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc9840b7af0 0x7fc98415d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:08.276 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.273+0000 7fc98a809700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc98415d990 0x7fc98414f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:08.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.273+0000 7fc98a809700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc98414f100 con 0x7fc970004d50 2023-10-08T15:37:08.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.273+0000 7fc98a809700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9840b7600 con 0x7fc98415d990 2023-10-08T15:37:08.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.273+0000 7fc98a809700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc98414eab0 con 0x7fc9840b7af0 2023-10-08T15:37:08.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.273+0000 7fc989807700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc970004d50 0x7fc9840b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:08.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.273+0000 7fc989807700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc970004d50 0x7fc9840b70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52328/0 (socket says 172.21.15.3:52328) 2023-10-08T15:37:08.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.273+0000 7fc989807700 1 -- 172.21.15.3:0/4211650901 learned_addr learned my addr 172.21.15.3:0/4211650901 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:08.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.273+0000 7fc98a008700 1 --2- 172.21.15.3:0/4211650901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc98415d990 0x7fc98414f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:08.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.273+0000 7fc989006700 1 --2- 172.21.15.3:0/4211650901 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc9840b7af0 0x7fc98415d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:08.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.273+0000 7fc98a008700 1 -- 172.21.15.3:0/4211650901 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc9840b7af0 msgr2=0x7fc98415d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:08.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.273+0000 7fc98a008700 1 --2- 172.21.15.3:0/4211650901 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc9840b7af0 0x7fc98415d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:08.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.273+0000 7fc98a008700 1 -- 172.21.15.3:0/4211650901 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc970004d50 msgr2=0x7fc9840b70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:08.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.273+0000 7fc98a008700 1 --2- 172.21.15.3:0/4211650901 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc970004d50 0x7fc9840b70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:08.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.273+0000 7fc98a008700 1 -- 172.21.15.3:0/4211650901 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc98414ed90 con 0x7fc98415d990 2023-10-08T15:37:08.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.273+0000 7fc989807700 1 --2- 172.21.15.3:0/4211650901 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc970004d50 0x7fc9840b70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:37:08.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.273+0000 7fc98a008700 1 --2- 172.21.15.3:0/4211650901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc98415d990 0x7fc98414f590 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc97c019000 tx=0x7fc97c01c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:08.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.277+0000 7fc975ffb700 1 -- 172.21.15.3:0/4211650901 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97c007e90 con 0x7fc98415d990 2023-10-08T15:37:08.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.277+0000 7fc975ffb700 1 -- 172.21.15.3:0/4211650901 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc97c01e600 con 0x7fc98415d990 2023-10-08T15:37:08.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.277+0000 7fc975ffb700 1 -- 172.21.15.3:0/4211650901 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97c01e9c0 con 0x7fc98415d990 2023-10-08T15:37:08.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.277+0000 7fc98a809700 1 -- 172.21.15.3:0/4211650901 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc98415de00 con 0x7fc98415d990 2023-10-08T15:37:08.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.277+0000 7fc98a809700 1 -- 172.21.15.3:0/4211650901 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc984152960 con 0x7fc98415d990 2023-10-08T15:37:08.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.277+0000 7fc975ffb700 1 -- 172.21.15.3:0/4211650901 <== mon.1 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fc97c003040 con 0x7fc98415d990 2023-10-08T15:37:08.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.277+0000 7fc975ffb700 1 -- 172.21.15.3:0/4211650901 <== mon.1 v2:172.21.15.50:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fc97c026bb0 con 0x7fc98415d990 2023-10-08T15:37:08.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.277+0000 7fc98a809700 1 -- 172.21.15.3:0/4211650901 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc98406e610 con 0x7fc98415d990 2023-10-08T15:37:08.283 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.281+0000 7fc975ffb700 1 -- 172.21.15.3:0/4211650901 <== mon.1 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fc98406e610 con 0x7fc98415d990 2023-10-08T15:37:08.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.353+0000 7fc98a809700 1 -- 172.21.15.3:0/4211650901 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fc98414f2b0 con 0x7fc98415d990 2023-10-08T15:37:08.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.357+0000 7fc975ffb700 1 -- 172.21.15.3:0/4211650901 <== mon.1 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fc98414f2b0 con 0x7fc98415d990 2023-10-08T15:37:08.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.361+0000 7fc98a809700 1 -- 172.21.15.3:0/4211650901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc98415d990 msgr2=0x7fc98414f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:08.365 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.361+0000 7fc98a809700 1 --2- 172.21.15.3:0/4211650901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc98415d990 0x7fc98414f590 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc97c019000 tx=0x7fc97c01c000 comp rx=0 tx=0).stop 2023-10-08T15:37:08.365 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.361+0000 7fc98a809700 1 -- 172.21.15.3:0/4211650901 shutdown_connections 2023-10-08T15:37:08.365 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.361+0000 7fc98a809700 1 --2- 172.21.15.3:0/4211650901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc98415d990 0x7fc98414f590 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:08.365 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.361+0000 7fc98a809700 1 --2- 172.21.15.3:0/4211650901 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc9840b7af0 0x7fc98415d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:08.365 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.361+0000 7fc98a809700 1 --2- 172.21.15.3:0/4211650901 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc970004d50 0x7fc9840b70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:08.365 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.361+0000 7fc98a809700 1 -- 172.21.15.3:0/4211650901 >> 172.21.15.3:0/4211650901 conn(0x7fc9840c1df0 msgr2=0x7fc984068b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:08.365 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.361+0000 7fc98a809700 1 -- 172.21.15.3:0/4211650901 shutdown_connections 2023-10-08T15:37:08.366 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:08.361+0000 7fc98a809700 1 -- 172.21.15.3:0/4211650901 wait complete. 2023-10-08T15:37:08.366 INFO:teuthology.orchestra.run.smithi003.stderr:adjusted tunables profile to default 2023-10-08T15:37:08.376 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-08T15:37:08.376 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-10-08T15:37:08.376 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-08T15:37:08.386 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-10-08T15:37:08.387 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-08T15:37:08.396 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-10-08T15:37:08.397 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-08T15:37:08.406 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-10-08T15:37:08.406 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-08T15:37:08.417 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-08T15:37:08.417 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-08T15:37:08.433 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-08T15:37:08.433 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-08T15:37:08.445 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-10-08T15:37:08.441+0000 7f1e620e7000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T15:37:08.454 INFO:tasks.ceph.mgr.x.smithi050.stderr:2023-10-08T15:37:08.449+0000 7f0469516000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T15:37:08.468 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-08T15:37:08.468 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-08T15:37:08.525 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-08T15:37:08.525 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-08T15:37:08.541 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd new 64fb1864-bfdd-4d75-9b41-03fb60085dc4 0 2023-10-08T15:37:08.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.641+0000 7f4300a4f700 1 Processor -- start 2023-10-08T15:37:08.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.641+0000 7f4300a4f700 1 -- start start 2023-10-08T15:37:08.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.641+0000 7f4300a4f700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f42fc067280 0x7f42fc06dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:08.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.641+0000 7f4300a4f700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42fc14d150 con 0x7f42fc067650 2023-10-08T15:37:08.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.641+0000 7f4300a4f700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42fc14d430 con 0x7f42fc06e700 2023-10-08T15:37:08.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.641+0000 7f4300a4f700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42fc14d7a0 con 0x7f42fc067280 2023-10-08T15:37:08.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.641+0000 7f42fad9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f42fc067280 0x7f42fc06dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:08.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.641+0000 7f42fb59e700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f42fc06e700 0x7f42fc06eb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51464/0 (socket says 172.21.15.50:51464) 2023-10-08T15:37:08.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.641+0000 7f42fad9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f42fc067280 0x7f42fc06dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60062/0 (socket says 172.21.15.50:60062) 2023-10-08T15:37:08.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.641+0000 7f42fb59e700 1 -- 172.21.15.50:0/2338536378 learned_addr learned my addr 172.21.15.50:0/2338536378 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-08T15:37:08.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.641+0000 7f42fad9d700 1 -- 172.21.15.50:0/2338536378 >> v1:172.21.15.50:6789/0 conn(0x7f42fc06e700 legacy=0x7f42fc06eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:08.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.641+0000 7f42fad9d700 1 -- 172.21.15.50:0/2338536378 >> v1:172.21.15.3:6789/0 conn(0x7f42fc067650 legacy=0x7f42fc14c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:08.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.641+0000 7f42fa59c700 1 -- 172.21.15.50:0/2338536378 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3351635541 0 0) 0x7f42fc14d430 con 0x7f42fc06e700 2023-10-08T15:37:08.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.641+0000 7f42fad9d700 1 -- 172.21.15.50:0/2338536378 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42fc06f290 con 0x7f42fc067280 2023-10-08T15:37:08.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.641+0000 7f42fad9d700 1 --2- 172.21.15.50:0/2338536378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42fc067280 0x7f42fc06dde0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f42ec0098e0 tx=0x7f42ec0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2795ef572ad1600d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:08.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.641+0000 7f42fa59c700 1 -- 172.21.15.50:0/2338536378 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ec009e80 con 0x7f42fc067280 2023-10-08T15:37:08.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.641+0000 7f42fa59c700 1 -- 172.21.15.50:0/2338536378 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42ec00b860 con 0x7f42fc067280 2023-10-08T15:37:08.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.641+0000 7f42fa59c700 1 -- 172.21.15.50:0/2338536378 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ec00bbe0 con 0x7f42fc067280 2023-10-08T15:37:08.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.641+0000 7f4300a4f700 1 -- 172.21.15.50:0/2338536378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42fc067280 msgr2=0x7f42fc06dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:08.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.641+0000 7f4300a4f700 1 --2- 172.21.15.50:0/2338536378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42fc067280 0x7f42fc06dde0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f42ec0098e0 tx=0x7f42ec0091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:08.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.641+0000 7f4300a4f700 1 -- 172.21.15.50:0/2338536378 shutdown_connections 2023-10-08T15:37:08.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.641+0000 7f4300a4f700 1 --2- 172.21.15.50:0/2338536378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42fc067280 0x7f42fc06dde0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:08.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.641+0000 7f4300a4f700 1 -- 172.21.15.50:0/2338536378 >> 172.21.15.50:0/2338536378 conn(0x7f42fc0beb10 msgr2=0x7f42fc0beee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:08.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.641+0000 7f4300a4f700 1 -- 172.21.15.50:0/2338536378 shutdown_connections 2023-10-08T15:37:08.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.641+0000 7f4300a4f700 1 -- 172.21.15.50:0/2338536378 wait complete. 2023-10-08T15:37:08.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.645+0000 7f4300a4f700 1 Processor -- start 2023-10-08T15:37:08.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.645+0000 7f4300a4f700 1 -- start start 2023-10-08T15:37:08.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.645+0000 7f4300a4f700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f42fc067280 0x7f42fc14b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:08.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.645+0000 7f4300a4f700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f42fc067650 0x7f42fc142080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:08.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.645+0000 7f4300a4f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42fc06e700 0x7f42fc159bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:08.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.645+0000 7f4300a4f700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42fc1591c0 con 0x7f42fc067650 2023-10-08T15:37:08.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.645+0000 7f4300a4f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42fc14ced0 con 0x7f42fc06e700 2023-10-08T15:37:08.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.645+0000 7f4300a4f700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42fc159740 con 0x7f42fc067280 2023-10-08T15:37:08.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.645+0000 7f42fad9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f42fc067280 0x7f42fc14b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:08.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.645+0000 7f42fb59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42fc06e700 0x7f42fc159bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:08.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.645+0000 7f42fad9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f42fc067280 0x7f42fc14b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:46082/0 (socket says 172.21.15.50:46082) 2023-10-08T15:37:08.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.645+0000 7f42fad9d700 1 -- 172.21.15.50:0/4157911232 learned_addr learned my addr 172.21.15.50:0/4157911232 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-08T15:37:08.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.645+0000 7f42f259c700 1 --2- 172.21.15.50:0/4157911232 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f42fc067650 0x7f42fc142080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:08.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.645+0000 7f42fad9d700 1 -- 172.21.15.50:0/4157911232 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42fc06e700 msgr2=0x7f42fc159bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:08.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.645+0000 7f42fad9d700 1 --2- 172.21.15.50:0/4157911232 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42fc06e700 0x7f42fc159bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:08.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.645+0000 7f42fad9d700 1 -- 172.21.15.50:0/4157911232 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f42fc067650 msgr2=0x7f42fc142080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:08.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.645+0000 7f42fad9d700 1 --2- 172.21.15.50:0/4157911232 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f42fc067650 0x7f42fc142080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:08.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.645+0000 7f42fad9d700 1 -- 172.21.15.50:0/4157911232 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42ec009420 con 0x7f42fc067280 2023-10-08T15:37:08.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.645+0000 7f42f259c700 1 --2- 172.21.15.50:0/4157911232 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f42fc067650 0x7f42fc142080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:37:08.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.645+0000 7f42fad9d700 1 --2- 172.21.15.50:0/4157911232 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f42fc067280 0x7f42fc14b180 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f42fc0bc5d0 tx=0x7f42ec017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:08.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.645+0000 7f42f37fe700 1 -- 172.21.15.50:0/4157911232 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ec01acf0 con 0x7f42fc067280 2023-10-08T15:37:08.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.645+0000 7f42f37fe700 1 -- 172.21.15.50:0/4157911232 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42ec01ae50 con 0x7f42fc067280 2023-10-08T15:37:08.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.645+0000 7f42f37fe700 1 -- 172.21.15.50:0/4157911232 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ec021720 con 0x7f42fc067280 2023-10-08T15:37:08.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.645+0000 7f4300a4f700 1 -- 172.21.15.50:0/4157911232 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42fc1593d0 con 0x7f42fc067280 2023-10-08T15:37:08.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.645+0000 7f4300a4f700 1 -- 172.21.15.50:0/4157911232 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42fc15a110 con 0x7f42fc067280 2023-10-08T15:37:08.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.645+0000 7f42f37fe700 1 -- 172.21.15.50:0/4157911232 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f42ec021d50 con 0x7f42fc067280 2023-10-08T15:37:08.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.645+0000 7f42f37fe700 1 -- 172.21.15.50:0/4157911232 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f42ec011d10 con 0x7f42fc067280 2023-10-08T15:37:08.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.645+0000 7f4300a4f700 1 -- 172.21.15.50:0/4157911232 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42fc05ecf0 con 0x7f42fc067280 2023-10-08T15:37:08.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.653+0000 7f42f37fe700 1 -- 172.21.15.50:0/4157911232 <== mon.2 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f42ec02f060 con 0x7f42fc067280 2023-10-08T15:37:08.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.729+0000 7f4300a4f700 1 -- 172.21.15.50:0/4157911232 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd new", "uuid": "64fb1864-bfdd-4d75-9b41-03fb60085dc4", "id": 0} v 0) v1 -- 0x7f42fc153e50 con 0x7f42fc067280 2023-10-08T15:37:08.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.737+0000 7f42f37fe700 1 -- 172.21.15.50:0/4157911232 <== mon.2 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "64fb1864-bfdd-4d75-9b41-03fb60085dc4", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f42ec015020 con 0x7f42fc067280 2023-10-08T15:37:08.740 INFO:teuthology.orchestra.run.smithi050.stdout:0 2023-10-08T15:37:08.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.737+0000 7f4300a4f700 1 -- 172.21.15.50:0/4157911232 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f42fc067280 msgr2=0x7f42fc14b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:08.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.737+0000 7f4300a4f700 1 --2- 172.21.15.50:0/4157911232 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f42fc067280 0x7f42fc14b180 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f42fc0bc5d0 tx=0x7f42ec017000 comp rx=0 tx=0).stop 2023-10-08T15:37:08.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.737+0000 7f4300a4f700 1 -- 172.21.15.50:0/4157911232 shutdown_connections 2023-10-08T15:37:08.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.737+0000 7f4300a4f700 1 --2- 172.21.15.50:0/4157911232 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42fc06e700 0x7f42fc159bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:08.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.737+0000 7f4300a4f700 1 --2- 172.21.15.50:0/4157911232 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f42fc067650 0x7f42fc142080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:08.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.737+0000 7f4300a4f700 1 --2- 172.21.15.50:0/4157911232 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f42fc067280 0x7f42fc14b180 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:08.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.737+0000 7f4300a4f700 1 -- 172.21.15.50:0/4157911232 >> 172.21.15.50:0/4157911232 conn(0x7f42fc0beb10 msgr2=0x7f42fc145720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:08.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.737+0000 7f4300a4f700 1 -- 172.21.15.50:0/4157911232 shutdown_connections 2023-10-08T15:37:08.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.737+0000 7f4300a4f700 1 -- 172.21.15.50:0/4157911232 wait complete. 2023-10-08T15:37:08.755 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd new 3ca6bd3a-3e8a-4c65-af9c-46148b0c2047 1 2023-10-08T15:37:08.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.861+0000 7ff0cb59e700 1 Processor -- start 2023-10-08T15:37:08.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.861+0000 7ff0cb59e700 1 -- start start 2023-10-08T15:37:08.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.861+0000 7ff0cb59e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff0cc0a4ce0 0x7ff0cc06bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:08.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.861+0000 7ff0cb59e700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0cc149770 con 0x7ff0cc06bb70 2023-10-08T15:37:08.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.861+0000 7ff0cb59e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0cc06c9b0 con 0x7ff0cc0a31c0 2023-10-08T15:37:08.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.861+0000 7ff0cb59e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0cc0a55b0 con 0x7ff0cc0a4ce0 2023-10-08T15:37:08.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.861+0000 7ff0c9d9b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff0cc0a31c0 0x7ff0cc149c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39756/0 (socket says 172.21.15.50:39756) 2023-10-08T15:37:08.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.861+0000 7ff0c9d9b700 1 -- 172.21.15.50:0/642713923 learned_addr learned my addr 172.21.15.50:0/642713923 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-08T15:37:08.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.861+0000 7ff0cad9d700 1 --2- 172.21.15.50:0/642713923 >> v2:172.21.15.50:3300/0 conn(0x7ff0cc0a4ce0 0x7ff0cc06bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:08.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.861+0000 7ff0c959a700 1 -- 172.21.15.50:0/642713923 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1147456553 0 0) 0x7ff0cc06c9b0 con 0x7ff0cc0a31c0 2023-10-08T15:37:08.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.861+0000 7ff0c959a700 1 -- 172.21.15.50:0/642713923 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0b4003570 con 0x7ff0cc0a31c0 2023-10-08T15:37:08.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.861+0000 7ff0cad9d700 1 -- 172.21.15.50:0/642713923 >> v1:172.21.15.50:6789/0 conn(0x7ff0cc0a31c0 legacy=0x7ff0cc149c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:08.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.861+0000 7ff0cad9d700 1 -- 172.21.15.50:0/642713923 >> v1:172.21.15.3:6789/0 conn(0x7ff0cc06bb70 legacy=0x7ff0cc148c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:08.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.861+0000 7ff0cad9d700 1 -- 172.21.15.50:0/642713923 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0cc0a4470 con 0x7ff0cc0a4ce0 2023-10-08T15:37:08.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.861+0000 7ff0cad9d700 1 --2- 172.21.15.50:0/642713923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0cc0a4ce0 0x7ff0cc06bf40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff0c4009e60 tx=0x7ff0c4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c14f2798e227d25b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:08.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.861+0000 7ff0c959a700 1 -- 172.21.15.50:0/642713923 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c400e070 con 0x7ff0cc0a4ce0 2023-10-08T15:37:08.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.861+0000 7ff0c959a700 1 -- 172.21.15.50:0/642713923 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c400bbf0 con 0x7ff0cc0a4ce0 2023-10-08T15:37:08.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.861+0000 7ff0c959a700 1 -- 172.21.15.50:0/642713923 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c4012430 con 0x7ff0cc0a4ce0 2023-10-08T15:37:08.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.865+0000 7ff0cb59e700 1 -- 172.21.15.50:0/642713923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0cc0a4ce0 msgr2=0x7ff0cc06bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:08.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.865+0000 7ff0cb59e700 1 --2- 172.21.15.50:0/642713923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0cc0a4ce0 0x7ff0cc06bf40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff0c4009e60 tx=0x7ff0c4009780 comp rx=0 tx=0).stop 2023-10-08T15:37:08.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.865+0000 7ff0cb59e700 1 -- 172.21.15.50:0/642713923 shutdown_connections 2023-10-08T15:37:08.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.865+0000 7ff0cb59e700 1 --2- 172.21.15.50:0/642713923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0cc0a4ce0 0x7ff0cc06bf40 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:08.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.865+0000 7ff0cb59e700 1 -- 172.21.15.50:0/642713923 >> 172.21.15.50:0/642713923 conn(0x7ff0cc06f410 msgr2=0x7ff0cc0670e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:08.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.865+0000 7ff0cb59e700 1 -- 172.21.15.50:0/642713923 shutdown_connections 2023-10-08T15:37:08.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.865+0000 7ff0cb59e700 1 -- 172.21.15.50:0/642713923 wait complete. 2023-10-08T15:37:08.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.865+0000 7ff0cb59e700 1 Processor -- start 2023-10-08T15:37:08.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.865+0000 7ff0cb59e700 1 -- start start 2023-10-08T15:37:08.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.865+0000 7ff0cb59e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff0cc06bb70 0x7ff0cc145be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:08.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.865+0000 7ff0cb59e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff0cc0a31c0 0x7ff0cc0697b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:08.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.865+0000 7ff0cb59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0cc0a4ce0 0x7ff0cc14ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:08.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.865+0000 7ff0cb59e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0cc0a4290 con 0x7ff0cc06bb70 2023-10-08T15:37:08.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.865+0000 7ff0cb59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0cc14da70 con 0x7ff0cc0a4ce0 2023-10-08T15:37:08.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.865+0000 7ff0cb59e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0cc14d790 con 0x7ff0cc0a31c0 2023-10-08T15:37:08.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.865+0000 7ff0cad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0cc0a4ce0 0x7ff0cc14ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:08.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.865+0000 7ff0cad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0cc0a4ce0 0x7ff0cc14ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58736/0 (socket says 172.21.15.50:58736) 2023-10-08T15:37:08.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.865+0000 7ff0cad9d700 1 -- 172.21.15.50:0/1145830591 learned_addr learned my addr 172.21.15.50:0/1145830591 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-08T15:37:08.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.865+0000 7ff0c9d9b700 1 --2- 172.21.15.50:0/1145830591 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff0cc0a31c0 0x7ff0cc0697b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:08.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.865+0000 7ff0ca59c700 1 --2- 172.21.15.50:0/1145830591 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff0cc06bb70 0x7ff0cc145be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:08.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.869+0000 7ff0cad9d700 1 -- 172.21.15.50:0/1145830591 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff0cc0a31c0 msgr2=0x7ff0cc0697b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:08.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.869+0000 7ff0cad9d700 1 --2- 172.21.15.50:0/1145830591 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff0cc0a31c0 0x7ff0cc0697b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:08.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.869+0000 7ff0cad9d700 1 -- 172.21.15.50:0/1145830591 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff0cc06bb70 msgr2=0x7ff0cc145be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:08.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.869+0000 7ff0cad9d700 1 --2- 172.21.15.50:0/1145830591 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff0cc06bb70 0x7ff0cc145be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:08.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.869+0000 7ff0cad9d700 1 -- 172.21.15.50:0/1145830591 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c4009a20 con 0x7ff0cc0a4ce0 2023-10-08T15:37:08.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.869+0000 7ff0cad9d700 1 --2- 172.21.15.50:0/1145830591 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0cc0a4ce0 0x7ff0cc14ec20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff0c400b6c0 tx=0x7ff0c4019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:08.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.869+0000 7ff0ba7fc700 1 -- 172.21.15.50:0/1145830591 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c4012e40 con 0x7ff0cc0a4ce0 2023-10-08T15:37:08.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.869+0000 7ff0ba7fc700 1 -- 172.21.15.50:0/1145830591 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c401d630 con 0x7ff0cc0a4ce0 2023-10-08T15:37:08.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.869+0000 7ff0ba7fc700 1 -- 172.21.15.50:0/1145830591 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c401d9f0 con 0x7ff0cc0a4ce0 2023-10-08T15:37:08.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.869+0000 7ff0cb59e700 1 -- 172.21.15.50:0/1145830591 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0cc0b9cb0 con 0x7ff0cc0a4ce0 2023-10-08T15:37:08.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.869+0000 7ff0cb59e700 1 -- 172.21.15.50:0/1145830591 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0cc068eb0 con 0x7ff0cc0a4ce0 2023-10-08T15:37:08.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.869+0000 7ff0ba7fc700 1 -- 172.21.15.50:0/1145830591 <== mon.1 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7ff0c4024070 con 0x7ff0cc0a4ce0 2023-10-08T15:37:08.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.869+0000 7ff0ba7fc700 1 -- 172.21.15.50:0/1145830591 <== mon.1 v2:172.21.15.50:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7ff0c4027af0 con 0x7ff0cc0a4ce0 2023-10-08T15:37:08.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.869+0000 7ff0cb59e700 1 -- 172.21.15.50:0/1145830591 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0cc14d5f0 con 0x7ff0cc0a4ce0 2023-10-08T15:37:08.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.873+0000 7ff0ba7fc700 1 -- 172.21.15.50:0/1145830591 <== mon.1 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7ff0c40476d0 con 0x7ff0cc0a4ce0 2023-10-08T15:37:08.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.945+0000 7ff0cb59e700 1 -- 172.21.15.50:0/1145830591 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3ca6bd3a-3e8a-4c65-af9c-46148b0c2047", "id": 1} v 0) v1 -- 0x7ff0cc05ecf0 con 0x7ff0cc0a4ce0 2023-10-08T15:37:08.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.953+0000 7ff0ba7fc700 1 -- 172.21.15.50:0/1145830591 <== mon.1 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3ca6bd3a-3e8a-4c65-af9c-46148b0c2047", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff0c4036030 con 0x7ff0cc0a4ce0 2023-10-08T15:37:08.957 INFO:teuthology.orchestra.run.smithi050.stdout:1 2023-10-08T15:37:08.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.953+0000 7ff0cb59e700 1 -- 172.21.15.50:0/1145830591 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0cc0a4ce0 msgr2=0x7ff0cc14ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:08.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.953+0000 7ff0cb59e700 1 --2- 172.21.15.50:0/1145830591 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0cc0a4ce0 0x7ff0cc14ec20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff0c400b6c0 tx=0x7ff0c4019000 comp rx=0 tx=0).stop 2023-10-08T15:37:08.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.953+0000 7ff0cb59e700 1 -- 172.21.15.50:0/1145830591 shutdown_connections 2023-10-08T15:37:08.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.953+0000 7ff0cb59e700 1 --2- 172.21.15.50:0/1145830591 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0cc0a4ce0 0x7ff0cc14ec20 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:08.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.953+0000 7ff0cb59e700 1 --2- 172.21.15.50:0/1145830591 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff0cc0a31c0 0x7ff0cc0697b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:08.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.953+0000 7ff0cb59e700 1 --2- 172.21.15.50:0/1145830591 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff0cc06bb70 0x7ff0cc145be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:08.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.953+0000 7ff0cb59e700 1 -- 172.21.15.50:0/1145830591 >> 172.21.15.50:0/1145830591 conn(0x7ff0cc06f410 msgr2=0x7ff0cc0a11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:08.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.953+0000 7ff0cb59e700 1 -- 172.21.15.50:0/1145830591 shutdown_connections 2023-10-08T15:37:08.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:08.953+0000 7ff0cb59e700 1 -- 172.21.15.50:0/1145830591 wait complete. 2023-10-08T15:37:08.975 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd new 6eb9f757-58dd-442f-910d-32401454bce3 2 2023-10-08T15:37:09.072 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-10-08T15:37:09.069+0000 7f1e620e7000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T15:37:09.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.073+0000 7f61b3fff700 1 Processor -- start 2023-10-08T15:37:09.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.073+0000 7f61b3fff700 1 -- start start 2023-10-08T15:37:09.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.073+0000 7f61b3fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f61b406e720 0x7f61b4069680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:09.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.073+0000 7f61b3fff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f61b406eaf0 0x7f61b4148470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:09.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.073+0000 7f61b3fff700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61b4147fe0 con 0x7f61b406cdc0 2023-10-08T15:37:09.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.073+0000 7f61b3fff700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61b406dda0 con 0x7f61b406eaf0 2023-10-08T15:37:09.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.073+0000 7f61b3fff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61b4069bc0 con 0x7f61b406e720 2023-10-08T15:37:09.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.077+0000 7f61b2ffd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f61b406e720 0x7f61b4069680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:09.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.077+0000 7f61b2ffd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f61b406e720 0x7f61b4069680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:43568/0 (socket says 172.21.15.50:43568) 2023-10-08T15:37:09.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.077+0000 7f61b2ffd700 1 -- 172.21.15.50:0/1765710879 learned_addr learned my addr 172.21.15.50:0/1765710879 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-08T15:37:09.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.077+0000 7f61abfff700 1 --2- 172.21.15.50:0/1765710879 >> v2:172.21.15.3:3300/0 conn(0x7f61b406eaf0 0x7f61b4148470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:09.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.077+0000 7f61b2ffd700 1 -- 172.21.15.50:0/1765710879 >> v2:172.21.15.3:3300/0 conn(0x7f61b406eaf0 msgr2=0x7f61b4148470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:09.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.077+0000 7f61b2ffd700 1 --2- 172.21.15.50:0/1765710879 >> v2:172.21.15.3:3300/0 conn(0x7f61b406eaf0 0x7f61b4148470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:09.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.077+0000 7f61b2ffd700 1 -- 172.21.15.50:0/1765710879 >> v1:172.21.15.3:6789/0 conn(0x7f61b406cdc0 legacy=0x7f61b406d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:09.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.077+0000 7f61b2ffd700 1 -- 172.21.15.50:0/1765710879 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b4147990 con 0x7f61b406e720 2023-10-08T15:37:09.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.077+0000 7f61b2ffd700 1 --2- 172.21.15.50:0/1765710879 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f61b406e720 0x7f61b4069680 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f61a40099b0 tx=0x7f61a4009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e97b7d2caec3b5fe server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:09.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.077+0000 7f61b27fc700 1 -- 172.21.15.50:0/1765710879 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a4009ea0 con 0x7f61b406e720 2023-10-08T15:37:09.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.077+0000 7f61b27fc700 1 -- 172.21.15.50:0/1765710879 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a400b860 con 0x7f61b406e720 2023-10-08T15:37:09.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.077+0000 7f61b27fc700 1 -- 172.21.15.50:0/1765710879 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a400bc00 con 0x7f61b406e720 2023-10-08T15:37:09.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.077+0000 7f61b3fff700 1 -- 172.21.15.50:0/1765710879 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f61b406e720 msgr2=0x7f61b4069680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:09.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.077+0000 7f61b3fff700 1 --2- 172.21.15.50:0/1765710879 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f61b406e720 0x7f61b4069680 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f61a40099b0 tx=0x7f61a4009250 comp rx=0 tx=0).stop 2023-10-08T15:37:09.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.077+0000 7f61b3fff700 1 -- 172.21.15.50:0/1765710879 shutdown_connections 2023-10-08T15:37:09.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.077+0000 7f61b3fff700 1 --2- 172.21.15.50:0/1765710879 >> v2:172.21.15.3:3300/0 conn(0x7f61b406eaf0 0x7f61b4148470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:09.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.077+0000 7f61b3fff700 1 --2- 172.21.15.50:0/1765710879 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f61b406e720 0x7f61b4069680 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:09.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.077+0000 7f61b3fff700 1 -- 172.21.15.50:0/1765710879 >> 172.21.15.50:0/1765710879 conn(0x7f61b4067bb0 msgr2=0x7f61b40be200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:09.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.077+0000 7f61b3fff700 1 -- 172.21.15.50:0/1765710879 shutdown_connections 2023-10-08T15:37:09.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.077+0000 7f61b3fff700 1 -- 172.21.15.50:0/1765710879 wait complete. 2023-10-08T15:37:09.085 INFO:tasks.ceph.mgr.x.smithi050.stderr:2023-10-08T15:37:09.077+0000 7f0469516000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T15:37:09.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.077+0000 7f61b3fff700 1 Processor -- start 2023-10-08T15:37:09.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.077+0000 7f61b3fff700 1 -- start start 2023-10-08T15:37:09.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.081+0000 7f61b3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61b406cdc0 0x7f61b40bdda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:09.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.081+0000 7f61b3fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f61b406e720 0x7f61b40b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:09.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.081+0000 7f61b3fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f61b406eaf0 0x7f61b40b3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:09.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.081+0000 7f61b3fff700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b40b5c40 con 0x7f61b406eaf0 2023-10-08T15:37:09.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.081+0000 7f61b3fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b40be2e0 con 0x7f61b406cdc0 2023-10-08T15:37:09.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.081+0000 7f61b3fff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61b40b58d0 con 0x7f61b406e720 2023-10-08T15:37:09.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.081+0000 7f61abfff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f61b406e720 0x7f61b40b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:09.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.081+0000 7f61abfff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f61b406e720 0x7f61b40b60d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:43570/0 (socket says 172.21.15.50:43570) 2023-10-08T15:37:09.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.081+0000 7f61b2ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61b406cdc0 0x7f61b40bdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:09.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.081+0000 7f61abfff700 1 -- 172.21.15.50:0/2164467086 learned_addr learned my addr 172.21.15.50:0/2164467086 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-08T15:37:09.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.081+0000 7f61b37fe700 1 --2- 172.21.15.50:0/2164467086 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f61b406eaf0 0x7f61b40b3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:09.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.081+0000 7f61abfff700 1 -- 172.21.15.50:0/2164467086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61b406cdc0 msgr2=0x7f61b40bdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:09.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.081+0000 7f61abfff700 1 --2- 172.21.15.50:0/2164467086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61b406cdc0 0x7f61b40bdda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:09.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.081+0000 7f61abfff700 1 -- 172.21.15.50:0/2164467086 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f61b406eaf0 msgr2=0x7f61b40b3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:09.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.081+0000 7f61abfff700 1 --2- 172.21.15.50:0/2164467086 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f61b406eaf0 0x7f61b40b3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:09.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.081+0000 7f61abfff700 1 -- 172.21.15.50:0/2164467086 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a40094f0 con 0x7f61b406e720 2023-10-08T15:37:09.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.081+0000 7f61abfff700 1 --2- 172.21.15.50:0/2164467086 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f61b406e720 0x7f61b40b60d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f619c00e930 tx=0x7f619c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:09.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.081+0000 7f61aaffd700 1 -- 172.21.15.50:0/2164467086 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619c013680 con 0x7f61b406e720 2023-10-08T15:37:09.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.081+0000 7f61aaffd700 1 -- 172.21.15.50:0/2164467086 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f619c0137e0 con 0x7f61b406e720 2023-10-08T15:37:09.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.081+0000 7f61b3fff700 1 -- 172.21.15.50:0/2164467086 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61b40b6610 con 0x7f61b406e720 2023-10-08T15:37:09.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.081+0000 7f61aaffd700 1 -- 172.21.15.50:0/2164467086 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619c013b80 con 0x7f61b406e720 2023-10-08T15:37:09.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.081+0000 7f61b3fff700 1 -- 172.21.15.50:0/2164467086 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61b4144400 con 0x7f61b406e720 2023-10-08T15:37:09.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.081+0000 7f61aaffd700 1 -- 172.21.15.50:0/2164467086 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f619c005c80 con 0x7f61b406e720 2023-10-08T15:37:09.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.081+0000 7f61aaffd700 1 -- 172.21.15.50:0/2164467086 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f619c00c3e0 con 0x7f61b406e720 2023-10-08T15:37:09.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.085+0000 7f61b3fff700 1 -- 172.21.15.50:0/2164467086 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61b40b5db0 con 0x7f61b406e720 2023-10-08T15:37:09.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.085+0000 7f61aaffd700 1 -- 172.21.15.50:0/2164467086 <== mon.2 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f619c021060 con 0x7f61b406e720 2023-10-08T15:37:09.130 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-10-08T15:37:09.129+0000 7f1e620e7000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T15:37:09.141 INFO:tasks.ceph.mgr.x.smithi050.stderr:2023-10-08T15:37:09.137+0000 7f0469516000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T15:37:09.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.161+0000 7f61b3fff700 1 -- 172.21.15.50:0/2164467086 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6eb9f757-58dd-442f-910d-32401454bce3", "id": 2} v 0) v1 -- 0x7f61b405ecf0 con 0x7f61b406e720 2023-10-08T15:37:09.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.169+0000 7f61aaffd700 1 -- 172.21.15.50:0/2164467086 <== mon.2 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6eb9f757-58dd-442f-910d-32401454bce3", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f619c017070 con 0x7f61b406e720 2023-10-08T15:37:09.174 INFO:teuthology.orchestra.run.smithi050.stdout:2 2023-10-08T15:37:09.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.169+0000 7f61b3fff700 1 -- 172.21.15.50:0/2164467086 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f61b406e720 msgr2=0x7f61b40b60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:09.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.169+0000 7f61b3fff700 1 --2- 172.21.15.50:0/2164467086 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f61b406e720 0x7f61b40b60d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f619c00e930 tx=0x7f619c0091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:09.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.173+0000 7f61b3fff700 1 -- 172.21.15.50:0/2164467086 shutdown_connections 2023-10-08T15:37:09.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.173+0000 7f61b3fff700 1 --2- 172.21.15.50:0/2164467086 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f61b406eaf0 0x7f61b40b3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:09.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.173+0000 7f61b3fff700 1 --2- 172.21.15.50:0/2164467086 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f61b406e720 0x7f61b40b60d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:09.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.173+0000 7f61b3fff700 1 --2- 172.21.15.50:0/2164467086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61b406cdc0 0x7f61b40bdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:09.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.173+0000 7f61b3fff700 1 -- 172.21.15.50:0/2164467086 >> 172.21.15.50:0/2164467086 conn(0x7f61b4067bb0 msgr2=0x7f61b4068c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:09.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.173+0000 7f61b3fff700 1 -- 172.21.15.50:0/2164467086 shutdown_connections 2023-10-08T15:37:09.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.173+0000 7f61b3fff700 1 -- 172.21.15.50:0/2164467086 wait complete. 2023-10-08T15:37:09.188 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd new 1c39866b-ac2e-4ea9-a69c-02b01ee4191d 3 2023-10-08T15:37:09.249 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-10-08T15:37:09.245+0000 7f1e620e7000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T15:37:09.269 INFO:tasks.ceph.mgr.x.smithi050.stderr:2023-10-08T15:37:09.265+0000 7f0469516000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T15:37:09.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.289+0000 7f9fb3fff700 1 Processor -- start 2023-10-08T15:37:09.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.289+0000 7f9fb3fff700 1 -- start start 2023-10-08T15:37:09.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.289+0000 7f9fb3fff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f9fb406efc0 0x7f9fb414aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:09.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.289+0000 7f9fb3fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9fb414afc0 0x7f9fb40bbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:09.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.289+0000 7f9fb3fff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fb414c690 con 0x7f9fb406be20 2023-10-08T15:37:09.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.289+0000 7f9fb3fff700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fb414c320 con 0x7f9fb406efc0 2023-10-08T15:37:09.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.289+0000 7f9fb3fff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fb414bff0 con 0x7f9fb414afc0 2023-10-08T15:37:09.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.289+0000 7f9fb37fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9fb414afc0 0x7f9fb40bbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:09.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.289+0000 7f9fb2ffd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9fb406be20 0x7f9fb406c1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39770/0 (socket says 172.21.15.50:39770) 2023-10-08T15:37:09.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.289+0000 7f9fb2ffd700 1 -- 172.21.15.50:0/406883758 learned_addr learned my addr 172.21.15.50:0/406883758 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-08T15:37:09.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.289+0000 7f9fb27fc700 1 --2- 172.21.15.50:0/406883758 >> v2:172.21.15.3:3300/0 conn(0x7f9fb406efc0 0x7f9fb414aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:09.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.293+0000 7f9fb37fe700 1 -- 172.21.15.50:0/406883758 >> v2:172.21.15.3:3300/0 conn(0x7f9fb406efc0 msgr2=0x7f9fb414aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:09.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.293+0000 7f9fb37fe700 1 --2- 172.21.15.50:0/406883758 >> v2:172.21.15.3:3300/0 conn(0x7f9fb406efc0 0x7f9fb414aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:09.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.293+0000 7f9fb37fe700 1 -- 172.21.15.50:0/406883758 >> v1:172.21.15.50:6789/0 conn(0x7f9fb406be20 legacy=0x7f9fb406c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:09.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.293+0000 7f9fb1ffb700 1 -- 172.21.15.50:0/406883758 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1740460965 0 0) 0x7f9fb414c690 con 0x7f9fb406be20 2023-10-08T15:37:09.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.293+0000 7f9fb37fe700 1 -- 172.21.15.50:0/406883758 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb414b420 con 0x7f9fb414afc0 2023-10-08T15:37:09.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.293+0000 7f9fb27fc700 1 --2- 172.21.15.50:0/406883758 >> v2:172.21.15.3:3300/0 conn(0x7f9fb406efc0 0x7f9fb414aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:37:09.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.293+0000 7f9fb37fe700 1 --2- 172.21.15.50:0/406883758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fb414afc0 0x7f9fb40bbc40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9fb40bd590 tx=0x7f9fac009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5ecafb69458ec3c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:09.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.293+0000 7f9fb1ffb700 1 -- 172.21.15.50:0/406883758 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fac00e070 con 0x7f9fb414afc0 2023-10-08T15:37:09.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.293+0000 7f9fb1ffb700 1 -- 172.21.15.50:0/406883758 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fac00bc30 con 0x7f9fb414afc0 2023-10-08T15:37:09.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.293+0000 7f9fb1ffb700 1 -- 172.21.15.50:0/406883758 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fac012430 con 0x7f9fb414afc0 2023-10-08T15:37:09.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.293+0000 7f9fb3fff700 1 -- 172.21.15.50:0/406883758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fb414afc0 msgr2=0x7f9fb40bbc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:09.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.293+0000 7f9fb3fff700 1 --2- 172.21.15.50:0/406883758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fb414afc0 0x7f9fb40bbc40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9fb40bd590 tx=0x7f9fac009780 comp rx=0 tx=0).stop 2023-10-08T15:37:09.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.293+0000 7f9fb3fff700 1 -- 172.21.15.50:0/406883758 shutdown_connections 2023-10-08T15:37:09.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.293+0000 7f9fb3fff700 1 --2- 172.21.15.50:0/406883758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fb414afc0 0x7f9fb40bbc40 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:09.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.293+0000 7f9fb3fff700 1 --2- 172.21.15.50:0/406883758 >> v2:172.21.15.3:3300/0 conn(0x7f9fb406efc0 0x7f9fb414aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:09.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.293+0000 7f9fb3fff700 1 -- 172.21.15.50:0/406883758 >> 172.21.15.50:0/406883758 conn(0x7f9fb4067bb0 msgr2=0x7f9fb406e8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:09.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.293+0000 7f9fb3fff700 1 -- 172.21.15.50:0/406883758 shutdown_connections 2023-10-08T15:37:09.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.293+0000 7f9fb3fff700 1 -- 172.21.15.50:0/406883758 wait complete. 2023-10-08T15:37:09.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.297+0000 7f9fb3fff700 1 Processor -- start 2023-10-08T15:37:09.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.297+0000 7f9fb3fff700 1 -- start start 2023-10-08T15:37:09.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.297+0000 7f9fb3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fb406be20 0x7f9fb415b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:09.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.297+0000 7f9fb3fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9fb406efc0 0x7f9fb40693f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:09.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.297+0000 7f9fb3fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9fb414afc0 0x7f9fb4143ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:09.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.297+0000 7f9fb3fff700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb406a2b0 con 0x7f9fb414afc0 2023-10-08T15:37:09.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.297+0000 7f9fb3fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb40c02f0 con 0x7f9fb406be20 2023-10-08T15:37:09.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.297+0000 7f9fb3fff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb40c0870 con 0x7f9fb406efc0 2023-10-08T15:37:09.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.297+0000 7f9fb27fc700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9fb406efc0 0x7f9fb40693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:09.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.297+0000 7f9fb2ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fb406be20 0x7f9fb415b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:09.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.297+0000 7f9fb27fc700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9fb406efc0 0x7f9fb40693f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:43578/0 (socket says 172.21.15.50:43578) 2023-10-08T15:37:09.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.297+0000 7f9fb27fc700 1 -- 172.21.15.50:0/652643062 learned_addr learned my addr 172.21.15.50:0/652643062 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-08T15:37:09.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.297+0000 7f9fb37fe700 1 --2- 172.21.15.50:0/652643062 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9fb414afc0 0x7f9fb4143ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:09.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.297+0000 7f9fb27fc700 1 -- 172.21.15.50:0/652643062 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fb406be20 msgr2=0x7f9fb415b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:09.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.297+0000 7f9fb27fc700 1 --2- 172.21.15.50:0/652643062 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fb406be20 0x7f9fb415b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:09.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.297+0000 7f9fb27fc700 1 -- 172.21.15.50:0/652643062 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9fb414afc0 msgr2=0x7f9fb4143ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:09.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.297+0000 7f9fb27fc700 1 --2- 172.21.15.50:0/652643062 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9fb414afc0 0x7f9fb4143ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:09.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.297+0000 7f9fb27fc700 1 -- 172.21.15.50:0/652643062 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fac009a20 con 0x7f9fb406efc0 2023-10-08T15:37:09.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.297+0000 7f9fb27fc700 1 --2- 172.21.15.50:0/652643062 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9fb406efc0 0x7f9fb40693f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c00e8d0 tx=0x7f9f9c008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:09.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.297+0000 7f9faaffd700 1 -- 172.21.15.50:0/652643062 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c013410 con 0x7f9fb406efc0 2023-10-08T15:37:09.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.297+0000 7f9faaffd700 1 -- 172.21.15.50:0/652643062 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f9c013570 con 0x7f9fb406efc0 2023-10-08T15:37:09.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.297+0000 7f9fb3fff700 1 -- 172.21.15.50:0/652643062 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fb4069930 con 0x7f9fb406efc0 2023-10-08T15:37:09.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.297+0000 7f9faaffd700 1 -- 172.21.15.50:0/652643062 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c013910 con 0x7f9fb406efc0 2023-10-08T15:37:09.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.297+0000 7f9fb3fff700 1 -- 172.21.15.50:0/652643062 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fb41477c0 con 0x7f9fb406efc0 2023-10-08T15:37:09.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.297+0000 7f9faaffd700 1 -- 172.21.15.50:0/652643062 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f9f9c013d00 con 0x7f9fb406efc0 2023-10-08T15:37:09.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.297+0000 7f9faaffd700 1 -- 172.21.15.50:0/652643062 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f9f9c00c3a0 con 0x7f9fb406efc0 2023-10-08T15:37:09.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.301+0000 7f9fb3fff700 1 -- 172.21.15.50:0/652643062 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fb415b940 con 0x7f9fb406efc0 2023-10-08T15:37:09.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.301+0000 7f9faaffd700 1 -- 172.21.15.50:0/652643062 <== mon.2 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f9f9c020060 con 0x7f9fb406efc0 2023-10-08T15:37:09.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.397+0000 7f9fb3fff700 1 -- 172.21.15.50:0/652643062 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1c39866b-ac2e-4ea9-a69c-02b01ee4191d", "id": 3} v 0) v1 -- 0x7f9fb4147a70 con 0x7f9fb406efc0 2023-10-08T15:37:09.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.405+0000 7f9faaffd700 1 -- 172.21.15.50:0/652643062 <== mon.2 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1c39866b-ac2e-4ea9-a69c-02b01ee4191d", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9f9c00f040 con 0x7f9fb406efc0 2023-10-08T15:37:09.410 INFO:teuthology.orchestra.run.smithi050.stdout:3 2023-10-08T15:37:09.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.405+0000 7f9fb3fff700 1 -- 172.21.15.50:0/652643062 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9fb406efc0 msgr2=0x7f9fb40693f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:09.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.405+0000 7f9fb3fff700 1 --2- 172.21.15.50:0/652643062 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9fb406efc0 0x7f9fb40693f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c00e8d0 tx=0x7f9f9c008040 comp rx=0 tx=0).stop 2023-10-08T15:37:09.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.405+0000 7f9fb3fff700 1 -- 172.21.15.50:0/652643062 shutdown_connections 2023-10-08T15:37:09.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.405+0000 7f9fb3fff700 1 --2- 172.21.15.50:0/652643062 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9fb414afc0 0x7f9fb4143ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:09.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.405+0000 7f9fb3fff700 1 --2- 172.21.15.50:0/652643062 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9fb406efc0 0x7f9fb40693f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:09.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.405+0000 7f9fb3fff700 1 --2- 172.21.15.50:0/652643062 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fb406be20 0x7f9fb415b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:09.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.405+0000 7f9fb3fff700 1 -- 172.21.15.50:0/652643062 >> 172.21.15.50:0/652643062 conn(0x7f9fb4067bb0 msgr2=0x7f9fb4149750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:09.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.405+0000 7f9fb3fff700 1 -- 172.21.15.50:0/652643062 shutdown_connections 2023-10-08T15:37:09.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.405+0000 7f9fb3fff700 1 -- 172.21.15.50:0/652643062 wait complete. 2023-10-08T15:37:09.423 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd new 15f86b61-b7f1-4780-ae00-9d80a68cb830 4 2023-10-08T15:37:09.493 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-10-08T15:37:09.485+0000 7f1e620e7000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T15:37:09.527 INFO:tasks.ceph.mgr.x.smithi050.stderr:2023-10-08T15:37:09.525+0000 7f0469516000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T15:37:09.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.525+0000 7f80e4b3f700 1 Processor -- start 2023-10-08T15:37:09.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.529+0000 7f80e4b3f700 1 -- start start 2023-10-08T15:37:09.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.529+0000 7f80e4b3f700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f80e00beb40 0x7f80e00b1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:09.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.529+0000 7f80e4b3f700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f80e006a760 0x7f80e01499c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:09.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.529+0000 7f80e4b3f700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80e0149530 con 0x7f80e006ac70 2023-10-08T15:37:09.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.529+0000 7f80e4b3f700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80e0149290 con 0x7f80e00beb40 2023-10-08T15:37:09.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.529+0000 7f80e4b3f700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80e0068da0 con 0x7f80e006a760 2023-10-08T15:37:09.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.529+0000 7f80deffd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f80e006a760 0x7f80e01499c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:09.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.529+0000 7f80dffff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f80e006ac70 0x7f80e014c810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39774/0 (socket says 172.21.15.50:39774) 2023-10-08T15:37:09.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.529+0000 7f80dffff700 1 -- 172.21.15.50:0/1736794275 learned_addr learned my addr 172.21.15.50:0/1736794275 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-08T15:37:09.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.529+0000 7f80df7fe700 1 --2- 172.21.15.50:0/1736794275 >> v2:172.21.15.3:3300/0 conn(0x7f80e00beb40 0x7f80e00b1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:09.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.529+0000 7f80deffd700 1 -- 172.21.15.50:0/1736794275 >> v2:172.21.15.3:3300/0 conn(0x7f80e00beb40 msgr2=0x7f80e00b1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:09.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.529+0000 7f80deffd700 1 --2- 172.21.15.50:0/1736794275 >> v2:172.21.15.3:3300/0 conn(0x7f80e00beb40 0x7f80e00b1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:09.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.529+0000 7f80de7fc700 1 -- 172.21.15.50:0/1736794275 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 837769712 0 0) 0x7f80e0149530 con 0x7f80e006ac70 2023-10-08T15:37:09.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.529+0000 7f80deffd700 1 -- 172.21.15.50:0/1736794275 >> v1:172.21.15.50:6789/0 conn(0x7f80e006ac70 legacy=0x7f80e014c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:09.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.529+0000 7f80deffd700 1 -- 172.21.15.50:0/1736794275 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e0069b40 con 0x7f80e006a760 2023-10-08T15:37:09.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.529+0000 7f80deffd700 1 --2- 172.21.15.50:0/1736794275 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f80e006a760 0x7f80e01499c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f80d40098e0 tx=0x7f80d40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93e9285c910f6380 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:09.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.529+0000 7f80de7fc700 1 -- 172.21.15.50:0/1736794275 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d4009e80 con 0x7f80e006a760 2023-10-08T15:37:09.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.529+0000 7f80de7fc700 1 -- 172.21.15.50:0/1736794275 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80d400b860 con 0x7f80e006a760 2023-10-08T15:37:09.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.529+0000 7f80de7fc700 1 -- 172.21.15.50:0/1736794275 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d400bbe0 con 0x7f80e006a760 2023-10-08T15:37:09.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.529+0000 7f80e4b3f700 1 -- 172.21.15.50:0/1736794275 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f80e006a760 msgr2=0x7f80e01499c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:09.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.529+0000 7f80e4b3f700 1 --2- 172.21.15.50:0/1736794275 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f80e006a760 0x7f80e01499c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f80d40098e0 tx=0x7f80d40091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:09.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.529+0000 7f80e4b3f700 1 -- 172.21.15.50:0/1736794275 shutdown_connections 2023-10-08T15:37:09.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.529+0000 7f80e4b3f700 1 --2- 172.21.15.50:0/1736794275 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f80e006a760 0x7f80e01499c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:09.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.529+0000 7f80e4b3f700 1 --2- 172.21.15.50:0/1736794275 >> v2:172.21.15.3:3300/0 conn(0x7f80e00beb40 0x7f80e00b1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:09.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.529+0000 7f80e4b3f700 1 -- 172.21.15.50:0/1736794275 >> 172.21.15.50:0/1736794275 conn(0x7f80e0067bb0 msgr2=0x7f80e00be200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:09.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.529+0000 7f80e4b3f700 1 -- 172.21.15.50:0/1736794275 shutdown_connections 2023-10-08T15:37:09.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.529+0000 7f80e4b3f700 1 -- 172.21.15.50:0/1736794275 wait complete. 2023-10-08T15:37:09.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.533+0000 7f80e4b3f700 1 Processor -- start 2023-10-08T15:37:09.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.533+0000 7f80e4b3f700 1 -- start start 2023-10-08T15:37:09.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.533+0000 7f80e4b3f700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f80e006a760 0x7f80e0140b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:09.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.533+0000 7f80e4b3f700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80e006ac70 0x7f80e014a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:09.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.533+0000 7f80e4b3f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80e00beb40 0x7f80e014c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:09.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.533+0000 7f80e4b3f700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e014bd00 con 0x7f80e006ac70 2023-10-08T15:37:09.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.533+0000 7f80e4b3f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e01407e0 con 0x7f80e00beb40 2023-10-08T15:37:09.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.533+0000 7f80e4b3f700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80e015cfb0 con 0x7f80e006a760 2023-10-08T15:37:09.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.533+0000 7f80df7fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f80e006a760 0x7f80e0140b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:09.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.533+0000 7f80df7fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f80e006a760 0x7f80e0140b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:43602/0 (socket says 172.21.15.50:43602) 2023-10-08T15:37:09.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.533+0000 7f80df7fe700 1 -- 172.21.15.50:0/3180526741 learned_addr learned my addr 172.21.15.50:0/3180526741 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-08T15:37:09.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.533+0000 7f80dffff700 1 --2- 172.21.15.50:0/3180526741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80e00beb40 0x7f80e014c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:09.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.533+0000 7f80deffd700 1 --2- 172.21.15.50:0/3180526741 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80e006ac70 0x7f80e014a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:09.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.533+0000 7f80df7fe700 1 -- 172.21.15.50:0/3180526741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80e00beb40 msgr2=0x7f80e014c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:09.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.533+0000 7f80df7fe700 1 --2- 172.21.15.50:0/3180526741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80e00beb40 0x7f80e014c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:09.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.533+0000 7f80df7fe700 1 -- 172.21.15.50:0/3180526741 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80e006ac70 msgr2=0x7f80e014a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:09.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.533+0000 7f80df7fe700 1 --2- 172.21.15.50:0/3180526741 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80e006ac70 0x7f80e014a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:09.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.533+0000 7f80df7fe700 1 -- 172.21.15.50:0/3180526741 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d4009420 con 0x7f80e006a760 2023-10-08T15:37:09.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.533+0000 7f80dffff700 1 --2- 172.21.15.50:0/3180526741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80e00beb40 0x7f80e014c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:37:09.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.533+0000 7f80deffd700 1 --2- 172.21.15.50:0/3180526741 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80e006ac70 0x7f80e014a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:37:09.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.533+0000 7f80df7fe700 1 --2- 172.21.15.50:0/3180526741 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f80e006a760 0x7f80e0140b10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f80d000d890 tx=0x7f80d0008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:09.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.533+0000 7f80c77fe700 1 -- 172.21.15.50:0/3180526741 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d00125f0 con 0x7f80e006a760 2023-10-08T15:37:09.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.533+0000 7f80c77fe700 1 -- 172.21.15.50:0/3180526741 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80d0012750 con 0x7f80e006a760 2023-10-08T15:37:09.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.533+0000 7f80e4b3f700 1 -- 172.21.15.50:0/3180526741 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80e014dfd0 con 0x7f80e006a760 2023-10-08T15:37:09.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.533+0000 7f80c77fe700 1 -- 172.21.15.50:0/3180526741 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d0012ad0 con 0x7f80e006a760 2023-10-08T15:37:09.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.533+0000 7f80e4b3f700 1 -- 172.21.15.50:0/3180526741 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80e014e4c0 con 0x7f80e006a760 2023-10-08T15:37:09.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.533+0000 7f80c77fe700 1 -- 172.21.15.50:0/3180526741 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f80d001e460 con 0x7f80e006a760 2023-10-08T15:37:09.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.533+0000 7f80c77fe700 1 -- 172.21.15.50:0/3180526741 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f80d0012e40 con 0x7f80e006a760 2023-10-08T15:37:09.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.537+0000 7f80e4b3f700 1 -- 172.21.15.50:0/3180526741 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80e014bb60 con 0x7f80e006a760 2023-10-08T15:37:09.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.541+0000 7f80c77fe700 1 -- 172.21.15.50:0/3180526741 <== mon.2 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f80e014bb60 con 0x7f80e006a760 2023-10-08T15:37:09.547 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-10-08T15:37:09.541+0000 7f1e620e7000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T15:37:09.582 INFO:tasks.ceph.mgr.x.smithi050.stderr:2023-10-08T15:37:09.577+0000 7f0469516000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T15:37:09.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.621+0000 7f80e4b3f700 1 -- 172.21.15.50:0/3180526741 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd new", "uuid": "15f86b61-b7f1-4780-ae00-9d80a68cb830", "id": 4} v 0) v1 -- 0x7f80e005ecf0 con 0x7f80e006a760 2023-10-08T15:37:09.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.625+0000 7f80c77fe700 1 -- 172.21.15.50:0/3180526741 <== mon.2 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "15f86b61-b7f1-4780-ae00-9d80a68cb830", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f80d002d0b0 con 0x7f80e006a760 2023-10-08T15:37:09.631 INFO:teuthology.orchestra.run.smithi050.stdout:4 2023-10-08T15:37:09.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.629+0000 7f80e4b3f700 1 -- 172.21.15.50:0/3180526741 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f80e006a760 msgr2=0x7f80e0140b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:09.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.629+0000 7f80e4b3f700 1 --2- 172.21.15.50:0/3180526741 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f80e006a760 0x7f80e0140b10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f80d000d890 tx=0x7f80d0008040 comp rx=0 tx=0).stop 2023-10-08T15:37:09.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.629+0000 7f80e4b3f700 1 -- 172.21.15.50:0/3180526741 shutdown_connections 2023-10-08T15:37:09.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.629+0000 7f80e4b3f700 1 --2- 172.21.15.50:0/3180526741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80e00beb40 0x7f80e014c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:09.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.629+0000 7f80e4b3f700 1 --2- 172.21.15.50:0/3180526741 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80e006ac70 0x7f80e014a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:09.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.629+0000 7f80e4b3f700 1 --2- 172.21.15.50:0/3180526741 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f80e006a760 0x7f80e0140b10 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:09.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.629+0000 7f80e4b3f700 1 -- 172.21.15.50:0/3180526741 >> 172.21.15.50:0/3180526741 conn(0x7f80e0067bb0 msgr2=0x7f80e00b2800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:09.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.629+0000 7f80e4b3f700 1 -- 172.21.15.50:0/3180526741 shutdown_connections 2023-10-08T15:37:09.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.629+0000 7f80e4b3f700 1 -- 172.21.15.50:0/3180526741 wait complete. 2023-10-08T15:37:09.645 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd new 726c3003-34e6-4d5a-b6e2-f911e13c2118 5 2023-10-08T15:37:09.737 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-10-08T15:37:09.733+0000 7f1e620e7000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T15:37:09.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.749+0000 7f85210e2700 1 Processor -- start 2023-10-08T15:37:09.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.749+0000 7f85210e2700 1 -- start start 2023-10-08T15:37:09.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.749+0000 7f85210e2700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f851c0b1dd0 0x7f851c0b21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:09.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.749+0000 7f85210e2700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f851c06f1d0 0x7f851c06d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:09.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.749+0000 7f85210e2700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f851c0b28a0 con 0x7f851c06ec60 2023-10-08T15:37:09.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.749+0000 7f85210e2700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f851c149160 con 0x7f851c0b1dd0 2023-10-08T15:37:09.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.749+0000 7f85210e2700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f851c14c310 con 0x7f851c06f1d0 2023-10-08T15:37:09.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.749+0000 7f851b7fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f851c06f1d0 0x7f851c06d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:09.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.749+0000 7f851bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f851c0b1dd0 0x7f851c0b21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:09.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.749+0000 7f851b7fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f851c06f1d0 0x7f851c06d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:43606/0 (socket says 172.21.15.50:43606) 2023-10-08T15:37:09.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.749+0000 7f851b7fe700 1 -- 172.21.15.50:0/3982124532 learned_addr learned my addr 172.21.15.50:0/3982124532 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-08T15:37:09.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.749+0000 7f85208e1700 1 --1- 172.21.15.50:0/3982124532 >> v1:172.21.15.50:6789/0 conn(0x7f851c06ec60 0x7f851c06dc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39778/0 (socket says 172.21.15.50:39778) 2023-10-08T15:37:09.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.749+0000 7f851affd700 1 -- 172.21.15.50:0/3982124532 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 509203277 0 0) 0x7f851c0b28a0 con 0x7f851c06ec60 2023-10-08T15:37:09.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.749+0000 7f851affd700 1 -- 172.21.15.50:0/3982124532 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8508003570 con 0x7f851c06ec60 2023-10-08T15:37:09.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.749+0000 7f851b7fe700 1 -- 172.21.15.50:0/3982124532 >> v2:172.21.15.50:3300/0 conn(0x7f851c0b1dd0 msgr2=0x7f851c0b21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:09.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.749+0000 7f851b7fe700 1 --2- 172.21.15.50:0/3982124532 >> v2:172.21.15.50:3300/0 conn(0x7f851c0b1dd0 0x7f851c0b21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:09.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.749+0000 7f851b7fe700 1 -- 172.21.15.50:0/3982124532 >> v1:172.21.15.50:6789/0 conn(0x7f851c06ec60 legacy=0x7f851c06dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:09.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.749+0000 7f851b7fe700 1 -- 172.21.15.50:0/3982124532 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f851c0a2d40 con 0x7f851c06f1d0 2023-10-08T15:37:09.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.749+0000 7f851bfff700 1 --2- 172.21.15.50:0/3982124532 >> v2:172.21.15.50:3300/0 conn(0x7f851c0b1dd0 0x7f851c0b21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:37:09.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.749+0000 7f851b7fe700 1 --2- 172.21.15.50:0/3982124532 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f851c06f1d0 0x7f851c06d6d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f85040099b0 tx=0x7f8504009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42b58b21aeada735 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:09.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.749+0000 7f851affd700 1 -- 172.21.15.50:0/3982124532 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8504009ea0 con 0x7f851c06f1d0 2023-10-08T15:37:09.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.753+0000 7f851affd700 1 -- 172.21.15.50:0/3982124532 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f850400b860 con 0x7f851c06f1d0 2023-10-08T15:37:09.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.753+0000 7f851affd700 1 -- 172.21.15.50:0/3982124532 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850400bbe0 con 0x7f851c06f1d0 2023-10-08T15:37:09.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.753+0000 7f85210e2700 1 -- 172.21.15.50:0/3982124532 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f851c06f1d0 msgr2=0x7f851c06d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:09.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.753+0000 7f85210e2700 1 --2- 172.21.15.50:0/3982124532 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f851c06f1d0 0x7f851c06d6d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f85040099b0 tx=0x7f8504009250 comp rx=0 tx=0).stop 2023-10-08T15:37:09.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.753+0000 7f85210e2700 1 -- 172.21.15.50:0/3982124532 shutdown_connections 2023-10-08T15:37:09.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.753+0000 7f85210e2700 1 --2- 172.21.15.50:0/3982124532 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f851c06f1d0 0x7f851c06d6d0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:09.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.753+0000 7f85210e2700 1 --2- 172.21.15.50:0/3982124532 >> v2:172.21.15.50:3300/0 conn(0x7f851c0b1dd0 0x7f851c0b21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:09.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.753+0000 7f85210e2700 1 -- 172.21.15.50:0/3982124532 >> 172.21.15.50:0/3982124532 conn(0x7f851c0beb10 msgr2=0x7f851c0beee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:09.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.753+0000 7f85210e2700 1 -- 172.21.15.50:0/3982124532 shutdown_connections 2023-10-08T15:37:09.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.753+0000 7f85210e2700 1 -- 172.21.15.50:0/3982124532 wait complete. 2023-10-08T15:37:09.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.753+0000 7f85210e2700 1 Processor -- start 2023-10-08T15:37:09.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.753+0000 7f85210e2700 1 -- start start 2023-10-08T15:37:09.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.753+0000 7f85210e2700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f851c06ec60 0x7f851c0b51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:09.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.753+0000 7f85210e2700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f851c06f1d0 0x7f851c14aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:09.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.753+0000 7f85210e2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f851c0b1dd0 0x7f851c156ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:09.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.753+0000 7f85210e2700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f851c0b5fa0 con 0x7f851c06f1d0 2023-10-08T15:37:09.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.753+0000 7f85210e2700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f851c0b6560 con 0x7f851c0b1dd0 2023-10-08T15:37:09.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.753+0000 7f85210e2700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f851c14afc0 con 0x7f851c06ec60 2023-10-08T15:37:09.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.753+0000 7f85208e1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f851c0b1dd0 0x7f851c156ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:09.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.753+0000 7f851bfff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f851c06ec60 0x7f851c0b51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:09.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.753+0000 7f85208e1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f851c0b1dd0 0x7f851c156ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58778/0 (socket says 172.21.15.50:58778) 2023-10-08T15:37:09.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.753+0000 7f85208e1700 1 -- 172.21.15.50:0/396461 learned_addr learned my addr 172.21.15.50:0/396461 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-08T15:37:09.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.753+0000 7f851b7fe700 1 --2- 172.21.15.50:0/396461 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f851c06f1d0 0x7f851c14aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:09.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.753+0000 7f85208e1700 1 -- 172.21.15.50:0/396461 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f851c06ec60 msgr2=0x7f851c0b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:09.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.753+0000 7f85208e1700 1 --2- 172.21.15.50:0/396461 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f851c06ec60 0x7f851c0b51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:09.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.753+0000 7f85208e1700 1 -- 172.21.15.50:0/396461 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f851c06f1d0 msgr2=0x7f851c14aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:09.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.753+0000 7f85208e1700 1 --2- 172.21.15.50:0/396461 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f851c06f1d0 0x7f851c14aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:09.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.753+0000 7f85208e1700 1 -- 172.21.15.50:0/396461 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85040094f0 con 0x7f851c0b1dd0 2023-10-08T15:37:09.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.753+0000 7f851b7fe700 1 --2- 172.21.15.50:0/396461 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f851c06f1d0 0x7f851c14aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:37:09.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.753+0000 7f85208e1700 1 --2- 172.21.15.50:0/396461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f851c0b1dd0 0x7f851c156ca0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f851400cd30 tx=0x7f8514001ac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:09.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.753+0000 7f8513fff700 1 -- 172.21.15.50:0/396461 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851400ce30 con 0x7f851c0b1dd0 2023-10-08T15:37:09.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.753+0000 7f8513fff700 1 -- 172.21.15.50:0/396461 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8514005df0 con 0x7f851c0b1dd0 2023-10-08T15:37:09.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.753+0000 7f85210e2700 1 -- 172.21.15.50:0/396461 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f851c0b61f0 con 0x7f851c0b1dd0 2023-10-08T15:37:09.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.753+0000 7f8513fff700 1 -- 172.21.15.50:0/396461 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851400ab70 con 0x7f851c0b1dd0 2023-10-08T15:37:09.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.753+0000 7f85210e2700 1 -- 172.21.15.50:0/396461 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f851c1567e0 con 0x7f851c0b1dd0 2023-10-08T15:37:09.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.753+0000 7f8513fff700 1 -- 172.21.15.50:0/396461 <== mon.1 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f85140070f0 con 0x7f851c0b1dd0 2023-10-08T15:37:09.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.757+0000 7f8513fff700 1 -- 172.21.15.50:0/396461 <== mon.1 v2:172.21.15.50:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7f8514012400 con 0x7f851c0b1dd0 2023-10-08T15:37:09.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.757+0000 7f85210e2700 1 -- 172.21.15.50:0/396461 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f851c05ecf0 con 0x7f851c0b1dd0 2023-10-08T15:37:09.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.757+0000 7f8513fff700 1 -- 172.21.15.50:0/396461 <== mon.1 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f85140073a0 con 0x7f851c0b1dd0 2023-10-08T15:37:09.784 INFO:tasks.ceph.mgr.x.smithi050.stderr:2023-10-08T15:37:09.781+0000 7f0469516000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T15:37:09.805 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-10-08T15:37:09.797+0000 7f1e620e7000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T15:37:09.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.841+0000 7f85210e2700 1 -- 172.21.15.50:0/396461 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd new", "uuid": "726c3003-34e6-4d5a-b6e2-f911e13c2118", "id": 5} v 0) v1 -- 0x7f851c0b66a0 con 0x7f851c0b1dd0 2023-10-08T15:37:09.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.845+0000 7f8513fff700 1 -- 172.21.15.50:0/396461 <== mon.1 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "726c3003-34e6-4d5a-b6e2-f911e13c2118", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8514007540 con 0x7f851c0b1dd0 2023-10-08T15:37:09.854 INFO:teuthology.orchestra.run.smithi050.stdout:5 2023-10-08T15:37:09.854 INFO:tasks.ceph.mgr.x.smithi050.stderr:2023-10-08T15:37:09.849+0000 7f0469516000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T15:37:09.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.849+0000 7f85210e2700 1 -- 172.21.15.50:0/396461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f851c0b1dd0 msgr2=0x7f851c156ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:09.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.849+0000 7f85210e2700 1 --2- 172.21.15.50:0/396461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f851c0b1dd0 0x7f851c156ca0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f851400cd30 tx=0x7f8514001ac0 comp rx=0 tx=0).stop 2023-10-08T15:37:09.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.849+0000 7f85210e2700 1 -- 172.21.15.50:0/396461 shutdown_connections 2023-10-08T15:37:09.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.849+0000 7f85210e2700 1 --2- 172.21.15.50:0/396461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f851c0b1dd0 0x7f851c156ca0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:09.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.849+0000 7f85210e2700 1 --2- 172.21.15.50:0/396461 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f851c06f1d0 0x7f851c14aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:09.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.849+0000 7f85210e2700 1 --2- 172.21.15.50:0/396461 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f851c06ec60 0x7f851c0b51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:09.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.849+0000 7f85210e2700 1 -- 172.21.15.50:0/396461 >> 172.21.15.50:0/396461 conn(0x7f851c0beb10 msgr2=0x7f851c144270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:09.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.849+0000 7f85210e2700 1 -- 172.21.15.50:0/396461 shutdown_connections 2023-10-08T15:37:09.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.849+0000 7f85210e2700 1 -- 172.21.15.50:0/396461 wait complete. 2023-10-08T15:37:09.866 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd new 401122a4-9988-441f-a5a7-39164434ebcd 6 2023-10-08T15:37:09.875 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-10-08T15:37:09.869+0000 7f1e620e7000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T15:37:09.919 INFO:tasks.ceph.mgr.x.smithi050.stderr:2023-10-08T15:37:09.917+0000 7f0469516000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T15:37:09.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.965+0000 7fdacb59e700 1 Processor -- start 2023-10-08T15:37:09.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.965+0000 7fdacb59e700 1 -- start start 2023-10-08T15:37:09.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.965+0000 7fdacb59e700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fdacc14b000 0x7fdacc068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:09.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.965+0000 7fdacb59e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdacc06d200 0x7fdacc06d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:09.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.965+0000 7fdacb59e700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdacc06c7b0 con 0x7fdacc14ac30 2023-10-08T15:37:09.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.965+0000 7fdacb59e700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdacc0a7e60 con 0x7fdacc14b000 2023-10-08T15:37:09.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.965+0000 7fdacb59e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdacc06ca00 con 0x7fdacc06d200 2023-10-08T15:37:09.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.965+0000 7fdacad9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdacc06d200 0x7fdacc06d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:09.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.969+0000 7fdacad9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdacc06d200 0x7fdacc06d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58786/0 (socket says 172.21.15.50:58786) 2023-10-08T15:37:09.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.969+0000 7fdacad9d700 1 -- 172.21.15.50:0/3639087688 learned_addr learned my addr 172.21.15.50:0/3639087688 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-08T15:37:09.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.969+0000 7fdac3fff700 1 --2- 172.21.15.50:0/3639087688 >> v2:172.21.15.3:3300/0 conn(0x7fdacc14b000 0x7fdacc068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:09.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.969+0000 7fdacad9d700 1 -- 172.21.15.50:0/3639087688 >> v2:172.21.15.3:3300/0 conn(0x7fdacc14b000 msgr2=0x7fdacc068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:09.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.969+0000 7fdacad9d700 1 --2- 172.21.15.50:0/3639087688 >> v2:172.21.15.3:3300/0 conn(0x7fdacc14b000 0x7fdacc068390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:09.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.969+0000 7fdacad9d700 1 -- 172.21.15.50:0/3639087688 >> v1:172.21.15.3:6789/0 conn(0x7fdacc14ac30 legacy=0x7fdacc14bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:09.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.969+0000 7fdacad9d700 1 -- 172.21.15.50:0/3639087688 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdacc06cce0 con 0x7fdacc06d200 2023-10-08T15:37:09.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.969+0000 7fdacad9d700 1 --2- 172.21.15.50:0/3639087688 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdacc06d200 0x7fdacc06d600 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdacc14c660 tx=0x7fdac4009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bda6a38d17f444b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:09.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.969+0000 7fdac9d9b700 1 -- 172.21.15.50:0/3639087688 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac400e070 con 0x7fdacc06d200 2023-10-08T15:37:09.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.969+0000 7fdac9d9b700 1 -- 172.21.15.50:0/3639087688 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac400ba10 con 0x7fdacc06d200 2023-10-08T15:37:09.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.969+0000 7fdac9d9b700 1 -- 172.21.15.50:0/3639087688 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac40092e0 con 0x7fdacc06d200 2023-10-08T15:37:09.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.969+0000 7fdacb59e700 1 -- 172.21.15.50:0/3639087688 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdacc06d200 msgr2=0x7fdacc06d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:09.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.969+0000 7fdacb59e700 1 --2- 172.21.15.50:0/3639087688 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdacc06d200 0x7fdacc06d600 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdacc14c660 tx=0x7fdac4009840 comp rx=0 tx=0).stop 2023-10-08T15:37:09.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.969+0000 7fdacb59e700 1 -- 172.21.15.50:0/3639087688 shutdown_connections 2023-10-08T15:37:09.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.969+0000 7fdacb59e700 1 --2- 172.21.15.50:0/3639087688 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdacc06d200 0x7fdacc06d600 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:09.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.969+0000 7fdacb59e700 1 --2- 172.21.15.50:0/3639087688 >> v2:172.21.15.3:3300/0 conn(0x7fdacc14b000 0x7fdacc068390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:09.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.969+0000 7fdacb59e700 1 -- 172.21.15.50:0/3639087688 >> 172.21.15.50:0/3639087688 conn(0x7fdacc0c1df0 msgr2=0x7fdacc0c21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:09.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.969+0000 7fdacb59e700 1 -- 172.21.15.50:0/3639087688 shutdown_connections 2023-10-08T15:37:09.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.969+0000 7fdacb59e700 1 -- 172.21.15.50:0/3639087688 wait complete. 2023-10-08T15:37:09.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.969+0000 7fdacb59e700 1 Processor -- start 2023-10-08T15:37:09.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.969+0000 7fdacb59e700 1 -- start start 2023-10-08T15:37:09.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.969+0000 7fdacb59e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdacc06d200 0x7fdacc14dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:09.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.969+0000 7fdacb59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdacc14ac30 0x7fdacc15e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:09.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.969+0000 7fdacb59e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdacc14b000 0x7fdacc150d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:09.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.969+0000 7fdacb59e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc14e8f0 con 0x7fdacc06d200 2023-10-08T15:37:09.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.969+0000 7fdacb59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc15ee50 con 0x7fdacc14ac30 2023-10-08T15:37:09.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.969+0000 7fdacb59e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc15ea70 con 0x7fdacc14b000 2023-10-08T15:37:09.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.969+0000 7fdac3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdacc14ac30 0x7fdacc15e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:09.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.969+0000 7fdac3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdacc14ac30 0x7fdacc15e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58790/0 (socket says 172.21.15.50:58790) 2023-10-08T15:37:09.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.969+0000 7fdac3fff700 1 -- 172.21.15.50:0/4171220649 learned_addr learned my addr 172.21.15.50:0/4171220649 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-08T15:37:09.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.969+0000 7fdacad9d700 1 --2- 172.21.15.50:0/4171220649 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdacc14b000 0x7fdacc150d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:09.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.969+0000 7fdaca59c700 1 --2- 172.21.15.50:0/4171220649 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdacc06d200 0x7fdacc14dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:09.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.969+0000 7fdac3fff700 1 -- 172.21.15.50:0/4171220649 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdacc14b000 msgr2=0x7fdacc150d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:09.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.969+0000 7fdac3fff700 1 --2- 172.21.15.50:0/4171220649 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdacc14b000 0x7fdacc150d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:09.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.969+0000 7fdac3fff700 1 -- 172.21.15.50:0/4171220649 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdacc06d200 msgr2=0x7fdacc14dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:09.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.969+0000 7fdac3fff700 1 --2- 172.21.15.50:0/4171220649 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdacc06d200 0x7fdacc14dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:09.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.969+0000 7fdac3fff700 1 -- 172.21.15.50:0/4171220649 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac4009ae0 con 0x7fdacc14ac30 2023-10-08T15:37:09.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.973+0000 7fdac3fff700 1 --2- 172.21.15.50:0/4171220649 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdacc14ac30 0x7fdacc15e100 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdab400d860 tx=0x7fdab4008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:09.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.973+0000 7fdac27fc700 1 -- 172.21.15.50:0/4171220649 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab40125f0 con 0x7fdacc14ac30 2023-10-08T15:37:09.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.973+0000 7fdac27fc700 1 -- 172.21.15.50:0/4171220649 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdab4012770 con 0x7fdacc14ac30 2023-10-08T15:37:09.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.973+0000 7fdac27fc700 1 -- 172.21.15.50:0/4171220649 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab4012b30 con 0x7fdacc14ac30 2023-10-08T15:37:09.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.973+0000 7fdacb59e700 1 -- 172.21.15.50:0/4171220649 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdacc14d820 con 0x7fdacc14ac30 2023-10-08T15:37:09.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.973+0000 7fdacb59e700 1 -- 172.21.15.50:0/4171220649 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdacc0a5d10 con 0x7fdacc14ac30 2023-10-08T15:37:09.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.973+0000 7fdac27fc700 1 -- 172.21.15.50:0/4171220649 <== mon.1 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fdab4013480 con 0x7fdacc14ac30 2023-10-08T15:37:09.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.973+0000 7fdac27fc700 1 -- 172.21.15.50:0/4171220649 <== mon.1 v2:172.21.15.50:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7fdab401da60 con 0x7fdacc14ac30 2023-10-08T15:37:09.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.973+0000 7fdacb59e700 1 -- 172.21.15.50:0/4171220649 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdacc05ecf0 con 0x7fdacc14ac30 2023-10-08T15:37:09.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:09.977+0000 7fdac27fc700 1 -- 172.21.15.50:0/4171220649 <== mon.1 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fdab40138c0 con 0x7fdacc14ac30 2023-10-08T15:37:10.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.053+0000 7fdacb59e700 1 -- 172.21.15.50:0/4171220649 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd new", "uuid": "401122a4-9988-441f-a5a7-39164434ebcd", "id": 6} v 0) v1 -- 0x7fdacc0688d0 con 0x7fdacc14ac30 2023-10-08T15:37:10.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.061+0000 7fdac27fc700 1 -- 172.21.15.50:0/4171220649 <== mon.1 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "401122a4-9988-441f-a5a7-39164434ebcd", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdab402c0b0 con 0x7fdacc14ac30 2023-10-08T15:37:10.064 INFO:teuthology.orchestra.run.smithi050.stdout:6 2023-10-08T15:37:10.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.061+0000 7fdacb59e700 1 -- 172.21.15.50:0/4171220649 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdacc14ac30 msgr2=0x7fdacc15e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:10.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.061+0000 7fdacb59e700 1 --2- 172.21.15.50:0/4171220649 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdacc14ac30 0x7fdacc15e100 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdab400d860 tx=0x7fdab4008040 comp rx=0 tx=0).stop 2023-10-08T15:37:10.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.061+0000 7fdacb59e700 1 -- 172.21.15.50:0/4171220649 shutdown_connections 2023-10-08T15:37:10.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.061+0000 7fdacb59e700 1 --2- 172.21.15.50:0/4171220649 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdacc14b000 0x7fdacc150d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:10.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.061+0000 7fdacb59e700 1 --2- 172.21.15.50:0/4171220649 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdacc14ac30 0x7fdacc15e100 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:10.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.061+0000 7fdacb59e700 1 --2- 172.21.15.50:0/4171220649 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdacc06d200 0x7fdacc14dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:10.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.061+0000 7fdacb59e700 1 -- 172.21.15.50:0/4171220649 >> 172.21.15.50:0/4171220649 conn(0x7fdacc0c1df0 msgr2=0x7fdacc068b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:10.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.061+0000 7fdacb59e700 1 -- 172.21.15.50:0/4171220649 shutdown_connections 2023-10-08T15:37:10.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.061+0000 7fdacb59e700 1 -- 172.21.15.50:0/4171220649 wait complete. 2023-10-08T15:37:10.076 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd new 6b3fa236-c9d0-4c4d-82ae-9af4daf6d699 7 2023-10-08T15:37:10.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.173+0000 7fc97f01a700 1 Processor -- start 2023-10-08T15:37:10.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.173+0000 7fc97f01a700 1 -- start start 2023-10-08T15:37:10.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.173+0000 7fc97f01a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc97806bb50 0x7fc97806bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:10.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.173+0000 7fc97f01a700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9780bbad0 con 0x7fc97806c6f0 2023-10-08T15:37:10.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.173+0000 7fc97f01a700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc978149be0 con 0x7fc9780bbf30 2023-10-08T15:37:10.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.173+0000 7fc97f01a700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9780baed0 con 0x7fc97806bb50 2023-10-08T15:37:10.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.173+0000 7fc97cdb6700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc97806bb50 0x7fc97806bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:10.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.173+0000 7fc977fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc9780bbf30 0x7fc9780bc320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39780/0 (socket says 172.21.15.50:39780) 2023-10-08T15:37:10.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.173+0000 7fc977fff700 1 -- 172.21.15.50:0/3277831019 learned_addr learned my addr 172.21.15.50:0/3277831019 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-08T15:37:10.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.173+0000 7fc97cdb6700 1 -- 172.21.15.50:0/3277831019 >> v1:172.21.15.50:6789/0 conn(0x7fc9780bbf30 legacy=0x7fc9780bc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:10.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.173+0000 7fc97cdb6700 1 -- 172.21.15.50:0/3277831019 >> v1:172.21.15.3:6789/0 conn(0x7fc97806c6f0 legacy=0x7fc97814a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:10.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.173+0000 7fc9777fe700 1 -- 172.21.15.50:0/3277831019 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4112493886 0 0) 0x7fc978149be0 con 0x7fc9780bbf30 2023-10-08T15:37:10.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.173+0000 7fc97cdb6700 1 -- 172.21.15.50:0/3277831019 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc978149870 con 0x7fc97806bb50 2023-10-08T15:37:10.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.173+0000 7fc97cdb6700 1 --2- 172.21.15.50:0/3277831019 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc97806bb50 0x7fc97806bf20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc968009e60 tx=0x7fc968009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a49bfcb7676b67ef server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:10.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.173+0000 7fc9777fe700 1 -- 172.21.15.50:0/3277831019 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96800e070 con 0x7fc97806bb50 2023-10-08T15:37:10.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.173+0000 7fc9777fe700 1 -- 172.21.15.50:0/3277831019 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc96800bc30 con 0x7fc97806bb50 2023-10-08T15:37:10.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.173+0000 7fc9777fe700 1 -- 172.21.15.50:0/3277831019 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc968012430 con 0x7fc97806bb50 2023-10-08T15:37:10.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.177+0000 7fc97f01a700 1 -- 172.21.15.50:0/3277831019 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc97806bb50 msgr2=0x7fc97806bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:10.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.177+0000 7fc97f01a700 1 --2- 172.21.15.50:0/3277831019 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc97806bb50 0x7fc97806bf20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc968009e60 tx=0x7fc968009780 comp rx=0 tx=0).stop 2023-10-08T15:37:10.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.177+0000 7fc97f01a700 1 -- 172.21.15.50:0/3277831019 shutdown_connections 2023-10-08T15:37:10.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.177+0000 7fc97f01a700 1 --2- 172.21.15.50:0/3277831019 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc97806bb50 0x7fc97806bf20 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:10.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.177+0000 7fc97f01a700 1 -- 172.21.15.50:0/3277831019 >> 172.21.15.50:0/3277831019 conn(0x7fc97806f410 msgr2=0x7fc9780670e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:10.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.177+0000 7fc97f01a700 1 -- 172.21.15.50:0/3277831019 shutdown_connections 2023-10-08T15:37:10.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.177+0000 7fc97f01a700 1 -- 172.21.15.50:0/3277831019 wait complete. 2023-10-08T15:37:10.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.177+0000 7fc97f01a700 1 Processor -- start 2023-10-08T15:37:10.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.177+0000 7fc97f01a700 1 -- start start 2023-10-08T15:37:10.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.177+0000 7fc97f01a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc97806bb50 0x7fc978159340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:10.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.177+0000 7fc97f01a700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc97806c6f0 0x7fc9780a1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:10.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.177+0000 7fc97f01a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9780bbf30 0x7fc978159b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:10.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.177+0000 7fc97f01a700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9780bca30 con 0x7fc97806c6f0 2023-10-08T15:37:10.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.177+0000 7fc97f01a700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9780b7790 con 0x7fc9780bbf30 2023-10-08T15:37:10.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.177+0000 7fc97f01a700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9780b5920 con 0x7fc97806bb50 2023-10-08T15:37:10.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.177+0000 7fc97cdb6700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc97806bb50 0x7fc978159340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:10.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.177+0000 7fc97d5b7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9780bbf30 0x7fc978159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:10.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.177+0000 7fc97d5b7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9780bbf30 0x7fc978159b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58804/0 (socket says 172.21.15.50:58804) 2023-10-08T15:37:10.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.177+0000 7fc97d5b7700 1 -- 172.21.15.50:0/4033595450 learned_addr learned my addr 172.21.15.50:0/4033595450 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-08T15:37:10.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.177+0000 7fc977fff700 1 --2- 172.21.15.50:0/4033595450 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc97806c6f0 0x7fc9780a1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:10.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.177+0000 7fc97d5b7700 1 -- 172.21.15.50:0/4033595450 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc97806bb50 msgr2=0x7fc978159340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:10.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.177+0000 7fc97d5b7700 1 --2- 172.21.15.50:0/4033595450 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc97806bb50 0x7fc978159340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:10.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.177+0000 7fc97d5b7700 1 -- 172.21.15.50:0/4033595450 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc97806c6f0 msgr2=0x7fc9780a1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:10.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.177+0000 7fc97d5b7700 1 --2- 172.21.15.50:0/4033595450 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc97806c6f0 0x7fc9780a1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:10.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.177+0000 7fc97d5b7700 1 -- 172.21.15.50:0/4033595450 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc968009a20 con 0x7fc9780bbf30 2023-10-08T15:37:10.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.177+0000 7fc977fff700 1 --2- 172.21.15.50:0/4033595450 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc97806c6f0 0x7fc9780a1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:37:10.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.177+0000 7fc97cdb6700 1 --2- 172.21.15.50:0/4033595450 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc97806bb50 0x7fc978159340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:37:10.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.177+0000 7fc97d5b7700 1 --2- 172.21.15.50:0/4033595450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9780bbf30 0x7fc978159b90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc97000c590 tx=0x7fc970007ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:10.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.177+0000 7fc974ff9700 1 -- 172.21.15.50:0/4033595450 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc970011590 con 0x7fc9780bbf30 2023-10-08T15:37:10.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.177+0000 7fc974ff9700 1 -- 172.21.15.50:0/4033595450 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc970011710 con 0x7fc9780bbf30 2023-10-08T15:37:10.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.177+0000 7fc97f01a700 1 -- 172.21.15.50:0/4033595450 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9780b5bc0 con 0x7fc9780bbf30 2023-10-08T15:37:10.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.181+0000 7fc974ff9700 1 -- 172.21.15.50:0/4033595450 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc970011ad0 con 0x7fc9780bbf30 2023-10-08T15:37:10.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.181+0000 7fc97f01a700 1 -- 172.21.15.50:0/4033595450 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9780a1d40 con 0x7fc9780bbf30 2023-10-08T15:37:10.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.181+0000 7fc974ff9700 1 -- 172.21.15.50:0/4033595450 <== mon.1 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fc97001c6c0 con 0x7fc9780bbf30 2023-10-08T15:37:10.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.181+0000 7fc974ff9700 1 -- 172.21.15.50:0/4033595450 <== mon.1 v2:172.21.15.50:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7fc970012a90 con 0x7fc9780bbf30 2023-10-08T15:37:10.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.185+0000 7fc97f01a700 1 -- 172.21.15.50:0/4033595450 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9780b7900 con 0x7fc9780bbf30 2023-10-08T15:37:10.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.185+0000 7fc974ff9700 1 -- 172.21.15.50:0/4033595450 <== mon.1 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fc970017070 con 0x7fc9780bbf30 2023-10-08T15:37:10.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.265+0000 7fc97f01a700 1 -- 172.21.15.50:0/4033595450 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6b3fa236-c9d0-4c4d-82ae-9af4daf6d699", "id": 7} v 0) v1 -- 0x7fc978064530 con 0x7fc9780bbf30 2023-10-08T15:37:10.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.273+0000 7fc974ff9700 1 -- 172.21.15.50:0/4033595450 <== mon.1 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6b3fa236-c9d0-4c4d-82ae-9af4daf6d699", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc97001cb50 con 0x7fc9780bbf30 2023-10-08T15:37:10.279 INFO:teuthology.orchestra.run.smithi050.stdout:7 2023-10-08T15:37:10.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.277+0000 7fc97f01a700 1 -- 172.21.15.50:0/4033595450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9780bbf30 msgr2=0x7fc978159b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:10.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.277+0000 7fc97f01a700 1 --2- 172.21.15.50:0/4033595450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9780bbf30 0x7fc978159b90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc97000c590 tx=0x7fc970007ec0 comp rx=0 tx=0).stop 2023-10-08T15:37:10.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.277+0000 7fc97f01a700 1 -- 172.21.15.50:0/4033595450 shutdown_connections 2023-10-08T15:37:10.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.277+0000 7fc97f01a700 1 --2- 172.21.15.50:0/4033595450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9780bbf30 0x7fc978159b90 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:10.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.277+0000 7fc97f01a700 1 --2- 172.21.15.50:0/4033595450 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc97806c6f0 0x7fc9780a1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:10.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.277+0000 7fc97f01a700 1 --2- 172.21.15.50:0/4033595450 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc97806bb50 0x7fc978159340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:10.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.277+0000 7fc97f01a700 1 -- 172.21.15.50:0/4033595450 >> 172.21.15.50:0/4033595450 conn(0x7fc97806f410 msgr2=0x7fc97814ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:10.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.277+0000 7fc97f01a700 1 -- 172.21.15.50:0/4033595450 shutdown_connections 2023-10-08T15:37:10.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-08T15:37:10.277+0000 7fc97f01a700 1 -- 172.21.15.50:0/4033595450 wait complete. 2023-10-08T15:37:10.297 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-08T15:37:10.298 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-08T15:37:10.299 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-10-08T15:37:10.293+0000 7f1e620e7000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T15:37:10.300 INFO:tasks.ceph.osd.0:Started 2023-10-08T15:37:10.300 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-08T15:37:10.300 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-08T15:37:10.302 INFO:tasks.ceph.osd.1:Started 2023-10-08T15:37:10.302 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-08T15:37:10.302 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-08T15:37:10.305 INFO:tasks.ceph.osd.2:Started 2023-10-08T15:37:10.305 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-08T15:37:10.305 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-08T15:37:10.306 INFO:tasks.ceph.mgr.x.smithi050.stderr:2023-10-08T15:37:10.301+0000 7f0469516000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T15:37:10.307 INFO:tasks.ceph.osd.3:Started 2023-10-08T15:37:10.307 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-08T15:37:10.307 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-08T15:37:10.310 INFO:tasks.ceph.osd.4:Started 2023-10-08T15:37:10.310 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-08T15:37:10.310 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-08T15:37:10.312 INFO:tasks.ceph.osd.5:Started 2023-10-08T15:37:10.312 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-08T15:37:10.312 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-08T15:37:10.317 INFO:tasks.ceph.osd.6:Started 2023-10-08T15:37:10.318 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-08T15:37:10.318 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-08T15:37:10.320 INFO:tasks.ceph.osd.7:Started 2023-10-08T15:37:10.320 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:37:10.430 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.425+0000 7fad5e6bf700 1 Processor -- start 2023-10-08T15:37:10.431 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.425+0000 7fad5e6bf700 1 -- start start 2023-10-08T15:37:10.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.425+0000 7fad5e6bf700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fad5806d380 0x7fad5814ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:10.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.425+0000 7fad5e6bf700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad580b1c30 con 0x7fad58068bb0 2023-10-08T15:37:10.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.425+0000 7fad5e6bf700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad58148a20 con 0x7fad580680f0 2023-10-08T15:37:10.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.425+0000 7fad5e6bf700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad580a2fd0 con 0x7fad5806d380 2023-10-08T15:37:10.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.425+0000 7fad57fff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fad58068bb0 0x7fad58147c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:55394/0 (socket says 172.21.15.3:55394) 2023-10-08T15:37:10.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.425+0000 7fad57fff700 1 -- 172.21.15.3:0/1466426262 learned_addr learned my addr 172.21.15.3:0/1466426262 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:10.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.425+0000 7fad577fe700 1 --2- 172.21.15.3:0/1466426262 >> v2:172.21.15.50:3300/0 conn(0x7fad5806d380 0x7fad5814ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:10.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.425+0000 7fad56ffd700 1 -- 172.21.15.3:0/1466426262 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4161991293 0 0) 0x7fad580b1c30 con 0x7fad58068bb0 2023-10-08T15:37:10.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.425+0000 7fad56ffd700 1 -- 172.21.15.3:0/1466426262 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad40003570 con 0x7fad58068bb0 2023-10-08T15:37:10.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.425+0000 7fad577fe700 1 -- 172.21.15.3:0/1466426262 >> v1:172.21.15.50:6789/0 conn(0x7fad580680f0 legacy=0x7fad58148310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:10.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.425+0000 7fad577fe700 1 -- 172.21.15.3:0/1466426262 >> v1:172.21.15.3:6789/0 conn(0x7fad58068bb0 legacy=0x7fad58147c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:10.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.425+0000 7fad577fe700 1 -- 172.21.15.3:0/1466426262 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad5806dee0 con 0x7fad5806d380 2023-10-08T15:37:10.434 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.425+0000 7fad577fe700 1 --2- 172.21.15.3:0/1466426262 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad5806d380 0x7fad5814ba50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fad4c0098e0 tx=0x7fad4c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5277d6c129c52d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:10.434 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.425+0000 7fad56ffd700 1 -- 172.21.15.3:0/1466426262 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4c00f6b0 con 0x7fad5806d380 2023-10-08T15:37:10.434 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.425+0000 7fad56ffd700 1 -- 172.21.15.3:0/1466426262 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad4c00f810 con 0x7fad5806d380 2023-10-08T15:37:10.435 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.425+0000 7fad56ffd700 1 -- 172.21.15.3:0/1466426262 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4c00fbb0 con 0x7fad5806d380 2023-10-08T15:37:10.435 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.425+0000 7fad5e6bf700 1 -- 172.21.15.3:0/1466426262 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad5806d380 msgr2=0x7fad5814ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:10.435 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.425+0000 7fad5e6bf700 1 --2- 172.21.15.3:0/1466426262 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad5806d380 0x7fad5814ba50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fad4c0098e0 tx=0x7fad4c0091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:10.435 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.425+0000 7fad5e6bf700 1 -- 172.21.15.3:0/1466426262 shutdown_connections 2023-10-08T15:37:10.435 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.425+0000 7fad5e6bf700 1 --2- 172.21.15.3:0/1466426262 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad5806d380 0x7fad5814ba50 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:10.435 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.425+0000 7fad5e6bf700 1 -- 172.21.15.3:0/1466426262 >> 172.21.15.3:0/1466426262 conn(0x7fad580be630 msgr2=0x7fad580ba6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:10.435 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.425+0000 7fad5e6bf700 1 -- 172.21.15.3:0/1466426262 shutdown_connections 2023-10-08T15:37:10.435 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.425+0000 7fad5e6bf700 1 -- 172.21.15.3:0/1466426262 wait complete. 2023-10-08T15:37:10.436 INFO:tasks.ceph.mgr.x.smithi050.stderr:2023-10-08T15:37:10.429+0000 7f0469516000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T15:37:10.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.429+0000 7fad5e6bf700 1 Processor -- start 2023-10-08T15:37:10.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.429+0000 7fad5e6bf700 1 -- start start 2023-10-08T15:37:10.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.429+0000 7fad5e6bf700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad580680f0 0x7fad58157620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:10.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.429+0000 7fad5e6bf700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad58068bb0 0x7fad5815a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:10.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.429+0000 7fad5e6bf700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fad5806d380 0x7fad58145210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:10.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.429+0000 7fad5e6bf700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad58157b60 con 0x7fad580680f0 2023-10-08T15:37:10.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.429+0000 7fad5e6bf700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5815ada0 con 0x7fad58068bb0 2023-10-08T15:37:10.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.429+0000 7fad5e6bf700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad581426d0 con 0x7fad5806d380 2023-10-08T15:37:10.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.429+0000 7fad57fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad580680f0 0x7fad58157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:10.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.429+0000 7fad57fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad580680f0 0x7fad58157620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52382/0 (socket says 172.21.15.3:52382) 2023-10-08T15:37:10.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.429+0000 7fad57fff700 1 -- 172.21.15.3:0/4046999411 learned_addr learned my addr 172.21.15.3:0/4046999411 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:10.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.429+0000 7fad577fe700 1 --2- 172.21.15.3:0/4046999411 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad58068bb0 0x7fad5815a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:10.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.429+0000 7fad5cc5c700 1 --2- 172.21.15.3:0/4046999411 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fad5806d380 0x7fad58145210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:10.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.429+0000 7fad57fff700 1 -- 172.21.15.3:0/4046999411 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fad5806d380 msgr2=0x7fad58145210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:10.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.429+0000 7fad57fff700 1 --2- 172.21.15.3:0/4046999411 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fad5806d380 0x7fad58145210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:10.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.429+0000 7fad57fff700 1 -- 172.21.15.3:0/4046999411 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad58068bb0 msgr2=0x7fad5815a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:10.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.429+0000 7fad57fff700 1 --2- 172.21.15.3:0/4046999411 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad58068bb0 0x7fad5815a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:10.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.429+0000 7fad57fff700 1 -- 172.21.15.3:0/4046999411 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad4c009420 con 0x7fad580680f0 2023-10-08T15:37:10.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.429+0000 7fad577fe700 1 --2- 172.21.15.3:0/4046999411 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad58068bb0 0x7fad5815a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:37:10.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.429+0000 7fad57fff700 1 --2- 172.21.15.3:0/4046999411 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad580680f0 0x7fad58157620 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fad4800c7c0 tx=0x7fad48007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:10.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.429+0000 7fad3ffff700 1 -- 172.21.15.3:0/4046999411 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad48005b30 con 0x7fad580680f0 2023-10-08T15:37:10.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.429+0000 7fad3ffff700 1 -- 172.21.15.3:0/4046999411 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad48005cb0 con 0x7fad580680f0 2023-10-08T15:37:10.440 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-10-08T15:37:10.429+0000 7f1e620e7000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T15:37:10.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.429+0000 7fad5e6bf700 1 -- 172.21.15.3:0/4046999411 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad5815aa30 con 0x7fad580680f0 2023-10-08T15:37:10.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.429+0000 7fad3ffff700 1 -- 172.21.15.3:0/4046999411 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad48007320 con 0x7fad580680f0 2023-10-08T15:37:10.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.429+0000 7fad5e6bf700 1 -- 172.21.15.3:0/4046999411 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad58147540 con 0x7fad580680f0 2023-10-08T15:37:10.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.429+0000 7fad3ffff700 1 -- 172.21.15.3:0/4046999411 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fad4801c6c0 con 0x7fad580680f0 2023-10-08T15:37:10.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.429+0000 7fad3ffff700 1 -- 172.21.15.3:0/4046999411 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7fad480076d0 con 0x7fad580680f0 2023-10-08T15:37:10.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.437+0000 7fad5e6bf700 1 -- 172.21.15.3:0/4046999411 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad58064530 con 0x7fad580680f0 2023-10-08T15:37:10.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.441+0000 7fad3ffff700 1 -- 172.21.15.3:0/4046999411 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fad48017070 con 0x7fad580680f0 2023-10-08T15:37:10.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.505+0000 7fad5e6bf700 1 -- 172.21.15.3:0/4046999411 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad5806e1c0 con 0x7fad580680f0 2023-10-08T15:37:10.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.505+0000 7fad3ffff700 1 -- 172.21.15.3:0/4046999411 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7fad4801cbf0 con 0x7fad580680f0 2023-10-08T15:37:10.513 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:37:10.514 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":10,"fsid":"7635972e-cd66-4a8f-a231-378db8b3847a","created":"2023-10-08T15:37:08.234594+0000","modified":"2023-10-08T15:37:10.269178+0000","last_up_change":"0.000000","last_in_change":"2023-10-08T15:37:10.269178+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"64fb1864-bfdd-4d75-9b41-03fb60085dc4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3ca6bd3a-3e8a-4c65-af9c-46148b0c2047","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6eb9f757-58dd-442f-910d-32401454bce3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1c39866b-ac2e-4ea9-a69c-02b01ee4191d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"15f86b61-b7f1-4780-ae00-9d80a68cb830","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"726c3003-34e6-4d5a-b6e2-f911e13c2118","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"401122a4-9988-441f-a5a7-39164434ebcd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"6b3fa236-c9d0-4c4d-82ae-9af4daf6d699","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:37:10.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.509+0000 7fad5e6bf700 1 -- 172.21.15.3:0/4046999411 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad580680f0 msgr2=0x7fad58157620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:10.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.509+0000 7fad5e6bf700 1 --2- 172.21.15.3:0/4046999411 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad580680f0 0x7fad58157620 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fad4800c7c0 tx=0x7fad48007e00 comp rx=0 tx=0).stop 2023-10-08T15:37:10.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.509+0000 7fad5e6bf700 1 -- 172.21.15.3:0/4046999411 shutdown_connections 2023-10-08T15:37:10.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.509+0000 7fad5e6bf700 1 --2- 172.21.15.3:0/4046999411 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fad5806d380 0x7fad58145210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:10.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.509+0000 7fad5e6bf700 1 --2- 172.21.15.3:0/4046999411 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad58068bb0 0x7fad5815a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:10.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.509+0000 7fad5e6bf700 1 --2- 172.21.15.3:0/4046999411 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad580680f0 0x7fad58157620 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:10.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.509+0000 7fad5e6bf700 1 -- 172.21.15.3:0/4046999411 >> 172.21.15.3:0/4046999411 conn(0x7fad580be630 msgr2=0x7fad5813dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:10.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.509+0000 7fad5e6bf700 1 -- 172.21.15.3:0/4046999411 shutdown_connections 2023-10-08T15:37:10.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:10.509+0000 7fad5e6bf700 1 -- 172.21.15.3:0/4046999411 wait complete. 2023-10-08T15:37:10.534 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-08T15:37:10.535 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-08T15:37:10.679 INFO:tasks.ceph.osd.0.smithi003.stderr:2023-10-08T15:37:10.673+0000 7f2f7044f3c0 -1 Falling back to public interface 2023-10-08T15:37:10.685 INFO:tasks.ceph.osd.5.smithi050.stderr:2023-10-08T15:37:10.681+0000 7f80d51763c0 -1 Falling back to public interface 2023-10-08T15:37:10.691 INFO:tasks.ceph.osd.3.smithi003.stderr:2023-10-08T15:37:10.685+0000 7fedf1ca13c0 -1 Falling back to public interface 2023-10-08T15:37:10.705 INFO:tasks.ceph.osd.4.smithi050.stderr:2023-10-08T15:37:10.701+0000 7fd5c82933c0 -1 Falling back to public interface 2023-10-08T15:37:10.735 INFO:tasks.ceph.mgr.x.smithi050.stderr:2023-10-08T15:37:10.733+0000 7f0469516000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T15:37:10.765 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-10-08T15:37:10.757+0000 7f1e620e7000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T15:37:10.904 INFO:tasks.ceph.mgr.x.smithi050.stderr:2023-10-08T15:37:10.901+0000 7f0469516000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T15:37:10.929 INFO:tasks.ceph.osd.7.smithi050.stderr:2023-10-08T15:37:10.925+0000 7f14761d53c0 -1 Falling back to public interface 2023-10-08T15:37:10.930 INFO:tasks.ceph.osd.6.smithi050.stderr:2023-10-08T15:37:10.925+0000 7f6d69bd33c0 -1 Falling back to public interface 2023-10-08T15:37:10.939 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-10-08T15:37:10.929+0000 7f1e620e7000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T15:37:10.947 INFO:tasks.ceph.osd.2.smithi003.stderr:2023-10-08T15:37:10.941+0000 7fd456edb3c0 -1 Falling back to public interface 2023-10-08T15:37:10.948 INFO:tasks.ceph.osd.1.smithi003.stderr:2023-10-08T15:37:10.941+0000 7f00a9c703c0 -1 Falling back to public interface 2023-10-08T15:37:10.949 INFO:tasks.ceph.osd.2.smithi003.stderr:2023-10-08T15:37:10.941+0000 7fd455ea4700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6818/0: (98) Address already in use 2023-10-08T15:37:10.970 INFO:tasks.ceph.mgr.x.smithi050.stderr:2023-10-08T15:37:10.965+0000 7f0469516000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T15:37:11.003 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-10-08T15:37:10.997+0000 7f1e620e7000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T15:37:11.024 INFO:tasks.ceph.mgr.x.smithi050.stderr:2023-10-08T15:37:11.021+0000 7f0469516000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T15:37:11.057 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-10-08T15:37:11.049+0000 7f1e620e7000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T15:37:11.084 INFO:tasks.ceph.mgr.x.smithi050.stderr:2023-10-08T15:37:11.081+0000 7f0469516000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T15:37:11.116 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-10-08T15:37:11.109+0000 7f1e620e7000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T15:37:11.342 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-08T15:37:11.373 INFO:tasks.ceph.mgr.x.smithi050.stderr:2023-10-08T15:37:11.369+0000 7f0469516000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T15:37:11.387 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-10-08T15:37:11.381+0000 7f1e620e7000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T15:37:11.432 INFO:tasks.ceph.mgr.x.smithi050.stderr:2023-10-08T15:37:11.429+0000 7f0469516000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T15:37:11.434 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.429+0000 7f41e1b9b700 1 Processor -- start 2023-10-08T15:37:11.434 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.429+0000 7f41e1b9b700 1 -- start start 2023-10-08T15:37:11.437 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.429+0000 7f41e1b9b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f41dc068e90 0x7f41dc14ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:11.437 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.429+0000 7f41e1b9b700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f41dc14b280 0x7f41dc14ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:11.437 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.429+0000 7f41e1b9b700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41dc14b700 con 0x7f41dc0be4d0 2023-10-08T15:37:11.437 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.429+0000 7f41e1b9b700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41dc0b7ea0 con 0x7f41dc14b280 2023-10-08T15:37:11.437 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.429+0000 7f41e1b9b700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41dc14f370 con 0x7f41dc068e90 2023-10-08T15:37:11.437 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.429+0000 7f41d2ffd700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f41dc0be4d0 0x7f41dc14ab70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:55408/0 (socket says 172.21.15.3:55408) 2023-10-08T15:37:11.437 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.429+0000 7f41d2ffd700 1 -- 172.21.15.3:0/2274886442 learned_addr learned my addr 172.21.15.3:0/2274886442 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:11.438 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.429+0000 7f41db7fe700 1 --2- 172.21.15.3:0/2274886442 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f41dc068e90 0x7f41dc14ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:11.438 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.429+0000 7f41dbfff700 1 --2- 172.21.15.3:0/2274886442 >> v2:172.21.15.3:3300/0 conn(0x7f41dc14b280 0x7f41dc14ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:11.438 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.429+0000 7f41daffd700 1 -- 172.21.15.3:0/2274886442 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 251682137 0 0) 0x7f41dc14b700 con 0x7f41dc0be4d0 2023-10-08T15:37:11.438 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.429+0000 7f41daffd700 1 -- 172.21.15.3:0/2274886442 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41c8003570 con 0x7f41dc0be4d0 2023-10-08T15:37:11.438 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.429+0000 7f41dbfff700 1 -- 172.21.15.3:0/2274886442 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f41dc068e90 msgr2=0x7f41dc14ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:11.438 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.429+0000 7f41dbfff700 1 --2- 172.21.15.3:0/2274886442 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f41dc068e90 0x7f41dc14ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:11.438 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.429+0000 7f41dbfff700 1 -- 172.21.15.3:0/2274886442 >> v1:172.21.15.3:6789/0 conn(0x7f41dc0be4d0 legacy=0x7f41dc14ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:11.438 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.429+0000 7f41daffd700 1 -- 172.21.15.3:0/2274886442 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1849139834 0 0) 0x7f41c8003570 con 0x7f41dc0be4d0 2023-10-08T15:37:11.438 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.429+0000 7f41dbfff700 1 -- 172.21.15.3:0/2274886442 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41dc14f620 con 0x7f41dc14b280 2023-10-08T15:37:11.438 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.429+0000 7f41dbfff700 1 --2- 172.21.15.3:0/2274886442 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f41dc14b280 0x7f41dc14ba90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f41d4009e60 tx=0x7f41d4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e398fd7393ef197b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:11.438 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.429+0000 7f41daffd700 1 -- 172.21.15.3:0/2274886442 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d400e070 con 0x7f41dc14b280 2023-10-08T15:37:11.439 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.429+0000 7f41daffd700 1 -- 172.21.15.3:0/2274886442 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d400b7a0 con 0x7f41dc14b280 2023-10-08T15:37:11.439 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.429+0000 7f41daffd700 1 -- 172.21.15.3:0/2274886442 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c4001470 con 0x7f41dc14b280 2023-10-08T15:37:11.441 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.429+0000 7f41e1b9b700 1 -- 172.21.15.3:0/2274886442 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f41dc14b280 msgr2=0x7f41dc14ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:11.441 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.429+0000 7f41e1b9b700 1 --2- 172.21.15.3:0/2274886442 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f41dc14b280 0x7f41dc14ba90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f41d4009e60 tx=0x7f41d4009780 comp rx=0 tx=0).stop 2023-10-08T15:37:11.441 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.429+0000 7f41e1b9b700 1 -- 172.21.15.3:0/2274886442 shutdown_connections 2023-10-08T15:37:11.441 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.429+0000 7f41e1b9b700 1 --2- 172.21.15.3:0/2274886442 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f41dc14b280 0x7f41dc14ba90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:11.441 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.429+0000 7f41e1b9b700 1 --2- 172.21.15.3:0/2274886442 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f41dc068e90 0x7f41dc14ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:11.441 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.429+0000 7f41e1b9b700 1 -- 172.21.15.3:0/2274886442 >> 172.21.15.3:0/2274886442 conn(0x7f41dc0c1f90 msgr2=0x7f41dc0c2390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:11.441 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.429+0000 7f41e1b9b700 1 -- 172.21.15.3:0/2274886442 shutdown_connections 2023-10-08T15:37:11.441 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.429+0000 7f41e1b9b700 1 -- 172.21.15.3:0/2274886442 wait complete. 2023-10-08T15:37:11.441 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.433+0000 7f41e1b9b700 1 Processor -- start 2023-10-08T15:37:11.441 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.433+0000 7f41e1b9b700 1 -- start start 2023-10-08T15:37:11.442 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.433+0000 7f41e1b9b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f41dc068e90 0x7f41dc1490b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:11.442 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.433+0000 7f41e1b9b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f41dc0be4d0 0x7f41dc146030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:11.442 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.433+0000 7f41e1b9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41dc14b280 0x7f41dc15b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:11.442 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.433+0000 7f41e1b9b700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41dc15b100 con 0x7f41dc0be4d0 2023-10-08T15:37:11.442 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.433+0000 7f41e1b9b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41dc1495f0 con 0x7f41dc14b280 2023-10-08T15:37:11.442 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.433+0000 7f41e1b9b700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41dc15aaf0 con 0x7f41dc068e90 2023-10-08T15:37:11.442 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.433+0000 7f41d2ffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f41dc0be4d0 0x7f41dc146030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:11.442 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.433+0000 7f41d2ffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f41dc0be4d0 0x7f41dc146030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52404/0 (socket says 172.21.15.3:52404) 2023-10-08T15:37:11.443 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.433+0000 7f41d2ffd700 1 -- 172.21.15.3:0/3120964024 learned_addr learned my addr 172.21.15.3:0/3120964024 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:11.443 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.433+0000 7f41db7fe700 1 --2- 172.21.15.3:0/3120964024 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f41dc068e90 0x7f41dc1490b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:11.443 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.433+0000 7f41dbfff700 1 --2- 172.21.15.3:0/3120964024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41dc14b280 0x7f41dc15b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:11.443 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.433+0000 7f41d2ffd700 1 -- 172.21.15.3:0/3120964024 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f41dc068e90 msgr2=0x7f41dc1490b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:11.443 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.433+0000 7f41d2ffd700 1 --2- 172.21.15.3:0/3120964024 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f41dc068e90 0x7f41dc1490b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:11.443 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.433+0000 7f41d2ffd700 1 -- 172.21.15.3:0/3120964024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41dc14b280 msgr2=0x7f41dc15b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:11.444 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.433+0000 7f41d2ffd700 1 --2- 172.21.15.3:0/3120964024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41dc14b280 0x7f41dc15b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:11.444 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.433+0000 7f41d2ffd700 1 -- 172.21.15.3:0/3120964024 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d4009a20 con 0x7f41dc0be4d0 2023-10-08T15:37:11.444 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.433+0000 7f41d2ffd700 1 --2- 172.21.15.3:0/3120964024 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f41dc0be4d0 0x7f41dc146030 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f41c400cb90 tx=0x7f41c4001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:11.445 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.433+0000 7f41d3fff700 1 -- 172.21.15.3:0/3120964024 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c4007e90 con 0x7f41dc0be4d0 2023-10-08T15:37:11.446 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.433+0000 7f41d3fff700 1 -- 172.21.15.3:0/3120964024 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41c4007360 con 0x7f41dc0be4d0 2023-10-08T15:37:11.446 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.433+0000 7f41e1b9b700 1 -- 172.21.15.3:0/3120964024 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41dc146570 con 0x7f41dc0be4d0 2023-10-08T15:37:11.446 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.433+0000 7f41d3fff700 1 -- 172.21.15.3:0/3120964024 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c4007700 con 0x7f41dc0be4d0 2023-10-08T15:37:11.446 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.433+0000 7f41e1b9b700 1 -- 172.21.15.3:0/3120964024 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41dc15bad0 con 0x7f41dc0be4d0 2023-10-08T15:37:11.446 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.433+0000 7f41d3fff700 1 -- 172.21.15.3:0/3120964024 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f41c4004cc0 con 0x7f41dc0be4d0 2023-10-08T15:37:11.446 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.433+0000 7f41d3fff700 1 -- 172.21.15.3:0/3120964024 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f41c400ac60 con 0x7f41dc0be4d0 2023-10-08T15:37:11.447 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.437+0000 7f41e1b9b700 1 -- 172.21.15.3:0/3120964024 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41dc15b270 con 0x7f41dc0be4d0 2023-10-08T15:37:11.447 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.437+0000 7f41d3fff700 1 -- 172.21.15.3:0/3120964024 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f41c4018070 con 0x7f41dc0be4d0 2023-10-08T15:37:11.448 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-10-08T15:37:11.441+0000 7f1e620e7000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T15:37:11.500 INFO:tasks.ceph.mgr.x.smithi050.stderr:2023-10-08T15:37:11.497+0000 7f0469516000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T15:37:11.507 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.501+0000 7f41e1b9b700 1 -- 172.21.15.3:0/3120964024 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41dc05ecf0 con 0x7f41dc0be4d0 2023-10-08T15:37:11.508 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.501+0000 7f41d3fff700 1 -- 172.21.15.3:0/3120964024 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f41c400a5d0 con 0x7f41dc0be4d0 2023-10-08T15:37:11.509 INFO:teuthology.misc.health.smithi003.stdout: 2023-10-08T15:37:11.509 INFO:teuthology.misc.health.smithi003.stdout:{"epoch":10,"fsid":"7635972e-cd66-4a8f-a231-378db8b3847a","created":"2023-10-08T15:37:08.234594+0000","modified":"2023-10-08T15:37:10.269178+0000","last_up_change":"0.000000","last_in_change":"2023-10-08T15:37:10.269178+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"64fb1864-bfdd-4d75-9b41-03fb60085dc4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3ca6bd3a-3e8a-4c65-af9c-46148b0c2047","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6eb9f757-58dd-442f-910d-32401454bce3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1c39866b-ac2e-4ea9-a69c-02b01ee4191d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"15f86b61-b7f1-4780-ae00-9d80a68cb830","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"726c3003-34e6-4d5a-b6e2-f911e13c2118","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"401122a4-9988-441f-a5a7-39164434ebcd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"6b3fa236-c9d0-4c4d-82ae-9af4daf6d699","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:37:11.510 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.501+0000 7f41e1b9b700 1 -- 172.21.15.3:0/3120964024 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f41dc0be4d0 msgr2=0x7f41dc146030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:11.511 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.501+0000 7f41e1b9b700 1 --2- 172.21.15.3:0/3120964024 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f41dc0be4d0 0x7f41dc146030 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f41c400cb90 tx=0x7f41c4001b50 comp rx=0 tx=0).stop 2023-10-08T15:37:11.511 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.501+0000 7f41e1b9b700 1 -- 172.21.15.3:0/3120964024 shutdown_connections 2023-10-08T15:37:11.511 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.501+0000 7f41e1b9b700 1 --2- 172.21.15.3:0/3120964024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41dc14b280 0x7f41dc15b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:11.511 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.501+0000 7f41e1b9b700 1 --2- 172.21.15.3:0/3120964024 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f41dc0be4d0 0x7f41dc146030 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:11.511 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.501+0000 7f41e1b9b700 1 --2- 172.21.15.3:0/3120964024 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f41dc068e90 0x7f41dc1490b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:11.511 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.501+0000 7f41e1b9b700 1 -- 172.21.15.3:0/3120964024 >> 172.21.15.3:0/3120964024 conn(0x7f41dc0c1f90 msgr2=0x7f41dc0be9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:11.512 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.501+0000 7f41e1b9b700 1 -- 172.21.15.3:0/3120964024 shutdown_connections 2023-10-08T15:37:11.512 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:11.501+0000 7f41e1b9b700 1 -- 172.21.15.3:0/3120964024 wait complete. 2023-10-08T15:37:11.514 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-10-08T15:37:11.509+0000 7f1e620e7000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T15:37:11.519 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-08T15:37:11.666 INFO:tasks.ceph.mgr.x.smithi050.stderr:2023-10-08T15:37:11.661+0000 7f0469516000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T15:37:11.682 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-10-08T15:37:11.673+0000 7f1e620e7000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T15:37:11.737 INFO:tasks.ceph.mgr.x.smithi050.stderr:2023-10-08T15:37:11.733+0000 7f0469516000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T15:37:11.751 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-10-08T15:37:11.745+0000 7f1e620e7000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T15:37:12.471 INFO:tasks.ceph.mgr.x.smithi050.stderr:2023-10-08T15:37:12.465+0000 7f0469516000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T15:37:12.482 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-10-08T15:37:12.477+0000 7f1e620e7000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T15:37:13.514 INFO:tasks.ceph.mgr.x.smithi050.stderr:2023-10-08T15:37:13.509+0000 7f045260e700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-08T15:37:13.514 INFO:tasks.ceph.mgr.x.smithi050.stderr:2023-10-08T15:37:13.509+0000 7f045260e700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-08T15:37:14.282 INFO:tasks.ceph.osd.5.smithi050.stderr:2023-10-08T15:37:14.277+0000 7f80d51763c0 -1 osd.5 0 log_to_monitors true 2023-10-08T15:37:14.343 INFO:tasks.ceph.osd.3.smithi003.stderr:2023-10-08T15:37:14.337+0000 7fedf1ca13c0 -1 osd.3 0 log_to_monitors true 2023-10-08T15:37:14.465 INFO:tasks.ceph.osd.0.smithi003.stderr:2023-10-08T15:37:14.457+0000 7f2f7044f3c0 -1 osd.0 0 log_to_monitors true 2023-10-08T15:37:14.471 INFO:tasks.ceph.osd.4.smithi050.stderr:2023-10-08T15:37:14.469+0000 7fd5c82933c0 -1 osd.4 0 log_to_monitors true 2023-10-08T15:37:14.565 INFO:tasks.ceph.osd.1.smithi003.stderr:2023-10-08T15:37:14.557+0000 7f00a9c703c0 -1 osd.1 0 log_to_monitors true 2023-10-08T15:37:14.602 INFO:tasks.ceph.osd.7.smithi050.stderr:2023-10-08T15:37:14.597+0000 7f14761d53c0 -1 osd.7 0 log_to_monitors true 2023-10-08T15:37:14.771 INFO:tasks.ceph.osd.6.smithi050.stderr:2023-10-08T15:37:14.765+0000 7f6d69bd33c0 -1 osd.6 0 log_to_monitors true 2023-10-08T15:37:14.840 INFO:tasks.ceph.osd.2.smithi003.stderr:2023-10-08T15:37:14.833+0000 7fd456edb3c0 -1 osd.2 0 log_to_monitors true 2023-10-08T15:37:16.432 INFO:tasks.ceph.osd.5.smithi050.stderr:2023-10-08T15:37:16.429+0000 7f80d0916700 -1 osd.5 0 waiting for initial osdmap 2023-10-08T15:37:16.439 INFO:tasks.ceph.osd.5.smithi050.stderr:2023-10-08T15:37:16.437+0000 7f80c96ba700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T15:37:16.439 INFO:tasks.ceph.osd.4.smithi050.stderr:2023-10-08T15:37:16.437+0000 7fd5c3a33700 -1 osd.4 0 waiting for initial osdmap 2023-10-08T15:37:16.443 INFO:tasks.ceph.osd.4.smithi050.stderr:2023-10-08T15:37:16.441+0000 7fd5bc7d7700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T15:37:16.520 INFO:tasks.ceph.osd.0.smithi003.stderr:2023-10-08T15:37:16.513+0000 7f2f6d414700 -1 osd.0 0 waiting for initial osdmap 2023-10-08T15:37:16.532 INFO:tasks.ceph.osd.3.smithi003.stderr:2023-10-08T15:37:16.525+0000 7feded441700 -1 osd.3 0 waiting for initial osdmap 2023-10-08T15:37:16.539 INFO:tasks.ceph.osd.0.smithi003.stderr:2023-10-08T15:37:16.533+0000 7f2f64993700 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T15:37:16.544 INFO:tasks.ceph.osd.3.smithi003.stderr:2023-10-08T15:37:16.537+0000 7fede61e5700 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T15:37:17.388 INFO:tasks.ceph.osd.6.smithi050.stderr:2023-10-08T15:37:17.385+0000 7f6d66b98700 -1 osd.6 0 waiting for initial osdmap 2023-10-08T15:37:17.394 INFO:tasks.ceph.osd.6.smithi050.stderr:2023-10-08T15:37:17.389+0000 7f6d5e117700 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T15:37:17.405 INFO:tasks.ceph.osd.7.smithi050.stderr:2023-10-08T15:37:17.401+0000 7f147319a700 -1 osd.7 0 waiting for initial osdmap 2023-10-08T15:37:17.411 INFO:tasks.ceph.osd.7.smithi050.stderr:2023-10-08T15:37:17.409+0000 7f146a719700 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T15:37:17.497 INFO:tasks.ceph.osd.2.smithi003.stderr:2023-10-08T15:37:17.489+0000 7fd45267b700 -1 osd.2 0 waiting for initial osdmap 2023-10-08T15:37:17.504 INFO:tasks.ceph.osd.2.smithi003.stderr:2023-10-08T15:37:17.497+0000 7fd44b41f700 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T15:37:17.507 INFO:tasks.ceph.osd.1.smithi003.stderr:2023-10-08T15:37:17.501+0000 7f00a5410700 -1 osd.1 0 waiting for initial osdmap 2023-10-08T15:37:17.513 INFO:tasks.ceph.osd.1.smithi003.stderr:2023-10-08T15:37:17.505+0000 7f009e1b4700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T15:37:18.326 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-08T15:37:18.431 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.425+0000 7f3661ab6700 1 Processor -- start 2023-10-08T15:37:18.431 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.425+0000 7f3661ab6700 1 -- start start 2023-10-08T15:37:18.433 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.425+0000 7f3661ab6700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f365c0bb030 0x7f365c14bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:18.433 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.425+0000 7f3661ab6700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f365c069bc0 0x7f365c146c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:18.434 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.425+0000 7f3661ab6700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f365c0a1b50 con 0x7f365c06c880 2023-10-08T15:37:18.434 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.425+0000 7f3661ab6700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f365c0babd0 con 0x7f365c0bb030 2023-10-08T15:37:18.434 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.425+0000 7f3661ab6700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f365c0a1520 con 0x7f365c069bc0 2023-10-08T15:37:18.434 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.425+0000 7f3653fff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f365c06c880 0x7f365c0694b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:59592/0 (socket says 172.21.15.3:59592) 2023-10-08T15:37:18.434 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.425+0000 7f3653fff700 1 -- 172.21.15.3:0/2898939906 learned_addr learned my addr 172.21.15.3:0/2898939906 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:18.434 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.425+0000 7f365b7fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f365c0bb030 0x7f365c14bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:18.434 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.429+0000 7f365bfff700 1 --2- 172.21.15.3:0/2898939906 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f365c069bc0 0x7f365c146c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:18.436 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.429+0000 7f365affd700 1 -- 172.21.15.3:0/2898939906 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2870313172 0 0) 0x7f365c0a1b50 con 0x7f365c06c880 2023-10-08T15:37:18.436 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.429+0000 7f365b7fe700 1 -- 172.21.15.3:0/2898939906 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f365c069bc0 msgr2=0x7f365c146c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:18.436 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.429+0000 7f365b7fe700 1 --2- 172.21.15.3:0/2898939906 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f365c069bc0 0x7f365c146c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:18.436 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.429+0000 7f365b7fe700 1 -- 172.21.15.3:0/2898939906 >> v1:172.21.15.3:6789/0 conn(0x7f365c06c880 legacy=0x7f365c0694b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:18.436 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.429+0000 7f365b7fe700 1 -- 172.21.15.3:0/2898939906 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f365c0a17e0 con 0x7f365c0bb030 2023-10-08T15:37:18.436 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.429+0000 7f365b7fe700 1 --2- 172.21.15.3:0/2898939906 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f365c0bb030 0x7f365c14bbb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f364c0098e0 tx=0x7f364c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4c5e326e47312d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:18.436 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.429+0000 7f365affd700 1 -- 172.21.15.3:0/2898939906 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364c00b640 con 0x7f365c0bb030 2023-10-08T15:37:18.436 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.429+0000 7f365affd700 1 -- 172.21.15.3:0/2898939906 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f364c00b7a0 con 0x7f365c0bb030 2023-10-08T15:37:18.436 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.429+0000 7f365affd700 1 -- 172.21.15.3:0/2898939906 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364c00bb40 con 0x7f365c0bb030 2023-10-08T15:37:18.436 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.429+0000 7f3661ab6700 1 -- 172.21.15.3:0/2898939906 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f365c0bb030 msgr2=0x7f365c14bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:18.437 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.429+0000 7f3661ab6700 1 --2- 172.21.15.3:0/2898939906 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f365c0bb030 0x7f365c14bbb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f364c0098e0 tx=0x7f364c0091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:18.437 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.429+0000 7f3661ab6700 1 -- 172.21.15.3:0/2898939906 shutdown_connections 2023-10-08T15:37:18.437 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.429+0000 7f3661ab6700 1 --2- 172.21.15.3:0/2898939906 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f365c069bc0 0x7f365c146c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:18.437 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.429+0000 7f3661ab6700 1 --2- 172.21.15.3:0/2898939906 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f365c0bb030 0x7f365c14bbb0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:18.437 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.429+0000 7f3661ab6700 1 -- 172.21.15.3:0/2898939906 >> 172.21.15.3:0/2898939906 conn(0x7f365c0670e0 msgr2=0x7f365c0674e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:18.437 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.429+0000 7f3661ab6700 1 -- 172.21.15.3:0/2898939906 shutdown_connections 2023-10-08T15:37:18.437 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.429+0000 7f3661ab6700 1 -- 172.21.15.3:0/2898939906 wait complete. 2023-10-08T15:37:18.438 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.429+0000 7f3661ab6700 1 Processor -- start 2023-10-08T15:37:18.438 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.433+0000 7f3661ab6700 1 -- start start 2023-10-08T15:37:18.440 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.433+0000 7f3661ab6700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f365c069bc0 0x7f365c148620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:18.440 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.433+0000 7f3661ab6700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f365c06c880 0x7f365c156840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:18.440 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.433+0000 7f3661ab6700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f365c0bb030 0x7f365c0bd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:18.440 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.433+0000 7f3661ab6700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f365c140820 con 0x7f365c069bc0 2023-10-08T15:37:18.441 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.433+0000 7f3661ab6700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f365c148180 con 0x7f365c0bb030 2023-10-08T15:37:18.441 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.433+0000 7f3661ab6700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f365c159fa0 con 0x7f365c06c880 2023-10-08T15:37:18.441 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.433+0000 7f365b7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f365c069bc0 0x7f365c148620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:18.441 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.433+0000 7f365b7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f365c069bc0 0x7f365c148620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36540/0 (socket says 172.21.15.3:36540) 2023-10-08T15:37:18.441 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.433+0000 7f365b7fe700 1 -- 172.21.15.3:0/779728775 learned_addr learned my addr 172.21.15.3:0/779728775 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:18.441 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.433+0000 7f3653fff700 1 --2- 172.21.15.3:0/779728775 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f365c06c880 0x7f365c156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:18.441 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.433+0000 7f365bfff700 1 --2- 172.21.15.3:0/779728775 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f365c0bb030 0x7f365c0bd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:18.441 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.433+0000 7f365b7fe700 1 -- 172.21.15.3:0/779728775 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f365c06c880 msgr2=0x7f365c156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:18.441 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.433+0000 7f365b7fe700 1 --2- 172.21.15.3:0/779728775 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f365c06c880 0x7f365c156840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:18.441 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.433+0000 7f365b7fe700 1 -- 172.21.15.3:0/779728775 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f365c0bb030 msgr2=0x7f365c0bd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:18.442 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.433+0000 7f365b7fe700 1 --2- 172.21.15.3:0/779728775 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f365c0bb030 0x7f365c0bd9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:18.442 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.433+0000 7f365b7fe700 1 -- 172.21.15.3:0/779728775 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f364c009420 con 0x7f365c069bc0 2023-10-08T15:37:18.442 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.433+0000 7f365b7fe700 1 --2- 172.21.15.3:0/779728775 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f365c069bc0 0x7f365c148620 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f365c067dd0 tx=0x7f364c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:18.442 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.433+0000 7f36537fe700 1 -- 172.21.15.3:0/779728775 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364c00bb20 con 0x7f365c069bc0 2023-10-08T15:37:18.442 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.433+0000 7f36537fe700 1 -- 172.21.15.3:0/779728775 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f364c011420 con 0x7f365c069bc0 2023-10-08T15:37:18.442 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.433+0000 7f3661ab6700 1 -- 172.21.15.3:0/779728775 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f365c147ea0 con 0x7f365c069bc0 2023-10-08T15:37:18.442 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.433+0000 7f36537fe700 1 -- 172.21.15.3:0/779728775 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364c0117a0 con 0x7f365c069bc0 2023-10-08T15:37:18.442 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.433+0000 7f3661ab6700 1 -- 172.21.15.3:0/779728775 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f365c156d80 con 0x7f365c069bc0 2023-10-08T15:37:18.443 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.437+0000 7f3661ab6700 1 -- 172.21.15.3:0/779728775 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f365c15a1a0 con 0x7f365c069bc0 2023-10-08T15:37:18.443 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.437+0000 7f36537fe700 1 -- 172.21.15.3:0/779728775 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 4) v1 ==== 79903+0+0 (secure 0 0 0) 0x7f364c011b10 con 0x7f365c069bc0 2023-10-08T15:37:18.443 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.437+0000 7f36537fe700 1 --2- 172.21.15.3:0/779728775 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f363c0604f0 0x7f363c0629a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:18.443 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.437+0000 7f36537fe700 1 -- 172.21.15.3:0/779728775 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4842+0+0 (secure 0 0 0) 0x7f364c07d630 con 0x7f365c069bc0 2023-10-08T15:37:18.444 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.437+0000 7f3653fff700 1 --2- 172.21.15.3:0/779728775 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f363c0604f0 0x7f363c0629a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:18.444 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.437+0000 7f3653fff700 1 --2- 172.21.15.3:0/779728775 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f363c0604f0 0x7f363c0629a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f365c0be3a0 tx=0x7f3644009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:18.452 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.445+0000 7f36537fe700 1 -- 172.21.15.3:0/779728775 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f365c15a1a0 con 0x7f365c069bc0 2023-10-08T15:37:18.621 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.613+0000 7f3661ab6700 1 -- 172.21.15.3:0/779728775 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f365c15a170 con 0x7f365c069bc0 2023-10-08T15:37:18.622 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.617+0000 7f36537fe700 1 -- 172.21.15.3:0/779728775 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+12044 (secure 0 0 0) 0x7f364c04e040 con 0x7f365c069bc0 2023-10-08T15:37:18.622 INFO:teuthology.misc.health.smithi003.stdout: 2023-10-08T15:37:18.623 INFO:teuthology.misc.health.smithi003.stdout:{"epoch":15,"fsid":"7635972e-cd66-4a8f-a231-378db8b3847a","created":"2023-10-08T15:37:08.234594+0000","modified":"2023-10-08T15:37:18.550822+0000","last_up_change":"2023-10-08T15:37:17.537726+0000","last_in_change":"2023-10-08T15:37:10.269178+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:37:16.581590+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"64fb1864-bfdd-4d75-9b41-03fb60085dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33363},{"type":"v1","addr":"172.21.15.3:6801","nonce":33363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33363},{"type":"v1","addr":"172.21.15.3:6803","nonce":33363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":33363},{"type":"v1","addr":"172.21.15.3:6807","nonce":33363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33363},{"type":"v1","addr":"172.21.15.3:6805","nonce":33363}]},"public_addr":"172.21.15.3:6801/33363","cluster_addr":"172.21.15.3:6803/33363","heartbeat_back_addr":"172.21.15.3:6807/33363","heartbeat_front_addr":"172.21.15.3:6805/33363","state":["exists","up"]},{"osd":1,"uuid":"3ca6bd3a-3e8a-4c65-af9c-46148b0c2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33364},{"type":"v1","addr":"172.21.15.3:6820","nonce":33364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33364},{"type":"v1","addr":"172.21.15.3:6824","nonce":33364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33364},{"type":"v1","addr":"172.21.15.3:6831","nonce":33364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33364},{"type":"v1","addr":"172.21.15.3:6828","nonce":33364}]},"public_addr":"172.21.15.3:6820/33364","cluster_addr":"172.21.15.3:6824/33364","heartbeat_back_addr":"172.21.15.3:6831/33364","heartbeat_front_addr":"172.21.15.3:6828/33364","state":["exists","up"]},{"osd":2,"uuid":"6eb9f757-58dd-442f-910d-32401454bce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33366},{"type":"v1","addr":"172.21.15.3:6817","nonce":33366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":33366},{"type":"v1","addr":"172.21.15.3:6821","nonce":33366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6827","nonce":33366},{"type":"v1","addr":"172.21.15.3:6829","nonce":33366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":33366},{"type":"v1","addr":"172.21.15.3:6825","nonce":33366}]},"public_addr":"172.21.15.3:6817/33366","cluster_addr":"172.21.15.3:6821/33366","heartbeat_back_addr":"172.21.15.3:6829/33366","heartbeat_front_addr":"172.21.15.3:6825/33366","state":["exists","up"]},{"osd":3,"uuid":"1c39866b-ac2e-4ea9-a69c-02b01ee4191d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33365},{"type":"v1","addr":"172.21.15.3:6809","nonce":33365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":33365},{"type":"v1","addr":"172.21.15.3:6811","nonce":33365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33365},{"type":"v1","addr":"172.21.15.3:6815","nonce":33365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":33365},{"type":"v1","addr":"172.21.15.3:6813","nonce":33365}]},"public_addr":"172.21.15.3:6809/33365","cluster_addr":"172.21.15.3:6811/33365","heartbeat_back_addr":"172.21.15.3:6815/33365","heartbeat_front_addr":"172.21.15.3:6813/33365","state":["exists","up"]},{"osd":4,"uuid":"15f86b61-b7f1-4780-ae00-9d80a68cb830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":33605},{"type":"v1","addr":"172.21.15.50:6809","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33605},{"type":"v1","addr":"172.21.15.50:6811","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33605},{"type":"v1","addr":"172.21.15.50:6815","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":33605},{"type":"v1","addr":"172.21.15.50:6813","nonce":33605}]},"public_addr":"172.21.15.50:6809/33605","cluster_addr":"172.21.15.50:6811/33605","heartbeat_back_addr":"172.21.15.50:6815/33605","heartbeat_front_addr":"172.21.15.50:6813/33605","state":["exists","up"]},{"osd":5,"uuid":"726c3003-34e6-4d5a-b6e2-f911e13c2118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33606},{"type":"v1","addr":"172.21.15.50:6801","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33606},{"type":"v1","addr":"172.21.15.50:6803","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33606},{"type":"v1","addr":"172.21.15.50:6807","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":33606},{"type":"v1","addr":"172.21.15.50:6805","nonce":33606}]},"public_addr":"172.21.15.50:6801/33606","cluster_addr":"172.21.15.50:6803/33606","heartbeat_back_addr":"172.21.15.50:6807/33606","heartbeat_front_addr":"172.21.15.50:6805/33606","state":["exists","up"]},{"osd":6,"uuid":"401122a4-9988-441f-a5a7-39164434ebcd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":33607},{"type":"v1","addr":"172.21.15.50:6819","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":33607},{"type":"v1","addr":"172.21.15.50:6823","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":33607},{"type":"v1","addr":"172.21.15.50:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":33607},{"type":"v1","addr":"172.21.15.50:6827","nonce":33607}]},"public_addr":"172.21.15.50:6819/33607","cluster_addr":"172.21.15.50:6823/33607","heartbeat_back_addr":"172.21.15.50:6831/33607","heartbeat_front_addr":"172.21.15.50:6827/33607","state":["exists","up"]},{"osd":7,"uuid":"6b3fa236-c9d0-4c4d-82ae-9af4daf6d699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33604},{"type":"v1","addr":"172.21.15.50:6818","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":33604},{"type":"v1","addr":"172.21.15.50:6822","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":33604},{"type":"v1","addr":"172.21.15.50:6830","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":33604},{"type":"v1","addr":"172.21.15.50:6826","nonce":33604}]},"public_addr":"172.21.15.50:6818/33604","cluster_addr":"172.21.15.50:6822/33604","heartbeat_back_addr":"172.21.15.50:6830/33604","heartbeat_front_addr":"172.21.15.50:6826/33604","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.497794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.529417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.873426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.325972+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.443971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.240795+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.739632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.643026+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:37:18.625 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.617+0000 7f3661ab6700 1 -- 172.21.15.3:0/779728775 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f363c0604f0 msgr2=0x7f363c0629a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:18.625 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.617+0000 7f3661ab6700 1 --2- 172.21.15.3:0/779728775 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f363c0604f0 0x7f363c0629a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f365c0be3a0 tx=0x7f3644009040 comp rx=0 tx=0).stop 2023-10-08T15:37:18.625 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.617+0000 7f3661ab6700 1 -- 172.21.15.3:0/779728775 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f365c069bc0 msgr2=0x7f365c148620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:18.626 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.617+0000 7f3661ab6700 1 --2- 172.21.15.3:0/779728775 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f365c069bc0 0x7f365c148620 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f365c067dd0 tx=0x7f364c017000 comp rx=0 tx=0).stop 2023-10-08T15:37:18.626 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.617+0000 7f3661ab6700 1 -- 172.21.15.3:0/779728775 shutdown_connections 2023-10-08T15:37:18.626 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.617+0000 7f3661ab6700 1 --2- 172.21.15.3:0/779728775 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f363c0604f0 0x7f363c0629a0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:18.626 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.617+0000 7f3661ab6700 1 --2- 172.21.15.3:0/779728775 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f365c0bb030 0x7f365c0bd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:18.626 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.617+0000 7f3661ab6700 1 --2- 172.21.15.3:0/779728775 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f365c06c880 0x7f365c156840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:18.626 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.617+0000 7f3661ab6700 1 --2- 172.21.15.3:0/779728775 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f365c069bc0 0x7f365c148620 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:18.626 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.617+0000 7f3661ab6700 1 -- 172.21.15.3:0/779728775 >> 172.21.15.3:0/779728775 conn(0x7f365c0670e0 msgr2=0x7f365c14b6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:18.626 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.617+0000 7f3661ab6700 1 -- 172.21.15.3:0/779728775 shutdown_connections 2023-10-08T15:37:18.627 INFO:teuthology.misc.health.smithi003.stderr:2023-10-08T15:37:18.617+0000 7f3661ab6700 1 -- 172.21.15.3:0/779728775 wait complete. 2023-10-08T15:37:18.635 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-08T15:37:18.636 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-08T15:37:18.636 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-08T15:37:18.636 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-08T15:37:18.638 INFO:tasks.ceph.mds.a:Started 2023-10-08T15:37:18.638 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-08T15:37:18.639 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-08T15:37:18.641 INFO:tasks.ceph.mds.b:Started 2023-10-08T15:37:18.642 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-08T15:37:18.642 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:37:18.713 INFO:tasks.ceph.mds.a.smithi003.stdout:starting mds.a at 2023-10-08T15:37:18.733 INFO:tasks.ceph.mds.b.smithi050.stdout:starting mds.b at 2023-10-08T15:37:18.741 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.733+0000 7fdb48bff700 1 Processor -- start 2023-10-08T15:37:18.742 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.733+0000 7fdb48bff700 1 -- start start 2023-10-08T15:37:18.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.737+0000 7fdb48bff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fdb441479e0 0x7fdb440b3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:18.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.737+0000 7fdb48bff700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb440bb790 con 0x7fdb4414c4b0 2023-10-08T15:37:18.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.737+0000 7fdb48bff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb440b1e80 con 0x7fdb44147db0 2023-10-08T15:37:18.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.737+0000 7fdb48bff700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb441494c0 con 0x7fdb441479e0 2023-10-08T15:37:18.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.737+0000 7fdb41d9b700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fdb4414c4b0 0x7fdb4406d710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:59616/0 (socket says 172.21.15.3:59616) 2023-10-08T15:37:18.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.737+0000 7fdb41d9b700 1 -- 172.21.15.3:0/1378497831 learned_addr learned my addr 172.21.15.3:0/1378497831 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:18.745 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.737+0000 7fdb4259c700 1 --2- 172.21.15.3:0/1378497831 >> v2:172.21.15.3:3300/0 conn(0x7fdb441479e0 0x7fdb440b3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:18.745 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.737+0000 7fdb4159a700 1 -- 172.21.15.3:0/1378497831 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3469269799 0 0) 0x7fdb440bb790 con 0x7fdb4414c4b0 2023-10-08T15:37:18.745 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.737+0000 7fdb4159a700 1 -- 172.21.15.3:0/1378497831 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb30003570 con 0x7fdb4414c4b0 2023-10-08T15:37:18.745 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.737+0000 7fdb4259c700 1 -- 172.21.15.3:0/1378497831 >> v1:172.21.15.50:6789/0 conn(0x7fdb44147db0 legacy=0x7fdb440b2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:18.745 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.737+0000 7fdb4259c700 1 -- 172.21.15.3:0/1378497831 >> v1:172.21.15.3:6789/0 conn(0x7fdb4414c4b0 legacy=0x7fdb4406d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:18.745 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.737+0000 7fdb4259c700 1 -- 172.21.15.3:0/1378497831 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb440bb4b0 con 0x7fdb441479e0 2023-10-08T15:37:18.745 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.737+0000 7fdb4259c700 1 --2- 172.21.15.3:0/1378497831 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb441479e0 0x7fdb440b3280 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fdb34009e60 tx=0x7fdb34009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a204ed015ab9493 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:18.745 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.737+0000 7fdb4159a700 1 -- 172.21.15.3:0/1378497831 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3400e070 con 0x7fdb441479e0 2023-10-08T15:37:18.745 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.737+0000 7fdb4159a700 1 -- 172.21.15.3:0/1378497831 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb3400bb60 con 0x7fdb441479e0 2023-10-08T15:37:18.746 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.737+0000 7fdb4159a700 1 -- 172.21.15.3:0/1378497831 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb34012430 con 0x7fdb441479e0 2023-10-08T15:37:18.750 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.737+0000 7fdb48bff700 1 -- 172.21.15.3:0/1378497831 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb441479e0 msgr2=0x7fdb440b3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:18.750 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.737+0000 7fdb48bff700 1 --2- 172.21.15.3:0/1378497831 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb441479e0 0x7fdb440b3280 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fdb34009e60 tx=0x7fdb34009780 comp rx=0 tx=0).stop 2023-10-08T15:37:18.750 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.737+0000 7fdb48bff700 1 -- 172.21.15.3:0/1378497831 shutdown_connections 2023-10-08T15:37:18.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.737+0000 7fdb48bff700 1 --2- 172.21.15.3:0/1378497831 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb441479e0 0x7fdb440b3280 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:18.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.737+0000 7fdb48bff700 1 -- 172.21.15.3:0/1378497831 >> 172.21.15.3:0/1378497831 conn(0x7fdb440be630 msgr2=0x7fdb440ba6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:18.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.737+0000 7fdb48bff700 1 -- 172.21.15.3:0/1378497831 shutdown_connections 2023-10-08T15:37:18.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.737+0000 7fdb48bff700 1 -- 172.21.15.3:0/1378497831 wait complete. 2023-10-08T15:37:18.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.741+0000 7fdb48bff700 1 Processor -- start 2023-10-08T15:37:18.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.741+0000 7fdb48bff700 1 -- start start 2023-10-08T15:37:18.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.741+0000 7fdb48bff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb441479e0 0x7fdb440b8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:18.752 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.741+0000 7fdb48bff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb44147db0 0x7fdb4414e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:18.753 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.741+0000 7fdb48bff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdb4414c4b0 0x7fdb4415b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:18.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.741+0000 7fdb48bff700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4415b470 con 0x7fdb441479e0 2023-10-08T15:37:18.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.741+0000 7fdb48bff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4414e880 con 0x7fdb44147db0 2023-10-08T15:37:18.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.741+0000 7fdb48bff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4415f3a0 con 0x7fdb4414c4b0 2023-10-08T15:37:18.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.741+0000 7fdb41d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb44147db0 0x7fdb4414e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:18.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.741+0000 7fdb4259c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb441479e0 0x7fdb440b8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:18.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.741+0000 7fdb41d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb44147db0 0x7fdb4414e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.3:48728/0 (socket says 172.21.15.3:48728) 2023-10-08T15:37:18.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.741+0000 7fdb41d9b700 1 -- 172.21.15.3:0/8447998 learned_addr learned my addr 172.21.15.3:0/8447998 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:18.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.741+0000 7fdb42d9d700 1 --2- 172.21.15.3:0/8447998 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdb4414c4b0 0x7fdb4415b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:18.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.741+0000 7fdb41d9b700 1 -- 172.21.15.3:0/8447998 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdb4414c4b0 msgr2=0x7fdb4415b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:18.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.741+0000 7fdb41d9b700 1 --2- 172.21.15.3:0/8447998 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdb4414c4b0 0x7fdb4415b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:18.755 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.741+0000 7fdb41d9b700 1 -- 172.21.15.3:0/8447998 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb441479e0 msgr2=0x7fdb440b8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:18.755 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.741+0000 7fdb41d9b700 1 --2- 172.21.15.3:0/8447998 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb441479e0 0x7fdb440b8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:18.755 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.741+0000 7fdb41d9b700 1 -- 172.21.15.3:0/8447998 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb34009a20 con 0x7fdb44147db0 2023-10-08T15:37:18.755 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.741+0000 7fdb41d9b700 1 --2- 172.21.15.3:0/8447998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb44147db0 0x7fdb4414e340 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c00c560 tx=0x7fdb2c007dd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:18.755 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.741+0000 7fdb3a7fc700 1 -- 172.21.15.3:0/8447998 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c005b30 con 0x7fdb44147db0 2023-10-08T15:37:18.755 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.741+0000 7fdb3a7fc700 1 -- 172.21.15.3:0/8447998 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb2c005c90 con 0x7fdb44147db0 2023-10-08T15:37:18.755 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.741+0000 7fdb3a7fc700 1 -- 172.21.15.3:0/8447998 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c0072e0 con 0x7fdb44147db0 2023-10-08T15:37:18.755 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.741+0000 7fdb48bff700 1 -- 172.21.15.3:0/8447998 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb4415f680 con 0x7fdb44147db0 2023-10-08T15:37:18.755 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.741+0000 7fdb48bff700 1 -- 172.21.15.3:0/8447998 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb440b6bf0 con 0x7fdb44147db0 2023-10-08T15:37:18.756 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.745+0000 7fdb48bff700 1 -- 172.21.15.3:0/8447998 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb4415b620 con 0x7fdb44147db0 2023-10-08T15:37:18.756 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.745+0000 7fdb3a7fc700 1 -- 172.21.15.3:0/8447998 <== mon.1 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 79903+0+0 (secure 0 0 0) 0x7fdb2c01b3b0 con 0x7fdb44147db0 2023-10-08T15:37:18.756 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.745+0000 7fdb3a7fc700 1 --2- 172.21.15.3:0/8447998 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fdb240604c0 0x7fdb24062970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:18.756 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.745+0000 7fdb3a7fc700 1 -- 172.21.15.3:0/8447998 <== mon.1 v2:172.21.15.50:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fdb2c07b650 con 0x7fdb44147db0 2023-10-08T15:37:18.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.745+0000 7fdb4259c700 1 --2- 172.21.15.3:0/8447998 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fdb240604c0 0x7fdb24062970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:18.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.745+0000 7fdb4259c700 1 --2- 172.21.15.3:0/8447998 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fdb240604c0 0x7fdb24062970 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fdb340097c0 tx=0x7fdb34019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:18.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.753+0000 7fdb3a7fc700 1 -- 172.21.15.3:0/8447998 <== mon.1 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fdb4415b620 con 0x7fdb44147db0 2023-10-08T15:37:18.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.917+0000 7fdb48bff700 1 -- 172.21.15.3:0/8447998 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdb4415b5e0 con 0x7fdb44147db0 2023-10-08T15:37:19.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.917+0000 7fdb3a7fc700 1 -- 172.21.15.3:0/8447998 <== mon.1 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+12044 (secure 0 0 0) 0x7fdb2c04c120 con 0x7fdb44147db0 2023-10-08T15:37:19.038 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:37:19.038 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":15,"fsid":"7635972e-cd66-4a8f-a231-378db8b3847a","created":"2023-10-08T15:37:08.234594+0000","modified":"2023-10-08T15:37:18.550822+0000","last_up_change":"2023-10-08T15:37:17.537726+0000","last_in_change":"2023-10-08T15:37:10.269178+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:37:16.581590+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"64fb1864-bfdd-4d75-9b41-03fb60085dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33363},{"type":"v1","addr":"172.21.15.3:6801","nonce":33363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33363},{"type":"v1","addr":"172.21.15.3:6803","nonce":33363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":33363},{"type":"v1","addr":"172.21.15.3:6807","nonce":33363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33363},{"type":"v1","addr":"172.21.15.3:6805","nonce":33363}]},"public_addr":"172.21.15.3:6801/33363","cluster_addr":"172.21.15.3:6803/33363","heartbeat_back_addr":"172.21.15.3:6807/33363","heartbeat_front_addr":"172.21.15.3:6805/33363","state":["exists","up"]},{"osd":1,"uuid":"3ca6bd3a-3e8a-4c65-af9c-46148b0c2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33364},{"type":"v1","addr":"172.21.15.3:6820","nonce":33364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33364},{"type":"v1","addr":"172.21.15.3:6824","nonce":33364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33364},{"type":"v1","addr":"172.21.15.3:6831","nonce":33364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33364},{"type":"v1","addr":"172.21.15.3:6828","nonce":33364}]},"public_addr":"172.21.15.3:6820/33364","cluster_addr":"172.21.15.3:6824/33364","heartbeat_back_addr":"172.21.15.3:6831/33364","heartbeat_front_addr":"172.21.15.3:6828/33364","state":["exists","up"]},{"osd":2,"uuid":"6eb9f757-58dd-442f-910d-32401454bce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33366},{"type":"v1","addr":"172.21.15.3:6817","nonce":33366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":33366},{"type":"v1","addr":"172.21.15.3:6821","nonce":33366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6827","nonce":33366},{"type":"v1","addr":"172.21.15.3:6829","nonce":33366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":33366},{"type":"v1","addr":"172.21.15.3:6825","nonce":33366}]},"public_addr":"172.21.15.3:6817/33366","cluster_addr":"172.21.15.3:6821/33366","heartbeat_back_addr":"172.21.15.3:6829/33366","heartbeat_front_addr":"172.21.15.3:6825/33366","state":["exists","up"]},{"osd":3,"uuid":"1c39866b-ac2e-4ea9-a69c-02b01ee4191d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33365},{"type":"v1","addr":"172.21.15.3:6809","nonce":33365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":33365},{"type":"v1","addr":"172.21.15.3:6811","nonce":33365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33365},{"type":"v1","addr":"172.21.15.3:6815","nonce":33365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":33365},{"type":"v1","addr":"172.21.15.3:6813","nonce":33365}]},"public_addr":"172.21.15.3:6809/33365","cluster_addr":"172.21.15.3:6811/33365","heartbeat_back_addr":"172.21.15.3:6815/33365","heartbeat_front_addr":"172.21.15.3:6813/33365","state":["exists","up"]},{"osd":4,"uuid":"15f86b61-b7f1-4780-ae00-9d80a68cb830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":33605},{"type":"v1","addr":"172.21.15.50:6809","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33605},{"type":"v1","addr":"172.21.15.50:6811","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33605},{"type":"v1","addr":"172.21.15.50:6815","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":33605},{"type":"v1","addr":"172.21.15.50:6813","nonce":33605}]},"public_addr":"172.21.15.50:6809/33605","cluster_addr":"172.21.15.50:6811/33605","heartbeat_back_addr":"172.21.15.50:6815/33605","heartbeat_front_addr":"172.21.15.50:6813/33605","state":["exists","up"]},{"osd":5,"uuid":"726c3003-34e6-4d5a-b6e2-f911e13c2118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33606},{"type":"v1","addr":"172.21.15.50:6801","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33606},{"type":"v1","addr":"172.21.15.50:6803","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33606},{"type":"v1","addr":"172.21.15.50:6807","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":33606},{"type":"v1","addr":"172.21.15.50:6805","nonce":33606}]},"public_addr":"172.21.15.50:6801/33606","cluster_addr":"172.21.15.50:6803/33606","heartbeat_back_addr":"172.21.15.50:6807/33606","heartbeat_front_addr":"172.21.15.50:6805/33606","state":["exists","up"]},{"osd":6,"uuid":"401122a4-9988-441f-a5a7-39164434ebcd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":33607},{"type":"v1","addr":"172.21.15.50:6819","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":33607},{"type":"v1","addr":"172.21.15.50:6823","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":33607},{"type":"v1","addr":"172.21.15.50:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":33607},{"type":"v1","addr":"172.21.15.50:6827","nonce":33607}]},"public_addr":"172.21.15.50:6819/33607","cluster_addr":"172.21.15.50:6823/33607","heartbeat_back_addr":"172.21.15.50:6831/33607","heartbeat_front_addr":"172.21.15.50:6827/33607","state":["exists","up"]},{"osd":7,"uuid":"6b3fa236-c9d0-4c4d-82ae-9af4daf6d699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33604},{"type":"v1","addr":"172.21.15.50:6818","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":33604},{"type":"v1","addr":"172.21.15.50:6822","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":33604},{"type":"v1","addr":"172.21.15.50:6830","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":33604},{"type":"v1","addr":"172.21.15.50:6826","nonce":33604}]},"public_addr":"172.21.15.50:6818/33604","cluster_addr":"172.21.15.50:6822/33604","heartbeat_back_addr":"172.21.15.50:6830/33604","heartbeat_front_addr":"172.21.15.50:6826/33604","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.497794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.529417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.873426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.325972+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.443971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.240795+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.739632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.643026+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:37:19.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.921+0000 7fdb48bff700 1 -- 172.21.15.3:0/8447998 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fdb240604c0 msgr2=0x7fdb24062970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:19.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.921+0000 7fdb48bff700 1 --2- 172.21.15.3:0/8447998 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fdb240604c0 0x7fdb24062970 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fdb340097c0 tx=0x7fdb34019000 comp rx=0 tx=0).stop 2023-10-08T15:37:19.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.921+0000 7fdb48bff700 1 -- 172.21.15.3:0/8447998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb44147db0 msgr2=0x7fdb4414e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:19.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.921+0000 7fdb48bff700 1 --2- 172.21.15.3:0/8447998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb44147db0 0x7fdb4414e340 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c00c560 tx=0x7fdb2c007dd0 comp rx=0 tx=0).stop 2023-10-08T15:37:19.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.921+0000 7fdb48bff700 1 -- 172.21.15.3:0/8447998 shutdown_connections 2023-10-08T15:37:19.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.921+0000 7fdb48bff700 1 --2- 172.21.15.3:0/8447998 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fdb240604c0 0x7fdb24062970 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:19.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.921+0000 7fdb48bff700 1 --2- 172.21.15.3:0/8447998 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdb4414c4b0 0x7fdb4415b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:19.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.921+0000 7fdb48bff700 1 --2- 172.21.15.3:0/8447998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb44147db0 0x7fdb4414e340 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:19.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.921+0000 7fdb48bff700 1 --2- 172.21.15.3:0/8447998 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb441479e0 0x7fdb440b8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:19.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.921+0000 7fdb48bff700 1 -- 172.21.15.3:0/8447998 >> 172.21.15.3:0/8447998 conn(0x7fdb440be630 msgr2=0x7fdb44147040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:19.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.921+0000 7fdb48bff700 1 -- 172.21.15.3:0/8447998 shutdown_connections 2023-10-08T15:37:19.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:18.921+0000 7fdb48bff700 1 -- 172.21.15.3:0/8447998 wait complete. 2023-10-08T15:37:19.042 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T15:37:16.581590+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-08T15:37:19.042 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T15:37:19.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.157+0000 7f083759e700 1 Processor -- start 2023-10-08T15:37:19.163 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.157+0000 7f083759e700 1 -- start start 2023-10-08T15:37:19.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.157+0000 7f083759e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f083806c5c0 0x7f08380be3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:19.352 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.157+0000 7f083759e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f08380a7bc0 0x7f083814bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:19.352 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.157+0000 7f083759e700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f083806ced0 con 0x7f08380a77f0 2023-10-08T15:37:19.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.157+0000 7f083759e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f083806e770 con 0x7f083806c5c0 2023-10-08T15:37:19.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.157+0000 7f083759e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0838069570 con 0x7f08380a7bc0 2023-10-08T15:37:19.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.157+0000 7f083659c700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f08380a77f0 0x7f08380a2200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:59624/0 (socket says 172.21.15.3:59624) 2023-10-08T15:37:19.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.157+0000 7f083659c700 1 -- 172.21.15.3:0/1497209274 learned_addr learned my addr 172.21.15.3:0/1497209274 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:19.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.157+0000 7f082ffff700 1 --2- 172.21.15.3:0/1497209274 >> v2:172.21.15.50:3300/0 conn(0x7f083806c5c0 0x7f08380be3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:19.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.157+0000 7f0836d9d700 1 --2- 172.21.15.3:0/1497209274 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f08380a7bc0 0x7f083814bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:19.359 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.157+0000 7f0835d9b700 1 -- 172.21.15.3:0/1497209274 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1095848885 0 0) 0x7f083806ced0 con 0x7f08380a77f0 2023-10-08T15:37:19.359 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.157+0000 7f0835d9b700 1 -- 172.21.15.3:0/1497209274 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0824003570 con 0x7f08380a77f0 2023-10-08T15:37:19.360 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.157+0000 7f0835d9b700 1 -- 172.21.15.3:0/1497209274 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3352181473 0 0) 0x7f0824003570 con 0x7f08380a77f0 2023-10-08T15:37:19.360 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.157+0000 7f082ffff700 1 -- 172.21.15.3:0/1497209274 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f08380a7bc0 msgr2=0x7f083814bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:19.360 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.157+0000 7f082ffff700 1 --2- 172.21.15.3:0/1497209274 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f08380a7bc0 0x7f083814bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:19.360 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.157+0000 7f082ffff700 1 -- 172.21.15.3:0/1497209274 >> v1:172.21.15.3:6789/0 conn(0x7f08380a77f0 legacy=0x7f08380a2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:19.360 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.157+0000 7f082ffff700 1 -- 172.21.15.3:0/1497209274 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f083814c620 con 0x7f083806c5c0 2023-10-08T15:37:19.360 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.157+0000 7f082ffff700 1 --2- 172.21.15.3:0/1497209274 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f083806c5c0 0x7f08380be3d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f08200098e0 tx=0x7f08200091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dddcda79a5a70955 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:19.360 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.161+0000 7f0835d9b700 1 -- 172.21.15.3:0/1497209274 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0828001470 con 0x7f083806c5c0 2023-10-08T15:37:19.360 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.161+0000 7f0835d9b700 1 -- 172.21.15.3:0/1497209274 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0820011420 con 0x7f083806c5c0 2023-10-08T15:37:19.360 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.161+0000 7f0835d9b700 1 -- 172.21.15.3:0/1497209274 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08200117c0 con 0x7f083806c5c0 2023-10-08T15:37:19.360 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.161+0000 7f083759e700 1 -- 172.21.15.3:0/1497209274 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f083806c5c0 msgr2=0x7f08380be3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:19.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.161+0000 7f083759e700 1 --2- 172.21.15.3:0/1497209274 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f083806c5c0 0x7f08380be3d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f08200098e0 tx=0x7f08200091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:19.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.161+0000 7f083759e700 1 -- 172.21.15.3:0/1497209274 shutdown_connections 2023-10-08T15:37:19.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.161+0000 7f083759e700 1 --2- 172.21.15.3:0/1497209274 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f08380a7bc0 0x7f083814bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:19.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.161+0000 7f083759e700 1 --2- 172.21.15.3:0/1497209274 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f083806c5c0 0x7f08380be3d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:19.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.161+0000 7f083759e700 1 -- 172.21.15.3:0/1497209274 >> 172.21.15.3:0/1497209274 conn(0x7f08380c29f0 msgr2=0x7f08380a1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:19.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.161+0000 7f083759e700 1 -- 172.21.15.3:0/1497209274 shutdown_connections 2023-10-08T15:37:19.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.161+0000 7f083759e700 1 -- 172.21.15.3:0/1497209274 wait complete. 2023-10-08T15:37:19.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.161+0000 7f083759e700 1 Processor -- start 2023-10-08T15:37:19.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.161+0000 7f083759e700 1 -- start start 2023-10-08T15:37:19.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.165+0000 7f083759e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f083806c5c0 0x7f083814d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:19.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.165+0000 7f083759e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08380a77f0 0x7f0838147a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:19.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.165+0000 7f083759e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f08380a7bc0 0x7f083815ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:19.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.165+0000 7f083759e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f083814fa60 con 0x7f083806c5c0 2023-10-08T15:37:19.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.165+0000 7f083759e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f083814d900 con 0x7f08380a77f0 2023-10-08T15:37:19.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.165+0000 7f083759e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0838146e80 con 0x7f08380a7bc0 2023-10-08T15:37:19.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.165+0000 7f083659c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f083806c5c0 0x7f083814d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:19.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.165+0000 7f082ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08380a77f0 0x7f0838147a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:19.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.165+0000 7f083659c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f083806c5c0 0x7f083814d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36576/0 (socket says 172.21.15.3:36576) 2023-10-08T15:37:19.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.165+0000 7f083659c700 1 -- 172.21.15.3:0/779431644 learned_addr learned my addr 172.21.15.3:0/779431644 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:19.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.165+0000 7f0836d9d700 1 --2- 172.21.15.3:0/779431644 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f08380a7bc0 0x7f083815ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:19.363 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.165+0000 7f083659c700 1 -- 172.21.15.3:0/779431644 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f08380a7bc0 msgr2=0x7f083815ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:19.363 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.165+0000 7f083659c700 1 --2- 172.21.15.3:0/779431644 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f08380a7bc0 0x7f083815ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:19.363 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.165+0000 7f083659c700 1 -- 172.21.15.3:0/779431644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08380a77f0 msgr2=0x7f0838147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:19.363 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.165+0000 7f083659c700 1 --2- 172.21.15.3:0/779431644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08380a77f0 0x7f0838147a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:19.363 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.165+0000 7f083659c700 1 -- 172.21.15.3:0/779431644 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0820009420 con 0x7f083806c5c0 2023-10-08T15:37:19.363 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.165+0000 7f0836d9d700 1 --2- 172.21.15.3:0/779431644 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f08380a7bc0 0x7f083815ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:37:19.363 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.165+0000 7f083659c700 1 --2- 172.21.15.3:0/779431644 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f083806c5c0 0x7f083814d3c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f082800cb90 tx=0x7f0828001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:19.363 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.165+0000 7f082e7fc700 1 -- 172.21.15.3:0/779431644 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0828007e90 con 0x7f083806c5c0 2023-10-08T15:37:19.363 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.165+0000 7f082e7fc700 1 -- 172.21.15.3:0/779431644 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0828007360 con 0x7f083806c5c0 2023-10-08T15:37:19.363 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.165+0000 7f083759e700 1 -- 172.21.15.3:0/779431644 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0838147fa0 con 0x7f083806c5c0 2023-10-08T15:37:19.363 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.165+0000 7f082e7fc700 1 -- 172.21.15.3:0/779431644 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0828007700 con 0x7f083806c5c0 2023-10-08T15:37:19.363 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.165+0000 7f083759e700 1 -- 172.21.15.3:0/779431644 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f083814f6f0 con 0x7f083806c5c0 2023-10-08T15:37:19.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.165+0000 7f083759e700 1 -- 172.21.15.3:0/779431644 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f083805ecf0 con 0x7f083806c5c0 2023-10-08T15:37:19.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.169+0000 7f082e7fc700 1 -- 172.21.15.3:0/779431644 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 4) v1 ==== 79903+0+0 (secure 0 0 0) 0x7f0828004a40 con 0x7f083806c5c0 2023-10-08T15:37:19.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.169+0000 7f082e7fc700 1 --2- 172.21.15.3:0/779431644 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f08180604c0 0x7f0818062970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:19.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.169+0000 7f082e7fc700 1 -- 172.21.15.3:0/779431644 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f082807bb20 con 0x7f083806c5c0 2023-10-08T15:37:19.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.169+0000 7f082ffff700 1 --2- 172.21.15.3:0/779431644 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f08180604c0 0x7f0818062970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:19.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.169+0000 7f082ffff700 1 --2- 172.21.15.3:0/779431644 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f08180604c0 0x7f0818062970 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f08200030c0 tx=0x7f0820016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:19.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.173+0000 7f082e7fc700 1 -- 172.21.15.3:0/779431644 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f082804c5c0 con 0x7f083806c5c0 2023-10-08T15:37:19.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.333+0000 7f083759e700 1 -- 172.21.15.3:0/779431644 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f083806cb60 con 0x7f083806c5c0 2023-10-08T15:37:19.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.333+0000 7f082e7fc700 1 -- 172.21.15.3:0/779431644 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v15) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0828018020 con 0x7f083806c5c0 2023-10-08T15:37:19.365 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2023-10-08T15:37:19.366 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.333+0000 7f083759e700 1 -- 172.21.15.3:0/779431644 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f08180604c0 msgr2=0x7f0818062970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:19.366 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.333+0000 7f083759e700 1 --2- 172.21.15.3:0/779431644 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f08180604c0 0x7f0818062970 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f08200030c0 tx=0x7f0820016000 comp rx=0 tx=0).stop 2023-10-08T15:37:19.366 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.333+0000 7f083759e700 1 -- 172.21.15.3:0/779431644 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f083806c5c0 msgr2=0x7f083814d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:19.366 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.333+0000 7f083759e700 1 --2- 172.21.15.3:0/779431644 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f083806c5c0 0x7f083814d3c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f082800cb90 tx=0x7f0828001b50 comp rx=0 tx=0).stop 2023-10-08T15:37:19.367 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.333+0000 7f083759e700 1 -- 172.21.15.3:0/779431644 shutdown_connections 2023-10-08T15:37:19.367 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.333+0000 7f083759e700 1 --2- 172.21.15.3:0/779431644 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f08180604c0 0x7f0818062970 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:19.367 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.333+0000 7f083759e700 1 --2- 172.21.15.3:0/779431644 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f08380a7bc0 0x7f083815ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:19.367 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.333+0000 7f083759e700 1 --2- 172.21.15.3:0/779431644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08380a77f0 0x7f0838147a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:19.367 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.333+0000 7f083759e700 1 --2- 172.21.15.3:0/779431644 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f083806c5c0 0x7f083814d3c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:19.367 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.333+0000 7f083759e700 1 -- 172.21.15.3:0/779431644 >> 172.21.15.3:0/779431644 conn(0x7f08380c29f0 msgr2=0x7f08381498c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:19.367 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.337+0000 7f083759e700 1 -- 172.21.15.3:0/779431644 shutdown_connections 2023-10-08T15:37:19.367 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.337+0000 7f083759e700 1 -- 172.21.15.3:0/779431644 wait complete. 2023-10-08T15:37:19.367 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:37:19.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.473+0000 7ff459caf700 1 Processor -- start 2023-10-08T15:37:19.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.473+0000 7ff459caf700 1 -- start start 2023-10-08T15:37:19.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.473+0000 7ff459caf700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff45414aac0 0x7ff4541411a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:19.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.473+0000 7ff459caf700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff454148f40 con 0x7ff4540a15e0 2023-10-08T15:37:19.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.473+0000 7ff459caf700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff45414bdc0 con 0x7ff454067f60 2023-10-08T15:37:19.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.473+0000 7ff459caf700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff454067640 con 0x7ff45414aac0 2023-10-08T15:37:19.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.473+0000 7ff4537fe700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7ff4540a15e0 0x7ff45414a3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:59634/0 (socket says 172.21.15.3:59634) 2023-10-08T15:37:19.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.473+0000 7ff4537fe700 1 -- 172.21.15.3:0/3044356937 learned_addr learned my addr 172.21.15.3:0/3044356937 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:19.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.473+0000 7ff44bfff700 1 --2- 172.21.15.3:0/3044356937 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff45414aac0 0x7ff4541411a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:19.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.473+0000 7ff452ffd700 1 -- 172.21.15.3:0/3044356937 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 317849509 0 0) 0x7ff454148f40 con 0x7ff4540a15e0 2023-10-08T15:37:19.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.473+0000 7ff452ffd700 1 -- 172.21.15.3:0/3044356937 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff440004680 con 0x7ff4540a15e0 2023-10-08T15:37:19.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.473+0000 7ff452ffd700 1 -- 172.21.15.3:0/3044356937 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2465473838 0 0) 0x7ff440004680 con 0x7ff4540a15e0 2023-10-08T15:37:19.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.473+0000 7ff452ffd700 1 -- 172.21.15.3:0/3044356937 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff45414aac0 msgr2=0x7ff4541411a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:19.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.473+0000 7ff452ffd700 1 --2- 172.21.15.3:0/3044356937 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff45414aac0 0x7ff4541411a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:19.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.473+0000 7ff452ffd700 1 -- 172.21.15.3:0/3044356937 >> v1:172.21.15.50:6789/0 conn(0x7ff454067f60 legacy=0x7ff4541416e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:19.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.473+0000 7ff452ffd700 1 -- 172.21.15.3:0/3044356937 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff45414b9f0 con 0x7ff4540a15e0 2023-10-08T15:37:19.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.473+0000 7ff452ffd700 1 -- 172.21.15.3:0/3044356937 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2285686191 0 0) 0x7ff444001470 con 0x7ff4540a15e0 2023-10-08T15:37:19.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.473+0000 7ff452ffd700 1 -- 172.21.15.3:0/3044356937 >> v1:172.21.15.3:6789/0 conn(0x7ff4540a15e0 legacy=0x7ff45414a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:19.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.473+0000 7ff452ffd700 1 --2- 172.21.15.3:0/3044356937 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff440004ba0 0x7ff440004f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:19.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.473+0000 7ff452ffd700 1 --2- 172.21.15.3:0/3044356937 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff45414aac0 0x7ff440005920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:19.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.473+0000 7ff452ffd700 1 --2- 172.21.15.3:0/3044356937 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff440005e60 0x7ff4400062d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:19.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.473+0000 7ff452ffd700 1 -- 172.21.15.3:0/3044356937 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff454067640 con 0x7ff440005e60 2023-10-08T15:37:19.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.473+0000 7ff452ffd700 1 -- 172.21.15.3:0/3044356937 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff44000cc50 con 0x7ff440004ba0 2023-10-08T15:37:19.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.473+0000 7ff452ffd700 1 -- 172.21.15.3:0/3044356937 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff44000ce10 con 0x7ff45414aac0 2023-10-08T15:37:19.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.473+0000 7ff4537fe700 1 --2- 172.21.15.3:0/3044356937 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff440004ba0 0x7ff440004f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:19.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.473+0000 7ff453fff700 1 --2- 172.21.15.3:0/3044356937 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff440005e60 0x7ff4400062d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:19.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.473+0000 7ff44bfff700 1 --2- 172.21.15.3:0/3044356937 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff45414aac0 0x7ff440005920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:19.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.473+0000 7ff4537fe700 1 -- 172.21.15.3:0/3044356937 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff45414aac0 msgr2=0x7ff440005920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:19.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.473+0000 7ff4537fe700 1 --2- 172.21.15.3:0/3044356937 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff45414aac0 0x7ff440005920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:19.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.473+0000 7ff4537fe700 1 -- 172.21.15.3:0/3044356937 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff440005e60 msgr2=0x7ff4400062d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:19.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.473+0000 7ff4537fe700 1 --2- 172.21.15.3:0/3044356937 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff440005e60 0x7ff4400062d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:19.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.473+0000 7ff4537fe700 1 -- 172.21.15.3:0/3044356937 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff440004680 con 0x7ff440004ba0 2023-10-08T15:37:19.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.477+0000 7ff4537fe700 1 --2- 172.21.15.3:0/3044356937 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff440004ba0 0x7ff440004f70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff44400e5d0 tx=0x7ff444007940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=928a09b4fee0cf2d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:19.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.477+0000 7ff452ffd700 1 -- 172.21.15.3:0/3044356937 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff444007c50 con 0x7ff440004ba0 2023-10-08T15:37:19.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.477+0000 7ff452ffd700 1 -- 172.21.15.3:0/3044356937 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff444005920 con 0x7ff440004ba0 2023-10-08T15:37:19.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.477+0000 7ff452ffd700 1 -- 172.21.15.3:0/3044356937 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff444005ce0 con 0x7ff440004ba0 2023-10-08T15:37:19.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.477+0000 7ff459caf700 1 -- 172.21.15.3:0/3044356937 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff440004ba0 msgr2=0x7ff440004f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:19.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.477+0000 7ff459caf700 1 --2- 172.21.15.3:0/3044356937 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff440004ba0 0x7ff440004f70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff44400e5d0 tx=0x7ff444007940 comp rx=0 tx=0).stop 2023-10-08T15:37:19.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.477+0000 7ff453fff700 1 -- 172.21.15.3:0/3044356937 reap_dead start 2023-10-08T15:37:19.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.477+0000 7ff459caf700 1 -- 172.21.15.3:0/3044356937 shutdown_connections 2023-10-08T15:37:19.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.477+0000 7ff459caf700 1 -- 172.21.15.3:0/3044356937 >> 172.21.15.3:0/3044356937 conn(0x7ff454068720 msgr2=0x7ff454068b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:19.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.477+0000 7ff459caf700 1 -- 172.21.15.3:0/3044356937 shutdown_connections 2023-10-08T15:37:19.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.477+0000 7ff459caf700 1 -- 172.21.15.3:0/3044356937 wait complete. 2023-10-08T15:37:19.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.477+0000 7ff459caf700 1 Processor -- start 2023-10-08T15:37:19.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.481+0000 7ff459caf700 1 -- start start 2023-10-08T15:37:19.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.481+0000 7ff459caf700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4540bc950 0x7ff454141670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:19.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.481+0000 7ff459caf700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff4540b4470 0x7ff454141bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:19.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.481+0000 7ff459caf700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff4540b3c30 0x7ff454157310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:19.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.481+0000 7ff459caf700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff454156c00 con 0x7ff4540b4470 2023-10-08T15:37:19.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.481+0000 7ff459caf700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff454156e80 con 0x7ff4540bc950 2023-10-08T15:37:19.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.481+0000 7ff459caf700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4541420f0 con 0x7ff4540b3c30 2023-10-08T15:37:19.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.481+0000 7ff44bfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff4540b4470 0x7ff454141bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:19.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.481+0000 7ff44bfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff4540b4470 0x7ff454141bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36588/0 (socket says 172.21.15.3:36588) 2023-10-08T15:37:19.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.481+0000 7ff44bfff700 1 -- 172.21.15.3:0/3752424515 learned_addr learned my addr 172.21.15.3:0/3752424515 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:19.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.481+0000 7ff4537fe700 1 --2- 172.21.15.3:0/3752424515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4540bc950 0x7ff454141670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:19.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.481+0000 7ff453fff700 1 --2- 172.21.15.3:0/3752424515 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff4540b3c30 0x7ff454157310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:19.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.481+0000 7ff44bfff700 1 -- 172.21.15.3:0/3752424515 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff4540b3c30 msgr2=0x7ff454157310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:19.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.481+0000 7ff44bfff700 1 --2- 172.21.15.3:0/3752424515 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff4540b3c30 0x7ff454157310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:19.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.481+0000 7ff44bfff700 1 -- 172.21.15.3:0/3752424515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4540bc950 msgr2=0x7ff454141670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:19.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.481+0000 7ff44bfff700 1 --2- 172.21.15.3:0/3752424515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4540bc950 0x7ff454141670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:19.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.481+0000 7ff44bfff700 1 -- 172.21.15.3:0/3752424515 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4540b2f10 con 0x7ff4540b4470 2023-10-08T15:37:19.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.481+0000 7ff44bfff700 1 --2- 172.21.15.3:0/3752424515 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff4540b4470 0x7ff454141bb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff43c011d40 tx=0x7ff43c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:19.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.481+0000 7ff44b7fe700 1 -- 172.21.15.3:0/3752424515 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43c00fa10 con 0x7ff4540b4470 2023-10-08T15:37:19.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.481+0000 7ff44b7fe700 1 -- 172.21.15.3:0/3752424515 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff43c00fb70 con 0x7ff4540b4470 2023-10-08T15:37:19.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.481+0000 7ff459caf700 1 -- 172.21.15.3:0/3752424515 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4540b2b20 con 0x7ff4540b4470 2023-10-08T15:37:19.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.481+0000 7ff44b7fe700 1 -- 172.21.15.3:0/3752424515 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43c014440 con 0x7ff4540b4470 2023-10-08T15:37:19.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.481+0000 7ff459caf700 1 -- 172.21.15.3:0/3752424515 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4540bcec0 con 0x7ff4540b4470 2023-10-08T15:37:19.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.485+0000 7ff459caf700 1 -- 172.21.15.3:0/3752424515 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff454157010 con 0x7ff4540b4470 2023-10-08T15:37:19.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.485+0000 7ff44b7fe700 1 -- 172.21.15.3:0/3752424515 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 4) v1 ==== 79903+0+0 (secure 0 0 0) 0x7ff43c014870 con 0x7ff4540b4470 2023-10-08T15:37:19.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.485+0000 7ff44b7fe700 1 --2- 172.21.15.3:0/3752424515 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff4340604c0 0x7ff434062970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:19.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.485+0000 7ff44b7fe700 1 -- 172.21.15.3:0/3752424515 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ff43c018030 con 0x7ff4540b4470 2023-10-08T15:37:19.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.485+0000 7ff4537fe700 1 --2- 172.21.15.3:0/3752424515 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff4340604c0 0x7ff434062970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:19.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.485+0000 7ff4537fe700 1 --2- 172.21.15.3:0/3752424515 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff4340604c0 0x7ff434062970 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff45406c690 tx=0x7ff444019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:19.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.493+0000 7ff44b7fe700 1 -- 172.21.15.3:0/3752424515 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff43c04d680 con 0x7ff4540b4470 2023-10-08T15:37:19.706 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.701+0000 7ff459caf700 1 -- 172.21.15.3:0/3752424515 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff454064530 con 0x7ff4540b4470 2023-10-08T15:37:19.706 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.701+0000 7ff44b7fe700 1 -- 172.21.15.3:0/3752424515 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1250 (secure 0 0 0) 0x7ff43c022090 con 0x7ff4540b4470 2023-10-08T15:37:19.707 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:37:19.707 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6833/519836882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":519836882},{"type":"v1","addr":"172.21.15.3:6833","nonce":519836882}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-10-08T15:37:19.710 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.705+0000 7ff459caf700 1 -- 172.21.15.3:0/3752424515 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff4340604c0 msgr2=0x7ff434062970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:19.710 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.705+0000 7ff459caf700 1 --2- 172.21.15.3:0/3752424515 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff4340604c0 0x7ff434062970 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff45406c690 tx=0x7ff444019000 comp rx=0 tx=0).stop 2023-10-08T15:37:19.710 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.705+0000 7ff459caf700 1 -- 172.21.15.3:0/3752424515 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff4540b4470 msgr2=0x7ff454141bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:19.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.705+0000 7ff459caf700 1 --2- 172.21.15.3:0/3752424515 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff4540b4470 0x7ff454141bb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff43c011d40 tx=0x7ff43c0091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:19.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.705+0000 7ff459caf700 1 -- 172.21.15.3:0/3752424515 shutdown_connections 2023-10-08T15:37:19.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.705+0000 7ff459caf700 1 --2- 172.21.15.3:0/3752424515 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff4340604c0 0x7ff434062970 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:19.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.705+0000 7ff459caf700 1 --2- 172.21.15.3:0/3752424515 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff4540b3c30 0x7ff454157310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:19.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.705+0000 7ff459caf700 1 --2- 172.21.15.3:0/3752424515 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff4540b4470 0x7ff454141bb0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:19.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.705+0000 7ff459caf700 1 --2- 172.21.15.3:0/3752424515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4540bc950 0x7ff454141670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:19.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.705+0000 7ff459caf700 1 -- 172.21.15.3:0/3752424515 >> 172.21.15.3:0/3752424515 conn(0x7ff454068720 msgr2=0x7ff45414af90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:19.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.705+0000 7ff459caf700 1 -- 172.21.15.3:0/3752424515 shutdown_connections 2023-10-08T15:37:19.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:19.705+0000 7ff459caf700 1 -- 172.21.15.3:0/3752424515 wait complete. 2023-10-08T15:37:19.712 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 2 2023-10-08T15:37:21.725 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:37:21.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:21.837+0000 7f3ed2920700 1 Processor -- start 2023-10-08T15:37:21.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:21.837+0000 7f3ed2920700 1 -- start start 2023-10-08T15:37:21.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:21.837+0000 7f3ed2920700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3ecc0bafe0 0x7f3ecc068ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:21.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:21.837+0000 7f3ed2920700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3ecc153ad0 0x7f3ecc14ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:21.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:21.837+0000 7f3ed2920700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ecc09e490 con 0x7f3ecc06d080 2023-10-08T15:37:21.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:21.837+0000 7f3ed2920700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ecc06ce30 con 0x7f3ecc153ad0 2023-10-08T15:37:21.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:21.837+0000 7f3ed2920700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ecc09e6e0 con 0x7f3ecc0bafe0 2023-10-08T15:37:21.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:21.837+0000 7f3ecbfff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3ecc0bafe0 0x7f3ecc068ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:21.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:21.837+0000 7f3ecbfff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3ecc0bafe0 0x7f3ecc068ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.3:57586/0 (socket says 172.21.15.3:57586) 2023-10-08T15:37:21.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:21.837+0000 7f3ecbfff700 1 -- 172.21.15.3:0/1137519868 learned_addr learned my addr 172.21.15.3:0/1137519868 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:21.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:21.837+0000 7f3ed0ebd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3ecc153ad0 0x7f3ecc14ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:21.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:21.837+0000 7f3ed0ebd700 1 -- 172.21.15.3:0/1137519868 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3ecc0bafe0 msgr2=0x7f3ecc068ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:21.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:21.837+0000 7f3ed0ebd700 1 --2- 172.21.15.3:0/1137519868 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3ecc0bafe0 0x7f3ecc068ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:21.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:21.837+0000 7f3ed0ebd700 1 -- 172.21.15.3:0/1137519868 >> v1:172.21.15.50:6789/0 conn(0x7f3ecc06d080 legacy=0x7f3ecc1533c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:21.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:21.837+0000 7f3ed0ebd700 1 -- 172.21.15.3:0/1137519868 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ecc153f50 con 0x7f3ecc153ad0 2023-10-08T15:37:21.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:21.837+0000 7f3ecbfff700 1 --2- 172.21.15.3:0/1137519868 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3ecc0bafe0 0x7f3ecc068ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:37:21.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:21.837+0000 7f3ed0ebd700 1 --2- 172.21.15.3:0/1137519868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ecc153ad0 0x7f3ecc14ef20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4009e60 tx=0x7f3ec4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c5015608a17e445 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:21.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:21.837+0000 7f3ecaffd700 1 -- 172.21.15.3:0/1137519868 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec400e070 con 0x7f3ecc153ad0 2023-10-08T15:37:21.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:21.837+0000 7f3ecaffd700 1 -- 172.21.15.3:0/1137519868 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec400bb60 con 0x7f3ecc153ad0 2023-10-08T15:37:21.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:21.837+0000 7f3ecaffd700 1 -- 172.21.15.3:0/1137519868 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec4012430 con 0x7f3ecc153ad0 2023-10-08T15:37:21.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:21.841+0000 7f3ed2920700 1 -- 172.21.15.3:0/1137519868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ecc153ad0 msgr2=0x7f3ecc14ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:21.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:21.841+0000 7f3ed2920700 1 --2- 172.21.15.3:0/1137519868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ecc153ad0 0x7f3ecc14ef20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4009e60 tx=0x7f3ec4009780 comp rx=0 tx=0).stop 2023-10-08T15:37:21.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:21.841+0000 7f3ed2920700 1 -- 172.21.15.3:0/1137519868 shutdown_connections 2023-10-08T15:37:21.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:21.841+0000 7f3ed2920700 1 --2- 172.21.15.3:0/1137519868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ecc153ad0 0x7f3ecc14ef20 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:21.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:21.841+0000 7f3ed2920700 1 --2- 172.21.15.3:0/1137519868 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3ecc0bafe0 0x7f3ecc068ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:21.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:21.841+0000 7f3ed2920700 1 -- 172.21.15.3:0/1137519868 >> 172.21.15.3:0/1137519868 conn(0x7f3ecc0be640 msgr2=0x7f3ecc0ba6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:21.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:21.841+0000 7f3ed2920700 1 -- 172.21.15.3:0/1137519868 shutdown_connections 2023-10-08T15:37:21.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:21.841+0000 7f3ed2920700 1 -- 172.21.15.3:0/1137519868 wait complete. 2023-10-08T15:37:21.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:21.841+0000 7f3ed2920700 1 Processor -- start 2023-10-08T15:37:21.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:21.841+0000 7f3ed2920700 1 -- start start 2023-10-08T15:37:21.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:21.841+0000 7f3ed2920700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3ecc06d080 0x7f3ecc14a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:21.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:21.841+0000 7f3ed2920700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3ecc0bafe0 0x7f3ecc0a0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:21.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:21.841+0000 7f3ed2920700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ecc153ad0 0x7f3ecc15ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:21.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:21.841+0000 7f3ed2920700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ecc15fb40 con 0x7f3ecc0bafe0 2023-10-08T15:37:21.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:21.841+0000 7f3ed2920700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ecc14a8d0 con 0x7f3ecc153ad0 2023-10-08T15:37:21.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:21.841+0000 7f3ed2920700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ecc15f7d0 con 0x7f3ecc06d080 2023-10-08T15:37:21.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:21.841+0000 7f3ecb7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3ecc0bafe0 0x7f3ecc0a0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:21.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:21.841+0000 7f3ecb7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3ecc0bafe0 0x7f3ecc0a0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36596/0 (socket says 172.21.15.3:36596) 2023-10-08T15:37:21.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:21.841+0000 7f3ecb7fe700 1 -- 172.21.15.3:0/1733746123 learned_addr learned my addr 172.21.15.3:0/1733746123 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:21.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:21.841+0000 7f3ecbfff700 1 --2- 172.21.15.3:0/1733746123 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3ecc06d080 0x7f3ecc14a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:21.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:21.841+0000 7f3ed0ebd700 1 --2- 172.21.15.3:0/1733746123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ecc153ad0 0x7f3ecc15ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:21.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:21.845+0000 7f3ed0ebd700 1 -- 172.21.15.3:0/1733746123 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3ecc06d080 msgr2=0x7f3ecc14a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:21.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:21.845+0000 7f3ed0ebd700 1 --2- 172.21.15.3:0/1733746123 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3ecc06d080 0x7f3ecc14a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:21.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:21.845+0000 7f3ed0ebd700 1 -- 172.21.15.3:0/1733746123 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3ecc0bafe0 msgr2=0x7f3ecc0a0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:21.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:21.845+0000 7f3ed0ebd700 1 --2- 172.21.15.3:0/1733746123 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3ecc0bafe0 0x7f3ecc0a0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:21.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:21.845+0000 7f3ed0ebd700 1 -- 172.21.15.3:0/1733746123 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb4009480 con 0x7f3ecc153ad0 2023-10-08T15:37:21.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:21.845+0000 7f3ed0ebd700 1 --2- 172.21.15.3:0/1733746123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ecc153ad0 0x7f3ecc15ffd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4016000 tx=0x7f3ec4019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:21.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:21.845+0000 7f3ec3fff700 1 -- 172.21.15.3:0/1733746123 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec4027470 con 0x7f3ecc153ad0 2023-10-08T15:37:21.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:21.845+0000 7f3ed2920700 1 -- 172.21.15.3:0/1733746123 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ec4009a20 con 0x7f3ecc153ad0 2023-10-08T15:37:21.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:21.845+0000 7f3ec3fff700 1 -- 172.21.15.3:0/1733746123 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec40275f0 con 0x7f3ecc153ad0 2023-10-08T15:37:21.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:21.845+0000 7f3ec3fff700 1 -- 172.21.15.3:0/1733746123 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec40279b0 con 0x7f3ecc153ad0 2023-10-08T15:37:21.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:21.845+0000 7f3ed2920700 1 -- 172.21.15.3:0/1733746123 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ecc148be0 con 0x7f3ecc153ad0 2023-10-08T15:37:21.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:21.845+0000 7f3ed2920700 1 -- 172.21.15.3:0/1733746123 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ecc15fcf0 con 0x7f3ecc153ad0 2023-10-08T15:37:21.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:21.845+0000 7f3ec3fff700 1 -- 172.21.15.3:0/1733746123 <== mon.1 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f3ec4024070 con 0x7f3ecc153ad0 2023-10-08T15:37:21.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:21.849+0000 7f3ec3fff700 1 --2- 172.21.15.3:0/1733746123 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3eac060580 0x7f3eac062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:21.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:21.849+0000 7f3ec3fff700 1 -- 172.21.15.3:0/1733746123 <== mon.1 v2:172.21.15.50:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3ec407f470 con 0x7f3ecc153ad0 2023-10-08T15:37:21.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:21.849+0000 7f3ecbfff700 1 --2- 172.21.15.3:0/1733746123 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3eac060580 0x7f3eac062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:21.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:21.849+0000 7f3ecbfff700 1 --2- 172.21.15.3:0/1733746123 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3eac060580 0x7f3eac062a30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4009f30 tx=0x7f3eb4009220 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:21.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:21.857+0000 7f3ec3fff700 1 -- 172.21.15.3:0/1733746123 <== mon.1 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3ec404fdb0 con 0x7f3ecc153ad0 2023-10-08T15:37:22.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.057+0000 7f3ed2920700 1 -- 172.21.15.3:0/1733746123 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3ecc064530 con 0x7f3ecc153ad0 2023-10-08T15:37:22.065 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.057+0000 7f3ec3fff700 1 -- 172.21.15.3:0/1733746123 <== mon.1 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2006 (secure 0 0 0) 0x7f3ec402c020 con 0x7f3ecc153ad0 2023-10-08T15:37:22.066 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:37:22.066 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6833/519836882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":519836882},{"type":"v1","addr":"172.21.15.3:6833","nonce":519836882}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4260,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1601527591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1601527591},{"type":"v1","addr":"172.21.15.50:6835","nonce":1601527591}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-10-08T15:37:22.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.061+0000 7f3ed2920700 1 -- 172.21.15.3:0/1733746123 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3eac060580 msgr2=0x7f3eac062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:22.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.061+0000 7f3ed2920700 1 --2- 172.21.15.3:0/1733746123 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3eac060580 0x7f3eac062a30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4009f30 tx=0x7f3eb4009220 comp rx=0 tx=0).stop 2023-10-08T15:37:22.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.061+0000 7f3ed2920700 1 -- 172.21.15.3:0/1733746123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ecc153ad0 msgr2=0x7f3ecc15ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:22.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.061+0000 7f3ed2920700 1 --2- 172.21.15.3:0/1733746123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ecc153ad0 0x7f3ecc15ffd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4016000 tx=0x7f3ec4019000 comp rx=0 tx=0).stop 2023-10-08T15:37:22.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.061+0000 7f3ed2920700 1 -- 172.21.15.3:0/1733746123 shutdown_connections 2023-10-08T15:37:22.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.061+0000 7f3ed2920700 1 --2- 172.21.15.3:0/1733746123 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3eac060580 0x7f3eac062a30 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:22.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.061+0000 7f3ed2920700 1 --2- 172.21.15.3:0/1733746123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ecc153ad0 0x7f3ecc15ffd0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:22.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.061+0000 7f3ed2920700 1 --2- 172.21.15.3:0/1733746123 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3ecc0bafe0 0x7f3ecc0a0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:22.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.061+0000 7f3ed2920700 1 --2- 172.21.15.3:0/1733746123 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3ecc06d080 0x7f3ecc14a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:22.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.061+0000 7f3ed2920700 1 -- 172.21.15.3:0/1733746123 >> 172.21.15.3:0/1733746123 conn(0x7f3ecc0be640 msgr2=0x7f3ecc150fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:22.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.061+0000 7f3ed2920700 1 -- 172.21.15.3:0/1733746123 shutdown_connections 2023-10-08T15:37:22.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.061+0000 7f3ed2920700 1 -- 172.21.15.3:0/1733746123 wait complete. 2023-10-08T15:37:22.070 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 3 2023-10-08T15:37:22.080 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:37:22.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.177+0000 7f6c18efb700 1 Processor -- start 2023-10-08T15:37:22.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.177+0000 7f6c18efb700 1 -- start start 2023-10-08T15:37:22.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.177+0000 7f6c18efb700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6c140a15e0 0x7f6c1414a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:22.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.177+0000 7f6c18efb700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6c14067f60 0x7f6c1414a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:22.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.177+0000 7f6c18efb700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c14148f40 con 0x7f6c140703a0 2023-10-08T15:37:22.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.177+0000 7f6c18efb700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c1414ae30 con 0x7f6c140a15e0 2023-10-08T15:37:22.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.177+0000 7f6c18efb700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1414bdc0 con 0x7f6c14067f60 2023-10-08T15:37:22.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.177+0000 7f6c12d9d700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f6c140703a0 0x7f6c141411a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:59638/0 (socket says 172.21.15.3:59638) 2023-10-08T15:37:22.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.177+0000 7f6c12d9d700 1 -- 172.21.15.3:0/2643164575 learned_addr learned my addr 172.21.15.3:0/2643164575 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:22.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.177+0000 7f6c11d9b700 1 --2- 172.21.15.3:0/2643164575 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6c14067f60 0x7f6c1414a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:22.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.177+0000 7f6c1259c700 1 --2- 172.21.15.3:0/2643164575 >> v2:172.21.15.50:3300/0 conn(0x7f6c140a15e0 0x7f6c1414a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:22.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.177+0000 7f6c1159a700 1 -- 172.21.15.3:0/2643164575 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 935690387 0 0) 0x7f6c14148f40 con 0x7f6c140703a0 2023-10-08T15:37:22.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.177+0000 7f6c1159a700 1 -- 172.21.15.3:0/2643164575 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bfc003570 con 0x7f6c140703a0 2023-10-08T15:37:22.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.177+0000 7f6c11d9b700 1 -- 172.21.15.3:0/2643164575 >> v2:172.21.15.50:3300/0 conn(0x7f6c140a15e0 msgr2=0x7f6c1414a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:22.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.177+0000 7f6c11d9b700 1 --2- 172.21.15.3:0/2643164575 >> v2:172.21.15.50:3300/0 conn(0x7f6c140a15e0 0x7f6c1414a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:22.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.177+0000 7f6c11d9b700 1 -- 172.21.15.3:0/2643164575 >> v1:172.21.15.3:6789/0 conn(0x7f6c140703a0 legacy=0x7f6c141411a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:22.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.177+0000 7f6c11d9b700 1 -- 172.21.15.3:0/2643164575 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c14067640 con 0x7f6c14067f60 2023-10-08T15:37:22.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.177+0000 7f6c11d9b700 1 --2- 172.21.15.3:0/2643164575 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6c14067f60 0x7f6c1414a8f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6c040098e0 tx=0x7f6c040091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f342b68774bc9d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:22.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.181+0000 7f6c1159a700 1 -- 172.21.15.3:0/2643164575 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c04011630 con 0x7f6c14067f60 2023-10-08T15:37:22.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.181+0000 7f6c1159a700 1 -- 172.21.15.3:0/2643164575 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c04011790 con 0x7f6c14067f60 2023-10-08T15:37:22.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.181+0000 7f6c1159a700 1 -- 172.21.15.3:0/2643164575 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c04011b30 con 0x7f6c14067f60 2023-10-08T15:37:22.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.181+0000 7f6c18efb700 1 -- 172.21.15.3:0/2643164575 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6c14067f60 msgr2=0x7f6c1414a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:22.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.181+0000 7f6c18efb700 1 --2- 172.21.15.3:0/2643164575 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6c14067f60 0x7f6c1414a8f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6c040098e0 tx=0x7f6c040091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:22.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.181+0000 7f6c18efb700 1 -- 172.21.15.3:0/2643164575 shutdown_connections 2023-10-08T15:37:22.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.181+0000 7f6c18efb700 1 --2- 172.21.15.3:0/2643164575 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6c14067f60 0x7f6c1414a8f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:22.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.181+0000 7f6c18efb700 1 --2- 172.21.15.3:0/2643164575 >> v2:172.21.15.50:3300/0 conn(0x7f6c140a15e0 0x7f6c1414a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:22.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.181+0000 7f6c18efb700 1 -- 172.21.15.3:0/2643164575 >> 172.21.15.3:0/2643164575 conn(0x7f6c14068720 msgr2=0x7f6c14068b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:22.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.181+0000 7f6c18efb700 1 -- 172.21.15.3:0/2643164575 shutdown_connections 2023-10-08T15:37:22.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.181+0000 7f6c18efb700 1 -- 172.21.15.3:0/2643164575 wait complete. 2023-10-08T15:37:22.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.181+0000 7f6c18efb700 1 Processor -- start 2023-10-08T15:37:22.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.181+0000 7f6c18efb700 1 -- start start 2023-10-08T15:37:22.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.181+0000 7f6c18efb700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6c14067f60 0x7f6c1415e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:22.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.181+0000 7f6c18efb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c140703a0 0x7f6c1413eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:22.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.181+0000 7f6c18efb700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6c140a15e0 0x7f6c1414c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:22.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.181+0000 7f6c18efb700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c14146df0 con 0x7f6c14067f60 2023-10-08T15:37:22.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.181+0000 7f6c18efb700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c14147320 con 0x7f6c140703a0 2023-10-08T15:37:22.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.181+0000 7f6c18efb700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1414e630 con 0x7f6c140a15e0 2023-10-08T15:37:22.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.181+0000 7f6c1259c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6c14067f60 0x7f6c1415e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:22.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.181+0000 7f6c1259c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6c14067f60 0x7f6c1415e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36602/0 (socket says 172.21.15.3:36602) 2023-10-08T15:37:22.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.181+0000 7f6c1259c700 1 -- 172.21.15.3:0/2234579360 learned_addr learned my addr 172.21.15.3:0/2234579360 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:22.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.185+0000 7f6c11d9b700 1 --2- 172.21.15.3:0/2234579360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c140703a0 0x7f6c1413eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:22.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.185+0000 7f6c12d9d700 1 --2- 172.21.15.3:0/2234579360 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6c140a15e0 0x7f6c1414c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:22.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.185+0000 7f6c1259c700 1 -- 172.21.15.3:0/2234579360 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6c140a15e0 msgr2=0x7f6c1414c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:22.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.185+0000 7f6c1259c700 1 --2- 172.21.15.3:0/2234579360 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6c140a15e0 0x7f6c1414c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:22.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.185+0000 7f6c1259c700 1 -- 172.21.15.3:0/2234579360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c140703a0 msgr2=0x7f6c1413eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:22.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.185+0000 7f6c1259c700 1 --2- 172.21.15.3:0/2234579360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c140703a0 0x7f6c1413eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:22.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.185+0000 7f6c1259c700 1 -- 172.21.15.3:0/2234579360 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c04009420 con 0x7f6c14067f60 2023-10-08T15:37:22.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.185+0000 7f6c12d9d700 1 --2- 172.21.15.3:0/2234579360 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6c140a15e0 0x7f6c1414c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:37:22.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.185+0000 7f6c1259c700 1 --2- 172.21.15.3:0/2234579360 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6c14067f60 0x7f6c1415e610 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6c0800ecb0 tx=0x7f6c080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:22.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.185+0000 7f6c027fc700 1 -- 172.21.15.3:0/2234579360 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0800c920 con 0x7f6c14067f60 2023-10-08T15:37:22.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.185+0000 7f6c18efb700 1 -- 172.21.15.3:0/2234579360 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c1413f940 con 0x7f6c14067f60 2023-10-08T15:37:22.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.185+0000 7f6c027fc700 1 -- 172.21.15.3:0/2234579360 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c0800ca80 con 0x7f6c14067f60 2023-10-08T15:37:22.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.185+0000 7f6c027fc700 1 -- 172.21.15.3:0/2234579360 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0800ce40 con 0x7f6c14067f60 2023-10-08T15:37:22.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.185+0000 7f6c18efb700 1 -- 172.21.15.3:0/2234579360 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c1413f3f0 con 0x7f6c14067f60 2023-10-08T15:37:22.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.185+0000 7f6c18efb700 1 -- 172.21.15.3:0/2234579360 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c14064530 con 0x7f6c14067f60 2023-10-08T15:37:22.194 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.185+0000 7f6c027fc700 1 -- 172.21.15.3:0/2234579360 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6c08013680 con 0x7f6c14067f60 2023-10-08T15:37:22.194 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.189+0000 7f6c027fc700 1 --2- 172.21.15.3:0/2234579360 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f6bf4060550 0x7f6bf4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:22.194 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.189+0000 7f6c027fc700 1 -- 172.21.15.3:0/2234579360 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f6c0807c6f0 con 0x7f6c14067f60 2023-10-08T15:37:22.194 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.189+0000 7f6c11d9b700 1 --2- 172.21.15.3:0/2234579360 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f6bf4060550 0x7f6bf4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:22.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.189+0000 7f6c11d9b700 1 --2- 172.21.15.3:0/2234579360 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f6bf4060550 0x7f6bf4062a00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6c040091e0 tx=0x7f6c04017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:22.205 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.197+0000 7f6c027fc700 1 -- 172.21.15.3:0/2234579360 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6c0804d030 con 0x7f6c14067f60 2023-10-08T15:37:22.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.357+0000 7f6c18efb700 1 -- 172.21.15.3:0/2234579360 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6c1414b9f0 con 0x7f6c14067f60 2023-10-08T15:37:22.366 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.361+0000 7f6c027fc700 1 -- 172.21.15.3:0/2234579360 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12031 (secure 0 0 0) 0x7f6c08050650 con 0x7f6c14067f60 2023-10-08T15:37:22.366 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:37:22.366 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":16,"fsid":"7635972e-cd66-4a8f-a231-378db8b3847a","created":"2023-10-08T15:37:08.234594+0000","modified":"2023-10-08T15:37:19.989970+0000","last_up_change":"2023-10-08T15:37:17.537726+0000","last_in_change":"2023-10-08T15:37:10.269178+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:37:16.581590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"64fb1864-bfdd-4d75-9b41-03fb60085dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33363},{"type":"v1","addr":"172.21.15.3:6801","nonce":33363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33363},{"type":"v1","addr":"172.21.15.3:6803","nonce":33363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":33363},{"type":"v1","addr":"172.21.15.3:6807","nonce":33363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33363},{"type":"v1","addr":"172.21.15.3:6805","nonce":33363}]},"public_addr":"172.21.15.3:6801/33363","cluster_addr":"172.21.15.3:6803/33363","heartbeat_back_addr":"172.21.15.3:6807/33363","heartbeat_front_addr":"172.21.15.3:6805/33363","state":["exists","up"]},{"osd":1,"uuid":"3ca6bd3a-3e8a-4c65-af9c-46148b0c2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33364},{"type":"v1","addr":"172.21.15.3:6820","nonce":33364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33364},{"type":"v1","addr":"172.21.15.3:6824","nonce":33364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33364},{"type":"v1","addr":"172.21.15.3:6831","nonce":33364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33364},{"type":"v1","addr":"172.21.15.3:6828","nonce":33364}]},"public_addr":"172.21.15.3:6820/33364","cluster_addr":"172.21.15.3:6824/33364","heartbeat_back_addr":"172.21.15.3:6831/33364","heartbeat_front_addr":"172.21.15.3:6828/33364","state":["exists","up"]},{"osd":2,"uuid":"6eb9f757-58dd-442f-910d-32401454bce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33366},{"type":"v1","addr":"172.21.15.3:6817","nonce":33366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":33366},{"type":"v1","addr":"172.21.15.3:6821","nonce":33366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6827","nonce":33366},{"type":"v1","addr":"172.21.15.3:6829","nonce":33366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":33366},{"type":"v1","addr":"172.21.15.3:6825","nonce":33366}]},"public_addr":"172.21.15.3:6817/33366","cluster_addr":"172.21.15.3:6821/33366","heartbeat_back_addr":"172.21.15.3:6829/33366","heartbeat_front_addr":"172.21.15.3:6825/33366","state":["exists","up"]},{"osd":3,"uuid":"1c39866b-ac2e-4ea9-a69c-02b01ee4191d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33365},{"type":"v1","addr":"172.21.15.3:6809","nonce":33365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":33365},{"type":"v1","addr":"172.21.15.3:6811","nonce":33365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33365},{"type":"v1","addr":"172.21.15.3:6815","nonce":33365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":33365},{"type":"v1","addr":"172.21.15.3:6813","nonce":33365}]},"public_addr":"172.21.15.3:6809/33365","cluster_addr":"172.21.15.3:6811/33365","heartbeat_back_addr":"172.21.15.3:6815/33365","heartbeat_front_addr":"172.21.15.3:6813/33365","state":["exists","up"]},{"osd":4,"uuid":"15f86b61-b7f1-4780-ae00-9d80a68cb830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":33605},{"type":"v1","addr":"172.21.15.50:6809","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33605},{"type":"v1","addr":"172.21.15.50:6811","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33605},{"type":"v1","addr":"172.21.15.50:6815","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":33605},{"type":"v1","addr":"172.21.15.50:6813","nonce":33605}]},"public_addr":"172.21.15.50:6809/33605","cluster_addr":"172.21.15.50:6811/33605","heartbeat_back_addr":"172.21.15.50:6815/33605","heartbeat_front_addr":"172.21.15.50:6813/33605","state":["exists","up"]},{"osd":5,"uuid":"726c3003-34e6-4d5a-b6e2-f911e13c2118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33606},{"type":"v1","addr":"172.21.15.50:6801","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33606},{"type":"v1","addr":"172.21.15.50:6803","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33606},{"type":"v1","addr":"172.21.15.50:6807","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":33606},{"type":"v1","addr":"172.21.15.50:6805","nonce":33606}]},"public_addr":"172.21.15.50:6801/33606","cluster_addr":"172.21.15.50:6803/33606","heartbeat_back_addr":"172.21.15.50:6807/33606","heartbeat_front_addr":"172.21.15.50:6805/33606","state":["exists","up"]},{"osd":6,"uuid":"401122a4-9988-441f-a5a7-39164434ebcd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":33607},{"type":"v1","addr":"172.21.15.50:6819","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":33607},{"type":"v1","addr":"172.21.15.50:6823","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":33607},{"type":"v1","addr":"172.21.15.50:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":33607},{"type":"v1","addr":"172.21.15.50:6827","nonce":33607}]},"public_addr":"172.21.15.50:6819/33607","cluster_addr":"172.21.15.50:6823/33607","heartbeat_back_addr":"172.21.15.50:6831/33607","heartbeat_front_addr":"172.21.15.50:6827/33607","state":["exists","up"]},{"osd":7,"uuid":"6b3fa236-c9d0-4c4d-82ae-9af4daf6d699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33604},{"type":"v1","addr":"172.21.15.50:6818","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":33604},{"type":"v1","addr":"172.21.15.50:6822","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":33604},{"type":"v1","addr":"172.21.15.50:6830","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":33604},{"type":"v1","addr":"172.21.15.50:6826","nonce":33604}]},"public_addr":"172.21.15.50:6818/33604","cluster_addr":"172.21.15.50:6822/33604","heartbeat_back_addr":"172.21.15.50:6830/33604","heartbeat_front_addr":"172.21.15.50:6826/33604","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.497794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.529417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.873426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.325972+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.443971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.240795+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.739632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.643026+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:37:22.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.361+0000 7f6c18efb700 1 -- 172.21.15.3:0/2234579360 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f6bf4060550 msgr2=0x7f6bf4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:22.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.361+0000 7f6c18efb700 1 --2- 172.21.15.3:0/2234579360 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f6bf4060550 0x7f6bf4062a00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6c040091e0 tx=0x7f6c04017000 comp rx=0 tx=0).stop 2023-10-08T15:37:22.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.361+0000 7f6c18efb700 1 -- 172.21.15.3:0/2234579360 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6c14067f60 msgr2=0x7f6c1415e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:22.369 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.361+0000 7f6c18efb700 1 --2- 172.21.15.3:0/2234579360 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6c14067f60 0x7f6c1415e610 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6c0800ecb0 tx=0x7f6c080091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:22.369 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.361+0000 7f6c18efb700 1 -- 172.21.15.3:0/2234579360 shutdown_connections 2023-10-08T15:37:22.369 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.361+0000 7f6c18efb700 1 --2- 172.21.15.3:0/2234579360 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f6bf4060550 0x7f6bf4062a00 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:22.369 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.361+0000 7f6c18efb700 1 --2- 172.21.15.3:0/2234579360 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6c140a15e0 0x7f6c1414c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:22.369 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.361+0000 7f6c18efb700 1 --2- 172.21.15.3:0/2234579360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c140703a0 0x7f6c1413eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:22.369 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.361+0000 7f6c18efb700 1 --2- 172.21.15.3:0/2234579360 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6c14067f60 0x7f6c1415e610 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:22.369 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.361+0000 7f6c18efb700 1 -- 172.21.15.3:0/2234579360 >> 172.21.15.3:0/2234579360 conn(0x7f6c14068720 msgr2=0x7f6c14068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:22.369 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.361+0000 7f6c18efb700 1 -- 172.21.15.3:0/2234579360 shutdown_connections 2023-10-08T15:37:22.369 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.361+0000 7f6c18efb700 1 -- 172.21.15.3:0/2234579360 wait complete. 2023-10-08T15:37:22.380 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T15:37:16.581590+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-08T15:37:22.380 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T15:37:22.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.493+0000 7fbd8447f700 1 Processor -- start 2023-10-08T15:37:22.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.493+0000 7fbd8447f700 1 -- start start 2023-10-08T15:37:22.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.493+0000 7fbd8447f700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fbd7c06c830 0x7fbd7c06d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:22.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.493+0000 7fbd8447f700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd7c14c0e0 con 0x7fbd7c0bf3a0 2023-10-08T15:37:22.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.493+0000 7fbd8447f700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd7c14c570 con 0x7fbd7c14a8a0 2023-10-08T15:37:22.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.493+0000 7fbd8447f700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd7c14ba90 con 0x7fbd7c06c830 2023-10-08T15:37:22.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.493+0000 7fbd81a1a700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fbd7c06c830 0x7fbd7c06d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:22.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.493+0000 7fbd8221b700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fbd7c0bf3a0 0x7fbd7c06cf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:59644/0 (socket says 172.21.15.3:59644) 2023-10-08T15:37:22.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.493+0000 7fbd8221b700 1 -- 172.21.15.3:0/3308502987 learned_addr learned my addr 172.21.15.3:0/3308502987 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:22.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.493+0000 7fbd81a1a700 1 -- 172.21.15.3:0/3308502987 >> v1:172.21.15.50:6789/0 conn(0x7fbd7c14a8a0 legacy=0x7fbd7c14acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:22.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.493+0000 7fbd81a1a700 1 -- 172.21.15.3:0/3308502987 >> v1:172.21.15.3:6789/0 conn(0x7fbd7c0bf3a0 legacy=0x7fbd7c06cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:22.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.493+0000 7fbd81a1a700 1 -- 172.21.15.3:0/3308502987 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd7c14bd70 con 0x7fbd7c06c830 2023-10-08T15:37:22.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.493+0000 7fbd81a1a700 1 --2- 172.21.15.3:0/3308502987 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbd7c06c830 0x7fbd7c06d660 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbd700098e0 tx=0x7fbd700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb733d07c78ddbd8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:22.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.493+0000 7fbd81219700 1 -- 172.21.15.3:0/3308502987 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd70009e80 con 0x7fbd7c06c830 2023-10-08T15:37:22.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.493+0000 7fbd81219700 1 -- 172.21.15.3:0/3308502987 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd7000b860 con 0x7fbd7c06c830 2023-10-08T15:37:22.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.493+0000 7fbd81219700 1 -- 172.21.15.3:0/3308502987 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd7000bc00 con 0x7fbd7c06c830 2023-10-08T15:37:22.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.493+0000 7fbd8447f700 1 -- 172.21.15.3:0/3308502987 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbd7c06c830 msgr2=0x7fbd7c06d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:22.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.493+0000 7fbd8447f700 1 --2- 172.21.15.3:0/3308502987 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbd7c06c830 0x7fbd7c06d660 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbd700098e0 tx=0x7fbd700091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:22.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.493+0000 7fbd8447f700 1 -- 172.21.15.3:0/3308502987 shutdown_connections 2023-10-08T15:37:22.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.493+0000 7fbd8447f700 1 --2- 172.21.15.3:0/3308502987 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbd7c06c830 0x7fbd7c06d660 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:22.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.493+0000 7fbd8447f700 1 -- 172.21.15.3:0/3308502987 >> 172.21.15.3:0/3308502987 conn(0x7fbd7c0c2a40 msgr2=0x7fbd7c0bea60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:22.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.493+0000 7fbd8447f700 1 -- 172.21.15.3:0/3308502987 shutdown_connections 2023-10-08T15:37:22.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.493+0000 7fbd8447f700 1 -- 172.21.15.3:0/3308502987 wait complete. 2023-10-08T15:37:22.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.497+0000 7fbd8447f700 1 Processor -- start 2023-10-08T15:37:22.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.497+0000 7fbd8447f700 1 -- start start 2023-10-08T15:37:22.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.497+0000 7fbd8447f700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbd7c06c830 0x7fbd7c143d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:22.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.497+0000 7fbd8447f700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbd7c0bf3a0 0x7fbd7c09bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:22.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.497+0000 7fbd8447f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd7c14a8a0 0x7fbd7c09c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:22.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.497+0000 7fbd8447f700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7c09d4b0 con 0x7fbd7c0bf3a0 2023-10-08T15:37:22.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.497+0000 7fbd8447f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7c09d780 con 0x7fbd7c14a8a0 2023-10-08T15:37:22.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.497+0000 7fbd8447f700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7c144930 con 0x7fbd7c06c830 2023-10-08T15:37:22.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.497+0000 7fbd81a1a700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbd7c0bf3a0 0x7fbd7c09bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:22.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.497+0000 7fbd81a1a700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbd7c0bf3a0 0x7fbd7c09bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36630/0 (socket says 172.21.15.3:36630) 2023-10-08T15:37:22.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.497+0000 7fbd8221b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbd7c06c830 0x7fbd7c143d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:22.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.497+0000 7fbd81a1a700 1 -- 172.21.15.3:0/876390148 learned_addr learned my addr 172.21.15.3:0/876390148 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:22.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.497+0000 7fbd82a1c700 1 --2- 172.21.15.3:0/876390148 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd7c14a8a0 0x7fbd7c09c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:22.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.497+0000 7fbd8221b700 1 -- 172.21.15.3:0/876390148 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd7c14a8a0 msgr2=0x7fbd7c09c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:22.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.497+0000 7fbd8221b700 1 --2- 172.21.15.3:0/876390148 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd7c14a8a0 0x7fbd7c09c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:22.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.497+0000 7fbd8221b700 1 -- 172.21.15.3:0/876390148 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbd7c0bf3a0 msgr2=0x7fbd7c09bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:22.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.497+0000 7fbd8221b700 1 --2- 172.21.15.3:0/876390148 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbd7c0bf3a0 0x7fbd7c09bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:22.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.497+0000 7fbd8221b700 1 -- 172.21.15.3:0/876390148 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd70009420 con 0x7fbd7c06c830 2023-10-08T15:37:22.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.497+0000 7fbd81a1a700 1 --2- 172.21.15.3:0/876390148 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbd7c0bf3a0 0x7fbd7c09bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:37:22.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.497+0000 7fbd8221b700 1 --2- 172.21.15.3:0/876390148 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbd7c06c830 0x7fbd7c143d80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c00cc70 tx=0x7fbd6c001a10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:22.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.497+0000 7fbd7a7fc700 1 -- 172.21.15.3:0/876390148 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c004bb0 con 0x7fbd7c06c830 2023-10-08T15:37:22.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.497+0000 7fbd7a7fc700 1 -- 172.21.15.3:0/876390148 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd6c004d30 con 0x7fbd7c06c830 2023-10-08T15:37:22.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.497+0000 7fbd8447f700 1 -- 172.21.15.3:0/876390148 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd7c09c650 con 0x7fbd7c06c830 2023-10-08T15:37:22.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.497+0000 7fbd7a7fc700 1 -- 172.21.15.3:0/876390148 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c004ea0 con 0x7fbd7c06c830 2023-10-08T15:37:22.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.497+0000 7fbd8447f700 1 -- 172.21.15.3:0/876390148 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd7c14f8d0 con 0x7fbd7c06c830 2023-10-08T15:37:22.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.501+0000 7fbd8447f700 1 -- 172.21.15.3:0/876390148 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd7c144b50 con 0x7fbd7c06c830 2023-10-08T15:37:22.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.501+0000 7fbd7a7fc700 1 -- 172.21.15.3:0/876390148 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fbd6c00ad10 con 0x7fbd7c06c830 2023-10-08T15:37:22.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.501+0000 7fbd7a7fc700 1 --2- 172.21.15.3:0/876390148 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbd68060550 0x7fbd68062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:22.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.501+0000 7fbd7a7fc700 1 -- 172.21.15.3:0/876390148 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fbd6c07bf80 con 0x7fbd7c06c830 2023-10-08T15:37:22.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.501+0000 7fbd81a1a700 1 --2- 172.21.15.3:0/876390148 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbd68060550 0x7fbd68062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:22.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.501+0000 7fbd81a1a700 1 --2- 172.21.15.3:0/876390148 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbd68060550 0x7fbd68062a00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c09f370 tx=0x7fbd70017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:22.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.513+0000 7fbd7a7fc700 1 -- 172.21.15.3:0/876390148 <== mon.2 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbd6c04c940 con 0x7fbd7c06c830 2023-10-08T15:37:22.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.677+0000 7fbd8447f700 1 -- 172.21.15.3:0/876390148 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbd7c064530 con 0x7fbd7c06c830 2023-10-08T15:37:22.686 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.681+0000 7fbd7a7fc700 1 -- 172.21.15.3:0/876390148 <== mon.2 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbd6c018020 con 0x7fbd7c06c830 2023-10-08T15:37:22.686 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2023-10-08T15:37:22.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.685+0000 7fbd8447f700 1 -- 172.21.15.3:0/876390148 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbd68060550 msgr2=0x7fbd68062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:22.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.685+0000 7fbd8447f700 1 --2- 172.21.15.3:0/876390148 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbd68060550 0x7fbd68062a00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c09f370 tx=0x7fbd70017000 comp rx=0 tx=0).stop 2023-10-08T15:37:22.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.685+0000 7fbd8447f700 1 -- 172.21.15.3:0/876390148 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbd7c06c830 msgr2=0x7fbd7c143d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:22.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.685+0000 7fbd8447f700 1 --2- 172.21.15.3:0/876390148 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbd7c06c830 0x7fbd7c143d80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c00cc70 tx=0x7fbd6c001a10 comp rx=0 tx=0).stop 2023-10-08T15:37:22.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.685+0000 7fbd8447f700 1 -- 172.21.15.3:0/876390148 shutdown_connections 2023-10-08T15:37:22.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.685+0000 7fbd8447f700 1 --2- 172.21.15.3:0/876390148 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbd68060550 0x7fbd68062a00 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:22.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.685+0000 7fbd8447f700 1 --2- 172.21.15.3:0/876390148 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd7c14a8a0 0x7fbd7c09c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:22.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.685+0000 7fbd8447f700 1 --2- 172.21.15.3:0/876390148 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbd7c0bf3a0 0x7fbd7c09bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:22.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.685+0000 7fbd8447f700 1 --2- 172.21.15.3:0/876390148 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbd7c06c830 0x7fbd7c143d80 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:22.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.685+0000 7fbd8447f700 1 -- 172.21.15.3:0/876390148 >> 172.21.15.3:0/876390148 conn(0x7fbd7c0c2a40 msgr2=0x7fbd7c06cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:22.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.685+0000 7fbd8447f700 1 -- 172.21.15.3:0/876390148 shutdown_connections 2023-10-08T15:37:22.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.685+0000 7fbd8447f700 1 -- 172.21.15.3:0/876390148 wait complete. 2023-10-08T15:37:22.704 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T15:37:22.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.801+0000 7f3766710700 1 Processor -- start 2023-10-08T15:37:22.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.801+0000 7f3766710700 1 -- start start 2023-10-08T15:37:22.808 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.801+0000 7f3766710700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f376014ac50 0x7f376014b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:22.808 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.801+0000 7f3766710700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f376006cc40 0x7f376014cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:22.808 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.801+0000 7f3766710700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f376014c6b0 con 0x7f376006be60 2023-10-08T15:37:22.808 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.801+0000 7f3766710700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f376014c060 con 0x7f376006cc40 2023-10-08T15:37:22.809 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.801+0000 7f3766710700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f376014c340 con 0x7f376014ac50 2023-10-08T15:37:22.809 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.801+0000 7f3765f0f700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f376006cc40 0x7f376014cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:22.809 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.801+0000 7f3765f0f700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f376006cc40 0x7f376014cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36636/0 (socket says 172.21.15.3:36636) 2023-10-08T15:37:22.809 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.801+0000 7f3765f0f700 1 -- 172.21.15.3:0/451454455 learned_addr learned my addr 172.21.15.3:0/451454455 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:22.809 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.801+0000 7f376570e700 1 --2- 172.21.15.3:0/451454455 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f376014ac50 0x7f376014b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:22.809 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.801+0000 7f3765f0f700 1 -- 172.21.15.3:0/451454455 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f376014ac50 msgr2=0x7f376014b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:22.809 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.801+0000 7f3765f0f700 1 --2- 172.21.15.3:0/451454455 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f376014ac50 0x7f376014b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:22.809 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.801+0000 7f3765f0f700 1 -- 172.21.15.3:0/451454455 >> v1:172.21.15.50:6789/0 conn(0x7f376006be60 legacy=0x7f376006c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:22.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.801+0000 7f3765f0f700 1 -- 172.21.15.3:0/451454455 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f376014e860 con 0x7f376006cc40 2023-10-08T15:37:22.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.801+0000 7f3765f0f700 1 --2- 172.21.15.3:0/451454455 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f376006cc40 0x7f376014cc40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3758009f20 tx=0x7f3758009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1279739dfd459a46 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:22.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.801+0000 7f3757fff700 1 -- 172.21.15.3:0/451454455 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375800e070 con 0x7f376006cc40 2023-10-08T15:37:22.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.801+0000 7f3757fff700 1 -- 172.21.15.3:0/451454455 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f375800ba80 con 0x7f376006cc40 2023-10-08T15:37:22.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.801+0000 7f3757fff700 1 -- 172.21.15.3:0/451454455 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37580092e0 con 0x7f376006cc40 2023-10-08T15:37:22.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.805+0000 7f3766710700 1 -- 172.21.15.3:0/451454455 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f376006cc40 msgr2=0x7f376014cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:22.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.805+0000 7f3766710700 1 --2- 172.21.15.3:0/451454455 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f376006cc40 0x7f376014cc40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3758009f20 tx=0x7f3758009840 comp rx=0 tx=0).stop 2023-10-08T15:37:22.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.805+0000 7f3766710700 1 -- 172.21.15.3:0/451454455 shutdown_connections 2023-10-08T15:37:22.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.805+0000 7f3766710700 1 --2- 172.21.15.3:0/451454455 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f376006cc40 0x7f376014cc40 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:22.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.805+0000 7f3766710700 1 --2- 172.21.15.3:0/451454455 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f376014ac50 0x7f376014b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:22.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.805+0000 7f3766710700 1 -- 172.21.15.3:0/451454455 >> 172.21.15.3:0/451454455 conn(0x7f37600c1df0 msgr2=0x7f37600c21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:22.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.805+0000 7f3766710700 1 -- 172.21.15.3:0/451454455 shutdown_connections 2023-10-08T15:37:22.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.805+0000 7f3766710700 1 -- 172.21.15.3:0/451454455 wait complete. 2023-10-08T15:37:22.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.805+0000 7f3766710700 1 Processor -- start 2023-10-08T15:37:22.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.805+0000 7f3766710700 1 -- start start 2023-10-08T15:37:22.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.805+0000 7f3766710700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f376006be60 0x7f376014d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:22.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.805+0000 7f3766710700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f376006cc40 0x7f376015e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:22.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.809+0000 7f3766710700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f376014ac50 0x7f376015e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:22.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.809+0000 7f3766710700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f376009c360 con 0x7f376006be60 2023-10-08T15:37:22.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.809+0000 7f3766710700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37601522f0 con 0x7f376014ac50 2023-10-08T15:37:22.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.809+0000 7f3766710700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f376009bd00 con 0x7f376006cc40 2023-10-08T15:37:22.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.809+0000 7f376570e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f376006be60 0x7f376014d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:22.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.809+0000 7f376570e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f376006be60 0x7f376014d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36646/0 (socket says 172.21.15.3:36646) 2023-10-08T15:37:22.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.809+0000 7f376570e700 1 -- 172.21.15.3:0/4041118368 learned_addr learned my addr 172.21.15.3:0/4041118368 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:22.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.809+0000 7f3764f0d700 1 --2- 172.21.15.3:0/4041118368 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f376006cc40 0x7f376015e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:22.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.809+0000 7f3765f0f700 1 --2- 172.21.15.3:0/4041118368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f376014ac50 0x7f376015e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:22.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.809+0000 7f376570e700 1 -- 172.21.15.3:0/4041118368 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f376006cc40 msgr2=0x7f376015e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:22.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.809+0000 7f376570e700 1 --2- 172.21.15.3:0/4041118368 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f376006cc40 0x7f376015e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:22.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.809+0000 7f376570e700 1 -- 172.21.15.3:0/4041118368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f376014ac50 msgr2=0x7f376015e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:22.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.809+0000 7f376570e700 1 --2- 172.21.15.3:0/4041118368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f376014ac50 0x7f376015e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:22.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.809+0000 7f376570e700 1 -- 172.21.15.3:0/4041118368 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3758009ae0 con 0x7f376006be60 2023-10-08T15:37:22.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.809+0000 7f376570e700 1 --2- 172.21.15.3:0/4041118368 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f376006be60 0x7f376014d180 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f375c00d860 tx=0x7f375c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:22.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.809+0000 7f37557fa700 1 -- 172.21.15.3:0/4041118368 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375c0125f0 con 0x7f376006be60 2023-10-08T15:37:22.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.809+0000 7f37557fa700 1 -- 172.21.15.3:0/4041118368 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f375c012750 con 0x7f376006be60 2023-10-08T15:37:22.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.809+0000 7f3766710700 1 -- 172.21.15.3:0/4041118368 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3760152780 con 0x7f376006be60 2023-10-08T15:37:22.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.809+0000 7f37557fa700 1 -- 172.21.15.3:0/4041118368 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375c012b10 con 0x7f376006be60 2023-10-08T15:37:22.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.809+0000 7f3766710700 1 -- 172.21.15.3:0/4041118368 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f376014ffb0 con 0x7f376006be60 2023-10-08T15:37:22.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.809+0000 7f3766710700 1 -- 172.21.15.3:0/4041118368 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3760151db0 con 0x7f376006be60 2023-10-08T15:37:22.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.813+0000 7f37557fa700 1 -- 172.21.15.3:0/4041118368 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f375c01e460 con 0x7f376006be60 2023-10-08T15:37:22.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.813+0000 7f37557fa700 1 --2- 172.21.15.3:0/4041118368 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3744060550 0x7f3744062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:22.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.813+0000 7f37557fa700 1 -- 172.21.15.3:0/4041118368 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f375c07ca20 con 0x7f376006be60 2023-10-08T15:37:22.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.813+0000 7f3764f0d700 1 --2- 172.21.15.3:0/4041118368 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3744060550 0x7f3744062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:22.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.813+0000 7f3764f0d700 1 --2- 172.21.15.3:0/4041118368 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3744060550 0x7f3744062a00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3760150950 tx=0x7f3750007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:22.826 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.821+0000 7f37557fa700 1 -- 172.21.15.3:0/4041118368 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f375c04d2c0 con 0x7f376006be60 2023-10-08T15:37:22.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.989+0000 7f3766710700 1 -- 172.21.15.3:0/4041118368 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f376005ecf0 con 0x7f376006be60 2023-10-08T15:37:22.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.989+0000 7f37557fa700 1 -- 172.21.15.3:0/4041118368 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f375c0508e0 con 0x7f376006be60 2023-10-08T15:37:22.995 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:37:22.995 INFO:teuthology.orchestra.run.smithi003.stdout:[ 2023-10-08T15:37:22.995 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:37:22.996 INFO:teuthology.orchestra.run.smithi003.stdout: "poolnum": 1, 2023-10-08T15:37:22.996 INFO:teuthology.orchestra.run.smithi003.stdout: "poolname": ".mgr" 2023-10-08T15:37:22.996 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:37:22.996 INFO:teuthology.orchestra.run.smithi003.stdout:] 2023-10-08T15:37:22.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.989+0000 7f3766710700 1 -- 172.21.15.3:0/4041118368 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3744060550 msgr2=0x7f3744062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:22.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.989+0000 7f3766710700 1 --2- 172.21.15.3:0/4041118368 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3744060550 0x7f3744062a00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3760150950 tx=0x7f3750007ec0 comp rx=0 tx=0).stop 2023-10-08T15:37:22.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.989+0000 7f3766710700 1 -- 172.21.15.3:0/4041118368 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f376006be60 msgr2=0x7f376014d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:22.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.989+0000 7f3766710700 1 --2- 172.21.15.3:0/4041118368 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f376006be60 0x7f376014d180 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f375c00d860 tx=0x7f375c008040 comp rx=0 tx=0).stop 2023-10-08T15:37:22.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.993+0000 7f3766710700 1 -- 172.21.15.3:0/4041118368 shutdown_connections 2023-10-08T15:37:22.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.993+0000 7f3766710700 1 --2- 172.21.15.3:0/4041118368 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3744060550 0x7f3744062a00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:22.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.993+0000 7f3766710700 1 --2- 172.21.15.3:0/4041118368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f376014ac50 0x7f376015e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:22.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.993+0000 7f3766710700 1 --2- 172.21.15.3:0/4041118368 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f376006cc40 0x7f376015e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:22.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.993+0000 7f3766710700 1 --2- 172.21.15.3:0/4041118368 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f376006be60 0x7f376014d180 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:22.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.993+0000 7f3766710700 1 -- 172.21.15.3:0/4041118368 >> 172.21.15.3:0/4041118368 conn(0x7f37600c1df0 msgr2=0x7f376014b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:22.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.993+0000 7f3766710700 1 -- 172.21.15.3:0/4041118368 shutdown_connections 2023-10-08T15:37:22.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:22.993+0000 7f3766710700 1 -- 172.21.15.3:0/4041118368 wait complete. 2023-10-08T15:37:23.009 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T15:37:23.009 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T15:37:23.128 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.121+0000 7fe0b2977700 1 Processor -- start 2023-10-08T15:37:23.128 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.121+0000 7fe0b2977700 1 -- start start 2023-10-08T15:37:23.129 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.121+0000 7fe0b2977700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe0ac0bc670 0x7fe0ac0bc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:23.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.121+0000 7fe0b2977700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe0ac0bca40 0x7fe0ac0bb650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:23.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.121+0000 7fe0b2977700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0ac0bce70 con 0x7fe0ac14d310 2023-10-08T15:37:23.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.121+0000 7fe0b2977700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0ac0ba960 con 0x7fe0ac0bca40 2023-10-08T15:37:23.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.121+0000 7fe0b2977700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ac0bb1c0 con 0x7fe0ac0bc670 2023-10-08T15:37:23.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.121+0000 7fe0b1174700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe0ac0bca40 0x7fe0ac0bb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:23.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.121+0000 7fe0b1975700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe0ac0bc670 0x7fe0ac0bc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:23.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.121+0000 7fe0b1174700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe0ac0bca40 0x7fe0ac0bb650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.3:48832/0 (socket says 172.21.15.3:48832) 2023-10-08T15:37:23.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.125+0000 7fe0b1174700 1 -- 172.21.15.3:0/2051619506 learned_addr learned my addr 172.21.15.3:0/2051619506 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:23.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.125+0000 7fe0b2176700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe0ac14d310 0x7fe0ac0a1fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.3:44824/0 (socket says 172.21.15.3:44824) 2023-10-08T15:37:23.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.125+0000 7fe0b1174700 1 -- 172.21.15.3:0/2051619506 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe0ac0bc670 msgr2=0x7fe0ac0bc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:23.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.125+0000 7fe0b1174700 1 --2- 172.21.15.3:0/2051619506 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe0ac0bc670 0x7fe0ac0bc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:23.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.125+0000 7fe0b1174700 1 -- 172.21.15.3:0/2051619506 >> v1:172.21.15.50:6789/0 conn(0x7fe0ac14d310 legacy=0x7fe0ac0a1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:23.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.125+0000 7fe0b0973700 1 -- 172.21.15.3:0/2051619506 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1691545831 0 0) 0x7fe0ac0bce70 con 0x7fe0ac14d310 2023-10-08T15:37:23.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.125+0000 7fe0b1174700 1 -- 172.21.15.3:0/2051619506 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0ac14d790 con 0x7fe0ac0bca40 2023-10-08T15:37:23.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.125+0000 7fe0b1174700 1 --2- 172.21.15.3:0/2051619506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0ac0bca40 0x7fe0ac0bb650 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe0a00099b0 tx=0x7fe0a0009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74633facee47aea3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:23.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.125+0000 7fe0b0973700 1 -- 172.21.15.3:0/2051619506 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a0009ea0 con 0x7fe0ac0bca40 2023-10-08T15:37:23.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.125+0000 7fe0b0973700 1 -- 172.21.15.3:0/2051619506 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0a000b860 con 0x7fe0ac0bca40 2023-10-08T15:37:23.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.125+0000 7fe0b0973700 1 -- 172.21.15.3:0/2051619506 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a000bc00 con 0x7fe0ac0bca40 2023-10-08T15:37:23.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.125+0000 7fe0b2977700 1 -- 172.21.15.3:0/2051619506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0ac0bca40 msgr2=0x7fe0ac0bb650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:23.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.125+0000 7fe0b2977700 1 --2- 172.21.15.3:0/2051619506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0ac0bca40 0x7fe0ac0bb650 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe0a00099b0 tx=0x7fe0a0009250 comp rx=0 tx=0).stop 2023-10-08T15:37:23.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.125+0000 7fe0b2977700 1 -- 172.21.15.3:0/2051619506 shutdown_connections 2023-10-08T15:37:23.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.125+0000 7fe0b2977700 1 --2- 172.21.15.3:0/2051619506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0ac0bca40 0x7fe0ac0bb650 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:23.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.125+0000 7fe0b2977700 1 --2- 172.21.15.3:0/2051619506 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe0ac0bc670 0x7fe0ac0bc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:23.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.125+0000 7fe0b2977700 1 -- 172.21.15.3:0/2051619506 >> 172.21.15.3:0/2051619506 conn(0x7fe0ac0670e0 msgr2=0x7fe0ac0674e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:23.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.125+0000 7fe0b2977700 1 -- 172.21.15.3:0/2051619506 shutdown_connections 2023-10-08T15:37:23.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.125+0000 7fe0b2977700 1 -- 172.21.15.3:0/2051619506 wait complete. 2023-10-08T15:37:23.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.125+0000 7fe0b2977700 1 Processor -- start 2023-10-08T15:37:23.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.125+0000 7fe0b2977700 1 -- start start 2023-10-08T15:37:23.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.129+0000 7fe0b2977700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe0ac0bc670 0x7fe0ac14bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:23.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.129+0000 7fe0b2977700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe0ac0bca40 0x7fe0ac147e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:23.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.129+0000 7fe0b2977700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0ac14d310 0x7fe0ac0b1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:23.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.129+0000 7fe0b2977700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ac0b3c10 con 0x7fe0ac0bca40 2023-10-08T15:37:23.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.129+0000 7fe0b2977700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ac15c4f0 con 0x7fe0ac14d310 2023-10-08T15:37:23.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.129+0000 7fe0b2977700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ac14c510 con 0x7fe0ac0bc670 2023-10-08T15:37:23.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.129+0000 7fe0b1174700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe0ac0bca40 0x7fe0ac147e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:23.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.129+0000 7fe0b1174700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe0ac0bca40 0x7fe0ac147e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36652/0 (socket says 172.21.15.3:36652) 2023-10-08T15:37:23.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.129+0000 7fe0b1174700 1 -- 172.21.15.3:0/1161974122 learned_addr learned my addr 172.21.15.3:0/1161974122 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:23.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.129+0000 7fe0b2176700 1 --2- 172.21.15.3:0/1161974122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0ac14d310 0x7fe0ac0b1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:23.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.129+0000 7fe0b1975700 1 --2- 172.21.15.3:0/1161974122 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe0ac0bc670 0x7fe0ac14bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:23.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.129+0000 7fe0b1174700 1 -- 172.21.15.3:0/1161974122 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe0ac0bc670 msgr2=0x7fe0ac14bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:23.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.129+0000 7fe0b1174700 1 --2- 172.21.15.3:0/1161974122 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe0ac0bc670 0x7fe0ac14bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:23.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.129+0000 7fe0b1174700 1 -- 172.21.15.3:0/1161974122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0ac14d310 msgr2=0x7fe0ac0b1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:23.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.129+0000 7fe0b1174700 1 --2- 172.21.15.3:0/1161974122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0ac14d310 0x7fe0ac0b1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:23.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.129+0000 7fe0b1174700 1 -- 172.21.15.3:0/1161974122 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a00094f0 con 0x7fe0ac0bca40 2023-10-08T15:37:23.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.129+0000 7fe0b1975700 1 --2- 172.21.15.3:0/1161974122 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe0ac0bc670 0x7fe0ac14bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:37:23.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.129+0000 7fe0b1174700 1 --2- 172.21.15.3:0/1161974122 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe0ac0bca40 0x7fe0ac147e30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac067d30 tx=0x7fe0a0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:23.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.129+0000 7fe09dffb700 1 -- 172.21.15.3:0/1161974122 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a000bbe0 con 0x7fe0ac0bca40 2023-10-08T15:37:23.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.129+0000 7fe09dffb700 1 -- 172.21.15.3:0/1161974122 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0a0011420 con 0x7fe0ac0bca40 2023-10-08T15:37:23.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.129+0000 7fe0b2977700 1 -- 172.21.15.3:0/1161974122 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0ac0b6770 con 0x7fe0ac0bca40 2023-10-08T15:37:23.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.129+0000 7fe09dffb700 1 -- 172.21.15.3:0/1161974122 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a00117c0 con 0x7fe0ac0bca40 2023-10-08T15:37:23.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.129+0000 7fe0b2977700 1 -- 172.21.15.3:0/1161974122 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0ac15c6e0 con 0x7fe0ac0bca40 2023-10-08T15:37:23.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.129+0000 7fe09dffb700 1 -- 172.21.15.3:0/1161974122 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe0a0011bf0 con 0x7fe0ac0bca40 2023-10-08T15:37:23.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.133+0000 7fe0b2977700 1 -- 172.21.15.3:0/1161974122 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0ac15c900 con 0x7fe0ac0bca40 2023-10-08T15:37:23.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.133+0000 7fe09dffb700 1 --2- 172.21.15.3:0/1161974122 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe090060580 0x7fe090062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:23.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.133+0000 7fe09dffb700 1 -- 172.21.15.3:0/1161974122 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fe0a007d4f0 con 0x7fe0ac0bca40 2023-10-08T15:37:23.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.133+0000 7fe0b1975700 1 --2- 172.21.15.3:0/1161974122 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe090060580 0x7fe090062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:23.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.133+0000 7fe0b1975700 1 --2- 172.21.15.3:0/1161974122 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe090060580 0x7fe090062a30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8006f00 tx=0x7fe0a8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:23.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.141+0000 7fe09dffb700 1 -- 172.21.15.3:0/1161974122 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe0a004de10 con 0x7fe0ac0bca40 2023-10-08T15:37:23.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.305+0000 7fe0b2977700 1 -- 172.21.15.3:0/1161974122 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fe0ac05ecf0 con 0x7fe0ac0bca40 2023-10-08T15:37:23.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.993+0000 7fe09dffb700 1 -- 172.21.15.3:0/1161974122 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7fe0a00150b0 con 0x7fe0ac0bca40 2023-10-08T15:37:24.003 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.997+0000 7fe0b2977700 1 -- 172.21.15.3:0/1161974122 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe090060580 msgr2=0x7fe090062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:24.003 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.997+0000 7fe0b2977700 1 --2- 172.21.15.3:0/1161974122 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe090060580 0x7fe090062a30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8006f00 tx=0x7fe0a8008040 comp rx=0 tx=0).stop 2023-10-08T15:37:24.003 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.997+0000 7fe0b2977700 1 -- 172.21.15.3:0/1161974122 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe0ac0bca40 msgr2=0x7fe0ac147e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:24.003 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.997+0000 7fe0b2977700 1 --2- 172.21.15.3:0/1161974122 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe0ac0bca40 0x7fe0ac147e30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac067d30 tx=0x7fe0a0017000 comp rx=0 tx=0).stop 2023-10-08T15:37:24.003 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.997+0000 7fe0b2977700 1 -- 172.21.15.3:0/1161974122 shutdown_connections 2023-10-08T15:37:24.004 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.997+0000 7fe0b2977700 1 --2- 172.21.15.3:0/1161974122 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe090060580 0x7fe090062a30 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:24.004 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.997+0000 7fe0b2977700 1 --2- 172.21.15.3:0/1161974122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0ac14d310 0x7fe0ac0b1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:24.004 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.997+0000 7fe0b2977700 1 --2- 172.21.15.3:0/1161974122 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe0ac0bca40 0x7fe0ac147e30 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:24.004 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.997+0000 7fe0b2977700 1 --2- 172.21.15.3:0/1161974122 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe0ac0bc670 0x7fe0ac14bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:24.004 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.997+0000 7fe0b2977700 1 -- 172.21.15.3:0/1161974122 >> 172.21.15.3:0/1161974122 conn(0x7fe0ac0670e0 msgr2=0x7fe0ac0674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:24.004 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.997+0000 7fe0b2977700 1 -- 172.21.15.3:0/1161974122 shutdown_connections 2023-10-08T15:37:24.004 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:23.997+0000 7fe0b2977700 1 -- 172.21.15.3:0/1161974122 wait complete. 2023-10-08T15:37:24.004 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'cephfs_metadata' created 2023-10-08T15:37:24.020 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T15:37:24.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:24.129+0000 7f579f59e700 1 Processor -- start 2023-10-08T15:37:24.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:24.129+0000 7f579f59e700 1 -- start start 2023-10-08T15:37:24.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:24.133+0000 7f579f59e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f57a006f2f0 0x7f57a00685c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:24.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:24.133+0000 7f579f59e700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57a014b890 con 0x7f57a00681f0 2023-10-08T15:37:24.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:24.133+0000 7f579f59e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57a006e1f0 con 0x7f57a006ec60 2023-10-08T15:37:24.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:24.133+0000 7f579f59e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57a0148640 con 0x7f57a006f2f0 2023-10-08T15:37:24.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:24.133+0000 7f579e59c700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f57a00681f0 0x7f57a0147f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:59646/0 (socket says 172.21.15.3:59646) 2023-10-08T15:37:24.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:24.133+0000 7f579e59c700 1 -- 172.21.15.3:0/4223199835 learned_addr learned my addr 172.21.15.3:0/4223199835 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:24.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:24.133+0000 7f579ed9d700 1 --2- 172.21.15.3:0/4223199835 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f57a006f2f0 0x7f57a00685c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:24.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:24.133+0000 7f579dd9b700 1 -- 172.21.15.3:0/4223199835 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 868946365 0 0) 0x7f57a014b890 con 0x7f57a00681f0 2023-10-08T15:37:24.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:24.133+0000 7f579dd9b700 1 -- 172.21.15.3:0/4223199835 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5780003570 con 0x7f57a00681f0 2023-10-08T15:37:24.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:24.133+0000 7f579dd9b700 1 -- 172.21.15.3:0/4223199835 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3752773867 0 0) 0x7f57a006e1f0 con 0x7f57a006ec60 2023-10-08T15:37:24.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:24.133+0000 7f579dd9b700 1 -- 172.21.15.3:0/4223199835 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57a014b890 con 0x7f57a006ec60 2023-10-08T15:37:24.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:24.133+0000 7f579dd9b700 1 -- 172.21.15.3:0/4223199835 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2971017723 0 0) 0x7f5780003570 con 0x7f57a00681f0 2023-10-08T15:37:24.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:24.133+0000 7f579ed9d700 1 -- 172.21.15.3:0/4223199835 >> v1:172.21.15.50:6789/0 conn(0x7f57a006ec60 legacy=0x7f57a0148b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:24.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:24.133+0000 7f579ed9d700 1 -- 172.21.15.3:0/4223199835 >> v1:172.21.15.3:6789/0 conn(0x7f57a00681f0 legacy=0x7f57a0147f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:24.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:24.133+0000 7f579ed9d700 1 -- 172.21.15.3:0/4223199835 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a006e4d0 con 0x7f57a006f2f0 2023-10-08T15:37:24.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:24.133+0000 7f579ed9d700 1 --2- 172.21.15.3:0/4223199835 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f57a006f2f0 0x7f57a00685c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5798009e90 tx=0x7f5798009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d55fe166be124822 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:24.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:24.133+0000 7f579dd9b700 1 -- 172.21.15.3:0/4223199835 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579800e070 con 0x7f57a006f2f0 2023-10-08T15:37:24.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:24.133+0000 7f579dd9b700 1 -- 172.21.15.3:0/4223199835 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f579800b870 con 0x7f57a006f2f0 2023-10-08T15:37:24.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:24.133+0000 7f579dd9b700 1 -- 172.21.15.3:0/4223199835 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5790001470 con 0x7f57a006f2f0 2023-10-08T15:37:24.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:24.133+0000 7f579f59e700 1 -- 172.21.15.3:0/4223199835 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f57a006f2f0 msgr2=0x7f57a00685c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:24.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:24.133+0000 7f579f59e700 1 --2- 172.21.15.3:0/4223199835 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f57a006f2f0 0x7f57a00685c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5798009e90 tx=0x7f5798009780 comp rx=0 tx=0).stop 2023-10-08T15:37:24.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:24.133+0000 7f579f59e700 1 -- 172.21.15.3:0/4223199835 shutdown_connections 2023-10-08T15:37:24.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:24.133+0000 7f579f59e700 1 --2- 172.21.15.3:0/4223199835 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f57a006f2f0 0x7f57a00685c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:24.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:24.133+0000 7f579f59e700 1 -- 172.21.15.3:0/4223199835 >> 172.21.15.3:0/4223199835 conn(0x7f57a00bead0 msgr2=0x7f57a00beed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:24.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:24.133+0000 7f579f59e700 1 -- 172.21.15.3:0/4223199835 shutdown_connections 2023-10-08T15:37:24.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:24.133+0000 7f579f59e700 1 -- 172.21.15.3:0/4223199835 wait complete. 2023-10-08T15:37:24.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:24.137+0000 7f579f59e700 1 Processor -- start 2023-10-08T15:37:24.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:24.137+0000 7f579f59e700 1 -- start start 2023-10-08T15:37:24.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:24.137+0000 7f579f59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57a00681f0 0x7f57a01438f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:24.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:24.137+0000 7f579f59e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57a006ec60 0x7f57a0143e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:24.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:24.137+0000 7f579f59e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f57a006f2f0 0x7f57a0150250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:24.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:24.137+0000 7f579f59e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a00b42d0 con 0x7f57a006ec60 2023-10-08T15:37:24.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:24.137+0000 7f579f59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a0144370 con 0x7f57a00681f0 2023-10-08T15:37:24.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:24.137+0000 7f579f59e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57a015b6d0 con 0x7f57a006f2f0 2023-10-08T15:37:24.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:24.137+0000 7f5797fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57a006ec60 0x7f57a0143e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:24.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:24.137+0000 7f5797fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57a006ec60 0x7f57a0143e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36664/0 (socket says 172.21.15.3:36664) 2023-10-08T15:37:24.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:24.137+0000 7f5797fff700 1 -- 172.21.15.3:0/4239870566 learned_addr learned my addr 172.21.15.3:0/4239870566 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:24.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:24.137+0000 7f579ed9d700 1 --2- 172.21.15.3:0/4239870566 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f57a006f2f0 0x7f57a0150250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:24.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:24.137+0000 7f579e59c700 1 --2- 172.21.15.3:0/4239870566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57a00681f0 0x7f57a01438f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:24.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:24.137+0000 7f5797fff700 1 -- 172.21.15.3:0/4239870566 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f57a006f2f0 msgr2=0x7f57a0150250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:24.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:24.137+0000 7f5797fff700 1 --2- 172.21.15.3:0/4239870566 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f57a006f2f0 0x7f57a0150250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:24.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:24.137+0000 7f5797fff700 1 -- 172.21.15.3:0/4239870566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57a00681f0 msgr2=0x7f57a01438f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:24.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:24.137+0000 7f5797fff700 1 --2- 172.21.15.3:0/4239870566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57a00681f0 0x7f57a01438f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:24.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:24.137+0000 7f5797fff700 1 -- 172.21.15.3:0/4239870566 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5798009a20 con 0x7f57a006ec60 2023-10-08T15:37:24.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:24.137+0000 7f579e59c700 1 --2- 172.21.15.3:0/4239870566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57a00681f0 0x7f57a01438f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:37:24.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:24.137+0000 7f5797fff700 1 --2- 172.21.15.3:0/4239870566 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57a006ec60 0x7f57a0143e30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f578800c7c0 tx=0x7f5788007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:24.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:24.137+0000 7f57967fc700 1 -- 172.21.15.3:0/4239870566 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5788010510 con 0x7f57a006ec60 2023-10-08T15:37:24.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:24.137+0000 7f57967fc700 1 -- 172.21.15.3:0/4239870566 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5788010690 con 0x7f57a006ec60 2023-10-08T15:37:24.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:24.137+0000 7f579f59e700 1 -- 172.21.15.3:0/4239870566 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57a015b9d0 con 0x7f57a006ec60 2023-10-08T15:37:24.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:24.137+0000 7f57967fc700 1 -- 172.21.15.3:0/4239870566 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5788010a50 con 0x7f57a006ec60 2023-10-08T15:37:24.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:24.137+0000 7f579f59e700 1 -- 172.21.15.3:0/4239870566 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57a014cae0 con 0x7f57a006ec60 2023-10-08T15:37:24.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:24.141+0000 7f579f59e700 1 -- 172.21.15.3:0/4239870566 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57a005ecf0 con 0x7f57a006ec60 2023-10-08T15:37:24.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:24.141+0000 7f57967fc700 1 -- 172.21.15.3:0/4239870566 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f578801b3b0 con 0x7f57a006ec60 2023-10-08T15:37:24.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:24.141+0000 7f57967fc700 1 --2- 172.21.15.3:0/4239870566 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5784060550 0x7f5784062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:24.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:24.141+0000 7f57967fc700 1 -- 172.21.15.3:0/4239870566 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f578807c2d0 con 0x7f57a006ec60 2023-10-08T15:37:24.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:24.141+0000 7f579e59c700 1 --2- 172.21.15.3:0/4239870566 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5784060550 0x7f5784062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:24.150 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:24.145+0000 7f579e59c700 1 --2- 172.21.15.3:0/4239870566 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5784060550 0x7f5784062a00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f57900015a0 tx=0x7f5790000bc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:24.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:24.153+0000 7f57967fc700 1 -- 172.21.15.3:0/4239870566 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f578804cb20 con 0x7f57a006ec60 2023-10-08T15:37:24.324 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:24.317+0000 7f579f59e700 1 -- 172.21.15.3:0/4239870566 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f57a00ba810 con 0x7f57a006ec60 2023-10-08T15:37:25.014 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.005+0000 7f57967fc700 1 -- 172.21.15.3:0/4239870566 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7f5788017020 con 0x7f57a006ec60 2023-10-08T15:37:25.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.029+0000 7f579f59e700 1 -- 172.21.15.3:0/4239870566 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5784060550 msgr2=0x7f5784062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:25.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.029+0000 7f579f59e700 1 --2- 172.21.15.3:0/4239870566 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5784060550 0x7f5784062a00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f57900015a0 tx=0x7f5790000bc0 comp rx=0 tx=0).stop 2023-10-08T15:37:25.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.029+0000 7f579f59e700 1 -- 172.21.15.3:0/4239870566 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57a006ec60 msgr2=0x7f57a0143e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:25.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.029+0000 7f579f59e700 1 --2- 172.21.15.3:0/4239870566 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57a006ec60 0x7f57a0143e30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f578800c7c0 tx=0x7f5788007de0 comp rx=0 tx=0).stop 2023-10-08T15:37:25.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.029+0000 7f579f59e700 1 -- 172.21.15.3:0/4239870566 shutdown_connections 2023-10-08T15:37:25.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.029+0000 7f579f59e700 1 --2- 172.21.15.3:0/4239870566 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5784060550 0x7f5784062a00 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:25.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.029+0000 7f579f59e700 1 --2- 172.21.15.3:0/4239870566 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f57a006f2f0 0x7f57a0150250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:25.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.029+0000 7f579f59e700 1 --2- 172.21.15.3:0/4239870566 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57a006ec60 0x7f57a0143e30 secure :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f578800c7c0 tx=0x7f5788007de0 comp rx=0 tx=0).stop 2023-10-08T15:37:25.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.029+0000 7f579f59e700 1 --2- 172.21.15.3:0/4239870566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57a00681f0 0x7f57a01438f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:25.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.029+0000 7f579f59e700 1 -- 172.21.15.3:0/4239870566 >> 172.21.15.3:0/4239870566 conn(0x7f57a00bead0 msgr2=0x7f57a00beea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:25.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.033+0000 7f579f59e700 1 -- 172.21.15.3:0/4239870566 shutdown_connections 2023-10-08T15:37:25.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.033+0000 7f579f59e700 1 -- 172.21.15.3:0/4239870566 wait complete. 2023-10-08T15:37:25.040 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'cephfs_data' created 2023-10-08T15:37:25.051 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T15:37:25.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.153+0000 7f2173fff700 1 Processor -- start 2023-10-08T15:37:25.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.153+0000 7f2173fff700 1 -- start start 2023-10-08T15:37:25.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.157+0000 7f2173fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f217406d730 0x7f217414c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:25.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.157+0000 7f2173fff700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2174068e00 con 0x7f217406ef30 2023-10-08T15:37:25.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.157+0000 7f2173fff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f217414b4b0 con 0x7f217414e3c0 2023-10-08T15:37:25.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.157+0000 7f2173fff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f217406e7a0 con 0x7f217406d730 2023-10-08T15:37:25.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.157+0000 7f216bfff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f217406ef30 0x7f217414b9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:59652/0 (socket says 172.21.15.3:59652) 2023-10-08T15:37:25.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.157+0000 7f216bfff700 1 -- 172.21.15.3:0/1755243007 learned_addr learned my addr 172.21.15.3:0/1755243007 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:25.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.157+0000 7f21737fe700 1 --2- 172.21.15.3:0/1755243007 >> v2:172.21.15.50:3300/0 conn(0x7f217406d730 0x7f217414c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:25.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.157+0000 7f21727fc700 1 -- 172.21.15.3:0/1755243007 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1218256413 0 0) 0x7f2174068e00 con 0x7f217406ef30 2023-10-08T15:37:25.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.157+0000 7f21727fc700 1 -- 172.21.15.3:0/1755243007 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2160003570 con 0x7f217406ef30 2023-10-08T15:37:25.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.157+0000 7f21727fc700 1 -- 172.21.15.3:0/1755243007 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1020771799 0 0) 0x7f217414b4b0 con 0x7f217414e3c0 2023-10-08T15:37:25.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.157+0000 7f21727fc700 1 -- 172.21.15.3:0/1755243007 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2174068e00 con 0x7f217414e3c0 2023-10-08T15:37:25.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.157+0000 7f21737fe700 1 -- 172.21.15.3:0/1755243007 >> v1:172.21.15.50:6789/0 conn(0x7f217414e3c0 legacy=0x7f21740be950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:25.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.157+0000 7f21727fc700 1 -- 172.21.15.3:0/1755243007 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 460974934 0 0) 0x7f2160003570 con 0x7f217406ef30 2023-10-08T15:37:25.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.157+0000 7f21737fe700 1 -- 172.21.15.3:0/1755243007 >> v1:172.21.15.3:6789/0 conn(0x7f217406ef30 legacy=0x7f217414b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:25.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.157+0000 7f21737fe700 1 -- 172.21.15.3:0/1755243007 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2174069050 con 0x7f217406d730 2023-10-08T15:37:25.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.157+0000 7f21737fe700 1 --2- 172.21.15.3:0/1755243007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f217406d730 0x7f217414c0b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f216c009e60 tx=0x7f216c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e19ccdae74bb605 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:25.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.157+0000 7f21727fc700 1 -- 172.21.15.3:0/1755243007 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216c00e070 con 0x7f217406d730 2023-10-08T15:37:25.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.157+0000 7f21727fc700 1 -- 172.21.15.3:0/1755243007 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f216c00b7a0 con 0x7f217406d730 2023-10-08T15:37:25.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.157+0000 7f21727fc700 1 -- 172.21.15.3:0/1755243007 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215c001470 con 0x7f217406d730 2023-10-08T15:37:25.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.157+0000 7f2173fff700 1 -- 172.21.15.3:0/1755243007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f217406d730 msgr2=0x7f217414c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:25.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.157+0000 7f2173fff700 1 --2- 172.21.15.3:0/1755243007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f217406d730 0x7f217414c0b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f216c009e60 tx=0x7f216c009780 comp rx=0 tx=0).stop 2023-10-08T15:37:25.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.157+0000 7f2173fff700 1 -- 172.21.15.3:0/1755243007 shutdown_connections 2023-10-08T15:37:25.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.157+0000 7f2173fff700 1 --2- 172.21.15.3:0/1755243007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f217406d730 0x7f217414c0b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:25.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.157+0000 7f2173fff700 1 -- 172.21.15.3:0/1755243007 >> 172.21.15.3:0/1755243007 conn(0x7f2174067b60 msgr2=0x7f21740be240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:25.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.157+0000 7f2173fff700 1 -- 172.21.15.3:0/1755243007 shutdown_connections 2023-10-08T15:37:25.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.157+0000 7f2173fff700 1 -- 172.21.15.3:0/1755243007 wait complete. 2023-10-08T15:37:25.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.161+0000 7f2173fff700 1 Processor -- start 2023-10-08T15:37:25.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.161+0000 7f2173fff700 1 -- start start 2023-10-08T15:37:25.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.161+0000 7f2173fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f217406d730 0x7f2174095e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:25.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.161+0000 7f2173fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f217414e3c0 0x7f217415e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:25.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.161+0000 7f2173fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2174096960 0x7f217415e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:25.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.161+0000 7f2173fff700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2174097d00 con 0x7f217406d730 2023-10-08T15:37:25.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.161+0000 7f2173fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2174096390 con 0x7f217414e3c0 2023-10-08T15:37:25.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.161+0000 7f2173fff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21740992a0 con 0x7f2174096960 2023-10-08T15:37:25.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.161+0000 7f2172ffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f217406d730 0x7f2174095e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:25.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.161+0000 7f2172ffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f217406d730 0x7f2174095e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36676/0 (socket says 172.21.15.3:36676) 2023-10-08T15:37:25.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.161+0000 7f2172ffd700 1 -- 172.21.15.3:0/67675081 learned_addr learned my addr 172.21.15.3:0/67675081 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:25.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.161+0000 7f216bfff700 1 --2- 172.21.15.3:0/67675081 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f217414e3c0 0x7f217415e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:25.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.161+0000 7f21737fe700 1 --2- 172.21.15.3:0/67675081 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2174096960 0x7f217415e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:25.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.161+0000 7f2172ffd700 1 -- 172.21.15.3:0/67675081 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2174096960 msgr2=0x7f217415e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:25.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.161+0000 7f2172ffd700 1 --2- 172.21.15.3:0/67675081 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2174096960 0x7f217415e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:25.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.161+0000 7f2172ffd700 1 -- 172.21.15.3:0/67675081 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f217414e3c0 msgr2=0x7f217415e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:25.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.161+0000 7f2172ffd700 1 --2- 172.21.15.3:0/67675081 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f217414e3c0 0x7f217415e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:25.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.161+0000 7f2172ffd700 1 -- 172.21.15.3:0/67675081 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f216c009a20 con 0x7f217406d730 2023-10-08T15:37:25.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.161+0000 7f21737fe700 1 --2- 172.21.15.3:0/67675081 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2174096960 0x7f217415e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:37:25.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.161+0000 7f2172ffd700 1 --2- 172.21.15.3:0/67675081 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f217406d730 0x7f2174095e50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f216400c580 tx=0x7f2164007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:25.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.161+0000 7f216affd700 1 -- 172.21.15.3:0/67675081 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2164010510 con 0x7f217406d730 2023-10-08T15:37:25.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.161+0000 7f216affd700 1 -- 172.21.15.3:0/67675081 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2164010670 con 0x7f217406d730 2023-10-08T15:37:25.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.161+0000 7f2173fff700 1 -- 172.21.15.3:0/67675081 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2174097990 con 0x7f217406d730 2023-10-08T15:37:25.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.161+0000 7f216affd700 1 -- 172.21.15.3:0/67675081 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2164010a30 con 0x7f217406d730 2023-10-08T15:37:25.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.161+0000 7f2173fff700 1 -- 172.21.15.3:0/67675081 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21740bacd0 con 0x7f217406d730 2023-10-08T15:37:25.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.165+0000 7f2173fff700 1 -- 172.21.15.3:0/67675081 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f217405ecf0 con 0x7f217406d730 2023-10-08T15:37:25.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.169+0000 7f216affd700 1 -- 172.21.15.3:0/67675081 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f2164025430 con 0x7f217406d730 2023-10-08T15:37:25.211 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.169+0000 7f216affd700 1 --2- 172.21.15.3:0/67675081 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f2154060520 0x7f21540629d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:25.211 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.169+0000 7f216affd700 1 -- 172.21.15.3:0/67675081 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f216407ce70 con 0x7f217406d730 2023-10-08T15:37:25.211 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.169+0000 7f216bfff700 1 --2- 172.21.15.3:0/67675081 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f2154060520 0x7f21540629d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:25.211 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.169+0000 7f216bfff700 1 --2- 172.21.15.3:0/67675081 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f2154060520 0x7f21540629d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f21740ba990 tx=0x7f215c000bc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:25.211 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.173+0000 7f216affd700 1 -- 172.21.15.3:0/67675081 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f216404d4c0 con 0x7f217406d730 2023-10-08T15:37:25.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:25.373+0000 7f2173fff700 1 -- 172.21.15.3:0/67675081 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f2174069e80 con 0x7f217406d730 2023-10-08T15:37:26.018 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.013+0000 7f216affd700 1 -- 172.21.15.3:0/67675081 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f2164050ae0 con 0x7f217406d730 2023-10-08T15:37:26.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.037+0000 7f2173fff700 1 -- 172.21.15.3:0/67675081 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f2154060520 msgr2=0x7f21540629d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:26.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.037+0000 7f2173fff700 1 --2- 172.21.15.3:0/67675081 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f2154060520 0x7f21540629d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f21740ba990 tx=0x7f215c000bc0 comp rx=0 tx=0).stop 2023-10-08T15:37:26.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.037+0000 7f2173fff700 1 -- 172.21.15.3:0/67675081 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f217406d730 msgr2=0x7f2174095e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:26.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.037+0000 7f2173fff700 1 --2- 172.21.15.3:0/67675081 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f217406d730 0x7f2174095e50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f216400c580 tx=0x7f2164007e10 comp rx=0 tx=0).stop 2023-10-08T15:37:26.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.037+0000 7f2173fff700 1 -- 172.21.15.3:0/67675081 shutdown_connections 2023-10-08T15:37:26.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.037+0000 7f2173fff700 1 --2- 172.21.15.3:0/67675081 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f2154060520 0x7f21540629d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:26.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.037+0000 7f2173fff700 1 --2- 172.21.15.3:0/67675081 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2174096960 0x7f217415e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:26.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.037+0000 7f2173fff700 1 --2- 172.21.15.3:0/67675081 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f217414e3c0 0x7f217415e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:26.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.037+0000 7f2173fff700 1 --2- 172.21.15.3:0/67675081 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f217406d730 0x7f2174095e50 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:26.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.037+0000 7f2173fff700 1 -- 172.21.15.3:0/67675081 >> 172.21.15.3:0/67675081 conn(0x7f2174067b60 msgr2=0x7f217414e790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:26.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.041+0000 7f2173fff700 1 -- 172.21.15.3:0/67675081 shutdown_connections 2023-10-08T15:37:26.047 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.041+0000 7f2173fff700 1 -- 172.21.15.3:0/67675081 wait complete. 2023-10-08T15:37:26.048 INFO:teuthology.orchestra.run.smithi003.stderr:new fs with metadata pool 2 and data pool 3 2023-10-08T15:37:26.062 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:37:26.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.157+0000 7f9a8cb69700 1 Processor -- start 2023-10-08T15:37:26.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.157+0000 7f9a8cb69700 1 -- start start 2023-10-08T15:37:26.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.157+0000 7f9a8cb69700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9a880c0720 0x7f9a880674b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:26.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.157+0000 7f9a8cb69700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a880687c0 con 0x7f9a880670e0 2023-10-08T15:37:26.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.157+0000 7f9a8cb69700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a88068aa0 con 0x7f9a880681f0 2023-10-08T15:37:26.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.157+0000 7f9a8cb69700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8814c6f0 con 0x7f9a880c0720 2023-10-08T15:37:26.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.157+0000 7f9a877fe700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f9a880670e0 0x7f9a88068f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:59662/0 (socket says 172.21.15.3:59662) 2023-10-08T15:37:26.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.157+0000 7f9a877fe700 1 -- 172.21.15.3:0/626571892 learned_addr learned my addr 172.21.15.3:0/626571892 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:26.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.157+0000 7f9a86ffd700 1 --2- 172.21.15.3:0/626571892 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9a880c0720 0x7f9a880674b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:26.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.157+0000 7f9a867fc700 1 -- 172.21.15.3:0/626571892 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 787426305 0 0) 0x7f9a880687c0 con 0x7f9a880670e0 2023-10-08T15:37:26.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.157+0000 7f9a86ffd700 1 -- 172.21.15.3:0/626571892 >> v1:172.21.15.50:6789/0 conn(0x7f9a880681f0 legacy=0x7f9a880a18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:26.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.157+0000 7f9a86ffd700 1 -- 172.21.15.3:0/626571892 >> v1:172.21.15.3:6789/0 conn(0x7f9a880670e0 legacy=0x7f9a88068f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:26.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.157+0000 7f9a86ffd700 1 -- 172.21.15.3:0/626571892 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a8806a030 con 0x7f9a880c0720 2023-10-08T15:37:26.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.161+0000 7f9a86ffd700 1 --2- 172.21.15.3:0/626571892 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9a880c0720 0x7f9a880674b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9a78009e90 tx=0x7f9a78009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6286bf4f6eddbca server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:26.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.161+0000 7f9a867fc700 1 -- 172.21.15.3:0/626571892 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a7800e070 con 0x7f9a880c0720 2023-10-08T15:37:26.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.161+0000 7f9a867fc700 1 -- 172.21.15.3:0/626571892 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a7800bc30 con 0x7f9a880c0720 2023-10-08T15:37:26.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.161+0000 7f9a867fc700 1 -- 172.21.15.3:0/626571892 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a78012430 con 0x7f9a880c0720 2023-10-08T15:37:26.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.161+0000 7f9a8cb69700 1 -- 172.21.15.3:0/626571892 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9a880c0720 msgr2=0x7f9a880674b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:26.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.161+0000 7f9a8cb69700 1 --2- 172.21.15.3:0/626571892 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9a880c0720 0x7f9a880674b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9a78009e90 tx=0x7f9a78009780 comp rx=0 tx=0).stop 2023-10-08T15:37:26.168 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.161+0000 7f9a8cb69700 1 -- 172.21.15.3:0/626571892 shutdown_connections 2023-10-08T15:37:26.168 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.161+0000 7f9a8cb69700 1 --2- 172.21.15.3:0/626571892 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9a880c0720 0x7f9a880674b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:26.168 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.161+0000 7f9a8cb69700 1 -- 172.21.15.3:0/626571892 >> 172.21.15.3:0/626571892 conn(0x7f9a8806dfb0 msgr2=0x7f9a8806e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:26.168 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.161+0000 7f9a8cb69700 1 -- 172.21.15.3:0/626571892 shutdown_connections 2023-10-08T15:37:26.168 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.161+0000 7f9a8cb69700 1 -- 172.21.15.3:0/626571892 wait complete. 2023-10-08T15:37:26.168 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.161+0000 7f9a8cb69700 1 Processor -- start 2023-10-08T15:37:26.169 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.161+0000 7f9a8cb69700 1 -- start start 2023-10-08T15:37:26.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.161+0000 7f9a8cb69700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9a880670e0 0x7f9a88099e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:26.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.161+0000 7f9a8cb69700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9a880681f0 0x7f9a8809c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:26.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.161+0000 7f9a8cb69700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a880c0720 0x7f9a8815e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:26.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.161+0000 7f9a8cb69700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8815bee0 con 0x7f9a880670e0 2023-10-08T15:37:26.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.161+0000 7f9a8cb69700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8809a3c0 con 0x7f9a880c0720 2023-10-08T15:37:26.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.161+0000 7f9a8cb69700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8815f490 con 0x7f9a880681f0 2023-10-08T15:37:26.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.165+0000 7f9a877fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9a880670e0 0x7f9a88099e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:26.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.165+0000 7f9a86ffd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9a880681f0 0x7f9a8809c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:26.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.165+0000 7f9a877fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9a880670e0 0x7f9a88099e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36682/0 (socket says 172.21.15.3:36682) 2023-10-08T15:37:26.171 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.165+0000 7f9a877fe700 1 -- 172.21.15.3:0/3339304764 learned_addr learned my addr 172.21.15.3:0/3339304764 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:26.171 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.165+0000 7f9a87fff700 1 --2- 172.21.15.3:0/3339304764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a880c0720 0x7f9a8815e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:26.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.165+0000 7f9a877fe700 1 -- 172.21.15.3:0/3339304764 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9a880681f0 msgr2=0x7f9a8809c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:26.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.165+0000 7f9a877fe700 1 --2- 172.21.15.3:0/3339304764 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9a880681f0 0x7f9a8809c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:26.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.165+0000 7f9a877fe700 1 -- 172.21.15.3:0/3339304764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a880c0720 msgr2=0x7f9a8815e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:26.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.165+0000 7f9a877fe700 1 --2- 172.21.15.3:0/3339304764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a880c0720 0x7f9a8815e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:26.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.165+0000 7f9a877fe700 1 -- 172.21.15.3:0/3339304764 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a78009a20 con 0x7f9a880670e0 2023-10-08T15:37:26.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.165+0000 7f9a877fe700 1 --2- 172.21.15.3:0/3339304764 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9a880670e0 0x7f9a88099e80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c00c810 tx=0x7f9a7c007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:26.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.165+0000 7f9a6f7fe700 1 -- 172.21.15.3:0/3339304764 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a7c005c00 con 0x7f9a880670e0 2023-10-08T15:37:26.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.165+0000 7f9a8cb69700 1 -- 172.21.15.3:0/3339304764 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a8815bb60 con 0x7f9a880670e0 2023-10-08T15:37:26.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.165+0000 7f9a6f7fe700 1 -- 172.21.15.3:0/3339304764 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a7c005d60 con 0x7f9a880670e0 2023-10-08T15:37:26.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.165+0000 7f9a6f7fe700 1 -- 172.21.15.3:0/3339304764 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a7c007320 con 0x7f9a880670e0 2023-10-08T15:37:26.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.165+0000 7f9a8cb69700 1 -- 172.21.15.3:0/3339304764 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a8809c660 con 0x7f9a880670e0 2023-10-08T15:37:26.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.165+0000 7f9a8cb69700 1 -- 172.21.15.3:0/3339304764 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a8805ecf0 con 0x7f9a880670e0 2023-10-08T15:37:26.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.169+0000 7f9a6f7fe700 1 -- 172.21.15.3:0/3339304764 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f9a7c01b3b0 con 0x7f9a880670e0 2023-10-08T15:37:26.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.169+0000 7f9a6f7fe700 1 --2- 172.21.15.3:0/3339304764 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f9a74060580 0x7f9a74062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:26.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.169+0000 7f9a6f7fe700 1 -- 172.21.15.3:0/3339304764 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9a7c07bd50 con 0x7f9a880670e0 2023-10-08T15:37:26.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.169+0000 7f9a86ffd700 1 --2- 172.21.15.3:0/3339304764 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f9a74060580 0x7f9a74062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:26.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.169+0000 7f9a86ffd700 1 --2- 172.21.15.3:0/3339304764 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f9a74060580 0x7f9a74062a30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9a78009e90 tx=0x7f9a78019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:26.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.173+0000 7f9a6f7fe700 1 -- 172.21.15.3:0/3339304764 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9a7c07f030 con 0x7f9a880670e0 2023-10-08T15:37:26.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.333+0000 7f9a8cb69700 1 -- 172.21.15.3:0/3339304764 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a8814d310 con 0x7f9a880670e0 2023-10-08T15:37:26.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.333+0000 7f9a6f7fe700 1 -- 172.21.15.3:0/3339304764 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+15267 (secure 0 0 0) 0x7f9a7c04c340 con 0x7f9a880670e0 2023-10-08T15:37:26.343 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:37:26.344 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":19,"fsid":"7635972e-cd66-4a8f-a231-378db8b3847a","created":"2023-10-08T15:37:08.234594+0000","modified":"2023-10-08T15:37:25.378457+0000","last_up_change":"2023-10-08T15:37:17.537726+0000","last_in_change":"2023-10-08T15:37:10.269178+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:37:16.581590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:37:23.353518+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T15:37:24.365114+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"64fb1864-bfdd-4d75-9b41-03fb60085dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33363},{"type":"v1","addr":"172.21.15.3:6801","nonce":33363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33363},{"type":"v1","addr":"172.21.15.3:6803","nonce":33363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":33363},{"type":"v1","addr":"172.21.15.3:6807","nonce":33363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33363},{"type":"v1","addr":"172.21.15.3:6805","nonce":33363}]},"public_addr":"172.21.15.3:6801/33363","cluster_addr":"172.21.15.3:6803/33363","heartbeat_back_addr":"172.21.15.3:6807/33363","heartbeat_front_addr":"172.21.15.3:6805/33363","state":["exists","up"]},{"osd":1,"uuid":"3ca6bd3a-3e8a-4c65-af9c-46148b0c2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33364},{"type":"v1","addr":"172.21.15.3:6820","nonce":33364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33364},{"type":"v1","addr":"172.21.15.3:6824","nonce":33364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33364},{"type":"v1","addr":"172.21.15.3:6831","nonce":33364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33364},{"type":"v1","addr":"172.21.15.3:6828","nonce":33364}]},"public_addr":"172.21.15.3:6820/33364","cluster_addr":"172.21.15.3:6824/33364","heartbeat_back_addr":"172.21.15.3:6831/33364","heartbeat_front_addr":"172.21.15.3:6828/33364","state":["exists","up"]},{"osd":2,"uuid":"6eb9f757-58dd-442f-910d-32401454bce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33366},{"type":"v1","addr":"172.21.15.3:6817","nonce":33366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":33366},{"type":"v1","addr":"172.21.15.3:6821","nonce":33366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6827","nonce":33366},{"type":"v1","addr":"172.21.15.3:6829","nonce":33366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":33366},{"type":"v1","addr":"172.21.15.3:6825","nonce":33366}]},"public_addr":"172.21.15.3:6817/33366","cluster_addr":"172.21.15.3:6821/33366","heartbeat_back_addr":"172.21.15.3:6829/33366","heartbeat_front_addr":"172.21.15.3:6825/33366","state":["exists","up"]},{"osd":3,"uuid":"1c39866b-ac2e-4ea9-a69c-02b01ee4191d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33365},{"type":"v1","addr":"172.21.15.3:6809","nonce":33365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":33365},{"type":"v1","addr":"172.21.15.3:6811","nonce":33365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33365},{"type":"v1","addr":"172.21.15.3:6815","nonce":33365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":33365},{"type":"v1","addr":"172.21.15.3:6813","nonce":33365}]},"public_addr":"172.21.15.3:6809/33365","cluster_addr":"172.21.15.3:6811/33365","heartbeat_back_addr":"172.21.15.3:6815/33365","heartbeat_front_addr":"172.21.15.3:6813/33365","state":["exists","up"]},{"osd":4,"uuid":"15f86b61-b7f1-4780-ae00-9d80a68cb830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":33605},{"type":"v1","addr":"172.21.15.50:6809","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33605},{"type":"v1","addr":"172.21.15.50:6811","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33605},{"type":"v1","addr":"172.21.15.50:6815","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":33605},{"type":"v1","addr":"172.21.15.50:6813","nonce":33605}]},"public_addr":"172.21.15.50:6809/33605","cluster_addr":"172.21.15.50:6811/33605","heartbeat_back_addr":"172.21.15.50:6815/33605","heartbeat_front_addr":"172.21.15.50:6813/33605","state":["exists","up"]},{"osd":5,"uuid":"726c3003-34e6-4d5a-b6e2-f911e13c2118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33606},{"type":"v1","addr":"172.21.15.50:6801","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33606},{"type":"v1","addr":"172.21.15.50:6803","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33606},{"type":"v1","addr":"172.21.15.50:6807","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":33606},{"type":"v1","addr":"172.21.15.50:6805","nonce":33606}]},"public_addr":"172.21.15.50:6801/33606","cluster_addr":"172.21.15.50:6803/33606","heartbeat_back_addr":"172.21.15.50:6807/33606","heartbeat_front_addr":"172.21.15.50:6805/33606","state":["exists","up"]},{"osd":6,"uuid":"401122a4-9988-441f-a5a7-39164434ebcd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":33607},{"type":"v1","addr":"172.21.15.50:6819","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":33607},{"type":"v1","addr":"172.21.15.50:6823","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":33607},{"type":"v1","addr":"172.21.15.50:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":33607},{"type":"v1","addr":"172.21.15.50:6827","nonce":33607}]},"public_addr":"172.21.15.50:6819/33607","cluster_addr":"172.21.15.50:6823/33607","heartbeat_back_addr":"172.21.15.50:6831/33607","heartbeat_front_addr":"172.21.15.50:6827/33607","state":["exists","up"]},{"osd":7,"uuid":"6b3fa236-c9d0-4c4d-82ae-9af4daf6d699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33604},{"type":"v1","addr":"172.21.15.50:6818","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":33604},{"type":"v1","addr":"172.21.15.50:6822","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":33604},{"type":"v1","addr":"172.21.15.50:6830","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":33604},{"type":"v1","addr":"172.21.15.50:6826","nonce":33604}]},"public_addr":"172.21.15.50:6818/33604","cluster_addr":"172.21.15.50:6822/33604","heartbeat_back_addr":"172.21.15.50:6830/33604","heartbeat_front_addr":"172.21.15.50:6826/33604","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.497794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.529417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.873426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.325972+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.443971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.240795+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.739632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.643026+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:37:26.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.337+0000 7f9a8cb69700 1 -- 172.21.15.3:0/3339304764 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f9a74060580 msgr2=0x7f9a74062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:26.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.337+0000 7f9a8cb69700 1 --2- 172.21.15.3:0/3339304764 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f9a74060580 0x7f9a74062a30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9a78009e90 tx=0x7f9a78019000 comp rx=0 tx=0).stop 2023-10-08T15:37:26.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.337+0000 7f9a8cb69700 1 -- 172.21.15.3:0/3339304764 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9a880670e0 msgr2=0x7f9a88099e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:26.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.337+0000 7f9a8cb69700 1 --2- 172.21.15.3:0/3339304764 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9a880670e0 0x7f9a88099e80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c00c810 tx=0x7f9a7c007d90 comp rx=0 tx=0).stop 2023-10-08T15:37:26.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.337+0000 7f9a8cb69700 1 -- 172.21.15.3:0/3339304764 shutdown_connections 2023-10-08T15:37:26.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.337+0000 7f9a8cb69700 1 --2- 172.21.15.3:0/3339304764 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f9a74060580 0x7f9a74062a30 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:26.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.337+0000 7f9a8cb69700 1 --2- 172.21.15.3:0/3339304764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a880c0720 0x7f9a8815e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:26.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.337+0000 7f9a8cb69700 1 --2- 172.21.15.3:0/3339304764 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9a880681f0 0x7f9a8809c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:26.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.337+0000 7f9a8cb69700 1 --2- 172.21.15.3:0/3339304764 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9a880670e0 0x7f9a88099e80 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:26.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.337+0000 7f9a8cb69700 1 -- 172.21.15.3:0/3339304764 >> 172.21.15.3:0/3339304764 conn(0x7f9a8806dfb0 msgr2=0x7f9a880a1140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:26.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.337+0000 7f9a8cb69700 1 -- 172.21.15.3:0/3339304764 shutdown_connections 2023-10-08T15:37:26.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.337+0000 7f9a8cb69700 1 -- 172.21.15.3:0/3339304764 wait complete. 2023-10-08T15:37:26.361 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:37:26.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.461+0000 7f7b5a2cc700 1 Processor -- start 2023-10-08T15:37:26.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.461+0000 7f7b5a2cc700 1 -- start start 2023-10-08T15:37:26.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.461+0000 7f7b5a2cc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7b540a15e0 0x7f7b5414eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:26.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.461+0000 7f7b5a2cc700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7b5406cf60 0x7f7b5414f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:26.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.461+0000 7f7b5a2cc700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f7b54068630 0x7f7b5414f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:26.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.461+0000 7f7b5a2cc700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b54069900 con 0x7f7b54068630 2023-10-08T15:37:26.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.461+0000 7f7b5a2cc700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b54069620 con 0x7f7b540a15e0 2023-10-08T15:37:26.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.461+0000 7f7b5a2cc700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b54068d10 con 0x7f7b5406cf60 2023-10-08T15:37:26.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.461+0000 7f7b59acb700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f7b54068630 0x7f7b5414f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:26.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.461+0000 7f7b592ca700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7b540a15e0 0x7f7b5414eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:26.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.461+0000 7f7b59acb700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f7b54068630 0x7f7b5414f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36696/0 (socket says 172.21.15.3:36696) 2023-10-08T15:37:26.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.461+0000 7f7b59acb700 1 -- 172.21.15.3:0/3529940324 learned_addr learned my addr 172.21.15.3:0/3529940324 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:26.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.461+0000 7f7b58ac9700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7b5406cf60 0x7f7b5414f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:26.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.461+0000 7f7b59acb700 1 -- 172.21.15.3:0/3529940324 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7b5406cf60 msgr2=0x7f7b5414f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:26.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.461+0000 7f7b59acb700 1 --2- 172.21.15.3:0/3529940324 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7b5406cf60 0x7f7b5414f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:26.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.461+0000 7f7b59acb700 1 -- 172.21.15.3:0/3529940324 >> v2:172.21.15.50:3300/0 conn(0x7f7b540a15e0 msgr2=0x7f7b5414eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:26.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.461+0000 7f7b59acb700 1 --2- 172.21.15.3:0/3529940324 >> v2:172.21.15.50:3300/0 conn(0x7f7b540a15e0 0x7f7b5414eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:26.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.461+0000 7f7b59acb700 1 -- 172.21.15.3:0/3529940324 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b5406e8e0 con 0x7f7b54068630 2023-10-08T15:37:26.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.461+0000 7f7b592ca700 1 --2- 172.21.15.3:0/3529940324 >> v2:172.21.15.50:3300/0 conn(0x7f7b540a15e0 0x7f7b5414eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:37:26.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.461+0000 7f7b59acb700 1 --2- 172.21.15.3:0/3529940324 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b54068630 0x7f7b5414f560 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7b540be250 tx=0x7f7b44009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7905958b57256135 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:26.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.465+0000 7f7b53fff700 1 -- 172.21.15.3:0/3529940324 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4400b640 con 0x7f7b54068630 2023-10-08T15:37:26.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.465+0000 7f7b53fff700 1 -- 172.21.15.3:0/3529940324 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b4400b7a0 con 0x7f7b54068630 2023-10-08T15:37:26.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.465+0000 7f7b53fff700 1 -- 172.21.15.3:0/3529940324 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4400bb60 con 0x7f7b54068630 2023-10-08T15:37:26.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.465+0000 7f7b5a2cc700 1 -- 172.21.15.3:0/3529940324 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b54068630 msgr2=0x7f7b5414f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:26.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.465+0000 7f7b5a2cc700 1 --2- 172.21.15.3:0/3529940324 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b54068630 0x7f7b5414f560 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7b540be250 tx=0x7f7b44009250 comp rx=0 tx=0).stop 2023-10-08T15:37:26.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.465+0000 7f7b5a2cc700 1 -- 172.21.15.3:0/3529940324 shutdown_connections 2023-10-08T15:37:26.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.465+0000 7f7b5a2cc700 1 --2- 172.21.15.3:0/3529940324 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7b5406cf60 0x7f7b5414f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:26.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.465+0000 7f7b5a2cc700 1 --2- 172.21.15.3:0/3529940324 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b54068630 0x7f7b5414f560 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:26.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.465+0000 7f7b5a2cc700 1 --2- 172.21.15.3:0/3529940324 >> v2:172.21.15.50:3300/0 conn(0x7f7b540a15e0 0x7f7b5414eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:26.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.465+0000 7f7b5a2cc700 1 -- 172.21.15.3:0/3529940324 >> 172.21.15.3:0/3529940324 conn(0x7f7b540670e0 msgr2=0x7f7b540674e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:26.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.465+0000 7f7b5a2cc700 1 -- 172.21.15.3:0/3529940324 shutdown_connections 2023-10-08T15:37:26.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.465+0000 7f7b5a2cc700 1 -- 172.21.15.3:0/3529940324 wait complete. 2023-10-08T15:37:26.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.465+0000 7f7b5a2cc700 1 Processor -- start 2023-10-08T15:37:26.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.465+0000 7f7b5a2cc700 1 -- start start 2023-10-08T15:37:26.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.469+0000 7f7b5a2cc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b54068630 0x7f7b540b8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:26.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.469+0000 7f7b5a2cc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b540a15e0 0x7f7b540a0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:26.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.469+0000 7f7b5a2cc700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7b540ba960 0x7f7b540a0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:26.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.469+0000 7f7b5a2cc700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5415bb00 con 0x7f7b540a15e0 2023-10-08T15:37:26.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.469+0000 7f7b5a2cc700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b540a0fb0 con 0x7f7b54068630 2023-10-08T15:37:26.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.469+0000 7f7b5a2cc700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b540b8d90 con 0x7f7b540ba960 2023-10-08T15:37:26.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.469+0000 7f7b58ac9700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b540a15e0 0x7f7b540a0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:26.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.469+0000 7f7b59acb700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7b540ba960 0x7f7b540a0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:26.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.469+0000 7f7b592ca700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b54068630 0x7f7b540b8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:26.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.469+0000 7f7b58ac9700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b540a15e0 0x7f7b540a0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36712/0 (socket says 172.21.15.3:36712) 2023-10-08T15:37:26.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.469+0000 7f7b58ac9700 1 -- 172.21.15.3:0/3245234659 learned_addr learned my addr 172.21.15.3:0/3245234659 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:26.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.469+0000 7f7b58ac9700 1 -- 172.21.15.3:0/3245234659 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7b540ba960 msgr2=0x7f7b540a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:26.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.469+0000 7f7b58ac9700 1 --2- 172.21.15.3:0/3245234659 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7b540ba960 0x7f7b540a0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:26.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.469+0000 7f7b58ac9700 1 -- 172.21.15.3:0/3245234659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b54068630 msgr2=0x7f7b540b8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:26.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.469+0000 7f7b58ac9700 1 --2- 172.21.15.3:0/3245234659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b54068630 0x7f7b540b8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:26.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.469+0000 7f7b58ac9700 1 -- 172.21.15.3:0/3245234659 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b4c009a20 con 0x7f7b540a15e0 2023-10-08T15:37:26.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.469+0000 7f7b59acb700 1 --2- 172.21.15.3:0/3245234659 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7b540ba960 0x7f7b540a0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:37:26.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.469+0000 7f7b58ac9700 1 --2- 172.21.15.3:0/3245234659 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b540a15e0 0x7f7b540a0530 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7b4800ec80 tx=0x7f7b480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:26.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.469+0000 7f7b517fa700 1 -- 172.21.15.3:0/3245234659 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4800c850 con 0x7f7b540a15e0 2023-10-08T15:37:26.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.469+0000 7f7b517fa700 1 -- 172.21.15.3:0/3245234659 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b4800c9d0 con 0x7f7b540a15e0 2023-10-08T15:37:26.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.469+0000 7f7b5a2cc700 1 -- 172.21.15.3:0/3245234659 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b440094f0 con 0x7f7b540a15e0 2023-10-08T15:37:26.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.469+0000 7f7b517fa700 1 -- 172.21.15.3:0/3245234659 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4800cd90 con 0x7f7b540a15e0 2023-10-08T15:37:26.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.469+0000 7f7b5a2cc700 1 -- 172.21.15.3:0/3245234659 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b5415b790 con 0x7f7b540a15e0 2023-10-08T15:37:26.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.473+0000 7f7b5a2cc700 1 -- 172.21.15.3:0/3245234659 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b5405ecf0 con 0x7f7b540a15e0 2023-10-08T15:37:26.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.473+0000 7f7b517fa700 1 -- 172.21.15.3:0/3245234659 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f7b48013680 con 0x7f7b540a15e0 2023-10-08T15:37:26.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.473+0000 7f7b517fa700 1 --2- 172.21.15.3:0/3245234659 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7b40060550 0x7f7b40062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:26.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.473+0000 7f7b517fa700 1 -- 172.21.15.3:0/3245234659 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7b4807ca30 con 0x7f7b540a15e0 2023-10-08T15:37:26.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.473+0000 7f7b592ca700 1 --2- 172.21.15.3:0/3245234659 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7b40060550 0x7f7b40062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:26.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.473+0000 7f7b592ca700 1 --2- 172.21.15.3:0/3245234659 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7b40060550 0x7f7b40062a00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c00f650 tx=0x7f7b4c00b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:26.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.481+0000 7f7b517fa700 1 -- 172.21.15.3:0/3245234659 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7b4804d020 con 0x7f7b540a15e0 2023-10-08T15:37:26.647 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.641+0000 7f7b5a2cc700 1 -- 172.21.15.3:0/3245234659 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7b540a19b0 con 0x7f7b540a15e0 2023-10-08T15:37:26.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.641+0000 7f7b517fa700 1 -- 172.21.15.3:0/3245234659 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+15267 (secure 0 0 0) 0x7f7b48050640 con 0x7f7b540a15e0 2023-10-08T15:37:26.649 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:37:26.649 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":19,"fsid":"7635972e-cd66-4a8f-a231-378db8b3847a","created":"2023-10-08T15:37:08.234594+0000","modified":"2023-10-08T15:37:25.378457+0000","last_up_change":"2023-10-08T15:37:17.537726+0000","last_in_change":"2023-10-08T15:37:10.269178+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:37:16.581590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:37:23.353518+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T15:37:24.365114+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"64fb1864-bfdd-4d75-9b41-03fb60085dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33363},{"type":"v1","addr":"172.21.15.3:6801","nonce":33363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33363},{"type":"v1","addr":"172.21.15.3:6803","nonce":33363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":33363},{"type":"v1","addr":"172.21.15.3:6807","nonce":33363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33363},{"type":"v1","addr":"172.21.15.3:6805","nonce":33363}]},"public_addr":"172.21.15.3:6801/33363","cluster_addr":"172.21.15.3:6803/33363","heartbeat_back_addr":"172.21.15.3:6807/33363","heartbeat_front_addr":"172.21.15.3:6805/33363","state":["exists","up"]},{"osd":1,"uuid":"3ca6bd3a-3e8a-4c65-af9c-46148b0c2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33364},{"type":"v1","addr":"172.21.15.3:6820","nonce":33364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33364},{"type":"v1","addr":"172.21.15.3:6824","nonce":33364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33364},{"type":"v1","addr":"172.21.15.3:6831","nonce":33364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33364},{"type":"v1","addr":"172.21.15.3:6828","nonce":33364}]},"public_addr":"172.21.15.3:6820/33364","cluster_addr":"172.21.15.3:6824/33364","heartbeat_back_addr":"172.21.15.3:6831/33364","heartbeat_front_addr":"172.21.15.3:6828/33364","state":["exists","up"]},{"osd":2,"uuid":"6eb9f757-58dd-442f-910d-32401454bce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33366},{"type":"v1","addr":"172.21.15.3:6817","nonce":33366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":33366},{"type":"v1","addr":"172.21.15.3:6821","nonce":33366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6827","nonce":33366},{"type":"v1","addr":"172.21.15.3:6829","nonce":33366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":33366},{"type":"v1","addr":"172.21.15.3:6825","nonce":33366}]},"public_addr":"172.21.15.3:6817/33366","cluster_addr":"172.21.15.3:6821/33366","heartbeat_back_addr":"172.21.15.3:6829/33366","heartbeat_front_addr":"172.21.15.3:6825/33366","state":["exists","up"]},{"osd":3,"uuid":"1c39866b-ac2e-4ea9-a69c-02b01ee4191d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33365},{"type":"v1","addr":"172.21.15.3:6809","nonce":33365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":33365},{"type":"v1","addr":"172.21.15.3:6811","nonce":33365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33365},{"type":"v1","addr":"172.21.15.3:6815","nonce":33365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":33365},{"type":"v1","addr":"172.21.15.3:6813","nonce":33365}]},"public_addr":"172.21.15.3:6809/33365","cluster_addr":"172.21.15.3:6811/33365","heartbeat_back_addr":"172.21.15.3:6815/33365","heartbeat_front_addr":"172.21.15.3:6813/33365","state":["exists","up"]},{"osd":4,"uuid":"15f86b61-b7f1-4780-ae00-9d80a68cb830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":33605},{"type":"v1","addr":"172.21.15.50:6809","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33605},{"type":"v1","addr":"172.21.15.50:6811","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33605},{"type":"v1","addr":"172.21.15.50:6815","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":33605},{"type":"v1","addr":"172.21.15.50:6813","nonce":33605}]},"public_addr":"172.21.15.50:6809/33605","cluster_addr":"172.21.15.50:6811/33605","heartbeat_back_addr":"172.21.15.50:6815/33605","heartbeat_front_addr":"172.21.15.50:6813/33605","state":["exists","up"]},{"osd":5,"uuid":"726c3003-34e6-4d5a-b6e2-f911e13c2118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33606},{"type":"v1","addr":"172.21.15.50:6801","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33606},{"type":"v1","addr":"172.21.15.50:6803","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33606},{"type":"v1","addr":"172.21.15.50:6807","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":33606},{"type":"v1","addr":"172.21.15.50:6805","nonce":33606}]},"public_addr":"172.21.15.50:6801/33606","cluster_addr":"172.21.15.50:6803/33606","heartbeat_back_addr":"172.21.15.50:6807/33606","heartbeat_front_addr":"172.21.15.50:6805/33606","state":["exists","up"]},{"osd":6,"uuid":"401122a4-9988-441f-a5a7-39164434ebcd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":33607},{"type":"v1","addr":"172.21.15.50:6819","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":33607},{"type":"v1","addr":"172.21.15.50:6823","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":33607},{"type":"v1","addr":"172.21.15.50:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":33607},{"type":"v1","addr":"172.21.15.50:6827","nonce":33607}]},"public_addr":"172.21.15.50:6819/33607","cluster_addr":"172.21.15.50:6823/33607","heartbeat_back_addr":"172.21.15.50:6831/33607","heartbeat_front_addr":"172.21.15.50:6827/33607","state":["exists","up"]},{"osd":7,"uuid":"6b3fa236-c9d0-4c4d-82ae-9af4daf6d699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33604},{"type":"v1","addr":"172.21.15.50:6818","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":33604},{"type":"v1","addr":"172.21.15.50:6822","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":33604},{"type":"v1","addr":"172.21.15.50:6830","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":33604},{"type":"v1","addr":"172.21.15.50:6826","nonce":33604}]},"public_addr":"172.21.15.50:6818/33604","cluster_addr":"172.21.15.50:6822/33604","heartbeat_back_addr":"172.21.15.50:6830/33604","heartbeat_front_addr":"172.21.15.50:6826/33604","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.497794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.529417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.873426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.325972+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.443971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.240795+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.739632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.643026+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:37:26.652 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.645+0000 7f7b5a2cc700 1 -- 172.21.15.3:0/3245234659 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7b40060550 msgr2=0x7f7b40062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:26.652 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.645+0000 7f7b5a2cc700 1 --2- 172.21.15.3:0/3245234659 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7b40060550 0x7f7b40062a00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c00f650 tx=0x7f7b4c00b040 comp rx=0 tx=0).stop 2023-10-08T15:37:26.652 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.645+0000 7f7b5a2cc700 1 -- 172.21.15.3:0/3245234659 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b540a15e0 msgr2=0x7f7b540a0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:26.652 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.645+0000 7f7b5a2cc700 1 --2- 172.21.15.3:0/3245234659 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b540a15e0 0x7f7b540a0530 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7b4800ec80 tx=0x7f7b480091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:26.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.645+0000 7f7b5a2cc700 1 -- 172.21.15.3:0/3245234659 shutdown_connections 2023-10-08T15:37:26.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.645+0000 7f7b5a2cc700 1 --2- 172.21.15.3:0/3245234659 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7b40060550 0x7f7b40062a00 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:26.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.645+0000 7f7b5a2cc700 1 --2- 172.21.15.3:0/3245234659 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7b540ba960 0x7f7b540a0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:26.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.645+0000 7f7b5a2cc700 1 --2- 172.21.15.3:0/3245234659 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b540a15e0 0x7f7b540a0530 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:26.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.645+0000 7f7b5a2cc700 1 --2- 172.21.15.3:0/3245234659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b54068630 0x7f7b540b8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:26.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.645+0000 7f7b5a2cc700 1 -- 172.21.15.3:0/3245234659 >> 172.21.15.3:0/3245234659 conn(0x7f7b540670e0 msgr2=0x7f7b54149900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:26.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.645+0000 7f7b5a2cc700 1 -- 172.21.15.3:0/3245234659 shutdown_connections 2023-10-08T15:37:26.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.645+0000 7f7b5a2cc700 1 -- 172.21.15.3:0/3245234659 wait complete. 2023-10-08T15:37:26.664 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T15:37:26.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.777+0000 7f058b59e700 1 Processor -- start 2023-10-08T15:37:26.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.777+0000 7f058b59e700 1 -- start start 2023-10-08T15:37:26.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.777+0000 7f058b59e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f058c14bfa0 0x7f058c068e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:26.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.777+0000 7f058b59e700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f058c069360 0x7f058c0bc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:26.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.777+0000 7f058b59e700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f058c068990 con 0x7f058c0bc2c0 2023-10-08T15:37:26.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.777+0000 7f058b59e700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f058c06a000 con 0x7f058c069360 2023-10-08T15:37:26.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.777+0000 7f058b59e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f058c068410 con 0x7f058c14bfa0 2023-10-08T15:37:26.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.777+0000 7f058a59c700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f058c0bc2c0 0x7f058c06bc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:53756/0 (socket says 172.21.15.3:53756) 2023-10-08T15:37:26.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.777+0000 7f058ad9d700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f058c069360 0x7f058c0bc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:26.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.777+0000 7f058a59c700 1 -- 172.21.15.3:0/3053747555 learned_addr learned my addr 172.21.15.3:0/3053747555 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:26.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.777+0000 7f0581d9b700 1 --2- 172.21.15.3:0/3053747555 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f058c14bfa0 0x7f058c068e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:26.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.777+0000 7f058ad9d700 1 -- 172.21.15.3:0/3053747555 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f058c14bfa0 msgr2=0x7f058c068e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:26.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.777+0000 7f058ad9d700 1 --2- 172.21.15.3:0/3053747555 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f058c14bfa0 0x7f058c068e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:26.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.777+0000 7f058ad9d700 1 -- 172.21.15.3:0/3053747555 >> v1:172.21.15.3:6789/0 conn(0x7f058c0bc2c0 legacy=0x7f058c06bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:26.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.777+0000 7f058ad9d700 1 -- 172.21.15.3:0/3053747555 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f058c06d4e0 con 0x7f058c069360 2023-10-08T15:37:26.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.777+0000 7f058ad9d700 1 --2- 172.21.15.3:0/3053747555 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f058c069360 0x7f058c0bc690 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0584009e60 tx=0x7f0584009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=578ef94e78e89c9a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:26.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.777+0000 7f0589d9b700 1 -- 172.21.15.3:0/3053747555 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058400e070 con 0x7f058c069360 2023-10-08T15:37:26.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.777+0000 7f0589d9b700 1 -- 172.21.15.3:0/3053747555 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f058400bb60 con 0x7f058c069360 2023-10-08T15:37:26.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.777+0000 7f0589d9b700 1 -- 172.21.15.3:0/3053747555 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0584012430 con 0x7f058c069360 2023-10-08T15:37:26.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.781+0000 7f058b59e700 1 -- 172.21.15.3:0/3053747555 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f058c069360 msgr2=0x7f058c0bc690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:26.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.781+0000 7f058b59e700 1 --2- 172.21.15.3:0/3053747555 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f058c069360 0x7f058c0bc690 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0584009e60 tx=0x7f0584009780 comp rx=0 tx=0).stop 2023-10-08T15:37:26.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.781+0000 7f058b59e700 1 -- 172.21.15.3:0/3053747555 shutdown_connections 2023-10-08T15:37:26.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.781+0000 7f058b59e700 1 --2- 172.21.15.3:0/3053747555 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f058c069360 0x7f058c0bc690 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:26.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.781+0000 7f058b59e700 1 --2- 172.21.15.3:0/3053747555 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f058c14bfa0 0x7f058c068e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:26.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.781+0000 7f058b59e700 1 -- 172.21.15.3:0/3053747555 >> 172.21.15.3:0/3053747555 conn(0x7f058c06f340 msgr2=0x7f058c0670e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:26.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.781+0000 7f058b59e700 1 -- 172.21.15.3:0/3053747555 shutdown_connections 2023-10-08T15:37:26.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.781+0000 7f058b59e700 1 -- 172.21.15.3:0/3053747555 wait complete. 2023-10-08T15:37:26.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.781+0000 7f058b59e700 1 Processor -- start 2023-10-08T15:37:26.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.781+0000 7f058b59e700 1 -- start start 2023-10-08T15:37:26.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.781+0000 7f058b59e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f058c069360 0x7f058c148350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:26.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.781+0000 7f058b59e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f058c0bc2c0 0x7f058c0b9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:26.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.781+0000 7f058b59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f058c14bfa0 0x7f058c15b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:26.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.781+0000 7f058b59e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058c15f070 con 0x7f058c0bc2c0 2023-10-08T15:37:26.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.781+0000 7f058b59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058c0ba320 con 0x7f058c14bfa0 2023-10-08T15:37:26.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.781+0000 7f058b59e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f058c15f330 con 0x7f058c069360 2023-10-08T15:37:26.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.781+0000 7f0581d9b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f058c0bc2c0 0x7f058c0b9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:26.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.781+0000 7f058a59c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f058c069360 0x7f058c148350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:26.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.781+0000 7f0581d9b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f058c0bc2c0 0x7f058c0b9de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47536/0 (socket says 172.21.15.3:47536) 2023-10-08T15:37:26.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.781+0000 7f058a59c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f058c069360 0x7f058c148350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.3:44174/0 (socket says 172.21.15.3:44174) 2023-10-08T15:37:26.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.781+0000 7f058ad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f058c14bfa0 0x7f058c15b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:26.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.781+0000 7f0581d9b700 1 -- 172.21.15.3:0/230297200 learned_addr learned my addr 172.21.15.3:0/230297200 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:26.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.785+0000 7f0581d9b700 1 -- 172.21.15.3:0/230297200 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f058c069360 msgr2=0x7f058c148350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:26.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.785+0000 7f0581d9b700 1 --2- 172.21.15.3:0/230297200 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f058c069360 0x7f058c148350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:26.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.785+0000 7f0581d9b700 1 -- 172.21.15.3:0/230297200 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f058c14bfa0 msgr2=0x7f058c15b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:26.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.785+0000 7f0581d9b700 1 --2- 172.21.15.3:0/230297200 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f058c14bfa0 0x7f058c15b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:26.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.785+0000 7f0581d9b700 1 -- 172.21.15.3:0/230297200 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0584009a20 con 0x7f058c0bc2c0 2023-10-08T15:37:26.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.785+0000 7f058ad9d700 1 --2- 172.21.15.3:0/230297200 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f058c14bfa0 0x7f058c15b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:37:26.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.785+0000 7f0581d9b700 1 --2- 172.21.15.3:0/230297200 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f058c0bc2c0 0x7f058c0b9de0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f057400ec80 tx=0x7f05740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:26.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.785+0000 7f0582ffd700 1 -- 172.21.15.3:0/230297200 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0574009690 con 0x7f058c0bc2c0 2023-10-08T15:37:26.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.785+0000 7f0582ffd700 1 -- 172.21.15.3:0/230297200 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f057400c850 con 0x7f058c0bc2c0 2023-10-08T15:37:26.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.785+0000 7f058b59e700 1 -- 172.21.15.3:0/230297200 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f058c096220 con 0x7f058c0bc2c0 2023-10-08T15:37:26.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.785+0000 7f0582ffd700 1 -- 172.21.15.3:0/230297200 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057400cc10 con 0x7f058c0bc2c0 2023-10-08T15:37:26.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.785+0000 7f058b59e700 1 -- 172.21.15.3:0/230297200 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f058c0b9270 con 0x7f058c0bc2c0 2023-10-08T15:37:26.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.785+0000 7f058b59e700 1 -- 172.21.15.3:0/230297200 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f058c05ecf0 con 0x7f058c0bc2c0 2023-10-08T15:37:26.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.789+0000 7f0582ffd700 1 -- 172.21.15.3:0/230297200 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f0574013470 con 0x7f058c0bc2c0 2023-10-08T15:37:26.794 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.789+0000 7f0582ffd700 1 --2- 172.21.15.3:0/230297200 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f056c060580 0x7f056c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:26.794 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.789+0000 7f0582ffd700 1 -- 172.21.15.3:0/230297200 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f057407c8e0 con 0x7f058c0bc2c0 2023-10-08T15:37:26.795 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.789+0000 7f058a59c700 1 --2- 172.21.15.3:0/230297200 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f056c060580 0x7f056c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:26.795 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.789+0000 7f058a59c700 1 --2- 172.21.15.3:0/230297200 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f056c060580 0x7f056c062a30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f057c007130 tx=0x7f057c007eb0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:26.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.793+0000 7f0582ffd700 1 -- 172.21.15.3:0/230297200 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0574050960 con 0x7f058c0bc2c0 2023-10-08T15:37:26.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:26.989+0000 7f058b59e700 1 -- 172.21.15.3:0/230297200 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f058c0a5780 con 0x7f058c0bc2c0 2023-10-08T15:37:27.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.033+0000 7f0582ffd700 1 -- 172.21.15.3:0/230297200 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 118+0+0 (secure 0 0 0) 0x7f05740504f0 con 0x7f058c0bc2c0 2023-10-08T15:37:27.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.037+0000 7f058b59e700 1 -- 172.21.15.3:0/230297200 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f056c060580 msgr2=0x7f056c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:27.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.037+0000 7f058b59e700 1 --2- 172.21.15.3:0/230297200 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f056c060580 0x7f056c062a30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f057c007130 tx=0x7f057c007eb0 comp rx=0 tx=0).stop 2023-10-08T15:37:27.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.037+0000 7f058b59e700 1 -- 172.21.15.3:0/230297200 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f058c0bc2c0 msgr2=0x7f058c0b9de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:27.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.037+0000 7f058b59e700 1 --2- 172.21.15.3:0/230297200 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f058c0bc2c0 0x7f058c0b9de0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f057400ec80 tx=0x7f05740091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:27.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.037+0000 7f058b59e700 1 -- 172.21.15.3:0/230297200 shutdown_connections 2023-10-08T15:37:27.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.037+0000 7f058b59e700 1 --2- 172.21.15.3:0/230297200 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f056c060580 0x7f056c062a30 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:27.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.037+0000 7f058b59e700 1 --2- 172.21.15.3:0/230297200 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f058c14bfa0 0x7f058c15b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:27.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.037+0000 7f058b59e700 1 --2- 172.21.15.3:0/230297200 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f058c0bc2c0 0x7f058c0b9de0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:27.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.037+0000 7f058b59e700 1 --2- 172.21.15.3:0/230297200 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f058c069360 0x7f058c148350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:27.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.037+0000 7f058b59e700 1 -- 172.21.15.3:0/230297200 >> 172.21.15.3:0/230297200 conn(0x7f058c06f340 msgr2=0x7f058c0be400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:27.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.041+0000 7f058b59e700 1 -- 172.21.15.3:0/230297200 shutdown_connections 2023-10-08T15:37:27.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.041+0000 7f058b59e700 1 -- 172.21.15.3:0/230297200 wait complete. 2023-10-08T15:37:27.063 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-08T15:37:27.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.173+0000 7f637ffff700 1 Processor -- start 2023-10-08T15:37:27.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.173+0000 7f637ffff700 1 -- start start 2023-10-08T15:37:27.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.173+0000 7f637ffff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f63800a77f0 0x7f63800be3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:27.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.173+0000 7f637ffff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f63800a7bc0 0x7f638014bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:27.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.173+0000 7f637ffff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f638006ced0 con 0x7f638006c5c0 2023-10-08T15:37:27.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.173+0000 7f637ffff700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f638006e770 con 0x7f63800a7bc0 2023-10-08T15:37:27.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.173+0000 7f637ffff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6380069570 con 0x7f63800a77f0 2023-10-08T15:37:27.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.173+0000 7f637f7fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f63800a7bc0 0x7f638014bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:27.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.173+0000 7f637f7fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f63800a7bc0 0x7f638014bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47548/0 (socket says 172.21.15.3:47548) 2023-10-08T15:37:27.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.173+0000 7f637f7fe700 1 -- 172.21.15.3:0/1829037596 learned_addr learned my addr 172.21.15.3:0/1829037596 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:27.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.173+0000 7f637effd700 1 --2- 172.21.15.3:0/1829037596 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f63800a77f0 0x7f63800be3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:27.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.177+0000 7f637f7fe700 1 -- 172.21.15.3:0/1829037596 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f63800a77f0 msgr2=0x7f63800be3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:27.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.177+0000 7f637f7fe700 1 --2- 172.21.15.3:0/1829037596 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f63800a77f0 0x7f63800be3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:27.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.177+0000 7f637f7fe700 1 -- 172.21.15.3:0/1829037596 >> v1:172.21.15.50:6789/0 conn(0x7f638006c5c0 legacy=0x7f63800a2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:27.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.177+0000 7f637f7fe700 1 -- 172.21.15.3:0/1829037596 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f638014c620 con 0x7f63800a7bc0 2023-10-08T15:37:27.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.177+0000 7f637f7fe700 1 --2- 172.21.15.3:0/1829037596 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f63800a7bc0 0x7f638014bfb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6378009f20 tx=0x7f6378009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37c1f52a5e865a47 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:27.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.177+0000 7f637dffb700 1 -- 172.21.15.3:0/1829037596 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637800e070 con 0x7f63800a7bc0 2023-10-08T15:37:27.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.177+0000 7f637dffb700 1 -- 172.21.15.3:0/1829037596 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f637800ba80 con 0x7f63800a7bc0 2023-10-08T15:37:27.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.177+0000 7f637dffb700 1 -- 172.21.15.3:0/1829037596 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63780092e0 con 0x7f63800a7bc0 2023-10-08T15:37:27.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.177+0000 7f637ffff700 1 -- 172.21.15.3:0/1829037596 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f63800a7bc0 msgr2=0x7f638014bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:27.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.177+0000 7f637ffff700 1 --2- 172.21.15.3:0/1829037596 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f63800a7bc0 0x7f638014bfb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6378009f20 tx=0x7f6378009840 comp rx=0 tx=0).stop 2023-10-08T15:37:27.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.177+0000 7f637ffff700 1 -- 172.21.15.3:0/1829037596 shutdown_connections 2023-10-08T15:37:27.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.177+0000 7f637ffff700 1 --2- 172.21.15.3:0/1829037596 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f63800a7bc0 0x7f638014bfb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:27.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.177+0000 7f637ffff700 1 --2- 172.21.15.3:0/1829037596 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f63800a77f0 0x7f63800be3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:27.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.177+0000 7f637ffff700 1 -- 172.21.15.3:0/1829037596 >> 172.21.15.3:0/1829037596 conn(0x7f63800c29f0 msgr2=0x7f63800a1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:27.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.177+0000 7f637ffff700 1 -- 172.21.15.3:0/1829037596 shutdown_connections 2023-10-08T15:37:27.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.177+0000 7f637ffff700 1 -- 172.21.15.3:0/1829037596 wait complete. 2023-10-08T15:37:27.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.177+0000 7f637ffff700 1 Processor -- start 2023-10-08T15:37:27.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.177+0000 7f637ffff700 1 -- start start 2023-10-08T15:37:27.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.181+0000 7f637ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f638006c5c0 0x7f638015ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:27.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.181+0000 7f637ffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f63800a77f0 0x7f638015e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:27.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.181+0000 7f637ffff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f63800a7bc0 0x7f6380148d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:27.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.181+0000 7f637ffff700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f638014a3f0 con 0x7f63800a77f0 2023-10-08T15:37:27.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.181+0000 7f637ffff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6380149cd0 con 0x7f638006c5c0 2023-10-08T15:37:27.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.181+0000 7f637ffff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f638015e8c0 con 0x7f63800a7bc0 2023-10-08T15:37:27.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.181+0000 7f637e7fc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f63800a77f0 0x7f638015e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:27.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.181+0000 7f637e7fc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f63800a77f0 0x7f638015e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47554/0 (socket says 172.21.15.3:47554) 2023-10-08T15:37:27.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.181+0000 7f637e7fc700 1 -- 172.21.15.3:0/1022966285 learned_addr learned my addr 172.21.15.3:0/1022966285 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:27.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.181+0000 7f637effd700 1 --2- 172.21.15.3:0/1022966285 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f638006c5c0 0x7f638015ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:27.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.181+0000 7f637f7fe700 1 --2- 172.21.15.3:0/1022966285 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f63800a7bc0 0x7f6380148d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:27.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.181+0000 7f637e7fc700 1 -- 172.21.15.3:0/1022966285 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f63800a7bc0 msgr2=0x7f6380148d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:27.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.181+0000 7f637e7fc700 1 --2- 172.21.15.3:0/1022966285 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f63800a7bc0 0x7f6380148d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:27.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.181+0000 7f637e7fc700 1 -- 172.21.15.3:0/1022966285 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f638006c5c0 msgr2=0x7f638015ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:27.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.181+0000 7f637e7fc700 1 --2- 172.21.15.3:0/1022966285 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f638006c5c0 0x7f638015ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:27.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.181+0000 7f637e7fc700 1 -- 172.21.15.3:0/1022966285 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6378009ae0 con 0x7f63800a77f0 2023-10-08T15:37:27.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.181+0000 7f637e7fc700 1 --2- 172.21.15.3:0/1022966285 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f63800a77f0 0x7f638015e380 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f637000c5c0 tx=0x7f637000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:27.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.181+0000 7f6366ffd700 1 -- 172.21.15.3:0/1022966285 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6370011590 con 0x7f63800a77f0 2023-10-08T15:37:27.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.181+0000 7f6366ffd700 1 -- 172.21.15.3:0/1022966285 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6370011710 con 0x7f63800a77f0 2023-10-08T15:37:27.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.181+0000 7f637ffff700 1 -- 172.21.15.3:0/1022966285 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f638014a110 con 0x7f63800a77f0 2023-10-08T15:37:27.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.181+0000 7f6366ffd700 1 -- 172.21.15.3:0/1022966285 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6370011ad0 con 0x7f63800a77f0 2023-10-08T15:37:27.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.181+0000 7f637ffff700 1 -- 172.21.15.3:0/1022966285 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63800a5740 con 0x7f63800a77f0 2023-10-08T15:37:27.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.181+0000 7f637ffff700 1 -- 172.21.15.3:0/1022966285 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6380149e60 con 0x7f63800a77f0 2023-10-08T15:37:27.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.185+0000 7f6366ffd700 1 -- 172.21.15.3:0/1022966285 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f637001b3b0 con 0x7f63800a77f0 2023-10-08T15:37:27.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.185+0000 7f6366ffd700 1 --2- 172.21.15.3:0/1022966285 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f636c060580 0x7f636c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:27.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.185+0000 7f6366ffd700 1 -- 172.21.15.3:0/1022966285 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f637007bbf0 con 0x7f63800a77f0 2023-10-08T15:37:27.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.185+0000 7f637effd700 1 --2- 172.21.15.3:0/1022966285 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f636c060580 0x7f636c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:27.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.185+0000 7f637effd700 1 --2- 172.21.15.3:0/1022966285 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f636c060580 0x7f636c062a30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6374006fd0 tx=0x7f6374008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:27.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.193+0000 7f6366ffd700 1 -- 172.21.15.3:0/1022966285 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f637004c1e0 con 0x7f63800a77f0 2023-10-08T15:37:27.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:27.393+0000 7f637ffff700 1 -- 172.21.15.3:0/1022966285 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f638005ecf0 con 0x7f63800a77f0 2023-10-08T15:37:28.048 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.041+0000 7f6366ffd700 1 -- 172.21.15.3:0/1022966285 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7f637004f800 con 0x7f63800a77f0 2023-10-08T15:37:28.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.045+0000 7f637ffff700 1 -- 172.21.15.3:0/1022966285 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f636c060580 msgr2=0x7f636c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:28.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.045+0000 7f637ffff700 1 --2- 172.21.15.3:0/1022966285 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f636c060580 0x7f636c062a30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6374006fd0 tx=0x7f6374008040 comp rx=0 tx=0).stop 2023-10-08T15:37:28.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.045+0000 7f637ffff700 1 -- 172.21.15.3:0/1022966285 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f63800a77f0 msgr2=0x7f638015e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:28.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.045+0000 7f637ffff700 1 --2- 172.21.15.3:0/1022966285 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f63800a77f0 0x7f638015e380 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f637000c5c0 tx=0x7f637000c8d0 comp rx=0 tx=0).stop 2023-10-08T15:37:28.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.045+0000 7f637ffff700 1 -- 172.21.15.3:0/1022966285 shutdown_connections 2023-10-08T15:37:28.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.045+0000 7f637ffff700 1 --2- 172.21.15.3:0/1022966285 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f636c060580 0x7f636c062a30 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:28.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.045+0000 7f637ffff700 1 --2- 172.21.15.3:0/1022966285 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f63800a7bc0 0x7f6380148d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:28.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.045+0000 7f637ffff700 1 --2- 172.21.15.3:0/1022966285 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f63800a77f0 0x7f638015e380 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:28.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.045+0000 7f637ffff700 1 --2- 172.21.15.3:0/1022966285 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f638006c5c0 0x7f638015ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:28.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.045+0000 7f637ffff700 1 -- 172.21.15.3:0/1022966285 >> 172.21.15.3:0/1022966285 conn(0x7f63800c29f0 msgr2=0x7f63800a21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:28.054 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.045+0000 7f637ffff700 1 -- 172.21.15.3:0/1022966285 shutdown_connections 2023-10-08T15:37:28.054 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.045+0000 7f637ffff700 1 -- 172.21.15.3:0/1022966285 wait complete. 2023-10-08T15:37:28.072 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:37:28.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.177+0000 7ff4153d1700 1 Processor -- start 2023-10-08T15:37:28.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.177+0000 7ff4153d1700 1 -- start start 2023-10-08T15:37:28.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.181+0000 7ff4153d1700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7ff4100a5a80 0x7ff4100bfd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:28.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.181+0000 7ff4153d1700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff41009e9a0 con 0x7ff4100c02d0 2023-10-08T15:37:28.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.181+0000 7ff4153d1700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4100a56a0 con 0x7ff410067310 2023-10-08T15:37:28.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.181+0000 7ff4153d1700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff41009e280 con 0x7ff4100a5a80 2023-10-08T15:37:28.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.181+0000 7ff40e7fc700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7ff4100a5a80 0x7ff4100bfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:28.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.181+0000 7ff40e7fc700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7ff4100a5a80 0x7ff4100bfd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47560/0 (socket says 172.21.15.3:47560) 2023-10-08T15:37:28.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.181+0000 7ff40e7fc700 1 -- 172.21.15.3:0/3461657838 learned_addr learned my addr 172.21.15.3:0/3461657838 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:28.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.181+0000 7ff40f7fe700 1 --1- 172.21.15.3:0/3461657838 >> v1:172.21.15.3:6789/0 conn(0x7ff4100c02d0 0x7ff410152320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:53768/0 (socket says 172.21.15.3:53768) 2023-10-08T15:37:28.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.181+0000 7ff40e7fc700 1 -- 172.21.15.3:0/3461657838 >> v1:172.21.15.50:6789/0 conn(0x7ff410067310 legacy=0x7ff41009ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:28.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.181+0000 7ff40e7fc700 1 -- 172.21.15.3:0/3461657838 >> v1:172.21.15.3:6789/0 conn(0x7ff4100c02d0 legacy=0x7ff410152320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:28.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.181+0000 7ff40e7fc700 1 -- 172.21.15.3:0/3461657838 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff41009e3c0 con 0x7ff4100a5a80 2023-10-08T15:37:28.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.181+0000 7ff40e7fc700 1 --2- 172.21.15.3:0/3461657838 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff4100a5a80 0x7ff4100bfd90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff4000099b0 tx=0x7ff400009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4106c25c416a8be4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:28.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.181+0000 7ff40dffb700 1 -- 172.21.15.3:0/3461657838 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40000b860 con 0x7ff4100a5a80 2023-10-08T15:37:28.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.181+0000 7ff40dffb700 1 -- 172.21.15.3:0/3461657838 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff40000b9c0 con 0x7ff4100a5a80 2023-10-08T15:37:28.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.181+0000 7ff40dffb700 1 -- 172.21.15.3:0/3461657838 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40000bd60 con 0x7ff4100a5a80 2023-10-08T15:37:28.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.181+0000 7ff4153d1700 1 -- 172.21.15.3:0/3461657838 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff4100a5a80 msgr2=0x7ff4100bfd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:28.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.181+0000 7ff4153d1700 1 --2- 172.21.15.3:0/3461657838 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff4100a5a80 0x7ff4100bfd90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff4000099b0 tx=0x7ff400009250 comp rx=0 tx=0).stop 2023-10-08T15:37:28.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.181+0000 7ff4153d1700 1 -- 172.21.15.3:0/3461657838 shutdown_connections 2023-10-08T15:37:28.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.181+0000 7ff4153d1700 1 --2- 172.21.15.3:0/3461657838 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff4100a5a80 0x7ff4100bfd90 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:28.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.181+0000 7ff4153d1700 1 -- 172.21.15.3:0/3461657838 >> 172.21.15.3:0/3461657838 conn(0x7ff41006e0d0 msgr2=0x7ff41006e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:28.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.181+0000 7ff4153d1700 1 -- 172.21.15.3:0/3461657838 shutdown_connections 2023-10-08T15:37:28.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.181+0000 7ff4153d1700 1 -- 172.21.15.3:0/3461657838 wait complete. 2023-10-08T15:37:28.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.185+0000 7ff4153d1700 1 Processor -- start 2023-10-08T15:37:28.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.185+0000 7ff4153d1700 1 -- start start 2023-10-08T15:37:28.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.189+0000 7ff4153d1700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff410067310 0x7ff4101608c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:28.196 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.189+0000 7ff4153d1700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff4100a5a80 0x7ff4100a0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:28.196 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.189+0000 7ff4153d1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4100c02d0 0x7ff410163560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:28.196 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.189+0000 7ff4153d1700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4100b7870 con 0x7ff410067310 2023-10-08T15:37:28.196 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.189+0000 7ff4153d1700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4100b4f10 con 0x7ff4100c02d0 2023-10-08T15:37:28.196 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.189+0000 7ff4153d1700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff410160e00 con 0x7ff4100a5a80 2023-10-08T15:37:28.196 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.189+0000 7ff40effd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff410067310 0x7ff4101608c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:28.196 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.189+0000 7ff40effd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff410067310 0x7ff4101608c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47564/0 (socket says 172.21.15.3:47564) 2023-10-08T15:37:28.196 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.189+0000 7ff40effd700 1 -- 172.21.15.3:0/3477078201 learned_addr learned my addr 172.21.15.3:0/3477078201 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:28.196 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.189+0000 7ff40f7fe700 1 --2- 172.21.15.3:0/3477078201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4100c02d0 0x7ff410163560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:28.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.189+0000 7ff40e7fc700 1 --2- 172.21.15.3:0/3477078201 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff4100a5a80 0x7ff4100a0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:28.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.189+0000 7ff40effd700 1 -- 172.21.15.3:0/3477078201 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff4100a5a80 msgr2=0x7ff4100a0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:28.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.189+0000 7ff40effd700 1 --2- 172.21.15.3:0/3477078201 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff4100a5a80 0x7ff4100a0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:28.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.189+0000 7ff40effd700 1 -- 172.21.15.3:0/3477078201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4100c02d0 msgr2=0x7ff410163560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:28.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.189+0000 7ff40effd700 1 --2- 172.21.15.3:0/3477078201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4100c02d0 0x7ff410163560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:28.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.189+0000 7ff40effd700 1 -- 172.21.15.3:0/3477078201 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4000094f0 con 0x7ff410067310 2023-10-08T15:37:28.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.189+0000 7ff40effd700 1 --2- 172.21.15.3:0/3477078201 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff410067310 0x7ff4101608c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff40400c7c0 tx=0x7ff404007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:28.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.189+0000 7ff3f6ffd700 1 -- 172.21.15.3:0/3477078201 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff404011590 con 0x7ff410067310 2023-10-08T15:37:28.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.189+0000 7ff3f6ffd700 1 -- 172.21.15.3:0/3477078201 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4040116f0 con 0x7ff410067310 2023-10-08T15:37:28.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.189+0000 7ff3f6ffd700 1 -- 172.21.15.3:0/3477078201 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff404011ab0 con 0x7ff410067310 2023-10-08T15:37:28.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.189+0000 7ff4153d1700 1 -- 172.21.15.3:0/3477078201 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4101538f0 con 0x7ff410067310 2023-10-08T15:37:28.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.189+0000 7ff4153d1700 1 -- 172.21.15.3:0/3477078201 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4100b74b0 con 0x7ff410067310 2023-10-08T15:37:28.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.189+0000 7ff4153d1700 1 -- 172.21.15.3:0/3477078201 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff410064530 con 0x7ff410067310 2023-10-08T15:37:28.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.193+0000 7ff3f6ffd700 1 -- 172.21.15.3:0/3477078201 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff40401b3b0 con 0x7ff410067310 2023-10-08T15:37:28.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.193+0000 7ff3f6ffd700 1 --2- 172.21.15.3:0/3477078201 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff3fc060580 0x7ff3fc062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:28.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.193+0000 7ff3f6ffd700 1 -- 172.21.15.3:0/3477078201 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff40407bb10 con 0x7ff410067310 2023-10-08T15:37:28.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.193+0000 7ff40e7fc700 1 --2- 172.21.15.3:0/3477078201 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff3fc060580 0x7ff3fc062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:28.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.193+0000 7ff40e7fc700 1 --2- 172.21.15.3:0/3477078201 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff3fc060580 0x7ff3fc062a30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff4000099b0 tx=0x7ff400017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:28.205 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.197+0000 7ff3f6ffd700 1 -- 172.21.15.3:0/3477078201 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff40404c100 con 0x7ff410067310 2023-10-08T15:37:28.405 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.397+0000 7ff4153d1700 1 -- 172.21.15.3:0/3477078201 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff41006f6d0 con 0x7ff410067310 2023-10-08T15:37:28.405 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.401+0000 7ff3f6ffd700 1 -- 172.21.15.3:0/3477078201 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+3073 (secure 0 0 0) 0x7ff404017020 con 0x7ff410067310 2023-10-08T15:37:28.406 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:37:28.406 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6833/519836882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":519836882},{"type":"v1","addr":"172.21.15.3:6833","nonce":519836882}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:37:25.379215+0000","modified":"2023-10-08T15:37:28.041086+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/1601527591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1601527591},{"type":"v1","addr":"172.21.15.50:6835","nonce":1601527591}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-08T15:37:28.408 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.401+0000 7ff4153d1700 1 -- 172.21.15.3:0/3477078201 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff3fc060580 msgr2=0x7ff3fc062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:28.408 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.401+0000 7ff4153d1700 1 --2- 172.21.15.3:0/3477078201 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff3fc060580 0x7ff3fc062a30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff4000099b0 tx=0x7ff400017000 comp rx=0 tx=0).stop 2023-10-08T15:37:28.408 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.401+0000 7ff4153d1700 1 -- 172.21.15.3:0/3477078201 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff410067310 msgr2=0x7ff4101608c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:28.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.401+0000 7ff4153d1700 1 --2- 172.21.15.3:0/3477078201 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff410067310 0x7ff4101608c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff40400c7c0 tx=0x7ff404007f40 comp rx=0 tx=0).stop 2023-10-08T15:37:28.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.401+0000 7ff4153d1700 1 -- 172.21.15.3:0/3477078201 shutdown_connections 2023-10-08T15:37:28.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.401+0000 7ff4153d1700 1 --2- 172.21.15.3:0/3477078201 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff3fc060580 0x7ff3fc062a30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:28.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.401+0000 7ff4153d1700 1 --2- 172.21.15.3:0/3477078201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4100c02d0 0x7ff410163560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:28.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.401+0000 7ff4153d1700 1 --2- 172.21.15.3:0/3477078201 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff4100a5a80 0x7ff4100a0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:28.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.401+0000 7ff4153d1700 1 --2- 172.21.15.3:0/3477078201 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff410067310 0x7ff4101608c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:28.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.401+0000 7ff4153d1700 1 -- 172.21.15.3:0/3477078201 >> 172.21.15.3:0/3477078201 conn(0x7ff41006e0d0 msgr2=0x7ff4100bf550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:28.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.401+0000 7ff4153d1700 1 -- 172.21.15.3:0/3477078201 shutdown_connections 2023-10-08T15:37:28.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.401+0000 7ff4153d1700 1 -- 172.21.15.3:0/3477078201 wait complete. 2023-10-08T15:37:28.410 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 6 2023-10-08T15:37:28.420 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:37:28.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.521+0000 7fd841183700 1 Processor -- start 2023-10-08T15:37:28.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.521+0000 7fd841183700 1 -- start start 2023-10-08T15:37:28.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.525+0000 7fd841183700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd83c14ac50 0x7fd83c14b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:28.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.525+0000 7fd841183700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd83c06be60 0x7fd83c06c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:28.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.525+0000 7fd841183700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fd83c06ca70 0x7fd83c06cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:28.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.525+0000 7fd841183700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd83c14c6b0 con 0x7fd83c06ca70 2023-10-08T15:37:28.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.525+0000 7fd841183700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd83c14c060 con 0x7fd83c14ac50 2023-10-08T15:37:28.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.525+0000 7fd841183700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd83c14c340 con 0x7fd83c06be60 2023-10-08T15:37:28.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.525+0000 7fd840982700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fd83c06ca70 0x7fd83c06cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:28.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.525+0000 7fd83b7fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd83c06be60 0x7fd83c06c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:28.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.525+0000 7fd840982700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fd83c06ca70 0x7fd83c06cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47574/0 (socket says 172.21.15.3:47574) 2023-10-08T15:37:28.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.525+0000 7fd840982700 1 -- 172.21.15.3:0/3164420761 learned_addr learned my addr 172.21.15.3:0/3164420761 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:28.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.525+0000 7fd83bfff700 1 --2- 172.21.15.3:0/3164420761 >> v2:172.21.15.50:3300/0 conn(0x7fd83c14ac50 0x7fd83c14b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:28.532 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.525+0000 7fd83b7fe700 1 -- 172.21.15.3:0/3164420761 >> v2:172.21.15.50:3300/0 conn(0x7fd83c14ac50 msgr2=0x7fd83c14b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:28.532 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.525+0000 7fd83b7fe700 1 --2- 172.21.15.3:0/3164420761 >> v2:172.21.15.50:3300/0 conn(0x7fd83c14ac50 0x7fd83c14b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:28.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.525+0000 7fd83b7fe700 1 -- 172.21.15.3:0/3164420761 >> v2:172.21.15.3:3300/0 conn(0x7fd83c06ca70 msgr2=0x7fd83c06cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:28.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.525+0000 7fd83b7fe700 1 --2- 172.21.15.3:0/3164420761 >> v2:172.21.15.3:3300/0 conn(0x7fd83c06ca70 0x7fd83c06cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:28.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.525+0000 7fd83b7fe700 1 -- 172.21.15.3:0/3164420761 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd83c14e860 con 0x7fd83c06be60 2023-10-08T15:37:28.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.525+0000 7fd83bfff700 1 --2- 172.21.15.3:0/3164420761 >> v2:172.21.15.50:3300/0 conn(0x7fd83c14ac50 0x7fd83c14b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:37:28.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.525+0000 7fd840982700 1 --2- 172.21.15.3:0/3164420761 >> v2:172.21.15.3:3300/0 conn(0x7fd83c06ca70 0x7fd83c06cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:37:28.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.525+0000 7fd83b7fe700 1 --2- 172.21.15.3:0/3164420761 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd83c06be60 0x7fd83c06c530 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd83c069ed0 tx=0x7fd82c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81da789054dd294 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:28.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.525+0000 7fd83affd700 1 -- 172.21.15.3:0/3164420761 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c011630 con 0x7fd83c06be60 2023-10-08T15:37:28.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.525+0000 7fd83affd700 1 -- 172.21.15.3:0/3164420761 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82c0117b0 con 0x7fd83c06be60 2023-10-08T15:37:28.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.525+0000 7fd83affd700 1 -- 172.21.15.3:0/3164420761 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c011b70 con 0x7fd83c06be60 2023-10-08T15:37:28.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.525+0000 7fd841183700 1 -- 172.21.15.3:0/3164420761 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd83c06be60 msgr2=0x7fd83c06c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:28.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.525+0000 7fd841183700 1 --2- 172.21.15.3:0/3164420761 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd83c06be60 0x7fd83c06c530 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd83c069ed0 tx=0x7fd82c0091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:28.534 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.525+0000 7fd841183700 1 -- 172.21.15.3:0/3164420761 shutdown_connections 2023-10-08T15:37:28.534 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.525+0000 7fd841183700 1 --2- 172.21.15.3:0/3164420761 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd83c06be60 0x7fd83c06c530 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:28.534 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.525+0000 7fd841183700 1 --2- 172.21.15.3:0/3164420761 >> v2:172.21.15.3:3300/0 conn(0x7fd83c06ca70 0x7fd83c06cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:28.534 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.525+0000 7fd841183700 1 --2- 172.21.15.3:0/3164420761 >> v2:172.21.15.50:3300/0 conn(0x7fd83c14ac50 0x7fd83c14b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:28.534 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.525+0000 7fd841183700 1 -- 172.21.15.3:0/3164420761 >> 172.21.15.3:0/3164420761 conn(0x7fd83c0c1df0 msgr2=0x7fd83c0c21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:28.534 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.525+0000 7fd841183700 1 -- 172.21.15.3:0/3164420761 shutdown_connections 2023-10-08T15:37:28.534 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.525+0000 7fd841183700 1 -- 172.21.15.3:0/3164420761 wait complete. 2023-10-08T15:37:28.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.529+0000 7fd841183700 1 Processor -- start 2023-10-08T15:37:28.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.529+0000 7fd841183700 1 -- start start 2023-10-08T15:37:28.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.529+0000 7fd841183700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd83c06be60 0x7fd83c09e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:28.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.529+0000 7fd841183700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd83c06ca70 0x7fd83c15e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:28.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.529+0000 7fd841183700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd83c14ac50 0x7fd83c09cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:28.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.529+0000 7fd841183700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd83c15ef90 con 0x7fd83c06ca70 2023-10-08T15:37:28.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.529+0000 7fd841183700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd83c0a09a0 con 0x7fd83c14ac50 2023-10-08T15:37:28.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.529+0000 7fd841183700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd83c0a2130 con 0x7fd83c06be60 2023-10-08T15:37:28.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.529+0000 7fd83b7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd83c06ca70 0x7fd83c15e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:28.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.529+0000 7fd83b7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd83c06ca70 0x7fd83c15e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47580/0 (socket says 172.21.15.3:47580) 2023-10-08T15:37:28.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.529+0000 7fd83b7fe700 1 -- 172.21.15.3:0/2357040963 learned_addr learned my addr 172.21.15.3:0/2357040963 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:28.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.529+0000 7fd840982700 1 --2- 172.21.15.3:0/2357040963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd83c14ac50 0x7fd83c09cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:28.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.529+0000 7fd83bfff700 1 --2- 172.21.15.3:0/2357040963 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd83c06be60 0x7fd83c09e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:28.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.529+0000 7fd83b7fe700 1 -- 172.21.15.3:0/2357040963 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd83c06be60 msgr2=0x7fd83c09e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:28.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.529+0000 7fd83b7fe700 1 --2- 172.21.15.3:0/2357040963 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd83c06be60 0x7fd83c09e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:28.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.529+0000 7fd83b7fe700 1 -- 172.21.15.3:0/2357040963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd83c14ac50 msgr2=0x7fd83c09cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:28.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.529+0000 7fd83b7fe700 1 --2- 172.21.15.3:0/2357040963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd83c14ac50 0x7fd83c09cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:28.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.529+0000 7fd83b7fe700 1 -- 172.21.15.3:0/2357040963 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd834009ae0 con 0x7fd83c06ca70 2023-10-08T15:37:28.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.529+0000 7fd83b7fe700 1 --2- 172.21.15.3:0/2357040963 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd83c06ca70 0x7fd83c15e450 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd82c013000 tx=0x7fd82c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:28.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.529+0000 7fd823fff700 1 -- 172.21.15.3:0/2357040963 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c01f070 con 0x7fd83c06ca70 2023-10-08T15:37:28.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.529+0000 7fd823fff700 1 -- 172.21.15.3:0/2357040963 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82c000bc0 con 0x7fd83c06ca70 2023-10-08T15:37:28.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.529+0000 7fd841183700 1 -- 172.21.15.3:0/2357040963 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd830009420 con 0x7fd83c06ca70 2023-10-08T15:37:28.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.529+0000 7fd823fff700 1 -- 172.21.15.3:0/2357040963 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c011b70 con 0x7fd83c06ca70 2023-10-08T15:37:28.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.529+0000 7fd841183700 1 -- 172.21.15.3:0/2357040963 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd82c009420 con 0x7fd83c06ca70 2023-10-08T15:37:28.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.529+0000 7fd841183700 1 -- 172.21.15.3:0/2357040963 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd83c0a0800 con 0x7fd83c06ca70 2023-10-08T15:37:28.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.533+0000 7fd823fff700 1 -- 172.21.15.3:0/2357040963 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fd82c023070 con 0x7fd83c06ca70 2023-10-08T15:37:28.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.533+0000 7fd823fff700 1 --2- 172.21.15.3:0/2357040963 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd828060550 0x7fd828062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:28.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.533+0000 7fd823fff700 1 -- 172.21.15.3:0/2357040963 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd82c07db20 con 0x7fd83c06ca70 2023-10-08T15:37:28.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.533+0000 7fd83bfff700 1 --2- 172.21.15.3:0/2357040963 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd828060550 0x7fd828062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:28.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.533+0000 7fd83bfff700 1 --2- 172.21.15.3:0/2357040963 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd828060550 0x7fd828062a00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd830009ea0 tx=0x7fd8300091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:28.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.545+0000 7fd823fff700 1 -- 172.21.15.3:0/2357040963 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd83c0a0800 con 0x7fd83c06ca70 2023-10-08T15:37:28.714 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.709+0000 7fd841183700 1 -- 172.21.15.3:0/2357040963 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd83c0a0800 con 0x7fd83c06ca70 2023-10-08T15:37:28.716 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.709+0000 7fd823fff700 1 -- 172.21.15.3:0/2357040963 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15254 (secure 0 0 0) 0x7fd83c0a0800 con 0x7fd83c06ca70 2023-10-08T15:37:28.716 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:37:28.716 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":20,"fsid":"7635972e-cd66-4a8f-a231-378db8b3847a","created":"2023-10-08T15:37:08.234594+0000","modified":"2023-10-08T15:37:27.007828+0000","last_up_change":"2023-10-08T15:37:17.537726+0000","last_in_change":"2023-10-08T15:37:10.269178+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:37:16.581590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:37:23.353518+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T15:37:24.365114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"64fb1864-bfdd-4d75-9b41-03fb60085dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33363},{"type":"v1","addr":"172.21.15.3:6801","nonce":33363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33363},{"type":"v1","addr":"172.21.15.3:6803","nonce":33363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":33363},{"type":"v1","addr":"172.21.15.3:6807","nonce":33363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33363},{"type":"v1","addr":"172.21.15.3:6805","nonce":33363}]},"public_addr":"172.21.15.3:6801/33363","cluster_addr":"172.21.15.3:6803/33363","heartbeat_back_addr":"172.21.15.3:6807/33363","heartbeat_front_addr":"172.21.15.3:6805/33363","state":["exists","up"]},{"osd":1,"uuid":"3ca6bd3a-3e8a-4c65-af9c-46148b0c2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33364},{"type":"v1","addr":"172.21.15.3:6820","nonce":33364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33364},{"type":"v1","addr":"172.21.15.3:6824","nonce":33364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33364},{"type":"v1","addr":"172.21.15.3:6831","nonce":33364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33364},{"type":"v1","addr":"172.21.15.3:6828","nonce":33364}]},"public_addr":"172.21.15.3:6820/33364","cluster_addr":"172.21.15.3:6824/33364","heartbeat_back_addr":"172.21.15.3:6831/33364","heartbeat_front_addr":"172.21.15.3:6828/33364","state":["exists","up"]},{"osd":2,"uuid":"6eb9f757-58dd-442f-910d-32401454bce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33366},{"type":"v1","addr":"172.21.15.3:6817","nonce":33366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":33366},{"type":"v1","addr":"172.21.15.3:6821","nonce":33366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6827","nonce":33366},{"type":"v1","addr":"172.21.15.3:6829","nonce":33366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":33366},{"type":"v1","addr":"172.21.15.3:6825","nonce":33366}]},"public_addr":"172.21.15.3:6817/33366","cluster_addr":"172.21.15.3:6821/33366","heartbeat_back_addr":"172.21.15.3:6829/33366","heartbeat_front_addr":"172.21.15.3:6825/33366","state":["exists","up"]},{"osd":3,"uuid":"1c39866b-ac2e-4ea9-a69c-02b01ee4191d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33365},{"type":"v1","addr":"172.21.15.3:6809","nonce":33365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":33365},{"type":"v1","addr":"172.21.15.3:6811","nonce":33365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33365},{"type":"v1","addr":"172.21.15.3:6815","nonce":33365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":33365},{"type":"v1","addr":"172.21.15.3:6813","nonce":33365}]},"public_addr":"172.21.15.3:6809/33365","cluster_addr":"172.21.15.3:6811/33365","heartbeat_back_addr":"172.21.15.3:6815/33365","heartbeat_front_addr":"172.21.15.3:6813/33365","state":["exists","up"]},{"osd":4,"uuid":"15f86b61-b7f1-4780-ae00-9d80a68cb830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":33605},{"type":"v1","addr":"172.21.15.50:6809","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33605},{"type":"v1","addr":"172.21.15.50:6811","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33605},{"type":"v1","addr":"172.21.15.50:6815","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":33605},{"type":"v1","addr":"172.21.15.50:6813","nonce":33605}]},"public_addr":"172.21.15.50:6809/33605","cluster_addr":"172.21.15.50:6811/33605","heartbeat_back_addr":"172.21.15.50:6815/33605","heartbeat_front_addr":"172.21.15.50:6813/33605","state":["exists","up"]},{"osd":5,"uuid":"726c3003-34e6-4d5a-b6e2-f911e13c2118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33606},{"type":"v1","addr":"172.21.15.50:6801","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33606},{"type":"v1","addr":"172.21.15.50:6803","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33606},{"type":"v1","addr":"172.21.15.50:6807","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":33606},{"type":"v1","addr":"172.21.15.50:6805","nonce":33606}]},"public_addr":"172.21.15.50:6801/33606","cluster_addr":"172.21.15.50:6803/33606","heartbeat_back_addr":"172.21.15.50:6807/33606","heartbeat_front_addr":"172.21.15.50:6805/33606","state":["exists","up"]},{"osd":6,"uuid":"401122a4-9988-441f-a5a7-39164434ebcd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":33607},{"type":"v1","addr":"172.21.15.50:6819","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":33607},{"type":"v1","addr":"172.21.15.50:6823","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":33607},{"type":"v1","addr":"172.21.15.50:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":33607},{"type":"v1","addr":"172.21.15.50:6827","nonce":33607}]},"public_addr":"172.21.15.50:6819/33607","cluster_addr":"172.21.15.50:6823/33607","heartbeat_back_addr":"172.21.15.50:6831/33607","heartbeat_front_addr":"172.21.15.50:6827/33607","state":["exists","up"]},{"osd":7,"uuid":"6b3fa236-c9d0-4c4d-82ae-9af4daf6d699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33604},{"type":"v1","addr":"172.21.15.50:6818","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":33604},{"type":"v1","addr":"172.21.15.50:6822","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":33604},{"type":"v1","addr":"172.21.15.50:6830","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":33604},{"type":"v1","addr":"172.21.15.50:6826","nonce":33604}]},"public_addr":"172.21.15.50:6818/33604","cluster_addr":"172.21.15.50:6822/33604","heartbeat_back_addr":"172.21.15.50:6830/33604","heartbeat_front_addr":"172.21.15.50:6826/33604","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.497794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.529417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.873426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.325972+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.443971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.240795+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.739632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.643026+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:37:28.720 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.713+0000 7fd841183700 1 -- 172.21.15.3:0/2357040963 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd828060550 msgr2=0x7fd828062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:28.720 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.713+0000 7fd841183700 1 --2- 172.21.15.3:0/2357040963 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd828060550 0x7fd828062a00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd830009ea0 tx=0x7fd8300091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:28.720 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.713+0000 7fd841183700 1 -- 172.21.15.3:0/2357040963 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd83c06ca70 msgr2=0x7fd83c15e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:28.720 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.713+0000 7fd841183700 1 --2- 172.21.15.3:0/2357040963 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd83c06ca70 0x7fd83c15e450 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd82c013000 tx=0x7fd82c017000 comp rx=0 tx=0).stop 2023-10-08T15:37:28.720 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.713+0000 7fd841183700 1 -- 172.21.15.3:0/2357040963 shutdown_connections 2023-10-08T15:37:28.721 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.713+0000 7fd841183700 1 --2- 172.21.15.3:0/2357040963 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd828060550 0x7fd828062a00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:28.721 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.713+0000 7fd841183700 1 --2- 172.21.15.3:0/2357040963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd83c14ac50 0x7fd83c09cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:28.721 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.713+0000 7fd841183700 1 --2- 172.21.15.3:0/2357040963 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd83c06ca70 0x7fd83c15e450 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:28.721 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.713+0000 7fd841183700 1 --2- 172.21.15.3:0/2357040963 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd83c06be60 0x7fd83c09e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:28.721 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.713+0000 7fd841183700 1 -- 172.21.15.3:0/2357040963 >> 172.21.15.3:0/2357040963 conn(0x7fd83c0c1df0 msgr2=0x7fd83c06ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:28.721 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.713+0000 7fd841183700 1 -- 172.21.15.3:0/2357040963 shutdown_connections 2023-10-08T15:37:28.721 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.713+0000 7fd841183700 1 -- 172.21.15.3:0/2357040963 wait complete. 2023-10-08T15:37:28.736 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T15:37:28.737 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T15:37:28.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.837+0000 7f5b1d06b700 1 Processor -- start 2023-10-08T15:37:28.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.837+0000 7f5b1d06b700 1 -- start start 2023-10-08T15:37:28.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.837+0000 7f5b1d06b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5b180bb0c0 0x7f5b1814a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:28.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.837+0000 7f5b1d06b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5b180b8a40 0x7f5b1814adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:28.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.837+0000 7f5b1d06b700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b1814eb80 con 0x7f5b180bacf0 2023-10-08T15:37:28.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.837+0000 7f5b1d06b700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b180b9e50 con 0x7f5b180bb0c0 2023-10-08T15:37:28.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.837+0000 7f5b1d06b700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b180ba130 con 0x7f5b180b8a40 2023-10-08T15:37:28.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.837+0000 7f5b177fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5b180bb0c0 0x7f5b1814a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:28.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.837+0000 7f5b1c86a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5b180b8a40 0x7f5b1814adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:28.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.837+0000 7f5b177fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5b180bb0c0 0x7f5b1814a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.3:36734/0 (socket says 172.21.15.3:36734) 2023-10-08T15:37:28.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.837+0000 7f5b177fe700 1 -- 172.21.15.3:0/282369833 learned_addr learned my addr 172.21.15.3:0/282369833 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:28.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.837+0000 7f5b1c86a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5b180b8a40 0x7f5b1814adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.3:44228/0 (socket says 172.21.15.3:44228) 2023-10-08T15:37:28.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.837+0000 7f5b17fff700 1 --1- 172.21.15.3:0/282369833 >> v1:172.21.15.50:6789/0 conn(0x7f5b180bacf0 0x7f5b1814f010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.3:46066/0 (socket says 172.21.15.3:46066) 2023-10-08T15:37:28.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.837+0000 7f5b177fe700 1 -- 172.21.15.3:0/282369833 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5b180b8a40 msgr2=0x7f5b1814adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:28.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.837+0000 7f5b177fe700 1 --2- 172.21.15.3:0/282369833 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5b180b8a40 0x7f5b1814adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:28.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.837+0000 7f5b177fe700 1 -- 172.21.15.3:0/282369833 >> v1:172.21.15.50:6789/0 conn(0x7f5b180bacf0 legacy=0x7f5b1814f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:28.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.837+0000 7f5b177fe700 1 -- 172.21.15.3:0/282369833 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b180b9b20 con 0x7f5b180bb0c0 2023-10-08T15:37:28.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.837+0000 7f5b177fe700 1 --2- 172.21.15.3:0/282369833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b180bb0c0 0x7f5b1814a870 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5b080099b0 tx=0x7f5b08009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=460455f9f54116af server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:28.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.841+0000 7f5b16ffd700 1 -- 172.21.15.3:0/282369833 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b08009ea0 con 0x7f5b180bb0c0 2023-10-08T15:37:28.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.841+0000 7f5b16ffd700 1 -- 172.21.15.3:0/282369833 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b0800b860 con 0x7f5b180bb0c0 2023-10-08T15:37:28.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.841+0000 7f5b16ffd700 1 -- 172.21.15.3:0/282369833 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0800bc00 con 0x7f5b180bb0c0 2023-10-08T15:37:28.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.841+0000 7f5b1d06b700 1 -- 172.21.15.3:0/282369833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b180bb0c0 msgr2=0x7f5b1814a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:28.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.841+0000 7f5b1d06b700 1 --2- 172.21.15.3:0/282369833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b180bb0c0 0x7f5b1814a870 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5b080099b0 tx=0x7f5b08009250 comp rx=0 tx=0).stop 2023-10-08T15:37:28.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.841+0000 7f5b1d06b700 1 -- 172.21.15.3:0/282369833 shutdown_connections 2023-10-08T15:37:28.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.841+0000 7f5b1d06b700 1 --2- 172.21.15.3:0/282369833 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5b180b8a40 0x7f5b1814adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:28.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.841+0000 7f5b1d06b700 1 --2- 172.21.15.3:0/282369833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b180bb0c0 0x7f5b1814a870 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:28.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.841+0000 7f5b1d06b700 1 -- 172.21.15.3:0/282369833 >> 172.21.15.3:0/282369833 conn(0x7f5b180be4a0 msgr2=0x7f5b180ba440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:28.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.841+0000 7f5b1d06b700 1 -- 172.21.15.3:0/282369833 shutdown_connections 2023-10-08T15:37:28.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.841+0000 7f5b1d06b700 1 -- 172.21.15.3:0/282369833 wait complete. 2023-10-08T15:37:28.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.845+0000 7f5b1d06b700 1 Processor -- start 2023-10-08T15:37:28.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.845+0000 7f5b1d06b700 1 -- start start 2023-10-08T15:37:28.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.845+0000 7f5b1d06b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5b180b8a40 0x7f5b18149020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:28.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.845+0000 7f5b1d06b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b180bacf0 0x7f5b18095a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:28.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.845+0000 7f5b1d06b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5b180bb0c0 0x7f5b1814d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:28.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.845+0000 7f5b1d06b700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1814db70 con 0x7f5b180bb0c0 2023-10-08T15:37:28.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.845+0000 7f5b1d06b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b18099380 con 0x7f5b180bacf0 2023-10-08T15:37:28.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.845+0000 7f5b1d06b700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b18148ae0 con 0x7f5b180b8a40 2023-10-08T15:37:28.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.845+0000 7f5b1c86a700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5b180bb0c0 0x7f5b1814d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:28.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.845+0000 7f5b1c86a700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5b180bb0c0 0x7f5b1814d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47588/0 (socket says 172.21.15.3:47588) 2023-10-08T15:37:28.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.845+0000 7f5b1c86a700 1 -- 172.21.15.3:0/136683510 learned_addr learned my addr 172.21.15.3:0/136683510 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:28.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.845+0000 7f5b177fe700 1 --2- 172.21.15.3:0/136683510 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b180bacf0 0x7f5b18095a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:28.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.845+0000 7f5b17fff700 1 --2- 172.21.15.3:0/136683510 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5b180b8a40 0x7f5b18149020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:28.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.845+0000 7f5b1c86a700 1 -- 172.21.15.3:0/136683510 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5b180b8a40 msgr2=0x7f5b18149020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:28.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.845+0000 7f5b1c86a700 1 --2- 172.21.15.3:0/136683510 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5b180b8a40 0x7f5b18149020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:28.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.845+0000 7f5b1c86a700 1 -- 172.21.15.3:0/136683510 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b180bacf0 msgr2=0x7f5b18095a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:28.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.845+0000 7f5b1c86a700 1 --2- 172.21.15.3:0/136683510 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b180bacf0 0x7f5b18095a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:28.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.845+0000 7f5b1c86a700 1 -- 172.21.15.3:0/136683510 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b080094f0 con 0x7f5b180bb0c0 2023-10-08T15:37:28.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.845+0000 7f5b1c86a700 1 --2- 172.21.15.3:0/136683510 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5b180bb0c0 0x7f5b1814d630 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5b10009ec0 tx=0x7f5b1000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:28.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.845+0000 7f5afffff700 1 -- 172.21.15.3:0/136683510 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1000cb70 con 0x7f5b180bb0c0 2023-10-08T15:37:28.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.845+0000 7f5afffff700 1 -- 172.21.15.3:0/136683510 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b1000f040 con 0x7f5b180bb0c0 2023-10-08T15:37:28.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.845+0000 7f5b1d06b700 1 -- 172.21.15.3:0/136683510 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b181495a0 con 0x7f5b180bb0c0 2023-10-08T15:37:28.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.845+0000 7f5afffff700 1 -- 172.21.15.3:0/136683510 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b10014480 con 0x7f5b180bb0c0 2023-10-08T15:37:28.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.845+0000 7f5b1d06b700 1 -- 172.21.15.3:0/136683510 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b1815eb20 con 0x7f5b180bb0c0 2023-10-08T15:37:28.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.849+0000 7f5b1d06b700 1 -- 172.21.15.3:0/136683510 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b180991e0 con 0x7f5b180bb0c0 2023-10-08T15:37:28.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.849+0000 7f5afffff700 1 -- 172.21.15.3:0/136683510 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5b100147f0 con 0x7f5b180bb0c0 2023-10-08T15:37:28.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.849+0000 7f5afffff700 1 --2- 172.21.15.3:0/136683510 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5b04060550 0x7f5b04062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:28.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.849+0000 7f5afffff700 1 -- 172.21.15.3:0/136683510 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5b1007d410 con 0x7f5b180bb0c0 2023-10-08T15:37:28.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.849+0000 7f5b17fff700 1 --2- 172.21.15.3:0/136683510 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5b04060550 0x7f5b04062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:28.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.849+0000 7f5b17fff700 1 --2- 172.21.15.3:0/136683510 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5b04060550 0x7f5b04062a00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c004f40 tx=0x7f5b0c007eb0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:28.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:28.857+0000 7f5afffff700 1 -- 172.21.15.3:0/136683510 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5b180991e0 con 0x7f5b180bb0c0 2023-10-08T15:37:29.020 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.013+0000 7f5b1d06b700 1 -- 172.21.15.3:0/136683510 --> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5b180995c0 con 0x7f5b04060550 2023-10-08T15:37:29.034 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.029+0000 7f5afffff700 1 -- 172.21.15.3:0/136683510 <== mgr.4102 v2:172.21.15.50:6832/33268 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+253394 (secure 0 0 0) 0x7f5b180995c0 con 0x7f5b04060550 2023-10-08T15:37:29.038 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:37:29.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.033+0000 7f5b1d06b700 1 -- 172.21.15.3:0/136683510 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5b04060550 msgr2=0x7f5b04062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:29.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.033+0000 7f5b1d06b700 1 --2- 172.21.15.3:0/136683510 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5b04060550 0x7f5b04062a00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c004f40 tx=0x7f5b0c007eb0 comp rx=0 tx=0).stop 2023-10-08T15:37:29.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.033+0000 7f5b1d06b700 1 -- 172.21.15.3:0/136683510 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5b180bb0c0 msgr2=0x7f5b1814d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:29.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.033+0000 7f5b1d06b700 1 --2- 172.21.15.3:0/136683510 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5b180bb0c0 0x7f5b1814d630 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5b10009ec0 tx=0x7f5b1000b040 comp rx=0 tx=0).stop 2023-10-08T15:37:29.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.033+0000 7f5b1d06b700 1 -- 172.21.15.3:0/136683510 shutdown_connections 2023-10-08T15:37:29.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.033+0000 7f5b1d06b700 1 --2- 172.21.15.3:0/136683510 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5b04060550 0x7f5b04062a00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:29.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.033+0000 7f5b1d06b700 1 --2- 172.21.15.3:0/136683510 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5b180bb0c0 0x7f5b1814d630 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:29.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.033+0000 7f5b1d06b700 1 --2- 172.21.15.3:0/136683510 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b180bacf0 0x7f5b18095a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:29.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.033+0000 7f5b1d06b700 1 --2- 172.21.15.3:0/136683510 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5b180b8a40 0x7f5b18149020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:29.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.033+0000 7f5b1d06b700 1 -- 172.21.15.3:0/136683510 >> 172.21.15.3:0/136683510 conn(0x7f5b180be4a0 msgr2=0x7f5b18068990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:29.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.033+0000 7f5b1d06b700 1 -- 172.21.15.3:0/136683510 shutdown_connections 2023-10-08T15:37:29.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.033+0000 7f5b1d06b700 1 -- 172.21.15.3:0/136683510 wait complete. 2023-10-08T15:37:29.041 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2023-10-08T15:37:29.053 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2023-10-08T15:37:28.508200+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590390,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":160,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":48,"acting":48,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":19,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":2396108,"kb_used_data":1400,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752578612,"statfs":{"total":773094113280,"available":770640498688,"internally_reserved":0,"allocated":1433600,"data_stored":1574590,"data_compressed":66282,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.511369"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.049673+0000","last_change":"2023-10-08T15:37:26.049673+0000","last_active":"2023-10-08T15:37:26.049673+0000","last_peered":"2023-10-08T15:37:26.049673+0000","last_clean":"2023-10-08T15:37:26.049673+0000","last_became_active":"2023-10-08T15:37:26.048595+0000","last_became_peered":"2023-10-08T15:37:26.048595+0000","last_unstale":"2023-10-08T15:37:26.049673+0000","last_undegraded":"2023-10-08T15:37:26.049673+0000","last_fullsized":"2023-10-08T15:37:26.049673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:05:25.732352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.046262+0000","last_change":"2023-10-08T15:37:26.046262+0000","last_active":"2023-10-08T15:37:26.046262+0000","last_peered":"2023-10-08T15:37:26.046262+0000","last_clean":"2023-10-08T15:37:26.046262+0000","last_became_active":"2023-10-08T15:37:26.045955+0000","last_became_peered":"2023-10-08T15:37:26.045955+0000","last_unstale":"2023-10-08T15:37:26.046262+0000","last_undegraded":"2023-10-08T15:37:26.046262+0000","last_fullsized":"2023-10-08T15:37:26.046262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:14:44.577836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.056900+0000","last_change":"2023-10-08T15:37:26.039886+0000","last_active":"2023-10-08T15:37:26.056900+0000","last_peered":"2023-10-08T15:37:26.056900+0000","last_clean":"2023-10-08T15:37:26.056900+0000","last_became_active":"2023-10-08T15:37:26.039551+0000","last_became_peered":"2023-10-08T15:37:26.039551+0000","last_unstale":"2023-10-08T15:37:26.056900+0000","last_undegraded":"2023-10-08T15:37:26.056900+0000","last_fullsized":"2023-10-08T15:37:26.056900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:18:49.734343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.050368+0000","last_change":"2023-10-08T15:37:26.050368+0000","last_active":"2023-10-08T15:37:26.050368+0000","last_peered":"2023-10-08T15:37:26.050368+0000","last_clean":"2023-10-08T15:37:26.050368+0000","last_became_active":"2023-10-08T15:37:26.050078+0000","last_became_peered":"2023-10-08T15:37:26.050078+0000","last_unstale":"2023-10-08T15:37:26.050368+0000","last_undegraded":"2023-10-08T15:37:26.050368+0000","last_fullsized":"2023-10-08T15:37:26.050368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:56:34.490787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.045671+0000","last_change":"2023-10-08T15:37:26.045671+0000","last_active":"2023-10-08T15:37:26.045671+0000","last_peered":"2023-10-08T15:37:26.045671+0000","last_clean":"2023-10-08T15:37:26.045671+0000","last_became_active":"2023-10-08T15:37:26.045356+0000","last_became_peered":"2023-10-08T15:37:26.045356+0000","last_unstale":"2023-10-08T15:37:26.045671+0000","last_undegraded":"2023-10-08T15:37:26.045671+0000","last_fullsized":"2023-10-08T15:37:26.045671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:47:37.094485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.045121+0000","last_change":"2023-10-08T15:37:26.045121+0000","last_active":"2023-10-08T15:37:26.045121+0000","last_peered":"2023-10-08T15:37:26.045121+0000","last_clean":"2023-10-08T15:37:26.045121+0000","last_became_active":"2023-10-08T15:37:26.044638+0000","last_became_peered":"2023-10-08T15:37:26.044638+0000","last_unstale":"2023-10-08T15:37:26.045121+0000","last_undegraded":"2023-10-08T15:37:26.045121+0000","last_fullsized":"2023-10-08T15:37:26.045121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:45:12.654892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.035585+0000","last_change":"2023-10-08T15:37:26.035585+0000","last_active":"2023-10-08T15:37:26.035585+0000","last_peered":"2023-10-08T15:37:26.035585+0000","last_clean":"2023-10-08T15:37:26.035585+0000","last_became_active":"2023-10-08T15:37:26.035286+0000","last_became_peered":"2023-10-08T15:37:26.035286+0000","last_unstale":"2023-10-08T15:37:26.035585+0000","last_undegraded":"2023-10-08T15:37:26.035585+0000","last_fullsized":"2023-10-08T15:37:26.035585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:15:33.124525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.035125+0000","last_change":"2023-10-08T15:37:26.035125+0000","last_active":"2023-10-08T15:37:26.035125+0000","last_peered":"2023-10-08T15:37:26.035125+0000","last_clean":"2023-10-08T15:37:26.035125+0000","last_became_active":"2023-10-08T15:37:26.034739+0000","last_became_peered":"2023-10-08T15:37:26.034739+0000","last_unstale":"2023-10-08T15:37:26.035125+0000","last_undegraded":"2023-10-08T15:37:26.035125+0000","last_fullsized":"2023-10-08T15:37:26.035125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:38:43.660811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.047730+0000","last_change":"2023-10-08T15:37:26.029621+0000","last_active":"2023-10-08T15:37:26.047730+0000","last_peered":"2023-10-08T15:37:26.047730+0000","last_clean":"2023-10-08T15:37:26.047730+0000","last_became_active":"2023-10-08T15:37:26.029280+0000","last_became_peered":"2023-10-08T15:37:26.029280+0000","last_unstale":"2023-10-08T15:37:26.047730+0000","last_undegraded":"2023-10-08T15:37:26.047730+0000","last_fullsized":"2023-10-08T15:37:26.047730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:52:17.141125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:37:25.042804+0000","last_change":"2023-10-08T15:37:25.041282+0000","last_active":"2023-10-08T15:37:25.042804+0000","last_peered":"2023-10-08T15:37:25.042804+0000","last_clean":"2023-10-08T15:37:25.042804+0000","last_became_active":"2023-10-08T15:37:25.040931+0000","last_became_peered":"2023-10-08T15:37:25.040931+0000","last_unstale":"2023-10-08T15:37:25.042804+0000","last_undegraded":"2023-10-08T15:37:25.042804+0000","last_fullsized":"2023-10-08T15:37:25.042804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:17:10.911391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.050389+0000","last_change":"2023-10-08T15:37:26.050389+0000","last_active":"2023-10-08T15:37:26.050389+0000","last_peered":"2023-10-08T15:37:26.050389+0000","last_clean":"2023-10-08T15:37:26.050389+0000","last_became_active":"2023-10-08T15:37:26.050059+0000","last_became_peered":"2023-10-08T15:37:26.050059+0000","last_unstale":"2023-10-08T15:37:26.050389+0000","last_undegraded":"2023-10-08T15:37:26.050389+0000","last_fullsized":"2023-10-08T15:37:26.050389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:37:10.263562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:37:25.042053+0000","last_change":"2023-10-08T15:37:25.037788+0000","last_active":"2023-10-08T15:37:25.042053+0000","last_peered":"2023-10-08T15:37:25.042053+0000","last_clean":"2023-10-08T15:37:25.042053+0000","last_became_active":"2023-10-08T15:37:25.037390+0000","last_became_peered":"2023-10-08T15:37:25.037390+0000","last_unstale":"2023-10-08T15:37:25.042053+0000","last_undegraded":"2023-10-08T15:37:25.042053+0000","last_fullsized":"2023-10-08T15:37:25.042053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:33:24.209108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.056434+0000","last_change":"2023-10-08T15:37:26.030498+0000","last_active":"2023-10-08T15:37:26.056434+0000","last_peered":"2023-10-08T15:37:26.056434+0000","last_clean":"2023-10-08T15:37:26.056434+0000","last_became_active":"2023-10-08T15:37:26.029947+0000","last_became_peered":"2023-10-08T15:37:26.029947+0000","last_unstale":"2023-10-08T15:37:26.056434+0000","last_undegraded":"2023-10-08T15:37:26.056434+0000","last_fullsized":"2023-10-08T15:37:26.056434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:21:26.142526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:37:25.042769+0000","last_change":"2023-10-08T15:37:25.040580+0000","last_active":"2023-10-08T15:37:25.042769+0000","last_peered":"2023-10-08T15:37:25.042769+0000","last_clean":"2023-10-08T15:37:25.042769+0000","last_became_active":"2023-10-08T15:37:25.039401+0000","last_became_peered":"2023-10-08T15:37:25.039401+0000","last_unstale":"2023-10-08T15:37:25.042769+0000","last_undegraded":"2023-10-08T15:37:25.042769+0000","last_fullsized":"2023-10-08T15:37:25.042769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:12:32.395357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.047479+0000","last_change":"2023-10-08T15:37:25.035792+0000","last_active":"2023-10-08T15:37:26.047479+0000","last_peered":"2023-10-08T15:37:26.047479+0000","last_clean":"2023-10-08T15:37:26.047479+0000","last_became_active":"2023-10-08T15:37:25.035413+0000","last_became_peered":"2023-10-08T15:37:25.035413+0000","last_unstale":"2023-10-08T15:37:26.047479+0000","last_undegraded":"2023-10-08T15:37:26.047479+0000","last_fullsized":"2023-10-08T15:37:26.047479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:08:13.115248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.035368+0000","last_change":"2023-10-08T15:37:26.035368+0000","last_active":"2023-10-08T15:37:26.035368+0000","last_peered":"2023-10-08T15:37:26.035368+0000","last_clean":"2023-10-08T15:37:26.035368+0000","last_became_active":"2023-10-08T15:37:26.034994+0000","last_became_peered":"2023-10-08T15:37:26.034994+0000","last_unstale":"2023-10-08T15:37:26.035368+0000","last_undegraded":"2023-10-08T15:37:26.035368+0000","last_fullsized":"2023-10-08T15:37:26.035368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:21:41.320706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":159,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-08T15:37:21.095074+0000","last_change":"2023-10-08T15:37:19.380955+0000","last_active":"2023-10-08T15:37:21.095074+0000","last_peered":"2023-10-08T15:37:21.095074+0000","last_clean":"2023-10-08T15:37:21.095074+0000","last_became_active":"2023-10-08T15:37:19.378277+0000","last_became_peered":"2023-10-08T15:37:19.378277+0000","last_unstale":"2023-10-08T15:37:21.095074+0000","last_undegraded":"2023-10-08T15:37:21.095074+0000","last_fullsized":"2023-10-08T15:37:21.095074+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:17.537726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:17.537726+0000","last_clean_scrub_stamp":"2023-10-08T15:37:17.537726+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:06:26.612046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:37:25.040973+0000","last_change":"2023-10-08T15:37:25.033028+0000","last_active":"2023-10-08T15:37:25.040973+0000","last_peered":"2023-10-08T15:37:25.040973+0000","last_clean":"2023-10-08T15:37:25.040973+0000","last_became_active":"2023-10-08T15:37:25.032661+0000","last_became_peered":"2023-10-08T15:37:25.032661+0000","last_unstale":"2023-10-08T15:37:25.040973+0000","last_undegraded":"2023-10-08T15:37:25.040973+0000","last_fullsized":"2023-10-08T15:37:25.040973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:18:48.729702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:37:25.042151+0000","last_change":"2023-10-08T15:37:25.037867+0000","last_active":"2023-10-08T15:37:25.042151+0000","last_peered":"2023-10-08T15:37:25.042151+0000","last_clean":"2023-10-08T15:37:25.042151+0000","last_became_active":"2023-10-08T15:37:25.037638+0000","last_became_peered":"2023-10-08T15:37:25.037638+0000","last_unstale":"2023-10-08T15:37:25.042151+0000","last_undegraded":"2023-10-08T15:37:25.042151+0000","last_fullsized":"2023-10-08T15:37:25.042151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:52:16.136483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.057054+0000","last_change":"2023-10-08T15:37:26.046686+0000","last_active":"2023-10-08T15:37:26.057054+0000","last_peered":"2023-10-08T15:37:26.057054+0000","last_clean":"2023-10-08T15:37:26.057054+0000","last_became_active":"2023-10-08T15:37:26.046295+0000","last_became_peered":"2023-10-08T15:37:26.046295+0000","last_unstale":"2023-10-08T15:37:26.057054+0000","last_undegraded":"2023-10-08T15:37:26.057054+0000","last_fullsized":"2023-10-08T15:37:26.057054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:27:46.266100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.049468+0000","last_change":"2023-10-08T15:37:26.049468+0000","last_active":"2023-10-08T15:37:26.049468+0000","last_peered":"2023-10-08T15:37:26.049468+0000","last_clean":"2023-10-08T15:37:26.049468+0000","last_became_active":"2023-10-08T15:37:26.048647+0000","last_became_peered":"2023-10-08T15:37:26.048647+0000","last_unstale":"2023-10-08T15:37:26.049468+0000","last_undegraded":"2023-10-08T15:37:26.049468+0000","last_fullsized":"2023-10-08T15:37:26.049468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:07:54.534413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.057284+0000","last_change":"2023-10-08T15:37:26.039472+0000","last_active":"2023-10-08T15:37:26.057284+0000","last_peered":"2023-10-08T15:37:26.057284+0000","last_clean":"2023-10-08T15:37:26.057284+0000","last_became_active":"2023-10-08T15:37:26.038579+0000","last_became_peered":"2023-10-08T15:37:26.038579+0000","last_unstale":"2023-10-08T15:37:26.057284+0000","last_undegraded":"2023-10-08T15:37:26.057284+0000","last_fullsized":"2023-10-08T15:37:26.057284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:33:25.213750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.057363+0000","last_change":"2023-10-08T15:37:26.057363+0000","last_active":"2023-10-08T15:37:26.057363+0000","last_peered":"2023-10-08T15:37:26.057363+0000","last_clean":"2023-10-08T15:37:26.057363+0000","last_became_active":"2023-10-08T15:37:26.057058+0000","last_became_peered":"2023-10-08T15:37:26.057058+0000","last_unstale":"2023-10-08T15:37:26.057363+0000","last_undegraded":"2023-10-08T15:37:26.057363+0000","last_fullsized":"2023-10-08T15:37:26.057363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:20:26.216438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.057526+0000","last_change":"2023-10-08T15:37:26.057526+0000","last_active":"2023-10-08T15:37:26.057526+0000","last_peered":"2023-10-08T15:37:26.057526+0000","last_clean":"2023-10-08T15:37:26.057526+0000","last_became_active":"2023-10-08T15:37:26.057220+0000","last_became_peered":"2023-10-08T15:37:26.057220+0000","last_unstale":"2023-10-08T15:37:26.057526+0000","last_undegraded":"2023-10-08T15:37:26.057526+0000","last_fullsized":"2023-10-08T15:37:26.057526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:48.862001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":34,"acting":34,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":12,"acting":12,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66282,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542146,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301608,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070232,"statfs":{"total":96636764160,"available":96327917568,"internally_reserved":0,"allocated":217088,"data_stored":634865,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2170000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.024}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3680000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4510000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.575}]}]},{"osd":6,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":301532,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070308,"statfs":{"total":96636764160,"available":96327995392,"internally_reserved":0,"allocated":151552,"data_stored":44497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.129}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3049999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297436,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074404,"statfs":{"total":96636764160,"available":96332189696,"internally_reserved":0,"allocated":151552,"data_stored":44497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1319999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297436,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074404,"statfs":{"total":96636764160,"available":96332189696,"internally_reserved":0,"allocated":151552,"data_stored":44497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.143}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2470000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.72}]}]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297436,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074404,"statfs":{"total":96636764160,"available":96332189696,"internally_reserved":0,"allocated":151552,"data_stored":44497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.399}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0009999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.581}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.819}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3940000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542148,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":217088,"data_stored":634865,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.514}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7549999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6519999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.214}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.532}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9199999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301572,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070268,"statfs":{"total":96636764160,"available":96327954432,"internally_reserved":0,"allocated":192512,"data_stored":63418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0249999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.206}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2609999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.458}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.597}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3819999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301580,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070260,"statfs":{"total":96636764160,"available":96327946240,"internally_reserved":0,"allocated":200704,"data_stored":63454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1180000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T15:37:29.059 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T15:37:29.163 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.157+0000 7efcc54d6700 1 Processor -- start 2023-10-08T15:37:29.163 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.157+0000 7efcc54d6700 1 -- start start 2023-10-08T15:37:29.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.157+0000 7efcc54d6700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efcc00c0720 0x7efcc00674b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:29.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.157+0000 7efcc54d6700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7efcc00681f0 0x7efcc00a18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:29.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.157+0000 7efcc54d6700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcc00687c0 con 0x7efcc00670e0 2023-10-08T15:37:29.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.157+0000 7efcc54d6700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcc0068aa0 con 0x7efcc00681f0 2023-10-08T15:37:29.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.157+0000 7efcc54d6700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcc014c6f0 con 0x7efcc00c0720 2023-10-08T15:37:29.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.157+0000 7efcc4cd5700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7efcc00681f0 0x7efcc00a18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:29.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.157+0000 7efcc4cd5700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7efcc00681f0 0x7efcc00a18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47596/0 (socket says 172.21.15.3:47596) 2023-10-08T15:37:29.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.157+0000 7efcc4cd5700 1 -- 172.21.15.3:0/1436625825 learned_addr learned my addr 172.21.15.3:0/1436625825 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:29.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.157+0000 7efcbf7fe700 1 --2- 172.21.15.3:0/1436625825 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efcc00c0720 0x7efcc00674b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:29.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.157+0000 7efcc4cd5700 1 -- 172.21.15.3:0/1436625825 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efcc00c0720 msgr2=0x7efcc00674b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:29.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.157+0000 7efcc4cd5700 1 --2- 172.21.15.3:0/1436625825 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efcc00c0720 0x7efcc00674b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:29.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.157+0000 7efcc4cd5700 1 -- 172.21.15.3:0/1436625825 >> v1:172.21.15.50:6789/0 conn(0x7efcc00670e0 legacy=0x7efcc0068f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:29.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.157+0000 7efcc4cd5700 1 -- 172.21.15.3:0/1436625825 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc006a030 con 0x7efcc00681f0 2023-10-08T15:37:29.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.157+0000 7efcc4cd5700 1 --2- 172.21.15.3:0/1436625825 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efcc00681f0 0x7efcc00a18c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efcb8009990 tx=0x7efcb8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eb40e46e35bccda server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:29.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.157+0000 7efcbeffd700 1 -- 172.21.15.3:0/1436625825 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb8009e80 con 0x7efcc00681f0 2023-10-08T15:37:29.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.157+0000 7efcbeffd700 1 -- 172.21.15.3:0/1436625825 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcb8005c60 con 0x7efcc00681f0 2023-10-08T15:37:29.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.157+0000 7efcbeffd700 1 -- 172.21.15.3:0/1436625825 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb800b650 con 0x7efcc00681f0 2023-10-08T15:37:29.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.161+0000 7efcc54d6700 1 -- 172.21.15.3:0/1436625825 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efcc00681f0 msgr2=0x7efcc00a18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:29.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.161+0000 7efcc54d6700 1 --2- 172.21.15.3:0/1436625825 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efcc00681f0 0x7efcc00a18c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efcb8009990 tx=0x7efcb8009250 comp rx=0 tx=0).stop 2023-10-08T15:37:29.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.161+0000 7efcc54d6700 1 -- 172.21.15.3:0/1436625825 shutdown_connections 2023-10-08T15:37:29.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.161+0000 7efcc54d6700 1 --2- 172.21.15.3:0/1436625825 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efcc00681f0 0x7efcc00a18c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:29.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.161+0000 7efcc54d6700 1 --2- 172.21.15.3:0/1436625825 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efcc00c0720 0x7efcc00674b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:29.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.161+0000 7efcc54d6700 1 -- 172.21.15.3:0/1436625825 >> 172.21.15.3:0/1436625825 conn(0x7efcc006dfb0 msgr2=0x7efcc006e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:29.168 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.161+0000 7efcc54d6700 1 -- 172.21.15.3:0/1436625825 shutdown_connections 2023-10-08T15:37:29.168 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.161+0000 7efcc54d6700 1 -- 172.21.15.3:0/1436625825 wait complete. 2023-10-08T15:37:29.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.161+0000 7efcc54d6700 1 Processor -- start 2023-10-08T15:37:29.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.161+0000 7efcc54d6700 1 -- start start 2023-10-08T15:37:29.171 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.161+0000 7efcc54d6700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efcc00670e0 0x7efcc009bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:29.171 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.161+0000 7efcc54d6700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efcc00681f0 0x7efcc009a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:29.171 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.161+0000 7efcc54d6700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efcc00c0720 0x7efcc015e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:29.171 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.161+0000 7efcc54d6700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc009e9a0 con 0x7efcc00670e0 2023-10-08T15:37:29.171 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.161+0000 7efcc54d6700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc009c2c0 con 0x7efcc00c0720 2023-10-08T15:37:29.171 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.161+0000 7efcc54d6700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcc009add0 con 0x7efcc00681f0 2023-10-08T15:37:29.171 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.161+0000 7efcbffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efcc00670e0 0x7efcc009bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:29.171 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.161+0000 7efcbffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efcc00670e0 0x7efcc009bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47610/0 (socket says 172.21.15.3:47610) 2023-10-08T15:37:29.171 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.161+0000 7efcbffff700 1 -- 172.21.15.3:0/3472964456 learned_addr learned my addr 172.21.15.3:0/3472964456 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:29.171 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.161+0000 7efcbf7fe700 1 --2- 172.21.15.3:0/3472964456 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efcc00681f0 0x7efcc009a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:29.171 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.161+0000 7efcc4cd5700 1 --2- 172.21.15.3:0/3472964456 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efcc00c0720 0x7efcc015e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:29.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.161+0000 7efcbffff700 1 -- 172.21.15.3:0/3472964456 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efcc00681f0 msgr2=0x7efcc009a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:29.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.161+0000 7efcbffff700 1 --2- 172.21.15.3:0/3472964456 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efcc00681f0 0x7efcc009a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:29.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.161+0000 7efcbffff700 1 -- 172.21.15.3:0/3472964456 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efcc00c0720 msgr2=0x7efcc015e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:29.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.161+0000 7efcbffff700 1 --2- 172.21.15.3:0/3472964456 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efcc00c0720 0x7efcc015e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:29.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.161+0000 7efcbffff700 1 -- 172.21.15.3:0/3472964456 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb80094d0 con 0x7efcc00670e0 2023-10-08T15:37:29.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.161+0000 7efcbffff700 1 --2- 172.21.15.3:0/3472964456 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efcc00670e0 0x7efcc009bd80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efcb000c590 tx=0x7efcb000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:29.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.161+0000 7efcb7fff700 1 -- 172.21.15.3:0/3472964456 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb0011590 con 0x7efcc00670e0 2023-10-08T15:37:29.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.161+0000 7efcb7fff700 1 -- 172.21.15.3:0/3472964456 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcb0011710 con 0x7efcc00670e0 2023-10-08T15:37:29.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.161+0000 7efcc54d6700 1 -- 172.21.15.3:0/3472964456 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcc009e350 con 0x7efcc00670e0 2023-10-08T15:37:29.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.161+0000 7efcb7fff700 1 -- 172.21.15.3:0/3472964456 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb0011ad0 con 0x7efcc00670e0 2023-10-08T15:37:29.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.165+0000 7efcc54d6700 1 -- 172.21.15.3:0/3472964456 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcc009c9a0 con 0x7efcc00670e0 2023-10-08T15:37:29.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.165+0000 7efcc54d6700 1 -- 172.21.15.3:0/3472964456 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcc009cb90 con 0x7efcc00670e0 2023-10-08T15:37:29.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.165+0000 7efcb7fff700 1 -- 172.21.15.3:0/3472964456 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7efcb001b3b0 con 0x7efcc00670e0 2023-10-08T15:37:29.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.165+0000 7efcb7fff700 1 --2- 172.21.15.3:0/3472964456 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7efca0060550 0x7efca0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:29.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.165+0000 7efcb7fff700 1 -- 172.21.15.3:0/3472964456 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efcb007bc00 con 0x7efcc00670e0 2023-10-08T15:37:29.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.169+0000 7efcbf7fe700 1 --2- 172.21.15.3:0/3472964456 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7efca0060550 0x7efca0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:29.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.169+0000 7efcbf7fe700 1 --2- 172.21.15.3:0/3472964456 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7efca0060550 0x7efca0062a00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efca8009fd0 tx=0x7efca800b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:29.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.173+0000 7efcb7fff700 1 -- 172.21.15.3:0/3472964456 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7efcb0082080 con 0x7efcc00670e0 2023-10-08T15:37:29.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.329+0000 7efcc54d6700 1 -- 172.21.15.3:0/3472964456 --> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efcc005ecf0 con 0x7efca0060550 2023-10-08T15:37:29.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.349+0000 7efcb7fff700 1 -- 172.21.15.3:0/3472964456 <== mgr.4102 v2:172.21.15.50:6832/33268 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+253394 (secure 0 0 0) 0x7efcc005ecf0 con 0x7efca0060550 2023-10-08T15:37:29.358 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:37:29.360 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.353+0000 7efcc54d6700 1 -- 172.21.15.3:0/3472964456 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7efca0060550 msgr2=0x7efca0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:29.360 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.353+0000 7efcc54d6700 1 --2- 172.21.15.3:0/3472964456 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7efca0060550 0x7efca0062a00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efca8009fd0 tx=0x7efca800b040 comp rx=0 tx=0).stop 2023-10-08T15:37:29.360 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.353+0000 7efcc54d6700 1 -- 172.21.15.3:0/3472964456 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efcc00670e0 msgr2=0x7efcc009bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:29.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.353+0000 7efcc54d6700 1 --2- 172.21.15.3:0/3472964456 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efcc00670e0 0x7efcc009bd80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efcb000c590 tx=0x7efcb000c8a0 comp rx=0 tx=0).stop 2023-10-08T15:37:29.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.353+0000 7efcc54d6700 1 -- 172.21.15.3:0/3472964456 shutdown_connections 2023-10-08T15:37:29.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.353+0000 7efcc54d6700 1 --2- 172.21.15.3:0/3472964456 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7efca0060550 0x7efca0062a00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:29.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.353+0000 7efcc54d6700 1 --2- 172.21.15.3:0/3472964456 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efcc00c0720 0x7efcc015e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:29.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.353+0000 7efcc54d6700 1 --2- 172.21.15.3:0/3472964456 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efcc00681f0 0x7efcc009a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:29.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.353+0000 7efcc54d6700 1 --2- 172.21.15.3:0/3472964456 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efcc00670e0 0x7efcc009bd80 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:29.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.353+0000 7efcc54d6700 1 -- 172.21.15.3:0/3472964456 >> 172.21.15.3:0/3472964456 conn(0x7efcc006dfb0 msgr2=0x7efcc00bfaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:29.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.353+0000 7efcc54d6700 1 -- 172.21.15.3:0/3472964456 shutdown_connections 2023-10-08T15:37:29.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.353+0000 7efcc54d6700 1 -- 172.21.15.3:0/3472964456 wait complete. 2023-10-08T15:37:29.362 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2023-10-08T15:37:29.374 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2023-10-08T15:37:28.508200+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590390,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":160,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":48,"acting":48,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":19,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":2396108,"kb_used_data":1400,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752578612,"statfs":{"total":773094113280,"available":770640498688,"internally_reserved":0,"allocated":1433600,"data_stored":1574590,"data_compressed":66282,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.511369"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.049673+0000","last_change":"2023-10-08T15:37:26.049673+0000","last_active":"2023-10-08T15:37:26.049673+0000","last_peered":"2023-10-08T15:37:26.049673+0000","last_clean":"2023-10-08T15:37:26.049673+0000","last_became_active":"2023-10-08T15:37:26.048595+0000","last_became_peered":"2023-10-08T15:37:26.048595+0000","last_unstale":"2023-10-08T15:37:26.049673+0000","last_undegraded":"2023-10-08T15:37:26.049673+0000","last_fullsized":"2023-10-08T15:37:26.049673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:05:25.732352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.046262+0000","last_change":"2023-10-08T15:37:26.046262+0000","last_active":"2023-10-08T15:37:26.046262+0000","last_peered":"2023-10-08T15:37:26.046262+0000","last_clean":"2023-10-08T15:37:26.046262+0000","last_became_active":"2023-10-08T15:37:26.045955+0000","last_became_peered":"2023-10-08T15:37:26.045955+0000","last_unstale":"2023-10-08T15:37:26.046262+0000","last_undegraded":"2023-10-08T15:37:26.046262+0000","last_fullsized":"2023-10-08T15:37:26.046262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:14:44.577836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.056900+0000","last_change":"2023-10-08T15:37:26.039886+0000","last_active":"2023-10-08T15:37:26.056900+0000","last_peered":"2023-10-08T15:37:26.056900+0000","last_clean":"2023-10-08T15:37:26.056900+0000","last_became_active":"2023-10-08T15:37:26.039551+0000","last_became_peered":"2023-10-08T15:37:26.039551+0000","last_unstale":"2023-10-08T15:37:26.056900+0000","last_undegraded":"2023-10-08T15:37:26.056900+0000","last_fullsized":"2023-10-08T15:37:26.056900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:18:49.734343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.050368+0000","last_change":"2023-10-08T15:37:26.050368+0000","last_active":"2023-10-08T15:37:26.050368+0000","last_peered":"2023-10-08T15:37:26.050368+0000","last_clean":"2023-10-08T15:37:26.050368+0000","last_became_active":"2023-10-08T15:37:26.050078+0000","last_became_peered":"2023-10-08T15:37:26.050078+0000","last_unstale":"2023-10-08T15:37:26.050368+0000","last_undegraded":"2023-10-08T15:37:26.050368+0000","last_fullsized":"2023-10-08T15:37:26.050368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:56:34.490787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.045671+0000","last_change":"2023-10-08T15:37:26.045671+0000","last_active":"2023-10-08T15:37:26.045671+0000","last_peered":"2023-10-08T15:37:26.045671+0000","last_clean":"2023-10-08T15:37:26.045671+0000","last_became_active":"2023-10-08T15:37:26.045356+0000","last_became_peered":"2023-10-08T15:37:26.045356+0000","last_unstale":"2023-10-08T15:37:26.045671+0000","last_undegraded":"2023-10-08T15:37:26.045671+0000","last_fullsized":"2023-10-08T15:37:26.045671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:47:37.094485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.045121+0000","last_change":"2023-10-08T15:37:26.045121+0000","last_active":"2023-10-08T15:37:26.045121+0000","last_peered":"2023-10-08T15:37:26.045121+0000","last_clean":"2023-10-08T15:37:26.045121+0000","last_became_active":"2023-10-08T15:37:26.044638+0000","last_became_peered":"2023-10-08T15:37:26.044638+0000","last_unstale":"2023-10-08T15:37:26.045121+0000","last_undegraded":"2023-10-08T15:37:26.045121+0000","last_fullsized":"2023-10-08T15:37:26.045121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:45:12.654892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.035585+0000","last_change":"2023-10-08T15:37:26.035585+0000","last_active":"2023-10-08T15:37:26.035585+0000","last_peered":"2023-10-08T15:37:26.035585+0000","last_clean":"2023-10-08T15:37:26.035585+0000","last_became_active":"2023-10-08T15:37:26.035286+0000","last_became_peered":"2023-10-08T15:37:26.035286+0000","last_unstale":"2023-10-08T15:37:26.035585+0000","last_undegraded":"2023-10-08T15:37:26.035585+0000","last_fullsized":"2023-10-08T15:37:26.035585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:15:33.124525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.035125+0000","last_change":"2023-10-08T15:37:26.035125+0000","last_active":"2023-10-08T15:37:26.035125+0000","last_peered":"2023-10-08T15:37:26.035125+0000","last_clean":"2023-10-08T15:37:26.035125+0000","last_became_active":"2023-10-08T15:37:26.034739+0000","last_became_peered":"2023-10-08T15:37:26.034739+0000","last_unstale":"2023-10-08T15:37:26.035125+0000","last_undegraded":"2023-10-08T15:37:26.035125+0000","last_fullsized":"2023-10-08T15:37:26.035125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:38:43.660811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.047730+0000","last_change":"2023-10-08T15:37:26.029621+0000","last_active":"2023-10-08T15:37:26.047730+0000","last_peered":"2023-10-08T15:37:26.047730+0000","last_clean":"2023-10-08T15:37:26.047730+0000","last_became_active":"2023-10-08T15:37:26.029280+0000","last_became_peered":"2023-10-08T15:37:26.029280+0000","last_unstale":"2023-10-08T15:37:26.047730+0000","last_undegraded":"2023-10-08T15:37:26.047730+0000","last_fullsized":"2023-10-08T15:37:26.047730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:52:17.141125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:37:25.042804+0000","last_change":"2023-10-08T15:37:25.041282+0000","last_active":"2023-10-08T15:37:25.042804+0000","last_peered":"2023-10-08T15:37:25.042804+0000","last_clean":"2023-10-08T15:37:25.042804+0000","last_became_active":"2023-10-08T15:37:25.040931+0000","last_became_peered":"2023-10-08T15:37:25.040931+0000","last_unstale":"2023-10-08T15:37:25.042804+0000","last_undegraded":"2023-10-08T15:37:25.042804+0000","last_fullsized":"2023-10-08T15:37:25.042804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:17:10.911391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.050389+0000","last_change":"2023-10-08T15:37:26.050389+0000","last_active":"2023-10-08T15:37:26.050389+0000","last_peered":"2023-10-08T15:37:26.050389+0000","last_clean":"2023-10-08T15:37:26.050389+0000","last_became_active":"2023-10-08T15:37:26.050059+0000","last_became_peered":"2023-10-08T15:37:26.050059+0000","last_unstale":"2023-10-08T15:37:26.050389+0000","last_undegraded":"2023-10-08T15:37:26.050389+0000","last_fullsized":"2023-10-08T15:37:26.050389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:37:10.263562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:37:25.042053+0000","last_change":"2023-10-08T15:37:25.037788+0000","last_active":"2023-10-08T15:37:25.042053+0000","last_peered":"2023-10-08T15:37:25.042053+0000","last_clean":"2023-10-08T15:37:25.042053+0000","last_became_active":"2023-10-08T15:37:25.037390+0000","last_became_peered":"2023-10-08T15:37:25.037390+0000","last_unstale":"2023-10-08T15:37:25.042053+0000","last_undegraded":"2023-10-08T15:37:25.042053+0000","last_fullsized":"2023-10-08T15:37:25.042053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:33:24.209108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.056434+0000","last_change":"2023-10-08T15:37:26.030498+0000","last_active":"2023-10-08T15:37:26.056434+0000","last_peered":"2023-10-08T15:37:26.056434+0000","last_clean":"2023-10-08T15:37:26.056434+0000","last_became_active":"2023-10-08T15:37:26.029947+0000","last_became_peered":"2023-10-08T15:37:26.029947+0000","last_unstale":"2023-10-08T15:37:26.056434+0000","last_undegraded":"2023-10-08T15:37:26.056434+0000","last_fullsized":"2023-10-08T15:37:26.056434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:21:26.142526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:37:25.042769+0000","last_change":"2023-10-08T15:37:25.040580+0000","last_active":"2023-10-08T15:37:25.042769+0000","last_peered":"2023-10-08T15:37:25.042769+0000","last_clean":"2023-10-08T15:37:25.042769+0000","last_became_active":"2023-10-08T15:37:25.039401+0000","last_became_peered":"2023-10-08T15:37:25.039401+0000","last_unstale":"2023-10-08T15:37:25.042769+0000","last_undegraded":"2023-10-08T15:37:25.042769+0000","last_fullsized":"2023-10-08T15:37:25.042769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:12:32.395357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.047479+0000","last_change":"2023-10-08T15:37:25.035792+0000","last_active":"2023-10-08T15:37:26.047479+0000","last_peered":"2023-10-08T15:37:26.047479+0000","last_clean":"2023-10-08T15:37:26.047479+0000","last_became_active":"2023-10-08T15:37:25.035413+0000","last_became_peered":"2023-10-08T15:37:25.035413+0000","last_unstale":"2023-10-08T15:37:26.047479+0000","last_undegraded":"2023-10-08T15:37:26.047479+0000","last_fullsized":"2023-10-08T15:37:26.047479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:08:13.115248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.035368+0000","last_change":"2023-10-08T15:37:26.035368+0000","last_active":"2023-10-08T15:37:26.035368+0000","last_peered":"2023-10-08T15:37:26.035368+0000","last_clean":"2023-10-08T15:37:26.035368+0000","last_became_active":"2023-10-08T15:37:26.034994+0000","last_became_peered":"2023-10-08T15:37:26.034994+0000","last_unstale":"2023-10-08T15:37:26.035368+0000","last_undegraded":"2023-10-08T15:37:26.035368+0000","last_fullsized":"2023-10-08T15:37:26.035368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:21:41.320706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":159,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-08T15:37:21.095074+0000","last_change":"2023-10-08T15:37:19.380955+0000","last_active":"2023-10-08T15:37:21.095074+0000","last_peered":"2023-10-08T15:37:21.095074+0000","last_clean":"2023-10-08T15:37:21.095074+0000","last_became_active":"2023-10-08T15:37:19.378277+0000","last_became_peered":"2023-10-08T15:37:19.378277+0000","last_unstale":"2023-10-08T15:37:21.095074+0000","last_undegraded":"2023-10-08T15:37:21.095074+0000","last_fullsized":"2023-10-08T15:37:21.095074+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:17.537726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:17.537726+0000","last_clean_scrub_stamp":"2023-10-08T15:37:17.537726+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:06:26.612046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:37:25.040973+0000","last_change":"2023-10-08T15:37:25.033028+0000","last_active":"2023-10-08T15:37:25.040973+0000","last_peered":"2023-10-08T15:37:25.040973+0000","last_clean":"2023-10-08T15:37:25.040973+0000","last_became_active":"2023-10-08T15:37:25.032661+0000","last_became_peered":"2023-10-08T15:37:25.032661+0000","last_unstale":"2023-10-08T15:37:25.040973+0000","last_undegraded":"2023-10-08T15:37:25.040973+0000","last_fullsized":"2023-10-08T15:37:25.040973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:18:48.729702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:37:25.042151+0000","last_change":"2023-10-08T15:37:25.037867+0000","last_active":"2023-10-08T15:37:25.042151+0000","last_peered":"2023-10-08T15:37:25.042151+0000","last_clean":"2023-10-08T15:37:25.042151+0000","last_became_active":"2023-10-08T15:37:25.037638+0000","last_became_peered":"2023-10-08T15:37:25.037638+0000","last_unstale":"2023-10-08T15:37:25.042151+0000","last_undegraded":"2023-10-08T15:37:25.042151+0000","last_fullsized":"2023-10-08T15:37:25.042151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:52:16.136483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.057054+0000","last_change":"2023-10-08T15:37:26.046686+0000","last_active":"2023-10-08T15:37:26.057054+0000","last_peered":"2023-10-08T15:37:26.057054+0000","last_clean":"2023-10-08T15:37:26.057054+0000","last_became_active":"2023-10-08T15:37:26.046295+0000","last_became_peered":"2023-10-08T15:37:26.046295+0000","last_unstale":"2023-10-08T15:37:26.057054+0000","last_undegraded":"2023-10-08T15:37:26.057054+0000","last_fullsized":"2023-10-08T15:37:26.057054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:27:46.266100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.049468+0000","last_change":"2023-10-08T15:37:26.049468+0000","last_active":"2023-10-08T15:37:26.049468+0000","last_peered":"2023-10-08T15:37:26.049468+0000","last_clean":"2023-10-08T15:37:26.049468+0000","last_became_active":"2023-10-08T15:37:26.048647+0000","last_became_peered":"2023-10-08T15:37:26.048647+0000","last_unstale":"2023-10-08T15:37:26.049468+0000","last_undegraded":"2023-10-08T15:37:26.049468+0000","last_fullsized":"2023-10-08T15:37:26.049468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:07:54.534413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.057284+0000","last_change":"2023-10-08T15:37:26.039472+0000","last_active":"2023-10-08T15:37:26.057284+0000","last_peered":"2023-10-08T15:37:26.057284+0000","last_clean":"2023-10-08T15:37:26.057284+0000","last_became_active":"2023-10-08T15:37:26.038579+0000","last_became_peered":"2023-10-08T15:37:26.038579+0000","last_unstale":"2023-10-08T15:37:26.057284+0000","last_undegraded":"2023-10-08T15:37:26.057284+0000","last_fullsized":"2023-10-08T15:37:26.057284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:33:25.213750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.057363+0000","last_change":"2023-10-08T15:37:26.057363+0000","last_active":"2023-10-08T15:37:26.057363+0000","last_peered":"2023-10-08T15:37:26.057363+0000","last_clean":"2023-10-08T15:37:26.057363+0000","last_became_active":"2023-10-08T15:37:26.057058+0000","last_became_peered":"2023-10-08T15:37:26.057058+0000","last_unstale":"2023-10-08T15:37:26.057363+0000","last_undegraded":"2023-10-08T15:37:26.057363+0000","last_fullsized":"2023-10-08T15:37:26.057363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:20:26.216438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.057526+0000","last_change":"2023-10-08T15:37:26.057526+0000","last_active":"2023-10-08T15:37:26.057526+0000","last_peered":"2023-10-08T15:37:26.057526+0000","last_clean":"2023-10-08T15:37:26.057526+0000","last_became_active":"2023-10-08T15:37:26.057220+0000","last_became_peered":"2023-10-08T15:37:26.057220+0000","last_unstale":"2023-10-08T15:37:26.057526+0000","last_undegraded":"2023-10-08T15:37:26.057526+0000","last_fullsized":"2023-10-08T15:37:26.057526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:48.862001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":34,"acting":34,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":12,"acting":12,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66282,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542146,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301608,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070232,"statfs":{"total":96636764160,"available":96327917568,"internally_reserved":0,"allocated":217088,"data_stored":634865,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2170000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.024}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3680000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4510000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.575}]}]},{"osd":6,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":301532,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070308,"statfs":{"total":96636764160,"available":96327995392,"internally_reserved":0,"allocated":151552,"data_stored":44497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.129}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3049999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297436,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074404,"statfs":{"total":96636764160,"available":96332189696,"internally_reserved":0,"allocated":151552,"data_stored":44497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1319999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297436,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074404,"statfs":{"total":96636764160,"available":96332189696,"internally_reserved":0,"allocated":151552,"data_stored":44497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.143}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2470000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.72}]}]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297436,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074404,"statfs":{"total":96636764160,"available":96332189696,"internally_reserved":0,"allocated":151552,"data_stored":44497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.399}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0009999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.581}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.819}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3940000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542148,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":217088,"data_stored":634865,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.514}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7549999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6519999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.214}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.532}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9199999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301572,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070268,"statfs":{"total":96636764160,"available":96327954432,"internally_reserved":0,"allocated":192512,"data_stored":63418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0249999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.206}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2609999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.458}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.597}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3819999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301580,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070260,"statfs":{"total":96636764160,"available":96327946240,"internally_reserved":0,"allocated":200704,"data_stored":63454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1180000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T15:37:29.379 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T15:37:29.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.485+0000 7f6de2ca7700 1 Processor -- start 2023-10-08T15:37:29.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.485+0000 7f6de2ca7700 1 -- start start 2023-10-08T15:37:29.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.485+0000 7f6de2ca7700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6ddc0bbf00 0x7f6ddc14ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:29.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.485+0000 7f6de2ca7700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6ddc0be600 0x7f6ddc14abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:29.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.485+0000 7f6de2ca7700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ddc14fbd0 con 0x7f6ddc0bcdd0 2023-10-08T15:37:29.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.485+0000 7f6de2ca7700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ddc0b29d0 con 0x7f6ddc0be600 2023-10-08T15:37:29.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.485+0000 7f6de2ca7700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ddc0b1ee0 con 0x7f6ddc0bbf00 2023-10-08T15:37:29.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.485+0000 7f6de14a4700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f6ddc0bcdd0 0x7f6ddc14f4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:53770/0 (socket says 172.21.15.3:53770) 2023-10-08T15:37:29.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.485+0000 7f6de14a4700 1 -- 172.21.15.3:0/2067516553 learned_addr learned my addr 172.21.15.3:0/2067516553 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:29.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.485+0000 7f6de1ca5700 1 --2- 172.21.15.3:0/2067516553 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6ddc0bbf00 0x7f6ddc14ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:29.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.485+0000 7f6de24a6700 1 --2- 172.21.15.3:0/2067516553 >> v2:172.21.15.50:3300/0 conn(0x7f6ddc0be600 0x7f6ddc14abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:29.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.485+0000 7f6de0ca3700 1 -- 172.21.15.3:0/2067516553 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2065437867 0 0) 0x7f6ddc14fbd0 con 0x7f6ddc0bcdd0 2023-10-08T15:37:29.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.485+0000 7f6de0ca3700 1 -- 172.21.15.3:0/2067516553 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6dc8003570 con 0x7f6ddc0bcdd0 2023-10-08T15:37:29.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.485+0000 7f6de1ca5700 1 -- 172.21.15.3:0/2067516553 >> v2:172.21.15.50:3300/0 conn(0x7f6ddc0be600 msgr2=0x7f6ddc14abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:29.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.485+0000 7f6de1ca5700 1 --2- 172.21.15.3:0/2067516553 >> v2:172.21.15.50:3300/0 conn(0x7f6ddc0be600 0x7f6ddc14abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:29.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.485+0000 7f6de1ca5700 1 -- 172.21.15.3:0/2067516553 >> v1:172.21.15.3:6789/0 conn(0x7f6ddc0bcdd0 legacy=0x7f6ddc14f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:29.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.485+0000 7f6de1ca5700 1 -- 172.21.15.3:0/2067516553 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ddc0b21c0 con 0x7f6ddc0bbf00 2023-10-08T15:37:29.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.485+0000 7f6de1ca5700 1 --2- 172.21.15.3:0/2067516553 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6ddc0bbf00 0x7f6ddc14ef80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6dd80098d0 tx=0x7f6dd8009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=459e6787aec591ad server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:29.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.485+0000 7f6de0ca3700 1 -- 172.21.15.3:0/2067516553 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd8005c10 con 0x7f6ddc0bbf00 2023-10-08T15:37:29.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.485+0000 7f6de0ca3700 1 -- 172.21.15.3:0/2067516553 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dd8005d70 con 0x7f6ddc0bbf00 2023-10-08T15:37:29.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.485+0000 7f6de0ca3700 1 -- 172.21.15.3:0/2067516553 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd8006280 con 0x7f6ddc0bbf00 2023-10-08T15:37:29.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.485+0000 7f6de2ca7700 1 -- 172.21.15.3:0/2067516553 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6ddc0bbf00 msgr2=0x7f6ddc14ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:29.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.485+0000 7f6de2ca7700 1 --2- 172.21.15.3:0/2067516553 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6ddc0bbf00 0x7f6ddc14ef80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6dd80098d0 tx=0x7f6dd8009120 comp rx=0 tx=0).stop 2023-10-08T15:37:29.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.485+0000 7f6de2ca7700 1 -- 172.21.15.3:0/2067516553 shutdown_connections 2023-10-08T15:37:29.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.485+0000 7f6de2ca7700 1 --2- 172.21.15.3:0/2067516553 >> v2:172.21.15.50:3300/0 conn(0x7f6ddc0be600 0x7f6ddc14abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:29.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.485+0000 7f6de2ca7700 1 --2- 172.21.15.3:0/2067516553 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6ddc0bbf00 0x7f6ddc14ef80 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:29.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.485+0000 7f6de2ca7700 1 -- 172.21.15.3:0/2067516553 >> 172.21.15.3:0/2067516553 conn(0x7f6ddc0bf5e0 msgr2=0x7f6ddc0bb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:29.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.485+0000 7f6de2ca7700 1 -- 172.21.15.3:0/2067516553 shutdown_connections 2023-10-08T15:37:29.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.485+0000 7f6de2ca7700 1 -- 172.21.15.3:0/2067516553 wait complete. 2023-10-08T15:37:29.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.489+0000 7f6de2ca7700 1 Processor -- start 2023-10-08T15:37:29.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.489+0000 7f6de2ca7700 1 -- start start 2023-10-08T15:37:29.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.489+0000 7f6de2ca7700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6ddc0bbf00 0x7f6ddc0b8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:29.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.489+0000 7f6de2ca7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ddc0bcdd0 0x7f6ddc15b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:29.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.489+0000 7f6de2ca7700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6ddc0be600 0x7f6ddc15e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:29.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.489+0000 7f6de2ca7700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ddc096490 con 0x7f6ddc0be600 2023-10-08T15:37:29.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.489+0000 7f6de2ca7700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ddc0b9d60 con 0x7f6ddc0bcdd0 2023-10-08T15:37:29.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.489+0000 7f6de2ca7700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ddc15f230 con 0x7f6ddc0bbf00 2023-10-08T15:37:29.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.489+0000 7f6de1ca5700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6ddc0bbf00 0x7f6ddc0b8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:29.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.489+0000 7f6de14a4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ddc0bcdd0 0x7f6ddc15b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:29.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.489+0000 7f6de24a6700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6ddc0be600 0x7f6ddc15e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:29.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.489+0000 7f6de14a4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ddc0bcdd0 0x7f6ddc15b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.3:36762/0 (socket says 172.21.15.3:36762) 2023-10-08T15:37:29.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.489+0000 7f6de1ca5700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6ddc0bbf00 0x7f6ddc0b8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.3:44264/0 (socket says 172.21.15.3:44264) 2023-10-08T15:37:29.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.489+0000 7f6de14a4700 1 -- 172.21.15.3:0/3568943554 learned_addr learned my addr 172.21.15.3:0/3568943554 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:29.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.489+0000 7f6de1ca5700 1 -- 172.21.15.3:0/3568943554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ddc0bcdd0 msgr2=0x7f6ddc15b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:29.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.489+0000 7f6de1ca5700 1 --2- 172.21.15.3:0/3568943554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ddc0bcdd0 0x7f6ddc15b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:29.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.489+0000 7f6de1ca5700 1 -- 172.21.15.3:0/3568943554 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6ddc0be600 msgr2=0x7f6ddc15e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:29.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.489+0000 7f6de1ca5700 1 --2- 172.21.15.3:0/3568943554 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6ddc0be600 0x7f6ddc15e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:29.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.489+0000 7f6de1ca5700 1 -- 172.21.15.3:0/3568943554 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd80093c0 con 0x7f6ddc0bbf00 2023-10-08T15:37:29.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.489+0000 7f6de14a4700 1 --2- 172.21.15.3:0/3568943554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ddc0bcdd0 0x7f6ddc15b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:37:29.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.489+0000 7f6de24a6700 1 --2- 172.21.15.3:0/3568943554 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6ddc0be600 0x7f6ddc15e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:37:29.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.493+0000 7f6de1ca5700 1 --2- 172.21.15.3:0/3568943554 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6ddc0bbf00 0x7f6ddc0b8250 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8015000 tx=0x7f6dd8016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:29.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.493+0000 7f6dd1ffb700 1 -- 172.21.15.3:0/3568943554 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd8006a70 con 0x7f6ddc0bbf00 2023-10-08T15:37:29.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.493+0000 7f6dd1ffb700 1 -- 172.21.15.3:0/3568943554 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dd801d6b0 con 0x7f6ddc0bbf00 2023-10-08T15:37:29.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.493+0000 7f6de2ca7700 1 -- 172.21.15.3:0/3568943554 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ddc096120 con 0x7f6ddc0bbf00 2023-10-08T15:37:29.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.493+0000 7f6dd1ffb700 1 -- 172.21.15.3:0/3568943554 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd801da70 con 0x7f6ddc0bbf00 2023-10-08T15:37:29.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.493+0000 7f6de2ca7700 1 -- 172.21.15.3:0/3568943554 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ddc15bc80 con 0x7f6ddc0bbf00 2023-10-08T15:37:29.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.493+0000 7f6de2ca7700 1 -- 172.21.15.3:0/3568943554 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ddc15be70 con 0x7f6ddc0bbf00 2023-10-08T15:37:29.501 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.493+0000 7f6dd1ffb700 1 -- 172.21.15.3:0/3568943554 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6dd801b480 con 0x7f6ddc0bbf00 2023-10-08T15:37:29.501 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.497+0000 7f6dd1ffb700 1 --2- 172.21.15.3:0/3568943554 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f6dc0060550 0x7f6dc0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:29.501 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.497+0000 7f6dd1ffb700 1 -- 172.21.15.3:0/3568943554 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6dd807e2c0 con 0x7f6ddc0bbf00 2023-10-08T15:37:29.502 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.497+0000 7f6de14a4700 1 --2- 172.21.15.3:0/3568943554 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f6dc0060550 0x7f6dc0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:29.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.497+0000 7f6de14a4700 1 --2- 172.21.15.3:0/3568943554 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f6dc0060550 0x7f6dc0062a00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc095fa0 tx=0x7f6dcc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:29.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.509+0000 7f6dd1ffb700 1 -- 172.21.15.3:0/3568943554 <== mon.2 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6dd804e8b0 con 0x7f6ddc0bbf00 2023-10-08T15:37:29.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.665+0000 7f6de2ca7700 1 -- 172.21.15.3:0/3568943554 --> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6ddc05ecf0 con 0x7f6dc0060550 2023-10-08T15:37:29.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.677+0000 7f6dd1ffb700 1 -- 172.21.15.3:0/3568943554 <== mgr.4102 v2:172.21.15.50:6832/33268 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+253394 (secure 0 0 0) 0x7f6ddc05ecf0 con 0x7f6dc0060550 2023-10-08T15:37:29.688 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:37:29.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.681+0000 7f6de2ca7700 1 -- 172.21.15.3:0/3568943554 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f6dc0060550 msgr2=0x7f6dc0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:29.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.681+0000 7f6de2ca7700 1 --2- 172.21.15.3:0/3568943554 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f6dc0060550 0x7f6dc0062a00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc095fa0 tx=0x7f6dcc009040 comp rx=0 tx=0).stop 2023-10-08T15:37:29.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.681+0000 7f6de2ca7700 1 -- 172.21.15.3:0/3568943554 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6ddc0bbf00 msgr2=0x7f6ddc0b8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:29.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.681+0000 7f6de2ca7700 1 --2- 172.21.15.3:0/3568943554 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6ddc0bbf00 0x7f6ddc0b8250 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8015000 tx=0x7f6dd8016000 comp rx=0 tx=0).stop 2023-10-08T15:37:29.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.681+0000 7f6de2ca7700 1 -- 172.21.15.3:0/3568943554 shutdown_connections 2023-10-08T15:37:29.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.681+0000 7f6de2ca7700 1 --2- 172.21.15.3:0/3568943554 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f6dc0060550 0x7f6dc0062a00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:29.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.681+0000 7f6de2ca7700 1 --2- 172.21.15.3:0/3568943554 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6ddc0be600 0x7f6ddc15e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:29.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.681+0000 7f6de2ca7700 1 --2- 172.21.15.3:0/3568943554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ddc0bcdd0 0x7f6ddc15b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:29.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.681+0000 7f6de2ca7700 1 --2- 172.21.15.3:0/3568943554 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6ddc0bbf00 0x7f6ddc0b8250 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:29.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.681+0000 7f6de2ca7700 1 -- 172.21.15.3:0/3568943554 >> 172.21.15.3:0/3568943554 conn(0x7f6ddc0bf5e0 msgr2=0x7f6ddc14df60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:29.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.681+0000 7f6de2ca7700 1 -- 172.21.15.3:0/3568943554 shutdown_connections 2023-10-08T15:37:29.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.681+0000 7f6de2ca7700 1 -- 172.21.15.3:0/3568943554 wait complete. 2023-10-08T15:37:29.692 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2023-10-08T15:37:29.703 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2023-10-08T15:37:28.508200+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590390,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":160,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":48,"acting":48,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":19,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":2396108,"kb_used_data":1400,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752578612,"statfs":{"total":773094113280,"available":770640498688,"internally_reserved":0,"allocated":1433600,"data_stored":1574590,"data_compressed":66282,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.511369"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.049673+0000","last_change":"2023-10-08T15:37:26.049673+0000","last_active":"2023-10-08T15:37:26.049673+0000","last_peered":"2023-10-08T15:37:26.049673+0000","last_clean":"2023-10-08T15:37:26.049673+0000","last_became_active":"2023-10-08T15:37:26.048595+0000","last_became_peered":"2023-10-08T15:37:26.048595+0000","last_unstale":"2023-10-08T15:37:26.049673+0000","last_undegraded":"2023-10-08T15:37:26.049673+0000","last_fullsized":"2023-10-08T15:37:26.049673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:05:25.732352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.046262+0000","last_change":"2023-10-08T15:37:26.046262+0000","last_active":"2023-10-08T15:37:26.046262+0000","last_peered":"2023-10-08T15:37:26.046262+0000","last_clean":"2023-10-08T15:37:26.046262+0000","last_became_active":"2023-10-08T15:37:26.045955+0000","last_became_peered":"2023-10-08T15:37:26.045955+0000","last_unstale":"2023-10-08T15:37:26.046262+0000","last_undegraded":"2023-10-08T15:37:26.046262+0000","last_fullsized":"2023-10-08T15:37:26.046262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:14:44.577836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.056900+0000","last_change":"2023-10-08T15:37:26.039886+0000","last_active":"2023-10-08T15:37:26.056900+0000","last_peered":"2023-10-08T15:37:26.056900+0000","last_clean":"2023-10-08T15:37:26.056900+0000","last_became_active":"2023-10-08T15:37:26.039551+0000","last_became_peered":"2023-10-08T15:37:26.039551+0000","last_unstale":"2023-10-08T15:37:26.056900+0000","last_undegraded":"2023-10-08T15:37:26.056900+0000","last_fullsized":"2023-10-08T15:37:26.056900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:18:49.734343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.050368+0000","last_change":"2023-10-08T15:37:26.050368+0000","last_active":"2023-10-08T15:37:26.050368+0000","last_peered":"2023-10-08T15:37:26.050368+0000","last_clean":"2023-10-08T15:37:26.050368+0000","last_became_active":"2023-10-08T15:37:26.050078+0000","last_became_peered":"2023-10-08T15:37:26.050078+0000","last_unstale":"2023-10-08T15:37:26.050368+0000","last_undegraded":"2023-10-08T15:37:26.050368+0000","last_fullsized":"2023-10-08T15:37:26.050368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:56:34.490787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.045671+0000","last_change":"2023-10-08T15:37:26.045671+0000","last_active":"2023-10-08T15:37:26.045671+0000","last_peered":"2023-10-08T15:37:26.045671+0000","last_clean":"2023-10-08T15:37:26.045671+0000","last_became_active":"2023-10-08T15:37:26.045356+0000","last_became_peered":"2023-10-08T15:37:26.045356+0000","last_unstale":"2023-10-08T15:37:26.045671+0000","last_undegraded":"2023-10-08T15:37:26.045671+0000","last_fullsized":"2023-10-08T15:37:26.045671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:47:37.094485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.045121+0000","last_change":"2023-10-08T15:37:26.045121+0000","last_active":"2023-10-08T15:37:26.045121+0000","last_peered":"2023-10-08T15:37:26.045121+0000","last_clean":"2023-10-08T15:37:26.045121+0000","last_became_active":"2023-10-08T15:37:26.044638+0000","last_became_peered":"2023-10-08T15:37:26.044638+0000","last_unstale":"2023-10-08T15:37:26.045121+0000","last_undegraded":"2023-10-08T15:37:26.045121+0000","last_fullsized":"2023-10-08T15:37:26.045121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:45:12.654892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.035585+0000","last_change":"2023-10-08T15:37:26.035585+0000","last_active":"2023-10-08T15:37:26.035585+0000","last_peered":"2023-10-08T15:37:26.035585+0000","last_clean":"2023-10-08T15:37:26.035585+0000","last_became_active":"2023-10-08T15:37:26.035286+0000","last_became_peered":"2023-10-08T15:37:26.035286+0000","last_unstale":"2023-10-08T15:37:26.035585+0000","last_undegraded":"2023-10-08T15:37:26.035585+0000","last_fullsized":"2023-10-08T15:37:26.035585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:15:33.124525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.035125+0000","last_change":"2023-10-08T15:37:26.035125+0000","last_active":"2023-10-08T15:37:26.035125+0000","last_peered":"2023-10-08T15:37:26.035125+0000","last_clean":"2023-10-08T15:37:26.035125+0000","last_became_active":"2023-10-08T15:37:26.034739+0000","last_became_peered":"2023-10-08T15:37:26.034739+0000","last_unstale":"2023-10-08T15:37:26.035125+0000","last_undegraded":"2023-10-08T15:37:26.035125+0000","last_fullsized":"2023-10-08T15:37:26.035125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:38:43.660811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.047730+0000","last_change":"2023-10-08T15:37:26.029621+0000","last_active":"2023-10-08T15:37:26.047730+0000","last_peered":"2023-10-08T15:37:26.047730+0000","last_clean":"2023-10-08T15:37:26.047730+0000","last_became_active":"2023-10-08T15:37:26.029280+0000","last_became_peered":"2023-10-08T15:37:26.029280+0000","last_unstale":"2023-10-08T15:37:26.047730+0000","last_undegraded":"2023-10-08T15:37:26.047730+0000","last_fullsized":"2023-10-08T15:37:26.047730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:52:17.141125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:37:25.042804+0000","last_change":"2023-10-08T15:37:25.041282+0000","last_active":"2023-10-08T15:37:25.042804+0000","last_peered":"2023-10-08T15:37:25.042804+0000","last_clean":"2023-10-08T15:37:25.042804+0000","last_became_active":"2023-10-08T15:37:25.040931+0000","last_became_peered":"2023-10-08T15:37:25.040931+0000","last_unstale":"2023-10-08T15:37:25.042804+0000","last_undegraded":"2023-10-08T15:37:25.042804+0000","last_fullsized":"2023-10-08T15:37:25.042804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:17:10.911391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.050389+0000","last_change":"2023-10-08T15:37:26.050389+0000","last_active":"2023-10-08T15:37:26.050389+0000","last_peered":"2023-10-08T15:37:26.050389+0000","last_clean":"2023-10-08T15:37:26.050389+0000","last_became_active":"2023-10-08T15:37:26.050059+0000","last_became_peered":"2023-10-08T15:37:26.050059+0000","last_unstale":"2023-10-08T15:37:26.050389+0000","last_undegraded":"2023-10-08T15:37:26.050389+0000","last_fullsized":"2023-10-08T15:37:26.050389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:37:10.263562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:37:25.042053+0000","last_change":"2023-10-08T15:37:25.037788+0000","last_active":"2023-10-08T15:37:25.042053+0000","last_peered":"2023-10-08T15:37:25.042053+0000","last_clean":"2023-10-08T15:37:25.042053+0000","last_became_active":"2023-10-08T15:37:25.037390+0000","last_became_peered":"2023-10-08T15:37:25.037390+0000","last_unstale":"2023-10-08T15:37:25.042053+0000","last_undegraded":"2023-10-08T15:37:25.042053+0000","last_fullsized":"2023-10-08T15:37:25.042053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:33:24.209108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.056434+0000","last_change":"2023-10-08T15:37:26.030498+0000","last_active":"2023-10-08T15:37:26.056434+0000","last_peered":"2023-10-08T15:37:26.056434+0000","last_clean":"2023-10-08T15:37:26.056434+0000","last_became_active":"2023-10-08T15:37:26.029947+0000","last_became_peered":"2023-10-08T15:37:26.029947+0000","last_unstale":"2023-10-08T15:37:26.056434+0000","last_undegraded":"2023-10-08T15:37:26.056434+0000","last_fullsized":"2023-10-08T15:37:26.056434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:21:26.142526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:37:25.042769+0000","last_change":"2023-10-08T15:37:25.040580+0000","last_active":"2023-10-08T15:37:25.042769+0000","last_peered":"2023-10-08T15:37:25.042769+0000","last_clean":"2023-10-08T15:37:25.042769+0000","last_became_active":"2023-10-08T15:37:25.039401+0000","last_became_peered":"2023-10-08T15:37:25.039401+0000","last_unstale":"2023-10-08T15:37:25.042769+0000","last_undegraded":"2023-10-08T15:37:25.042769+0000","last_fullsized":"2023-10-08T15:37:25.042769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:12:32.395357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.047479+0000","last_change":"2023-10-08T15:37:25.035792+0000","last_active":"2023-10-08T15:37:26.047479+0000","last_peered":"2023-10-08T15:37:26.047479+0000","last_clean":"2023-10-08T15:37:26.047479+0000","last_became_active":"2023-10-08T15:37:25.035413+0000","last_became_peered":"2023-10-08T15:37:25.035413+0000","last_unstale":"2023-10-08T15:37:26.047479+0000","last_undegraded":"2023-10-08T15:37:26.047479+0000","last_fullsized":"2023-10-08T15:37:26.047479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:08:13.115248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.035368+0000","last_change":"2023-10-08T15:37:26.035368+0000","last_active":"2023-10-08T15:37:26.035368+0000","last_peered":"2023-10-08T15:37:26.035368+0000","last_clean":"2023-10-08T15:37:26.035368+0000","last_became_active":"2023-10-08T15:37:26.034994+0000","last_became_peered":"2023-10-08T15:37:26.034994+0000","last_unstale":"2023-10-08T15:37:26.035368+0000","last_undegraded":"2023-10-08T15:37:26.035368+0000","last_fullsized":"2023-10-08T15:37:26.035368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:21:41.320706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":159,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-08T15:37:21.095074+0000","last_change":"2023-10-08T15:37:19.380955+0000","last_active":"2023-10-08T15:37:21.095074+0000","last_peered":"2023-10-08T15:37:21.095074+0000","last_clean":"2023-10-08T15:37:21.095074+0000","last_became_active":"2023-10-08T15:37:19.378277+0000","last_became_peered":"2023-10-08T15:37:19.378277+0000","last_unstale":"2023-10-08T15:37:21.095074+0000","last_undegraded":"2023-10-08T15:37:21.095074+0000","last_fullsized":"2023-10-08T15:37:21.095074+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:17.537726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:17.537726+0000","last_clean_scrub_stamp":"2023-10-08T15:37:17.537726+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:06:26.612046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:37:25.040973+0000","last_change":"2023-10-08T15:37:25.033028+0000","last_active":"2023-10-08T15:37:25.040973+0000","last_peered":"2023-10-08T15:37:25.040973+0000","last_clean":"2023-10-08T15:37:25.040973+0000","last_became_active":"2023-10-08T15:37:25.032661+0000","last_became_peered":"2023-10-08T15:37:25.032661+0000","last_unstale":"2023-10-08T15:37:25.040973+0000","last_undegraded":"2023-10-08T15:37:25.040973+0000","last_fullsized":"2023-10-08T15:37:25.040973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:18:48.729702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:37:25.042151+0000","last_change":"2023-10-08T15:37:25.037867+0000","last_active":"2023-10-08T15:37:25.042151+0000","last_peered":"2023-10-08T15:37:25.042151+0000","last_clean":"2023-10-08T15:37:25.042151+0000","last_became_active":"2023-10-08T15:37:25.037638+0000","last_became_peered":"2023-10-08T15:37:25.037638+0000","last_unstale":"2023-10-08T15:37:25.042151+0000","last_undegraded":"2023-10-08T15:37:25.042151+0000","last_fullsized":"2023-10-08T15:37:25.042151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:52:16.136483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.057054+0000","last_change":"2023-10-08T15:37:26.046686+0000","last_active":"2023-10-08T15:37:26.057054+0000","last_peered":"2023-10-08T15:37:26.057054+0000","last_clean":"2023-10-08T15:37:26.057054+0000","last_became_active":"2023-10-08T15:37:26.046295+0000","last_became_peered":"2023-10-08T15:37:26.046295+0000","last_unstale":"2023-10-08T15:37:26.057054+0000","last_undegraded":"2023-10-08T15:37:26.057054+0000","last_fullsized":"2023-10-08T15:37:26.057054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:27:46.266100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.049468+0000","last_change":"2023-10-08T15:37:26.049468+0000","last_active":"2023-10-08T15:37:26.049468+0000","last_peered":"2023-10-08T15:37:26.049468+0000","last_clean":"2023-10-08T15:37:26.049468+0000","last_became_active":"2023-10-08T15:37:26.048647+0000","last_became_peered":"2023-10-08T15:37:26.048647+0000","last_unstale":"2023-10-08T15:37:26.049468+0000","last_undegraded":"2023-10-08T15:37:26.049468+0000","last_fullsized":"2023-10-08T15:37:26.049468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:07:54.534413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.057284+0000","last_change":"2023-10-08T15:37:26.039472+0000","last_active":"2023-10-08T15:37:26.057284+0000","last_peered":"2023-10-08T15:37:26.057284+0000","last_clean":"2023-10-08T15:37:26.057284+0000","last_became_active":"2023-10-08T15:37:26.038579+0000","last_became_peered":"2023-10-08T15:37:26.038579+0000","last_unstale":"2023-10-08T15:37:26.057284+0000","last_undegraded":"2023-10-08T15:37:26.057284+0000","last_fullsized":"2023-10-08T15:37:26.057284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:33:25.213750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.057363+0000","last_change":"2023-10-08T15:37:26.057363+0000","last_active":"2023-10-08T15:37:26.057363+0000","last_peered":"2023-10-08T15:37:26.057363+0000","last_clean":"2023-10-08T15:37:26.057363+0000","last_became_active":"2023-10-08T15:37:26.057058+0000","last_became_peered":"2023-10-08T15:37:26.057058+0000","last_unstale":"2023-10-08T15:37:26.057363+0000","last_undegraded":"2023-10-08T15:37:26.057363+0000","last_fullsized":"2023-10-08T15:37:26.057363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:20:26.216438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.057526+0000","last_change":"2023-10-08T15:37:26.057526+0000","last_active":"2023-10-08T15:37:26.057526+0000","last_peered":"2023-10-08T15:37:26.057526+0000","last_clean":"2023-10-08T15:37:26.057526+0000","last_became_active":"2023-10-08T15:37:26.057220+0000","last_became_peered":"2023-10-08T15:37:26.057220+0000","last_unstale":"2023-10-08T15:37:26.057526+0000","last_undegraded":"2023-10-08T15:37:26.057526+0000","last_fullsized":"2023-10-08T15:37:26.057526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:48.862001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":34,"acting":34,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":12,"acting":12,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66282,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542146,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301608,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070232,"statfs":{"total":96636764160,"available":96327917568,"internally_reserved":0,"allocated":217088,"data_stored":634865,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2170000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.024}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3680000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4510000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.575}]}]},{"osd":6,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":301532,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070308,"statfs":{"total":96636764160,"available":96327995392,"internally_reserved":0,"allocated":151552,"data_stored":44497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.129}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3049999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297436,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074404,"statfs":{"total":96636764160,"available":96332189696,"internally_reserved":0,"allocated":151552,"data_stored":44497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1319999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297436,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074404,"statfs":{"total":96636764160,"available":96332189696,"internally_reserved":0,"allocated":151552,"data_stored":44497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.143}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2470000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.72}]}]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297436,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074404,"statfs":{"total":96636764160,"available":96332189696,"internally_reserved":0,"allocated":151552,"data_stored":44497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.399}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0009999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.581}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.819}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3940000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542148,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":217088,"data_stored":634865,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.514}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7549999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6519999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.214}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.532}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9199999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301572,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070268,"statfs":{"total":96636764160,"available":96327954432,"internally_reserved":0,"allocated":192512,"data_stored":63418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0249999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.206}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2609999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.458}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.597}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3819999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301580,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070260,"statfs":{"total":96636764160,"available":96327946240,"internally_reserved":0,"allocated":200704,"data_stored":63454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1180000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T15:37:29.708 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3f is not active+clean 2023-10-08T15:37:29.708 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:24.993513+0000', 'last_change': '2023-10-08T15:37:24.993513+0000', 'last_active': '2023-10-08T15:37:24.993513+0000', 'last_peered': '2023-10-08T15:37:24.993513+0000', 'last_clean': '2023-10-08T15:37:24.993513+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:24.993513+0000', 'last_undegraded': '2023-10-08T15:37:24.993513+0000', 'last_fullsized': '2023-10-08T15:37:24.993513+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.709 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3e is not active+clean 2023-10-08T15:37:29.709 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:24.993513+0000', 'last_change': '2023-10-08T15:37:24.993513+0000', 'last_active': '2023-10-08T15:37:24.993513+0000', 'last_peered': '2023-10-08T15:37:24.993513+0000', 'last_clean': '2023-10-08T15:37:24.993513+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:24.993513+0000', 'last_undegraded': '2023-10-08T15:37:24.993513+0000', 'last_fullsized': '2023-10-08T15:37:24.993513+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.709 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3d is not active+clean 2023-10-08T15:37:29.709 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:24.993513+0000', 'last_change': '2023-10-08T15:37:24.993513+0000', 'last_active': '2023-10-08T15:37:24.993513+0000', 'last_peered': '2023-10-08T15:37:24.993513+0000', 'last_clean': '2023-10-08T15:37:24.993513+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:24.993513+0000', 'last_undegraded': '2023-10-08T15:37:24.993513+0000', 'last_fullsized': '2023-10-08T15:37:24.993513+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.709 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3b is not active+clean 2023-10-08T15:37:29.709 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:24.993513+0000', 'last_change': '2023-10-08T15:37:24.993513+0000', 'last_active': '2023-10-08T15:37:24.993513+0000', 'last_peered': '2023-10-08T15:37:24.993513+0000', 'last_clean': '2023-10-08T15:37:24.993513+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:24.993513+0000', 'last_undegraded': '2023-10-08T15:37:24.993513+0000', 'last_fullsized': '2023-10-08T15:37:24.993513+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.709 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.39 is not active+clean 2023-10-08T15:37:29.709 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:24.993513+0000', 'last_change': '2023-10-08T15:37:24.993513+0000', 'last_active': '2023-10-08T15:37:24.993513+0000', 'last_peered': '2023-10-08T15:37:24.993513+0000', 'last_clean': '2023-10-08T15:37:24.993513+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:24.993513+0000', 'last_undegraded': '2023-10-08T15:37:24.993513+0000', 'last_fullsized': '2023-10-08T15:37:24.993513+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.710 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.38 is not active+clean 2023-10-08T15:37:29.710 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:24.993513+0000', 'last_change': '2023-10-08T15:37:24.993513+0000', 'last_active': '2023-10-08T15:37:24.993513+0000', 'last_peered': '2023-10-08T15:37:24.993513+0000', 'last_clean': '2023-10-08T15:37:24.993513+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:24.993513+0000', 'last_undegraded': '2023-10-08T15:37:24.993513+0000', 'last_fullsized': '2023-10-08T15:37:24.993513+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.710 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.37 is not active+clean 2023-10-08T15:37:29.710 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:24.993513+0000', 'last_change': '2023-10-08T15:37:24.993513+0000', 'last_active': '2023-10-08T15:37:24.993513+0000', 'last_peered': '2023-10-08T15:37:24.993513+0000', 'last_clean': '2023-10-08T15:37:24.993513+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:24.993513+0000', 'last_undegraded': '2023-10-08T15:37:24.993513+0000', 'last_fullsized': '2023-10-08T15:37:24.993513+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.710 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.36 is not active+clean 2023-10-08T15:37:29.710 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:24.993513+0000', 'last_change': '2023-10-08T15:37:24.993513+0000', 'last_active': '2023-10-08T15:37:24.993513+0000', 'last_peered': '2023-10-08T15:37:24.993513+0000', 'last_clean': '2023-10-08T15:37:24.993513+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:24.993513+0000', 'last_undegraded': '2023-10-08T15:37:24.993513+0000', 'last_fullsized': '2023-10-08T15:37:24.993513+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.710 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.35 is not active+clean 2023-10-08T15:37:29.710 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:24.993513+0000', 'last_change': '2023-10-08T15:37:24.993513+0000', 'last_active': '2023-10-08T15:37:24.993513+0000', 'last_peered': '2023-10-08T15:37:24.993513+0000', 'last_clean': '2023-10-08T15:37:24.993513+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:24.993513+0000', 'last_undegraded': '2023-10-08T15:37:24.993513+0000', 'last_fullsized': '2023-10-08T15:37:24.993513+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.711 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.33 is not active+clean 2023-10-08T15:37:29.711 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:24.993513+0000', 'last_change': '2023-10-08T15:37:24.993513+0000', 'last_active': '2023-10-08T15:37:24.993513+0000', 'last_peered': '2023-10-08T15:37:24.993513+0000', 'last_clean': '2023-10-08T15:37:24.993513+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:24.993513+0000', 'last_undegraded': '2023-10-08T15:37:24.993513+0000', 'last_fullsized': '2023-10-08T15:37:24.993513+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.711 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.32 is not active+clean 2023-10-08T15:37:29.711 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:24.993513+0000', 'last_change': '2023-10-08T15:37:24.993513+0000', 'last_active': '2023-10-08T15:37:24.993513+0000', 'last_peered': '2023-10-08T15:37:24.993513+0000', 'last_clean': '2023-10-08T15:37:24.993513+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:24.993513+0000', 'last_undegraded': '2023-10-08T15:37:24.993513+0000', 'last_fullsized': '2023-10-08T15:37:24.993513+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.711 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.31 is not active+clean 2023-10-08T15:37:29.711 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:24.993513+0000', 'last_change': '2023-10-08T15:37:24.993513+0000', 'last_active': '2023-10-08T15:37:24.993513+0000', 'last_peered': '2023-10-08T15:37:24.993513+0000', 'last_clean': '2023-10-08T15:37:24.993513+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:24.993513+0000', 'last_undegraded': '2023-10-08T15:37:24.993513+0000', 'last_fullsized': '2023-10-08T15:37:24.993513+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.711 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2e is not active+clean 2023-10-08T15:37:29.711 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:24.993513+0000', 'last_change': '2023-10-08T15:37:24.993513+0000', 'last_active': '2023-10-08T15:37:24.993513+0000', 'last_peered': '2023-10-08T15:37:24.993513+0000', 'last_clean': '2023-10-08T15:37:24.993513+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:24.993513+0000', 'last_undegraded': '2023-10-08T15:37:24.993513+0000', 'last_fullsized': '2023-10-08T15:37:24.993513+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.711 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2d is not active+clean 2023-10-08T15:37:29.711 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:24.993513+0000', 'last_change': '2023-10-08T15:37:24.993513+0000', 'last_active': '2023-10-08T15:37:24.993513+0000', 'last_peered': '2023-10-08T15:37:24.993513+0000', 'last_clean': '2023-10-08T15:37:24.993513+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:24.993513+0000', 'last_undegraded': '2023-10-08T15:37:24.993513+0000', 'last_fullsized': '2023-10-08T15:37:24.993513+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.712 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2c is not active+clean 2023-10-08T15:37:29.712 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:24.993513+0000', 'last_change': '2023-10-08T15:37:24.993513+0000', 'last_active': '2023-10-08T15:37:24.993513+0000', 'last_peered': '2023-10-08T15:37:24.993513+0000', 'last_clean': '2023-10-08T15:37:24.993513+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:24.993513+0000', 'last_undegraded': '2023-10-08T15:37:24.993513+0000', 'last_fullsized': '2023-10-08T15:37:24.993513+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.712 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2b is not active+clean 2023-10-08T15:37:29.712 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:24.993513+0000', 'last_change': '2023-10-08T15:37:24.993513+0000', 'last_active': '2023-10-08T15:37:24.993513+0000', 'last_peered': '2023-10-08T15:37:24.993513+0000', 'last_clean': '2023-10-08T15:37:24.993513+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:24.993513+0000', 'last_undegraded': '2023-10-08T15:37:24.993513+0000', 'last_fullsized': '2023-10-08T15:37:24.993513+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.712 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.29 is not active+clean 2023-10-08T15:37:29.712 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:24.993513+0000', 'last_change': '2023-10-08T15:37:24.993513+0000', 'last_active': '2023-10-08T15:37:24.993513+0000', 'last_peered': '2023-10-08T15:37:24.993513+0000', 'last_clean': '2023-10-08T15:37:24.993513+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:24.993513+0000', 'last_undegraded': '2023-10-08T15:37:24.993513+0000', 'last_fullsized': '2023-10-08T15:37:24.993513+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.712 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.27 is not active+clean 2023-10-08T15:37:29.712 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:24.993513+0000', 'last_change': '2023-10-08T15:37:24.993513+0000', 'last_active': '2023-10-08T15:37:24.993513+0000', 'last_peered': '2023-10-08T15:37:24.993513+0000', 'last_clean': '2023-10-08T15:37:24.993513+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:24.993513+0000', 'last_undegraded': '2023-10-08T15:37:24.993513+0000', 'last_fullsized': '2023-10-08T15:37:24.993513+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.713 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.26 is not active+clean 2023-10-08T15:37:29.713 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:24.993513+0000', 'last_change': '2023-10-08T15:37:24.993513+0000', 'last_active': '2023-10-08T15:37:24.993513+0000', 'last_peered': '2023-10-08T15:37:24.993513+0000', 'last_clean': '2023-10-08T15:37:24.993513+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:24.993513+0000', 'last_undegraded': '2023-10-08T15:37:24.993513+0000', 'last_fullsized': '2023-10-08T15:37:24.993513+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.713 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.25 is not active+clean 2023-10-08T15:37:29.713 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:24.993513+0000', 'last_change': '2023-10-08T15:37:24.993513+0000', 'last_active': '2023-10-08T15:37:24.993513+0000', 'last_peered': '2023-10-08T15:37:24.993513+0000', 'last_clean': '2023-10-08T15:37:24.993513+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:24.993513+0000', 'last_undegraded': '2023-10-08T15:37:24.993513+0000', 'last_fullsized': '2023-10-08T15:37:24.993513+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.713 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.24 is not active+clean 2023-10-08T15:37:29.713 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:24.993513+0000', 'last_change': '2023-10-08T15:37:24.993513+0000', 'last_active': '2023-10-08T15:37:24.993513+0000', 'last_peered': '2023-10-08T15:37:24.993513+0000', 'last_clean': '2023-10-08T15:37:24.993513+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:24.993513+0000', 'last_undegraded': '2023-10-08T15:37:24.993513+0000', 'last_fullsized': '2023-10-08T15:37:24.993513+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.713 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.23 is not active+clean 2023-10-08T15:37:29.713 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:24.993513+0000', 'last_change': '2023-10-08T15:37:24.993513+0000', 'last_active': '2023-10-08T15:37:24.993513+0000', 'last_peered': '2023-10-08T15:37:24.993513+0000', 'last_clean': '2023-10-08T15:37:24.993513+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:24.993513+0000', 'last_undegraded': '2023-10-08T15:37:24.993513+0000', 'last_fullsized': '2023-10-08T15:37:24.993513+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.713 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.21 is not active+clean 2023-10-08T15:37:29.714 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:24.993513+0000', 'last_change': '2023-10-08T15:37:24.993513+0000', 'last_active': '2023-10-08T15:37:24.993513+0000', 'last_peered': '2023-10-08T15:37:24.993513+0000', 'last_clean': '2023-10-08T15:37:24.993513+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:24.993513+0000', 'last_undegraded': '2023-10-08T15:37:24.993513+0000', 'last_fullsized': '2023-10-08T15:37:24.993513+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.714 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.20 is not active+clean 2023-10-08T15:37:29.714 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:24.993513+0000', 'last_change': '2023-10-08T15:37:24.993513+0000', 'last_active': '2023-10-08T15:37:24.993513+0000', 'last_peered': '2023-10-08T15:37:24.993513+0000', 'last_clean': '2023-10-08T15:37:24.993513+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:24.993513+0000', 'last_undegraded': '2023-10-08T15:37:24.993513+0000', 'last_fullsized': '2023-10-08T15:37:24.993513+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.714 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1b is not active+clean 2023-10-08T15:37:29.714 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:23.988871+0000', 'last_change': '2023-10-08T15:37:23.988871+0000', 'last_active': '2023-10-08T15:37:23.988871+0000', 'last_peered': '2023-10-08T15:37:23.988871+0000', 'last_clean': '2023-10-08T15:37:23.988871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:23.988871+0000', 'last_undegraded': '2023-10-08T15:37:23.988871+0000', 'last_fullsized': '2023-10-08T15:37:23.988871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.714 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1b is not active+clean 2023-10-08T15:37:29.714 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:24.993513+0000', 'last_change': '2023-10-08T15:37:24.993513+0000', 'last_active': '2023-10-08T15:37:24.993513+0000', 'last_peered': '2023-10-08T15:37:24.993513+0000', 'last_clean': '2023-10-08T15:37:24.993513+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:24.993513+0000', 'last_undegraded': '2023-10-08T15:37:24.993513+0000', 'last_fullsized': '2023-10-08T15:37:24.993513+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.715 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1a is not active+clean 2023-10-08T15:37:29.715 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:23.988871+0000', 'last_change': '2023-10-08T15:37:23.988871+0000', 'last_active': '2023-10-08T15:37:23.988871+0000', 'last_peered': '2023-10-08T15:37:23.988871+0000', 'last_clean': '2023-10-08T15:37:23.988871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:23.988871+0000', 'last_undegraded': '2023-10-08T15:37:23.988871+0000', 'last_fullsized': '2023-10-08T15:37:23.988871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.715 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.19 is not active+clean 2023-10-08T15:37:29.715 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:23.988871+0000', 'last_change': '2023-10-08T15:37:23.988871+0000', 'last_active': '2023-10-08T15:37:23.988871+0000', 'last_peered': '2023-10-08T15:37:23.988871+0000', 'last_clean': '2023-10-08T15:37:23.988871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:23.988871+0000', 'last_undegraded': '2023-10-08T15:37:23.988871+0000', 'last_fullsized': '2023-10-08T15:37:23.988871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.716 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2023-10-08T15:37:29.716 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:24.993513+0000', 'last_change': '2023-10-08T15:37:24.993513+0000', 'last_active': '2023-10-08T15:37:24.993513+0000', 'last_peered': '2023-10-08T15:37:24.993513+0000', 'last_clean': '2023-10-08T15:37:24.993513+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:24.993513+0000', 'last_undegraded': '2023-10-08T15:37:24.993513+0000', 'last_fullsized': '2023-10-08T15:37:24.993513+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.716 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.19 is not active+clean 2023-10-08T15:37:29.716 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:24.993513+0000', 'last_change': '2023-10-08T15:37:24.993513+0000', 'last_active': '2023-10-08T15:37:24.993513+0000', 'last_peered': '2023-10-08T15:37:24.993513+0000', 'last_clean': '2023-10-08T15:37:24.993513+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:24.993513+0000', 'last_undegraded': '2023-10-08T15:37:24.993513+0000', 'last_fullsized': '2023-10-08T15:37:24.993513+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.716 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.17 is not active+clean 2023-10-08T15:37:29.716 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:23.988871+0000', 'last_change': '2023-10-08T15:37:23.988871+0000', 'last_active': '2023-10-08T15:37:23.988871+0000', 'last_peered': '2023-10-08T15:37:23.988871+0000', 'last_clean': '2023-10-08T15:37:23.988871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:23.988871+0000', 'last_undegraded': '2023-10-08T15:37:23.988871+0000', 'last_fullsized': '2023-10-08T15:37:23.988871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.716 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2023-10-08T15:37:29.716 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:24.993513+0000', 'last_change': '2023-10-08T15:37:24.993513+0000', 'last_active': '2023-10-08T15:37:24.993513+0000', 'last_peered': '2023-10-08T15:37:24.993513+0000', 'last_clean': '2023-10-08T15:37:24.993513+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:24.993513+0000', 'last_undegraded': '2023-10-08T15:37:24.993513+0000', 'last_fullsized': '2023-10-08T15:37:24.993513+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.716 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.15 is not active+clean 2023-10-08T15:37:29.716 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:23.988871+0000', 'last_change': '2023-10-08T15:37:23.988871+0000', 'last_active': '2023-10-08T15:37:23.988871+0000', 'last_peered': '2023-10-08T15:37:23.988871+0000', 'last_clean': '2023-10-08T15:37:23.988871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:23.988871+0000', 'last_undegraded': '2023-10-08T15:37:23.988871+0000', 'last_fullsized': '2023-10-08T15:37:23.988871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.717 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.14 is not active+clean 2023-10-08T15:37:29.717 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:23.988871+0000', 'last_change': '2023-10-08T15:37:23.988871+0000', 'last_active': '2023-10-08T15:37:23.988871+0000', 'last_peered': '2023-10-08T15:37:23.988871+0000', 'last_clean': '2023-10-08T15:37:23.988871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:23.988871+0000', 'last_undegraded': '2023-10-08T15:37:23.988871+0000', 'last_fullsized': '2023-10-08T15:37:23.988871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.717 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.15 is not active+clean 2023-10-08T15:37:29.717 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:24.993513+0000', 'last_change': '2023-10-08T15:37:24.993513+0000', 'last_active': '2023-10-08T15:37:24.993513+0000', 'last_peered': '2023-10-08T15:37:24.993513+0000', 'last_clean': '2023-10-08T15:37:24.993513+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:24.993513+0000', 'last_undegraded': '2023-10-08T15:37:24.993513+0000', 'last_fullsized': '2023-10-08T15:37:24.993513+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.717 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.13 is not active+clean 2023-10-08T15:37:29.717 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:23.988871+0000', 'last_change': '2023-10-08T15:37:23.988871+0000', 'last_active': '2023-10-08T15:37:23.988871+0000', 'last_peered': '2023-10-08T15:37:23.988871+0000', 'last_clean': '2023-10-08T15:37:23.988871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:23.988871+0000', 'last_undegraded': '2023-10-08T15:37:23.988871+0000', 'last_fullsized': '2023-10-08T15:37:23.988871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.717 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.12 is not active+clean 2023-10-08T15:37:29.717 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:24.993513+0000', 'last_change': '2023-10-08T15:37:24.993513+0000', 'last_active': '2023-10-08T15:37:24.993513+0000', 'last_peered': '2023-10-08T15:37:24.993513+0000', 'last_clean': '2023-10-08T15:37:24.993513+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:24.993513+0000', 'last_undegraded': '2023-10-08T15:37:24.993513+0000', 'last_fullsized': '2023-10-08T15:37:24.993513+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.718 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.13 is not active+clean 2023-10-08T15:37:29.718 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:24.993513+0000', 'last_change': '2023-10-08T15:37:24.993513+0000', 'last_active': '2023-10-08T15:37:24.993513+0000', 'last_peered': '2023-10-08T15:37:24.993513+0000', 'last_clean': '2023-10-08T15:37:24.993513+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:24.993513+0000', 'last_undegraded': '2023-10-08T15:37:24.993513+0000', 'last_fullsized': '2023-10-08T15:37:24.993513+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.718 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.11 is not active+clean 2023-10-08T15:37:29.718 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:23.988871+0000', 'last_change': '2023-10-08T15:37:23.988871+0000', 'last_active': '2023-10-08T15:37:23.988871+0000', 'last_peered': '2023-10-08T15:37:23.988871+0000', 'last_clean': '2023-10-08T15:37:23.988871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:23.988871+0000', 'last_undegraded': '2023-10-08T15:37:23.988871+0000', 'last_fullsized': '2023-10-08T15:37:23.988871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.718 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.10 is not active+clean 2023-10-08T15:37:29.718 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:24.993513+0000', 'last_change': '2023-10-08T15:37:24.993513+0000', 'last_active': '2023-10-08T15:37:24.993513+0000', 'last_peered': '2023-10-08T15:37:24.993513+0000', 'last_clean': '2023-10-08T15:37:24.993513+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:24.993513+0000', 'last_undegraded': '2023-10-08T15:37:24.993513+0000', 'last_fullsized': '2023-10-08T15:37:24.993513+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.718 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.10 is not active+clean 2023-10-08T15:37:29.718 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:23.988871+0000', 'last_change': '2023-10-08T15:37:23.988871+0000', 'last_active': '2023-10-08T15:37:23.988871+0000', 'last_peered': '2023-10-08T15:37:23.988871+0000', 'last_clean': '2023-10-08T15:37:23.988871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:23.988871+0000', 'last_undegraded': '2023-10-08T15:37:23.988871+0000', 'last_fullsized': '2023-10-08T15:37:23.988871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.719 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2023-10-08T15:37:29.719 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:24.993513+0000', 'last_change': '2023-10-08T15:37:24.993513+0000', 'last_active': '2023-10-08T15:37:24.993513+0000', 'last_peered': '2023-10-08T15:37:24.993513+0000', 'last_clean': '2023-10-08T15:37:24.993513+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:24.993513+0000', 'last_undegraded': '2023-10-08T15:37:24.993513+0000', 'last_fullsized': '2023-10-08T15:37:24.993513+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.719 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.e is not active+clean 2023-10-08T15:37:29.719 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:24.993513+0000', 'last_change': '2023-10-08T15:37:24.993513+0000', 'last_active': '2023-10-08T15:37:24.993513+0000', 'last_peered': '2023-10-08T15:37:24.993513+0000', 'last_clean': '2023-10-08T15:37:24.993513+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:24.993513+0000', 'last_undegraded': '2023-10-08T15:37:24.993513+0000', 'last_fullsized': '2023-10-08T15:37:24.993513+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.719 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.e is not active+clean 2023-10-08T15:37:29.719 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:23.988871+0000', 'last_change': '2023-10-08T15:37:23.988871+0000', 'last_active': '2023-10-08T15:37:23.988871+0000', 'last_peered': '2023-10-08T15:37:23.988871+0000', 'last_clean': '2023-10-08T15:37:23.988871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:23.988871+0000', 'last_undegraded': '2023-10-08T15:37:23.988871+0000', 'last_fullsized': '2023-10-08T15:37:23.988871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.719 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.f is not active+clean 2023-10-08T15:37:29.719 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:24.993513+0000', 'last_change': '2023-10-08T15:37:24.993513+0000', 'last_active': '2023-10-08T15:37:24.993513+0000', 'last_peered': '2023-10-08T15:37:24.993513+0000', 'last_clean': '2023-10-08T15:37:24.993513+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:24.993513+0000', 'last_undegraded': '2023-10-08T15:37:24.993513+0000', 'last_fullsized': '2023-10-08T15:37:24.993513+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.720 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.d is not active+clean 2023-10-08T15:37:29.720 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:23.988871+0000', 'last_change': '2023-10-08T15:37:23.988871+0000', 'last_active': '2023-10-08T15:37:23.988871+0000', 'last_peered': '2023-10-08T15:37:23.988871+0000', 'last_clean': '2023-10-08T15:37:23.988871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:23.988871+0000', 'last_undegraded': '2023-10-08T15:37:23.988871+0000', 'last_fullsized': '2023-10-08T15:37:23.988871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.720 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.c is not active+clean 2023-10-08T15:37:29.720 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:23.988871+0000', 'last_change': '2023-10-08T15:37:23.988871+0000', 'last_active': '2023-10-08T15:37:23.988871+0000', 'last_peered': '2023-10-08T15:37:23.988871+0000', 'last_clean': '2023-10-08T15:37:23.988871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:23.988871+0000', 'last_undegraded': '2023-10-08T15:37:23.988871+0000', 'last_fullsized': '2023-10-08T15:37:23.988871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.720 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.d is not active+clean 2023-10-08T15:37:29.720 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:24.993513+0000', 'last_change': '2023-10-08T15:37:24.993513+0000', 'last_active': '2023-10-08T15:37:24.993513+0000', 'last_peered': '2023-10-08T15:37:24.993513+0000', 'last_clean': '2023-10-08T15:37:24.993513+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:24.993513+0000', 'last_undegraded': '2023-10-08T15:37:24.993513+0000', 'last_fullsized': '2023-10-08T15:37:24.993513+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.720 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2023-10-08T15:37:29.720 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:24.993513+0000', 'last_change': '2023-10-08T15:37:24.993513+0000', 'last_active': '2023-10-08T15:37:24.993513+0000', 'last_peered': '2023-10-08T15:37:24.993513+0000', 'last_clean': '2023-10-08T15:37:24.993513+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:24.993513+0000', 'last_undegraded': '2023-10-08T15:37:24.993513+0000', 'last_fullsized': '2023-10-08T15:37:24.993513+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.720 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.0 is not active+clean 2023-10-08T15:37:29.721 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:23.988871+0000', 'last_change': '2023-10-08T15:37:23.988871+0000', 'last_active': '2023-10-08T15:37:23.988871+0000', 'last_peered': '2023-10-08T15:37:23.988871+0000', 'last_clean': '2023-10-08T15:37:23.988871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:23.988871+0000', 'last_undegraded': '2023-10-08T15:37:23.988871+0000', 'last_fullsized': '2023-10-08T15:37:23.988871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.721 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1 is not active+clean 2023-10-08T15:37:29.721 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:24.993513+0000', 'last_change': '2023-10-08T15:37:24.993513+0000', 'last_active': '2023-10-08T15:37:24.993513+0000', 'last_peered': '2023-10-08T15:37:24.993513+0000', 'last_clean': '2023-10-08T15:37:24.993513+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:24.993513+0000', 'last_undegraded': '2023-10-08T15:37:24.993513+0000', 'last_fullsized': '2023-10-08T15:37:24.993513+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.721 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1 is not active+clean 2023-10-08T15:37:29.721 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:23.988871+0000', 'last_change': '2023-10-08T15:37:23.988871+0000', 'last_active': '2023-10-08T15:37:23.988871+0000', 'last_peered': '2023-10-08T15:37:23.988871+0000', 'last_clean': '2023-10-08T15:37:23.988871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:23.988871+0000', 'last_undegraded': '2023-10-08T15:37:23.988871+0000', 'last_fullsized': '2023-10-08T15:37:23.988871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.721 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.0 is not active+clean 2023-10-08T15:37:29.721 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:24.993513+0000', 'last_change': '2023-10-08T15:37:24.993513+0000', 'last_active': '2023-10-08T15:37:24.993513+0000', 'last_peered': '2023-10-08T15:37:24.993513+0000', 'last_clean': '2023-10-08T15:37:24.993513+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:24.993513+0000', 'last_undegraded': '2023-10-08T15:37:24.993513+0000', 'last_fullsized': '2023-10-08T15:37:24.993513+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.721 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.4 is not active+clean 2023-10-08T15:37:29.721 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:23.988871+0000', 'last_change': '2023-10-08T15:37:23.988871+0000', 'last_active': '2023-10-08T15:37:23.988871+0000', 'last_peered': '2023-10-08T15:37:23.988871+0000', 'last_clean': '2023-10-08T15:37:23.988871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:23.988871+0000', 'last_undegraded': '2023-10-08T15:37:23.988871+0000', 'last_fullsized': '2023-10-08T15:37:23.988871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.722 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.5 is not active+clean 2023-10-08T15:37:29.722 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:23.988871+0000', 'last_change': '2023-10-08T15:37:23.988871+0000', 'last_active': '2023-10-08T15:37:23.988871+0000', 'last_peered': '2023-10-08T15:37:23.988871+0000', 'last_clean': '2023-10-08T15:37:23.988871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:23.988871+0000', 'last_undegraded': '2023-10-08T15:37:23.988871+0000', 'last_fullsized': '2023-10-08T15:37:23.988871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.722 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.4 is not active+clean 2023-10-08T15:37:29.722 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:24.993513+0000', 'last_change': '2023-10-08T15:37:24.993513+0000', 'last_active': '2023-10-08T15:37:24.993513+0000', 'last_peered': '2023-10-08T15:37:24.993513+0000', 'last_clean': '2023-10-08T15:37:24.993513+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:24.993513+0000', 'last_undegraded': '2023-10-08T15:37:24.993513+0000', 'last_fullsized': '2023-10-08T15:37:24.993513+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.722 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.6 is not active+clean 2023-10-08T15:37:29.722 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:23.988871+0000', 'last_change': '2023-10-08T15:37:23.988871+0000', 'last_active': '2023-10-08T15:37:23.988871+0000', 'last_peered': '2023-10-08T15:37:23.988871+0000', 'last_clean': '2023-10-08T15:37:23.988871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:23.988871+0000', 'last_undegraded': '2023-10-08T15:37:23.988871+0000', 'last_fullsized': '2023-10-08T15:37:23.988871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.722 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2023-10-08T15:37:29.722 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:24.993513+0000', 'last_change': '2023-10-08T15:37:24.993513+0000', 'last_active': '2023-10-08T15:37:24.993513+0000', 'last_peered': '2023-10-08T15:37:24.993513+0000', 'last_clean': '2023-10-08T15:37:24.993513+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:24.993513+0000', 'last_undegraded': '2023-10-08T15:37:24.993513+0000', 'last_fullsized': '2023-10-08T15:37:24.993513+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.723 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.7 is not active+clean 2023-10-08T15:37:29.723 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:23.988871+0000', 'last_change': '2023-10-08T15:37:23.988871+0000', 'last_active': '2023-10-08T15:37:23.988871+0000', 'last_peered': '2023-10-08T15:37:23.988871+0000', 'last_clean': '2023-10-08T15:37:23.988871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:23.988871+0000', 'last_undegraded': '2023-10-08T15:37:23.988871+0000', 'last_fullsized': '2023-10-08T15:37:23.988871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.723 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.6 is not active+clean 2023-10-08T15:37:29.723 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:24.993513+0000', 'last_change': '2023-10-08T15:37:24.993513+0000', 'last_active': '2023-10-08T15:37:24.993513+0000', 'last_peered': '2023-10-08T15:37:24.993513+0000', 'last_clean': '2023-10-08T15:37:24.993513+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:24.993513+0000', 'last_undegraded': '2023-10-08T15:37:24.993513+0000', 'last_fullsized': '2023-10-08T15:37:24.993513+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.723 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.8 is not active+clean 2023-10-08T15:37:29.723 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:23.988871+0000', 'last_change': '2023-10-08T15:37:23.988871+0000', 'last_active': '2023-10-08T15:37:23.988871+0000', 'last_peered': '2023-10-08T15:37:23.988871+0000', 'last_clean': '2023-10-08T15:37:23.988871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:23.988871+0000', 'last_undegraded': '2023-10-08T15:37:23.988871+0000', 'last_fullsized': '2023-10-08T15:37:23.988871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.723 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.9 is not active+clean 2023-10-08T15:37:29.723 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:23.988871+0000', 'last_change': '2023-10-08T15:37:23.988871+0000', 'last_active': '2023-10-08T15:37:23.988871+0000', 'last_peered': '2023-10-08T15:37:23.988871+0000', 'last_clean': '2023-10-08T15:37:23.988871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:23.988871+0000', 'last_undegraded': '2023-10-08T15:37:23.988871+0000', 'last_fullsized': '2023-10-08T15:37:23.988871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.723 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.8 is not active+clean 2023-10-08T15:37:29.723 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:24.993513+0000', 'last_change': '2023-10-08T15:37:24.993513+0000', 'last_active': '2023-10-08T15:37:24.993513+0000', 'last_peered': '2023-10-08T15:37:24.993513+0000', 'last_clean': '2023-10-08T15:37:24.993513+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:24.993513+0000', 'last_undegraded': '2023-10-08T15:37:24.993513+0000', 'last_fullsized': '2023-10-08T15:37:24.993513+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.724 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.a is not active+clean 2023-10-08T15:37:29.724 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:23.988871+0000', 'last_change': '2023-10-08T15:37:23.988871+0000', 'last_active': '2023-10-08T15:37:23.988871+0000', 'last_peered': '2023-10-08T15:37:23.988871+0000', 'last_clean': '2023-10-08T15:37:23.988871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:23.988871+0000', 'last_undegraded': '2023-10-08T15:37:23.988871+0000', 'last_fullsized': '2023-10-08T15:37:23.988871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.724 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.b is not active+clean 2023-10-08T15:37:29.724 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:24.993513+0000', 'last_change': '2023-10-08T15:37:24.993513+0000', 'last_active': '2023-10-08T15:37:24.993513+0000', 'last_peered': '2023-10-08T15:37:24.993513+0000', 'last_clean': '2023-10-08T15:37:24.993513+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:24.993513+0000', 'last_undegraded': '2023-10-08T15:37:24.993513+0000', 'last_fullsized': '2023-10-08T15:37:24.993513+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.724 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.b is not active+clean 2023-10-08T15:37:29.724 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:23.988871+0000', 'last_change': '2023-10-08T15:37:23.988871+0000', 'last_active': '2023-10-08T15:37:23.988871+0000', 'last_peered': '2023-10-08T15:37:23.988871+0000', 'last_clean': '2023-10-08T15:37:23.988871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:23.988871+0000', 'last_undegraded': '2023-10-08T15:37:23.988871+0000', 'last_fullsized': '2023-10-08T15:37:23.988871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.724 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.a is not active+clean 2023-10-08T15:37:29.724 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:24.993513+0000', 'last_change': '2023-10-08T15:37:24.993513+0000', 'last_active': '2023-10-08T15:37:24.993513+0000', 'last_peered': '2023-10-08T15:37:24.993513+0000', 'last_clean': '2023-10-08T15:37:24.993513+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:24.993513+0000', 'last_undegraded': '2023-10-08T15:37:24.993513+0000', 'last_fullsized': '2023-10-08T15:37:24.993513+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.724 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1c is not active+clean 2023-10-08T15:37:29.725 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:23.988871+0000', 'last_change': '2023-10-08T15:37:23.988871+0000', 'last_active': '2023-10-08T15:37:23.988871+0000', 'last_peered': '2023-10-08T15:37:23.988871+0000', 'last_clean': '2023-10-08T15:37:23.988871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:23.988871+0000', 'last_undegraded': '2023-10-08T15:37:23.988871+0000', 'last_fullsized': '2023-10-08T15:37:23.988871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.725 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1d is not active+clean 2023-10-08T15:37:29.725 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:23.988871+0000', 'last_change': '2023-10-08T15:37:23.988871+0000', 'last_active': '2023-10-08T15:37:23.988871+0000', 'last_peered': '2023-10-08T15:37:23.988871+0000', 'last_clean': '2023-10-08T15:37:23.988871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:23.988871+0000', 'last_undegraded': '2023-10-08T15:37:23.988871+0000', 'last_fullsized': '2023-10-08T15:37:23.988871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.725 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1f is not active+clean 2023-10-08T15:37:29.725 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:24.993513+0000', 'last_change': '2023-10-08T15:37:24.993513+0000', 'last_active': '2023-10-08T15:37:24.993513+0000', 'last_peered': '2023-10-08T15:37:24.993513+0000', 'last_clean': '2023-10-08T15:37:24.993513+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:24.993513+0000', 'last_undegraded': '2023-10-08T15:37:24.993513+0000', 'last_fullsized': '2023-10-08T15:37:24.993513+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.725 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1e is not active+clean 2023-10-08T15:37:29.725 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:23.988871+0000', 'last_change': '2023-10-08T15:37:23.988871+0000', 'last_active': '2023-10-08T15:37:23.988871+0000', 'last_peered': '2023-10-08T15:37:23.988871+0000', 'last_clean': '2023-10-08T15:37:23.988871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:23.988871+0000', 'last_undegraded': '2023-10-08T15:37:23.988871+0000', 'last_fullsized': '2023-10-08T15:37:23.988871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.725 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2023-10-08T15:37:29.725 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:24.993513+0000', 'last_change': '2023-10-08T15:37:24.993513+0000', 'last_active': '2023-10-08T15:37:24.993513+0000', 'last_peered': '2023-10-08T15:37:24.993513+0000', 'last_clean': '2023-10-08T15:37:24.993513+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:24.993513+0000', 'last_undegraded': '2023-10-08T15:37:24.993513+0000', 'last_fullsized': '2023-10-08T15:37:24.993513+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:24.993513+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.726 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1f is not active+clean 2023-10-08T15:37:29.726 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:37:23.988871+0000', 'last_change': '2023-10-08T15:37:23.988871+0000', 'last_active': '2023-10-08T15:37:23.988871+0000', 'last_peered': '2023-10-08T15:37:23.988871+0000', 'last_clean': '2023-10-08T15:37:23.988871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:37:23.988871+0000', 'last_undegraded': '2023-10-08T15:37:23.988871+0000', 'last_fullsized': '2023-10-08T15:37:23.988871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'last_clean_scrub_stamp': '2023-10-08T15:37:23.988871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:37:29.726 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-08T15:37:29.742 INFO:tasks.ceph.mds.b.smithi050.stderr:2023-10-08T15:37:29.736+0000 7f64d1d48700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T15:37:29.835 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.829+0000 7fd70bfff700 1 Processor -- start 2023-10-08T15:37:29.835 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.829+0000 7fd70bfff700 1 -- start start 2023-10-08T15:37:29.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.829+0000 7fd70bfff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fd70c06be60 0x7fd70c14b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:29.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.829+0000 7fd70bfff700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd70c14c6b0 con 0x7fd70c06cc40 2023-10-08T15:37:29.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.829+0000 7fd70bfff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd70c14c060 con 0x7fd70c14ac50 2023-10-08T15:37:29.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.829+0000 7fd70bfff700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd70c14c340 con 0x7fd70c06be60 2023-10-08T15:37:29.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.829+0000 7fd70a7fc700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fd70c06be60 0x7fd70c14b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:29.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.829+0000 7fd70b7fe700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fd70c06cc40 0x7fd70c14cc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:53774/0 (socket says 172.21.15.3:53774) 2023-10-08T15:37:29.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.829+0000 7fd70b7fe700 1 -- 172.21.15.3:0/2413418249 learned_addr learned my addr 172.21.15.3:0/2413418249 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:29.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.829+0000 7fd70a7fc700 1 -- 172.21.15.3:0/2413418249 >> v1:172.21.15.50:6789/0 conn(0x7fd70c14ac50 legacy=0x7fd70c06c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:29.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.829+0000 7fd70a7fc700 1 -- 172.21.15.3:0/2413418249 >> v1:172.21.15.3:6789/0 conn(0x7fd70c06cc40 legacy=0x7fd70c14cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:29.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.829+0000 7fd70a7fc700 1 -- 172.21.15.3:0/2413418249 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd70c14e860 con 0x7fd70c06be60 2023-10-08T15:37:29.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.829+0000 7fd70a7fc700 1 --2- 172.21.15.3:0/2413418249 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd70c06be60 0x7fd70c14b020 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd6f4009e60 tx=0x7fd6f4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16fa8104d46f33ab server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:29.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.829+0000 7fd709ffb700 1 -- 172.21.15.3:0/2413418249 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f400e070 con 0x7fd70c06be60 2023-10-08T15:37:29.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.829+0000 7fd709ffb700 1 -- 172.21.15.3:0/2413418249 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f400bc30 con 0x7fd70c06be60 2023-10-08T15:37:29.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.829+0000 7fd709ffb700 1 -- 172.21.15.3:0/2413418249 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f4012430 con 0x7fd70c06be60 2023-10-08T15:37:29.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.833+0000 7fd70bfff700 1 -- 172.21.15.3:0/2413418249 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd70c06be60 msgr2=0x7fd70c14b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:29.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.833+0000 7fd70bfff700 1 --2- 172.21.15.3:0/2413418249 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd70c06be60 0x7fd70c14b020 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd6f4009e60 tx=0x7fd6f4009780 comp rx=0 tx=0).stop 2023-10-08T15:37:29.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.833+0000 7fd70bfff700 1 -- 172.21.15.3:0/2413418249 shutdown_connections 2023-10-08T15:37:29.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.833+0000 7fd70bfff700 1 --2- 172.21.15.3:0/2413418249 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd70c06be60 0x7fd70c14b020 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:29.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.833+0000 7fd70bfff700 1 -- 172.21.15.3:0/2413418249 >> 172.21.15.3:0/2413418249 conn(0x7fd70c0c1df0 msgr2=0x7fd70c0c21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:29.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.833+0000 7fd70bfff700 1 -- 172.21.15.3:0/2413418249 shutdown_connections 2023-10-08T15:37:29.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.833+0000 7fd70bfff700 1 -- 172.21.15.3:0/2413418249 wait complete. 2023-10-08T15:37:29.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.833+0000 7fd70bfff700 1 Processor -- start 2023-10-08T15:37:29.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.833+0000 7fd70bfff700 1 -- start start 2023-10-08T15:37:29.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.833+0000 7fd70bfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd70c06be60 0x7fd70c146220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:29.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.833+0000 7fd70bfff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd70c06cc40 0x7fd70c0a13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:29.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.833+0000 7fd70bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd70c14ac50 0x7fd70c0a1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:29.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.833+0000 7fd70bfff700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c146eb0 con 0x7fd70c06be60 2023-10-08T15:37:29.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.833+0000 7fd70bfff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c0a1e70 con 0x7fd70c14ac50 2023-10-08T15:37:29.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.833+0000 7fd70bfff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c14fc80 con 0x7fd70c06cc40 2023-10-08T15:37:29.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.833+0000 7fd70affd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd70c06be60 0x7fd70c146220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:29.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.833+0000 7fd70affd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd70c06be60 0x7fd70c146220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47638/0 (socket says 172.21.15.3:47638) 2023-10-08T15:37:29.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.837+0000 7fd70affd700 1 -- 172.21.15.3:0/2299879194 learned_addr learned my addr 172.21.15.3:0/2299879194 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:29.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.837+0000 7fd70b7fe700 1 --2- 172.21.15.3:0/2299879194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd70c14ac50 0x7fd70c0a1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:29.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.837+0000 7fd70a7fc700 1 --2- 172.21.15.3:0/2299879194 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd70c06cc40 0x7fd70c0a13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:29.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.837+0000 7fd70affd700 1 -- 172.21.15.3:0/2299879194 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd70c06cc40 msgr2=0x7fd70c0a13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:29.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.837+0000 7fd70affd700 1 --2- 172.21.15.3:0/2299879194 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd70c06cc40 0x7fd70c0a13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:29.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.837+0000 7fd70affd700 1 -- 172.21.15.3:0/2299879194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd70c14ac50 msgr2=0x7fd70c0a1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:29.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.837+0000 7fd70affd700 1 --2- 172.21.15.3:0/2299879194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd70c14ac50 0x7fd70c0a1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:29.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.837+0000 7fd70affd700 1 -- 172.21.15.3:0/2299879194 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f4009a20 con 0x7fd70c06be60 2023-10-08T15:37:29.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.837+0000 7fd70a7fc700 1 --2- 172.21.15.3:0/2299879194 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd70c06cc40 0x7fd70c0a13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:37:29.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.837+0000 7fd70affd700 1 --2- 172.21.15.3:0/2299879194 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd70c06be60 0x7fd70c146220 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc00c590 tx=0x7fd6fc007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:29.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.837+0000 7fd702ffd700 1 -- 172.21.15.3:0/2299879194 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc011590 con 0x7fd70c06be60 2023-10-08T15:37:29.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.837+0000 7fd702ffd700 1 -- 172.21.15.3:0/2299879194 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6fc011730 con 0x7fd70c06be60 2023-10-08T15:37:29.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.837+0000 7fd70bfff700 1 -- 172.21.15.3:0/2299879194 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd70c0c05a0 con 0x7fd70c06be60 2023-10-08T15:37:29.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.837+0000 7fd702ffd700 1 -- 172.21.15.3:0/2299879194 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc011af0 con 0x7fd70c06be60 2023-10-08T15:37:29.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.837+0000 7fd70bfff700 1 -- 172.21.15.3:0/2299879194 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd70c0c0230 con 0x7fd70c06be60 2023-10-08T15:37:29.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.837+0000 7fd70bfff700 1 -- 172.21.15.3:0/2299879194 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd70c05ecf0 con 0x7fd70c06be60 2023-10-08T15:37:29.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.837+0000 7fd702ffd700 1 -- 172.21.15.3:0/2299879194 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fd6fc012420 con 0x7fd70c06be60 2023-10-08T15:37:29.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.841+0000 7fd702ffd700 1 --2- 172.21.15.3:0/2299879194 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd6ec060550 0x7fd6ec062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:29.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.841+0000 7fd702ffd700 1 -- 172.21.15.3:0/2299879194 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd6fc07bb60 con 0x7fd70c06be60 2023-10-08T15:37:29.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.841+0000 7fd70a7fc700 1 --2- 172.21.15.3:0/2299879194 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd6ec060550 0x7fd6ec062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:29.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.841+0000 7fd70a7fc700 1 --2- 172.21.15.3:0/2299879194 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd6ec060550 0x7fd6ec062a00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd6f4009e60 tx=0x7fd6f4019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:29.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:29.845+0000 7fd702ffd700 1 -- 172.21.15.3:0/2299879194 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd6fc04c200 con 0x7fd70c06be60 2023-10-08T15:37:30.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.061+0000 7fd70bfff700 1 -- 172.21.15.3:0/2299879194 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fd70c06d0e0 con 0x7fd70c06be60 2023-10-08T15:37:30.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.065+0000 7fd702ffd700 1 -- 172.21.15.3:0/2299879194 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1087 (secure 0 0 0) 0x7fd6fc017450 con 0x7fd70c06be60 2023-10-08T15:37:30.070 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:37:30.070 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"7635972e-cd66-4a8f-a231-378db8b3847a","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":21,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":20,"num_osds":8,"num_up_osds":8,"osd_up_since":1696779437,"num_in_osds":8,"osd_in_since":1696779430,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":73},{"state_name":"active+clean","count":24}],"num_pgs":97,"num_pools":3,"num_objects":3,"data_bytes":590390,"bytes_used":2453614592,"bytes_avail":770640498688,"bytes_total":773094113280,"unknown_pgs_ratio":0.75257730484008789,"write_bytes_sec":226,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":4260}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-10-08T15:37:08.237183+0000","services":{}},"progress_events":{}} 2023-10-08T15:37:30.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.065+0000 7fd70bfff700 1 -- 172.21.15.3:0/2299879194 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd6ec060550 msgr2=0x7fd6ec062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:30.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.065+0000 7fd70bfff700 1 --2- 172.21.15.3:0/2299879194 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd6ec060550 0x7fd6ec062a00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd6f4009e60 tx=0x7fd6f4019000 comp rx=0 tx=0).stop 2023-10-08T15:37:30.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.065+0000 7fd70bfff700 1 -- 172.21.15.3:0/2299879194 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd70c06be60 msgr2=0x7fd70c146220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:30.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.065+0000 7fd70bfff700 1 --2- 172.21.15.3:0/2299879194 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd70c06be60 0x7fd70c146220 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc00c590 tx=0x7fd6fc007f30 comp rx=0 tx=0).stop 2023-10-08T15:37:30.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.065+0000 7fd70bfff700 1 -- 172.21.15.3:0/2299879194 shutdown_connections 2023-10-08T15:37:30.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.065+0000 7fd70bfff700 1 --2- 172.21.15.3:0/2299879194 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd6ec060550 0x7fd6ec062a00 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:30.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.065+0000 7fd70bfff700 1 --2- 172.21.15.3:0/2299879194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd70c14ac50 0x7fd70c0a1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:30.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.065+0000 7fd70bfff700 1 --2- 172.21.15.3:0/2299879194 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd70c06cc40 0x7fd70c0a13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:30.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.065+0000 7fd70bfff700 1 --2- 172.21.15.3:0/2299879194 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd70c06be60 0x7fd70c146220 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:30.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.065+0000 7fd70bfff700 1 -- 172.21.15.3:0/2299879194 >> 172.21.15.3:0/2299879194 conn(0x7fd70c0c1df0 msgr2=0x7fd70c1498b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:30.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.065+0000 7fd70bfff700 1 -- 172.21.15.3:0/2299879194 shutdown_connections 2023-10-08T15:37:30.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.065+0000 7fd70bfff700 1 -- 172.21.15.3:0/2299879194 wait complete. 2023-10-08T15:37:30.084 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-08T15:37:30.084 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T15:37:30.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.185+0000 7f104ffff700 1 Processor -- start 2023-10-08T15:37:30.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.185+0000 7f104ffff700 1 -- start start 2023-10-08T15:37:30.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.185+0000 7f104ffff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f105014ac50 0x7f105014b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:30.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.185+0000 7f104ffff700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f105014c6b0 con 0x7f105006cc40 2023-10-08T15:37:30.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.185+0000 7f104ffff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f105014c060 con 0x7f105006be60 2023-10-08T15:37:30.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.185+0000 7f104ffff700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f105014c340 con 0x7f105014ac50 2023-10-08T15:37:30.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.185+0000 7f104effd700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f105014ac50 0x7f105014b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:30.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.185+0000 7f104f7fe700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f105006cc40 0x7f105014cc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:53778/0 (socket says 172.21.15.3:53778) 2023-10-08T15:37:30.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.185+0000 7f104f7fe700 1 -- 172.21.15.3:0/991662415 learned_addr learned my addr 172.21.15.3:0/991662415 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:30.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.185+0000 7f104effd700 1 -- 172.21.15.3:0/991662415 >> v1:172.21.15.50:6789/0 conn(0x7f105006be60 legacy=0x7f105006c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:30.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.185+0000 7f104dffb700 1 -- 172.21.15.3:0/991662415 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2214019901 0 0) 0x7f105014c6b0 con 0x7f105006cc40 2023-10-08T15:37:30.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.185+0000 7f104effd700 1 -- 172.21.15.3:0/991662415 >> v1:172.21.15.3:6789/0 conn(0x7f105006cc40 legacy=0x7f105014cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:30.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.185+0000 7f104effd700 1 -- 172.21.15.3:0/991662415 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f105014e860 con 0x7f105014ac50 2023-10-08T15:37:30.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.185+0000 7f104effd700 1 --2- 172.21.15.3:0/991662415 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f105014ac50 0x7f105014b020 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f10400098e0 tx=0x7f10400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f49075ff1e2765b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:30.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.185+0000 7f104dffb700 1 -- 172.21.15.3:0/991662415 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1040009e80 con 0x7f105014ac50 2023-10-08T15:37:30.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.185+0000 7f104dffb700 1 -- 172.21.15.3:0/991662415 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f104000b860 con 0x7f105014ac50 2023-10-08T15:37:30.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.185+0000 7f104dffb700 1 -- 172.21.15.3:0/991662415 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104000bbe0 con 0x7f105014ac50 2023-10-08T15:37:30.194 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.185+0000 7f104ffff700 1 -- 172.21.15.3:0/991662415 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f105014ac50 msgr2=0x7f105014b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:30.194 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.185+0000 7f104ffff700 1 --2- 172.21.15.3:0/991662415 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f105014ac50 0x7f105014b020 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f10400098e0 tx=0x7f10400091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:30.194 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.185+0000 7f104ffff700 1 -- 172.21.15.3:0/991662415 shutdown_connections 2023-10-08T15:37:30.194 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.185+0000 7f104ffff700 1 --2- 172.21.15.3:0/991662415 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f105014ac50 0x7f105014b020 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:30.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.185+0000 7f104ffff700 1 -- 172.21.15.3:0/991662415 >> 172.21.15.3:0/991662415 conn(0x7f10500c1df0 msgr2=0x7f10500c21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:30.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.185+0000 7f104ffff700 1 -- 172.21.15.3:0/991662415 shutdown_connections 2023-10-08T15:37:30.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.185+0000 7f104ffff700 1 -- 172.21.15.3:0/991662415 wait complete. 2023-10-08T15:37:30.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.189+0000 7f104ffff700 1 Processor -- start 2023-10-08T15:37:30.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.189+0000 7f104ffff700 1 -- start start 2023-10-08T15:37:30.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.189+0000 7f104ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f105006be60 0x7f1050150c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:30.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.189+0000 7f104ffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f105006cc40 0x7f105015e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:30.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.189+0000 7f104ffff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f105014ac50 0x7f105015eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:30.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.189+0000 7f104ffff700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f105009bf90 con 0x7f105006cc40 2023-10-08T15:37:30.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.189+0000 7f104ffff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10501512e0 con 0x7f105006be60 2023-10-08T15:37:30.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.189+0000 7f104ffff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f105015f090 con 0x7f105014ac50 2023-10-08T15:37:30.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.189+0000 7f104e7fc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f105006cc40 0x7f105015e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:30.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.189+0000 7f104e7fc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f105006cc40 0x7f105015e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47652/0 (socket says 172.21.15.3:47652) 2023-10-08T15:37:30.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.189+0000 7f104e7fc700 1 -- 172.21.15.3:0/1615472166 learned_addr learned my addr 172.21.15.3:0/1615472166 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:30.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.189+0000 7f104effd700 1 --2- 172.21.15.3:0/1615472166 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f105006be60 0x7f1050150c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:30.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.189+0000 7f104f7fe700 1 --2- 172.21.15.3:0/1615472166 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f105014ac50 0x7f105015eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:30.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.189+0000 7f104e7fc700 1 -- 172.21.15.3:0/1615472166 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f105014ac50 msgr2=0x7f105015eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:30.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.189+0000 7f104e7fc700 1 --2- 172.21.15.3:0/1615472166 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f105014ac50 0x7f105015eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:30.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.189+0000 7f104e7fc700 1 -- 172.21.15.3:0/1615472166 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f105006be60 msgr2=0x7f1050150c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:30.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.189+0000 7f104e7fc700 1 --2- 172.21.15.3:0/1615472166 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f105006be60 0x7f1050150c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:30.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.189+0000 7f104e7fc700 1 -- 172.21.15.3:0/1615472166 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1040009420 con 0x7f105006cc40 2023-10-08T15:37:30.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.189+0000 7f104f7fe700 1 --2- 172.21.15.3:0/1615472166 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f105014ac50 0x7f105015eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:37:30.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.189+0000 7f104e7fc700 1 --2- 172.21.15.3:0/1615472166 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f105006cc40 0x7f105015e610 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f104400c590 tx=0x7f104400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:30.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.189+0000 7f1036ffd700 1 -- 172.21.15.3:0/1615472166 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1044011590 con 0x7f105006cc40 2023-10-08T15:37:30.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.189+0000 7f1036ffd700 1 -- 172.21.15.3:0/1615472166 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10440116f0 con 0x7f105006cc40 2023-10-08T15:37:30.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.189+0000 7f104ffff700 1 -- 172.21.15.3:0/1615472166 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f105009b880 con 0x7f105006cc40 2023-10-08T15:37:30.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.189+0000 7f1036ffd700 1 -- 172.21.15.3:0/1615472166 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1044011ab0 con 0x7f105006cc40 2023-10-08T15:37:30.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.189+0000 7f104ffff700 1 -- 172.21.15.3:0/1615472166 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f105015c2e0 con 0x7f105006cc40 2023-10-08T15:37:30.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.193+0000 7f104ffff700 1 -- 172.21.15.3:0/1615472166 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f105009b370 con 0x7f105006cc40 2023-10-08T15:37:30.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.193+0000 7f1036ffd700 1 -- 172.21.15.3:0/1615472166 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f104401c440 con 0x7f105006cc40 2023-10-08T15:37:30.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.193+0000 7f1036ffd700 1 --2- 172.21.15.3:0/1615472166 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f103c060550 0x7f103c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:30.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.193+0000 7f1036ffd700 1 -- 172.21.15.3:0/1615472166 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f104407be00 con 0x7f105006cc40 2023-10-08T15:37:30.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.193+0000 7f104effd700 1 --2- 172.21.15.3:0/1615472166 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f103c060550 0x7f103c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:30.201 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.193+0000 7f104effd700 1 --2- 172.21.15.3:0/1615472166 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f103c060550 0x7f103c062a00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f10400093f0 tx=0x7f1040017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:30.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.197+0000 7f1036ffd700 1 -- 172.21.15.3:0/1615472166 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f105009b370 con 0x7f105006cc40 2023-10-08T15:37:30.360 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.353+0000 7f104ffff700 1 -- 172.21.15.3:0/1615472166 --> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f105009b370 con 0x7f103c060550 2023-10-08T15:37:30.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.365+0000 7f1036ffd700 1 -- 172.21.15.3:0/1615472166 <== mgr.4102 v2:172.21.15.50:6832/33268 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+253394 (secure 0 0 0) 0x7f105009b370 con 0x7f103c060550 2023-10-08T15:37:30.378 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:37:30.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.373+0000 7f104ffff700 1 -- 172.21.15.3:0/1615472166 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f103c060550 msgr2=0x7f103c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:30.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.373+0000 7f104ffff700 1 --2- 172.21.15.3:0/1615472166 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f103c060550 0x7f103c062a00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f10400093f0 tx=0x7f1040017000 comp rx=0 tx=0).stop 2023-10-08T15:37:30.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.373+0000 7f104ffff700 1 -- 172.21.15.3:0/1615472166 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f105006cc40 msgr2=0x7f105015e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:30.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.373+0000 7f104ffff700 1 --2- 172.21.15.3:0/1615472166 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f105006cc40 0x7f105015e610 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f104400c590 tx=0x7f104400c950 comp rx=0 tx=0).stop 2023-10-08T15:37:30.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.373+0000 7f104ffff700 1 -- 172.21.15.3:0/1615472166 shutdown_connections 2023-10-08T15:37:30.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.373+0000 7f104ffff700 1 --2- 172.21.15.3:0/1615472166 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f103c060550 0x7f103c062a00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:30.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.373+0000 7f104ffff700 1 --2- 172.21.15.3:0/1615472166 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f105014ac50 0x7f105015eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:30.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.373+0000 7f104ffff700 1 --2- 172.21.15.3:0/1615472166 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f105006cc40 0x7f105015e610 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:30.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.373+0000 7f104ffff700 1 --2- 172.21.15.3:0/1615472166 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f105006be60 0x7f1050150c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:30.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.373+0000 7f104ffff700 1 -- 172.21.15.3:0/1615472166 >> 172.21.15.3:0/1615472166 conn(0x7f10500c1df0 msgr2=0x7f105006c510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:30.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.373+0000 7f104ffff700 1 -- 172.21.15.3:0/1615472166 shutdown_connections 2023-10-08T15:37:30.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:30.373+0000 7f104ffff700 1 -- 172.21.15.3:0/1615472166 wait complete. 2023-10-08T15:37:30.381 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2023-10-08T15:37:30.391 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2023-10-08T15:37:28.508200+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590390,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":160,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":48,"acting":48,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":19,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":2396108,"kb_used_data":1400,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752578612,"statfs":{"total":773094113280,"available":770640498688,"internally_reserved":0,"allocated":1433600,"data_stored":1574590,"data_compressed":66282,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.511369"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.049673+0000","last_change":"2023-10-08T15:37:26.049673+0000","last_active":"2023-10-08T15:37:26.049673+0000","last_peered":"2023-10-08T15:37:26.049673+0000","last_clean":"2023-10-08T15:37:26.049673+0000","last_became_active":"2023-10-08T15:37:26.048595+0000","last_became_peered":"2023-10-08T15:37:26.048595+0000","last_unstale":"2023-10-08T15:37:26.049673+0000","last_undegraded":"2023-10-08T15:37:26.049673+0000","last_fullsized":"2023-10-08T15:37:26.049673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:05:25.732352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.046262+0000","last_change":"2023-10-08T15:37:26.046262+0000","last_active":"2023-10-08T15:37:26.046262+0000","last_peered":"2023-10-08T15:37:26.046262+0000","last_clean":"2023-10-08T15:37:26.046262+0000","last_became_active":"2023-10-08T15:37:26.045955+0000","last_became_peered":"2023-10-08T15:37:26.045955+0000","last_unstale":"2023-10-08T15:37:26.046262+0000","last_undegraded":"2023-10-08T15:37:26.046262+0000","last_fullsized":"2023-10-08T15:37:26.046262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:14:44.577836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.056900+0000","last_change":"2023-10-08T15:37:26.039886+0000","last_active":"2023-10-08T15:37:26.056900+0000","last_peered":"2023-10-08T15:37:26.056900+0000","last_clean":"2023-10-08T15:37:26.056900+0000","last_became_active":"2023-10-08T15:37:26.039551+0000","last_became_peered":"2023-10-08T15:37:26.039551+0000","last_unstale":"2023-10-08T15:37:26.056900+0000","last_undegraded":"2023-10-08T15:37:26.056900+0000","last_fullsized":"2023-10-08T15:37:26.056900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:18:49.734343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.050368+0000","last_change":"2023-10-08T15:37:26.050368+0000","last_active":"2023-10-08T15:37:26.050368+0000","last_peered":"2023-10-08T15:37:26.050368+0000","last_clean":"2023-10-08T15:37:26.050368+0000","last_became_active":"2023-10-08T15:37:26.050078+0000","last_became_peered":"2023-10-08T15:37:26.050078+0000","last_unstale":"2023-10-08T15:37:26.050368+0000","last_undegraded":"2023-10-08T15:37:26.050368+0000","last_fullsized":"2023-10-08T15:37:26.050368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:56:34.490787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.045671+0000","last_change":"2023-10-08T15:37:26.045671+0000","last_active":"2023-10-08T15:37:26.045671+0000","last_peered":"2023-10-08T15:37:26.045671+0000","last_clean":"2023-10-08T15:37:26.045671+0000","last_became_active":"2023-10-08T15:37:26.045356+0000","last_became_peered":"2023-10-08T15:37:26.045356+0000","last_unstale":"2023-10-08T15:37:26.045671+0000","last_undegraded":"2023-10-08T15:37:26.045671+0000","last_fullsized":"2023-10-08T15:37:26.045671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:47:37.094485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.045121+0000","last_change":"2023-10-08T15:37:26.045121+0000","last_active":"2023-10-08T15:37:26.045121+0000","last_peered":"2023-10-08T15:37:26.045121+0000","last_clean":"2023-10-08T15:37:26.045121+0000","last_became_active":"2023-10-08T15:37:26.044638+0000","last_became_peered":"2023-10-08T15:37:26.044638+0000","last_unstale":"2023-10-08T15:37:26.045121+0000","last_undegraded":"2023-10-08T15:37:26.045121+0000","last_fullsized":"2023-10-08T15:37:26.045121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:45:12.654892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.035585+0000","last_change":"2023-10-08T15:37:26.035585+0000","last_active":"2023-10-08T15:37:26.035585+0000","last_peered":"2023-10-08T15:37:26.035585+0000","last_clean":"2023-10-08T15:37:26.035585+0000","last_became_active":"2023-10-08T15:37:26.035286+0000","last_became_peered":"2023-10-08T15:37:26.035286+0000","last_unstale":"2023-10-08T15:37:26.035585+0000","last_undegraded":"2023-10-08T15:37:26.035585+0000","last_fullsized":"2023-10-08T15:37:26.035585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:15:33.124525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.035125+0000","last_change":"2023-10-08T15:37:26.035125+0000","last_active":"2023-10-08T15:37:26.035125+0000","last_peered":"2023-10-08T15:37:26.035125+0000","last_clean":"2023-10-08T15:37:26.035125+0000","last_became_active":"2023-10-08T15:37:26.034739+0000","last_became_peered":"2023-10-08T15:37:26.034739+0000","last_unstale":"2023-10-08T15:37:26.035125+0000","last_undegraded":"2023-10-08T15:37:26.035125+0000","last_fullsized":"2023-10-08T15:37:26.035125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:38:43.660811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.047730+0000","last_change":"2023-10-08T15:37:26.029621+0000","last_active":"2023-10-08T15:37:26.047730+0000","last_peered":"2023-10-08T15:37:26.047730+0000","last_clean":"2023-10-08T15:37:26.047730+0000","last_became_active":"2023-10-08T15:37:26.029280+0000","last_became_peered":"2023-10-08T15:37:26.029280+0000","last_unstale":"2023-10-08T15:37:26.047730+0000","last_undegraded":"2023-10-08T15:37:26.047730+0000","last_fullsized":"2023-10-08T15:37:26.047730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:52:17.141125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:37:25.042804+0000","last_change":"2023-10-08T15:37:25.041282+0000","last_active":"2023-10-08T15:37:25.042804+0000","last_peered":"2023-10-08T15:37:25.042804+0000","last_clean":"2023-10-08T15:37:25.042804+0000","last_became_active":"2023-10-08T15:37:25.040931+0000","last_became_peered":"2023-10-08T15:37:25.040931+0000","last_unstale":"2023-10-08T15:37:25.042804+0000","last_undegraded":"2023-10-08T15:37:25.042804+0000","last_fullsized":"2023-10-08T15:37:25.042804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:17:10.911391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.050389+0000","last_change":"2023-10-08T15:37:26.050389+0000","last_active":"2023-10-08T15:37:26.050389+0000","last_peered":"2023-10-08T15:37:26.050389+0000","last_clean":"2023-10-08T15:37:26.050389+0000","last_became_active":"2023-10-08T15:37:26.050059+0000","last_became_peered":"2023-10-08T15:37:26.050059+0000","last_unstale":"2023-10-08T15:37:26.050389+0000","last_undegraded":"2023-10-08T15:37:26.050389+0000","last_fullsized":"2023-10-08T15:37:26.050389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:37:10.263562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:37:25.042053+0000","last_change":"2023-10-08T15:37:25.037788+0000","last_active":"2023-10-08T15:37:25.042053+0000","last_peered":"2023-10-08T15:37:25.042053+0000","last_clean":"2023-10-08T15:37:25.042053+0000","last_became_active":"2023-10-08T15:37:25.037390+0000","last_became_peered":"2023-10-08T15:37:25.037390+0000","last_unstale":"2023-10-08T15:37:25.042053+0000","last_undegraded":"2023-10-08T15:37:25.042053+0000","last_fullsized":"2023-10-08T15:37:25.042053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:33:24.209108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.056434+0000","last_change":"2023-10-08T15:37:26.030498+0000","last_active":"2023-10-08T15:37:26.056434+0000","last_peered":"2023-10-08T15:37:26.056434+0000","last_clean":"2023-10-08T15:37:26.056434+0000","last_became_active":"2023-10-08T15:37:26.029947+0000","last_became_peered":"2023-10-08T15:37:26.029947+0000","last_unstale":"2023-10-08T15:37:26.056434+0000","last_undegraded":"2023-10-08T15:37:26.056434+0000","last_fullsized":"2023-10-08T15:37:26.056434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:21:26.142526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:37:25.042769+0000","last_change":"2023-10-08T15:37:25.040580+0000","last_active":"2023-10-08T15:37:25.042769+0000","last_peered":"2023-10-08T15:37:25.042769+0000","last_clean":"2023-10-08T15:37:25.042769+0000","last_became_active":"2023-10-08T15:37:25.039401+0000","last_became_peered":"2023-10-08T15:37:25.039401+0000","last_unstale":"2023-10-08T15:37:25.042769+0000","last_undegraded":"2023-10-08T15:37:25.042769+0000","last_fullsized":"2023-10-08T15:37:25.042769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:12:32.395357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.047479+0000","last_change":"2023-10-08T15:37:25.035792+0000","last_active":"2023-10-08T15:37:26.047479+0000","last_peered":"2023-10-08T15:37:26.047479+0000","last_clean":"2023-10-08T15:37:26.047479+0000","last_became_active":"2023-10-08T15:37:25.035413+0000","last_became_peered":"2023-10-08T15:37:25.035413+0000","last_unstale":"2023-10-08T15:37:26.047479+0000","last_undegraded":"2023-10-08T15:37:26.047479+0000","last_fullsized":"2023-10-08T15:37:26.047479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:08:13.115248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.035368+0000","last_change":"2023-10-08T15:37:26.035368+0000","last_active":"2023-10-08T15:37:26.035368+0000","last_peered":"2023-10-08T15:37:26.035368+0000","last_clean":"2023-10-08T15:37:26.035368+0000","last_became_active":"2023-10-08T15:37:26.034994+0000","last_became_peered":"2023-10-08T15:37:26.034994+0000","last_unstale":"2023-10-08T15:37:26.035368+0000","last_undegraded":"2023-10-08T15:37:26.035368+0000","last_fullsized":"2023-10-08T15:37:26.035368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:21:41.320706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":159,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-08T15:37:21.095074+0000","last_change":"2023-10-08T15:37:19.380955+0000","last_active":"2023-10-08T15:37:21.095074+0000","last_peered":"2023-10-08T15:37:21.095074+0000","last_clean":"2023-10-08T15:37:21.095074+0000","last_became_active":"2023-10-08T15:37:19.378277+0000","last_became_peered":"2023-10-08T15:37:19.378277+0000","last_unstale":"2023-10-08T15:37:21.095074+0000","last_undegraded":"2023-10-08T15:37:21.095074+0000","last_fullsized":"2023-10-08T15:37:21.095074+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:17.537726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:17.537726+0000","last_clean_scrub_stamp":"2023-10-08T15:37:17.537726+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:06:26.612046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:37:25.040973+0000","last_change":"2023-10-08T15:37:25.033028+0000","last_active":"2023-10-08T15:37:25.040973+0000","last_peered":"2023-10-08T15:37:25.040973+0000","last_clean":"2023-10-08T15:37:25.040973+0000","last_became_active":"2023-10-08T15:37:25.032661+0000","last_became_peered":"2023-10-08T15:37:25.032661+0000","last_unstale":"2023-10-08T15:37:25.040973+0000","last_undegraded":"2023-10-08T15:37:25.040973+0000","last_fullsized":"2023-10-08T15:37:25.040973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:18:48.729702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:37:25.042151+0000","last_change":"2023-10-08T15:37:25.037867+0000","last_active":"2023-10-08T15:37:25.042151+0000","last_peered":"2023-10-08T15:37:25.042151+0000","last_clean":"2023-10-08T15:37:25.042151+0000","last_became_active":"2023-10-08T15:37:25.037638+0000","last_became_peered":"2023-10-08T15:37:25.037638+0000","last_unstale":"2023-10-08T15:37:25.042151+0000","last_undegraded":"2023-10-08T15:37:25.042151+0000","last_fullsized":"2023-10-08T15:37:25.042151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:52:16.136483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.057054+0000","last_change":"2023-10-08T15:37:26.046686+0000","last_active":"2023-10-08T15:37:26.057054+0000","last_peered":"2023-10-08T15:37:26.057054+0000","last_clean":"2023-10-08T15:37:26.057054+0000","last_became_active":"2023-10-08T15:37:26.046295+0000","last_became_peered":"2023-10-08T15:37:26.046295+0000","last_unstale":"2023-10-08T15:37:26.057054+0000","last_undegraded":"2023-10-08T15:37:26.057054+0000","last_fullsized":"2023-10-08T15:37:26.057054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:27:46.266100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.049468+0000","last_change":"2023-10-08T15:37:26.049468+0000","last_active":"2023-10-08T15:37:26.049468+0000","last_peered":"2023-10-08T15:37:26.049468+0000","last_clean":"2023-10-08T15:37:26.049468+0000","last_became_active":"2023-10-08T15:37:26.048647+0000","last_became_peered":"2023-10-08T15:37:26.048647+0000","last_unstale":"2023-10-08T15:37:26.049468+0000","last_undegraded":"2023-10-08T15:37:26.049468+0000","last_fullsized":"2023-10-08T15:37:26.049468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:07:54.534413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.057284+0000","last_change":"2023-10-08T15:37:26.039472+0000","last_active":"2023-10-08T15:37:26.057284+0000","last_peered":"2023-10-08T15:37:26.057284+0000","last_clean":"2023-10-08T15:37:26.057284+0000","last_became_active":"2023-10-08T15:37:26.038579+0000","last_became_peered":"2023-10-08T15:37:26.038579+0000","last_unstale":"2023-10-08T15:37:26.057284+0000","last_undegraded":"2023-10-08T15:37:26.057284+0000","last_fullsized":"2023-10-08T15:37:26.057284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:33:25.213750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.057363+0000","last_change":"2023-10-08T15:37:26.057363+0000","last_active":"2023-10-08T15:37:26.057363+0000","last_peered":"2023-10-08T15:37:26.057363+0000","last_clean":"2023-10-08T15:37:26.057363+0000","last_became_active":"2023-10-08T15:37:26.057058+0000","last_became_peered":"2023-10-08T15:37:26.057058+0000","last_unstale":"2023-10-08T15:37:26.057363+0000","last_undegraded":"2023-10-08T15:37:26.057363+0000","last_fullsized":"2023-10-08T15:37:26.057363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:20:26.216438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.057526+0000","last_change":"2023-10-08T15:37:26.057526+0000","last_active":"2023-10-08T15:37:26.057526+0000","last_peered":"2023-10-08T15:37:26.057526+0000","last_clean":"2023-10-08T15:37:26.057526+0000","last_became_active":"2023-10-08T15:37:26.057220+0000","last_became_peered":"2023-10-08T15:37:26.057220+0000","last_unstale":"2023-10-08T15:37:26.057526+0000","last_undegraded":"2023-10-08T15:37:26.057526+0000","last_fullsized":"2023-10-08T15:37:26.057526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:48.862001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:24.993513+0000","last_change":"2023-10-08T15:37:24.993513+0000","last_active":"2023-10-08T15:37:24.993513+0000","last_peered":"2023-10-08T15:37:24.993513+0000","last_clean":"2023-10-08T15:37:24.993513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:24.993513+0000","last_undegraded":"2023-10-08T15:37:24.993513+0000","last_fullsized":"2023-10-08T15:37:24.993513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:37:23.988871+0000","last_change":"2023-10-08T15:37:23.988871+0000","last_active":"2023-10-08T15:37:23.988871+0000","last_peered":"2023-10-08T15:37:23.988871+0000","last_clean":"2023-10-08T15:37:23.988871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:37:23.988871+0000","last_undegraded":"2023-10-08T15:37:23.988871+0000","last_fullsized":"2023-10-08T15:37:23.988871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":34,"acting":34,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":12,"acting":12,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66282,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542146,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301608,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070232,"statfs":{"total":96636764160,"available":96327917568,"internally_reserved":0,"allocated":217088,"data_stored":634865,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2170000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.024}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3680000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4510000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.575}]}]},{"osd":6,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":301532,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070308,"statfs":{"total":96636764160,"available":96327995392,"internally_reserved":0,"allocated":151552,"data_stored":44497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.129}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3049999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297436,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074404,"statfs":{"total":96636764160,"available":96332189696,"internally_reserved":0,"allocated":151552,"data_stored":44497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1319999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297436,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074404,"statfs":{"total":96636764160,"available":96332189696,"internally_reserved":0,"allocated":151552,"data_stored":44497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.143}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2470000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.72}]}]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297436,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074404,"statfs":{"total":96636764160,"available":96332189696,"internally_reserved":0,"allocated":151552,"data_stored":44497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.399}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0009999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.581}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.819}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3940000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542148,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":217088,"data_stored":634865,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.514}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7549999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6519999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.214}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.532}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9199999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301572,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070268,"statfs":{"total":96636764160,"available":96327954432,"internally_reserved":0,"allocated":192512,"data_stored":63418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0249999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.206}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2609999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.458}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.597}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3819999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301580,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070260,"statfs":{"total":96636764160,"available":96327946240,"internally_reserved":0,"allocated":200704,"data_stored":63454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1180000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T15:37:33.398 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T15:37:33.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.509+0000 7f1f46052700 1 Processor -- start 2023-10-08T15:37:33.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.509+0000 7f1f46052700 1 -- start start 2023-10-08T15:37:33.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.509+0000 7f1f46052700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1f4014efa0 0x7f1f400a1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:33.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.509+0000 7f1f46052700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f4014fcc0 con 0x7f1f4006bfe0 2023-10-08T15:37:33.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.509+0000 7f1f46052700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f4014f9e0 con 0x7f1f400a75f0 2023-10-08T15:37:33.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.509+0000 7f1f46052700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f4006c400 con 0x7f1f4014efa0 2023-10-08T15:37:33.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.509+0000 7f1f3ffff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f1f4006bfe0 0x7f1f4006c810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:53794/0 (socket says 172.21.15.3:53794) 2023-10-08T15:37:33.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.509+0000 7f1f3ffff700 1 -- 172.21.15.3:0/242654984 learned_addr learned my addr 172.21.15.3:0/242654984 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:33.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.509+0000 7f1f3f7fe700 1 --2- 172.21.15.3:0/242654984 >> v2:172.21.15.50:3300/0 conn(0x7f1f4014efa0 0x7f1f400a1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:33.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.509+0000 7f1f3effd700 1 -- 172.21.15.3:0/242654984 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1743028281 0 0) 0x7f1f4014fcc0 con 0x7f1f4006bfe0 2023-10-08T15:37:33.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.509+0000 7f1f3effd700 1 -- 172.21.15.3:0/242654984 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f20003570 con 0x7f1f4006bfe0 2023-10-08T15:37:33.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.509+0000 7f1f3f7fe700 1 -- 172.21.15.3:0/242654984 >> v1:172.21.15.50:6789/0 conn(0x7f1f400a75f0 legacy=0x7f1f40068480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:33.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.509+0000 7f1f3effd700 1 -- 172.21.15.3:0/242654984 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1010414184 0 0) 0x7f1f20003570 con 0x7f1f4006bfe0 2023-10-08T15:37:33.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.509+0000 7f1f3f7fe700 1 -- 172.21.15.3:0/242654984 >> v1:172.21.15.3:6789/0 conn(0x7f1f4006bfe0 legacy=0x7f1f4006c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:33.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.509+0000 7f1f3f7fe700 1 -- 172.21.15.3:0/242654984 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f40068b90 con 0x7f1f4014efa0 2023-10-08T15:37:33.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.509+0000 7f1f3f7fe700 1 --2- 172.21.15.3:0/242654984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f4014efa0 0x7f1f400a1570 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1f300098e0 tx=0x7f1f300091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1956598e82caadb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:33.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.509+0000 7f1f3effd700 1 -- 172.21.15.3:0/242654984 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f380017f0 con 0x7f1f4014efa0 2023-10-08T15:37:33.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.509+0000 7f1f3effd700 1 -- 172.21.15.3:0/242654984 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f30011420 con 0x7f1f4014efa0 2023-10-08T15:37:33.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.509+0000 7f1f3effd700 1 -- 172.21.15.3:0/242654984 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f300117c0 con 0x7f1f4014efa0 2023-10-08T15:37:33.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.513+0000 7f1f46052700 1 -- 172.21.15.3:0/242654984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f4014efa0 msgr2=0x7f1f400a1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:33.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.513+0000 7f1f46052700 1 --2- 172.21.15.3:0/242654984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f4014efa0 0x7f1f400a1570 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1f300098e0 tx=0x7f1f300091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:33.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.513+0000 7f1f46052700 1 -- 172.21.15.3:0/242654984 shutdown_connections 2023-10-08T15:37:33.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.513+0000 7f1f46052700 1 --2- 172.21.15.3:0/242654984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f4014efa0 0x7f1f400a1570 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:33.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.513+0000 7f1f46052700 1 -- 172.21.15.3:0/242654984 >> 172.21.15.3:0/242654984 conn(0x7f1f400c1f20 msgr2=0x7f1f400c2320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:33.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.513+0000 7f1f46052700 1 -- 172.21.15.3:0/242654984 shutdown_connections 2023-10-08T15:37:33.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.513+0000 7f1f46052700 1 -- 172.21.15.3:0/242654984 wait complete. 2023-10-08T15:37:33.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.513+0000 7f1f46052700 1 Processor -- start 2023-10-08T15:37:33.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.513+0000 7f1f46052700 1 -- start start 2023-10-08T15:37:33.523 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.517+0000 7f1f46052700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f4006bfe0 0x7f1f4009a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:33.523 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.517+0000 7f1f46052700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1f400a75f0 0x7f1f40147280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:33.523 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.517+0000 7f1f46052700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1f4014efa0 0x7f1f4015be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:33.524 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.517+0000 7f1f46052700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4015b4a0 con 0x7f1f400a75f0 2023-10-08T15:37:33.524 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.517+0000 7f1f46052700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4009aed0 con 0x7f1f4006bfe0 2023-10-08T15:37:33.524 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.517+0000 7f1f46052700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f40149490 con 0x7f1f4014efa0 2023-10-08T15:37:33.524 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.517+0000 7f1f37fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1f400a75f0 0x7f1f40147280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:33.524 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.517+0000 7f1f3f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f4006bfe0 0x7f1f4009a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:33.524 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.517+0000 7f1f37fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1f400a75f0 0x7f1f40147280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47658/0 (socket says 172.21.15.3:47658) 2023-10-08T15:37:33.524 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.517+0000 7f1f3f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f4006bfe0 0x7f1f4009a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.3:36790/0 (socket says 172.21.15.3:36790) 2023-10-08T15:37:33.524 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.517+0000 7f1f37fff700 1 -- 172.21.15.3:0/3413476858 learned_addr learned my addr 172.21.15.3:0/3413476858 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:33.524 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.517+0000 7f1f3ffff700 1 --2- 172.21.15.3:0/3413476858 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1f4014efa0 0x7f1f4015be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:33.524 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.517+0000 7f1f37fff700 1 -- 172.21.15.3:0/3413476858 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1f4014efa0 msgr2=0x7f1f4015be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:33.525 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.517+0000 7f1f37fff700 1 --2- 172.21.15.3:0/3413476858 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1f4014efa0 0x7f1f4015be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:33.525 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.517+0000 7f1f37fff700 1 -- 172.21.15.3:0/3413476858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f4006bfe0 msgr2=0x7f1f4009a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:33.525 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.517+0000 7f1f37fff700 1 --2- 172.21.15.3:0/3413476858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f4006bfe0 0x7f1f4009a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:33.525 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.517+0000 7f1f37fff700 1 -- 172.21.15.3:0/3413476858 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f30009420 con 0x7f1f400a75f0 2023-10-08T15:37:33.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.517+0000 7f1f37fff700 1 --2- 172.21.15.3:0/3413476858 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1f400a75f0 0x7f1f40147280 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1f2800c5c0 tx=0x7f1f2800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:33.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.517+0000 7f1f377fe700 1 -- 172.21.15.3:0/3413476858 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f28011590 con 0x7f1f400a75f0 2023-10-08T15:37:33.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.517+0000 7f1f377fe700 1 -- 172.21.15.3:0/3413476858 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f28011710 con 0x7f1f400a75f0 2023-10-08T15:37:33.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.517+0000 7f1f46052700 1 -- 172.21.15.3:0/3413476858 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f4015b9f0 con 0x7f1f400a75f0 2023-10-08T15:37:33.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.517+0000 7f1f377fe700 1 -- 172.21.15.3:0/3413476858 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f28011ad0 con 0x7f1f400a75f0 2023-10-08T15:37:33.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.517+0000 7f1f46052700 1 -- 172.21.15.3:0/3413476858 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f4009a560 con 0x7f1f400a75f0 2023-10-08T15:37:33.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.521+0000 7f1f46052700 1 -- 172.21.15.3:0/3413476858 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f40064530 con 0x7f1f400a75f0 2023-10-08T15:37:33.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.521+0000 7f1f377fe700 1 -- 172.21.15.3:0/3413476858 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f1f2801b3b0 con 0x7f1f400a75f0 2023-10-08T15:37:33.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.521+0000 7f1f377fe700 1 --2- 172.21.15.3:0/3413476858 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1f24060580 0x7f1f24062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:33.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.521+0000 7f1f377fe700 1 -- 172.21.15.3:0/3413476858 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1f2807bd10 con 0x7f1f400a75f0 2023-10-08T15:37:33.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.521+0000 7f1f3f7fe700 1 --2- 172.21.15.3:0/3413476858 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1f24060580 0x7f1f24062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:33.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.521+0000 7f1f3f7fe700 1 --2- 172.21.15.3:0/3413476858 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1f24060580 0x7f1f24062a30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1f300091e0 tx=0x7f1f30016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:33.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.529+0000 7f1f377fe700 1 -- 172.21.15.3:0/3413476858 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1f28081020 con 0x7f1f400a75f0 2023-10-08T15:37:33.689 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.681+0000 7f1f46052700 1 -- 172.21.15.3:0/3413476858 --> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1f4006d1b0 con 0x7f1f24060580 2023-10-08T15:37:33.703 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.701+0000 7f1f377fe700 1 -- 172.21.15.3:0/3413476858 <== mgr.4102 v2:172.21.15.50:6832/33268 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264617 (secure 0 0 0) 0x7f1f4006d1b0 con 0x7f1f24060580 2023-10-08T15:37:33.708 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:37:33.710 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.701+0000 7f1f46052700 1 -- 172.21.15.3:0/3413476858 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1f24060580 msgr2=0x7f1f24062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:33.710 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.701+0000 7f1f46052700 1 --2- 172.21.15.3:0/3413476858 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1f24060580 0x7f1f24062a30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1f300091e0 tx=0x7f1f30016000 comp rx=0 tx=0).stop 2023-10-08T15:37:33.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.701+0000 7f1f46052700 1 -- 172.21.15.3:0/3413476858 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1f400a75f0 msgr2=0x7f1f40147280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:33.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.701+0000 7f1f46052700 1 --2- 172.21.15.3:0/3413476858 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1f400a75f0 0x7f1f40147280 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1f2800c5c0 tx=0x7f1f2800c8d0 comp rx=0 tx=0).stop 2023-10-08T15:37:33.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.701+0000 7f1f46052700 1 -- 172.21.15.3:0/3413476858 shutdown_connections 2023-10-08T15:37:33.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.701+0000 7f1f46052700 1 --2- 172.21.15.3:0/3413476858 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1f24060580 0x7f1f24062a30 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:33.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.701+0000 7f1f46052700 1 --2- 172.21.15.3:0/3413476858 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1f4014efa0 0x7f1f4015be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:33.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.701+0000 7f1f46052700 1 --2- 172.21.15.3:0/3413476858 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1f400a75f0 0x7f1f40147280 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:33.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.701+0000 7f1f46052700 1 --2- 172.21.15.3:0/3413476858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f4006bfe0 0x7f1f4009a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:33.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.701+0000 7f1f46052700 1 -- 172.21.15.3:0/3413476858 >> 172.21.15.3:0/3413476858 conn(0x7f1f400c1f20 msgr2=0x7f1f400bfe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:33.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.701+0000 7f1f46052700 1 -- 172.21.15.3:0/3413476858 shutdown_connections 2023-10-08T15:37:33.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.701+0000 7f1f46052700 1 -- 172.21.15.3:0/3413476858 wait complete. 2023-10-08T15:37:33.712 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2023-10-08T15:37:33.723 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-10-08T15:37:32.509848+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":94,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2396436,"kb_used_data":1748,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752578284,"statfs":{"total":773094113280,"available":770640162816,"internally_reserved":0,"allocated":1789952,"data_stored":1735988,"data_compressed":66282,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.501504"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.053739+0000","last_change":"2023-10-08T15:37:26.047226+0000","last_active":"2023-10-08T15:37:26.053739+0000","last_peered":"2023-10-08T15:37:26.053739+0000","last_clean":"2023-10-08T15:37:26.053739+0000","last_became_active":"2023-10-08T15:37:26.046910+0000","last_became_peered":"2023-10-08T15:37:26.046910+0000","last_unstale":"2023-10-08T15:37:26.053739+0000","last_undegraded":"2023-10-08T15:37:26.053739+0000","last_fullsized":"2023-10-08T15:37:26.053739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:15:10.097776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.048869+0000","last_change":"2023-10-08T15:37:26.044911+0000","last_active":"2023-10-08T15:37:26.048869+0000","last_peered":"2023-10-08T15:37:26.048869+0000","last_clean":"2023-10-08T15:37:26.048869+0000","last_became_active":"2023-10-08T15:37:26.044586+0000","last_became_peered":"2023-10-08T15:37:26.044586+0000","last_unstale":"2023-10-08T15:37:26.048869+0000","last_undegraded":"2023-10-08T15:37:26.048869+0000","last_fullsized":"2023-10-08T15:37:26.048869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:56.482633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.046260+0000","last_change":"2023-10-08T15:37:26.040753+0000","last_active":"2023-10-08T15:37:26.046260+0000","last_peered":"2023-10-08T15:37:26.046260+0000","last_clean":"2023-10-08T15:37:26.046260+0000","last_became_active":"2023-10-08T15:37:26.040446+0000","last_became_peered":"2023-10-08T15:37:26.040446+0000","last_unstale":"2023-10-08T15:37:26.046260+0000","last_undegraded":"2023-10-08T15:37:26.046260+0000","last_fullsized":"2023-10-08T15:37:26.046260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:54:46.510693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.057269+0000","last_change":"2023-10-08T15:37:26.049673+0000","last_active":"2023-10-08T15:37:26.057269+0000","last_peered":"2023-10-08T15:37:26.057269+0000","last_clean":"2023-10-08T15:37:26.057269+0000","last_became_active":"2023-10-08T15:37:26.048595+0000","last_became_peered":"2023-10-08T15:37:26.048595+0000","last_unstale":"2023-10-08T15:37:26.057269+0000","last_undegraded":"2023-10-08T15:37:26.057269+0000","last_fullsized":"2023-10-08T15:37:26.057269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:05:25.732352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.041730+0000","last_change":"2023-10-08T15:37:26.033012+0000","last_active":"2023-10-08T15:37:26.041730+0000","last_peered":"2023-10-08T15:37:26.041730+0000","last_clean":"2023-10-08T15:37:26.041730+0000","last_became_active":"2023-10-08T15:37:26.032730+0000","last_became_peered":"2023-10-08T15:37:26.032730+0000","last_unstale":"2023-10-08T15:37:26.041730+0000","last_undegraded":"2023-10-08T15:37:26.041730+0000","last_fullsized":"2023-10-08T15:37:26.041730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:24:52.143093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.054406+0000","last_change":"2023-10-08T15:37:26.046262+0000","last_active":"2023-10-08T15:37:26.054406+0000","last_peered":"2023-10-08T15:37:26.054406+0000","last_clean":"2023-10-08T15:37:26.054406+0000","last_became_active":"2023-10-08T15:37:26.045955+0000","last_became_peered":"2023-10-08T15:37:26.045955+0000","last_unstale":"2023-10-08T15:37:26.054406+0000","last_undegraded":"2023-10-08T15:37:26.054406+0000","last_fullsized":"2023-10-08T15:37:26.054406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:14:44.577836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.049470+0000","last_change":"2023-10-08T15:37:26.042885+0000","last_active":"2023-10-08T15:37:26.049470+0000","last_peered":"2023-10-08T15:37:26.049470+0000","last_clean":"2023-10-08T15:37:26.049470+0000","last_became_active":"2023-10-08T15:37:26.042523+0000","last_became_peered":"2023-10-08T15:37:26.042523+0000","last_unstale":"2023-10-08T15:37:26.049470+0000","last_undegraded":"2023-10-08T15:37:26.049470+0000","last_fullsized":"2023-10-08T15:37:26.049470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:39:02.147413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.053032+0000","last_change":"2023-10-08T15:37:26.050106+0000","last_active":"2023-10-08T15:37:26.053032+0000","last_peered":"2023-10-08T15:37:26.053032+0000","last_clean":"2023-10-08T15:37:26.053032+0000","last_became_active":"2023-10-08T15:37:26.049801+0000","last_became_peered":"2023-10-08T15:37:26.049801+0000","last_unstale":"2023-10-08T15:37:26.053032+0000","last_undegraded":"2023-10-08T15:37:26.053032+0000","last_fullsized":"2023-10-08T15:37:26.053032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:48.862001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.041806+0000","last_change":"2023-10-08T15:37:26.034922+0000","last_active":"2023-10-08T15:37:26.041806+0000","last_peered":"2023-10-08T15:37:26.041806+0000","last_clean":"2023-10-08T15:37:26.041806+0000","last_became_active":"2023-10-08T15:37:26.034328+0000","last_became_peered":"2023-10-08T15:37:26.034328+0000","last_unstale":"2023-10-08T15:37:26.041806+0000","last_undegraded":"2023-10-08T15:37:26.041806+0000","last_fullsized":"2023-10-08T15:37:26.041806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:40:49.862643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.056035+0000","last_change":"2023-10-08T15:37:26.055002+0000","last_active":"2023-10-08T15:37:26.056035+0000","last_peered":"2023-10-08T15:37:26.056035+0000","last_clean":"2023-10-08T15:37:26.056035+0000","last_became_active":"2023-10-08T15:37:26.054672+0000","last_became_peered":"2023-10-08T15:37:26.054672+0000","last_unstale":"2023-10-08T15:37:26.056035+0000","last_undegraded":"2023-10-08T15:37:26.056035+0000","last_fullsized":"2023-10-08T15:37:26.056035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:56.482633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.056053+0000","last_change":"2023-10-08T15:37:26.055226+0000","last_active":"2023-10-08T15:37:26.056053+0000","last_peered":"2023-10-08T15:37:26.056053+0000","last_clean":"2023-10-08T15:37:26.056053+0000","last_became_active":"2023-10-08T15:37:26.054740+0000","last_became_peered":"2023-10-08T15:37:26.054740+0000","last_unstale":"2023-10-08T15:37:26.056053+0000","last_undegraded":"2023-10-08T15:37:26.056053+0000","last_fullsized":"2023-10-08T15:37:26.056053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:13:29.705445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.056900+0000","last_change":"2023-10-08T15:37:26.039886+0000","last_active":"2023-10-08T15:37:26.056900+0000","last_peered":"2023-10-08T15:37:26.056900+0000","last_clean":"2023-10-08T15:37:26.056900+0000","last_became_active":"2023-10-08T15:37:26.039551+0000","last_became_peered":"2023-10-08T15:37:26.039551+0000","last_unstale":"2023-10-08T15:37:26.056900+0000","last_undegraded":"2023-10-08T15:37:26.056900+0000","last_fullsized":"2023-10-08T15:37:26.056900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:18:49.734343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.039639+0000","last_change":"2023-10-08T15:37:26.036155+0000","last_active":"2023-10-08T15:37:26.039639+0000","last_peered":"2023-10-08T15:37:26.039639+0000","last_clean":"2023-10-08T15:37:26.039639+0000","last_became_active":"2023-10-08T15:37:26.035854+0000","last_became_peered":"2023-10-08T15:37:26.035854+0000","last_unstale":"2023-10-08T15:37:26.039639+0000","last_undegraded":"2023-10-08T15:37:26.039639+0000","last_fullsized":"2023-10-08T15:37:26.039639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:54:46.510693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.046268+0000","last_change":"2023-10-08T15:37:26.041053+0000","last_active":"2023-10-08T15:37:26.046268+0000","last_peered":"2023-10-08T15:37:26.046268+0000","last_clean":"2023-10-08T15:37:26.046268+0000","last_became_active":"2023-10-08T15:37:26.040408+0000","last_became_peered":"2023-10-08T15:37:26.040408+0000","last_unstale":"2023-10-08T15:37:26.046268+0000","last_undegraded":"2023-10-08T15:37:26.046268+0000","last_fullsized":"2023-10-08T15:37:26.046268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:20:49.172777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.036901+0000","last_change":"2023-10-08T15:37:26.032920+0000","last_active":"2023-10-08T15:37:26.036901+0000","last_peered":"2023-10-08T15:37:26.036901+0000","last_clean":"2023-10-08T15:37:26.036901+0000","last_became_active":"2023-10-08T15:37:26.032226+0000","last_became_peered":"2023-10-08T15:37:26.032226+0000","last_unstale":"2023-10-08T15:37:26.036901+0000","last_undegraded":"2023-10-08T15:37:26.036901+0000","last_fullsized":"2023-10-08T15:37:26.036901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:44:20.631125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.057085+0000","last_change":"2023-10-08T15:37:26.050368+0000","last_active":"2023-10-08T15:37:26.057085+0000","last_peered":"2023-10-08T15:37:26.057085+0000","last_clean":"2023-10-08T15:37:26.057085+0000","last_became_active":"2023-10-08T15:37:26.050078+0000","last_became_peered":"2023-10-08T15:37:26.050078+0000","last_unstale":"2023-10-08T15:37:26.057085+0000","last_undegraded":"2023-10-08T15:37:26.057085+0000","last_fullsized":"2023-10-08T15:37:26.057085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:56:34.490787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.054310+0000","last_change":"2023-10-08T15:37:26.045671+0000","last_active":"2023-10-08T15:37:26.054310+0000","last_peered":"2023-10-08T15:37:26.054310+0000","last_clean":"2023-10-08T15:37:26.054310+0000","last_became_active":"2023-10-08T15:37:26.045356+0000","last_became_peered":"2023-10-08T15:37:26.045356+0000","last_unstale":"2023-10-08T15:37:26.054310+0000","last_undegraded":"2023-10-08T15:37:26.054310+0000","last_fullsized":"2023-10-08T15:37:26.054310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:47:37.094485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.043896+0000","last_change":"2023-10-08T15:37:26.037867+0000","last_active":"2023-10-08T15:37:26.043896+0000","last_peered":"2023-10-08T15:37:26.043896+0000","last_clean":"2023-10-08T15:37:26.043896+0000","last_became_active":"2023-10-08T15:37:26.037579+0000","last_became_peered":"2023-10-08T15:37:26.037579+0000","last_unstale":"2023-10-08T15:37:26.043896+0000","last_undegraded":"2023-10-08T15:37:26.043896+0000","last_fullsized":"2023-10-08T15:37:26.043896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:07.193145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.043711+0000","last_change":"2023-10-08T15:37:26.038808+0000","last_active":"2023-10-08T15:37:26.043711+0000","last_peered":"2023-10-08T15:37:26.043711+0000","last_clean":"2023-10-08T15:37:26.043711+0000","last_became_active":"2023-10-08T15:37:26.038502+0000","last_became_peered":"2023-10-08T15:37:26.038502+0000","last_unstale":"2023-10-08T15:37:26.043711+0000","last_undegraded":"2023-10-08T15:37:26.043711+0000","last_fullsized":"2023-10-08T15:37:26.043711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:20:17.146211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.059517+0000","last_change":"2023-10-08T15:37:26.057588+0000","last_active":"2023-10-08T15:37:26.059517+0000","last_peered":"2023-10-08T15:37:26.059517+0000","last_clean":"2023-10-08T15:37:26.059517+0000","last_became_active":"2023-10-08T15:37:26.057292+0000","last_became_peered":"2023-10-08T15:37:26.057292+0000","last_unstale":"2023-10-08T15:37:26.059517+0000","last_undegraded":"2023-10-08T15:37:26.059517+0000","last_fullsized":"2023-10-08T15:37:26.059517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:38:52.246025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.049010+0000","last_change":"2023-10-08T15:37:26.044085+0000","last_active":"2023-10-08T15:37:26.049010+0000","last_peered":"2023-10-08T15:37:26.049010+0000","last_clean":"2023-10-08T15:37:26.049010+0000","last_became_active":"2023-10-08T15:37:26.043779+0000","last_became_peered":"2023-10-08T15:37:26.043779+0000","last_unstale":"2023-10-08T15:37:26.049010+0000","last_undegraded":"2023-10-08T15:37:26.049010+0000","last_fullsized":"2023-10-08T15:37:26.049010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:31:04.163648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.054276+0000","last_change":"2023-10-08T15:37:26.045121+0000","last_active":"2023-10-08T15:37:26.054276+0000","last_peered":"2023-10-08T15:37:26.054276+0000","last_clean":"2023-10-08T15:37:26.054276+0000","last_became_active":"2023-10-08T15:37:26.044638+0000","last_became_peered":"2023-10-08T15:37:26.044638+0000","last_unstale":"2023-10-08T15:37:26.054276+0000","last_undegraded":"2023-10-08T15:37:26.054276+0000","last_fullsized":"2023-10-08T15:37:26.054276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:45:12.654892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.061107+0000","last_change":"2023-10-08T15:37:26.056315+0000","last_active":"2023-10-08T15:37:26.061107+0000","last_peered":"2023-10-08T15:37:26.061107+0000","last_clean":"2023-10-08T15:37:26.061107+0000","last_became_active":"2023-10-08T15:37:26.056048+0000","last_became_peered":"2023-10-08T15:37:26.056048+0000","last_unstale":"2023-10-08T15:37:26.061107+0000","last_undegraded":"2023-10-08T15:37:26.061107+0000","last_fullsized":"2023-10-08T15:37:26.061107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:10:03.706049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.054064+0000","last_change":"2023-10-08T15:37:26.035585+0000","last_active":"2023-10-08T15:37:26.054064+0000","last_peered":"2023-10-08T15:37:26.054064+0000","last_clean":"2023-10-08T15:37:26.054064+0000","last_became_active":"2023-10-08T15:37:26.035286+0000","last_became_peered":"2023-10-08T15:37:26.035286+0000","last_unstale":"2023-10-08T15:37:26.054064+0000","last_undegraded":"2023-10-08T15:37:26.054064+0000","last_fullsized":"2023-10-08T15:37:26.054064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:15:33.124525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.060750+0000","last_change":"2023-10-08T15:37:26.056162+0000","last_active":"2023-10-08T15:37:26.060750+0000","last_peered":"2023-10-08T15:37:26.060750+0000","last_clean":"2023-10-08T15:37:26.060750+0000","last_became_active":"2023-10-08T15:37:26.055788+0000","last_became_peered":"2023-10-08T15:37:26.055788+0000","last_unstale":"2023-10-08T15:37:26.060750+0000","last_undegraded":"2023-10-08T15:37:26.060750+0000","last_fullsized":"2023-10-08T15:37:26.060750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:31:04.163648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.045525+0000","last_change":"2023-10-08T15:37:26.043352+0000","last_active":"2023-10-08T15:37:26.045525+0000","last_peered":"2023-10-08T15:37:26.045525+0000","last_clean":"2023-10-08T15:37:26.045525+0000","last_became_active":"2023-10-08T15:37:26.043051+0000","last_became_peered":"2023-10-08T15:37:26.043051+0000","last_unstale":"2023-10-08T15:37:26.045525+0000","last_undegraded":"2023-10-08T15:37:26.045525+0000","last_fullsized":"2023-10-08T15:37:26.045525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:10:14.668770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.037359+0000","last_change":"2023-10-08T15:37:26.034315+0000","last_active":"2023-10-08T15:37:26.037359+0000","last_peered":"2023-10-08T15:37:26.037359+0000","last_clean":"2023-10-08T15:37:26.037359+0000","last_became_active":"2023-10-08T15:37:26.032177+0000","last_became_peered":"2023-10-08T15:37:26.032177+0000","last_unstale":"2023-10-08T15:37:26.037359+0000","last_undegraded":"2023-10-08T15:37:26.037359+0000","last_fullsized":"2023-10-08T15:37:26.037359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:49:47.826663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.050562+0000","last_change":"2023-10-08T15:37:26.047383+0000","last_active":"2023-10-08T15:37:26.050562+0000","last_peered":"2023-10-08T15:37:26.050562+0000","last_clean":"2023-10-08T15:37:26.050562+0000","last_became_active":"2023-10-08T15:37:26.046845+0000","last_became_peered":"2023-10-08T15:37:26.046845+0000","last_unstale":"2023-10-08T15:37:26.050562+0000","last_undegraded":"2023-10-08T15:37:26.050562+0000","last_fullsized":"2023-10-08T15:37:26.050562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:17:23.022933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.046293+0000","last_change":"2023-10-08T15:37:26.041133+0000","last_active":"2023-10-08T15:37:26.046293+0000","last_peered":"2023-10-08T15:37:26.046293+0000","last_clean":"2023-10-08T15:37:26.046293+0000","last_became_active":"2023-10-08T15:37:26.040867+0000","last_became_peered":"2023-10-08T15:37:26.040867+0000","last_unstale":"2023-10-08T15:37:26.046293+0000","last_undegraded":"2023-10-08T15:37:26.046293+0000","last_fullsized":"2023-10-08T15:37:26.046293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:10:03.706049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.054247+0000","last_change":"2023-10-08T15:37:26.035125+0000","last_active":"2023-10-08T15:37:26.054247+0000","last_peered":"2023-10-08T15:37:26.054247+0000","last_clean":"2023-10-08T15:37:26.054247+0000","last_became_active":"2023-10-08T15:37:26.034739+0000","last_became_peered":"2023-10-08T15:37:26.034739+0000","last_unstale":"2023-10-08T15:37:26.054247+0000","last_undegraded":"2023-10-08T15:37:26.054247+0000","last_fullsized":"2023-10-08T15:37:26.054247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:38:43.660811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.038213+0000","last_change":"2023-10-08T15:37:26.030988+0000","last_active":"2023-10-08T15:37:26.038213+0000","last_peered":"2023-10-08T15:37:26.038213+0000","last_clean":"2023-10-08T15:37:26.038213+0000","last_became_active":"2023-10-08T15:37:26.030522+0000","last_became_peered":"2023-10-08T15:37:26.030522+0000","last_unstale":"2023-10-08T15:37:26.038213+0000","last_undegraded":"2023-10-08T15:37:26.038213+0000","last_fullsized":"2023-10-08T15:37:26.038213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:37:45.941867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.049875+0000","last_change":"2023-10-08T15:37:26.046534+0000","last_active":"2023-10-08T15:37:26.049875+0000","last_peered":"2023-10-08T15:37:26.049875+0000","last_clean":"2023-10-08T15:37:26.049875+0000","last_became_active":"2023-10-08T15:37:26.046213+0000","last_became_peered":"2023-10-08T15:37:26.046213+0000","last_unstale":"2023-10-08T15:37:26.049875+0000","last_undegraded":"2023-10-08T15:37:26.049875+0000","last_fullsized":"2023-10-08T15:37:26.049875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:44:20.631125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.047730+0000","last_change":"2023-10-08T15:37:26.029621+0000","last_active":"2023-10-08T15:37:26.047730+0000","last_peered":"2023-10-08T15:37:26.047730+0000","last_clean":"2023-10-08T15:37:26.047730+0000","last_became_active":"2023-10-08T15:37:26.029280+0000","last_became_peered":"2023-10-08T15:37:26.029280+0000","last_unstale":"2023-10-08T15:37:26.047730+0000","last_undegraded":"2023-10-08T15:37:26.047730+0000","last_fullsized":"2023-10-08T15:37:26.047730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:52:17.141125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.042428+0000","last_change":"2023-10-08T15:37:25.030754+0000","last_active":"2023-10-08T15:37:26.042428+0000","last_peered":"2023-10-08T15:37:26.042428+0000","last_clean":"2023-10-08T15:37:26.042428+0000","last_became_active":"2023-10-08T15:37:25.030391+0000","last_became_peered":"2023-10-08T15:37:25.030391+0000","last_unstale":"2023-10-08T15:37:26.042428+0000","last_undegraded":"2023-10-08T15:37:26.042428+0000","last_fullsized":"2023-10-08T15:37:26.042428+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:12:17.158973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.060787+0000","last_change":"2023-10-08T15:37:26.057810+0000","last_active":"2023-10-08T15:37:26.060787+0000","last_peered":"2023-10-08T15:37:26.060787+0000","last_clean":"2023-10-08T15:37:26.060787+0000","last_became_active":"2023-10-08T15:37:26.057527+0000","last_became_peered":"2023-10-08T15:37:26.057527+0000","last_unstale":"2023-10-08T15:37:26.060787+0000","last_undegraded":"2023-10-08T15:37:26.060787+0000","last_fullsized":"2023-10-08T15:37:26.060787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:03:31.974502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.058236+0000","last_change":"2023-10-08T15:37:25.031114+0000","last_active":"2023-10-08T15:37:26.058236+0000","last_peered":"2023-10-08T15:37:26.058236+0000","last_clean":"2023-10-08T15:37:26.058236+0000","last_became_active":"2023-10-08T15:37:25.030559+0000","last_became_peered":"2023-10-08T15:37:25.030559+0000","last_unstale":"2023-10-08T15:37:26.058236+0000","last_undegraded":"2023-10-08T15:37:26.058236+0000","last_fullsized":"2023-10-08T15:37:26.058236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:17:55.698139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.022121+0000","last_change":"2023-10-08T15:37:25.030150+0000","last_active":"2023-10-08T15:37:26.022121+0000","last_peered":"2023-10-08T15:37:26.022121+0000","last_clean":"2023-10-08T15:37:26.022121+0000","last_became_active":"2023-10-08T15:37:25.029857+0000","last_became_peered":"2023-10-08T15:37:25.029857+0000","last_unstale":"2023-10-08T15:37:26.022121+0000","last_undegraded":"2023-10-08T15:37:26.022121+0000","last_fullsized":"2023-10-08T15:37:26.022121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:17:10.911391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.046155+0000","last_change":"2023-10-08T15:37:26.044512+0000","last_active":"2023-10-08T15:37:26.046155+0000","last_peered":"2023-10-08T15:37:26.046155+0000","last_clean":"2023-10-08T15:37:26.046155+0000","last_became_active":"2023-10-08T15:37:26.044155+0000","last_became_peered":"2023-10-08T15:37:26.044155+0000","last_unstale":"2023-10-08T15:37:26.046155+0000","last_undegraded":"2023-10-08T15:37:26.046155+0000","last_fullsized":"2023-10-08T15:37:26.046155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:20:26.216438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.028350+0000","last_change":"2023-10-08T15:37:25.041282+0000","last_active":"2023-10-08T15:37:26.028350+0000","last_peered":"2023-10-08T15:37:26.028350+0000","last_clean":"2023-10-08T15:37:26.028350+0000","last_became_active":"2023-10-08T15:37:25.040931+0000","last_became_peered":"2023-10-08T15:37:25.040931+0000","last_unstale":"2023-10-08T15:37:26.028350+0000","last_undegraded":"2023-10-08T15:37:26.028350+0000","last_fullsized":"2023-10-08T15:37:26.028350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:17:10.911391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.036843+0000","last_change":"2023-10-08T15:37:26.032685+0000","last_active":"2023-10-08T15:37:26.036843+0000","last_peered":"2023-10-08T15:37:26.036843+0000","last_clean":"2023-10-08T15:37:26.036843+0000","last_became_active":"2023-10-08T15:37:26.031819+0000","last_became_peered":"2023-10-08T15:37:26.031819+0000","last_unstale":"2023-10-08T15:37:26.036843+0000","last_undegraded":"2023-10-08T15:37:26.036843+0000","last_fullsized":"2023-10-08T15:37:26.036843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:10:14.668770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.034785+0000","last_change":"2023-10-08T15:37:25.039812+0000","last_active":"2023-10-08T15:37:26.034785+0000","last_peered":"2023-10-08T15:37:26.034785+0000","last_clean":"2023-10-08T15:37:26.034785+0000","last_became_active":"2023-10-08T15:37:25.039165+0000","last_became_peered":"2023-10-08T15:37:25.039165+0000","last_unstale":"2023-10-08T15:37:26.034785+0000","last_undegraded":"2023-10-08T15:37:26.034785+0000","last_fullsized":"2023-10-08T15:37:26.034785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:09:10.975405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.057652+0000","last_change":"2023-10-08T15:37:26.050389+0000","last_active":"2023-10-08T15:37:26.057652+0000","last_peered":"2023-10-08T15:37:26.057652+0000","last_clean":"2023-10-08T15:37:26.057652+0000","last_became_active":"2023-10-08T15:37:26.050059+0000","last_became_peered":"2023-10-08T15:37:26.050059+0000","last_unstale":"2023-10-08T15:37:26.057652+0000","last_undegraded":"2023-10-08T15:37:26.057652+0000","last_fullsized":"2023-10-08T15:37:26.057652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:37:10.263562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.031544+0000","last_change":"2023-10-08T15:37:25.037788+0000","last_active":"2023-10-08T15:37:26.031544+0000","last_peered":"2023-10-08T15:37:26.031544+0000","last_clean":"2023-10-08T15:37:26.031544+0000","last_became_active":"2023-10-08T15:37:25.037390+0000","last_became_peered":"2023-10-08T15:37:25.037390+0000","last_unstale":"2023-10-08T15:37:26.031544+0000","last_undegraded":"2023-10-08T15:37:26.031544+0000","last_fullsized":"2023-10-08T15:37:26.031544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:33:24.209108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.054995+0000","last_change":"2023-10-08T15:37:26.052388+0000","last_active":"2023-10-08T15:37:26.054995+0000","last_peered":"2023-10-08T15:37:26.054995+0000","last_clean":"2023-10-08T15:37:26.054995+0000","last_became_active":"2023-10-08T15:37:26.052080+0000","last_became_peered":"2023-10-08T15:37:26.052080+0000","last_unstale":"2023-10-08T15:37:26.054995+0000","last_undegraded":"2023-10-08T15:37:26.054995+0000","last_fullsized":"2023-10-08T15:37:26.054995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:17:23.022933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.049288+0000","last_change":"2023-10-08T15:37:25.040184+0000","last_active":"2023-10-08T15:37:26.049288+0000","last_peered":"2023-10-08T15:37:26.049288+0000","last_clean":"2023-10-08T15:37:26.049288+0000","last_became_active":"2023-10-08T15:37:25.039952+0000","last_became_peered":"2023-10-08T15:37:25.039952+0000","last_unstale":"2023-10-08T15:37:26.049288+0000","last_undegraded":"2023-10-08T15:37:26.049288+0000","last_fullsized":"2023-10-08T15:37:26.049288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:37:44.937225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.056434+0000","last_change":"2023-10-08T15:37:26.030498+0000","last_active":"2023-10-08T15:37:26.056434+0000","last_peered":"2023-10-08T15:37:26.056434+0000","last_clean":"2023-10-08T15:37:26.056434+0000","last_became_active":"2023-10-08T15:37:26.029947+0000","last_became_peered":"2023-10-08T15:37:26.029947+0000","last_unstale":"2023-10-08T15:37:26.056434+0000","last_undegraded":"2023-10-08T15:37:26.056434+0000","last_fullsized":"2023-10-08T15:37:26.056434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:21:26.142526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.049086+0000","last_change":"2023-10-08T15:37:25.034475+0000","last_active":"2023-10-08T15:37:26.049086+0000","last_peered":"2023-10-08T15:37:26.049086+0000","last_clean":"2023-10-08T15:37:26.049086+0000","last_became_active":"2023-10-08T15:37:25.034280+0000","last_became_peered":"2023-10-08T15:37:25.034280+0000","last_unstale":"2023-10-08T15:37:26.049086+0000","last_undegraded":"2023-10-08T15:37:26.049086+0000","last_fullsized":"2023-10-08T15:37:26.049086+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:14:36.405051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.041985+0000","last_change":"2023-10-08T15:37:26.037712+0000","last_active":"2023-10-08T15:37:26.041985+0000","last_peered":"2023-10-08T15:37:26.041985+0000","last_clean":"2023-10-08T15:37:26.041985+0000","last_became_active":"2023-10-08T15:37:26.036887+0000","last_became_peered":"2023-10-08T15:37:26.036887+0000","last_unstale":"2023-10-08T15:37:26.041985+0000","last_undegraded":"2023-10-08T15:37:26.041985+0000","last_fullsized":"2023-10-08T15:37:26.041985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:25:12.941976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.057432+0000","last_change":"2023-10-08T15:37:25.029595+0000","last_active":"2023-10-08T15:37:26.057432+0000","last_peered":"2023-10-08T15:37:26.057432+0000","last_clean":"2023-10-08T15:37:26.057432+0000","last_became_active":"2023-10-08T15:37:25.029268+0000","last_became_peered":"2023-10-08T15:37:25.029268+0000","last_unstale":"2023-10-08T15:37:26.057432+0000","last_undegraded":"2023-10-08T15:37:26.057432+0000","last_fullsized":"2023-10-08T15:37:26.057432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:08:13.115248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.046362+0000","last_change":"2023-10-08T15:37:26.042309+0000","last_active":"2023-10-08T15:37:26.046362+0000","last_peered":"2023-10-08T15:37:26.046362+0000","last_clean":"2023-10-08T15:37:26.046362+0000","last_became_active":"2023-10-08T15:37:26.042045+0000","last_became_peered":"2023-10-08T15:37:26.042045+0000","last_unstale":"2023-10-08T15:37:26.046362+0000","last_undegraded":"2023-10-08T15:37:26.046362+0000","last_fullsized":"2023-10-08T15:37:26.046362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:09:23.414069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.028559+0000","last_change":"2023-10-08T15:37:25.040580+0000","last_active":"2023-10-08T15:37:26.028559+0000","last_peered":"2023-10-08T15:37:26.028559+0000","last_clean":"2023-10-08T15:37:26.028559+0000","last_became_active":"2023-10-08T15:37:25.039401+0000","last_became_peered":"2023-10-08T15:37:25.039401+0000","last_unstale":"2023-10-08T15:37:26.028559+0000","last_undegraded":"2023-10-08T15:37:26.028559+0000","last_fullsized":"2023-10-08T15:37:26.028559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:12:32.395357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.041952+0000","last_change":"2023-10-08T15:37:26.037408+0000","last_active":"2023-10-08T15:37:26.041952+0000","last_peered":"2023-10-08T15:37:26.041952+0000","last_clean":"2023-10-08T15:37:26.041952+0000","last_became_active":"2023-10-08T15:37:26.037124+0000","last_became_peered":"2023-10-08T15:37:26.037124+0000","last_unstale":"2023-10-08T15:37:26.041952+0000","last_undegraded":"2023-10-08T15:37:26.041952+0000","last_fullsized":"2023-10-08T15:37:26.041952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:02:42.564039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.027097+0000","last_change":"2023-10-08T15:37:25.024341+0000","last_active":"2023-10-08T15:37:26.027097+0000","last_peered":"2023-10-08T15:37:26.027097+0000","last_clean":"2023-10-08T15:37:26.027097+0000","last_became_active":"2023-10-08T15:37:25.023991+0000","last_became_peered":"2023-10-08T15:37:25.023991+0000","last_unstale":"2023-10-08T15:37:26.027097+0000","last_undegraded":"2023-10-08T15:37:26.027097+0000","last_fullsized":"2023-10-08T15:37:26.027097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:20:36.667774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.049857+0000","last_change":"2023-10-08T15:37:26.046530+0000","last_active":"2023-10-08T15:37:26.049857+0000","last_peered":"2023-10-08T15:37:26.049857+0000","last_clean":"2023-10-08T15:37:26.049857+0000","last_became_active":"2023-10-08T15:37:26.046211+0000","last_became_peered":"2023-10-08T15:37:26.046211+0000","last_unstale":"2023-10-08T15:37:26.049857+0000","last_undegraded":"2023-10-08T15:37:26.049857+0000","last_fullsized":"2023-10-08T15:37:26.049857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:49:47.826663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.042536+0000","last_change":"2023-10-08T15:37:25.024875+0000","last_active":"2023-10-08T15:37:26.042536+0000","last_peered":"2023-10-08T15:37:26.042536+0000","last_clean":"2023-10-08T15:37:26.042536+0000","last_became_active":"2023-10-08T15:37:25.023897+0000","last_became_peered":"2023-10-08T15:37:25.023897+0000","last_unstale":"2023-10-08T15:37:26.042536+0000","last_undegraded":"2023-10-08T15:37:26.042536+0000","last_fullsized":"2023-10-08T15:37:26.042536+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:51:33.993191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.053797+0000","last_change":"2023-10-08T15:37:26.048199+0000","last_active":"2023-10-08T15:37:26.053797+0000","last_peered":"2023-10-08T15:37:26.053797+0000","last_clean":"2023-10-08T15:37:26.053797+0000","last_became_active":"2023-10-08T15:37:26.047816+0000","last_became_peered":"2023-10-08T15:37:26.047816+0000","last_unstale":"2023-10-08T15:37:26.053797+0000","last_undegraded":"2023-10-08T15:37:26.053797+0000","last_fullsized":"2023-10-08T15:37:26.053797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:13:29.705445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.047479+0000","last_change":"2023-10-08T15:37:25.035792+0000","last_active":"2023-10-08T15:37:26.047479+0000","last_peered":"2023-10-08T15:37:26.047479+0000","last_clean":"2023-10-08T15:37:26.047479+0000","last_became_active":"2023-10-08T15:37:25.035413+0000","last_became_peered":"2023-10-08T15:37:25.035413+0000","last_unstale":"2023-10-08T15:37:26.047479+0000","last_undegraded":"2023-10-08T15:37:26.047479+0000","last_fullsized":"2023-10-08T15:37:26.047479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:08:13.115248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.038047+0000","last_change":"2023-10-08T15:37:26.029023+0000","last_active":"2023-10-08T15:37:26.038047+0000","last_peered":"2023-10-08T15:37:26.038047+0000","last_clean":"2023-10-08T15:37:26.038047+0000","last_became_active":"2023-10-08T15:37:26.028552+0000","last_became_peered":"2023-10-08T15:37:26.028552+0000","last_unstale":"2023-10-08T15:37:26.038047+0000","last_undegraded":"2023-10-08T15:37:26.038047+0000","last_fullsized":"2023-10-08T15:37:26.038047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:10:14.668770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.039684+0000","last_change":"2023-10-08T15:37:25.033468+0000","last_active":"2023-10-08T15:37:26.039684+0000","last_peered":"2023-10-08T15:37:26.039684+0000","last_clean":"2023-10-08T15:37:26.039684+0000","last_became_active":"2023-10-08T15:37:25.033054+0000","last_became_peered":"2023-10-08T15:37:25.033054+0000","last_unstale":"2023-10-08T15:37:26.039684+0000","last_undegraded":"2023-10-08T15:37:26.039684+0000","last_fullsized":"2023-10-08T15:37:26.039684+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:03:03.753758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.037886+0000","last_change":"2023-10-08T15:37:26.028708+0000","last_active":"2023-10-08T15:37:26.037886+0000","last_peered":"2023-10-08T15:37:26.037886+0000","last_clean":"2023-10-08T15:37:26.037886+0000","last_became_active":"2023-10-08T15:37:26.028418+0000","last_became_peered":"2023-10-08T15:37:26.028418+0000","last_unstale":"2023-10-08T15:37:26.037886+0000","last_undegraded":"2023-10-08T15:37:26.037886+0000","last_fullsized":"2023-10-08T15:37:26.037886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:58:41.177656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.055778+0000","last_change":"2023-10-08T15:37:25.026007+0000","last_active":"2023-10-08T15:37:26.055778+0000","last_peered":"2023-10-08T15:37:26.055778+0000","last_clean":"2023-10-08T15:37:26.055778+0000","last_became_active":"2023-10-08T15:37:25.024633+0000","last_became_peered":"2023-10-08T15:37:25.024633+0000","last_unstale":"2023-10-08T15:37:26.055778+0000","last_undegraded":"2023-10-08T15:37:26.055778+0000","last_fullsized":"2023-10-08T15:37:26.055778+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:20:36.667774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.052950+0000","last_change":"2023-10-08T15:37:26.035368+0000","last_active":"2023-10-08T15:37:26.052950+0000","last_peered":"2023-10-08T15:37:26.052950+0000","last_clean":"2023-10-08T15:37:26.052950+0000","last_became_active":"2023-10-08T15:37:26.034994+0000","last_became_peered":"2023-10-08T15:37:26.034994+0000","last_unstale":"2023-10-08T15:37:26.052950+0000","last_undegraded":"2023-10-08T15:37:26.052950+0000","last_fullsized":"2023-10-08T15:37:26.052950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:21:41.320706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.023845+0000","last_change":"2023-10-08T15:37:25.030197+0000","last_active":"2023-10-08T15:37:26.023845+0000","last_peered":"2023-10-08T15:37:26.023845+0000","last_clean":"2023-10-08T15:37:26.023845+0000","last_became_active":"2023-10-08T15:37:25.028215+0000","last_became_peered":"2023-10-08T15:37:25.028215+0000","last_unstale":"2023-10-08T15:37:26.023845+0000","last_undegraded":"2023-10-08T15:37:26.023845+0000","last_fullsized":"2023-10-08T15:37:26.023845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:17:55.698139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.041872+0000","last_change":"2023-10-08T15:37:26.031876+0000","last_active":"2023-10-08T15:37:26.041872+0000","last_peered":"2023-10-08T15:37:26.041872+0000","last_clean":"2023-10-08T15:37:26.041872+0000","last_became_active":"2023-10-08T15:37:26.031592+0000","last_became_peered":"2023-10-08T15:37:26.031592+0000","last_unstale":"2023-10-08T15:37:26.041872+0000","last_undegraded":"2023-10-08T15:37:26.041872+0000","last_fullsized":"2023-10-08T15:37:26.041872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:39:17.396462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.017482+0000","last_change":"2023-10-08T15:37:19.380955+0000","last_active":"2023-10-08T15:37:26.017482+0000","last_peered":"2023-10-08T15:37:26.017482+0000","last_clean":"2023-10-08T15:37:26.017482+0000","last_became_active":"2023-10-08T15:37:19.378277+0000","last_became_peered":"2023-10-08T15:37:19.378277+0000","last_unstale":"2023-10-08T15:37:26.017482+0000","last_undegraded":"2023-10-08T15:37:26.017482+0000","last_fullsized":"2023-10-08T15:37:26.017482+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:17.537726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:17.537726+0000","last_clean_scrub_stamp":"2023-10-08T15:37:17.537726+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:06:26.612046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.029287+0000","last_change":"2023-10-08T15:37:25.033028+0000","last_active":"2023-10-08T15:37:26.029287+0000","last_peered":"2023-10-08T15:37:26.029287+0000","last_clean":"2023-10-08T15:37:26.029287+0000","last_became_active":"2023-10-08T15:37:25.032661+0000","last_became_peered":"2023-10-08T15:37:25.032661+0000","last_unstale":"2023-10-08T15:37:26.029287+0000","last_undegraded":"2023-10-08T15:37:26.029287+0000","last_fullsized":"2023-10-08T15:37:26.029287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:18:48.729702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.053015+0000","last_change":"2023-10-08T15:37:26.050013+0000","last_active":"2023-10-08T15:37:26.053015+0000","last_peered":"2023-10-08T15:37:26.053015+0000","last_clean":"2023-10-08T15:37:26.053015+0000","last_became_active":"2023-10-08T15:37:26.049729+0000","last_became_peered":"2023-10-08T15:37:26.049729+0000","last_unstale":"2023-10-08T15:37:26.053015+0000","last_undegraded":"2023-10-08T15:37:26.053015+0000","last_fullsized":"2023-10-08T15:37:26.053015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:35:27.592646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.017320+0000","last_change":"2023-10-08T15:37:25.029859+0000","last_active":"2023-10-08T15:37:26.017320+0000","last_peered":"2023-10-08T15:37:26.017320+0000","last_clean":"2023-10-08T15:37:26.017320+0000","last_became_active":"2023-10-08T15:37:25.029537+0000","last_became_peered":"2023-10-08T15:37:25.029537+0000","last_unstale":"2023-10-08T15:37:26.017320+0000","last_undegraded":"2023-10-08T15:37:26.017320+0000","last_fullsized":"2023-10-08T15:37:26.017320+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:37:44.937225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.060797+0000","last_change":"2023-10-08T15:37:26.057875+0000","last_active":"2023-10-08T15:37:26.060797+0000","last_peered":"2023-10-08T15:37:26.060797+0000","last_clean":"2023-10-08T15:37:26.060797+0000","last_became_active":"2023-10-08T15:37:26.057545+0000","last_became_peered":"2023-10-08T15:37:26.057545+0000","last_unstale":"2023-10-08T15:37:26.060797+0000","last_undegraded":"2023-10-08T15:37:26.060797+0000","last_fullsized":"2023-10-08T15:37:26.060797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:10.725842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.022360+0000","last_change":"2023-10-08T15:37:25.035939+0000","last_active":"2023-10-08T15:37:26.022360+0000","last_peered":"2023-10-08T15:37:26.022360+0000","last_clean":"2023-10-08T15:37:26.022360+0000","last_became_active":"2023-10-08T15:37:25.035628+0000","last_became_peered":"2023-10-08T15:37:25.035628+0000","last_unstale":"2023-10-08T15:37:26.022360+0000","last_undegraded":"2023-10-08T15:37:26.022360+0000","last_fullsized":"2023-10-08T15:37:26.022360+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:51:28.443377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.041424+0000","last_change":"2023-10-08T15:37:26.038726+0000","last_active":"2023-10-08T15:37:26.041424+0000","last_peered":"2023-10-08T15:37:26.041424+0000","last_clean":"2023-10-08T15:37:26.041424+0000","last_became_active":"2023-10-08T15:37:26.036653+0000","last_became_peered":"2023-10-08T15:37:26.036653+0000","last_unstale":"2023-10-08T15:37:26.041424+0000","last_undegraded":"2023-10-08T15:37:26.041424+0000","last_fullsized":"2023-10-08T15:37:26.041424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:30:40.002556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.028671+0000","last_change":"2023-10-08T15:37:25.037867+0000","last_active":"2023-10-08T15:37:26.028671+0000","last_peered":"2023-10-08T15:37:26.028671+0000","last_clean":"2023-10-08T15:37:26.028671+0000","last_became_active":"2023-10-08T15:37:25.037638+0000","last_became_peered":"2023-10-08T15:37:25.037638+0000","last_unstale":"2023-10-08T15:37:26.028671+0000","last_undegraded":"2023-10-08T15:37:26.028671+0000","last_fullsized":"2023-10-08T15:37:26.028671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:52:16.136483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.057054+0000","last_change":"2023-10-08T15:37:26.046686+0000","last_active":"2023-10-08T15:37:26.057054+0000","last_peered":"2023-10-08T15:37:26.057054+0000","last_clean":"2023-10-08T15:37:26.057054+0000","last_became_active":"2023-10-08T15:37:26.046295+0000","last_became_peered":"2023-10-08T15:37:26.046295+0000","last_unstale":"2023-10-08T15:37:26.057054+0000","last_undegraded":"2023-10-08T15:37:26.057054+0000","last_fullsized":"2023-10-08T15:37:26.057054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:27:46.266100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.014293+0000","last_change":"2023-10-08T15:37:25.034339+0000","last_active":"2023-10-08T15:37:26.014293+0000","last_peered":"2023-10-08T15:37:26.014293+0000","last_clean":"2023-10-08T15:37:26.014293+0000","last_became_active":"2023-10-08T15:37:25.034011+0000","last_became_peered":"2023-10-08T15:37:25.034011+0000","last_unstale":"2023-10-08T15:37:26.014293+0000","last_undegraded":"2023-10-08T15:37:26.014293+0000","last_fullsized":"2023-10-08T15:37:26.014293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:14:36.405051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.057481+0000","last_change":"2023-10-08T15:37:26.049468+0000","last_active":"2023-10-08T15:37:26.057481+0000","last_peered":"2023-10-08T15:37:26.057481+0000","last_clean":"2023-10-08T15:37:26.057481+0000","last_became_active":"2023-10-08T15:37:26.048647+0000","last_became_peered":"2023-10-08T15:37:26.048647+0000","last_unstale":"2023-10-08T15:37:26.057481+0000","last_undegraded":"2023-10-08T15:37:26.057481+0000","last_fullsized":"2023-10-08T15:37:26.057481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:07:54.534413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.020837+0000","last_change":"2023-10-08T15:37:25.038765+0000","last_active":"2023-10-08T15:37:26.020837+0000","last_peered":"2023-10-08T15:37:26.020837+0000","last_clean":"2023-10-08T15:37:26.020837+0000","last_became_active":"2023-10-08T15:37:25.038448+0000","last_became_peered":"2023-10-08T15:37:25.038448+0000","last_unstale":"2023-10-08T15:37:26.020837+0000","last_undegraded":"2023-10-08T15:37:26.020837+0000","last_fullsized":"2023-10-08T15:37:26.020837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:14:36.405051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.041393+0000","last_change":"2023-10-08T15:37:26.039674+0000","last_active":"2023-10-08T15:37:26.041393+0000","last_peered":"2023-10-08T15:37:26.041393+0000","last_clean":"2023-10-08T15:37:26.041393+0000","last_became_active":"2023-10-08T15:37:26.039394+0000","last_became_peered":"2023-10-08T15:37:26.039394+0000","last_unstale":"2023-10-08T15:37:26.041393+0000","last_undegraded":"2023-10-08T15:37:26.041393+0000","last_fullsized":"2023-10-08T15:37:26.041393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:01:07.561679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.013929+0000","last_change":"2023-10-08T15:37:25.030182+0000","last_active":"2023-10-08T15:37:26.013929+0000","last_peered":"2023-10-08T15:37:26.013929+0000","last_clean":"2023-10-08T15:37:26.013929+0000","last_became_active":"2023-10-08T15:37:25.029834+0000","last_became_peered":"2023-10-08T15:37:25.029834+0000","last_unstale":"2023-10-08T15:37:26.013929+0000","last_undegraded":"2023-10-08T15:37:26.013929+0000","last_fullsized":"2023-10-08T15:37:26.013929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:09:10.975405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.037854+0000","last_change":"2023-10-08T15:37:26.030211+0000","last_active":"2023-10-08T15:37:26.037854+0000","last_peered":"2023-10-08T15:37:26.037854+0000","last_clean":"2023-10-08T15:37:26.037854+0000","last_became_active":"2023-10-08T15:37:26.029155+0000","last_became_peered":"2023-10-08T15:37:26.029155+0000","last_unstale":"2023-10-08T15:37:26.037854+0000","last_undegraded":"2023-10-08T15:37:26.037854+0000","last_fullsized":"2023-10-08T15:37:26.037854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:12:46.913128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.054023+0000","last_change":"2023-10-08T15:37:25.033767+0000","last_active":"2023-10-08T15:37:26.054023+0000","last_peered":"2023-10-08T15:37:26.054023+0000","last_clean":"2023-10-08T15:37:26.054023+0000","last_became_active":"2023-10-08T15:37:25.033432+0000","last_became_peered":"2023-10-08T15:37:25.033432+0000","last_unstale":"2023-10-08T15:37:26.054023+0000","last_undegraded":"2023-10-08T15:37:26.054023+0000","last_fullsized":"2023-10-08T15:37:26.054023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:18:34.111508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.049042+0000","last_change":"2023-10-08T15:37:26.044802+0000","last_active":"2023-10-08T15:37:26.049042+0000","last_peered":"2023-10-08T15:37:26.049042+0000","last_clean":"2023-10-08T15:37:26.049042+0000","last_became_active":"2023-10-08T15:37:26.044064+0000","last_became_peered":"2023-10-08T15:37:26.044064+0000","last_unstale":"2023-10-08T15:37:26.049042+0000","last_undegraded":"2023-10-08T15:37:26.049042+0000","last_fullsized":"2023-10-08T15:37:26.049042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:27:46.266100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.017243+0000","last_change":"2023-10-08T15:37:25.038017+0000","last_active":"2023-10-08T15:37:26.017243+0000","last_peered":"2023-10-08T15:37:26.017243+0000","last_clean":"2023-10-08T15:37:26.017243+0000","last_became_active":"2023-10-08T15:37:25.037738+0000","last_became_peered":"2023-10-08T15:37:25.037738+0000","last_unstale":"2023-10-08T15:37:26.017243+0000","last_undegraded":"2023-10-08T15:37:26.017243+0000","last_fullsized":"2023-10-08T15:37:26.017243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:09:10.975405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.057284+0000","last_change":"2023-10-08T15:37:26.039472+0000","last_active":"2023-10-08T15:37:26.057284+0000","last_peered":"2023-10-08T15:37:26.057284+0000","last_clean":"2023-10-08T15:37:26.057284+0000","last_became_active":"2023-10-08T15:37:26.038579+0000","last_became_peered":"2023-10-08T15:37:26.038579+0000","last_unstale":"2023-10-08T15:37:26.057284+0000","last_undegraded":"2023-10-08T15:37:26.057284+0000","last_fullsized":"2023-10-08T15:37:26.057284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:33:25.213750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.013917+0000","last_change":"2023-10-08T15:37:25.024556+0000","last_active":"2023-10-08T15:37:26.013917+0000","last_peered":"2023-10-08T15:37:26.013917+0000","last_clean":"2023-10-08T15:37:26.013917+0000","last_became_active":"2023-10-08T15:37:25.024208+0000","last_became_peered":"2023-10-08T15:37:25.024208+0000","last_unstale":"2023-10-08T15:37:26.013917+0000","last_undegraded":"2023-10-08T15:37:26.013917+0000","last_fullsized":"2023-10-08T15:37:26.013917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:18:34.111508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.039462+0000","last_change":"2023-10-08T15:37:26.035450+0000","last_active":"2023-10-08T15:37:26.039462+0000","last_peered":"2023-10-08T15:37:26.039462+0000","last_clean":"2023-10-08T15:37:26.039462+0000","last_became_active":"2023-10-08T15:37:26.034248+0000","last_became_peered":"2023-10-08T15:37:26.034248+0000","last_unstale":"2023-10-08T15:37:26.039462+0000","last_undegraded":"2023-10-08T15:37:26.039462+0000","last_fullsized":"2023-10-08T15:37:26.039462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:37:10.263562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.013177+0000","last_change":"2023-10-08T15:37:25.030789+0000","last_active":"2023-10-08T15:37:26.013177+0000","last_peered":"2023-10-08T15:37:26.013177+0000","last_clean":"2023-10-08T15:37:26.013177+0000","last_became_active":"2023-10-08T15:37:25.030435+0000","last_became_peered":"2023-10-08T15:37:25.030435+0000","last_unstale":"2023-10-08T15:37:26.013177+0000","last_undegraded":"2023-10-08T15:37:26.013177+0000","last_fullsized":"2023-10-08T15:37:26.013177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:17:55.698139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.046184+0000","last_change":"2023-10-08T15:37:26.045028+0000","last_active":"2023-10-08T15:37:26.046184+0000","last_peered":"2023-10-08T15:37:26.046184+0000","last_clean":"2023-10-08T15:37:26.046184+0000","last_became_active":"2023-10-08T15:37:26.044703+0000","last_became_peered":"2023-10-08T15:37:26.044703+0000","last_unstale":"2023-10-08T15:37:26.046184+0000","last_undegraded":"2023-10-08T15:37:26.046184+0000","last_fullsized":"2023-10-08T15:37:26.046184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:47:37.094485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.058571+0000","last_change":"2023-10-08T15:37:25.032025+0000","last_active":"2023-10-08T15:37:26.058571+0000","last_peered":"2023-10-08T15:37:26.058571+0000","last_clean":"2023-10-08T15:37:26.058571+0000","last_became_active":"2023-10-08T15:37:25.031526+0000","last_became_peered":"2023-10-08T15:37:25.031526+0000","last_unstale":"2023-10-08T15:37:26.058571+0000","last_undegraded":"2023-10-08T15:37:26.058571+0000","last_fullsized":"2023-10-08T15:37:26.058571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:20:36.667774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.059510+0000","last_change":"2023-10-08T15:37:26.057305+0000","last_active":"2023-10-08T15:37:26.059510+0000","last_peered":"2023-10-08T15:37:26.059510+0000","last_clean":"2023-10-08T15:37:26.059510+0000","last_became_active":"2023-10-08T15:37:26.056970+0000","last_became_peered":"2023-10-08T15:37:26.056970+0000","last_unstale":"2023-10-08T15:37:26.059510+0000","last_undegraded":"2023-10-08T15:37:26.059510+0000","last_fullsized":"2023-10-08T15:37:26.059510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:30:40.002556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.058725+0000","last_change":"2023-10-08T15:37:26.057363+0000","last_active":"2023-10-08T15:37:26.058725+0000","last_peered":"2023-10-08T15:37:26.058725+0000","last_clean":"2023-10-08T15:37:26.058725+0000","last_became_active":"2023-10-08T15:37:26.057058+0000","last_became_peered":"2023-10-08T15:37:26.057058+0000","last_unstale":"2023-10-08T15:37:26.058725+0000","last_undegraded":"2023-10-08T15:37:26.058725+0000","last_fullsized":"2023-10-08T15:37:26.058725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:20:26.216438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.054689+0000","last_change":"2023-10-08T15:37:25.041688+0000","last_active":"2023-10-08T15:37:26.054689+0000","last_peered":"2023-10-08T15:37:26.054689+0000","last_clean":"2023-10-08T15:37:26.054689+0000","last_became_active":"2023-10-08T15:37:25.041387+0000","last_became_peered":"2023-10-08T15:37:25.041387+0000","last_unstale":"2023-10-08T15:37:26.054689+0000","last_undegraded":"2023-10-08T15:37:26.054689+0000","last_fullsized":"2023-10-08T15:37:26.054689+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:38:23.485886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.058772+0000","last_change":"2023-10-08T15:37:26.057526+0000","last_active":"2023-10-08T15:37:26.058772+0000","last_peered":"2023-10-08T15:37:26.058772+0000","last_clean":"2023-10-08T15:37:26.058772+0000","last_became_active":"2023-10-08T15:37:26.057220+0000","last_became_peered":"2023-10-08T15:37:26.057220+0000","last_unstale":"2023-10-08T15:37:26.058772+0000","last_undegraded":"2023-10-08T15:37:26.058772+0000","last_fullsized":"2023-10-08T15:37:26.058772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:48.862001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.049539+0000","last_change":"2023-10-08T15:37:25.035362+0000","last_active":"2023-10-08T15:37:26.049539+0000","last_peered":"2023-10-08T15:37:26.049539+0000","last_clean":"2023-10-08T15:37:26.049539+0000","last_became_active":"2023-10-08T15:37:25.035068+0000","last_became_peered":"2023-10-08T15:37:25.035068+0000","last_unstale":"2023-10-08T15:37:26.049539+0000","last_undegraded":"2023-10-08T15:37:26.049539+0000","last_fullsized":"2023-10-08T15:37:26.049539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:06.188503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.052326+0000","last_change":"2023-10-08T15:37:26.050163+0000","last_active":"2023-10-08T15:37:26.052326+0000","last_peered":"2023-10-08T15:37:26.052326+0000","last_clean":"2023-10-08T15:37:26.052326+0000","last_became_active":"2023-10-08T15:37:26.049850+0000","last_became_peered":"2023-10-08T15:37:26.049850+0000","last_unstale":"2023-10-08T15:37:26.052326+0000","last_undegraded":"2023-10-08T15:37:26.052326+0000","last_fullsized":"2023-10-08T15:37:26.052326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:12:46.913128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.045285+0000","last_change":"2023-10-08T15:37:25.034880+0000","last_active":"2023-10-08T15:37:26.045285+0000","last_peered":"2023-10-08T15:37:26.045285+0000","last_clean":"2023-10-08T15:37:26.045285+0000","last_became_active":"2023-10-08T15:37:25.034547+0000","last_became_peered":"2023-10-08T15:37:25.034547+0000","last_unstale":"2023-10-08T15:37:26.045285+0000","last_undegraded":"2023-10-08T15:37:26.045285+0000","last_fullsized":"2023-10-08T15:37:26.045285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:13:24.905916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.042918+0000","last_change":"2023-10-08T15:37:26.040375+0000","last_active":"2023-10-08T15:37:26.042918+0000","last_peered":"2023-10-08T15:37:26.042918+0000","last_clean":"2023-10-08T15:37:26.042918+0000","last_became_active":"2023-10-08T15:37:26.040082+0000","last_became_peered":"2023-10-08T15:37:26.040082+0000","last_unstale":"2023-10-08T15:37:26.042918+0000","last_undegraded":"2023-10-08T15:37:26.042918+0000","last_fullsized":"2023-10-08T15:37:26.042918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:09:23.414069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.052719+0000","last_change":"2023-10-08T15:37:25.034909+0000","last_active":"2023-10-08T15:37:26.052719+0000","last_peered":"2023-10-08T15:37:26.052719+0000","last_clean":"2023-10-08T15:37:26.052719+0000","last_became_active":"2023-10-08T15:37:25.034403+0000","last_became_peered":"2023-10-08T15:37:25.034403+0000","last_unstale":"2023-10-08T15:37:26.052719+0000","last_undegraded":"2023-10-08T15:37:26.052719+0000","last_fullsized":"2023-10-08T15:37:26.052719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:27:16.596718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66282,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542147,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301648,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070192,"statfs":{"total":96636764160,"available":96327876608,"internally_reserved":0,"allocated":270336,"data_stored":660538,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0529999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.254}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2809999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5549999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301592,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070248,"statfs":{"total":96636764160,"available":96327933952,"internally_reserved":0,"allocated":212992,"data_stored":71152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.129}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3049999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297496,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074344,"statfs":{"total":96636764160,"available":96332128256,"internally_reserved":0,"allocated":212992,"data_stored":71152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1319999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542148,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297484,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074356,"statfs":{"total":96636764160,"available":96332140544,"internally_reserved":0,"allocated":200704,"data_stored":69616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2529999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2909999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4219999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5229999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297492,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074348,"statfs":{"total":96636764160,"available":96332132352,"internally_reserved":0,"allocated":208896,"data_stored":69776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2250000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1739999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.077}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.302}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3380000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297560,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074280,"statfs":{"total":96636764160,"available":96332062720,"internally_reserved":0,"allocated":278528,"data_stored":660594,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.264}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3069999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301584,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070256,"statfs":{"total":96636764160,"available":96327942144,"internally_reserved":0,"allocated":204800,"data_stored":69706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1990000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3480000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1279999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.25}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301580,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070260,"statfs":{"total":96636764160,"available":96327946240,"internally_reserved":0,"allocated":200704,"data_stored":63454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1180000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T15:37:33.729 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-08T15:37:33.729 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-08T15:37:33.729 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-08T15:37:33.729 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-08T15:37:33.730 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-08T15:37:33.839 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.833+0000 7f950759e700 1 Processor -- start 2023-10-08T15:37:33.839 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.833+0000 7f950759e700 1 -- start start 2023-10-08T15:37:33.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.833+0000 7f950759e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f95080bbf00 0x7f950814ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:33.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.833+0000 7f950759e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f95080bcdd0 0x7f950814f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:33.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.833+0000 7f950759e700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95080b1ee0 con 0x7f95080be600 2023-10-08T15:37:33.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.833+0000 7f950759e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95080b29d0 con 0x7f95080bcdd0 2023-10-08T15:37:33.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.833+0000 7f950759e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95080b21c0 con 0x7f95080bbf00 2023-10-08T15:37:33.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.833+0000 7f9506d9d700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f95080be600 0x7f95080670e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:53804/0 (socket says 172.21.15.3:53804) 2023-10-08T15:37:33.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.833+0000 7f9506d9d700 1 -- 172.21.15.3:0/3828507869 learned_addr learned my addr 172.21.15.3:0/3828507869 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:33.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.833+0000 7f950659c700 1 --2- 172.21.15.3:0/3828507869 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f95080bbf00 0x7f950814ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:33.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.833+0000 7f9505d9b700 1 --2- 172.21.15.3:0/3828507869 >> v2:172.21.15.50:3300/0 conn(0x7f95080bcdd0 0x7f950814f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:33.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.833+0000 7f950559a700 1 -- 172.21.15.3:0/3828507869 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1922711503 0 0) 0x7f95080b1ee0 con 0x7f95080be600 2023-10-08T15:37:33.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.833+0000 7f950559a700 1 -- 172.21.15.3:0/3828507869 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94f0003570 con 0x7f95080be600 2023-10-08T15:37:33.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.833+0000 7f950659c700 1 -- 172.21.15.3:0/3828507869 >> v2:172.21.15.50:3300/0 conn(0x7f95080bcdd0 msgr2=0x7f950814f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:33.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.833+0000 7f950659c700 1 --2- 172.21.15.3:0/3828507869 >> v2:172.21.15.50:3300/0 conn(0x7f95080bcdd0 0x7f950814f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:33.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.833+0000 7f950659c700 1 -- 172.21.15.3:0/3828507869 >> v1:172.21.15.3:6789/0 conn(0x7f95080be600 legacy=0x7f95080670e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:33.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.833+0000 7f950659c700 1 -- 172.21.15.3:0/3828507869 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95080b2530 con 0x7f95080bbf00 2023-10-08T15:37:33.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.833+0000 7f9505d9b700 1 --2- 172.21.15.3:0/3828507869 >> v2:172.21.15.50:3300/0 conn(0x7f95080bcdd0 0x7f950814f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:37:33.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.837+0000 7f950659c700 1 --2- 172.21.15.3:0/3828507869 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f95080bbf00 0x7f950814ef80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f94f80098d0 tx=0x7f94f8009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43fccab102cc7680 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:33.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.837+0000 7f950559a700 1 -- 172.21.15.3:0/3828507869 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f8005c10 con 0x7f95080bbf00 2023-10-08T15:37:33.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.837+0000 7f950559a700 1 -- 172.21.15.3:0/3828507869 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94f8005d70 con 0x7f95080bbf00 2023-10-08T15:37:33.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.837+0000 7f950559a700 1 -- 172.21.15.3:0/3828507869 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f8006280 con 0x7f95080bbf00 2023-10-08T15:37:33.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.837+0000 7f950759e700 1 -- 172.21.15.3:0/3828507869 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f95080bbf00 msgr2=0x7f950814ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:33.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.837+0000 7f950759e700 1 --2- 172.21.15.3:0/3828507869 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f95080bbf00 0x7f950814ef80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f94f80098d0 tx=0x7f94f8009120 comp rx=0 tx=0).stop 2023-10-08T15:37:33.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.837+0000 7f950759e700 1 -- 172.21.15.3:0/3828507869 shutdown_connections 2023-10-08T15:37:33.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.837+0000 7f950759e700 1 --2- 172.21.15.3:0/3828507869 >> v2:172.21.15.50:3300/0 conn(0x7f95080bcdd0 0x7f950814f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:33.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.837+0000 7f950759e700 1 --2- 172.21.15.3:0/3828507869 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f95080bbf00 0x7f950814ef80 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:33.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.837+0000 7f950759e700 1 -- 172.21.15.3:0/3828507869 >> 172.21.15.3:0/3828507869 conn(0x7f95080bf5e0 msgr2=0x7f95080bb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:33.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.837+0000 7f950759e700 1 -- 172.21.15.3:0/3828507869 shutdown_connections 2023-10-08T15:37:33.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.837+0000 7f950759e700 1 -- 172.21.15.3:0/3828507869 wait complete. 2023-10-08T15:37:33.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.837+0000 7f950759e700 1 Processor -- start 2023-10-08T15:37:33.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.837+0000 7f950759e700 1 -- start start 2023-10-08T15:37:33.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.837+0000 7f950759e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95080bbf00 0x7f950809ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:33.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.837+0000 7f950759e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f95080bcdd0 0x7f950809a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:33.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.837+0000 7f950759e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f95080be600 0x7f9508098c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:33.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.837+0000 7f950759e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9508099c60 con 0x7f95080bcdd0 2023-10-08T15:37:33.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.837+0000 7f950759e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f950809a630 con 0x7f95080bbf00 2023-10-08T15:37:33.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.837+0000 7f950759e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9508099160 con 0x7f95080be600 2023-10-08T15:37:33.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.837+0000 7f9505d9b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f95080bcdd0 0x7f950809a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:33.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.837+0000 7f9505d9b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f95080bcdd0 0x7f950809a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47664/0 (socket says 172.21.15.3:47664) 2023-10-08T15:37:33.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.837+0000 7f9505d9b700 1 -- 172.21.15.3:0/3848891808 learned_addr learned my addr 172.21.15.3:0/3848891808 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:33.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.837+0000 7f9506d9d700 1 --2- 172.21.15.3:0/3848891808 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f95080be600 0x7f9508098c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:33.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.837+0000 7f950659c700 1 --2- 172.21.15.3:0/3848891808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95080bbf00 0x7f950809ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:33.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.837+0000 7f9505d9b700 1 -- 172.21.15.3:0/3848891808 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f95080be600 msgr2=0x7f9508098c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:33.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.837+0000 7f9505d9b700 1 --2- 172.21.15.3:0/3848891808 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f95080be600 0x7f9508098c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:33.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.837+0000 7f9505d9b700 1 -- 172.21.15.3:0/3848891808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95080bbf00 msgr2=0x7f950809ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:33.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.837+0000 7f9505d9b700 1 --2- 172.21.15.3:0/3848891808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95080bbf00 0x7f950809ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:33.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.837+0000 7f9505d9b700 1 -- 172.21.15.3:0/3848891808 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94fc009420 con 0x7f95080bcdd0 2023-10-08T15:37:33.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.841+0000 7f9505d9b700 1 --2- 172.21.15.3:0/3848891808 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f95080bcdd0 0x7f950809a0f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f94fc00ec80 tx=0x7f94fc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:33.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.841+0000 7f94f67fc700 1 -- 172.21.15.3:0/3848891808 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94fc00c9d0 con 0x7f95080bcdd0 2023-10-08T15:37:33.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.841+0000 7f950759e700 1 -- 172.21.15.3:0/3848891808 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94f80093c0 con 0x7f95080bcdd0 2023-10-08T15:37:33.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.841+0000 7f94f67fc700 1 -- 172.21.15.3:0/3848891808 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94fc00cb30 con 0x7f95080bcdd0 2023-10-08T15:37:33.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.841+0000 7f950759e700 1 -- 172.21.15.3:0/3848891808 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9508097b80 con 0x7f95080bcdd0 2023-10-08T15:37:33.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.841+0000 7f94f67fc700 1 -- 172.21.15.3:0/3848891808 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94fc00ceb0 con 0x7f95080bcdd0 2023-10-08T15:37:33.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.841+0000 7f94f67fc700 1 -- 172.21.15.3:0/3848891808 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f94fc005a00 con 0x7f95080bcdd0 2023-10-08T15:37:33.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.841+0000 7f950759e700 1 -- 172.21.15.3:0/3848891808 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9508099750 con 0x7f95080bcdd0 2023-10-08T15:37:33.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.841+0000 7f94f67fc700 1 --2- 172.21.15.3:0/3848891808 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f94e8060580 0x7f94e8062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:33.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.841+0000 7f94f67fc700 1 -- 172.21.15.3:0/3848891808 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f94fc07ca90 con 0x7f95080bcdd0 2023-10-08T15:37:33.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.841+0000 7f950659c700 1 --2- 172.21.15.3:0/3848891808 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f94e8060580 0x7f94e8062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:33.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.845+0000 7f950659c700 1 --2- 172.21.15.3:0/3848891808 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f94e8060580 0x7f94e8062a30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f94f80098d0 tx=0x7f94f8016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:33.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:33.849+0000 7f94f67fc700 1 -- 172.21.15.3:0/3848891808 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9508099750 con 0x7f95080bcdd0 2023-10-08T15:37:34.057 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.049+0000 7f950759e700 1 -- 172.21.15.3:0/3848891808 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f9508099750 con 0x7f95080bcdd0 2023-10-08T15:37:34.063 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.057+0000 7f94f67fc700 1 -- 172.21.15.3:0/3848891808 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+154129 (secure 0 0 0) 0x7f9508099750 con 0x7f95080bcdd0 2023-10-08T15:37:34.066 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:37:34.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.061+0000 7f950759e700 1 -- 172.21.15.3:0/3848891808 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f94e8060580 msgr2=0x7f94e8062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.061+0000 7f950759e700 1 --2- 172.21.15.3:0/3848891808 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f94e8060580 0x7f94e8062a30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f94f80098d0 tx=0x7f94f8016000 comp rx=0 tx=0).stop 2023-10-08T15:37:34.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.061+0000 7f950759e700 1 -- 172.21.15.3:0/3848891808 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f95080bcdd0 msgr2=0x7f950809a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.061+0000 7f950759e700 1 --2- 172.21.15.3:0/3848891808 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f95080bcdd0 0x7f950809a0f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f94fc00ec80 tx=0x7f94fc0091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.061+0000 7f950759e700 1 -- 172.21.15.3:0/3848891808 shutdown_connections 2023-10-08T15:37:34.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.061+0000 7f950759e700 1 --2- 172.21.15.3:0/3848891808 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f94e8060580 0x7f94e8062a30 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.061+0000 7f950759e700 1 --2- 172.21.15.3:0/3848891808 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f95080be600 0x7f9508098c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.061+0000 7f950759e700 1 --2- 172.21.15.3:0/3848891808 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f95080bcdd0 0x7f950809a0f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.061+0000 7f950759e700 1 --2- 172.21.15.3:0/3848891808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95080bbf00 0x7f950809ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.061+0000 7f950759e700 1 -- 172.21.15.3:0/3848891808 >> 172.21.15.3:0/3848891808 conn(0x7f95080bf5e0 msgr2=0x7f950814e410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:34.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.061+0000 7f950759e700 1 -- 172.21.15.3:0/3848891808 shutdown_connections 2023-10-08T15:37:34.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.061+0000 7f950759e700 1 -- 172.21.15.3:0/3848891808 wait complete. 2023-10-08T15:37:34.080 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":5,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":33268},{"type":"v1","addr":"172.21.15.50:6833","nonce":33268}]},"active_addr":"172.21.15.50:6833/33268","active_change":"2023-10-08T15:37:12.489704+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4108,"name":"y","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading asyncssh library:No module named 'asyncssh'","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading asyncssh library:No module named 'asyncssh'","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":4104955790}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":4084998371}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":122800622}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":141351707}]}]} 2023-10-08T15:37:34.084 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-08T15:37:34.084 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-08T15:37:34.084 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:37:34.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.185+0000 7f697bfff700 1 Processor -- start 2023-10-08T15:37:34.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.185+0000 7f697bfff700 1 -- start start 2023-10-08T15:37:34.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.185+0000 7f697bfff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f697c06be60 0x7f697c14b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.185+0000 7f697bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f697c06cc40 0x7f697c14cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.185+0000 7f697bfff700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f697c14c6b0 con 0x7f697c14ac50 2023-10-08T15:37:34.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.185+0000 7f697bfff700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f697c14c060 con 0x7f697c06be60 2023-10-08T15:37:34.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.185+0000 7f697bfff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f697c14c340 con 0x7f697c06cc40 2023-10-08T15:37:34.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.185+0000 7f697a7fc700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f697c06be60 0x7f697c14b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:34.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.185+0000 7f697a7fc700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f697c06be60 0x7f697c14b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47678/0 (socket says 172.21.15.3:47678) 2023-10-08T15:37:34.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.185+0000 7f697affd700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f697c14ac50 0x7f697c06c530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:53806/0 (socket says 172.21.15.3:53806) 2023-10-08T15:37:34.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.185+0000 7f697a7fc700 1 -- 172.21.15.3:0/4127651530 learned_addr learned my addr 172.21.15.3:0/4127651530 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:34.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.185+0000 7f697b7fe700 1 --2- 172.21.15.3:0/4127651530 >> v2:172.21.15.50:3300/0 conn(0x7f697c06cc40 0x7f697c14cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:34.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.185+0000 7f697a7fc700 1 -- 172.21.15.3:0/4127651530 >> v2:172.21.15.50:3300/0 conn(0x7f697c06cc40 msgr2=0x7f697c14cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:34.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.185+0000 7f697a7fc700 1 --2- 172.21.15.3:0/4127651530 >> v2:172.21.15.50:3300/0 conn(0x7f697c06cc40 0x7f697c14cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.185+0000 7f697a7fc700 1 -- 172.21.15.3:0/4127651530 >> v1:172.21.15.3:6789/0 conn(0x7f697c14ac50 legacy=0x7f697c06c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.185+0000 7f697a7fc700 1 -- 172.21.15.3:0/4127651530 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f697c14e860 con 0x7f697c06be60 2023-10-08T15:37:34.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.185+0000 7f697a7fc700 1 --2- 172.21.15.3:0/4127651530 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f697c06be60 0x7f697c14b020 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f697c14bf70 tx=0x7f696c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36500b4428e80a50 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:34.194 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.185+0000 7f6979ffb700 1 -- 172.21.15.3:0/4127651530 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696c00e070 con 0x7f697c06be60 2023-10-08T15:37:34.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.185+0000 7f6979ffb700 1 -- 172.21.15.3:0/4127651530 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f696c00ba20 con 0x7f697c06be60 2023-10-08T15:37:34.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.185+0000 7f6979ffb700 1 -- 172.21.15.3:0/4127651530 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696c0092e0 con 0x7f697c06be60 2023-10-08T15:37:34.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.189+0000 7f697bfff700 1 -- 172.21.15.3:0/4127651530 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f697c06be60 msgr2=0x7f697c14b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.189+0000 7f697bfff700 1 --2- 172.21.15.3:0/4127651530 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f697c06be60 0x7f697c14b020 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f697c14bf70 tx=0x7f696c009840 comp rx=0 tx=0).stop 2023-10-08T15:37:34.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.189+0000 7f697bfff700 1 -- 172.21.15.3:0/4127651530 shutdown_connections 2023-10-08T15:37:34.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.189+0000 7f697bfff700 1 --2- 172.21.15.3:0/4127651530 >> v2:172.21.15.50:3300/0 conn(0x7f697c06cc40 0x7f697c14cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.189+0000 7f697bfff700 1 --2- 172.21.15.3:0/4127651530 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f697c06be60 0x7f697c14b020 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.189+0000 7f697bfff700 1 -- 172.21.15.3:0/4127651530 >> 172.21.15.3:0/4127651530 conn(0x7f697c0c1df0 msgr2=0x7f697c0c21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:34.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.189+0000 7f697bfff700 1 -- 172.21.15.3:0/4127651530 shutdown_connections 2023-10-08T15:37:34.196 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.189+0000 7f697bfff700 1 -- 172.21.15.3:0/4127651530 wait complete. 2023-10-08T15:37:34.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.189+0000 7f697bfff700 1 Processor -- start 2023-10-08T15:37:34.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.189+0000 7f697bfff700 1 -- start start 2023-10-08T15:37:34.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.189+0000 7f697bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f697c06be60 0x7f697c09fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.189+0000 7f697bfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f697c06cc40 0x7f697c09e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.189+0000 7f697bfff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f697c14ac50 0x7f697c15b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.189+0000 7f697bfff700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697c0a1330 con 0x7f697c06cc40 2023-10-08T15:37:34.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.189+0000 7f697bfff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697c15b050 con 0x7f697c06be60 2023-10-08T15:37:34.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.189+0000 7f697bfff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f697c0a0390 con 0x7f697c14ac50 2023-10-08T15:37:34.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.189+0000 7f697a7fc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f697c06cc40 0x7f697c09e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:34.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.189+0000 7f697a7fc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f697c06cc40 0x7f697c09e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47694/0 (socket says 172.21.15.3:47694) 2023-10-08T15:37:34.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.189+0000 7f697a7fc700 1 -- 172.21.15.3:0/310927083 learned_addr learned my addr 172.21.15.3:0/310927083 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:34.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.189+0000 7f697b7fe700 1 --2- 172.21.15.3:0/310927083 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f697c14ac50 0x7f697c15b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:34.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.189+0000 7f697affd700 1 --2- 172.21.15.3:0/310927083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f697c06be60 0x7f697c09fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:34.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.189+0000 7f697a7fc700 1 -- 172.21.15.3:0/310927083 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f697c14ac50 msgr2=0x7f697c15b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.189+0000 7f697a7fc700 1 --2- 172.21.15.3:0/310927083 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f697c14ac50 0x7f697c15b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.189+0000 7f697a7fc700 1 -- 172.21.15.3:0/310927083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f697c06be60 msgr2=0x7f697c09fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.189+0000 7f697a7fc700 1 --2- 172.21.15.3:0/310927083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f697c06be60 0x7f697c09fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.189+0000 7f697a7fc700 1 -- 172.21.15.3:0/310927083 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f696c009ae0 con 0x7f697c06cc40 2023-10-08T15:37:34.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.193+0000 7f697a7fc700 1 --2- 172.21.15.3:0/310927083 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f697c06cc40 0x7f697c09e680 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f696c009880 tx=0x7f696c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:34.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.193+0000 7f6962ffd700 1 -- 172.21.15.3:0/310927083 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696c008980 con 0x7f697c06cc40 2023-10-08T15:37:34.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.193+0000 7f6962ffd700 1 -- 172.21.15.3:0/310927083 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f696c008ae0 con 0x7f697c06cc40 2023-10-08T15:37:34.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.193+0000 7f697bfff700 1 -- 172.21.15.3:0/310927083 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f697c15aa00 con 0x7f697c06cc40 2023-10-08T15:37:34.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.193+0000 7f6962ffd700 1 -- 172.21.15.3:0/310927083 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696c008ea0 con 0x7f697c06cc40 2023-10-08T15:37:34.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.193+0000 7f697bfff700 1 -- 172.21.15.3:0/310927083 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f697c15ba20 con 0x7f697c06cc40 2023-10-08T15:37:34.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.193+0000 7f697bfff700 1 -- 172.21.15.3:0/310927083 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f697c15ae20 con 0x7f697c06cc40 2023-10-08T15:37:34.201 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.197+0000 7f6962ffd700 1 -- 172.21.15.3:0/310927083 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f696c003040 con 0x7f697c06cc40 2023-10-08T15:37:34.202 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.197+0000 7f6962ffd700 1 --2- 172.21.15.3:0/310927083 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f6968060550 0x7f6968062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.202 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.197+0000 7f6962ffd700 1 -- 172.21.15.3:0/310927083 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f696c07e630 con 0x7f697c06cc40 2023-10-08T15:37:34.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.197+0000 7f697affd700 1 --2- 172.21.15.3:0/310927083 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f6968060550 0x7f6968062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:34.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.197+0000 7f697affd700 1 --2- 172.21.15.3:0/310927083 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f6968060550 0x7f6968062a00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6970007130 tx=0x7f6970000bc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:34.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.201+0000 7f6962ffd700 1 -- 172.21.15.3:0/310927083 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f696c04ec30 con 0x7f697c06cc40 2023-10-08T15:37:34.367 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.361+0000 7f697bfff700 1 -- 172.21.15.3:0/310927083 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f697c15ae20 con 0x7f697c06cc40 2023-10-08T15:37:34.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.361+0000 7f6962ffd700 1 -- 172.21.15.3:0/310927083 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15254 (secure 0 0 0) 0x7f697c15ae20 con 0x7f697c06cc40 2023-10-08T15:37:34.369 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:37:34.369 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":20,"fsid":"7635972e-cd66-4a8f-a231-378db8b3847a","created":"2023-10-08T15:37:08.234594+0000","modified":"2023-10-08T15:37:27.007828+0000","last_up_change":"2023-10-08T15:37:17.537726+0000","last_in_change":"2023-10-08T15:37:10.269178+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:37:16.581590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:37:23.353518+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T15:37:24.365114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"64fb1864-bfdd-4d75-9b41-03fb60085dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33363},{"type":"v1","addr":"172.21.15.3:6801","nonce":33363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33363},{"type":"v1","addr":"172.21.15.3:6803","nonce":33363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":33363},{"type":"v1","addr":"172.21.15.3:6807","nonce":33363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33363},{"type":"v1","addr":"172.21.15.3:6805","nonce":33363}]},"public_addr":"172.21.15.3:6801/33363","cluster_addr":"172.21.15.3:6803/33363","heartbeat_back_addr":"172.21.15.3:6807/33363","heartbeat_front_addr":"172.21.15.3:6805/33363","state":["exists","up"]},{"osd":1,"uuid":"3ca6bd3a-3e8a-4c65-af9c-46148b0c2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33364},{"type":"v1","addr":"172.21.15.3:6820","nonce":33364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33364},{"type":"v1","addr":"172.21.15.3:6824","nonce":33364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33364},{"type":"v1","addr":"172.21.15.3:6831","nonce":33364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33364},{"type":"v1","addr":"172.21.15.3:6828","nonce":33364}]},"public_addr":"172.21.15.3:6820/33364","cluster_addr":"172.21.15.3:6824/33364","heartbeat_back_addr":"172.21.15.3:6831/33364","heartbeat_front_addr":"172.21.15.3:6828/33364","state":["exists","up"]},{"osd":2,"uuid":"6eb9f757-58dd-442f-910d-32401454bce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33366},{"type":"v1","addr":"172.21.15.3:6817","nonce":33366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":33366},{"type":"v1","addr":"172.21.15.3:6821","nonce":33366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6827","nonce":33366},{"type":"v1","addr":"172.21.15.3:6829","nonce":33366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":33366},{"type":"v1","addr":"172.21.15.3:6825","nonce":33366}]},"public_addr":"172.21.15.3:6817/33366","cluster_addr":"172.21.15.3:6821/33366","heartbeat_back_addr":"172.21.15.3:6829/33366","heartbeat_front_addr":"172.21.15.3:6825/33366","state":["exists","up"]},{"osd":3,"uuid":"1c39866b-ac2e-4ea9-a69c-02b01ee4191d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33365},{"type":"v1","addr":"172.21.15.3:6809","nonce":33365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":33365},{"type":"v1","addr":"172.21.15.3:6811","nonce":33365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33365},{"type":"v1","addr":"172.21.15.3:6815","nonce":33365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":33365},{"type":"v1","addr":"172.21.15.3:6813","nonce":33365}]},"public_addr":"172.21.15.3:6809/33365","cluster_addr":"172.21.15.3:6811/33365","heartbeat_back_addr":"172.21.15.3:6815/33365","heartbeat_front_addr":"172.21.15.3:6813/33365","state":["exists","up"]},{"osd":4,"uuid":"15f86b61-b7f1-4780-ae00-9d80a68cb830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":33605},{"type":"v1","addr":"172.21.15.50:6809","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33605},{"type":"v1","addr":"172.21.15.50:6811","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33605},{"type":"v1","addr":"172.21.15.50:6815","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":33605},{"type":"v1","addr":"172.21.15.50:6813","nonce":33605}]},"public_addr":"172.21.15.50:6809/33605","cluster_addr":"172.21.15.50:6811/33605","heartbeat_back_addr":"172.21.15.50:6815/33605","heartbeat_front_addr":"172.21.15.50:6813/33605","state":["exists","up"]},{"osd":5,"uuid":"726c3003-34e6-4d5a-b6e2-f911e13c2118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33606},{"type":"v1","addr":"172.21.15.50:6801","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33606},{"type":"v1","addr":"172.21.15.50:6803","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33606},{"type":"v1","addr":"172.21.15.50:6807","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":33606},{"type":"v1","addr":"172.21.15.50:6805","nonce":33606}]},"public_addr":"172.21.15.50:6801/33606","cluster_addr":"172.21.15.50:6803/33606","heartbeat_back_addr":"172.21.15.50:6807/33606","heartbeat_front_addr":"172.21.15.50:6805/33606","state":["exists","up"]},{"osd":6,"uuid":"401122a4-9988-441f-a5a7-39164434ebcd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":33607},{"type":"v1","addr":"172.21.15.50:6819","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":33607},{"type":"v1","addr":"172.21.15.50:6823","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":33607},{"type":"v1","addr":"172.21.15.50:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":33607},{"type":"v1","addr":"172.21.15.50:6827","nonce":33607}]},"public_addr":"172.21.15.50:6819/33607","cluster_addr":"172.21.15.50:6823/33607","heartbeat_back_addr":"172.21.15.50:6831/33607","heartbeat_front_addr":"172.21.15.50:6827/33607","state":["exists","up"]},{"osd":7,"uuid":"6b3fa236-c9d0-4c4d-82ae-9af4daf6d699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33604},{"type":"v1","addr":"172.21.15.50:6818","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":33604},{"type":"v1","addr":"172.21.15.50:6822","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":33604},{"type":"v1","addr":"172.21.15.50:6830","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":33604},{"type":"v1","addr":"172.21.15.50:6826","nonce":33604}]},"public_addr":"172.21.15.50:6818/33604","cluster_addr":"172.21.15.50:6822/33604","heartbeat_back_addr":"172.21.15.50:6830/33604","heartbeat_front_addr":"172.21.15.50:6826/33604","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.497794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.529417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.873426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.325972+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.443971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.240795+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.739632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.643026+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:37:34.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.365+0000 7f697bfff700 1 -- 172.21.15.3:0/310927083 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f6968060550 msgr2=0x7f6968062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.365+0000 7f697bfff700 1 --2- 172.21.15.3:0/310927083 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f6968060550 0x7f6968062a00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6970007130 tx=0x7f6970000bc0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.365+0000 7f697bfff700 1 -- 172.21.15.3:0/310927083 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f697c06cc40 msgr2=0x7f697c09e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.365+0000 7f697bfff700 1 --2- 172.21.15.3:0/310927083 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f697c06cc40 0x7f697c09e680 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f696c009880 tx=0x7f696c018000 comp rx=0 tx=0).stop 2023-10-08T15:37:34.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.365+0000 7f697bfff700 1 -- 172.21.15.3:0/310927083 shutdown_connections 2023-10-08T15:37:34.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.365+0000 7f697bfff700 1 --2- 172.21.15.3:0/310927083 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f6968060550 0x7f6968062a00 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.365+0000 7f697bfff700 1 --2- 172.21.15.3:0/310927083 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f697c14ac50 0x7f697c15b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.365+0000 7f697bfff700 1 --2- 172.21.15.3:0/310927083 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f697c06cc40 0x7f697c09e680 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.365+0000 7f697bfff700 1 --2- 172.21.15.3:0/310927083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f697c06be60 0x7f697c09fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.365+0000 7f697bfff700 1 -- 172.21.15.3:0/310927083 >> 172.21.15.3:0/310927083 conn(0x7f697c0c1df0 msgr2=0x7f697c14d910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:34.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.365+0000 7f697bfff700 1 -- 172.21.15.3:0/310927083 shutdown_connections 2023-10-08T15:37:34.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.365+0000 7f697bfff700 1 -- 172.21.15.3:0/310927083 wait complete. 2023-10-08T15:37:34.387 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-08T15:37:34.387 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:37:34.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.485+0000 7fabd9232700 1 Processor -- start 2023-10-08T15:37:34.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.485+0000 7fabd9232700 1 -- start start 2023-10-08T15:37:34.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.489+0000 7fabd9232700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fabd40bbcd0 0x7fabd40bc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.489+0000 7fabd9232700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fabd40b3280 0x7fabd40b2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.489+0000 7fabd9232700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabd41495c0 con 0x7fabd40be5f0 2023-10-08T15:37:34.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.489+0000 7fabd9232700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabd40bd9e0 con 0x7fabd40b3280 2023-10-08T15:37:34.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.489+0000 7fabd9232700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabd40b1e80 con 0x7fabd40bbcd0 2023-10-08T15:37:34.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.489+0000 7fabcbfff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fabd40b3280 0x7fabd40b2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:34.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.489+0000 7fabcbfff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fabd40b3280 0x7fabd40b2310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47706/0 (socket says 172.21.15.3:47706) 2023-10-08T15:37:34.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.489+0000 7fabcbfff700 1 -- 172.21.15.3:0/2743149338 learned_addr learned my addr 172.21.15.3:0/2743149338 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:34.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.489+0000 7fabd3fff700 1 --2- 172.21.15.3:0/2743149338 >> v2:172.21.15.50:3300/0 conn(0x7fabd40bbcd0 0x7fabd40bc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:34.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.489+0000 7fabcbfff700 1 -- 172.21.15.3:0/2743149338 >> v2:172.21.15.50:3300/0 conn(0x7fabd40bbcd0 msgr2=0x7fabd40bc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:34.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.489+0000 7fabcbfff700 1 --2- 172.21.15.3:0/2743149338 >> v2:172.21.15.50:3300/0 conn(0x7fabd40bbcd0 0x7fabd40bc0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.489+0000 7fabcbfff700 1 -- 172.21.15.3:0/2743149338 >> v1:172.21.15.50:6789/0 conn(0x7fabd40be5f0 legacy=0x7fabd4147970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:34.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.489+0000 7fabcbfff700 1 -- 172.21.15.3:0/2743149338 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd40bd700 con 0x7fabd40b3280 2023-10-08T15:37:34.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.489+0000 7fabd3fff700 1 --2- 172.21.15.3:0/2743149338 >> v2:172.21.15.50:3300/0 conn(0x7fabd40bbcd0 0x7fabd40bc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:37:34.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.489+0000 7fabcbfff700 1 --2- 172.21.15.3:0/2743149338 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fabd40b3280 0x7fabd40b2310 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fabd406e110 tx=0x7fabbc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7b8d3c3afcd4c4d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:34.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.489+0000 7fabd37fe700 1 -- 172.21.15.3:0/2743149338 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabbc00b820 con 0x7fabd40b3280 2023-10-08T15:37:34.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.489+0000 7fabd37fe700 1 -- 172.21.15.3:0/2743149338 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabbc00b980 con 0x7fabd40b3280 2023-10-08T15:37:34.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.489+0000 7fabd37fe700 1 -- 172.21.15.3:0/2743149338 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabbc00bd20 con 0x7fabd40b3280 2023-10-08T15:37:34.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.489+0000 7fabd9232700 1 -- 172.21.15.3:0/2743149338 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fabd40b3280 msgr2=0x7fabd40b2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.489+0000 7fabd9232700 1 --2- 172.21.15.3:0/2743149338 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fabd40b3280 0x7fabd40b2310 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fabd406e110 tx=0x7fabbc009250 comp rx=0 tx=0).stop 2023-10-08T15:37:34.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.489+0000 7fabd9232700 1 -- 172.21.15.3:0/2743149338 shutdown_connections 2023-10-08T15:37:34.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.489+0000 7fabd9232700 1 --2- 172.21.15.3:0/2743149338 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fabd40b3280 0x7fabd40b2310 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.489+0000 7fabd9232700 1 --2- 172.21.15.3:0/2743149338 >> v2:172.21.15.50:3300/0 conn(0x7fabd40bbcd0 0x7fabd40bc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.489+0000 7fabd9232700 1 -- 172.21.15.3:0/2743149338 >> 172.21.15.3:0/2743149338 conn(0x7fabd40bf5e0 msgr2=0x7fabd40bb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:34.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.489+0000 7fabd9232700 1 -- 172.21.15.3:0/2743149338 shutdown_connections 2023-10-08T15:37:34.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.489+0000 7fabd9232700 1 -- 172.21.15.3:0/2743149338 wait complete. 2023-10-08T15:37:34.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.493+0000 7fabd9232700 1 Processor -- start 2023-10-08T15:37:34.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.493+0000 7fabd9232700 1 -- start start 2023-10-08T15:37:34.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.493+0000 7fabd9232700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fabd40b3280 0x7fabd41449c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.493+0000 7fabd9232700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabd40bbcd0 0x7fabd414b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.493+0000 7fabd9232700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fabd40be5f0 0x7fabd414b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.493+0000 7fabd9232700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd4137b40 con 0x7fabd40b3280 2023-10-08T15:37:34.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.493+0000 7fabd9232700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd415ce80 con 0x7fabd40bbcd0 2023-10-08T15:37:34.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.493+0000 7fabd9232700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd4144f00 con 0x7fabd40be5f0 2023-10-08T15:37:34.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.493+0000 7fabd3fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fabd40b3280 0x7fabd41449c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:34.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.493+0000 7fabd3fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fabd40b3280 0x7fabd41449c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47712/0 (socket says 172.21.15.3:47712) 2023-10-08T15:37:34.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.493+0000 7fabcbfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabd40bbcd0 0x7fabd414b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:34.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.493+0000 7fabd3fff700 1 -- 172.21.15.3:0/74093077 learned_addr learned my addr 172.21.15.3:0/74093077 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:34.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.493+0000 7fabd8a31700 1 --2- 172.21.15.3:0/74093077 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fabd40be5f0 0x7fabd414b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:34.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.493+0000 7fabd3fff700 1 -- 172.21.15.3:0/74093077 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fabd40be5f0 msgr2=0x7fabd414b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.493+0000 7fabd3fff700 1 --2- 172.21.15.3:0/74093077 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fabd40be5f0 0x7fabd414b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.501 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.493+0000 7fabd3fff700 1 -- 172.21.15.3:0/74093077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabd40bbcd0 msgr2=0x7fabd414b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.501 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.493+0000 7fabd3fff700 1 --2- 172.21.15.3:0/74093077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabd40bbcd0 0x7fabd414b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.501 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.493+0000 7fabd3fff700 1 -- 172.21.15.3:0/74093077 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabbc0094f0 con 0x7fabd40b3280 2023-10-08T15:37:34.501 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.493+0000 7fabd3fff700 1 --2- 172.21.15.3:0/74093077 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fabd40b3280 0x7fabd41449c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fabc400c860 tx=0x7fabc4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:34.502 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.493+0000 7fabd0ff9700 1 -- 172.21.15.3:0/74093077 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc4005a00 con 0x7fabd40b3280 2023-10-08T15:37:34.502 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.493+0000 7fabd0ff9700 1 -- 172.21.15.3:0/74093077 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc4005b60 con 0x7fabd40b3280 2023-10-08T15:37:34.502 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.493+0000 7fabd9232700 1 -- 172.21.15.3:0/74093077 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabd415c830 con 0x7fabd40b3280 2023-10-08T15:37:34.502 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.493+0000 7fabd0ff9700 1 -- 172.21.15.3:0/74093077 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc4011600 con 0x7fabd40b3280 2023-10-08T15:37:34.502 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.493+0000 7fabd9232700 1 -- 172.21.15.3:0/74093077 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabd4143c10 con 0x7fabd40b3280 2023-10-08T15:37:34.502 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.497+0000 7fabd9232700 1 -- 172.21.15.3:0/74093077 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabd405ecf0 con 0x7fabd40b3280 2023-10-08T15:37:34.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.497+0000 7fabd0ff9700 1 -- 172.21.15.3:0/74093077 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fabc40119b0 con 0x7fabd40b3280 2023-10-08T15:37:34.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.497+0000 7fabd0ff9700 1 --2- 172.21.15.3:0/74093077 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fabb4060550 0x7fabb4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.497+0000 7fabd0ff9700 1 -- 172.21.15.3:0/74093077 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fabc407c500 con 0x7fabd40b3280 2023-10-08T15:37:34.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.497+0000 7fabcbfff700 1 --2- 172.21.15.3:0/74093077 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fabb4060550 0x7fabb4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:34.505 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.497+0000 7fabcbfff700 1 --2- 172.21.15.3:0/74093077 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fabb4060550 0x7fabb4062a00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fabd406e110 tx=0x7fabbc016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:34.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.501+0000 7fabd0ff9700 1 -- 172.21.15.3:0/74093077 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fabc4050580 con 0x7fabd40b3280 2023-10-08T15:37:34.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.665+0000 7fabd9232700 1 -- 172.21.15.3:0/74093077 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fabd40bd3d0 con 0x7fabd40b3280 2023-10-08T15:37:34.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.669+0000 7fabd0ff9700 1 -- 172.21.15.3:0/74093077 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15254 (secure 0 0 0) 0x7fabc4050110 con 0x7fabd40b3280 2023-10-08T15:37:34.674 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:37:34.674 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":20,"fsid":"7635972e-cd66-4a8f-a231-378db8b3847a","created":"2023-10-08T15:37:08.234594+0000","modified":"2023-10-08T15:37:27.007828+0000","last_up_change":"2023-10-08T15:37:17.537726+0000","last_in_change":"2023-10-08T15:37:10.269178+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:37:16.581590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:37:23.353518+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T15:37:24.365114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"64fb1864-bfdd-4d75-9b41-03fb60085dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33363},{"type":"v1","addr":"172.21.15.3:6801","nonce":33363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33363},{"type":"v1","addr":"172.21.15.3:6803","nonce":33363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":33363},{"type":"v1","addr":"172.21.15.3:6807","nonce":33363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33363},{"type":"v1","addr":"172.21.15.3:6805","nonce":33363}]},"public_addr":"172.21.15.3:6801/33363","cluster_addr":"172.21.15.3:6803/33363","heartbeat_back_addr":"172.21.15.3:6807/33363","heartbeat_front_addr":"172.21.15.3:6805/33363","state":["exists","up"]},{"osd":1,"uuid":"3ca6bd3a-3e8a-4c65-af9c-46148b0c2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33364},{"type":"v1","addr":"172.21.15.3:6820","nonce":33364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33364},{"type":"v1","addr":"172.21.15.3:6824","nonce":33364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33364},{"type":"v1","addr":"172.21.15.3:6831","nonce":33364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33364},{"type":"v1","addr":"172.21.15.3:6828","nonce":33364}]},"public_addr":"172.21.15.3:6820/33364","cluster_addr":"172.21.15.3:6824/33364","heartbeat_back_addr":"172.21.15.3:6831/33364","heartbeat_front_addr":"172.21.15.3:6828/33364","state":["exists","up"]},{"osd":2,"uuid":"6eb9f757-58dd-442f-910d-32401454bce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33366},{"type":"v1","addr":"172.21.15.3:6817","nonce":33366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":33366},{"type":"v1","addr":"172.21.15.3:6821","nonce":33366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6827","nonce":33366},{"type":"v1","addr":"172.21.15.3:6829","nonce":33366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":33366},{"type":"v1","addr":"172.21.15.3:6825","nonce":33366}]},"public_addr":"172.21.15.3:6817/33366","cluster_addr":"172.21.15.3:6821/33366","heartbeat_back_addr":"172.21.15.3:6829/33366","heartbeat_front_addr":"172.21.15.3:6825/33366","state":["exists","up"]},{"osd":3,"uuid":"1c39866b-ac2e-4ea9-a69c-02b01ee4191d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33365},{"type":"v1","addr":"172.21.15.3:6809","nonce":33365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":33365},{"type":"v1","addr":"172.21.15.3:6811","nonce":33365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33365},{"type":"v1","addr":"172.21.15.3:6815","nonce":33365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":33365},{"type":"v1","addr":"172.21.15.3:6813","nonce":33365}]},"public_addr":"172.21.15.3:6809/33365","cluster_addr":"172.21.15.3:6811/33365","heartbeat_back_addr":"172.21.15.3:6815/33365","heartbeat_front_addr":"172.21.15.3:6813/33365","state":["exists","up"]},{"osd":4,"uuid":"15f86b61-b7f1-4780-ae00-9d80a68cb830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":33605},{"type":"v1","addr":"172.21.15.50:6809","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33605},{"type":"v1","addr":"172.21.15.50:6811","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33605},{"type":"v1","addr":"172.21.15.50:6815","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":33605},{"type":"v1","addr":"172.21.15.50:6813","nonce":33605}]},"public_addr":"172.21.15.50:6809/33605","cluster_addr":"172.21.15.50:6811/33605","heartbeat_back_addr":"172.21.15.50:6815/33605","heartbeat_front_addr":"172.21.15.50:6813/33605","state":["exists","up"]},{"osd":5,"uuid":"726c3003-34e6-4d5a-b6e2-f911e13c2118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33606},{"type":"v1","addr":"172.21.15.50:6801","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33606},{"type":"v1","addr":"172.21.15.50:6803","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33606},{"type":"v1","addr":"172.21.15.50:6807","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":33606},{"type":"v1","addr":"172.21.15.50:6805","nonce":33606}]},"public_addr":"172.21.15.50:6801/33606","cluster_addr":"172.21.15.50:6803/33606","heartbeat_back_addr":"172.21.15.50:6807/33606","heartbeat_front_addr":"172.21.15.50:6805/33606","state":["exists","up"]},{"osd":6,"uuid":"401122a4-9988-441f-a5a7-39164434ebcd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":33607},{"type":"v1","addr":"172.21.15.50:6819","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":33607},{"type":"v1","addr":"172.21.15.50:6823","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":33607},{"type":"v1","addr":"172.21.15.50:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":33607},{"type":"v1","addr":"172.21.15.50:6827","nonce":33607}]},"public_addr":"172.21.15.50:6819/33607","cluster_addr":"172.21.15.50:6823/33607","heartbeat_back_addr":"172.21.15.50:6831/33607","heartbeat_front_addr":"172.21.15.50:6827/33607","state":["exists","up"]},{"osd":7,"uuid":"6b3fa236-c9d0-4c4d-82ae-9af4daf6d699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33604},{"type":"v1","addr":"172.21.15.50:6818","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":33604},{"type":"v1","addr":"172.21.15.50:6822","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":33604},{"type":"v1","addr":"172.21.15.50:6830","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":33604},{"type":"v1","addr":"172.21.15.50:6826","nonce":33604}]},"public_addr":"172.21.15.50:6818/33604","cluster_addr":"172.21.15.50:6822/33604","heartbeat_back_addr":"172.21.15.50:6830/33604","heartbeat_front_addr":"172.21.15.50:6826/33604","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.497794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.529417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.873426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.325972+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.443971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.240795+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.739632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.643026+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:37:34.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.669+0000 7fabd9232700 1 -- 172.21.15.3:0/74093077 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fabb4060550 msgr2=0x7fabb4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.669+0000 7fabd9232700 1 --2- 172.21.15.3:0/74093077 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fabb4060550 0x7fabb4062a00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fabd406e110 tx=0x7fabbc016000 comp rx=0 tx=0).stop 2023-10-08T15:37:34.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.669+0000 7fabd9232700 1 -- 172.21.15.3:0/74093077 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fabd40b3280 msgr2=0x7fabd41449c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.669+0000 7fabd9232700 1 --2- 172.21.15.3:0/74093077 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fabd40b3280 0x7fabd41449c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fabc400c860 tx=0x7fabc4008040 comp rx=0 tx=0).stop 2023-10-08T15:37:34.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.669+0000 7fabd9232700 1 -- 172.21.15.3:0/74093077 shutdown_connections 2023-10-08T15:37:34.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.669+0000 7fabd9232700 1 --2- 172.21.15.3:0/74093077 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fabb4060550 0x7fabb4062a00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.669+0000 7fabd9232700 1 --2- 172.21.15.3:0/74093077 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fabd40be5f0 0x7fabd414b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.669+0000 7fabd9232700 1 --2- 172.21.15.3:0/74093077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabd40bbcd0 0x7fabd414b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.669+0000 7fabd9232700 1 --2- 172.21.15.3:0/74093077 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fabd40b3280 0x7fabd41449c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.669+0000 7fabd9232700 1 -- 172.21.15.3:0/74093077 >> 172.21.15.3:0/74093077 conn(0x7fabd40bf5e0 msgr2=0x7fabd4141450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:34.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.669+0000 7fabd9232700 1 -- 172.21.15.3:0/74093077 shutdown_connections 2023-10-08T15:37:34.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.669+0000 7fabd9232700 1 -- 172.21.15.3:0/74093077 wait complete. 2023-10-08T15:37:34.689 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-08T15:37:34.689 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-08T15:37:34.690 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-08T15:37:34.690 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-08T15:37:34.690 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-08T15:37:34.691 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-08T15:37:34.691 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-08T15:37:34.692 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-08T15:37:34.836 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.829+0000 7f392359e700 1 Processor -- start 2023-10-08T15:37:34.836 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.829+0000 7f34c6a10700 1 Processor -- start 2023-10-08T15:37:34.836 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.829+0000 7f392359e700 1 -- start start 2023-10-08T15:37:34.837 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.829+0000 7f34c6a10700 1 -- start start 2023-10-08T15:37:34.837 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.829+0000 7fe9f6b8c700 1 Processor -- start 2023-10-08T15:37:34.837 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.829+0000 7fdeb5ea3700 1 Processor -- start 2023-10-08T15:37:34.838 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.829+0000 7fe9f6b8c700 1 -- start start 2023-10-08T15:37:34.838 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.829+0000 7fdeb5ea3700 1 -- start start 2023-10-08T15:37:34.838 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.829+0000 7f21e874d700 1 Processor -- start 2023-10-08T15:37:34.839 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.829+0000 7f392359e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f392414f620 0x7f39240a0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.839 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.829+0000 7f392359e700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f3924152e00 0x7f39240baf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.839 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.829+0000 7f392359e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3924153610 con 0x7f39240bab30 2023-10-08T15:37:34.839 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.829+0000 7f392359e700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3924153860 con 0x7f3924152e00 2023-10-08T15:37:34.839 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.829+0000 7f392359e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3924153b40 con 0x7f392414f620 2023-10-08T15:37:34.839 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.829+0000 7f21e874d700 1 -- start start 2023-10-08T15:37:34.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f34c6a10700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f34c0068320 0x7f34c00b2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f34c6a10700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f34c006d2b0 0x7f34c0148650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f34c6a10700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34c014bba0 con 0x7f34c00b1c30 2023-10-08T15:37:34.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f34c6a10700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34c0147af0 con 0x7f34c0068320 2023-10-08T15:37:34.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f34c6a10700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34c014be40 con 0x7f34c006d2b0 2023-10-08T15:37:34.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f3921d9b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f392414f620 0x7f39240a0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:34.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f3922d9d700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f3924152e00 0x7f39240baf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:34.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f3922d9d700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f3924152e00 0x7f39240baf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47722/0 (socket says 172.21.15.3:47722) 2023-10-08T15:37:34.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f3922d9d700 1 -- 172.21.15.3:0/1376530108 learned_addr learned my addr 172.21.15.3:0/1376530108 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:34.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f21e874d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f21e01471b0 0x7f21e014ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f21e874d700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21e00b1cd0 con 0x7f21e0068320 2023-10-08T15:37:34.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f21e874d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21e00b1f40 con 0x7f21e00b2740 2023-10-08T15:37:34.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f21e874d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21e0147610 con 0x7f21e01471b0 2023-10-08T15:37:34.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7fe9f6b8c700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fe9e80263e0 0x7fe9e800aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7fe9f6b8c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe9e802b5b0 0x7fe9e802b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7fe9f6b8c700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9e80d3730 con 0x7fe9e8007150 2023-10-08T15:37:34.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7fe9f6b8c700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9e802aeb0 con 0x7fe9e80263e0 2023-10-08T15:37:34.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7fe9f6b8c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9e80d2ba0 con 0x7fe9e802b5b0 2023-10-08T15:37:34.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f3922d9d700 1 -- 172.21.15.3:0/1376530108 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f392414f620 msgr2=0x7f39240a0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:34.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f3922d9d700 1 --2- 172.21.15.3:0/1376530108 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f392414f620 0x7f39240a0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f3922d9d700 1 -- 172.21.15.3:0/1376530108 >> v1:172.21.15.50:6789/0 conn(0x7f39240bab30 legacy=0x7f392409d7b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T15:37:34.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f3922d9d700 1 -- 172.21.15.3:0/1376530108 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f392409dec0 con 0x7f3924152e00 2023-10-08T15:37:34.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7fe9f5389700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fe9e80263e0 0x7fe9e800aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:34.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7fe9f5389700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fe9e80263e0 0x7fe9e800aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47730/0 (socket says 172.21.15.3:47730) 2023-10-08T15:37:34.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7fe9f5389700 1 -- 172.21.15.3:0/3935026582 learned_addr learned my addr 172.21.15.3:0/3935026582 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:34.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f34bf7fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f34c00b1c30 0x7f34c0147f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.3:46118/0 (socket says 172.21.15.3:46118) 2023-10-08T15:37:34.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f34c4fad700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f34c006d2b0 0x7f34c0148650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:34.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f34bf7fe700 1 -- 172.21.15.3:0/1152722116 learned_addr learned my addr 172.21.15.3:0/1152722116 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:34.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7fdeb5ea3700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdeb006e580 0x7fdeb009ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7fdeb5ea3700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeb009f160 con 0x7fdeb00a2470 2023-10-08T15:37:34.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7fdeaffff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fdeb00a2470 0x7fdeb009d6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:53814/0 (socket says 172.21.15.3:53814) 2023-10-08T15:37:34.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7fdeaffff700 1 -- 172.21.15.3:0/2906013900 learned_addr learned my addr 172.21.15.3:0/2906013900 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:34.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f34bffff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f34c0068320 0x7f34c00b2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:34.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7fdeb5ea3700 1 -- 172.21.15.3:0/2906013900 --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeb00a1fe0 con 0x7fdeb0147a50 2023-10-08T15:37:34.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7fdeb5ea3700 1 -- 172.21.15.3:0/2906013900 --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeb014c040 con 0x7fdeb006e580 2023-10-08T15:37:34.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f21e6cea700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f21e01471b0 0x7f21e014ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:34.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f21e6cea700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f21e01471b0 0x7f21e014ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.3:36850/0 (socket says 172.21.15.3:36850) 2023-10-08T15:37:34.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f21e6cea700 1 -- 172.21.15.3:0/1486192300 learned_addr learned my addr 172.21.15.3:0/1486192300 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:34.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f34beffd700 1 -- 172.21.15.3:0/1152722116 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 57579881 0 0) 0x7f34c014bba0 con 0x7f34c00b1c30 2023-10-08T15:37:34.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f34beffd700 1 -- 172.21.15.3:0/1152722116 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34a8003570 con 0x7f34c00b1c30 2023-10-08T15:37:34.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7fdeb56a2700 1 --2- 172.21.15.3:0/2906013900 >> v2:172.21.15.50:3300/0 conn(0x7fdeb006e580 0x7fdeb009ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:34.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7fdeaf7fe700 1 -- 172.21.15.3:0/2906013900 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2789890412 0 0) 0x7fdeb00a1fe0 con 0x7fdeb0147a50 2023-10-08T15:37:34.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7fdeaf7fe700 1 -- 172.21.15.3:0/2906013900 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde98003570 con 0x7fdeb0147a50 2023-10-08T15:37:34.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7fdeaf7fe700 1 -- 172.21.15.3:0/2906013900 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3457184311 0 0) 0x7fdea8001490 con 0x7fdeb00a2470 2023-10-08T15:37:34.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7fdeaf7fe700 1 -- 172.21.15.3:0/2906013900 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde980048f0 con 0x7fdeb00a2470 2023-10-08T15:37:34.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7fe9f5389700 1 -- 172.21.15.3:0/3935026582 >> v2:172.21.15.50:3300/0 conn(0x7fe9e802b5b0 msgr2=0x7fe9e802b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:34.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7fe9f5389700 1 --2- 172.21.15.3:0/3935026582 >> v2:172.21.15.50:3300/0 conn(0x7fe9e802b5b0 0x7fe9e802b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7fe9f5389700 1 -- 172.21.15.3:0/3935026582 >> v1:172.21.15.3:6789/0 conn(0x7fe9e8007150 legacy=0x7fe9e8025cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7fe9f5389700 1 -- 172.21.15.3:0/3935026582 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e80d3a10 con 0x7fe9e80263e0 2023-10-08T15:37:34.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f34bffff700 1 -- 172.21.15.3:0/1152722116 >> v2:172.21.15.50:3300/0 conn(0x7f34c006d2b0 msgr2=0x7f34c0148650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:34.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f34bffff700 1 --2- 172.21.15.3:0/1152722116 >> v2:172.21.15.50:3300/0 conn(0x7f34c006d2b0 0x7f34c0148650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f34bffff700 1 -- 172.21.15.3:0/1152722116 >> v1:172.21.15.50:6789/0 conn(0x7f34c00b1c30 legacy=0x7f34c0147f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f34bffff700 1 -- 172.21.15.3:0/1152722116 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34c006daa0 con 0x7f34c0068320 2023-10-08T15:37:34.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f4a0dafb700 1 Processor -- start 2023-10-08T15:37:34.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7fdeb56a2700 1 -- 172.21.15.3:0/2906013900 >> v1:172.21.15.50:6789/0 conn(0x7fdeb0147a50 legacy=0x7fdeb00bab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7fdeb56a2700 1 -- 172.21.15.3:0/2906013900 >> v1:172.21.15.3:6789/0 conn(0x7fdeb00a2470 legacy=0x7fdeb009d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7fdeb56a2700 1 -- 172.21.15.3:0/2906013900 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb006ed80 con 0x7fdeb006e580 2023-10-08T15:37:34.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f3922d9d700 1 --2- 172.21.15.3:0/1376530108 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3924152e00 0x7f39240baf00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f39180099b0 tx=0x7f3918009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a52f19f6d9ec2d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:34.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7fe9f5389700 1 --2- 172.21.15.3:0/3935026582 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe9e80263e0 0x7fe9e800aeb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe9e8029ba0 tx=0x7fe9e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b3e277c2e2e8a46 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:34.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f34bffff700 1 --2- 172.21.15.3:0/1152722116 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f34c0068320 0x7f34c00b2440 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f34c006ba30 tx=0x7f34b400b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aac5570458953129 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:34.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f4a0dafb700 1 -- start start 2023-10-08T15:37:34.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f4a0dafb700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4a080bb040 0x7f4a080a2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f4a0dafb700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4a0809e490 0x7f4a080688d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f4a0dafb700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a08068440 con 0x7f4a08153050 2023-10-08T15:37:34.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f4a0dafb700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a0809f270 con 0x7f4a080bb040 2023-10-08T15:37:34.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f4a0dafb700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a080680f0 con 0x7f4a0809e490 2023-10-08T15:37:34.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f4a07fff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f4a08153050 0x7f4a0806d5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:53832/0 (socket says 172.21.15.3:53832) 2023-10-08T15:37:34.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f4a07fff700 1 -- 172.21.15.3:0/2873650340 learned_addr learned my addr 172.21.15.3:0/2873650340 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:34.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f4a06ffd700 1 --2- 172.21.15.3:0/2873650340 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4a0809e490 0x7f4a080688d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:34.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7fdeb56a2700 1 --2- 172.21.15.3:0/2906013900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdeb006e580 0x7fdeb009ec20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdea00098e0 tx=0x7fdea00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8192d0c91549858e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:34.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f21e54e7700 1 -- 172.21.15.3:0/1486192300 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2538446972 0 0) 0x7f21e00b1f40 con 0x7f21e00b2740 2023-10-08T15:37:34.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f21e54e7700 1 -- 172.21.15.3:0/1486192300 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21cc003570 con 0x7f21e00b2740 2023-10-08T15:37:34.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f392159a700 1 -- 172.21.15.3:0/1376530108 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391800b820 con 0x7f3924152e00 2023-10-08T15:37:34.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7fe9f4b88700 1 -- 172.21.15.3:0/3935026582 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e000b820 con 0x7fe9e80263e0 2023-10-08T15:37:34.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f21e6cea700 1 -- 172.21.15.3:0/1486192300 >> v1:172.21.15.50:6789/0 conn(0x7f21e00b2740 legacy=0x7f21e0146aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f21e6cea700 1 -- 172.21.15.3:0/1486192300 >> v1:172.21.15.3:6789/0 conn(0x7f21e0068320 legacy=0x7f21e006cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f21e6cea700 1 -- 172.21.15.3:0/1486192300 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e00b2220 con 0x7f21e01471b0 2023-10-08T15:37:34.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f4a06ffd700 1 -- 172.21.15.3:0/2873650340 >> v2:172.21.15.50:3300/0 conn(0x7f4a080bb040 msgr2=0x7f4a080a2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:34.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f34beffd700 1 -- 172.21.15.3:0/1152722116 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b400d960 con 0x7f34c0068320 2023-10-08T15:37:34.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f4a06ffd700 1 --2- 172.21.15.3:0/2873650340 >> v2:172.21.15.50:3300/0 conn(0x7f4a080bb040 0x7f4a080a2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f4a06ffd700 1 -- 172.21.15.3:0/2873650340 >> v1:172.21.15.3:6789/0 conn(0x7f4a08153050 legacy=0x7f4a0806d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f4a06ffd700 1 -- 172.21.15.3:0/2873650340 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a0809ea20 con 0x7f4a0809e490 2023-10-08T15:37:34.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f392159a700 1 -- 172.21.15.3:0/1376530108 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f391800b980 con 0x7f3924152e00 2023-10-08T15:37:34.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f392159a700 1 -- 172.21.15.3:0/1376530108 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391800bd20 con 0x7f3924152e00 2023-10-08T15:37:34.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7fdeaf7fe700 1 -- 172.21.15.3:0/2906013900 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea0011630 con 0x7fdeb006e580 2023-10-08T15:37:34.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f34beffd700 1 -- 172.21.15.3:0/1152722116 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34b400dac0 con 0x7f34c0068320 2023-10-08T15:37:34.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f34beffd700 1 -- 172.21.15.3:0/1152722116 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b400de40 con 0x7f34c0068320 2023-10-08T15:37:34.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7fdeaf7fe700 1 -- 172.21.15.3:0/2906013900 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdea0011790 con 0x7fdeb006e580 2023-10-08T15:37:34.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7fdeaf7fe700 1 -- 172.21.15.3:0/2906013900 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea0011b10 con 0x7fdeb006e580 2023-10-08T15:37:34.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f21e6cea700 1 --2- 172.21.15.3:0/1486192300 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21e01471b0 0x7f21e014ac90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f21dc0099b0 tx=0x7f21dc009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6ac2faaaa2db51f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:34.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f392359e700 1 -- 172.21.15.3:0/1376530108 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3924152e00 msgr2=0x7f39240baf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.857 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f392359e700 1 --2- 172.21.15.3:0/1376530108 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3924152e00 0x7f39240baf00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f39180099b0 tx=0x7f3918009250 comp rx=0 tx=0).stop 2023-10-08T15:37:34.857 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7f21e54e7700 1 -- 172.21.15.3:0/1486192300 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21dc009ea0 con 0x7f21e01471b0 2023-10-08T15:37:34.857 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f4a06ffd700 1 --2- 172.21.15.3:0/2873650340 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4a0809e490 0x7f4a080688d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f49fc0098e0 tx=0x7f49fc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aea6264d01a33998 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:34.857 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f4a067fc700 1 -- 172.21.15.3:0/2873650340 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49fc009e80 con 0x7f4a0809e490 2023-10-08T15:37:34.857 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.833+0000 7f4a067fc700 1 -- 172.21.15.3:0/2873650340 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49fc00b760 con 0x7f4a0809e490 2023-10-08T15:37:34.858 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7fe9f4b88700 1 -- 172.21.15.3:0/3935026582 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e000b980 con 0x7fe9e80263e0 2023-10-08T15:37:34.858 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7fe9f4b88700 1 -- 172.21.15.3:0/3935026582 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e000b820 con 0x7fe9e80263e0 2023-10-08T15:37:34.858 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7f21e54e7700 1 -- 172.21.15.3:0/1486192300 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21dc00c970 con 0x7f21e01471b0 2023-10-08T15:37:34.858 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7f21e54e7700 1 -- 172.21.15.3:0/1486192300 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21dc00ccf0 con 0x7f21e01471b0 2023-10-08T15:37:34.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7f392359e700 1 -- 172.21.15.3:0/1376530108 shutdown_connections 2023-10-08T15:37:34.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7f392359e700 1 --2- 172.21.15.3:0/1376530108 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3924152e00 0x7f39240baf00 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7f392359e700 1 --2- 172.21.15.3:0/1376530108 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f392414f620 0x7f39240a0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7f392359e700 1 -- 172.21.15.3:0/1376530108 >> 172.21.15.3:0/1376530108 conn(0x7f39240be440 msgr2=0x7f39240ba420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:34.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7f4a067fc700 1 -- 172.21.15.3:0/2873650340 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49fc00bae0 con 0x7f4a0809e490 2023-10-08T15:37:34.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7f34c6a10700 1 -- 172.21.15.3:0/1152722116 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f34c0068320 msgr2=0x7f34c00b2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7f34c6a10700 1 --2- 172.21.15.3:0/1152722116 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f34c0068320 0x7f34c00b2440 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f34c006ba30 tx=0x7f34b400b430 comp rx=0 tx=0).stop 2023-10-08T15:37:34.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7f34c6a10700 1 -- 172.21.15.3:0/1152722116 shutdown_connections 2023-10-08T15:37:34.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7f34c6a10700 1 --2- 172.21.15.3:0/1152722116 >> v2:172.21.15.50:3300/0 conn(0x7f34c006d2b0 0x7f34c0148650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7f34c6a10700 1 --2- 172.21.15.3:0/1152722116 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f34c0068320 0x7f34c00b2440 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7f34c6a10700 1 -- 172.21.15.3:0/1152722116 >> 172.21.15.3:0/1152722116 conn(0x7f34c00be640 msgr2=0x7f34c00ba6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:34.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7fdeb5ea3700 1 -- 172.21.15.3:0/2906013900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdeb006e580 msgr2=0x7fdeb009ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7fdeb5ea3700 1 --2- 172.21.15.3:0/2906013900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdeb006e580 0x7fdeb009ec20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdea00098e0 tx=0x7fdea00091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7fdeb5ea3700 1 -- 172.21.15.3:0/2906013900 shutdown_connections 2023-10-08T15:37:34.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7fdeb5ea3700 1 --2- 172.21.15.3:0/2906013900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdeb006e580 0x7fdeb009ec20 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7fdeb5ea3700 1 -- 172.21.15.3:0/2906013900 >> 172.21.15.3:0/2906013900 conn(0x7fdeb00be440 msgr2=0x7fdeb00ba420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:34.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7fdeb5ea3700 1 -- 172.21.15.3:0/2906013900 shutdown_connections 2023-10-08T15:37:34.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7fdeb5ea3700 1 -- 172.21.15.3:0/2906013900 wait complete. 2023-10-08T15:37:34.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7fe9f6b8c700 1 -- 172.21.15.3:0/3935026582 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe9e80263e0 msgr2=0x7fe9e800aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7fe9f6b8c700 1 --2- 172.21.15.3:0/3935026582 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe9e80263e0 0x7fe9e800aeb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe9e8029ba0 tx=0x7fe9e0009250 comp rx=0 tx=0).stop 2023-10-08T15:37:34.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7f21e874d700 1 -- 172.21.15.3:0/1486192300 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21e01471b0 msgr2=0x7f21e014ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7f21e874d700 1 --2- 172.21.15.3:0/1486192300 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21e01471b0 0x7f21e014ac90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f21dc0099b0 tx=0x7f21dc009250 comp rx=0 tx=0).stop 2023-10-08T15:37:34.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7f392359e700 1 -- 172.21.15.3:0/1376530108 shutdown_connections 2023-10-08T15:37:34.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7fe9f6b8c700 1 -- 172.21.15.3:0/3935026582 shutdown_connections 2023-10-08T15:37:34.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7fe9f6b8c700 1 --2- 172.21.15.3:0/3935026582 >> v2:172.21.15.50:3300/0 conn(0x7fe9e802b5b0 0x7fe9e802b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7fe9f6b8c700 1 --2- 172.21.15.3:0/3935026582 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe9e80263e0 0x7fe9e800aeb0 secure :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe9e8029ba0 tx=0x7fe9e0009250 comp rx=0 tx=0).stop 2023-10-08T15:37:34.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7fe9f6b8c700 1 -- 172.21.15.3:0/3935026582 >> 172.21.15.3:0/3935026582 conn(0x7fe9e8044500 msgr2=0x7fe9e800a590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:34.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7f34c6a10700 1 -- 172.21.15.3:0/1152722116 shutdown_connections 2023-10-08T15:37:34.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7f21e874d700 1 -- 172.21.15.3:0/1486192300 shutdown_connections 2023-10-08T15:37:34.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7f21e874d700 1 --2- 172.21.15.3:0/1486192300 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21e01471b0 0x7f21e014ac90 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7f21e874d700 1 -- 172.21.15.3:0/1486192300 >> 172.21.15.3:0/1486192300 conn(0x7f21e00be630 msgr2=0x7f21e00ba6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:34.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7f21e874d700 1 -- 172.21.15.3:0/1486192300 shutdown_connections 2023-10-08T15:37:34.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7f21e874d700 1 -- 172.21.15.3:0/1486192300 wait complete. 2023-10-08T15:37:34.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7fe9f6b8c700 1 -- 172.21.15.3:0/3935026582 shutdown_connections 2023-10-08T15:37:34.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7fe9f6b8c700 1 -- 172.21.15.3:0/3935026582 wait complete. 2023-10-08T15:37:34.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7f4a0dafb700 1 -- 172.21.15.3:0/2873650340 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4a0809e490 msgr2=0x7f4a080688d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7f4a0dafb700 1 --2- 172.21.15.3:0/2873650340 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4a0809e490 0x7f4a080688d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f49fc0098e0 tx=0x7f49fc0091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7f4a0dafb700 1 -- 172.21.15.3:0/2873650340 shutdown_connections 2023-10-08T15:37:34.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7f4a0dafb700 1 --2- 172.21.15.3:0/2873650340 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4a0809e490 0x7f4a080688d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7f4a0dafb700 1 --2- 172.21.15.3:0/2873650340 >> v2:172.21.15.50:3300/0 conn(0x7f4a080bb040 0x7f4a080a2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7f4a0dafb700 1 -- 172.21.15.3:0/2873650340 >> 172.21.15.3:0/2873650340 conn(0x7f4a080be630 msgr2=0x7f4a080ba6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:34.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7fe9f6b8c700 1 Processor -- start 2023-10-08T15:37:34.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7fe9f6b8c700 1 -- start start 2023-10-08T15:37:34.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7f21e874d700 1 Processor -- start 2023-10-08T15:37:34.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7f4a0dafb700 1 -- 172.21.15.3:0/2873650340 shutdown_connections 2023-10-08T15:37:34.867 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7fdeb5ea3700 1 Processor -- start 2023-10-08T15:37:34.867 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7fdeb5ea3700 1 -- start start 2023-10-08T15:37:34.867 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7f21e874d700 1 -- start start 2023-10-08T15:37:34.868 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7fdeb5ea3700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdeb006e580 0x7fdeb015c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.868 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7fdeb5ea3700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdeb00a2470 0x7fdeb0141a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.868 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7fdeb5ea3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdeb0147a50 0x7fdeb0141fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.868 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7fdeb5ea3700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb01437b0 con 0x7fdeb00a2470 2023-10-08T15:37:34.868 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7fdeb5ea3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb015cd00 con 0x7fdeb0147a50 2023-10-08T15:37:34.868 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7fdeb5ea3700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb0142b20 con 0x7fdeb006e580 2023-10-08T15:37:34.868 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7f392359e700 1 -- 172.21.15.3:0/1376530108 wait complete. 2023-10-08T15:37:34.869 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7fdeaffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdeb00a2470 0x7fdeb0141a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:34.869 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7fdeaffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdeb00a2470 0x7fdeb0141a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47732/0 (socket says 172.21.15.3:47732) 2023-10-08T15:37:34.869 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7fdeaffff700 1 -- 172.21.15.3:0/1886919232 learned_addr learned my addr 172.21.15.3:0/1886919232 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:34.869 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7fe9f6b8c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe9e8007150 0x7fe9e8005f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.869 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7fe9f6b8c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe9e802b5b0 0x7fe9e80d5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.870 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7fe9f6b8c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9e8025ee0 0x7fe9e80d6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.870 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7fe9f6b8c700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e80d7b10 con 0x7fe9e8007150 2023-10-08T15:37:34.870 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7fe9f6b8c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e80e6640 con 0x7fe9e8025ee0 2023-10-08T15:37:34.870 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7fe9f6b8c700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e80e68e0 con 0x7fe9e802b5b0 2023-10-08T15:37:34.870 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7f34c6a10700 1 -- 172.21.15.3:0/1152722116 wait complete. 2023-10-08T15:37:34.870 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7f34c6a10700 1 Processor -- start 2023-10-08T15:37:34.870 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7fdeb56a2700 1 --2- 172.21.15.3:0/1886919232 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdeb0147a50 0x7fdeb0141fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:34.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7fdeaffff700 1 -- 172.21.15.3:0/1886919232 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdeb006e580 msgr2=0x7fdeb015c230 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T15:37:34.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7fdeaffff700 1 --2- 172.21.15.3:0/1886919232 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdeb006e580 0x7fdeb015c230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7fdeaffff700 1 -- 172.21.15.3:0/1886919232 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdeb0147a50 msgr2=0x7fdeb0141fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7fdeaffff700 1 --2- 172.21.15.3:0/1886919232 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdeb0147a50 0x7fdeb0141fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7fdeaffff700 1 -- 172.21.15.3:0/1886919232 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea0009420 con 0x7fdeb00a2470 2023-10-08T15:37:34.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7fe9f5b8a700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe9e8007150 0x7fe9e8005f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:34.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7fe9f5b8a700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe9e8007150 0x7fe9e8005f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47744/0 (socket says 172.21.15.3:47744) 2023-10-08T15:37:34.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7fe9f5b8a700 1 -- 172.21.15.3:0/677980021 learned_addr learned my addr 172.21.15.3:0/677980021 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:34.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7fe9f638b700 1 --2- 172.21.15.3:0/677980021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9e8025ee0 0x7fe9e80d6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:34.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f21e874d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21e0068320 0x7f21e015ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f21e874d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f21e00b2740 0x7f21e00bce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f21e874d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f21e01471b0 0x7f21e013dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f21e874d700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e00b7b40 con 0x7f21e01471b0 2023-10-08T15:37:34.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f21e874d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e00b7530 con 0x7f21e0068320 2023-10-08T15:37:34.873 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7fdeb56a2700 1 --2- 172.21.15.3:0/1886919232 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdeb0147a50 0x7fdeb0141fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:37:34.873 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f21e874d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21e015cfa0 con 0x7f21e00b2740 2023-10-08T15:37:34.873 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7fdeaffff700 1 --2- 172.21.15.3:0/1886919232 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdeb00a2470 0x7fdeb0141a70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdea800cd30 tx=0x7fdea8001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:34.873 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f392359e700 1 Processor -- start 2023-10-08T15:37:34.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f392359e700 1 -- start start 2023-10-08T15:37:34.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f21e64e9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21e0068320 0x7f21e015ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:34.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7fdeacff9700 1 -- 172.21.15.3:0/1886919232 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea800ab70 con 0x7fdeb00a2470 2023-10-08T15:37:34.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.837+0000 7f34c6a10700 1 -- start start 2023-10-08T15:37:34.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f34c6a10700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f34c0068320 0x7f34c0144b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.875 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f34c6a10700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34c006d2b0 0x7f34c01428f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.875 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f34c6a10700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f34c00b1c30 0x7f34c014d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.875 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f34c6a10700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c0144690 con 0x7f34c0068320 2023-10-08T15:37:34.875 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f21e64e9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21e0068320 0x7f21e015ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.3:36912/0 (socket says 172.21.15.3:36912) 2023-10-08T15:37:34.875 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f21e64e9700 1 -- 172.21.15.3:0/4143939408 learned_addr learned my addr 172.21.15.3:0/4143939408 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:34.875 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f34c6a10700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c0144080 con 0x7f34c006d2b0 2023-10-08T15:37:34.875 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f34c6a10700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34c0142e30 con 0x7f34c00b1c30 2023-10-08T15:37:34.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7fdeacff9700 1 -- 172.21.15.3:0/1886919232 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdea800acf0 con 0x7fdeb00a2470 2023-10-08T15:37:34.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7fdeb5ea3700 1 -- 172.21.15.3:0/1886919232 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdeb0142e00 con 0x7fdeb00a2470 2023-10-08T15:37:34.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7fdeacff9700 1 -- 172.21.15.3:0/1886919232 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea8007340 con 0x7fdeb00a2470 2023-10-08T15:37:34.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f34c4fad700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f34c00b1c30 0x7f34c014d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:34.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f34c4fad700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f34c00b1c30 0x7f34c014d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.3:44386/0 (socket says 172.21.15.3:44386) 2023-10-08T15:37:34.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f34c4fad700 1 -- 172.21.15.3:0/704135265 learned_addr learned my addr 172.21.15.3:0/704135265 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:34.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7fdeb5ea3700 1 -- 172.21.15.3:0/1886919232 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeb01444b0 con 0x7fdeb00a2470 2023-10-08T15:37:34.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f4a0dafb700 1 -- 172.21.15.3:0/2873650340 wait complete. 2023-10-08T15:37:34.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f4a0dafb700 1 Processor -- start 2023-10-08T15:37:34.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f4a0dafb700 1 -- start start 2023-10-08T15:37:34.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7fe9f5389700 1 --2- 172.21.15.3:0/677980021 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe9e802b5b0 0x7fe9e80d5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:34.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7fe9f5b8a700 1 -- 172.21.15.3:0/677980021 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe9e802b5b0 msgr2=0x7fe9e80d5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7fe9f5b8a700 1 --2- 172.21.15.3:0/677980021 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe9e802b5b0 0x7fe9e80d5ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7fe9f5b8a700 1 -- 172.21.15.3:0/677980021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9e8025ee0 msgr2=0x7fe9e80d6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7fe9f5b8a700 1 --2- 172.21.15.3:0/677980021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9e8025ee0 0x7fe9e80d6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7fe9f5b8a700 1 -- 172.21.15.3:0/677980021 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e00094f0 con 0x7fe9e8007150 2023-10-08T15:37:34.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7fe9f5b8a700 1 --2- 172.21.15.3:0/677980021 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe9e8007150 0x7fe9e8005f30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec00c590 tx=0x7fe9ec00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:34.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7fe9e5ffb700 1 -- 172.21.15.3:0/677980021 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec011590 con 0x7fe9e8007150 2023-10-08T15:37:34.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7fe9f6b8c700 1 -- 172.21.15.3:0/677980021 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9e80d6560 con 0x7fe9e8007150 2023-10-08T15:37:34.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7fe9f6b8c700 1 -- 172.21.15.3:0/677980021 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9e80402b0 con 0x7fe9e8007150 2023-10-08T15:37:34.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7fe9e5ffb700 1 -- 172.21.15.3:0/677980021 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9ec011710 con 0x7fe9e8007150 2023-10-08T15:37:34.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7fe9e5ffb700 1 -- 172.21.15.3:0/677980021 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec011ad0 con 0x7fe9e8007150 2023-10-08T15:37:34.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f34c4fad700 1 -- 172.21.15.3:0/704135265 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34c006d2b0 msgr2=0x7f34c01428f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T15:37:34.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f34c4fad700 1 --2- 172.21.15.3:0/704135265 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34c006d2b0 0x7f34c01428f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f34c4fad700 1 -- 172.21.15.3:0/704135265 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f34c0068320 msgr2=0x7f34c0144b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f34c4fad700 1 --2- 172.21.15.3:0/704135265 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f34c0068320 0x7f34c0144b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f34c4fad700 1 -- 172.21.15.3:0/704135265 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b400b670 con 0x7f34c00b1c30 2023-10-08T15:37:34.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f34c4fad700 1 --2- 172.21.15.3:0/704135265 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f34c00b1c30 0x7f34c014d200 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f34b000ea50 tx=0x7f34b00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:34.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f392359e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f39240bab30 0x7f392406e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f392359e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f392414f620 0x7f392414c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f392359e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3924152e00 0x7f392415f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f392359e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392406ecc0 con 0x7f3924152e00 2023-10-08T15:37:34.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f392359e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39240974e0 con 0x7f392414f620 2023-10-08T15:37:34.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f392359e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f392406ddb0 con 0x7f39240bab30 2023-10-08T15:37:34.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f392259c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f39240bab30 0x7f392406e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:34.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f3921d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f392414f620 0x7f392414c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:34.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f3921d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f392414f620 0x7f392414c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.3:36928/0 (socket says 172.21.15.3:36928) 2023-10-08T15:37:34.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f3921d9b700 1 -- 172.21.15.3:0/2122738797 learned_addr learned my addr 172.21.15.3:0/2122738797 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:34.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7fe9f6b8c700 1 -- 172.21.15.3:0/677980021 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe9d4001000 con 0x7fe9e8007150 2023-10-08T15:37:34.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f34a7fff700 1 -- 172.21.15.3:0/704135265 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b000c7f0 con 0x7f34c00b1c30 2023-10-08T15:37:34.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f18bafba700 1 Processor -- start 2023-10-08T15:37:34.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f34a7fff700 1 -- 172.21.15.3:0/704135265 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34b000c950 con 0x7f34c00b1c30 2023-10-08T15:37:34.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f34c6a10700 1 -- 172.21.15.3:0/704135265 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34c0144320 con 0x7f34c00b1c30 2023-10-08T15:37:34.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f4a0dafb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a0809e490 0x7f4a0814eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.883 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f4a0dafb700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4a080bb040 0x7f4a0814f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.883 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f4a0dafb700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4a08153050 0x7f4a0814c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.883 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f4a0dafb700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a08156700 con 0x7f4a080bb040 2023-10-08T15:37:34.883 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f4a0dafb700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0814f580 con 0x7f4a0809e490 2023-10-08T15:37:34.883 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f4a0dafb700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a081560b0 con 0x7f4a08153050 2023-10-08T15:37:34.883 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f3922d9d700 1 --2- 172.21.15.3:0/2122738797 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3924152e00 0x7f392415f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:34.883 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f4a077fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a0809e490 0x7f4a0814eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:34.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7fdeb5ea3700 1 -- 172.21.15.3:0/1886919232 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fde90000fd0 con 0x7fdeb00a2470 2023-10-08T15:37:34.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f4a077fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a0809e490 0x7f4a0814eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.3:36932/0 (socket says 172.21.15.3:36932) 2023-10-08T15:37:34.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f4a077fe700 1 -- 172.21.15.3:0/4170159049 learned_addr learned my addr 172.21.15.3:0/4170159049 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:34.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f4a06ffd700 1 --2- 172.21.15.3:0/4170159049 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4a080bb040 0x7f4a0814f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:34.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f4a07fff700 1 --2- 172.21.15.3:0/4170159049 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4a08153050 0x7f4a0814c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:34.885 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f18bafba700 1 -- start start 2023-10-08T15:37:34.885 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f392259c700 1 -- 172.21.15.3:0/2122738797 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f392414f620 msgr2=0x7f392414c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.885 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f392259c700 1 --2- 172.21.15.3:0/2122738797 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f392414f620 0x7f392414c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.885 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f392259c700 1 -- 172.21.15.3:0/2122738797 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3924152e00 msgr2=0x7f392415f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.885 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f392259c700 1 --2- 172.21.15.3:0/2122738797 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3924152e00 0x7f392415f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.885 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f392259c700 1 -- 172.21.15.3:0/2122738797 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39180094f0 con 0x7f39240bab30 2023-10-08T15:37:34.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7f34a7fff700 1 -- 172.21.15.3:0/704135265 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b000ccf0 con 0x7f34c00b1c30 2023-10-08T15:37:34.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7f34c6a10700 1 -- 172.21.15.3:0/704135265 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34c014d960 con 0x7f34c00b1c30 2023-10-08T15:37:34.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7f4a06ffd700 1 -- 172.21.15.3:0/4170159049 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4a08153050 msgr2=0x7f4a0814c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7f4a06ffd700 1 --2- 172.21.15.3:0/4170159049 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4a08153050 0x7f4a0814c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7f4a06ffd700 1 -- 172.21.15.3:0/4170159049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a0809e490 msgr2=0x7f4a0814eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7f4a06ffd700 1 --2- 172.21.15.3:0/4170159049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a0809e490 0x7f4a0814eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7f4a06ffd700 1 -- 172.21.15.3:0/4170159049 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49fc009420 con 0x7f4a080bb040 2023-10-08T15:37:34.887 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7f392259c700 1 --2- 172.21.15.3:0/2122738797 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f39240bab30 0x7f392406e780 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f391400b5e0 tx=0x7f39140090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:34.887 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7f18bafba700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f18b40be0b0 0x7f18b40bc260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.887 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7f18bafba700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f18b40bc7a0 0x7f18b409faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.887 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7f18bafba700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18b40a1690 con 0x7f18b40a2620 2023-10-08T15:37:34.887 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7f18bafba700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18b41489c0 con 0x7f18b40bc7a0 2023-10-08T15:37:34.887 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7f18bafba700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b409d510 con 0x7f18b40be0b0 2023-10-08T15:37:34.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7f18ba7b9700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f18b40bc7a0 0x7f18b409faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:34.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7f18ba7b9700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f18b40bc7a0 0x7f18b409faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47780/0 (socket says 172.21.15.3:47780) 2023-10-08T15:37:34.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7f18ba7b9700 1 -- 172.21.15.3:0/3270284955 learned_addr learned my addr 172.21.15.3:0/3270284955 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:34.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7f39127fc700 1 -- 172.21.15.3:0/2122738797 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391400f510 con 0x7f39240bab30 2023-10-08T15:37:34.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7f4a06ffd700 1 --2- 172.21.15.3:0/4170159049 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4a080bb040 0x7f4a0814f040 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f49fc015000 tx=0x7f49fc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:34.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7f392359e700 1 -- 172.21.15.3:0/2122738797 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3924097170 con 0x7f39240bab30 2023-10-08T15:37:34.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7f392359e700 1 -- 172.21.15.3:0/2122738797 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f392414b4f0 con 0x7f39240bab30 2023-10-08T15:37:34.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7f39127fc700 1 -- 172.21.15.3:0/2122738797 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f391400f670 con 0x7f39240bab30 2023-10-08T15:37:34.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7fe9e5ffb700 1 -- 172.21.15.3:0/677980021 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe9ec01b3b0 con 0x7fe9e8007150 2023-10-08T15:37:34.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7fe9e5ffb700 1 --2- 172.21.15.3:0/677980021 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe9dc060730 0x7fe9dc062be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7fe9e5ffb700 1 -- 172.21.15.3:0/677980021 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe9ec07c470 con 0x7fe9e8007150 2023-10-08T15:37:34.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7fe9e5ffb700 1 --2- 172.21.15.3:0/677980021 >> [v2:172.21.15.3:6818/33364,v1:172.21.15.3:6820/33364] conn(0x7fe9dc068940 0x7fe9dc06ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7fe9e5ffb700 1 -- 172.21.15.3:0/677980021 --> [v2:172.21.15.3:6818/33364,v1:172.21.15.3:6820/33364] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe9dc06b400 con 0x7fe9dc068940 2023-10-08T15:37:34.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7fe9e5ffb700 1 -- 172.21.15.3:0/677980021 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe9ec07c810 con 0x7fe9e8007150 2023-10-08T15:37:34.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f21e5ce8700 1 --2- 172.21.15.3:0/4143939408 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f21e00b2740 0x7f21e00bce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:34.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f21e6cea700 1 --2- 172.21.15.3:0/4143939408 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f21e01471b0 0x7f21e013dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:34.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f21e5ce8700 1 -- 172.21.15.3:0/4143939408 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21e0068320 msgr2=0x7f21e015ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f21e5ce8700 1 --2- 172.21.15.3:0/4143939408 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21e0068320 0x7f21e015ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f21e5ce8700 1 -- 172.21.15.3:0/4143939408 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f21e01471b0 msgr2=0x7f21e013dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f21e5ce8700 1 --2- 172.21.15.3:0/4143939408 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f21e01471b0 0x7f21e013dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f21e5ce8700 1 -- 172.21.15.3:0/4143939408 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21dc0094f0 con 0x7f21e00b2740 2023-10-08T15:37:34.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.841+0000 7f21e5ce8700 1 --2- 172.21.15.3:0/4143939408 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f21e00b2740 0x7f21e00bce60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f21d800cb40 tx=0x7f21d8007f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:34.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7f21d67fc700 1 -- 172.21.15.3:0/4143939408 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d8004100 con 0x7f21e00b2740 2023-10-08T15:37:34.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7f21d67fc700 1 -- 172.21.15.3:0/4143939408 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21d8015b70 con 0x7f21e00b2740 2023-10-08T15:37:34.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7f21e874d700 1 -- 172.21.15.3:0/4143939408 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21e00bd3a0 con 0x7f21e00b2740 2023-10-08T15:37:34.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7f21e874d700 1 -- 172.21.15.3:0/4143939408 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21e0158a40 con 0x7f21e00b2740 2023-10-08T15:37:34.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7f21d67fc700 1 -- 172.21.15.3:0/4143939408 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d800a550 con 0x7f21e00b2740 2023-10-08T15:37:34.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7f21e874d700 1 -- 172.21.15.3:0/4143939408 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f21c8000fd0 con 0x7f21e00b2740 2023-10-08T15:37:34.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7fdeacff9700 1 -- 172.21.15.3:0/1886919232 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fdea8007770 con 0x7fdeb00a2470 2023-10-08T15:37:34.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7fdeacff9700 1 --2- 172.21.15.3:0/1886919232 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fde9c060620 0x7fde9c062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7fdeacff9700 1 -- 172.21.15.3:0/1886919232 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdea807d470 con 0x7fdeb00a2470 2023-10-08T15:37:34.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7fdeacff9700 1 --2- 172.21.15.3:0/1886919232 >> [v2:172.21.15.3:6808/33365,v1:172.21.15.3:6809/33365] conn(0x7fde9c068830 0x7fde9c06ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7fdeacff9700 1 -- 172.21.15.3:0/1886919232 --> [v2:172.21.15.3:6808/33365,v1:172.21.15.3:6809/33365] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fde9c06b2f0 con 0x7fde9c068830 2023-10-08T15:37:34.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7fdeacff9700 1 -- 172.21.15.3:0/1886919232 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdea807d890 con 0x7fdeb00a2470 2023-10-08T15:37:34.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7f18b97b7700 1 --2- 172.21.15.3:0/3270284955 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f18b40be0b0 0x7f18b40bc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:34.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7f18ba7b9700 1 -- 172.21.15.3:0/3270284955 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f18b40be0b0 msgr2=0x7f18b40bc260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:34.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7f18ba7b9700 1 --2- 172.21.15.3:0/3270284955 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f18b40be0b0 0x7f18b40bc260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7f18ba7b9700 1 -- 172.21.15.3:0/3270284955 >> v1:172.21.15.3:6789/0 conn(0x7f18b40a2620 legacy=0x7f18b409da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7f18ba7b9700 1 -- 172.21.15.3:0/3270284955 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b40a1c60 con 0x7f18b40bc7a0 2023-10-08T15:37:34.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7f18ba7b9700 1 --2- 172.21.15.3:0/3270284955 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f18b40bc7a0 0x7f18b409faa0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f18a40099b0 tx=0x7f18a4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c987eafbce8bfe68 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:34.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7f49ef7fe700 1 -- 172.21.15.3:0/4170159049 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49fc006e50 con 0x7f4a080bb040 2023-10-08T15:37:34.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7f49ef7fe700 1 -- 172.21.15.3:0/4170159049 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49fc00b8d0 con 0x7f4a080bb040 2023-10-08T15:37:34.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7f49ef7fe700 1 -- 172.21.15.3:0/4170159049 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49fc01c460 con 0x7f4a080bb040 2023-10-08T15:37:34.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7f4a0dafb700 1 -- 172.21.15.3:0/4170159049 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a08156390 con 0x7f4a080bb040 2023-10-08T15:37:34.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7f4a0dafb700 1 -- 172.21.15.3:0/4170159049 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a08156b90 con 0x7f4a080bb040 2023-10-08T15:37:34.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7f39127fc700 1 -- 172.21.15.3:0/2122738797 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391400fa30 con 0x7f39240bab30 2023-10-08T15:37:34.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7f34a7fff700 1 -- 172.21.15.3:0/704135265 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f34b0013680 con 0x7f34c00b1c30 2023-10-08T15:37:34.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7f34c6a10700 1 -- 172.21.15.3:0/704135265 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f34c014dc40 con 0x7f34c00b1c30 2023-10-08T15:37:34.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7f392359e700 1 -- 172.21.15.3:0/2122738797 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3908000fd0 con 0x7f39240bab30 2023-10-08T15:37:34.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7fdeb4ea1700 1 --2- 172.21.15.3:0/1886919232 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fde9c060620 0x7fde9c062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:34.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7f18b8fb6700 1 -- 172.21.15.3:0/3270284955 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a400b860 con 0x7f18b40bc7a0 2023-10-08T15:37:34.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7f18b8fb6700 1 -- 172.21.15.3:0/3270284955 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a400b9c0 con 0x7f18b40bc7a0 2023-10-08T15:37:34.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7fe9f5389700 1 --2- 172.21.15.3:0/677980021 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe9dc060730 0x7fe9dc062be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:34.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7f21d67fc700 1 -- 172.21.15.3:0/4143939408 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f21d8036b10 con 0x7f21e00b2740 2023-10-08T15:37:34.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7fdfdfd0f700 1 Processor -- start 2023-10-08T15:37:34.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7fdfdfd0f700 1 -- start start 2023-10-08T15:37:34.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7fdfdfd0f700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fdfd80b1e60 0x7fdfd806dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7f4a0dafb700 1 -- 172.21.15.3:0/4170159049 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4a08064530 con 0x7f4a080bb040 2023-10-08T15:37:34.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7fdfdfd0f700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdfd815c090 0x7fdfd815a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7fdfdfd0f700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfd806d950 con 0x7fdfd806d0d0 2023-10-08T15:37:34.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7fdfdfd0f700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfd80b2920 con 0x7fdfd80b1e60 2023-10-08T15:37:34.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7fdfdfd0f700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd806e320 con 0x7fdfd815c090 2023-10-08T15:37:34.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7f34a7fff700 1 --2- 172.21.15.3:0/704135265 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f34ac060580 0x7f34ac062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7fe9f5389700 1 --2- 172.21.15.3:0/677980021 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe9dc060730 0x7fe9dc062be0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe9e8029ba0 tx=0x7fe9e0017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:34.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7fdfde2ac700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdfd815c090 0x7fdfd815a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:34.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7fdfddaab700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fdfd80b1e60 0x7fdfd806dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:34.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7fdfddaab700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fdfd80b1e60 0x7fdfd806dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47786/0 (socket says 172.21.15.3:47786) 2023-10-08T15:37:34.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7fdfde2ac700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdfd815c090 0x7fdfd815a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.3:44428/0 (socket says 172.21.15.3:44428) 2023-10-08T15:37:34.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7fdfddaab700 1 -- 172.21.15.3:0/1199842870 learned_addr learned my addr 172.21.15.3:0/1199842870 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:34.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7f34a7fff700 1 -- 172.21.15.3:0/704135265 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f34b007cb80 con 0x7f34c00b1c30 2023-10-08T15:37:34.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.845+0000 7f18b8fb6700 1 -- 172.21.15.3:0/3270284955 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a400bd60 con 0x7f18b40bc7a0 2023-10-08T15:37:34.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7f34bffff700 1 --2- 172.21.15.3:0/704135265 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f34ac060580 0x7f34ac062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:34.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7f34a7fff700 1 --2- 172.21.15.3:0/704135265 >> [v2:172.21.15.50:6808/33605,v1:172.21.15.50:6809/33605] conn(0x7f34ac068620 0x7f34ac06aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7f34a7fff700 1 -- 172.21.15.3:0/704135265 --> [v2:172.21.15.50:6808/33605,v1:172.21.15.50:6809/33605] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f34ac06b0e0 con 0x7f34ac068620 2023-10-08T15:37:34.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7f34a7fff700 1 -- 172.21.15.3:0/704135265 <== mon.2 v2:172.21.15.50:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f34b0081200 con 0x7f34c00b1c30 2023-10-08T15:37:34.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7fdeb56a2700 1 --2- 172.21.15.3:0/1886919232 >> [v2:172.21.15.3:6808/33365,v1:172.21.15.3:6809/33365] conn(0x7fde9c068830 0x7fde9c06ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:34.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7f21d67fc700 1 --2- 172.21.15.3:0/4143939408 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f21c4060620 0x7f21c4062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7fdfde2ac700 1 -- 172.21.15.3:0/1199842870 >> v2:172.21.15.3:3300/0 conn(0x7fdfd80b1e60 msgr2=0x7fdfd806dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:34.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7fdfde2ac700 1 --2- 172.21.15.3:0/1199842870 >> v2:172.21.15.3:3300/0 conn(0x7fdfd80b1e60 0x7fdfd806dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7fdfde2ac700 1 -- 172.21.15.3:0/1199842870 >> v1:172.21.15.50:6789/0 conn(0x7fdfd806d0d0 legacy=0x7fdfd815b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:34.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7fdfde2ac700 1 -- 172.21.15.3:0/1199842870 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd80ba3b0 con 0x7fdfd815c090 2023-10-08T15:37:34.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7fdeb4ea1700 1 --2- 172.21.15.3:0/1886919232 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fde9c060620 0x7fde9c062ad0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdea4000f60 tx=0x7fdea4006cc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:34.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7fdfde2ac700 1 --2- 172.21.15.3:0/1199842870 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdfd815c090 0x7fdfd815a900 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdfc8005e20 tx=0x7fdfc8009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a064f22005170ef7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:34.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7fdeb56a2700 1 --2- 172.21.15.3:0/1886919232 >> [v2:172.21.15.3:6808/33365,v1:172.21.15.3:6809/33365] conn(0x7fde9c068830 0x7fde9c06ac40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:34.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7f49ef7fe700 1 -- 172.21.15.3:0/4170159049 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f49fc01c890 con 0x7f4a080bb040 2023-10-08T15:37:34.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7f49ef7fe700 1 --2- 172.21.15.3:0/4170159049 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f49f4060650 0x7f49f4062b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7fe9f638b700 1 --2- 172.21.15.3:0/677980021 >> [v2:172.21.15.3:6818/33364,v1:172.21.15.3:6820/33364] conn(0x7fe9dc068940 0x7fe9dc06ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:34.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7f39127fc700 1 -- 172.21.15.3:0/2122738797 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f3914024430 con 0x7f39240bab30 2023-10-08T15:37:34.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7f39127fc700 1 --2- 172.21.15.3:0/2122738797 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3904060620 0x7f3904062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7f39127fc700 1 -- 172.21.15.3:0/2122738797 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f391407cb60 con 0x7f39240bab30 2023-10-08T15:37:34.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7fe9f638b700 1 --2- 172.21.15.3:0/677980021 >> [v2:172.21.15.3:6818/33364,v1:172.21.15.3:6820/33364] conn(0x7fe9dc068940 0x7fe9dc06ad50 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:34.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7f21e64e9700 1 --2- 172.21.15.3:0/4143939408 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f21c4060620 0x7f21c4062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:34.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7f21d67fc700 1 -- 172.21.15.3:0/4143939408 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f21d807c9d0 con 0x7f21e00b2740 2023-10-08T15:37:34.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7f21d67fc700 1 --2- 172.21.15.3:0/4143939408 >> [v2:172.21.15.3:6816/33366,v1:172.21.15.3:6817/33366] conn(0x7f21c40686c0 0x7f21c406aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7f21d67fc700 1 -- 172.21.15.3:0/4143939408 --> [v2:172.21.15.3:6816/33366,v1:172.21.15.3:6817/33366] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f21c406b180 con 0x7f21c40686c0 2023-10-08T15:37:34.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7f34bf7fe700 1 --2- 172.21.15.3:0/704135265 >> [v2:172.21.15.50:6808/33605,v1:172.21.15.50:6809/33605] conn(0x7f34ac068620 0x7f34ac06aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:34.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7f34bffff700 1 --2- 172.21.15.3:0/704135265 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f34ac060580 0x7f34ac062a30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f34b400b470 tx=0x7f34b4019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:34.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7f18bafba700 1 -- 172.21.15.3:0/3270284955 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f18b40bc7a0 msgr2=0x7f18b409faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7f18bafba700 1 --2- 172.21.15.3:0/3270284955 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f18b40bc7a0 0x7f18b409faa0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f18a40099b0 tx=0x7f18a4009250 comp rx=0 tx=0).stop 2023-10-08T15:37:34.905 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7f4a077fe700 1 --2- 172.21.15.3:0/4170159049 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f49f4060650 0x7f49f4062b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:34.905 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7f49ef7fe700 1 -- 172.21.15.3:0/4170159049 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f49fc07eba0 con 0x7f4a080bb040 2023-10-08T15:37:34.905 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7f49ef7fe700 1 --2- 172.21.15.3:0/4170159049 >> [v2:172.21.15.50:6816/33604,v1:172.21.15.50:6818/33604] conn(0x7f49f40687e0 0x7f49f406abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.905 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7f49ef7fe700 1 -- 172.21.15.3:0/4170159049 --> [v2:172.21.15.50:6816/33604,v1:172.21.15.50:6818/33604] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f49f406b2a0 con 0x7f49f40687e0 2023-10-08T15:37:34.905 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7f21e6cea700 1 --2- 172.21.15.3:0/4143939408 >> [v2:172.21.15.3:6816/33366,v1:172.21.15.3:6817/33366] conn(0x7f21c40686c0 0x7f21c406aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:34.905 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7f21d67fc700 1 -- 172.21.15.3:0/4143939408 <== mon.2 v2:172.21.15.50:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f21d807cd00 con 0x7f21e00b2740 2023-10-08T15:37:34.906 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7fdfdcaa9700 1 -- 172.21.15.3:0/1199842870 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc800b820 con 0x7fdfd815c090 2023-10-08T15:37:34.906 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7fdfdcaa9700 1 -- 172.21.15.3:0/1199842870 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc800b980 con 0x7fdfd815c090 2023-10-08T15:37:34.906 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7f39127fc700 1 --2- 172.21.15.3:0/2122738797 >> [v2:172.21.15.3:6800/33363,v1:172.21.15.3:6801/33363] conn(0x7f39040686c0 0x7f390406aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.906 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7f39127fc700 1 -- 172.21.15.3:0/2122738797 --> [v2:172.21.15.3:6800/33363,v1:172.21.15.3:6801/33363] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f390406b180 con 0x7f39040686c0 2023-10-08T15:37:34.906 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7f3921d9b700 1 --2- 172.21.15.3:0/2122738797 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3904060620 0x7f3904062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:34.906 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7fdfdcaa9700 1 -- 172.21.15.3:0/1199842870 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc800bd40 con 0x7fdfd815c090 2023-10-08T15:37:34.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7f39127fc700 1 -- 172.21.15.3:0/2122738797 <== mon.2 v2:172.21.15.50:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f391407ce90 con 0x7f39240bab30 2023-10-08T15:37:34.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7f3922d9d700 1 --2- 172.21.15.3:0/2122738797 >> [v2:172.21.15.3:6800/33363,v1:172.21.15.3:6801/33363] conn(0x7f39040686c0 0x7f390406aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:34.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7f21e64e9700 1 --2- 172.21.15.3:0/4143939408 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f21c4060620 0x7f21c4062ad0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f21d00078a0 tx=0x7f21d0007830 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:34.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7fdeacff9700 1 -- 172.21.15.3:0/1886919232 <== osd.3 v2:172.21.15.3:6808/33365 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fde9c06b2f0 con 0x7fde9c068830 2023-10-08T15:37:34.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7f34bf7fe700 1 --2- 172.21.15.3:0/704135265 >> [v2:172.21.15.50:6808/33605,v1:172.21.15.50:6809/33605] conn(0x7f34ac068620 0x7f34ac06aa30 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:34.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7f49ef7fe700 1 -- 172.21.15.3:0/4170159049 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f49fc04f170 con 0x7f4a080bb040 2023-10-08T15:37:34.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7f4a07fff700 1 --2- 172.21.15.3:0/4170159049 >> [v2:172.21.15.50:6816/33604,v1:172.21.15.50:6818/33604] conn(0x7f49f40687e0 0x7f49f406abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:34.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7f18bafba700 1 -- 172.21.15.3:0/3270284955 shutdown_connections 2023-10-08T15:37:34.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7f18bafba700 1 --2- 172.21.15.3:0/3270284955 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f18b40bc7a0 0x7f18b409faa0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7f18bafba700 1 --2- 172.21.15.3:0/3270284955 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f18b40be0b0 0x7f18b40bc260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7f18bafba700 1 -- 172.21.15.3:0/3270284955 >> 172.21.15.3:0/3270284955 conn(0x7f18b406a900 msgr2=0x7f18b40bd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:34.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7fdfdfd0f700 1 -- 172.21.15.3:0/1199842870 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdfd815c090 msgr2=0x7fdfd815a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7fe9e5ffb700 1 -- 172.21.15.3:0/677980021 <== osd.1 v2:172.21.15.3:6818/33364 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fe9dc06b400 con 0x7fe9dc068940 2023-10-08T15:37:34.910 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7f18bafba700 1 -- 172.21.15.3:0/3270284955 shutdown_connections 2023-10-08T15:37:34.910 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7f18bafba700 1 -- 172.21.15.3:0/3270284955 wait complete. 2023-10-08T15:37:34.910 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7fdfdfd0f700 1 --2- 172.21.15.3:0/1199842870 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdfd815c090 0x7fdfd815a900 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdfc8005e20 tx=0x7fdfc8009310 comp rx=0 tx=0).stop 2023-10-08T15:37:34.910 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7f21e6cea700 1 --2- 172.21.15.3:0/4143939408 >> [v2:172.21.15.3:6816/33366,v1:172.21.15.3:6817/33366] conn(0x7f21c40686c0 0x7f21c406aad0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:34.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7f4a077fe700 1 --2- 172.21.15.3:0/4170159049 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f49f4060650 0x7f49f4062b00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f49f8009ca0 tx=0x7f49f8009250 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:34.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7fdfdfd0f700 1 -- 172.21.15.3:0/1199842870 shutdown_connections 2023-10-08T15:37:34.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7fdfdfd0f700 1 --2- 172.21.15.3:0/1199842870 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdfd815c090 0x7fdfd815a900 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7fdfdfd0f700 1 --2- 172.21.15.3:0/1199842870 >> v2:172.21.15.3:3300/0 conn(0x7fdfd80b1e60 0x7fdfd806dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7fdfdfd0f700 1 -- 172.21.15.3:0/1199842870 >> 172.21.15.3:0/1199842870 conn(0x7fdfd80be630 msgr2=0x7fdfd80ba6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:34.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7fdfdfd0f700 1 -- 172.21.15.3:0/1199842870 shutdown_connections 2023-10-08T15:37:34.912 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7fdfdfd0f700 1 -- 172.21.15.3:0/1199842870 wait complete. 2023-10-08T15:37:34.912 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7f4a07fff700 1 --2- 172.21.15.3:0/4170159049 >> [v2:172.21.15.50:6816/33604,v1:172.21.15.50:6818/33604] conn(0x7f49f40687e0 0x7f49f406abf0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:34.912 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7f34a7fff700 1 -- 172.21.15.3:0/704135265 <== osd.4 v2:172.21.15.50:6808/33605 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f34ac06b0e0 con 0x7f34ac068620 2023-10-08T15:37:34.912 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7f21d67fc700 1 -- 172.21.15.3:0/4143939408 <== osd.2 v2:172.21.15.3:6816/33366 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f21c406b180 con 0x7f21c40686c0 2023-10-08T15:37:34.913 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.853+0000 7fdfdfd0f700 1 Processor -- start 2023-10-08T15:37:34.913 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.853+0000 7fdfdfd0f700 1 -- start start 2023-10-08T15:37:34.913 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.853+0000 7f18bafba700 1 Processor -- start 2023-10-08T15:37:34.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.853+0000 7fdfdfd0f700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdfd806d0d0 0x7fdfd815a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.853+0000 7fdfdfd0f700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdfd80b1e60 0x7fdfd8151860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.853+0000 7fdfdfd0f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfd815c090 0x7fdfd815af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.853+0000 7fdfdfd0f700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd80b3d60 con 0x7fdfd80b1e60 2023-10-08T15:37:34.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.853+0000 7fdfdfd0f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd80864c0 con 0x7fdfd815c090 2023-10-08T15:37:34.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.853+0000 7fdfdfd0f700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd815aa70 con 0x7fdfd806d0d0 2023-10-08T15:37:34.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.853+0000 7f18bafba700 1 -- start start 2023-10-08T15:37:34.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.853+0000 7fdfddaab700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdfd806d0d0 0x7fdfd815a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:34.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.853+0000 7fdfde2ac700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfd815c090 0x7fdfd815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:34.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.853+0000 7fdfddaab700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdfd806d0d0 0x7fdfd815a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.3:44438/0 (socket says 172.21.15.3:44438) 2023-10-08T15:37:34.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.853+0000 7fdfddaab700 1 -- 172.21.15.3:0/2224113455 learned_addr learned my addr 172.21.15.3:0/2224113455 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:34.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.853+0000 7fdfddaab700 1 -- 172.21.15.3:0/2224113455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfd815c090 msgr2=0x7fdfd815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.853+0000 7fdfddaab700 1 --2- 172.21.15.3:0/2224113455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfd815c090 0x7fdfd815af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.853+0000 7fdfddaab700 1 -- 172.21.15.3:0/2224113455 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdfd80b1e60 msgr2=0x7fdfd8151860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.853+0000 7fdfddaab700 1 --2- 172.21.15.3:0/2224113455 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdfd80b1e60 0x7fdfd8151860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.853+0000 7fdfddaab700 1 -- 172.21.15.3:0/2224113455 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc80095d0 con 0x7fdfd806d0d0 2023-10-08T15:37:34.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.853+0000 7fdfddaab700 1 --2- 172.21.15.3:0/2224113455 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdfd806d0d0 0x7fdfd815a1f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdfd400be50 tx=0x7fdfd400d040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:34.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.853+0000 7fdfcdffb700 1 -- 172.21.15.3:0/2224113455 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd4007e10 con 0x7fdfd806d0d0 2023-10-08T15:37:34.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.853+0000 7fdfcdffb700 1 -- 172.21.15.3:0/2224113455 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfd4011040 con 0x7fdfd806d0d0 2023-10-08T15:37:34.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.853+0000 7fdfcdffb700 1 -- 172.21.15.3:0/2224113455 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd4015660 con 0x7fdfd806d0d0 2023-10-08T15:37:34.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.853+0000 7fdfdfd0f700 1 -- 172.21.15.3:0/2224113455 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfd815a730 con 0x7fdfd806d0d0 2023-10-08T15:37:34.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.853+0000 7fdfdfd0f700 1 -- 172.21.15.3:0/2224113455 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfd8159560 con 0x7fdfd806d0d0 2023-10-08T15:37:34.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.853+0000 7f18bafba700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f18b40a2620 0x7f18b4143430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.853+0000 7f18bafba700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18b40bc7a0 0x7f18b413ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.853+0000 7f18bafba700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f18b40be0b0 0x7f18b4146e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.853+0000 7f18bafba700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b413c630 con 0x7f18b40a2620 2023-10-08T15:37:34.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.853+0000 7f18bafba700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b4144a40 con 0x7f18b40bc7a0 2023-10-08T15:37:34.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.853+0000 7f18bafba700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b409c9e0 con 0x7f18b40be0b0 2023-10-08T15:37:34.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.853+0000 7f18b97b7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18b40bc7a0 0x7f18b413ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:34.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.853+0000 7f18b9fb8700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f18b40a2620 0x7f18b4143430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:34.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.853+0000 7f18b97b7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18b40bc7a0 0x7f18b413ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.3:36954/0 (socket says 172.21.15.3:36954) 2023-10-08T15:37:34.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.853+0000 7f18b97b7700 1 -- 172.21.15.3:0/3823994491 learned_addr learned my addr 172.21.15.3:0/3823994491 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:34.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.853+0000 7fdfdfd0f700 1 -- 172.21.15.3:0/2224113455 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdfd8064530 con 0x7fdfd806d0d0 2023-10-08T15:37:34.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.853+0000 7f18b9fb8700 1 -- 172.21.15.3:0/3823994491 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f18b40be0b0 msgr2=0x7f18b4146e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.853+0000 7f18b9fb8700 1 --2- 172.21.15.3:0/3823994491 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f18b40be0b0 0x7f18b4146e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.853+0000 7f18b9fb8700 1 -- 172.21.15.3:0/3823994491 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18b40bc7a0 msgr2=0x7f18b413ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.853+0000 7f18b9fb8700 1 --2- 172.21.15.3:0/3823994491 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18b40bc7a0 0x7f18b413ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.853+0000 7f18b9fb8700 1 -- 172.21.15.3:0/3823994491 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a40094f0 con 0x7f18b40a2620 2023-10-08T15:37:34.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.857+0000 7f18b9fb8700 1 --2- 172.21.15.3:0/3823994491 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f18b40a2620 0x7f18b4143430 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f18ac00c910 tx=0x7f18ac0016b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:34.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.857+0000 7f18a9ffb700 1 -- 172.21.15.3:0/3823994491 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ac012630 con 0x7f18b40a2620 2023-10-08T15:37:34.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.857+0000 7f18a9ffb700 1 -- 172.21.15.3:0/3823994491 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18ac0127b0 con 0x7f18b40a2620 2023-10-08T15:37:34.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.857+0000 7f18bafba700 1 -- 172.21.15.3:0/3823994491 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18b4143cb0 con 0x7f18b40a2620 2023-10-08T15:37:34.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.857+0000 7f18a9ffb700 1 -- 172.21.15.3:0/3823994491 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ac012b70 con 0x7f18b40a2620 2023-10-08T15:37:34.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.857+0000 7f18bafba700 1 -- 172.21.15.3:0/3823994491 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18b413d3f0 con 0x7f18b40a2620 2023-10-08T15:37:34.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.857+0000 7fdfcdffb700 1 -- 172.21.15.3:0/2224113455 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fdfd4039b50 con 0x7fdfd806d0d0 2023-10-08T15:37:34.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.857+0000 7fdfcdffb700 1 --2- 172.21.15.3:0/2224113455 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fdfbc0605d0 0x7fdfbc062a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.857+0000 7fdfcdffb700 1 -- 172.21.15.3:0/2224113455 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdfd407d370 con 0x7fdfd806d0d0 2023-10-08T15:37:34.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.857+0000 7fdfcdffb700 1 --2- 172.21.15.3:0/2224113455 >> [v2:172.21.15.50:6817/33607,v1:172.21.15.50:6819/33607] conn(0x7fdfbc0687e0 0x7fdfbc06abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.857+0000 7fdfcdffb700 1 -- 172.21.15.3:0/2224113455 --> [v2:172.21.15.50:6817/33607,v1:172.21.15.50:6819/33607] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdfbc06b2a0 con 0x7fdfbc0687e0 2023-10-08T15:37:34.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.857+0000 7fdfcdffb700 1 -- 172.21.15.3:0/2224113455 <== mon.2 v2:172.21.15.50:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdfd407d6a0 con 0x7fdfd806d0d0 2023-10-08T15:37:34.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.857+0000 7fdfdd2aa700 1 --2- 172.21.15.3:0/2224113455 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fdfbc0605d0 0x7fdfbc062a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:34.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.857+0000 7fdfde2ac700 1 --2- 172.21.15.3:0/2224113455 >> [v2:172.21.15.50:6817/33607,v1:172.21.15.50:6819/33607] conn(0x7fdfbc0687e0 0x7fdfbc06abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:34.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.857+0000 7f18a9ffb700 1 -- 172.21.15.3:0/3823994491 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f18ac003030 con 0x7f18b40a2620 2023-10-08T15:37:34.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.857+0000 7f18a9ffb700 1 --2- 172.21.15.3:0/3823994491 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1898060550 0x7f1898062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.857+0000 7fdfdd2aa700 1 --2- 172.21.15.3:0/2224113455 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fdfbc0605d0 0x7fdfbc062a80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdfd8158e70 tx=0x7fdfd0007ea0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:34.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.857+0000 7fdfde2ac700 1 --2- 172.21.15.3:0/2224113455 >> [v2:172.21.15.50:6817/33607,v1:172.21.15.50:6819/33607] conn(0x7fdfbc0687e0 0x7fdfbc06abf0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:34.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.857+0000 7f18a9ffb700 1 -- 172.21.15.3:0/3823994491 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f18ac07c6d0 con 0x7f18b40a2620 2023-10-08T15:37:34.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.857+0000 7f18b97b7700 1 --2- 172.21.15.3:0/3823994491 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1898060550 0x7f1898062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:34.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.849+0000 7f3922d9d700 1 --2- 172.21.15.3:0/2122738797 >> [v2:172.21.15.3:6800/33363,v1:172.21.15.3:6801/33363] conn(0x7f39040686c0 0x7f390406aad0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:34.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.853+0000 7f3921d9b700 1 --2- 172.21.15.3:0/2122738797 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3904060620 0x7f3904062ad0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f391c009fd0 tx=0x7f391c009900 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:34.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.861+0000 7f49ef7fe700 1 -- 172.21.15.3:0/4170159049 <== osd.7 v2:172.21.15.50:6816/33604 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f49f406b2a0 con 0x7f49f40687e0 2023-10-08T15:37:34.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.861+0000 7f39127fc700 1 -- 172.21.15.3:0/2122738797 <== osd.0 v2:172.21.15.3:6800/33363 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f390406b180 con 0x7f39040686c0 2023-10-08T15:37:34.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.861+0000 7f18b97b7700 1 --2- 172.21.15.3:0/3823994491 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1898060550 0x7f1898062a00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f18b4154f50 tx=0x7f18b0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:34.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.861+0000 7fdfcdffb700 1 -- 172.21.15.3:0/2224113455 <== osd.6 v2:172.21.15.50:6817/33607 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fdfbc06b2a0 con 0x7fdfbc0687e0 2023-10-08T15:37:34.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.865+0000 7f18bafba700 1 --2- 172.21.15.3:0/3823994491 >> [v2:172.21.15.50:6800/33606,v1:172.21.15.50:6801/33606] conn(0x7f18940015f0 0x7f1894003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:34.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.865+0000 7f18bafba700 1 -- 172.21.15.3:0/3823994491 --> [v2:172.21.15.50:6800/33606,v1:172.21.15.50:6801/33606] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1894006b90 con 0x7f18940015f0 2023-10-08T15:37:34.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.865+0000 7f18ba7b9700 1 --2- 172.21.15.3:0/3823994491 >> [v2:172.21.15.50:6800/33606,v1:172.21.15.50:6801/33606] conn(0x7f18940015f0 0x7f1894003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:34.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.865+0000 7f18ba7b9700 1 --2- 172.21.15.3:0/3823994491 >> [v2:172.21.15.50:6800/33606,v1:172.21.15.50:6801/33606] conn(0x7f18940015f0 0x7f1894003aa0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:34.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.865+0000 7f18a9ffb700 1 -- 172.21.15.3:0/3823994491 <== osd.5 v2:172.21.15.50:6800/33606 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f1894006b90 con 0x7f18940015f0 2023-10-08T15:37:34.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.877+0000 7fdeb5ea3700 1 -- 172.21.15.3:0/1886919232 --> [v2:172.21.15.3:6808/33365,v1:172.21.15.3:6809/33365] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fde90002d30 con 0x7fde9c068830 2023-10-08T15:37:34.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.877+0000 7f21e874d700 1 -- 172.21.15.3:0/4143939408 --> [v2:172.21.15.3:6816/33366,v1:172.21.15.3:6817/33366] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f21c8002d30 con 0x7f21c40686c0 2023-10-08T15:37:34.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.877+0000 7f21d67fc700 1 -- 172.21.15.3:0/4143939408 <== osd.2 v2:172.21.15.3:6816/33366 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f21c8002d30 con 0x7f21c40686c0 2023-10-08T15:37:34.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.877+0000 7fdeacff9700 1 -- 172.21.15.3:0/1886919232 <== osd.3 v2:172.21.15.3:6808/33365 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fde90002d30 con 0x7fde9c068830 2023-10-08T15:37:34.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.877+0000 7fe9f6b8c700 1 -- 172.21.15.3:0/677980021 --> [v2:172.21.15.3:6818/33364,v1:172.21.15.3:6820/33364] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe9d4002cc0 con 0x7fe9dc068940 2023-10-08T15:37:34.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.877+0000 7f21c3fff700 1 -- 172.21.15.3:0/4143939408 >> [v2:172.21.15.3:6816/33366,v1:172.21.15.3:6817/33366] conn(0x7f21c40686c0 msgr2=0x7f21c406aad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.877+0000 7f21c3fff700 1 --2- 172.21.15.3:0/4143939408 >> [v2:172.21.15.3:6816/33366,v1:172.21.15.3:6817/33366] conn(0x7f21c40686c0 0x7f21c406aad0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.877+0000 7fde967fc700 1 -- 172.21.15.3:0/1886919232 >> [v2:172.21.15.3:6808/33365,v1:172.21.15.3:6809/33365] conn(0x7fde9c068830 msgr2=0x7fde9c06ac40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.877+0000 7fde967fc700 1 --2- 172.21.15.3:0/1886919232 >> [v2:172.21.15.3:6808/33365,v1:172.21.15.3:6809/33365] conn(0x7fde9c068830 0x7fde9c06ac40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.877+0000 7f21c3fff700 1 -- 172.21.15.3:0/4143939408 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f21c4060620 msgr2=0x7f21c4062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.877+0000 7fe9e5ffb700 1 -- 172.21.15.3:0/677980021 <== osd.1 v2:172.21.15.3:6818/33364 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe9d4002cc0 con 0x7fe9dc068940 2023-10-08T15:37:34.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.877+0000 7f21c3fff700 1 --2- 172.21.15.3:0/4143939408 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f21c4060620 0x7f21c4062ad0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f21d00078a0 tx=0x7f21d0007830 comp rx=0 tx=0).stop 2023-10-08T15:37:34.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.877+0000 7f21c3fff700 1 -- 172.21.15.3:0/4143939408 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f21e00b2740 msgr2=0x7f21e00bce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.877+0000 7f21c3fff700 1 --2- 172.21.15.3:0/4143939408 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f21e00b2740 0x7f21e00bce60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f21d800cb40 tx=0x7f21d8007f90 comp rx=0 tx=0).stop 2023-10-08T15:37:34.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.877+0000 7f21e6cea700 1 -- 172.21.15.3:0/4143939408 reap_dead start 2023-10-08T15:37:34.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.877+0000 7f21c3fff700 1 -- 172.21.15.3:0/4143939408 shutdown_connections 2023-10-08T15:37:34.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.877+0000 7f21c3fff700 1 -- 172.21.15.3:0/4143939408 >> 172.21.15.3:0/4143939408 conn(0x7f21e00be630 msgr2=0x7f21e0147780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:34.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.877+0000 7f21c3fff700 1 -- 172.21.15.3:0/4143939408 shutdown_connections 2023-10-08T15:37:34.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.877+0000 7fde967fc700 1 -- 172.21.15.3:0/1886919232 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fde9c060620 msgr2=0x7fde9c062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.877+0000 7fde967fc700 1 --2- 172.21.15.3:0/1886919232 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fde9c060620 0x7fde9c062ad0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdea4000f60 tx=0x7fdea4006cc0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.877+0000 7f21c3fff700 1 -- 172.21.15.3:0/4143939408 wait complete. 2023-10-08T15:37:34.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.877+0000 7fde967fc700 1 -- 172.21.15.3:0/1886919232 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdeb00a2470 msgr2=0x7fdeb0141a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.877+0000 7fde967fc700 1 --2- 172.21.15.3:0/1886919232 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdeb00a2470 0x7fdeb0141a70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdea800cd30 tx=0x7fdea8001b10 comp rx=0 tx=0).stop 2023-10-08T15:37:34.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.877+0000 7fdeb56a2700 1 -- 172.21.15.3:0/1886919232 reap_dead start 2023-10-08T15:37:34.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.877+0000 7fde967fc700 1 -- 172.21.15.3:0/1886919232 shutdown_connections 2023-10-08T15:37:34.935 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.877+0000 7fde967fc700 1 -- 172.21.15.3:0/1886919232 >> 172.21.15.3:0/1886919232 conn(0x7fdeb00be440 msgr2=0x7fdeb00bcac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:34.935 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.877+0000 7fde967fc700 1 -- 172.21.15.3:0/1886919232 shutdown_connections 2023-10-08T15:37:34.935 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.877+0000 7fde967fc700 1 -- 172.21.15.3:0/1886919232 wait complete. 2023-10-08T15:37:34.935 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.877+0000 7fe9db7fe700 1 -- 172.21.15.3:0/677980021 >> [v2:172.21.15.3:6818/33364,v1:172.21.15.3:6820/33364] conn(0x7fe9dc068940 msgr2=0x7fe9dc06ad50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.935 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.877+0000 7fe9db7fe700 1 --2- 172.21.15.3:0/677980021 >> [v2:172.21.15.3:6818/33364,v1:172.21.15.3:6820/33364] conn(0x7fe9dc068940 0x7fe9dc06ad50 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.877+0000 7fe9db7fe700 1 -- 172.21.15.3:0/677980021 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe9dc060730 msgr2=0x7fe9dc062be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.877+0000 7fe9db7fe700 1 --2- 172.21.15.3:0/677980021 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe9dc060730 0x7fe9dc062be0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe9e8029ba0 tx=0x7fe9e0017000 comp rx=0 tx=0).stop 2023-10-08T15:37:34.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.877+0000 7fe9db7fe700 1 -- 172.21.15.3:0/677980021 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe9e8007150 msgr2=0x7fe9e8005f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.877+0000 7fe9db7fe700 1 --2- 172.21.15.3:0/677980021 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe9e8007150 0x7fe9e8005f30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec00c590 tx=0x7fe9ec00c8a0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.877+0000 7f34c6a10700 1 -- 172.21.15.3:0/704135265 --> [v2:172.21.15.50:6808/33605,v1:172.21.15.50:6809/33605] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f34c014dc40 con 0x7f34ac068620 2023-10-08T15:37:34.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.877+0000 7fe9f638b700 1 -- 172.21.15.3:0/677980021 reap_dead start 2023-10-08T15:37:34.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.877+0000 7fe9db7fe700 1 -- 172.21.15.3:0/677980021 shutdown_connections 2023-10-08T15:37:34.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.877+0000 7fe9db7fe700 1 -- 172.21.15.3:0/677980021 >> 172.21.15.3:0/677980021 conn(0x7fe9e8044500 msgr2=0x7fe9e80457e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:34.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.877+0000 7fe9db7fe700 1 -- 172.21.15.3:0/677980021 shutdown_connections 2023-10-08T15:37:34.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.877+0000 7fe9db7fe700 1 -- 172.21.15.3:0/677980021 wait complete. 2023-10-08T15:37:34.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.877+0000 7f34a7fff700 1 -- 172.21.15.3:0/704135265 <== osd.4 v2:172.21.15.50:6808/33605 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f34c014dc40 con 0x7f34ac068620 2023-10-08T15:37:34.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.881+0000 7f34a5ffb700 1 -- 172.21.15.3:0/704135265 >> [v2:172.21.15.50:6808/33605,v1:172.21.15.50:6809/33605] conn(0x7f34ac068620 msgr2=0x7f34ac06aa30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.881+0000 7f34a5ffb700 1 --2- 172.21.15.3:0/704135265 >> [v2:172.21.15.50:6808/33605,v1:172.21.15.50:6809/33605] conn(0x7f34ac068620 0x7f34ac06aa30 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.881+0000 7f34a5ffb700 1 -- 172.21.15.3:0/704135265 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f34ac060580 msgr2=0x7f34ac062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.881+0000 7f34a5ffb700 1 --2- 172.21.15.3:0/704135265 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f34ac060580 0x7f34ac062a30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f34b400b470 tx=0x7f34b4019000 comp rx=0 tx=0).stop 2023-10-08T15:37:34.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.881+0000 7f34a5ffb700 1 -- 172.21.15.3:0/704135265 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f34c00b1c30 msgr2=0x7f34c014d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.881+0000 7f34a5ffb700 1 --2- 172.21.15.3:0/704135265 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f34c00b1c30 0x7f34c014d200 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f34b000ea50 tx=0x7f34b00091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.881+0000 7f34c4fad700 1 -- 172.21.15.3:0/704135265 reap_dead start 2023-10-08T15:37:34.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.881+0000 7f34a5ffb700 1 -- 172.21.15.3:0/704135265 shutdown_connections 2023-10-08T15:37:34.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.881+0000 7f34a5ffb700 1 -- 172.21.15.3:0/704135265 >> 172.21.15.3:0/704135265 conn(0x7f34c00be640 msgr2=0x7f34c013e1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:34.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.881+0000 7f34a5ffb700 1 -- 172.21.15.3:0/704135265 shutdown_connections 2023-10-08T15:37:34.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.881+0000 7f34a5ffb700 1 -- 172.21.15.3:0/704135265 wait complete. 2023-10-08T15:37:34.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.885+0000 7f4a0dafb700 1 -- 172.21.15.3:0/4170159049 --> [v2:172.21.15.50:6816/33604,v1:172.21.15.50:6818/33604] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4a080ba3a0 con 0x7f49f40687e0 2023-10-08T15:37:34.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.885+0000 7f49ef7fe700 1 -- 172.21.15.3:0/4170159049 <== osd.7 v2:172.21.15.50:6816/33604 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4a080ba3a0 con 0x7f49f40687e0 2023-10-08T15:37:34.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.893+0000 7f392359e700 1 -- 172.21.15.3:0/2122738797 --> [v2:172.21.15.3:6800/33363,v1:172.21.15.3:6801/33363] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3908002d30 con 0x7f39040686c0 2023-10-08T15:37:34.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.893+0000 7f18bafba700 1 -- 172.21.15.3:0/3823994491 --> [v2:172.21.15.50:6800/33606,v1:172.21.15.50:6801/33606] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1894005c20 con 0x7f18940015f0 2023-10-08T15:37:34.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.893+0000 7f4a0dafb700 1 -- 172.21.15.3:0/4170159049 >> [v2:172.21.15.50:6816/33604,v1:172.21.15.50:6818/33604] conn(0x7f49f40687e0 msgr2=0x7f49f406abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.893+0000 7f4a0dafb700 1 --2- 172.21.15.3:0/4170159049 >> [v2:172.21.15.50:6816/33604,v1:172.21.15.50:6818/33604] conn(0x7f49f40687e0 0x7f49f406abf0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.893+0000 7f4a0dafb700 1 -- 172.21.15.3:0/4170159049 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f49f4060650 msgr2=0x7f49f4062b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.893+0000 7f4a0dafb700 1 --2- 172.21.15.3:0/4170159049 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f49f4060650 0x7f49f4062b00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f49f8009ca0 tx=0x7f49f8009250 comp rx=0 tx=0).stop 2023-10-08T15:37:34.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.893+0000 7f4a0dafb700 1 -- 172.21.15.3:0/4170159049 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4a080bb040 msgr2=0x7f4a0814f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.893+0000 7f4a0dafb700 1 --2- 172.21.15.3:0/4170159049 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4a080bb040 0x7f4a0814f040 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f49fc015000 tx=0x7f49fc016000 comp rx=0 tx=0).stop 2023-10-08T15:37:34.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.893+0000 7f39127fc700 1 -- 172.21.15.3:0/2122738797 <== osd.0 v2:172.21.15.3:6800/33363 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3908002d30 con 0x7f39040686c0 2023-10-08T15:37:34.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.893+0000 7f4a07fff700 1 -- 172.21.15.3:0/4170159049 reap_dead start 2023-10-08T15:37:34.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.893+0000 7f18a9ffb700 1 -- 172.21.15.3:0/3823994491 <== osd.5 v2:172.21.15.50:6800/33606 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1894005c20 con 0x7f18940015f0 2023-10-08T15:37:34.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.893+0000 7f4a0dafb700 1 -- 172.21.15.3:0/4170159049 shutdown_connections 2023-10-08T15:37:34.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.893+0000 7f4a0dafb700 1 -- 172.21.15.3:0/4170159049 >> 172.21.15.3:0/4170159049 conn(0x7f4a080be630 msgr2=0x7f4a081503d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:34.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.893+0000 7f4a0dafb700 1 -- 172.21.15.3:0/4170159049 shutdown_connections 2023-10-08T15:37:34.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.893+0000 7f4a0dafb700 1 -- 172.21.15.3:0/4170159049 wait complete. 2023-10-08T15:37:34.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.893+0000 7fdfdfd0f700 1 -- 172.21.15.3:0/2224113455 --> [v2:172.21.15.50:6817/33607,v1:172.21.15.50:6819/33607] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdfd806d5e0 con 0x7fdfbc0687e0 2023-10-08T15:37:34.945 INFO:teuthology.orchestra.run.smithi003.stdout:60129542151 2023-10-08T15:37:34.946 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-08T15:37:34.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.893+0000 7fdfcdffb700 1 -- 172.21.15.3:0/2224113455 <== osd.6 v2:172.21.15.50:6817/33607 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdfd806d5e0 con 0x7fdfbc0687e0 2023-10-08T15:37:34.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.893+0000 7f392359e700 1 -- 172.21.15.3:0/2122738797 >> [v2:172.21.15.3:6800/33363,v1:172.21.15.3:6801/33363] conn(0x7f39040686c0 msgr2=0x7f390406aad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.893+0000 7f392359e700 1 --2- 172.21.15.3:0/2122738797 >> [v2:172.21.15.3:6800/33363,v1:172.21.15.3:6801/33363] conn(0x7f39040686c0 0x7f390406aad0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.893+0000 7f392359e700 1 -- 172.21.15.3:0/2122738797 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3904060620 msgr2=0x7f3904062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.893+0000 7f18bafba700 1 -- 172.21.15.3:0/3823994491 >> [v2:172.21.15.50:6800/33606,v1:172.21.15.50:6801/33606] conn(0x7f18940015f0 msgr2=0x7f1894003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.893+0000 7f18bafba700 1 --2- 172.21.15.3:0/3823994491 >> [v2:172.21.15.50:6800/33606,v1:172.21.15.50:6801/33606] conn(0x7f18940015f0 0x7f1894003aa0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.893+0000 7f392359e700 1 --2- 172.21.15.3:0/2122738797 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3904060620 0x7f3904062ad0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f391c009fd0 tx=0x7f391c009900 comp rx=0 tx=0).stop 2023-10-08T15:37:34.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.893+0000 7f392359e700 1 -- 172.21.15.3:0/2122738797 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f39240bab30 msgr2=0x7f392406e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.893+0000 7f392359e700 1 --2- 172.21.15.3:0/2122738797 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f39240bab30 0x7f392406e780 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f391400b5e0 tx=0x7f39140090f0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.893+0000 7f3922d9d700 1 -- 172.21.15.3:0/2122738797 reap_dead start 2023-10-08T15:37:34.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.893+0000 7f18bafba700 1 -- 172.21.15.3:0/3823994491 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1898060550 msgr2=0x7f1898062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.893+0000 7f18bafba700 1 --2- 172.21.15.3:0/3823994491 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1898060550 0x7f1898062a00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f18b4154f50 tx=0x7f18b0008040 comp rx=0 tx=0).stop 2023-10-08T15:37:34.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.893+0000 7f18bafba700 1 -- 172.21.15.3:0/3823994491 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f18b40a2620 msgr2=0x7f18b4143430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.893+0000 7f18bafba700 1 --2- 172.21.15.3:0/3823994491 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f18b40a2620 0x7f18b4143430 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f18ac00c910 tx=0x7f18ac0016b0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.893+0000 7f392359e700 1 -- 172.21.15.3:0/2122738797 shutdown_connections 2023-10-08T15:37:34.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.893+0000 7f392359e700 1 -- 172.21.15.3:0/2122738797 >> 172.21.15.3:0/2122738797 conn(0x7f39240be440 msgr2=0x7f3924068760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:34.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.893+0000 7f18ba7b9700 1 -- 172.21.15.3:0/3823994491 reap_dead start 2023-10-08T15:37:34.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.893+0000 7f18bafba700 1 -- 172.21.15.3:0/3823994491 shutdown_connections 2023-10-08T15:37:34.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.893+0000 7f18bafba700 1 -- 172.21.15.3:0/3823994491 >> 172.21.15.3:0/3823994491 conn(0x7f18b406a900 msgr2=0x7f18b406e340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:34.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.893+0000 7fdfdfd0f700 1 -- 172.21.15.3:0/2224113455 >> [v2:172.21.15.50:6817/33607,v1:172.21.15.50:6819/33607] conn(0x7fdfbc0687e0 msgr2=0x7fdfbc06abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.893+0000 7fdfdfd0f700 1 --2- 172.21.15.3:0/2224113455 >> [v2:172.21.15.50:6817/33607,v1:172.21.15.50:6819/33607] conn(0x7fdfbc0687e0 0x7fdfbc06abf0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.893+0000 7fdfdfd0f700 1 -- 172.21.15.3:0/2224113455 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fdfbc0605d0 msgr2=0x7fdfbc062a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.893+0000 7fdfdfd0f700 1 --2- 172.21.15.3:0/2224113455 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fdfbc0605d0 0x7fdfbc062a80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdfd8158e70 tx=0x7fdfd0007ea0 comp rx=0 tx=0).stop 2023-10-08T15:37:34.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.893+0000 7fdfdfd0f700 1 -- 172.21.15.3:0/2224113455 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdfd806d0d0 msgr2=0x7fdfd815a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:34.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.893+0000 7fdfdfd0f700 1 --2- 172.21.15.3:0/2224113455 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdfd806d0d0 0x7fdfd815a1f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdfd400be50 tx=0x7fdfd400d040 comp rx=0 tx=0).stop 2023-10-08T15:37:34.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.893+0000 7fdfde2ac700 1 -- 172.21.15.3:0/2224113455 reap_dead start 2023-10-08T15:37:34.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.893+0000 7f18bafba700 1 -- 172.21.15.3:0/3823994491 shutdown_connections 2023-10-08T15:37:34.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.897+0000 7f18bafba700 1 -- 172.21.15.3:0/3823994491 wait complete. 2023-10-08T15:37:34.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.897+0000 7f392359e700 1 -- 172.21.15.3:0/2122738797 shutdown_connections 2023-10-08T15:37:34.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.897+0000 7f392359e700 1 -- 172.21.15.3:0/2122738797 wait complete. 2023-10-08T15:37:34.953 INFO:teuthology.orchestra.run.smithi003.stdout:55834574854 2023-10-08T15:37:34.953 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-08T15:37:34.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.897+0000 7fdfdfd0f700 1 -- 172.21.15.3:0/2224113455 shutdown_connections 2023-10-08T15:37:34.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.897+0000 7fdfdfd0f700 1 -- 172.21.15.3:0/2224113455 >> 172.21.15.3:0/2224113455 conn(0x7fdfd80be630 msgr2=0x7fdfd80bc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:34.954 INFO:teuthology.orchestra.run.smithi003.stdout:60129542150 2023-10-08T15:37:34.955 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-08T15:37:34.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.897+0000 7fdfdfd0f700 1 -- 172.21.15.3:0/2224113455 shutdown_connections 2023-10-08T15:37:34.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:34.897+0000 7fdfdfd0f700 1 -- 172.21.15.3:0/2224113455 wait complete. 2023-10-08T15:37:34.956 INFO:teuthology.orchestra.run.smithi003.stdout:60129542151 2023-10-08T15:37:34.956 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-08T15:37:34.957 INFO:teuthology.orchestra.run.smithi003.stdout:60129542149 2023-10-08T15:37:34.958 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-08T15:37:34.958 INFO:teuthology.orchestra.run.smithi003.stdout:55834574854 2023-10-08T15:37:34.959 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-08T15:37:34.959 INFO:teuthology.orchestra.run.smithi003.stdout:60129542151 2023-10-08T15:37:34.960 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-08T15:37:34.961 INFO:teuthology.orchestra.run.smithi003.stdout:60129542150 2023-10-08T15:37:34.961 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-08T15:37:35.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.141+0000 7f01af67c700 1 Processor -- start 2023-10-08T15:37:35.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.141+0000 7f01af67c700 1 -- start start 2023-10-08T15:37:35.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.141+0000 7f01af67c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f01a80b2740 0x7f01a8146aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:35.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.141+0000 7f01af67c700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01a80b1cd0 con 0x7f01a8146fe0 2023-10-08T15:37:35.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.141+0000 7f01af67c700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01a80b1f40 con 0x7f01a8068320 2023-10-08T15:37:35.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.141+0000 7f01af67c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01a80b2220 con 0x7f01a80b2740 2023-10-08T15:37:35.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.141+0000 7f01adc19700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f01a8146fe0 0x7f01a814ac90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:53848/0 (socket says 172.21.15.3:53848) 2023-10-08T15:37:35.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.141+0000 7f01adc19700 1 -- 172.21.15.3:0/4002224664 learned_addr learned my addr 172.21.15.3:0/4002224664 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:35.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.141+0000 7f4093fff700 1 Processor -- start 2023-10-08T15:37:35.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.141+0000 7f019ffff700 1 -- 172.21.15.3:0/4002224664 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2469604908 0 0) 0x7f01a80b1cd0 con 0x7f01a8146fe0 2023-10-08T15:37:35.150 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.141+0000 7f4093fff700 1 -- start start 2023-10-08T15:37:35.150 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.141+0000 7f019ffff700 1 -- 172.21.15.3:0/4002224664 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0194003570 con 0x7f01a8146fe0 2023-10-08T15:37:35.151 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.141+0000 7f01acc17700 1 --2- 172.21.15.3:0/4002224664 >> v2:172.21.15.50:3300/0 conn(0x7f01a80b2740 0x7f01a8146aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:35.151 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.145+0000 7f01acc17700 1 -- 172.21.15.3:0/4002224664 >> v1:172.21.15.50:6789/0 conn(0x7f01a8068320 legacy=0x7f01a806cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:35.151 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.145+0000 7f01acc17700 1 -- 172.21.15.3:0/4002224664 >> v1:172.21.15.3:6789/0 conn(0x7f01a8146fe0 legacy=0x7f01a814ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:35.151 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.145+0000 7f01acc17700 1 -- 172.21.15.3:0/4002224664 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a806d600 con 0x7f01a80b2740 2023-10-08T15:37:35.151 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.145+0000 7f4093fff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f40940be0b0 0x7f40940be480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:35.151 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.145+0000 7f4093fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40940a23f0 0x7f40940bc390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:35.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.145+0000 7f4093fff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4094149cc0 con 0x7f409414a150 2023-10-08T15:37:35.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.145+0000 7f4093fff700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4094149670 con 0x7f40940be0b0 2023-10-08T15:37:35.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.145+0000 7f4093fff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4094149950 con 0x7f40940a23f0 2023-10-08T15:37:35.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.145+0000 7f01acc17700 1 --2- 172.21.15.3:0/4002224664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01a80b2740 0x7f01a8146aa0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f01980098e0 tx=0x7f01980091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b59ff18658d66bdf server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:35.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.145+0000 7f4092ffd700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f40940be0b0 0x7f40940be480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:35.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.145+0000 7f40937fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f409414a150 0x7f40940a0a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.3:46190/0 (socket says 172.21.15.3:46190) 2023-10-08T15:37:35.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.145+0000 7f40937fe700 1 -- 172.21.15.3:0/1505161446 learned_addr learned my addr 172.21.15.3:0/1505161446 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:35.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.145+0000 7f40927fc700 1 --2- 172.21.15.3:0/1505161446 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40940a23f0 0x7f40940bc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:35.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.145+0000 7f019ffff700 1 -- 172.21.15.3:0/4002224664 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019800b640 con 0x7f01a80b2740 2023-10-08T15:37:35.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.145+0000 7f019ffff700 1 -- 172.21.15.3:0/4002224664 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f019800b7a0 con 0x7f01a80b2740 2023-10-08T15:37:35.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.145+0000 7f019ffff700 1 -- 172.21.15.3:0/4002224664 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019800bb20 con 0x7f01a80b2740 2023-10-08T15:37:35.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.145+0000 7f4091ffb700 1 -- 172.21.15.3:0/1505161446 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1102437060 0 0) 0x7f4094149cc0 con 0x7f409414a150 2023-10-08T15:37:35.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.145+0000 7f4091ffb700 1 -- 172.21.15.3:0/1505161446 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f407c003570 con 0x7f409414a150 2023-10-08T15:37:35.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.145+0000 7f40927fc700 1 -- 172.21.15.3:0/1505161446 >> v2:172.21.15.3:3300/0 conn(0x7f40940be0b0 msgr2=0x7f40940be480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:35.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.145+0000 7f4091ffb700 1 -- 172.21.15.3:0/1505161446 <== mon.1 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 190853344 0 0) 0x7f407c003570 con 0x7f409414a150 2023-10-08T15:37:35.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.145+0000 7f01af67c700 1 -- 172.21.15.3:0/4002224664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01a80b2740 msgr2=0x7f01a8146aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:35.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.145+0000 7f01af67c700 1 --2- 172.21.15.3:0/4002224664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01a80b2740 0x7f01a8146aa0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f01980098e0 tx=0x7f01980091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.145+0000 7f40927fc700 1 --2- 172.21.15.3:0/1505161446 >> v2:172.21.15.3:3300/0 conn(0x7f40940be0b0 0x7f40940be480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.145+0000 7f40927fc700 1 -- 172.21.15.3:0/1505161446 >> v1:172.21.15.50:6789/0 conn(0x7f409414a150 legacy=0x7f40940a0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:35.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.145+0000 7f40927fc700 1 -- 172.21.15.3:0/1505161446 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f409414a580 con 0x7f40940a23f0 2023-10-08T15:37:35.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.145+0000 7f4092ffd700 1 --2- 172.21.15.3:0/1505161446 >> v2:172.21.15.3:3300/0 conn(0x7f40940be0b0 0x7f40940be480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:37:35.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.145+0000 7f01af67c700 1 -- 172.21.15.3:0/4002224664 shutdown_connections 2023-10-08T15:37:35.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.145+0000 7f01af67c700 1 --2- 172.21.15.3:0/4002224664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01a80b2740 0x7f01a8146aa0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.145+0000 7f01af67c700 1 -- 172.21.15.3:0/4002224664 >> 172.21.15.3:0/4002224664 conn(0x7f01a80be630 msgr2=0x7f01a80ba6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:35.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.145+0000 7f01af67c700 1 -- 172.21.15.3:0/4002224664 shutdown_connections 2023-10-08T15:37:35.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.145+0000 7f01af67c700 1 -- 172.21.15.3:0/4002224664 wait complete. 2023-10-08T15:37:35.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.145+0000 7f2318963700 1 Processor -- start 2023-10-08T15:37:35.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.145+0000 7f2318963700 1 -- start start 2023-10-08T15:37:35.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.145+0000 7f40927fc700 1 --2- 172.21.15.3:0/1505161446 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40940a23f0 0x7f40940bc390 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f408c009e60 tx=0x7f408c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16c38c6b2561f294 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:35.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.145+0000 7f2318963700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f23140a1d80 0x7f23140a2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:35.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7f2318963700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f231409dec0 con 0x7f23140a1430 2023-10-08T15:37:35.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7f2318963700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23140a2890 con 0x7f231414b4b0 2023-10-08T15:37:35.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7f2318963700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f231414ebb0 con 0x7f23140a1d80 2023-10-08T15:37:35.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7f23137fe700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f23140a1430 0x7f231414f3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:53852/0 (socket says 172.21.15.3:53852) 2023-10-08T15:37:35.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7f23137fe700 1 -- 172.21.15.3:0/4223319447 learned_addr learned my addr 172.21.15.3:0/4223319447 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:35.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7f01af67c700 1 Processor -- start 2023-10-08T15:37:35.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7f01af67c700 1 -- start start 2023-10-08T15:37:35.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7f4091ffb700 1 -- 172.21.15.3:0/1505161446 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408c00e070 con 0x7f40940a23f0 2023-10-08T15:37:35.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7f4091ffb700 1 -- 172.21.15.3:0/1505161446 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f408c00b7a0 con 0x7f40940a23f0 2023-10-08T15:37:35.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7f1fda8cd700 1 Processor -- start 2023-10-08T15:37:35.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7f2312ffd700 1 --2- 172.21.15.3:0/4223319447 >> v2:172.21.15.50:3300/0 conn(0x7f23140a1d80 0x7f23140a2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:35.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7f1fda8cd700 1 -- start start 2023-10-08T15:37:35.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7f23127fc700 1 -- 172.21.15.3:0/4223319447 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 295502306 0 0) 0x7f231409dec0 con 0x7f23140a1430 2023-10-08T15:37:35.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7f23127fc700 1 -- 172.21.15.3:0/4223319447 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22fc003570 con 0x7f23140a1430 2023-10-08T15:37:35.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7f4093fff700 1 -- 172.21.15.3:0/1505161446 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40940a23f0 msgr2=0x7f40940bc390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:35.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7f4093fff700 1 --2- 172.21.15.3:0/1505161446 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40940a23f0 0x7f40940bc390 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f408c009e60 tx=0x7f408c009780 comp rx=0 tx=0).stop 2023-10-08T15:37:35.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7fad68c40700 1 Processor -- start 2023-10-08T15:37:35.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7f23127fc700 1 -- 172.21.15.3:0/4223319447 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2970086845 0 0) 0x7f23140a2890 con 0x7f231414b4b0 2023-10-08T15:37:35.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7f23127fc700 1 -- 172.21.15.3:0/4223319447 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f231409dec0 con 0x7f231414b4b0 2023-10-08T15:37:35.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7f01af67c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f01a8068320 0x7f01a813ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:35.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7f01af67c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f01a80b2740 0x7f01a814b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:35.163 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7f01af67c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01a8146fe0 0x7f01a815ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:35.163 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7f01af67c700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a815a6b0 con 0x7f01a8068320 2023-10-08T15:37:35.163 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7f01af67c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a813e7d0 con 0x7f01a8146fe0 2023-10-08T15:37:35.163 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7f01af67c700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a814b4a0 con 0x7f01a80b2740 2023-10-08T15:37:35.163 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7fad68c40700 1 -- start start 2023-10-08T15:37:35.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7f4093fff700 1 -- 172.21.15.3:0/1505161446 shutdown_connections 2023-10-08T15:37:35.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7f4093fff700 1 --2- 172.21.15.3:0/1505161446 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40940a23f0 0x7f40940bc390 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7f4093fff700 1 --2- 172.21.15.3:0/1505161446 >> v2:172.21.15.3:3300/0 conn(0x7f40940be0b0 0x7f40940be480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7f4093fff700 1 -- 172.21.15.3:0/1505161446 >> 172.21.15.3:0/1505161446 conn(0x7f409406a900 msgr2=0x7f40940bd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:35.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7f4093fff700 1 -- 172.21.15.3:0/1505161446 shutdown_connections 2023-10-08T15:37:35.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7f4093fff700 1 -- 172.21.15.3:0/1505161446 wait complete. 2023-10-08T15:37:35.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7fbb8158d700 1 Processor -- start 2023-10-08T15:37:35.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7f01ad418700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f01a8068320 0x7f01a813ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:35.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7fbb8158d700 1 -- start start 2023-10-08T15:37:35.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7f01acc17700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f01a80b2740 0x7f01a814b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:35.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7f01ad418700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f01a8068320 0x7f01a813ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47826/0 (socket says 172.21.15.3:47826) 2023-10-08T15:37:35.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7f01ad418700 1 -- 172.21.15.3:0/3589228442 learned_addr learned my addr 172.21.15.3:0/3589228442 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:35.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7f01adc19700 1 --2- 172.21.15.3:0/3589228442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01a8146fe0 0x7f01a815ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:35.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7f01ad418700 1 -- 172.21.15.3:0/3589228442 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f01a80b2740 msgr2=0x7f01a814b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:35.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7f01ad418700 1 --2- 172.21.15.3:0/3589228442 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f01a80b2740 0x7f01a814b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7f01ad418700 1 -- 172.21.15.3:0/3589228442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01a8146fe0 msgr2=0x7f01a815ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:35.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7f01ad418700 1 --2- 172.21.15.3:0/3589228442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01a8146fe0 0x7f01a815ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7f01ad418700 1 -- 172.21.15.3:0/3589228442 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0198009420 con 0x7f01a8068320 2023-10-08T15:37:35.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7f2312ffd700 1 -- 172.21.15.3:0/4223319447 >> v1:172.21.15.50:6789/0 conn(0x7f231414b4b0 legacy=0x7f231409f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:35.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7f23127fc700 1 -- 172.21.15.3:0/4223319447 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 710729005 0 0) 0x7f22fc003570 con 0x7f23140a1430 2023-10-08T15:37:35.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7f2312ffd700 1 -- 172.21.15.3:0/4223319447 >> v1:172.21.15.3:6789/0 conn(0x7f23140a1430 legacy=0x7f231414f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:35.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7f2312ffd700 1 -- 172.21.15.3:0/4223319447 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f231414ee90 con 0x7f23140a1d80 2023-10-08T15:37:35.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7f01ad418700 1 --2- 172.21.15.3:0/3589228442 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f01a8068320 0x7f01a813ebd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f01a400c590 tx=0x7f01a400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:35.168 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7f2312ffd700 1 --2- 172.21.15.3:0/4223319447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23140a1d80 0x7f23140a2200 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2304009910 tx=0x7f23040091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=375da088ea373eb1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:35.168 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7f019d7fa700 1 -- 172.21.15.3:0/3589228442 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a4006820 con 0x7f01a8068320 2023-10-08T15:37:35.168 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7f019d7fa700 1 -- 172.21.15.3:0/3589228442 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01a4006980 con 0x7f01a8068320 2023-10-08T15:37:35.169 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7fbb8158d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbb7c06be60 0x7fbb7c0be520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:35.169 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7fbb8158d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbb7c06c3e0 0x7fbb7c14b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:35.169 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7fbb8158d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb7c06cb60 con 0x7fbb7c0be150 2023-10-08T15:37:35.169 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7fbb8158d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb7c14f8e0 con 0x7fbb7c06c3e0 2023-10-08T15:37:35.169 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7fbb8158d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7c14f5f0 con 0x7fbb7c06be60 2023-10-08T15:37:35.169 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7f23127fc700 1 -- 172.21.15.3:0/4223319447 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2308001470 con 0x7f23140a1d80 2023-10-08T15:37:35.169 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7fbb7affd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fbb7c0be150 0x7fbb7c0c26a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.3:46220/0 (socket says 172.21.15.3:46220) 2023-10-08T15:37:35.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7fbb7affd700 1 -- 172.21.15.3:0/1617701057 learned_addr learned my addr 172.21.15.3:0/1617701057 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:35.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7fad68c40700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fad640b3530 0x7fad6414abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:35.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7fad68c40700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fad640b2830 0x7fad6414b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:35.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7fad68c40700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad640b8a00 con 0x7fad6406e020 2023-10-08T15:37:35.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7fad68c40700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad640b2f80 con 0x7fad640b3530 2023-10-08T15:37:35.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7fad68c40700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad640b83d0 con 0x7fad640b2830 2023-10-08T15:37:35.171 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7fad6259c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fad640b3530 0x7fad6414abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:35.171 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7fad61d9b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fad640b2830 0x7fad6414b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:35.171 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7fad6259c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fad640b3530 0x7fad6414abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.3:36986/0 (socket says 172.21.15.3:36986) 2023-10-08T15:37:35.171 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7fad6259c700 1 -- 172.21.15.3:0/3577449 learned_addr learned my addr 172.21.15.3:0/3577449 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:35.171 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7f23127fc700 1 -- 172.21.15.3:0/4223319447 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2304011420 con 0x7f23140a1d80 2023-10-08T15:37:35.171 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7fbb7a7fc700 1 --2- 172.21.15.3:0/1617701057 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbb7c06be60 0x7fbb7c0be520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:35.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7fbb7b7fe700 1 --2- 172.21.15.3:0/1617701057 >> v2:172.21.15.50:3300/0 conn(0x7fbb7c06c3e0 0x7fbb7c14b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:35.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7f23127fc700 1 -- 172.21.15.3:0/4223319447 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23040117c0 con 0x7f23140a1d80 2023-10-08T15:37:35.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7fad6259c700 1 -- 172.21.15.3:0/3577449 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fad640b2830 msgr2=0x7fad6414b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:35.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7fad6259c700 1 --2- 172.21.15.3:0/3577449 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fad640b2830 0x7fad6414b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7fad6259c700 1 -- 172.21.15.3:0/3577449 >> v1:172.21.15.50:6789/0 conn(0x7fad6406e020 legacy=0x7fad6414ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:35.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7f4093fff700 1 Processor -- start 2023-10-08T15:37:35.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7fad6259c700 1 -- 172.21.15.3:0/3577449 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad640b8690 con 0x7fad640b3530 2023-10-08T15:37:35.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.149+0000 7f019d7fa700 1 -- 172.21.15.3:0/3589228442 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a4006d00 con 0x7f01a8068320 2023-10-08T15:37:35.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f4093fff700 1 -- start start 2023-10-08T15:37:35.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7fbb79ffb700 1 -- 172.21.15.3:0/1617701057 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1027519028 0 0) 0x7fbb7c06cb60 con 0x7fbb7c0be150 2023-10-08T15:37:35.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7fbb7a7fc700 1 -- 172.21.15.3:0/1617701057 >> v2:172.21.15.50:3300/0 conn(0x7fbb7c06c3e0 msgr2=0x7fbb7c14b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:35.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7fbb7a7fc700 1 --2- 172.21.15.3:0/1617701057 >> v2:172.21.15.50:3300/0 conn(0x7fbb7c06c3e0 0x7fbb7c14b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7fbb7a7fc700 1 -- 172.21.15.3:0/1617701057 >> v1:172.21.15.50:6789/0 conn(0x7fbb7c0be150 legacy=0x7fbb7c0c26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:35.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7fbb7a7fc700 1 -- 172.21.15.3:0/1617701057 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb7c0c2db0 con 0x7fbb7c06be60 2023-10-08T15:37:35.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7fad6259c700 1 --2- 172.21.15.3:0/3577449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad640b3530 0x7fad6414abe0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fad540099b0 tx=0x7fad54009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52e90fa4ba615057 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:35.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f1fda8cd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1fd40670e0 0x7f1fd414c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:35.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f1fda8cd700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f1fd414ae70 0x7f1fd414b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:35.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f1fda8cd700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fd40685b0 con 0x7f1fd4067ad0 2023-10-08T15:37:35.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f1fda8cd700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fd4068ff0 con 0x7f1fd414ae70 2023-10-08T15:37:35.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f1fda8cd700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd406dca0 con 0x7f1fd40670e0 2023-10-08T15:37:35.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7fad6159a700 1 -- 172.21.15.3:0/3577449 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5400b860 con 0x7fad640b3530 2023-10-08T15:37:35.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f2318963700 1 -- 172.21.15.3:0/4223319447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23140a1d80 msgr2=0x7f23140a2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:35.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f2318963700 1 --2- 172.21.15.3:0/4223319447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23140a1d80 0x7f23140a2200 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2304009910 tx=0x7f23040091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7fbb7a7fc700 1 --2- 172.21.15.3:0/1617701057 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbb7c06be60 0x7fbb7c0be520 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbb700098e0 tx=0x7fbb700091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=babca87e84c43ccd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:35.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f1fd3fff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f1fd4067ad0 0x7f1fd4067ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:53854/0 (socket says 172.21.15.3:53854) 2023-10-08T15:37:35.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f1fd3fff700 1 -- 172.21.15.3:0/2023885363 learned_addr learned my addr 172.21.15.3:0/2023885363 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:35.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f1fd37fe700 1 --2- 172.21.15.3:0/2023885363 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1fd40670e0 0x7f1fd414c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:35.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7fad6159a700 1 -- 172.21.15.3:0/3577449 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad5400b9c0 con 0x7fad640b3530 2023-10-08T15:37:35.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7fad6159a700 1 -- 172.21.15.3:0/3577449 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5400bd60 con 0x7fad640b3530 2023-10-08T15:37:35.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f2318963700 1 -- 172.21.15.3:0/4223319447 shutdown_connections 2023-10-08T15:37:35.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f2318963700 1 --2- 172.21.15.3:0/4223319447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23140a1d80 0x7f23140a2200 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f2318963700 1 -- 172.21.15.3:0/4223319447 >> 172.21.15.3:0/4223319447 conn(0x7f23140bd9b0 msgr2=0x7f23140bddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:35.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f1fd8e6a700 1 --2- 172.21.15.3:0/2023885363 >> v2:172.21.15.3:3300/0 conn(0x7f1fd414ae70 0x7f1fd414b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:35.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7fbb79ffb700 1 -- 172.21.15.3:0/1617701057 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb70009e80 con 0x7fbb7c06be60 2023-10-08T15:37:35.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f4093fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f40940a23f0 0x7f409415adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:35.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f4093fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40940be0b0 0x7f409409c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:35.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f4093fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f409414a150 0x7f40940b1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:35.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f4093fff700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f409415b300 con 0x7f40940a23f0 2023-10-08T15:37:35.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f4093fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f409409c740 con 0x7f40940be0b0 2023-10-08T15:37:35.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f4093fff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f409415b5b0 con 0x7f409414a150 2023-10-08T15:37:35.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7fbb79ffb700 1 -- 172.21.15.3:0/1617701057 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb7000b860 con 0x7fbb7c06be60 2023-10-08T15:37:35.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7fbb79ffb700 1 -- 172.21.15.3:0/1617701057 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb7000bc00 con 0x7fbb7c06be60 2023-10-08T15:37:35.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7fbb8158d700 1 -- 172.21.15.3:0/1617701057 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbb7c06be60 msgr2=0x7fbb7c0be520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:35.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7fbb8158d700 1 --2- 172.21.15.3:0/1617701057 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbb7c06be60 0x7fbb7c0be520 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbb700098e0 tx=0x7fbb700091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f4092ffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f40940a23f0 0x7f409415adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:35.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f4092ffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f40940a23f0 0x7f409415adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47838/0 (socket says 172.21.15.3:47838) 2023-10-08T15:37:35.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f4092ffd700 1 -- 172.21.15.3:0/1823560360 learned_addr learned my addr 172.21.15.3:0/1823560360 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:35.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f40937fe700 1 --2- 172.21.15.3:0/1823560360 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f409414a150 0x7f40940b1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:35.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f4092ffd700 1 -- 172.21.15.3:0/1823560360 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f409414a150 msgr2=0x7f40940b1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:35.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f4092ffd700 1 --2- 172.21.15.3:0/1823560360 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f409414a150 0x7f40940b1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f4092ffd700 1 -- 172.21.15.3:0/1823560360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40940be0b0 msgr2=0x7f409409c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:35.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f4092ffd700 1 --2- 172.21.15.3:0/1823560360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40940be0b0 0x7f409409c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f4092ffd700 1 -- 172.21.15.3:0/1823560360 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4088009420 con 0x7f40940a23f0 2023-10-08T15:37:35.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f40937fe700 1 --2- 172.21.15.3:0/1823560360 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f409414a150 0x7f40940b1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:37:35.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f4092ffd700 1 --2- 172.21.15.3:0/1823560360 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f40940a23f0 0x7f409415adc0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f408800ec80 tx=0x7f40880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:35.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f1fd2ffd700 1 -- 172.21.15.3:0/2023885363 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1874813662 0 0) 0x7f1fd40685b0 con 0x7f1fd4067ad0 2023-10-08T15:37:35.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f1fd2ffd700 1 -- 172.21.15.3:0/2023885363 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fbc003570 con 0x7f1fd4067ad0 2023-10-08T15:37:35.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7fad68c40700 1 -- 172.21.15.3:0/3577449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad640b3530 msgr2=0x7fad6414abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:35.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7fad68c40700 1 --2- 172.21.15.3:0/3577449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad640b3530 0x7fad6414abe0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fad540099b0 tx=0x7fad54009250 comp rx=0 tx=0).stop 2023-10-08T15:37:35.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f01af67c700 1 -- 172.21.15.3:0/3589228442 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01a814bf10 con 0x7f01a8068320 2023-10-08T15:37:35.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f01af67c700 1 -- 172.21.15.3:0/3589228442 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01a813f320 con 0x7f01a8068320 2023-10-08T15:37:35.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f1fd2ffd700 1 -- 172.21.15.3:0/2023885363 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2626740837 0 0) 0x7f1fbc003570 con 0x7f1fd4067ad0 2023-10-08T15:37:35.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f1fd2ffd700 1 -- 172.21.15.3:0/2023885363 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1fd40670e0 msgr2=0x7f1fd414c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:35.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f1fd2ffd700 1 --2- 172.21.15.3:0/2023885363 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1fd40670e0 0x7f1fd414c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f1fd2ffd700 1 -- 172.21.15.3:0/2023885363 >> v2:172.21.15.3:3300/0 conn(0x7f1fd414ae70 msgr2=0x7f1fd414b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:35.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f1fd2ffd700 1 --2- 172.21.15.3:0/2023885363 >> v2:172.21.15.3:3300/0 conn(0x7f1fd414ae70 0x7f1fd414b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f1fd2ffd700 1 -- 172.21.15.3:0/2023885363 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd406df80 con 0x7f1fd4067ad0 2023-10-08T15:37:35.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f1fd2ffd700 1 -- 172.21.15.3:0/2023885363 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2285686191 0 0) 0x7f1fc4001470 con 0x7f1fd4067ad0 2023-10-08T15:37:35.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f1fd8e6a700 1 --2- 172.21.15.3:0/2023885363 >> v2:172.21.15.3:3300/0 conn(0x7f1fd414ae70 0x7f1fd414b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:37:35.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f1fd2ffd700 1 -- 172.21.15.3:0/2023885363 >> v1:172.21.15.3:6789/0 conn(0x7f1fd4067ad0 legacy=0x7f1fd4067ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:35.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f1fd2ffd700 1 --2- 172.21.15.3:0/2023885363 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1fbc003ae0 0x7f1fbc003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:35.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f1fd2ffd700 1 --2- 172.21.15.3:0/2023885363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fbc004810 0x7f1fbc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:35.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f1fd2ffd700 1 --2- 172.21.15.3:0/2023885363 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1fd40670e0 0x7f1fbc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:35.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f1fd2ffd700 1 -- 172.21.15.3:0/2023885363 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd4068ff0 con 0x7f1fbc003ae0 2023-10-08T15:37:35.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f1fd2ffd700 1 -- 172.21.15.3:0/2023885363 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd406dca0 con 0x7f1fbc004810 2023-10-08T15:37:35.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f1fd2ffd700 1 -- 172.21.15.3:0/2023885363 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fbc00bb10 con 0x7f1fd40670e0 2023-10-08T15:37:35.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f2318963700 1 -- 172.21.15.3:0/4223319447 shutdown_connections 2023-10-08T15:37:35.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f1fd3fff700 1 --2- 172.21.15.3:0/2023885363 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1fbc003ae0 0x7f1fbc003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:35.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f1fd3fff700 1 -- 172.21.15.3:0/2023885363 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1fd40670e0 msgr2=0x7f1fbc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:35.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f1fd8e6a700 1 --2- 172.21.15.3:0/2023885363 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1fd40670e0 0x7f1fbc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:35.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f1fd3fff700 1 --2- 172.21.15.3:0/2023885363 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1fd40670e0 0x7f1fbc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f1fd3fff700 1 -- 172.21.15.3:0/2023885363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fbc004810 msgr2=0x7f1fbc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:35.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f1fd3fff700 1 --2- 172.21.15.3:0/2023885363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fbc004810 0x7f1fbc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f1fd3fff700 1 -- 172.21.15.3:0/2023885363 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fbc003570 con 0x7f1fbc003ae0 2023-10-08T15:37:35.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f1fd8e6a700 1 --2- 172.21.15.3:0/2023885363 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1fd40670e0 0x7f1fbc0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:37:35.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f1fd3fff700 1 --2- 172.21.15.3:0/2023885363 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1fbc003ae0 0x7f1fbc003ef0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1fc400c2d0 tx=0x7f1fc4001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e546c279fbfc6295 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:35.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f1fd2ffd700 1 -- 172.21.15.3:0/2023885363 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc400cba0 con 0x7f1fbc003ae0 2023-10-08T15:37:35.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f1fd2ffd700 1 -- 172.21.15.3:0/2023885363 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fc400cd20 con 0x7f1fbc003ae0 2023-10-08T15:37:35.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f1fd2ffd700 1 -- 172.21.15.3:0/2023885363 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc4005b70 con 0x7f1fbc003ae0 2023-10-08T15:37:35.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f019d7fa700 1 -- 172.21.15.3:0/3589228442 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f01a4007230 con 0x7f01a8068320 2023-10-08T15:37:35.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7f1fda8cd700 1 -- 172.21.15.3:0/2023885363 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1fbc003ae0 msgr2=0x7f1fbc003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:35.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7f1fda8cd700 1 --2- 172.21.15.3:0/2023885363 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1fbc003ae0 0x7f1fbc003ef0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1fc400c2d0 tx=0x7f1fc4001dc0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7fad68c40700 1 -- 172.21.15.3:0/3577449 shutdown_connections 2023-10-08T15:37:35.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7fad68c40700 1 --2- 172.21.15.3:0/3577449 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fad640b2830 0x7fad6414b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7fad68c40700 1 --2- 172.21.15.3:0/3577449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad640b3530 0x7fad6414abe0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7fad68c40700 1 -- 172.21.15.3:0/3577449 >> 172.21.15.3:0/3577449 conn(0x7fad640be630 msgr2=0x7fad640ba6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:35.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7fad68c40700 1 -- 172.21.15.3:0/3577449 shutdown_connections 2023-10-08T15:37:35.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7fad68c40700 1 -- 172.21.15.3:0/3577449 wait complete. 2023-10-08T15:37:35.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7f019d7fa700 1 --2- 172.21.15.3:0/3589228442 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f018c0605d0 0x7f018c062a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:35.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7f01af67c700 1 -- 172.21.15.3:0/3589228442 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01a813ea10 con 0x7f01a8068320 2023-10-08T15:37:35.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.153+0000 7f2318963700 1 -- 172.21.15.3:0/4223319447 wait complete. 2023-10-08T15:37:35.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7f2318963700 1 Processor -- start 2023-10-08T15:37:35.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7f2318963700 1 -- start start 2023-10-08T15:37:35.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7f1fd8e6a700 1 -- 172.21.15.3:0/2023885363 reap_dead start 2023-10-08T15:37:35.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7f2318963700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f23140a1430 0x7f23141508d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:35.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7f2318963700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23140a1d80 0x7f231415e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:35.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7f2318963700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f231414b4b0 0x7f2314067850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:35.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7f2318963700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23140670e0 con 0x7f231414b4b0 2023-10-08T15:37:35.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7f2318963700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23140673c0 con 0x7f23140a1d80 2023-10-08T15:37:35.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7f2318963700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2314150e10 con 0x7f23140a1430 2023-10-08T15:37:35.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7f2313fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f231414b4b0 0x7f2314067850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:35.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7f2313fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f231414b4b0 0x7f2314067850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47858/0 (socket says 172.21.15.3:47858) 2023-10-08T15:37:35.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7f2313fff700 1 -- 172.21.15.3:0/940902737 learned_addr learned my addr 172.21.15.3:0/940902737 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:35.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7f23137fe700 1 --2- 172.21.15.3:0/940902737 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f23140a1430 0x7f23141508d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:35.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7f2312ffd700 1 --2- 172.21.15.3:0/940902737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23140a1d80 0x7f231415e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:35.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7f2313fff700 1 -- 172.21.15.3:0/940902737 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f23140a1430 msgr2=0x7f23141508d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:35.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7f2313fff700 1 --2- 172.21.15.3:0/940902737 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f23140a1430 0x7f23141508d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7f2313fff700 1 -- 172.21.15.3:0/940902737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23140a1d80 msgr2=0x7f231415e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:35.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7f2313fff700 1 --2- 172.21.15.3:0/940902737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23140a1d80 0x7f231415e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7f2313fff700 1 -- 172.21.15.3:0/940902737 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2304009420 con 0x7f231414b4b0 2023-10-08T15:37:35.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7fad68c40700 1 Processor -- start 2023-10-08T15:37:35.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7fad68c40700 1 -- start start 2023-10-08T15:37:35.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7f2313fff700 1 --2- 172.21.15.3:0/940902737 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f231414b4b0 0x7f2314067850 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f230c00c890 tx=0x7f230c002700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:35.194 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7fad68c40700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad6406e020 0x7fad6406be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:35.194 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7fad68c40700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fad640b2830 0x7fad64130f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:35.194 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7fad68c40700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad640b3530 0x7fad6414cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:35.194 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7fad68c40700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad6406dad0 con 0x7fad640b3530 2023-10-08T15:37:35.194 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7fad68c40700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad6406c360 con 0x7fad6406e020 2023-10-08T15:37:35.194 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7fad68c40700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad6414ee90 con 0x7fad640b2830 2023-10-08T15:37:35.194 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7fad62d9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad640b3530 0x7fad6414cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:35.194 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7fad62d9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad640b3530 0x7fad6414cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47864/0 (socket says 172.21.15.3:47864) 2023-10-08T15:37:35.194 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7fad62d9d700 1 -- 172.21.15.3:0/3339720306 learned_addr learned my addr 172.21.15.3:0/3339720306 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:35.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7fad61d9b700 1 --2- 172.21.15.3:0/3339720306 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fad640b2830 0x7fad64130f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:35.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7fad6259c700 1 --2- 172.21.15.3:0/3339720306 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad6406e020 0x7fad6406be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:35.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7fad62d9d700 1 -- 172.21.15.3:0/3339720306 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fad640b2830 msgr2=0x7fad64130f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:35.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7fad62d9d700 1 --2- 172.21.15.3:0/3339720306 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fad640b2830 0x7fad64130f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7fad62d9d700 1 -- 172.21.15.3:0/3339720306 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad6406e020 msgr2=0x7fad6406be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:35.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7fad62d9d700 1 --2- 172.21.15.3:0/3339720306 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad6406e020 0x7fad6406be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7fad62d9d700 1 -- 172.21.15.3:0/3339720306 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad540094f0 con 0x7fad640b3530 2023-10-08T15:37:35.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7fad6259c700 1 --2- 172.21.15.3:0/3339720306 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad6406e020 0x7fad6406be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:37:35.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7fad62d9d700 1 --2- 172.21.15.3:0/3339720306 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad640b3530 0x7fad6414cf20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fad5c00c870 tx=0x7fad5c001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:35.196 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7fbb8158d700 1 -- 172.21.15.3:0/1617701057 shutdown_connections 2023-10-08T15:37:35.196 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7fbb8158d700 1 --2- 172.21.15.3:0/1617701057 >> v2:172.21.15.50:3300/0 conn(0x7fbb7c06c3e0 0x7fbb7c14b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.196 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7fbb8158d700 1 --2- 172.21.15.3:0/1617701057 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbb7c06be60 0x7fbb7c0be520 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.196 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7fbb8158d700 1 -- 172.21.15.3:0/1617701057 >> 172.21.15.3:0/1617701057 conn(0x7fbb7c06e460 msgr2=0x7fbb7c0c1f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:35.196 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7f1fda8cd700 1 -- 172.21.15.3:0/2023885363 shutdown_connections 2023-10-08T15:37:35.196 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7f1fda8cd700 1 -- 172.21.15.3:0/2023885363 >> 172.21.15.3:0/2023885363 conn(0x7f1fd40bdda0 msgr2=0x7f1fd40be170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:35.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7f407affd700 1 -- 172.21.15.3:0/1823560360 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408800c9d0 con 0x7f40940a23f0 2023-10-08T15:37:35.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7f407affd700 1 -- 172.21.15.3:0/1823560360 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f408800cb30 con 0x7f40940a23f0 2023-10-08T15:37:35.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7fbb8158d700 1 -- 172.21.15.3:0/1617701057 shutdown_connections 2023-10-08T15:37:35.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7f407affd700 1 -- 172.21.15.3:0/1823560360 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408800ceb0 con 0x7f40940a23f0 2023-10-08T15:37:35.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7f1fda8cd700 1 -- 172.21.15.3:0/2023885363 shutdown_connections 2023-10-08T15:37:35.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7f01acc17700 1 --2- 172.21.15.3:0/3589228442 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f018c0605d0 0x7f018c062a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:35.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.157+0000 7f1fda8cd700 1 -- 172.21.15.3:0/2023885363 wait complete. 2023-10-08T15:37:35.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.161+0000 7fbb8158d700 1 -- 172.21.15.3:0/1617701057 wait complete. 2023-10-08T15:37:35.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.161+0000 7f4093fff700 1 -- 172.21.15.3:0/1823560360 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f408c009a20 con 0x7f40940a23f0 2023-10-08T15:37:35.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.161+0000 7f4093fff700 1 -- 172.21.15.3:0/1823560360 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f409409d490 con 0x7f40940a23f0 2023-10-08T15:37:35.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.161+0000 7f1fda8cd700 1 Processor -- start 2023-10-08T15:37:35.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.161+0000 7f1fda8cd700 1 -- start start 2023-10-08T15:37:35.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.161+0000 7fbb8158d700 1 Processor -- start 2023-10-08T15:37:35.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.161+0000 7f1fda8cd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1fbc003ae0 0x7f1fd415c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:35.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.161+0000 7f1fda8cd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1fd40989f0 0x7f1fd4096850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:35.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.161+0000 7f1fda8cd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fd4097410 0x7f1fd40a1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:35.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.161+0000 7f1fda8cd700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd415bde0 con 0x7f1fd40989f0 2023-10-08T15:37:35.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.161+0000 7f1fda8cd700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd415b790 con 0x7f1fd4097410 2023-10-08T15:37:35.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.161+0000 7f1fda8cd700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd415ba70 con 0x7f1fbc003ae0 2023-10-08T15:37:35.201 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.161+0000 7fbb8158d700 1 -- start start 2023-10-08T15:37:35.201 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.161+0000 7f1fd37fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1fd40989f0 0x7f1fd4096850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:35.201 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.161+0000 7f1fd37fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1fd40989f0 0x7f1fd4096850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47868/0 (socket says 172.21.15.3:47868) 2023-10-08T15:37:35.201 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.161+0000 7f1fd37fe700 1 -- 172.21.15.3:0/465901460 learned_addr learned my addr 172.21.15.3:0/465901460 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:35.201 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.161+0000 7f4093fff700 1 -- 172.21.15.3:0/1823560360 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f409405ecf0 con 0x7f40940a23f0 2023-10-08T15:37:35.202 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.161+0000 7f1fd8e6a700 1 --2- 172.21.15.3:0/465901460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fd4097410 0x7f1fd40a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:35.202 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.161+0000 7f1fd3fff700 1 --2- 172.21.15.3:0/465901460 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1fbc003ae0 0x7f1fd415c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:35.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.161+0000 7f1fd37fe700 1 -- 172.21.15.3:0/465901460 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1fbc003ae0 msgr2=0x7f1fd415c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:35.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.161+0000 7f1fd37fe700 1 --2- 172.21.15.3:0/465901460 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1fbc003ae0 0x7f1fd415c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.161+0000 7f1fd37fe700 1 -- 172.21.15.3:0/465901460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fd4097410 msgr2=0x7f1fd40a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:35.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.161+0000 7f1fd37fe700 1 --2- 172.21.15.3:0/465901460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fd4097410 0x7f1fd40a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.161+0000 7f1fd37fe700 1 -- 172.21.15.3:0/465901460 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd415b440 con 0x7f1fd40989f0 2023-10-08T15:37:35.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.161+0000 7f1fd8e6a700 1 --2- 172.21.15.3:0/465901460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fd4097410 0x7f1fd40a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:37:35.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.161+0000 7f019d7fa700 1 -- 172.21.15.3:0/3589228442 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f01a407ffc0 con 0x7f01a8068320 2023-10-08T15:37:35.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.161+0000 7f01acc17700 1 --2- 172.21.15.3:0/3589228442 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f018c0605d0 0x7f018c062a80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f01980091e0 tx=0x7f0198017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:35.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.161+0000 7f1fd37fe700 1 --2- 172.21.15.3:0/465901460 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1fd40989f0 0x7f1fd4096850 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1fc800e9d0 tx=0x7f1fc80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:35.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.161+0000 7fbb8158d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb7c06be60 0x7fbb7c0c2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:35.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.161+0000 7fbb8158d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb7c06c3e0 0x7fbb7c09e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:35.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.161+0000 7fbb8158d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbb7c0be150 0x7fbb7c0bc910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:35.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.161+0000 7fae25cda700 1 Processor -- start 2023-10-08T15:37:35.205 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.161+0000 7fbb8158d700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7c0bbd30 con 0x7fbb7c06be60 2023-10-08T15:37:35.205 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.161+0000 7fbb8158d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7c0c2770 con 0x7fbb7c06c3e0 2023-10-08T15:37:35.205 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.161+0000 7fbb8158d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7c1638c0 con 0x7fbb7c0be150 2023-10-08T15:37:35.205 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.161+0000 7fae25cda700 1 -- start start 2023-10-08T15:37:35.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.161+0000 7fbb7affd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb7c06be60 0x7fbb7c0c2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:35.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.161+0000 7fbb7affd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb7c06be60 0x7fbb7c0c2230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47874/0 (socket says 172.21.15.3:47874) 2023-10-08T15:37:35.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.161+0000 7fbb7affd700 1 -- 172.21.15.3:0/2363291931 learned_addr learned my addr 172.21.15.3:0/2363291931 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:35.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.161+0000 7fbb7a7fc700 1 --2- 172.21.15.3:0/2363291931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb7c06c3e0 0x7fbb7c09e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:35.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.161+0000 7fbb7b7fe700 1 --2- 172.21.15.3:0/2363291931 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbb7c0be150 0x7fbb7c0bc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:35.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.161+0000 7fbb7affd700 1 -- 172.21.15.3:0/2363291931 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbb7c0be150 msgr2=0x7fbb7c0bc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:35.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.161+0000 7fbb7affd700 1 --2- 172.21.15.3:0/2363291931 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbb7c0be150 0x7fbb7c0bc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.161+0000 7fbb7affd700 1 -- 172.21.15.3:0/2363291931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb7c06c3e0 msgr2=0x7fbb7c09e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:35.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.161+0000 7fbb7affd700 1 --2- 172.21.15.3:0/2363291931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb7c06c3e0 0x7fbb7c09e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.161+0000 7fbb7affd700 1 -- 172.21.15.3:0/2363291931 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb70009420 con 0x7fbb7c06be60 2023-10-08T15:37:35.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.161+0000 7fbb7affd700 1 --2- 172.21.15.3:0/2363291931 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb7c06be60 0x7fbb7c0c2230 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbb7400cc70 tx=0x7fbb74001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:35.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.165+0000 7f1fc3fff700 1 -- 172.21.15.3:0/465901460 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc800c850 con 0x7f1fd40989f0 2023-10-08T15:37:35.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.165+0000 7f1fda8cd700 1 -- 172.21.15.3:0/465901460 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fd4096d90 con 0x7f1fd40989f0 2023-10-08T15:37:35.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.165+0000 7f1fda8cd700 1 -- 172.21.15.3:0/465901460 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fd40a1bf0 con 0x7f1fd40989f0 2023-10-08T15:37:35.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.165+0000 7fad527fc700 1 -- 172.21.15.3:0/3339720306 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5c012630 con 0x7fad640b3530 2023-10-08T15:37:35.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.165+0000 7fad68c40700 1 -- 172.21.15.3:0/3339720306 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad641314b0 con 0x7fad640b3530 2023-10-08T15:37:35.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.165+0000 7fad68c40700 1 -- 172.21.15.3:0/3339720306 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad6414d460 con 0x7fad640b3530 2023-10-08T15:37:35.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.165+0000 7f019d7fa700 1 -- 172.21.15.3:0/3589228442 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f01a813ea10 con 0x7f01a8068320 2023-10-08T15:37:35.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.161+0000 7fae25cda700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fae200a1d80 0x7fae200a2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:35.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.161+0000 7fae25cda700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae2009dec0 con 0x7fae200a1430 2023-10-08T15:37:35.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.165+0000 7fae25cda700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae200a2890 con 0x7fae2014b4b0 2023-10-08T15:37:35.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.165+0000 7fae25cda700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae2014ebb0 con 0x7fae200a1d80 2023-10-08T15:37:35.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.165+0000 7fae24cd8700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fae200a1430 0x7fae2014f3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:53866/0 (socket says 172.21.15.3:53866) 2023-10-08T15:37:35.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.165+0000 7fae24cd8700 1 -- 172.21.15.3:0/956352463 learned_addr learned my addr 172.21.15.3:0/956352463 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:35.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.161+0000 7f22fb7fe700 1 -- 172.21.15.3:0/940902737 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230c002030 con 0x7f231414b4b0 2023-10-08T15:37:35.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.165+0000 7f2318963700 1 -- 172.21.15.3:0/940902737 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2314149f60 con 0x7f231414b4b0 2023-10-08T15:37:35.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.165+0000 7f2318963700 1 -- 172.21.15.3:0/940902737 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f231415e770 con 0x7f231414b4b0 2023-10-08T15:37:35.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.165+0000 7fae1ffff700 1 --2- 172.21.15.3:0/956352463 >> v2:172.21.15.50:3300/0 conn(0x7fae200a1d80 0x7fae200a2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:35.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.165+0000 7fbb6affd700 1 -- 172.21.15.3:0/2363291931 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb7400ce80 con 0x7fbb7c06be60 2023-10-08T15:37:35.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.165+0000 7fbb8158d700 1 -- 172.21.15.3:0/2363291931 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb7c163590 con 0x7fbb7c06be60 2023-10-08T15:37:35.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.165+0000 7fbb8158d700 1 -- 172.21.15.3:0/2363291931 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb7c14a820 con 0x7fbb7c06be60 2023-10-08T15:37:35.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.165+0000 7fad527fc700 1 -- 172.21.15.3:0/3339720306 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad5c0129a0 con 0x7fad640b3530 2023-10-08T15:37:35.211 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.165+0000 7fad527fc700 1 -- 172.21.15.3:0/3339720306 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5c012b10 con 0x7fad640b3530 2023-10-08T15:37:35.211 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.165+0000 7f407affd700 1 -- 172.21.15.3:0/1823560360 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4088013680 con 0x7f40940a23f0 2023-10-08T15:37:35.211 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.165+0000 7fae1f7fe700 1 -- 172.21.15.3:0/956352463 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2677221641 0 0) 0x7fae200a2890 con 0x7fae2014b4b0 2023-10-08T15:37:35.211 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.165+0000 7fae1f7fe700 1 -- 172.21.15.3:0/956352463 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae08003570 con 0x7fae2014b4b0 2023-10-08T15:37:35.212 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.165+0000 7fae1f7fe700 1 -- 172.21.15.3:0/956352463 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2632788432 0 0) 0x7fae2009dec0 con 0x7fae200a1430 2023-10-08T15:37:35.212 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.165+0000 7fae1f7fe700 1 -- 172.21.15.3:0/956352463 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae200a2890 con 0x7fae200a1430 2023-10-08T15:37:35.212 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.165+0000 7f407affd700 1 --2- 172.21.15.3:0/1823560360 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4080060650 0x7f4080062b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:35.212 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.165+0000 7f407affd700 1 -- 172.21.15.3:0/1823560360 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f408807d250 con 0x7f40940a23f0 2023-10-08T15:37:35.212 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.165+0000 7fae1ffff700 1 -- 172.21.15.3:0/956352463 >> v1:172.21.15.50:6789/0 conn(0x7fae2014b4b0 legacy=0x7fae2009f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:35.212 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.165+0000 7fae1ffff700 1 -- 172.21.15.3:0/956352463 >> v1:172.21.15.3:6789/0 conn(0x7fae200a1430 legacy=0x7fae2014f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:35.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.165+0000 7fae1ffff700 1 -- 172.21.15.3:0/956352463 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae2014ee90 con 0x7fae200a1d80 2023-10-08T15:37:35.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.165+0000 7f40927fc700 1 --2- 172.21.15.3:0/1823560360 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4080060650 0x7f4080062b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:35.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.165+0000 7fad527fc700 1 -- 172.21.15.3:0/3339720306 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fad5c003030 con 0x7fad640b3530 2023-10-08T15:37:35.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.165+0000 7fae1ffff700 1 --2- 172.21.15.3:0/956352463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae200a1d80 0x7fae200a2200 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fae14009910 tx=0x7fae140091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba22618d65de6785 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:35.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.165+0000 7f1fc1ffb700 1 -- 172.21.15.3:0/465901460 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fd415bf50 con 0x7f1fd40989f0 2023-10-08T15:37:35.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.165+0000 7fbb8158d700 1 -- 172.21.15.3:0/2363291931 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb7c064530 con 0x7fbb7c06be60 2023-10-08T15:37:35.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.165+0000 7fae1f7fe700 1 -- 172.21.15.3:0/956352463 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae14011630 con 0x7fae200a1d80 2023-10-08T15:37:35.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.165+0000 7fae1f7fe700 1 -- 172.21.15.3:0/956352463 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae14011790 con 0x7fae200a1d80 2023-10-08T15:37:35.215 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.165+0000 7f22f97fa700 1 -- 172.21.15.3:0/940902737 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2314149dc0 con 0x7f231414b4b0 2023-10-08T15:37:35.215 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.165+0000 7f40927fc700 1 --2- 172.21.15.3:0/1823560360 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4080060650 0x7f4080062b00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f409406f5a0 tx=0x7f408c018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:35.215 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.165+0000 7f22fb7fe700 1 -- 172.21.15.3:0/940902737 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f230c0023a0 con 0x7f231414b4b0 2023-10-08T15:37:35.215 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.165+0000 7f22fb7fe700 1 -- 172.21.15.3:0/940902737 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230c012630 con 0x7f231414b4b0 2023-10-08T15:37:35.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.169+0000 7fbb6affd700 1 -- 172.21.15.3:0/2363291931 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb74001b90 con 0x7fbb7c06be60 2023-10-08T15:37:35.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.169+0000 7fbb6affd700 1 -- 172.21.15.3:0/2363291931 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb7400ad80 con 0x7fbb7c06be60 2023-10-08T15:37:35.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.169+0000 7f1fc3fff700 1 -- 172.21.15.3:0/465901460 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fc800cbc0 con 0x7f1fd40989f0 2023-10-08T15:37:35.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.169+0000 7f1fc3fff700 1 -- 172.21.15.3:0/465901460 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc800cd30 con 0x7f1fd40989f0 2023-10-08T15:37:35.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.165+0000 7fad527fc700 1 --2- 172.21.15.3:0/3339720306 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fad44060520 0x7fad440629d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:35.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.165+0000 7fad6259c700 1 --2- 172.21.15.3:0/3339720306 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fad44060520 0x7fad440629d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:35.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.169+0000 7fad68c40700 1 -- 172.21.15.3:0/3339720306 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad480052b0 con 0x7fad640b3530 2023-10-08T15:37:35.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.169+0000 7fae25cda700 1 -- 172.21.15.3:0/956352463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae200a1d80 msgr2=0x7fae200a2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:35.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.169+0000 7fae25cda700 1 --2- 172.21.15.3:0/956352463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae200a1d80 0x7fae200a2200 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fae14009910 tx=0x7fae140091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.218 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.169+0000 7fae25cda700 1 -- 172.21.15.3:0/956352463 shutdown_connections 2023-10-08T15:37:35.218 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.169+0000 7fae25cda700 1 --2- 172.21.15.3:0/956352463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae200a1d80 0x7fae200a2200 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.218 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.169+0000 7fae25cda700 1 -- 172.21.15.3:0/956352463 >> 172.21.15.3:0/956352463 conn(0x7fae200bd9b0 msgr2=0x7fae200bddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:35.218 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.169+0000 7fae25cda700 1 -- 172.21.15.3:0/956352463 shutdown_connections 2023-10-08T15:37:35.218 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.169+0000 7fae25cda700 1 -- 172.21.15.3:0/956352463 wait complete. 2023-10-08T15:37:35.218 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.169+0000 7f22fb7fe700 1 -- 172.21.15.3:0/940902737 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f230c012810 con 0x7f231414b4b0 2023-10-08T15:37:35.218 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.169+0000 7f22fb7fe700 1 --2- 172.21.15.3:0/940902737 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f22fc060970 0x7f22fc062e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:35.219 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.169+0000 7fad6259c700 1 --2- 172.21.15.3:0/3339720306 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fad44060520 0x7fad440629d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fad540099b0 tx=0x7fad54017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:35.219 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.169+0000 7fae25cda700 1 Processor -- start 2023-10-08T15:37:35.219 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.169+0000 7fae25cda700 1 -- start start 2023-10-08T15:37:35.219 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.169+0000 7fae25cda700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fae200a1430 0x7fae20149220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:35.219 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.169+0000 7fae25cda700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae200a1d80 0x7fae201427d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:35.219 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.169+0000 7fae25cda700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fae2014b4b0 0x7fae20142d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:35.220 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.169+0000 7fae25cda700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae2015ea20 con 0x7fae200a1430 2023-10-08T15:37:35.220 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.169+0000 7fae25cda700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae2006c100 con 0x7fae200a1d80 2023-10-08T15:37:35.220 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.169+0000 7fae25cda700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae20143250 con 0x7fae2014b4b0 2023-10-08T15:37:35.220 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.169+0000 7f23137fe700 1 --2- 172.21.15.3:0/940902737 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f22fc060970 0x7f22fc062e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:35.220 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.169+0000 7f7db2dfa700 1 Processor -- start 2023-10-08T15:37:35.220 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.169+0000 7f7db2dfa700 1 -- start start 2023-10-08T15:37:35.221 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.169+0000 7fae24cd8700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fae200a1430 0x7fae20149220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:35.221 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.169+0000 7fae24cd8700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fae200a1430 0x7fae20149220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47890/0 (socket says 172.21.15.3:47890) 2023-10-08T15:37:35.221 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.169+0000 7fae24cd8700 1 -- 172.21.15.3:0/1091416393 learned_addr learned my addr 172.21.15.3:0/1091416393 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:35.221 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.169+0000 7fae1ffff700 1 --2- 172.21.15.3:0/1091416393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae200a1d80 0x7fae201427d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:35.221 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.169+0000 7fae254d9700 1 --2- 172.21.15.3:0/1091416393 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fae2014b4b0 0x7fae20142d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:35.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.169+0000 7f23137fe700 1 --2- 172.21.15.3:0/940902737 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f22fc060970 0x7f22fc062e20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2314144740 tx=0x7f2308001a80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:35.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.169+0000 7fae24cd8700 1 -- 172.21.15.3:0/1091416393 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fae2014b4b0 msgr2=0x7fae20142d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:35.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.169+0000 7fae24cd8700 1 --2- 172.21.15.3:0/1091416393 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fae2014b4b0 0x7fae20142d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.169+0000 7fae24cd8700 1 -- 172.21.15.3:0/1091416393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae200a1d80 msgr2=0x7fae201427d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:35.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.169+0000 7fae24cd8700 1 --2- 172.21.15.3:0/1091416393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae200a1d80 0x7fae201427d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.169+0000 7fae24cd8700 1 -- 172.21.15.3:0/1091416393 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae14009420 con 0x7fae200a1430 2023-10-08T15:37:35.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.169+0000 7f7db2dfa700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7dac1479e0 0x7f7dac0b3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:35.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.169+0000 7f7db2dfa700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7dac14c4b0 0x7f7dac06d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:35.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.169+0000 7f7db2dfa700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dac0bb790 con 0x7f7dac06dc50 2023-10-08T15:37:35.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.169+0000 7f7db2dfa700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dac0b1e80 con 0x7f7dac1479e0 2023-10-08T15:37:35.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.169+0000 7f7db2dfa700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dac1494c0 con 0x7f7dac14c4b0 2023-10-08T15:37:35.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.169+0000 7f7db1397700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f7dac06dc50 0x7f7dac147db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:53878/0 (socket says 172.21.15.3:53878) 2023-10-08T15:37:35.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.169+0000 7f7db1397700 1 -- 172.21.15.3:0/1416719165 learned_addr learned my addr 172.21.15.3:0/1416719165 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:35.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.169+0000 7fae24cd8700 1 --2- 172.21.15.3:0/1091416393 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fae200a1430 0x7fae20149220 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fae1800cd30 tx=0x7fae18001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:35.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.173+0000 7f7db0b96700 1 --2- 172.21.15.3:0/1416719165 >> v2:172.21.15.50:3300/0 conn(0x7f7dac1479e0 0x7f7dac0b3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:35.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.173+0000 7f7dabfff700 1 --2- 172.21.15.3:0/1416719165 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7dac14c4b0 0x7f7dac06d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:35.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.173+0000 7f7dabfff700 1 -- 172.21.15.3:0/1416719165 >> v2:172.21.15.50:3300/0 conn(0x7f7dac1479e0 msgr2=0x7f7dac0b3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:35.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.173+0000 7f7dabfff700 1 --2- 172.21.15.3:0/1416719165 >> v2:172.21.15.50:3300/0 conn(0x7f7dac1479e0 0x7f7dac0b3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.173+0000 7f7dabfff700 1 -- 172.21.15.3:0/1416719165 >> v1:172.21.15.3:6789/0 conn(0x7f7dac06dc50 legacy=0x7f7dac147db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:35.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.173+0000 7f7dabfff700 1 -- 172.21.15.3:0/1416719165 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dac0bb4b0 con 0x7f7dac14c4b0 2023-10-08T15:37:35.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.173+0000 7f7db0b96700 1 --2- 172.21.15.3:0/1416719165 >> v2:172.21.15.50:3300/0 conn(0x7f7dac1479e0 0x7f7dac0b3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:37:35.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.173+0000 7f7dabfff700 1 --2- 172.21.15.3:0/1416719165 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7dac14c4b0 0x7f7dac06d710 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7da00098e0 tx=0x7f7da00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8545fafed5ad1d50 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:35.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.173+0000 7f7dab7fe700 1 -- 172.21.15.3:0/1416719165 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da000b640 con 0x7f7dac14c4b0 2023-10-08T15:37:35.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.173+0000 7f7dab7fe700 1 -- 172.21.15.3:0/1416719165 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7da000b7a0 con 0x7f7dac14c4b0 2023-10-08T15:37:35.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.173+0000 7f7dab7fe700 1 -- 172.21.15.3:0/1416719165 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da000bb40 con 0x7f7dac14c4b0 2023-10-08T15:37:35.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.173+0000 7f7db2dfa700 1 -- 172.21.15.3:0/1416719165 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7dac14c4b0 msgr2=0x7f7dac06d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:35.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.173+0000 7f7db2dfa700 1 --2- 172.21.15.3:0/1416719165 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7dac14c4b0 0x7f7dac06d710 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7da00098e0 tx=0x7f7da00091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.173+0000 7fad527fc700 1 -- 172.21.15.3:0/3339720306 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fad5c0212a0 con 0x7fad640b3530 2023-10-08T15:37:35.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.173+0000 7f22fb7fe700 1 -- 172.21.15.3:0/940902737 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f230c0514a0 con 0x7f231414b4b0 2023-10-08T15:37:35.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.173+0000 7f407affd700 1 -- 172.21.15.3:0/1823560360 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f408804d9a0 con 0x7f40940a23f0 2023-10-08T15:37:35.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.177+0000 7f7db2dfa700 1 -- 172.21.15.3:0/1416719165 shutdown_connections 2023-10-08T15:37:35.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.177+0000 7f7db2dfa700 1 --2- 172.21.15.3:0/1416719165 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7dac14c4b0 0x7f7dac06d710 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.177+0000 7f7db2dfa700 1 --2- 172.21.15.3:0/1416719165 >> v2:172.21.15.50:3300/0 conn(0x7f7dac1479e0 0x7f7dac0b3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.177+0000 7f7db2dfa700 1 -- 172.21.15.3:0/1416719165 >> 172.21.15.3:0/1416719165 conn(0x7f7dac0be630 msgr2=0x7f7dac0ba6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:35.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.177+0000 7f7db2dfa700 1 -- 172.21.15.3:0/1416719165 shutdown_connections 2023-10-08T15:37:35.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.177+0000 7f7db2dfa700 1 -- 172.21.15.3:0/1416719165 wait complete. 2023-10-08T15:37:35.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.177+0000 7f1fc3fff700 1 -- 172.21.15.3:0/465901460 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f1fc8013470 con 0x7f1fd40989f0 2023-10-08T15:37:35.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.177+0000 7fae1cff9700 1 -- 172.21.15.3:0/1091416393 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae1800ce90 con 0x7fae200a1430 2023-10-08T15:37:35.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.177+0000 7f1fc3fff700 1 --2- 172.21.15.3:0/465901460 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1fb8060550 0x7f1fb8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:35.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.177+0000 7fae25cda700 1 -- 172.21.15.3:0/1091416393 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae2015ef70 con 0x7fae200a1430 2023-10-08T15:37:35.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.177+0000 7fae25cda700 1 -- 172.21.15.3:0/1091416393 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae2006bd90 con 0x7fae200a1430 2023-10-08T15:37:35.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.177+0000 7f1fd3fff700 1 --2- 172.21.15.3:0/465901460 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1fb8060550 0x7f1fb8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:35.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.177+0000 7fbb6affd700 1 -- 172.21.15.3:0/2363291931 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fbb74025430 con 0x7fbb7c06be60 2023-10-08T15:37:35.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.177+0000 7f7db2dfa700 1 Processor -- start 2023-10-08T15:37:35.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.177+0000 7fbb6affd700 1 --2- 172.21.15.3:0/2363291931 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbb60060520 0x7fbb600629d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:35.231 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.177+0000 7f1fd3fff700 1 --2- 172.21.15.3:0/465901460 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1fb8060550 0x7f1fb8062a00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4015040 tx=0x7f1fc4012000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:35.231 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.177+0000 7fbb7a7fc700 1 --2- 172.21.15.3:0/2363291931 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbb60060520 0x7fbb600629d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:35.232 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.177+0000 7f7db2dfa700 1 -- start start 2023-10-08T15:37:35.232 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.177+0000 7fbb7a7fc700 1 --2- 172.21.15.3:0/2363291931 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbb60060520 0x7fbb600629d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbb700098e0 tx=0x7fbb70017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:35.234 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.177+0000 7f7db2dfa700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7dac06dc50 0x7f7dac0b8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:35.234 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.177+0000 7f7db2dfa700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7dac1479e0 0x7f7dac143090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:35.234 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.177+0000 7f7db2dfa700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7dac14c4b0 0x7f7dac1435d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:35.234 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.177+0000 7f7db2dfa700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dac0ba140 con 0x7f7dac06dc50 2023-10-08T15:37:35.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.177+0000 7f7db2dfa700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dac0ba3c0 con 0x7f7dac14c4b0 2023-10-08T15:37:35.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.177+0000 7f7db2dfa700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dac0b8f80 con 0x7f7dac1479e0 2023-10-08T15:37:35.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.177+0000 7f7db0b96700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7dac06dc50 0x7f7dac0b8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:35.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.177+0000 7f7db0b96700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7dac06dc50 0x7f7dac0b8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47902/0 (socket says 172.21.15.3:47902) 2023-10-08T15:37:35.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.177+0000 7f7db0b96700 1 -- 172.21.15.3:0/1231904478 learned_addr learned my addr 172.21.15.3:0/1231904478 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:35.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.181+0000 7f7dabfff700 1 --2- 172.21.15.3:0/1231904478 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7dac1479e0 0x7f7dac143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:35.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.181+0000 7f7db1397700 1 --2- 172.21.15.3:0/1231904478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7dac14c4b0 0x7f7dac1435d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:35.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.181+0000 7f7db0b96700 1 -- 172.21.15.3:0/1231904478 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7dac1479e0 msgr2=0x7f7dac143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:35.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.181+0000 7f7db0b96700 1 --2- 172.21.15.3:0/1231904478 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7dac1479e0 0x7f7dac143090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.181+0000 7f7db0b96700 1 -- 172.21.15.3:0/1231904478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7dac14c4b0 msgr2=0x7f7dac1435d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:35.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.181+0000 7f7db0b96700 1 --2- 172.21.15.3:0/1231904478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7dac14c4b0 0x7f7dac1435d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.181+0000 7f7db0b96700 1 -- 172.21.15.3:0/1231904478 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7da400bc30 con 0x7f7dac06dc50 2023-10-08T15:37:35.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.181+0000 7f7db0b96700 1 --2- 172.21.15.3:0/1231904478 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7dac06dc50 0x7f7dac0b8a40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7da400e440 tx=0x7f7da400d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:35.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.185+0000 7fae25cda700 1 -- 172.21.15.3:0/1091416393 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae2005ecf0 con 0x7fae200a1430 2023-10-08T15:37:35.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.185+0000 7f22fb7fe700 1 -- 172.21.15.3:0/940902737 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f230c04d0a0 con 0x7f231414b4b0 2023-10-08T15:37:35.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.193+0000 7fbb6affd700 1 -- 172.21.15.3:0/2363291931 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbb74051f10 con 0x7fbb7c06be60 2023-10-08T15:37:35.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.193+0000 7f1fc3fff700 1 -- 172.21.15.3:0/465901460 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1fc8051a30 con 0x7f1fd40989f0 2023-10-08T15:37:35.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.193+0000 7fae1cff9700 1 -- 172.21.15.3:0/1091416393 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae1800acd0 con 0x7fae200a1430 2023-10-08T15:37:35.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.193+0000 7fae1cff9700 1 -- 172.21.15.3:0/1091416393 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae1800ae40 con 0x7fae200a1430 2023-10-08T15:37:35.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.193+0000 7fad527fc700 1 -- 172.21.15.3:0/3339720306 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fad5c04caf0 con 0x7fad640b3530 2023-10-08T15:37:35.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.193+0000 7f7da8ff9700 1 -- 172.21.15.3:0/1231904478 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da4010040 con 0x7f7dac06dc50 2023-10-08T15:37:35.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.193+0000 7f7db2dfa700 1 -- 172.21.15.3:0/1231904478 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7da0009420 con 0x7f7dac06dc50 2023-10-08T15:37:35.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.193+0000 7f7db2dfa700 1 -- 172.21.15.3:0/1231904478 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dac0b7be0 con 0x7f7dac06dc50 2023-10-08T15:37:35.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.197+0000 7f7db2dfa700 1 -- 172.21.15.3:0/1231904478 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dac064530 con 0x7f7dac06dc50 2023-10-08T15:37:35.239 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.201+0000 7f1fc3fff700 1 -- 172.21.15.3:0/465901460 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1fc804d630 con 0x7f1fd40989f0 2023-10-08T15:37:35.239 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.209+0000 7fbb6affd700 1 -- 172.21.15.3:0/2363291931 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbb7404db10 con 0x7fbb7c06be60 2023-10-08T15:37:35.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.209+0000 7f7da8ff9700 1 -- 172.21.15.3:0/1231904478 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7da400ee50 con 0x7f7dac06dc50 2023-10-08T15:37:35.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.213+0000 7f7da8ff9700 1 -- 172.21.15.3:0/1231904478 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da400b2e0 con 0x7f7dac06dc50 2023-10-08T15:37:35.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.217+0000 7f7da8ff9700 1 -- 172.21.15.3:0/1231904478 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f7da4009550 con 0x7f7dac06dc50 2023-10-08T15:37:35.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.217+0000 7f7da8ff9700 1 --2- 172.21.15.3:0/1231904478 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7d90060520 0x7f7d900629d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:35.241 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.217+0000 7fae1cff9700 1 -- 172.21.15.3:0/1091416393 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fae18025430 con 0x7fae200a1430 2023-10-08T15:37:35.241 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.217+0000 7f7dabfff700 1 --2- 172.21.15.3:0/1231904478 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7d90060520 0x7f7d900629d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:35.242 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.217+0000 7fae1cff9700 1 --2- 172.21.15.3:0/1091416393 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fae0c060550 0x7fae0c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:35.242 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.217+0000 7fae1cff9700 1 -- 172.21.15.3:0/1091416393 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fae1807d510 con 0x7fae200a1430 2023-10-08T15:37:35.242 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.217+0000 7f7dabfff700 1 --2- 172.21.15.3:0/1231904478 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7d90060520 0x7f7d900629d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7da000a010 tx=0x7f7da0017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:35.243 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.217+0000 7fae1ffff700 1 --2- 172.21.15.3:0/1091416393 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fae0c060550 0x7fae0c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:35.243 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.217+0000 7fae1ffff700 1 --2- 172.21.15.3:0/1091416393 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fae0c060550 0x7fae0c062a00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fae14009fd0 tx=0x7fae14016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:35.243 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.221+0000 7fae1cff9700 1 -- 172.21.15.3:0/1091416393 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fae1804dae0 con 0x7fae200a1430 2023-10-08T15:37:35.244 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.221+0000 7f7da8ff9700 1 -- 172.21.15.3:0/1231904478 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7da4052400 con 0x7f7dac06dc50 2023-10-08T15:37:35.244 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.229+0000 7f7da8ff9700 1 -- 172.21.15.3:0/1231904478 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7da404e000 con 0x7f7dac06dc50 2023-10-08T15:37:35.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.485+0000 7f01af67c700 1 -- 172.21.15.3:0/3589228442 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f01a815a480 con 0x7f01a8068320 2023-10-08T15:37:35.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.485+0000 7f019d7fa700 1 -- 172.21.15.3:0/3589228442 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f01a815a480 con 0x7f01a8068320 2023-10-08T15:37:35.495 INFO:teuthology.orchestra.run.smithi003.stdout:60129542148 2023-10-08T15:37:35.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.497+0000 7f0192ffd700 1 -- 172.21.15.3:0/3589228442 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f018c0605d0 msgr2=0x7f018c062a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:35.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.497+0000 7f0192ffd700 1 --2- 172.21.15.3:0/3589228442 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f018c0605d0 0x7f018c062a80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f01980091e0 tx=0x7f0198017000 comp rx=0 tx=0).stop 2023-10-08T15:37:35.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.497+0000 7f0192ffd700 1 -- 172.21.15.3:0/3589228442 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f01a8068320 msgr2=0x7f01a813ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:35.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.497+0000 7f0192ffd700 1 --2- 172.21.15.3:0/3589228442 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f01a8068320 0x7f01a813ebd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f01a400c590 tx=0x7f01a400c8a0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.497+0000 7f0192ffd700 1 -- 172.21.15.3:0/3589228442 shutdown_connections 2023-10-08T15:37:35.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.497+0000 7f0192ffd700 1 --2- 172.21.15.3:0/3589228442 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f018c0605d0 0x7f018c062a80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.497+0000 7f0192ffd700 1 --2- 172.21.15.3:0/3589228442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01a8146fe0 0x7f01a815ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.497+0000 7f0192ffd700 1 --2- 172.21.15.3:0/3589228442 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f01a80b2740 0x7f01a814b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.497+0000 7f0192ffd700 1 --2- 172.21.15.3:0/3589228442 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f01a8068320 0x7f01a813ebd0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.497+0000 7f0192ffd700 1 -- 172.21.15.3:0/3589228442 >> 172.21.15.3:0/3589228442 conn(0x7f01a80be630 msgr2=0x7f01a8143060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:35.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.497+0000 7f0192ffd700 1 -- 172.21.15.3:0/3589228442 shutdown_connections 2023-10-08T15:37:35.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.497+0000 7f0192ffd700 1 -- 172.21.15.3:0/3589228442 wait complete. 2023-10-08T15:37:35.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.501+0000 7f4093fff700 1 -- 172.21.15.3:0/1823560360 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f40940a1150 con 0x7f40940a23f0 2023-10-08T15:37:35.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.505+0000 7f407affd700 1 -- 172.21.15.3:0/1823560360 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4088050fc0 con 0x7f40940a23f0 2023-10-08T15:37:35.509 INFO:teuthology.orchestra.run.smithi003.stdout:60129542149 2023-10-08T15:37:35.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.509+0000 7f4093fff700 1 -- 172.21.15.3:0/1823560360 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4080060650 msgr2=0x7f4080062b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:35.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.509+0000 7f4093fff700 1 --2- 172.21.15.3:0/1823560360 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4080060650 0x7f4080062b00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f409406f5a0 tx=0x7f408c018000 comp rx=0 tx=0).stop 2023-10-08T15:37:35.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.509+0000 7f4093fff700 1 -- 172.21.15.3:0/1823560360 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f40940a23f0 msgr2=0x7f409415adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:35.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.509+0000 7f4093fff700 1 --2- 172.21.15.3:0/1823560360 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f40940a23f0 0x7f409415adc0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f408800ec80 tx=0x7f40880091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.509+0000 7f4093fff700 1 -- 172.21.15.3:0/1823560360 shutdown_connections 2023-10-08T15:37:35.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.509+0000 7f4093fff700 1 --2- 172.21.15.3:0/1823560360 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4080060650 0x7f4080062b00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.509+0000 7f4093fff700 1 --2- 172.21.15.3:0/1823560360 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f409414a150 0x7f40940b1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.509+0000 7f4093fff700 1 --2- 172.21.15.3:0/1823560360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40940be0b0 0x7f409409c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.509+0000 7f4093fff700 1 --2- 172.21.15.3:0/1823560360 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f40940a23f0 0x7f409415adc0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.509+0000 7f4093fff700 1 -- 172.21.15.3:0/1823560360 >> 172.21.15.3:0/1823560360 conn(0x7f409406a900 msgr2=0x7f4094148d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:35.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.509+0000 7f4093fff700 1 -- 172.21.15.3:0/1823560360 shutdown_connections 2023-10-08T15:37:35.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.509+0000 7f4093fff700 1 -- 172.21.15.3:0/1823560360 wait complete. 2023-10-08T15:37:35.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.509+0000 7f22f97fa700 1 -- 172.21.15.3:0/940902737 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2314149dc0 con 0x7f231414b4b0 2023-10-08T15:37:35.517 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.7 2023-10-08T15:37:35.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.509+0000 7f22fb7fe700 1 -- 172.21.15.3:0/940902737 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2314149dc0 con 0x7f231414b4b0 2023-10-08T15:37:35.517 INFO:teuthology.orchestra.run.smithi003.stdout:60129542150 2023-10-08T15:37:35.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.513+0000 7f1fc1ffb700 1 -- 172.21.15.3:0/465901460 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1fd4064530 con 0x7f1fd40989f0 2023-10-08T15:37:35.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.513+0000 7f1fc3fff700 1 -- 172.21.15.3:0/465901460 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1fc8021090 con 0x7f1fd40989f0 2023-10-08T15:37:35.519 INFO:teuthology.orchestra.run.smithi003.stdout:60129542150 2023-10-08T15:37:35.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.513+0000 7f22f97fa700 1 -- 172.21.15.3:0/940902737 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f22fc060970 msgr2=0x7f22fc062e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:35.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.513+0000 7f22f97fa700 1 --2- 172.21.15.3:0/940902737 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f22fc060970 0x7f22fc062e20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2314144740 tx=0x7f2308001a80 comp rx=0 tx=0).stop 2023-10-08T15:37:35.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.513+0000 7f22f97fa700 1 -- 172.21.15.3:0/940902737 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f231414b4b0 msgr2=0x7f2314067850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:35.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.513+0000 7f22f97fa700 1 --2- 172.21.15.3:0/940902737 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f231414b4b0 0x7f2314067850 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f230c00c890 tx=0x7f230c002700 comp rx=0 tx=0).stop 2023-10-08T15:37:35.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.513+0000 7f22f97fa700 1 -- 172.21.15.3:0/940902737 shutdown_connections 2023-10-08T15:37:35.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.513+0000 7f22f97fa700 1 --2- 172.21.15.3:0/940902737 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f22fc060970 0x7f22fc062e20 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.513+0000 7f22f97fa700 1 --2- 172.21.15.3:0/940902737 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f231414b4b0 0x7f2314067850 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.513+0000 7f22f97fa700 1 --2- 172.21.15.3:0/940902737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23140a1d80 0x7f231415e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.513+0000 7f22f97fa700 1 --2- 172.21.15.3:0/940902737 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f23140a1430 0x7f23141508d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.513+0000 7f22f97fa700 1 -- 172.21.15.3:0/940902737 >> 172.21.15.3:0/940902737 conn(0x7f23140bd9b0 msgr2=0x7f23140bdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:35.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.513+0000 7f22f97fa700 1 -- 172.21.15.3:0/940902737 shutdown_connections 2023-10-08T15:37:35.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.513+0000 7f22f97fa700 1 -- 172.21.15.3:0/940902737 wait complete. 2023-10-08T15:37:35.523 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.517+0000 7f1fc1ffb700 1 -- 172.21.15.3:0/465901460 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1fb8060550 msgr2=0x7f1fb8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:35.523 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.517+0000 7f1fc1ffb700 1 --2- 172.21.15.3:0/465901460 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1fb8060550 0x7f1fb8062a00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4015040 tx=0x7f1fc4012000 comp rx=0 tx=0).stop 2023-10-08T15:37:35.523 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.517+0000 7f1fc1ffb700 1 -- 172.21.15.3:0/465901460 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1fd40989f0 msgr2=0x7f1fd4096850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:35.523 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.517+0000 7f1fc1ffb700 1 --2- 172.21.15.3:0/465901460 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1fd40989f0 0x7f1fd4096850 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1fc800e9d0 tx=0x7f1fc80091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.523 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.517+0000 7f1fc1ffb700 1 -- 172.21.15.3:0/465901460 shutdown_connections 2023-10-08T15:37:35.523 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.517+0000 7f1fc1ffb700 1 --2- 172.21.15.3:0/465901460 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1fb8060550 0x7f1fb8062a00 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.523 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.517+0000 7f1fc1ffb700 1 --2- 172.21.15.3:0/465901460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fd4097410 0x7f1fd40a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.524 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.517+0000 7f1fc1ffb700 1 --2- 172.21.15.3:0/465901460 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1fd40989f0 0x7f1fd4096850 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.524 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.517+0000 7f1fc1ffb700 1 --2- 172.21.15.3:0/465901460 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1fbc003ae0 0x7f1fd415c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.524 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.517+0000 7f1fc1ffb700 1 -- 172.21.15.3:0/465901460 >> 172.21.15.3:0/465901460 conn(0x7f1fd40bdda0 msgr2=0x7f1fd4148a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:35.524 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.517+0000 7f1fc1ffb700 1 -- 172.21.15.3:0/465901460 shutdown_connections 2023-10-08T15:37:35.524 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.517+0000 7f1fc1ffb700 1 -- 172.21.15.3:0/465901460 wait complete. 2023-10-08T15:37:35.524 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.517+0000 7fad68c40700 1 -- 172.21.15.3:0/3339720306 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fad48005560 con 0x7fad640b3530 2023-10-08T15:37:35.525 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.517+0000 7fad527fc700 1 -- 172.21.15.3:0/3339720306 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fad5c050110 con 0x7fad640b3530 2023-10-08T15:37:35.525 INFO:teuthology.orchestra.run.smithi003.stdout:55834574853 2023-10-08T15:37:35.528 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.2 2023-10-08T15:37:35.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.521+0000 7fad68c40700 1 -- 172.21.15.3:0/3339720306 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fad44060520 msgr2=0x7fad440629d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:35.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.521+0000 7fad68c40700 1 --2- 172.21.15.3:0/3339720306 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fad44060520 0x7fad440629d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fad540099b0 tx=0x7fad54017000 comp rx=0 tx=0).stop 2023-10-08T15:37:35.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.521+0000 7fad68c40700 1 -- 172.21.15.3:0/3339720306 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad640b3530 msgr2=0x7fad6414cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:35.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.521+0000 7fad68c40700 1 --2- 172.21.15.3:0/3339720306 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad640b3530 0x7fad6414cf20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fad5c00c870 tx=0x7fad5c001670 comp rx=0 tx=0).stop 2023-10-08T15:37:35.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.521+0000 7fad68c40700 1 -- 172.21.15.3:0/3339720306 shutdown_connections 2023-10-08T15:37:35.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.521+0000 7fad68c40700 1 --2- 172.21.15.3:0/3339720306 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fad44060520 0x7fad440629d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.521+0000 7fad68c40700 1 --2- 172.21.15.3:0/3339720306 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad640b3530 0x7fad6414cf20 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.521+0000 7fad68c40700 1 --2- 172.21.15.3:0/3339720306 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fad640b2830 0x7fad64130f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.521+0000 7fad68c40700 1 --2- 172.21.15.3:0/3339720306 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad6406e020 0x7fad6406be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.521+0000 7fad68c40700 1 -- 172.21.15.3:0/3339720306 >> 172.21.15.3:0/3339720306 conn(0x7fad640be630 msgr2=0x7fad640bcfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:35.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.521+0000 7fad68c40700 1 -- 172.21.15.3:0/3339720306 shutdown_connections 2023-10-08T15:37:35.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.521+0000 7fad68c40700 1 -- 172.21.15.3:0/3339720306 wait complete. 2023-10-08T15:37:35.534 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.0 2023-10-08T15:37:35.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.533+0000 7fbb8158d700 1 -- 172.21.15.3:0/2363291931 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbb7c14b930 con 0x7fbb7c06be60 2023-10-08T15:37:35.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.533+0000 7fbb6affd700 1 -- 172.21.15.3:0/2363291931 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbb74051130 con 0x7fbb7c06be60 2023-10-08T15:37:35.539 INFO:teuthology.orchestra.run.smithi003.stdout:60129542150 2023-10-08T15:37:35.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.537+0000 7fbb8158d700 1 -- 172.21.15.3:0/2363291931 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbb60060520 msgr2=0x7fbb600629d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:35.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.537+0000 7fbb8158d700 1 --2- 172.21.15.3:0/2363291931 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbb60060520 0x7fbb600629d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbb700098e0 tx=0x7fbb70017000 comp rx=0 tx=0).stop 2023-10-08T15:37:35.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.537+0000 7fbb8158d700 1 -- 172.21.15.3:0/2363291931 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb7c06be60 msgr2=0x7fbb7c0c2230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:35.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.537+0000 7fbb8158d700 1 --2- 172.21.15.3:0/2363291931 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb7c06be60 0x7fbb7c0c2230 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbb7400cc70 tx=0x7fbb74001a30 comp rx=0 tx=0).stop 2023-10-08T15:37:35.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.537+0000 7fbb8158d700 1 -- 172.21.15.3:0/2363291931 shutdown_connections 2023-10-08T15:37:35.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.537+0000 7fbb8158d700 1 --2- 172.21.15.3:0/2363291931 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbb60060520 0x7fbb600629d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.537+0000 7fbb8158d700 1 --2- 172.21.15.3:0/2363291931 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbb7c0be150 0x7fbb7c0bc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.537+0000 7fbb8158d700 1 --2- 172.21.15.3:0/2363291931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb7c06c3e0 0x7fbb7c09e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.537+0000 7fbb8158d700 1 --2- 172.21.15.3:0/2363291931 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb7c06be60 0x7fbb7c0c2230 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.537+0000 7fbb8158d700 1 -- 172.21.15.3:0/2363291931 >> 172.21.15.3:0/2363291931 conn(0x7fbb7c06e460 msgr2=0x7fbb7c149670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:35.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.537+0000 7fbb8158d700 1 -- 172.21.15.3:0/2363291931 shutdown_connections 2023-10-08T15:37:35.544 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2023-10-08T15:37:35.545 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.3 2023-10-08T15:37:35.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.537+0000 7fbb8158d700 1 -- 172.21.15.3:0/2363291931 wait complete. 2023-10-08T15:37:35.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.541+0000 7f7db2dfa700 1 -- 172.21.15.3:0/1231904478 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f7dac0bb1a0 con 0x7f7dac06dc50 2023-10-08T15:37:35.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.541+0000 7f7da8ff9700 1 -- 172.21.15.3:0/1231904478 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7da4051620 con 0x7f7dac06dc50 2023-10-08T15:37:35.547 INFO:teuthology.orchestra.run.smithi003.stdout:60129542149 2023-10-08T15:37:35.549 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.541+0000 7f7db2dfa700 1 -- 172.21.15.3:0/1231904478 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7d90060520 msgr2=0x7f7d900629d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:35.549 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.541+0000 7f7db2dfa700 1 --2- 172.21.15.3:0/1231904478 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7d90060520 0x7f7d900629d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7da000a010 tx=0x7f7da0017000 comp rx=0 tx=0).stop 2023-10-08T15:37:35.549 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.541+0000 7f7db2dfa700 1 -- 172.21.15.3:0/1231904478 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7dac06dc50 msgr2=0x7f7dac0b8a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:35.549 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.541+0000 7f7db2dfa700 1 --2- 172.21.15.3:0/1231904478 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7dac06dc50 0x7f7dac0b8a40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7da400e440 tx=0x7f7da400d040 comp rx=0 tx=0).stop 2023-10-08T15:37:35.549 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.541+0000 7f7db2dfa700 1 -- 172.21.15.3:0/1231904478 shutdown_connections 2023-10-08T15:37:35.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.541+0000 7f7db2dfa700 1 --2- 172.21.15.3:0/1231904478 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7d90060520 0x7f7d900629d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.541+0000 7f7db2dfa700 1 --2- 172.21.15.3:0/1231904478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7dac14c4b0 0x7f7dac1435d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.541+0000 7f7db2dfa700 1 --2- 172.21.15.3:0/1231904478 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7dac1479e0 0x7f7dac143090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.541+0000 7f7db2dfa700 1 --2- 172.21.15.3:0/1231904478 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7dac06dc50 0x7f7dac0b8a40 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.541+0000 7f7db2dfa700 1 -- 172.21.15.3:0/1231904478 >> 172.21.15.3:0/1231904478 conn(0x7f7dac0be630 msgr2=0x7f7dac1462f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:35.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.541+0000 7f7db2dfa700 1 -- 172.21.15.3:0/1231904478 shutdown_connections 2023-10-08T15:37:35.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.541+0000 7f7db2dfa700 1 -- 172.21.15.3:0/1231904478 wait complete. 2023-10-08T15:37:35.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.545+0000 7fae25cda700 1 -- 172.21.15.3:0/1091416393 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fae200a1800 con 0x7fae200a1430 2023-10-08T15:37:35.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.549+0000 7fae1cff9700 1 -- 172.21.15.3:0/1091416393 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fae18051100 con 0x7fae200a1430 2023-10-08T15:37:35.554 INFO:teuthology.orchestra.run.smithi003.stdout:55834574853 2023-10-08T15:37:35.556 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.1 2023-10-08T15:37:35.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.549+0000 7fae25cda700 1 -- 172.21.15.3:0/1091416393 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fae0c060550 msgr2=0x7fae0c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:35.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.549+0000 7fae25cda700 1 --2- 172.21.15.3:0/1091416393 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fae0c060550 0x7fae0c062a00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fae14009fd0 tx=0x7fae14016000 comp rx=0 tx=0).stop 2023-10-08T15:37:35.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.549+0000 7fae25cda700 1 -- 172.21.15.3:0/1091416393 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fae200a1430 msgr2=0x7fae20149220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:35.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.549+0000 7fae25cda700 1 --2- 172.21.15.3:0/1091416393 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fae200a1430 0x7fae20149220 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fae1800cd30 tx=0x7fae18001b10 comp rx=0 tx=0).stop 2023-10-08T15:37:35.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.549+0000 7fae25cda700 1 -- 172.21.15.3:0/1091416393 shutdown_connections 2023-10-08T15:37:35.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.549+0000 7fae25cda700 1 --2- 172.21.15.3:0/1091416393 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fae0c060550 0x7fae0c062a00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.549+0000 7fae25cda700 1 --2- 172.21.15.3:0/1091416393 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fae2014b4b0 0x7fae20142d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.549+0000 7fae25cda700 1 --2- 172.21.15.3:0/1091416393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae200a1d80 0x7fae201427d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.549+0000 7fae25cda700 1 --2- 172.21.15.3:0/1091416393 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fae200a1430 0x7fae20149220 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:35.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.549+0000 7fae25cda700 1 -- 172.21.15.3:0/1091416393 >> 172.21.15.3:0/1091416393 conn(0x7fae200bd9b0 msgr2=0x7fae2009fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:35.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.549+0000 7fae25cda700 1 -- 172.21.15.3:0/1091416393 shutdown_connections 2023-10-08T15:37:35.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:35.549+0000 7fae25cda700 1 -- 172.21.15.3:0/1091416393 wait complete. 2023-10-08T15:37:35.559 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.6 2023-10-08T15:37:35.566 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2023-10-08T15:37:36.518 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-08T15:37:36.529 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-08T15:37:36.534 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-08T15:37:36.545 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-08T15:37:36.545 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-08T15:37:36.557 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-08T15:37:36.561 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-08T15:37:36.566 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-08T15:37:36.657 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.649+0000 7f5b087d3700 1 Processor -- start 2023-10-08T15:37:36.657 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.649+0000 7f5b087d3700 1 -- start start 2023-10-08T15:37:36.658 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.653+0000 7f5b087d3700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5b000b1e60 0x7f5b000b4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:36.658 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.653+0000 7f5b087d3700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f5b0014d100 0x7f5b000bb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:36.658 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.653+0000 7f5b087d3700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b000a10c0 con 0x7f5b000a2700 2023-10-08T15:37:36.658 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.653+0000 7f5b087d3700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b000a22f0 con 0x7f5b0014d100 2023-10-08T15:37:36.658 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.653+0000 7f5b087d3700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b000a1310 con 0x7f5b000b1e60 2023-10-08T15:37:36.659 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.653+0000 7f5b06d70700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f5b0014d100 0x7f5b000bb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:36.659 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.653+0000 7f5b06d70700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f5b0014d100 0x7f5b000bb8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47916/0 (socket says 172.21.15.3:47916) 2023-10-08T15:37:36.659 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.653+0000 7f5b06d70700 1 -- 172.21.15.3:0/49046274 learned_addr learned my addr 172.21.15.3:0/49046274 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:36.659 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.653+0000 7f5b0656f700 1 --2- 172.21.15.3:0/49046274 >> v2:172.21.15.50:3300/0 conn(0x7f5b000b1e60 0x7f5b000b4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:36.660 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.653+0000 7f5b06d70700 1 -- 172.21.15.3:0/49046274 >> v2:172.21.15.50:3300/0 conn(0x7f5b000b1e60 msgr2=0x7f5b000b4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:36.660 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.653+0000 7f5b06d70700 1 --2- 172.21.15.3:0/49046274 >> v2:172.21.15.50:3300/0 conn(0x7f5b000b1e60 0x7f5b000b4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:36.660 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.653+0000 7f5b06d70700 1 -- 172.21.15.3:0/49046274 >> v1:172.21.15.50:6789/0 conn(0x7f5b000a2700 legacy=0x7f5b0014c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:36.660 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.653+0000 7f5b06d70700 1 -- 172.21.15.3:0/49046274 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b000a1f10 con 0x7f5b0014d100 2023-10-08T15:37:36.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.653+0000 7f5b06d70700 1 --2- 172.21.15.3:0/49046274 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5b0014d100 0x7f5b000bb8c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5b000a0bc0 tx=0x7f5af0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fb9dc5ec780bfd8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:36.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.653+0000 7f5b0556d700 1 -- 172.21.15.3:0/49046274 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af0009e70 con 0x7f5b0014d100 2023-10-08T15:37:36.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.653+0000 7f5b0556d700 1 -- 172.21.15.3:0/49046274 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af000b860 con 0x7f5b0014d100 2023-10-08T15:37:36.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.653+0000 7f5b0556d700 1 -- 172.21.15.3:0/49046274 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af000bc20 con 0x7f5b0014d100 2023-10-08T15:37:36.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.653+0000 7f5b087d3700 1 -- 172.21.15.3:0/49046274 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5b0014d100 msgr2=0x7f5b000bb8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:36.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.653+0000 7f5b087d3700 1 --2- 172.21.15.3:0/49046274 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5b0014d100 0x7f5b000bb8c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5b000a0bc0 tx=0x7f5af0009250 comp rx=0 tx=0).stop 2023-10-08T15:37:36.665 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.661+0000 7f5b087d3700 1 -- 172.21.15.3:0/49046274 shutdown_connections 2023-10-08T15:37:36.666 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.661+0000 7f5b087d3700 1 --2- 172.21.15.3:0/49046274 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5b0014d100 0x7f5b000bb8c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:36.666 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.661+0000 7f5b087d3700 1 --2- 172.21.15.3:0/49046274 >> v2:172.21.15.50:3300/0 conn(0x7f5b000b1e60 0x7f5b000b4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:36.666 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.661+0000 7f5b087d3700 1 -- 172.21.15.3:0/49046274 >> 172.21.15.3:0/49046274 conn(0x7f5b0006a900 msgr2=0x7f5b000bd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:36.666 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.661+0000 7f5b087d3700 1 -- 172.21.15.3:0/49046274 shutdown_connections 2023-10-08T15:37:36.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.661+0000 7f5b087d3700 1 -- 172.21.15.3:0/49046274 wait complete. 2023-10-08T15:37:36.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.661+0000 7f5b087d3700 1 Processor -- start 2023-10-08T15:37:36.668 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.661+0000 7f5b087d3700 1 -- start start 2023-10-08T15:37:36.669 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.661+0000 7f5b087d3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b000a2700 0x7f5b0009e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:36.669 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.661+0000 7f5b087d3700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5b000b1e60 0x7f5b0016af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:36.669 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.661+0000 7f5b087d3700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5b0014d100 0x7f5b0014e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:36.669 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.661+0000 7f5b087d3700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0014f9e0 con 0x7f5b0014d100 2023-10-08T15:37:36.669 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.661+0000 7f5b087d3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0014d650 con 0x7f5b000a2700 2023-10-08T15:37:36.669 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.661+0000 7f5b087d3700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b00150950 con 0x7f5b000b1e60 2023-10-08T15:37:36.670 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.661+0000 7f5b06d70700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5b0014d100 0x7f5b0014e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:36.670 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.665+0000 7f5b06d70700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5b0014d100 0x7f5b0014e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47922/0 (socket says 172.21.15.3:47922) 2023-10-08T15:37:36.670 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.665+0000 7f5b06d70700 1 -- 172.21.15.3:0/337209134 learned_addr learned my addr 172.21.15.3:0/337209134 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:36.670 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.665+0000 7f5b0656f700 1 --2- 172.21.15.3:0/337209134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b000a2700 0x7f5b0009e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:36.670 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.665+0000 7f5b05d6e700 1 --2- 172.21.15.3:0/337209134 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5b000b1e60 0x7f5b0016af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:36.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.665+0000 7f5b06d70700 1 -- 172.21.15.3:0/337209134 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5b000b1e60 msgr2=0x7f5b0016af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:36.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.665+0000 7f5b06d70700 1 --2- 172.21.15.3:0/337209134 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5b000b1e60 0x7f5b0016af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:36.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.665+0000 7f5b06d70700 1 -- 172.21.15.3:0/337209134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b000a2700 msgr2=0x7f5b0009e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:36.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.665+0000 7f5b06d70700 1 --2- 172.21.15.3:0/337209134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b000a2700 0x7f5b0009e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:36.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.665+0000 7f5b06d70700 1 -- 172.21.15.3:0/337209134 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af00094f0 con 0x7f5b0014d100 2023-10-08T15:37:36.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.665+0000 7f5b06d70700 1 --2- 172.21.15.3:0/337209134 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5b0014d100 0x7f5b0014e130 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5af0006fd0 tx=0x7f5af0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:36.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.665+0000 7f5af67fc700 1 -- 172.21.15.3:0/337209134 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af001f070 con 0x7f5b0014d100 2023-10-08T15:37:36.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.665+0000 7f5af67fc700 1 -- 172.21.15.3:0/337209134 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af0009e70 con 0x7f5b0014d100 2023-10-08T15:37:36.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.665+0000 7f5b087d3700 1 -- 172.21.15.3:0/337209134 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b0016b7e0 con 0x7f5b0014d100 2023-10-08T15:37:36.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.665+0000 7f5b087d3700 1 -- 172.21.15.3:0/337209134 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b0016b440 con 0x7f5b0014d100 2023-10-08T15:37:36.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.665+0000 7f5af67fc700 1 -- 172.21.15.3:0/337209134 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af0011630 con 0x7f5b0014d100 2023-10-08T15:37:36.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.669+0000 7f5af67fc700 1 -- 172.21.15.3:0/337209134 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5af00119a0 con 0x7f5b0014d100 2023-10-08T15:37:36.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.669+0000 7feedef57700 1 Processor -- start 2023-10-08T15:37:36.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.669+0000 7feedef57700 1 -- start start 2023-10-08T15:37:36.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.669+0000 7f5af67fc700 1 --2- 172.21.15.3:0/337209134 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5ae4060570 0x7f5ae4062a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:36.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.669+0000 7f5af67fc700 1 -- 172.21.15.3:0/337209134 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5af007d8b0 con 0x7f5b0014d100 2023-10-08T15:37:36.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.669+0000 7f5b0656f700 1 --2- 172.21.15.3:0/337209134 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5ae4060570 0x7f5ae4062a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:36.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.669+0000 7f5b087d3700 1 -- 172.21.15.3:0/337209134 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b0014fba0 con 0x7f5b0014d100 2023-10-08T15:37:36.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.669+0000 7feedef57700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7feed806ca60 0x7feed806cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:36.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.669+0000 7feedef57700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7feed8148fa0 0x7feed814c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:36.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.669+0000 7feedef57700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feed806d5e0 con 0x7feed80b4070 2023-10-08T15:37:36.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.669+0000 7feedef57700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feed80b4b40 con 0x7feed806ca60 2023-10-08T15:37:36.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.669+0000 7feedef57700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feed8149420 con 0x7feed8148fa0 2023-10-08T15:37:36.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.669+0000 7feedccf3700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7feed80b4070 0x7feed8148890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:53888/0 (socket says 172.21.15.3:53888) 2023-10-08T15:37:36.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.669+0000 7feedccf3700 1 -- 172.21.15.3:0/601642652 learned_addr learned my addr 172.21.15.3:0/601642652 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:36.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.669+0000 7feedd4f4700 1 --2- 172.21.15.3:0/601642652 >> v2:172.21.15.50:3300/0 conn(0x7feed8148fa0 0x7feed814c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:36.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.669+0000 7feed7fff700 1 --2- 172.21.15.3:0/601642652 >> v2:172.21.15.3:3300/0 conn(0x7feed806ca60 0x7feed806cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:36.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.669+0000 7feedd4f4700 1 -- 172.21.15.3:0/601642652 >> v2:172.21.15.3:3300/0 conn(0x7feed806ca60 msgr2=0x7feed806cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:36.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.669+0000 7feedd4f4700 1 --2- 172.21.15.3:0/601642652 >> v2:172.21.15.3:3300/0 conn(0x7feed806ca60 0x7feed806cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:36.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.669+0000 7feedd4f4700 1 -- 172.21.15.3:0/601642652 >> v1:172.21.15.3:6789/0 conn(0x7feed80b4070 legacy=0x7feed8148890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:36.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.669+0000 7feedd4f4700 1 -- 172.21.15.3:0/601642652 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed806de80 con 0x7feed8148fa0 2023-10-08T15:37:36.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.669+0000 7feed7fff700 1 --2- 172.21.15.3:0/601642652 >> v2:172.21.15.3:3300/0 conn(0x7feed806ca60 0x7feed806cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:37:36.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.669+0000 7feedd4f4700 1 --2- 172.21.15.3:0/601642652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feed8148fa0 0x7feed814c9e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7feed806cee0 tx=0x7feed0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d4539aae287db0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:36.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.673+0000 7feed77fe700 1 -- 172.21.15.3:0/601642652 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed000e070 con 0x7feed8148fa0 2023-10-08T15:37:36.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.673+0000 7feed77fe700 1 -- 172.21.15.3:0/601642652 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feed000bc30 con 0x7feed8148fa0 2023-10-08T15:37:36.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.673+0000 7feedef57700 1 -- 172.21.15.3:0/601642652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feed8148fa0 msgr2=0x7feed814c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:36.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.673+0000 7feedef57700 1 --2- 172.21.15.3:0/601642652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feed8148fa0 0x7feed814c9e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7feed806cee0 tx=0x7feed0009780 comp rx=0 tx=0).stop 2023-10-08T15:37:36.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.673+0000 7feedef57700 1 -- 172.21.15.3:0/601642652 shutdown_connections 2023-10-08T15:37:36.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.673+0000 7feedef57700 1 --2- 172.21.15.3:0/601642652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feed8148fa0 0x7feed814c9e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:36.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.673+0000 7feedef57700 1 --2- 172.21.15.3:0/601642652 >> v2:172.21.15.3:3300/0 conn(0x7feed806ca60 0x7feed806cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:36.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.673+0000 7feedef57700 1 -- 172.21.15.3:0/601642652 >> 172.21.15.3:0/601642652 conn(0x7feed80be630 msgr2=0x7feed80ba6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:36.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.673+0000 7feedef57700 1 -- 172.21.15.3:0/601642652 shutdown_connections 2023-10-08T15:37:36.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.673+0000 7feedef57700 1 -- 172.21.15.3:0/601642652 wait complete. 2023-10-08T15:37:36.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.673+0000 7f5b0656f700 1 --2- 172.21.15.3:0/337209134 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5ae4060570 0x7f5ae4062a20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5af800f570 tx=0x7f5af800b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:36.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.673+0000 7feedef57700 1 Processor -- start 2023-10-08T15:37:36.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.673+0000 7feedef57700 1 -- start start 2023-10-08T15:37:36.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.677+0000 7feedef57700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feed806ca60 0x7feed814b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:36.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.677+0000 7feedef57700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feed80b4070 0x7feed80bcd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:36.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.677+0000 7feedef57700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feed814c800 0x7feed8159180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:36.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.677+0000 7feedef57700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed8142750 con 0x7feed80b4070 2023-10-08T15:37:36.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.677+0000 7feedef57700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed814a8e0 con 0x7feed806ca60 2023-10-08T15:37:36.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.677+0000 7feedef57700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feed814b180 con 0x7feed814c800 2023-10-08T15:37:36.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.677+0000 7feedccf3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feed806ca60 0x7feed814b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:36.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.677+0000 7feedd4f4700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feed814c800 0x7feed8159180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:36.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.677+0000 7feedd4f4700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feed814c800 0x7feed8159180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.3:44590/0 (socket says 172.21.15.3:44590) 2023-10-08T15:37:36.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.677+0000 7feedd4f4700 1 -- 172.21.15.3:0/3005454071 learned_addr learned my addr 172.21.15.3:0/3005454071 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:36.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.677+0000 7feedd4f4700 1 -- 172.21.15.3:0/3005454071 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feed806ca60 msgr2=0x7feed814b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:36.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.677+0000 7feedd4f4700 1 --2- 172.21.15.3:0/3005454071 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feed806ca60 0x7feed814b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:36.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.677+0000 7feedd4f4700 1 -- 172.21.15.3:0/3005454071 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feed80b4070 msgr2=0x7feed80bcd30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T15:37:36.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.677+0000 7feedd4f4700 1 --2- 172.21.15.3:0/3005454071 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feed80b4070 0x7feed80bcd30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:36.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.677+0000 7feedd4f4700 1 -- 172.21.15.3:0/3005454071 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed0009a20 con 0x7feed814c800 2023-10-08T15:37:36.684 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:37:36.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.677+0000 7feedd4f4700 1 --2- 172.21.15.3:0/3005454071 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feed814c800 0x7feed8159180 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7feed000b6c0 tx=0x7feed0019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:36.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.677+0000 7feed4ff9700 1 -- 172.21.15.3:0/3005454071 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed0012e00 con 0x7feed814c800 2023-10-08T15:37:36.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.677+0000 7f5af67fc700 1 -- 172.21.15.3:0/337209134 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5af004e020 con 0x7f5b0014d100 2023-10-08T15:37:36.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.677+0000 7feed4ff9700 1 -- 172.21.15.3:0/3005454071 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feed0021070 con 0x7feed814c800 2023-10-08T15:37:36.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.677+0000 7feedef57700 1 -- 172.21.15.3:0/3005454071 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feed80bd270 con 0x7feed814c800 2023-10-08T15:37:36.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.677+0000 7feed4ff9700 1 -- 172.21.15.3:0/3005454071 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed0026680 con 0x7feed814c800 2023-10-08T15:37:36.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.677+0000 7feedef57700 1 -- 172.21.15.3:0/3005454071 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feed814abe0 con 0x7feed814c800 2023-10-08T15:37:36.687 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:37:36.687 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.681+0000 7feedef57700 1 -- 172.21.15.3:0/3005454071 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feed814b2f0 con 0x7feed814c800 2023-10-08T15:37:36.689 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:37:36.691 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:37:36.694 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:37:36.697 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.693+0000 7feed4ff9700 1 -- 172.21.15.3:0/3005454071 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7feed0023030 con 0x7feed814c800 2023-10-08T15:37:36.698 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.693+0000 7feed4ff9700 1 --2- 172.21.15.3:0/3005454071 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7feec40605d0 0x7feec4062a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:36.698 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.693+0000 7feed4ff9700 1 -- 172.21.15.3:0/3005454071 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7feed007e980 con 0x7feed814c800 2023-10-08T15:37:36.698 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.693+0000 7feedccf3700 1 --2- 172.21.15.3:0/3005454071 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7feec40605d0 0x7feec4062a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:36.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.693+0000 7feedccf3700 1 --2- 172.21.15.3:0/3005454071 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7feec40605d0 0x7feec4062a80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7feec8001950 tx=0x7feec8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:36.708 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.701+0000 7feed4ff9700 1 -- 172.21.15.3:0/3005454071 <== mon.2 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7feed004eed0 con 0x7feed814c800 2023-10-08T15:37:36.717 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.713+0000 7f679b17c700 1 Processor -- start 2023-10-08T15:37:36.719 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.713+0000 7fe03f59e700 1 Processor -- start 2023-10-08T15:37:36.719 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.713+0000 7fe03f59e700 1 -- start start 2023-10-08T15:37:36.720 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.713+0000 7f679b17c700 1 -- start start 2023-10-08T15:37:36.720 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.713+0000 7f679b17c700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f67940a15f0 0x7f67940a1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:36.720 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.713+0000 7f679b17c700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67940a26e0 con 0x7f679409fb30 2023-10-08T15:37:36.720 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.713+0000 7f679b17c700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f679409d940 con 0x7f67940bc980 2023-10-08T15:37:36.720 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.713+0000 7f679b17c700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67941488d0 con 0x7f67940a15f0 2023-10-08T15:37:36.720 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.713+0000 7f679a17a700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f679409fb30 0x7f67940bc270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:53890/0 (socket says 172.21.15.3:53890) 2023-10-08T15:37:36.720 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.713+0000 7f679a17a700 1 -- 172.21.15.3:0/585727557 learned_addr learned my addr 172.21.15.3:0/585727557 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:36.720 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.713+0000 7f6799979700 1 --2- 172.21.15.3:0/585727557 >> v2:172.21.15.3:3300/0 conn(0x7f67940a15f0 0x7f67940a1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:36.721 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.713+0000 7f6799178700 1 -- 172.21.15.3:0/585727557 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4145690862 0 0) 0x7f67940a26e0 con 0x7f679409fb30 2023-10-08T15:37:36.721 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.713+0000 7f6799178700 1 -- 172.21.15.3:0/585727557 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6780003570 con 0x7f679409fb30 2023-10-08T15:37:36.721 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.713+0000 7f56f42d4700 1 Processor -- start 2023-10-08T15:37:36.721 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.713+0000 7f56f42d4700 1 -- start start 2023-10-08T15:37:36.721 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.713+0000 7f6799979700 1 -- 172.21.15.3:0/585727557 >> v1:172.21.15.50:6789/0 conn(0x7f67940bc980 legacy=0x7f679406dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:36.721 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.713+0000 7f6799979700 1 -- 172.21.15.3:0/585727557 >> v1:172.21.15.3:6789/0 conn(0x7f679409fb30 legacy=0x7f67940bc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:36.721 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.713+0000 7f6799979700 1 -- 172.21.15.3:0/585727557 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f679409dd20 con 0x7f67940a15f0 2023-10-08T15:37:36.722 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.713+0000 7ffbb9648700 1 Processor -- start 2023-10-08T15:37:36.722 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.713+0000 7f4bdc922700 1 Processor -- start 2023-10-08T15:37:36.722 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.713+0000 7fe03f59e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe0400a1d80 0x7fe0400a2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:36.723 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.713+0000 7fe03f59e700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fe04014b4b0 0x7fe04014b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:36.723 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.713+0000 7fe03f59e700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe04009dec0 con 0x7fe0400a1430 2023-10-08T15:37:36.723 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.713+0000 7fe03f59e700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe04014be10 con 0x7fe04014b4b0 2023-10-08T15:37:36.723 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.713+0000 7fe03f59e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0400a2890 con 0x7fe0400a1d80 2023-10-08T15:37:36.723 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.713+0000 7f4bdc922700 1 -- start start 2023-10-08T15:37:36.723 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.713+0000 7f56f42d4700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f56ec06ca60 0x7f56ec06cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:36.724 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.713+0000 7f56f42d4700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56ec06d5e0 con 0x7f56ec0b4070 2023-10-08T15:37:36.724 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.713+0000 7f56f42d4700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56ec06de80 con 0x7f56ec148fa0 2023-10-08T15:37:36.724 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.713+0000 7f56f42d4700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56ec0b4b40 con 0x7f56ec06ca60 2023-10-08T15:37:36.724 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7f56f2070700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f56ec0b4070 0x7f56ec148890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:53904/0 (socket says 172.21.15.3:53904) 2023-10-08T15:37:36.724 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7f56f2070700 1 -- 172.21.15.3:0/2913617850 learned_addr learned my addr 172.21.15.3:0/2913617850 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:36.724 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7f56f186f700 1 --2- 172.21.15.3:0/2913617850 >> v2:172.21.15.50:3300/0 conn(0x7f56ec06ca60 0x7f56ec06cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:36.724 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.713+0000 7fe03e59c700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fe0400a1430 0x7fe04014f3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:53902/0 (socket says 172.21.15.3:53902) 2023-10-08T15:37:36.724 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.713+0000 7fe03e59c700 1 -- 172.21.15.3:0/194794092 learned_addr learned my addr 172.21.15.3:0/194794092 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:36.724 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.713+0000 7fe03ed9d700 1 --2- 172.21.15.3:0/194794092 >> v2:172.21.15.3:3300/0 conn(0x7fe04014b4b0 0x7fe04014b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:36.725 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.713+0000 7fe03dd9b700 1 --2- 172.21.15.3:0/194794092 >> v2:172.21.15.50:3300/0 conn(0x7fe0400a1d80 0x7fe0400a2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:36.725 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.713+0000 7fe03d59a700 1 -- 172.21.15.3:0/194794092 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 931755346 0 0) 0x7fe04009dec0 con 0x7fe0400a1430 2023-10-08T15:37:36.725 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.713+0000 7fe03ed9d700 1 -- 172.21.15.3:0/194794092 >> v2:172.21.15.50:3300/0 conn(0x7fe0400a1d80 msgr2=0x7fe0400a2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:36.725 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.713+0000 7fe03ed9d700 1 --2- 172.21.15.3:0/194794092 >> v2:172.21.15.50:3300/0 conn(0x7fe0400a1d80 0x7fe0400a2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:36.725 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.713+0000 7fe03ed9d700 1 -- 172.21.15.3:0/194794092 >> v1:172.21.15.3:6789/0 conn(0x7fe0400a1430 legacy=0x7fe04014f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:36.725 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.713+0000 7fe03ed9d700 1 -- 172.21.15.3:0/194794092 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe04014ebb0 con 0x7fe04014b4b0 2023-10-08T15:37:36.725 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.713+0000 7fe03ed9d700 1 --2- 172.21.15.3:0/194794092 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe04014b4b0 0x7fe04014b8d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe038009e60 tx=0x7fe038009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b6f15d06647b637 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:36.725 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7fe03d59a700 1 -- 172.21.15.3:0/194794092 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03800e070 con 0x7fe04014b4b0 2023-10-08T15:37:36.725 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7fe03d59a700 1 -- 172.21.15.3:0/194794092 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe03800bbf0 con 0x7fe04014b4b0 2023-10-08T15:37:36.726 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.713+0000 7ffbb9648700 1 -- start start 2023-10-08T15:37:36.726 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7ffbb9648700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ffbb4068320 0x7ffbb406cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:36.726 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7ffbb9648700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ffbb40b2740 0x7ffbb4146aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:36.726 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7ffbb9648700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbb40b1cd0 con 0x7ffbb406d430 2023-10-08T15:37:36.726 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7ffbb9648700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbb40b1f40 con 0x7ffbb4068320 2023-10-08T15:37:36.726 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7ffbb9648700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb40b2220 con 0x7ffbb40b2740 2023-10-08T15:37:36.726 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7ffbb2ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ffbb4068320 0x7ffbb406cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:36.726 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7ffbb2ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ffbb4068320 0x7ffbb406cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.3:37112/0 (socket says 172.21.15.3:37112) 2023-10-08T15:37:36.726 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7ffbb2ffd700 1 -- 172.21.15.3:0/4034717152 learned_addr learned my addr 172.21.15.3:0/4034717152 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:36.727 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.713+0000 7f6799979700 1 --2- 172.21.15.3:0/585727557 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f67940a15f0 0x7f67940a1d10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f67840098e0 tx=0x7f67840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7565ac41768b1019 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:36.727 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.713+0000 7f6799178700 1 -- 172.21.15.3:0/585727557 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678400f750 con 0x7f67940a15f0 2023-10-08T15:37:36.727 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.713+0000 7f6799178700 1 -- 172.21.15.3:0/585727557 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f678400f8d0 con 0x7f67940a15f0 2023-10-08T15:37:36.727 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.713+0000 7f6799178700 1 -- 172.21.15.3:0/585727557 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678400fc90 con 0x7f67940a15f0 2023-10-08T15:37:36.727 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7ffbb2ffd700 1 -- 172.21.15.3:0/4034717152 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ffbb40b2740 msgr2=0x7ffbb4146aa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T15:37:36.727 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7ffbb2ffd700 1 --2- 172.21.15.3:0/4034717152 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ffbb40b2740 0x7ffbb4146aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:36.727 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7ffbb2ffd700 1 -- 172.21.15.3:0/4034717152 >> v1:172.21.15.50:6789/0 conn(0x7ffbb406d430 legacy=0x7ffbb4146fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:36.727 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7ffbb2ffd700 1 -- 172.21.15.3:0/4034717152 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbb406e380 con 0x7ffbb4068320 2023-10-08T15:37:36.728 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7fe03d59a700 1 -- 172.21.15.3:0/194794092 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe038012430 con 0x7fe04014b4b0 2023-10-08T15:37:36.728 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7f4bdc922700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4bd80b3530 0x7f4bd814abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:36.728 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7f4bdc922700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4bd806e020 0x7f4bd814b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:36.728 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7f4bdc922700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bd80b8a00 con 0x7f4bd80b2830 2023-10-08T15:37:36.729 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7fe03f59e700 1 -- 172.21.15.3:0/194794092 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe04014b4b0 msgr2=0x7fe04014b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:36.729 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7fe03f59e700 1 --2- 172.21.15.3:0/194794092 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe04014b4b0 0x7fe04014b8d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe038009e60 tx=0x7fe038009780 comp rx=0 tx=0).stop 2023-10-08T15:37:36.729 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7f4bdc922700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bd80b2f80 con 0x7f4bd80b3530 2023-10-08T15:37:36.729 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7f4bdc922700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd80b83d0 con 0x7f4bd806e020 2023-10-08T15:37:36.729 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7f679b17c700 1 -- 172.21.15.3:0/585727557 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f67940a15f0 msgr2=0x7f67940a1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:36.730 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7f679b17c700 1 --2- 172.21.15.3:0/585727557 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f67940a15f0 0x7f67940a1d10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f67840098e0 tx=0x7f67840091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:36.730 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7f679b17c700 1 -- 172.21.15.3:0/585727557 shutdown_connections 2023-10-08T15:37:36.730 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7f679b17c700 1 --2- 172.21.15.3:0/585727557 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f67940a15f0 0x7f67940a1d10 secure :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f67840098e0 tx=0x7f67840091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:36.730 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7f679b17c700 1 -- 172.21.15.3:0/585727557 >> 172.21.15.3:0/585727557 conn(0x7f67940bd9b0 msgr2=0x7f67940bddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:36.730 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7f56f106e700 1 -- 172.21.15.3:0/2913617850 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 775618182 0 0) 0x7f56ec06d5e0 con 0x7f56ec0b4070 2023-10-08T15:37:36.730 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7f56f186f700 1 -- 172.21.15.3:0/2913617850 >> v1:172.21.15.50:6789/0 conn(0x7f56ec148fa0 legacy=0x7f56ec14c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:36.730 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7f56f186f700 1 -- 172.21.15.3:0/2913617850 >> v1:172.21.15.3:6789/0 conn(0x7f56ec0b4070 legacy=0x7f56ec148890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:36.731 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7f56f186f700 1 -- 172.21.15.3:0/2913617850 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56ec0b3c50 con 0x7f56ec06ca60 2023-10-08T15:37:36.731 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7f4bd5d9b700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f4bd80b2830 0x7f4bd814ec00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:53916/0 (socket says 172.21.15.3:53916) 2023-10-08T15:37:36.731 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7f4bd5d9b700 1 -- 172.21.15.3:0/621254866 learned_addr learned my addr 172.21.15.3:0/621254866 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:36.731 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7ffbb2ffd700 1 --2- 172.21.15.3:0/4034717152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffbb4068320 0x7ffbb406cef0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ffbac00d1a0 tx=0x7ffbac007690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7598366ee1dc49f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:36.732 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7f679b17c700 1 -- 172.21.15.3:0/585727557 shutdown_connections 2023-10-08T15:37:36.732 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7f679b17c700 1 -- 172.21.15.3:0/585727557 wait complete. 2023-10-08T15:37:36.732 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7f4bd6d9d700 1 --2- 172.21.15.3:0/621254866 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4bd806e020 0x7f4bd814b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:36.732 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7f56f186f700 1 --2- 172.21.15.3:0/2913617850 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56ec06ca60 0x7f56ec06cfe0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f56dc009860 tx=0x7f56dc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=629a75e30afaea01 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:36.733 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7fe03f59e700 1 -- 172.21.15.3:0/194794092 shutdown_connections 2023-10-08T15:37:36.733 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7fe03f59e700 1 --2- 172.21.15.3:0/194794092 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe04014b4b0 0x7fe04014b8d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:36.733 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7fe03f59e700 1 --2- 172.21.15.3:0/194794092 >> v2:172.21.15.50:3300/0 conn(0x7fe0400a1d80 0x7fe0400a2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:36.733 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7fe03f59e700 1 -- 172.21.15.3:0/194794092 >> 172.21.15.3:0/194794092 conn(0x7fe0400bd9b0 msgr2=0x7fe0400bddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:36.733 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7ffbb1ffb700 1 -- 172.21.15.3:0/4034717152 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbac010070 con 0x7ffbb4068320 2023-10-08T15:37:36.733 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7f4bd659c700 1 --2- 172.21.15.3:0/621254866 >> v2:172.21.15.50:3300/0 conn(0x7f4bd80b3530 0x7f4bd814abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:36.734 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7ffbb1ffb700 1 -- 172.21.15.3:0/4034717152 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbac00dc70 con 0x7ffbb4068320 2023-10-08T15:37:36.734 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7ffbb1ffb700 1 -- 172.21.15.3:0/4034717152 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbac007b40 con 0x7ffbb4068320 2023-10-08T15:37:36.734 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7ffbb9648700 1 -- 172.21.15.3:0/4034717152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffbb4068320 msgr2=0x7ffbb406cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:36.735 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7ffbb9648700 1 --2- 172.21.15.3:0/4034717152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffbb4068320 0x7ffbb406cef0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ffbac00d1a0 tx=0x7ffbac007690 comp rx=0 tx=0).stop 2023-10-08T15:37:36.735 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7f4bd659c700 1 -- 172.21.15.3:0/621254866 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4bd806e020 msgr2=0x7f4bd814b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:36.735 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7f4bd659c700 1 --2- 172.21.15.3:0/621254866 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4bd806e020 0x7f4bd814b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:36.735 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7ffbb9648700 1 -- 172.21.15.3:0/4034717152 shutdown_connections 2023-10-08T15:37:36.736 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7ffbb9648700 1 --2- 172.21.15.3:0/4034717152 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ffbb40b2740 0x7ffbb4146aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:36.736 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7ffbb9648700 1 --2- 172.21.15.3:0/4034717152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffbb4068320 0x7ffbb406cef0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:36.736 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7ffbb9648700 1 -- 172.21.15.3:0/4034717152 >> 172.21.15.3:0/4034717152 conn(0x7ffbb40be630 msgr2=0x7ffbb40ba6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:36.736 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7f4bd659c700 1 -- 172.21.15.3:0/621254866 >> v1:172.21.15.3:6789/0 conn(0x7f4bd80b2830 legacy=0x7f4bd814ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:36.736 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7f4bd659c700 1 -- 172.21.15.3:0/621254866 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd80b8690 con 0x7f4bd80b3530 2023-10-08T15:37:36.737 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7ffbb9648700 1 -- 172.21.15.3:0/4034717152 shutdown_connections 2023-10-08T15:37:36.737 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7ffbb9648700 1 -- 172.21.15.3:0/4034717152 wait complete. 2023-10-08T15:37:36.737 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7f679b17c700 1 Processor -- start 2023-10-08T15:37:36.737 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7f56f106e700 1 -- 172.21.15.3:0/2913617850 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56dc011630 con 0x7f56ec06ca60 2023-10-08T15:37:36.737 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7f56f106e700 1 -- 172.21.15.3:0/2913617850 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56dc011790 con 0x7f56ec06ca60 2023-10-08T15:37:36.738 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7f679b17c700 1 -- start start 2023-10-08T15:37:36.738 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7f56f106e700 1 -- 172.21.15.3:0/2913617850 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56dc011b50 con 0x7f56ec06ca60 2023-10-08T15:37:36.738 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7f4bd659c700 1 --2- 172.21.15.3:0/621254866 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bd80b3530 0x7f4bd814abe0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4bc80098e0 tx=0x7f4bc80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a1ef44263f30c5b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:36.739 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7fe03f59e700 1 -- 172.21.15.3:0/194794092 shutdown_connections 2023-10-08T15:37:36.739 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.717+0000 7fe03f59e700 1 -- 172.21.15.3:0/194794092 wait complete. 2023-10-08T15:37:36.739 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7f4bd559a700 1 -- 172.21.15.3:0/621254866 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc8011630 con 0x7f4bd80b3530 2023-10-08T15:37:36.739 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7f4bd559a700 1 -- 172.21.15.3:0/621254866 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc8011790 con 0x7f4bd80b3530 2023-10-08T15:37:36.740 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7f4bd559a700 1 -- 172.21.15.3:0/621254866 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc8011b30 con 0x7f4bd80b3530 2023-10-08T15:37:36.740 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7f56f42d4700 1 -- 172.21.15.3:0/2913617850 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56ec06ca60 msgr2=0x7f56ec06cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:36.740 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7f56f42d4700 1 --2- 172.21.15.3:0/2913617850 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56ec06ca60 0x7f56ec06cfe0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f56dc009860 tx=0x7f56dc0091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:36.741 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7f679b17c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f679409fb30 0x7f679414d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:36.741 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7f679b17c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f67940bc980 0x7f6794147520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:36.741 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7f679b17c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67940b9ec0 0x7f6794147a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:36.741 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7f679b17c700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6794097840 con 0x7f679409fb30 2023-10-08T15:37:36.741 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7f679b17c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f679415ad90 con 0x7f67940b9ec0 2023-10-08T15:37:36.741 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7f679b17c700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f679415b2c0 con 0x7f67940bc980 2023-10-08T15:37:36.741 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7ffbb9648700 1 Processor -- start 2023-10-08T15:37:36.742 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7f679a17a700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f679409fb30 0x7f679414d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:36.742 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7f679a17a700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f679409fb30 0x7f679414d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47956/0 (socket says 172.21.15.3:47956) 2023-10-08T15:37:36.742 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7f679a17a700 1 -- 172.21.15.3:0/1818961998 learned_addr learned my addr 172.21.15.3:0/1818961998 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:36.742 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7ffbb9648700 1 -- start start 2023-10-08T15:37:36.742 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7f679a97b700 1 --2- 172.21.15.3:0/1818961998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67940b9ec0 0x7f6794147a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:36.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7f56f42d4700 1 -- 172.21.15.3:0/2913617850 shutdown_connections 2023-10-08T15:37:36.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7f56f42d4700 1 --2- 172.21.15.3:0/2913617850 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56ec06ca60 0x7f56ec06cfe0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:36.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7f56f42d4700 1 -- 172.21.15.3:0/2913617850 >> 172.21.15.3:0/2913617850 conn(0x7f56ec0be630 msgr2=0x7f56ec0ba6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:36.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7f56f42d4700 1 -- 172.21.15.3:0/2913617850 shutdown_connections 2023-10-08T15:37:36.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7f56f42d4700 1 -- 172.21.15.3:0/2913617850 wait complete. 2023-10-08T15:37:36.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7fe03f59e700 1 Processor -- start 2023-10-08T15:37:36.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7fe03f59e700 1 -- start start 2023-10-08T15:37:36.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7f679a17a700 1 -- 172.21.15.3:0/1818961998 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f67940bc980 msgr2=0x7f6794147520 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T15:37:36.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7f679a17a700 1 --2- 172.21.15.3:0/1818961998 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f67940bc980 0x7f6794147520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:36.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7f679a17a700 1 -- 172.21.15.3:0/1818961998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67940b9ec0 msgr2=0x7f6794147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:36.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7f679a17a700 1 --2- 172.21.15.3:0/1818961998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67940b9ec0 0x7f6794147a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:36.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7f679a17a700 1 -- 172.21.15.3:0/1818961998 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6784009420 con 0x7f679409fb30 2023-10-08T15:37:36.745 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7f4bdc922700 1 -- 172.21.15.3:0/621254866 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bd80b3530 msgr2=0x7f4bd814abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:36.745 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7f4bdc922700 1 --2- 172.21.15.3:0/621254866 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bd80b3530 0x7f4bd814abe0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4bc80098e0 tx=0x7f4bc80091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:36.745 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7f4bdc922700 1 -- 172.21.15.3:0/621254866 shutdown_connections 2023-10-08T15:37:36.745 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7f4bdc922700 1 --2- 172.21.15.3:0/621254866 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4bd806e020 0x7f4bd814b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:36.745 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7f4bdc922700 1 --2- 172.21.15.3:0/621254866 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bd80b3530 0x7f4bd814abe0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:36.745 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7f4bdc922700 1 -- 172.21.15.3:0/621254866 >> 172.21.15.3:0/621254866 conn(0x7f4bd80be630 msgr2=0x7f4bd80ba6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:36.745 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7f4bdc922700 1 -- 172.21.15.3:0/621254866 shutdown_connections 2023-10-08T15:37:36.746 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7f56f42d4700 1 Processor -- start 2023-10-08T15:37:36.746 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7f56f42d4700 1 -- start start 2023-10-08T15:37:36.746 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7fe03f59e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe0400a1430 0x7fe04014dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:36.746 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7fe03f59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0400a1d80 0x7fe04006e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:36.746 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7fe03f59e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe04014b4b0 0x7fe040162130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:36.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7fe03f59e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe04006d210 con 0x7fe0400a1430 2023-10-08T15:37:36.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7fe03f59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe04006e240 con 0x7fe0400a1d80 2023-10-08T15:37:36.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7fe03f59e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe04014e150 con 0x7fe04014b4b0 2023-10-08T15:37:36.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7fe03e59c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe0400a1430 0x7fe04014dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:36.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7fe03e59c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe0400a1430 0x7fe04014dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47970/0 (socket says 172.21.15.3:47970) 2023-10-08T15:37:36.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7fe03e59c700 1 -- 172.21.15.3:0/147906729 learned_addr learned my addr 172.21.15.3:0/147906729 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:36.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7fe03dd9b700 1 --2- 172.21.15.3:0/147906729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0400a1d80 0x7fe04006e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:36.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7fe03ed9d700 1 --2- 172.21.15.3:0/147906729 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe04014b4b0 0x7fe040162130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:36.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7fe03e59c700 1 -- 172.21.15.3:0/147906729 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe04014b4b0 msgr2=0x7fe040162130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:36.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7fe03e59c700 1 --2- 172.21.15.3:0/147906729 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe04014b4b0 0x7fe040162130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:36.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7fe03e59c700 1 -- 172.21.15.3:0/147906729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0400a1d80 msgr2=0x7fe04006e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:36.748 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7fe03e59c700 1 --2- 172.21.15.3:0/147906729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0400a1d80 0x7fe04006e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:36.748 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7fe03e59c700 1 -- 172.21.15.3:0/147906729 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe038009a20 con 0x7fe0400a1430 2023-10-08T15:37:36.748 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7fe03e59c700 1 --2- 172.21.15.3:0/147906729 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe0400a1430 0x7fe04014dc10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe03000c560 tx=0x7fe030000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:36.748 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.725+0000 7fe02e7fc700 1 -- 172.21.15.3:0/147906729 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe030005b30 con 0x7fe0400a1430 2023-10-08T15:37:36.748 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.725+0000 7fe02e7fc700 1 -- 172.21.15.3:0/147906729 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe030005c90 con 0x7fe0400a1430 2023-10-08T15:37:36.748 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.725+0000 7fe03f59e700 1 -- 172.21.15.3:0/147906729 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe04006c380 con 0x7fe0400a1430 2023-10-08T15:37:36.748 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.725+0000 7fe03f59e700 1 -- 172.21.15.3:0/147906729 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe04006c660 con 0x7fe0400a1430 2023-10-08T15:37:36.748 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7ffbb9648700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffbb4068320 0x7ffbb41609a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:36.748 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7ffbb9648700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffbb406d430 0x7ffbb41631f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:36.749 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7ffbb9648700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ffbb40b2740 0x7ffbb4163730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:36.749 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7ffbb9648700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb4163c70 con 0x7ffbb4068320 2023-10-08T15:37:36.749 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7ffbb9648700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb4164140 con 0x7ffbb406d430 2023-10-08T15:37:36.749 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7ffbb9648700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb40a2bf0 con 0x7ffbb40b2740 2023-10-08T15:37:36.749 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7ffbb2ffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffbb4068320 0x7ffbb41609a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:36.749 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7ffbb2ffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffbb4068320 0x7ffbb41609a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47964/0 (socket says 172.21.15.3:47964) 2023-10-08T15:37:36.749 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7ffbb2ffd700 1 -- 172.21.15.3:0/928472513 learned_addr learned my addr 172.21.15.3:0/928472513 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:36.749 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7ffbb37fe700 1 --2- 172.21.15.3:0/928472513 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ffbb40b2740 0x7ffbb4163730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:36.749 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7ffbb27fc700 1 --2- 172.21.15.3:0/928472513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffbb406d430 0x7ffbb41631f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:36.749 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7ffbb2ffd700 1 -- 172.21.15.3:0/928472513 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ffbb40b2740 msgr2=0x7ffbb4163730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:36.749 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7ffbb2ffd700 1 --2- 172.21.15.3:0/928472513 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ffbb40b2740 0x7ffbb4163730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:36.749 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7ffbb2ffd700 1 -- 172.21.15.3:0/928472513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffbb406d430 msgr2=0x7ffbb41631f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:36.750 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7ffbb2ffd700 1 --2- 172.21.15.3:0/928472513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffbb406d430 0x7ffbb41631f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:36.750 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7ffbb2ffd700 1 -- 172.21.15.3:0/928472513 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbac00be70 con 0x7ffbb4068320 2023-10-08T15:37:36.750 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7ffbb2ffd700 1 --2- 172.21.15.3:0/928472513 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffbb4068320 0x7ffbb41609a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ffbac007260 tx=0x7ffbac01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:36.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7f679a17a700 1 --2- 172.21.15.3:0/1818961998 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f679409fb30 0x7f679414d790 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f679000c7f0 tx=0x7f6790007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:36.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7f678a7fc700 1 -- 172.21.15.3:0/1818961998 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6790005b30 con 0x7f679409fb30 2023-10-08T15:37:36.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7f678a7fc700 1 -- 172.21.15.3:0/1818961998 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6790005cb0 con 0x7f679409fb30 2023-10-08T15:37:36.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7f678a7fc700 1 -- 172.21.15.3:0/1818961998 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6790007320 con 0x7f679409fb30 2023-10-08T15:37:36.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7f679b17c700 1 -- 172.21.15.3:0/1818961998 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6794098000 con 0x7f679409fb30 2023-10-08T15:37:36.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.721+0000 7f679b17c700 1 -- 172.21.15.3:0/1818961998 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f679415afe0 con 0x7f679409fb30 2023-10-08T15:37:36.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.725+0000 7f678a7fc700 1 -- 172.21.15.3:0/1818961998 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f679001b3b0 con 0x7f679409fb30 2023-10-08T15:37:36.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.725+0000 7f679b17c700 1 -- 172.21.15.3:0/1818961998 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f679405ecf0 con 0x7f679409fb30 2023-10-08T15:37:36.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.725+0000 7f678a7fc700 1 --2- 172.21.15.3:0/1818961998 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f6778060650 0x7f6778062b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:36.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.725+0000 7f678a7fc700 1 -- 172.21.15.3:0/1818961998 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f679007bd40 con 0x7f679409fb30 2023-10-08T15:37:36.752 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.725+0000 7fe03f59e700 1 -- 172.21.15.3:0/147906729 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe04005ecf0 con 0x7fe0400a1430 2023-10-08T15:37:36.752 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.725+0000 7f6799979700 1 --2- 172.21.15.3:0/1818961998 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f6778060650 0x7f6778062b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:36.753 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.725+0000 7f56f42d4700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f56ec06ca60 0x7f56ec15afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:36.753 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.725+0000 7f56f42d4700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f56ec0b4070 0x7f56ec0ba860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:36.753 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.725+0000 7f56f42d4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56ec148fa0 0x7f56ec1473e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:36.753 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.725+0000 7f56f42d4700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56ec0bbda0 con 0x7f56ec06ca60 2023-10-08T15:37:36.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.725+0000 7f56f42d4700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56ec141800 con 0x7f56ec148fa0 2023-10-08T15:37:36.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.725+0000 7f56f42d4700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56ec0bd860 con 0x7f56ec0b4070 2023-10-08T15:37:36.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.725+0000 7f56f2871700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56ec148fa0 0x7f56ec1473e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:36.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.725+0000 7f56f2871700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56ec148fa0 0x7f56ec1473e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.3:37160/0 (socket says 172.21.15.3:37160) 2023-10-08T15:37:36.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.725+0000 7f56f2871700 1 -- 172.21.15.3:0/2079559096 learned_addr learned my addr 172.21.15.3:0/2079559096 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:36.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.725+0000 7f56f2070700 1 --2- 172.21.15.3:0/2079559096 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f56ec06ca60 0x7f56ec15afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:36.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.725+0000 7f6799979700 1 --2- 172.21.15.3:0/1818961998 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f6778060650 0x7f6778062b00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f67840098e0 tx=0x7f6784019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:36.755 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.725+0000 7f56f2070700 1 -- 172.21.15.3:0/2079559096 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f56ec0b4070 msgr2=0x7f56ec0ba860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T15:37:36.755 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.725+0000 7f56f2070700 1 --2- 172.21.15.3:0/2079559096 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f56ec0b4070 0x7f56ec0ba860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:36.755 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.725+0000 7f56f2070700 1 -- 172.21.15.3:0/2079559096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56ec148fa0 msgr2=0x7f56ec1473e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:36.755 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.725+0000 7f56f2070700 1 --2- 172.21.15.3:0/2079559096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56ec148fa0 0x7f56ec1473e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:36.755 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.725+0000 7f56f2070700 1 -- 172.21.15.3:0/2079559096 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56dc009420 con 0x7f56ec06ca60 2023-10-08T15:37:36.756 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.725+0000 7f56f2070700 1 --2- 172.21.15.3:0/2079559096 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f56ec06ca60 0x7f56ec15afb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f56e400e460 tx=0x7f56e4010960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:36.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.725+0000 7f4bdc922700 1 -- 172.21.15.3:0/621254866 wait complete. 2023-10-08T15:37:36.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.725+0000 7f4bdc922700 1 Processor -- start 2023-10-08T15:37:36.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.725+0000 7f4bdc922700 1 -- start start 2023-10-08T15:37:36.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.725+0000 7f4bdc922700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bd806e020 0x7f4bd81439e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:36.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.725+0000 7f4bdc922700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4bd80b2830 0x7f4bd806c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:36.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.725+0000 7f4bdc922700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4bd80b3530 0x7f4bd806ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:36.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.725+0000 7f4bdc922700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd814ce70 con 0x7f4bd80b2830 2023-10-08T15:37:36.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.725+0000 7f4bdc922700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd817a150 con 0x7f4bd806e020 2023-10-08T15:37:36.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.725+0000 7f4bdc922700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd806c500 con 0x7f4bd80b3530 2023-10-08T15:37:36.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.725+0000 7f4bd5d9b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4bd80b2830 0x7f4bd806c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:36.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.725+0000 7f4bd5d9b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4bd80b2830 0x7f4bd806c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47990/0 (socket says 172.21.15.3:47990) 2023-10-08T15:37:36.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.725+0000 7f4bd5d9b700 1 -- 172.21.15.3:0/3202078418 learned_addr learned my addr 172.21.15.3:0/3202078418 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:36.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.725+0000 7f4bd659c700 1 --2- 172.21.15.3:0/3202078418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bd806e020 0x7f4bd81439e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:36.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.725+0000 7f4bd6d9d700 1 --2- 172.21.15.3:0/3202078418 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4bd80b3530 0x7f4bd806ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:36.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.725+0000 7f4bd5d9b700 1 -- 172.21.15.3:0/3202078418 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4bd80b3530 msgr2=0x7f4bd806ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:36.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.725+0000 7f4bd5d9b700 1 --2- 172.21.15.3:0/3202078418 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4bd80b3530 0x7f4bd806ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:36.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.729+0000 7f4bd5d9b700 1 -- 172.21.15.3:0/3202078418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bd806e020 msgr2=0x7f4bd81439e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:36.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.729+0000 7f4bd5d9b700 1 --2- 172.21.15.3:0/3202078418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bd806e020 0x7f4bd81439e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:36.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.729+0000 7f4bd5d9b700 1 -- 172.21.15.3:0/3202078418 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc8009420 con 0x7f4bd80b2830 2023-10-08T15:37:36.759 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.729+0000 7ffba2ffd700 1 -- 172.21.15.3:0/928472513 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbac00dee0 con 0x7ffbb4068320 2023-10-08T15:37:36.759 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.729+0000 7f4bd5d9b700 1 --2- 172.21.15.3:0/3202078418 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4bd80b2830 0x7f4bd806c990 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4bd000cd80 tx=0x7f4bd0001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:36.759 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.729+0000 7ffba2ffd700 1 -- 172.21.15.3:0/928472513 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbac020460 con 0x7ffbb4068320 2023-10-08T15:37:36.759 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.729+0000 7ffba2ffd700 1 -- 172.21.15.3:0/928472513 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbac020800 con 0x7ffbb4068320 2023-10-08T15:37:36.759 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.729+0000 7ffbb9648700 1 -- 172.21.15.3:0/928472513 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbb4163e60 con 0x7ffbb4068320 2023-10-08T15:37:36.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.729+0000 7ffbb9648700 1 -- 172.21.15.3:0/928472513 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbb414caa0 con 0x7ffbb4068320 2023-10-08T15:37:36.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.733+0000 7f678a7fc700 1 -- 172.21.15.3:0/1818961998 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f679004c3b0 con 0x7f679409fb30 2023-10-08T15:37:36.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.733+0000 7f7814a68700 1 Processor -- start 2023-10-08T15:37:36.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.733+0000 7f7814a68700 1 -- start start 2023-10-08T15:37:36.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.733+0000 7fe02e7fc700 1 -- 172.21.15.3:0/147906729 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe030007300 con 0x7fe0400a1430 2023-10-08T15:37:36.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.733+0000 7fe02e7fc700 1 -- 172.21.15.3:0/147906729 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe030012400 con 0x7fe0400a1430 2023-10-08T15:37:36.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.737+0000 7fe02e7fc700 1 --2- 172.21.15.3:0/147906729 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe0280607b0 0x7fe028062c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:36.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.737+0000 7fe02e7fc700 1 -- 172.21.15.3:0/147906729 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe03007c7a0 con 0x7fe0400a1430 2023-10-08T15:37:36.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.737+0000 7f7814a68700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f78100b3530 0x7f781014d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:36.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.737+0000 7f7814a68700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f7810148ff0 0x7f7810149420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:36.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.737+0000 7f7814a68700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78100b2ee0 con 0x7f7810148c20 2023-10-08T15:37:36.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.737+0000 7f7814a68700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78100b3c60 con 0x7f7810148ff0 2023-10-08T15:37:36.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.737+0000 7f7814a68700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f781006d300 con 0x7f78100b3530 2023-10-08T15:37:36.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.737+0000 7fe03dd9b700 1 --2- 172.21.15.3:0/147906729 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe0280607b0 0x7fe028062c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:36.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.737+0000 7f780ed9d700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f7810148ff0 0x7f7810149420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:36.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.737+0000 7f780ed9d700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f7810148ff0 0x7f7810149420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47992/0 (socket says 172.21.15.3:47992) 2023-10-08T15:37:36.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.737+0000 7f780ed9d700 1 -- 172.21.15.3:0/593354884 learned_addr learned my addr 172.21.15.3:0/593354884 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:36.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.737+0000 7f780dd9b700 1 --2- 172.21.15.3:0/593354884 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f78100b3530 0x7f781014d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:36.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.737+0000 7f780ed9d700 1 -- 172.21.15.3:0/593354884 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f78100b3530 msgr2=0x7f781014d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:36.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.737+0000 7f780ed9d700 1 --2- 172.21.15.3:0/593354884 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f78100b3530 0x7f781014d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:36.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.737+0000 7f780ed9d700 1 -- 172.21.15.3:0/593354884 >> v1:172.21.15.3:6789/0 conn(0x7f7810148c20 legacy=0x7f781014cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:36.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.737+0000 7f780ed9d700 1 -- 172.21.15.3:0/593354884 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78100b25f0 con 0x7f7810148ff0 2023-10-08T15:37:36.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.737+0000 7ffbb9648700 1 -- 172.21.15.3:0/928472513 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb900052b0 con 0x7ffbb4068320 2023-10-08T15:37:36.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.737+0000 7fe03dd9b700 1 --2- 172.21.15.3:0/147906729 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe0280607b0 0x7fe028062c60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe04006d7d0 tx=0x7fe034008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:36.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.737+0000 7f780ed9d700 1 --2- 172.21.15.3:0/593354884 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7810148ff0 0x7f7810149420 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7808009f20 tx=0x7f7808009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56932e60d7486a71 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:36.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.745+0000 7f56e27fc700 1 -- 172.21.15.3:0/2079559096 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e40102e0 con 0x7f56ec06ca60 2023-10-08T15:37:36.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.745+0000 7f4bc67fc700 1 -- 172.21.15.3:0/3202078418 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd000aac0 con 0x7f4bd80b2830 2023-10-08T15:37:36.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.745+0000 7f4bdc922700 1 -- 172.21.15.3:0/3202078418 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bd8143f20 con 0x7f4bd80b2830 2023-10-08T15:37:36.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.745+0000 7f4bdc922700 1 -- 172.21.15.3:0/3202078418 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bd814cb00 con 0x7f4bd80b2830 2023-10-08T15:37:36.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.745+0000 7f56f42d4700 1 -- 172.21.15.3:0/2079559096 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56ec0bd230 con 0x7f56ec06ca60 2023-10-08T15:37:36.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.745+0000 7f56f42d4700 1 -- 172.21.15.3:0/2079559096 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56ec0bd4f0 con 0x7f56ec06ca60 2023-10-08T15:37:36.767 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.745+0000 7f780d59a700 1 -- 172.21.15.3:0/593354884 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780800e070 con 0x7f7810148ff0 2023-10-08T15:37:36.767 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.745+0000 7fe02e7fc700 1 -- 172.21.15.3:0/147906729 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe030049be0 con 0x7fe0400a1430 2023-10-08T15:37:36.767 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.745+0000 7f56f42d4700 1 -- 172.21.15.3:0/2079559096 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56ec064530 con 0x7f56ec06ca60 2023-10-08T15:37:36.767 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.745+0000 7f56e27fc700 1 -- 172.21.15.3:0/2079559096 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56e4010ac0 con 0x7f56ec06ca60 2023-10-08T15:37:36.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.745+0000 7f56e27fc700 1 -- 172.21.15.3:0/2079559096 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e4015de0 con 0x7f56ec06ca60 2023-10-08T15:37:36.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.745+0000 7ffba2ffd700 1 -- 172.21.15.3:0/928472513 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ffbac02a440 con 0x7ffbb4068320 2023-10-08T15:37:36.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.745+0000 7f4bc67fc700 1 -- 172.21.15.3:0/3202078418 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd0001ca0 con 0x7f4bd80b2830 2023-10-08T15:37:36.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.745+0000 7f4bc67fc700 1 -- 172.21.15.3:0/3202078418 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd000ae30 con 0x7f4bd80b2830 2023-10-08T15:37:36.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.745+0000 7ffba2ffd700 1 --2- 172.21.15.3:0/928472513 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ffb9c060780 0x7ffb9c062c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:36.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.745+0000 7ffba2ffd700 1 -- 172.21.15.3:0/928472513 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ffbac07e360 con 0x7ffbb4068320 2023-10-08T15:37:36.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.745+0000 7ffbb27fc700 1 --2- 172.21.15.3:0/928472513 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ffb9c060780 0x7ffb9c062c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:36.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.749+0000 7f780d59a700 1 -- 172.21.15.3:0/593354884 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f780800b9d0 con 0x7f7810148ff0 2023-10-08T15:37:36.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.749+0000 7ffbb27fc700 1 --2- 172.21.15.3:0/928472513 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ffb9c060780 0x7ffb9c062c30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ffbb40bd6f0 tx=0x7ffba8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:36.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.749+0000 7f780d59a700 1 -- 172.21.15.3:0/593354884 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78080092e0 con 0x7f7810148ff0 2023-10-08T15:37:36.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.749+0000 7f7814a68700 1 -- 172.21.15.3:0/593354884 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7810148ff0 msgr2=0x7f7810149420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:36.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.749+0000 7f7814a68700 1 --2- 172.21.15.3:0/593354884 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7810148ff0 0x7f7810149420 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7808009f20 tx=0x7f7808009840 comp rx=0 tx=0).stop 2023-10-08T15:37:36.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.749+0000 7f4bc67fc700 1 -- 172.21.15.3:0/3202078418 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4bd00070f0 con 0x7f4bd80b2830 2023-10-08T15:37:36.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.749+0000 7f56e27fc700 1 -- 172.21.15.3:0/2079559096 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f56e400e6a0 con 0x7f56ec06ca60 2023-10-08T15:37:36.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.749+0000 7f7814a68700 1 -- 172.21.15.3:0/593354884 shutdown_connections 2023-10-08T15:37:36.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.749+0000 7f7814a68700 1 --2- 172.21.15.3:0/593354884 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7810148ff0 0x7f7810149420 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:36.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.749+0000 7f7814a68700 1 --2- 172.21.15.3:0/593354884 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f78100b3530 0x7f781014d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:36.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.749+0000 7f7814a68700 1 -- 172.21.15.3:0/593354884 >> 172.21.15.3:0/593354884 conn(0x7f78100bdda0 msgr2=0x7f78100be170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:36.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.749+0000 7f7814a68700 1 -- 172.21.15.3:0/593354884 shutdown_connections 2023-10-08T15:37:36.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.749+0000 7f7814a68700 1 -- 172.21.15.3:0/593354884 wait complete. 2023-10-08T15:37:36.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.749+0000 7f4bc67fc700 1 --2- 172.21.15.3:0/3202078418 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4bb8060550 0x7f4bb8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:36.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.749+0000 7f4bd659c700 1 --2- 172.21.15.3:0/3202078418 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4bb8060550 0x7f4bb8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:36.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.749+0000 7f56e27fc700 1 --2- 172.21.15.3:0/2079559096 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f56d0060580 0x7f56d0062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:36.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.749+0000 7f56f186f700 1 --2- 172.21.15.3:0/2079559096 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f56d0060580 0x7f56d0062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:36.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.749+0000 7f4bd659c700 1 --2- 172.21.15.3:0/3202078418 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4bb8060550 0x7f4bb8062a00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4bc80093f0 tx=0x7f4bc8016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:36.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.753+0000 7f56f186f700 1 --2- 172.21.15.3:0/2079559096 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f56d0060580 0x7f56d0062a30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f56ec0bdb80 tx=0x7f56dc016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:36.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.753+0000 7f7814a68700 1 Processor -- start 2023-10-08T15:37:36.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.753+0000 7f7814a68700 1 -- start start 2023-10-08T15:37:36.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.753+0000 7f7814a68700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f78100b3530 0x7f7810142d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:36.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.753+0000 7f7814a68700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7810148c20 0x7f781014b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:36.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.753+0000 7f7814a68700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7810148ff0 0x7f781014b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:36.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.753+0000 7f7814a68700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7810142360 con 0x7f7810148ff0 2023-10-08T15:37:36.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.753+0000 7f7814a68700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78101428c0 con 0x7f7810148c20 2023-10-08T15:37:36.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.753+0000 7f7814a68700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f781015a030 con 0x7f78100b3530 2023-10-08T15:37:36.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.753+0000 7f780dd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7810148c20 0x7f781014b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:36.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.753+0000 7f780dd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7810148c20 0x7f781014b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.3:51712/0 (socket says 172.21.15.3:51712) 2023-10-08T15:37:36.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.753+0000 7f780dd9b700 1 -- 172.21.15.3:0/1551217765 learned_addr learned my addr 172.21.15.3:0/1551217765 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:36.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.753+0000 7f4bdc922700 1 -- 172.21.15.3:0/3202078418 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bbc0052b0 con 0x7f4bd80b2830 2023-10-08T15:37:36.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.753+0000 7f780e59c700 1 --2- 172.21.15.3:0/1551217765 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f78100b3530 0x7f7810142d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:36.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.753+0000 7f780ed9d700 1 --2- 172.21.15.3:0/1551217765 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7810148ff0 0x7f781014b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:36.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.753+0000 7f780dd9b700 1 -- 172.21.15.3:0/1551217765 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f78100b3530 msgr2=0x7f7810142d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:36.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.753+0000 7f780dd9b700 1 --2- 172.21.15.3:0/1551217765 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f78100b3530 0x7f7810142d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:36.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.753+0000 7f780dd9b700 1 -- 172.21.15.3:0/1551217765 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7810148ff0 msgr2=0x7f781014b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:36.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.753+0000 7f780dd9b700 1 --2- 172.21.15.3:0/1551217765 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7810148ff0 0x7f781014b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:36.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.753+0000 7f780dd9b700 1 -- 172.21.15.3:0/1551217765 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7808009ae0 con 0x7f7810148c20 2023-10-08T15:37:36.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.753+0000 7f780e59c700 1 --2- 172.21.15.3:0/1551217765 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f78100b3530 0x7f7810142d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:37:36.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.753+0000 7f780ed9d700 1 --2- 172.21.15.3:0/1551217765 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7810148ff0 0x7f781014b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:37:36.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.753+0000 7f780dd9b700 1 --2- 172.21.15.3:0/1551217765 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7810148c20 0x7f781014b0b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f780400ec80 tx=0x7f78040091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:36.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.753+0000 7f77fe7fc700 1 -- 172.21.15.3:0/1551217765 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780400c9d0 con 0x7f7810148c20 2023-10-08T15:37:36.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.753+0000 7f77fe7fc700 1 -- 172.21.15.3:0/1551217765 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f780400cb30 con 0x7f7810148c20 2023-10-08T15:37:36.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.753+0000 7f7814a68700 1 -- 172.21.15.3:0/1551217765 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7810143290 con 0x7f7810148c20 2023-10-08T15:37:36.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.753+0000 7f7814a68700 1 -- 172.21.15.3:0/1551217765 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7810140d60 con 0x7f7810148c20 2023-10-08T15:37:36.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.753+0000 7f77fe7fc700 1 -- 172.21.15.3:0/1551217765 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7804013470 con 0x7f7810148c20 2023-10-08T15:37:36.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.757+0000 7f56e27fc700 1 -- 172.21.15.3:0/2079559096 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f56e405c760 con 0x7f56ec06ca60 2023-10-08T15:37:36.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.757+0000 7f4bc67fc700 1 -- 172.21.15.3:0/3202078418 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4bd001a360 con 0x7f4bd80b2830 2023-10-08T15:37:36.779 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.757+0000 7ffba2ffd700 1 -- 172.21.15.3:0/928472513 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ffbac04eab0 con 0x7ffbb4068320 2023-10-08T15:37:36.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.757+0000 7f77fe7fc700 1 -- 172.21.15.3:0/1551217765 <== mon.1 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f7804013860 con 0x7f7810148c20 2023-10-08T15:37:36.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.757+0000 7f77fe7fc700 1 --2- 172.21.15.3:0/1551217765 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f77f00605d0 0x7f77f0062a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:36.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.757+0000 7f77fe7fc700 1 -- 172.21.15.3:0/1551217765 <== mon.1 v2:172.21.15.50:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f780407cba0 con 0x7f7810148c20 2023-10-08T15:37:36.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.757+0000 7f780e59c700 1 --2- 172.21.15.3:0/1551217765 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f77f00605d0 0x7f77f0062a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:36.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.761+0000 7f780e59c700 1 --2- 172.21.15.3:0/1551217765 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f77f00605d0 0x7f77f0062a80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7800001840 tx=0x7f7800009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:36.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.765+0000 7f7814a68700 1 -- 172.21.15.3:0/1551217765 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77f40052b0 con 0x7f7810148c20 2023-10-08T15:37:36.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.765+0000 7f56e27fc700 1 -- 172.21.15.3:0/2079559096 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f56e4059350 con 0x7f56ec06ca60 2023-10-08T15:37:36.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.773+0000 7f4bc67fc700 1 -- 172.21.15.3:0/3202078418 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4bd004cf40 con 0x7f4bd80b2830 2023-10-08T15:37:36.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.777+0000 7f77fe7fc700 1 -- 172.21.15.3:0/1551217765 <== mon.1 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f780404d0f0 con 0x7f7810148c20 2023-10-08T15:37:36.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.985+0000 7f5b087d3700 1 -- 172.21.15.3:0/337209134 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f5b0005ecf0 con 0x7f5b0014d100 2023-10-08T15:37:36.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.985+0000 7f5af67fc700 1 -- 172.21.15.3:0/337209134 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5af0015090 con 0x7f5b0014d100 2023-10-08T15:37:36.994 INFO:teuthology.orchestra.run.smithi003.stdout:60129542148 2023-10-08T15:37:36.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.993+0000 7f5ae3fff700 1 -- 172.21.15.3:0/337209134 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5ae4060570 msgr2=0x7f5ae4062a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:36.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.993+0000 7f5ae3fff700 1 --2- 172.21.15.3:0/337209134 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5ae4060570 0x7f5ae4062a20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5af800f570 tx=0x7f5af800b040 comp rx=0 tx=0).stop 2023-10-08T15:37:36.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.993+0000 7f5ae3fff700 1 -- 172.21.15.3:0/337209134 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5b0014d100 msgr2=0x7f5b0014e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:36.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.993+0000 7f5ae3fff700 1 --2- 172.21.15.3:0/337209134 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5b0014d100 0x7f5b0014e130 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5af0006fd0 tx=0x7f5af0017000 comp rx=0 tx=0).stop 2023-10-08T15:37:36.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.993+0000 7f5ae3fff700 1 -- 172.21.15.3:0/337209134 shutdown_connections 2023-10-08T15:37:36.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.993+0000 7f5ae3fff700 1 --2- 172.21.15.3:0/337209134 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5ae4060570 0x7f5ae4062a20 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:36.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.993+0000 7f5ae3fff700 1 --2- 172.21.15.3:0/337209134 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5b0014d100 0x7f5b0014e130 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:36.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.993+0000 7f5ae3fff700 1 --2- 172.21.15.3:0/337209134 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5b000b1e60 0x7f5b0016af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:36.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.993+0000 7f5ae3fff700 1 --2- 172.21.15.3:0/337209134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b000a2700 0x7f5b0009e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:36.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.993+0000 7f5ae3fff700 1 -- 172.21.15.3:0/337209134 >> 172.21.15.3:0/337209134 conn(0x7f5b0006a900 msgr2=0x7f5b00067ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:36.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.993+0000 7f5ae3fff700 1 -- 172.21.15.3:0/337209134 shutdown_connections 2023-10-08T15:37:37.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:36.993+0000 7f5ae3fff700 1 -- 172.21.15.3:0/337209134 wait complete. 2023-10-08T15:37:37.006 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.001+0000 7feedef57700 1 -- 172.21.15.3:0/3005454071 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7feed8064530 con 0x7feed814c800 2023-10-08T15:37:37.006 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.001+0000 7feed4ff9700 1 -- 172.21.15.3:0/3005454071 <== mon.2 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7feed00524f0 con 0x7feed814c800 2023-10-08T15:37:37.009 INFO:teuthology.orchestra.run.smithi003.stdout:60129542149 2023-10-08T15:37:37.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.005+0000 7feebe7fc700 1 -- 172.21.15.3:0/3005454071 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7feec40605d0 msgr2=0x7feec4062a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:37.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.005+0000 7feebe7fc700 1 --2- 172.21.15.3:0/3005454071 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7feec40605d0 0x7feec4062a80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7feec8001950 tx=0x7feec8009040 comp rx=0 tx=0).stop 2023-10-08T15:37:37.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.005+0000 7feebe7fc700 1 -- 172.21.15.3:0/3005454071 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feed814c800 msgr2=0x7feed8159180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:37.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.005+0000 7feebe7fc700 1 --2- 172.21.15.3:0/3005454071 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feed814c800 0x7feed8159180 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7feed000b6c0 tx=0x7feed0019000 comp rx=0 tx=0).stop 2023-10-08T15:37:37.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.005+0000 7feebe7fc700 1 -- 172.21.15.3:0/3005454071 shutdown_connections 2023-10-08T15:37:37.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.005+0000 7feebe7fc700 1 --2- 172.21.15.3:0/3005454071 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7feec40605d0 0x7feec4062a80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:37.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.005+0000 7feebe7fc700 1 --2- 172.21.15.3:0/3005454071 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feed814c800 0x7feed8159180 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:37.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.005+0000 7feebe7fc700 1 --2- 172.21.15.3:0/3005454071 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feed80b4070 0x7feed80bcd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:37.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.005+0000 7feebe7fc700 1 --2- 172.21.15.3:0/3005454071 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feed806ca60 0x7feed814b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:37.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.005+0000 7feebe7fc700 1 -- 172.21.15.3:0/3005454071 >> 172.21.15.3:0/3005454071 conn(0x7feed80be630 msgr2=0x7feed81465c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:37.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.005+0000 7feebe7fc700 1 -- 172.21.15.3:0/3005454071 shutdown_connections 2023-10-08T15:37:37.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.005+0000 7feebe7fc700 1 -- 172.21.15.3:0/3005454071 wait complete. 2023-10-08T15:37:37.012 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.7 2023-10-08T15:37:37.024 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.2 2023-10-08T15:37:37.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.029+0000 7f679b17c700 1 -- 172.21.15.3:0/1818961998 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f679406c3f0 con 0x7f679409fb30 2023-10-08T15:37:37.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.029+0000 7f678a7fc700 1 -- 172.21.15.3:0/1818961998 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6790017020 con 0x7f679409fb30 2023-10-08T15:37:37.036 INFO:teuthology.orchestra.run.smithi003.stdout:55834574853 2023-10-08T15:37:37.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.033+0000 7f679b17c700 1 -- 172.21.15.3:0/1818961998 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f6778060650 msgr2=0x7f6778062b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:37.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.033+0000 7f679b17c700 1 --2- 172.21.15.3:0/1818961998 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f6778060650 0x7f6778062b00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f67840098e0 tx=0x7f6784019000 comp rx=0 tx=0).stop 2023-10-08T15:37:37.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.033+0000 7f679b17c700 1 -- 172.21.15.3:0/1818961998 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f679409fb30 msgr2=0x7f679414d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:37.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.033+0000 7f679b17c700 1 --2- 172.21.15.3:0/1818961998 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f679409fb30 0x7f679414d790 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f679000c7f0 tx=0x7f6790007e00 comp rx=0 tx=0).stop 2023-10-08T15:37:37.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.033+0000 7f679b17c700 1 -- 172.21.15.3:0/1818961998 shutdown_connections 2023-10-08T15:37:37.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.033+0000 7f679b17c700 1 --2- 172.21.15.3:0/1818961998 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f6778060650 0x7f6778062b00 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:37.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.033+0000 7f679b17c700 1 --2- 172.21.15.3:0/1818961998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67940b9ec0 0x7f6794147a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:37.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.033+0000 7f679b17c700 1 --2- 172.21.15.3:0/1818961998 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f67940bc980 0x7f6794147520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:37.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.033+0000 7f679b17c700 1 --2- 172.21.15.3:0/1818961998 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f679409fb30 0x7f679414d790 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:37.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.033+0000 7f679b17c700 1 -- 172.21.15.3:0/1818961998 >> 172.21.15.3:0/1818961998 conn(0x7f67940bd9b0 msgr2=0x7f67940bdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:37.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.033+0000 7f679b17c700 1 -- 172.21.15.3:0/1818961998 shutdown_connections 2023-10-08T15:37:37.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.033+0000 7f679b17c700 1 -- 172.21.15.3:0/1818961998 wait complete. 2023-10-08T15:37:37.047 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.041+0000 7fe03f59e700 1 -- 172.21.15.3:0/147906729 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe04006e4b0 con 0x7fe0400a1430 2023-10-08T15:37:37.047 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.041+0000 7fe02e7fc700 1 -- 172.21.15.3:0/147906729 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe03004fe30 con 0x7fe0400a1430 2023-10-08T15:37:37.048 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2023-10-08T15:37:37.048 INFO:teuthology.orchestra.run.smithi003.stdout:60129542150 2023-10-08T15:37:37.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.045+0000 7fe03f59e700 1 -- 172.21.15.3:0/147906729 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe0280607b0 msgr2=0x7fe028062c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:37.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.045+0000 7fe03f59e700 1 --2- 172.21.15.3:0/147906729 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe0280607b0 0x7fe028062c60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe04006d7d0 tx=0x7fe034008040 comp rx=0 tx=0).stop 2023-10-08T15:37:37.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.045+0000 7fe03f59e700 1 -- 172.21.15.3:0/147906729 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe0400a1430 msgr2=0x7fe04014dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:37.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.045+0000 7fe03f59e700 1 --2- 172.21.15.3:0/147906729 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe0400a1430 0x7fe04014dc10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe03000c560 tx=0x7fe030000fe0 comp rx=0 tx=0).stop 2023-10-08T15:37:37.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.045+0000 7fe03f59e700 1 -- 172.21.15.3:0/147906729 shutdown_connections 2023-10-08T15:37:37.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.045+0000 7fe03f59e700 1 --2- 172.21.15.3:0/147906729 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe0280607b0 0x7fe028062c60 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:37.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.045+0000 7fe03f59e700 1 --2- 172.21.15.3:0/147906729 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe04014b4b0 0x7fe040162130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:37.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.045+0000 7fe03f59e700 1 --2- 172.21.15.3:0/147906729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0400a1d80 0x7fe04006e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:37.052 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.045+0000 7fe03f59e700 1 --2- 172.21.15.3:0/147906729 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe0400a1430 0x7fe04014dc10 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:37.052 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.045+0000 7fe03f59e700 1 -- 172.21.15.3:0/147906729 >> 172.21.15.3:0/147906729 conn(0x7fe0400bd9b0 msgr2=0x7fe0400ba3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:37.052 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.045+0000 7fe03f59e700 1 -- 172.21.15.3:0/147906729 shutdown_connections 2023-10-08T15:37:37.052 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.045+0000 7fe03f59e700 1 -- 172.21.15.3:0/147906729 wait complete. 2023-10-08T15:37:37.052 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.045+0000 7f4bdc922700 1 -- 172.21.15.3:0/3202078418 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4bbc005560 con 0x7f4bd80b2830 2023-10-08T15:37:37.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.045+0000 7f4bc67fc700 1 -- 172.21.15.3:0/3202078418 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4bd0050560 con 0x7f4bd80b2830 2023-10-08T15:37:37.053 INFO:teuthology.orchestra.run.smithi003.stdout:60129542150 2023-10-08T15:37:37.058 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.053+0000 7f4bdc922700 1 -- 172.21.15.3:0/3202078418 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4bb8060550 msgr2=0x7f4bb8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:37.058 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.053+0000 7f4bdc922700 1 --2- 172.21.15.3:0/3202078418 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4bb8060550 0x7f4bb8062a00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4bc80093f0 tx=0x7f4bc8016000 comp rx=0 tx=0).stop 2023-10-08T15:37:37.058 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.053+0000 7f4bdc922700 1 -- 172.21.15.3:0/3202078418 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4bd80b2830 msgr2=0x7f4bd806c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:37.058 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.053+0000 7f4bdc922700 1 --2- 172.21.15.3:0/3202078418 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4bd80b2830 0x7f4bd806c990 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4bd000cd80 tx=0x7f4bd0001b40 comp rx=0 tx=0).stop 2023-10-08T15:37:37.058 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.053+0000 7f4bdc922700 1 -- 172.21.15.3:0/3202078418 shutdown_connections 2023-10-08T15:37:37.058 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.053+0000 7f4bdc922700 1 --2- 172.21.15.3:0/3202078418 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4bb8060550 0x7f4bb8062a00 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:37.058 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.053+0000 7f4bdc922700 1 --2- 172.21.15.3:0/3202078418 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4bd80b3530 0x7f4bd806ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:37.059 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.053+0000 7f4bdc922700 1 --2- 172.21.15.3:0/3202078418 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4bd80b2830 0x7f4bd806c990 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:37.059 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.053+0000 7f4bdc922700 1 --2- 172.21.15.3:0/3202078418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bd806e020 0x7f4bd81439e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:37.059 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.053+0000 7f4bdc922700 1 -- 172.21.15.3:0/3202078418 >> 172.21.15.3:0/3202078418 conn(0x7f4bd80be630 msgr2=0x7f4bd80bd200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:37.059 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.053+0000 7f4bdc922700 1 -- 172.21.15.3:0/3202078418 shutdown_connections 2023-10-08T15:37:37.059 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.053+0000 7f4bdc922700 1 -- 172.21.15.3:0/3202078418 wait complete. 2023-10-08T15:37:37.065 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.1 2023-10-08T15:37:37.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.061+0000 7ffbb9648700 1 -- 172.21.15.3:0/928472513 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7ffb90005830 con 0x7ffbb4068320 2023-10-08T15:37:37.069 INFO:teuthology.orchestra.run.smithi003.stdout:60129542149 2023-10-08T15:37:37.070 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.0 2023-10-08T15:37:37.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.061+0000 7ffba2ffd700 1 -- 172.21.15.3:0/928472513 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ffbac0520d0 con 0x7ffbb4068320 2023-10-08T15:37:37.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.065+0000 7ffbb9648700 1 -- 172.21.15.3:0/928472513 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ffb9c060780 msgr2=0x7ffb9c062c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:37.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.065+0000 7ffbb9648700 1 --2- 172.21.15.3:0/928472513 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ffb9c060780 0x7ffb9c062c30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ffbb40bd6f0 tx=0x7ffba8008040 comp rx=0 tx=0).stop 2023-10-08T15:37:37.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.065+0000 7ffbb9648700 1 -- 172.21.15.3:0/928472513 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffbb4068320 msgr2=0x7ffbb41609a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:37.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.065+0000 7ffbb9648700 1 --2- 172.21.15.3:0/928472513 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffbb4068320 0x7ffbb41609a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ffbac007260 tx=0x7ffbac01a000 comp rx=0 tx=0).stop 2023-10-08T15:37:37.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.065+0000 7ffbb9648700 1 -- 172.21.15.3:0/928472513 shutdown_connections 2023-10-08T15:37:37.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.065+0000 7ffbb9648700 1 --2- 172.21.15.3:0/928472513 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ffb9c060780 0x7ffb9c062c30 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:37.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.065+0000 7ffbb9648700 1 --2- 172.21.15.3:0/928472513 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ffbb40b2740 0x7ffbb4163730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:37.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.065+0000 7ffbb9648700 1 --2- 172.21.15.3:0/928472513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffbb406d430 0x7ffbb41631f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:37.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.065+0000 7ffbb9648700 1 --2- 172.21.15.3:0/928472513 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffbb4068320 0x7ffbb41609a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:37.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.065+0000 7ffbb9648700 1 -- 172.21.15.3:0/928472513 >> 172.21.15.3:0/928472513 conn(0x7ffbb40be630 msgr2=0x7ffbb4146870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:37.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.065+0000 7ffbb9648700 1 -- 172.21.15.3:0/928472513 shutdown_connections 2023-10-08T15:37:37.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.065+0000 7ffbb9648700 1 -- 172.21.15.3:0/928472513 wait complete. 2023-10-08T15:37:37.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.069+0000 7f56f42d4700 1 -- 172.21.15.3:0/2079559096 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f56ec0a2be0 con 0x7f56ec06ca60 2023-10-08T15:37:37.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.069+0000 7f56e27fc700 1 -- 172.21.15.3:0/2079559096 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f56e402a020 con 0x7f56ec06ca60 2023-10-08T15:37:37.075 INFO:teuthology.orchestra.run.smithi003.stdout:55834574853 2023-10-08T15:37:37.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.069+0000 7f56f42d4700 1 -- 172.21.15.3:0/2079559096 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f56d0060580 msgr2=0x7f56d0062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:37.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.069+0000 7f56f42d4700 1 --2- 172.21.15.3:0/2079559096 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f56d0060580 0x7f56d0062a30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f56ec0bdb80 tx=0x7f56dc016000 comp rx=0 tx=0).stop 2023-10-08T15:37:37.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.069+0000 7f56f42d4700 1 -- 172.21.15.3:0/2079559096 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f56ec06ca60 msgr2=0x7f56ec15afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:37.078 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.069+0000 7f56f42d4700 1 --2- 172.21.15.3:0/2079559096 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f56ec06ca60 0x7f56ec15afb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f56e400e460 tx=0x7f56e4010960 comp rx=0 tx=0).stop 2023-10-08T15:37:37.078 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.069+0000 7f56f42d4700 1 -- 172.21.15.3:0/2079559096 shutdown_connections 2023-10-08T15:37:37.078 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.069+0000 7f56f42d4700 1 --2- 172.21.15.3:0/2079559096 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f56d0060580 0x7f56d0062a30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:37.078 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.069+0000 7f56f42d4700 1 --2- 172.21.15.3:0/2079559096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56ec148fa0 0x7f56ec1473e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:37.078 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.069+0000 7f56f42d4700 1 --2- 172.21.15.3:0/2079559096 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f56ec0b4070 0x7f56ec0ba860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:37.078 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.069+0000 7f56f42d4700 1 --2- 172.21.15.3:0/2079559096 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f56ec06ca60 0x7f56ec15afb0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:37.078 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.069+0000 7f56f42d4700 1 -- 172.21.15.3:0/2079559096 >> 172.21.15.3:0/2079559096 conn(0x7f56ec0be630 msgr2=0x7f56ec0b2940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:37.078 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.073+0000 7f56f42d4700 1 -- 172.21.15.3:0/2079559096 shutdown_connections 2023-10-08T15:37:37.078 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.073+0000 7f56f42d4700 1 -- 172.21.15.3:0/2079559096 wait complete. 2023-10-08T15:37:37.086 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.6 2023-10-08T15:37:37.087 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2023-10-08T15:37:37.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.081+0000 7f7814a68700 1 -- 172.21.15.3:0/1551217765 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f77f4005560 con 0x7f7810148c20 2023-10-08T15:37:37.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.081+0000 7f77fe7fc700 1 -- 172.21.15.3:0/1551217765 <== mon.1 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7804021020 con 0x7f7810148c20 2023-10-08T15:37:37.089 INFO:teuthology.orchestra.run.smithi003.stdout:60129542150 2023-10-08T15:37:37.091 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.085+0000 7f7814a68700 1 -- 172.21.15.3:0/1551217765 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f77f00605d0 msgr2=0x7f77f0062a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:37.091 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.085+0000 7f7814a68700 1 --2- 172.21.15.3:0/1551217765 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f77f00605d0 0x7f77f0062a80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7800001840 tx=0x7f7800009040 comp rx=0 tx=0).stop 2023-10-08T15:37:37.091 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.085+0000 7f7814a68700 1 -- 172.21.15.3:0/1551217765 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7810148c20 msgr2=0x7f781014b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:37.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.085+0000 7f7814a68700 1 --2- 172.21.15.3:0/1551217765 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7810148c20 0x7f781014b0b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f780400ec80 tx=0x7f78040091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:37.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.085+0000 7f7814a68700 1 -- 172.21.15.3:0/1551217765 shutdown_connections 2023-10-08T15:37:37.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.085+0000 7f7814a68700 1 --2- 172.21.15.3:0/1551217765 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f77f00605d0 0x7f77f0062a80 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:37.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.085+0000 7f7814a68700 1 --2- 172.21.15.3:0/1551217765 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7810148ff0 0x7f781014b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:37.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.085+0000 7f7814a68700 1 --2- 172.21.15.3:0/1551217765 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7810148c20 0x7f781014b0b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:37.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.085+0000 7f7814a68700 1 --2- 172.21.15.3:0/1551217765 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f78100b3530 0x7f7810142d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:37.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.085+0000 7f7814a68700 1 -- 172.21.15.3:0/1551217765 >> 172.21.15.3:0/1551217765 conn(0x7f78100bdda0 msgr2=0x7f78100bc4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:37.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.085+0000 7f7814a68700 1 -- 172.21.15.3:0/1551217765 shutdown_connections 2023-10-08T15:37:37.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:37.085+0000 7f7814a68700 1 -- 172.21.15.3:0/1551217765 wait complete. 2023-10-08T15:37:37.101 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.3 2023-10-08T15:37:38.013 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-08T15:37:38.024 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-08T15:37:38.049 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-08T15:37:38.065 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-08T15:37:38.071 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-08T15:37:38.087 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-08T15:37:38.088 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-08T15:37:38.102 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-08T15:37:38.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.149+0000 7f01ac94b700 1 Processor -- start 2023-10-08T15:37:38.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.149+0000 7f01ac94b700 1 -- start start 2023-10-08T15:37:38.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.149+0000 7f01ac94b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f01a80670e0 0x7f01a8150610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:38.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.149+0000 7f01ac94b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f01a8150b50 0x7f01a814ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:38.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.149+0000 7f01ac94b700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01a80ba280 con 0x7f01a8067ad0 2023-10-08T15:37:38.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.149+0000 7f01ac94b700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01a80685b0 con 0x7f01a80670e0 2023-10-08T15:37:38.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.149+0000 7f01ac94b700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a80682d0 con 0x7f01a8150b50 2023-10-08T15:37:38.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.149+0000 7f01a6d9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f01a8150b50 0x7f01a814ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:38.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.149+0000 7f01a6d9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f01a8150b50 0x7f01a814ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.3:38820/0 (socket says 172.21.15.3:38820) 2023-10-08T15:37:38.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.149+0000 7f01a6d9d700 1 -- 172.21.15.3:0/4184383579 learned_addr learned my addr 172.21.15.3:0/4184383579 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:38.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.149+0000 7f01a5d9b700 1 --2- 172.21.15.3:0/4184383579 >> v2:172.21.15.50:3300/0 conn(0x7f01a80670e0 0x7f01a8150610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:38.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.149+0000 7f01a6d9d700 1 -- 172.21.15.3:0/4184383579 >> v2:172.21.15.50:3300/0 conn(0x7f01a80670e0 msgr2=0x7f01a8150610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:38.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.149+0000 7f01a6d9d700 1 --2- 172.21.15.3:0/4184383579 >> v2:172.21.15.50:3300/0 conn(0x7f01a80670e0 0x7f01a8150610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.149+0000 7f01a6d9d700 1 -- 172.21.15.3:0/4184383579 >> v1:172.21.15.50:6789/0 conn(0x7f01a8067ad0 legacy=0x7f01a806c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:38.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.149+0000 7f01a6d9d700 1 -- 172.21.15.3:0/4184383579 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a8068ce0 con 0x7f01a8150b50 2023-10-08T15:37:38.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.149+0000 7f01a6d9d700 1 --2- 172.21.15.3:0/4184383579 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f01a8150b50 0x7f01a814ef50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f01a0009f20 tx=0x7f01a0009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=665edf04a38d760d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:38.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.149+0000 7f01a559a700 1 -- 172.21.15.3:0/4184383579 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a000e070 con 0x7f01a8150b50 2023-10-08T15:37:38.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.149+0000 7f01a559a700 1 -- 172.21.15.3:0/4184383579 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01a000b9d0 con 0x7f01a8150b50 2023-10-08T15:37:38.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.153+0000 7f01ac94b700 1 -- 172.21.15.3:0/4184383579 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f01a8150b50 msgr2=0x7f01a814ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:38.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.153+0000 7f01ac94b700 1 --2- 172.21.15.3:0/4184383579 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f01a8150b50 0x7f01a814ef50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f01a0009f20 tx=0x7f01a0009840 comp rx=0 tx=0).stop 2023-10-08T15:37:38.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.153+0000 7f01ac94b700 1 -- 172.21.15.3:0/4184383579 shutdown_connections 2023-10-08T15:37:38.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.153+0000 7f01ac94b700 1 --2- 172.21.15.3:0/4184383579 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f01a8150b50 0x7f01a814ef50 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.153+0000 7f01ac94b700 1 --2- 172.21.15.3:0/4184383579 >> v2:172.21.15.50:3300/0 conn(0x7f01a80670e0 0x7f01a8150610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.153+0000 7f01ac94b700 1 -- 172.21.15.3:0/4184383579 >> 172.21.15.3:0/4184383579 conn(0x7f01a80bdda0 msgr2=0x7f01a80be170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:38.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.153+0000 7f01ac94b700 1 -- 172.21.15.3:0/4184383579 shutdown_connections 2023-10-08T15:37:38.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.153+0000 7f01ac94b700 1 -- 172.21.15.3:0/4184383579 wait complete. 2023-10-08T15:37:38.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.153+0000 7f01ac94b700 1 Processor -- start 2023-10-08T15:37:38.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.153+0000 7f01ac94b700 1 -- start start 2023-10-08T15:37:38.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.157+0000 7f01ac94b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f01a80670e0 0x7f01a815a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:38.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.157+0000 7f01ac94b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f01a8067ad0 0x7f01a8157070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:38.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.157+0000 7f01ac94b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01a8150b50 0x7f01a814e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:38.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.157+0000 7f01ac94b700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a81542b0 con 0x7f01a80670e0 2023-10-08T15:37:38.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.157+0000 7f01ac94b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a814ba30 con 0x7f01a8150b50 2023-10-08T15:37:38.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.157+0000 7f01ac94b700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a81575b0 con 0x7f01a8067ad0 2023-10-08T15:37:38.163 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.157+0000 7f01a5d9b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f01a8067ad0 0x7f01a8157070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:38.163 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.157+0000 7f01a6d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01a8150b50 0x7f01a814e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:38.163 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.157+0000 7f01a5d9b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f01a8067ad0 0x7f01a8157070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.3:38834/0 (socket says 172.21.15.3:38834) 2023-10-08T15:37:38.163 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.157+0000 7f01a5d9b700 1 -- 172.21.15.3:0/806337132 learned_addr learned my addr 172.21.15.3:0/806337132 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:38.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.157+0000 7f01a659c700 1 --2- 172.21.15.3:0/806337132 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f01a80670e0 0x7f01a815a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:38.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.157+0000 7f01a6d9d700 1 -- 172.21.15.3:0/806337132 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f01a8067ad0 msgr2=0x7f01a8157070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:38.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.157+0000 7f01a6d9d700 1 --2- 172.21.15.3:0/806337132 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f01a8067ad0 0x7f01a8157070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.157+0000 7f01a6d9d700 1 -- 172.21.15.3:0/806337132 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f01a80670e0 msgr2=0x7f01a815a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:38.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.157+0000 7f01a6d9d700 1 --2- 172.21.15.3:0/806337132 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f01a80670e0 0x7f01a815a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.157+0000 7f01a6d9d700 1 -- 172.21.15.3:0/806337132 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a0009ae0 con 0x7f01a8150b50 2023-10-08T15:37:38.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.157+0000 7f01a6d9d700 1 --2- 172.21.15.3:0/806337132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01a8150b50 0x7f01a814e300 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f01a0015000 tx=0x7f01a0018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:38.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.157+0000 7f01967fc700 1 -- 172.21.15.3:0/806337132 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a0007c50 con 0x7f01a8150b50 2023-10-08T15:37:38.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.157+0000 7f01ac94b700 1 -- 172.21.15.3:0/806337132 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01a8156680 con 0x7f01a8150b50 2023-10-08T15:37:38.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.157+0000 7f01ac94b700 1 -- 172.21.15.3:0/806337132 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01a814e840 con 0x7f01a8150b50 2023-10-08T15:37:38.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.157+0000 7f01967fc700 1 -- 172.21.15.3:0/806337132 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01a0007db0 con 0x7f01a8150b50 2023-10-08T15:37:38.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.157+0000 7f01967fc700 1 -- 172.21.15.3:0/806337132 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a00266b0 con 0x7f01a8150b50 2023-10-08T15:37:38.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.157+0000 7f01ac94b700 1 -- 172.21.15.3:0/806337132 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f018c0052b0 con 0x7f01a8150b50 2023-10-08T15:37:38.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.161+0000 7f01967fc700 1 -- 172.21.15.3:0/806337132 <== mon.1 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f01a0026ae0 con 0x7f01a8150b50 2023-10-08T15:37:38.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.161+0000 7f01967fc700 1 --2- 172.21.15.3:0/806337132 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f0190060710 0x7f0190062bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:38.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.161+0000 7f01967fc700 1 -- 172.21.15.3:0/806337132 <== mon.1 v2:172.21.15.50:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f01a007e8e0 con 0x7f01a8150b50 2023-10-08T15:37:38.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.161+0000 7f01a659c700 1 --2- 172.21.15.3:0/806337132 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f0190060710 0x7f0190062bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:38.168 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.161+0000 7f01a659c700 1 --2- 172.21.15.3:0/806337132 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f0190060710 0x7f0190062bc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f019c003a80 tx=0x7f019c007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:38.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.169+0000 7f432983f700 1 Processor -- start 2023-10-08T15:37:38.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.169+0000 7f432983f700 1 -- start start 2023-10-08T15:37:38.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.173+0000 7f01967fc700 1 -- 172.21.15.3:0/806337132 <== mon.1 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f01a004eeb0 con 0x7f01a8150b50 2023-10-08T15:37:38.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.173+0000 7f432983f700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f432414ba20 0x7f432414aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:38.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.173+0000 7f432983f700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f4324068a80 0x7f43240703a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:38.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.173+0000 7f43237fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f4324068a80 0x7f43240703a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:38.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.173+0000 7f43237fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f4324068a80 0x7f43240703a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43958/0 (socket says 172.21.15.3:43958) 2023-10-08T15:37:38.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.173+0000 7f43237fe700 1 -- 172.21.15.3:0/1062411419 learned_addr learned my addr 172.21.15.3:0/1062411419 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:38.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.173+0000 7f432983f700 1 -- 172.21.15.3:0/1062411419 --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4324069930 con 0x7f4324067310 2023-10-08T15:37:38.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.173+0000 7f432983f700 1 -- 172.21.15.3:0/1062411419 --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f432414bf30 con 0x7f4324068a80 2023-10-08T15:37:38.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.173+0000 7f432983f700 1 -- 172.21.15.3:0/1062411419 --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43240695c0 con 0x7f432414ba20 2023-10-08T15:37:38.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.173+0000 7f43237fe700 1 -- 172.21.15.3:0/1062411419 >> v2:172.21.15.50:3300/0 conn(0x7f432414ba20 msgr2=0x7f432414aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:38.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.173+0000 7f43237fe700 1 --2- 172.21.15.3:0/1062411419 >> v2:172.21.15.50:3300/0 conn(0x7f432414ba20 0x7f432414aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.173+0000 7f43237fe700 1 -- 172.21.15.3:0/1062411419 >> v1:172.21.15.50:6789/0 conn(0x7f4324067310 legacy=0x7f432414a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:38.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.173+0000 7f43237fe700 1 -- 172.21.15.3:0/1062411419 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f432406e910 con 0x7f4324068a80 2023-10-08T15:37:38.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.173+0000 7f43237fe700 1 --2- 172.21.15.3:0/1062411419 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4324068a80 0x7f43240703a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f432406c6a0 tx=0x7f431c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d3a904e8ac79a7a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:38.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.173+0000 7f4321ffb700 1 -- 172.21.15.3:0/1062411419 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431c00e070 con 0x7f4324068a80 2023-10-08T15:37:38.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.173+0000 7f4321ffb700 1 -- 172.21.15.3:0/1062411419 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f431c00ba50 con 0x7f4324068a80 2023-10-08T15:37:38.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.173+0000 7f4321ffb700 1 -- 172.21.15.3:0/1062411419 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431c0092e0 con 0x7f4324068a80 2023-10-08T15:37:38.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.173+0000 7f432983f700 1 -- 172.21.15.3:0/1062411419 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4324068a80 msgr2=0x7f43240703a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:38.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.173+0000 7f432983f700 1 --2- 172.21.15.3:0/1062411419 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4324068a80 0x7f43240703a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f432406c6a0 tx=0x7f431c009840 comp rx=0 tx=0).stop 2023-10-08T15:37:38.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.177+0000 7f432983f700 1 -- 172.21.15.3:0/1062411419 shutdown_connections 2023-10-08T15:37:38.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.177+0000 7f432983f700 1 --2- 172.21.15.3:0/1062411419 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4324068a80 0x7f43240703a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.177+0000 7f432983f700 1 --2- 172.21.15.3:0/1062411419 >> v2:172.21.15.50:3300/0 conn(0x7f432414ba20 0x7f432414aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.177+0000 7f432983f700 1 -- 172.21.15.3:0/1062411419 >> 172.21.15.3:0/1062411419 conn(0x7f43240be3f0 msgr2=0x7f43240be7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:38.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.177+0000 7f432983f700 1 -- 172.21.15.3:0/1062411419 shutdown_connections 2023-10-08T15:37:38.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.177+0000 7fd4b3067700 1 Processor -- start 2023-10-08T15:37:38.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.177+0000 7fd4b3067700 1 -- start start 2023-10-08T15:37:38.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.177+0000 7f432983f700 1 -- 172.21.15.3:0/1062411419 wait complete. 2023-10-08T15:37:38.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.181+0000 7fd4b0e03700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fd4ac068320 0x7fd4ac06cef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:59578/0 (socket says 172.21.15.3:59578) 2023-10-08T15:37:38.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.181+0000 7fd4b0e03700 1 -- 172.21.15.3:0/4147958482 learned_addr learned my addr 172.21.15.3:0/4147958482 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:38.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.181+0000 7f432983f700 1 Processor -- start 2023-10-08T15:37:38.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.181+0000 7fd4b3067700 1 --2- 172.21.15.3:0/4147958482 >> v2:172.21.15.3:3300/0 conn(0x7fd4ac0b2740 0x7fd4ac146aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:38.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.181+0000 7f432983f700 1 -- start start 2023-10-08T15:37:38.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.181+0000 7fd4abfff700 1 --2- 172.21.15.3:0/4147958482 >> v2:172.21.15.3:3300/0 conn(0x7fd4ac0b2740 0x7fd4ac146aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:38.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.181+0000 7fd4b3067700 1 -- 172.21.15.3:0/4147958482 --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4ac0b1cd0 con 0x7fd4ac068320 2023-10-08T15:37:38.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.181+0000 7fd4b3067700 1 -- 172.21.15.3:0/4147958482 --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4ac0b1f40 con 0x7fd4ac146fe0 2023-10-08T15:37:38.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.181+0000 7f432983f700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4324067310 0x7f4324142370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:38.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.181+0000 7fd4b3067700 1 -- 172.21.15.3:0/4147958482 --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4ac0b2220 con 0x7fd4ac0b2740 2023-10-08T15:37:38.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.181+0000 7f432983f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4324068a80 0x7f432413a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:38.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.181+0000 7f432983f700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f432413c140 0x7f432413a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:38.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.181+0000 7f4322ffd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4324067310 0x7f4324142370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:38.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.181+0000 7f4322ffd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4324067310 0x7f4324142370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.3:38844/0 (socket says 172.21.15.3:38844) 2023-10-08T15:37:38.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.181+0000 7f43237fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f432413c140 0x7f432413a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:38.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.181+0000 7f43237fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f432413c140 0x7f432413a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43970/0 (socket says 172.21.15.3:43970) 2023-10-08T15:37:38.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.181+0000 7f4322ffd700 1 -- 172.21.15.3:0/2149897905 learned_addr learned my addr 172.21.15.3:0/2149897905 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:38.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.181+0000 7f432983f700 1 -- 172.21.15.3:0/2149897905 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4324147720 con 0x7f432413c140 2023-10-08T15:37:38.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.181+0000 7f43227fc700 1 --2- 172.21.15.3:0/2149897905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4324068a80 0x7f432413a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:38.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.181+0000 7f432983f700 1 -- 172.21.15.3:0/2149897905 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43241433d0 con 0x7f4324068a80 2023-10-08T15:37:38.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.181+0000 7fd4abfff700 1 -- 172.21.15.3:0/4147958482 >> v1:172.21.15.50:6789/0 conn(0x7fd4ac146fe0 legacy=0x7fd4ac14ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:38.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.185+0000 7f432983f700 1 -- 172.21.15.3:0/2149897905 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4324143080 con 0x7f4324067310 2023-10-08T15:37:38.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.185+0000 7fd4abfff700 1 -- 172.21.15.3:0/4147958482 >> v1:172.21.15.3:6789/0 conn(0x7fd4ac068320 legacy=0x7fd4ac06cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:38.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.185+0000 7f43237fe700 1 -- 172.21.15.3:0/2149897905 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4324067310 msgr2=0x7f4324142370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:38.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.185+0000 7f43237fe700 1 --2- 172.21.15.3:0/2149897905 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4324067310 0x7f4324142370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.185+0000 7f43237fe700 1 -- 172.21.15.3:0/2149897905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4324068a80 msgr2=0x7f432413a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:38.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.185+0000 7f43237fe700 1 --2- 172.21.15.3:0/2149897905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4324068a80 0x7f432413a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.185+0000 7f43237fe700 1 -- 172.21.15.3:0/2149897905 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f431c009ae0 con 0x7f432413c140 2023-10-08T15:37:38.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.185+0000 7f43237fe700 1 --2- 172.21.15.3:0/2149897905 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f432413c140 0x7f432413a6c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f431c015000 tx=0x7f431c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:38.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.185+0000 7fd4abfff700 1 -- 172.21.15.3:0/4147958482 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4ac06d600 con 0x7fd4ac0b2740 2023-10-08T15:37:38.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.185+0000 7fd4abfff700 1 --2- 172.21.15.3:0/4147958482 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd4ac0b2740 0x7fd4ac146aa0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd4a0009b40 tx=0x7fd4a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=930cb910846352a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:38.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.185+0000 7f430affd700 1 -- 172.21.15.3:0/2149897905 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431c0094e0 con 0x7f432413c140 2023-10-08T15:37:38.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.185+0000 7f430affd700 1 -- 172.21.15.3:0/2149897905 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f431c009300 con 0x7f432413c140 2023-10-08T15:37:38.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.185+0000 7f432983f700 1 -- 172.21.15.3:0/2149897905 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f432413be20 con 0x7f432413c140 2023-10-08T15:37:38.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.185+0000 7f432983f700 1 -- 172.21.15.3:0/2149897905 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43241428b0 con 0x7f432413c140 2023-10-08T15:37:38.194 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.185+0000 7fd4ab7fe700 1 -- 172.21.15.3:0/4147958482 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a000b680 con 0x7fd4ac0b2740 2023-10-08T15:37:38.194 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.185+0000 7fd4ab7fe700 1 -- 172.21.15.3:0/4147958482 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4a000b7e0 con 0x7fd4ac0b2740 2023-10-08T15:37:38.194 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.185+0000 7fd4ab7fe700 1 -- 172.21.15.3:0/4147958482 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a000bb80 con 0x7fd4ac0b2740 2023-10-08T15:37:38.194 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.185+0000 7fd4b3067700 1 -- 172.21.15.3:0/4147958482 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd4ac0b2740 msgr2=0x7fd4ac146aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:38.194 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.185+0000 7fd4b3067700 1 --2- 172.21.15.3:0/4147958482 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd4ac0b2740 0x7fd4ac146aa0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd4a0009b40 tx=0x7fd4a00091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.189+0000 7f430affd700 1 -- 172.21.15.3:0/2149897905 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431c026460 con 0x7f432413c140 2023-10-08T15:37:38.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.189+0000 7f430affd700 1 -- 172.21.15.3:0/2149897905 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f431c003040 con 0x7f432413c140 2023-10-08T15:37:38.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.189+0000 7fd4b3067700 1 -- 172.21.15.3:0/4147958482 shutdown_connections 2023-10-08T15:37:38.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.189+0000 7fd4b3067700 1 --2- 172.21.15.3:0/4147958482 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd4ac0b2740 0x7fd4ac146aa0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.189+0000 7fd4b3067700 1 -- 172.21.15.3:0/4147958482 >> 172.21.15.3:0/4147958482 conn(0x7fd4ac0be630 msgr2=0x7fd4ac0ba6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:38.196 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.189+0000 7f430affd700 1 --2- 172.21.15.3:0/2149897905 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f430c060780 0x7f430c062c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:38.196 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.189+0000 7f430affd700 1 -- 172.21.15.3:0/2149897905 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f431c07e7f0 con 0x7f432413c140 2023-10-08T15:37:38.196 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.189+0000 7f4322ffd700 1 --2- 172.21.15.3:0/2149897905 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f430c060780 0x7f430c062c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:38.196 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.189+0000 7f4322ffd700 1 --2- 172.21.15.3:0/2149897905 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f430c060780 0x7f430c062c30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4318007fd0 tx=0x7f4318000bc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:38.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.193+0000 7fd4b3067700 1 -- 172.21.15.3:0/4147958482 shutdown_connections 2023-10-08T15:37:38.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.193+0000 7fd4b3067700 1 -- 172.21.15.3:0/4147958482 wait complete. 2023-10-08T15:37:38.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.193+0000 7fd4b3067700 1 Processor -- start 2023-10-08T15:37:38.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.193+0000 7fd4b3067700 1 -- start start 2023-10-08T15:37:38.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.193+0000 7fd4b3067700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd4ac068320 0x7fd4ac13ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:38.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.193+0000 7fd4b3067700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd4ac0b2740 0x7fd4ac1425d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:38.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.193+0000 7fd4b3067700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4ac146fe0 0x7fd4ac15d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:38.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.193+0000 7fd4b3067700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ac13f270 con 0x7fd4ac068320 2023-10-08T15:37:38.201 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.193+0000 7fd4b3067700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ac146510 con 0x7fd4ac146fe0 2023-10-08T15:37:38.201 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.193+0000 7fd4b3067700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ac146230 con 0x7fd4ac0b2740 2023-10-08T15:37:38.201 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.193+0000 7f432983f700 1 -- 172.21.15.3:0/2149897905 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43040052b0 con 0x7f432413c140 2023-10-08T15:37:38.202 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.193+0000 7fd4b1604700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4ac146fe0 0x7fd4ac15d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:38.202 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.193+0000 7fd4b0e03700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd4ac068320 0x7fd4ac13ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:38.202 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.193+0000 7fd4b1604700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4ac146fe0 0x7fd4ac15d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.3:51758/0 (socket says 172.21.15.3:51758) 2023-10-08T15:37:38.202 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.193+0000 7fd4b1604700 1 -- 172.21.15.3:0/2621668750 learned_addr learned my addr 172.21.15.3:0/2621668750 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:38.202 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.193+0000 7fd4abfff700 1 --2- 172.21.15.3:0/2621668750 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd4ac0b2740 0x7fd4ac1425d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:38.202 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.197+0000 7fd4b1604700 1 -- 172.21.15.3:0/2621668750 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd4ac0b2740 msgr2=0x7fd4ac1425d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:38.202 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.197+0000 7fd4b1604700 1 --2- 172.21.15.3:0/2621668750 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd4ac0b2740 0x7fd4ac1425d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.197+0000 7fd4b1604700 1 -- 172.21.15.3:0/2621668750 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd4ac068320 msgr2=0x7fd4ac13ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:38.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.197+0000 7fd4b1604700 1 --2- 172.21.15.3:0/2621668750 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd4ac068320 0x7fd4ac13ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.197+0000 7fd4b1604700 1 -- 172.21.15.3:0/2621668750 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a0009420 con 0x7fd4ac146fe0 2023-10-08T15:37:38.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.197+0000 7fd4b1604700 1 --2- 172.21.15.3:0/2621668750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4ac146fe0 0x7fd4ac15d3a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd4a400c8e0 tx=0x7fd4a40016d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:38.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.197+0000 7fd4a8ff9700 1 -- 172.21.15.3:0/2621668750 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a4012630 con 0x7fd4ac146fe0 2023-10-08T15:37:38.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.197+0000 7fd4b3067700 1 -- 172.21.15.3:0/2621668750 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4ac15ce80 con 0x7fd4ac146fe0 2023-10-08T15:37:38.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.197+0000 7fd4a8ff9700 1 -- 172.21.15.3:0/2621668750 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4a40127d0 con 0x7fd4ac146fe0 2023-10-08T15:37:38.205 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.197+0000 7fd4a8ff9700 1 -- 172.21.15.3:0/2621668750 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a4012b90 con 0x7fd4ac146fe0 2023-10-08T15:37:38.205 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.197+0000 7fd4b3067700 1 -- 172.21.15.3:0/2621668750 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4ac142b10 con 0x7fd4ac146fe0 2023-10-08T15:37:38.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.197+0000 7fd4a8ff9700 1 -- 172.21.15.3:0/2621668750 <== mon.1 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fd4a4003030 con 0x7fd4ac146fe0 2023-10-08T15:37:38.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.197+0000 7fd4a8ff9700 1 --2- 172.21.15.3:0/2621668750 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd4940606d0 0x7fd494062b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:38.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.197+0000 7fd4a8ff9700 1 -- 172.21.15.3:0/2621668750 <== mon.1 v2:172.21.15.50:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd4a407c1c0 con 0x7fd4ac146fe0 2023-10-08T15:37:38.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.201+0000 7fd49a7fc700 1 -- 172.21.15.3:0/2621668750 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4ac15d0a0 con 0x7fd4ac146fe0 2023-10-08T15:37:38.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.201+0000 7f4cf46a3700 1 Processor -- start 2023-10-08T15:37:38.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.201+0000 7fd4b0e03700 1 --2- 172.21.15.3:0/2621668750 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd4940606d0 0x7fd494062b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:38.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.201+0000 7f4cf46a3700 1 -- start start 2023-10-08T15:37:38.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.201+0000 7fd4b0e03700 1 --2- 172.21.15.3:0/2621668750 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd4940606d0 0x7fd494062b80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd49c007fd0 tx=0x7fd49c007e70 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:38.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.201+0000 7f4cf46a3700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4cec0b3530 0x7f4cec14abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:38.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.201+0000 7f4cf46a3700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f4cec06e020 0x7f4cec14b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:38.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.201+0000 7f4cf46a3700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cec0b8a00 con 0x7f4cec0b2830 2023-10-08T15:37:38.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.201+0000 7f4cf46a3700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cec0b2f80 con 0x7f4cec06e020 2023-10-08T15:37:38.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.201+0000 7f4cf46a3700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cec0b83d0 con 0x7f4cec0b3530 2023-10-08T15:37:38.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.201+0000 7f4cf1c3e700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f4cec0b2830 0x7f4cec14ec00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:59594/0 (socket says 172.21.15.3:59594) 2023-10-08T15:37:38.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.201+0000 7f4cf1c3e700 1 -- 172.21.15.3:0/3554376447 learned_addr learned my addr 172.21.15.3:0/3554376447 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:38.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.201+0000 7f4cf243f700 1 --2- 172.21.15.3:0/3554376447 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4cec0b3530 0x7f4cec14abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:38.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.201+0000 7f4cf2c40700 1 --2- 172.21.15.3:0/3554376447 >> v2:172.21.15.3:3300/0 conn(0x7f4cec06e020 0x7f4cec14b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:38.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.201+0000 7f8bce4f4700 1 Processor -- start 2023-10-08T15:37:38.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.201+0000 7f8bce4f4700 1 -- start start 2023-10-08T15:37:38.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.201+0000 7f4cf243f700 1 -- 172.21.15.3:0/3554376447 >> v2:172.21.15.3:3300/0 conn(0x7f4cec06e020 msgr2=0x7f4cec14b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:38.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.201+0000 7f4cf243f700 1 --2- 172.21.15.3:0/3554376447 >> v2:172.21.15.3:3300/0 conn(0x7f4cec06e020 0x7f4cec14b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.201+0000 7f4cf243f700 1 -- 172.21.15.3:0/3554376447 >> v1:172.21.15.3:6789/0 conn(0x7f4cec0b2830 legacy=0x7f4cec14ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:38.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.201+0000 7f4cf243f700 1 -- 172.21.15.3:0/3554376447 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cec0b8690 con 0x7f4cec0b3530 2023-10-08T15:37:38.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.201+0000 7f4cf243f700 1 --2- 172.21.15.3:0/3554376447 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4cec0b3530 0x7f4cec14abe0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc0098e0 tx=0x7f4cdc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a066d4defcb30f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:38.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.201+0000 7f4cf143d700 1 -- 172.21.15.3:0/3554376447 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cdc00b640 con 0x7f4cec0b3530 2023-10-08T15:37:38.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.201+0000 7f4cf143d700 1 -- 172.21.15.3:0/3554376447 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cdc00b7a0 con 0x7f4cec0b3530 2023-10-08T15:37:38.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.201+0000 7f4cf143d700 1 -- 172.21.15.3:0/3554376447 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cdc00bb40 con 0x7f4cec0b3530 2023-10-08T15:37:38.211 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.205+0000 7f8bce4f4700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8bc81471b0 0x7f8bc814ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:38.211 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.205+0000 7f8bce4f4700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bc80b1cd0 con 0x7f8bc80b2740 2023-10-08T15:37:38.211 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.205+0000 7f8bce4f4700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bc80b1f40 con 0x7f8bc8068320 2023-10-08T15:37:38.211 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.205+0000 7f8bce4f4700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc8147610 con 0x7f8bc81471b0 2023-10-08T15:37:38.211 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.205+0000 7f430affd700 1 -- 172.21.15.3:0/2149897905 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f431c04ee60 con 0x7f432413c140 2023-10-08T15:37:38.212 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.205+0000 7f8bc77fe700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f8bc80b2740 0x7f8bc8146aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:59598/0 (socket says 172.21.15.3:59598) 2023-10-08T15:37:38.212 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.205+0000 7f8bc77fe700 1 -- 172.21.15.3:0/4098023730 learned_addr learned my addr 172.21.15.3:0/4098023730 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:38.212 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.205+0000 7f8bcca91700 1 --2- 172.21.15.3:0/4098023730 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8bc81471b0 0x7f8bc814ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:38.212 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.205+0000 7f4cf46a3700 1 -- 172.21.15.3:0/3554376447 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4cec0b3530 msgr2=0x7f4cec14abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:38.212 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.205+0000 7f4cf46a3700 1 --2- 172.21.15.3:0/3554376447 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4cec0b3530 0x7f4cec14abe0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc0098e0 tx=0x7f4cdc0091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.205+0000 7f8bc6ffd700 1 -- 172.21.15.3:0/4098023730 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2627056266 0 0) 0x7f8bc80b1cd0 con 0x7f8bc80b2740 2023-10-08T15:37:38.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.205+0000 7f8bc6ffd700 1 -- 172.21.15.3:0/4098023730 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bb0003570 con 0x7f8bc80b2740 2023-10-08T15:37:38.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.205+0000 7f4cf46a3700 1 -- 172.21.15.3:0/3554376447 shutdown_connections 2023-10-08T15:37:38.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.205+0000 7f4cf46a3700 1 --2- 172.21.15.3:0/3554376447 >> v2:172.21.15.3:3300/0 conn(0x7f4cec06e020 0x7f4cec14b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.205+0000 7f4cf46a3700 1 --2- 172.21.15.3:0/3554376447 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4cec0b3530 0x7f4cec14abe0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.205+0000 7f4cf46a3700 1 -- 172.21.15.3:0/3554376447 >> 172.21.15.3:0/3554376447 conn(0x7f4cec0be630 msgr2=0x7f4cec0ba6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:38.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.205+0000 7f4cf46a3700 1 -- 172.21.15.3:0/3554376447 shutdown_connections 2023-10-08T15:37:38.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.205+0000 7f4cf46a3700 1 -- 172.21.15.3:0/3554376447 wait complete. 2023-10-08T15:37:38.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.205+0000 7f8bc6ffd700 1 -- 172.21.15.3:0/4098023730 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1617954727 0 0) 0x7f8bb0003570 con 0x7f8bc80b2740 2023-10-08T15:37:38.215 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.205+0000 7f8bc6ffd700 1 -- 172.21.15.3:0/4098023730 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8bc81471b0 msgr2=0x7f8bc814ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:38.215 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.205+0000 7f8bc6ffd700 1 --2- 172.21.15.3:0/4098023730 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8bc81471b0 0x7f8bc814ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.215 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.205+0000 7f8bc6ffd700 1 -- 172.21.15.3:0/4098023730 >> v1:172.21.15.50:6789/0 conn(0x7f8bc8068320 legacy=0x7f8bc806cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:38.215 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.205+0000 7f8bc6ffd700 1 -- 172.21.15.3:0/4098023730 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc80b2220 con 0x7f8bc80b2740 2023-10-08T15:37:38.215 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.205+0000 7f8bc6ffd700 1 -- 172.21.15.3:0/4098023730 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2285686191 0 0) 0x7f8bc0001810 con 0x7f8bc80b2740 2023-10-08T15:37:38.215 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.205+0000 7f8bc6ffd700 1 -- 172.21.15.3:0/4098023730 >> v1:172.21.15.3:6789/0 conn(0x7f8bc80b2740 legacy=0x7f8bc8146aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:38.215 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.205+0000 7f8bc6ffd700 1 --2- 172.21.15.3:0/4098023730 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bb0003a90 0x7f8bb0003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:38.215 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.205+0000 7f8bc6ffd700 1 --2- 172.21.15.3:0/4098023730 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8bb0004810 0x7f8bb0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:38.215 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.205+0000 7f8bc77fe700 1 --2- 172.21.15.3:0/4098023730 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8bb0004810 0x7f8bb0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:38.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.205+0000 7f8bc6ffd700 1 --2- 172.21.15.3:0/4098023730 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8bb00051c0 0x7f8bb000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:38.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.205+0000 7f8bc6ffd700 1 -- 172.21.15.3:0/4098023730 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc8147610 con 0x7f8bb0004810 2023-10-08T15:37:38.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.205+0000 7f8bc6ffd700 1 -- 172.21.15.3:0/4098023730 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb000c050 con 0x7f8bb0003a90 2023-10-08T15:37:38.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.205+0000 7f8bc6ffd700 1 -- 172.21.15.3:0/4098023730 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb000c210 con 0x7f8bb00051c0 2023-10-08T15:37:38.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.205+0000 7f8bc77fe700 1 -- 172.21.15.3:0/4098023730 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8bb00051c0 msgr2=0x7f8bb000ba60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T15:37:38.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.205+0000 7f8bc77fe700 1 --2- 172.21.15.3:0/4098023730 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8bb00051c0 0x7f8bb000ba60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.205+0000 7f8bc77fe700 1 -- 172.21.15.3:0/4098023730 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bb0003a90 msgr2=0x7f8bb0003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:38.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.205+0000 7f8bc77fe700 1 --2- 172.21.15.3:0/4098023730 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bb0003a90 0x7f8bb0003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.205+0000 7f8bc77fe700 1 -- 172.21.15.3:0/4098023730 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb0003570 con 0x7f8bb0004810 2023-10-08T15:37:38.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.205+0000 7f4cf46a3700 1 Processor -- start 2023-10-08T15:37:38.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.205+0000 7f4cf46a3700 1 -- start start 2023-10-08T15:37:38.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.205+0000 7f8bc77fe700 1 --2- 172.21.15.3:0/4098023730 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8bb0004810 0x7f8bb0004c80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0005650 tx=0x7f8bc0005200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd1ff058833c98dc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:38.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.205+0000 7f8bc6ffd700 1 -- 172.21.15.3:0/4098023730 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc0017030 con 0x7f8bb0004810 2023-10-08T15:37:38.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.205+0000 7f8bc6ffd700 1 -- 172.21.15.3:0/4098023730 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc000d940 con 0x7f8bb0004810 2023-10-08T15:37:38.218 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.205+0000 7f4cf46a3700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4cec06e020 0x7f4cec14de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:38.218 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.205+0000 7f8bcca91700 1 --2- 172.21.15.3:0/4098023730 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8bc81471b0 0x7f8bc814ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:37:38.218 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.205+0000 7f8bce4f4700 1 -- 172.21.15.3:0/4098023730 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8bb0004810 msgr2=0x7f8bb0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:38.219 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.205+0000 7f8bce4f4700 1 --2- 172.21.15.3:0/4098023730 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8bb0004810 0x7f8bb0004c80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0005650 tx=0x7f8bc0005200 comp rx=0 tx=0).stop 2023-10-08T15:37:38.219 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.209+0000 7f8bcca91700 1 -- 172.21.15.3:0/4098023730 reap_dead start 2023-10-08T15:37:38.219 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.209+0000 7f8bce4f4700 1 -- 172.21.15.3:0/4098023730 shutdown_connections 2023-10-08T15:37:38.219 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.209+0000 7f8bce4f4700 1 -- 172.21.15.3:0/4098023730 >> 172.21.15.3:0/4098023730 conn(0x7f8bc80be630 msgr2=0x7f8bc80ba6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:38.219 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.205+0000 7f4cf46a3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4cec0b2830 0x7f4cec095ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:38.219 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.205+0000 7f4cf46a3700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4cec0b3530 0x7f4cec0961e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:38.219 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.205+0000 7f4cf46a3700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cec15c540 con 0x7f4cec0b3530 2023-10-08T15:37:38.220 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.205+0000 7f4cf46a3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cec14e360 con 0x7f4cec0b2830 2023-10-08T15:37:38.220 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.205+0000 7f4cf46a3700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cec0967e0 con 0x7f4cec06e020 2023-10-08T15:37:38.220 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.205+0000 7f4cf2c40700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4cec0b3530 0x7f4cec0961e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:38.220 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.205+0000 7f4cf2c40700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4cec0b3530 0x7f4cec0961e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44008/0 (socket says 172.21.15.3:44008) 2023-10-08T15:37:38.220 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.205+0000 7f4cf2c40700 1 -- 172.21.15.3:0/3039658211 learned_addr learned my addr 172.21.15.3:0/3039658211 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:38.220 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.205+0000 7f4cf243f700 1 --2- 172.21.15.3:0/3039658211 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4cec06e020 0x7f4cec14de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:38.220 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.209+0000 7f4cf2c40700 1 -- 172.21.15.3:0/3039658211 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4cec06e020 msgr2=0x7f4cec14de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:38.220 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.209+0000 7f4cf2c40700 1 --2- 172.21.15.3:0/3039658211 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4cec06e020 0x7f4cec14de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.220 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.209+0000 7f4cf2c40700 1 -- 172.21.15.3:0/3039658211 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4cec0b2830 msgr2=0x7f4cec095ca0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T15:37:38.220 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.209+0000 7f4cf2c40700 1 --2- 172.21.15.3:0/3039658211 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4cec0b2830 0x7f4cec095ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.220 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.209+0000 7f4cf2c40700 1 -- 172.21.15.3:0/3039658211 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cdc009420 con 0x7f4cec0b3530 2023-10-08T15:37:38.221 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.209+0000 7f8bce4f4700 1 -- 172.21.15.3:0/4098023730 shutdown_connections 2023-10-08T15:37:38.221 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.209+0000 7f8bce4f4700 1 -- 172.21.15.3:0/4098023730 wait complete. 2023-10-08T15:37:38.221 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.209+0000 7f4cf2c40700 1 --2- 172.21.15.3:0/3039658211 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4cec0b3530 0x7f4cec0961e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4ce800e930 tx=0x7f4ce80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:38.221 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.209+0000 7f4ce27fc700 1 -- 172.21.15.3:0/3039658211 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce8013680 con 0x7f4cec0b3530 2023-10-08T15:37:38.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.209+0000 7f4ce27fc700 1 -- 172.21.15.3:0/3039658211 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce8013800 con 0x7f4cec0b3530 2023-10-08T15:37:38.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.209+0000 7f4ce27fc700 1 -- 172.21.15.3:0/3039658211 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce8013bc0 con 0x7f4cec0b3530 2023-10-08T15:37:38.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.209+0000 7f8bce4f4700 1 Processor -- start 2023-10-08T15:37:38.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.209+0000 7f4cf46a3700 1 -- 172.21.15.3:0/3039658211 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cec15c1a0 con 0x7f4cec0b3530 2023-10-08T15:37:38.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.209+0000 7f8bce4f4700 1 -- start start 2023-10-08T15:37:38.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.209+0000 7f4cf46a3700 1 -- 172.21.15.3:0/3039658211 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cec14d0e0 con 0x7f4cec0b3530 2023-10-08T15:37:38.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.209+0000 7f8bce4f4700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8bb0004810 0x7f8bc814a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:38.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.209+0000 7f8bce4f4700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8bc8162a60 0x7f8bc8162e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:38.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.209+0000 7f8bce4f4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bc809f030 0x7f8bc809f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:38.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.209+0000 7f8bce4f4700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc814cf00 con 0x7f8bc8162a60 2023-10-08T15:37:38.224 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.209+0000 7f8bce4f4700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc814d1c0 con 0x7f8bc809f030 2023-10-08T15:37:38.224 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.209+0000 7f8bce4f4700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc814c0a0 con 0x7f8bb0004810 2023-10-08T15:37:38.224 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.209+0000 7f8bcca91700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bc809f030 0x7f8bc809f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:38.224 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.209+0000 7f8bcca91700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bc809f030 0x7f8bc809f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.3:51800/0 (socket says 172.21.15.3:51800) 2023-10-08T15:37:38.224 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.209+0000 7f8bcca91700 1 -- 172.21.15.3:0/3966661220 learned_addr learned my addr 172.21.15.3:0/3966661220 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:38.224 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.213+0000 7f8bc7fff700 1 --2- 172.21.15.3:0/3966661220 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8bb0004810 0x7f8bc814a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:38.224 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.213+0000 7f4ce27fc700 1 -- 172.21.15.3:0/3039658211 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4ce80123d0 con 0x7f4cec0b3530 2023-10-08T15:37:38.224 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.213+0000 7f4ce27fc700 1 --2- 172.21.15.3:0/3039658211 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4cd0060580 0x7f4cd0062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:38.224 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.213+0000 7f4ce27fc700 1 -- 172.21.15.3:0/3039658211 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4ce807c900 con 0x7f4cec0b3530 2023-10-08T15:37:38.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.213+0000 7f8bcca91700 1 -- 172.21.15.3:0/3966661220 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8bb0004810 msgr2=0x7f8bc814a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:38.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.213+0000 7f8bcca91700 1 --2- 172.21.15.3:0/3966661220 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8bb0004810 0x7f8bc814a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.213+0000 7f8bcca91700 1 -- 172.21.15.3:0/3966661220 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8bc8162a60 msgr2=0x7f8bc8162e90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T15:37:38.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.213+0000 7f8bcca91700 1 --2- 172.21.15.3:0/3966661220 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8bc8162a60 0x7f8bc8162e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.213+0000 7f8bcca91700 1 -- 172.21.15.3:0/3966661220 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc81633d0 con 0x7f8bc809f030 2023-10-08T15:37:38.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.213+0000 7f4cf243f700 1 --2- 172.21.15.3:0/3039658211 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4cd0060580 0x7f4cd0062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:38.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.213+0000 7f8bcca91700 1 --2- 172.21.15.3:0/3966661220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bc809f030 0x7f8bc809f4a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8bc80b38e0 tx=0x7f8bb800c040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:38.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.213+0000 7f4cf243f700 1 --2- 172.21.15.3:0/3039658211 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4cd0060580 0x7f4cd0062a30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc0093f0 tx=0x7f4cdc017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:38.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.213+0000 7fd4a8ff9700 1 -- 172.21.15.3:0/2621668750 <== mon.1 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd4a404c7b0 con 0x7fd4ac146fe0 2023-10-08T15:37:38.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.221+0000 7f8bb7fff700 1 -- 172.21.15.3:0/3966661220 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb800f040 con 0x7f8bc809f030 2023-10-08T15:37:38.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.221+0000 7f4ccffff700 1 -- 172.21.15.3:0/3039658211 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cec15bfd0 con 0x7f4cec0b3530 2023-10-08T15:37:38.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.221+0000 7f8bb7fff700 1 -- 172.21.15.3:0/3966661220 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bb8013610 con 0x7f8bc809f030 2023-10-08T15:37:38.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.221+0000 7f8bb7fff700 1 -- 172.21.15.3:0/3966661220 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb80139f0 con 0x7f8bc809f030 2023-10-08T15:37:38.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.221+0000 7f8bce4f4700 1 -- 172.21.15.3:0/3966661220 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bc809f9e0 con 0x7f8bc809f030 2023-10-08T15:37:38.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.221+0000 7f8bce4f4700 1 -- 172.21.15.3:0/3966661220 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bc8141d20 con 0x7f8bc809f030 2023-10-08T15:37:38.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.225+0000 7f8bb7fff700 1 -- 172.21.15.3:0/3966661220 <== mon.1 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f8bb801e460 con 0x7f8bc809f030 2023-10-08T15:37:38.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.225+0000 7f8bce4f4700 1 -- 172.21.15.3:0/3966661220 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bc8064530 con 0x7f8bc809f030 2023-10-08T15:37:38.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.225+0000 7f8bb7fff700 1 --2- 172.21.15.3:0/3966661220 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8bac0606a0 0x7f8bac062b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:38.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.225+0000 7f8bb7fff700 1 -- 172.21.15.3:0/3966661220 <== mon.1 v2:172.21.15.50:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8bb807be10 con 0x7f8bc809f030 2023-10-08T15:37:38.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.225+0000 7f8bc7fff700 1 --2- 172.21.15.3:0/3966661220 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8bac0606a0 0x7f8bac062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:38.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.225+0000 7f8bc7fff700 1 --2- 172.21.15.3:0/3966661220 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8bac0606a0 0x7f8bac062b50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8bc804c6c0 tx=0x7f8bbc007ea0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:38.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.229+0000 7f4ce27fc700 1 -- 172.21.15.3:0/3039658211 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4ce804cef0 con 0x7f4cec0b3530 2023-10-08T15:37:38.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.229+0000 7f8bb7fff700 1 -- 172.21.15.3:0/3966661220 <== mon.1 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8bb804c3e0 con 0x7f8bc809f030 2023-10-08T15:37:38.245 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.241+0000 7f65009bf700 1 Processor -- start 2023-10-08T15:37:38.247 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.241+0000 7f65009bf700 1 -- start start 2023-10-08T15:37:38.247 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.241+0000 7f65009bf700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f64fc09fb30 0x7f64fc09ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:38.247 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.241+0000 7f65009bf700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f64fc0a1c60 0x7f64fc0bc260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:38.247 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.241+0000 7f65009bf700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64fc0a1690 con 0x7f64fc0a2620 2023-10-08T15:37:38.247 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.241+0000 7f65009bf700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64fc1489c0 con 0x7f64fc0a1c60 2023-10-08T15:37:38.248 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.241+0000 7f65009bf700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64fc09d510 con 0x7f64fc09fb30 2023-10-08T15:37:38.248 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.241+0000 7f64fbfff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f64fc0a1c60 0x7f64fc0bc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:38.248 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.241+0000 7f64fbfff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f64fc0a1c60 0x7f64fc0bc260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44020/0 (socket says 172.21.15.3:44020) 2023-10-08T15:37:38.248 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.241+0000 7f64fbfff700 1 -- 172.21.15.3:0/964716729 learned_addr learned my addr 172.21.15.3:0/964716729 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:38.248 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.241+0000 7f64fb7fe700 1 --2- 172.21.15.3:0/964716729 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f64fc09fb30 0x7f64fc09ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:38.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.241+0000 7f64fbfff700 1 -- 172.21.15.3:0/964716729 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f64fc09fb30 msgr2=0x7f64fc09ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:38.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.241+0000 7f64fbfff700 1 --2- 172.21.15.3:0/964716729 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f64fc09fb30 0x7f64fc09ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.241+0000 7f64fbfff700 1 -- 172.21.15.3:0/964716729 >> v1:172.21.15.50:6789/0 conn(0x7f64fc0a2620 legacy=0x7f64fc09da30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T15:37:38.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.241+0000 7f64fbfff700 1 -- 172.21.15.3:0/964716729 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64fc0bc7a0 con 0x7f64fc0a1c60 2023-10-08T15:37:38.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.241+0000 7f64fbfff700 1 --2- 172.21.15.3:0/964716729 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f64fc0a1c60 0x7f64fc0bc260 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f64ec0089b0 tx=0x7f64ec0082d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47913544fe3d04f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:38.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.241+0000 7f64fa7fc700 1 -- 172.21.15.3:0/964716729 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ec010070 con 0x7f64fc0a1c60 2023-10-08T15:37:38.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.241+0000 7f64fa7fc700 1 -- 172.21.15.3:0/964716729 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64ec00da40 con 0x7f64fc0a1c60 2023-10-08T15:37:38.250 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.245+0000 7f65009bf700 1 -- 172.21.15.3:0/964716729 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f64fc0a1c60 msgr2=0x7f64fc0bc260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:38.250 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.245+0000 7f65009bf700 1 --2- 172.21.15.3:0/964716729 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f64fc0a1c60 0x7f64fc0bc260 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f64ec0089b0 tx=0x7f64ec0082d0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.250 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.245+0000 7f65009bf700 1 -- 172.21.15.3:0/964716729 shutdown_connections 2023-10-08T15:37:38.250 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.245+0000 7f65009bf700 1 --2- 172.21.15.3:0/964716729 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f64fc0a1c60 0x7f64fc0bc260 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.250 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.245+0000 7f65009bf700 1 --2- 172.21.15.3:0/964716729 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f64fc09fb30 0x7f64fc09ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.250 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.245+0000 7f65009bf700 1 -- 172.21.15.3:0/964716729 >> 172.21.15.3:0/964716729 conn(0x7f64fc06a900 msgr2=0x7f64fc0bd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:38.251 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.245+0000 7f65009bf700 1 -- 172.21.15.3:0/964716729 shutdown_connections 2023-10-08T15:37:38.251 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.245+0000 7f65009bf700 1 -- 172.21.15.3:0/964716729 wait complete. 2023-10-08T15:37:38.251 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.245+0000 7ff52c886700 1 Processor -- start 2023-10-08T15:37:38.251 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.245+0000 7f65009bf700 1 Processor -- start 2023-10-08T15:37:38.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.245+0000 7ff52c886700 1 -- start start 2023-10-08T15:37:38.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.245+0000 7ff52c886700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7ff52809fb30 0x7ff52809ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:38.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.245+0000 7ff52c886700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff5280a1c60 0x7ff5280bc260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:38.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.245+0000 7ff52c886700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5280a1690 con 0x7ff5280a2620 2023-10-08T15:37:38.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.245+0000 7ff52c886700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5281489c0 con 0x7ff52809fb30 2023-10-08T15:37:38.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.245+0000 7ff52c886700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff52809d510 con 0x7ff5280a1c60 2023-10-08T15:37:38.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.245+0000 7ff5277fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7ff52809fb30 0x7ff52809ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:38.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.245+0000 7ff5277fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7ff52809fb30 0x7ff52809ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44026/0 (socket says 172.21.15.3:44026) 2023-10-08T15:37:38.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.245+0000 7ff5277fe700 1 -- 172.21.15.3:0/3314688796 learned_addr learned my addr 172.21.15.3:0/3314688796 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:38.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.245+0000 7ff527fff700 1 --2- 172.21.15.3:0/3314688796 >> v2:172.21.15.50:3300/0 conn(0x7ff5280a1c60 0x7ff5280bc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:38.254 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.245+0000 7f65009bf700 1 -- start start 2023-10-08T15:37:38.254 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.245+0000 7f65009bf700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64fc09fb30 0x7f64fc162e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:38.254 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.245+0000 7f65009bf700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f64fc0a1c60 0x7f64fc0ba440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:38.254 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.245+0000 7f65009bf700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f64fc0a2620 0x7f64fc1457f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:38.254 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.245+0000 7f65009bf700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64fc14e4a0 con 0x7f64fc0a2620 2023-10-08T15:37:38.254 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.245+0000 7f65009bf700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64fc14ddc0 con 0x7f64fc09fb30 2023-10-08T15:37:38.254 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.245+0000 7f65009bf700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64fc14d770 con 0x7f64fc0a1c60 2023-10-08T15:37:38.254 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.245+0000 7ff5277fe700 1 -- 172.21.15.3:0/3314688796 >> v2:172.21.15.50:3300/0 conn(0x7ff5280a1c60 msgr2=0x7ff5280bc260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:38.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.245+0000 7ff5277fe700 1 --2- 172.21.15.3:0/3314688796 >> v2:172.21.15.50:3300/0 conn(0x7ff5280a1c60 0x7ff5280bc260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.245+0000 7ff5277fe700 1 -- 172.21.15.3:0/3314688796 >> v1:172.21.15.3:6789/0 conn(0x7ff5280a2620 legacy=0x7ff52809da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:38.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.245+0000 7ff5277fe700 1 -- 172.21.15.3:0/3314688796 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5280bc7a0 con 0x7ff52809fb30 2023-10-08T15:37:38.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.245+0000 7f64fbfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f64fc0a2620 0x7f64fc1457f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:38.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.245+0000 7f64faffd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f64fc0a1c60 0x7f64fc0ba440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:38.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.245+0000 7f64fbfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f64fc0a2620 0x7f64fc1457f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44038/0 (socket says 172.21.15.3:44038) 2023-10-08T15:37:38.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.245+0000 7f64fbfff700 1 -- 172.21.15.3:0/4146357410 learned_addr learned my addr 172.21.15.3:0/4146357410 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:38.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.245+0000 7f64fb7fe700 1 --2- 172.21.15.3:0/4146357410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64fc09fb30 0x7f64fc162e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:38.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.249+0000 7f64fbfff700 1 -- 172.21.15.3:0/4146357410 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f64fc0a1c60 msgr2=0x7f64fc0ba440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:38.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.249+0000 7f64fbfff700 1 --2- 172.21.15.3:0/4146357410 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f64fc0a1c60 0x7f64fc0ba440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.249+0000 7f64fbfff700 1 -- 172.21.15.3:0/4146357410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64fc09fb30 msgr2=0x7f64fc162e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:38.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.249+0000 7f64fbfff700 1 --2- 172.21.15.3:0/4146357410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64fc09fb30 0x7f64fc162e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.249+0000 7f64fbfff700 1 -- 172.21.15.3:0/4146357410 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64ec008570 con 0x7f64fc0a2620 2023-10-08T15:37:38.257 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.249+0000 7ff5277fe700 1 --2- 172.21.15.3:0/3314688796 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff52809fb30 0x7ff52809ff00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff52809f5c0 tx=0x7ff518009b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c3ff52764f17924 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:38.257 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.249+0000 7ff5267fc700 1 -- 172.21.15.3:0/3314688796 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff518007ae0 con 0x7ff52809fb30 2023-10-08T15:37:38.257 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.249+0000 7ff5267fc700 1 -- 172.21.15.3:0/3314688796 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff518007c40 con 0x7ff52809fb30 2023-10-08T15:37:38.257 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.249+0000 7ff5267fc700 1 -- 172.21.15.3:0/3314688796 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5180090d0 con 0x7ff52809fb30 2023-10-08T15:37:38.257 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.249+0000 7f64fbfff700 1 --2- 172.21.15.3:0/4146357410 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f64fc0a2620 0x7f64fc1457f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f64ec0030c0 tx=0x7f64ec01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:38.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.249+0000 7ff52c886700 1 -- 172.21.15.3:0/3314688796 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff52809fb30 msgr2=0x7ff52809ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:38.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.249+0000 7ff52c886700 1 --2- 172.21.15.3:0/3314688796 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff52809fb30 0x7ff52809ff00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff52809f5c0 tx=0x7ff518009b70 comp rx=0 tx=0).stop 2023-10-08T15:37:38.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.249+0000 7ff52c886700 1 -- 172.21.15.3:0/3314688796 shutdown_connections 2023-10-08T15:37:38.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.249+0000 7ff52c886700 1 --2- 172.21.15.3:0/3314688796 >> v2:172.21.15.50:3300/0 conn(0x7ff5280a1c60 0x7ff5280bc260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.249+0000 7ff52c886700 1 --2- 172.21.15.3:0/3314688796 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff52809fb30 0x7ff52809ff00 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.249+0000 7ff52c886700 1 -- 172.21.15.3:0/3314688796 >> 172.21.15.3:0/3314688796 conn(0x7ff52806a900 msgr2=0x7ff5280bd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:38.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.249+0000 7ff52c886700 1 -- 172.21.15.3:0/3314688796 shutdown_connections 2023-10-08T15:37:38.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.249+0000 7ff52c886700 1 -- 172.21.15.3:0/3314688796 wait complete. 2023-10-08T15:37:38.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.249+0000 7f64e37fe700 1 -- 172.21.15.3:0/4146357410 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ec00dc80 con 0x7f64fc0a2620 2023-10-08T15:37:38.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.249+0000 7f65009bf700 1 -- 172.21.15.3:0/4146357410 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64fc14da50 con 0x7f64fc0a2620 2023-10-08T15:37:38.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.249+0000 7f65009bf700 1 -- 172.21.15.3:0/4146357410 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64fc095a70 con 0x7f64fc0a2620 2023-10-08T15:37:38.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.249+0000 7f64e37fe700 1 -- 172.21.15.3:0/4146357410 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64ec017da0 con 0x7f64fc0a2620 2023-10-08T15:37:38.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.249+0000 7f64e37fe700 1 -- 172.21.15.3:0/4146357410 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ec00b310 con 0x7f64fc0a2620 2023-10-08T15:37:38.260 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.249+0000 7ff52c886700 1 Processor -- start 2023-10-08T15:37:38.260 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.249+0000 7f65009bf700 1 -- 172.21.15.3:0/4146357410 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64dc0052b0 con 0x7f64fc0a2620 2023-10-08T15:37:38.261 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.253+0000 7ff52c886700 1 -- start start 2023-10-08T15:37:38.261 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.253+0000 7ff52c886700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff52809fb30 0x7ff52809bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:38.261 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.253+0000 7ff52c886700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5280a1c60 0x7ff52809c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:38.261 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.253+0000 7ff52c886700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff5280a2620 0x7ff528096cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:38.261 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.253+0000 7ff52c886700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff52815a120 con 0x7ff5280a2620 2023-10-08T15:37:38.261 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.253+0000 7ff52c886700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff528098740 con 0x7ff5280a1c60 2023-10-08T15:37:38.261 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.253+0000 7ff52c886700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff528097fd0 con 0x7ff52809fb30 2023-10-08T15:37:38.261 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.253+0000 7ff526ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5280a1c60 0x7ff52809c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:38.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.253+0000 7ff526ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5280a1c60 0x7ff52809c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.3:51826/0 (socket says 172.21.15.3:51826) 2023-10-08T15:37:38.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.253+0000 7ff526ffd700 1 -- 172.21.15.3:0/3410551097 learned_addr learned my addr 172.21.15.3:0/3410551097 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:38.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.253+0000 7ff527fff700 1 --2- 172.21.15.3:0/3410551097 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff5280a2620 0x7ff528096cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:38.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.253+0000 7ff526ffd700 1 -- 172.21.15.3:0/3410551097 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff52809fb30 msgr2=0x7ff52809bfb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T15:37:38.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.253+0000 7ff526ffd700 1 --2- 172.21.15.3:0/3410551097 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff52809fb30 0x7ff52809bfb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.253+0000 7ff526ffd700 1 -- 172.21.15.3:0/3410551097 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff5280a2620 msgr2=0x7ff528096cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:38.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.253+0000 7ff526ffd700 1 --2- 172.21.15.3:0/3410551097 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff5280a2620 0x7ff528096cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.253+0000 7ff526ffd700 1 -- 172.21.15.3:0/3410551097 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff51800d040 con 0x7ff5280a1c60 2023-10-08T15:37:38.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.253+0000 7ff527fff700 1 --2- 172.21.15.3:0/3410551097 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff5280a2620 0x7ff528096cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:37:38.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.253+0000 7f64e37fe700 1 -- 172.21.15.3:0/4146357410 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f64ec01d070 con 0x7f64fc0a2620 2023-10-08T15:37:38.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.253+0000 7f64e37fe700 1 --2- 172.21.15.3:0/4146357410 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f64e8060650 0x7f64e8062b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:38.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.253+0000 7f64e37fe700 1 -- 172.21.15.3:0/4146357410 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f64ec07ebf0 con 0x7f64fc0a2620 2023-10-08T15:37:38.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.253+0000 7f64fb7fe700 1 --2- 172.21.15.3:0/4146357410 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f64e8060650 0x7f64e8062b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:38.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.253+0000 7ff526ffd700 1 --2- 172.21.15.3:0/3410551097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5280a1c60 0x7ff52809c4f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff51c00b5e0 tx=0x7ff51c009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:38.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.253+0000 7ff50f7fe700 1 -- 172.21.15.3:0/3410551097 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51c00f510 con 0x7ff5280a1c60 2023-10-08T15:37:38.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.253+0000 7ff50f7fe700 1 -- 172.21.15.3:0/3410551097 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff51c00f6b0 con 0x7ff5280a1c60 2023-10-08T15:37:38.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.253+0000 7f64fb7fe700 1 --2- 172.21.15.3:0/4146357410 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f64e8060650 0x7f64e8062b00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f64f400f570 tx=0x7f64f400b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:38.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.257+0000 7ff50f7fe700 1 -- 172.21.15.3:0/3410551097 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51c00fa70 con 0x7ff5280a1c60 2023-10-08T15:37:38.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.257+0000 7ff52c886700 1 -- 172.21.15.3:0/3410551097 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5280982b0 con 0x7ff5280a1c60 2023-10-08T15:37:38.265 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.257+0000 7ff52c886700 1 -- 172.21.15.3:0/3410551097 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff528168450 con 0x7ff5280a1c60 2023-10-08T15:37:38.265 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.257+0000 7f959b2ae700 1 Processor -- start 2023-10-08T15:37:38.265 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.257+0000 7f959b2ae700 1 -- start start 2023-10-08T15:37:38.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.257+0000 7f959b2ae700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f95940b4510 0x7f9594153f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:38.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.257+0000 7f959b2ae700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95940a10c0 con 0x7f95940b1e60 2023-10-08T15:37:38.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.257+0000 7f959b2ae700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95940bc8d0 con 0x7f95940a2700 2023-10-08T15:37:38.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.257+0000 7f959b2ae700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95940a22f0 con 0x7f95940b4510 2023-10-08T15:37:38.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.257+0000 7f959904a700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f95940b1e60 0x7f959414c9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:59618/0 (socket says 172.21.15.3:59618) 2023-10-08T15:37:38.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.257+0000 7f959904a700 1 -- 172.21.15.3:0/1242559133 learned_addr learned my addr 172.21.15.3:0/1242559133 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:38.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.261+0000 7f958bfff700 1 -- 172.21.15.3:0/1242559133 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2282517355 0 0) 0x7f95940bc8d0 con 0x7f95940a2700 2023-10-08T15:37:38.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.261+0000 7f958bfff700 1 -- 172.21.15.3:0/1242559133 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9580003570 con 0x7f95940a2700 2023-10-08T15:37:38.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.257+0000 7ff50f7fe700 1 -- 172.21.15.3:0/3410551097 <== mon.1 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff51c01a400 con 0x7ff5280a1c60 2023-10-08T15:37:38.267 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.257+0000 7ff50f7fe700 1 --2- 172.21.15.3:0/3410551097 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff510060760 0x7ff510062c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:38.267 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.257+0000 7ff50f7fe700 1 -- 172.21.15.3:0/3410551097 <== mon.1 v2:172.21.15.50:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff51c07c020 con 0x7ff5280a1c60 2023-10-08T15:37:38.267 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.261+0000 7ff5277fe700 1 --2- 172.21.15.3:0/3410551097 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff510060760 0x7ff510062c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:38.267 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.261+0000 7f64e37fe700 1 -- 172.21.15.3:0/4146357410 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f64ec04f300 con 0x7f64fc0a2620 2023-10-08T15:37:38.269 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.261+0000 7f959984b700 1 --2- 172.21.15.3:0/1242559133 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f95940b4510 0x7f9594153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:38.269 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.261+0000 7f958bfff700 1 -- 172.21.15.3:0/1242559133 <== mon.1 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2246383186 0 0) 0x7f9580003570 con 0x7f95940a2700 2023-10-08T15:37:38.269 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.261+0000 7f958bfff700 1 -- 172.21.15.3:0/1242559133 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f95940b4510 msgr2=0x7f9594153f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:38.269 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.261+0000 7f958bfff700 1 --2- 172.21.15.3:0/1242559133 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f95940b4510 0x7f9594153f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.269 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.261+0000 7f958bfff700 1 -- 172.21.15.3:0/1242559133 >> v1:172.21.15.3:6789/0 conn(0x7f95940b1e60 legacy=0x7f959414c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:38.269 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.261+0000 7f958bfff700 1 -- 172.21.15.3:0/1242559133 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f959414d810 con 0x7f95940a2700 2023-10-08T15:37:38.269 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.261+0000 7f958bfff700 1 -- 172.21.15.3:0/1242559133 <== mon.1 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2285686191 0 0) 0x7f958c0017f0 con 0x7f95940a2700 2023-10-08T15:37:38.270 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.261+0000 7f958bfff700 1 -- 172.21.15.3:0/1242559133 >> v1:172.21.15.50:6789/0 conn(0x7f95940a2700 legacy=0x7f959414d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:38.270 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.261+0000 7f958bfff700 1 --2- 172.21.15.3:0/1242559133 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9580003ae0 0x7f9580003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:38.270 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.261+0000 7f959904a700 1 --2- 172.21.15.3:0/1242559133 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9580003ae0 0x7f9580003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:38.270 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.261+0000 7f958bfff700 1 --2- 172.21.15.3:0/1242559133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9580004810 0x7f9580004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:38.270 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.261+0000 7f958bfff700 1 --2- 172.21.15.3:0/1242559133 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f95940b4510 0x7f958000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:38.270 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.261+0000 7f958bfff700 1 -- 172.21.15.3:0/1242559133 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95940a22f0 con 0x7f9580003ae0 2023-10-08T15:37:38.270 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.261+0000 7f958bfff700 1 -- 172.21.15.3:0/1242559133 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95800054f0 con 0x7f9580004810 2023-10-08T15:37:38.270 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.261+0000 7f958bfff700 1 -- 172.21.15.3:0/1242559133 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95800056b0 con 0x7f95940b4510 2023-10-08T15:37:38.270 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.261+0000 7f9598849700 1 --2- 172.21.15.3:0/1242559133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9580004810 0x7f9580004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:38.270 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.261+0000 7f959984b700 1 --2- 172.21.15.3:0/1242559133 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f95940b4510 0x7f958000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:38.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.261+0000 7f959904a700 1 -- 172.21.15.3:0/1242559133 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f95940b4510 msgr2=0x7f958000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:38.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.261+0000 7f959904a700 1 --2- 172.21.15.3:0/1242559133 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f95940b4510 0x7f958000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.261+0000 7f959904a700 1 -- 172.21.15.3:0/1242559133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9580004810 msgr2=0x7f9580004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:38.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.261+0000 7f959904a700 1 --2- 172.21.15.3:0/1242559133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9580004810 0x7f9580004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.261+0000 7f959904a700 1 -- 172.21.15.3:0/1242559133 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9580003570 con 0x7f9580003ae0 2023-10-08T15:37:38.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.261+0000 7f9598849700 1 --2- 172.21.15.3:0/1242559133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9580004810 0x7f9580004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:37:38.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.261+0000 7f959904a700 1 --2- 172.21.15.3:0/1242559133 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9580003ae0 0x7f9580003eb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f95900019b0 tx=0x7f9590007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fa9648275668969 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:38.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.261+0000 7f958bfff700 1 -- 172.21.15.3:0/1242559133 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95900048f0 con 0x7f9580003ae0 2023-10-08T15:37:38.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.261+0000 7f958bfff700 1 -- 172.21.15.3:0/1242559133 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9590004a50 con 0x7f9580003ae0 2023-10-08T15:37:38.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.261+0000 7f958bfff700 1 -- 172.21.15.3:0/1242559133 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9590004e10 con 0x7f9580003ae0 2023-10-08T15:37:38.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.261+0000 7f959b2ae700 1 -- 172.21.15.3:0/1242559133 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9580003ae0 msgr2=0x7f9580003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:38.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.261+0000 7f959b2ae700 1 --2- 172.21.15.3:0/1242559133 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9580003ae0 0x7f9580003eb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f95900019b0 tx=0x7f9590007e00 comp rx=0 tx=0).stop 2023-10-08T15:37:38.272 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.261+0000 7f959984b700 1 -- 172.21.15.3:0/1242559133 reap_dead start 2023-10-08T15:37:38.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.265+0000 7ff5277fe700 1 --2- 172.21.15.3:0/3410551097 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff510060760 0x7ff510062c10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff52809f5c0 tx=0x7ff518017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:38.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.269+0000 7f959b2ae700 1 -- 172.21.15.3:0/1242559133 shutdown_connections 2023-10-08T15:37:38.274 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.269+0000 7f959b2ae700 1 -- 172.21.15.3:0/1242559133 >> 172.21.15.3:0/1242559133 conn(0x7f959406a900 msgr2=0x7f95940bd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:38.274 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.269+0000 7ff52c886700 1 -- 172.21.15.3:0/3410551097 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5080052b0 con 0x7ff5280a1c60 2023-10-08T15:37:38.274 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.269+0000 7f959b2ae700 1 -- 172.21.15.3:0/1242559133 shutdown_connections 2023-10-08T15:37:38.274 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.269+0000 7f959b2ae700 1 -- 172.21.15.3:0/1242559133 wait complete. 2023-10-08T15:37:38.275 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.269+0000 7f959b2ae700 1 Processor -- start 2023-10-08T15:37:38.275 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.269+0000 7f959b2ae700 1 -- start start 2023-10-08T15:37:38.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.269+0000 7f959b2ae700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9580003ae0 0x7f9594067310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:38.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.269+0000 7f959b2ae700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f95940b9220 0x7f959415de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:38.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.269+0000 7f959b2ae700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f959415e3a0 0x7f959415e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:38.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.269+0000 7f959b2ae700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95940b8fd0 con 0x7f95940b9220 2023-10-08T15:37:38.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.269+0000 7f959b2ae700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95940b9a60 con 0x7f959415e3a0 2023-10-08T15:37:38.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.269+0000 7f959b2ae700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95940b8b40 con 0x7f9580003ae0 2023-10-08T15:37:38.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.269+0000 7f9598849700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f95940b9220 0x7f959415de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:38.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.269+0000 7f9598849700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f95940b9220 0x7f959415de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44050/0 (socket says 172.21.15.3:44050) 2023-10-08T15:37:38.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.269+0000 7f9598849700 1 -- 172.21.15.3:0/1032494947 learned_addr learned my addr 172.21.15.3:0/1032494947 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:38.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.269+0000 7f959904a700 1 --2- 172.21.15.3:0/1032494947 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9580003ae0 0x7f9594067310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:38.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.273+0000 7f9598849700 1 -- 172.21.15.3:0/1032494947 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9580003ae0 msgr2=0x7f9594067310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:38.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.273+0000 7f9598849700 1 --2- 172.21.15.3:0/1032494947 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9580003ae0 0x7f9594067310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.273+0000 7f9598849700 1 -- 172.21.15.3:0/1032494947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f959415e3a0 msgr2=0x7f959415e810 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T15:37:38.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.273+0000 7f9598849700 1 --2- 172.21.15.3:0/1032494947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f959415e3a0 0x7f959415e810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.273+0000 7f9598849700 1 -- 172.21.15.3:0/1032494947 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95940b7d90 con 0x7f95940b9220 2023-10-08T15:37:38.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.273+0000 7f9598849700 1 --2- 172.21.15.3:0/1032494947 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f95940b9220 0x7f959415de60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f958c0014a0 tx=0x7f958c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:38.283 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.277+0000 7f95897fa700 1 -- 172.21.15.3:0/1032494947 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958c00cb10 con 0x7f95940b9220 2023-10-08T15:37:38.283 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.277+0000 7f95897fa700 1 -- 172.21.15.3:0/1032494947 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f958c00cc70 con 0x7f95940b9220 2023-10-08T15:37:38.283 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.277+0000 7f959b2ae700 1 -- 172.21.15.3:0/1032494947 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9594067850 con 0x7f95940b9220 2023-10-08T15:37:38.283 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.277+0000 7f959b2ae700 1 -- 172.21.15.3:0/1032494947 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f959409c7b0 con 0x7f95940b9220 2023-10-08T15:37:38.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.277+0000 7f95897fa700 1 -- 172.21.15.3:0/1032494947 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958c015430 con 0x7f95940b9220 2023-10-08T15:37:38.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.277+0000 7ff50f7fe700 1 -- 172.21.15.3:0/3410551097 <== mon.1 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff51c04c770 con 0x7ff5280a1c60 2023-10-08T15:37:38.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.277+0000 7f95897fa700 1 -- 172.21.15.3:0/1032494947 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f958c0157e0 con 0x7f95940b9220 2023-10-08T15:37:38.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.281+0000 7f95897fa700 1 --2- 172.21.15.3:0/1032494947 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f9578060620 0x7f9578062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:38.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.281+0000 7f95897fa700 1 -- 172.21.15.3:0/1032494947 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f958c051d50 con 0x7f95940b9220 2023-10-08T15:37:38.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.281+0000 7f959904a700 1 --2- 172.21.15.3:0/1032494947 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f9578060620 0x7f9578062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:38.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.281+0000 7f959904a700 1 --2- 172.21.15.3:0/1032494947 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f9578060620 0x7f9578062ad0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9590007e40 tx=0x7f9590015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:38.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.285+0000 7f959b2ae700 1 -- 172.21.15.3:0/1032494947 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95700052b0 con 0x7f95940b9220 2023-10-08T15:37:38.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.293+0000 7f95897fa700 1 -- 172.21.15.3:0/1032494947 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f958c0513e0 con 0x7f95940b9220 2023-10-08T15:37:38.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.493+0000 7f01ac94b700 1 -- 172.21.15.3:0/806337132 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f018c005830 con 0x7f01a8150b50 2023-10-08T15:37:38.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.493+0000 7f01967fc700 1 -- 172.21.15.3:0/806337132 <== mon.1 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f01a00524d0 con 0x7f01a8150b50 2023-10-08T15:37:38.503 INFO:teuthology.orchestra.run.smithi003.stdout:60129542149 2023-10-08T15:37:38.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.501+0000 7f0187fff700 1 -- 172.21.15.3:0/806337132 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f0190060710 msgr2=0x7f0190062bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:38.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.501+0000 7f0187fff700 1 --2- 172.21.15.3:0/806337132 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f0190060710 0x7f0190062bc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f019c003a80 tx=0x7f019c007ec0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.501+0000 7f0187fff700 1 -- 172.21.15.3:0/806337132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01a8150b50 msgr2=0x7f01a814e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:38.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.501+0000 7f0187fff700 1 --2- 172.21.15.3:0/806337132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01a8150b50 0x7f01a814e300 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f01a0015000 tx=0x7f01a0018000 comp rx=0 tx=0).stop 2023-10-08T15:37:38.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.501+0000 7f0187fff700 1 -- 172.21.15.3:0/806337132 shutdown_connections 2023-10-08T15:37:38.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.501+0000 7f0187fff700 1 --2- 172.21.15.3:0/806337132 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f0190060710 0x7f0190062bc0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.501+0000 7f0187fff700 1 --2- 172.21.15.3:0/806337132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01a8150b50 0x7f01a814e300 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.501+0000 7f0187fff700 1 --2- 172.21.15.3:0/806337132 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f01a8067ad0 0x7f01a8157070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.501+0000 7f0187fff700 1 --2- 172.21.15.3:0/806337132 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f01a80670e0 0x7f01a815a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.501+0000 7f0187fff700 1 -- 172.21.15.3:0/806337132 >> 172.21.15.3:0/806337132 conn(0x7f01a80bdda0 msgr2=0x7f01a814ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:38.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.501+0000 7f0187fff700 1 -- 172.21.15.3:0/806337132 shutdown_connections 2023-10-08T15:37:38.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.501+0000 7f0187fff700 1 -- 172.21.15.3:0/806337132 wait complete. 2023-10-08T15:37:38.520 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.7 2023-10-08T15:37:38.521 DEBUG:teuthology.parallel:result is None 2023-10-08T15:37:38.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.517+0000 7f432983f700 1 -- 172.21.15.3:0/2149897905 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f4304005830 con 0x7f432413c140 2023-10-08T15:37:38.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.517+0000 7f430affd700 1 -- 172.21.15.3:0/2149897905 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f431c021030 con 0x7f432413c140 2023-10-08T15:37:38.523 INFO:teuthology.orchestra.run.smithi003.stdout:55834574854 2023-10-08T15:37:38.523 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.517+0000 7f8bce4f4700 1 -- 172.21.15.3:0/3966661220 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8bc809fb70 con 0x7f8bc809f030 2023-10-08T15:37:38.524 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.517+0000 7f8bb7fff700 1 -- 172.21.15.3:0/3966661220 <== mon.1 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8bb804fa00 con 0x7f8bc809f030 2023-10-08T15:37:38.524 INFO:teuthology.orchestra.run.smithi003.stdout:60129542151 2023-10-08T15:37:38.525 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.521+0000 7f432983f700 1 -- 172.21.15.3:0/2149897905 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f430c060780 msgr2=0x7f430c062c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:38.525 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.521+0000 7f432983f700 1 --2- 172.21.15.3:0/2149897905 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f430c060780 0x7f430c062c30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4318007fd0 tx=0x7f4318000bc0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.521+0000 7f432983f700 1 -- 172.21.15.3:0/2149897905 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f432413c140 msgr2=0x7f432413a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:38.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.521+0000 7f432983f700 1 --2- 172.21.15.3:0/2149897905 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f432413c140 0x7f432413a6c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f431c015000 tx=0x7f431c018000 comp rx=0 tx=0).stop 2023-10-08T15:37:38.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.521+0000 7f432983f700 1 -- 172.21.15.3:0/2149897905 shutdown_connections 2023-10-08T15:37:38.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.521+0000 7f432983f700 1 --2- 172.21.15.3:0/2149897905 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f430c060780 0x7f430c062c30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.521+0000 7f432983f700 1 --2- 172.21.15.3:0/2149897905 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f432413c140 0x7f432413a6c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.521+0000 7f432983f700 1 --2- 172.21.15.3:0/2149897905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4324068a80 0x7f432413a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.521+0000 7f432983f700 1 --2- 172.21.15.3:0/2149897905 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4324067310 0x7f4324142370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.521+0000 7f432983f700 1 -- 172.21.15.3:0/2149897905 >> 172.21.15.3:0/2149897905 conn(0x7f43240be3f0 msgr2=0x7f432414afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:38.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.521+0000 7f432983f700 1 -- 172.21.15.3:0/2149897905 shutdown_connections 2023-10-08T15:37:38.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.521+0000 7f432983f700 1 -- 172.21.15.3:0/2149897905 wait complete. 2023-10-08T15:37:38.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.521+0000 7f8bce4f4700 1 -- 172.21.15.3:0/3966661220 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8bac0606a0 msgr2=0x7f8bac062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:38.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.521+0000 7f8bce4f4700 1 --2- 172.21.15.3:0/3966661220 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8bac0606a0 0x7f8bac062b50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8bc804c6c0 tx=0x7f8bbc007ea0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.521+0000 7f8bce4f4700 1 -- 172.21.15.3:0/3966661220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bc809f030 msgr2=0x7f8bc809f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:38.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.521+0000 7f8bce4f4700 1 --2- 172.21.15.3:0/3966661220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bc809f030 0x7f8bc809f4a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8bc80b38e0 tx=0x7f8bb800c040 comp rx=0 tx=0).stop 2023-10-08T15:37:38.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.521+0000 7f8bce4f4700 1 -- 172.21.15.3:0/3966661220 shutdown_connections 2023-10-08T15:37:38.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.521+0000 7f8bce4f4700 1 --2- 172.21.15.3:0/3966661220 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8bac0606a0 0x7f8bac062b50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.521+0000 7f8bce4f4700 1 --2- 172.21.15.3:0/3966661220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bc809f030 0x7f8bc809f4a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.521+0000 7f8bce4f4700 1 --2- 172.21.15.3:0/3966661220 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8bc8162a60 0x7f8bc8162e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.521+0000 7f8bce4f4700 1 --2- 172.21.15.3:0/3966661220 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8bb0004810 0x7f8bc814a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.521+0000 7f8bce4f4700 1 -- 172.21.15.3:0/3966661220 >> 172.21.15.3:0/3966661220 conn(0x7f8bc80be630 msgr2=0x7f8bc8143070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:38.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.521+0000 7f8bce4f4700 1 -- 172.21.15.3:0/3966661220 shutdown_connections 2023-10-08T15:37:38.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.521+0000 7f8bce4f4700 1 -- 172.21.15.3:0/3966661220 wait complete. 2023-10-08T15:37:38.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.525+0000 7fd49a7fc700 1 -- 172.21.15.3:0/2621668750 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd4ac064530 con 0x7fd4ac146fe0 2023-10-08T15:37:38.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.525+0000 7fd4a8ff9700 1 -- 172.21.15.3:0/2621668750 <== mon.1 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd4a404fdd0 con 0x7fd4ac146fe0 2023-10-08T15:37:38.532 INFO:teuthology.orchestra.run.smithi003.stdout:60129542150 2023-10-08T15:37:38.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.529+0000 7fd49a7fc700 1 -- 172.21.15.3:0/2621668750 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd4940606d0 msgr2=0x7fd494062b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:38.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.529+0000 7fd49a7fc700 1 --2- 172.21.15.3:0/2621668750 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd4940606d0 0x7fd494062b80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd49c007fd0 tx=0x7fd49c007e70 comp rx=0 tx=0).stop 2023-10-08T15:37:38.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.529+0000 7fd49a7fc700 1 -- 172.21.15.3:0/2621668750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4ac146fe0 msgr2=0x7fd4ac15d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:38.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.529+0000 7fd49a7fc700 1 --2- 172.21.15.3:0/2621668750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4ac146fe0 0x7fd4ac15d3a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd4a400c8e0 tx=0x7fd4a40016d0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.529+0000 7fd49a7fc700 1 -- 172.21.15.3:0/2621668750 shutdown_connections 2023-10-08T15:37:38.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.529+0000 7fd49a7fc700 1 --2- 172.21.15.3:0/2621668750 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd4940606d0 0x7fd494062b80 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.529+0000 7fd49a7fc700 1 --2- 172.21.15.3:0/2621668750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4ac146fe0 0x7fd4ac15d3a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.529+0000 7fd49a7fc700 1 --2- 172.21.15.3:0/2621668750 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd4ac0b2740 0x7fd4ac1425d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.529+0000 7fd49a7fc700 1 --2- 172.21.15.3:0/2621668750 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd4ac068320 0x7fd4ac13ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.529+0000 7fd49a7fc700 1 -- 172.21.15.3:0/2621668750 >> 172.21.15.3:0/2621668750 conn(0x7fd4ac0be630 msgr2=0x7fd4ac1481e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:38.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.529+0000 7fd49a7fc700 1 -- 172.21.15.3:0/2621668750 shutdown_connections 2023-10-08T15:37:38.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.529+0000 7fd49a7fc700 1 -- 172.21.15.3:0/2621668750 wait complete. 2023-10-08T15:37:38.542 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2023-10-08T15:37:38.542 DEBUG:teuthology.parallel:result is None 2023-10-08T15:37:38.543 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.1 2023-10-08T15:37:38.543 DEBUG:teuthology.parallel:result is None 2023-10-08T15:37:38.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.541+0000 7f4ccffff700 1 -- 172.21.15.3:0/3039658211 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4cec064530 con 0x7f4cec0b3530 2023-10-08T15:37:38.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.541+0000 7f4ce27fc700 1 -- 172.21.15.3:0/3039658211 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4ce8021020 con 0x7f4cec0b3530 2023-10-08T15:37:38.546 INFO:teuthology.orchestra.run.smithi003.stdout:60129542151 2023-10-08T15:37:38.549 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.2 2023-10-08T15:37:38.550 DEBUG:teuthology.parallel:result is None 2023-10-08T15:37:38.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.541+0000 7f4ccffff700 1 -- 172.21.15.3:0/3039658211 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4cd0060580 msgr2=0x7f4cd0062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:38.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.541+0000 7f4ccffff700 1 --2- 172.21.15.3:0/3039658211 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4cd0060580 0x7f4cd0062a30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc0093f0 tx=0x7f4cdc017000 comp rx=0 tx=0).stop 2023-10-08T15:37:38.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.541+0000 7f4ccffff700 1 -- 172.21.15.3:0/3039658211 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4cec0b3530 msgr2=0x7f4cec0961e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:38.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.541+0000 7f4ccffff700 1 --2- 172.21.15.3:0/3039658211 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4cec0b3530 0x7f4cec0961e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4ce800e930 tx=0x7f4ce80091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.541+0000 7f4ccffff700 1 -- 172.21.15.3:0/3039658211 shutdown_connections 2023-10-08T15:37:38.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.541+0000 7f4ccffff700 1 --2- 172.21.15.3:0/3039658211 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4cd0060580 0x7f4cd0062a30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.541+0000 7f4ccffff700 1 --2- 172.21.15.3:0/3039658211 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4cec0b3530 0x7f4cec0961e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.541+0000 7f4ccffff700 1 --2- 172.21.15.3:0/3039658211 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4cec0b2830 0x7f4cec095ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.541+0000 7f4ccffff700 1 --2- 172.21.15.3:0/3039658211 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4cec06e020 0x7f4cec14de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.541+0000 7f4ccffff700 1 -- 172.21.15.3:0/3039658211 >> 172.21.15.3:0/3039658211 conn(0x7f4cec0be630 msgr2=0x7f4cec0bd010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:38.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.545+0000 7f4ccffff700 1 -- 172.21.15.3:0/3039658211 shutdown_connections 2023-10-08T15:37:38.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.545+0000 7f4ccffff700 1 -- 172.21.15.3:0/3039658211 wait complete. 2023-10-08T15:37:38.555 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.549+0000 7f65009bf700 1 -- 172.21.15.3:0/4146357410 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f64dc005830 con 0x7f64fc0a2620 2023-10-08T15:37:38.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.549+0000 7f64e37fe700 1 -- 172.21.15.3:0/4146357410 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f64ec0083d0 con 0x7f64fc0a2620 2023-10-08T15:37:38.556 INFO:teuthology.orchestra.run.smithi003.stdout:60129542151 2023-10-08T15:37:38.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.553+0000 7f65009bf700 1 -- 172.21.15.3:0/4146357410 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f64e8060650 msgr2=0x7f64e8062b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:38.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.553+0000 7f65009bf700 1 --2- 172.21.15.3:0/4146357410 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f64e8060650 0x7f64e8062b00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f64f400f570 tx=0x7f64f400b040 comp rx=0 tx=0).stop 2023-10-08T15:37:38.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.553+0000 7f65009bf700 1 -- 172.21.15.3:0/4146357410 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f64fc0a2620 msgr2=0x7f64fc1457f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:38.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.553+0000 7f65009bf700 1 --2- 172.21.15.3:0/4146357410 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f64fc0a2620 0x7f64fc1457f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f64ec0030c0 tx=0x7f64ec01b000 comp rx=0 tx=0).stop 2023-10-08T15:37:38.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.553+0000 7f65009bf700 1 -- 172.21.15.3:0/4146357410 shutdown_connections 2023-10-08T15:37:38.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.553+0000 7f65009bf700 1 --2- 172.21.15.3:0/4146357410 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f64e8060650 0x7f64e8062b00 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.553+0000 7f65009bf700 1 --2- 172.21.15.3:0/4146357410 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f64fc0a2620 0x7f64fc1457f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.553+0000 7f65009bf700 1 --2- 172.21.15.3:0/4146357410 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f64fc0a1c60 0x7f64fc0ba440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.553+0000 7f65009bf700 1 --2- 172.21.15.3:0/4146357410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64fc09fb30 0x7f64fc162e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.553+0000 7f65009bf700 1 -- 172.21.15.3:0/4146357410 >> 172.21.15.3:0/4146357410 conn(0x7f64fc06a900 msgr2=0x7f64fc0670e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:38.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.553+0000 7f65009bf700 1 -- 172.21.15.3:0/4146357410 shutdown_connections 2023-10-08T15:37:38.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.553+0000 7f65009bf700 1 -- 172.21.15.3:0/4146357410 wait complete. 2023-10-08T15:37:38.560 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.0 2023-10-08T15:37:38.560 DEBUG:teuthology.parallel:result is None 2023-10-08T15:37:38.567 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.3 2023-10-08T15:37:38.567 DEBUG:teuthology.parallel:result is None 2023-10-08T15:37:38.569 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.561+0000 7ff52c886700 1 -- 172.21.15.3:0/3410551097 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7ff508005830 con 0x7ff5280a1c60 2023-10-08T15:37:38.569 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.561+0000 7f959b2ae700 1 -- 172.21.15.3:0/1032494947 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f9570005560 con 0x7f95940b9220 2023-10-08T15:37:38.569 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.561+0000 7f95897fa700 1 -- 172.21.15.3:0/1032494947 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f958c050f70 con 0x7f95940b9220 2023-10-08T15:37:38.570 INFO:teuthology.orchestra.run.smithi003.stdout:60129542150 2023-10-08T15:37:38.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.565+0000 7ff50f7fe700 1 -- 172.21.15.3:0/3410551097 <== mon.1 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff51c04fd90 con 0x7ff5280a1c60 2023-10-08T15:37:38.570 INFO:teuthology.orchestra.run.smithi003.stdout:55834574854 2023-10-08T15:37:38.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.565+0000 7f959b2ae700 1 -- 172.21.15.3:0/1032494947 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f9578060620 msgr2=0x7f9578062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:38.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.565+0000 7f959b2ae700 1 --2- 172.21.15.3:0/1032494947 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f9578060620 0x7f9578062ad0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9590007e40 tx=0x7f9590015000 comp rx=0 tx=0).stop 2023-10-08T15:37:38.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.565+0000 7f959b2ae700 1 -- 172.21.15.3:0/1032494947 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f95940b9220 msgr2=0x7f959415de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:38.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.565+0000 7f959b2ae700 1 --2- 172.21.15.3:0/1032494947 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f95940b9220 0x7f959415de60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f958c0014a0 tx=0x7f958c009040 comp rx=0 tx=0).stop 2023-10-08T15:37:38.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.565+0000 7f959b2ae700 1 -- 172.21.15.3:0/1032494947 shutdown_connections 2023-10-08T15:37:38.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.565+0000 7f959b2ae700 1 --2- 172.21.15.3:0/1032494947 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f9578060620 0x7f9578062ad0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.565+0000 7f959b2ae700 1 --2- 172.21.15.3:0/1032494947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f959415e3a0 0x7f959415e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.565+0000 7f959b2ae700 1 --2- 172.21.15.3:0/1032494947 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f95940b9220 0x7f959415de60 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.565+0000 7f959b2ae700 1 --2- 172.21.15.3:0/1032494947 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9580003ae0 0x7f9594067310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.565+0000 7f959b2ae700 1 -- 172.21.15.3:0/1032494947 >> 172.21.15.3:0/1032494947 conn(0x7f959406a900 msgr2=0x7f95940bca80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:38.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.565+0000 7ff52c886700 1 -- 172.21.15.3:0/3410551097 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff510060760 msgr2=0x7ff510062c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:38.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.565+0000 7ff52c886700 1 --2- 172.21.15.3:0/3410551097 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff510060760 0x7ff510062c10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff52809f5c0 tx=0x7ff518017000 comp rx=0 tx=0).stop 2023-10-08T15:37:38.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.565+0000 7ff52c886700 1 -- 172.21.15.3:0/3410551097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5280a1c60 msgr2=0x7ff52809c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:38.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.565+0000 7ff52c886700 1 --2- 172.21.15.3:0/3410551097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5280a1c60 0x7ff52809c4f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff51c00b5e0 tx=0x7ff51c009120 comp rx=0 tx=0).stop 2023-10-08T15:37:38.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.565+0000 7f959b2ae700 1 -- 172.21.15.3:0/1032494947 shutdown_connections 2023-10-08T15:37:38.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.565+0000 7ff52c886700 1 -- 172.21.15.3:0/3410551097 shutdown_connections 2023-10-08T15:37:38.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.565+0000 7ff52c886700 1 --2- 172.21.15.3:0/3410551097 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff510060760 0x7ff510062c10 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.565+0000 7f959b2ae700 1 -- 172.21.15.3:0/1032494947 wait complete. 2023-10-08T15:37:38.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.565+0000 7ff52c886700 1 --2- 172.21.15.3:0/3410551097 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff5280a2620 0x7ff528096cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.565+0000 7ff52c886700 1 --2- 172.21.15.3:0/3410551097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5280a1c60 0x7ff52809c4f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.565+0000 7ff52c886700 1 --2- 172.21.15.3:0/3410551097 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff52809fb30 0x7ff52809bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.565+0000 7ff52c886700 1 -- 172.21.15.3:0/3410551097 >> 172.21.15.3:0/3410551097 conn(0x7ff52806a900 msgr2=0x7ff5280bc990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:38.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.565+0000 7ff52c886700 1 -- 172.21.15.3:0/3410551097 shutdown_connections 2023-10-08T15:37:38.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.565+0000 7ff52c886700 1 -- 172.21.15.3:0/3410551097 wait complete. 2023-10-08T15:37:38.582 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2023-10-08T15:37:38.582 DEBUG:teuthology.parallel:result is None 2023-10-08T15:37:38.584 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.6 2023-10-08T15:37:38.584 DEBUG:teuthology.parallel:result is None 2023-10-08T15:37:38.584 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-08T15:37:38.584 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T15:37:38.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.673+0000 7fde14baf700 1 Processor -- start 2023-10-08T15:37:38.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.673+0000 7fde14baf700 1 -- start start 2023-10-08T15:37:38.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.673+0000 7fde14baf700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fde100bab50 0x7fde100baf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:38.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.673+0000 7fde14baf700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fde1006df30 0x7fde10149970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:38.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.673+0000 7fde14baf700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fde10149eb0 0x7fde1014c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:38.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.673+0000 7fde14baf700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde10146da0 con 0x7fde10149eb0 2023-10-08T15:37:38.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.673+0000 7fde14baf700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde1014a330 con 0x7fde100bab50 2023-10-08T15:37:38.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.673+0000 7fde14baf700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde100b4710 con 0x7fde1006df30 2023-10-08T15:37:38.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.673+0000 7fde0ffff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fde10149eb0 0x7fde1014c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:38.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.673+0000 7fde0ffff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fde10149eb0 0x7fde1014c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44058/0 (socket says 172.21.15.3:44058) 2023-10-08T15:37:38.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.673+0000 7fde0ffff700 1 -- 172.21.15.3:0/2091834988 learned_addr learned my addr 172.21.15.3:0/2091834988 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:38.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.673+0000 7fde0effd700 1 --2- 172.21.15.3:0/2091834988 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fde1006df30 0x7fde10149970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:38.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.673+0000 7fde0f7fe700 1 --2- 172.21.15.3:0/2091834988 >> v2:172.21.15.50:3300/0 conn(0x7fde100bab50 0x7fde100baf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:38.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.673+0000 7fde0ffff700 1 -- 172.21.15.3:0/2091834988 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fde1006df30 msgr2=0x7fde10149970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:38.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.673+0000 7fde0ffff700 1 --2- 172.21.15.3:0/2091834988 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fde1006df30 0x7fde10149970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.673+0000 7fde0ffff700 1 -- 172.21.15.3:0/2091834988 >> v2:172.21.15.50:3300/0 conn(0x7fde100bab50 msgr2=0x7fde100baf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:38.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.673+0000 7fde0ffff700 1 --2- 172.21.15.3:0/2091834988 >> v2:172.21.15.50:3300/0 conn(0x7fde100bab50 0x7fde100baf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.686 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.673+0000 7fde0ffff700 1 -- 172.21.15.3:0/2091834988 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde100b4050 con 0x7fde10149eb0 2023-10-08T15:37:38.686 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.673+0000 7fde0ffff700 1 --2- 172.21.15.3:0/2091834988 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fde10149eb0 0x7fde1014c9c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fde10063240 tx=0x7fddf8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74853aec5babcda1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:38.686 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.677+0000 7fde0e7fc700 1 -- 172.21.15.3:0/2091834988 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf800b640 con 0x7fde10149eb0 2023-10-08T15:37:38.686 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.677+0000 7fde0e7fc700 1 -- 172.21.15.3:0/2091834988 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf800b7a0 con 0x7fde10149eb0 2023-10-08T15:37:38.686 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.677+0000 7fde0e7fc700 1 -- 172.21.15.3:0/2091834988 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf800bb40 con 0x7fde10149eb0 2023-10-08T15:37:38.689 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.677+0000 7fde14baf700 1 -- 172.21.15.3:0/2091834988 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fde10149eb0 msgr2=0x7fde1014c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:38.689 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.677+0000 7fde14baf700 1 --2- 172.21.15.3:0/2091834988 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fde10149eb0 0x7fde1014c9c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fde10063240 tx=0x7fddf8009250 comp rx=0 tx=0).stop 2023-10-08T15:37:38.689 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.677+0000 7fde14baf700 1 -- 172.21.15.3:0/2091834988 shutdown_connections 2023-10-08T15:37:38.689 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.677+0000 7fde14baf700 1 --2- 172.21.15.3:0/2091834988 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fde1006df30 0x7fde10149970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.689 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.677+0000 7fde14baf700 1 --2- 172.21.15.3:0/2091834988 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fde10149eb0 0x7fde1014c9c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.689 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.677+0000 7fde14baf700 1 --2- 172.21.15.3:0/2091834988 >> v2:172.21.15.50:3300/0 conn(0x7fde100bab50 0x7fde100baf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.689 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.677+0000 7fde14baf700 1 -- 172.21.15.3:0/2091834988 >> 172.21.15.3:0/2091834988 conn(0x7fde100be4a0 msgr2=0x7fde100ba440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:38.689 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.677+0000 7fde14baf700 1 -- 172.21.15.3:0/2091834988 shutdown_connections 2023-10-08T15:37:38.689 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.677+0000 7fde14baf700 1 -- 172.21.15.3:0/2091834988 wait complete. 2023-10-08T15:37:38.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.677+0000 7fde14baf700 1 Processor -- start 2023-10-08T15:37:38.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.677+0000 7fde14baf700 1 -- start start 2023-10-08T15:37:38.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.677+0000 7fde14baf700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde1006df30 0x7fde1015e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:38.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.677+0000 7fde14baf700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fde100bab50 0x7fde100b9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:38.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.677+0000 7fde14baf700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fde10149eb0 0x7fde1009a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:38.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.677+0000 7fde14baf700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde100b3c90 con 0x7fde10149eb0 2023-10-08T15:37:38.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.677+0000 7fde14baf700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde1015adc0 con 0x7fde1006df30 2023-10-08T15:37:38.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.677+0000 7fde14baf700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde1015a790 con 0x7fde100bab50 2023-10-08T15:37:38.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.677+0000 7fde0ffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fde10149eb0 0x7fde1009a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:38.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.677+0000 7fde0ffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fde10149eb0 0x7fde1009a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44068/0 (socket says 172.21.15.3:44068) 2023-10-08T15:37:38.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.677+0000 7fde0effd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fde100bab50 0x7fde100b9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:38.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.677+0000 7fde0ffff700 1 -- 172.21.15.3:0/1664138608 learned_addr learned my addr 172.21.15.3:0/1664138608 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:38.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.677+0000 7fde0f7fe700 1 --2- 172.21.15.3:0/1664138608 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde1006df30 0x7fde1015e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:38.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.681+0000 7fde0effd700 1 -- 172.21.15.3:0/1664138608 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde1006df30 msgr2=0x7fde1015e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:38.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.681+0000 7fde0effd700 1 --2- 172.21.15.3:0/1664138608 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde1006df30 0x7fde1015e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.681+0000 7fde0effd700 1 -- 172.21.15.3:0/1664138608 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fde10149eb0 msgr2=0x7fde1009a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:38.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.681+0000 7fde0effd700 1 --2- 172.21.15.3:0/1664138608 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fde10149eb0 0x7fde1009a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.681+0000 7fde0effd700 1 -- 172.21.15.3:0/1664138608 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf80094f0 con 0x7fde100bab50 2023-10-08T15:37:38.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.681+0000 7fde0ffff700 1 --2- 172.21.15.3:0/1664138608 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fde10149eb0 0x7fde1009a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:37:38.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.681+0000 7fde0effd700 1 --2- 172.21.15.3:0/1664138608 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fde100bab50 0x7fde100b9730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fde00009f00 tx=0x7fde0000b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:38.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.681+0000 7fde077fe700 1 -- 172.21.15.3:0/1664138608 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde0000cb70 con 0x7fde100bab50 2023-10-08T15:37:38.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.681+0000 7fde077fe700 1 -- 172.21.15.3:0/1664138608 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde0000f040 con 0x7fde100bab50 2023-10-08T15:37:38.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.681+0000 7fde077fe700 1 -- 172.21.15.3:0/1664138608 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde00014480 con 0x7fde100bab50 2023-10-08T15:37:38.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.681+0000 7fde14baf700 1 -- 172.21.15.3:0/1664138608 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde100b9c70 con 0x7fde100bab50 2023-10-08T15:37:38.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.681+0000 7fde14baf700 1 -- 172.21.15.3:0/1664138608 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde1009ae70 con 0x7fde100bab50 2023-10-08T15:37:38.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.681+0000 7fde14baf700 1 -- 172.21.15.3:0/1664138608 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde1005ecf0 con 0x7fde100bab50 2023-10-08T15:37:38.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.681+0000 7fde077fe700 1 -- 172.21.15.3:0/1664138608 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fde000147f0 con 0x7fde100bab50 2023-10-08T15:37:38.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.685+0000 7fde077fe700 1 --2- 172.21.15.3:0/1664138608 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fddf4060550 0x7fddf4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:38.693 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.685+0000 7fde077fe700 1 -- 172.21.15.3:0/1664138608 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fde0007dab0 con 0x7fde100bab50 2023-10-08T15:37:38.693 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.685+0000 7fde0f7fe700 1 --2- 172.21.15.3:0/1664138608 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fddf4060550 0x7fddf4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:38.693 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.685+0000 7fde0f7fe700 1 --2- 172.21.15.3:0/1664138608 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fddf4060550 0x7fddf4062a00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fde08009db0 tx=0x7fde080091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:38.698 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.693+0000 7fde077fe700 1 -- 172.21.15.3:0/1664138608 <== mon.2 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fde0004e0a0 con 0x7fde100bab50 2023-10-08T15:37:38.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.845+0000 7fde14baf700 1 -- 172.21.15.3:0/1664138608 --> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fde1006dd10 con 0x7fddf4060550 2023-10-08T15:37:38.959 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.865+0000 7fde077fe700 1 -- 172.21.15.3:0/1664138608 <== mgr.4102 v2:172.21.15.50:6832/33268 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264497 (secure 0 0 0) 0x7fde1006dd10 con 0x7fddf4060550 2023-10-08T15:37:38.962 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:37:38.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.869+0000 7fde14baf700 1 -- 172.21.15.3:0/1664138608 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fddf4060550 msgr2=0x7fddf4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:38.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.869+0000 7fde14baf700 1 --2- 172.21.15.3:0/1664138608 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fddf4060550 0x7fddf4062a00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fde08009db0 tx=0x7fde080091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.869+0000 7fde14baf700 1 -- 172.21.15.3:0/1664138608 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fde100bab50 msgr2=0x7fde100b9730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:38.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.869+0000 7fde14baf700 1 --2- 172.21.15.3:0/1664138608 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fde100bab50 0x7fde100b9730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fde00009f00 tx=0x7fde0000b040 comp rx=0 tx=0).stop 2023-10-08T15:37:38.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.869+0000 7fde14baf700 1 -- 172.21.15.3:0/1664138608 shutdown_connections 2023-10-08T15:37:38.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.869+0000 7fde14baf700 1 --2- 172.21.15.3:0/1664138608 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fddf4060550 0x7fddf4062a00 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.869+0000 7fde14baf700 1 --2- 172.21.15.3:0/1664138608 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fde10149eb0 0x7fde1009a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.965 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.869+0000 7fde14baf700 1 --2- 172.21.15.3:0/1664138608 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fde100bab50 0x7fde100b9730 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.965 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.869+0000 7fde14baf700 1 --2- 172.21.15.3:0/1664138608 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde1006df30 0x7fde1015e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:38.965 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.869+0000 7fde14baf700 1 -- 172.21.15.3:0/1664138608 >> 172.21.15.3:0/1664138608 conn(0x7fde100be4a0 msgr2=0x7fde10068800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:38.965 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.869+0000 7fde14baf700 1 -- 172.21.15.3:0/1664138608 shutdown_connections 2023-10-08T15:37:38.965 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:38.869+0000 7fde14baf700 1 -- 172.21.15.3:0/1664138608 wait complete. 2023-10-08T15:37:38.965 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2023-10-08T15:37:38.967 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-10-08T15:37:38.512378+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2396448,"kb_used_data":1760,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752578272,"statfs":{"total":773094113280,"available":770640150528,"internally_reserved":0,"allocated":1802240,"data_stored":1742276,"data_compressed":66282,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.497810"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.053739+0000","last_change":"2023-10-08T15:37:26.047226+0000","last_active":"2023-10-08T15:37:26.053739+0000","last_peered":"2023-10-08T15:37:26.053739+0000","last_clean":"2023-10-08T15:37:26.053739+0000","last_became_active":"2023-10-08T15:37:26.046910+0000","last_became_peered":"2023-10-08T15:37:26.046910+0000","last_unstale":"2023-10-08T15:37:26.053739+0000","last_undegraded":"2023-10-08T15:37:26.053739+0000","last_fullsized":"2023-10-08T15:37:26.053739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:15:10.097776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.048869+0000","last_change":"2023-10-08T15:37:26.044911+0000","last_active":"2023-10-08T15:37:26.048869+0000","last_peered":"2023-10-08T15:37:26.048869+0000","last_clean":"2023-10-08T15:37:26.048869+0000","last_became_active":"2023-10-08T15:37:26.044586+0000","last_became_peered":"2023-10-08T15:37:26.044586+0000","last_unstale":"2023-10-08T15:37:26.048869+0000","last_undegraded":"2023-10-08T15:37:26.048869+0000","last_fullsized":"2023-10-08T15:37:26.048869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:56.482633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.046260+0000","last_change":"2023-10-08T15:37:26.040753+0000","last_active":"2023-10-08T15:37:26.046260+0000","last_peered":"2023-10-08T15:37:26.046260+0000","last_clean":"2023-10-08T15:37:26.046260+0000","last_became_active":"2023-10-08T15:37:26.040446+0000","last_became_peered":"2023-10-08T15:37:26.040446+0000","last_unstale":"2023-10-08T15:37:26.046260+0000","last_undegraded":"2023-10-08T15:37:26.046260+0000","last_fullsized":"2023-10-08T15:37:26.046260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:54:46.510693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.057269+0000","last_change":"2023-10-08T15:37:26.049673+0000","last_active":"2023-10-08T15:37:26.057269+0000","last_peered":"2023-10-08T15:37:26.057269+0000","last_clean":"2023-10-08T15:37:26.057269+0000","last_became_active":"2023-10-08T15:37:26.048595+0000","last_became_peered":"2023-10-08T15:37:26.048595+0000","last_unstale":"2023-10-08T15:37:26.057269+0000","last_undegraded":"2023-10-08T15:37:26.057269+0000","last_fullsized":"2023-10-08T15:37:26.057269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:05:25.732352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.041730+0000","last_change":"2023-10-08T15:37:26.033012+0000","last_active":"2023-10-08T15:37:26.041730+0000","last_peered":"2023-10-08T15:37:26.041730+0000","last_clean":"2023-10-08T15:37:26.041730+0000","last_became_active":"2023-10-08T15:37:26.032730+0000","last_became_peered":"2023-10-08T15:37:26.032730+0000","last_unstale":"2023-10-08T15:37:26.041730+0000","last_undegraded":"2023-10-08T15:37:26.041730+0000","last_fullsized":"2023-10-08T15:37:26.041730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:24:52.143093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.054406+0000","last_change":"2023-10-08T15:37:26.046262+0000","last_active":"2023-10-08T15:37:26.054406+0000","last_peered":"2023-10-08T15:37:26.054406+0000","last_clean":"2023-10-08T15:37:26.054406+0000","last_became_active":"2023-10-08T15:37:26.045955+0000","last_became_peered":"2023-10-08T15:37:26.045955+0000","last_unstale":"2023-10-08T15:37:26.054406+0000","last_undegraded":"2023-10-08T15:37:26.054406+0000","last_fullsized":"2023-10-08T15:37:26.054406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:14:44.577836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.049470+0000","last_change":"2023-10-08T15:37:26.042885+0000","last_active":"2023-10-08T15:37:26.049470+0000","last_peered":"2023-10-08T15:37:26.049470+0000","last_clean":"2023-10-08T15:37:26.049470+0000","last_became_active":"2023-10-08T15:37:26.042523+0000","last_became_peered":"2023-10-08T15:37:26.042523+0000","last_unstale":"2023-10-08T15:37:26.049470+0000","last_undegraded":"2023-10-08T15:37:26.049470+0000","last_fullsized":"2023-10-08T15:37:26.049470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:39:02.147413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.053032+0000","last_change":"2023-10-08T15:37:26.050106+0000","last_active":"2023-10-08T15:37:26.053032+0000","last_peered":"2023-10-08T15:37:26.053032+0000","last_clean":"2023-10-08T15:37:26.053032+0000","last_became_active":"2023-10-08T15:37:26.049801+0000","last_became_peered":"2023-10-08T15:37:26.049801+0000","last_unstale":"2023-10-08T15:37:26.053032+0000","last_undegraded":"2023-10-08T15:37:26.053032+0000","last_fullsized":"2023-10-08T15:37:26.053032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:48.862001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.041806+0000","last_change":"2023-10-08T15:37:26.034922+0000","last_active":"2023-10-08T15:37:26.041806+0000","last_peered":"2023-10-08T15:37:26.041806+0000","last_clean":"2023-10-08T15:37:26.041806+0000","last_became_active":"2023-10-08T15:37:26.034328+0000","last_became_peered":"2023-10-08T15:37:26.034328+0000","last_unstale":"2023-10-08T15:37:26.041806+0000","last_undegraded":"2023-10-08T15:37:26.041806+0000","last_fullsized":"2023-10-08T15:37:26.041806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:40:49.862643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.056035+0000","last_change":"2023-10-08T15:37:26.055002+0000","last_active":"2023-10-08T15:37:26.056035+0000","last_peered":"2023-10-08T15:37:26.056035+0000","last_clean":"2023-10-08T15:37:26.056035+0000","last_became_active":"2023-10-08T15:37:26.054672+0000","last_became_peered":"2023-10-08T15:37:26.054672+0000","last_unstale":"2023-10-08T15:37:26.056035+0000","last_undegraded":"2023-10-08T15:37:26.056035+0000","last_fullsized":"2023-10-08T15:37:26.056035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:56.482633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.056053+0000","last_change":"2023-10-08T15:37:26.055226+0000","last_active":"2023-10-08T15:37:26.056053+0000","last_peered":"2023-10-08T15:37:26.056053+0000","last_clean":"2023-10-08T15:37:26.056053+0000","last_became_active":"2023-10-08T15:37:26.054740+0000","last_became_peered":"2023-10-08T15:37:26.054740+0000","last_unstale":"2023-10-08T15:37:26.056053+0000","last_undegraded":"2023-10-08T15:37:26.056053+0000","last_fullsized":"2023-10-08T15:37:26.056053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:13:29.705445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.056900+0000","last_change":"2023-10-08T15:37:26.039886+0000","last_active":"2023-10-08T15:37:26.056900+0000","last_peered":"2023-10-08T15:37:26.056900+0000","last_clean":"2023-10-08T15:37:26.056900+0000","last_became_active":"2023-10-08T15:37:26.039551+0000","last_became_peered":"2023-10-08T15:37:26.039551+0000","last_unstale":"2023-10-08T15:37:26.056900+0000","last_undegraded":"2023-10-08T15:37:26.056900+0000","last_fullsized":"2023-10-08T15:37:26.056900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:18:49.734343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.039639+0000","last_change":"2023-10-08T15:37:26.036155+0000","last_active":"2023-10-08T15:37:26.039639+0000","last_peered":"2023-10-08T15:37:26.039639+0000","last_clean":"2023-10-08T15:37:26.039639+0000","last_became_active":"2023-10-08T15:37:26.035854+0000","last_became_peered":"2023-10-08T15:37:26.035854+0000","last_unstale":"2023-10-08T15:37:26.039639+0000","last_undegraded":"2023-10-08T15:37:26.039639+0000","last_fullsized":"2023-10-08T15:37:26.039639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:54:46.510693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.046268+0000","last_change":"2023-10-08T15:37:26.041053+0000","last_active":"2023-10-08T15:37:26.046268+0000","last_peered":"2023-10-08T15:37:26.046268+0000","last_clean":"2023-10-08T15:37:26.046268+0000","last_became_active":"2023-10-08T15:37:26.040408+0000","last_became_peered":"2023-10-08T15:37:26.040408+0000","last_unstale":"2023-10-08T15:37:26.046268+0000","last_undegraded":"2023-10-08T15:37:26.046268+0000","last_fullsized":"2023-10-08T15:37:26.046268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:20:49.172777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.036901+0000","last_change":"2023-10-08T15:37:26.032920+0000","last_active":"2023-10-08T15:37:26.036901+0000","last_peered":"2023-10-08T15:37:26.036901+0000","last_clean":"2023-10-08T15:37:26.036901+0000","last_became_active":"2023-10-08T15:37:26.032226+0000","last_became_peered":"2023-10-08T15:37:26.032226+0000","last_unstale":"2023-10-08T15:37:26.036901+0000","last_undegraded":"2023-10-08T15:37:26.036901+0000","last_fullsized":"2023-10-08T15:37:26.036901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:44:20.631125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.057085+0000","last_change":"2023-10-08T15:37:26.050368+0000","last_active":"2023-10-08T15:37:26.057085+0000","last_peered":"2023-10-08T15:37:26.057085+0000","last_clean":"2023-10-08T15:37:26.057085+0000","last_became_active":"2023-10-08T15:37:26.050078+0000","last_became_peered":"2023-10-08T15:37:26.050078+0000","last_unstale":"2023-10-08T15:37:26.057085+0000","last_undegraded":"2023-10-08T15:37:26.057085+0000","last_fullsized":"2023-10-08T15:37:26.057085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:56:34.490787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.054310+0000","last_change":"2023-10-08T15:37:26.045671+0000","last_active":"2023-10-08T15:37:26.054310+0000","last_peered":"2023-10-08T15:37:26.054310+0000","last_clean":"2023-10-08T15:37:26.054310+0000","last_became_active":"2023-10-08T15:37:26.045356+0000","last_became_peered":"2023-10-08T15:37:26.045356+0000","last_unstale":"2023-10-08T15:37:26.054310+0000","last_undegraded":"2023-10-08T15:37:26.054310+0000","last_fullsized":"2023-10-08T15:37:26.054310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:47:37.094485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.043896+0000","last_change":"2023-10-08T15:37:26.037867+0000","last_active":"2023-10-08T15:37:26.043896+0000","last_peered":"2023-10-08T15:37:26.043896+0000","last_clean":"2023-10-08T15:37:26.043896+0000","last_became_active":"2023-10-08T15:37:26.037579+0000","last_became_peered":"2023-10-08T15:37:26.037579+0000","last_unstale":"2023-10-08T15:37:26.043896+0000","last_undegraded":"2023-10-08T15:37:26.043896+0000","last_fullsized":"2023-10-08T15:37:26.043896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:07.193145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.043711+0000","last_change":"2023-10-08T15:37:26.038808+0000","last_active":"2023-10-08T15:37:26.043711+0000","last_peered":"2023-10-08T15:37:26.043711+0000","last_clean":"2023-10-08T15:37:26.043711+0000","last_became_active":"2023-10-08T15:37:26.038502+0000","last_became_peered":"2023-10-08T15:37:26.038502+0000","last_unstale":"2023-10-08T15:37:26.043711+0000","last_undegraded":"2023-10-08T15:37:26.043711+0000","last_fullsized":"2023-10-08T15:37:26.043711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:20:17.146211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.059517+0000","last_change":"2023-10-08T15:37:26.057588+0000","last_active":"2023-10-08T15:37:26.059517+0000","last_peered":"2023-10-08T15:37:26.059517+0000","last_clean":"2023-10-08T15:37:26.059517+0000","last_became_active":"2023-10-08T15:37:26.057292+0000","last_became_peered":"2023-10-08T15:37:26.057292+0000","last_unstale":"2023-10-08T15:37:26.059517+0000","last_undegraded":"2023-10-08T15:37:26.059517+0000","last_fullsized":"2023-10-08T15:37:26.059517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:38:52.246025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.049010+0000","last_change":"2023-10-08T15:37:26.044085+0000","last_active":"2023-10-08T15:37:26.049010+0000","last_peered":"2023-10-08T15:37:26.049010+0000","last_clean":"2023-10-08T15:37:26.049010+0000","last_became_active":"2023-10-08T15:37:26.043779+0000","last_became_peered":"2023-10-08T15:37:26.043779+0000","last_unstale":"2023-10-08T15:37:26.049010+0000","last_undegraded":"2023-10-08T15:37:26.049010+0000","last_fullsized":"2023-10-08T15:37:26.049010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:31:04.163648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.054276+0000","last_change":"2023-10-08T15:37:26.045121+0000","last_active":"2023-10-08T15:37:26.054276+0000","last_peered":"2023-10-08T15:37:26.054276+0000","last_clean":"2023-10-08T15:37:26.054276+0000","last_became_active":"2023-10-08T15:37:26.044638+0000","last_became_peered":"2023-10-08T15:37:26.044638+0000","last_unstale":"2023-10-08T15:37:26.054276+0000","last_undegraded":"2023-10-08T15:37:26.054276+0000","last_fullsized":"2023-10-08T15:37:26.054276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:45:12.654892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.061107+0000","last_change":"2023-10-08T15:37:26.056315+0000","last_active":"2023-10-08T15:37:26.061107+0000","last_peered":"2023-10-08T15:37:26.061107+0000","last_clean":"2023-10-08T15:37:26.061107+0000","last_became_active":"2023-10-08T15:37:26.056048+0000","last_became_peered":"2023-10-08T15:37:26.056048+0000","last_unstale":"2023-10-08T15:37:26.061107+0000","last_undegraded":"2023-10-08T15:37:26.061107+0000","last_fullsized":"2023-10-08T15:37:26.061107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:10:03.706049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.054064+0000","last_change":"2023-10-08T15:37:26.035585+0000","last_active":"2023-10-08T15:37:26.054064+0000","last_peered":"2023-10-08T15:37:26.054064+0000","last_clean":"2023-10-08T15:37:26.054064+0000","last_became_active":"2023-10-08T15:37:26.035286+0000","last_became_peered":"2023-10-08T15:37:26.035286+0000","last_unstale":"2023-10-08T15:37:26.054064+0000","last_undegraded":"2023-10-08T15:37:26.054064+0000","last_fullsized":"2023-10-08T15:37:26.054064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:15:33.124525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.060750+0000","last_change":"2023-10-08T15:37:26.056162+0000","last_active":"2023-10-08T15:37:26.060750+0000","last_peered":"2023-10-08T15:37:26.060750+0000","last_clean":"2023-10-08T15:37:26.060750+0000","last_became_active":"2023-10-08T15:37:26.055788+0000","last_became_peered":"2023-10-08T15:37:26.055788+0000","last_unstale":"2023-10-08T15:37:26.060750+0000","last_undegraded":"2023-10-08T15:37:26.060750+0000","last_fullsized":"2023-10-08T15:37:26.060750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:31:04.163648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.045525+0000","last_change":"2023-10-08T15:37:26.043352+0000","last_active":"2023-10-08T15:37:26.045525+0000","last_peered":"2023-10-08T15:37:26.045525+0000","last_clean":"2023-10-08T15:37:26.045525+0000","last_became_active":"2023-10-08T15:37:26.043051+0000","last_became_peered":"2023-10-08T15:37:26.043051+0000","last_unstale":"2023-10-08T15:37:26.045525+0000","last_undegraded":"2023-10-08T15:37:26.045525+0000","last_fullsized":"2023-10-08T15:37:26.045525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:10:14.668770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.037359+0000","last_change":"2023-10-08T15:37:26.034315+0000","last_active":"2023-10-08T15:37:26.037359+0000","last_peered":"2023-10-08T15:37:26.037359+0000","last_clean":"2023-10-08T15:37:26.037359+0000","last_became_active":"2023-10-08T15:37:26.032177+0000","last_became_peered":"2023-10-08T15:37:26.032177+0000","last_unstale":"2023-10-08T15:37:26.037359+0000","last_undegraded":"2023-10-08T15:37:26.037359+0000","last_fullsized":"2023-10-08T15:37:26.037359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:49:47.826663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.050562+0000","last_change":"2023-10-08T15:37:26.047383+0000","last_active":"2023-10-08T15:37:26.050562+0000","last_peered":"2023-10-08T15:37:26.050562+0000","last_clean":"2023-10-08T15:37:26.050562+0000","last_became_active":"2023-10-08T15:37:26.046845+0000","last_became_peered":"2023-10-08T15:37:26.046845+0000","last_unstale":"2023-10-08T15:37:26.050562+0000","last_undegraded":"2023-10-08T15:37:26.050562+0000","last_fullsized":"2023-10-08T15:37:26.050562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:17:23.022933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.046293+0000","last_change":"2023-10-08T15:37:26.041133+0000","last_active":"2023-10-08T15:37:26.046293+0000","last_peered":"2023-10-08T15:37:26.046293+0000","last_clean":"2023-10-08T15:37:26.046293+0000","last_became_active":"2023-10-08T15:37:26.040867+0000","last_became_peered":"2023-10-08T15:37:26.040867+0000","last_unstale":"2023-10-08T15:37:26.046293+0000","last_undegraded":"2023-10-08T15:37:26.046293+0000","last_fullsized":"2023-10-08T15:37:26.046293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:10:03.706049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.054247+0000","last_change":"2023-10-08T15:37:26.035125+0000","last_active":"2023-10-08T15:37:26.054247+0000","last_peered":"2023-10-08T15:37:26.054247+0000","last_clean":"2023-10-08T15:37:26.054247+0000","last_became_active":"2023-10-08T15:37:26.034739+0000","last_became_peered":"2023-10-08T15:37:26.034739+0000","last_unstale":"2023-10-08T15:37:26.054247+0000","last_undegraded":"2023-10-08T15:37:26.054247+0000","last_fullsized":"2023-10-08T15:37:26.054247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:38:43.660811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.038213+0000","last_change":"2023-10-08T15:37:26.030988+0000","last_active":"2023-10-08T15:37:26.038213+0000","last_peered":"2023-10-08T15:37:26.038213+0000","last_clean":"2023-10-08T15:37:26.038213+0000","last_became_active":"2023-10-08T15:37:26.030522+0000","last_became_peered":"2023-10-08T15:37:26.030522+0000","last_unstale":"2023-10-08T15:37:26.038213+0000","last_undegraded":"2023-10-08T15:37:26.038213+0000","last_fullsized":"2023-10-08T15:37:26.038213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:37:45.941867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.049875+0000","last_change":"2023-10-08T15:37:26.046534+0000","last_active":"2023-10-08T15:37:26.049875+0000","last_peered":"2023-10-08T15:37:26.049875+0000","last_clean":"2023-10-08T15:37:26.049875+0000","last_became_active":"2023-10-08T15:37:26.046213+0000","last_became_peered":"2023-10-08T15:37:26.046213+0000","last_unstale":"2023-10-08T15:37:26.049875+0000","last_undegraded":"2023-10-08T15:37:26.049875+0000","last_fullsized":"2023-10-08T15:37:26.049875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:44:20.631125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.047730+0000","last_change":"2023-10-08T15:37:26.029621+0000","last_active":"2023-10-08T15:37:26.047730+0000","last_peered":"2023-10-08T15:37:26.047730+0000","last_clean":"2023-10-08T15:37:26.047730+0000","last_became_active":"2023-10-08T15:37:26.029280+0000","last_became_peered":"2023-10-08T15:37:26.029280+0000","last_unstale":"2023-10-08T15:37:26.047730+0000","last_undegraded":"2023-10-08T15:37:26.047730+0000","last_fullsized":"2023-10-08T15:37:26.047730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:52:17.141125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.042428+0000","last_change":"2023-10-08T15:37:25.030754+0000","last_active":"2023-10-08T15:37:26.042428+0000","last_peered":"2023-10-08T15:37:26.042428+0000","last_clean":"2023-10-08T15:37:26.042428+0000","last_became_active":"2023-10-08T15:37:25.030391+0000","last_became_peered":"2023-10-08T15:37:25.030391+0000","last_unstale":"2023-10-08T15:37:26.042428+0000","last_undegraded":"2023-10-08T15:37:26.042428+0000","last_fullsized":"2023-10-08T15:37:26.042428+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:12:17.158973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.060787+0000","last_change":"2023-10-08T15:37:26.057810+0000","last_active":"2023-10-08T15:37:26.060787+0000","last_peered":"2023-10-08T15:37:26.060787+0000","last_clean":"2023-10-08T15:37:26.060787+0000","last_became_active":"2023-10-08T15:37:26.057527+0000","last_became_peered":"2023-10-08T15:37:26.057527+0000","last_unstale":"2023-10-08T15:37:26.060787+0000","last_undegraded":"2023-10-08T15:37:26.060787+0000","last_fullsized":"2023-10-08T15:37:26.060787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:03:31.974502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.058236+0000","last_change":"2023-10-08T15:37:25.031114+0000","last_active":"2023-10-08T15:37:26.058236+0000","last_peered":"2023-10-08T15:37:26.058236+0000","last_clean":"2023-10-08T15:37:26.058236+0000","last_became_active":"2023-10-08T15:37:25.030559+0000","last_became_peered":"2023-10-08T15:37:25.030559+0000","last_unstale":"2023-10-08T15:37:26.058236+0000","last_undegraded":"2023-10-08T15:37:26.058236+0000","last_fullsized":"2023-10-08T15:37:26.058236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:17:55.698139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.022121+0000","last_change":"2023-10-08T15:37:25.030150+0000","last_active":"2023-10-08T15:37:26.022121+0000","last_peered":"2023-10-08T15:37:26.022121+0000","last_clean":"2023-10-08T15:37:26.022121+0000","last_became_active":"2023-10-08T15:37:25.029857+0000","last_became_peered":"2023-10-08T15:37:25.029857+0000","last_unstale":"2023-10-08T15:37:26.022121+0000","last_undegraded":"2023-10-08T15:37:26.022121+0000","last_fullsized":"2023-10-08T15:37:26.022121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:17:10.911391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.046155+0000","last_change":"2023-10-08T15:37:26.044512+0000","last_active":"2023-10-08T15:37:26.046155+0000","last_peered":"2023-10-08T15:37:26.046155+0000","last_clean":"2023-10-08T15:37:26.046155+0000","last_became_active":"2023-10-08T15:37:26.044155+0000","last_became_peered":"2023-10-08T15:37:26.044155+0000","last_unstale":"2023-10-08T15:37:26.046155+0000","last_undegraded":"2023-10-08T15:37:26.046155+0000","last_fullsized":"2023-10-08T15:37:26.046155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:20:26.216438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.028350+0000","last_change":"2023-10-08T15:37:25.041282+0000","last_active":"2023-10-08T15:37:26.028350+0000","last_peered":"2023-10-08T15:37:26.028350+0000","last_clean":"2023-10-08T15:37:26.028350+0000","last_became_active":"2023-10-08T15:37:25.040931+0000","last_became_peered":"2023-10-08T15:37:25.040931+0000","last_unstale":"2023-10-08T15:37:26.028350+0000","last_undegraded":"2023-10-08T15:37:26.028350+0000","last_fullsized":"2023-10-08T15:37:26.028350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:17:10.911391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.036843+0000","last_change":"2023-10-08T15:37:26.032685+0000","last_active":"2023-10-08T15:37:26.036843+0000","last_peered":"2023-10-08T15:37:26.036843+0000","last_clean":"2023-10-08T15:37:26.036843+0000","last_became_active":"2023-10-08T15:37:26.031819+0000","last_became_peered":"2023-10-08T15:37:26.031819+0000","last_unstale":"2023-10-08T15:37:26.036843+0000","last_undegraded":"2023-10-08T15:37:26.036843+0000","last_fullsized":"2023-10-08T15:37:26.036843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:10:14.668770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.034785+0000","last_change":"2023-10-08T15:37:25.039812+0000","last_active":"2023-10-08T15:37:26.034785+0000","last_peered":"2023-10-08T15:37:26.034785+0000","last_clean":"2023-10-08T15:37:26.034785+0000","last_became_active":"2023-10-08T15:37:25.039165+0000","last_became_peered":"2023-10-08T15:37:25.039165+0000","last_unstale":"2023-10-08T15:37:26.034785+0000","last_undegraded":"2023-10-08T15:37:26.034785+0000","last_fullsized":"2023-10-08T15:37:26.034785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:09:10.975405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.057652+0000","last_change":"2023-10-08T15:37:26.050389+0000","last_active":"2023-10-08T15:37:26.057652+0000","last_peered":"2023-10-08T15:37:26.057652+0000","last_clean":"2023-10-08T15:37:26.057652+0000","last_became_active":"2023-10-08T15:37:26.050059+0000","last_became_peered":"2023-10-08T15:37:26.050059+0000","last_unstale":"2023-10-08T15:37:26.057652+0000","last_undegraded":"2023-10-08T15:37:26.057652+0000","last_fullsized":"2023-10-08T15:37:26.057652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:37:10.263562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.031544+0000","last_change":"2023-10-08T15:37:25.037788+0000","last_active":"2023-10-08T15:37:26.031544+0000","last_peered":"2023-10-08T15:37:26.031544+0000","last_clean":"2023-10-08T15:37:26.031544+0000","last_became_active":"2023-10-08T15:37:25.037390+0000","last_became_peered":"2023-10-08T15:37:25.037390+0000","last_unstale":"2023-10-08T15:37:26.031544+0000","last_undegraded":"2023-10-08T15:37:26.031544+0000","last_fullsized":"2023-10-08T15:37:26.031544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:33:24.209108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.054995+0000","last_change":"2023-10-08T15:37:26.052388+0000","last_active":"2023-10-08T15:37:26.054995+0000","last_peered":"2023-10-08T15:37:26.054995+0000","last_clean":"2023-10-08T15:37:26.054995+0000","last_became_active":"2023-10-08T15:37:26.052080+0000","last_became_peered":"2023-10-08T15:37:26.052080+0000","last_unstale":"2023-10-08T15:37:26.054995+0000","last_undegraded":"2023-10-08T15:37:26.054995+0000","last_fullsized":"2023-10-08T15:37:26.054995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:17:23.022933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.049288+0000","last_change":"2023-10-08T15:37:25.040184+0000","last_active":"2023-10-08T15:37:26.049288+0000","last_peered":"2023-10-08T15:37:26.049288+0000","last_clean":"2023-10-08T15:37:26.049288+0000","last_became_active":"2023-10-08T15:37:25.039952+0000","last_became_peered":"2023-10-08T15:37:25.039952+0000","last_unstale":"2023-10-08T15:37:26.049288+0000","last_undegraded":"2023-10-08T15:37:26.049288+0000","last_fullsized":"2023-10-08T15:37:26.049288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:37:44.937225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.056434+0000","last_change":"2023-10-08T15:37:26.030498+0000","last_active":"2023-10-08T15:37:26.056434+0000","last_peered":"2023-10-08T15:37:26.056434+0000","last_clean":"2023-10-08T15:37:26.056434+0000","last_became_active":"2023-10-08T15:37:26.029947+0000","last_became_peered":"2023-10-08T15:37:26.029947+0000","last_unstale":"2023-10-08T15:37:26.056434+0000","last_undegraded":"2023-10-08T15:37:26.056434+0000","last_fullsized":"2023-10-08T15:37:26.056434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:21:26.142526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.049086+0000","last_change":"2023-10-08T15:37:25.034475+0000","last_active":"2023-10-08T15:37:26.049086+0000","last_peered":"2023-10-08T15:37:26.049086+0000","last_clean":"2023-10-08T15:37:26.049086+0000","last_became_active":"2023-10-08T15:37:25.034280+0000","last_became_peered":"2023-10-08T15:37:25.034280+0000","last_unstale":"2023-10-08T15:37:26.049086+0000","last_undegraded":"2023-10-08T15:37:26.049086+0000","last_fullsized":"2023-10-08T15:37:26.049086+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:14:36.405051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.041985+0000","last_change":"2023-10-08T15:37:26.037712+0000","last_active":"2023-10-08T15:37:26.041985+0000","last_peered":"2023-10-08T15:37:26.041985+0000","last_clean":"2023-10-08T15:37:26.041985+0000","last_became_active":"2023-10-08T15:37:26.036887+0000","last_became_peered":"2023-10-08T15:37:26.036887+0000","last_unstale":"2023-10-08T15:37:26.041985+0000","last_undegraded":"2023-10-08T15:37:26.041985+0000","last_fullsized":"2023-10-08T15:37:26.041985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:25:12.941976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.057432+0000","last_change":"2023-10-08T15:37:25.029595+0000","last_active":"2023-10-08T15:37:26.057432+0000","last_peered":"2023-10-08T15:37:26.057432+0000","last_clean":"2023-10-08T15:37:26.057432+0000","last_became_active":"2023-10-08T15:37:25.029268+0000","last_became_peered":"2023-10-08T15:37:25.029268+0000","last_unstale":"2023-10-08T15:37:26.057432+0000","last_undegraded":"2023-10-08T15:37:26.057432+0000","last_fullsized":"2023-10-08T15:37:26.057432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:08:13.115248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.046362+0000","last_change":"2023-10-08T15:37:26.042309+0000","last_active":"2023-10-08T15:37:26.046362+0000","last_peered":"2023-10-08T15:37:26.046362+0000","last_clean":"2023-10-08T15:37:26.046362+0000","last_became_active":"2023-10-08T15:37:26.042045+0000","last_became_peered":"2023-10-08T15:37:26.042045+0000","last_unstale":"2023-10-08T15:37:26.046362+0000","last_undegraded":"2023-10-08T15:37:26.046362+0000","last_fullsized":"2023-10-08T15:37:26.046362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:09:23.414069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.028559+0000","last_change":"2023-10-08T15:37:25.040580+0000","last_active":"2023-10-08T15:37:26.028559+0000","last_peered":"2023-10-08T15:37:26.028559+0000","last_clean":"2023-10-08T15:37:26.028559+0000","last_became_active":"2023-10-08T15:37:25.039401+0000","last_became_peered":"2023-10-08T15:37:25.039401+0000","last_unstale":"2023-10-08T15:37:26.028559+0000","last_undegraded":"2023-10-08T15:37:26.028559+0000","last_fullsized":"2023-10-08T15:37:26.028559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:12:32.395357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.041952+0000","last_change":"2023-10-08T15:37:26.037408+0000","last_active":"2023-10-08T15:37:26.041952+0000","last_peered":"2023-10-08T15:37:26.041952+0000","last_clean":"2023-10-08T15:37:26.041952+0000","last_became_active":"2023-10-08T15:37:26.037124+0000","last_became_peered":"2023-10-08T15:37:26.037124+0000","last_unstale":"2023-10-08T15:37:26.041952+0000","last_undegraded":"2023-10-08T15:37:26.041952+0000","last_fullsized":"2023-10-08T15:37:26.041952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:02:42.564039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.027097+0000","last_change":"2023-10-08T15:37:25.024341+0000","last_active":"2023-10-08T15:37:26.027097+0000","last_peered":"2023-10-08T15:37:26.027097+0000","last_clean":"2023-10-08T15:37:26.027097+0000","last_became_active":"2023-10-08T15:37:25.023991+0000","last_became_peered":"2023-10-08T15:37:25.023991+0000","last_unstale":"2023-10-08T15:37:26.027097+0000","last_undegraded":"2023-10-08T15:37:26.027097+0000","last_fullsized":"2023-10-08T15:37:26.027097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:20:36.667774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.049857+0000","last_change":"2023-10-08T15:37:26.046530+0000","last_active":"2023-10-08T15:37:26.049857+0000","last_peered":"2023-10-08T15:37:26.049857+0000","last_clean":"2023-10-08T15:37:26.049857+0000","last_became_active":"2023-10-08T15:37:26.046211+0000","last_became_peered":"2023-10-08T15:37:26.046211+0000","last_unstale":"2023-10-08T15:37:26.049857+0000","last_undegraded":"2023-10-08T15:37:26.049857+0000","last_fullsized":"2023-10-08T15:37:26.049857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:49:47.826663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.042536+0000","last_change":"2023-10-08T15:37:25.024875+0000","last_active":"2023-10-08T15:37:26.042536+0000","last_peered":"2023-10-08T15:37:26.042536+0000","last_clean":"2023-10-08T15:37:26.042536+0000","last_became_active":"2023-10-08T15:37:25.023897+0000","last_became_peered":"2023-10-08T15:37:25.023897+0000","last_unstale":"2023-10-08T15:37:26.042536+0000","last_undegraded":"2023-10-08T15:37:26.042536+0000","last_fullsized":"2023-10-08T15:37:26.042536+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:51:33.993191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.053797+0000","last_change":"2023-10-08T15:37:26.048199+0000","last_active":"2023-10-08T15:37:26.053797+0000","last_peered":"2023-10-08T15:37:26.053797+0000","last_clean":"2023-10-08T15:37:26.053797+0000","last_became_active":"2023-10-08T15:37:26.047816+0000","last_became_peered":"2023-10-08T15:37:26.047816+0000","last_unstale":"2023-10-08T15:37:26.053797+0000","last_undegraded":"2023-10-08T15:37:26.053797+0000","last_fullsized":"2023-10-08T15:37:26.053797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:13:29.705445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.047479+0000","last_change":"2023-10-08T15:37:25.035792+0000","last_active":"2023-10-08T15:37:26.047479+0000","last_peered":"2023-10-08T15:37:26.047479+0000","last_clean":"2023-10-08T15:37:26.047479+0000","last_became_active":"2023-10-08T15:37:25.035413+0000","last_became_peered":"2023-10-08T15:37:25.035413+0000","last_unstale":"2023-10-08T15:37:26.047479+0000","last_undegraded":"2023-10-08T15:37:26.047479+0000","last_fullsized":"2023-10-08T15:37:26.047479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:08:13.115248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.038047+0000","last_change":"2023-10-08T15:37:26.029023+0000","last_active":"2023-10-08T15:37:26.038047+0000","last_peered":"2023-10-08T15:37:26.038047+0000","last_clean":"2023-10-08T15:37:26.038047+0000","last_became_active":"2023-10-08T15:37:26.028552+0000","last_became_peered":"2023-10-08T15:37:26.028552+0000","last_unstale":"2023-10-08T15:37:26.038047+0000","last_undegraded":"2023-10-08T15:37:26.038047+0000","last_fullsized":"2023-10-08T15:37:26.038047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:10:14.668770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.039684+0000","last_change":"2023-10-08T15:37:25.033468+0000","last_active":"2023-10-08T15:37:26.039684+0000","last_peered":"2023-10-08T15:37:26.039684+0000","last_clean":"2023-10-08T15:37:26.039684+0000","last_became_active":"2023-10-08T15:37:25.033054+0000","last_became_peered":"2023-10-08T15:37:25.033054+0000","last_unstale":"2023-10-08T15:37:26.039684+0000","last_undegraded":"2023-10-08T15:37:26.039684+0000","last_fullsized":"2023-10-08T15:37:26.039684+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:03:03.753758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.037886+0000","last_change":"2023-10-08T15:37:26.028708+0000","last_active":"2023-10-08T15:37:26.037886+0000","last_peered":"2023-10-08T15:37:26.037886+0000","last_clean":"2023-10-08T15:37:26.037886+0000","last_became_active":"2023-10-08T15:37:26.028418+0000","last_became_peered":"2023-10-08T15:37:26.028418+0000","last_unstale":"2023-10-08T15:37:26.037886+0000","last_undegraded":"2023-10-08T15:37:26.037886+0000","last_fullsized":"2023-10-08T15:37:26.037886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:58:41.177656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.055778+0000","last_change":"2023-10-08T15:37:25.026007+0000","last_active":"2023-10-08T15:37:26.055778+0000","last_peered":"2023-10-08T15:37:26.055778+0000","last_clean":"2023-10-08T15:37:26.055778+0000","last_became_active":"2023-10-08T15:37:25.024633+0000","last_became_peered":"2023-10-08T15:37:25.024633+0000","last_unstale":"2023-10-08T15:37:26.055778+0000","last_undegraded":"2023-10-08T15:37:26.055778+0000","last_fullsized":"2023-10-08T15:37:26.055778+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:20:36.667774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.052950+0000","last_change":"2023-10-08T15:37:26.035368+0000","last_active":"2023-10-08T15:37:26.052950+0000","last_peered":"2023-10-08T15:37:26.052950+0000","last_clean":"2023-10-08T15:37:26.052950+0000","last_became_active":"2023-10-08T15:37:26.034994+0000","last_became_peered":"2023-10-08T15:37:26.034994+0000","last_unstale":"2023-10-08T15:37:26.052950+0000","last_undegraded":"2023-10-08T15:37:26.052950+0000","last_fullsized":"2023-10-08T15:37:26.052950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:21:41.320706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.023845+0000","last_change":"2023-10-08T15:37:25.030197+0000","last_active":"2023-10-08T15:37:26.023845+0000","last_peered":"2023-10-08T15:37:26.023845+0000","last_clean":"2023-10-08T15:37:26.023845+0000","last_became_active":"2023-10-08T15:37:25.028215+0000","last_became_peered":"2023-10-08T15:37:25.028215+0000","last_unstale":"2023-10-08T15:37:26.023845+0000","last_undegraded":"2023-10-08T15:37:26.023845+0000","last_fullsized":"2023-10-08T15:37:26.023845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:17:55.698139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.041872+0000","last_change":"2023-10-08T15:37:26.031876+0000","last_active":"2023-10-08T15:37:26.041872+0000","last_peered":"2023-10-08T15:37:26.041872+0000","last_clean":"2023-10-08T15:37:26.041872+0000","last_became_active":"2023-10-08T15:37:26.031592+0000","last_became_peered":"2023-10-08T15:37:26.031592+0000","last_unstale":"2023-10-08T15:37:26.041872+0000","last_undegraded":"2023-10-08T15:37:26.041872+0000","last_fullsized":"2023-10-08T15:37:26.041872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:39:17.396462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.017482+0000","last_change":"2023-10-08T15:37:19.380955+0000","last_active":"2023-10-08T15:37:26.017482+0000","last_peered":"2023-10-08T15:37:26.017482+0000","last_clean":"2023-10-08T15:37:26.017482+0000","last_became_active":"2023-10-08T15:37:19.378277+0000","last_became_peered":"2023-10-08T15:37:19.378277+0000","last_unstale":"2023-10-08T15:37:26.017482+0000","last_undegraded":"2023-10-08T15:37:26.017482+0000","last_fullsized":"2023-10-08T15:37:26.017482+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:17.537726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:17.537726+0000","last_clean_scrub_stamp":"2023-10-08T15:37:17.537726+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:06:26.612046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.029287+0000","last_change":"2023-10-08T15:37:25.033028+0000","last_active":"2023-10-08T15:37:26.029287+0000","last_peered":"2023-10-08T15:37:26.029287+0000","last_clean":"2023-10-08T15:37:26.029287+0000","last_became_active":"2023-10-08T15:37:25.032661+0000","last_became_peered":"2023-10-08T15:37:25.032661+0000","last_unstale":"2023-10-08T15:37:26.029287+0000","last_undegraded":"2023-10-08T15:37:26.029287+0000","last_fullsized":"2023-10-08T15:37:26.029287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:18:48.729702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.053015+0000","last_change":"2023-10-08T15:37:26.050013+0000","last_active":"2023-10-08T15:37:26.053015+0000","last_peered":"2023-10-08T15:37:26.053015+0000","last_clean":"2023-10-08T15:37:26.053015+0000","last_became_active":"2023-10-08T15:37:26.049729+0000","last_became_peered":"2023-10-08T15:37:26.049729+0000","last_unstale":"2023-10-08T15:37:26.053015+0000","last_undegraded":"2023-10-08T15:37:26.053015+0000","last_fullsized":"2023-10-08T15:37:26.053015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:35:27.592646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.017320+0000","last_change":"2023-10-08T15:37:25.029859+0000","last_active":"2023-10-08T15:37:26.017320+0000","last_peered":"2023-10-08T15:37:26.017320+0000","last_clean":"2023-10-08T15:37:26.017320+0000","last_became_active":"2023-10-08T15:37:25.029537+0000","last_became_peered":"2023-10-08T15:37:25.029537+0000","last_unstale":"2023-10-08T15:37:26.017320+0000","last_undegraded":"2023-10-08T15:37:26.017320+0000","last_fullsized":"2023-10-08T15:37:26.017320+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:37:44.937225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.060797+0000","last_change":"2023-10-08T15:37:26.057875+0000","last_active":"2023-10-08T15:37:26.060797+0000","last_peered":"2023-10-08T15:37:26.060797+0000","last_clean":"2023-10-08T15:37:26.060797+0000","last_became_active":"2023-10-08T15:37:26.057545+0000","last_became_peered":"2023-10-08T15:37:26.057545+0000","last_unstale":"2023-10-08T15:37:26.060797+0000","last_undegraded":"2023-10-08T15:37:26.060797+0000","last_fullsized":"2023-10-08T15:37:26.060797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:10.725842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.022360+0000","last_change":"2023-10-08T15:37:25.035939+0000","last_active":"2023-10-08T15:37:26.022360+0000","last_peered":"2023-10-08T15:37:26.022360+0000","last_clean":"2023-10-08T15:37:26.022360+0000","last_became_active":"2023-10-08T15:37:25.035628+0000","last_became_peered":"2023-10-08T15:37:25.035628+0000","last_unstale":"2023-10-08T15:37:26.022360+0000","last_undegraded":"2023-10-08T15:37:26.022360+0000","last_fullsized":"2023-10-08T15:37:26.022360+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:51:28.443377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.041424+0000","last_change":"2023-10-08T15:37:26.038726+0000","last_active":"2023-10-08T15:37:26.041424+0000","last_peered":"2023-10-08T15:37:26.041424+0000","last_clean":"2023-10-08T15:37:26.041424+0000","last_became_active":"2023-10-08T15:37:26.036653+0000","last_became_peered":"2023-10-08T15:37:26.036653+0000","last_unstale":"2023-10-08T15:37:26.041424+0000","last_undegraded":"2023-10-08T15:37:26.041424+0000","last_fullsized":"2023-10-08T15:37:26.041424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:30:40.002556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.028671+0000","last_change":"2023-10-08T15:37:25.037867+0000","last_active":"2023-10-08T15:37:26.028671+0000","last_peered":"2023-10-08T15:37:26.028671+0000","last_clean":"2023-10-08T15:37:26.028671+0000","last_became_active":"2023-10-08T15:37:25.037638+0000","last_became_peered":"2023-10-08T15:37:25.037638+0000","last_unstale":"2023-10-08T15:37:26.028671+0000","last_undegraded":"2023-10-08T15:37:26.028671+0000","last_fullsized":"2023-10-08T15:37:26.028671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:52:16.136483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.057054+0000","last_change":"2023-10-08T15:37:26.046686+0000","last_active":"2023-10-08T15:37:26.057054+0000","last_peered":"2023-10-08T15:37:26.057054+0000","last_clean":"2023-10-08T15:37:26.057054+0000","last_became_active":"2023-10-08T15:37:26.046295+0000","last_became_peered":"2023-10-08T15:37:26.046295+0000","last_unstale":"2023-10-08T15:37:26.057054+0000","last_undegraded":"2023-10-08T15:37:26.057054+0000","last_fullsized":"2023-10-08T15:37:26.057054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:27:46.266100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.014293+0000","last_change":"2023-10-08T15:37:25.034339+0000","last_active":"2023-10-08T15:37:26.014293+0000","last_peered":"2023-10-08T15:37:26.014293+0000","last_clean":"2023-10-08T15:37:26.014293+0000","last_became_active":"2023-10-08T15:37:25.034011+0000","last_became_peered":"2023-10-08T15:37:25.034011+0000","last_unstale":"2023-10-08T15:37:26.014293+0000","last_undegraded":"2023-10-08T15:37:26.014293+0000","last_fullsized":"2023-10-08T15:37:26.014293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:14:36.405051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.057481+0000","last_change":"2023-10-08T15:37:26.049468+0000","last_active":"2023-10-08T15:37:26.057481+0000","last_peered":"2023-10-08T15:37:26.057481+0000","last_clean":"2023-10-08T15:37:26.057481+0000","last_became_active":"2023-10-08T15:37:26.048647+0000","last_became_peered":"2023-10-08T15:37:26.048647+0000","last_unstale":"2023-10-08T15:37:26.057481+0000","last_undegraded":"2023-10-08T15:37:26.057481+0000","last_fullsized":"2023-10-08T15:37:26.057481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:07:54.534413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.020837+0000","last_change":"2023-10-08T15:37:25.038765+0000","last_active":"2023-10-08T15:37:26.020837+0000","last_peered":"2023-10-08T15:37:26.020837+0000","last_clean":"2023-10-08T15:37:26.020837+0000","last_became_active":"2023-10-08T15:37:25.038448+0000","last_became_peered":"2023-10-08T15:37:25.038448+0000","last_unstale":"2023-10-08T15:37:26.020837+0000","last_undegraded":"2023-10-08T15:37:26.020837+0000","last_fullsized":"2023-10-08T15:37:26.020837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:14:36.405051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.041393+0000","last_change":"2023-10-08T15:37:26.039674+0000","last_active":"2023-10-08T15:37:26.041393+0000","last_peered":"2023-10-08T15:37:26.041393+0000","last_clean":"2023-10-08T15:37:26.041393+0000","last_became_active":"2023-10-08T15:37:26.039394+0000","last_became_peered":"2023-10-08T15:37:26.039394+0000","last_unstale":"2023-10-08T15:37:26.041393+0000","last_undegraded":"2023-10-08T15:37:26.041393+0000","last_fullsized":"2023-10-08T15:37:26.041393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:01:07.561679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T15:37:27.015443+0000","last_change":"2023-10-08T15:37:25.030182+0000","last_active":"2023-10-08T15:37:27.015443+0000","last_peered":"2023-10-08T15:37:27.015443+0000","last_clean":"2023-10-08T15:37:27.015443+0000","last_became_active":"2023-10-08T15:37:25.029834+0000","last_became_peered":"2023-10-08T15:37:25.029834+0000","last_unstale":"2023-10-08T15:37:27.015443+0000","last_undegraded":"2023-10-08T15:37:27.015443+0000","last_fullsized":"2023-10-08T15:37:27.015443+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:09:10.975405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.037854+0000","last_change":"2023-10-08T15:37:26.030211+0000","last_active":"2023-10-08T15:37:26.037854+0000","last_peered":"2023-10-08T15:37:26.037854+0000","last_clean":"2023-10-08T15:37:26.037854+0000","last_became_active":"2023-10-08T15:37:26.029155+0000","last_became_peered":"2023-10-08T15:37:26.029155+0000","last_unstale":"2023-10-08T15:37:26.037854+0000","last_undegraded":"2023-10-08T15:37:26.037854+0000","last_fullsized":"2023-10-08T15:37:26.037854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:12:46.913128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.054023+0000","last_change":"2023-10-08T15:37:25.033767+0000","last_active":"2023-10-08T15:37:26.054023+0000","last_peered":"2023-10-08T15:37:26.054023+0000","last_clean":"2023-10-08T15:37:26.054023+0000","last_became_active":"2023-10-08T15:37:25.033432+0000","last_became_peered":"2023-10-08T15:37:25.033432+0000","last_unstale":"2023-10-08T15:37:26.054023+0000","last_undegraded":"2023-10-08T15:37:26.054023+0000","last_fullsized":"2023-10-08T15:37:26.054023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:18:34.111508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.049042+0000","last_change":"2023-10-08T15:37:26.044802+0000","last_active":"2023-10-08T15:37:26.049042+0000","last_peered":"2023-10-08T15:37:26.049042+0000","last_clean":"2023-10-08T15:37:26.049042+0000","last_became_active":"2023-10-08T15:37:26.044064+0000","last_became_peered":"2023-10-08T15:37:26.044064+0000","last_unstale":"2023-10-08T15:37:26.049042+0000","last_undegraded":"2023-10-08T15:37:26.049042+0000","last_fullsized":"2023-10-08T15:37:26.049042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:27:46.266100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.017243+0000","last_change":"2023-10-08T15:37:25.038017+0000","last_active":"2023-10-08T15:37:26.017243+0000","last_peered":"2023-10-08T15:37:26.017243+0000","last_clean":"2023-10-08T15:37:26.017243+0000","last_became_active":"2023-10-08T15:37:25.037738+0000","last_became_peered":"2023-10-08T15:37:25.037738+0000","last_unstale":"2023-10-08T15:37:26.017243+0000","last_undegraded":"2023-10-08T15:37:26.017243+0000","last_fullsized":"2023-10-08T15:37:26.017243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:09:10.975405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.057284+0000","last_change":"2023-10-08T15:37:26.039472+0000","last_active":"2023-10-08T15:37:26.057284+0000","last_peered":"2023-10-08T15:37:26.057284+0000","last_clean":"2023-10-08T15:37:26.057284+0000","last_became_active":"2023-10-08T15:37:26.038579+0000","last_became_peered":"2023-10-08T15:37:26.038579+0000","last_unstale":"2023-10-08T15:37:26.057284+0000","last_undegraded":"2023-10-08T15:37:26.057284+0000","last_fullsized":"2023-10-08T15:37:26.057284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:33:25.213750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.013917+0000","last_change":"2023-10-08T15:37:25.024556+0000","last_active":"2023-10-08T15:37:26.013917+0000","last_peered":"2023-10-08T15:37:26.013917+0000","last_clean":"2023-10-08T15:37:26.013917+0000","last_became_active":"2023-10-08T15:37:25.024208+0000","last_became_peered":"2023-10-08T15:37:25.024208+0000","last_unstale":"2023-10-08T15:37:26.013917+0000","last_undegraded":"2023-10-08T15:37:26.013917+0000","last_fullsized":"2023-10-08T15:37:26.013917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:18:34.111508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.039462+0000","last_change":"2023-10-08T15:37:26.035450+0000","last_active":"2023-10-08T15:37:26.039462+0000","last_peered":"2023-10-08T15:37:26.039462+0000","last_clean":"2023-10-08T15:37:26.039462+0000","last_became_active":"2023-10-08T15:37:26.034248+0000","last_became_peered":"2023-10-08T15:37:26.034248+0000","last_unstale":"2023-10-08T15:37:26.039462+0000","last_undegraded":"2023-10-08T15:37:26.039462+0000","last_fullsized":"2023-10-08T15:37:26.039462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:37:10.263562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.013177+0000","last_change":"2023-10-08T15:37:25.030789+0000","last_active":"2023-10-08T15:37:26.013177+0000","last_peered":"2023-10-08T15:37:26.013177+0000","last_clean":"2023-10-08T15:37:26.013177+0000","last_became_active":"2023-10-08T15:37:25.030435+0000","last_became_peered":"2023-10-08T15:37:25.030435+0000","last_unstale":"2023-10-08T15:37:26.013177+0000","last_undegraded":"2023-10-08T15:37:26.013177+0000","last_fullsized":"2023-10-08T15:37:26.013177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:17:55.698139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.046184+0000","last_change":"2023-10-08T15:37:26.045028+0000","last_active":"2023-10-08T15:37:26.046184+0000","last_peered":"2023-10-08T15:37:26.046184+0000","last_clean":"2023-10-08T15:37:26.046184+0000","last_became_active":"2023-10-08T15:37:26.044703+0000","last_became_peered":"2023-10-08T15:37:26.044703+0000","last_unstale":"2023-10-08T15:37:26.046184+0000","last_undegraded":"2023-10-08T15:37:26.046184+0000","last_fullsized":"2023-10-08T15:37:26.046184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:47:37.094485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.058571+0000","last_change":"2023-10-08T15:37:25.032025+0000","last_active":"2023-10-08T15:37:26.058571+0000","last_peered":"2023-10-08T15:37:26.058571+0000","last_clean":"2023-10-08T15:37:26.058571+0000","last_became_active":"2023-10-08T15:37:25.031526+0000","last_became_peered":"2023-10-08T15:37:25.031526+0000","last_unstale":"2023-10-08T15:37:26.058571+0000","last_undegraded":"2023-10-08T15:37:26.058571+0000","last_fullsized":"2023-10-08T15:37:26.058571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:20:36.667774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.059510+0000","last_change":"2023-10-08T15:37:26.057305+0000","last_active":"2023-10-08T15:37:26.059510+0000","last_peered":"2023-10-08T15:37:26.059510+0000","last_clean":"2023-10-08T15:37:26.059510+0000","last_became_active":"2023-10-08T15:37:26.056970+0000","last_became_peered":"2023-10-08T15:37:26.056970+0000","last_unstale":"2023-10-08T15:37:26.059510+0000","last_undegraded":"2023-10-08T15:37:26.059510+0000","last_fullsized":"2023-10-08T15:37:26.059510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:30:40.002556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.058725+0000","last_change":"2023-10-08T15:37:26.057363+0000","last_active":"2023-10-08T15:37:26.058725+0000","last_peered":"2023-10-08T15:37:26.058725+0000","last_clean":"2023-10-08T15:37:26.058725+0000","last_became_active":"2023-10-08T15:37:26.057058+0000","last_became_peered":"2023-10-08T15:37:26.057058+0000","last_unstale":"2023-10-08T15:37:26.058725+0000","last_undegraded":"2023-10-08T15:37:26.058725+0000","last_fullsized":"2023-10-08T15:37:26.058725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:20:26.216438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.054689+0000","last_change":"2023-10-08T15:37:25.041688+0000","last_active":"2023-10-08T15:37:26.054689+0000","last_peered":"2023-10-08T15:37:26.054689+0000","last_clean":"2023-10-08T15:37:26.054689+0000","last_became_active":"2023-10-08T15:37:25.041387+0000","last_became_peered":"2023-10-08T15:37:25.041387+0000","last_unstale":"2023-10-08T15:37:26.054689+0000","last_undegraded":"2023-10-08T15:37:26.054689+0000","last_fullsized":"2023-10-08T15:37:26.054689+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:38:23.485886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.058772+0000","last_change":"2023-10-08T15:37:26.057526+0000","last_active":"2023-10-08T15:37:26.058772+0000","last_peered":"2023-10-08T15:37:26.058772+0000","last_clean":"2023-10-08T15:37:26.058772+0000","last_became_active":"2023-10-08T15:37:26.057220+0000","last_became_peered":"2023-10-08T15:37:26.057220+0000","last_unstale":"2023-10-08T15:37:26.058772+0000","last_undegraded":"2023-10-08T15:37:26.058772+0000","last_fullsized":"2023-10-08T15:37:26.058772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:48.862001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.049539+0000","last_change":"2023-10-08T15:37:25.035362+0000","last_active":"2023-10-08T15:37:26.049539+0000","last_peered":"2023-10-08T15:37:26.049539+0000","last_clean":"2023-10-08T15:37:26.049539+0000","last_became_active":"2023-10-08T15:37:25.035068+0000","last_became_peered":"2023-10-08T15:37:25.035068+0000","last_unstale":"2023-10-08T15:37:26.049539+0000","last_undegraded":"2023-10-08T15:37:26.049539+0000","last_fullsized":"2023-10-08T15:37:26.049539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:06.188503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.052326+0000","last_change":"2023-10-08T15:37:26.050163+0000","last_active":"2023-10-08T15:37:26.052326+0000","last_peered":"2023-10-08T15:37:26.052326+0000","last_clean":"2023-10-08T15:37:26.052326+0000","last_became_active":"2023-10-08T15:37:26.049850+0000","last_became_peered":"2023-10-08T15:37:26.049850+0000","last_unstale":"2023-10-08T15:37:26.052326+0000","last_undegraded":"2023-10-08T15:37:26.052326+0000","last_fullsized":"2023-10-08T15:37:26.052326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:12:46.913128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.045285+0000","last_change":"2023-10-08T15:37:25.034880+0000","last_active":"2023-10-08T15:37:26.045285+0000","last_peered":"2023-10-08T15:37:26.045285+0000","last_clean":"2023-10-08T15:37:26.045285+0000","last_became_active":"2023-10-08T15:37:25.034547+0000","last_became_peered":"2023-10-08T15:37:25.034547+0000","last_unstale":"2023-10-08T15:37:26.045285+0000","last_undegraded":"2023-10-08T15:37:26.045285+0000","last_fullsized":"2023-10-08T15:37:26.045285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:13:24.905916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.042918+0000","last_change":"2023-10-08T15:37:26.040375+0000","last_active":"2023-10-08T15:37:26.042918+0000","last_peered":"2023-10-08T15:37:26.042918+0000","last_clean":"2023-10-08T15:37:26.042918+0000","last_became_active":"2023-10-08T15:37:26.040082+0000","last_became_peered":"2023-10-08T15:37:26.040082+0000","last_unstale":"2023-10-08T15:37:26.042918+0000","last_undegraded":"2023-10-08T15:37:26.042918+0000","last_fullsized":"2023-10-08T15:37:26.042918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:09:23.414069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.052719+0000","last_change":"2023-10-08T15:37:25.034909+0000","last_active":"2023-10-08T15:37:26.052719+0000","last_peered":"2023-10-08T15:37:26.052719+0000","last_clean":"2023-10-08T15:37:26.052719+0000","last_became_active":"2023-10-08T15:37:25.034403+0000","last_became_peered":"2023-10-08T15:37:25.034403+0000","last_unstale":"2023-10-08T15:37:26.052719+0000","last_undegraded":"2023-10-08T15:37:26.052719+0000","last_fullsized":"2023-10-08T15:37:26.052719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:27:16.596718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66282,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301648,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070192,"statfs":{"total":96636764160,"available":96327876608,"internally_reserved":0,"allocated":270336,"data_stored":660538,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2929999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3799999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301592,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070248,"statfs":{"total":96636764160,"available":96327933952,"internally_reserved":0,"allocated":212992,"data_stored":71152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.012}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.246}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4319999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542151,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297496,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074344,"statfs":{"total":96636764160,"available":96332128256,"internally_reserved":0,"allocated":212992,"data_stored":71152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]}]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297484,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074356,"statfs":{"total":96636764160,"available":96332140544,"internally_reserved":0,"allocated":200704,"data_stored":69616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0529999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542151,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297492,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074348,"statfs":{"total":96636764160,"available":96332132352,"internally_reserved":0,"allocated":208896,"data_stored":69776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1639999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.133}]}]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297560,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074280,"statfs":{"total":96636764160,"available":96332062720,"internally_reserved":0,"allocated":278528,"data_stored":660594,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.196}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3600000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301584,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070256,"statfs":{"total":96636764160,"available":96327942144,"internally_reserved":0,"allocated":204800,"data_stored":69706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301592,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070248,"statfs":{"total":96636764160,"available":96327933952,"internally_reserved":0,"allocated":212992,"data_stored":69742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.252}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5029999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T15:37:38.988 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T15:37:39.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.089+0000 7f52d6a82700 1 Processor -- start 2023-10-08T15:37:39.289 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.089+0000 7f52d6a82700 1 -- start start 2023-10-08T15:37:39.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.089+0000 7f52d6a82700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f52d00c0720 0x7f52d00674b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:39.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.089+0000 7f52d6a82700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52d00687c0 con 0x7f52d00681f0 2023-10-08T15:37:39.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.089+0000 7f52d6a82700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52d0068aa0 con 0x7f52d00670e0 2023-10-08T15:37:39.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.089+0000 7f52d6a82700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52d014c6f0 con 0x7f52d00c0720 2023-10-08T15:37:39.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.089+0000 7f52d6281700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f52d00681f0 0x7f52d00a18c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:59628/0 (socket says 172.21.15.3:59628) 2023-10-08T15:37:39.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.089+0000 7f52d6281700 1 -- 172.21.15.3:0/2009384620 learned_addr learned my addr 172.21.15.3:0/2009384620 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:39.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.089+0000 7f52d527f700 1 --2- 172.21.15.3:0/2009384620 >> v2:172.21.15.50:3300/0 conn(0x7f52d00c0720 0x7f52d00674b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:39.297 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.089+0000 7f52d4a7e700 1 -- 172.21.15.3:0/2009384620 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3803845131 0 0) 0x7f52d00687c0 con 0x7f52d00681f0 2023-10-08T15:37:39.297 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.089+0000 7f52d4a7e700 1 -- 172.21.15.3:0/2009384620 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52bc003570 con 0x7f52d00681f0 2023-10-08T15:37:39.297 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.089+0000 7f52d527f700 1 -- 172.21.15.3:0/2009384620 >> v1:172.21.15.50:6789/0 conn(0x7f52d00670e0 legacy=0x7f52d0068f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:39.297 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.089+0000 7f52d527f700 1 -- 172.21.15.3:0/2009384620 >> v1:172.21.15.3:6789/0 conn(0x7f52d00681f0 legacy=0x7f52d00a18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:39.297 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.093+0000 7f52d527f700 1 -- 172.21.15.3:0/2009384620 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d006a030 con 0x7f52d00c0720 2023-10-08T15:37:39.297 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.093+0000 7f52d527f700 1 --2- 172.21.15.3:0/2009384620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52d00c0720 0x7f52d00674b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f52c4009e60 tx=0x7f52c4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2195459b17f965e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:39.297 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.093+0000 7f52d4a7e700 1 -- 172.21.15.3:0/2009384620 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c400e070 con 0x7f52d00c0720 2023-10-08T15:37:39.297 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.093+0000 7f52d4a7e700 1 -- 172.21.15.3:0/2009384620 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c400bb60 con 0x7f52d00c0720 2023-10-08T15:37:39.297 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.093+0000 7f52d4a7e700 1 -- 172.21.15.3:0/2009384620 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c4012430 con 0x7f52d00c0720 2023-10-08T15:37:39.297 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.093+0000 7f52d6a82700 1 -- 172.21.15.3:0/2009384620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52d00c0720 msgr2=0x7f52d00674b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:39.297 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.093+0000 7f52d6a82700 1 --2- 172.21.15.3:0/2009384620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52d00c0720 0x7f52d00674b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f52c4009e60 tx=0x7f52c4009780 comp rx=0 tx=0).stop 2023-10-08T15:37:39.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.093+0000 7f52d6a82700 1 -- 172.21.15.3:0/2009384620 shutdown_connections 2023-10-08T15:37:39.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.093+0000 7f52d6a82700 1 --2- 172.21.15.3:0/2009384620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52d00c0720 0x7f52d00674b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:39.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.093+0000 7f52d6a82700 1 -- 172.21.15.3:0/2009384620 >> 172.21.15.3:0/2009384620 conn(0x7f52d006dfb0 msgr2=0x7f52d006e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:39.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.093+0000 7f52d6a82700 1 -- 172.21.15.3:0/2009384620 shutdown_connections 2023-10-08T15:37:39.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.093+0000 7f52d6a82700 1 -- 172.21.15.3:0/2009384620 wait complete. 2023-10-08T15:37:39.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.093+0000 7f52d6a82700 1 Processor -- start 2023-10-08T15:37:39.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.093+0000 7f52d6a82700 1 -- start start 2023-10-08T15:37:39.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.097+0000 7f52d6a82700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f52d00670e0 0x7f52d009ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:39.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.097+0000 7f52d6a82700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52d00681f0 0x7f52d015bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:39.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.097+0000 7f52d6a82700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f52d00c0720 0x7f52d009d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:39.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.097+0000 7f52d6a82700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d00b28e0 con 0x7f52d00c0720 2023-10-08T15:37:39.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.097+0000 7f52d6a82700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d015baf0 con 0x7f52d00681f0 2023-10-08T15:37:39.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.097+0000 7f52d6a82700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d009da40 con 0x7f52d00670e0 2023-10-08T15:37:39.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.097+0000 7f52d6281700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f52d00c0720 0x7f52d009d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:39.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.097+0000 7f52d6281700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f52d00c0720 0x7f52d009d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44070/0 (socket says 172.21.15.3:44070) 2023-10-08T15:37:39.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.097+0000 7f52d6281700 1 -- 172.21.15.3:0/3120807173 learned_addr learned my addr 172.21.15.3:0/3120807173 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:39.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.097+0000 7f52d527f700 1 --2- 172.21.15.3:0/3120807173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52d00681f0 0x7f52d015bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:39.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.097+0000 7f52d5a80700 1 --2- 172.21.15.3:0/3120807173 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f52d00670e0 0x7f52d009ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:39.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.097+0000 7f52d6281700 1 -- 172.21.15.3:0/3120807173 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f52d00670e0 msgr2=0x7f52d009ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:39.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.097+0000 7f52d6281700 1 --2- 172.21.15.3:0/3120807173 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f52d00670e0 0x7f52d009ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:39.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.097+0000 7f52d6281700 1 -- 172.21.15.3:0/3120807173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52d00681f0 msgr2=0x7f52d015bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:39.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.097+0000 7f52d6281700 1 --2- 172.21.15.3:0/3120807173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52d00681f0 0x7f52d015bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:39.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.097+0000 7f52d6281700 1 -- 172.21.15.3:0/3120807173 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c4009a20 con 0x7f52d00c0720 2023-10-08T15:37:39.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.097+0000 7f52d6281700 1 --2- 172.21.15.3:0/3120807173 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f52d00c0720 0x7f52d009d500 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f52c800c580 tx=0x7f52c8007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:39.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.097+0000 7f52c1ffb700 1 -- 172.21.15.3:0/3120807173 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c8005c50 con 0x7f52d00c0720 2023-10-08T15:37:39.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.097+0000 7f52c1ffb700 1 -- 172.21.15.3:0/3120807173 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c8005db0 con 0x7f52d00c0720 2023-10-08T15:37:39.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.097+0000 7f52c1ffb700 1 -- 172.21.15.3:0/3120807173 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c8007300 con 0x7f52d00c0720 2023-10-08T15:37:39.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.097+0000 7f52d6a82700 1 -- 172.21.15.3:0/3120807173 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52d015b4a0 con 0x7f52d00c0720 2023-10-08T15:37:39.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.097+0000 7f52d6a82700 1 -- 172.21.15.3:0/3120807173 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52d015b210 con 0x7f52d00c0720 2023-10-08T15:37:39.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.101+0000 7f52d6a82700 1 -- 172.21.15.3:0/3120807173 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52d015bca0 con 0x7f52d00c0720 2023-10-08T15:37:39.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.101+0000 7f52c1ffb700 1 -- 172.21.15.3:0/3120807173 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f52c801b3b0 con 0x7f52d00c0720 2023-10-08T15:37:39.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.101+0000 7f52c1ffb700 1 --2- 172.21.15.3:0/3120807173 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f52b4060580 0x7f52b4062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:39.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.101+0000 7f52c1ffb700 1 -- 172.21.15.3:0/3120807173 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f52c807bcf0 con 0x7f52d00c0720 2023-10-08T15:37:39.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.101+0000 7f52d5a80700 1 --2- 172.21.15.3:0/3120807173 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f52b4060580 0x7f52b4062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:39.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.101+0000 7f52d5a80700 1 --2- 172.21.15.3:0/3120807173 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f52b4060580 0x7f52b4062a30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f52cc003860 tx=0x7f52cc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:39.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.109+0000 7f52c1ffb700 1 -- 172.21.15.3:0/3120807173 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f52d015bca0 con 0x7f52d00c0720 2023-10-08T15:37:39.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.257+0000 7f52d6a82700 1 -- 172.21.15.3:0/3120807173 --> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f52d015bca0 con 0x7f52b4060580 2023-10-08T15:37:39.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.277+0000 7f52c1ffb700 1 -- 172.21.15.3:0/3120807173 <== mgr.4102 v2:172.21.15.50:6832/33268 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264497 (secure 0 0 0) 0x7f52d015bca0 con 0x7f52b4060580 2023-10-08T15:37:39.411 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:37:39.413 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.281+0000 7f52d6a82700 1 -- 172.21.15.3:0/3120807173 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f52b4060580 msgr2=0x7f52b4062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:39.414 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.281+0000 7f52d6a82700 1 --2- 172.21.15.3:0/3120807173 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f52b4060580 0x7f52b4062a30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f52cc003860 tx=0x7f52cc009040 comp rx=0 tx=0).stop 2023-10-08T15:37:39.414 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.281+0000 7f52d6a82700 1 -- 172.21.15.3:0/3120807173 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f52d00c0720 msgr2=0x7f52d009d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:39.414 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.281+0000 7f52d6a82700 1 --2- 172.21.15.3:0/3120807173 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f52d00c0720 0x7f52d009d500 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f52c800c580 tx=0x7f52c8007d80 comp rx=0 tx=0).stop 2023-10-08T15:37:39.414 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.281+0000 7f52d6a82700 1 -- 172.21.15.3:0/3120807173 shutdown_connections 2023-10-08T15:37:39.414 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.281+0000 7f52d6a82700 1 --2- 172.21.15.3:0/3120807173 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f52b4060580 0x7f52b4062a30 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:39.414 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.281+0000 7f52d6a82700 1 --2- 172.21.15.3:0/3120807173 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f52d00c0720 0x7f52d009d500 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:39.414 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.281+0000 7f52d6a82700 1 --2- 172.21.15.3:0/3120807173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52d00681f0 0x7f52d015bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:39.414 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.281+0000 7f52d6a82700 1 --2- 172.21.15.3:0/3120807173 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f52d00670e0 0x7f52d009ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:39.414 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.281+0000 7f52d6a82700 1 -- 172.21.15.3:0/3120807173 >> 172.21.15.3:0/3120807173 conn(0x7f52d006dfb0 msgr2=0x7f52d014ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:39.414 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.281+0000 7f52d6a82700 1 -- 172.21.15.3:0/3120807173 shutdown_connections 2023-10-08T15:37:39.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.281+0000 7f52d6a82700 1 -- 172.21.15.3:0/3120807173 wait complete. 2023-10-08T15:37:39.415 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2023-10-08T15:37:39.415 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-10-08T15:37:38.512378+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2396448,"kb_used_data":1760,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752578272,"statfs":{"total":773094113280,"available":770640150528,"internally_reserved":0,"allocated":1802240,"data_stored":1742276,"data_compressed":66282,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.497810"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.053739+0000","last_change":"2023-10-08T15:37:26.047226+0000","last_active":"2023-10-08T15:37:26.053739+0000","last_peered":"2023-10-08T15:37:26.053739+0000","last_clean":"2023-10-08T15:37:26.053739+0000","last_became_active":"2023-10-08T15:37:26.046910+0000","last_became_peered":"2023-10-08T15:37:26.046910+0000","last_unstale":"2023-10-08T15:37:26.053739+0000","last_undegraded":"2023-10-08T15:37:26.053739+0000","last_fullsized":"2023-10-08T15:37:26.053739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:15:10.097776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.048869+0000","last_change":"2023-10-08T15:37:26.044911+0000","last_active":"2023-10-08T15:37:26.048869+0000","last_peered":"2023-10-08T15:37:26.048869+0000","last_clean":"2023-10-08T15:37:26.048869+0000","last_became_active":"2023-10-08T15:37:26.044586+0000","last_became_peered":"2023-10-08T15:37:26.044586+0000","last_unstale":"2023-10-08T15:37:26.048869+0000","last_undegraded":"2023-10-08T15:37:26.048869+0000","last_fullsized":"2023-10-08T15:37:26.048869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:56.482633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.046260+0000","last_change":"2023-10-08T15:37:26.040753+0000","last_active":"2023-10-08T15:37:26.046260+0000","last_peered":"2023-10-08T15:37:26.046260+0000","last_clean":"2023-10-08T15:37:26.046260+0000","last_became_active":"2023-10-08T15:37:26.040446+0000","last_became_peered":"2023-10-08T15:37:26.040446+0000","last_unstale":"2023-10-08T15:37:26.046260+0000","last_undegraded":"2023-10-08T15:37:26.046260+0000","last_fullsized":"2023-10-08T15:37:26.046260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:54:46.510693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.057269+0000","last_change":"2023-10-08T15:37:26.049673+0000","last_active":"2023-10-08T15:37:26.057269+0000","last_peered":"2023-10-08T15:37:26.057269+0000","last_clean":"2023-10-08T15:37:26.057269+0000","last_became_active":"2023-10-08T15:37:26.048595+0000","last_became_peered":"2023-10-08T15:37:26.048595+0000","last_unstale":"2023-10-08T15:37:26.057269+0000","last_undegraded":"2023-10-08T15:37:26.057269+0000","last_fullsized":"2023-10-08T15:37:26.057269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:05:25.732352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.041730+0000","last_change":"2023-10-08T15:37:26.033012+0000","last_active":"2023-10-08T15:37:26.041730+0000","last_peered":"2023-10-08T15:37:26.041730+0000","last_clean":"2023-10-08T15:37:26.041730+0000","last_became_active":"2023-10-08T15:37:26.032730+0000","last_became_peered":"2023-10-08T15:37:26.032730+0000","last_unstale":"2023-10-08T15:37:26.041730+0000","last_undegraded":"2023-10-08T15:37:26.041730+0000","last_fullsized":"2023-10-08T15:37:26.041730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:24:52.143093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.054406+0000","last_change":"2023-10-08T15:37:26.046262+0000","last_active":"2023-10-08T15:37:26.054406+0000","last_peered":"2023-10-08T15:37:26.054406+0000","last_clean":"2023-10-08T15:37:26.054406+0000","last_became_active":"2023-10-08T15:37:26.045955+0000","last_became_peered":"2023-10-08T15:37:26.045955+0000","last_unstale":"2023-10-08T15:37:26.054406+0000","last_undegraded":"2023-10-08T15:37:26.054406+0000","last_fullsized":"2023-10-08T15:37:26.054406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:14:44.577836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.049470+0000","last_change":"2023-10-08T15:37:26.042885+0000","last_active":"2023-10-08T15:37:26.049470+0000","last_peered":"2023-10-08T15:37:26.049470+0000","last_clean":"2023-10-08T15:37:26.049470+0000","last_became_active":"2023-10-08T15:37:26.042523+0000","last_became_peered":"2023-10-08T15:37:26.042523+0000","last_unstale":"2023-10-08T15:37:26.049470+0000","last_undegraded":"2023-10-08T15:37:26.049470+0000","last_fullsized":"2023-10-08T15:37:26.049470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:39:02.147413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.053032+0000","last_change":"2023-10-08T15:37:26.050106+0000","last_active":"2023-10-08T15:37:26.053032+0000","last_peered":"2023-10-08T15:37:26.053032+0000","last_clean":"2023-10-08T15:37:26.053032+0000","last_became_active":"2023-10-08T15:37:26.049801+0000","last_became_peered":"2023-10-08T15:37:26.049801+0000","last_unstale":"2023-10-08T15:37:26.053032+0000","last_undegraded":"2023-10-08T15:37:26.053032+0000","last_fullsized":"2023-10-08T15:37:26.053032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:48.862001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.041806+0000","last_change":"2023-10-08T15:37:26.034922+0000","last_active":"2023-10-08T15:37:26.041806+0000","last_peered":"2023-10-08T15:37:26.041806+0000","last_clean":"2023-10-08T15:37:26.041806+0000","last_became_active":"2023-10-08T15:37:26.034328+0000","last_became_peered":"2023-10-08T15:37:26.034328+0000","last_unstale":"2023-10-08T15:37:26.041806+0000","last_undegraded":"2023-10-08T15:37:26.041806+0000","last_fullsized":"2023-10-08T15:37:26.041806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:40:49.862643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.056035+0000","last_change":"2023-10-08T15:37:26.055002+0000","last_active":"2023-10-08T15:37:26.056035+0000","last_peered":"2023-10-08T15:37:26.056035+0000","last_clean":"2023-10-08T15:37:26.056035+0000","last_became_active":"2023-10-08T15:37:26.054672+0000","last_became_peered":"2023-10-08T15:37:26.054672+0000","last_unstale":"2023-10-08T15:37:26.056035+0000","last_undegraded":"2023-10-08T15:37:26.056035+0000","last_fullsized":"2023-10-08T15:37:26.056035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:56.482633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.056053+0000","last_change":"2023-10-08T15:37:26.055226+0000","last_active":"2023-10-08T15:37:26.056053+0000","last_peered":"2023-10-08T15:37:26.056053+0000","last_clean":"2023-10-08T15:37:26.056053+0000","last_became_active":"2023-10-08T15:37:26.054740+0000","last_became_peered":"2023-10-08T15:37:26.054740+0000","last_unstale":"2023-10-08T15:37:26.056053+0000","last_undegraded":"2023-10-08T15:37:26.056053+0000","last_fullsized":"2023-10-08T15:37:26.056053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:13:29.705445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.056900+0000","last_change":"2023-10-08T15:37:26.039886+0000","last_active":"2023-10-08T15:37:26.056900+0000","last_peered":"2023-10-08T15:37:26.056900+0000","last_clean":"2023-10-08T15:37:26.056900+0000","last_became_active":"2023-10-08T15:37:26.039551+0000","last_became_peered":"2023-10-08T15:37:26.039551+0000","last_unstale":"2023-10-08T15:37:26.056900+0000","last_undegraded":"2023-10-08T15:37:26.056900+0000","last_fullsized":"2023-10-08T15:37:26.056900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:18:49.734343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.039639+0000","last_change":"2023-10-08T15:37:26.036155+0000","last_active":"2023-10-08T15:37:26.039639+0000","last_peered":"2023-10-08T15:37:26.039639+0000","last_clean":"2023-10-08T15:37:26.039639+0000","last_became_active":"2023-10-08T15:37:26.035854+0000","last_became_peered":"2023-10-08T15:37:26.035854+0000","last_unstale":"2023-10-08T15:37:26.039639+0000","last_undegraded":"2023-10-08T15:37:26.039639+0000","last_fullsized":"2023-10-08T15:37:26.039639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:54:46.510693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.046268+0000","last_change":"2023-10-08T15:37:26.041053+0000","last_active":"2023-10-08T15:37:26.046268+0000","last_peered":"2023-10-08T15:37:26.046268+0000","last_clean":"2023-10-08T15:37:26.046268+0000","last_became_active":"2023-10-08T15:37:26.040408+0000","last_became_peered":"2023-10-08T15:37:26.040408+0000","last_unstale":"2023-10-08T15:37:26.046268+0000","last_undegraded":"2023-10-08T15:37:26.046268+0000","last_fullsized":"2023-10-08T15:37:26.046268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:20:49.172777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.036901+0000","last_change":"2023-10-08T15:37:26.032920+0000","last_active":"2023-10-08T15:37:26.036901+0000","last_peered":"2023-10-08T15:37:26.036901+0000","last_clean":"2023-10-08T15:37:26.036901+0000","last_became_active":"2023-10-08T15:37:26.032226+0000","last_became_peered":"2023-10-08T15:37:26.032226+0000","last_unstale":"2023-10-08T15:37:26.036901+0000","last_undegraded":"2023-10-08T15:37:26.036901+0000","last_fullsized":"2023-10-08T15:37:26.036901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:44:20.631125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.057085+0000","last_change":"2023-10-08T15:37:26.050368+0000","last_active":"2023-10-08T15:37:26.057085+0000","last_peered":"2023-10-08T15:37:26.057085+0000","last_clean":"2023-10-08T15:37:26.057085+0000","last_became_active":"2023-10-08T15:37:26.050078+0000","last_became_peered":"2023-10-08T15:37:26.050078+0000","last_unstale":"2023-10-08T15:37:26.057085+0000","last_undegraded":"2023-10-08T15:37:26.057085+0000","last_fullsized":"2023-10-08T15:37:26.057085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:56:34.490787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.054310+0000","last_change":"2023-10-08T15:37:26.045671+0000","last_active":"2023-10-08T15:37:26.054310+0000","last_peered":"2023-10-08T15:37:26.054310+0000","last_clean":"2023-10-08T15:37:26.054310+0000","last_became_active":"2023-10-08T15:37:26.045356+0000","last_became_peered":"2023-10-08T15:37:26.045356+0000","last_unstale":"2023-10-08T15:37:26.054310+0000","last_undegraded":"2023-10-08T15:37:26.054310+0000","last_fullsized":"2023-10-08T15:37:26.054310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:47:37.094485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.043896+0000","last_change":"2023-10-08T15:37:26.037867+0000","last_active":"2023-10-08T15:37:26.043896+0000","last_peered":"2023-10-08T15:37:26.043896+0000","last_clean":"2023-10-08T15:37:26.043896+0000","last_became_active":"2023-10-08T15:37:26.037579+0000","last_became_peered":"2023-10-08T15:37:26.037579+0000","last_unstale":"2023-10-08T15:37:26.043896+0000","last_undegraded":"2023-10-08T15:37:26.043896+0000","last_fullsized":"2023-10-08T15:37:26.043896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:07.193145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.043711+0000","last_change":"2023-10-08T15:37:26.038808+0000","last_active":"2023-10-08T15:37:26.043711+0000","last_peered":"2023-10-08T15:37:26.043711+0000","last_clean":"2023-10-08T15:37:26.043711+0000","last_became_active":"2023-10-08T15:37:26.038502+0000","last_became_peered":"2023-10-08T15:37:26.038502+0000","last_unstale":"2023-10-08T15:37:26.043711+0000","last_undegraded":"2023-10-08T15:37:26.043711+0000","last_fullsized":"2023-10-08T15:37:26.043711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:20:17.146211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.059517+0000","last_change":"2023-10-08T15:37:26.057588+0000","last_active":"2023-10-08T15:37:26.059517+0000","last_peered":"2023-10-08T15:37:26.059517+0000","last_clean":"2023-10-08T15:37:26.059517+0000","last_became_active":"2023-10-08T15:37:26.057292+0000","last_became_peered":"2023-10-08T15:37:26.057292+0000","last_unstale":"2023-10-08T15:37:26.059517+0000","last_undegraded":"2023-10-08T15:37:26.059517+0000","last_fullsized":"2023-10-08T15:37:26.059517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:38:52.246025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.049010+0000","last_change":"2023-10-08T15:37:26.044085+0000","last_active":"2023-10-08T15:37:26.049010+0000","last_peered":"2023-10-08T15:37:26.049010+0000","last_clean":"2023-10-08T15:37:26.049010+0000","last_became_active":"2023-10-08T15:37:26.043779+0000","last_became_peered":"2023-10-08T15:37:26.043779+0000","last_unstale":"2023-10-08T15:37:26.049010+0000","last_undegraded":"2023-10-08T15:37:26.049010+0000","last_fullsized":"2023-10-08T15:37:26.049010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:31:04.163648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.054276+0000","last_change":"2023-10-08T15:37:26.045121+0000","last_active":"2023-10-08T15:37:26.054276+0000","last_peered":"2023-10-08T15:37:26.054276+0000","last_clean":"2023-10-08T15:37:26.054276+0000","last_became_active":"2023-10-08T15:37:26.044638+0000","last_became_peered":"2023-10-08T15:37:26.044638+0000","last_unstale":"2023-10-08T15:37:26.054276+0000","last_undegraded":"2023-10-08T15:37:26.054276+0000","last_fullsized":"2023-10-08T15:37:26.054276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:45:12.654892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.061107+0000","last_change":"2023-10-08T15:37:26.056315+0000","last_active":"2023-10-08T15:37:26.061107+0000","last_peered":"2023-10-08T15:37:26.061107+0000","last_clean":"2023-10-08T15:37:26.061107+0000","last_became_active":"2023-10-08T15:37:26.056048+0000","last_became_peered":"2023-10-08T15:37:26.056048+0000","last_unstale":"2023-10-08T15:37:26.061107+0000","last_undegraded":"2023-10-08T15:37:26.061107+0000","last_fullsized":"2023-10-08T15:37:26.061107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:10:03.706049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.054064+0000","last_change":"2023-10-08T15:37:26.035585+0000","last_active":"2023-10-08T15:37:26.054064+0000","last_peered":"2023-10-08T15:37:26.054064+0000","last_clean":"2023-10-08T15:37:26.054064+0000","last_became_active":"2023-10-08T15:37:26.035286+0000","last_became_peered":"2023-10-08T15:37:26.035286+0000","last_unstale":"2023-10-08T15:37:26.054064+0000","last_undegraded":"2023-10-08T15:37:26.054064+0000","last_fullsized":"2023-10-08T15:37:26.054064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:15:33.124525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.060750+0000","last_change":"2023-10-08T15:37:26.056162+0000","last_active":"2023-10-08T15:37:26.060750+0000","last_peered":"2023-10-08T15:37:26.060750+0000","last_clean":"2023-10-08T15:37:26.060750+0000","last_became_active":"2023-10-08T15:37:26.055788+0000","last_became_peered":"2023-10-08T15:37:26.055788+0000","last_unstale":"2023-10-08T15:37:26.060750+0000","last_undegraded":"2023-10-08T15:37:26.060750+0000","last_fullsized":"2023-10-08T15:37:26.060750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:31:04.163648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.045525+0000","last_change":"2023-10-08T15:37:26.043352+0000","last_active":"2023-10-08T15:37:26.045525+0000","last_peered":"2023-10-08T15:37:26.045525+0000","last_clean":"2023-10-08T15:37:26.045525+0000","last_became_active":"2023-10-08T15:37:26.043051+0000","last_became_peered":"2023-10-08T15:37:26.043051+0000","last_unstale":"2023-10-08T15:37:26.045525+0000","last_undegraded":"2023-10-08T15:37:26.045525+0000","last_fullsized":"2023-10-08T15:37:26.045525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:10:14.668770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.037359+0000","last_change":"2023-10-08T15:37:26.034315+0000","last_active":"2023-10-08T15:37:26.037359+0000","last_peered":"2023-10-08T15:37:26.037359+0000","last_clean":"2023-10-08T15:37:26.037359+0000","last_became_active":"2023-10-08T15:37:26.032177+0000","last_became_peered":"2023-10-08T15:37:26.032177+0000","last_unstale":"2023-10-08T15:37:26.037359+0000","last_undegraded":"2023-10-08T15:37:26.037359+0000","last_fullsized":"2023-10-08T15:37:26.037359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:49:47.826663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.050562+0000","last_change":"2023-10-08T15:37:26.047383+0000","last_active":"2023-10-08T15:37:26.050562+0000","last_peered":"2023-10-08T15:37:26.050562+0000","last_clean":"2023-10-08T15:37:26.050562+0000","last_became_active":"2023-10-08T15:37:26.046845+0000","last_became_peered":"2023-10-08T15:37:26.046845+0000","last_unstale":"2023-10-08T15:37:26.050562+0000","last_undegraded":"2023-10-08T15:37:26.050562+0000","last_fullsized":"2023-10-08T15:37:26.050562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:17:23.022933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.046293+0000","last_change":"2023-10-08T15:37:26.041133+0000","last_active":"2023-10-08T15:37:26.046293+0000","last_peered":"2023-10-08T15:37:26.046293+0000","last_clean":"2023-10-08T15:37:26.046293+0000","last_became_active":"2023-10-08T15:37:26.040867+0000","last_became_peered":"2023-10-08T15:37:26.040867+0000","last_unstale":"2023-10-08T15:37:26.046293+0000","last_undegraded":"2023-10-08T15:37:26.046293+0000","last_fullsized":"2023-10-08T15:37:26.046293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:10:03.706049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.054247+0000","last_change":"2023-10-08T15:37:26.035125+0000","last_active":"2023-10-08T15:37:26.054247+0000","last_peered":"2023-10-08T15:37:26.054247+0000","last_clean":"2023-10-08T15:37:26.054247+0000","last_became_active":"2023-10-08T15:37:26.034739+0000","last_became_peered":"2023-10-08T15:37:26.034739+0000","last_unstale":"2023-10-08T15:37:26.054247+0000","last_undegraded":"2023-10-08T15:37:26.054247+0000","last_fullsized":"2023-10-08T15:37:26.054247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:38:43.660811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.038213+0000","last_change":"2023-10-08T15:37:26.030988+0000","last_active":"2023-10-08T15:37:26.038213+0000","last_peered":"2023-10-08T15:37:26.038213+0000","last_clean":"2023-10-08T15:37:26.038213+0000","last_became_active":"2023-10-08T15:37:26.030522+0000","last_became_peered":"2023-10-08T15:37:26.030522+0000","last_unstale":"2023-10-08T15:37:26.038213+0000","last_undegraded":"2023-10-08T15:37:26.038213+0000","last_fullsized":"2023-10-08T15:37:26.038213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:37:45.941867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.049875+0000","last_change":"2023-10-08T15:37:26.046534+0000","last_active":"2023-10-08T15:37:26.049875+0000","last_peered":"2023-10-08T15:37:26.049875+0000","last_clean":"2023-10-08T15:37:26.049875+0000","last_became_active":"2023-10-08T15:37:26.046213+0000","last_became_peered":"2023-10-08T15:37:26.046213+0000","last_unstale":"2023-10-08T15:37:26.049875+0000","last_undegraded":"2023-10-08T15:37:26.049875+0000","last_fullsized":"2023-10-08T15:37:26.049875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:44:20.631125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.047730+0000","last_change":"2023-10-08T15:37:26.029621+0000","last_active":"2023-10-08T15:37:26.047730+0000","last_peered":"2023-10-08T15:37:26.047730+0000","last_clean":"2023-10-08T15:37:26.047730+0000","last_became_active":"2023-10-08T15:37:26.029280+0000","last_became_peered":"2023-10-08T15:37:26.029280+0000","last_unstale":"2023-10-08T15:37:26.047730+0000","last_undegraded":"2023-10-08T15:37:26.047730+0000","last_fullsized":"2023-10-08T15:37:26.047730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:52:17.141125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.042428+0000","last_change":"2023-10-08T15:37:25.030754+0000","last_active":"2023-10-08T15:37:26.042428+0000","last_peered":"2023-10-08T15:37:26.042428+0000","last_clean":"2023-10-08T15:37:26.042428+0000","last_became_active":"2023-10-08T15:37:25.030391+0000","last_became_peered":"2023-10-08T15:37:25.030391+0000","last_unstale":"2023-10-08T15:37:26.042428+0000","last_undegraded":"2023-10-08T15:37:26.042428+0000","last_fullsized":"2023-10-08T15:37:26.042428+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:12:17.158973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.060787+0000","last_change":"2023-10-08T15:37:26.057810+0000","last_active":"2023-10-08T15:37:26.060787+0000","last_peered":"2023-10-08T15:37:26.060787+0000","last_clean":"2023-10-08T15:37:26.060787+0000","last_became_active":"2023-10-08T15:37:26.057527+0000","last_became_peered":"2023-10-08T15:37:26.057527+0000","last_unstale":"2023-10-08T15:37:26.060787+0000","last_undegraded":"2023-10-08T15:37:26.060787+0000","last_fullsized":"2023-10-08T15:37:26.060787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:03:31.974502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.058236+0000","last_change":"2023-10-08T15:37:25.031114+0000","last_active":"2023-10-08T15:37:26.058236+0000","last_peered":"2023-10-08T15:37:26.058236+0000","last_clean":"2023-10-08T15:37:26.058236+0000","last_became_active":"2023-10-08T15:37:25.030559+0000","last_became_peered":"2023-10-08T15:37:25.030559+0000","last_unstale":"2023-10-08T15:37:26.058236+0000","last_undegraded":"2023-10-08T15:37:26.058236+0000","last_fullsized":"2023-10-08T15:37:26.058236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:17:55.698139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.022121+0000","last_change":"2023-10-08T15:37:25.030150+0000","last_active":"2023-10-08T15:37:26.022121+0000","last_peered":"2023-10-08T15:37:26.022121+0000","last_clean":"2023-10-08T15:37:26.022121+0000","last_became_active":"2023-10-08T15:37:25.029857+0000","last_became_peered":"2023-10-08T15:37:25.029857+0000","last_unstale":"2023-10-08T15:37:26.022121+0000","last_undegraded":"2023-10-08T15:37:26.022121+0000","last_fullsized":"2023-10-08T15:37:26.022121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:17:10.911391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.046155+0000","last_change":"2023-10-08T15:37:26.044512+0000","last_active":"2023-10-08T15:37:26.046155+0000","last_peered":"2023-10-08T15:37:26.046155+0000","last_clean":"2023-10-08T15:37:26.046155+0000","last_became_active":"2023-10-08T15:37:26.044155+0000","last_became_peered":"2023-10-08T15:37:26.044155+0000","last_unstale":"2023-10-08T15:37:26.046155+0000","last_undegraded":"2023-10-08T15:37:26.046155+0000","last_fullsized":"2023-10-08T15:37:26.046155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:20:26.216438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.028350+0000","last_change":"2023-10-08T15:37:25.041282+0000","last_active":"2023-10-08T15:37:26.028350+0000","last_peered":"2023-10-08T15:37:26.028350+0000","last_clean":"2023-10-08T15:37:26.028350+0000","last_became_active":"2023-10-08T15:37:25.040931+0000","last_became_peered":"2023-10-08T15:37:25.040931+0000","last_unstale":"2023-10-08T15:37:26.028350+0000","last_undegraded":"2023-10-08T15:37:26.028350+0000","last_fullsized":"2023-10-08T15:37:26.028350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:17:10.911391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.036843+0000","last_change":"2023-10-08T15:37:26.032685+0000","last_active":"2023-10-08T15:37:26.036843+0000","last_peered":"2023-10-08T15:37:26.036843+0000","last_clean":"2023-10-08T15:37:26.036843+0000","last_became_active":"2023-10-08T15:37:26.031819+0000","last_became_peered":"2023-10-08T15:37:26.031819+0000","last_unstale":"2023-10-08T15:37:26.036843+0000","last_undegraded":"2023-10-08T15:37:26.036843+0000","last_fullsized":"2023-10-08T15:37:26.036843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:10:14.668770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.034785+0000","last_change":"2023-10-08T15:37:25.039812+0000","last_active":"2023-10-08T15:37:26.034785+0000","last_peered":"2023-10-08T15:37:26.034785+0000","last_clean":"2023-10-08T15:37:26.034785+0000","last_became_active":"2023-10-08T15:37:25.039165+0000","last_became_peered":"2023-10-08T15:37:25.039165+0000","last_unstale":"2023-10-08T15:37:26.034785+0000","last_undegraded":"2023-10-08T15:37:26.034785+0000","last_fullsized":"2023-10-08T15:37:26.034785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:09:10.975405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.057652+0000","last_change":"2023-10-08T15:37:26.050389+0000","last_active":"2023-10-08T15:37:26.057652+0000","last_peered":"2023-10-08T15:37:26.057652+0000","last_clean":"2023-10-08T15:37:26.057652+0000","last_became_active":"2023-10-08T15:37:26.050059+0000","last_became_peered":"2023-10-08T15:37:26.050059+0000","last_unstale":"2023-10-08T15:37:26.057652+0000","last_undegraded":"2023-10-08T15:37:26.057652+0000","last_fullsized":"2023-10-08T15:37:26.057652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:37:10.263562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.031544+0000","last_change":"2023-10-08T15:37:25.037788+0000","last_active":"2023-10-08T15:37:26.031544+0000","last_peered":"2023-10-08T15:37:26.031544+0000","last_clean":"2023-10-08T15:37:26.031544+0000","last_became_active":"2023-10-08T15:37:25.037390+0000","last_became_peered":"2023-10-08T15:37:25.037390+0000","last_unstale":"2023-10-08T15:37:26.031544+0000","last_undegraded":"2023-10-08T15:37:26.031544+0000","last_fullsized":"2023-10-08T15:37:26.031544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:33:24.209108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.054995+0000","last_change":"2023-10-08T15:37:26.052388+0000","last_active":"2023-10-08T15:37:26.054995+0000","last_peered":"2023-10-08T15:37:26.054995+0000","last_clean":"2023-10-08T15:37:26.054995+0000","last_became_active":"2023-10-08T15:37:26.052080+0000","last_became_peered":"2023-10-08T15:37:26.052080+0000","last_unstale":"2023-10-08T15:37:26.054995+0000","last_undegraded":"2023-10-08T15:37:26.054995+0000","last_fullsized":"2023-10-08T15:37:26.054995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:17:23.022933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.049288+0000","last_change":"2023-10-08T15:37:25.040184+0000","last_active":"2023-10-08T15:37:26.049288+0000","last_peered":"2023-10-08T15:37:26.049288+0000","last_clean":"2023-10-08T15:37:26.049288+0000","last_became_active":"2023-10-08T15:37:25.039952+0000","last_became_peered":"2023-10-08T15:37:25.039952+0000","last_unstale":"2023-10-08T15:37:26.049288+0000","last_undegraded":"2023-10-08T15:37:26.049288+0000","last_fullsized":"2023-10-08T15:37:26.049288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:37:44.937225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.056434+0000","last_change":"2023-10-08T15:37:26.030498+0000","last_active":"2023-10-08T15:37:26.056434+0000","last_peered":"2023-10-08T15:37:26.056434+0000","last_clean":"2023-10-08T15:37:26.056434+0000","last_became_active":"2023-10-08T15:37:26.029947+0000","last_became_peered":"2023-10-08T15:37:26.029947+0000","last_unstale":"2023-10-08T15:37:26.056434+0000","last_undegraded":"2023-10-08T15:37:26.056434+0000","last_fullsized":"2023-10-08T15:37:26.056434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:21:26.142526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.049086+0000","last_change":"2023-10-08T15:37:25.034475+0000","last_active":"2023-10-08T15:37:26.049086+0000","last_peered":"2023-10-08T15:37:26.049086+0000","last_clean":"2023-10-08T15:37:26.049086+0000","last_became_active":"2023-10-08T15:37:25.034280+0000","last_became_peered":"2023-10-08T15:37:25.034280+0000","last_unstale":"2023-10-08T15:37:26.049086+0000","last_undegraded":"2023-10-08T15:37:26.049086+0000","last_fullsized":"2023-10-08T15:37:26.049086+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:14:36.405051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.041985+0000","last_change":"2023-10-08T15:37:26.037712+0000","last_active":"2023-10-08T15:37:26.041985+0000","last_peered":"2023-10-08T15:37:26.041985+0000","last_clean":"2023-10-08T15:37:26.041985+0000","last_became_active":"2023-10-08T15:37:26.036887+0000","last_became_peered":"2023-10-08T15:37:26.036887+0000","last_unstale":"2023-10-08T15:37:26.041985+0000","last_undegraded":"2023-10-08T15:37:26.041985+0000","last_fullsized":"2023-10-08T15:37:26.041985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:25:12.941976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.057432+0000","last_change":"2023-10-08T15:37:25.029595+0000","last_active":"2023-10-08T15:37:26.057432+0000","last_peered":"2023-10-08T15:37:26.057432+0000","last_clean":"2023-10-08T15:37:26.057432+0000","last_became_active":"2023-10-08T15:37:25.029268+0000","last_became_peered":"2023-10-08T15:37:25.029268+0000","last_unstale":"2023-10-08T15:37:26.057432+0000","last_undegraded":"2023-10-08T15:37:26.057432+0000","last_fullsized":"2023-10-08T15:37:26.057432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:08:13.115248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.046362+0000","last_change":"2023-10-08T15:37:26.042309+0000","last_active":"2023-10-08T15:37:26.046362+0000","last_peered":"2023-10-08T15:37:26.046362+0000","last_clean":"2023-10-08T15:37:26.046362+0000","last_became_active":"2023-10-08T15:37:26.042045+0000","last_became_peered":"2023-10-08T15:37:26.042045+0000","last_unstale":"2023-10-08T15:37:26.046362+0000","last_undegraded":"2023-10-08T15:37:26.046362+0000","last_fullsized":"2023-10-08T15:37:26.046362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:09:23.414069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.028559+0000","last_change":"2023-10-08T15:37:25.040580+0000","last_active":"2023-10-08T15:37:26.028559+0000","last_peered":"2023-10-08T15:37:26.028559+0000","last_clean":"2023-10-08T15:37:26.028559+0000","last_became_active":"2023-10-08T15:37:25.039401+0000","last_became_peered":"2023-10-08T15:37:25.039401+0000","last_unstale":"2023-10-08T15:37:26.028559+0000","last_undegraded":"2023-10-08T15:37:26.028559+0000","last_fullsized":"2023-10-08T15:37:26.028559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:12:32.395357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.041952+0000","last_change":"2023-10-08T15:37:26.037408+0000","last_active":"2023-10-08T15:37:26.041952+0000","last_peered":"2023-10-08T15:37:26.041952+0000","last_clean":"2023-10-08T15:37:26.041952+0000","last_became_active":"2023-10-08T15:37:26.037124+0000","last_became_peered":"2023-10-08T15:37:26.037124+0000","last_unstale":"2023-10-08T15:37:26.041952+0000","last_undegraded":"2023-10-08T15:37:26.041952+0000","last_fullsized":"2023-10-08T15:37:26.041952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:02:42.564039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.027097+0000","last_change":"2023-10-08T15:37:25.024341+0000","last_active":"2023-10-08T15:37:26.027097+0000","last_peered":"2023-10-08T15:37:26.027097+0000","last_clean":"2023-10-08T15:37:26.027097+0000","last_became_active":"2023-10-08T15:37:25.023991+0000","last_became_peered":"2023-10-08T15:37:25.023991+0000","last_unstale":"2023-10-08T15:37:26.027097+0000","last_undegraded":"2023-10-08T15:37:26.027097+0000","last_fullsized":"2023-10-08T15:37:26.027097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:20:36.667774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.049857+0000","last_change":"2023-10-08T15:37:26.046530+0000","last_active":"2023-10-08T15:37:26.049857+0000","last_peered":"2023-10-08T15:37:26.049857+0000","last_clean":"2023-10-08T15:37:26.049857+0000","last_became_active":"2023-10-08T15:37:26.046211+0000","last_became_peered":"2023-10-08T15:37:26.046211+0000","last_unstale":"2023-10-08T15:37:26.049857+0000","last_undegraded":"2023-10-08T15:37:26.049857+0000","last_fullsized":"2023-10-08T15:37:26.049857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:49:47.826663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.042536+0000","last_change":"2023-10-08T15:37:25.024875+0000","last_active":"2023-10-08T15:37:26.042536+0000","last_peered":"2023-10-08T15:37:26.042536+0000","last_clean":"2023-10-08T15:37:26.042536+0000","last_became_active":"2023-10-08T15:37:25.023897+0000","last_became_peered":"2023-10-08T15:37:25.023897+0000","last_unstale":"2023-10-08T15:37:26.042536+0000","last_undegraded":"2023-10-08T15:37:26.042536+0000","last_fullsized":"2023-10-08T15:37:26.042536+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:51:33.993191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.053797+0000","last_change":"2023-10-08T15:37:26.048199+0000","last_active":"2023-10-08T15:37:26.053797+0000","last_peered":"2023-10-08T15:37:26.053797+0000","last_clean":"2023-10-08T15:37:26.053797+0000","last_became_active":"2023-10-08T15:37:26.047816+0000","last_became_peered":"2023-10-08T15:37:26.047816+0000","last_unstale":"2023-10-08T15:37:26.053797+0000","last_undegraded":"2023-10-08T15:37:26.053797+0000","last_fullsized":"2023-10-08T15:37:26.053797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:13:29.705445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.047479+0000","last_change":"2023-10-08T15:37:25.035792+0000","last_active":"2023-10-08T15:37:26.047479+0000","last_peered":"2023-10-08T15:37:26.047479+0000","last_clean":"2023-10-08T15:37:26.047479+0000","last_became_active":"2023-10-08T15:37:25.035413+0000","last_became_peered":"2023-10-08T15:37:25.035413+0000","last_unstale":"2023-10-08T15:37:26.047479+0000","last_undegraded":"2023-10-08T15:37:26.047479+0000","last_fullsized":"2023-10-08T15:37:26.047479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:08:13.115248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.038047+0000","last_change":"2023-10-08T15:37:26.029023+0000","last_active":"2023-10-08T15:37:26.038047+0000","last_peered":"2023-10-08T15:37:26.038047+0000","last_clean":"2023-10-08T15:37:26.038047+0000","last_became_active":"2023-10-08T15:37:26.028552+0000","last_became_peered":"2023-10-08T15:37:26.028552+0000","last_unstale":"2023-10-08T15:37:26.038047+0000","last_undegraded":"2023-10-08T15:37:26.038047+0000","last_fullsized":"2023-10-08T15:37:26.038047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:10:14.668770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.039684+0000","last_change":"2023-10-08T15:37:25.033468+0000","last_active":"2023-10-08T15:37:26.039684+0000","last_peered":"2023-10-08T15:37:26.039684+0000","last_clean":"2023-10-08T15:37:26.039684+0000","last_became_active":"2023-10-08T15:37:25.033054+0000","last_became_peered":"2023-10-08T15:37:25.033054+0000","last_unstale":"2023-10-08T15:37:26.039684+0000","last_undegraded":"2023-10-08T15:37:26.039684+0000","last_fullsized":"2023-10-08T15:37:26.039684+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:03:03.753758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.037886+0000","last_change":"2023-10-08T15:37:26.028708+0000","last_active":"2023-10-08T15:37:26.037886+0000","last_peered":"2023-10-08T15:37:26.037886+0000","last_clean":"2023-10-08T15:37:26.037886+0000","last_became_active":"2023-10-08T15:37:26.028418+0000","last_became_peered":"2023-10-08T15:37:26.028418+0000","last_unstale":"2023-10-08T15:37:26.037886+0000","last_undegraded":"2023-10-08T15:37:26.037886+0000","last_fullsized":"2023-10-08T15:37:26.037886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:58:41.177656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.055778+0000","last_change":"2023-10-08T15:37:25.026007+0000","last_active":"2023-10-08T15:37:26.055778+0000","last_peered":"2023-10-08T15:37:26.055778+0000","last_clean":"2023-10-08T15:37:26.055778+0000","last_became_active":"2023-10-08T15:37:25.024633+0000","last_became_peered":"2023-10-08T15:37:25.024633+0000","last_unstale":"2023-10-08T15:37:26.055778+0000","last_undegraded":"2023-10-08T15:37:26.055778+0000","last_fullsized":"2023-10-08T15:37:26.055778+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:20:36.667774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.052950+0000","last_change":"2023-10-08T15:37:26.035368+0000","last_active":"2023-10-08T15:37:26.052950+0000","last_peered":"2023-10-08T15:37:26.052950+0000","last_clean":"2023-10-08T15:37:26.052950+0000","last_became_active":"2023-10-08T15:37:26.034994+0000","last_became_peered":"2023-10-08T15:37:26.034994+0000","last_unstale":"2023-10-08T15:37:26.052950+0000","last_undegraded":"2023-10-08T15:37:26.052950+0000","last_fullsized":"2023-10-08T15:37:26.052950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:21:41.320706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.023845+0000","last_change":"2023-10-08T15:37:25.030197+0000","last_active":"2023-10-08T15:37:26.023845+0000","last_peered":"2023-10-08T15:37:26.023845+0000","last_clean":"2023-10-08T15:37:26.023845+0000","last_became_active":"2023-10-08T15:37:25.028215+0000","last_became_peered":"2023-10-08T15:37:25.028215+0000","last_unstale":"2023-10-08T15:37:26.023845+0000","last_undegraded":"2023-10-08T15:37:26.023845+0000","last_fullsized":"2023-10-08T15:37:26.023845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:17:55.698139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.041872+0000","last_change":"2023-10-08T15:37:26.031876+0000","last_active":"2023-10-08T15:37:26.041872+0000","last_peered":"2023-10-08T15:37:26.041872+0000","last_clean":"2023-10-08T15:37:26.041872+0000","last_became_active":"2023-10-08T15:37:26.031592+0000","last_became_peered":"2023-10-08T15:37:26.031592+0000","last_unstale":"2023-10-08T15:37:26.041872+0000","last_undegraded":"2023-10-08T15:37:26.041872+0000","last_fullsized":"2023-10-08T15:37:26.041872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:39:17.396462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.017482+0000","last_change":"2023-10-08T15:37:19.380955+0000","last_active":"2023-10-08T15:37:26.017482+0000","last_peered":"2023-10-08T15:37:26.017482+0000","last_clean":"2023-10-08T15:37:26.017482+0000","last_became_active":"2023-10-08T15:37:19.378277+0000","last_became_peered":"2023-10-08T15:37:19.378277+0000","last_unstale":"2023-10-08T15:37:26.017482+0000","last_undegraded":"2023-10-08T15:37:26.017482+0000","last_fullsized":"2023-10-08T15:37:26.017482+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:17.537726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:17.537726+0000","last_clean_scrub_stamp":"2023-10-08T15:37:17.537726+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:06:26.612046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.029287+0000","last_change":"2023-10-08T15:37:25.033028+0000","last_active":"2023-10-08T15:37:26.029287+0000","last_peered":"2023-10-08T15:37:26.029287+0000","last_clean":"2023-10-08T15:37:26.029287+0000","last_became_active":"2023-10-08T15:37:25.032661+0000","last_became_peered":"2023-10-08T15:37:25.032661+0000","last_unstale":"2023-10-08T15:37:26.029287+0000","last_undegraded":"2023-10-08T15:37:26.029287+0000","last_fullsized":"2023-10-08T15:37:26.029287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:18:48.729702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.053015+0000","last_change":"2023-10-08T15:37:26.050013+0000","last_active":"2023-10-08T15:37:26.053015+0000","last_peered":"2023-10-08T15:37:26.053015+0000","last_clean":"2023-10-08T15:37:26.053015+0000","last_became_active":"2023-10-08T15:37:26.049729+0000","last_became_peered":"2023-10-08T15:37:26.049729+0000","last_unstale":"2023-10-08T15:37:26.053015+0000","last_undegraded":"2023-10-08T15:37:26.053015+0000","last_fullsized":"2023-10-08T15:37:26.053015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:35:27.592646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.017320+0000","last_change":"2023-10-08T15:37:25.029859+0000","last_active":"2023-10-08T15:37:26.017320+0000","last_peered":"2023-10-08T15:37:26.017320+0000","last_clean":"2023-10-08T15:37:26.017320+0000","last_became_active":"2023-10-08T15:37:25.029537+0000","last_became_peered":"2023-10-08T15:37:25.029537+0000","last_unstale":"2023-10-08T15:37:26.017320+0000","last_undegraded":"2023-10-08T15:37:26.017320+0000","last_fullsized":"2023-10-08T15:37:26.017320+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:37:44.937225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.060797+0000","last_change":"2023-10-08T15:37:26.057875+0000","last_active":"2023-10-08T15:37:26.060797+0000","last_peered":"2023-10-08T15:37:26.060797+0000","last_clean":"2023-10-08T15:37:26.060797+0000","last_became_active":"2023-10-08T15:37:26.057545+0000","last_became_peered":"2023-10-08T15:37:26.057545+0000","last_unstale":"2023-10-08T15:37:26.060797+0000","last_undegraded":"2023-10-08T15:37:26.060797+0000","last_fullsized":"2023-10-08T15:37:26.060797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:10.725842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.022360+0000","last_change":"2023-10-08T15:37:25.035939+0000","last_active":"2023-10-08T15:37:26.022360+0000","last_peered":"2023-10-08T15:37:26.022360+0000","last_clean":"2023-10-08T15:37:26.022360+0000","last_became_active":"2023-10-08T15:37:25.035628+0000","last_became_peered":"2023-10-08T15:37:25.035628+0000","last_unstale":"2023-10-08T15:37:26.022360+0000","last_undegraded":"2023-10-08T15:37:26.022360+0000","last_fullsized":"2023-10-08T15:37:26.022360+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:51:28.443377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.041424+0000","last_change":"2023-10-08T15:37:26.038726+0000","last_active":"2023-10-08T15:37:26.041424+0000","last_peered":"2023-10-08T15:37:26.041424+0000","last_clean":"2023-10-08T15:37:26.041424+0000","last_became_active":"2023-10-08T15:37:26.036653+0000","last_became_peered":"2023-10-08T15:37:26.036653+0000","last_unstale":"2023-10-08T15:37:26.041424+0000","last_undegraded":"2023-10-08T15:37:26.041424+0000","last_fullsized":"2023-10-08T15:37:26.041424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:30:40.002556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.028671+0000","last_change":"2023-10-08T15:37:25.037867+0000","last_active":"2023-10-08T15:37:26.028671+0000","last_peered":"2023-10-08T15:37:26.028671+0000","last_clean":"2023-10-08T15:37:26.028671+0000","last_became_active":"2023-10-08T15:37:25.037638+0000","last_became_peered":"2023-10-08T15:37:25.037638+0000","last_unstale":"2023-10-08T15:37:26.028671+0000","last_undegraded":"2023-10-08T15:37:26.028671+0000","last_fullsized":"2023-10-08T15:37:26.028671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:52:16.136483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.057054+0000","last_change":"2023-10-08T15:37:26.046686+0000","last_active":"2023-10-08T15:37:26.057054+0000","last_peered":"2023-10-08T15:37:26.057054+0000","last_clean":"2023-10-08T15:37:26.057054+0000","last_became_active":"2023-10-08T15:37:26.046295+0000","last_became_peered":"2023-10-08T15:37:26.046295+0000","last_unstale":"2023-10-08T15:37:26.057054+0000","last_undegraded":"2023-10-08T15:37:26.057054+0000","last_fullsized":"2023-10-08T15:37:26.057054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:27:46.266100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.014293+0000","last_change":"2023-10-08T15:37:25.034339+0000","last_active":"2023-10-08T15:37:26.014293+0000","last_peered":"2023-10-08T15:37:26.014293+0000","last_clean":"2023-10-08T15:37:26.014293+0000","last_became_active":"2023-10-08T15:37:25.034011+0000","last_became_peered":"2023-10-08T15:37:25.034011+0000","last_unstale":"2023-10-08T15:37:26.014293+0000","last_undegraded":"2023-10-08T15:37:26.014293+0000","last_fullsized":"2023-10-08T15:37:26.014293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:14:36.405051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.057481+0000","last_change":"2023-10-08T15:37:26.049468+0000","last_active":"2023-10-08T15:37:26.057481+0000","last_peered":"2023-10-08T15:37:26.057481+0000","last_clean":"2023-10-08T15:37:26.057481+0000","last_became_active":"2023-10-08T15:37:26.048647+0000","last_became_peered":"2023-10-08T15:37:26.048647+0000","last_unstale":"2023-10-08T15:37:26.057481+0000","last_undegraded":"2023-10-08T15:37:26.057481+0000","last_fullsized":"2023-10-08T15:37:26.057481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:07:54.534413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.020837+0000","last_change":"2023-10-08T15:37:25.038765+0000","last_active":"2023-10-08T15:37:26.020837+0000","last_peered":"2023-10-08T15:37:26.020837+0000","last_clean":"2023-10-08T15:37:26.020837+0000","last_became_active":"2023-10-08T15:37:25.038448+0000","last_became_peered":"2023-10-08T15:37:25.038448+0000","last_unstale":"2023-10-08T15:37:26.020837+0000","last_undegraded":"2023-10-08T15:37:26.020837+0000","last_fullsized":"2023-10-08T15:37:26.020837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:14:36.405051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.041393+0000","last_change":"2023-10-08T15:37:26.039674+0000","last_active":"2023-10-08T15:37:26.041393+0000","last_peered":"2023-10-08T15:37:26.041393+0000","last_clean":"2023-10-08T15:37:26.041393+0000","last_became_active":"2023-10-08T15:37:26.039394+0000","last_became_peered":"2023-10-08T15:37:26.039394+0000","last_unstale":"2023-10-08T15:37:26.041393+0000","last_undegraded":"2023-10-08T15:37:26.041393+0000","last_fullsized":"2023-10-08T15:37:26.041393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:01:07.561679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T15:37:27.015443+0000","last_change":"2023-10-08T15:37:25.030182+0000","last_active":"2023-10-08T15:37:27.015443+0000","last_peered":"2023-10-08T15:37:27.015443+0000","last_clean":"2023-10-08T15:37:27.015443+0000","last_became_active":"2023-10-08T15:37:25.029834+0000","last_became_peered":"2023-10-08T15:37:25.029834+0000","last_unstale":"2023-10-08T15:37:27.015443+0000","last_undegraded":"2023-10-08T15:37:27.015443+0000","last_fullsized":"2023-10-08T15:37:27.015443+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:09:10.975405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.037854+0000","last_change":"2023-10-08T15:37:26.030211+0000","last_active":"2023-10-08T15:37:26.037854+0000","last_peered":"2023-10-08T15:37:26.037854+0000","last_clean":"2023-10-08T15:37:26.037854+0000","last_became_active":"2023-10-08T15:37:26.029155+0000","last_became_peered":"2023-10-08T15:37:26.029155+0000","last_unstale":"2023-10-08T15:37:26.037854+0000","last_undegraded":"2023-10-08T15:37:26.037854+0000","last_fullsized":"2023-10-08T15:37:26.037854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:12:46.913128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.054023+0000","last_change":"2023-10-08T15:37:25.033767+0000","last_active":"2023-10-08T15:37:26.054023+0000","last_peered":"2023-10-08T15:37:26.054023+0000","last_clean":"2023-10-08T15:37:26.054023+0000","last_became_active":"2023-10-08T15:37:25.033432+0000","last_became_peered":"2023-10-08T15:37:25.033432+0000","last_unstale":"2023-10-08T15:37:26.054023+0000","last_undegraded":"2023-10-08T15:37:26.054023+0000","last_fullsized":"2023-10-08T15:37:26.054023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:18:34.111508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.049042+0000","last_change":"2023-10-08T15:37:26.044802+0000","last_active":"2023-10-08T15:37:26.049042+0000","last_peered":"2023-10-08T15:37:26.049042+0000","last_clean":"2023-10-08T15:37:26.049042+0000","last_became_active":"2023-10-08T15:37:26.044064+0000","last_became_peered":"2023-10-08T15:37:26.044064+0000","last_unstale":"2023-10-08T15:37:26.049042+0000","last_undegraded":"2023-10-08T15:37:26.049042+0000","last_fullsized":"2023-10-08T15:37:26.049042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:27:46.266100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.017243+0000","last_change":"2023-10-08T15:37:25.038017+0000","last_active":"2023-10-08T15:37:26.017243+0000","last_peered":"2023-10-08T15:37:26.017243+0000","last_clean":"2023-10-08T15:37:26.017243+0000","last_became_active":"2023-10-08T15:37:25.037738+0000","last_became_peered":"2023-10-08T15:37:25.037738+0000","last_unstale":"2023-10-08T15:37:26.017243+0000","last_undegraded":"2023-10-08T15:37:26.017243+0000","last_fullsized":"2023-10-08T15:37:26.017243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:09:10.975405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.057284+0000","last_change":"2023-10-08T15:37:26.039472+0000","last_active":"2023-10-08T15:37:26.057284+0000","last_peered":"2023-10-08T15:37:26.057284+0000","last_clean":"2023-10-08T15:37:26.057284+0000","last_became_active":"2023-10-08T15:37:26.038579+0000","last_became_peered":"2023-10-08T15:37:26.038579+0000","last_unstale":"2023-10-08T15:37:26.057284+0000","last_undegraded":"2023-10-08T15:37:26.057284+0000","last_fullsized":"2023-10-08T15:37:26.057284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:33:25.213750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.013917+0000","last_change":"2023-10-08T15:37:25.024556+0000","last_active":"2023-10-08T15:37:26.013917+0000","last_peered":"2023-10-08T15:37:26.013917+0000","last_clean":"2023-10-08T15:37:26.013917+0000","last_became_active":"2023-10-08T15:37:25.024208+0000","last_became_peered":"2023-10-08T15:37:25.024208+0000","last_unstale":"2023-10-08T15:37:26.013917+0000","last_undegraded":"2023-10-08T15:37:26.013917+0000","last_fullsized":"2023-10-08T15:37:26.013917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:18:34.111508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.039462+0000","last_change":"2023-10-08T15:37:26.035450+0000","last_active":"2023-10-08T15:37:26.039462+0000","last_peered":"2023-10-08T15:37:26.039462+0000","last_clean":"2023-10-08T15:37:26.039462+0000","last_became_active":"2023-10-08T15:37:26.034248+0000","last_became_peered":"2023-10-08T15:37:26.034248+0000","last_unstale":"2023-10-08T15:37:26.039462+0000","last_undegraded":"2023-10-08T15:37:26.039462+0000","last_fullsized":"2023-10-08T15:37:26.039462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:37:10.263562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.013177+0000","last_change":"2023-10-08T15:37:25.030789+0000","last_active":"2023-10-08T15:37:26.013177+0000","last_peered":"2023-10-08T15:37:26.013177+0000","last_clean":"2023-10-08T15:37:26.013177+0000","last_became_active":"2023-10-08T15:37:25.030435+0000","last_became_peered":"2023-10-08T15:37:25.030435+0000","last_unstale":"2023-10-08T15:37:26.013177+0000","last_undegraded":"2023-10-08T15:37:26.013177+0000","last_fullsized":"2023-10-08T15:37:26.013177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:17:55.698139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.046184+0000","last_change":"2023-10-08T15:37:26.045028+0000","last_active":"2023-10-08T15:37:26.046184+0000","last_peered":"2023-10-08T15:37:26.046184+0000","last_clean":"2023-10-08T15:37:26.046184+0000","last_became_active":"2023-10-08T15:37:26.044703+0000","last_became_peered":"2023-10-08T15:37:26.044703+0000","last_unstale":"2023-10-08T15:37:26.046184+0000","last_undegraded":"2023-10-08T15:37:26.046184+0000","last_fullsized":"2023-10-08T15:37:26.046184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:47:37.094485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.058571+0000","last_change":"2023-10-08T15:37:25.032025+0000","last_active":"2023-10-08T15:37:26.058571+0000","last_peered":"2023-10-08T15:37:26.058571+0000","last_clean":"2023-10-08T15:37:26.058571+0000","last_became_active":"2023-10-08T15:37:25.031526+0000","last_became_peered":"2023-10-08T15:37:25.031526+0000","last_unstale":"2023-10-08T15:37:26.058571+0000","last_undegraded":"2023-10-08T15:37:26.058571+0000","last_fullsized":"2023-10-08T15:37:26.058571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:20:36.667774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.059510+0000","last_change":"2023-10-08T15:37:26.057305+0000","last_active":"2023-10-08T15:37:26.059510+0000","last_peered":"2023-10-08T15:37:26.059510+0000","last_clean":"2023-10-08T15:37:26.059510+0000","last_became_active":"2023-10-08T15:37:26.056970+0000","last_became_peered":"2023-10-08T15:37:26.056970+0000","last_unstale":"2023-10-08T15:37:26.059510+0000","last_undegraded":"2023-10-08T15:37:26.059510+0000","last_fullsized":"2023-10-08T15:37:26.059510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:30:40.002556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.058725+0000","last_change":"2023-10-08T15:37:26.057363+0000","last_active":"2023-10-08T15:37:26.058725+0000","last_peered":"2023-10-08T15:37:26.058725+0000","last_clean":"2023-10-08T15:37:26.058725+0000","last_became_active":"2023-10-08T15:37:26.057058+0000","last_became_peered":"2023-10-08T15:37:26.057058+0000","last_unstale":"2023-10-08T15:37:26.058725+0000","last_undegraded":"2023-10-08T15:37:26.058725+0000","last_fullsized":"2023-10-08T15:37:26.058725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:20:26.216438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.054689+0000","last_change":"2023-10-08T15:37:25.041688+0000","last_active":"2023-10-08T15:37:26.054689+0000","last_peered":"2023-10-08T15:37:26.054689+0000","last_clean":"2023-10-08T15:37:26.054689+0000","last_became_active":"2023-10-08T15:37:25.041387+0000","last_became_peered":"2023-10-08T15:37:25.041387+0000","last_unstale":"2023-10-08T15:37:26.054689+0000","last_undegraded":"2023-10-08T15:37:26.054689+0000","last_fullsized":"2023-10-08T15:37:26.054689+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:38:23.485886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.058772+0000","last_change":"2023-10-08T15:37:26.057526+0000","last_active":"2023-10-08T15:37:26.058772+0000","last_peered":"2023-10-08T15:37:26.058772+0000","last_clean":"2023-10-08T15:37:26.058772+0000","last_became_active":"2023-10-08T15:37:26.057220+0000","last_became_peered":"2023-10-08T15:37:26.057220+0000","last_unstale":"2023-10-08T15:37:26.058772+0000","last_undegraded":"2023-10-08T15:37:26.058772+0000","last_fullsized":"2023-10-08T15:37:26.058772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:48.862001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.049539+0000","last_change":"2023-10-08T15:37:25.035362+0000","last_active":"2023-10-08T15:37:26.049539+0000","last_peered":"2023-10-08T15:37:26.049539+0000","last_clean":"2023-10-08T15:37:26.049539+0000","last_became_active":"2023-10-08T15:37:25.035068+0000","last_became_peered":"2023-10-08T15:37:25.035068+0000","last_unstale":"2023-10-08T15:37:26.049539+0000","last_undegraded":"2023-10-08T15:37:26.049539+0000","last_fullsized":"2023-10-08T15:37:26.049539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:06.188503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.052326+0000","last_change":"2023-10-08T15:37:26.050163+0000","last_active":"2023-10-08T15:37:26.052326+0000","last_peered":"2023-10-08T15:37:26.052326+0000","last_clean":"2023-10-08T15:37:26.052326+0000","last_became_active":"2023-10-08T15:37:26.049850+0000","last_became_peered":"2023-10-08T15:37:26.049850+0000","last_unstale":"2023-10-08T15:37:26.052326+0000","last_undegraded":"2023-10-08T15:37:26.052326+0000","last_fullsized":"2023-10-08T15:37:26.052326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:12:46.913128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.045285+0000","last_change":"2023-10-08T15:37:25.034880+0000","last_active":"2023-10-08T15:37:26.045285+0000","last_peered":"2023-10-08T15:37:26.045285+0000","last_clean":"2023-10-08T15:37:26.045285+0000","last_became_active":"2023-10-08T15:37:25.034547+0000","last_became_peered":"2023-10-08T15:37:25.034547+0000","last_unstale":"2023-10-08T15:37:26.045285+0000","last_undegraded":"2023-10-08T15:37:26.045285+0000","last_fullsized":"2023-10-08T15:37:26.045285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:13:24.905916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.042918+0000","last_change":"2023-10-08T15:37:26.040375+0000","last_active":"2023-10-08T15:37:26.042918+0000","last_peered":"2023-10-08T15:37:26.042918+0000","last_clean":"2023-10-08T15:37:26.042918+0000","last_became_active":"2023-10-08T15:37:26.040082+0000","last_became_peered":"2023-10-08T15:37:26.040082+0000","last_unstale":"2023-10-08T15:37:26.042918+0000","last_undegraded":"2023-10-08T15:37:26.042918+0000","last_fullsized":"2023-10-08T15:37:26.042918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:24.993513+0000","last_clean_scrub_stamp":"2023-10-08T15:37:24.993513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:09:23.414069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:37:26.052719+0000","last_change":"2023-10-08T15:37:25.034909+0000","last_active":"2023-10-08T15:37:26.052719+0000","last_peered":"2023-10-08T15:37:26.052719+0000","last_clean":"2023-10-08T15:37:26.052719+0000","last_became_active":"2023-10-08T15:37:25.034403+0000","last_became_peered":"2023-10-08T15:37:25.034403+0000","last_unstale":"2023-10-08T15:37:26.052719+0000","last_undegraded":"2023-10-08T15:37:26.052719+0000","last_fullsized":"2023-10-08T15:37:26.052719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:23.988871+0000","last_clean_scrub_stamp":"2023-10-08T15:37:23.988871+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:27:16.596718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66282,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301648,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070192,"statfs":{"total":96636764160,"available":96327876608,"internally_reserved":0,"allocated":270336,"data_stored":660538,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2929999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3799999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301592,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070248,"statfs":{"total":96636764160,"available":96327933952,"internally_reserved":0,"allocated":212992,"data_stored":71152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.012}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.246}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4319999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542151,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297496,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074344,"statfs":{"total":96636764160,"available":96332128256,"internally_reserved":0,"allocated":212992,"data_stored":71152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]}]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297484,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074356,"statfs":{"total":96636764160,"available":96332140544,"internally_reserved":0,"allocated":200704,"data_stored":69616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0529999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542151,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297492,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074348,"statfs":{"total":96636764160,"available":96332132352,"internally_reserved":0,"allocated":208896,"data_stored":69776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1639999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.133}]}]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297560,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074280,"statfs":{"total":96636764160,"available":96332062720,"internally_reserved":0,"allocated":278528,"data_stored":660594,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.196}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3600000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301584,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070256,"statfs":{"total":96636764160,"available":96327942144,"internally_reserved":0,"allocated":204800,"data_stored":69706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301592,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070248,"statfs":{"total":96636764160,"available":96327933952,"internally_reserved":0,"allocated":212992,"data_stored":69742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.252}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5029999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T15:37:39.420 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-08T15:37:39.420 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-08T15:37:39.420 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-08T15:37:39.420 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-08T15:37:39.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.521+0000 7fe14676e700 1 Processor -- start 2023-10-08T15:37:39.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.521+0000 7fe14676e700 1 -- start start 2023-10-08T15:37:39.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.521+0000 7fe14676e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe14006dbe0 0x7fe1400bfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:39.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.521+0000 7fe14676e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe14006d300 0x7fe1401534c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:39.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.521+0000 7fe14676e700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1400be030 con 0x7fe1401530f0 2023-10-08T15:37:39.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.521+0000 7fe14676e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe140153a00 con 0x7fe14006dbe0 2023-10-08T15:37:39.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.521+0000 7fe14676e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1400be310 con 0x7fe14006d300 2023-10-08T15:37:39.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.521+0000 7fe14576c700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fe1401530f0 0x7fe14006cbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:59634/0 (socket says 172.21.15.3:59634) 2023-10-08T15:37:39.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.521+0000 7fe14576c700 1 -- 172.21.15.3:0/1618080847 learned_addr learned my addr 172.21.15.3:0/1618080847 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:39.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.521+0000 7fe144f6b700 1 --2- 172.21.15.3:0/1618080847 >> v2:172.21.15.50:3300/0 conn(0x7fe14006dbe0 0x7fe1400bfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:39.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.521+0000 7fe145f6d700 1 --2- 172.21.15.3:0/1618080847 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe14006d300 0x7fe1401534c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:39.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.521+0000 7fe133fff700 1 -- 172.21.15.3:0/1618080847 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1555955328 0 0) 0x7fe1400be030 con 0x7fe1401530f0 2023-10-08T15:37:39.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.521+0000 7fe133fff700 1 -- 172.21.15.3:0/1618080847 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe12c003570 con 0x7fe1401530f0 2023-10-08T15:37:39.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.521+0000 7fe144f6b700 1 -- 172.21.15.3:0/1618080847 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe14006d300 msgr2=0x7fe1401534c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:39.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.521+0000 7fe144f6b700 1 --2- 172.21.15.3:0/1618080847 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe14006d300 0x7fe1401534c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:39.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.521+0000 7fe144f6b700 1 -- 172.21.15.3:0/1618080847 >> v1:172.21.15.3:6789/0 conn(0x7fe1401530f0 legacy=0x7fe14006cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:39.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.521+0000 7fe144f6b700 1 -- 172.21.15.3:0/1618080847 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe140153c10 con 0x7fe14006dbe0 2023-10-08T15:37:39.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.521+0000 7fe145f6d700 1 --2- 172.21.15.3:0/1618080847 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe14006d300 0x7fe1401534c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:37:39.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.521+0000 7fe144f6b700 1 --2- 172.21.15.3:0/1618080847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe14006dbe0 0x7fe1400bfcf0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe138009e60 tx=0x7fe138009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aca48b099ab8cb86 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:39.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.521+0000 7fe133fff700 1 -- 172.21.15.3:0/1618080847 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13800e070 con 0x7fe14006dbe0 2023-10-08T15:37:39.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.521+0000 7fe133fff700 1 -- 172.21.15.3:0/1618080847 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe13800bab0 con 0x7fe14006dbe0 2023-10-08T15:37:39.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.521+0000 7fe133fff700 1 -- 172.21.15.3:0/1618080847 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13800be30 con 0x7fe14006dbe0 2023-10-08T15:37:39.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.525+0000 7fe14676e700 1 -- 172.21.15.3:0/1618080847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe14006dbe0 msgr2=0x7fe1400bfcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:39.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.525+0000 7fe14676e700 1 --2- 172.21.15.3:0/1618080847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe14006dbe0 0x7fe1400bfcf0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe138009e60 tx=0x7fe138009780 comp rx=0 tx=0).stop 2023-10-08T15:37:39.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.525+0000 7fe14676e700 1 -- 172.21.15.3:0/1618080847 shutdown_connections 2023-10-08T15:37:39.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.525+0000 7fe14676e700 1 --2- 172.21.15.3:0/1618080847 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe14006d300 0x7fe1401534c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:39.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.525+0000 7fe14676e700 1 --2- 172.21.15.3:0/1618080847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe14006dbe0 0x7fe1400bfcf0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:39.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.525+0000 7fe14676e700 1 -- 172.21.15.3:0/1618080847 >> 172.21.15.3:0/1618080847 conn(0x7fe1400c1df0 msgr2=0x7fe1400c21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:39.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.525+0000 7fe14676e700 1 -- 172.21.15.3:0/1618080847 shutdown_connections 2023-10-08T15:37:39.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.525+0000 7fe14676e700 1 -- 172.21.15.3:0/1618080847 wait complete. 2023-10-08T15:37:39.532 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.525+0000 7fe14676e700 1 Processor -- start 2023-10-08T15:37:39.532 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.525+0000 7fe14676e700 1 -- start start 2023-10-08T15:37:39.534 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.529+0000 7fe14676e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe14006d300 0x7fe1401517a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:39.534 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.529+0000 7fe14676e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe14006dbe0 0x7fe14014b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:39.534 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.529+0000 7fe14676e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1401530f0 0x7fe14008a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:39.534 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.529+0000 7fe14676e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14014ba40 con 0x7fe14006d300 2023-10-08T15:37:39.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.529+0000 7fe14676e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1401528c0 con 0x7fe1401530f0 2023-10-08T15:37:39.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.529+0000 7fe14676e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe140152ba0 con 0x7fe14006dbe0 2023-10-08T15:37:39.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.529+0000 7fe14576c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe14006d300 0x7fe1401517a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:39.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.529+0000 7fe14576c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe14006d300 0x7fe1401517a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44074/0 (socket says 172.21.15.3:44074) 2023-10-08T15:37:39.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.529+0000 7fe14576c700 1 -- 172.21.15.3:0/3810117676 learned_addr learned my addr 172.21.15.3:0/3810117676 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:39.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.529+0000 7fe145f6d700 1 --2- 172.21.15.3:0/3810117676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1401530f0 0x7fe14008a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:39.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.529+0000 7fe144f6b700 1 --2- 172.21.15.3:0/3810117676 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe14006dbe0 0x7fe14014b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:39.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.529+0000 7fe14576c700 1 -- 172.21.15.3:0/3810117676 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe14006dbe0 msgr2=0x7fe14014b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:39.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.529+0000 7fe14576c700 1 --2- 172.21.15.3:0/3810117676 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe14006dbe0 0x7fe14014b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:39.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.529+0000 7fe14576c700 1 -- 172.21.15.3:0/3810117676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1401530f0 msgr2=0x7fe14008a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:39.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.529+0000 7fe14576c700 1 --2- 172.21.15.3:0/3810117676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1401530f0 0x7fe14008a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:39.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.529+0000 7fe14576c700 1 -- 172.21.15.3:0/3810117676 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe13c009420 con 0x7fe14006d300 2023-10-08T15:37:39.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.529+0000 7fe14576c700 1 --2- 172.21.15.3:0/3810117676 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe14006d300 0x7fe1401517a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe1340011e0 tx=0x7fe134007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:39.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.529+0000 7fe1317fa700 1 -- 172.21.15.3:0/3810117676 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe134005b30 con 0x7fe14006d300 2023-10-08T15:37:39.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.529+0000 7fe1317fa700 1 -- 172.21.15.3:0/3810117676 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe134005c90 con 0x7fe14006d300 2023-10-08T15:37:39.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.529+0000 7fe14676e700 1 -- 172.21.15.3:0/3810117676 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe138009a20 con 0x7fe14006d300 2023-10-08T15:37:39.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.529+0000 7fe1317fa700 1 -- 172.21.15.3:0/3810117676 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe134007320 con 0x7fe14006d300 2023-10-08T15:37:39.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.529+0000 7fe14676e700 1 -- 172.21.15.3:0/3810117676 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1401467e0 con 0x7fe14006d300 2023-10-08T15:37:39.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.529+0000 7fe14676e700 1 -- 172.21.15.3:0/3810117676 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe140151d70 con 0x7fe14006d300 2023-10-08T15:37:39.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.529+0000 7fe1317fa700 1 -- 172.21.15.3:0/3810117676 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe134007690 con 0x7fe14006d300 2023-10-08T15:37:39.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.533+0000 7fe1317fa700 1 --2- 172.21.15.3:0/3810117676 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe124060550 0x7fe124062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:39.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.533+0000 7fe1317fa700 1 -- 172.21.15.3:0/3810117676 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe13407bc10 con 0x7fe14006d300 2023-10-08T15:37:39.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.533+0000 7fe144f6b700 1 --2- 172.21.15.3:0/3810117676 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe124060550 0x7fe124062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:39.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.533+0000 7fe144f6b700 1 --2- 172.21.15.3:0/3810117676 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe124060550 0x7fe124062a00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe1380097c0 tx=0x7fe138019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:39.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.541+0000 7fe1317fa700 1 -- 172.21.15.3:0/3810117676 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe140151d70 con 0x7fe14006d300 2023-10-08T15:37:39.733 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.725+0000 7fe14676e700 1 -- 172.21.15.3:0/3810117676 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fe140151d70 con 0x7fe14006d300 2023-10-08T15:37:39.733 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.725+0000 7fe1317fa700 1 -- 172.21.15.3:0/3810117676 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fe134017040 con 0x7fe14006d300 2023-10-08T15:37:39.733 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:37:39.733 INFO:teuthology.orchestra.run.smithi003.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-08T15:37:39.735 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.729+0000 7fe14676e700 1 -- 172.21.15.3:0/3810117676 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe124060550 msgr2=0x7fe124062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:39.736 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.729+0000 7fe14676e700 1 --2- 172.21.15.3:0/3810117676 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe124060550 0x7fe124062a00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe1380097c0 tx=0x7fe138019000 comp rx=0 tx=0).stop 2023-10-08T15:37:39.736 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.729+0000 7fe14676e700 1 -- 172.21.15.3:0/3810117676 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe14006d300 msgr2=0x7fe1401517a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:39.736 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.729+0000 7fe14676e700 1 --2- 172.21.15.3:0/3810117676 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe14006d300 0x7fe1401517a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe1340011e0 tx=0x7fe134007df0 comp rx=0 tx=0).stop 2023-10-08T15:37:39.736 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.729+0000 7fe14676e700 1 -- 172.21.15.3:0/3810117676 shutdown_connections 2023-10-08T15:37:39.736 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.729+0000 7fe14676e700 1 --2- 172.21.15.3:0/3810117676 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe124060550 0x7fe124062a00 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:39.736 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.729+0000 7fe14676e700 1 --2- 172.21.15.3:0/3810117676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1401530f0 0x7fe14008a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:39.736 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.729+0000 7fe14676e700 1 --2- 172.21.15.3:0/3810117676 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe14006dbe0 0x7fe14014b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:39.736 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.729+0000 7fe14676e700 1 --2- 172.21.15.3:0/3810117676 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe14006d300 0x7fe1401517a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:39.736 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.729+0000 7fe14676e700 1 -- 172.21.15.3:0/3810117676 >> 172.21.15.3:0/3810117676 conn(0x7fe1400c1df0 msgr2=0x7fe1400c0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:39.736 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.729+0000 7fe14676e700 1 -- 172.21.15.3:0/3810117676 shutdown_connections 2023-10-08T15:37:39.736 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.729+0000 7fe14676e700 1 -- 172.21.15.3:0/3810117676 wait complete. 2023-10-08T15:37:39.750 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-08T15:37:39.751 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:37:39.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.845+0000 7f163a259700 1 Processor -- start 2023-10-08T15:37:39.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.845+0000 7f163a259700 1 -- start start 2023-10-08T15:37:39.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.845+0000 7f163a259700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f16340703a0 0x7f1634146b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:39.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.845+0000 7f163a259700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16341477c0 con 0x7f16340707d0 2023-10-08T15:37:39.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.845+0000 7f163a259700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1634147970 con 0x7f163414b850 2023-10-08T15:37:39.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.845+0000 7f163a259700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f163406de00 con 0x7f16340703a0 2023-10-08T15:37:39.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.845+0000 7f1639a58700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f16340707d0 0x7f16341470b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:59650/0 (socket says 172.21.15.3:59650) 2023-10-08T15:37:39.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.845+0000 7f1639a58700 1 -- 172.21.15.3:0/621895339 learned_addr learned my addr 172.21.15.3:0/621895339 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:39.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.845+0000 7f1638a56700 1 --2- 172.21.15.3:0/621895339 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f16340703a0 0x7f1634146b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:39.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.845+0000 7f162bfff700 1 -- 172.21.15.3:0/621895339 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1575624102 0 0) 0x7f16341477c0 con 0x7f16340707d0 2023-10-08T15:37:39.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.845+0000 7f162bfff700 1 -- 172.21.15.3:0/621895339 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1620003570 con 0x7f16340707d0 2023-10-08T15:37:39.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.845+0000 7f162bfff700 1 -- 172.21.15.3:0/621895339 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3463728189 0 0) 0x7f1634147970 con 0x7f163414b850 2023-10-08T15:37:39.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.845+0000 7f162bfff700 1 -- 172.21.15.3:0/621895339 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16341477c0 con 0x7f163414b850 2023-10-08T15:37:39.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.845+0000 7f1638a56700 1 -- 172.21.15.3:0/621895339 >> v1:172.21.15.50:6789/0 conn(0x7f163414b850 legacy=0x7f16340a15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:39.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.845+0000 7f1638a56700 1 -- 172.21.15.3:0/621895339 >> v1:172.21.15.3:6789/0 conn(0x7f16340707d0 legacy=0x7f16341470b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:39.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.845+0000 7f1638a56700 1 -- 172.21.15.3:0/621895339 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1634069770 con 0x7f16340703a0 2023-10-08T15:37:39.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.845+0000 7f1638a56700 1 --2- 172.21.15.3:0/621895339 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f16340703a0 0x7f1634146b70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1624009910 tx=0x7f16240091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f55cf6d57f45621 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:39.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.845+0000 7f162bfff700 1 -- 172.21.15.3:0/621895339 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1624011630 con 0x7f16340703a0 2023-10-08T15:37:39.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.845+0000 7f162bfff700 1 -- 172.21.15.3:0/621895339 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1624011790 con 0x7f16340703a0 2023-10-08T15:37:39.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.845+0000 7f162bfff700 1 -- 172.21.15.3:0/621895339 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1624011b10 con 0x7f16340703a0 2023-10-08T15:37:39.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.845+0000 7f163a259700 1 -- 172.21.15.3:0/621895339 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f16340703a0 msgr2=0x7f1634146b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:39.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.845+0000 7f163a259700 1 --2- 172.21.15.3:0/621895339 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f16340703a0 0x7f1634146b70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1624009910 tx=0x7f16240091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:39.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.849+0000 7f163a259700 1 -- 172.21.15.3:0/621895339 shutdown_connections 2023-10-08T15:37:39.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.849+0000 7f163a259700 1 --2- 172.21.15.3:0/621895339 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f16340703a0 0x7f1634146b70 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:39.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.849+0000 7f163a259700 1 -- 172.21.15.3:0/621895339 >> 172.21.15.3:0/621895339 conn(0x7f16340670e0 msgr2=0x7f16340674e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:39.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.849+0000 7f163a259700 1 -- 172.21.15.3:0/621895339 shutdown_connections 2023-10-08T15:37:39.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.849+0000 7f163a259700 1 -- 172.21.15.3:0/621895339 wait complete. 2023-10-08T15:37:39.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.849+0000 7f163a259700 1 Processor -- start 2023-10-08T15:37:39.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.849+0000 7f163a259700 1 -- start start 2023-10-08T15:37:39.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.853+0000 7f163a259700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f16340703a0 0x7f16340b4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:39.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.853+0000 7f163a259700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16340707d0 0x7f16340ba770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:39.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.853+0000 7f163a259700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f163414b850 0x7f163415be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:39.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.853+0000 7f163a259700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16340b6e00 con 0x7f16340703a0 2023-10-08T15:37:39.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.853+0000 7f163a259700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16341592b0 con 0x7f16340707d0 2023-10-08T15:37:39.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.853+0000 7f163a259700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1634140eb0 con 0x7f163414b850 2023-10-08T15:37:39.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.853+0000 7f1639257700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f16340703a0 0x7f16340b4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:39.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.853+0000 7f1639257700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f16340703a0 0x7f16340b4490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44080/0 (socket says 172.21.15.3:44080) 2023-10-08T15:37:39.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.853+0000 7f1639257700 1 -- 172.21.15.3:0/2568898358 learned_addr learned my addr 172.21.15.3:0/2568898358 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:39.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.853+0000 7f1638a56700 1 --2- 172.21.15.3:0/2568898358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16340707d0 0x7f16340ba770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:39.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.853+0000 7f1639a58700 1 --2- 172.21.15.3:0/2568898358 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f163414b850 0x7f163415be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:39.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.853+0000 7f1639257700 1 -- 172.21.15.3:0/2568898358 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f163414b850 msgr2=0x7f163415be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:39.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.853+0000 7f1639257700 1 --2- 172.21.15.3:0/2568898358 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f163414b850 0x7f163415be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:39.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.853+0000 7f1639257700 1 -- 172.21.15.3:0/2568898358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16340707d0 msgr2=0x7f16340ba770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:39.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.853+0000 7f1639257700 1 --2- 172.21.15.3:0/2568898358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16340707d0 0x7f16340ba770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:39.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.853+0000 7f1639257700 1 -- 172.21.15.3:0/2568898358 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1624009420 con 0x7f16340703a0 2023-10-08T15:37:39.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.853+0000 7f1639257700 1 --2- 172.21.15.3:0/2568898358 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f16340703a0 0x7f16340b4490 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f163000c590 tx=0x7f1630007dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:39.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.853+0000 7f16297fa700 1 -- 172.21.15.3:0/2568898358 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1630010510 con 0x7f16340703a0 2023-10-08T15:37:39.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.853+0000 7f16297fa700 1 -- 172.21.15.3:0/2568898358 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1630010670 con 0x7f16340703a0 2023-10-08T15:37:39.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.853+0000 7f163a259700 1 -- 172.21.15.3:0/2568898358 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f163415ca50 con 0x7f16340703a0 2023-10-08T15:37:39.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.853+0000 7f16297fa700 1 -- 172.21.15.3:0/2568898358 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1630010a30 con 0x7f16340703a0 2023-10-08T15:37:39.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.853+0000 7f163a259700 1 -- 172.21.15.3:0/2568898358 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1634140640 con 0x7f16340703a0 2023-10-08T15:37:39.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.857+0000 7f163a259700 1 -- 172.21.15.3:0/2568898358 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f163405ecf0 con 0x7f16340703a0 2023-10-08T15:37:39.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.857+0000 7f16297fa700 1 -- 172.21.15.3:0/2568898358 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f163001b400 con 0x7f16340703a0 2023-10-08T15:37:39.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.857+0000 7f16297fa700 1 --2- 172.21.15.3:0/2568898358 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1618060550 0x7f1618062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:39.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.857+0000 7f16297fa700 1 -- 172.21.15.3:0/2568898358 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f163007c2b0 con 0x7f16340703a0 2023-10-08T15:37:39.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.857+0000 7f1638a56700 1 --2- 172.21.15.3:0/2568898358 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1618060550 0x7f1618062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:39.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.857+0000 7f1638a56700 1 --2- 172.21.15.3:0/2568898358 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1618060550 0x7f1618062a00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1624009860 tx=0x7f1624017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:39.870 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:39.865+0000 7f16297fa700 1 -- 172.21.15.3:0/2568898358 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f163004c8a0 con 0x7f16340703a0 2023-10-08T15:37:40.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.021+0000 7f163a259700 1 -- 172.21.15.3:0/2568898358 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1634068c60 con 0x7f16340703a0 2023-10-08T15:37:40.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.025+0000 7f16297fa700 1 -- 172.21.15.3:0/2568898358 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15254 (secure 0 0 0) 0x7f163004fec0 con 0x7f16340703a0 2023-10-08T15:37:40.030 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:37:40.030 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":20,"fsid":"7635972e-cd66-4a8f-a231-378db8b3847a","created":"2023-10-08T15:37:08.234594+0000","modified":"2023-10-08T15:37:27.007828+0000","last_up_change":"2023-10-08T15:37:17.537726+0000","last_in_change":"2023-10-08T15:37:10.269178+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:37:16.581590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:37:23.353518+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T15:37:24.365114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"64fb1864-bfdd-4d75-9b41-03fb60085dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33363},{"type":"v1","addr":"172.21.15.3:6801","nonce":33363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33363},{"type":"v1","addr":"172.21.15.3:6803","nonce":33363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":33363},{"type":"v1","addr":"172.21.15.3:6807","nonce":33363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33363},{"type":"v1","addr":"172.21.15.3:6805","nonce":33363}]},"public_addr":"172.21.15.3:6801/33363","cluster_addr":"172.21.15.3:6803/33363","heartbeat_back_addr":"172.21.15.3:6807/33363","heartbeat_front_addr":"172.21.15.3:6805/33363","state":["exists","up"]},{"osd":1,"uuid":"3ca6bd3a-3e8a-4c65-af9c-46148b0c2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33364},{"type":"v1","addr":"172.21.15.3:6820","nonce":33364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33364},{"type":"v1","addr":"172.21.15.3:6824","nonce":33364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33364},{"type":"v1","addr":"172.21.15.3:6831","nonce":33364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33364},{"type":"v1","addr":"172.21.15.3:6828","nonce":33364}]},"public_addr":"172.21.15.3:6820/33364","cluster_addr":"172.21.15.3:6824/33364","heartbeat_back_addr":"172.21.15.3:6831/33364","heartbeat_front_addr":"172.21.15.3:6828/33364","state":["exists","up"]},{"osd":2,"uuid":"6eb9f757-58dd-442f-910d-32401454bce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33366},{"type":"v1","addr":"172.21.15.3:6817","nonce":33366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":33366},{"type":"v1","addr":"172.21.15.3:6821","nonce":33366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6827","nonce":33366},{"type":"v1","addr":"172.21.15.3:6829","nonce":33366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":33366},{"type":"v1","addr":"172.21.15.3:6825","nonce":33366}]},"public_addr":"172.21.15.3:6817/33366","cluster_addr":"172.21.15.3:6821/33366","heartbeat_back_addr":"172.21.15.3:6829/33366","heartbeat_front_addr":"172.21.15.3:6825/33366","state":["exists","up"]},{"osd":3,"uuid":"1c39866b-ac2e-4ea9-a69c-02b01ee4191d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33365},{"type":"v1","addr":"172.21.15.3:6809","nonce":33365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":33365},{"type":"v1","addr":"172.21.15.3:6811","nonce":33365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33365},{"type":"v1","addr":"172.21.15.3:6815","nonce":33365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":33365},{"type":"v1","addr":"172.21.15.3:6813","nonce":33365}]},"public_addr":"172.21.15.3:6809/33365","cluster_addr":"172.21.15.3:6811/33365","heartbeat_back_addr":"172.21.15.3:6815/33365","heartbeat_front_addr":"172.21.15.3:6813/33365","state":["exists","up"]},{"osd":4,"uuid":"15f86b61-b7f1-4780-ae00-9d80a68cb830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":33605},{"type":"v1","addr":"172.21.15.50:6809","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33605},{"type":"v1","addr":"172.21.15.50:6811","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33605},{"type":"v1","addr":"172.21.15.50:6815","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":33605},{"type":"v1","addr":"172.21.15.50:6813","nonce":33605}]},"public_addr":"172.21.15.50:6809/33605","cluster_addr":"172.21.15.50:6811/33605","heartbeat_back_addr":"172.21.15.50:6815/33605","heartbeat_front_addr":"172.21.15.50:6813/33605","state":["exists","up"]},{"osd":5,"uuid":"726c3003-34e6-4d5a-b6e2-f911e13c2118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33606},{"type":"v1","addr":"172.21.15.50:6801","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33606},{"type":"v1","addr":"172.21.15.50:6803","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33606},{"type":"v1","addr":"172.21.15.50:6807","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":33606},{"type":"v1","addr":"172.21.15.50:6805","nonce":33606}]},"public_addr":"172.21.15.50:6801/33606","cluster_addr":"172.21.15.50:6803/33606","heartbeat_back_addr":"172.21.15.50:6807/33606","heartbeat_front_addr":"172.21.15.50:6805/33606","state":["exists","up"]},{"osd":6,"uuid":"401122a4-9988-441f-a5a7-39164434ebcd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":33607},{"type":"v1","addr":"172.21.15.50:6819","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":33607},{"type":"v1","addr":"172.21.15.50:6823","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":33607},{"type":"v1","addr":"172.21.15.50:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":33607},{"type":"v1","addr":"172.21.15.50:6827","nonce":33607}]},"public_addr":"172.21.15.50:6819/33607","cluster_addr":"172.21.15.50:6823/33607","heartbeat_back_addr":"172.21.15.50:6831/33607","heartbeat_front_addr":"172.21.15.50:6827/33607","state":["exists","up"]},{"osd":7,"uuid":"6b3fa236-c9d0-4c4d-82ae-9af4daf6d699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33604},{"type":"v1","addr":"172.21.15.50:6818","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":33604},{"type":"v1","addr":"172.21.15.50:6822","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":33604},{"type":"v1","addr":"172.21.15.50:6830","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":33604},{"type":"v1","addr":"172.21.15.50:6826","nonce":33604}]},"public_addr":"172.21.15.50:6818/33604","cluster_addr":"172.21.15.50:6822/33604","heartbeat_back_addr":"172.21.15.50:6830/33604","heartbeat_front_addr":"172.21.15.50:6826/33604","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.497794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.529417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.873426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.325972+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.443971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.240795+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.739632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.643026+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:37:40.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.025+0000 7f163a259700 1 -- 172.21.15.3:0/2568898358 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1618060550 msgr2=0x7f1618062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:40.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.025+0000 7f163a259700 1 --2- 172.21.15.3:0/2568898358 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1618060550 0x7f1618062a00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1624009860 tx=0x7f1624017000 comp rx=0 tx=0).stop 2023-10-08T15:37:40.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.025+0000 7f163a259700 1 -- 172.21.15.3:0/2568898358 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f16340703a0 msgr2=0x7f16340b4490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:40.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.025+0000 7f163a259700 1 --2- 172.21.15.3:0/2568898358 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f16340703a0 0x7f16340b4490 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f163000c590 tx=0x7f1630007dc0 comp rx=0 tx=0).stop 2023-10-08T15:37:40.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.025+0000 7f163a259700 1 -- 172.21.15.3:0/2568898358 shutdown_connections 2023-10-08T15:37:40.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.025+0000 7f163a259700 1 --2- 172.21.15.3:0/2568898358 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1618060550 0x7f1618062a00 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:40.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.025+0000 7f163a259700 1 --2- 172.21.15.3:0/2568898358 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f163414b850 0x7f163415be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:40.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.025+0000 7f163a259700 1 --2- 172.21.15.3:0/2568898358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16340707d0 0x7f16340ba770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:40.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.025+0000 7f163a259700 1 --2- 172.21.15.3:0/2568898358 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f16340703a0 0x7f16340b4490 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:40.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.025+0000 7f163a259700 1 -- 172.21.15.3:0/2568898358 >> 172.21.15.3:0/2568898358 conn(0x7f16340670e0 msgr2=0x7f16340a15e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:40.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.025+0000 7f163a259700 1 -- 172.21.15.3:0/2568898358 shutdown_connections 2023-10-08T15:37:40.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.025+0000 7f163a259700 1 -- 172.21.15.3:0/2568898358 wait complete. 2023-10-08T15:37:40.045 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T15:37:16.581590+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T15:37:23.353518+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T15:37:24.365114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T15:37:40.046 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T15:37:40.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.149+0000 7f3687fff700 1 Processor -- start 2023-10-08T15:37:40.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.149+0000 7f3687fff700 1 -- start start 2023-10-08T15:37:40.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.149+0000 7f3687fff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f3688148980 0x7f3688148d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:40.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.153+0000 7f3687fff700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3688149d50 con 0x7f368809f8f0 2023-10-08T15:37:40.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.153+0000 7f3687fff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f368814a030 con 0x7f36880a01d0 2023-10-08T15:37:40.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.153+0000 7f3687fff700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f368814a4c0 con 0x7f3688148980 2023-10-08T15:37:40.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.153+0000 7f3686ffd700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f3688148980 0x7f3688148d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:40.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.153+0000 7f36867fc700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f368809f8f0 0x7f36880bad60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:59664/0 (socket says 172.21.15.3:59664) 2023-10-08T15:37:40.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.153+0000 7f36867fc700 1 -- 172.21.15.3:0/647668550 learned_addr learned my addr 172.21.15.3:0/647668550 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:40.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.153+0000 7f3685ffb700 1 -- 172.21.15.3:0/647668550 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3676676510 0 0) 0x7f3688149d50 con 0x7f368809f8f0 2023-10-08T15:37:40.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.153+0000 7f3685ffb700 1 -- 172.21.15.3:0/647668550 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3674003570 con 0x7f368809f8f0 2023-10-08T15:37:40.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.153+0000 7f3686ffd700 1 -- 172.21.15.3:0/647668550 >> v1:172.21.15.50:6789/0 conn(0x7f36880a01d0 legacy=0x7f368806dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:40.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.153+0000 7f3686ffd700 1 -- 172.21.15.3:0/647668550 >> v1:172.21.15.3:6789/0 conn(0x7f368809f8f0 legacy=0x7f36880bad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:40.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.153+0000 7f3685ffb700 1 -- 172.21.15.3:0/647668550 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1197857872 0 0) 0x7f3674003570 con 0x7f368809f8f0 2023-10-08T15:37:40.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.153+0000 7f3686ffd700 1 -- 172.21.15.3:0/647668550 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36880ba280 con 0x7f3688148980 2023-10-08T15:37:40.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.153+0000 7f3686ffd700 1 --2- 172.21.15.3:0/647668550 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3688148980 0x7f3688148d50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f36780098e0 tx=0x7f36780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9280df084b9eaba server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:40.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.153+0000 7f3685ffb700 1 -- 172.21.15.3:0/647668550 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36700017f0 con 0x7f3688148980 2023-10-08T15:37:40.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.153+0000 7f3685ffb700 1 -- 172.21.15.3:0/647668550 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3678011420 con 0x7f3688148980 2023-10-08T15:37:40.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.153+0000 7f3685ffb700 1 -- 172.21.15.3:0/647668550 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36780117c0 con 0x7f3688148980 2023-10-08T15:37:40.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.153+0000 7f3687fff700 1 -- 172.21.15.3:0/647668550 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3688148980 msgr2=0x7f3688148d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:40.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.153+0000 7f3687fff700 1 --2- 172.21.15.3:0/647668550 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3688148980 0x7f3688148d50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f36780098e0 tx=0x7f36780091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:40.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.153+0000 7f3687fff700 1 -- 172.21.15.3:0/647668550 shutdown_connections 2023-10-08T15:37:40.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.153+0000 7f3687fff700 1 --2- 172.21.15.3:0/647668550 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3688148980 0x7f3688148d50 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:40.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.153+0000 7f3687fff700 1 -- 172.21.15.3:0/647668550 >> 172.21.15.3:0/647668550 conn(0x7f3688067b70 msgr2=0x7f36880ba650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:40.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.153+0000 7f3687fff700 1 -- 172.21.15.3:0/647668550 shutdown_connections 2023-10-08T15:37:40.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.153+0000 7f3687fff700 1 -- 172.21.15.3:0/647668550 wait complete. 2023-10-08T15:37:40.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.157+0000 7f3687fff700 1 Processor -- start 2023-10-08T15:37:40.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.157+0000 7f3687fff700 1 -- start start 2023-10-08T15:37:40.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.157+0000 7f3687fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f368809f8f0 0x7f368814dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:40.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.157+0000 7f3687fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f36880a01d0 0x7f3688096490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:40.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.157+0000 7f3687fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3688148980 0x7f368815ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:40.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.157+0000 7f3687fff700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36881451c0 con 0x7f36880a01d0 2023-10-08T15:37:40.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.157+0000 7f3687fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3688144a80 con 0x7f3688148980 2023-10-08T15:37:40.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.157+0000 7f3687fff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f368814d700 con 0x7f368809f8f0 2023-10-08T15:37:40.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.157+0000 7f36867fc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f36880a01d0 0x7f3688096490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:40.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.157+0000 7f36867fc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f36880a01d0 0x7f3688096490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44090/0 (socket says 172.21.15.3:44090) 2023-10-08T15:37:40.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.157+0000 7f36867fc700 1 -- 172.21.15.3:0/3527745833 learned_addr learned my addr 172.21.15.3:0/3527745833 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:40.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.157+0000 7f3686ffd700 1 --2- 172.21.15.3:0/3527745833 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f368809f8f0 0x7f368814dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:40.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.157+0000 7f36877fe700 1 --2- 172.21.15.3:0/3527745833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3688148980 0x7f368815ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:40.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.157+0000 7f36867fc700 1 -- 172.21.15.3:0/3527745833 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f368809f8f0 msgr2=0x7f368814dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:40.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.157+0000 7f36867fc700 1 --2- 172.21.15.3:0/3527745833 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f368809f8f0 0x7f368814dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:40.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.157+0000 7f36867fc700 1 -- 172.21.15.3:0/3527745833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3688148980 msgr2=0x7f368815ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:40.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.157+0000 7f36867fc700 1 --2- 172.21.15.3:0/3527745833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3688148980 0x7f368815ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:40.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.157+0000 7f36867fc700 1 -- 172.21.15.3:0/3527745833 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3678009420 con 0x7f36880a01d0 2023-10-08T15:37:40.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.157+0000 7f36867fc700 1 --2- 172.21.15.3:0/3527745833 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f36880a01d0 0x7f3688096490 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f367000cfb0 tx=0x7f3670001d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:40.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.157+0000 7f367effd700 1 -- 172.21.15.3:0/3527745833 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367000ad10 con 0x7f36880a01d0 2023-10-08T15:37:40.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.157+0000 7f367effd700 1 -- 172.21.15.3:0/3527745833 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f367000ae70 con 0x7f36880a01d0 2023-10-08T15:37:40.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.157+0000 7f3687fff700 1 -- 172.21.15.3:0/3527745833 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f368815d390 con 0x7f36880a01d0 2023-10-08T15:37:40.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.157+0000 7f367effd700 1 -- 172.21.15.3:0/3527745833 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3670007320 con 0x7f36880a01d0 2023-10-08T15:37:40.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.157+0000 7f3687fff700 1 -- 172.21.15.3:0/3527745833 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3688159fa0 con 0x7f36880a01d0 2023-10-08T15:37:40.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.157+0000 7f3687fff700 1 -- 172.21.15.3:0/3527745833 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f368805ecf0 con 0x7f36880a01d0 2023-10-08T15:37:40.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.161+0000 7f367effd700 1 -- 172.21.15.3:0/3527745833 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f3670007690 con 0x7f36880a01d0 2023-10-08T15:37:40.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.161+0000 7f367effd700 1 --2- 172.21.15.3:0/3527745833 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3668060550 0x7f3668062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:40.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.161+0000 7f367effd700 1 -- 172.21.15.3:0/3527745833 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f367007d810 con 0x7f36880a01d0 2023-10-08T15:37:40.168 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.161+0000 7f3686ffd700 1 --2- 172.21.15.3:0/3527745833 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3668060550 0x7f3668062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:40.168 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.161+0000 7f3686ffd700 1 --2- 172.21.15.3:0/3527745833 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3668060550 0x7f3668062a00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f36780091e0 tx=0x7f3678016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:40.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.165+0000 7f367effd700 1 -- 172.21.15.3:0/3527745833 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f367004df60 con 0x7f36880a01d0 2023-10-08T15:37:40.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.321+0000 7f3687fff700 1 -- 172.21.15.3:0/3527745833 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f368815d390 con 0x7f36880a01d0 2023-10-08T15:37:40.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.321+0000 7f367effd700 1 -- 172.21.15.3:0/3527745833 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3670051580 con 0x7f36880a01d0 2023-10-08T15:37:40.327 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2023-10-08T15:37:40.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.321+0000 7f3687fff700 1 -- 172.21.15.3:0/3527745833 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3668060550 msgr2=0x7f3668062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:40.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.321+0000 7f3687fff700 1 --2- 172.21.15.3:0/3527745833 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3668060550 0x7f3668062a00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f36780091e0 tx=0x7f3678016000 comp rx=0 tx=0).stop 2023-10-08T15:37:40.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.321+0000 7f3687fff700 1 -- 172.21.15.3:0/3527745833 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f36880a01d0 msgr2=0x7f3688096490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:40.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.321+0000 7f3687fff700 1 --2- 172.21.15.3:0/3527745833 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f36880a01d0 0x7f3688096490 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f367000cfb0 tx=0x7f3670001d90 comp rx=0 tx=0).stop 2023-10-08T15:37:40.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.321+0000 7f3687fff700 1 -- 172.21.15.3:0/3527745833 shutdown_connections 2023-10-08T15:37:40.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.321+0000 7f3687fff700 1 --2- 172.21.15.3:0/3527745833 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3668060550 0x7f3668062a00 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:40.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.321+0000 7f3687fff700 1 --2- 172.21.15.3:0/3527745833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3688148980 0x7f368815ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:40.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.321+0000 7f3687fff700 1 --2- 172.21.15.3:0/3527745833 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f36880a01d0 0x7f3688096490 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:40.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.321+0000 7f3687fff700 1 --2- 172.21.15.3:0/3527745833 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f368809f8f0 0x7f368814dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:40.356 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.321+0000 7f3687fff700 1 -- 172.21.15.3:0/3527745833 >> 172.21.15.3:0/3527745833 conn(0x7f3688067b70 msgr2=0x7f36880ba5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:40.356 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.321+0000 7f3687fff700 1 -- 172.21.15.3:0/3527745833 shutdown_connections 2023-10-08T15:37:40.356 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.325+0000 7f3687fff700 1 -- 172.21.15.3:0/3527745833 wait complete. 2023-10-08T15:37:40.357 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T15:37:40.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.465+0000 7f5c616ae700 1 Processor -- start 2023-10-08T15:37:40.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.465+0000 7f5c616ae700 1 -- start start 2023-10-08T15:37:40.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.469+0000 7f5c616ae700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5c5c0bc2c0 0x7f5c5c14bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:40.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.469+0000 7f5c616ae700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c5c068990 con 0x7f5c5c06bc90 2023-10-08T15:37:40.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.469+0000 7f5c616ae700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c5c06d4e0 con 0x7f5c5c06c0c0 2023-10-08T15:37:40.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.469+0000 7f5c616ae700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5c06a000 con 0x7f5c5c0bc2c0 2023-10-08T15:37:40.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.469+0000 7f5c5b7fe700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f5c5c06bc90 0x7f5c5c068e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:59672/0 (socket says 172.21.15.3:59672) 2023-10-08T15:37:40.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.469+0000 7f5c5b7fe700 1 -- 172.21.15.3:0/3450061979 learned_addr learned my addr 172.21.15.3:0/3450061979 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:40.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.469+0000 7f5c5bfff700 1 --2- 172.21.15.3:0/3450061979 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5c5c0bc2c0 0x7f5c5c14bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:40.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.469+0000 7f5c5affd700 1 -- 172.21.15.3:0/3450061979 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2799075597 0 0) 0x7f5c5c068990 con 0x7f5c5c06bc90 2023-10-08T15:37:40.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.469+0000 7f5c5affd700 1 -- 172.21.15.3:0/3450061979 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c48003570 con 0x7f5c5c06bc90 2023-10-08T15:37:40.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.469+0000 7f5c5affd700 1 -- 172.21.15.3:0/3450061979 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 793133669 0 0) 0x7f5c5c06d4e0 con 0x7f5c5c06c0c0 2023-10-08T15:37:40.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.469+0000 7f5c5affd700 1 -- 172.21.15.3:0/3450061979 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c5c068990 con 0x7f5c5c06c0c0 2023-10-08T15:37:40.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.469+0000 7f5c5affd700 1 -- 172.21.15.3:0/3450061979 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 203388539 0 0) 0x7f5c48003570 con 0x7f5c5c06bc90 2023-10-08T15:37:40.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.469+0000 7f5c5affd700 1 -- 172.21.15.3:0/3450061979 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5c5c0bc2c0 msgr2=0x7f5c5c14bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:40.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.469+0000 7f5c5affd700 1 --2- 172.21.15.3:0/3450061979 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5c5c0bc2c0 0x7f5c5c14bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:40.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.469+0000 7f5c5affd700 1 -- 172.21.15.3:0/3450061979 >> v1:172.21.15.50:6789/0 conn(0x7f5c5c06c0c0 legacy=0x7f5c5c0bc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:40.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.469+0000 7f5c5affd700 1 -- 172.21.15.3:0/3450061979 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c5c069530 con 0x7f5c5c06bc90 2023-10-08T15:37:40.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.469+0000 7f5c5affd700 1 -- 172.21.15.3:0/3450061979 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2285686191 0 0) 0x7f5c44001470 con 0x7f5c5c06bc90 2023-10-08T15:37:40.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.469+0000 7f5c5affd700 1 -- 172.21.15.3:0/3450061979 >> v1:172.21.15.3:6789/0 conn(0x7f5c5c06bc90 legacy=0x7f5c5c068e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:40.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.469+0000 7f5c5affd700 1 --2- 172.21.15.3:0/3450061979 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5c48003c20 0x7f5c48004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:40.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.469+0000 7f5c5affd700 1 --2- 172.21.15.3:0/3450061979 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5c5c0bc2c0 0x7f5c48004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:40.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.469+0000 7f5c5affd700 1 --2- 172.21.15.3:0/3450061979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c48004d50 0x7f5c480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:40.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.469+0000 7f5c5affd700 1 -- 172.21.15.3:0/3450061979 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5c06a000 con 0x7f5c48003c20 2023-10-08T15:37:40.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.469+0000 7f5c5affd700 1 -- 172.21.15.3:0/3450061979 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4800bb40 con 0x7f5c48004d50 2023-10-08T15:37:40.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.469+0000 7f5c5affd700 1 -- 172.21.15.3:0/3450061979 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4800bd00 con 0x7f5c5c0bc2c0 2023-10-08T15:37:40.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.469+0000 7f5c5bfff700 1 --2- 172.21.15.3:0/3450061979 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5c48003c20 0x7f5c48004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:40.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.469+0000 7f5c5b7fe700 1 --2- 172.21.15.3:0/3450061979 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5c5c0bc2c0 0x7f5c48004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:40.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.469+0000 7f5c60ead700 1 --2- 172.21.15.3:0/3450061979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c48004d50 0x7f5c480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:40.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.469+0000 7f5c5bfff700 1 -- 172.21.15.3:0/3450061979 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5c5c0bc2c0 msgr2=0x7f5c48004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:40.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.469+0000 7f5c5bfff700 1 --2- 172.21.15.3:0/3450061979 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5c5c0bc2c0 0x7f5c48004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:40.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.469+0000 7f5c5bfff700 1 -- 172.21.15.3:0/3450061979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c48004d50 msgr2=0x7f5c480051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:40.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.469+0000 7f5c5bfff700 1 --2- 172.21.15.3:0/3450061979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c48004d50 0x7f5c480051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:40.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.469+0000 7f5c5bfff700 1 -- 172.21.15.3:0/3450061979 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c5c069530 con 0x7f5c48003c20 2023-10-08T15:37:40.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.469+0000 7f5c5bfff700 1 --2- 172.21.15.3:0/3450061979 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5c48003c20 0x7f5c48004010 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c009c00 tx=0x7f5c4c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79eb00ddff619f79 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:40.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.469+0000 7f5c5affd700 1 -- 172.21.15.3:0/3450061979 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c4c00e710 con 0x7f5c48003c20 2023-10-08T15:37:40.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.469+0000 7f5c5affd700 1 -- 172.21.15.3:0/3450061979 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c4c00e870 con 0x7f5c48003c20 2023-10-08T15:37:40.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.469+0000 7f5c5affd700 1 -- 172.21.15.3:0/3450061979 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c4c00ec30 con 0x7f5c48003c20 2023-10-08T15:37:40.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.469+0000 7f5c616ae700 1 -- 172.21.15.3:0/3450061979 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5c48003c20 msgr2=0x7f5c48004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:40.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.469+0000 7f5c616ae700 1 --2- 172.21.15.3:0/3450061979 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5c48003c20 0x7f5c48004010 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c009c00 tx=0x7f5c4c0091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:40.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.469+0000 7f5c60ead700 1 -- 172.21.15.3:0/3450061979 reap_dead start 2023-10-08T15:37:40.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.469+0000 7f5c616ae700 1 -- 172.21.15.3:0/3450061979 shutdown_connections 2023-10-08T15:37:40.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.469+0000 7f5c616ae700 1 -- 172.21.15.3:0/3450061979 >> 172.21.15.3:0/3450061979 conn(0x7f5c5c06f340 msgr2=0x7f5c5c0670e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:40.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.469+0000 7f5c616ae700 1 -- 172.21.15.3:0/3450061979 shutdown_connections 2023-10-08T15:37:40.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.473+0000 7f5c616ae700 1 -- 172.21.15.3:0/3450061979 wait complete. 2023-10-08T15:37:40.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.473+0000 7f5c616ae700 1 Processor -- start 2023-10-08T15:37:40.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.473+0000 7f5c616ae700 1 -- start start 2023-10-08T15:37:40.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.477+0000 7f5c616ae700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5c5c150ec0 0x7f5c5c15b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:40.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.477+0000 7f5c616ae700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5c5c15aca0 0x7f5c5c15b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:40.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.477+0000 7f5c616ae700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c5c150780 0x7f5c5c14ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:40.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.477+0000 7f5c616ae700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5c15be40 con 0x7f5c5c15aca0 2023-10-08T15:37:40.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.477+0000 7f5c616ae700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5c150440 con 0x7f5c5c150780 2023-10-08T15:37:40.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.477+0000 7f5c616ae700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5c15e270 con 0x7f5c5c150ec0 2023-10-08T15:37:40.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.477+0000 7f5c5b7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5c5c15aca0 0x7f5c5c15b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:40.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.477+0000 7f5c5b7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5c5c15aca0 0x7f5c5c15b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44104/0 (socket says 172.21.15.3:44104) 2023-10-08T15:37:40.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.477+0000 7f5c5b7fe700 1 -- 172.21.15.3:0/312338197 learned_addr learned my addr 172.21.15.3:0/312338197 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:40.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.477+0000 7f5c5bfff700 1 --2- 172.21.15.3:0/312338197 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5c5c150ec0 0x7f5c5c15b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:40.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.477+0000 7f5c60ead700 1 --2- 172.21.15.3:0/312338197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c5c150780 0x7f5c5c14ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:40.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.477+0000 7f5c5b7fe700 1 -- 172.21.15.3:0/312338197 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5c5c150ec0 msgr2=0x7f5c5c15b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:40.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.477+0000 7f5c5b7fe700 1 --2- 172.21.15.3:0/312338197 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5c5c150ec0 0x7f5c5c15b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:40.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.477+0000 7f5c5b7fe700 1 -- 172.21.15.3:0/312338197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c5c150780 msgr2=0x7f5c5c14ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:40.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.477+0000 7f5c5b7fe700 1 --2- 172.21.15.3:0/312338197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c5c150780 0x7f5c5c14ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:40.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.477+0000 7f5c5b7fe700 1 -- 172.21.15.3:0/312338197 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c5c14a830 con 0x7f5c5c15aca0 2023-10-08T15:37:40.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.477+0000 7f5c5bfff700 1 --2- 172.21.15.3:0/312338197 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5c5c150ec0 0x7f5c5c15b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:37:40.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.477+0000 7f5c60ead700 1 --2- 172.21.15.3:0/312338197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c5c150780 0x7f5c5c14ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:37:40.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.477+0000 7f5c5b7fe700 1 --2- 172.21.15.3:0/312338197 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5c5c15aca0 0x7f5c5c15b900 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5c440010e0 tx=0x7f5c44000cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:40.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.477+0000 7f5c53fff700 1 -- 172.21.15.3:0/312338197 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c4400c7e0 con 0x7f5c5c15aca0 2023-10-08T15:37:40.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.477+0000 7f5c53fff700 1 -- 172.21.15.3:0/312338197 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c4400c960 con 0x7f5c5c15aca0 2023-10-08T15:37:40.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.477+0000 7f5c616ae700 1 -- 172.21.15.3:0/312338197 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c5c151290 con 0x7f5c5c15aca0 2023-10-08T15:37:40.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.477+0000 7f5c53fff700 1 -- 172.21.15.3:0/312338197 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c4400cd20 con 0x7f5c5c15aca0 2023-10-08T15:37:40.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.477+0000 7f5c616ae700 1 -- 172.21.15.3:0/312338197 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c5c14e1d0 con 0x7f5c5c15aca0 2023-10-08T15:37:40.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.477+0000 7f5c616ae700 1 -- 172.21.15.3:0/312338197 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c5c1502a0 con 0x7f5c5c15aca0 2023-10-08T15:37:40.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.477+0000 7f5c53fff700 1 -- 172.21.15.3:0/312338197 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5c44013630 con 0x7f5c5c15aca0 2023-10-08T15:37:40.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.481+0000 7f5c53fff700 1 --2- 172.21.15.3:0/312338197 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5c3c060580 0x7f5c3c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:40.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.481+0000 7f5c53fff700 1 -- 172.21.15.3:0/312338197 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5c4407c7a0 con 0x7f5c5c15aca0 2023-10-08T15:37:40.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.481+0000 7f5c5bfff700 1 --2- 172.21.15.3:0/312338197 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5c3c060580 0x7f5c3c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:40.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.481+0000 7f5c5bfff700 1 --2- 172.21.15.3:0/312338197 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5c3c060580 0x7f5c3c062a30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c06e6d0 tx=0x7f5c4c01a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:40.523 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.489+0000 7f5c53fff700 1 -- 172.21.15.3:0/312338197 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5c5c1502a0 con 0x7f5c5c15aca0 2023-10-08T15:37:40.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.649+0000 7f5c616ae700 1 -- 172.21.15.3:0/312338197 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5c5c15e5e0 con 0x7f5c5c15aca0 2023-10-08T15:37:40.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.649+0000 7f5c53fff700 1 -- 172.21.15.3:0/312338197 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5c5c15e5e0 con 0x7f5c5c15aca0 2023-10-08T15:37:40.654 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 32 2023-10-08T15:37:40.659 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.653+0000 7f5c616ae700 1 -- 172.21.15.3:0/312338197 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5c3c060580 msgr2=0x7f5c3c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:40.659 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.653+0000 7f5c616ae700 1 --2- 172.21.15.3:0/312338197 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5c3c060580 0x7f5c3c062a30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c06e6d0 tx=0x7f5c4c01a000 comp rx=0 tx=0).stop 2023-10-08T15:37:40.659 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.653+0000 7f5c616ae700 1 -- 172.21.15.3:0/312338197 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5c5c15aca0 msgr2=0x7f5c5c15b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:40.659 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.653+0000 7f5c616ae700 1 --2- 172.21.15.3:0/312338197 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5c5c15aca0 0x7f5c5c15b900 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5c440010e0 tx=0x7f5c44000cc0 comp rx=0 tx=0).stop 2023-10-08T15:37:40.659 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.653+0000 7f5c616ae700 1 -- 172.21.15.3:0/312338197 shutdown_connections 2023-10-08T15:37:40.659 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.653+0000 7f5c616ae700 1 --2- 172.21.15.3:0/312338197 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5c3c060580 0x7f5c3c062a30 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:40.659 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.653+0000 7f5c616ae700 1 --2- 172.21.15.3:0/312338197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c5c150780 0x7f5c5c14ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:40.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.653+0000 7f5c616ae700 1 --2- 172.21.15.3:0/312338197 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5c5c15aca0 0x7f5c5c15b900 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:40.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.653+0000 7f5c616ae700 1 --2- 172.21.15.3:0/312338197 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5c5c150ec0 0x7f5c5c15b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:40.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.653+0000 7f5c616ae700 1 -- 172.21.15.3:0/312338197 >> 172.21.15.3:0/312338197 conn(0x7f5c5c06f340 msgr2=0x7f5c5c0bb620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:40.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.653+0000 7f5c616ae700 1 -- 172.21.15.3:0/312338197 shutdown_connections 2023-10-08T15:37:40.662 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.653+0000 7f5c616ae700 1 -- 172.21.15.3:0/312338197 wait complete. 2023-10-08T15:37:40.675 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T15:37:40.804 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.797+0000 7f8947fff700 1 Processor -- start 2023-10-08T15:37:40.821 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.797+0000 7f8947fff700 1 -- start start 2023-10-08T15:37:40.828 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.801+0000 7f8947fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f89480a7bc0 0x7f89480be3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:40.828 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.801+0000 7f8947fff700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f894806ced0 con 0x7f89480a77f0 2023-10-08T15:37:40.828 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.801+0000 7f8947fff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8948069570 con 0x7f894806c5c0 2023-10-08T15:37:40.828 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.801+0000 7f8947fff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f894806e770 con 0x7f89480a7bc0 2023-10-08T15:37:40.828 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.801+0000 7f8946ffd700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f89480a77f0 0x7f89480a2200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:59678/0 (socket says 172.21.15.3:59678) 2023-10-08T15:37:40.829 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.801+0000 7f8946ffd700 1 -- 172.21.15.3:0/2013760851 learned_addr learned my addr 172.21.15.3:0/2013760851 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:40.829 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.801+0000 7f89477fe700 1 --2- 172.21.15.3:0/2013760851 >> v2:172.21.15.50:3300/0 conn(0x7f89480a7bc0 0x7f89480be3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:40.829 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.801+0000 7f8945ffb700 1 -- 172.21.15.3:0/2013760851 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 956456683 0 0) 0x7f894806ced0 con 0x7f89480a77f0 2023-10-08T15:37:40.829 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.801+0000 7f8945ffb700 1 -- 172.21.15.3:0/2013760851 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8934003570 con 0x7f89480a77f0 2023-10-08T15:37:40.829 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.801+0000 7f8945ffb700 1 -- 172.21.15.3:0/2013760851 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 421915833 0 0) 0x7f8948069570 con 0x7f894806c5c0 2023-10-08T15:37:40.829 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.801+0000 7f8945ffb700 1 -- 172.21.15.3:0/2013760851 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f894806ced0 con 0x7f894806c5c0 2023-10-08T15:37:40.829 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.801+0000 7f89477fe700 1 -- 172.21.15.3:0/2013760851 >> v1:172.21.15.50:6789/0 conn(0x7f894806c5c0 legacy=0x7f894806d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:40.830 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.801+0000 7f89477fe700 1 -- 172.21.15.3:0/2013760851 >> v1:172.21.15.3:6789/0 conn(0x7f89480a77f0 legacy=0x7f89480a2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:40.830 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.801+0000 7f89477fe700 1 -- 172.21.15.3:0/2013760851 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f894814c620 con 0x7f89480a7bc0 2023-10-08T15:37:40.830 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.801+0000 7f89477fe700 1 --2- 172.21.15.3:0/2013760851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89480a7bc0 0x7f89480be3d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8948069700 tx=0x7f8940009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd59897a8d3e7df9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:40.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.801+0000 7f8945ffb700 1 -- 172.21.15.3:0/2013760851 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894000e070 con 0x7f89480a7bc0 2023-10-08T15:37:40.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.801+0000 7f8945ffb700 1 -- 172.21.15.3:0/2013760851 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f894000ba70 con 0x7f89480a7bc0 2023-10-08T15:37:40.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.801+0000 7f8945ffb700 1 -- 172.21.15.3:0/2013760851 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894000be30 con 0x7f89480a7bc0 2023-10-08T15:37:40.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.801+0000 7f8947fff700 1 -- 172.21.15.3:0/2013760851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89480a7bc0 msgr2=0x7f89480be3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:40.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.801+0000 7f8947fff700 1 --2- 172.21.15.3:0/2013760851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89480a7bc0 0x7f89480be3d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8948069700 tx=0x7f8940009780 comp rx=0 tx=0).stop 2023-10-08T15:37:40.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.801+0000 7f8947fff700 1 -- 172.21.15.3:0/2013760851 shutdown_connections 2023-10-08T15:37:40.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.801+0000 7f8947fff700 1 --2- 172.21.15.3:0/2013760851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89480a7bc0 0x7f89480be3d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:40.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.801+0000 7f8947fff700 1 -- 172.21.15.3:0/2013760851 >> 172.21.15.3:0/2013760851 conn(0x7f89480c29f0 msgr2=0x7f89480a1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:40.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.801+0000 7f8947fff700 1 -- 172.21.15.3:0/2013760851 shutdown_connections 2023-10-08T15:37:40.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.801+0000 7f8947fff700 1 -- 172.21.15.3:0/2013760851 wait complete. 2023-10-08T15:37:40.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.805+0000 7f8947fff700 1 Processor -- start 2023-10-08T15:37:40.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.805+0000 7f8947fff700 1 -- start start 2023-10-08T15:37:40.832 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.805+0000 7f8947fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f894806c5c0 0x7f894814ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:40.832 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.805+0000 7f8947fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f89480a77f0 0x7f894814ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:40.832 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.805+0000 7f8947fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f89480a7bc0 0x7f89480a40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:40.832 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.805+0000 7f8947fff700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89480a3c30 con 0x7f89480a7bc0 2023-10-08T15:37:40.832 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.805+0000 7f8947fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89480a6fa0 con 0x7f894806c5c0 2023-10-08T15:37:40.832 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.805+0000 7f8947fff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89480a35e0 con 0x7f89480a77f0 2023-10-08T15:37:40.832 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.805+0000 7f89477fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f89480a7bc0 0x7f89480a40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:40.832 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.805+0000 7f89477fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f89480a7bc0 0x7f89480a40c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44116/0 (socket says 172.21.15.3:44116) 2023-10-08T15:37:40.832 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.805+0000 7f89477fe700 1 -- 172.21.15.3:0/2431786126 learned_addr learned my addr 172.21.15.3:0/2431786126 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:40.832 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.805+0000 7f89467fc700 1 --2- 172.21.15.3:0/2431786126 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f89480a77f0 0x7f894814ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:40.833 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.805+0000 7f8946ffd700 1 --2- 172.21.15.3:0/2431786126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f894806c5c0 0x7f894814ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:40.833 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.805+0000 7f89477fe700 1 -- 172.21.15.3:0/2431786126 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f89480a77f0 msgr2=0x7f894814ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:40.833 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.805+0000 7f89477fe700 1 --2- 172.21.15.3:0/2431786126 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f89480a77f0 0x7f894814ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:40.833 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.805+0000 7f89477fe700 1 -- 172.21.15.3:0/2431786126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f894806c5c0 msgr2=0x7f894814ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:40.833 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.805+0000 7f89477fe700 1 --2- 172.21.15.3:0/2431786126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f894806c5c0 0x7f894814ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:40.833 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.805+0000 7f89477fe700 1 -- 172.21.15.3:0/2431786126 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8940009a20 con 0x7f89480a7bc0 2023-10-08T15:37:40.833 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.805+0000 7f8946ffd700 1 --2- 172.21.15.3:0/2431786126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f894806c5c0 0x7f894814ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:37:40.833 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.805+0000 7f89477fe700 1 --2- 172.21.15.3:0/2431786126 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f89480a7bc0 0x7f89480a40c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f894806ca80 tx=0x7f8940019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:40.834 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.805+0000 7f893effd700 1 -- 172.21.15.3:0/2431786126 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89400032f0 con 0x7f89480a7bc0 2023-10-08T15:37:40.834 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.805+0000 7f893effd700 1 -- 172.21.15.3:0/2431786126 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8940007080 con 0x7f89480a7bc0 2023-10-08T15:37:40.834 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.805+0000 7f8947fff700 1 -- 172.21.15.3:0/2431786126 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89480a38c0 con 0x7f89480a7bc0 2023-10-08T15:37:40.834 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.805+0000 7f893effd700 1 -- 172.21.15.3:0/2431786126 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8940027470 con 0x7f89480a7bc0 2023-10-08T15:37:40.834 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.805+0000 7f8947fff700 1 -- 172.21.15.3:0/2431786126 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8948152920 con 0x7f89480a7bc0 2023-10-08T15:37:40.834 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.809+0000 7f8947fff700 1 -- 172.21.15.3:0/2431786126 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f894805ecf0 con 0x7f89480a7bc0 2023-10-08T15:37:40.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.809+0000 7f893effd700 1 -- 172.21.15.3:0/2431786126 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f8940024070 con 0x7f89480a7bc0 2023-10-08T15:37:40.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.809+0000 7f893effd700 1 --2- 172.21.15.3:0/2431786126 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8928060580 0x7f8928062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:40.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.809+0000 7f893effd700 1 -- 172.21.15.3:0/2431786126 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f894007ec40 con 0x7f89480a7bc0 2023-10-08T15:37:40.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.809+0000 7f8946ffd700 1 --2- 172.21.15.3:0/2431786126 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8928060580 0x7f8928062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:40.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.809+0000 7f8946ffd700 1 --2- 172.21.15.3:0/2431786126 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8928060580 0x7f8928062a30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f89380058d0 tx=0x7f8938009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:40.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.817+0000 7f893effd700 1 -- 172.21.15.3:0/2431786126 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f894004f230 con 0x7f89480a7bc0 2023-10-08T15:37:40.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.977+0000 7f8947fff700 1 -- 172.21.15.3:0/2431786126 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f894806cb60 con 0x7f89480a7bc0 2023-10-08T15:37:40.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.977+0000 7f893effd700 1 -- 172.21.15.3:0/2431786126 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f894002c020 con 0x7f89480a7bc0 2023-10-08T15:37:40.991 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 64 2023-10-08T15:37:40.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.977+0000 7f8947fff700 1 -- 172.21.15.3:0/2431786126 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8928060580 msgr2=0x7f8928062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:40.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.977+0000 7f8947fff700 1 --2- 172.21.15.3:0/2431786126 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8928060580 0x7f8928062a30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f89380058d0 tx=0x7f8938009040 comp rx=0 tx=0).stop 2023-10-08T15:37:40.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.977+0000 7f8947fff700 1 -- 172.21.15.3:0/2431786126 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f89480a7bc0 msgr2=0x7f89480a40c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:40.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.977+0000 7f8947fff700 1 --2- 172.21.15.3:0/2431786126 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f89480a7bc0 0x7f89480a40c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f894806ca80 tx=0x7f8940019000 comp rx=0 tx=0).stop 2023-10-08T15:37:40.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.977+0000 7f8947fff700 1 -- 172.21.15.3:0/2431786126 shutdown_connections 2023-10-08T15:37:40.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.977+0000 7f8947fff700 1 --2- 172.21.15.3:0/2431786126 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8928060580 0x7f8928062a30 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:40.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.977+0000 7f8947fff700 1 --2- 172.21.15.3:0/2431786126 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f89480a7bc0 0x7f89480a40c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:40.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.977+0000 7f8947fff700 1 --2- 172.21.15.3:0/2431786126 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f89480a77f0 0x7f894814ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:40.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.977+0000 7f8947fff700 1 --2- 172.21.15.3:0/2431786126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f894806c5c0 0x7f894814ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:40.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.977+0000 7f8947fff700 1 -- 172.21.15.3:0/2431786126 >> 172.21.15.3:0/2431786126 conn(0x7f89480c29f0 msgr2=0x7f89480bffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:40.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.977+0000 7f8947fff700 1 -- 172.21.15.3:0/2431786126 shutdown_connections 2023-10-08T15:37:40.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:40.977+0000 7f8947fff700 1 -- 172.21.15.3:0/2431786126 wait complete. 2023-10-08T15:37:40.997 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:37:41.107 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.101+0000 7f0495b6a700 1 Processor -- start 2023-10-08T15:37:41.107 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.101+0000 7f0495b6a700 1 -- start start 2023-10-08T15:37:41.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.101+0000 7f0495b6a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f04900a15e0 0x7f049014b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:41.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.101+0000 7f0495b6a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0490146b70 0x7f0490146fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:41.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.101+0000 7f0495b6a700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f04901474e0 0x7f0490147e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:41.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.101+0000 7f0495b6a700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f049006de00 con 0x7f04901474e0 2023-10-08T15:37:41.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.101+0000 7f0495b6a700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0490147970 con 0x7f0490146b70 2023-10-08T15:37:41.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.101+0000 7f0495b6a700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f049014bd90 con 0x7f04900a15e0 2023-10-08T15:37:41.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.101+0000 7f0495369700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f04901474e0 0x7f0490147e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:41.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.105+0000 7f0495369700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f04901474e0 0x7f0490147e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44126/0 (socket says 172.21.15.3:44126) 2023-10-08T15:37:41.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.105+0000 7f0495369700 1 -- 172.21.15.3:0/2254796166 learned_addr learned my addr 172.21.15.3:0/2254796166 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:41.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.105+0000 7f0494b68700 1 --2- 172.21.15.3:0/2254796166 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f04900a15e0 0x7f049014b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:41.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.105+0000 7f048ffff700 1 --2- 172.21.15.3:0/2254796166 >> v2:172.21.15.50:3300/0 conn(0x7f0490146b70 0x7f0490146fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:41.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.105+0000 7f0495369700 1 -- 172.21.15.3:0/2254796166 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f04900a15e0 msgr2=0x7f049014b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:41.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.105+0000 7f0495369700 1 --2- 172.21.15.3:0/2254796166 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f04900a15e0 0x7f049014b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:41.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.105+0000 7f0495369700 1 -- 172.21.15.3:0/2254796166 >> v2:172.21.15.50:3300/0 conn(0x7f0490146b70 msgr2=0x7f0490146fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:41.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.105+0000 7f0495369700 1 --2- 172.21.15.3:0/2254796166 >> v2:172.21.15.50:3300/0 conn(0x7f0490146b70 0x7f0490146fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:41.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.105+0000 7f0495369700 1 -- 172.21.15.3:0/2254796166 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0490069770 con 0x7f04901474e0 2023-10-08T15:37:41.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.105+0000 7f0495369700 1 --2- 172.21.15.3:0/2254796166 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f04901474e0 0x7f0490147e00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f049006a2a0 tx=0x7f048800c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64c69dab4419c40b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:41.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.105+0000 7f048f7fe700 1 -- 172.21.15.3:0/2254796166 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048800a2e0 con 0x7f04901474e0 2023-10-08T15:37:41.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.105+0000 7f048f7fe700 1 -- 172.21.15.3:0/2254796166 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f048800b9c0 con 0x7f04901474e0 2023-10-08T15:37:41.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.105+0000 7f048f7fe700 1 -- 172.21.15.3:0/2254796166 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048800bd80 con 0x7f04901474e0 2023-10-08T15:37:41.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.105+0000 7f0495b6a700 1 -- 172.21.15.3:0/2254796166 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f04901474e0 msgr2=0x7f0490147e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:41.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.105+0000 7f0495b6a700 1 --2- 172.21.15.3:0/2254796166 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f04901474e0 0x7f0490147e00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f049006a2a0 tx=0x7f048800c040 comp rx=0 tx=0).stop 2023-10-08T15:37:41.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.105+0000 7f0495b6a700 1 -- 172.21.15.3:0/2254796166 shutdown_connections 2023-10-08T15:37:41.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.105+0000 7f0495b6a700 1 --2- 172.21.15.3:0/2254796166 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f04901474e0 0x7f0490147e00 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:41.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.105+0000 7f0495b6a700 1 --2- 172.21.15.3:0/2254796166 >> v2:172.21.15.50:3300/0 conn(0x7f0490146b70 0x7f0490146fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:41.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.105+0000 7f0495b6a700 1 --2- 172.21.15.3:0/2254796166 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f04900a15e0 0x7f049014b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:41.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.105+0000 7f0495b6a700 1 -- 172.21.15.3:0/2254796166 >> 172.21.15.3:0/2254796166 conn(0x7f04900670e0 msgr2=0x7f04900674e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:41.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.105+0000 7f0495b6a700 1 -- 172.21.15.3:0/2254796166 shutdown_connections 2023-10-08T15:37:41.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.105+0000 7f0495b6a700 1 -- 172.21.15.3:0/2254796166 wait complete. 2023-10-08T15:37:41.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.105+0000 7f0495b6a700 1 Processor -- start 2023-10-08T15:37:41.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.105+0000 7f0495b6a700 1 -- start start 2023-10-08T15:37:41.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.109+0000 7f0495b6a700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f04900a15e0 0x7f0490141dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:41.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.109+0000 7f0495b6a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0490146b70 0x7f049015a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:41.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.109+0000 7f0495b6a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f04901474e0 0x7f0490141060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:41.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.109+0000 7f0495b6a700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04900b5170 con 0x7f04900a15e0 2023-10-08T15:37:41.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.109+0000 7f0495b6a700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04900b47a0 con 0x7f0490146b70 2023-10-08T15:37:41.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.109+0000 7f0495b6a700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f049015ae20 con 0x7f04901474e0 2023-10-08T15:37:41.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.109+0000 7f0494b68700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f04900a15e0 0x7f0490141dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:41.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.109+0000 7f0494b68700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f04900a15e0 0x7f0490141dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44142/0 (socket says 172.21.15.3:44142) 2023-10-08T15:37:41.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.109+0000 7f0494b68700 1 -- 172.21.15.3:0/2015418577 learned_addr learned my addr 172.21.15.3:0/2015418577 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:41.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.109+0000 7f0495369700 1 --2- 172.21.15.3:0/2015418577 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f04901474e0 0x7f0490141060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:41.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.109+0000 7f048ffff700 1 --2- 172.21.15.3:0/2015418577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0490146b70 0x7f049015a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:41.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.109+0000 7f0494b68700 1 -- 172.21.15.3:0/2015418577 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f04901474e0 msgr2=0x7f0490141060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:41.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.109+0000 7f0494b68700 1 --2- 172.21.15.3:0/2015418577 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f04901474e0 0x7f0490141060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:41.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.109+0000 7f0494b68700 1 -- 172.21.15.3:0/2015418577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0490146b70 msgr2=0x7f049015a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:41.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.109+0000 7f0494b68700 1 --2- 172.21.15.3:0/2015418577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0490146b70 0x7f049015a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:41.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.109+0000 7f0494b68700 1 -- 172.21.15.3:0/2015418577 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f048800aaf0 con 0x7f04900a15e0 2023-10-08T15:37:41.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.109+0000 7f0495369700 1 --2- 172.21.15.3:0/2015418577 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f04901474e0 0x7f0490141060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:37:41.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.109+0000 7f0494b68700 1 --2- 172.21.15.3:0/2015418577 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f04900a15e0 0x7f0490141dc0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f048400bef0 tx=0x7f048400d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:41.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.109+0000 7f048cff9700 1 -- 172.21.15.3:0/2015418577 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048400ec50 con 0x7f04900a15e0 2023-10-08T15:37:41.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.109+0000 7f048cff9700 1 -- 172.21.15.3:0/2015418577 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0484011040 con 0x7f04900a15e0 2023-10-08T15:37:41.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.109+0000 7f048cff9700 1 -- 172.21.15.3:0/2015418577 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0484016480 con 0x7f04900a15e0 2023-10-08T15:37:41.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.109+0000 7f0495b6a700 1 -- 172.21.15.3:0/2015418577 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f049015ab40 con 0x7f04900a15e0 2023-10-08T15:37:41.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.109+0000 7f0495b6a700 1 -- 172.21.15.3:0/2015418577 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04900bb900 con 0x7f04900a15e0 2023-10-08T15:37:41.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.109+0000 7f0495b6a700 1 -- 172.21.15.3:0/2015418577 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f049005ecf0 con 0x7f04900a15e0 2023-10-08T15:37:41.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.113+0000 7f048cff9700 1 -- 172.21.15.3:0/2015418577 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f04840167f0 con 0x7f04900a15e0 2023-10-08T15:37:41.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.113+0000 7f048cff9700 1 --2- 172.21.15.3:0/2015418577 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f0474060550 0x7f0474062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:41.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.113+0000 7f048cff9700 1 -- 172.21.15.3:0/2015418577 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f048407f390 con 0x7f04900a15e0 2023-10-08T15:37:41.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.113+0000 7f048ffff700 1 --2- 172.21.15.3:0/2015418577 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f0474060550 0x7f0474062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:41.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.113+0000 7f048ffff700 1 --2- 172.21.15.3:0/2015418577 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f0474060550 0x7f0474062a00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0490157a50 tx=0x7f047c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:41.126 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.121+0000 7f048cff9700 1 -- 172.21.15.3:0/2015418577 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f048404f980 con 0x7f04900a15e0 2023-10-08T15:37:41.323 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.317+0000 7f0495b6a700 1 -- 172.21.15.3:0/2015418577 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0490068c60 con 0x7f04900a15e0 2023-10-08T15:37:41.323 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.317+0000 7f048cff9700 1 -- 172.21.15.3:0/2015418577 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+3073 (secure 0 0 0) 0x7f0484052fa0 con 0x7f04900a15e0 2023-10-08T15:37:41.324 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:37:41.324 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6833/519836882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":519836882},{"type":"v1","addr":"172.21.15.3:6833","nonce":519836882}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:37:25.379215+0000","modified":"2023-10-08T15:37:28.041086+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/1601527591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1601527591},{"type":"v1","addr":"172.21.15.50:6835","nonce":1601527591}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-08T15:37:41.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.321+0000 7f0495b6a700 1 -- 172.21.15.3:0/2015418577 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f0474060550 msgr2=0x7f0474062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:41.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.321+0000 7f0495b6a700 1 --2- 172.21.15.3:0/2015418577 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f0474060550 0x7f0474062a00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0490157a50 tx=0x7f047c008040 comp rx=0 tx=0).stop 2023-10-08T15:37:41.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.321+0000 7f0495b6a700 1 -- 172.21.15.3:0/2015418577 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f04900a15e0 msgr2=0x7f0490141dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:41.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.321+0000 7f0495b6a700 1 --2- 172.21.15.3:0/2015418577 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f04900a15e0 0x7f0490141dc0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f048400bef0 tx=0x7f048400d040 comp rx=0 tx=0).stop 2023-10-08T15:37:41.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.321+0000 7f0495b6a700 1 -- 172.21.15.3:0/2015418577 shutdown_connections 2023-10-08T15:37:41.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.321+0000 7f0495b6a700 1 --2- 172.21.15.3:0/2015418577 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f0474060550 0x7f0474062a00 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:41.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.321+0000 7f0495b6a700 1 --2- 172.21.15.3:0/2015418577 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f04901474e0 0x7f0490141060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:41.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.321+0000 7f0495b6a700 1 --2- 172.21.15.3:0/2015418577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0490146b70 0x7f049015a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:41.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.321+0000 7f0495b6a700 1 --2- 172.21.15.3:0/2015418577 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f04900a15e0 0x7f0490141dc0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:41.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.321+0000 7f0495b6a700 1 -- 172.21.15.3:0/2015418577 >> 172.21.15.3:0/2015418577 conn(0x7f04900670e0 msgr2=0x7f0490142880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:41.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.321+0000 7f0495b6a700 1 -- 172.21.15.3:0/2015418577 shutdown_connections 2023-10-08T15:37:41.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.321+0000 7f0495b6a700 1 -- 172.21.15.3:0/2015418577 wait complete. 2023-10-08T15:37:41.327 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 6 2023-10-08T15:37:41.338 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:37:41.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.437+0000 7f066cafa700 1 Processor -- start 2023-10-08T15:37:41.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.437+0000 7f066cafa700 1 -- start start 2023-10-08T15:37:41.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.437+0000 7f066cafa700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f06680bbf00 0x7f06680b3e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:41.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.437+0000 7f066cafa700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0668148980 0x7f0668148d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:41.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.437+0000 7f066cafa700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f066814ce00 con 0x7f06680be470 2023-10-08T15:37:41.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.437+0000 7f066cafa700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f066814a870 con 0x7f06680bbf00 2023-10-08T15:37:41.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.437+0000 7f066cafa700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06680b47f0 con 0x7f0668148980 2023-10-08T15:37:41.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.437+0000 7f06677fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f06680bbf00 0x7f06680b3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:41.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.437+0000 7f0666ffd700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f06680be470 0x7f066814d290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:59684/0 (socket says 172.21.15.3:59684) 2023-10-08T15:37:41.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.437+0000 7f06677fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f06680bbf00 0x7f06680b3e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44156/0 (socket says 172.21.15.3:44156) 2023-10-08T15:37:41.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.437+0000 7f0666ffd700 1 -- 172.21.15.3:0/3167684446 learned_addr learned my addr 172.21.15.3:0/3167684446 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:41.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.437+0000 7f0667fff700 1 --2- 172.21.15.3:0/3167684446 >> v2:172.21.15.50:3300/0 conn(0x7f0668148980 0x7f0668148d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:41.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.437+0000 7f06677fe700 1 -- 172.21.15.3:0/3167684446 >> v2:172.21.15.50:3300/0 conn(0x7f0668148980 msgr2=0x7f0668148d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:41.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.437+0000 7f06677fe700 1 --2- 172.21.15.3:0/3167684446 >> v2:172.21.15.50:3300/0 conn(0x7f0668148980 0x7f0668148d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:41.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.437+0000 7f06677fe700 1 -- 172.21.15.3:0/3167684446 >> v1:172.21.15.3:6789/0 conn(0x7f06680be470 legacy=0x7f066814d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:41.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.437+0000 7f06667fc700 1 -- 172.21.15.3:0/3167684446 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 187094145 0 0) 0x7f066814ce00 con 0x7f06680be470 2023-10-08T15:37:41.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.437+0000 7f06677fe700 1 -- 172.21.15.3:0/3167684446 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06680be8b0 con 0x7f06680bbf00 2023-10-08T15:37:41.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.437+0000 7f0667fff700 1 --2- 172.21.15.3:0/3167684446 >> v2:172.21.15.50:3300/0 conn(0x7f0668148980 0x7f0668148d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:37:41.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.437+0000 7f06677fe700 1 --2- 172.21.15.3:0/3167684446 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06680bbf00 0x7f06680b3e40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f06680bcb10 tx=0x7f0660009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c628f9a23f996a94 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:41.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.437+0000 7f06667fc700 1 -- 172.21.15.3:0/3167684446 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066000e070 con 0x7f06680bbf00 2023-10-08T15:37:41.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.437+0000 7f06667fc700 1 -- 172.21.15.3:0/3167684446 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f066000bc30 con 0x7f06680bbf00 2023-10-08T15:37:41.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.437+0000 7f06667fc700 1 -- 172.21.15.3:0/3167684446 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0660012430 con 0x7f06680bbf00 2023-10-08T15:37:41.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.441+0000 7f066cafa700 1 -- 172.21.15.3:0/3167684446 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06680bbf00 msgr2=0x7f06680b3e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:41.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.441+0000 7f066cafa700 1 --2- 172.21.15.3:0/3167684446 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06680bbf00 0x7f06680b3e40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f06680bcb10 tx=0x7f0660009780 comp rx=0 tx=0).stop 2023-10-08T15:37:41.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.441+0000 7f066cafa700 1 -- 172.21.15.3:0/3167684446 shutdown_connections 2023-10-08T15:37:41.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.441+0000 7f066cafa700 1 --2- 172.21.15.3:0/3167684446 >> v2:172.21.15.50:3300/0 conn(0x7f0668148980 0x7f0668148d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:41.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.441+0000 7f066cafa700 1 --2- 172.21.15.3:0/3167684446 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06680bbf00 0x7f06680b3e40 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:41.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.441+0000 7f066cafa700 1 -- 172.21.15.3:0/3167684446 >> 172.21.15.3:0/3167684446 conn(0x7f06680bf5e0 msgr2=0x7f06680bb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:41.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.441+0000 7f066cafa700 1 -- 172.21.15.3:0/3167684446 shutdown_connections 2023-10-08T15:37:41.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.441+0000 7f066cafa700 1 -- 172.21.15.3:0/3167684446 wait complete. 2023-10-08T15:37:41.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.441+0000 7f066cafa700 1 Processor -- start 2023-10-08T15:37:41.449 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.441+0000 7f066cafa700 1 -- start start 2023-10-08T15:37:41.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.445+0000 7f066cafa700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06680bbf00 0x7f0668143930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:41.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.445+0000 7f066cafa700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f06680be470 0x7f06680ba980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:41.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.445+0000 7f066cafa700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0668148980 0x7f0668159270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:41.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.445+0000 7f066cafa700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06680b9b10 con 0x7f06680bbf00 2023-10-08T15:37:41.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.445+0000 7f066cafa700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06680b8a90 con 0x7f0668148980 2023-10-08T15:37:41.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.445+0000 7f066cafa700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06681446e0 con 0x7f06680be470 2023-10-08T15:37:41.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.445+0000 7f06677fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06680bbf00 0x7f0668143930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:41.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.445+0000 7f06677fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06680bbf00 0x7f0668143930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44172/0 (socket says 172.21.15.3:44172) 2023-10-08T15:37:41.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.445+0000 7f06677fe700 1 -- 172.21.15.3:0/2882653595 learned_addr learned my addr 172.21.15.3:0/2882653595 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:41.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.445+0000 7f0667fff700 1 --2- 172.21.15.3:0/2882653595 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0668148980 0x7f0668159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:41.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.445+0000 7f0666ffd700 1 --2- 172.21.15.3:0/2882653595 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f06680be470 0x7f06680ba980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:41.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.445+0000 7f06677fe700 1 -- 172.21.15.3:0/2882653595 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f06680be470 msgr2=0x7f06680ba980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:41.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.445+0000 7f06677fe700 1 --2- 172.21.15.3:0/2882653595 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f06680be470 0x7f06680ba980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:41.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.445+0000 7f06677fe700 1 -- 172.21.15.3:0/2882653595 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0668148980 msgr2=0x7f0668159270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:41.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.445+0000 7f06677fe700 1 --2- 172.21.15.3:0/2882653595 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0668148980 0x7f0668159270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:41.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.445+0000 7f06677fe700 1 -- 172.21.15.3:0/2882653595 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0660009a20 con 0x7f06680bbf00 2023-10-08T15:37:41.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.445+0000 7f06677fe700 1 --2- 172.21.15.3:0/2882653595 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06680bbf00 0x7f0668143930 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0660013000 tx=0x7f0660019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:41.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.445+0000 7f065f7fe700 1 -- 172.21.15.3:0/2882653595 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0660001090 con 0x7f06680bbf00 2023-10-08T15:37:41.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.445+0000 7f065f7fe700 1 -- 172.21.15.3:0/2882653595 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0660009420 con 0x7f06680bbf00 2023-10-08T15:37:41.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.445+0000 7f066cafa700 1 -- 172.21.15.3:0/2882653595 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0668144240 con 0x7f06680bbf00 2023-10-08T15:37:41.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.445+0000 7f065f7fe700 1 -- 172.21.15.3:0/2882653595 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06600276c0 con 0x7f06680bbf00 2023-10-08T15:37:41.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.445+0000 7f066cafa700 1 -- 172.21.15.3:0/2882653595 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0668143e70 con 0x7f06680bbf00 2023-10-08T15:37:41.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.449+0000 7f066cafa700 1 -- 172.21.15.3:0/2882653595 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f066805ecf0 con 0x7f06680bbf00 2023-10-08T15:37:41.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.449+0000 7f065f7fe700 1 -- 172.21.15.3:0/2882653595 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f0660024070 con 0x7f06680bbf00 2023-10-08T15:37:41.455 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.449+0000 7f065f7fe700 1 --2- 172.21.15.3:0/2882653595 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f0648060550 0x7f0648062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:41.455 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.449+0000 7f065f7fe700 1 -- 172.21.15.3:0/2882653595 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f066007ed30 con 0x7f06680bbf00 2023-10-08T15:37:41.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.449+0000 7f0666ffd700 1 --2- 172.21.15.3:0/2882653595 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f0648060550 0x7f0648062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:41.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.449+0000 7f0666ffd700 1 --2- 172.21.15.3:0/2882653595 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f0648060550 0x7f0648062a00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f06680b6650 tx=0x7f0650007d30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:41.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.457+0000 7f065f7fe700 1 -- 172.21.15.3:0/2882653595 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f066004f320 con 0x7f06680bbf00 2023-10-08T15:37:41.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.621+0000 7f066cafa700 1 -- 172.21.15.3:0/2882653595 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0668148760 con 0x7f06680bbf00 2023-10-08T15:37:41.630 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.625+0000 7f065f7fe700 1 -- 172.21.15.3:0/2882653595 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15254 (secure 0 0 0) 0x7f0660009880 con 0x7f06680bbf00 2023-10-08T15:37:41.630 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:37:41.630 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":20,"fsid":"7635972e-cd66-4a8f-a231-378db8b3847a","created":"2023-10-08T15:37:08.234594+0000","modified":"2023-10-08T15:37:27.007828+0000","last_up_change":"2023-10-08T15:37:17.537726+0000","last_in_change":"2023-10-08T15:37:10.269178+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:37:16.581590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:37:23.353518+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T15:37:24.365114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"64fb1864-bfdd-4d75-9b41-03fb60085dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33363},{"type":"v1","addr":"172.21.15.3:6801","nonce":33363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33363},{"type":"v1","addr":"172.21.15.3:6803","nonce":33363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":33363},{"type":"v1","addr":"172.21.15.3:6807","nonce":33363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33363},{"type":"v1","addr":"172.21.15.3:6805","nonce":33363}]},"public_addr":"172.21.15.3:6801/33363","cluster_addr":"172.21.15.3:6803/33363","heartbeat_back_addr":"172.21.15.3:6807/33363","heartbeat_front_addr":"172.21.15.3:6805/33363","state":["exists","up"]},{"osd":1,"uuid":"3ca6bd3a-3e8a-4c65-af9c-46148b0c2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33364},{"type":"v1","addr":"172.21.15.3:6820","nonce":33364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33364},{"type":"v1","addr":"172.21.15.3:6824","nonce":33364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33364},{"type":"v1","addr":"172.21.15.3:6831","nonce":33364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33364},{"type":"v1","addr":"172.21.15.3:6828","nonce":33364}]},"public_addr":"172.21.15.3:6820/33364","cluster_addr":"172.21.15.3:6824/33364","heartbeat_back_addr":"172.21.15.3:6831/33364","heartbeat_front_addr":"172.21.15.3:6828/33364","state":["exists","up"]},{"osd":2,"uuid":"6eb9f757-58dd-442f-910d-32401454bce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33366},{"type":"v1","addr":"172.21.15.3:6817","nonce":33366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":33366},{"type":"v1","addr":"172.21.15.3:6821","nonce":33366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6827","nonce":33366},{"type":"v1","addr":"172.21.15.3:6829","nonce":33366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":33366},{"type":"v1","addr":"172.21.15.3:6825","nonce":33366}]},"public_addr":"172.21.15.3:6817/33366","cluster_addr":"172.21.15.3:6821/33366","heartbeat_back_addr":"172.21.15.3:6829/33366","heartbeat_front_addr":"172.21.15.3:6825/33366","state":["exists","up"]},{"osd":3,"uuid":"1c39866b-ac2e-4ea9-a69c-02b01ee4191d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33365},{"type":"v1","addr":"172.21.15.3:6809","nonce":33365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":33365},{"type":"v1","addr":"172.21.15.3:6811","nonce":33365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33365},{"type":"v1","addr":"172.21.15.3:6815","nonce":33365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":33365},{"type":"v1","addr":"172.21.15.3:6813","nonce":33365}]},"public_addr":"172.21.15.3:6809/33365","cluster_addr":"172.21.15.3:6811/33365","heartbeat_back_addr":"172.21.15.3:6815/33365","heartbeat_front_addr":"172.21.15.3:6813/33365","state":["exists","up"]},{"osd":4,"uuid":"15f86b61-b7f1-4780-ae00-9d80a68cb830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":33605},{"type":"v1","addr":"172.21.15.50:6809","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33605},{"type":"v1","addr":"172.21.15.50:6811","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33605},{"type":"v1","addr":"172.21.15.50:6815","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":33605},{"type":"v1","addr":"172.21.15.50:6813","nonce":33605}]},"public_addr":"172.21.15.50:6809/33605","cluster_addr":"172.21.15.50:6811/33605","heartbeat_back_addr":"172.21.15.50:6815/33605","heartbeat_front_addr":"172.21.15.50:6813/33605","state":["exists","up"]},{"osd":5,"uuid":"726c3003-34e6-4d5a-b6e2-f911e13c2118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33606},{"type":"v1","addr":"172.21.15.50:6801","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33606},{"type":"v1","addr":"172.21.15.50:6803","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33606},{"type":"v1","addr":"172.21.15.50:6807","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":33606},{"type":"v1","addr":"172.21.15.50:6805","nonce":33606}]},"public_addr":"172.21.15.50:6801/33606","cluster_addr":"172.21.15.50:6803/33606","heartbeat_back_addr":"172.21.15.50:6807/33606","heartbeat_front_addr":"172.21.15.50:6805/33606","state":["exists","up"]},{"osd":6,"uuid":"401122a4-9988-441f-a5a7-39164434ebcd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":33607},{"type":"v1","addr":"172.21.15.50:6819","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":33607},{"type":"v1","addr":"172.21.15.50:6823","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":33607},{"type":"v1","addr":"172.21.15.50:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":33607},{"type":"v1","addr":"172.21.15.50:6827","nonce":33607}]},"public_addr":"172.21.15.50:6819/33607","cluster_addr":"172.21.15.50:6823/33607","heartbeat_back_addr":"172.21.15.50:6831/33607","heartbeat_front_addr":"172.21.15.50:6827/33607","state":["exists","up"]},{"osd":7,"uuid":"6b3fa236-c9d0-4c4d-82ae-9af4daf6d699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33604},{"type":"v1","addr":"172.21.15.50:6818","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":33604},{"type":"v1","addr":"172.21.15.50:6822","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":33604},{"type":"v1","addr":"172.21.15.50:6830","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":33604},{"type":"v1","addr":"172.21.15.50:6826","nonce":33604}]},"public_addr":"172.21.15.50:6818/33604","cluster_addr":"172.21.15.50:6822/33604","heartbeat_back_addr":"172.21.15.50:6830/33604","heartbeat_front_addr":"172.21.15.50:6826/33604","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.497794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.529417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.873426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.325972+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.443971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.240795+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.739632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.643026+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:37:41.632 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.625+0000 7f066cafa700 1 -- 172.21.15.3:0/2882653595 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f0648060550 msgr2=0x7f0648062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:41.633 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.625+0000 7f066cafa700 1 --2- 172.21.15.3:0/2882653595 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f0648060550 0x7f0648062a00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f06680b6650 tx=0x7f0650007d30 comp rx=0 tx=0).stop 2023-10-08T15:37:41.633 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.625+0000 7f066cafa700 1 -- 172.21.15.3:0/2882653595 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06680bbf00 msgr2=0x7f0668143930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:41.633 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.625+0000 7f066cafa700 1 --2- 172.21.15.3:0/2882653595 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06680bbf00 0x7f0668143930 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0660013000 tx=0x7f0660019000 comp rx=0 tx=0).stop 2023-10-08T15:37:41.633 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.625+0000 7f066cafa700 1 -- 172.21.15.3:0/2882653595 shutdown_connections 2023-10-08T15:37:41.633 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.625+0000 7f066cafa700 1 --2- 172.21.15.3:0/2882653595 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f0648060550 0x7f0648062a00 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:41.633 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.625+0000 7f066cafa700 1 --2- 172.21.15.3:0/2882653595 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0668148980 0x7f0668159270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:41.633 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.625+0000 7f066cafa700 1 --2- 172.21.15.3:0/2882653595 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f06680be470 0x7f06680ba980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:41.633 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.625+0000 7f066cafa700 1 --2- 172.21.15.3:0/2882653595 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06680bbf00 0x7f0668143930 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:41.634 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.625+0000 7f066cafa700 1 -- 172.21.15.3:0/2882653595 >> 172.21.15.3:0/2882653595 conn(0x7f06680bf5e0 msgr2=0x7f0668068190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:41.634 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.625+0000 7f066cafa700 1 -- 172.21.15.3:0/2882653595 shutdown_connections 2023-10-08T15:37:41.634 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.625+0000 7f066cafa700 1 -- 172.21.15.3:0/2882653595 wait complete. 2023-10-08T15:37:41.645 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T15:37:16.581590+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T15:37:23.353518+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T15:37:24.365114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T15:37:41.646 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T15:37:41.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.753+0000 7fc0664de700 1 Processor -- start 2023-10-08T15:37:41.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.757+0000 7fc0664de700 1 -- start start 2023-10-08T15:37:41.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.757+0000 7fc0664de700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc06014b2e0 0x7fc06014b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:41.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.757+0000 7fc0664de700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc06006ddf0 con 0x7fc06006ef40 2023-10-08T15:37:41.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.757+0000 7fc0664de700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc06014bf20 con 0x7fc060141bd0 2023-10-08T15:37:41.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.757+0000 7fc0664de700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc060142010 con 0x7fc06014b2e0 2023-10-08T15:37:41.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.757+0000 7fc057fff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fc06006ef40 0x7fc0601414c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:59694/0 (socket says 172.21.15.3:59694) 2023-10-08T15:37:41.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.757+0000 7fc057fff700 1 -- 172.21.15.3:0/3801384727 learned_addr learned my addr 172.21.15.3:0/3801384727 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:41.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.757+0000 7fc05ffff700 1 --2- 172.21.15.3:0/3801384727 >> v2:172.21.15.50:3300/0 conn(0x7fc06014b2e0 0x7fc06014b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:41.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.757+0000 7fc05f7fe700 1 -- 172.21.15.3:0/3801384727 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 308514384 0 0) 0x7fc06006ddf0 con 0x7fc06006ef40 2023-10-08T15:37:41.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.757+0000 7fc05f7fe700 1 -- 172.21.15.3:0/3801384727 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc04c004680 con 0x7fc06006ef40 2023-10-08T15:37:41.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.757+0000 7fc05ffff700 1 -- 172.21.15.3:0/3801384727 >> v1:172.21.15.50:6789/0 conn(0x7fc060141bd0 legacy=0x7fc0600b1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:41.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.757+0000 7fc05ffff700 1 -- 172.21.15.3:0/3801384727 >> v1:172.21.15.3:6789/0 conn(0x7fc06006ef40 legacy=0x7fc0601414c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:41.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.757+0000 7fc05ffff700 1 -- 172.21.15.3:0/3801384727 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc06006da80 con 0x7fc06014b2e0 2023-10-08T15:37:41.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.757+0000 7fc05ffff700 1 --2- 172.21.15.3:0/3801384727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc06014b2e0 0x7fc06014b6b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc0500098e0 tx=0x7fc0500091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbc1ea0d00d51c8a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:41.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.757+0000 7fc05f7fe700 1 -- 172.21.15.3:0/3801384727 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05000b640 con 0x7fc06014b2e0 2023-10-08T15:37:41.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.757+0000 7fc05f7fe700 1 -- 172.21.15.3:0/3801384727 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc05000b7a0 con 0x7fc06014b2e0 2023-10-08T15:37:41.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.757+0000 7fc05f7fe700 1 -- 172.21.15.3:0/3801384727 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05000bb20 con 0x7fc06014b2e0 2023-10-08T15:37:41.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.761+0000 7fc0664de700 1 -- 172.21.15.3:0/3801384727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc06014b2e0 msgr2=0x7fc06014b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:41.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.761+0000 7fc0664de700 1 --2- 172.21.15.3:0/3801384727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc06014b2e0 0x7fc06014b6b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc0500098e0 tx=0x7fc0500091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:41.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.761+0000 7fc0664de700 1 -- 172.21.15.3:0/3801384727 shutdown_connections 2023-10-08T15:37:41.767 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.761+0000 7fc0664de700 1 --2- 172.21.15.3:0/3801384727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc06014b2e0 0x7fc06014b6b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:41.767 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.761+0000 7fc0664de700 1 -- 172.21.15.3:0/3801384727 >> 172.21.15.3:0/3801384727 conn(0x7fc0600be4f0 msgr2=0x7fc0600be8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:41.767 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.761+0000 7fc0664de700 1 -- 172.21.15.3:0/3801384727 shutdown_connections 2023-10-08T15:37:41.767 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.761+0000 7fc0664de700 1 -- 172.21.15.3:0/3801384727 wait complete. 2023-10-08T15:37:41.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.761+0000 7fc0664de700 1 Processor -- start 2023-10-08T15:37:41.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.761+0000 7fc0664de700 1 -- start start 2023-10-08T15:37:41.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.761+0000 7fc0664de700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc06006ef40 0x7fc060144ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:41.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.761+0000 7fc0664de700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc060141bd0 0x7fc0600b9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:41.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.761+0000 7fc0664de700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc06014b2e0 0x7fc060142160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:41.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.761+0000 7fc0664de700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc060144a30 con 0x7fc06006ef40 2023-10-08T15:37:41.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.761+0000 7fc0664de700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0601446c0 con 0x7fc06014b2e0 2023-10-08T15:37:41.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.761+0000 7fc0664de700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc060145400 con 0x7fc060141bd0 2023-10-08T15:37:41.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.761+0000 7fc05ffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc06006ef40 0x7fc060144ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:41.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.761+0000 7fc05ffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc06006ef40 0x7fc060144ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44188/0 (socket says 172.21.15.3:44188) 2023-10-08T15:37:41.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.761+0000 7fc05ffff700 1 -- 172.21.15.3:0/2454307900 learned_addr learned my addr 172.21.15.3:0/2454307900 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:41.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.765+0000 7fc064a7b700 1 --2- 172.21.15.3:0/2454307900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc06014b2e0 0x7fc060142160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:41.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.765+0000 7fc057fff700 1 --2- 172.21.15.3:0/2454307900 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc060141bd0 0x7fc0600b9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:41.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.765+0000 7fc05ffff700 1 -- 172.21.15.3:0/2454307900 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc060141bd0 msgr2=0x7fc0600b9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:41.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.765+0000 7fc05ffff700 1 --2- 172.21.15.3:0/2454307900 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc060141bd0 0x7fc0600b9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:41.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.765+0000 7fc05ffff700 1 -- 172.21.15.3:0/2454307900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc06014b2e0 msgr2=0x7fc060142160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:41.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.765+0000 7fc05ffff700 1 --2- 172.21.15.3:0/2454307900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc06014b2e0 0x7fc060142160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:41.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.765+0000 7fc05ffff700 1 -- 172.21.15.3:0/2454307900 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc050009420 con 0x7fc06006ef40 2023-10-08T15:37:41.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.765+0000 7fc064a7b700 1 --2- 172.21.15.3:0/2454307900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc06014b2e0 0x7fc060142160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:37:41.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.765+0000 7fc05ffff700 1 --2- 172.21.15.3:0/2454307900 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc06006ef40 0x7fc060144ec0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc0600bf140 tx=0x7fc050017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:41.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.765+0000 7fc05cff9700 1 -- 172.21.15.3:0/2454307900 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05000bb20 con 0x7fc06006ef40 2023-10-08T15:37:41.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.765+0000 7fc05cff9700 1 -- 172.21.15.3:0/2454307900 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc050011420 con 0x7fc06006ef40 2023-10-08T15:37:41.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.765+0000 7fc05cff9700 1 -- 172.21.15.3:0/2454307900 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0500117e0 con 0x7fc06006ef40 2023-10-08T15:37:41.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.765+0000 7fc0664de700 1 -- 172.21.15.3:0/2454307900 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0600b9dc0 con 0x7fc06006ef40 2023-10-08T15:37:41.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.765+0000 7fc0664de700 1 -- 172.21.15.3:0/2454307900 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0600b8b30 con 0x7fc06006ef40 2023-10-08T15:37:41.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.765+0000 7fc0664de700 1 -- 172.21.15.3:0/2454307900 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc060064530 con 0x7fc06006ef40 2023-10-08T15:37:41.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.765+0000 7fc05cff9700 1 -- 172.21.15.3:0/2454307900 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc050011c10 con 0x7fc06006ef40 2023-10-08T15:37:41.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.765+0000 7fc05cff9700 1 --2- 172.21.15.3:0/2454307900 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc040060550 0x7fc040062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:41.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.765+0000 7fc05cff9700 1 -- 172.21.15.3:0/2454307900 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc05007dfc0 con 0x7fc06006ef40 2023-10-08T15:37:41.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.769+0000 7fc057fff700 1 --2- 172.21.15.3:0/2454307900 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc040060550 0x7fc040062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:41.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.769+0000 7fc057fff700 1 --2- 172.21.15.3:0/2454307900 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc040060550 0x7fc040062a00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc0601409e0 tx=0x7fc048009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:41.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.773+0000 7fc05cff9700 1 -- 172.21.15.3:0/2454307900 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc0500adbe0 con 0x7fc06006ef40 2023-10-08T15:37:41.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.937+0000 7fc0664de700 1 -- 172.21.15.3:0/2454307900 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc06014bbf0 con 0x7fc06006ef40 2023-10-08T15:37:41.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.937+0000 7fc05cff9700 1 -- 172.21.15.3:0/2454307900 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc05004e5b0 con 0x7fc06006ef40 2023-10-08T15:37:41.943 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2023-10-08T15:37:41.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.937+0000 7fc0664de700 1 -- 172.21.15.3:0/2454307900 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc040060550 msgr2=0x7fc040062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:41.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.937+0000 7fc0664de700 1 --2- 172.21.15.3:0/2454307900 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc040060550 0x7fc040062a00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc0601409e0 tx=0x7fc048009040 comp rx=0 tx=0).stop 2023-10-08T15:37:41.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.937+0000 7fc0664de700 1 -- 172.21.15.3:0/2454307900 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc06006ef40 msgr2=0x7fc060144ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:41.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.937+0000 7fc0664de700 1 --2- 172.21.15.3:0/2454307900 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc06006ef40 0x7fc060144ec0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc0600bf140 tx=0x7fc050017000 comp rx=0 tx=0).stop 2023-10-08T15:37:41.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.937+0000 7fc0664de700 1 -- 172.21.15.3:0/2454307900 shutdown_connections 2023-10-08T15:37:41.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.937+0000 7fc0664de700 1 --2- 172.21.15.3:0/2454307900 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc040060550 0x7fc040062a00 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:41.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.937+0000 7fc0664de700 1 --2- 172.21.15.3:0/2454307900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc06014b2e0 0x7fc060142160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:41.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.937+0000 7fc0664de700 1 --2- 172.21.15.3:0/2454307900 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc060141bd0 0x7fc0600b9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:41.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.937+0000 7fc0664de700 1 --2- 172.21.15.3:0/2454307900 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc06006ef40 0x7fc060144ec0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:41.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.937+0000 7fc0664de700 1 -- 172.21.15.3:0/2454307900 >> 172.21.15.3:0/2454307900 conn(0x7fc0600be4f0 msgr2=0x7fc06014a850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:41.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.937+0000 7fc0664de700 1 -- 172.21.15.3:0/2454307900 shutdown_connections 2023-10-08T15:37:41.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:41.937+0000 7fc0664de700 1 -- 172.21.15.3:0/2454307900 wait complete. 2023-10-08T15:37:41.957 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T15:37:42.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.073+0000 7f1e2aaf4700 1 Processor -- start 2023-10-08T15:37:42.081 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.073+0000 7f1e2aaf4700 1 -- start start 2023-10-08T15:37:42.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.073+0000 7f1e2aaf4700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1e24153f60 0x7f1e24156340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:42.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.073+0000 7f1e2aaf4700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e2414c0e0 con 0x7f1e2406c830 2023-10-08T15:37:42.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.073+0000 7f1e2aaf4700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e2414c570 con 0x7f1e240bf3a0 2023-10-08T15:37:42.086 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.073+0000 7f1e2aaf4700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2414b8b0 con 0x7f1e24153f60 2023-10-08T15:37:42.086 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.077+0000 7f1e23fff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f1e2406c830 0x7f1e2406d660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:59700/0 (socket says 172.21.15.3:59700) 2023-10-08T15:37:42.086 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.077+0000 7f1e23fff700 1 -- 172.21.15.3:0/634205989 learned_addr learned my addr 172.21.15.3:0/634205989 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:42.086 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.077+0000 7f1e29091700 1 --2- 172.21.15.3:0/634205989 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1e24153f60 0x7f1e24156340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:42.086 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.077+0000 7f1e237fe700 1 -- 172.21.15.3:0/634205989 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2476933541 0 0) 0x7f1e2414c0e0 con 0x7f1e2406c830 2023-10-08T15:37:42.086 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.077+0000 7f1e237fe700 1 -- 172.21.15.3:0/634205989 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e0c003570 con 0x7f1e2406c830 2023-10-08T15:37:42.086 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.077+0000 7f1e237fe700 1 -- 172.21.15.3:0/634205989 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3601078253 0 0) 0x7f1e2414c570 con 0x7f1e240bf3a0 2023-10-08T15:37:42.086 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.077+0000 7f1e237fe700 1 -- 172.21.15.3:0/634205989 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e2414c0e0 con 0x7f1e240bf3a0 2023-10-08T15:37:42.087 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.077+0000 7f1e237fe700 1 -- 172.21.15.3:0/634205989 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2611373323 0 0) 0x7f1e0c003570 con 0x7f1e2406c830 2023-10-08T15:37:42.087 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.077+0000 7f1e237fe700 1 -- 172.21.15.3:0/634205989 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1e24153f60 msgr2=0x7f1e24156340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:42.087 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.077+0000 7f1e237fe700 1 --2- 172.21.15.3:0/634205989 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1e24153f60 0x7f1e24156340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:42.087 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.077+0000 7f1e237fe700 1 -- 172.21.15.3:0/634205989 >> v1:172.21.15.50:6789/0 conn(0x7f1e240bf3a0 legacy=0x7f1e2406cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:42.087 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.077+0000 7f1e237fe700 1 -- 172.21.15.3:0/634205989 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e2414ba90 con 0x7f1e2406c830 2023-10-08T15:37:42.087 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.077+0000 7f1e237fe700 1 -- 172.21.15.3:0/634205989 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2285686191 0 0) 0x7f1e18001470 con 0x7f1e2406c830 2023-10-08T15:37:42.087 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.077+0000 7f1e29091700 1 --2- 172.21.15.3:0/634205989 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1e24153f60 0x7f1e24156340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:37:42.087 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.077+0000 7f1e237fe700 1 -- 172.21.15.3:0/634205989 >> v1:172.21.15.3:6789/0 conn(0x7f1e2406c830 legacy=0x7f1e2406d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:42.087 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.077+0000 7f1e237fe700 1 --2- 172.21.15.3:0/634205989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e0c003c20 0x7f1e0c004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:42.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.077+0000 7f1e237fe700 1 --2- 172.21.15.3:0/634205989 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1e0c004810 0x7f1e0c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:42.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.077+0000 7f1e237fe700 1 --2- 172.21.15.3:0/634205989 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1e0c0051c0 0x7f1e0c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:42.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.077+0000 7f1e237fe700 1 -- 172.21.15.3:0/634205989 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2414b8b0 con 0x7f1e0c0051c0 2023-10-08T15:37:42.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.077+0000 7f1e237fe700 1 -- 172.21.15.3:0/634205989 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0c00c0b0 con 0x7f1e0c003c20 2023-10-08T15:37:42.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.077+0000 7f1e237fe700 1 -- 172.21.15.3:0/634205989 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0c00c270 con 0x7f1e0c004810 2023-10-08T15:37:42.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.077+0000 7f1e29091700 1 --2- 172.21.15.3:0/634205989 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1e0c0051c0 0x7f1e0c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:42.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.077+0000 7f1e28890700 1 --2- 172.21.15.3:0/634205989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e0c003c20 0x7f1e0c004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:42.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.077+0000 7f1e23fff700 1 --2- 172.21.15.3:0/634205989 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1e0c004810 0x7f1e0c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:42.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.077+0000 7f1e29091700 1 -- 172.21.15.3:0/634205989 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1e0c004810 msgr2=0x7f1e0c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:42.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.077+0000 7f1e29091700 1 --2- 172.21.15.3:0/634205989 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1e0c004810 0x7f1e0c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:42.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.077+0000 7f1e29091700 1 -- 172.21.15.3:0/634205989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e0c003c20 msgr2=0x7f1e0c004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:42.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.077+0000 7f1e29091700 1 --2- 172.21.15.3:0/634205989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e0c003c20 0x7f1e0c004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:42.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.077+0000 7f1e29091700 1 -- 172.21.15.3:0/634205989 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e0c003570 con 0x7f1e0c0051c0 2023-10-08T15:37:42.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.077+0000 7f1e29091700 1 --2- 172.21.15.3:0/634205989 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1e0c0051c0 0x7f1e0c00ba60 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1e2406e810 tx=0x7f1e1c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83188924f347a410 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:42.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.077+0000 7f1e237fe700 1 -- 172.21.15.3:0/634205989 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c00eb00 con 0x7f1e0c0051c0 2023-10-08T15:37:42.090 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.077+0000 7f1e237fe700 1 -- 172.21.15.3:0/634205989 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e1c00f040 con 0x7f1e0c0051c0 2023-10-08T15:37:42.090 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.077+0000 7f1e237fe700 1 -- 172.21.15.3:0/634205989 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c00eeb0 con 0x7f1e0c0051c0 2023-10-08T15:37:42.090 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.077+0000 7f1e2aaf4700 1 -- 172.21.15.3:0/634205989 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1e0c0051c0 msgr2=0x7f1e0c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:42.090 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.077+0000 7f1e2aaf4700 1 --2- 172.21.15.3:0/634205989 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1e0c0051c0 0x7f1e0c00ba60 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1e2406e810 tx=0x7f1e1c00b040 comp rx=0 tx=0).stop 2023-10-08T15:37:42.090 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.077+0000 7f1e29091700 1 -- 172.21.15.3:0/634205989 reap_dead start 2023-10-08T15:37:42.090 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.077+0000 7f1e2aaf4700 1 -- 172.21.15.3:0/634205989 shutdown_connections 2023-10-08T15:37:42.090 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.077+0000 7f1e2aaf4700 1 -- 172.21.15.3:0/634205989 >> 172.21.15.3:0/634205989 conn(0x7f1e240c2a40 msgr2=0x7f1e240bea60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:42.091 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.077+0000 7f1e2aaf4700 1 -- 172.21.15.3:0/634205989 shutdown_connections 2023-10-08T15:37:42.091 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.077+0000 7f1e2aaf4700 1 -- 172.21.15.3:0/634205989 wait complete. 2023-10-08T15:37:42.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.081+0000 7f1e2aaf4700 1 Processor -- start 2023-10-08T15:37:42.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.081+0000 7f1e2aaf4700 1 -- start start 2023-10-08T15:37:42.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.081+0000 7f1e2aaf4700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1e0c0051c0 0x7f1e24143d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:42.094 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.081+0000 7f1e2aaf4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e24145b20 0x7f1e2413cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:42.094 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.081+0000 7f1e2aaf4700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1e2413efe0 0x7f1e2413d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:42.094 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.081+0000 7f1e2aaf4700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e24146400 con 0x7f1e0c0051c0 2023-10-08T15:37:42.094 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.081+0000 7f1e2aaf4700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e24145490 con 0x7f1e24145b20 2023-10-08T15:37:42.094 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.081+0000 7f1e2aaf4700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e24145770 con 0x7f1e2413efe0 2023-10-08T15:37:42.094 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.081+0000 7f1e28890700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1e0c0051c0 0x7f1e24143d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:42.094 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.081+0000 7f1e28890700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1e0c0051c0 0x7f1e24143d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44194/0 (socket says 172.21.15.3:44194) 2023-10-08T15:37:42.094 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.081+0000 7f1e28890700 1 -- 172.21.15.3:0/1934366042 learned_addr learned my addr 172.21.15.3:0/1934366042 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:42.094 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.081+0000 7f1e23fff700 1 --2- 172.21.15.3:0/1934366042 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e24145b20 0x7f1e2413cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:42.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.081+0000 7f1e29091700 1 --2- 172.21.15.3:0/1934366042 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1e2413efe0 0x7f1e2413d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:42.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.081+0000 7f1e28890700 1 -- 172.21.15.3:0/1934366042 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1e2413efe0 msgr2=0x7f1e2413d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:42.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.081+0000 7f1e28890700 1 --2- 172.21.15.3:0/1934366042 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1e2413efe0 0x7f1e2413d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:42.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.081+0000 7f1e28890700 1 -- 172.21.15.3:0/1934366042 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e24145b20 msgr2=0x7f1e2413cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:42.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.081+0000 7f1e28890700 1 --2- 172.21.15.3:0/1934366042 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e24145b20 0x7f1e2413cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:42.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.081+0000 7f1e28890700 1 -- 172.21.15.3:0/1934366042 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e2415c7b0 con 0x7f1e0c0051c0 2023-10-08T15:37:42.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.085+0000 7f1e28890700 1 --2- 172.21.15.3:0/1934366042 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1e0c0051c0 0x7f1e24143d60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1e14002b80 tx=0x7f1e14007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:42.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.085+0000 7f1e20ff9700 1 -- 172.21.15.3:0/1934366042 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e140034f0 con 0x7f1e0c0051c0 2023-10-08T15:37:42.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.085+0000 7f1e20ff9700 1 -- 172.21.15.3:0/1934366042 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e1400f9a0 con 0x7f1e0c0051c0 2023-10-08T15:37:42.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.085+0000 7f1e2aaf4700 1 -- 172.21.15.3:0/1934366042 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e2413f6f0 con 0x7f1e0c0051c0 2023-10-08T15:37:42.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.085+0000 7f1e20ff9700 1 -- 172.21.15.3:0/1934366042 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1400fd60 con 0x7f1e0c0051c0 2023-10-08T15:37:42.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.085+0000 7f1e2aaf4700 1 -- 172.21.15.3:0/1934366042 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e2413da60 con 0x7f1e0c0051c0 2023-10-08T15:37:42.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.085+0000 7f1e2aaf4700 1 -- 172.21.15.3:0/1934366042 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e2413f550 con 0x7f1e0c0051c0 2023-10-08T15:37:42.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.085+0000 7f1e20ff9700 1 -- 172.21.15.3:0/1934366042 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f1e14013600 con 0x7f1e0c0051c0 2023-10-08T15:37:42.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.085+0000 7f1e20ff9700 1 --2- 172.21.15.3:0/1934366042 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1e10060550 0x7f1e10062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:42.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.085+0000 7f1e20ff9700 1 -- 172.21.15.3:0/1934366042 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1e1407cd30 con 0x7f1e0c0051c0 2023-10-08T15:37:42.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.085+0000 7f1e23fff700 1 --2- 172.21.15.3:0/1934366042 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1e10060550 0x7f1e10062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:42.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.089+0000 7f1e23fff700 1 --2- 172.21.15.3:0/1934366042 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1e10060550 0x7f1e10062a00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1e18005d00 tx=0x7f1e18007040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:42.100 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.093+0000 7f1e20ff9700 1 -- 172.21.15.3:0/1934366042 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1e2413f550 con 0x7f1e0c0051c0 2023-10-08T15:37:42.269 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.261+0000 7f1e2aaf4700 1 -- 172.21.15.3:0/1934366042 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1e2413f550 con 0x7f1e0c0051c0 2023-10-08T15:37:42.269 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.261+0000 7f1e20ff9700 1 -- 172.21.15.3:0/1934366042 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1e14017020 con 0x7f1e0c0051c0 2023-10-08T15:37:42.270 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 32 2023-10-08T15:37:42.272 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.265+0000 7f1e2aaf4700 1 -- 172.21.15.3:0/1934366042 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1e10060550 msgr2=0x7f1e10062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:42.272 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.265+0000 7f1e2aaf4700 1 --2- 172.21.15.3:0/1934366042 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1e10060550 0x7f1e10062a00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1e18005d00 tx=0x7f1e18007040 comp rx=0 tx=0).stop 2023-10-08T15:37:42.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.265+0000 7f1e2aaf4700 1 -- 172.21.15.3:0/1934366042 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1e0c0051c0 msgr2=0x7f1e24143d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:42.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.265+0000 7f1e2aaf4700 1 --2- 172.21.15.3:0/1934366042 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1e0c0051c0 0x7f1e24143d60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1e14002b80 tx=0x7f1e14007d30 comp rx=0 tx=0).stop 2023-10-08T15:37:42.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.265+0000 7f1e2aaf4700 1 -- 172.21.15.3:0/1934366042 shutdown_connections 2023-10-08T15:37:42.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.265+0000 7f1e2aaf4700 1 --2- 172.21.15.3:0/1934366042 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1e10060550 0x7f1e10062a00 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:42.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.265+0000 7f1e2aaf4700 1 --2- 172.21.15.3:0/1934366042 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1e2413efe0 0x7f1e2413d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:42.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.265+0000 7f1e2aaf4700 1 --2- 172.21.15.3:0/1934366042 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e24145b20 0x7f1e2413cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:42.274 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.265+0000 7f1e2aaf4700 1 --2- 172.21.15.3:0/1934366042 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1e0c0051c0 0x7f1e24143d60 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:42.274 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.265+0000 7f1e2aaf4700 1 -- 172.21.15.3:0/1934366042 >> 172.21.15.3:0/1934366042 conn(0x7f1e240c2a40 msgr2=0x7f1e24140180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:42.274 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.265+0000 7f1e2aaf4700 1 -- 172.21.15.3:0/1934366042 shutdown_connections 2023-10-08T15:37:42.274 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.265+0000 7f1e2aaf4700 1 -- 172.21.15.3:0/1934366042 wait complete. 2023-10-08T15:37:42.283 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T15:37:42.396 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.389+0000 7fdd48fda700 1 Processor -- start 2023-10-08T15:37:42.396 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.389+0000 7fdd48fda700 1 -- start start 2023-10-08T15:37:42.400 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.389+0000 7fdd48fda700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fdd440a77f0 0x7fdd440be3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:42.400 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.389+0000 7fdd48fda700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdd440a7bc0 0x7fdd4414bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:42.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.389+0000 7fdd48fda700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd4406ced0 con 0x7fdd4406c5c0 2023-10-08T15:37:42.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.389+0000 7fdd48fda700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd4406e770 con 0x7fdd440a77f0 2023-10-08T15:37:42.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.389+0000 7fdd48fda700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd44069570 con 0x7fdd440a7bc0 2023-10-08T15:37:42.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.389+0000 7fdd437fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fdd440a77f0 0x7fdd440be3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:42.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.389+0000 7fdd42ffd700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fdd4406c5c0 0x7fdd440a2200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:59710/0 (socket says 172.21.15.3:59710) 2023-10-08T15:37:42.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.389+0000 7fdd42ffd700 1 -- 172.21.15.3:0/2736750827 learned_addr learned my addr 172.21.15.3:0/2736750827 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:42.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.393+0000 7fdd43fff700 1 --2- 172.21.15.3:0/2736750827 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdd440a7bc0 0x7fdd4414bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:42.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.393+0000 7fdd427fc700 1 -- 172.21.15.3:0/2736750827 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3660251005 0 0) 0x7fdd4406ced0 con 0x7fdd4406c5c0 2023-10-08T15:37:42.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.393+0000 7fdd427fc700 1 -- 172.21.15.3:0/2736750827 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd2c003570 con 0x7fdd4406c5c0 2023-10-08T15:37:42.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.393+0000 7fdd437fe700 1 -- 172.21.15.3:0/2736750827 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdd440a7bc0 msgr2=0x7fdd4414bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:42.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.393+0000 7fdd437fe700 1 --2- 172.21.15.3:0/2736750827 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdd440a7bc0 0x7fdd4414bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:42.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.393+0000 7fdd437fe700 1 -- 172.21.15.3:0/2736750827 >> v1:172.21.15.3:6789/0 conn(0x7fdd4406c5c0 legacy=0x7fdd440a2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:42.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.393+0000 7fdd437fe700 1 -- 172.21.15.3:0/2736750827 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd4414c620 con 0x7fdd440a77f0 2023-10-08T15:37:42.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.393+0000 7fdd437fe700 1 --2- 172.21.15.3:0/2736750827 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdd440a77f0 0x7fdd440be3d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdd380098e0 tx=0x7fdd380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=958cb391ba920326 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:42.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.393+0000 7fdd427fc700 1 -- 172.21.15.3:0/2736750827 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd38011630 con 0x7fdd440a77f0 2023-10-08T15:37:42.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.393+0000 7fdd427fc700 1 -- 172.21.15.3:0/2736750827 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd38011790 con 0x7fdd440a77f0 2023-10-08T15:37:42.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.393+0000 7fdd427fc700 1 -- 172.21.15.3:0/2736750827 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd38011b30 con 0x7fdd440a77f0 2023-10-08T15:37:42.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.393+0000 7fdd48fda700 1 -- 172.21.15.3:0/2736750827 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdd440a77f0 msgr2=0x7fdd440be3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:42.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.393+0000 7fdd48fda700 1 --2- 172.21.15.3:0/2736750827 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdd440a77f0 0x7fdd440be3d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdd380098e0 tx=0x7fdd380091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:42.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.393+0000 7fdd48fda700 1 -- 172.21.15.3:0/2736750827 shutdown_connections 2023-10-08T15:37:42.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.393+0000 7fdd48fda700 1 --2- 172.21.15.3:0/2736750827 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdd440a7bc0 0x7fdd4414bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:42.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.393+0000 7fdd48fda700 1 --2- 172.21.15.3:0/2736750827 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdd440a77f0 0x7fdd440be3d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:42.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.393+0000 7fdd48fda700 1 -- 172.21.15.3:0/2736750827 >> 172.21.15.3:0/2736750827 conn(0x7fdd440c29f0 msgr2=0x7fdd440a1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:42.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.393+0000 7fdd48fda700 1 -- 172.21.15.3:0/2736750827 shutdown_connections 2023-10-08T15:37:42.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.393+0000 7fdd48fda700 1 -- 172.21.15.3:0/2736750827 wait complete. 2023-10-08T15:37:42.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.397+0000 7fdd48fda700 1 Processor -- start 2023-10-08T15:37:42.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.397+0000 7fdd48fda700 1 -- start start 2023-10-08T15:37:42.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.397+0000 7fdd48fda700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdd4406c5c0 0x7fdd44145410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:42.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.397+0000 7fdd48fda700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd440a7bc0 0x7fdd4415d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:42.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.397+0000 7fdd48fda700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdd4415d970 0x7fdd4415de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:42.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.397+0000 7fdd48fda700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4414cfa0 con 0x7fdd4406c5c0 2023-10-08T15:37:42.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.397+0000 7fdd48fda700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd44145950 con 0x7fdd440a7bc0 2023-10-08T15:37:42.410 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.397+0000 7fdd48fda700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4415e5c0 con 0x7fdd4415d970 2023-10-08T15:37:42.410 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.397+0000 7fdd437fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdd4406c5c0 0x7fdd44145410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:42.410 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.397+0000 7fdd437fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdd4406c5c0 0x7fdd44145410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44220/0 (socket says 172.21.15.3:44220) 2023-10-08T15:37:42.410 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.397+0000 7fdd437fe700 1 -- 172.21.15.3:0/3965984445 learned_addr learned my addr 172.21.15.3:0/3965984445 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:42.410 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.397+0000 7fdd43fff700 1 --2- 172.21.15.3:0/3965984445 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdd4415d970 0x7fdd4415de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:42.410 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.397+0000 7fdd42ffd700 1 --2- 172.21.15.3:0/3965984445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd440a7bc0 0x7fdd4415d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:42.410 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.397+0000 7fdd437fe700 1 -- 172.21.15.3:0/3965984445 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdd4415d970 msgr2=0x7fdd4415de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:42.410 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.397+0000 7fdd437fe700 1 --2- 172.21.15.3:0/3965984445 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdd4415d970 0x7fdd4415de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:42.410 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.397+0000 7fdd437fe700 1 -- 172.21.15.3:0/3965984445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd440a7bc0 msgr2=0x7fdd4415d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:42.411 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.397+0000 7fdd437fe700 1 --2- 172.21.15.3:0/3965984445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd440a7bc0 0x7fdd4415d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:42.411 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.397+0000 7fdd437fe700 1 -- 172.21.15.3:0/3965984445 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd38009420 con 0x7fdd4406c5c0 2023-10-08T15:37:42.411 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.397+0000 7fdd43fff700 1 --2- 172.21.15.3:0/3965984445 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdd4415d970 0x7fdd4415de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:37:42.411 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.397+0000 7fdd437fe700 1 --2- 172.21.15.3:0/3965984445 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdd4406c5c0 0x7fdd44145410 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fdd4406bb30 tx=0x7fdd38017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:42.411 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.397+0000 7fdd2b7fe700 1 -- 172.21.15.3:0/3965984445 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd38011900 con 0x7fdd4406c5c0 2023-10-08T15:37:42.411 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.397+0000 7fdd2b7fe700 1 -- 172.21.15.3:0/3965984445 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd38011ac0 con 0x7fdd4406c5c0 2023-10-08T15:37:42.411 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.397+0000 7fdd48fda700 1 -- 172.21.15.3:0/3965984445 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd4414ca00 con 0x7fdd4406c5c0 2023-10-08T15:37:42.411 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.397+0000 7fdd2b7fe700 1 -- 172.21.15.3:0/3965984445 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd38025640 con 0x7fdd4406c5c0 2023-10-08T15:37:42.412 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.397+0000 7fdd48fda700 1 -- 172.21.15.3:0/3965984445 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd4414e7c0 con 0x7fdd4406c5c0 2023-10-08T15:37:42.412 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.401+0000 7fdd48fda700 1 -- 172.21.15.3:0/3965984445 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd4405ecf0 con 0x7fdd4406c5c0 2023-10-08T15:37:42.412 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.401+0000 7fdd2b7fe700 1 -- 172.21.15.3:0/3965984445 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fdd380259f0 con 0x7fdd4406c5c0 2023-10-08T15:37:42.412 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.401+0000 7fdd2b7fe700 1 --2- 172.21.15.3:0/3965984445 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fdd30060550 0x7fdd30062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:42.412 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.401+0000 7fdd2b7fe700 1 -- 172.21.15.3:0/3965984445 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdd3807df90 con 0x7fdd4406c5c0 2023-10-08T15:37:42.412 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.401+0000 7fdd42ffd700 1 --2- 172.21.15.3:0/3965984445 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fdd30060550 0x7fdd30062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:42.413 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.405+0000 7fdd42ffd700 1 --2- 172.21.15.3:0/3965984445 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fdd30060550 0x7fdd30062a00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdd44147710 tx=0x7fdd34009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:42.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.413+0000 7fdd2b7fe700 1 -- 172.21.15.3:0/3965984445 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fdd3804e4e0 con 0x7fdd4406c5c0 2023-10-08T15:37:42.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.573+0000 7fdd48fda700 1 -- 172.21.15.3:0/3965984445 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdd4406cb60 con 0x7fdd4406c5c0 2023-10-08T15:37:42.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.573+0000 7fdd2b7fe700 1 -- 172.21.15.3:0/3965984445 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdd38057020 con 0x7fdd4406c5c0 2023-10-08T15:37:42.579 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 64 2023-10-08T15:37:42.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.577+0000 7fdd48fda700 1 -- 172.21.15.3:0/3965984445 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fdd30060550 msgr2=0x7fdd30062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:42.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.577+0000 7fdd48fda700 1 --2- 172.21.15.3:0/3965984445 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fdd30060550 0x7fdd30062a00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdd44147710 tx=0x7fdd34009040 comp rx=0 tx=0).stop 2023-10-08T15:37:42.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.577+0000 7fdd48fda700 1 -- 172.21.15.3:0/3965984445 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdd4406c5c0 msgr2=0x7fdd44145410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:42.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.577+0000 7fdd48fda700 1 --2- 172.21.15.3:0/3965984445 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdd4406c5c0 0x7fdd44145410 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fdd4406bb30 tx=0x7fdd38017000 comp rx=0 tx=0).stop 2023-10-08T15:37:42.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.577+0000 7fdd48fda700 1 -- 172.21.15.3:0/3965984445 shutdown_connections 2023-10-08T15:37:42.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.577+0000 7fdd48fda700 1 --2- 172.21.15.3:0/3965984445 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fdd30060550 0x7fdd30062a00 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:42.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.577+0000 7fdd48fda700 1 --2- 172.21.15.3:0/3965984445 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdd4415d970 0x7fdd4415de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:42.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.577+0000 7fdd48fda700 1 --2- 172.21.15.3:0/3965984445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd440a7bc0 0x7fdd4415d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:42.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.577+0000 7fdd48fda700 1 --2- 172.21.15.3:0/3965984445 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdd4406c5c0 0x7fdd44145410 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:42.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.577+0000 7fdd48fda700 1 -- 172.21.15.3:0/3965984445 >> 172.21.15.3:0/3965984445 conn(0x7fdd440c29f0 msgr2=0x7fdd4406d360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:42.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.577+0000 7fdd48fda700 1 -- 172.21.15.3:0/3965984445 shutdown_connections 2023-10-08T15:37:42.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.577+0000 7fdd48fda700 1 -- 172.21.15.3:0/3965984445 wait complete. 2023-10-08T15:37:42.597 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:37:42.706 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.697+0000 7fbbfbfff700 1 Processor -- start 2023-10-08T15:37:42.706 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.697+0000 7fbbfbfff700 1 -- start start 2023-10-08T15:37:42.707 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.697+0000 7fbbfbfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbbfc0bbcd0 0x7fbbfc0bc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:42.707 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.697+0000 7fbbfbfff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbbfc0b3280 0x7fbbfc0b2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:42.707 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.697+0000 7fbbfbfff700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbfc1495c0 con 0x7fbbfc0be5f0 2023-10-08T15:37:42.707 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.697+0000 7fbbfbfff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbfc0bd9e0 con 0x7fbbfc0bbcd0 2023-10-08T15:37:42.707 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.697+0000 7fbbfbfff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbfc0b1e80 con 0x7fbbfc0b3280 2023-10-08T15:37:42.707 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.701+0000 7fbbfb7fe700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fbbfc0be5f0 0x7fbbfc147970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:59724/0 (socket says 172.21.15.3:59724) 2023-10-08T15:37:42.707 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.701+0000 7fbbfb7fe700 1 -- 172.21.15.3:0/310628130 learned_addr learned my addr 172.21.15.3:0/310628130 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:42.707 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.701+0000 7fbbf3fff700 1 --2- 172.21.15.3:0/310628130 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbbfc0b3280 0x7fbbfc0b2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:42.707 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.701+0000 7fbbfaffd700 1 --2- 172.21.15.3:0/310628130 >> v2:172.21.15.50:3300/0 conn(0x7fbbfc0bbcd0 0x7fbbfc0bc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:42.707 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.701+0000 7fbbfa7fc700 1 -- 172.21.15.3:0/310628130 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 854877315 0 0) 0x7fbbfc1495c0 con 0x7fbbfc0be5f0 2023-10-08T15:37:42.708 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.701+0000 7fbbfa7fc700 1 -- 172.21.15.3:0/310628130 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbe8003570 con 0x7fbbfc0be5f0 2023-10-08T15:37:42.708 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.701+0000 7fbbf3fff700 1 -- 172.21.15.3:0/310628130 >> v2:172.21.15.50:3300/0 conn(0x7fbbfc0bbcd0 msgr2=0x7fbbfc0bc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:42.708 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.701+0000 7fbbf3fff700 1 --2- 172.21.15.3:0/310628130 >> v2:172.21.15.50:3300/0 conn(0x7fbbfc0bbcd0 0x7fbbfc0bc0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:42.708 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.701+0000 7fbbf3fff700 1 -- 172.21.15.3:0/310628130 >> v1:172.21.15.3:6789/0 conn(0x7fbbfc0be5f0 legacy=0x7fbbfc147970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:42.708 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.701+0000 7fbbf3fff700 1 -- 172.21.15.3:0/310628130 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbfc0bd700 con 0x7fbbfc0b3280 2023-10-08T15:37:42.708 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.701+0000 7fbbf3fff700 1 --2- 172.21.15.3:0/310628130 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbbfc0b3280 0x7fbbfc0b2310 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbbe40098e0 tx=0x7fbbe40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=420c0badc17672ff server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:42.710 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.701+0000 7fbbfa7fc700 1 -- 172.21.15.3:0/310628130 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe4011630 con 0x7fbbfc0b3280 2023-10-08T15:37:42.710 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.701+0000 7fbbfa7fc700 1 -- 172.21.15.3:0/310628130 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe4011790 con 0x7fbbfc0b3280 2023-10-08T15:37:42.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.701+0000 7fbbfa7fc700 1 -- 172.21.15.3:0/310628130 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe4011b30 con 0x7fbbfc0b3280 2023-10-08T15:37:42.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.701+0000 7fbbfbfff700 1 -- 172.21.15.3:0/310628130 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbbfc0b3280 msgr2=0x7fbbfc0b2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:42.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.701+0000 7fbbfbfff700 1 --2- 172.21.15.3:0/310628130 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbbfc0b3280 0x7fbbfc0b2310 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbbe40098e0 tx=0x7fbbe40091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:42.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.701+0000 7fbbfbfff700 1 -- 172.21.15.3:0/310628130 shutdown_connections 2023-10-08T15:37:42.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.701+0000 7fbbfbfff700 1 --2- 172.21.15.3:0/310628130 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbbfc0b3280 0x7fbbfc0b2310 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:42.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.701+0000 7fbbfbfff700 1 --2- 172.21.15.3:0/310628130 >> v2:172.21.15.50:3300/0 conn(0x7fbbfc0bbcd0 0x7fbbfc0bc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:42.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.701+0000 7fbbfbfff700 1 -- 172.21.15.3:0/310628130 >> 172.21.15.3:0/310628130 conn(0x7fbbfc0bf5e0 msgr2=0x7fbbfc0bb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:42.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.701+0000 7fbbfbfff700 1 -- 172.21.15.3:0/310628130 shutdown_connections 2023-10-08T15:37:42.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.701+0000 7fbbfbfff700 1 -- 172.21.15.3:0/310628130 wait complete. 2023-10-08T15:37:42.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.701+0000 7fbbfbfff700 1 Processor -- start 2023-10-08T15:37:42.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.701+0000 7fbbfbfff700 1 -- start start 2023-10-08T15:37:42.712 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.705+0000 7fbbfbfff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbbfc0b3280 0x7fbbfc0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:42.712 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.705+0000 7fbbfbfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbbfc0bbcd0 0x7fbbfc147f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:42.712 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.705+0000 7fbbfbfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbbfc0be5f0 0x7fbbfc1484c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:42.712 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.705+0000 7fbbfbfff700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbfc13d3c0 con 0x7fbbfc0bbcd0 2023-10-08T15:37:42.712 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.705+0000 7fbbfbfff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbfc148a00 con 0x7fbbfc0be5f0 2023-10-08T15:37:42.712 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.705+0000 7fbbfbfff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbfc13ab10 con 0x7fbbfc0b3280 2023-10-08T15:37:42.712 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.705+0000 7fbbf3fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbbfc0bbcd0 0x7fbbfc147f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:42.712 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.705+0000 7fbbf3fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbbfc0bbcd0 0x7fbbfc147f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44236/0 (socket says 172.21.15.3:44236) 2023-10-08T15:37:42.712 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.705+0000 7fbbf3fff700 1 -- 172.21.15.3:0/321780946 learned_addr learned my addr 172.21.15.3:0/321780946 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:42.712 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.705+0000 7fbbfaffd700 1 --2- 172.21.15.3:0/321780946 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbbfc0b3280 0x7fbbfc0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:42.712 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.705+0000 7fbbfb7fe700 1 --2- 172.21.15.3:0/321780946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbbfc0be5f0 0x7fbbfc1484c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:42.713 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.705+0000 7fbbf3fff700 1 -- 172.21.15.3:0/321780946 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbbfc0b3280 msgr2=0x7fbbfc0697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:42.713 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.705+0000 7fbbf3fff700 1 --2- 172.21.15.3:0/321780946 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbbfc0b3280 0x7fbbfc0697e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:42.713 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.705+0000 7fbbf3fff700 1 -- 172.21.15.3:0/321780946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbbfc0be5f0 msgr2=0x7fbbfc1484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:42.713 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.705+0000 7fbbf3fff700 1 --2- 172.21.15.3:0/321780946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbbfc0be5f0 0x7fbbfc1484c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:42.713 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.705+0000 7fbbf3fff700 1 -- 172.21.15.3:0/321780946 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe4009420 con 0x7fbbfc0bbcd0 2023-10-08T15:37:42.713 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.705+0000 7fbbf3fff700 1 --2- 172.21.15.3:0/321780946 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbbfc0bbcd0 0x7fbbfc147f80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4009ed0 tx=0x7fbbe4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:42.714 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.705+0000 7fbbf2ffd700 1 -- 172.21.15.3:0/321780946 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe4011900 con 0x7fbbfc0bbcd0 2023-10-08T15:37:42.714 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.705+0000 7fbbf2ffd700 1 -- 172.21.15.3:0/321780946 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe4011a60 con 0x7fbbfc0bbcd0 2023-10-08T15:37:42.714 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.705+0000 7fbbf2ffd700 1 -- 172.21.15.3:0/321780946 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe4023620 con 0x7fbbfc0bbcd0 2023-10-08T15:37:42.714 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.705+0000 7fbbfbfff700 1 -- 172.21.15.3:0/321780946 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbfc13adf0 con 0x7fbbfc0bbcd0 2023-10-08T15:37:42.714 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.705+0000 7fbbfbfff700 1 -- 172.21.15.3:0/321780946 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbfc13c330 con 0x7fbbfc0bbcd0 2023-10-08T15:37:42.714 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.709+0000 7fbbfbfff700 1 -- 172.21.15.3:0/321780946 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbfc05ecf0 con 0x7fbbfc0bbcd0 2023-10-08T15:37:42.715 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.709+0000 7fbbf2ffd700 1 -- 172.21.15.3:0/321780946 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fbbe402c3b0 con 0x7fbbfc0bbcd0 2023-10-08T15:37:42.715 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.709+0000 7fbbf2ffd700 1 --2- 172.21.15.3:0/321780946 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbbdc060550 0x7fbbdc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:42.715 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.709+0000 7fbbf2ffd700 1 -- 172.21.15.3:0/321780946 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbbe407dbb0 con 0x7fbbfc0bbcd0 2023-10-08T15:37:42.715 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.709+0000 7fbbfaffd700 1 --2- 172.21.15.3:0/321780946 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbbdc060550 0x7fbbdc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:42.716 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.709+0000 7fbbfaffd700 1 --2- 172.21.15.3:0/321780946 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbbdc060550 0x7fbbdc062a00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbbec009d10 tx=0x7fbbec009120 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:42.723 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.717+0000 7fbbf2ffd700 1 -- 172.21.15.3:0/321780946 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbbe404e180 con 0x7fbbfc0bbcd0 2023-10-08T15:37:42.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.913+0000 7fbbfbfff700 1 -- 172.21.15.3:0/321780946 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbbfc0bd3d0 con 0x7fbbfc0bbcd0 2023-10-08T15:37:42.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.913+0000 7fbbf2ffd700 1 -- 172.21.15.3:0/321780946 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+3073 (secure 0 0 0) 0x7fbbe4015c20 con 0x7fbbfc0bbcd0 2023-10-08T15:37:42.919 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:37:42.919 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6833/519836882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":519836882},{"type":"v1","addr":"172.21.15.3:6833","nonce":519836882}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:37:25.379215+0000","modified":"2023-10-08T15:37:28.041086+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/1601527591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1601527591},{"type":"v1","addr":"172.21.15.50:6835","nonce":1601527591}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-08T15:37:42.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.913+0000 7fbbfbfff700 1 -- 172.21.15.3:0/321780946 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbbdc060550 msgr2=0x7fbbdc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:42.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.913+0000 7fbbfbfff700 1 --2- 172.21.15.3:0/321780946 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbbdc060550 0x7fbbdc062a00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbbec009d10 tx=0x7fbbec009120 comp rx=0 tx=0).stop 2023-10-08T15:37:42.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.913+0000 7fbbfbfff700 1 -- 172.21.15.3:0/321780946 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbbfc0bbcd0 msgr2=0x7fbbfc147f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:42.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.913+0000 7fbbfbfff700 1 --2- 172.21.15.3:0/321780946 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbbfc0bbcd0 0x7fbbfc147f80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4009ed0 tx=0x7fbbe4017000 comp rx=0 tx=0).stop 2023-10-08T15:37:42.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.913+0000 7fbbfbfff700 1 -- 172.21.15.3:0/321780946 shutdown_connections 2023-10-08T15:37:42.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.913+0000 7fbbfbfff700 1 --2- 172.21.15.3:0/321780946 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbbdc060550 0x7fbbdc062a00 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:42.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.913+0000 7fbbfbfff700 1 --2- 172.21.15.3:0/321780946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbbfc0be5f0 0x7fbbfc1484c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:42.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.913+0000 7fbbfbfff700 1 --2- 172.21.15.3:0/321780946 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbbfc0bbcd0 0x7fbbfc147f80 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:42.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.913+0000 7fbbfbfff700 1 --2- 172.21.15.3:0/321780946 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbbfc0b3280 0x7fbbfc0697e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:42.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.913+0000 7fbbfbfff700 1 -- 172.21.15.3:0/321780946 >> 172.21.15.3:0/321780946 conn(0x7fbbfc0bf5e0 msgr2=0x7fbbfc13df40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:42.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.913+0000 7fbbfbfff700 1 -- 172.21.15.3:0/321780946 shutdown_connections 2023-10-08T15:37:42.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:42.913+0000 7fbbfbfff700 1 -- 172.21.15.3:0/321780946 wait complete. 2023-10-08T15:37:42.923 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 6 2023-10-08T15:37:42.933 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:37:43.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.033+0000 7f3f73587700 1 Processor -- start 2023-10-08T15:37:43.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.033+0000 7f3f73587700 1 -- start start 2023-10-08T15:37:43.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.033+0000 7f3f73587700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3f6c0a15e0 0x7f3f6c14eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:43.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.033+0000 7f3f73587700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3f6c06cf60 0x7f3f6c14f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:43.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.033+0000 7f3f73587700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f3f6c068630 0x7f3f6c14f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:43.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.033+0000 7f3f73587700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f6c069900 con 0x7f3f6c068630 2023-10-08T15:37:43.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.033+0000 7f3f73587700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f6c069620 con 0x7f3f6c0a15e0 2023-10-08T15:37:43.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.033+0000 7f3f73587700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6c068d10 con 0x7f3f6c06cf60 2023-10-08T15:37:43.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.033+0000 7f3f72d86700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f3f6c068630 0x7f3f6c14f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:43.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.033+0000 7f3f72d86700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f3f6c068630 0x7f3f6c14f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44248/0 (socket says 172.21.15.3:44248) 2023-10-08T15:37:43.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.033+0000 7f3f72d86700 1 -- 172.21.15.3:0/4197965459 learned_addr learned my addr 172.21.15.3:0/4197965459 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:43.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.033+0000 7f3f72585700 1 --2- 172.21.15.3:0/4197965459 >> v2:172.21.15.50:3300/0 conn(0x7f3f6c0a15e0 0x7f3f6c14eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:43.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.033+0000 7f3f71d84700 1 --2- 172.21.15.3:0/4197965459 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3f6c06cf60 0x7f3f6c14f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:43.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.037+0000 7f3f72d86700 1 -- 172.21.15.3:0/4197965459 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3f6c06cf60 msgr2=0x7f3f6c14f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:43.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.037+0000 7f3f72d86700 1 --2- 172.21.15.3:0/4197965459 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3f6c06cf60 0x7f3f6c14f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:43.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.037+0000 7f3f72d86700 1 -- 172.21.15.3:0/4197965459 >> v2:172.21.15.50:3300/0 conn(0x7f3f6c0a15e0 msgr2=0x7f3f6c14eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:43.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.037+0000 7f3f72d86700 1 --2- 172.21.15.3:0/4197965459 >> v2:172.21.15.50:3300/0 conn(0x7f3f6c0a15e0 0x7f3f6c14eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:43.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.037+0000 7f3f72d86700 1 -- 172.21.15.3:0/4197965459 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f6c06e8e0 con 0x7f3f6c068630 2023-10-08T15:37:43.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.037+0000 7f3f72d86700 1 --2- 172.21.15.3:0/4197965459 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3f6c068630 0x7f3f6c14f560 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c0be250 tx=0x7f3f64009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45e25bf1887c7697 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:43.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.037+0000 7f3f71583700 1 -- 172.21.15.3:0/4197965459 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6400e070 con 0x7f3f6c068630 2023-10-08T15:37:43.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.037+0000 7f3f71583700 1 -- 172.21.15.3:0/4197965459 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f6400b970 con 0x7f3f6c068630 2023-10-08T15:37:43.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.037+0000 7f3f71583700 1 -- 172.21.15.3:0/4197965459 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f640092e0 con 0x7f3f6c068630 2023-10-08T15:37:43.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.037+0000 7f3f73587700 1 -- 172.21.15.3:0/4197965459 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3f6c068630 msgr2=0x7f3f6c14f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:43.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.037+0000 7f3f73587700 1 --2- 172.21.15.3:0/4197965459 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3f6c068630 0x7f3f6c14f560 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c0be250 tx=0x7f3f64009840 comp rx=0 tx=0).stop 2023-10-08T15:37:43.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.037+0000 7f3f73587700 1 -- 172.21.15.3:0/4197965459 shutdown_connections 2023-10-08T15:37:43.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.037+0000 7f3f73587700 1 --2- 172.21.15.3:0/4197965459 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3f6c06cf60 0x7f3f6c14f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:43.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.037+0000 7f3f73587700 1 --2- 172.21.15.3:0/4197965459 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3f6c068630 0x7f3f6c14f560 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:43.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.037+0000 7f3f73587700 1 --2- 172.21.15.3:0/4197965459 >> v2:172.21.15.50:3300/0 conn(0x7f3f6c0a15e0 0x7f3f6c14eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:43.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.037+0000 7f3f73587700 1 -- 172.21.15.3:0/4197965459 >> 172.21.15.3:0/4197965459 conn(0x7f3f6c0670e0 msgr2=0x7f3f6c0674e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:43.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.037+0000 7f3f73587700 1 -- 172.21.15.3:0/4197965459 shutdown_connections 2023-10-08T15:37:43.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.037+0000 7f3f73587700 1 -- 172.21.15.3:0/4197965459 wait complete. 2023-10-08T15:37:43.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.037+0000 7f3f73587700 1 Processor -- start 2023-10-08T15:37:43.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.037+0000 7f3f73587700 1 -- start start 2023-10-08T15:37:43.047 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.041+0000 7f3f73587700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3f6c068630 0x7f3f6c14dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:43.048 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.041+0000 7f3f73587700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3f6c0a15e0 0x7f3f6c140390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:43.048 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.041+0000 7f3f73587700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f6c14f320 0x7f3f6c13f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:43.048 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.041+0000 7f3f73587700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6c14e850 con 0x7f3f6c0a15e0 2023-10-08T15:37:43.048 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.041+0000 7f3f73587700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6c1408d0 con 0x7f3f6c14f320 2023-10-08T15:37:43.048 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.041+0000 7f3f73587700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6c14eae0 con 0x7f3f6c068630 2023-10-08T15:37:43.048 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.041+0000 7f3f71d84700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3f6c0a15e0 0x7f3f6c140390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:43.049 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.041+0000 7f3f72585700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3f6c068630 0x7f3f6c14dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:43.049 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.041+0000 7f3f71d84700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3f6c0a15e0 0x7f3f6c140390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44262/0 (socket says 172.21.15.3:44262) 2023-10-08T15:37:43.049 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.041+0000 7f3f71d84700 1 -- 172.21.15.3:0/3747009412 learned_addr learned my addr 172.21.15.3:0/3747009412 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:43.049 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.041+0000 7f3f72d86700 1 --2- 172.21.15.3:0/3747009412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f6c14f320 0x7f3f6c13f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:43.049 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.041+0000 7f3f71d84700 1 -- 172.21.15.3:0/3747009412 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3f6c068630 msgr2=0x7f3f6c14dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:43.049 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.041+0000 7f3f71d84700 1 --2- 172.21.15.3:0/3747009412 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3f6c068630 0x7f3f6c14dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:43.049 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.041+0000 7f3f71d84700 1 -- 172.21.15.3:0/3747009412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f6c14f320 msgr2=0x7f3f6c13f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:43.049 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.041+0000 7f3f71d84700 1 --2- 172.21.15.3:0/3747009412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f6c14f320 0x7f3f6c13f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:43.049 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.041+0000 7f3f71d84700 1 -- 172.21.15.3:0/3747009412 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f64009ae0 con 0x7f3f6c0a15e0 2023-10-08T15:37:43.049 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.041+0000 7f3f71d84700 1 --2- 172.21.15.3:0/3747009412 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3f6c0a15e0 0x7f3f6c140390 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3f6800ec80 tx=0x7f3f680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:43.049 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.041+0000 7f3f5e7fc700 1 -- 172.21.15.3:0/3747009412 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6800c850 con 0x7f3f6c0a15e0 2023-10-08T15:37:43.050 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.041+0000 7f3f73587700 1 -- 172.21.15.3:0/3747009412 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f6c14e1e0 con 0x7f3f6c0a15e0 2023-10-08T15:37:43.050 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.041+0000 7f3f5e7fc700 1 -- 172.21.15.3:0/3747009412 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f6800c9d0 con 0x7f3f6c0a15e0 2023-10-08T15:37:43.050 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.041+0000 7f3f73587700 1 -- 172.21.15.3:0/3747009412 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f6c14edc0 con 0x7f3f6c0a15e0 2023-10-08T15:37:43.050 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.041+0000 7f3f5e7fc700 1 -- 172.21.15.3:0/3747009412 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6800cd50 con 0x7f3f6c0a15e0 2023-10-08T15:37:43.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.041+0000 7f3f73587700 1 -- 172.21.15.3:0/3747009412 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f6c14d800 con 0x7f3f6c0a15e0 2023-10-08T15:37:43.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.045+0000 7f3f5e7fc700 1 -- 172.21.15.3:0/3747009412 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f3f68013680 con 0x7f3f6c0a15e0 2023-10-08T15:37:43.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.045+0000 7f3f5e7fc700 1 --2- 172.21.15.3:0/3747009412 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3f50060550 0x7f3f50062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:43.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.045+0000 7f3f5e7fc700 1 -- 172.21.15.3:0/3747009412 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3f6807ce80 con 0x7f3f6c0a15e0 2023-10-08T15:37:43.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.045+0000 7f3f72585700 1 --2- 172.21.15.3:0/3747009412 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3f50060550 0x7f3f50062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:43.052 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.045+0000 7f3f72585700 1 --2- 172.21.15.3:0/3747009412 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3f50060550 0x7f3f50062a00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3f60009db0 tx=0x7f3f600091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:43.057 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.049+0000 7f3f5e7fc700 1 -- 172.21.15.3:0/3747009412 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3f6c14d800 con 0x7f3f6c0a15e0 2023-10-08T15:37:43.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.213+0000 7f3f73587700 1 -- 172.21.15.3:0/3747009412 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3f6c14d800 con 0x7f3f6c0a15e0 2023-10-08T15:37:43.219 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.213+0000 7f3f5e7fc700 1 -- 172.21.15.3:0/3747009412 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15254 (secure 0 0 0) 0x7f3f6c14d800 con 0x7f3f6c0a15e0 2023-10-08T15:37:43.220 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:37:43.220 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":20,"fsid":"7635972e-cd66-4a8f-a231-378db8b3847a","created":"2023-10-08T15:37:08.234594+0000","modified":"2023-10-08T15:37:27.007828+0000","last_up_change":"2023-10-08T15:37:17.537726+0000","last_in_change":"2023-10-08T15:37:10.269178+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:37:16.581590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:37:23.353518+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T15:37:24.365114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"64fb1864-bfdd-4d75-9b41-03fb60085dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33363},{"type":"v1","addr":"172.21.15.3:6801","nonce":33363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33363},{"type":"v1","addr":"172.21.15.3:6803","nonce":33363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":33363},{"type":"v1","addr":"172.21.15.3:6807","nonce":33363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33363},{"type":"v1","addr":"172.21.15.3:6805","nonce":33363}]},"public_addr":"172.21.15.3:6801/33363","cluster_addr":"172.21.15.3:6803/33363","heartbeat_back_addr":"172.21.15.3:6807/33363","heartbeat_front_addr":"172.21.15.3:6805/33363","state":["exists","up"]},{"osd":1,"uuid":"3ca6bd3a-3e8a-4c65-af9c-46148b0c2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33364},{"type":"v1","addr":"172.21.15.3:6820","nonce":33364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33364},{"type":"v1","addr":"172.21.15.3:6824","nonce":33364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33364},{"type":"v1","addr":"172.21.15.3:6831","nonce":33364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33364},{"type":"v1","addr":"172.21.15.3:6828","nonce":33364}]},"public_addr":"172.21.15.3:6820/33364","cluster_addr":"172.21.15.3:6824/33364","heartbeat_back_addr":"172.21.15.3:6831/33364","heartbeat_front_addr":"172.21.15.3:6828/33364","state":["exists","up"]},{"osd":2,"uuid":"6eb9f757-58dd-442f-910d-32401454bce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33366},{"type":"v1","addr":"172.21.15.3:6817","nonce":33366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":33366},{"type":"v1","addr":"172.21.15.3:6821","nonce":33366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6827","nonce":33366},{"type":"v1","addr":"172.21.15.3:6829","nonce":33366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":33366},{"type":"v1","addr":"172.21.15.3:6825","nonce":33366}]},"public_addr":"172.21.15.3:6817/33366","cluster_addr":"172.21.15.3:6821/33366","heartbeat_back_addr":"172.21.15.3:6829/33366","heartbeat_front_addr":"172.21.15.3:6825/33366","state":["exists","up"]},{"osd":3,"uuid":"1c39866b-ac2e-4ea9-a69c-02b01ee4191d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33365},{"type":"v1","addr":"172.21.15.3:6809","nonce":33365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":33365},{"type":"v1","addr":"172.21.15.3:6811","nonce":33365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33365},{"type":"v1","addr":"172.21.15.3:6815","nonce":33365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":33365},{"type":"v1","addr":"172.21.15.3:6813","nonce":33365}]},"public_addr":"172.21.15.3:6809/33365","cluster_addr":"172.21.15.3:6811/33365","heartbeat_back_addr":"172.21.15.3:6815/33365","heartbeat_front_addr":"172.21.15.3:6813/33365","state":["exists","up"]},{"osd":4,"uuid":"15f86b61-b7f1-4780-ae00-9d80a68cb830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":33605},{"type":"v1","addr":"172.21.15.50:6809","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33605},{"type":"v1","addr":"172.21.15.50:6811","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33605},{"type":"v1","addr":"172.21.15.50:6815","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":33605},{"type":"v1","addr":"172.21.15.50:6813","nonce":33605}]},"public_addr":"172.21.15.50:6809/33605","cluster_addr":"172.21.15.50:6811/33605","heartbeat_back_addr":"172.21.15.50:6815/33605","heartbeat_front_addr":"172.21.15.50:6813/33605","state":["exists","up"]},{"osd":5,"uuid":"726c3003-34e6-4d5a-b6e2-f911e13c2118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33606},{"type":"v1","addr":"172.21.15.50:6801","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33606},{"type":"v1","addr":"172.21.15.50:6803","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33606},{"type":"v1","addr":"172.21.15.50:6807","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":33606},{"type":"v1","addr":"172.21.15.50:6805","nonce":33606}]},"public_addr":"172.21.15.50:6801/33606","cluster_addr":"172.21.15.50:6803/33606","heartbeat_back_addr":"172.21.15.50:6807/33606","heartbeat_front_addr":"172.21.15.50:6805/33606","state":["exists","up"]},{"osd":6,"uuid":"401122a4-9988-441f-a5a7-39164434ebcd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":33607},{"type":"v1","addr":"172.21.15.50:6819","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":33607},{"type":"v1","addr":"172.21.15.50:6823","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":33607},{"type":"v1","addr":"172.21.15.50:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":33607},{"type":"v1","addr":"172.21.15.50:6827","nonce":33607}]},"public_addr":"172.21.15.50:6819/33607","cluster_addr":"172.21.15.50:6823/33607","heartbeat_back_addr":"172.21.15.50:6831/33607","heartbeat_front_addr":"172.21.15.50:6827/33607","state":["exists","up"]},{"osd":7,"uuid":"6b3fa236-c9d0-4c4d-82ae-9af4daf6d699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33604},{"type":"v1","addr":"172.21.15.50:6818","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":33604},{"type":"v1","addr":"172.21.15.50:6822","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":33604},{"type":"v1","addr":"172.21.15.50:6830","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":33604},{"type":"v1","addr":"172.21.15.50:6826","nonce":33604}]},"public_addr":"172.21.15.50:6818/33604","cluster_addr":"172.21.15.50:6822/33604","heartbeat_back_addr":"172.21.15.50:6830/33604","heartbeat_front_addr":"172.21.15.50:6826/33604","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.497794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.529417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.873426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.325972+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.443971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.240795+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.739632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.643026+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:37:43.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.217+0000 7f3f73587700 1 -- 172.21.15.3:0/3747009412 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3f50060550 msgr2=0x7f3f50062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:43.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.217+0000 7f3f73587700 1 --2- 172.21.15.3:0/3747009412 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3f50060550 0x7f3f50062a00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3f60009db0 tx=0x7f3f600091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:43.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.217+0000 7f3f73587700 1 -- 172.21.15.3:0/3747009412 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3f6c0a15e0 msgr2=0x7f3f6c140390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:43.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.217+0000 7f3f73587700 1 --2- 172.21.15.3:0/3747009412 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3f6c0a15e0 0x7f3f6c140390 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3f6800ec80 tx=0x7f3f680091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:43.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.217+0000 7f3f73587700 1 -- 172.21.15.3:0/3747009412 shutdown_connections 2023-10-08T15:37:43.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.217+0000 7f3f73587700 1 --2- 172.21.15.3:0/3747009412 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3f50060550 0x7f3f50062a00 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:43.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.217+0000 7f3f73587700 1 --2- 172.21.15.3:0/3747009412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f6c14f320 0x7f3f6c13f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:43.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.217+0000 7f3f73587700 1 --2- 172.21.15.3:0/3747009412 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3f6c0a15e0 0x7f3f6c140390 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:43.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.217+0000 7f3f73587700 1 --2- 172.21.15.3:0/3747009412 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3f6c068630 0x7f3f6c14dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:43.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.217+0000 7f3f73587700 1 -- 172.21.15.3:0/3747009412 >> 172.21.15.3:0/3747009412 conn(0x7f3f6c0670e0 msgr2=0x7f3f6c146fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:43.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.217+0000 7f3f73587700 1 -- 172.21.15.3:0/3747009412 shutdown_connections 2023-10-08T15:37:43.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.217+0000 7f3f73587700 1 -- 172.21.15.3:0/3747009412 wait complete. 2023-10-08T15:37:43.234 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:37:43.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.329+0000 7f48d0e67700 1 Processor -- start 2023-10-08T15:37:43.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.329+0000 7f48d0e67700 1 -- start start 2023-10-08T15:37:43.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.329+0000 7f48d0e67700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f48cc06be60 0x7f48cc0be520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:43.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.329+0000 7f48d0e67700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f48cc06c3e0 0x7f48cc14b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:43.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.329+0000 7f48d0e67700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48cc06cb60 con 0x7f48cc0be150 2023-10-08T15:37:43.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.329+0000 7f48d0e67700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48cc14f8e0 con 0x7f48cc06c3e0 2023-10-08T15:37:43.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.329+0000 7f48d0e67700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48cc14f5f0 con 0x7f48cc06be60 2023-10-08T15:37:43.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.329+0000 7f48cad9d700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f48cc06c3e0 0x7f48cc14b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:43.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.333+0000 7f48cad9d700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f48cc06c3e0 0x7f48cc14b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44274/0 (socket says 172.21.15.3:44274) 2023-10-08T15:37:43.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.333+0000 7f48cad9d700 1 -- 172.21.15.3:0/3281404299 learned_addr learned my addr 172.21.15.3:0/3281404299 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:43.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.333+0000 7f48c9d9b700 1 --2- 172.21.15.3:0/3281404299 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f48cc06be60 0x7f48cc0be520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:43.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.333+0000 7f48cad9d700 1 -- 172.21.15.3:0/3281404299 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f48cc06be60 msgr2=0x7f48cc0be520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:43.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.333+0000 7f48cad9d700 1 --2- 172.21.15.3:0/3281404299 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f48cc06be60 0x7f48cc0be520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:43.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.333+0000 7f48cad9d700 1 -- 172.21.15.3:0/3281404299 >> v1:172.21.15.50:6789/0 conn(0x7f48cc0be150 legacy=0x7f48cc0c26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:43.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.333+0000 7f48cad9d700 1 -- 172.21.15.3:0/3281404299 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48cc0c2db0 con 0x7f48cc06c3e0 2023-10-08T15:37:43.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.333+0000 7f48cad9d700 1 --2- 172.21.15.3:0/3281404299 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f48cc06c3e0 0x7f48cc14b3f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f48c4009f20 tx=0x7f48c4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3bf93a67df1a732 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:43.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.333+0000 7f48c959a700 1 -- 172.21.15.3:0/3281404299 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c400e070 con 0x7f48cc06c3e0 2023-10-08T15:37:43.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.333+0000 7f48c959a700 1 -- 172.21.15.3:0/3281404299 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48c400b9d0 con 0x7f48cc06c3e0 2023-10-08T15:37:43.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.333+0000 7f48c959a700 1 -- 172.21.15.3:0/3281404299 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c40092e0 con 0x7f48cc06c3e0 2023-10-08T15:37:43.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.333+0000 7f48d0e67700 1 -- 172.21.15.3:0/3281404299 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f48cc06c3e0 msgr2=0x7f48cc14b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:43.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.333+0000 7f48d0e67700 1 --2- 172.21.15.3:0/3281404299 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f48cc06c3e0 0x7f48cc14b3f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f48c4009f20 tx=0x7f48c4009840 comp rx=0 tx=0).stop 2023-10-08T15:37:43.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.333+0000 7f48d0e67700 1 -- 172.21.15.3:0/3281404299 shutdown_connections 2023-10-08T15:37:43.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.333+0000 7f48d0e67700 1 --2- 172.21.15.3:0/3281404299 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f48cc06c3e0 0x7f48cc14b3f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:43.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.333+0000 7f48d0e67700 1 --2- 172.21.15.3:0/3281404299 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f48cc06be60 0x7f48cc0be520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:43.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.333+0000 7f48d0e67700 1 -- 172.21.15.3:0/3281404299 >> 172.21.15.3:0/3281404299 conn(0x7f48cc06e460 msgr2=0x7f48cc0c1f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:43.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.333+0000 7f48d0e67700 1 -- 172.21.15.3:0/3281404299 shutdown_connections 2023-10-08T15:37:43.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.333+0000 7f48d0e67700 1 -- 172.21.15.3:0/3281404299 wait complete. 2023-10-08T15:37:43.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.337+0000 7f48d0e67700 1 Processor -- start 2023-10-08T15:37:43.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.337+0000 7f48d0e67700 1 -- start start 2023-10-08T15:37:43.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.337+0000 7f48d0e67700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f48cc06be60 0x7f48cc15f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:43.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.337+0000 7f48d0e67700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f48cc06c3e0 0x7f48cc0c2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:43.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.337+0000 7f48d0e67700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48cc0be150 0x7f48cc1420d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:43.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.337+0000 7f48d0e67700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48cc144d50 con 0x7f48cc06be60 2023-10-08T15:37:43.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.337+0000 7f48d0e67700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48cc14f000 con 0x7f48cc0be150 2023-10-08T15:37:43.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.337+0000 7f48d0e67700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48cc15f690 con 0x7f48cc06c3e0 2023-10-08T15:37:43.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.337+0000 7f48ca59c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f48cc06be60 0x7f48cc15f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:43.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.337+0000 7f48ca59c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f48cc06be60 0x7f48cc15f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44282/0 (socket says 172.21.15.3:44282) 2023-10-08T15:37:43.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.337+0000 7f48ca59c700 1 -- 172.21.15.3:0/1033530314 learned_addr learned my addr 172.21.15.3:0/1033530314 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:43.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.337+0000 7f48c9d9b700 1 --2- 172.21.15.3:0/1033530314 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f48cc06c3e0 0x7f48cc0c2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:43.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.337+0000 7f48cad9d700 1 --2- 172.21.15.3:0/1033530314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48cc0be150 0x7f48cc1420d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:43.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.337+0000 7f48ca59c700 1 -- 172.21.15.3:0/1033530314 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f48cc06c3e0 msgr2=0x7f48cc0c2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:43.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.337+0000 7f48ca59c700 1 --2- 172.21.15.3:0/1033530314 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f48cc06c3e0 0x7f48cc0c2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:43.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.337+0000 7f48ca59c700 1 -- 172.21.15.3:0/1033530314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48cc0be150 msgr2=0x7f48cc1420d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:43.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.337+0000 7f48ca59c700 1 --2- 172.21.15.3:0/1033530314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48cc0be150 0x7f48cc1420d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:43.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.337+0000 7f48ca59c700 1 -- 172.21.15.3:0/1033530314 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c4009ae0 con 0x7f48cc06be60 2023-10-08T15:37:43.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.337+0000 7f48cad9d700 1 --2- 172.21.15.3:0/1033530314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48cc0be150 0x7f48cc1420d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:37:43.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.337+0000 7f48ca59c700 1 --2- 172.21.15.3:0/1033530314 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f48cc06be60 0x7f48cc15f150 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f48c000c5c0 tx=0x7f48c0007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:43.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.337+0000 7f48ba7fc700 1 -- 172.21.15.3:0/1033530314 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c0011590 con 0x7f48cc06be60 2023-10-08T15:37:43.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.337+0000 7f48ba7fc700 1 -- 172.21.15.3:0/1033530314 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48c0011730 con 0x7f48cc06be60 2023-10-08T15:37:43.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.337+0000 7f48d0e67700 1 -- 172.21.15.3:0/1033530314 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48cc14e9b0 con 0x7f48cc06be60 2023-10-08T15:37:43.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.337+0000 7f48ba7fc700 1 -- 172.21.15.3:0/1033530314 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c0011af0 con 0x7f48cc06be60 2023-10-08T15:37:43.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.337+0000 7f48d0e67700 1 -- 172.21.15.3:0/1033530314 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48cc15b1d0 con 0x7f48cc06be60 2023-10-08T15:37:43.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.341+0000 7f48d0e67700 1 -- 172.21.15.3:0/1033530314 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48cc064530 con 0x7f48cc06be60 2023-10-08T15:37:43.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.341+0000 7f48ba7fc700 1 -- 172.21.15.3:0/1033530314 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f48c0012420 con 0x7f48cc06be60 2023-10-08T15:37:43.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.341+0000 7f48ba7fc700 1 --2- 172.21.15.3:0/1033530314 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f48ac060550 0x7f48ac062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:43.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.341+0000 7f48ba7fc700 1 -- 172.21.15.3:0/1033530314 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f48c007bb00 con 0x7f48cc06be60 2023-10-08T15:37:43.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.341+0000 7f48c9d9b700 1 --2- 172.21.15.3:0/1033530314 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f48ac060550 0x7f48ac062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:43.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.341+0000 7f48c9d9b700 1 --2- 172.21.15.3:0/1033530314 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f48ac060550 0x7f48ac062a00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f48cc0c2a90 tx=0x7f48bc0091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:43.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.345+0000 7f48ba7fc700 1 -- 172.21.15.3:0/1033530314 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f48c0049be0 con 0x7f48cc06be60 2023-10-08T15:37:43.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.545+0000 7f48d0e67700 1 -- 172.21.15.3:0/1033530314 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f48cc09a020 con 0x7f48cc06be60 2023-10-08T15:37:43.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.545+0000 7f48ba7fc700 1 -- 172.21.15.3:0/1033530314 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+3073 (secure 0 0 0) 0x7f48c0017020 con 0x7f48cc06be60 2023-10-08T15:37:43.553 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:37:43.553 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6833/519836882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":519836882},{"type":"v1","addr":"172.21.15.3:6833","nonce":519836882}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:37:25.379215+0000","modified":"2023-10-08T15:37:28.041086+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/1601527591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1601527591},{"type":"v1","addr":"172.21.15.50:6835","nonce":1601527591}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-08T15:37:43.555 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.549+0000 7f48d0e67700 1 -- 172.21.15.3:0/1033530314 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f48ac060550 msgr2=0x7f48ac062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:43.555 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.549+0000 7f48d0e67700 1 --2- 172.21.15.3:0/1033530314 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f48ac060550 0x7f48ac062a00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f48cc0c2a90 tx=0x7f48bc0091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:43.555 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.549+0000 7f48d0e67700 1 -- 172.21.15.3:0/1033530314 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f48cc06be60 msgr2=0x7f48cc15f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:43.555 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.549+0000 7f48d0e67700 1 --2- 172.21.15.3:0/1033530314 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f48cc06be60 0x7f48cc15f150 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f48c000c5c0 tx=0x7f48c0007f30 comp rx=0 tx=0).stop 2023-10-08T15:37:43.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.549+0000 7f48d0e67700 1 -- 172.21.15.3:0/1033530314 shutdown_connections 2023-10-08T15:37:43.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.549+0000 7f48d0e67700 1 --2- 172.21.15.3:0/1033530314 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f48ac060550 0x7f48ac062a00 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:43.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.549+0000 7f48d0e67700 1 --2- 172.21.15.3:0/1033530314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48cc0be150 0x7f48cc1420d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:43.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.549+0000 7f48d0e67700 1 --2- 172.21.15.3:0/1033530314 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f48cc06c3e0 0x7f48cc0c2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:43.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.549+0000 7f48d0e67700 1 --2- 172.21.15.3:0/1033530314 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f48cc06be60 0x7f48cc15f150 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:43.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.549+0000 7f48d0e67700 1 -- 172.21.15.3:0/1033530314 >> 172.21.15.3:0/1033530314 conn(0x7f48cc06e460 msgr2=0x7f48cc0c1750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:43.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.549+0000 7f48d0e67700 1 -- 172.21.15.3:0/1033530314 shutdown_connections 2023-10-08T15:37:43.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.549+0000 7f48d0e67700 1 -- 172.21.15.3:0/1033530314 wait complete. 2023-10-08T15:37:43.557 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 6 2023-10-08T15:37:43.772 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-08T15:37:25.379215+0000', 'modified': '2023-10-08T15:37:28.041086+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4260}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4260': {'gid': 4260, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.50:6835/1601527591', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6834', 'nonce': 1601527591}, {'type': 'v1', 'addr': '172.21.15.50:6835', 'nonce': 1601527591}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-08T15:37:43.772 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-08T15:37:43.773 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-08T15:37:43.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.889+0000 7fbee2808700 1 Processor -- start 2023-10-08T15:37:43.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.889+0000 7fbee2808700 1 -- start start 2023-10-08T15:37:43.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.889+0000 7fbee2808700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbedc0670e0 0x7fbedc0674b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:43.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.889+0000 7fbee2808700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fbedc0bd4f0 0x7fbedc0687b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:43.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.889+0000 7fbee2808700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbedc0bd2b0 con 0x7fbedc069640 2023-10-08T15:37:43.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.889+0000 7fbee2808700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbedc069f00 con 0x7fbedc0bd4f0 2023-10-08T15:37:43.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.889+0000 7fbee2808700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbedc0a5940 con 0x7fbedc0670e0 2023-10-08T15:37:43.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.889+0000 7fbee1005700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fbedc0bd4f0 0x7fbedc0687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:43.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.889+0000 7fbee1005700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fbedc0bd4f0 0x7fbedc0687b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44290/0 (socket says 172.21.15.3:44290) 2023-10-08T15:37:43.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.889+0000 7fbee1005700 1 -- 172.21.15.3:0/1886091853 learned_addr learned my addr 172.21.15.3:0/1886091853 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:43.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.889+0000 7fbee1806700 1 --2- 172.21.15.3:0/1886091853 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbedc0670e0 0x7fbedc0674b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:43.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.889+0000 7fbee1005700 1 -- 172.21.15.3:0/1886091853 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbedc0670e0 msgr2=0x7fbedc0674b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:43.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.889+0000 7fbee1005700 1 --2- 172.21.15.3:0/1886091853 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbedc0670e0 0x7fbedc0674b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:43.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.889+0000 7fbee1005700 1 -- 172.21.15.3:0/1886091853 >> v1:172.21.15.50:6789/0 conn(0x7fbedc069640 legacy=0x7fbedc0bfb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:43.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.889+0000 7fbee1005700 1 -- 172.21.15.3:0/1886091853 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbedc14f5a0 con 0x7fbedc0bd4f0 2023-10-08T15:37:43.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.889+0000 7fbee1005700 1 --2- 172.21.15.3:0/1886091853 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbedc0bd4f0 0x7fbedc0687b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fbecc0099b0 tx=0x7fbecc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef6a56319edc0686 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:43.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.889+0000 7fbee0804700 1 -- 172.21.15.3:0/1886091853 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbecc009ea0 con 0x7fbedc0bd4f0 2023-10-08T15:37:43.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.889+0000 7fbee0804700 1 -- 172.21.15.3:0/1886091853 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbecc00b860 con 0x7fbedc0bd4f0 2023-10-08T15:37:43.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.889+0000 7fbee0804700 1 -- 172.21.15.3:0/1886091853 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbecc00bc00 con 0x7fbedc0bd4f0 2023-10-08T15:37:43.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.889+0000 7fbee2808700 1 -- 172.21.15.3:0/1886091853 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbedc0bd4f0 msgr2=0x7fbedc0687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:43.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.889+0000 7fbee2808700 1 --2- 172.21.15.3:0/1886091853 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbedc0bd4f0 0x7fbedc0687b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fbecc0099b0 tx=0x7fbecc009250 comp rx=0 tx=0).stop 2023-10-08T15:37:43.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.889+0000 7fbee2808700 1 -- 172.21.15.3:0/1886091853 shutdown_connections 2023-10-08T15:37:43.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.889+0000 7fbee2808700 1 --2- 172.21.15.3:0/1886091853 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbedc0bd4f0 0x7fbedc0687b0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:43.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.889+0000 7fbee2808700 1 --2- 172.21.15.3:0/1886091853 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbedc0670e0 0x7fbedc0674b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:43.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.889+0000 7fbee2808700 1 -- 172.21.15.3:0/1886091853 >> 172.21.15.3:0/1886091853 conn(0x7fbedc06a760 msgr2=0x7fbedc06dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:43.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.889+0000 7fbee2808700 1 -- 172.21.15.3:0/1886091853 shutdown_connections 2023-10-08T15:37:43.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.889+0000 7fbee2808700 1 -- 172.21.15.3:0/1886091853 wait complete. 2023-10-08T15:37:43.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.893+0000 7fbee2808700 1 Processor -- start 2023-10-08T15:37:43.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.893+0000 7fbee2808700 1 -- start start 2023-10-08T15:37:43.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.893+0000 7fbee2808700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbedc0670e0 0x7fbedc144f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:43.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.893+0000 7fbee2808700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbedc069640 0x7fbedc0bb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:43.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.893+0000 7fbee2808700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbedc0bd4f0 0x7fbedc0bb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:43.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.893+0000 7fbee2808700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbedc145f40 con 0x7fbedc069640 2023-10-08T15:37:43.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.893+0000 7fbee2808700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbedc0bbc20 con 0x7fbedc0670e0 2023-10-08T15:37:43.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.893+0000 7fbee2808700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbedc148e00 con 0x7fbedc0bd4f0 2023-10-08T15:37:43.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.893+0000 7fbee1005700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbedc069640 0x7fbedc0bb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:43.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.893+0000 7fbee1005700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbedc069640 0x7fbedc0bb1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44300/0 (socket says 172.21.15.3:44300) 2023-10-08T15:37:43.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.893+0000 7fbee1005700 1 -- 172.21.15.3:0/4169151418 learned_addr learned my addr 172.21.15.3:0/4169151418 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:43.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.893+0000 7fbee2007700 1 --2- 172.21.15.3:0/4169151418 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbedc0bd4f0 0x7fbedc0bb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:43.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.893+0000 7fbee1806700 1 --2- 172.21.15.3:0/4169151418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbedc0670e0 0x7fbedc144f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:43.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.897+0000 7fbee2007700 1 -- 172.21.15.3:0/4169151418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbedc0670e0 msgr2=0x7fbedc144f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:43.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.897+0000 7fbee2007700 1 --2- 172.21.15.3:0/4169151418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbedc0670e0 0x7fbedc144f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:43.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.897+0000 7fbee2007700 1 -- 172.21.15.3:0/4169151418 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbedc069640 msgr2=0x7fbedc0bb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:43.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.897+0000 7fbee2007700 1 --2- 172.21.15.3:0/4169151418 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbedc069640 0x7fbedc0bb1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:43.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.897+0000 7fbee2007700 1 -- 172.21.15.3:0/4169151418 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbecc0094f0 con 0x7fbedc0bd4f0 2023-10-08T15:37:43.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.897+0000 7fbee2007700 1 --2- 172.21.15.3:0/4169151418 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbedc0bd4f0 0x7fbedc0bb6e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbed400c830 tx=0x7fbed4001690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:43.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.897+0000 7fbed1ffb700 1 -- 172.21.15.3:0/4169151418 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed4012630 con 0x7fbedc0bd4f0 2023-10-08T15:37:43.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.897+0000 7fbed1ffb700 1 -- 172.21.15.3:0/4169151418 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbed4012790 con 0x7fbedc0bd4f0 2023-10-08T15:37:43.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.897+0000 7fbee2808700 1 -- 172.21.15.3:0/4169151418 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbedc150ac0 con 0x7fbedc0bd4f0 2023-10-08T15:37:43.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.897+0000 7fbed1ffb700 1 -- 172.21.15.3:0/4169151418 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed4012b50 con 0x7fbedc0bd4f0 2023-10-08T15:37:43.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.897+0000 7fbee2808700 1 -- 172.21.15.3:0/4169151418 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbedc150d80 con 0x7fbedc0bd4f0 2023-10-08T15:37:43.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.897+0000 7fbed1ffb700 1 -- 172.21.15.3:0/4169151418 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fbed4011380 con 0x7fbedc0bd4f0 2023-10-08T15:37:43.905 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.901+0000 7fbed1ffb700 1 --2- 172.21.15.3:0/4169151418 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbec0060580 0x7fbec0062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:43.905 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.901+0000 7fbed1ffb700 1 -- 172.21.15.3:0/4169151418 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbed407c9e0 con 0x7fbedc0bd4f0 2023-10-08T15:37:43.906 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.901+0000 7fbee1806700 1 --2- 172.21.15.3:0/4169151418 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbec0060580 0x7fbec0062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:43.906 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.901+0000 7fbee1806700 1 --2- 172.21.15.3:0/4169151418 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbec0060580 0x7fbec0062a30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbed8009db0 tx=0x7fbed80091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:43.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.901+0000 7fbee5d13740 1 Processor -- start 2023-10-08T15:37:43.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.901+0000 7fbee5d13740 1 -- start start 2023-10-08T15:37:43.910 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.901+0000 7fbee5d13740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1937ae0 0x1b6f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:43.910 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.901+0000 7fbee5d13740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1937710 0x1b6f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:43.910 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.901+0000 7fbee5d13740 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1982790 0x1b6fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:43.910 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.901+0000 7fbee5d13740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ae2f30 con 0x1937710 2023-10-08T15:37:43.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.901+0000 7fbee5d13740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x1adeed0 con 0x1937ae0 2023-10-08T15:37:43.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.901+0000 7fbee5d13740 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x1aa50b0 con 0x1982790 2023-10-08T15:37:43.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.901+0000 7fbee1005700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1937710 0x1b6f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:43.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.901+0000 7fbee1005700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1937710 0x1b6f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44312/0 (socket says 172.21.15.3:44312) 2023-10-08T15:37:43.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.901+0000 7fbee1005700 1 -- 172.21.15.3:0/1325354061 learned_addr learned my addr 172.21.15.3:0/1325354061 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:43.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.901+0000 7fbee1806700 1 --2- 172.21.15.3:0/1325354061 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1937ae0 0x1b6f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:43.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.901+0000 7fbee2007700 1 --2- 172.21.15.3:0/1325354061 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1982790 0x1b6fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:43.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.905+0000 7fbee1005700 1 -- 172.21.15.3:0/1325354061 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1982790 msgr2=0x1b6fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:43.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.905+0000 7fbee1005700 1 --2- 172.21.15.3:0/1325354061 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1982790 0x1b6fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:43.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.905+0000 7fbee1005700 1 -- 172.21.15.3:0/1325354061 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1937ae0 msgr2=0x1b6f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:43.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.905+0000 7fbee1005700 1 --2- 172.21.15.3:0/1325354061 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1937ae0 0x1b6f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:43.912 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.905+0000 7fbee1005700 1 -- 172.21.15.3:0/1325354061 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x19839e0 con 0x1937710 2023-10-08T15:37:43.912 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.905+0000 7fbee2007700 1 --2- 172.21.15.3:0/1325354061 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1982790 0x1b6fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:37:43.912 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.905+0000 7fbee1005700 1 --2- 172.21.15.3:0/1325354061 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1937710 0x1b6f9a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fbedc067e10 tx=0x7fbecc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55ded158578a2bc3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:43.912 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.905+0000 7fbec6ffd700 1 -- 172.21.15.3:0/1325354061 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbecc022070 con 0x1937710 2023-10-08T15:37:43.912 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.905+0000 7fbec6ffd700 1 -- 172.21.15.3:0/1325354061 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbecc000bc0 con 0x1937710 2023-10-08T15:37:43.912 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.905+0000 7fbec6ffd700 1 -- 172.21.15.3:0/1325354061 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbecc00bbe0 con 0x1937710 2023-10-08T15:37:43.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.905+0000 7fbee5d13740 1 -- 172.21.15.3:0/1325354061 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1937710 msgr2=0x1b6f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:43.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.905+0000 7fbee5d13740 1 --2- 172.21.15.3:0/1325354061 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1937710 0x1b6f9a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fbedc067e10 tx=0x7fbecc017000 comp rx=0 tx=0).stop 2023-10-08T15:37:43.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.905+0000 7fbee5d13740 1 -- 172.21.15.3:0/1325354061 shutdown_connections 2023-10-08T15:37:43.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.905+0000 7fbee5d13740 1 --2- 172.21.15.3:0/1325354061 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1982790 0x1b6fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:43.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.905+0000 7fbee5d13740 1 --2- 172.21.15.3:0/1325354061 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1937710 0x1b6f9a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:43.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.905+0000 7fbee5d13740 1 --2- 172.21.15.3:0/1325354061 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1937ae0 0x1b6f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:43.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.905+0000 7fbee5d13740 1 -- 172.21.15.3:0/1325354061 >> 172.21.15.3:0/1325354061 conn(0x1937eb0 msgr2=0x1b6a810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:43.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.905+0000 7fbee5d13740 1 -- 172.21.15.3:0/1325354061 shutdown_connections 2023-10-08T15:37:43.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.905+0000 7fbee5d13740 1 -- 172.21.15.3:0/1325354061 wait complete. 2023-10-08T15:37:43.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.905+0000 7fbee5d13740 1 -- start start 2023-10-08T15:37:43.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.905+0000 7fbee5d13740 1 Processor -- start 2023-10-08T15:37:43.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.909+0000 7fbee5d13740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1937710 0x1ba5570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:43.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.909+0000 7fbee5d13740 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1937ae0 0x1ba5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:43.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.909+0000 7fbee5d13740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1982790 0x1ba65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:43.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.909+0000 7fbee5d13740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x1aa4d50 con 0x1937710 2023-10-08T15:37:43.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.909+0000 7fbee5d13740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a7d970 con 0x1982790 2023-10-08T15:37:43.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.909+0000 7fbee5d13740 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x1ae5290 con 0x1937ae0 2023-10-08T15:37:43.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.909+0000 7fbee5d13740 10 client.0 _ll_register_callbacks cb 0x1b286a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T15:37:43.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.909+0000 7fbee1806700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1937710 0x1ba5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:43.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.909+0000 7fbee1806700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1937710 0x1ba5570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44326/0 (socket says 172.21.15.3:44326) 2023-10-08T15:37:43.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.909+0000 7fbee1806700 1 -- 172.21.15.3:0/3711597995 learned_addr learned my addr 172.21.15.3:0/3711597995 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:43.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.909+0000 7fbee1005700 1 --2- 172.21.15.3:0/3711597995 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1937ae0 0x1ba5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:43.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.909+0000 7fbee2007700 1 --2- 172.21.15.3:0/3711597995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1982790 0x1ba65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:43.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.909+0000 7fbee1806700 1 -- 172.21.15.3:0/3711597995 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1937ae0 msgr2=0x1ba5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:43.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.909+0000 7fbee1806700 1 --2- 172.21.15.3:0/3711597995 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1937ae0 0x1ba5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:43.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.909+0000 7fbee1806700 1 -- 172.21.15.3:0/3711597995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1982790 msgr2=0x1ba65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:43.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.909+0000 7fbee1806700 1 --2- 172.21.15.3:0/3711597995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1982790 0x1ba65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:43.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.909+0000 7fbee1806700 1 -- 172.21.15.3:0/3711597995 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbedc14f5a0 con 0x1937710 2023-10-08T15:37:43.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.909+0000 7fbee1806700 1 --2- 172.21.15.3:0/3711597995 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1937710 0x1ba5570 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbed8014bd0 tx=0x7fbed8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80825339d644ca7b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:43.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.909+0000 7fbebbfff700 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2023-10-08T15:37:43.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.909+0000 7fbebbfff700 1 -- 172.21.15.3:0/3711597995 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed8013a40 con 0x1937710 2023-10-08T15:37:43.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.909+0000 7fbebbfff700 1 -- 172.21.15.3:0/3711597995 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbed801a030 con 0x1937710 2023-10-08T15:37:43.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.909+0000 7fbee5d13740 1 -- 172.21.15.3:0/3711597995 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1a7dcc0 con 0x1937710 2023-10-08T15:37:43.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.909+0000 7fbebbfff700 1 -- 172.21.15.3:0/3711597995 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbed8013db0 con 0x1937710 2023-10-08T15:37:43.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.909+0000 7fbee5d13740 10 client.4719 fetch_fsmap learned FSMap version 6 2023-10-08T15:37:43.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.909+0000 7fbee5d13740 1 -- 172.21.15.3:0/3711597995 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x1aad370 con 0x1937710 2023-10-08T15:37:43.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.909+0000 7fbebbfff700 1 -- 172.21.15.3:0/3711597995 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1a7dcc0 con 0x1937710 2023-10-08T15:37:43.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.909+0000 7fbebbfff700 1 -- 172.21.15.3:0/3711597995 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 6) v1 ==== 2010+0+0 (secure 0 0 0) 0x7fbed8028020 con 0x1937710 2023-10-08T15:37:43.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.909+0000 7fbee5d13740 10 client.4719 fetch_fsmap finished waiting for FSMap version 6 2023-10-08T15:37:43.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.909+0000 7fbee5d13740 10 client.4719 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-08T15:37:43.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.909+0000 7fbee5d13740 20 client.4719 populate_metadata read hostname 'smithi003' 2023-10-08T15:37:43.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.909+0000 7fbee5d13740 1 --2- 172.21.15.3:0/3711597995 >> [v2:172.21.15.50:6834/1601527591,v1:172.21.15.50:6835/1601527591] conn(0x1bb5b90 0x1bb7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:43.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.909+0000 7fbee5d13740 4 client.4719 mds_command: new command op to 4260 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-08T15:37:43.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.909+0000 7fbee5d13740 1 -- 172.21.15.3:0/3711597995 --> [v2:172.21.15.50:6834/1601527591,v1:172.21.15.50:6835/1601527591] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1a813e0 con 0x1bb5b90 2023-10-08T15:37:43.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.909+0000 7fbee1005700 1 --2- 172.21.15.3:0/3711597995 >> [v2:172.21.15.50:6834/1601527591,v1:172.21.15.50:6835/1601527591] conn(0x1bb5b90 0x1bb7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:43.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.909+0000 7fbebbfff700 10 client.4719 ms_handle_connect on v2:172.21.15.50:6834/1601527591 2023-10-08T15:37:43.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.909+0000 7fbee1005700 1 --2- 172.21.15.3:0/3711597995 >> [v2:172.21.15.50:6834/1601527591,v1:172.21.15.50:6835/1601527591] conn(0x1bb5b90 0x1bb7f70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f546f6afb6c32c9b server_cookie=615fe9d4ba63010d in_seq=0 out_seq=0 2023-10-08T15:37:43.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.913+0000 7fbebbfff700 1 -- 172.21.15.3:0/3711597995 <== mds.0 v2:172.21.15.50:6834/1601527591 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x1a813e0 con 0x1bb5b90 2023-10-08T15:37:43.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.913+0000 7fbebbfff700 10 client.4719 handle_command_reply: tid=0 2023-10-08T15:37:43.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.913+0000 7fbee5d13740 1 client.4719 shutdown 2023-10-08T15:37:43.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.913+0000 7fbee5d13740 1 -- 172.21.15.3:0/3711597995 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1937710 msgr2=0x1ba5570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:43.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.913+0000 7fbee5d13740 1 --2- 172.21.15.3:0/3711597995 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1937710 0x1ba5570 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbed8014bd0 tx=0x7fbed8019000 comp rx=0 tx=0).stop 2023-10-08T15:37:43.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.913+0000 7fbee5d13740 1 -- 172.21.15.3:0/3711597995 shutdown_connections 2023-10-08T15:37:43.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.913+0000 7fbee5d13740 1 --2- 172.21.15.3:0/3711597995 >> [v2:172.21.15.50:6834/1601527591,v1:172.21.15.50:6835/1601527591] conn(0x1bb5b90 0x1bb7f70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:43.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.913+0000 7fbee5d13740 1 --2- 172.21.15.3:0/3711597995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1982790 0x1ba65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:43.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.913+0000 7fbee5d13740 1 --2- 172.21.15.3:0/3711597995 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1937ae0 0x1ba5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:43.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.913+0000 7fbebbfff700 0 client.4719 ms_handle_reset on v2:172.21.15.50:6834/1601527591 2023-10-08T15:37:43.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.913+0000 7fbee5d13740 1 --2- 172.21.15.3:0/3711597995 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1937710 0x1ba5570 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:43.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.913+0000 7fbee5d13740 1 -- 172.21.15.3:0/3711597995 >> 172.21.15.3:0/3711597995 conn(0x1937eb0 msgr2=0x1b69f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:43.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.913+0000 7fbee5d13740 1 -- 172.21.15.3:0/3711597995 shutdown_connections 2023-10-08T15:37:43.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.913+0000 7fbee5d13740 1 -- 172.21.15.3:0/3711597995 wait complete. 2023-10-08T15:37:43.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.913+0000 7fbee5d13740 20 client.4719 trim_cache size 0 max 16384 2023-10-08T15:37:43.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.933+0000 7fbee5d13740 1 Processor -- start 2023-10-08T15:37:43.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.933+0000 7fbee5d13740 1 -- start start 2023-10-08T15:37:43.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.933+0000 7fbee5d13740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1937eb0 0x1bb2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:43.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.933+0000 7fbee5d13740 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1937710 0x1bb3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:43.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.933+0000 7fbee5d13740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1937ae0 0x1bfe550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:43.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.933+0000 7fbee5d13740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b05d00 con 0x1937eb0 2023-10-08T15:37:43.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.933+0000 7fbee5d13740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ba6800 con 0x1937ae0 2023-10-08T15:37:43.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.933+0000 7fbee5d13740 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x1ab3610 con 0x1937710 2023-10-08T15:37:43.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.933+0000 7fbee1806700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1937eb0 0x1bb2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:43.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.933+0000 7fbee1806700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1937eb0 0x1bb2d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44342/0 (socket says 172.21.15.3:44342) 2023-10-08T15:37:43.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.933+0000 7fbee1806700 1 -- 172.21.15.3:0/1296217606 learned_addr learned my addr 172.21.15.3:0/1296217606 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:43.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.933+0000 7fbee1005700 1 --2- 172.21.15.3:0/1296217606 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1937710 0x1bb3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:43.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.933+0000 7fbee2007700 1 --2- 172.21.15.3:0/1296217606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1937ae0 0x1bfe550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:43.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.933+0000 7fbee1005700 1 -- 172.21.15.3:0/1296217606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1937ae0 msgr2=0x1bfe550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:43.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.933+0000 7fbee1005700 1 --2- 172.21.15.3:0/1296217606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1937ae0 0x1bfe550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:43.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.933+0000 7fbee1005700 1 -- 172.21.15.3:0/1296217606 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1937eb0 msgr2=0x1bb2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:43.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.933+0000 7fbee1005700 1 --2- 172.21.15.3:0/1296217606 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1937eb0 0x1bb2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:43.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.933+0000 7fbee1005700 1 -- 172.21.15.3:0/1296217606 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1a93d80 con 0x1937710 2023-10-08T15:37:43.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.933+0000 7fbee1806700 1 --2- 172.21.15.3:0/1296217606 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1937eb0 0x1bb2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:37:43.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.933+0000 7fbee1005700 1 --2- 172.21.15.3:0/1296217606 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1937710 0x1bb3290 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbecc025000 tx=0x7fbecc037250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eaf33b6be1bb345b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:43.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.933+0000 7fbec77fe700 1 -- 172.21.15.3:0/1296217606 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbecc022070 con 0x1937710 2023-10-08T15:37:43.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.933+0000 7fbec77fe700 1 -- 172.21.15.3:0/1296217606 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbecc020040 con 0x1937710 2023-10-08T15:37:43.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.933+0000 7fbec77fe700 1 -- 172.21.15.3:0/1296217606 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbecc00b650 con 0x1937710 2023-10-08T15:37:43.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.937+0000 7fbee5d13740 1 -- 172.21.15.3:0/1296217606 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1937710 msgr2=0x1bb3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:43.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.937+0000 7fbee5d13740 1 --2- 172.21.15.3:0/1296217606 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1937710 0x1bb3290 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbecc025000 tx=0x7fbecc037250 comp rx=0 tx=0).stop 2023-10-08T15:37:43.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.937+0000 7fbee5d13740 1 -- 172.21.15.3:0/1296217606 shutdown_connections 2023-10-08T15:37:43.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.937+0000 7fbee5d13740 1 --2- 172.21.15.3:0/1296217606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1937ae0 0x1bfe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:43.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.937+0000 7fbee5d13740 1 --2- 172.21.15.3:0/1296217606 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1937710 0x1bb3290 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:43.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.937+0000 7fbee5d13740 1 --2- 172.21.15.3:0/1296217606 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1937eb0 0x1bb2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:43.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.937+0000 7fbee5d13740 1 -- 172.21.15.3:0/1296217606 >> 172.21.15.3:0/1296217606 conn(0x1b6c880 msgr2=0x1bb2640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:43.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.937+0000 7fbee5d13740 1 -- 172.21.15.3:0/1296217606 shutdown_connections 2023-10-08T15:37:43.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.937+0000 7fbee5d13740 1 -- 172.21.15.3:0/1296217606 wait complete. 2023-10-08T15:37:43.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.937+0000 7fbee5d13740 1 -- start start 2023-10-08T15:37:43.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.937+0000 7fbee5d13740 1 Processor -- start 2023-10-08T15:37:43.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.937+0000 7fbee5d13740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1937710 0x1c02320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:43.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.937+0000 7fbee5d13740 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1937ae0 0x1c02860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:43.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.937+0000 7fbee5d13740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1937eb0 0x1bc9100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:43.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.937+0000 7fbee5d13740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x19b4650 con 0x1937710 2023-10-08T15:37:43.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.937+0000 7fbee5d13740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x1adc890 con 0x1937eb0 2023-10-08T15:37:43.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.937+0000 7fbee5d13740 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x19b07c0 con 0x1937ae0 2023-10-08T15:37:43.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.941+0000 7fbee1806700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1937710 0x1c02320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:43.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.941+0000 7fbee5d13740 10 client.0 _ll_register_callbacks cb 0x1a06d00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T15:37:43.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.941+0000 7fbee1806700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1937710 0x1c02320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44348/0 (socket says 172.21.15.3:44348) 2023-10-08T15:37:43.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.941+0000 7fbee1806700 1 -- 172.21.15.3:0/2803097513 learned_addr learned my addr 172.21.15.3:0/2803097513 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:43.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.941+0000 7fbee2007700 1 --2- 172.21.15.3:0/2803097513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1937eb0 0x1bc9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:43.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.941+0000 7fbee1005700 1 --2- 172.21.15.3:0/2803097513 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1937ae0 0x1c02860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:43.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.941+0000 7fbee1806700 1 -- 172.21.15.3:0/2803097513 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1937ae0 msgr2=0x1c02860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:43.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.941+0000 7fbee1806700 1 --2- 172.21.15.3:0/2803097513 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1937ae0 0x1c02860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:43.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.941+0000 7fbee1806700 1 -- 172.21.15.3:0/2803097513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1937eb0 msgr2=0x1bc9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:43.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.941+0000 7fbee1806700 1 --2- 172.21.15.3:0/2803097513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1937eb0 0x1bc9100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:43.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.941+0000 7fbee1806700 1 -- 172.21.15.3:0/2803097513 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1aad370 con 0x1937710 2023-10-08T15:37:43.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.941+0000 7fbee1806700 1 --2- 172.21.15.3:0/2803097513 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1937710 0x1c02320 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbed8000c00 tx=0x7fbed8025000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=745437abb8d6db4a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:43.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.941+0000 7fbebbfff700 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2023-10-08T15:37:43.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.941+0000 7fbebbfff700 1 -- 172.21.15.3:0/2803097513 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed803b070 con 0x1937710 2023-10-08T15:37:43.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.941+0000 7fbebbfff700 1 -- 172.21.15.3:0/2803097513 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbed801a040 con 0x1937710 2023-10-08T15:37:43.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.941+0000 7fbee5d13740 1 -- 172.21.15.3:0/2803097513 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbecc000bc0 con 0x1937710 2023-10-08T15:37:43.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.941+0000 7fbebbfff700 1 -- 172.21.15.3:0/2803097513 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbed8013680 con 0x1937710 2023-10-08T15:37:43.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.941+0000 7fbee5d13740 10 client.4725 fetch_fsmap learned FSMap version 6 2023-10-08T15:37:43.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.941+0000 7fbee5d13740 1 -- 172.21.15.3:0/2803097513 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x19839e0 con 0x1937710 2023-10-08T15:37:43.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.941+0000 7fbebbfff700 1 -- 172.21.15.3:0/2803097513 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbecc000bc0 con 0x1937710 2023-10-08T15:37:43.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.941+0000 7fbebbfff700 1 -- 172.21.15.3:0/2803097513 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 6) v1 ==== 2010+0+0 (secure 0 0 0) 0x7fbed8014c00 con 0x1937710 2023-10-08T15:37:43.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.941+0000 7fbee5d13740 10 client.4725 fetch_fsmap finished waiting for FSMap version 6 2023-10-08T15:37:43.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.941+0000 7fbee5d13740 10 client.4725 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-08T15:37:43.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.941+0000 7fbee5d13740 20 client.4725 populate_metadata read hostname 'smithi003' 2023-10-08T15:37:43.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.941+0000 7fbee5d13740 1 --2- 172.21.15.3:0/2803097513 >> [v2:172.21.15.50:6834/1601527591,v1:172.21.15.50:6835/1601527591] conn(0x1982790 0x1bca520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:43.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.941+0000 7fbee5d13740 4 client.4725 mds_command: new command op to 4260 tid=0[{"prefix": "status"}] 2023-10-08T15:37:43.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.941+0000 7fbee5d13740 1 -- 172.21.15.3:0/2803097513 --> [v2:172.21.15.50:6834/1601527591,v1:172.21.15.50:6835/1601527591] -- command(tid 0: {"prefix": "status"}) v1 -- 0x1ab3410 con 0x1982790 2023-10-08T15:37:43.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.941+0000 7fbee1005700 1 --2- 172.21.15.3:0/2803097513 >> [v2:172.21.15.50:6834/1601527591,v1:172.21.15.50:6835/1601527591] conn(0x1982790 0x1bca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:43.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.941+0000 7fbebbfff700 10 client.4725 ms_handle_connect on v2:172.21.15.50:6834/1601527591 2023-10-08T15:37:43.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.941+0000 7fbee1005700 1 --2- 172.21.15.3:0/2803097513 >> [v2:172.21.15.50:6834/1601527591,v1:172.21.15.50:6835/1601527591] conn(0x1982790 0x1bca520 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0bfe1a1c7f0e7ea server_cookie=8dae553aaa03ef48 in_seq=0 out_seq=0 2023-10-08T15:37:43.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.945+0000 7fbebbfff700 1 -- 172.21.15.3:0/2803097513 <== mds.0 v2:172.21.15.50:6834/1601527591 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x1ab3410 con 0x1982790 2023-10-08T15:37:43.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.945+0000 7fbebbfff700 10 client.4725 handle_command_reply: tid=0 2023-10-08T15:37:43.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.945+0000 7fbee5d13740 1 client.4725 shutdown 2023-10-08T15:37:43.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.945+0000 7fbee5d13740 1 -- 172.21.15.3:0/2803097513 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1937710 msgr2=0x1c02320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:43.970 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.945+0000 7fbee5d13740 1 --2- 172.21.15.3:0/2803097513 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1937710 0x1c02320 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbed8000c00 tx=0x7fbed8025000 comp rx=0 tx=0).stop 2023-10-08T15:37:43.970 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.945+0000 7fbee5d13740 1 -- 172.21.15.3:0/2803097513 shutdown_connections 2023-10-08T15:37:43.970 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.945+0000 7fbee5d13740 1 --2- 172.21.15.3:0/2803097513 >> [v2:172.21.15.50:6834/1601527591,v1:172.21.15.50:6835/1601527591] conn(0x1982790 0x1bca520 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:43.970 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.945+0000 7fbee5d13740 1 --2- 172.21.15.3:0/2803097513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1937eb0 0x1bc9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:43.970 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.945+0000 7fbee5d13740 1 --2- 172.21.15.3:0/2803097513 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1937ae0 0x1c02860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:43.970 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.945+0000 7fbee5d13740 1 --2- 172.21.15.3:0/2803097513 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1937710 0x1c02320 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:43.970 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.945+0000 7fbebbfff700 0 client.4725 ms_handle_reset on v2:172.21.15.50:6834/1601527591 2023-10-08T15:37:43.970 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.945+0000 7fbee5d13740 1 -- 172.21.15.3:0/2803097513 >> 172.21.15.3:0/2803097513 conn(0x1b6c880 msgr2=0x1b6f060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:43.971 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.945+0000 7fbee5d13740 1 -- 172.21.15.3:0/2803097513 shutdown_connections 2023-10-08T15:37:43.971 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.945+0000 7fbee5d13740 1 -- 172.21.15.3:0/2803097513 wait complete. 2023-10-08T15:37:43.971 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.945+0000 7fbee5d13740 20 client.4725 trim_cache size 0 max 16384 2023-10-08T15:37:43.971 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2023-10-08T15:37:43.971 INFO:teuthology.orchestra.run.smithi003.stdout: "cluster_fsid": "7635972e-cd66-4a8f-a231-378db8b3847a", 2023-10-08T15:37:43.971 INFO:teuthology.orchestra.run.smithi003.stdout: "whoami": 0, 2023-10-08T15:37:43.971 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 4260, 2023-10-08T15:37:43.972 INFO:teuthology.orchestra.run.smithi003.stdout: "want_state": "up:active", 2023-10-08T15:37:43.972 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "up:active", 2023-10-08T15:37:43.972 INFO:teuthology.orchestra.run.smithi003.stdout: "fs_name": "cephfs", 2023-10-08T15:37:43.972 INFO:teuthology.orchestra.run.smithi003.stdout: "rank_uptime": 17.939951827000002, 2023-10-08T15:37:43.972 INFO:teuthology.orchestra.run.smithi003.stdout: "mdsmap_epoch": 6, 2023-10-08T15:37:43.972 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch": 20, 2023-10-08T15:37:43.972 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch_barrier": 20, 2023-10-08T15:37:43.972 INFO:teuthology.orchestra.run.smithi003.stdout: "uptime": 25.213558668000001 2023-10-08T15:37:43.972 INFO:teuthology.orchestra.run.smithi003.stdout:} 2023-10-08T15:37:43.974 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.945+0000 7fbee2808700 1 -- 172.21.15.3:0/4169151418 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbec0060580 msgr2=0x7fbec0062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:43.974 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.945+0000 7fbee2808700 1 --2- 172.21.15.3:0/4169151418 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbec0060580 0x7fbec0062a30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbed8009db0 tx=0x7fbed80091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:43.974 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.945+0000 7fbee2808700 1 -- 172.21.15.3:0/4169151418 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbedc0bd4f0 msgr2=0x7fbedc0bb6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:43.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.945+0000 7fbee2808700 1 --2- 172.21.15.3:0/4169151418 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbedc0bd4f0 0x7fbedc0bb6e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbed400c830 tx=0x7fbed4001690 comp rx=0 tx=0).stop 2023-10-08T15:37:43.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.945+0000 7fbee2808700 1 -- 172.21.15.3:0/4169151418 shutdown_connections 2023-10-08T15:37:43.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.945+0000 7fbee2808700 1 --2- 172.21.15.3:0/4169151418 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbec0060580 0x7fbec0062a30 secure :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbed8009db0 tx=0x7fbed80091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:43.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.945+0000 7fbee2808700 1 --2- 172.21.15.3:0/4169151418 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbedc0bd4f0 0x7fbedc0bb6e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:43.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.945+0000 7fbee2808700 1 --2- 172.21.15.3:0/4169151418 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbedc069640 0x7fbedc0bb1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:43.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.945+0000 7fbee2808700 1 --2- 172.21.15.3:0/4169151418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbedc0670e0 0x7fbedc144f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:43.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.945+0000 7fbee2808700 1 -- 172.21.15.3:0/4169151418 >> 172.21.15.3:0/4169151418 conn(0x7fbedc06a760 msgr2=0x7fbedc149800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:43.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.945+0000 7fbee2808700 1 -- 172.21.15.3:0/4169151418 shutdown_connections 2023-10-08T15:37:43.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:43.945+0000 7fbee2808700 1 -- 172.21.15.3:0/4169151418 wait complete. 2023-10-08T15:37:43.976 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-10-08T15:37:43.999 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-10-08T15:37:44.000 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}, 'client.2': {}} 2023-10-08T15:37:44.000 INFO:tasks.ceph_fuse:client.0 config is {} 2023-10-08T15:37:44.000 INFO:tasks.ceph_fuse:client.1 config is {} 2023-10-08T15:37:44.000 INFO:tasks.ceph_fuse:client.2 config is {} 2023-10-08T15:37:44.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:37:44.000 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list 2023-10-08T15:37:44.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:37:44.009 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link delete ceph-brx 2023-10-08T15:37:44.029 INFO:teuthology.orchestra.run.smithi098.stderr:Cannot find device "ceph-brx" 2023-10-08T15:37:44.030 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T15:37:44.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:37:44.030 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2023-10-08T15:37:44.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:37:44.039 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link delete ceph-brx 2023-10-08T15:37:44.101 INFO:teuthology.orchestra.run.smithi089.stderr:Cannot find device "ceph-brx" 2023-10-08T15:37:44.102 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T15:37:44.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:37:44.123 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2023-10-08T15:37:44.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:37:44.131 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link delete ceph-brx 2023-10-08T15:37:44.146 INFO:teuthology.orchestra.run.smithi153.stderr:Cannot find device "ceph-brx" 2023-10-08T15:37:44.147 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T15:37:44.148 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-10-08T15:37:44.148 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T15:37:44.267 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.261+0000 7f0f096e1700 1 Processor -- start 2023-10-08T15:37:44.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.261+0000 7f0f096e1700 1 -- start start 2023-10-08T15:37:44.283 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.261+0000 7f0f096e1700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0f040bbf00 0x7f0f0414ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:44.283 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.261+0000 7f0f096e1700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f0f040be600 0x7f0f0414abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:44.283 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.261+0000 7f0f096e1700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f0414fbd0 con 0x7f0f040bcdd0 2023-10-08T15:37:44.283 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.261+0000 7f0f096e1700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f040b29d0 con 0x7f0f040be600 2023-10-08T15:37:44.283 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.261+0000 7f0f096e1700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f040b1ee0 con 0x7f0f040bbf00 2023-10-08T15:37:44.283 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.261+0000 7f0f08ee0700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f0f040be600 0x7f0f0414abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:44.283 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.261+0000 7f0f08ee0700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f0f040be600 0x7f0f0414abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44364/0 (socket says 172.21.15.3:44364) 2023-10-08T15:37:44.283 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.261+0000 7f0f08ee0700 1 -- 172.21.15.3:0/1551566307 learned_addr learned my addr 172.21.15.3:0/1551566307 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:44.283 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.261+0000 7f0f03fff700 1 --2- 172.21.15.3:0/1551566307 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0f040bbf00 0x7f0f0414ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:44.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.261+0000 7f0f08ee0700 1 -- 172.21.15.3:0/1551566307 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0f040bbf00 msgr2=0x7f0f0414ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:44.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.261+0000 7f0f08ee0700 1 --2- 172.21.15.3:0/1551566307 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0f040bbf00 0x7f0f0414ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:44.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.261+0000 7f0f08ee0700 1 -- 172.21.15.3:0/1551566307 >> v1:172.21.15.50:6789/0 conn(0x7f0f040bcdd0 legacy=0x7f0f0414f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:44.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.261+0000 7f0f037fe700 1 -- 172.21.15.3:0/1551566307 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1468246514 0 0) 0x7f0f0414fbd0 con 0x7f0f040bcdd0 2023-10-08T15:37:44.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.261+0000 7f0f08ee0700 1 -- 172.21.15.3:0/1551566307 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f040b21c0 con 0x7f0f040be600 2023-10-08T15:37:44.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.265+0000 7f0f08ee0700 1 --2- 172.21.15.3:0/1551566307 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f040be600 0x7f0f0414abd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0efc009f20 tx=0x7f0efc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb4da0a93daaaf59 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:44.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.265+0000 7f0f037fe700 1 -- 172.21.15.3:0/1551566307 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc00e070 con 0x7f0f040be600 2023-10-08T15:37:44.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.265+0000 7f0f037fe700 1 -- 172.21.15.3:0/1551566307 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0efc00b9d0 con 0x7f0f040be600 2023-10-08T15:37:44.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.265+0000 7f0f037fe700 1 -- 172.21.15.3:0/1551566307 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc0092e0 con 0x7f0f040be600 2023-10-08T15:37:44.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.265+0000 7f0f096e1700 1 -- 172.21.15.3:0/1551566307 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f040be600 msgr2=0x7f0f0414abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:44.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.265+0000 7f0f096e1700 1 --2- 172.21.15.3:0/1551566307 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f040be600 0x7f0f0414abd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0efc009f20 tx=0x7f0efc009840 comp rx=0 tx=0).stop 2023-10-08T15:37:44.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.265+0000 7f0f096e1700 1 -- 172.21.15.3:0/1551566307 shutdown_connections 2023-10-08T15:37:44.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.265+0000 7f0f096e1700 1 --2- 172.21.15.3:0/1551566307 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f040be600 0x7f0f0414abd0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:44.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.265+0000 7f0f096e1700 1 --2- 172.21.15.3:0/1551566307 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0f040bbf00 0x7f0f0414ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:44.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.265+0000 7f0f096e1700 1 -- 172.21.15.3:0/1551566307 >> 172.21.15.3:0/1551566307 conn(0x7f0f040bf5e0 msgr2=0x7f0f040bb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:44.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.265+0000 7f0f096e1700 1 -- 172.21.15.3:0/1551566307 shutdown_connections 2023-10-08T15:37:44.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.265+0000 7f0f096e1700 1 -- 172.21.15.3:0/1551566307 wait complete. 2023-10-08T15:37:44.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.265+0000 7f0f096e1700 1 Processor -- start 2023-10-08T15:37:44.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.265+0000 7f0f096e1700 1 -- start start 2023-10-08T15:37:44.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.265+0000 7f0f096e1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f040bbf00 0x7f0f0414ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:44.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.265+0000 7f0f096e1700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0f040bcdd0 0x7f0f04146a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:44.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.265+0000 7f0f096e1700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f040be600 0x7f0f0415e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:44.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.265+0000 7f0f096e1700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f04150510 con 0x7f0f040be600 2023-10-08T15:37:44.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.265+0000 7f0f096e1700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0415f0e0 con 0x7f0f040bbf00 2023-10-08T15:37:44.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.265+0000 7f0f096e1700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f04146fd0 con 0x7f0f040bcdd0 2023-10-08T15:37:44.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.265+0000 7f0f08ee0700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f040be600 0x7f0f0415e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:44.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.265+0000 7f0f08ee0700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f040be600 0x7f0f0415e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44374/0 (socket says 172.21.15.3:44374) 2023-10-08T15:37:44.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.265+0000 7f0f08ee0700 1 -- 172.21.15.3:0/4137453207 learned_addr learned my addr 172.21.15.3:0/4137453207 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:44.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.265+0000 7f0f03fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f040bbf00 0x7f0f0414ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:44.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.265+0000 7f0efbfff700 1 --2- 172.21.15.3:0/4137453207 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0f040bcdd0 0x7f0f04146a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:44.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.265+0000 7f0f08ee0700 1 -- 172.21.15.3:0/4137453207 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0f040bcdd0 msgr2=0x7f0f04146a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:44.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.265+0000 7f0f08ee0700 1 --2- 172.21.15.3:0/4137453207 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0f040bcdd0 0x7f0f04146a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:44.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.265+0000 7f0f08ee0700 1 -- 172.21.15.3:0/4137453207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f040bbf00 msgr2=0x7f0f0414ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:44.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.265+0000 7f0f08ee0700 1 --2- 172.21.15.3:0/4137453207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f040bbf00 0x7f0f0414ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:44.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.265+0000 7f0f08ee0700 1 -- 172.21.15.3:0/4137453207 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0efc009ae0 con 0x7f0f040be600 2023-10-08T15:37:44.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.269+0000 7f0f08ee0700 1 --2- 172.21.15.3:0/4137453207 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f040be600 0x7f0f0415e520 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0f040706b0 tx=0x7f0efc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:44.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.269+0000 7f0f00ff9700 1 -- 172.21.15.3:0/4137453207 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc007b00 con 0x7f0f040be600 2023-10-08T15:37:44.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.269+0000 7f0f00ff9700 1 -- 172.21.15.3:0/4137453207 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0efc007c80 con 0x7f0f040be600 2023-10-08T15:37:44.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.269+0000 7f0f096e1700 1 -- 172.21.15.3:0/4137453207 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f0415edb0 con 0x7f0f040be600 2023-10-08T15:37:44.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.269+0000 7f0f00ff9700 1 -- 172.21.15.3:0/4137453207 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc01d420 con 0x7f0f040be600 2023-10-08T15:37:44.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.269+0000 7f0f096e1700 1 -- 172.21.15.3:0/4137453207 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f0415ea60 con 0x7f0f040be600 2023-10-08T15:37:44.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.269+0000 7f0f096e1700 1 -- 172.21.15.3:0/4137453207 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f0405ecf0 con 0x7f0f040be600 2023-10-08T15:37:44.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.269+0000 7f0f00ff9700 1 -- 172.21.15.3:0/4137453207 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f0efc003040 con 0x7f0f040be600 2023-10-08T15:37:44.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.273+0000 7f0f00ff9700 1 --2- 172.21.15.3:0/4137453207 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f0ee4060550 0x7f0ee4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:44.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.273+0000 7f0f00ff9700 1 -- 172.21.15.3:0/4137453207 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0efc07e4e0 con 0x7f0f040be600 2023-10-08T15:37:44.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.273+0000 7f0f03fff700 1 --2- 172.21.15.3:0/4137453207 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f0ee4060550 0x7f0ee4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:44.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.273+0000 7f0f03fff700 1 --2- 172.21.15.3:0/4137453207 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f0ee4060550 0x7f0ee4062a00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4009da0 tx=0x7f0ef4009120 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:44.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.277+0000 7f0f00ff9700 1 -- 172.21.15.3:0/4137453207 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0efc04ead0 con 0x7f0f040be600 2023-10-08T15:37:44.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.477+0000 7f0f096e1700 1 -- 172.21.15.3:0/4137453207 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0f040639f0 con 0x7f0f040be600 2023-10-08T15:37:44.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.481+0000 7f0f00ff9700 1 -- 172.21.15.3:0/4137453207 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0efc0520f0 con 0x7f0f040be600 2023-10-08T15:37:44.504 INFO:teuthology.orchestra.run.smithi003.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T15:37:44.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.481+0000 7f0f096e1700 1 -- 172.21.15.3:0/4137453207 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f0ee4060550 msgr2=0x7f0ee4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:44.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.481+0000 7f0f096e1700 1 --2- 172.21.15.3:0/4137453207 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f0ee4060550 0x7f0ee4062a00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4009da0 tx=0x7f0ef4009120 comp rx=0 tx=0).stop 2023-10-08T15:37:44.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.481+0000 7f0f096e1700 1 -- 172.21.15.3:0/4137453207 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f040be600 msgr2=0x7f0f0415e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:44.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.481+0000 7f0f096e1700 1 --2- 172.21.15.3:0/4137453207 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f040be600 0x7f0f0415e520 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0f040706b0 tx=0x7f0efc018000 comp rx=0 tx=0).stop 2023-10-08T15:37:44.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.481+0000 7f0f096e1700 1 -- 172.21.15.3:0/4137453207 shutdown_connections 2023-10-08T15:37:44.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.481+0000 7f0f096e1700 1 --2- 172.21.15.3:0/4137453207 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f0ee4060550 0x7f0ee4062a00 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:44.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.481+0000 7f0f096e1700 1 --2- 172.21.15.3:0/4137453207 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f040be600 0x7f0f0415e520 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:44.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.481+0000 7f0f096e1700 1 --2- 172.21.15.3:0/4137453207 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0f040bcdd0 0x7f0f04146a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:44.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.481+0000 7f0f096e1700 1 --2- 172.21.15.3:0/4137453207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f040bbf00 0x7f0f0414ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:44.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.481+0000 7f0f096e1700 1 -- 172.21.15.3:0/4137453207 >> 172.21.15.3:0/4137453207 conn(0x7f0f040bf5e0 msgr2=0x7f0f040bb5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:44.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.481+0000 7f0f096e1700 1 -- 172.21.15.3:0/4137453207 shutdown_connections 2023-10-08T15:37:44.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:44.481+0000 7f0f096e1700 1 -- 172.21.15.3:0/4137453207 wait complete. 2023-10-08T15:37:44.507 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-08T15:37:44.507 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T15:37:44.507 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi089.front.sepia.ceph.com 2023-10-08T15:37:44.507 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-08T15:37:44.508 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T15:37:44.508 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-08T15:37:44.508 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-08T15:37:44.508 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T15:37:44.508 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T15:37:44.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:37:44.509 DEBUG:teuthology.orchestra.run.smithi089:> ip addr 2023-10-08T15:37:44.516 INFO:teuthology.orchestra.run.smithi089.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T15:37:44.524 INFO:teuthology.orchestra.run.smithi089.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T15:37:44.525 INFO:teuthology.orchestra.run.smithi089.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T15:37:44.525 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:37:44.525 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 ::1/128 scope host 2023-10-08T15:37:44.525 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:37:44.525 INFO:teuthology.orchestra.run.smithi089.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T15:37:44.525 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c6 brd ff:ff:ff:ff:ff:ff 2023-10-08T15:37:44.525 INFO:teuthology.orchestra.run.smithi089.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T15:37:44.525 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c7 brd ff:ff:ff:ff:ff:ff 2023-10-08T15:37:44.525 INFO:teuthology.orchestra.run.smithi089.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T15:37:44.526 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:00 brd ff:ff:ff:ff:ff:ff 2023-10-08T15:37:44.526 INFO:teuthology.orchestra.run.smithi089.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T15:37:44.526 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:01 brd ff:ff:ff:ff:ff:ff 2023-10-08T15:37:44.526 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.21.15.89/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-08T15:37:44.526 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft 42532sec preferred_lft 42532sec 2023-10-08T15:37:44.526 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::ec4:7aff:fe8f:d501/64 scope link 2023-10-08T15:37:44.526 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:37:44.526 INFO:teuthology.orchestra.run.smithi089.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-08T15:37:44.526 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 02:42:0d:de:29:b2 brd ff:ff:ff:ff:ff:ff 2023-10-08T15:37:44.527 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-08T15:37:44.527 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:37:44.527 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-08T15:37:44.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:37:44.527 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-10-08T15:37:44.528 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-10-08T15:37:44.528 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link add name ceph-brx type bridge 2023-10-08T15:37:44.528 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip addr flush dev ceph-brx 2023-10-08T15:37:44.528 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set ceph-brx up 2023-10-08T15:37:44.528 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-08T15:37:44.528 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-10-08T15:37:44.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:37:44.575 DEBUG:teuthology.orchestra.run.smithi089:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T15:37:44.631 INFO:teuthology.orchestra.run.smithi089.stdout:1 2023-10-08T15:37:44.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:37:44.634 DEBUG:teuthology.orchestra.run.smithi089:> route 2023-10-08T15:37:44.659 INFO:teuthology.orchestra.run.smithi089.stdout:Kernel IP routing table 2023-10-08T15:37:44.660 INFO:teuthology.orchestra.run.smithi089.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T15:37:44.660 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-08T15:37:44.660 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-08T15:37:44.660 INFO:teuthology.orchestra.run.smithi089.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-08T15:37:44.660 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-10-08T15:37:44.660 INFO:teuthology.orchestra.run.smithi089.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-08T15:37:44.660 INFO:teuthology.orchestra.run.smithi089.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T15:37:44.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:37:44.661 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-10-08T15:37:44.661 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-10-08T15:37:44.661 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-08T15:37:44.661 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-08T15:37:44.661 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-08T15:37:44.661 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-10-08T15:37:44.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:37:44.703 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2023-10-08T15:37:44.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:37:44.711 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list-id 2023-10-08T15:37:44.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:37:44.759 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-10-08T15:37:44.760 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-10-08T15:37:44.760 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T15:37:44.760 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-08T15:37:44.760 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-10-08T15:37:44.793 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-08T15:37:44.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:37:44.794 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-10-08T15:37:44.794 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-10-08T15:37:44.794 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-08T15:37:44.794 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-08T15:37:44.794 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-08T15:37:44.794 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-08T15:37:44.795 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-08T15:37:44.795 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-10-08T15:37:44.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:37:44.895 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-10-08T15:37:44.895 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-10-08T15:37:44.895 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set brx.0 up 2023-10-08T15:37:44.895 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set dev brx.0 master ceph-brx 2023-10-08T15:37:44.895 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-10-08T15:37:44.925 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-08T15:37:44.947 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T15:37:44.948 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-08T15:37:44.975 INFO:teuthology.orchestra.run.smithi089.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-08T15:37:44.976 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T15:37:44.976 DEBUG:teuthology.orchestra.run.smithi089:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-08T15:37:44.981 DEBUG:teuthology.orchestra.run.smithi089:> sudo modprobe fuse 2023-10-08T15:37:44.994 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-08T15:37:45.019 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-08T15:37:45.052 INFO:teuthology.orchestra.run.smithi089.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-08T15:37:45.053 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-08T15:37:45.053 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:37:45.053 DEBUG:teuthology.orchestra.run.smithi089:> ls /sys/fs/fuse/connections 2023-10-08T15:37:45.060 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-08T15:37:45.060 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-08T15:37:45.063 DEBUG:teuthology.orchestra.run.smithi089:> sudo modprobe fuse 2023-10-08T15:37:45.080 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-08T15:37:45.080 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-08T15:37:45.091 INFO:teuthology.orchestra.run.smithi089.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-08T15:37:45.091 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-08T15:37:45.092 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:37:45.092 DEBUG:teuthology.orchestra.run.smithi089:> ls /sys/fs/fuse/connections 2023-10-08T15:37:45.161 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi089.stderr:2023-10-08T15:37:45.158+0000 7f1afda28380 -1 init, newargv = 0x55f0a2c45d40 newargc=15 2023-10-08T15:37:45.161 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi089.stderr:ceph-fuse[28627]: starting ceph client 2023-10-08T15:37:45.172 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi089.stderr:ceph-fuse[28627]: starting fuse 2023-10-08T15:37:46.241 DEBUG:teuthology.orchestra.run.smithi089:> sudo modprobe fuse 2023-10-08T15:37:46.259 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-08T15:37:46.259 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-08T15:37:46.270 INFO:teuthology.orchestra.run.smithi089.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-08T15:37:46.271 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-08T15:37:46.272 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:37:46.272 DEBUG:teuthology.orchestra.run.smithi089:> ls /sys/fs/fuse/connections 2023-10-08T15:37:46.319 INFO:teuthology.orchestra.run.smithi089.stdout:52 2023-10-08T15:37:46.319 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-10-08T15:37:46.319 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-08T15:37:46.319 DEBUG:teuthology.orchestra.run.smithi089:> import glob 2023-10-08T15:37:46.319 DEBUG:teuthology.orchestra.run.smithi089:> import re 2023-10-08T15:37:46.319 DEBUG:teuthology.orchestra.run.smithi089:> import os 2023-10-08T15:37:46.320 DEBUG:teuthology.orchestra.run.smithi089:> import subprocess 2023-10-08T15:37:46.320 DEBUG:teuthology.orchestra.run.smithi089:> 2023-10-08T15:37:46.320 DEBUG:teuthology.orchestra.run.smithi089:> def _find_admin_socket(client_name): 2023-10-08T15:37:46.320 DEBUG:teuthology.orchestra.run.smithi089:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-08T15:37:46.320 DEBUG:teuthology.orchestra.run.smithi089:> files = glob.glob(asok_path) 2023-10-08T15:37:46.320 DEBUG:teuthology.orchestra.run.smithi089:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-08T15:37:46.320 DEBUG:teuthology.orchestra.run.smithi089:> 2023-10-08T15:37:46.320 DEBUG:teuthology.orchestra.run.smithi089:> # Given a non-glob path, it better be there 2023-10-08T15:37:46.320 DEBUG:teuthology.orchestra.run.smithi089:> if "*" not in asok_path: 2023-10-08T15:37:46.320 DEBUG:teuthology.orchestra.run.smithi089:> assert(len(files) == 1) 2023-10-08T15:37:46.320 DEBUG:teuthology.orchestra.run.smithi089:> return files[0] 2023-10-08T15:37:46.320 DEBUG:teuthology.orchestra.run.smithi089:> 2023-10-08T15:37:46.320 DEBUG:teuthology.orchestra.run.smithi089:> for f in files: 2023-10-08T15:37:46.321 DEBUG:teuthology.orchestra.run.smithi089:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-08T15:37:46.321 DEBUG:teuthology.orchestra.run.smithi089:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-08T15:37:46.321 DEBUG:teuthology.orchestra.run.smithi089:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-08T15:37:46.321 DEBUG:teuthology.orchestra.run.smithi089:> contents = proc_f.read() 2023-10-08T15:37:46.321 DEBUG:teuthology.orchestra.run.smithi089:> if mountpoint in contents: 2023-10-08T15:37:46.321 DEBUG:teuthology.orchestra.run.smithi089:> return f 2023-10-08T15:37:46.321 DEBUG:teuthology.orchestra.run.smithi089:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-08T15:37:46.321 DEBUG:teuthology.orchestra.run.smithi089:> 2023-10-08T15:37:46.321 DEBUG:teuthology.orchestra.run.smithi089:> print(_find_admin_socket("client.0")) 2023-10-08T15:37:46.321 DEBUG:teuthology.orchestra.run.smithi089:> ' 2023-10-08T15:37:46.405 INFO:teuthology.orchestra.run.smithi089.stdout:/var/run/ceph/ceph-client.0.28627.asok 2023-10-08T15:37:46.591 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.28627.asok 2023-10-08T15:37:46.592 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:37:46.592 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.28627.asok status 2023-10-08T15:37:46.686 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2023-10-08T15:37:46.686 INFO:teuthology.orchestra.run.smithi089.stdout: "metadata": { 2023-10-08T15:37:46.686 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph_sha1": "08cac0187919fc3a247efdf445f652e2fb30a647", 2023-10-08T15:37:46.686 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph_version": "ceph version 17.2.6-1320-g08cac018 (08cac0187919fc3a247efdf445f652e2fb30a647) quincy (stable)", 2023-10-08T15:37:46.686 INFO:teuthology.orchestra.run.smithi089.stdout: "entity_id": "0", 2023-10-08T15:37:46.686 INFO:teuthology.orchestra.run.smithi089.stdout: "hostname": "smithi089", 2023-10-08T15:37:46.687 INFO:teuthology.orchestra.run.smithi089.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-08T15:37:46.687 INFO:teuthology.orchestra.run.smithi089.stdout: "pid": "28627", 2023-10-08T15:37:46.687 INFO:teuthology.orchestra.run.smithi089.stdout: "root": "/" 2023-10-08T15:37:46.687 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-10-08T15:37:46.687 INFO:teuthology.orchestra.run.smithi089.stdout: "dentry_count": 0, 2023-10-08T15:37:46.687 INFO:teuthology.orchestra.run.smithi089.stdout: "dentry_pinned_count": 0, 2023-10-08T15:37:46.687 INFO:teuthology.orchestra.run.smithi089.stdout: "id": 4553, 2023-10-08T15:37:46.687 INFO:teuthology.orchestra.run.smithi089.stdout: "inst": { 2023-10-08T15:37:46.687 INFO:teuthology.orchestra.run.smithi089.stdout: "name": { 2023-10-08T15:37:46.687 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "client", 2023-10-08T15:37:46.687 INFO:teuthology.orchestra.run.smithi089.stdout: "num": 4553 2023-10-08T15:37:46.688 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-10-08T15:37:46.688 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": { 2023-10-08T15:37:46.688 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2023-10-08T15:37:46.688 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:0", 2023-10-08T15:37:46.688 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 3581469927 2023-10-08T15:37:46.688 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-10-08T15:37:46.688 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-10-08T15:37:46.688 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": { 2023-10-08T15:37:46.688 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2023-10-08T15:37:46.688 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:0", 2023-10-08T15:37:46.688 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 3581469927 2023-10-08T15:37:46.688 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-10-08T15:37:46.689 INFO:teuthology.orchestra.run.smithi089.stdout: "inst_str": "client.4553 172.21.15.89:0/3581469927", 2023-10-08T15:37:46.689 INFO:teuthology.orchestra.run.smithi089.stdout: "addr_str": "172.21.15.89:0/3581469927", 2023-10-08T15:37:46.689 INFO:teuthology.orchestra.run.smithi089.stdout: "inode_count": 1, 2023-10-08T15:37:46.689 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_epoch": 6, 2023-10-08T15:37:46.689 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_epoch": 20, 2023-10-08T15:37:46.689 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_epoch_barrier": 0, 2023-10-08T15:37:46.689 INFO:teuthology.orchestra.run.smithi089.stdout: "blocklisted": false, 2023-10-08T15:37:46.689 INFO:teuthology.orchestra.run.smithi089.stdout: "fs_name": "cephfs" 2023-10-08T15:37:46.689 INFO:teuthology.orchestra.run.smithi089.stdout:} 2023-10-08T15:37:46.695 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T15:37:46.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:46.809+0000 7fd058fbb700 1 Processor -- start 2023-10-08T15:37:46.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:46.809+0000 7fd058fbb700 1 -- start start 2023-10-08T15:37:46.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:46.809+0000 7fd058fbb700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fd0540bab50 0x7fd0540baf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:46.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:46.809+0000 7fd058fbb700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0540b4050 con 0x7fd05406df30 2023-10-08T15:37:46.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:46.809+0000 7fd058fbb700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0540b4330 con 0x7fd05414a080 2023-10-08T15:37:46.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:46.809+0000 7fd058fbb700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd054146da0 con 0x7fd0540bab50 2023-10-08T15:37:46.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:46.809+0000 7fd04affd700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fd05406df30 0x7fd054149970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:49896/0 (socket says 172.21.15.3:49896) 2023-10-08T15:37:46.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:46.809+0000 7fd04affd700 1 -- 172.21.15.3:0/935919698 learned_addr learned my addr 172.21.15.3:0/935919698 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:46.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:46.809+0000 7fd0537fe700 1 --2- 172.21.15.3:0/935919698 >> v2:172.21.15.3:3300/0 conn(0x7fd0540bab50 0x7fd0540baf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:46.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:46.809+0000 7fd052ffd700 1 -- 172.21.15.3:0/935919698 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2328272549 0 0) 0x7fd0540b4050 con 0x7fd05406df30 2023-10-08T15:37:46.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:46.809+0000 7fd052ffd700 1 -- 172.21.15.3:0/935919698 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd034003570 con 0x7fd05406df30 2023-10-08T15:37:46.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:46.809+0000 7fd052ffd700 1 -- 172.21.15.3:0/935919698 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1612810428 0 0) 0x7fd0540b4330 con 0x7fd05414a080 2023-10-08T15:37:46.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:46.809+0000 7fd052ffd700 1 -- 172.21.15.3:0/935919698 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0540b4050 con 0x7fd05414a080 2023-10-08T15:37:46.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:46.809+0000 7fd0537fe700 1 -- 172.21.15.3:0/935919698 >> v1:172.21.15.50:6789/0 conn(0x7fd05414a080 legacy=0x7fd05414c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:46.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:46.809+0000 7fd0537fe700 1 -- 172.21.15.3:0/935919698 >> v1:172.21.15.3:6789/0 conn(0x7fd05406df30 legacy=0x7fd054149970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:46.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:46.809+0000 7fd0537fe700 1 -- 172.21.15.3:0/935919698 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd054149270 con 0x7fd0540bab50 2023-10-08T15:37:46.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:46.813+0000 7fd0537fe700 1 --2- 172.21.15.3:0/935919698 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd0540bab50 0x7fd0540baf20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd0440098e0 tx=0x7fd0440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=570bb4eea6f9f9f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:46.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:46.813+0000 7fd052ffd700 1 -- 172.21.15.3:0/935919698 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd044011630 con 0x7fd0540bab50 2023-10-08T15:37:46.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:46.813+0000 7fd052ffd700 1 -- 172.21.15.3:0/935919698 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd044011790 con 0x7fd0540bab50 2023-10-08T15:37:46.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:46.813+0000 7fd052ffd700 1 -- 172.21.15.3:0/935919698 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd044011b30 con 0x7fd0540bab50 2023-10-08T15:37:46.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:46.813+0000 7fd058fbb700 1 -- 172.21.15.3:0/935919698 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd0540bab50 msgr2=0x7fd0540baf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:46.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:46.813+0000 7fd058fbb700 1 --2- 172.21.15.3:0/935919698 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd0540bab50 0x7fd0540baf20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd0440098e0 tx=0x7fd0440091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:46.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:46.813+0000 7fd058fbb700 1 -- 172.21.15.3:0/935919698 shutdown_connections 2023-10-08T15:37:46.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:46.813+0000 7fd058fbb700 1 --2- 172.21.15.3:0/935919698 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd0540bab50 0x7fd0540baf20 secure :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd0440098e0 tx=0x7fd0440091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:46.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:46.813+0000 7fd058fbb700 1 -- 172.21.15.3:0/935919698 >> 172.21.15.3:0/935919698 conn(0x7fd0540be4a0 msgr2=0x7fd0540ba440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:46.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:46.813+0000 7fd058fbb700 1 -- 172.21.15.3:0/935919698 shutdown_connections 2023-10-08T15:37:46.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:46.813+0000 7fd058fbb700 1 -- 172.21.15.3:0/935919698 wait complete. 2023-10-08T15:37:46.821 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:46.813+0000 7fd058fbb700 1 Processor -- start 2023-10-08T15:37:46.821 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:46.813+0000 7fd058fbb700 1 -- start start 2023-10-08T15:37:46.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:46.817+0000 7fd058fbb700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd05406df30 0x7fd0540b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:46.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:46.817+0000 7fd058fbb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd05414a080 0x7fd0540b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:46.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:46.817+0000 7fd058fbb700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd05415e0c0 0x7fd05415e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:46.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:46.817+0000 7fd058fbb700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0540b4710 con 0x7fd05415e0c0 2023-10-08T15:37:46.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:46.817+0000 7fd058fbb700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0541472b0 con 0x7fd05414a080 2023-10-08T15:37:46.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:46.817+0000 7fd058fbb700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd054146f80 con 0x7fd05406df30 2023-10-08T15:37:46.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:46.817+0000 7fd053fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd05415e0c0 0x7fd05415e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:46.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:46.817+0000 7fd053fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd05415e0c0 0x7fd05415e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59878/0 (socket says 172.21.15.3:59878) 2023-10-08T15:37:46.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:46.817+0000 7fd053fff700 1 -- 172.21.15.3:0/810661528 learned_addr learned my addr 172.21.15.3:0/810661528 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:46.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:46.817+0000 7fd04affd700 1 --2- 172.21.15.3:0/810661528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd05414a080 0x7fd0540b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:46.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:46.817+0000 7fd0537fe700 1 --2- 172.21.15.3:0/810661528 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd05406df30 0x7fd0540b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:46.824 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:46.817+0000 7fd053fff700 1 -- 172.21.15.3:0/810661528 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd05406df30 msgr2=0x7fd0540b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:46.824 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:46.817+0000 7fd053fff700 1 --2- 172.21.15.3:0/810661528 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd05406df30 0x7fd0540b21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:46.824 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:46.817+0000 7fd053fff700 1 -- 172.21.15.3:0/810661528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd05414a080 msgr2=0x7fd0540b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:46.824 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:46.817+0000 7fd053fff700 1 --2- 172.21.15.3:0/810661528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd05414a080 0x7fd0540b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:46.824 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:46.817+0000 7fd053fff700 1 -- 172.21.15.3:0/810661528 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd044009420 con 0x7fd05415e0c0 2023-10-08T15:37:46.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:46.817+0000 7fd053fff700 1 --2- 172.21.15.3:0/810661528 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd05415e0c0 0x7fd05415e540 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd04c00c860 tx=0x7fd04c002700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:46.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:46.817+0000 7fd04bfff700 1 -- 172.21.15.3:0/810661528 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04c002030 con 0x7fd05415e0c0 2023-10-08T15:37:46.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:46.817+0000 7fd04bfff700 1 -- 172.21.15.3:0/810661528 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd04c0021b0 con 0x7fd05415e0c0 2023-10-08T15:37:46.826 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:46.817+0000 7fd058fbb700 1 -- 172.21.15.3:0/810661528 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0540b64c0 con 0x7fd05415e0c0 2023-10-08T15:37:46.826 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:46.817+0000 7fd04bfff700 1 -- 172.21.15.3:0/810661528 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04c012630 con 0x7fd05415e0c0 2023-10-08T15:37:46.826 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:46.817+0000 7fd058fbb700 1 -- 172.21.15.3:0/810661528 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0540b3b80 con 0x7fd05415e0c0 2023-10-08T15:37:46.826 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:46.817+0000 7fd058fbb700 1 -- 172.21.15.3:0/810661528 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0540b26f0 con 0x7fd05415e0c0 2023-10-08T15:37:46.826 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:46.821+0000 7fd04bfff700 1 -- 172.21.15.3:0/810661528 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fd04c0129e0 con 0x7fd05415e0c0 2023-10-08T15:37:46.827 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:46.821+0000 7fd04bfff700 1 --2- 172.21.15.3:0/810661528 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd038060550 0x7fd038062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:46.827 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:46.821+0000 7fd04bfff700 1 -- 172.21.15.3:0/810661528 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd04c07c720 con 0x7fd05415e0c0 2023-10-08T15:37:46.827 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:46.821+0000 7fd0537fe700 1 --2- 172.21.15.3:0/810661528 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd038060550 0x7fd038062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:46.827 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:46.821+0000 7fd0537fe700 1 --2- 172.21.15.3:0/810661528 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd038060550 0x7fd038062a00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd05406e8f0 tx=0x7fd044017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:46.832 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:46.825+0000 7fd04bfff700 1 -- 172.21.15.3:0/810661528 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd04c04cd10 con 0x7fd05415e0c0 2023-10-08T15:37:47.033 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:47.029+0000 7fd058fbb700 1 -- 172.21.15.3:0/810661528 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd05405ecf0 con 0x7fd05415e0c0 2023-10-08T15:37:47.034 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:47.029+0000 7fd04bfff700 1 -- 172.21.15.3:0/810661528 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd04c050330 con 0x7fd05415e0c0 2023-10-08T15:37:47.034 INFO:teuthology.orchestra.run.smithi003.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T15:37:47.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:47.029+0000 7fd058fbb700 1 -- 172.21.15.3:0/810661528 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd038060550 msgr2=0x7fd038062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:47.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:47.029+0000 7fd058fbb700 1 --2- 172.21.15.3:0/810661528 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd038060550 0x7fd038062a00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd05406e8f0 tx=0x7fd044017000 comp rx=0 tx=0).stop 2023-10-08T15:37:47.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:47.029+0000 7fd058fbb700 1 -- 172.21.15.3:0/810661528 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd05415e0c0 msgr2=0x7fd05415e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:47.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:47.029+0000 7fd058fbb700 1 --2- 172.21.15.3:0/810661528 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd05415e0c0 0x7fd05415e540 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd04c00c860 tx=0x7fd04c002700 comp rx=0 tx=0).stop 2023-10-08T15:37:47.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:47.029+0000 7fd058fbb700 1 -- 172.21.15.3:0/810661528 shutdown_connections 2023-10-08T15:37:47.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:47.029+0000 7fd058fbb700 1 --2- 172.21.15.3:0/810661528 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd038060550 0x7fd038062a00 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:47.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:47.029+0000 7fd058fbb700 1 --2- 172.21.15.3:0/810661528 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd05415e0c0 0x7fd05415e540 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:47.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:47.029+0000 7fd058fbb700 1 --2- 172.21.15.3:0/810661528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd05414a080 0x7fd0540b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:47.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:47.029+0000 7fd058fbb700 1 --2- 172.21.15.3:0/810661528 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd05406df30 0x7fd0540b21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:47.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:47.029+0000 7fd058fbb700 1 -- 172.21.15.3:0/810661528 >> 172.21.15.3:0/810661528 conn(0x7fd0540be4a0 msgr2=0x7fd054145f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:47.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:47.029+0000 7fd058fbb700 1 -- 172.21.15.3:0/810661528 shutdown_connections 2023-10-08T15:37:47.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:47.029+0000 7fd058fbb700 1 -- 172.21.15.3:0/810661528 wait complete. 2023-10-08T15:37:47.048 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-08T15:37:47.048 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T15:37:47.048 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi098.front.sepia.ceph.com 2023-10-08T15:37:47.048 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-08T15:37:47.048 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-08T15:37:47.048 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-08T15:37:47.048 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-08T15:37:47.048 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T15:37:47.049 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-08T15:37:47.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:37:47.049 DEBUG:teuthology.orchestra.run.smithi098:> ip addr 2023-10-08T15:37:47.056 INFO:teuthology.orchestra.run.smithi098.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T15:37:47.056 INFO:teuthology.orchestra.run.smithi098.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T15:37:47.056 INFO:teuthology.orchestra.run.smithi098.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T15:37:47.057 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:37:47.057 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 ::1/128 scope host 2023-10-08T15:37:47.057 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:37:47.057 INFO:teuthology.orchestra.run.smithi098.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T15:37:47.057 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:d8:d9:b8 brd ff:ff:ff:ff:ff:ff 2023-10-08T15:37:47.057 INFO:teuthology.orchestra.run.smithi098.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T15:37:47.057 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:d8:d9:b9 brd ff:ff:ff:ff:ff:ff 2023-10-08T15:37:47.057 INFO:teuthology.orchestra.run.smithi098.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T15:37:47.057 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:8f:d2:6a brd ff:ff:ff:ff:ff:ff 2023-10-08T15:37:47.057 INFO:teuthology.orchestra.run.smithi098.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T15:37:47.058 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:8f:d2:6b brd ff:ff:ff:ff:ff:ff 2023-10-08T15:37:47.058 INFO:teuthology.orchestra.run.smithi098.stdout: inet 172.21.15.98/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-08T15:37:47.058 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft 42530sec preferred_lft 42530sec 2023-10-08T15:37:47.058 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::ec4:7aff:fe8f:d26b/64 scope link 2023-10-08T15:37:47.058 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:37:47.058 INFO:teuthology.orchestra.run.smithi098.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-08T15:37:47.058 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 02:42:b5:ef:a6:12 brd ff:ff:ff:ff:ff:ff 2023-10-08T15:37:47.058 INFO:teuthology.orchestra.run.smithi098.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-08T15:37:47.058 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:37:47.059 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-08T15:37:47.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:37:47.059 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec bash -c ' 2023-10-08T15:37:47.059 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2023-10-08T15:37:47.059 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link add name ceph-brx type bridge 2023-10-08T15:37:47.059 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip addr flush dev ceph-brx 2023-10-08T15:37:47.059 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link set ceph-brx up 2023-10-08T15:37:47.059 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-08T15:37:47.059 DEBUG:teuthology.orchestra.run.smithi098:> ') 2023-10-08T15:37:47.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:37:47.147 DEBUG:teuthology.orchestra.run.smithi098:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T15:37:47.156 INFO:teuthology.orchestra.run.smithi098.stdout:1 2023-10-08T15:37:47.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:37:47.158 DEBUG:teuthology.orchestra.run.smithi098:> route 2023-10-08T15:37:47.182 INFO:teuthology.orchestra.run.smithi098.stdout:Kernel IP routing table 2023-10-08T15:37:47.183 INFO:teuthology.orchestra.run.smithi098.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T15:37:47.183 INFO:teuthology.orchestra.run.smithi098.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-08T15:37:47.183 INFO:teuthology.orchestra.run.smithi098.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-08T15:37:47.183 INFO:teuthology.orchestra.run.smithi098.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-08T15:37:47.183 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-10-08T15:37:47.183 INFO:teuthology.orchestra.run.smithi098.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-08T15:37:47.183 INFO:teuthology.orchestra.run.smithi098.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T15:37:47.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:37:47.184 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec bash -c ' 2023-10-08T15:37:47.184 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2023-10-08T15:37:47.184 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-08T15:37:47.184 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-08T15:37:47.184 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-08T15:37:47.184 DEBUG:teuthology.orchestra.run.smithi098:> ') 2023-10-08T15:37:47.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:37:47.226 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list 2023-10-08T15:37:47.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:37:47.276 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list-id 2023-10-08T15:37:47.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:37:47.284 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec bash -c ' 2023-10-08T15:37:47.284 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2023-10-08T15:37:47.284 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-08T15:37:47.284 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-08T15:37:47.284 DEBUG:teuthology.orchestra.run.smithi098:> ') 2023-10-08T15:37:47.311 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-08T15:37:47.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:37:47.312 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec bash -c ' 2023-10-08T15:37:47.312 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2023-10-08T15:37:47.312 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-08T15:37:47.312 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-08T15:37:47.312 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-08T15:37:47.312 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-08T15:37:47.312 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-08T15:37:47.312 DEBUG:teuthology.orchestra.run.smithi098:> ') 2023-10-08T15:37:47.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:37:47.434 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec bash -c ' 2023-10-08T15:37:47.434 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2023-10-08T15:37:47.434 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link set brx.0 up 2023-10-08T15:37:47.435 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link set dev brx.0 master ceph-brx 2023-10-08T15:37:47.435 DEBUG:teuthology.orchestra.run.smithi098:> ') 2023-10-08T15:37:47.459 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-10-08T15:37:47.459 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T15:37:47.459 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-08T15:37:47.465 INFO:teuthology.orchestra.run.smithi098.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-08T15:37:47.466 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T15:37:47.466 DEBUG:teuthology.orchestra.run.smithi098:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-08T15:37:47.472 DEBUG:teuthology.orchestra.run.smithi098:> sudo modprobe fuse 2023-10-08T15:37:47.488 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-08T15:37:47.488 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-08T15:37:47.497 INFO:teuthology.orchestra.run.smithi098.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-08T15:37:47.498 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-08T15:37:47.499 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:37:47.499 DEBUG:teuthology.orchestra.run.smithi098:> ls /sys/fs/fuse/connections 2023-10-08T15:37:47.547 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-08T15:37:47.547 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-10-08T15:37:47.549 DEBUG:teuthology.orchestra.run.smithi098:> sudo modprobe fuse 2023-10-08T15:37:47.566 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-08T15:37:47.566 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-08T15:37:47.580 INFO:teuthology.orchestra.run.smithi098.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-08T15:37:47.581 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-08T15:37:47.582 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:37:47.582 DEBUG:teuthology.orchestra.run.smithi098:> ls /sys/fs/fuse/connections 2023-10-08T15:37:47.647 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi098.stderr:2023-10-08T15:37:47.642+0000 7fa5db90d380 -1 init, newargv = 0x560774029e10 newargc=15 2023-10-08T15:37:47.647 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi098.stderr:ceph-fuse[28615]: starting ceph client 2023-10-08T15:37:47.658 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi098.stderr:ceph-fuse[28615]: starting fuse 2023-10-08T15:37:48.688 DEBUG:teuthology.orchestra.run.smithi098:> sudo modprobe fuse 2023-10-08T15:37:48.706 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-08T15:37:48.706 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-08T15:37:48.722 INFO:teuthology.orchestra.run.smithi098.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-08T15:37:48.723 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-08T15:37:48.724 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:37:48.724 DEBUG:teuthology.orchestra.run.smithi098:> ls /sys/fs/fuse/connections 2023-10-08T15:37:48.730 INFO:teuthology.orchestra.run.smithi098.stdout:52 2023-10-08T15:37:48.730 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-10-08T15:37:48.730 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-08T15:37:48.730 DEBUG:teuthology.orchestra.run.smithi098:> import glob 2023-10-08T15:37:48.730 DEBUG:teuthology.orchestra.run.smithi098:> import re 2023-10-08T15:37:48.730 DEBUG:teuthology.orchestra.run.smithi098:> import os 2023-10-08T15:37:48.731 DEBUG:teuthology.orchestra.run.smithi098:> import subprocess 2023-10-08T15:37:48.731 DEBUG:teuthology.orchestra.run.smithi098:> 2023-10-08T15:37:48.731 DEBUG:teuthology.orchestra.run.smithi098:> def _find_admin_socket(client_name): 2023-10-08T15:37:48.731 DEBUG:teuthology.orchestra.run.smithi098:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-10-08T15:37:48.731 DEBUG:teuthology.orchestra.run.smithi098:> files = glob.glob(asok_path) 2023-10-08T15:37:48.731 DEBUG:teuthology.orchestra.run.smithi098:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-10-08T15:37:48.731 DEBUG:teuthology.orchestra.run.smithi098:> 2023-10-08T15:37:48.731 DEBUG:teuthology.orchestra.run.smithi098:> # Given a non-glob path, it better be there 2023-10-08T15:37:48.731 DEBUG:teuthology.orchestra.run.smithi098:> if "*" not in asok_path: 2023-10-08T15:37:48.731 DEBUG:teuthology.orchestra.run.smithi098:> assert(len(files) == 1) 2023-10-08T15:37:48.731 DEBUG:teuthology.orchestra.run.smithi098:> return files[0] 2023-10-08T15:37:48.731 DEBUG:teuthology.orchestra.run.smithi098:> 2023-10-08T15:37:48.732 DEBUG:teuthology.orchestra.run.smithi098:> for f in files: 2023-10-08T15:37:48.732 DEBUG:teuthology.orchestra.run.smithi098:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-08T15:37:48.732 DEBUG:teuthology.orchestra.run.smithi098:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-08T15:37:48.732 DEBUG:teuthology.orchestra.run.smithi098:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-08T15:37:48.732 DEBUG:teuthology.orchestra.run.smithi098:> contents = proc_f.read() 2023-10-08T15:37:48.732 DEBUG:teuthology.orchestra.run.smithi098:> if mountpoint in contents: 2023-10-08T15:37:48.732 DEBUG:teuthology.orchestra.run.smithi098:> return f 2023-10-08T15:37:48.732 DEBUG:teuthology.orchestra.run.smithi098:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-08T15:37:48.732 DEBUG:teuthology.orchestra.run.smithi098:> 2023-10-08T15:37:48.732 DEBUG:teuthology.orchestra.run.smithi098:> print(_find_admin_socket("client.1")) 2023-10-08T15:37:48.732 DEBUG:teuthology.orchestra.run.smithi098:> ' 2023-10-08T15:37:48.853 INFO:teuthology.orchestra.run.smithi098.stdout:/var/run/ceph/ceph-client.1.28615.asok 2023-10-08T15:37:49.040 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.28615.asok 2023-10-08T15:37:49.040 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:37:49.040 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.28615.asok status 2023-10-08T15:37:49.138 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-10-08T15:37:49.139 INFO:teuthology.orchestra.run.smithi098.stdout: "metadata": { 2023-10-08T15:37:49.139 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_sha1": "08cac0187919fc3a247efdf445f652e2fb30a647", 2023-10-08T15:37:49.139 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_version": "ceph version 17.2.6-1320-g08cac018 (08cac0187919fc3a247efdf445f652e2fb30a647) quincy (stable)", 2023-10-08T15:37:49.139 INFO:teuthology.orchestra.run.smithi098.stdout: "entity_id": "1", 2023-10-08T15:37:49.139 INFO:teuthology.orchestra.run.smithi098.stdout: "hostname": "smithi098", 2023-10-08T15:37:49.139 INFO:teuthology.orchestra.run.smithi098.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-10-08T15:37:49.139 INFO:teuthology.orchestra.run.smithi098.stdout: "pid": "28615", 2023-10-08T15:37:49.139 INFO:teuthology.orchestra.run.smithi098.stdout: "root": "/" 2023-10-08T15:37:49.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-10-08T15:37:49.139 INFO:teuthology.orchestra.run.smithi098.stdout: "dentry_count": 0, 2023-10-08T15:37:49.139 INFO:teuthology.orchestra.run.smithi098.stdout: "dentry_pinned_count": 0, 2023-10-08T15:37:49.140 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 4747, 2023-10-08T15:37:49.140 INFO:teuthology.orchestra.run.smithi098.stdout: "inst": { 2023-10-08T15:37:49.140 INFO:teuthology.orchestra.run.smithi098.stdout: "name": { 2023-10-08T15:37:49.140 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "client", 2023-10-08T15:37:49.140 INFO:teuthology.orchestra.run.smithi098.stdout: "num": 4747 2023-10-08T15:37:49.140 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-10-08T15:37:49.140 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": { 2023-10-08T15:37:49.140 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "v1", 2023-10-08T15:37:49.140 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": "172.21.15.98:0", 2023-10-08T15:37:49.140 INFO:teuthology.orchestra.run.smithi098.stdout: "nonce": 3433050066 2023-10-08T15:37:49.140 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-10-08T15:37:49.140 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-10-08T15:37:49.141 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": { 2023-10-08T15:37:49.141 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "v1", 2023-10-08T15:37:49.141 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": "172.21.15.98:0", 2023-10-08T15:37:49.141 INFO:teuthology.orchestra.run.smithi098.stdout: "nonce": 3433050066 2023-10-08T15:37:49.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-10-08T15:37:49.141 INFO:teuthology.orchestra.run.smithi098.stdout: "inst_str": "client.4747 172.21.15.98:0/3433050066", 2023-10-08T15:37:49.141 INFO:teuthology.orchestra.run.smithi098.stdout: "addr_str": "172.21.15.98:0/3433050066", 2023-10-08T15:37:49.141 INFO:teuthology.orchestra.run.smithi098.stdout: "inode_count": 1, 2023-10-08T15:37:49.141 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_epoch": 6, 2023-10-08T15:37:49.141 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_epoch": 20, 2023-10-08T15:37:49.141 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_epoch_barrier": 0, 2023-10-08T15:37:49.141 INFO:teuthology.orchestra.run.smithi098.stdout: "blocklisted": false, 2023-10-08T15:37:49.142 INFO:teuthology.orchestra.run.smithi098.stdout: "fs_name": "cephfs" 2023-10-08T15:37:49.142 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-10-08T15:37:49.148 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T15:37:49.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.261+0000 7f039281f700 1 Processor -- start 2023-10-08T15:37:49.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.261+0000 7f039281f700 1 -- start start 2023-10-08T15:37:49.267 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.261+0000 7f039281f700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f038c14b4e0 0x7f038c0b1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:49.268 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.261+0000 7f039281f700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f038c14b8b0 0x7f038c148970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:49.268 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.261+0000 7f039281f700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f038c14c190 con 0x7f038c067500 2023-10-08T15:37:49.268 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.261+0000 7f039281f700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f038c148eb0 con 0x7f038c14b4e0 2023-10-08T15:37:49.268 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.261+0000 7f039281f700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f038c068e60 con 0x7f038c14b8b0 2023-10-08T15:37:49.268 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.261+0000 7f0390dbc700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f038c067500 0x7f038c067d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:49912/0 (socket says 172.21.15.3:49912) 2023-10-08T15:37:49.268 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.261+0000 7f0390dbc700 1 -- 172.21.15.3:0/3826594370 learned_addr learned my addr 172.21.15.3:0/3826594370 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:49.268 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.261+0000 7f038b7fe700 1 --2- 172.21.15.3:0/3826594370 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f038c14b8b0 0x7f038c148970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:49.268 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.261+0000 7f038bfff700 1 --2- 172.21.15.3:0/3826594370 >> v2:172.21.15.50:3300/0 conn(0x7f038c14b4e0 0x7f038c0b1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:49.268 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.261+0000 7f038affd700 1 -- 172.21.15.3:0/3826594370 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4247539917 0 0) 0x7f038c14c190 con 0x7f038c067500 2023-10-08T15:37:49.268 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.261+0000 7f038affd700 1 -- 172.21.15.3:0/3826594370 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0374003570 con 0x7f038c067500 2023-10-08T15:37:49.270 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.261+0000 7f038affd700 1 -- 172.21.15.3:0/3826594370 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2783861714 0 0) 0x7f0374003570 con 0x7f038c067500 2023-10-08T15:37:49.270 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.261+0000 7f038b7fe700 1 -- 172.21.15.3:0/3826594370 >> v2:172.21.15.50:3300/0 conn(0x7f038c14b4e0 msgr2=0x7f038c0b1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:49.270 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.261+0000 7f038b7fe700 1 --2- 172.21.15.3:0/3826594370 >> v2:172.21.15.50:3300/0 conn(0x7f038c14b4e0 0x7f038c0b1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:49.270 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.261+0000 7f038b7fe700 1 -- 172.21.15.3:0/3826594370 >> v1:172.21.15.3:6789/0 conn(0x7f038c067500 legacy=0x7f038c067d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:49.270 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.261+0000 7f038b7fe700 1 -- 172.21.15.3:0/3826594370 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f038c0b2540 con 0x7f038c14b8b0 2023-10-08T15:37:49.270 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.261+0000 7f038b7fe700 1 --2- 172.21.15.3:0/3826594370 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f038c14b8b0 0x7f038c148970 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f037c009e60 tx=0x7f037c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a36a5381a57a1cbf server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:49.270 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.261+0000 7f038affd700 1 -- 172.21.15.3:0/3826594370 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037c00e070 con 0x7f038c14b8b0 2023-10-08T15:37:49.270 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.261+0000 7f038affd700 1 -- 172.21.15.3:0/3826594370 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f037c00b7a0 con 0x7f038c14b8b0 2023-10-08T15:37:49.270 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.261+0000 7f038affd700 1 -- 172.21.15.3:0/3826594370 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0384001470 con 0x7f038c14b8b0 2023-10-08T15:37:49.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.265+0000 7f039281f700 1 -- 172.21.15.3:0/3826594370 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f038c14b8b0 msgr2=0x7f038c148970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:49.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.265+0000 7f039281f700 1 --2- 172.21.15.3:0/3826594370 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f038c14b8b0 0x7f038c148970 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f037c009e60 tx=0x7f037c009780 comp rx=0 tx=0).stop 2023-10-08T15:37:49.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.265+0000 7f039281f700 1 -- 172.21.15.3:0/3826594370 shutdown_connections 2023-10-08T15:37:49.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.265+0000 7f039281f700 1 --2- 172.21.15.3:0/3826594370 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f038c14b8b0 0x7f038c148970 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:49.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.265+0000 7f039281f700 1 --2- 172.21.15.3:0/3826594370 >> v2:172.21.15.50:3300/0 conn(0x7f038c14b4e0 0x7f038c0b1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:49.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.265+0000 7f039281f700 1 -- 172.21.15.3:0/3826594370 >> 172.21.15.3:0/3826594370 conn(0x7f038c0bdda0 msgr2=0x7f038c0be170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:49.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.265+0000 7f039281f700 1 -- 172.21.15.3:0/3826594370 shutdown_connections 2023-10-08T15:37:49.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.265+0000 7f039281f700 1 -- 172.21.15.3:0/3826594370 wait complete. 2023-10-08T15:37:49.272 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.265+0000 7f039281f700 1 Processor -- start 2023-10-08T15:37:49.272 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.265+0000 7f039281f700 1 -- start start 2023-10-08T15:37:49.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.265+0000 7f039281f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f038c067500 0x7f038c1427b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:49.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.265+0000 7f039281f700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f038c14b4e0 0x7f038c141490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:49.274 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.265+0000 7f039281f700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f038c14b8b0 0x7f038c15d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:49.274 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.265+0000 7f039281f700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f038c1381f0 con 0x7f038c14b4e0 2023-10-08T15:37:49.274 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.265+0000 7f039281f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f038c140f80 con 0x7f038c067500 2023-10-08T15:37:49.274 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.265+0000 7f039281f700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f038c142cf0 con 0x7f038c14b8b0 2023-10-08T15:37:49.274 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.269+0000 7f038b7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f038c14b4e0 0x7f038c141490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:49.274 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.269+0000 7f038b7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f038c14b4e0 0x7f038c141490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59884/0 (socket says 172.21.15.3:59884) 2023-10-08T15:37:49.274 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.269+0000 7f038b7fe700 1 -- 172.21.15.3:0/1640387679 learned_addr learned my addr 172.21.15.3:0/1640387679 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:49.274 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.269+0000 7f038bfff700 1 --2- 172.21.15.3:0/1640387679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f038c067500 0x7f038c1427b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:49.274 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.269+0000 7f0390dbc700 1 --2- 172.21.15.3:0/1640387679 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f038c14b8b0 0x7f038c15d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:49.275 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.269+0000 7f038b7fe700 1 -- 172.21.15.3:0/1640387679 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f038c14b8b0 msgr2=0x7f038c15d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:49.276 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.269+0000 7f038b7fe700 1 --2- 172.21.15.3:0/1640387679 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f038c14b8b0 0x7f038c15d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:49.276 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.269+0000 7f038b7fe700 1 -- 172.21.15.3:0/1640387679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f038c067500 msgr2=0x7f038c1427b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:49.276 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.269+0000 7f038b7fe700 1 --2- 172.21.15.3:0/1640387679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f038c067500 0x7f038c1427b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:49.276 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.269+0000 7f038b7fe700 1 -- 172.21.15.3:0/1640387679 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f037c009a20 con 0x7f038c14b4e0 2023-10-08T15:37:49.276 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.269+0000 7f038b7fe700 1 --2- 172.21.15.3:0/1640387679 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f038c14b4e0 0x7f038c141490 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f037c00b610 tx=0x7f037c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:49.276 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.269+0000 7f0373fff700 1 -- 172.21.15.3:0/1640387679 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037c00be80 con 0x7f038c14b4e0 2023-10-08T15:37:49.276 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.269+0000 7f0373fff700 1 -- 172.21.15.3:0/1640387679 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f037c012b20 con 0x7f038c14b4e0 2023-10-08T15:37:49.276 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.269+0000 7f039281f700 1 -- 172.21.15.3:0/1640387679 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f038c1411d0 con 0x7f038c14b4e0 2023-10-08T15:37:49.276 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.269+0000 7f0373fff700 1 -- 172.21.15.3:0/1640387679 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037c026460 con 0x7f038c14b4e0 2023-10-08T15:37:49.276 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.269+0000 7f039281f700 1 -- 172.21.15.3:0/1640387679 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f038c13ff00 con 0x7f038c14b4e0 2023-10-08T15:37:49.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.269+0000 7f039281f700 1 -- 172.21.15.3:0/1640387679 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f038c141a30 con 0x7f038c14b4e0 2023-10-08T15:37:49.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.273+0000 7f0373fff700 1 -- 172.21.15.3:0/1640387679 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f037c01d420 con 0x7f038c14b4e0 2023-10-08T15:37:49.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.273+0000 7f0373fff700 1 --2- 172.21.15.3:0/1640387679 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f0378060550 0x7f0378062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:49.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.273+0000 7f0373fff700 1 -- 172.21.15.3:0/1640387679 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f037c07e6c0 con 0x7f038c14b4e0 2023-10-08T15:37:49.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.273+0000 7f038bfff700 1 --2- 172.21.15.3:0/1640387679 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f0378060550 0x7f0378062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:49.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.273+0000 7f038bfff700 1 --2- 172.21.15.3:0/1640387679 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f0378060550 0x7f0378062a00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f038c139ed0 tx=0x7f03800091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:49.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.281+0000 7f0373fff700 1 -- 172.21.15.3:0/1640387679 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f037c04ecb0 con 0x7f038c14b4e0 2023-10-08T15:37:49.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.477+0000 7f039281f700 1 -- 172.21.15.3:0/1640387679 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f038c064530 con 0x7f038c14b4e0 2023-10-08T15:37:49.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.477+0000 7f0373fff700 1 -- 172.21.15.3:0/1640387679 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f037c0522d0 con 0x7f038c14b4e0 2023-10-08T15:37:49.486 INFO:teuthology.orchestra.run.smithi003.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T15:37:49.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.481+0000 7f039281f700 1 -- 172.21.15.3:0/1640387679 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f0378060550 msgr2=0x7f0378062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:49.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.481+0000 7f039281f700 1 --2- 172.21.15.3:0/1640387679 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f0378060550 0x7f0378062a00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f038c139ed0 tx=0x7f03800091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:49.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.481+0000 7f039281f700 1 -- 172.21.15.3:0/1640387679 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f038c14b4e0 msgr2=0x7f038c141490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:49.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.481+0000 7f039281f700 1 --2- 172.21.15.3:0/1640387679 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f038c14b4e0 0x7f038c141490 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f037c00b610 tx=0x7f037c018000 comp rx=0 tx=0).stop 2023-10-08T15:37:49.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.481+0000 7f039281f700 1 -- 172.21.15.3:0/1640387679 shutdown_connections 2023-10-08T15:37:49.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.481+0000 7f039281f700 1 --2- 172.21.15.3:0/1640387679 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f0378060550 0x7f0378062a00 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:49.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.481+0000 7f039281f700 1 --2- 172.21.15.3:0/1640387679 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f038c14b8b0 0x7f038c15d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:49.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.481+0000 7f039281f700 1 --2- 172.21.15.3:0/1640387679 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f038c14b4e0 0x7f038c141490 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:49.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.481+0000 7f039281f700 1 --2- 172.21.15.3:0/1640387679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f038c067500 0x7f038c1427b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:49.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.481+0000 7f039281f700 1 -- 172.21.15.3:0/1640387679 >> 172.21.15.3:0/1640387679 conn(0x7f038c0bdda0 msgr2=0x7f038c13c120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:49.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.481+0000 7f039281f700 1 -- 172.21.15.3:0/1640387679 shutdown_connections 2023-10-08T15:37:49.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:49.481+0000 7f039281f700 1 -- 172.21.15.3:0/1640387679 wait complete. 2023-10-08T15:37:49.502 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-08T15:37:49.502 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T15:37:49.502 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi153.front.sepia.ceph.com 2023-10-08T15:37:49.503 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-10-08T15:37:49.503 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-08T15:37:49.503 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-08T15:37:49.503 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-08T15:37:49.503 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T15:37:49.503 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-10-08T15:37:49.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:37:49.503 DEBUG:teuthology.orchestra.run.smithi153:> ip addr 2023-10-08T15:37:49.511 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T15:37:49.511 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T15:37:49.511 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T15:37:49.511 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:37:49.511 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2023-10-08T15:37:49.511 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:37:49.511 INFO:teuthology.orchestra.run.smithi153.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T15:37:49.511 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b2 brd ff:ff:ff:ff:ff:ff 2023-10-08T15:37:49.512 INFO:teuthology.orchestra.run.smithi153.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T15:37:49.512 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b3 brd ff:ff:ff:ff:ff:ff 2023-10-08T15:37:49.512 INFO:teuthology.orchestra.run.smithi153.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T15:37:49.512 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:ea brd ff:ff:ff:ff:ff:ff 2023-10-08T15:37:49.512 INFO:teuthology.orchestra.run.smithi153.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T15:37:49.512 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:eb brd ff:ff:ff:ff:ff:ff 2023-10-08T15:37:49.512 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.21.15.153/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-08T15:37:49.512 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft 42530sec preferred_lft 42530sec 2023-10-08T15:37:49.512 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::ec4:7aff:fe88:6deb/64 scope link 2023-10-08T15:37:49.512 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:37:49.512 INFO:teuthology.orchestra.run.smithi153.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-08T15:37:49.512 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 02:42:b1:17:55:87 brd ff:ff:ff:ff:ff:ff 2023-10-08T15:37:49.513 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-08T15:37:49.513 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:37:49.513 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-08T15:37:49.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:37:49.513 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2023-10-08T15:37:49.513 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-10-08T15:37:49.513 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link add name ceph-brx type bridge 2023-10-08T15:37:49.513 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip addr flush dev ceph-brx 2023-10-08T15:37:49.513 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set ceph-brx up 2023-10-08T15:37:49.514 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-08T15:37:49.514 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-10-08T15:37:49.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:37:49.559 DEBUG:teuthology.orchestra.run.smithi153:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T15:37:49.615 INFO:teuthology.orchestra.run.smithi153.stdout:1 2023-10-08T15:37:49.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:37:49.618 DEBUG:teuthology.orchestra.run.smithi153:> route 2023-10-08T15:37:49.644 INFO:teuthology.orchestra.run.smithi153.stdout:Kernel IP routing table 2023-10-08T15:37:49.644 INFO:teuthology.orchestra.run.smithi153.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T15:37:49.644 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-08T15:37:49.644 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-08T15:37:49.645 INFO:teuthology.orchestra.run.smithi153.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-08T15:37:49.645 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-10-08T15:37:49.645 INFO:teuthology.orchestra.run.smithi153.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-08T15:37:49.645 INFO:teuthology.orchestra.run.smithi153.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T15:37:49.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:37:49.645 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2023-10-08T15:37:49.645 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-10-08T15:37:49.645 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-08T15:37:49.646 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-08T15:37:49.646 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-08T15:37:49.646 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-10-08T15:37:49.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:37:49.690 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2023-10-08T15:37:49.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:37:49.739 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list-id 2023-10-08T15:37:49.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:37:49.746 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2023-10-08T15:37:49.747 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-10-08T15:37:49.747 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T15:37:49.747 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 0 2023-10-08T15:37:49.747 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-10-08T15:37:49.775 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.1/16 2023-10-08T15:37:49.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:37:49.775 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2023-10-08T15:37:49.776 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-10-08T15:37:49.776 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.0 2023-10-08T15:37:49.776 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-08T15:37:49.776 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-10-08T15:37:49.776 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-10-08T15:37:49.776 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-10-08T15:37:49.776 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-10-08T15:37:49.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:37:49.850 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2023-10-08T15:37:49.850 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-10-08T15:37:49.850 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set brx.0 up 2023-10-08T15:37:49.850 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set dev brx.0 master ceph-brx 2023-10-08T15:37:49.851 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-10-08T15:37:49.875 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-10-08T15:37:49.876 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T15:37:49.876 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-10-08T15:37:49.883 INFO:teuthology.orchestra.run.smithi153.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-10-08T15:37:49.883 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T15:37:49.883 DEBUG:teuthology.orchestra.run.smithi153:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-10-08T15:37:49.889 DEBUG:teuthology.orchestra.run.smithi153:> sudo modprobe fuse 2023-10-08T15:37:49.903 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-08T15:37:49.903 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-08T15:37:49.960 INFO:teuthology.orchestra.run.smithi153.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-08T15:37:49.961 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-08T15:37:49.962 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:37:49.962 DEBUG:teuthology.orchestra.run.smithi153:> ls /sys/fs/fuse/connections 2023-10-08T15:37:49.969 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-08T15:37:49.969 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-10-08T15:37:49.971 DEBUG:teuthology.orchestra.run.smithi153:> sudo modprobe fuse 2023-10-08T15:37:49.986 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-08T15:37:49.986 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-08T15:37:50.040 INFO:teuthology.orchestra.run.smithi153.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-08T15:37:50.040 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-08T15:37:50.041 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:37:50.041 DEBUG:teuthology.orchestra.run.smithi153:> ls /sys/fs/fuse/connections 2023-10-08T15:37:50.065 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi153.stderr:2023-10-08T15:37:50.063+0000 7fd337768380 -1 init, newargv = 0x558ec85bda10 newargc=15 2023-10-08T15:37:50.065 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi153.stderr:ceph-fuse[28590]: starting ceph client 2023-10-08T15:37:50.074 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi153.stderr:ceph-fuse[28590]: starting fuse 2023-10-08T15:37:51.147 DEBUG:teuthology.orchestra.run.smithi153:> sudo modprobe fuse 2023-10-08T15:37:51.165 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-08T15:37:51.165 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-08T15:37:51.175 INFO:teuthology.orchestra.run.smithi153.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-08T15:37:51.176 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-08T15:37:51.176 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:37:51.176 DEBUG:teuthology.orchestra.run.smithi153:> ls /sys/fs/fuse/connections 2023-10-08T15:37:51.182 INFO:teuthology.orchestra.run.smithi153.stdout:52 2023-10-08T15:37:51.183 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-10-08T15:37:51.183 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-08T15:37:51.183 DEBUG:teuthology.orchestra.run.smithi153:> import glob 2023-10-08T15:37:51.183 DEBUG:teuthology.orchestra.run.smithi153:> import re 2023-10-08T15:37:51.183 DEBUG:teuthology.orchestra.run.smithi153:> import os 2023-10-08T15:37:51.183 DEBUG:teuthology.orchestra.run.smithi153:> import subprocess 2023-10-08T15:37:51.183 DEBUG:teuthology.orchestra.run.smithi153:> 2023-10-08T15:37:51.183 DEBUG:teuthology.orchestra.run.smithi153:> def _find_admin_socket(client_name): 2023-10-08T15:37:51.183 DEBUG:teuthology.orchestra.run.smithi153:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-10-08T15:37:51.183 DEBUG:teuthology.orchestra.run.smithi153:> files = glob.glob(asok_path) 2023-10-08T15:37:51.183 DEBUG:teuthology.orchestra.run.smithi153:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-10-08T15:37:51.184 DEBUG:teuthology.orchestra.run.smithi153:> 2023-10-08T15:37:51.184 DEBUG:teuthology.orchestra.run.smithi153:> # Given a non-glob path, it better be there 2023-10-08T15:37:51.184 DEBUG:teuthology.orchestra.run.smithi153:> if "*" not in asok_path: 2023-10-08T15:37:51.184 DEBUG:teuthology.orchestra.run.smithi153:> assert(len(files) == 1) 2023-10-08T15:37:51.184 DEBUG:teuthology.orchestra.run.smithi153:> return files[0] 2023-10-08T15:37:51.184 DEBUG:teuthology.orchestra.run.smithi153:> 2023-10-08T15:37:51.184 DEBUG:teuthology.orchestra.run.smithi153:> for f in files: 2023-10-08T15:37:51.184 DEBUG:teuthology.orchestra.run.smithi153:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-08T15:37:51.184 DEBUG:teuthology.orchestra.run.smithi153:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-08T15:37:51.184 DEBUG:teuthology.orchestra.run.smithi153:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-08T15:37:51.184 DEBUG:teuthology.orchestra.run.smithi153:> contents = proc_f.read() 2023-10-08T15:37:51.184 DEBUG:teuthology.orchestra.run.smithi153:> if mountpoint in contents: 2023-10-08T15:37:51.185 DEBUG:teuthology.orchestra.run.smithi153:> return f 2023-10-08T15:37:51.185 DEBUG:teuthology.orchestra.run.smithi153:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-08T15:37:51.185 DEBUG:teuthology.orchestra.run.smithi153:> 2023-10-08T15:37:51.185 DEBUG:teuthology.orchestra.run.smithi153:> print(_find_admin_socket("client.2")) 2023-10-08T15:37:51.185 DEBUG:teuthology.orchestra.run.smithi153:> ' 2023-10-08T15:37:51.307 INFO:teuthology.orchestra.run.smithi153.stdout:/var/run/ceph/ceph-client.2.28590.asok 2023-10-08T15:37:51.491 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.28590.asok 2023-10-08T15:37:51.492 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:37:51.492 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.28590.asok status 2023-10-08T15:37:51.586 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-10-08T15:37:51.586 INFO:teuthology.orchestra.run.smithi153.stdout: "metadata": { 2023-10-08T15:37:51.586 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_sha1": "08cac0187919fc3a247efdf445f652e2fb30a647", 2023-10-08T15:37:51.586 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_version": "ceph version 17.2.6-1320-g08cac018 (08cac0187919fc3a247efdf445f652e2fb30a647) quincy (stable)", 2023-10-08T15:37:51.586 INFO:teuthology.orchestra.run.smithi153.stdout: "entity_id": "2", 2023-10-08T15:37:51.587 INFO:teuthology.orchestra.run.smithi153.stdout: "hostname": "smithi153", 2023-10-08T15:37:51.587 INFO:teuthology.orchestra.run.smithi153.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-10-08T15:37:51.587 INFO:teuthology.orchestra.run.smithi153.stdout: "pid": "28590", 2023-10-08T15:37:51.587 INFO:teuthology.orchestra.run.smithi153.stdout: "root": "/" 2023-10-08T15:37:51.587 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-08T15:37:51.587 INFO:teuthology.orchestra.run.smithi153.stdout: "dentry_count": 0, 2023-10-08T15:37:51.587 INFO:teuthology.orchestra.run.smithi153.stdout: "dentry_pinned_count": 0, 2023-10-08T15:37:51.587 INFO:teuthology.orchestra.run.smithi153.stdout: "id": 4764, 2023-10-08T15:37:51.587 INFO:teuthology.orchestra.run.smithi153.stdout: "inst": { 2023-10-08T15:37:51.587 INFO:teuthology.orchestra.run.smithi153.stdout: "name": { 2023-10-08T15:37:51.588 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "client", 2023-10-08T15:37:51.588 INFO:teuthology.orchestra.run.smithi153.stdout: "num": 4764 2023-10-08T15:37:51.588 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-08T15:37:51.588 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": { 2023-10-08T15:37:51.588 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "v1", 2023-10-08T15:37:51.588 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": "172.21.15.153:0", 2023-10-08T15:37:51.588 INFO:teuthology.orchestra.run.smithi153.stdout: "nonce": 3312113943 2023-10-08T15:37:51.588 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-08T15:37:51.588 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-08T15:37:51.588 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": { 2023-10-08T15:37:51.588 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "v1", 2023-10-08T15:37:51.589 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": "172.21.15.153:0", 2023-10-08T15:37:51.589 INFO:teuthology.orchestra.run.smithi153.stdout: "nonce": 3312113943 2023-10-08T15:37:51.589 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-08T15:37:51.589 INFO:teuthology.orchestra.run.smithi153.stdout: "inst_str": "client.4764 172.21.15.153:0/3312113943", 2023-10-08T15:37:51.589 INFO:teuthology.orchestra.run.smithi153.stdout: "addr_str": "172.21.15.153:0/3312113943", 2023-10-08T15:37:51.589 INFO:teuthology.orchestra.run.smithi153.stdout: "inode_count": 1, 2023-10-08T15:37:51.589 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_epoch": 6, 2023-10-08T15:37:51.589 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_epoch": 20, 2023-10-08T15:37:51.589 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_epoch_barrier": 0, 2023-10-08T15:37:51.589 INFO:teuthology.orchestra.run.smithi153.stdout: "blocklisted": false, 2023-10-08T15:37:51.589 INFO:teuthology.orchestra.run.smithi153.stdout: "fs_name": "cephfs" 2023-10-08T15:37:51.589 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-10-08T15:37:51.596 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:37:51.596 DEBUG:teuthology.orchestra.run.smithi089:> stat --file-system '--printf=%T 2023-10-08T15:37:51.596 DEBUG:teuthology.orchestra.run.smithi089:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-08T15:37:51.605 INFO:teuthology.orchestra.run.smithi089.stdout:fuseblk 2023-10-08T15:37:51.605 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-08T15:37:51.606 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:37:51.606 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-08T15:37:51.624 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:37:51.624 DEBUG:teuthology.orchestra.run.smithi098:> stat --file-system '--printf=%T 2023-10-08T15:37:51.624 DEBUG:teuthology.orchestra.run.smithi098:> ' -- /home/ubuntu/cephtest/mnt.1 2023-10-08T15:37:51.632 INFO:teuthology.orchestra.run.smithi098.stdout:fuseblk 2023-10-08T15:37:51.633 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-10-08T15:37:51.633 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:37:51.633 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-08T15:37:51.697 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:37:51.697 DEBUG:teuthology.orchestra.run.smithi153:> stat --file-system '--printf=%T 2023-10-08T15:37:51.697 DEBUG:teuthology.orchestra.run.smithi153:> ' -- /home/ubuntu/cephtest/mnt.2 2023-10-08T15:37:51.706 INFO:teuthology.orchestra.run.smithi153.stdout:fuseblk 2023-10-08T15:37:51.706 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-10-08T15:37:51.706 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:37:51.706 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-10-08T15:37:51.764 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-08T15:37:51.781 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:37:51.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.893+0000 7f78b215b700 1 Processor -- start 2023-10-08T15:37:51.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.897+0000 7f78b215b700 1 -- start start 2023-10-08T15:37:51.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.897+0000 7f78b215b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f78ac0a0bc0 0x7f78ac0a0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:51.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.897+0000 7f78b215b700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78ac0a23b0 con 0x7f78ac14c2b0 2023-10-08T15:37:51.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.897+0000 7f78b215b700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78ac09e6e0 con 0x7f78ac0a1510 2023-10-08T15:37:51.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.897+0000 7f78b215b700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78ac148fa0 con 0x7f78ac0a0bc0 2023-10-08T15:37:51.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.897+0000 7f78aaffd700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f78ac14c2b0 0x7f78ac0670e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:49928/0 (socket says 172.21.15.3:49928) 2023-10-08T15:37:51.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.897+0000 7f78aaffd700 1 -- 172.21.15.3:0/227475247 learned_addr learned my addr 172.21.15.3:0/227475247 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:51.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.897+0000 7f78abfff700 1 --2- 172.21.15.3:0/227475247 >> v2:172.21.15.50:3300/0 conn(0x7f78ac0a0bc0 0x7f78ac0a0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:51.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.897+0000 7f78aa7fc700 1 -- 172.21.15.3:0/227475247 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 880247845 0 0) 0x7f78ac0a23b0 con 0x7f78ac14c2b0 2023-10-08T15:37:51.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.897+0000 7f78aa7fc700 1 -- 172.21.15.3:0/227475247 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7894003570 con 0x7f78ac14c2b0 2023-10-08T15:37:51.906 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.897+0000 7f78aa7fc700 1 -- 172.21.15.3:0/227475247 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 679781600 0 0) 0x7f7894003570 con 0x7f78ac14c2b0 2023-10-08T15:37:51.906 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.897+0000 7f78aa7fc700 1 -- 172.21.15.3:0/227475247 >> v2:172.21.15.50:3300/0 conn(0x7f78ac0a0bc0 msgr2=0x7f78ac0a0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:51.906 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.897+0000 7f78aa7fc700 1 --2- 172.21.15.3:0/227475247 >> v2:172.21.15.50:3300/0 conn(0x7f78ac0a0bc0 0x7f78ac0a0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:51.906 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.897+0000 7f78aa7fc700 1 -- 172.21.15.3:0/227475247 >> v1:172.21.15.50:6789/0 conn(0x7f78ac0a1510 legacy=0x7f78ac09fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:51.906 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.897+0000 7f78aa7fc700 1 -- 172.21.15.3:0/227475247 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ac0a2040 con 0x7f78ac14c2b0 2023-10-08T15:37:51.906 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.897+0000 7f78aa7fc700 1 -- 172.21.15.3:0/227475247 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2285686191 0 0) 0x7f789c001470 con 0x7f78ac14c2b0 2023-10-08T15:37:51.906 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.897+0000 7f78aa7fc700 1 -- 172.21.15.3:0/227475247 >> v1:172.21.15.3:6789/0 conn(0x7f78ac14c2b0 legacy=0x7f78ac0670e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:51.906 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.897+0000 7f78aa7fc700 1 --2- 172.21.15.3:0/227475247 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7894003a60 0x7f7894003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:51.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.897+0000 7f78aa7fc700 1 --2- 172.21.15.3:0/227475247 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7894004810 0x7f7894004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:51.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.897+0000 7f78aa7fc700 1 --2- 172.21.15.3:0/227475247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78940051c0 0x7f789400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:51.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.897+0000 7f78aa7fc700 1 -- 172.21.15.3:0/227475247 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78ac148fa0 con 0x7f7894004810 2023-10-08T15:37:51.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.897+0000 7f78aa7fc700 1 -- 172.21.15.3:0/227475247 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f789400c0d0 con 0x7f78940051c0 2023-10-08T15:37:51.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.897+0000 7f78aa7fc700 1 -- 172.21.15.3:0/227475247 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f789400c290 con 0x7f7894003a60 2023-10-08T15:37:51.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.897+0000 7f78aaffd700 1 --2- 172.21.15.3:0/227475247 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7894004810 0x7f7894004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:51.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.897+0000 7f78ab7fe700 1 --2- 172.21.15.3:0/227475247 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7894003a60 0x7f7894003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:51.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.897+0000 7f78abfff700 1 --2- 172.21.15.3:0/227475247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78940051c0 0x7f789400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:51.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.897+0000 7f78aaffd700 1 -- 172.21.15.3:0/227475247 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7894003a60 msgr2=0x7f7894003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:51.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.897+0000 7f78aaffd700 1 --2- 172.21.15.3:0/227475247 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7894003a60 0x7f7894003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:51.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.897+0000 7f78aaffd700 1 -- 172.21.15.3:0/227475247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78940051c0 msgr2=0x7f789400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:51.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.897+0000 7f78aaffd700 1 --2- 172.21.15.3:0/227475247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78940051c0 0x7f789400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:51.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.897+0000 7f78aaffd700 1 -- 172.21.15.3:0/227475247 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7894003570 con 0x7f7894004810 2023-10-08T15:37:51.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.897+0000 7f78abfff700 1 -- 172.21.15.3:0/227475247 reap_dead start 2023-10-08T15:37:51.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.897+0000 7f78ab7fe700 1 --2- 172.21.15.3:0/227475247 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7894003a60 0x7f7894003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:37:51.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.897+0000 7f78aaffd700 1 --2- 172.21.15.3:0/227475247 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7894004810 0x7f7894004c80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f78ac06bd80 tx=0x7f789c001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f194cd30fa1e832 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:51.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.897+0000 7f78aa7fc700 1 -- 172.21.15.3:0/227475247 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789c00cb80 con 0x7f7894004810 2023-10-08T15:37:51.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.897+0000 7f78aa7fc700 1 -- 172.21.15.3:0/227475247 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f789c00cce0 con 0x7f7894004810 2023-10-08T15:37:51.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.897+0000 7f78aa7fc700 1 -- 172.21.15.3:0/227475247 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789c005b50 con 0x7f7894004810 2023-10-08T15:37:51.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.901+0000 7f78b215b700 1 -- 172.21.15.3:0/227475247 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7894004810 msgr2=0x7f7894004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:51.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.901+0000 7f78b215b700 1 --2- 172.21.15.3:0/227475247 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7894004810 0x7f7894004c80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f78ac06bd80 tx=0x7f789c001e50 comp rx=0 tx=0).stop 2023-10-08T15:37:51.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.901+0000 7f78b215b700 1 -- 172.21.15.3:0/227475247 shutdown_connections 2023-10-08T15:37:51.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.901+0000 7f78b215b700 1 --2- 172.21.15.3:0/227475247 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7894004810 0x7f7894004c80 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:51.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.901+0000 7f78b215b700 1 -- 172.21.15.3:0/227475247 >> 172.21.15.3:0/227475247 conn(0x7f78ac0bdb60 msgr2=0x7f78ac0bdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:51.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.901+0000 7f78b215b700 1 -- 172.21.15.3:0/227475247 shutdown_connections 2023-10-08T15:37:51.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.901+0000 7f78b215b700 1 -- 172.21.15.3:0/227475247 wait complete. 2023-10-08T15:37:51.913 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.901+0000 7f78b215b700 1 Processor -- start 2023-10-08T15:37:51.913 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.901+0000 7f78b215b700 1 -- start start 2023-10-08T15:37:51.913 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.905+0000 7f78b215b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7894004810 0x7f78ac0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:51.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.905+0000 7f78b215b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f78ac149b00 0x7f78ac15b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:51.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.905+0000 7f78b215b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f78ac15b5d0 0x7f78ac06ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:51.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.905+0000 7f78b215b700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78ac14ad40 con 0x7f78ac15b5d0 2023-10-08T15:37:51.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.905+0000 7f78b215b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78ac14f620 con 0x7f7894004810 2023-10-08T15:37:51.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.905+0000 7f78b215b700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78ac14f890 con 0x7f78ac149b00 2023-10-08T15:37:51.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.905+0000 7f78aaffd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f78ac149b00 0x7f78ac15b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:51.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.905+0000 7f78ab7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7894004810 0x7f78ac0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:51.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.905+0000 7f78abfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f78ac15b5d0 0x7f78ac06ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:51.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.905+0000 7f78aaffd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f78ac149b00 0x7f78ac15b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.3:46066/0 (socket says 172.21.15.3:46066) 2023-10-08T15:37:51.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.905+0000 7f78ab7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7894004810 0x7f78ac0673c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.3:40090/0 (socket says 172.21.15.3:40090) 2023-10-08T15:37:51.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.905+0000 7f78aaffd700 1 -- 172.21.15.3:0/1074561877 learned_addr learned my addr 172.21.15.3:0/1074561877 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:51.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.905+0000 7f78ab7fe700 1 -- 172.21.15.3:0/1074561877 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f78ac149b00 msgr2=0x7f78ac15b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:51.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.905+0000 7f78ab7fe700 1 --2- 172.21.15.3:0/1074561877 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f78ac149b00 0x7f78ac15b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:51.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.905+0000 7f78ab7fe700 1 -- 172.21.15.3:0/1074561877 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f78ac15b5d0 msgr2=0x7f78ac06ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:51.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.905+0000 7f78ab7fe700 1 --2- 172.21.15.3:0/1074561877 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f78ac15b5d0 0x7f78ac06ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:51.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.905+0000 7f78ab7fe700 1 -- 172.21.15.3:0/1074561877 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ac14a930 con 0x7f7894004810 2023-10-08T15:37:51.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.905+0000 7f78abfff700 1 --2- 172.21.15.3:0/1074561877 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f78ac15b5d0 0x7f78ac06ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:37:51.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.905+0000 7f78ab7fe700 1 --2- 172.21.15.3:0/1074561877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7894004810 0x7f78ac0673c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f78ac0a2320 tx=0x7f78a0009040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:51.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.905+0000 7f78937fe700 1 -- 172.21.15.3:0/1074561877 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a0018070 con 0x7f7894004810 2023-10-08T15:37:51.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.905+0000 7f78937fe700 1 -- 172.21.15.3:0/1074561877 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a0006820 con 0x7f7894004810 2023-10-08T15:37:51.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.905+0000 7f78b215b700 1 -- 172.21.15.3:0/1074561877 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78ac067900 con 0x7f7894004810 2023-10-08T15:37:51.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.905+0000 7f78937fe700 1 -- 172.21.15.3:0/1074561877 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a0006be0 con 0x7f7894004810 2023-10-08T15:37:51.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.905+0000 7f78b215b700 1 -- 172.21.15.3:0/1074561877 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78ac14a4f0 con 0x7f7894004810 2023-10-08T15:37:51.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.905+0000 7f78b215b700 1 -- 172.21.15.3:0/1074561877 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78ac064530 con 0x7f7894004810 2023-10-08T15:37:51.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.909+0000 7f78937fe700 1 -- 172.21.15.3:0/1074561877 <== mon.1 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f78a0037b50 con 0x7f7894004810 2023-10-08T15:37:51.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.909+0000 7f78937fe700 1 --2- 172.21.15.3:0/1074561877 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7898060550 0x7f7898062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:51.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.909+0000 7f78937fe700 1 -- 172.21.15.3:0/1074561877 <== mon.1 v2:172.21.15.50:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f78a007c440 con 0x7f7894004810 2023-10-08T15:37:51.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.909+0000 7f78aaffd700 1 --2- 172.21.15.3:0/1074561877 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7898060550 0x7f7898062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:51.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.909+0000 7f78aaffd700 1 --2- 172.21.15.3:0/1074561877 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7898060550 0x7f7898062a00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f789c00ccb0 tx=0x7f789c015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:51.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:51.917+0000 7f78937fe700 1 -- 172.21.15.3:0/1074561877 <== mon.1 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f78a004c990 con 0x7f7894004810 2023-10-08T15:37:52.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.081+0000 7f78b215b700 1 -- 172.21.15.3:0/1074561877 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f78ac14a4f0 con 0x7f7894004810 2023-10-08T15:37:52.090 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.085+0000 7f78937fe700 1 -- 172.21.15.3:0/1074561877 <== mon.1 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15254 (secure 0 0 0) 0x7f78ac14a4f0 con 0x7f7894004810 2023-10-08T15:37:52.091 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:37:52.091 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":20,"fsid":"7635972e-cd66-4a8f-a231-378db8b3847a","created":"2023-10-08T15:37:08.234594+0000","modified":"2023-10-08T15:37:27.007828+0000","last_up_change":"2023-10-08T15:37:17.537726+0000","last_in_change":"2023-10-08T15:37:10.269178+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:37:16.581590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:37:23.353518+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T15:37:24.365114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"64fb1864-bfdd-4d75-9b41-03fb60085dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33363},{"type":"v1","addr":"172.21.15.3:6801","nonce":33363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33363},{"type":"v1","addr":"172.21.15.3:6803","nonce":33363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":33363},{"type":"v1","addr":"172.21.15.3:6807","nonce":33363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33363},{"type":"v1","addr":"172.21.15.3:6805","nonce":33363}]},"public_addr":"172.21.15.3:6801/33363","cluster_addr":"172.21.15.3:6803/33363","heartbeat_back_addr":"172.21.15.3:6807/33363","heartbeat_front_addr":"172.21.15.3:6805/33363","state":["exists","up"]},{"osd":1,"uuid":"3ca6bd3a-3e8a-4c65-af9c-46148b0c2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33364},{"type":"v1","addr":"172.21.15.3:6820","nonce":33364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33364},{"type":"v1","addr":"172.21.15.3:6824","nonce":33364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33364},{"type":"v1","addr":"172.21.15.3:6831","nonce":33364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33364},{"type":"v1","addr":"172.21.15.3:6828","nonce":33364}]},"public_addr":"172.21.15.3:6820/33364","cluster_addr":"172.21.15.3:6824/33364","heartbeat_back_addr":"172.21.15.3:6831/33364","heartbeat_front_addr":"172.21.15.3:6828/33364","state":["exists","up"]},{"osd":2,"uuid":"6eb9f757-58dd-442f-910d-32401454bce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33366},{"type":"v1","addr":"172.21.15.3:6817","nonce":33366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":33366},{"type":"v1","addr":"172.21.15.3:6821","nonce":33366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6827","nonce":33366},{"type":"v1","addr":"172.21.15.3:6829","nonce":33366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":33366},{"type":"v1","addr":"172.21.15.3:6825","nonce":33366}]},"public_addr":"172.21.15.3:6817/33366","cluster_addr":"172.21.15.3:6821/33366","heartbeat_back_addr":"172.21.15.3:6829/33366","heartbeat_front_addr":"172.21.15.3:6825/33366","state":["exists","up"]},{"osd":3,"uuid":"1c39866b-ac2e-4ea9-a69c-02b01ee4191d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33365},{"type":"v1","addr":"172.21.15.3:6809","nonce":33365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":33365},{"type":"v1","addr":"172.21.15.3:6811","nonce":33365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33365},{"type":"v1","addr":"172.21.15.3:6815","nonce":33365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":33365},{"type":"v1","addr":"172.21.15.3:6813","nonce":33365}]},"public_addr":"172.21.15.3:6809/33365","cluster_addr":"172.21.15.3:6811/33365","heartbeat_back_addr":"172.21.15.3:6815/33365","heartbeat_front_addr":"172.21.15.3:6813/33365","state":["exists","up"]},{"osd":4,"uuid":"15f86b61-b7f1-4780-ae00-9d80a68cb830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":33605},{"type":"v1","addr":"172.21.15.50:6809","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33605},{"type":"v1","addr":"172.21.15.50:6811","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33605},{"type":"v1","addr":"172.21.15.50:6815","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":33605},{"type":"v1","addr":"172.21.15.50:6813","nonce":33605}]},"public_addr":"172.21.15.50:6809/33605","cluster_addr":"172.21.15.50:6811/33605","heartbeat_back_addr":"172.21.15.50:6815/33605","heartbeat_front_addr":"172.21.15.50:6813/33605","state":["exists","up"]},{"osd":5,"uuid":"726c3003-34e6-4d5a-b6e2-f911e13c2118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33606},{"type":"v1","addr":"172.21.15.50:6801","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33606},{"type":"v1","addr":"172.21.15.50:6803","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33606},{"type":"v1","addr":"172.21.15.50:6807","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":33606},{"type":"v1","addr":"172.21.15.50:6805","nonce":33606}]},"public_addr":"172.21.15.50:6801/33606","cluster_addr":"172.21.15.50:6803/33606","heartbeat_back_addr":"172.21.15.50:6807/33606","heartbeat_front_addr":"172.21.15.50:6805/33606","state":["exists","up"]},{"osd":6,"uuid":"401122a4-9988-441f-a5a7-39164434ebcd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":33607},{"type":"v1","addr":"172.21.15.50:6819","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":33607},{"type":"v1","addr":"172.21.15.50:6823","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":33607},{"type":"v1","addr":"172.21.15.50:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":33607},{"type":"v1","addr":"172.21.15.50:6827","nonce":33607}]},"public_addr":"172.21.15.50:6819/33607","cluster_addr":"172.21.15.50:6823/33607","heartbeat_back_addr":"172.21.15.50:6831/33607","heartbeat_front_addr":"172.21.15.50:6827/33607","state":["exists","up"]},{"osd":7,"uuid":"6b3fa236-c9d0-4c4d-82ae-9af4daf6d699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33604},{"type":"v1","addr":"172.21.15.50:6818","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":33604},{"type":"v1","addr":"172.21.15.50:6822","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":33604},{"type":"v1","addr":"172.21.15.50:6830","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":33604},{"type":"v1","addr":"172.21.15.50:6826","nonce":33604}]},"public_addr":"172.21.15.50:6818/33604","cluster_addr":"172.21.15.50:6822/33604","heartbeat_back_addr":"172.21.15.50:6830/33604","heartbeat_front_addr":"172.21.15.50:6826/33604","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.497794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.529417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.873426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.325972+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.443971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.240795+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.739632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.643026+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:37:52.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.089+0000 7f78b215b700 1 -- 172.21.15.3:0/1074561877 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7898060550 msgr2=0x7f7898062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:52.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.089+0000 7f78b215b700 1 --2- 172.21.15.3:0/1074561877 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7898060550 0x7f7898062a00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f789c00ccb0 tx=0x7f789c015000 comp rx=0 tx=0).stop 2023-10-08T15:37:52.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.089+0000 7f78b215b700 1 -- 172.21.15.3:0/1074561877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7894004810 msgr2=0x7f78ac0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:52.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.089+0000 7f78b215b700 1 --2- 172.21.15.3:0/1074561877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7894004810 0x7f78ac0673c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f78ac0a2320 tx=0x7f78a0009040 comp rx=0 tx=0).stop 2023-10-08T15:37:52.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.089+0000 7f78b215b700 1 -- 172.21.15.3:0/1074561877 shutdown_connections 2023-10-08T15:37:52.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.089+0000 7f78b215b700 1 --2- 172.21.15.3:0/1074561877 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7898060550 0x7f7898062a00 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:52.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.089+0000 7f78b215b700 1 --2- 172.21.15.3:0/1074561877 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f78ac15b5d0 0x7f78ac06ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:52.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.089+0000 7f78b215b700 1 --2- 172.21.15.3:0/1074561877 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f78ac149b00 0x7f78ac15b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:52.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.089+0000 7f78b215b700 1 --2- 172.21.15.3:0/1074561877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7894004810 0x7f78ac0673c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:52.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.089+0000 7f78b215b700 1 -- 172.21.15.3:0/1074561877 >> 172.21.15.3:0/1074561877 conn(0x7f78ac0bdb60 msgr2=0x7f78ac150cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:52.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.089+0000 7f78b215b700 1 -- 172.21.15.3:0/1074561877 shutdown_connections 2023-10-08T15:37:52.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.089+0000 7f78b215b700 1 -- 172.21.15.3:0/1074561877 wait complete. 2023-10-08T15:37:52.110 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T15:37:16.581590+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T15:37:23.353518+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T15:37:24.365114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T15:37:52.111 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T15:37:52.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.217+0000 7fc826ab1700 1 Processor -- start 2023-10-08T15:37:52.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.217+0000 7fc826ab1700 1 -- start start 2023-10-08T15:37:52.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.221+0000 7fc826ab1700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc8200bf3a0 0x7fc82006cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:52.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.221+0000 7fc826ab1700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc82006c830 0x7fc82006d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:52.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.221+0000 7fc826ab1700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc82014c0e0 con 0x7fc82006d9d0 2023-10-08T15:37:52.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.221+0000 7fc826ab1700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc82014b8b0 con 0x7fc82006c830 2023-10-08T15:37:52.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.221+0000 7fc826ab1700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc82014c570 con 0x7fc8200bf3a0 2023-10-08T15:37:52.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.221+0000 7fc81ffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc82006c830 0x7fc82006d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:52.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.221+0000 7fc82484d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc8200bf3a0 0x7fc82006cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:52.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.221+0000 7fc82504e700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc82006d9d0 0x7fc82014ebd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.3:36954/0 (socket says 172.21.15.3:36954) 2023-10-08T15:37:52.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.221+0000 7fc81ffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc82006c830 0x7fc82006d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.3:40096/0 (socket says 172.21.15.3:40096) 2023-10-08T15:37:52.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.221+0000 7fc82504e700 1 -- 172.21.15.3:0/3724785912 learned_addr learned my addr 172.21.15.3:0/3724785912 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:52.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.221+0000 7fc81ffff700 1 -- 172.21.15.3:0/3724785912 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc8200bf3a0 msgr2=0x7fc82006cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:52.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.221+0000 7fc81ffff700 1 --2- 172.21.15.3:0/3724785912 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc8200bf3a0 0x7fc82006cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:52.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.221+0000 7fc81ffff700 1 -- 172.21.15.3:0/3724785912 >> v1:172.21.15.50:6789/0 conn(0x7fc82006d9d0 legacy=0x7fc82014ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:52.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.221+0000 7fc81ffff700 1 -- 172.21.15.3:0/3724785912 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc82014ba90 con 0x7fc82006c830 2023-10-08T15:37:52.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.221+0000 7fc81ffff700 1 --2- 172.21.15.3:0/3724785912 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc82006c830 0x7fc82006d490 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc8100098e0 tx=0x7fc8100091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5331ea77976a48fa server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:52.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.221+0000 7fc81f7fe700 1 -- 172.21.15.3:0/3724785912 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81000b640 con 0x7fc82006c830 2023-10-08T15:37:52.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.221+0000 7fc81f7fe700 1 -- 172.21.15.3:0/3724785912 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc81000b7a0 con 0x7fc82006c830 2023-10-08T15:37:52.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.221+0000 7fc81f7fe700 1 -- 172.21.15.3:0/3724785912 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81000bb40 con 0x7fc82006c830 2023-10-08T15:37:52.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.221+0000 7fc826ab1700 1 -- 172.21.15.3:0/3724785912 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc82006c830 msgr2=0x7fc82006d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:52.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.221+0000 7fc826ab1700 1 --2- 172.21.15.3:0/3724785912 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc82006c830 0x7fc82006d490 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc8100098e0 tx=0x7fc8100091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:52.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.221+0000 7fc826ab1700 1 -- 172.21.15.3:0/3724785912 shutdown_connections 2023-10-08T15:37:52.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.221+0000 7fc826ab1700 1 --2- 172.21.15.3:0/3724785912 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc82006c830 0x7fc82006d490 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:52.239 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.221+0000 7fc826ab1700 1 --2- 172.21.15.3:0/3724785912 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc8200bf3a0 0x7fc82006cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:52.239 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.221+0000 7fc826ab1700 1 -- 172.21.15.3:0/3724785912 >> 172.21.15.3:0/3724785912 conn(0x7fc8200c2a40 msgr2=0x7fc8200bea60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:52.239 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.221+0000 7fc826ab1700 1 -- 172.21.15.3:0/3724785912 shutdown_connections 2023-10-08T15:37:52.239 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.221+0000 7fc826ab1700 1 -- 172.21.15.3:0/3724785912 wait complete. 2023-10-08T15:37:52.239 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.225+0000 7fc826ab1700 1 Processor -- start 2023-10-08T15:37:52.239 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.225+0000 7fc826ab1700 1 -- start start 2023-10-08T15:37:52.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.225+0000 7fc826ab1700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc82006c830 0x7fc8201471a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:52.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.225+0000 7fc826ab1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc82006d9d0 0x7fc82014d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:52.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.225+0000 7fc826ab1700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc8200bf3a0 0x7fc82014f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:52.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.225+0000 7fc826ab1700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc820146360 con 0x7fc82006c830 2023-10-08T15:37:52.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.225+0000 7fc826ab1700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82015f900 con 0x7fc82006d9d0 2023-10-08T15:37:52.241 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.225+0000 7fc826ab1700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc82013e320 con 0x7fc8200bf3a0 2023-10-08T15:37:52.241 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.225+0000 7fc82484d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc82006c830 0x7fc8201471a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:52.241 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.225+0000 7fc82484d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc82006c830 0x7fc8201471a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59900/0 (socket says 172.21.15.3:59900) 2023-10-08T15:37:52.241 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.225+0000 7fc82484d700 1 -- 172.21.15.3:0/2264726661 learned_addr learned my addr 172.21.15.3:0/2264726661 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:52.241 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.225+0000 7fc81ffff700 1 --2- 172.21.15.3:0/2264726661 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc82006d9d0 0x7fc82014d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:52.241 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.225+0000 7fc82504e700 1 --2- 172.21.15.3:0/2264726661 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc8200bf3a0 0x7fc82014f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:52.242 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.225+0000 7fc82484d700 1 -- 172.21.15.3:0/2264726661 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc8200bf3a0 msgr2=0x7fc82014f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:52.242 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.225+0000 7fc82484d700 1 --2- 172.21.15.3:0/2264726661 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc8200bf3a0 0x7fc82014f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:52.242 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.225+0000 7fc82484d700 1 -- 172.21.15.3:0/2264726661 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc82006d9d0 msgr2=0x7fc82014d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:52.242 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.225+0000 7fc82484d700 1 --2- 172.21.15.3:0/2264726661 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc82006d9d0 0x7fc82014d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:52.242 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.225+0000 7fc82484d700 1 -- 172.21.15.3:0/2264726661 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc810009420 con 0x7fc82006c830 2023-10-08T15:37:52.243 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.225+0000 7fc82504e700 1 --2- 172.21.15.3:0/2264726661 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc8200bf3a0 0x7fc82014f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:37:52.243 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.225+0000 7fc81ffff700 1 --2- 172.21.15.3:0/2264726661 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc82006d9d0 0x7fc82014d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:37:52.243 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.225+0000 7fc82484d700 1 --2- 172.21.15.3:0/2264726661 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc82006c830 0x7fc8201471a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc80800ec80 tx=0x7fc8080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:52.243 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.225+0000 7fc81cff9700 1 -- 172.21.15.3:0/2264726661 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80800c850 con 0x7fc82006c830 2023-10-08T15:37:52.243 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.225+0000 7fc81cff9700 1 -- 172.21.15.3:0/2264726661 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc80800c9b0 con 0x7fc82006c830 2023-10-08T15:37:52.243 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.225+0000 7fc826ab1700 1 -- 172.21.15.3:0/2264726661 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc82014f940 con 0x7fc82006c830 2023-10-08T15:37:52.244 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.225+0000 7fc81cff9700 1 -- 172.21.15.3:0/2264726661 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80800cd50 con 0x7fc82006c830 2023-10-08T15:37:52.244 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.225+0000 7fc826ab1700 1 -- 172.21.15.3:0/2264726661 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc820148070 con 0x7fc82006c830 2023-10-08T15:37:52.244 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.229+0000 7fc826ab1700 1 -- 172.21.15.3:0/2264726661 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc820064530 con 0x7fc82006c830 2023-10-08T15:37:52.244 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.229+0000 7fc81cff9700 1 -- 172.21.15.3:0/2264726661 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc808013680 con 0x7fc82006c830 2023-10-08T15:37:52.246 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.229+0000 7fc81cff9700 1 --2- 172.21.15.3:0/2264726661 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc800060550 0x7fc800062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:52.246 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.229+0000 7fc81cff9700 1 -- 172.21.15.3:0/2264726661 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc80807ca90 con 0x7fc82006c830 2023-10-08T15:37:52.246 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.229+0000 7fc81ffff700 1 --2- 172.21.15.3:0/2264726661 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc800060550 0x7fc800062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:52.246 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.233+0000 7fc81ffff700 1 --2- 172.21.15.3:0/2264726661 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc800060550 0x7fc800062a00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc8100093f0 tx=0x7fc810017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:52.248 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.241+0000 7fc81cff9700 1 -- 172.21.15.3:0/2264726661 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc80804cfe0 con 0x7fc82006c830 2023-10-08T15:37:52.413 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.405+0000 7fc826ab1700 1 -- 172.21.15.3:0/2264726661 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc820147af0 con 0x7fc82006c830 2023-10-08T15:37:52.414 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.409+0000 7fc81cff9700 1 -- 172.21.15.3:0/2264726661 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc808050600 con 0x7fc82006c830 2023-10-08T15:37:52.414 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2023-10-08T15:37:52.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.409+0000 7fc826ab1700 1 -- 172.21.15.3:0/2264726661 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc800060550 msgr2=0x7fc800062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:52.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.409+0000 7fc826ab1700 1 --2- 172.21.15.3:0/2264726661 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc800060550 0x7fc800062a00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc8100093f0 tx=0x7fc810017000 comp rx=0 tx=0).stop 2023-10-08T15:37:52.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.409+0000 7fc826ab1700 1 -- 172.21.15.3:0/2264726661 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc82006c830 msgr2=0x7fc8201471a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:52.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.409+0000 7fc826ab1700 1 --2- 172.21.15.3:0/2264726661 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc82006c830 0x7fc8201471a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc80800ec80 tx=0x7fc8080091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:52.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.409+0000 7fc826ab1700 1 -- 172.21.15.3:0/2264726661 shutdown_connections 2023-10-08T15:37:52.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.409+0000 7fc826ab1700 1 --2- 172.21.15.3:0/2264726661 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc800060550 0x7fc800062a00 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:52.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.409+0000 7fc826ab1700 1 --2- 172.21.15.3:0/2264726661 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc8200bf3a0 0x7fc82014f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:52.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.409+0000 7fc826ab1700 1 --2- 172.21.15.3:0/2264726661 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc82006d9d0 0x7fc82014d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:52.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.409+0000 7fc826ab1700 1 --2- 172.21.15.3:0/2264726661 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc82006c830 0x7fc8201471a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:52.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.409+0000 7fc826ab1700 1 -- 172.21.15.3:0/2264726661 >> 172.21.15.3:0/2264726661 conn(0x7fc8200c2a40 msgr2=0x7fc820149a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:52.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.409+0000 7fc826ab1700 1 -- 172.21.15.3:0/2264726661 shutdown_connections 2023-10-08T15:37:52.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.409+0000 7fc826ab1700 1 -- 172.21.15.3:0/2264726661 wait complete. 2023-10-08T15:37:52.429 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T15:37:52.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.537+0000 7fbb12b12700 1 Processor -- start 2023-10-08T15:37:52.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.537+0000 7fbb12b12700 1 -- start start 2023-10-08T15:37:52.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.537+0000 7fbb12b12700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbb0c0b4380 0x7fbb0c0b2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:52.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.537+0000 7fbb12b12700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fbb0c149f90 0x7fbb0c148400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:52.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.537+0000 7fbb12b12700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb0c14a950 con 0x7fbb0c0b1e60 2023-10-08T15:37:52.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.537+0000 7fbb12b12700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb0c0b3a00 con 0x7fbb0c149f90 2023-10-08T15:37:52.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.537+0000 7fbb12b12700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0c0b3ce0 con 0x7fbb0c0b4380 2023-10-08T15:37:52.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.537+0000 7fbb110af700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fbb0c149f90 0x7fbb0c148400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:52.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.537+0000 7fbb110af700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fbb0c149f90 0x7fbb0c148400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59902/0 (socket says 172.21.15.3:59902) 2023-10-08T15:37:52.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.537+0000 7fbb110af700 1 -- 172.21.15.3:0/1293759070 learned_addr learned my addr 172.21.15.3:0/1293759070 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:52.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.537+0000 7fbb0bfff700 1 --2- 172.21.15.3:0/1293759070 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbb0c0b4380 0x7fbb0c0b2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:52.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.537+0000 7fbb110af700 1 -- 172.21.15.3:0/1293759070 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbb0c0b4380 msgr2=0x7fbb0c0b2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:52.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.537+0000 7fbb110af700 1 --2- 172.21.15.3:0/1293759070 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbb0c0b4380 0x7fbb0c0b2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:52.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.537+0000 7fbb110af700 1 -- 172.21.15.3:0/1293759070 >> v1:172.21.15.3:6789/0 conn(0x7fbb0c0b1e60 legacy=0x7fbb0c149880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:52.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.537+0000 7fbb110af700 1 -- 172.21.15.3:0/1293759070 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb0c0b2230 con 0x7fbb0c149f90 2023-10-08T15:37:52.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.541+0000 7fbb110af700 1 --2- 172.21.15.3:0/1293759070 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb0c149f90 0x7fbb0c148400 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbb04009f20 tx=0x7fbb04009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65a73aed758041ab server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:52.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.541+0000 7fbb0b7fe700 1 -- 172.21.15.3:0/1293759070 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0400e070 con 0x7fbb0c149f90 2023-10-08T15:37:52.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.541+0000 7fbb0b7fe700 1 -- 172.21.15.3:0/1293759070 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb0400ba80 con 0x7fbb0c149f90 2023-10-08T15:37:52.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.541+0000 7fbb0b7fe700 1 -- 172.21.15.3:0/1293759070 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb040092e0 con 0x7fbb0c149f90 2023-10-08T15:37:52.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.541+0000 7fbb12b12700 1 -- 172.21.15.3:0/1293759070 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb0c149f90 msgr2=0x7fbb0c148400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:52.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.541+0000 7fbb12b12700 1 --2- 172.21.15.3:0/1293759070 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb0c149f90 0x7fbb0c148400 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbb04009f20 tx=0x7fbb04009840 comp rx=0 tx=0).stop 2023-10-08T15:37:52.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.541+0000 7fbb12b12700 1 -- 172.21.15.3:0/1293759070 shutdown_connections 2023-10-08T15:37:52.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.541+0000 7fbb12b12700 1 --2- 172.21.15.3:0/1293759070 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb0c149f90 0x7fbb0c148400 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:52.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.541+0000 7fbb12b12700 1 --2- 172.21.15.3:0/1293759070 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbb0c0b4380 0x7fbb0c0b2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:52.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.541+0000 7fbb12b12700 1 -- 172.21.15.3:0/1293759070 >> 172.21.15.3:0/1293759070 conn(0x7fbb0c0be4f0 msgr2=0x7fbb0c0be8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:52.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.541+0000 7fbb12b12700 1 -- 172.21.15.3:0/1293759070 shutdown_connections 2023-10-08T15:37:52.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.541+0000 7fbb12b12700 1 -- 172.21.15.3:0/1293759070 wait complete. 2023-10-08T15:37:52.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.541+0000 7fbb12b12700 1 Processor -- start 2023-10-08T15:37:52.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.541+0000 7fbb12b12700 1 -- start start 2023-10-08T15:37:52.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.541+0000 7fbb12b12700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb0c0b1e60 0x7fbb0c15c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:52.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.541+0000 7fbb12b12700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb0c0b4380 0x7fbb0c0b5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:52.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.541+0000 7fbb12b12700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbb0c149f90 0x7fbb0c0b8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:52.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.541+0000 7fbb12b12700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0c0b9b80 con 0x7fbb0c0b4380 2023-10-08T15:37:52.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.541+0000 7fbb12b12700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0c15c9e0 con 0x7fbb0c0b1e60 2023-10-08T15:37:52.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.541+0000 7fbb12b12700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0c0b8c50 con 0x7fbb0c149f90 2023-10-08T15:37:52.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.541+0000 7fbb0bfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb0c0b4380 0x7fbb0c0b5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:52.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.541+0000 7fbb0bfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb0c0b4380 0x7fbb0c0b5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59908/0 (socket says 172.21.15.3:59908) 2023-10-08T15:37:52.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.541+0000 7fbb0bfff700 1 -- 172.21.15.3:0/3571867856 learned_addr learned my addr 172.21.15.3:0/3571867856 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:52.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.541+0000 7fbb108ae700 1 --2- 172.21.15.3:0/3571867856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb0c0b1e60 0x7fbb0c15c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:52.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.541+0000 7fbb110af700 1 --2- 172.21.15.3:0/3571867856 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbb0c149f90 0x7fbb0c0b8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:52.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.541+0000 7fbb0bfff700 1 -- 172.21.15.3:0/3571867856 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbb0c149f90 msgr2=0x7fbb0c0b8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:52.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.541+0000 7fbb0bfff700 1 --2- 172.21.15.3:0/3571867856 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbb0c149f90 0x7fbb0c0b8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:52.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.541+0000 7fbb0bfff700 1 -- 172.21.15.3:0/3571867856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb0c0b1e60 msgr2=0x7fbb0c15c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:52.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.541+0000 7fbb0bfff700 1 --2- 172.21.15.3:0/3571867856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb0c0b1e60 0x7fbb0c15c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:52.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.541+0000 7fbb0bfff700 1 -- 172.21.15.3:0/3571867856 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb04009ae0 con 0x7fbb0c0b4380 2023-10-08T15:37:52.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.541+0000 7fbb108ae700 1 --2- 172.21.15.3:0/3571867856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb0c0b1e60 0x7fbb0c15c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:37:52.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.541+0000 7fbb0bfff700 1 --2- 172.21.15.3:0/3571867856 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb0c0b4380 0x7fbb0c0b5c80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbaf800d860 tx=0x7fbaf8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:52.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.545+0000 7fbb08ff9700 1 -- 172.21.15.3:0/3571867856 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf8018070 con 0x7fbb0c0b4380 2023-10-08T15:37:52.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.545+0000 7fbb08ff9700 1 -- 172.21.15.3:0/3571867856 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaf80125f0 con 0x7fbb0c0b4380 2023-10-08T15:37:52.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.545+0000 7fbb12b12700 1 -- 172.21.15.3:0/3571867856 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb0c15c620 con 0x7fbb0c0b4380 2023-10-08T15:37:52.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.545+0000 7fbb08ff9700 1 -- 172.21.15.3:0/3571867856 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf80129b0 con 0x7fbb0c0b4380 2023-10-08T15:37:52.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.545+0000 7fbb12b12700 1 -- 172.21.15.3:0/3571867856 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb0c0b6360 con 0x7fbb0c0b4380 2023-10-08T15:37:52.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.545+0000 7fbb12b12700 1 -- 172.21.15.3:0/3571867856 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb0c15c840 con 0x7fbb0c0b4380 2023-10-08T15:37:52.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.545+0000 7fbb08ff9700 1 -- 172.21.15.3:0/3571867856 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fbaf8012d20 con 0x7fbb0c0b4380 2023-10-08T15:37:52.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.545+0000 7fbb08ff9700 1 --2- 172.21.15.3:0/3571867856 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbaf0060550 0x7fbaf0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:52.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.545+0000 7fbb08ff9700 1 -- 172.21.15.3:0/3571867856 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbaf807cb10 con 0x7fbb0c0b4380 2023-10-08T15:37:52.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.545+0000 7fbb108ae700 1 --2- 172.21.15.3:0/3571867856 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbaf0060550 0x7fbaf0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:52.555 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.549+0000 7fbb108ae700 1 --2- 172.21.15.3:0/3571867856 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbaf0060550 0x7fbaf0062a00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbb00007fd0 tx=0x7fbb00009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:52.562 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.557+0000 7fbb08ff9700 1 -- 172.21.15.3:0/3571867856 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbb0c15c840 con 0x7fbb0c0b4380 2023-10-08T15:37:52.721 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.713+0000 7fbb12b12700 1 -- 172.21.15.3:0/3571867856 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbb0c15c810 con 0x7fbb0c0b4380 2023-10-08T15:37:52.721 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.713+0000 7fbb08ff9700 1 -- 172.21.15.3:0/3571867856 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbaf8050b90 con 0x7fbb0c0b4380 2023-10-08T15:37:52.721 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 32 2023-10-08T15:37:52.726 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.721+0000 7fbb12b12700 1 -- 172.21.15.3:0/3571867856 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbaf0060550 msgr2=0x7fbaf0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:52.726 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.721+0000 7fbb12b12700 1 --2- 172.21.15.3:0/3571867856 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbaf0060550 0x7fbaf0062a00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbb00007fd0 tx=0x7fbb00009040 comp rx=0 tx=0).stop 2023-10-08T15:37:52.726 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.721+0000 7fbb12b12700 1 -- 172.21.15.3:0/3571867856 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb0c0b4380 msgr2=0x7fbb0c0b5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:52.726 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.721+0000 7fbb12b12700 1 --2- 172.21.15.3:0/3571867856 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb0c0b4380 0x7fbb0c0b5c80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbaf800d860 tx=0x7fbaf8008040 comp rx=0 tx=0).stop 2023-10-08T15:37:52.726 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.721+0000 7fbb12b12700 1 -- 172.21.15.3:0/3571867856 shutdown_connections 2023-10-08T15:37:52.727 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.721+0000 7fbb12b12700 1 --2- 172.21.15.3:0/3571867856 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbaf0060550 0x7fbaf0062a00 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:52.727 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.721+0000 7fbb12b12700 1 --2- 172.21.15.3:0/3571867856 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbb0c149f90 0x7fbb0c0b8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:52.727 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.721+0000 7fbb12b12700 1 --2- 172.21.15.3:0/3571867856 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb0c0b4380 0x7fbb0c0b5c80 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:52.727 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.721+0000 7fbb12b12700 1 --2- 172.21.15.3:0/3571867856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb0c0b1e60 0x7fbb0c15c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:52.727 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.721+0000 7fbb12b12700 1 -- 172.21.15.3:0/3571867856 >> 172.21.15.3:0/3571867856 conn(0x7fbb0c0be4f0 msgr2=0x7fbb0c148280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:52.727 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.721+0000 7fbb12b12700 1 -- 172.21.15.3:0/3571867856 shutdown_connections 2023-10-08T15:37:52.727 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.721+0000 7fbb12b12700 1 -- 172.21.15.3:0/3571867856 wait complete. 2023-10-08T15:37:52.741 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T15:37:52.858 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.853+0000 7fbf5c1d4700 1 Processor -- start 2023-10-08T15:37:52.858 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.853+0000 7fbf5c1d4700 1 -- start start 2023-10-08T15:37:52.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.853+0000 7fbf5c1d4700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbf540bf3a0 0x7fbf5406cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:52.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.853+0000 7fbf5c1d4700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbf5406c830 0x7fbf5406d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:52.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.853+0000 7fbf5c1d4700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf5414c0e0 con 0x7fbf5406d9d0 2023-10-08T15:37:52.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.853+0000 7fbf5c1d4700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf5414b8b0 con 0x7fbf540bf3a0 2023-10-08T15:37:52.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.853+0000 7fbf5c1d4700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5414c570 con 0x7fbf5406c830 2023-10-08T15:37:52.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.853+0000 7fbf5976f700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbf5406c830 0x7fbf5406d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:52.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.853+0000 7fbf59f70700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbf540bf3a0 0x7fbf5406cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:52.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.853+0000 7fbf5976f700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbf5406c830 0x7fbf5406d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.3:46096/0 (socket says 172.21.15.3:46096) 2023-10-08T15:37:52.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.853+0000 7fbf5976f700 1 -- 172.21.15.3:0/2197585446 learned_addr learned my addr 172.21.15.3:0/2197585446 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:52.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.853+0000 7fbf5976f700 1 -- 172.21.15.3:0/2197585446 >> v2:172.21.15.50:3300/0 conn(0x7fbf540bf3a0 msgr2=0x7fbf5406cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:52.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.853+0000 7fbf5976f700 1 --2- 172.21.15.3:0/2197585446 >> v2:172.21.15.50:3300/0 conn(0x7fbf540bf3a0 0x7fbf5406cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:52.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.853+0000 7fbf5976f700 1 -- 172.21.15.3:0/2197585446 >> v1:172.21.15.50:6789/0 conn(0x7fbf5406d9d0 legacy=0x7fbf5414ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:52.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.853+0000 7fbf5976f700 1 -- 172.21.15.3:0/2197585446 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf5414ba90 con 0x7fbf5406c830 2023-10-08T15:37:52.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.853+0000 7fbf59f70700 1 --2- 172.21.15.3:0/2197585446 >> v2:172.21.15.50:3300/0 conn(0x7fbf540bf3a0 0x7fbf5406cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:37:52.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.853+0000 7fbf5976f700 1 --2- 172.21.15.3:0/2197585446 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbf5406c830 0x7fbf5406d490 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbf440099b0 tx=0x7fbf44009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58101f7db4c7f55a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:52.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.853+0000 7fbf58f6e700 1 -- 172.21.15.3:0/2197585446 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf44009ea0 con 0x7fbf5406c830 2023-10-08T15:37:52.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.853+0000 7fbf58f6e700 1 -- 172.21.15.3:0/2197585446 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf4400b860 con 0x7fbf5406c830 2023-10-08T15:37:52.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.853+0000 7fbf58f6e700 1 -- 172.21.15.3:0/2197585446 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4400bc00 con 0x7fbf5406c830 2023-10-08T15:37:52.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.857+0000 7fbf5c1d4700 1 -- 172.21.15.3:0/2197585446 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbf5406c830 msgr2=0x7fbf5406d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:52.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.857+0000 7fbf5c1d4700 1 --2- 172.21.15.3:0/2197585446 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbf5406c830 0x7fbf5406d490 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbf440099b0 tx=0x7fbf44009250 comp rx=0 tx=0).stop 2023-10-08T15:37:52.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.857+0000 7fbf5c1d4700 1 -- 172.21.15.3:0/2197585446 shutdown_connections 2023-10-08T15:37:52.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.857+0000 7fbf5c1d4700 1 --2- 172.21.15.3:0/2197585446 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbf5406c830 0x7fbf5406d490 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:52.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.857+0000 7fbf5c1d4700 1 --2- 172.21.15.3:0/2197585446 >> v2:172.21.15.50:3300/0 conn(0x7fbf540bf3a0 0x7fbf5406cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:52.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.857+0000 7fbf5c1d4700 1 -- 172.21.15.3:0/2197585446 >> 172.21.15.3:0/2197585446 conn(0x7fbf540c2a40 msgr2=0x7fbf540bea60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:52.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.857+0000 7fbf5c1d4700 1 -- 172.21.15.3:0/2197585446 shutdown_connections 2023-10-08T15:37:52.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.857+0000 7fbf5c1d4700 1 -- 172.21.15.3:0/2197585446 wait complete. 2023-10-08T15:37:52.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.857+0000 7fbf5c1d4700 1 Processor -- start 2023-10-08T15:37:52.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.857+0000 7fbf5c1d4700 1 -- start start 2023-10-08T15:37:52.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.857+0000 7fbf5c1d4700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbf5406c830 0x7fbf54147310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:52.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.857+0000 7fbf5c1d4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf5406d9d0 0x7fbf541484b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:52.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.857+0000 7fbf5c1d4700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbf540bf3a0 0x7fbf541489f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:52.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.857+0000 7fbf5c1d4700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf54148f30 con 0x7fbf540bf3a0 2023-10-08T15:37:52.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.857+0000 7fbf5c1d4700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5413e9f0 con 0x7fbf5406d9d0 2023-10-08T15:37:52.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.857+0000 7fbf5c1d4700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf54141080 con 0x7fbf5406c830 2023-10-08T15:37:52.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.857+0000 7fbf5a771700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbf540bf3a0 0x7fbf541489f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:52.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.857+0000 7fbf59f70700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbf5406c830 0x7fbf54147310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:52.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.857+0000 7fbf5a771700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbf540bf3a0 0x7fbf541489f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59914/0 (socket says 172.21.15.3:59914) 2023-10-08T15:37:52.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.857+0000 7fbf5a771700 1 -- 172.21.15.3:0/3097345444 learned_addr learned my addr 172.21.15.3:0/3097345444 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:52.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.857+0000 7fbf5976f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf5406d9d0 0x7fbf541484b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:52.867 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.857+0000 7fbf5a771700 1 -- 172.21.15.3:0/3097345444 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbf5406c830 msgr2=0x7fbf54147310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:52.867 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.857+0000 7fbf5a771700 1 --2- 172.21.15.3:0/3097345444 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbf5406c830 0x7fbf54147310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:52.867 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.857+0000 7fbf5a771700 1 -- 172.21.15.3:0/3097345444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf5406d9d0 msgr2=0x7fbf541484b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:52.867 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.857+0000 7fbf5a771700 1 --2- 172.21.15.3:0/3097345444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf5406d9d0 0x7fbf541484b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:52.867 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.857+0000 7fbf5a771700 1 -- 172.21.15.3:0/3097345444 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf50009420 con 0x7fbf540bf3a0 2023-10-08T15:37:52.867 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.861+0000 7fbf5976f700 1 --2- 172.21.15.3:0/3097345444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf5406d9d0 0x7fbf541484b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:37:52.867 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.861+0000 7fbf5a771700 1 --2- 172.21.15.3:0/3097345444 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbf540bf3a0 0x7fbf541489f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c00c910 tx=0x7fbf4c001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:52.867 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.861+0000 7fbf49ffb700 1 -- 172.21.15.3:0/3097345444 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c012630 con 0x7fbf540bf3a0 2023-10-08T15:37:52.867 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.861+0000 7fbf5c1d4700 1 -- 172.21.15.3:0/3097345444 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf440094f0 con 0x7fbf540bf3a0 2023-10-08T15:37:52.867 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.861+0000 7fbf49ffb700 1 -- 172.21.15.3:0/3097345444 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf4c0127b0 con 0x7fbf540bf3a0 2023-10-08T15:37:52.868 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.861+0000 7fbf49ffb700 1 -- 172.21.15.3:0/3097345444 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c012b70 con 0x7fbf540bf3a0 2023-10-08T15:37:52.868 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.861+0000 7fbf5c1d4700 1 -- 172.21.15.3:0/3097345444 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf54148040 con 0x7fbf540bf3a0 2023-10-08T15:37:52.868 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.861+0000 7fbf5c1d4700 1 -- 172.21.15.3:0/3097345444 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf54064530 con 0x7fbf540bf3a0 2023-10-08T15:37:52.869 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.865+0000 7fbf49ffb700 1 -- 172.21.15.3:0/3097345444 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fbf4c003030 con 0x7fbf540bf3a0 2023-10-08T15:37:52.870 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.865+0000 7fbf49ffb700 1 --2- 172.21.15.3:0/3097345444 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbf38060580 0x7fbf38062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:52.870 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.865+0000 7fbf49ffb700 1 -- 172.21.15.3:0/3097345444 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbf4c07c710 con 0x7fbf540bf3a0 2023-10-08T15:37:52.870 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.865+0000 7fbf59f70700 1 --2- 172.21.15.3:0/3097345444 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbf38060580 0x7fbf38062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:52.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.865+0000 7fbf59f70700 1 --2- 172.21.15.3:0/3097345444 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbf38060580 0x7fbf38062a30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbf54147b50 tx=0x7fbf500091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:52.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:52.873+0000 7fbf49ffb700 1 -- 172.21.15.3:0/3097345444 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbf4c04cd00 con 0x7fbf540bf3a0 2023-10-08T15:37:53.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.037+0000 7fbf5c1d4700 1 -- 172.21.15.3:0/3097345444 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbf5414bd70 con 0x7fbf540bf3a0 2023-10-08T15:37:53.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.037+0000 7fbf49ffb700 1 -- 172.21.15.3:0/3097345444 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbf4c050320 con 0x7fbf540bf3a0 2023-10-08T15:37:53.042 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 64 2023-10-08T15:37:53.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.037+0000 7fbf5c1d4700 1 -- 172.21.15.3:0/3097345444 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbf38060580 msgr2=0x7fbf38062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:53.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.037+0000 7fbf5c1d4700 1 --2- 172.21.15.3:0/3097345444 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbf38060580 0x7fbf38062a30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbf54147b50 tx=0x7fbf500091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:53.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.037+0000 7fbf5c1d4700 1 -- 172.21.15.3:0/3097345444 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbf540bf3a0 msgr2=0x7fbf541489f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:53.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.037+0000 7fbf5c1d4700 1 --2- 172.21.15.3:0/3097345444 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbf540bf3a0 0x7fbf541489f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c00c910 tx=0x7fbf4c001710 comp rx=0 tx=0).stop 2023-10-08T15:37:53.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.037+0000 7fbf5c1d4700 1 -- 172.21.15.3:0/3097345444 shutdown_connections 2023-10-08T15:37:53.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.037+0000 7fbf5c1d4700 1 --2- 172.21.15.3:0/3097345444 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbf38060580 0x7fbf38062a30 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:53.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.037+0000 7fbf5c1d4700 1 --2- 172.21.15.3:0/3097345444 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbf540bf3a0 0x7fbf541489f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:53.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.037+0000 7fbf5c1d4700 1 --2- 172.21.15.3:0/3097345444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf5406d9d0 0x7fbf541484b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:53.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.037+0000 7fbf5c1d4700 1 --2- 172.21.15.3:0/3097345444 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbf5406c830 0x7fbf54147310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:53.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.037+0000 7fbf5c1d4700 1 -- 172.21.15.3:0/3097345444 >> 172.21.15.3:0/3097345444 conn(0x7fbf540c2a40 msgr2=0x7fbf54068c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:53.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.037+0000 7fbf5c1d4700 1 -- 172.21.15.3:0/3097345444 shutdown_connections 2023-10-08T15:37:53.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.037+0000 7fbf5c1d4700 1 -- 172.21.15.3:0/3097345444 wait complete. 2023-10-08T15:37:53.056 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:37:53.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.153+0000 7f523de49700 1 Processor -- start 2023-10-08T15:37:53.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.153+0000 7f523de49700 1 -- start start 2023-10-08T15:37:53.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.153+0000 7f523de49700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f523806cd70 0x7f523806ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:53.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.153+0000 7f523de49700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f52380bbac0 0x7f523814b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:53.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.153+0000 7f523de49700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f523806d570 con 0x7f523814bbd0 2023-10-08T15:37:53.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.153+0000 7f523de49700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f523806c9a0 con 0x7f52380bbac0 2023-10-08T15:37:53.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.153+0000 7f523de49700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f523806d850 con 0x7f523806cd70 2023-10-08T15:37:53.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.153+0000 7f5237fff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f52380bbac0 0x7f523814b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:53.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.153+0000 7f523ce47700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f523806cd70 0x7f523806ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:53.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.153+0000 7f5237fff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f52380bbac0 0x7f523814b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59924/0 (socket says 172.21.15.3:59924) 2023-10-08T15:37:53.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.153+0000 7f5237fff700 1 -- 172.21.15.3:0/2847886815 learned_addr learned my addr 172.21.15.3:0/2847886815 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:53.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.153+0000 7f5237fff700 1 -- 172.21.15.3:0/2847886815 >> v2:172.21.15.50:3300/0 conn(0x7f523806cd70 msgr2=0x7f523806ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:53.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.153+0000 7f5237fff700 1 --2- 172.21.15.3:0/2847886815 >> v2:172.21.15.50:3300/0 conn(0x7f523806cd70 0x7f523806ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:53.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.153+0000 7f5237fff700 1 -- 172.21.15.3:0/2847886815 >> v1:172.21.15.50:6789/0 conn(0x7f523814bbd0 legacy=0x7f5238147390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:53.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.153+0000 7f5237fff700 1 -- 172.21.15.3:0/2847886815 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5238069110 con 0x7f52380bbac0 2023-10-08T15:37:53.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.153+0000 7f523ce47700 1 --2- 172.21.15.3:0/2847886815 >> v2:172.21.15.50:3300/0 conn(0x7f523806cd70 0x7f523806ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:37:53.163 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.157+0000 7f5237fff700 1 --2- 172.21.15.3:0/2847886815 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f52380bbac0 0x7f523814b690 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f523806a310 tx=0x7f522c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b96edbb354808a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:53.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.157+0000 7f52377fe700 1 -- 172.21.15.3:0/2847886815 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522c009e70 con 0x7f52380bbac0 2023-10-08T15:37:53.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.157+0000 7f52377fe700 1 -- 172.21.15.3:0/2847886815 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f522c00b860 con 0x7f52380bbac0 2023-10-08T15:37:53.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.157+0000 7f52377fe700 1 -- 172.21.15.3:0/2847886815 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522c00bc00 con 0x7f52380bbac0 2023-10-08T15:37:53.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.157+0000 7f523de49700 1 -- 172.21.15.3:0/2847886815 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f52380bbac0 msgr2=0x7f523814b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:53.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.157+0000 7f523de49700 1 --2- 172.21.15.3:0/2847886815 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f52380bbac0 0x7f523814b690 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f523806a310 tx=0x7f522c009250 comp rx=0 tx=0).stop 2023-10-08T15:37:53.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.157+0000 7f523de49700 1 -- 172.21.15.3:0/2847886815 shutdown_connections 2023-10-08T15:37:53.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.157+0000 7f523de49700 1 --2- 172.21.15.3:0/2847886815 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f52380bbac0 0x7f523814b690 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:53.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.157+0000 7f523de49700 1 --2- 172.21.15.3:0/2847886815 >> v2:172.21.15.50:3300/0 conn(0x7f523806cd70 0x7f523806ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:53.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.157+0000 7f523de49700 1 -- 172.21.15.3:0/2847886815 >> 172.21.15.3:0/2847886815 conn(0x7f52380670e0 msgr2=0x7f52380674e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:53.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.157+0000 7f523de49700 1 -- 172.21.15.3:0/2847886815 shutdown_connections 2023-10-08T15:37:53.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.157+0000 7f523de49700 1 -- 172.21.15.3:0/2847886815 wait complete. 2023-10-08T15:37:53.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.161+0000 7f523de49700 1 Processor -- start 2023-10-08T15:37:53.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.161+0000 7f523de49700 1 -- start start 2023-10-08T15:37:53.168 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.161+0000 7f523de49700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f523806cd70 0x7f523815bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:53.168 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.161+0000 7f523de49700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f52380bbac0 0x7f52381503b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:53.168 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.161+0000 7f523de49700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f523814bbd0 0x7f52381444a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:53.168 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.161+0000 7f523de49700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f523815b310 con 0x7f523814bbd0 2023-10-08T15:37:53.168 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.161+0000 7f523de49700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f523815bb50 con 0x7f523806cd70 2023-10-08T15:37:53.168 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.161+0000 7f523de49700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f523815b500 con 0x7f52380bbac0 2023-10-08T15:37:53.168 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.161+0000 7f523d648700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f523814bbd0 0x7f52381444a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:53.169 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.161+0000 7f523d648700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f523814bbd0 0x7f52381444a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59940/0 (socket says 172.21.15.3:59940) 2023-10-08T15:37:53.169 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.161+0000 7f523d648700 1 -- 172.21.15.3:0/3961221451 learned_addr learned my addr 172.21.15.3:0/3961221451 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:53.169 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.161+0000 7f523ce47700 1 --2- 172.21.15.3:0/3961221451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f523806cd70 0x7f523815bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:53.169 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.161+0000 7f5237fff700 1 --2- 172.21.15.3:0/3961221451 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f52380bbac0 0x7f52381503b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:53.169 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.161+0000 7f523d648700 1 -- 172.21.15.3:0/3961221451 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f52380bbac0 msgr2=0x7f52381503b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:53.169 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.161+0000 7f523d648700 1 --2- 172.21.15.3:0/3961221451 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f52380bbac0 0x7f52381503b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:53.169 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.161+0000 7f523d648700 1 -- 172.21.15.3:0/3961221451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f523806cd70 msgr2=0x7f523815bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:53.169 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.161+0000 7f523d648700 1 --2- 172.21.15.3:0/3961221451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f523806cd70 0x7f523815bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:53.169 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.161+0000 7f523d648700 1 -- 172.21.15.3:0/3961221451 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5230009a20 con 0x7f523814bbd0 2023-10-08T15:37:53.169 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.161+0000 7f5237fff700 1 --2- 172.21.15.3:0/3961221451 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f52380bbac0 0x7f52381503b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:37:53.169 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.161+0000 7f523ce47700 1 --2- 172.21.15.3:0/3961221451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f523806cd70 0x7f523815bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:37:53.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.161+0000 7f523d648700 1 --2- 172.21.15.3:0/3961221451 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f523814bbd0 0x7f52381444a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f522800c4c0 tx=0x7f5228007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:53.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.161+0000 7f5234ff9700 1 -- 172.21.15.3:0/3961221451 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5228011590 con 0x7f523814bbd0 2023-10-08T15:37:53.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.161+0000 7f5234ff9700 1 -- 172.21.15.3:0/3961221451 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5228011710 con 0x7f523814bbd0 2023-10-08T15:37:53.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.161+0000 7f523de49700 1 -- 172.21.15.3:0/3961221451 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f522c0094f0 con 0x7f523814bbd0 2023-10-08T15:37:53.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.161+0000 7f5234ff9700 1 -- 172.21.15.3:0/3961221451 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5228011ad0 con 0x7f523814bbd0 2023-10-08T15:37:53.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.161+0000 7f523de49700 1 -- 172.21.15.3:0/3961221451 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5238150db0 con 0x7f523814bbd0 2023-10-08T15:37:53.171 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.165+0000 7f523de49700 1 -- 172.21.15.3:0/3961221451 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f523805ecf0 con 0x7f523814bbd0 2023-10-08T15:37:53.171 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.165+0000 7f5234ff9700 1 -- 172.21.15.3:0/3961221451 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f522801b3b0 con 0x7f523814bbd0 2023-10-08T15:37:53.171 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.165+0000 7f5234ff9700 1 --2- 172.21.15.3:0/3961221451 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5224060550 0x7f5224062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:53.171 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.165+0000 7f5234ff9700 1 -- 172.21.15.3:0/3961221451 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f522807bbb0 con 0x7f523814bbd0 2023-10-08T15:37:53.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.165+0000 7f523ce47700 1 --2- 172.21.15.3:0/3961221451 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5224060550 0x7f5224062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:53.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.165+0000 7f523ce47700 1 --2- 172.21.15.3:0/3961221451 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5224060550 0x7f5224062a00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f52300099f0 tx=0x7f523000b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:53.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.173+0000 7f5234ff9700 1 -- 172.21.15.3:0/3961221451 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f522804c1a0 con 0x7f523814bbd0 2023-10-08T15:37:53.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.337+0000 7f523de49700 1 -- 172.21.15.3:0/3961221451 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f523815bc90 con 0x7f523814bbd0 2023-10-08T15:37:53.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.341+0000 7f5234ff9700 1 -- 172.21.15.3:0/3961221451 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15254 (secure 0 0 0) 0x7f522804f7c0 con 0x7f523814bbd0 2023-10-08T15:37:53.347 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:37:53.347 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":20,"fsid":"7635972e-cd66-4a8f-a231-378db8b3847a","created":"2023-10-08T15:37:08.234594+0000","modified":"2023-10-08T15:37:27.007828+0000","last_up_change":"2023-10-08T15:37:17.537726+0000","last_in_change":"2023-10-08T15:37:10.269178+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:37:16.581590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:37:23.353518+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T15:37:24.365114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"64fb1864-bfdd-4d75-9b41-03fb60085dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33363},{"type":"v1","addr":"172.21.15.3:6801","nonce":33363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33363},{"type":"v1","addr":"172.21.15.3:6803","nonce":33363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":33363},{"type":"v1","addr":"172.21.15.3:6807","nonce":33363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33363},{"type":"v1","addr":"172.21.15.3:6805","nonce":33363}]},"public_addr":"172.21.15.3:6801/33363","cluster_addr":"172.21.15.3:6803/33363","heartbeat_back_addr":"172.21.15.3:6807/33363","heartbeat_front_addr":"172.21.15.3:6805/33363","state":["exists","up"]},{"osd":1,"uuid":"3ca6bd3a-3e8a-4c65-af9c-46148b0c2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33364},{"type":"v1","addr":"172.21.15.3:6820","nonce":33364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33364},{"type":"v1","addr":"172.21.15.3:6824","nonce":33364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33364},{"type":"v1","addr":"172.21.15.3:6831","nonce":33364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33364},{"type":"v1","addr":"172.21.15.3:6828","nonce":33364}]},"public_addr":"172.21.15.3:6820/33364","cluster_addr":"172.21.15.3:6824/33364","heartbeat_back_addr":"172.21.15.3:6831/33364","heartbeat_front_addr":"172.21.15.3:6828/33364","state":["exists","up"]},{"osd":2,"uuid":"6eb9f757-58dd-442f-910d-32401454bce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33366},{"type":"v1","addr":"172.21.15.3:6817","nonce":33366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":33366},{"type":"v1","addr":"172.21.15.3:6821","nonce":33366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6827","nonce":33366},{"type":"v1","addr":"172.21.15.3:6829","nonce":33366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":33366},{"type":"v1","addr":"172.21.15.3:6825","nonce":33366}]},"public_addr":"172.21.15.3:6817/33366","cluster_addr":"172.21.15.3:6821/33366","heartbeat_back_addr":"172.21.15.3:6829/33366","heartbeat_front_addr":"172.21.15.3:6825/33366","state":["exists","up"]},{"osd":3,"uuid":"1c39866b-ac2e-4ea9-a69c-02b01ee4191d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33365},{"type":"v1","addr":"172.21.15.3:6809","nonce":33365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":33365},{"type":"v1","addr":"172.21.15.3:6811","nonce":33365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33365},{"type":"v1","addr":"172.21.15.3:6815","nonce":33365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":33365},{"type":"v1","addr":"172.21.15.3:6813","nonce":33365}]},"public_addr":"172.21.15.3:6809/33365","cluster_addr":"172.21.15.3:6811/33365","heartbeat_back_addr":"172.21.15.3:6815/33365","heartbeat_front_addr":"172.21.15.3:6813/33365","state":["exists","up"]},{"osd":4,"uuid":"15f86b61-b7f1-4780-ae00-9d80a68cb830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":33605},{"type":"v1","addr":"172.21.15.50:6809","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33605},{"type":"v1","addr":"172.21.15.50:6811","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33605},{"type":"v1","addr":"172.21.15.50:6815","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":33605},{"type":"v1","addr":"172.21.15.50:6813","nonce":33605}]},"public_addr":"172.21.15.50:6809/33605","cluster_addr":"172.21.15.50:6811/33605","heartbeat_back_addr":"172.21.15.50:6815/33605","heartbeat_front_addr":"172.21.15.50:6813/33605","state":["exists","up"]},{"osd":5,"uuid":"726c3003-34e6-4d5a-b6e2-f911e13c2118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33606},{"type":"v1","addr":"172.21.15.50:6801","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33606},{"type":"v1","addr":"172.21.15.50:6803","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33606},{"type":"v1","addr":"172.21.15.50:6807","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":33606},{"type":"v1","addr":"172.21.15.50:6805","nonce":33606}]},"public_addr":"172.21.15.50:6801/33606","cluster_addr":"172.21.15.50:6803/33606","heartbeat_back_addr":"172.21.15.50:6807/33606","heartbeat_front_addr":"172.21.15.50:6805/33606","state":["exists","up"]},{"osd":6,"uuid":"401122a4-9988-441f-a5a7-39164434ebcd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":33607},{"type":"v1","addr":"172.21.15.50:6819","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":33607},{"type":"v1","addr":"172.21.15.50:6823","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":33607},{"type":"v1","addr":"172.21.15.50:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":33607},{"type":"v1","addr":"172.21.15.50:6827","nonce":33607}]},"public_addr":"172.21.15.50:6819/33607","cluster_addr":"172.21.15.50:6823/33607","heartbeat_back_addr":"172.21.15.50:6831/33607","heartbeat_front_addr":"172.21.15.50:6827/33607","state":["exists","up"]},{"osd":7,"uuid":"6b3fa236-c9d0-4c4d-82ae-9af4daf6d699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33604},{"type":"v1","addr":"172.21.15.50:6818","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":33604},{"type":"v1","addr":"172.21.15.50:6822","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":33604},{"type":"v1","addr":"172.21.15.50:6830","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":33604},{"type":"v1","addr":"172.21.15.50:6826","nonce":33604}]},"public_addr":"172.21.15.50:6818/33604","cluster_addr":"172.21.15.50:6822/33604","heartbeat_back_addr":"172.21.15.50:6830/33604","heartbeat_front_addr":"172.21.15.50:6826/33604","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.497794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.529417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.873426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.325972+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.443971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.240795+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.739632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.643026+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:37:53.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.345+0000 7f523de49700 1 -- 172.21.15.3:0/3961221451 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5224060550 msgr2=0x7f5224062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:53.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.345+0000 7f523de49700 1 --2- 172.21.15.3:0/3961221451 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5224060550 0x7f5224062a00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f52300099f0 tx=0x7f523000b040 comp rx=0 tx=0).stop 2023-10-08T15:37:53.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.345+0000 7f523de49700 1 -- 172.21.15.3:0/3961221451 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f523814bbd0 msgr2=0x7f52381444a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:53.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.345+0000 7f523de49700 1 --2- 172.21.15.3:0/3961221451 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f523814bbd0 0x7f52381444a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f522800c4c0 tx=0x7f5228007f50 comp rx=0 tx=0).stop 2023-10-08T15:37:53.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.345+0000 7f523de49700 1 -- 172.21.15.3:0/3961221451 shutdown_connections 2023-10-08T15:37:53.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.345+0000 7f523de49700 1 --2- 172.21.15.3:0/3961221451 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5224060550 0x7f5224062a00 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:53.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.345+0000 7f523de49700 1 --2- 172.21.15.3:0/3961221451 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f523814bbd0 0x7f52381444a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:53.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.345+0000 7f523de49700 1 --2- 172.21.15.3:0/3961221451 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f52380bbac0 0x7f52381503b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:53.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.345+0000 7f523de49700 1 --2- 172.21.15.3:0/3961221451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f523806cd70 0x7f523815bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:53.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.345+0000 7f523de49700 1 -- 172.21.15.3:0/3961221451 >> 172.21.15.3:0/3961221451 conn(0x7f52380670e0 msgr2=0x7f52380be900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:53.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.345+0000 7f523de49700 1 -- 172.21.15.3:0/3961221451 shutdown_connections 2023-10-08T15:37:53.352 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.345+0000 7f523de49700 1 -- 172.21.15.3:0/3961221451 wait complete. 2023-10-08T15:37:53.366 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T15:37:16.581590+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T15:37:23.353518+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T15:37:24.365114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T15:37:53.367 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T15:37:53.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.473+0000 7f7a1e8b0700 1 Processor -- start 2023-10-08T15:37:53.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.473+0000 7f7a1e8b0700 1 -- start start 2023-10-08T15:37:53.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.473+0000 7f7a1e8b0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7a18067e20 0x7f7a1814c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:53.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.473+0000 7f7a1e8b0700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7a1814d280 0x7f7a1814a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:53.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.473+0000 7f7a1e8b0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a1814b970 con 0x7f7a1806e6f0 2023-10-08T15:37:53.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.473+0000 7f7a1e8b0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a1806e2b0 con 0x7f7a18067e20 2023-10-08T15:37:53.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.473+0000 7f7a1e8b0700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1814bc50 con 0x7f7a1814d280 2023-10-08T15:37:53.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.473+0000 7f7a1ce4d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7a1814d280 0x7f7a1814a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:53.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.473+0000 7f7a17fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7a18067e20 0x7f7a1814c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:53.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.473+0000 7f7a17fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7a18067e20 0x7f7a1814c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.3:40156/0 (socket says 172.21.15.3:40156) 2023-10-08T15:37:53.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.473+0000 7f7a1ce4d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7a1814d280 0x7f7a1814a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.3:46140/0 (socket says 172.21.15.3:46140) 2023-10-08T15:37:53.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.473+0000 7f7a17fff700 1 -- 172.21.15.3:0/448123581 learned_addr learned my addr 172.21.15.3:0/448123581 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:53.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.473+0000 7f7a177fe700 1 -- 172.21.15.3:0/448123581 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 732908984 0 0) 0x7f7a1814b970 con 0x7f7a1806e6f0 2023-10-08T15:37:53.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.473+0000 7f7a177fe700 1 -- 172.21.15.3:0/448123581 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a04003570 con 0x7f7a1806e6f0 2023-10-08T15:37:53.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.473+0000 7f7a17fff700 1 -- 172.21.15.3:0/448123581 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7a1814d280 msgr2=0x7f7a1814a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:53.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.473+0000 7f7a17fff700 1 --2- 172.21.15.3:0/448123581 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7a1814d280 0x7f7a1814a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:53.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.473+0000 7f7a17fff700 1 -- 172.21.15.3:0/448123581 >> v1:172.21.15.50:6789/0 conn(0x7f7a1806e6f0 legacy=0x7f7a1814cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:53.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.473+0000 7f7a17fff700 1 -- 172.21.15.3:0/448123581 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a1814bf30 con 0x7f7a18067e20 2023-10-08T15:37:53.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.473+0000 7f7a1ce4d700 1 --2- 172.21.15.3:0/448123581 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7a1814d280 0x7f7a1814a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:37:53.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.473+0000 7f7a17fff700 1 --2- 172.21.15.3:0/448123581 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a18067e20 0x7f7a1814c450 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7a080099b0 tx=0x7f7a08009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b93e68cefbaf040a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:53.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.473+0000 7f7a177fe700 1 -- 172.21.15.3:0/448123581 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0800b680 con 0x7f7a18067e20 2023-10-08T15:37:53.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.473+0000 7f7a177fe700 1 -- 172.21.15.3:0/448123581 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a0800b7e0 con 0x7f7a18067e20 2023-10-08T15:37:53.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.473+0000 7f7a177fe700 1 -- 172.21.15.3:0/448123581 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0800bb80 con 0x7f7a18067e20 2023-10-08T15:37:53.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.477+0000 7f7a1e8b0700 1 -- 172.21.15.3:0/448123581 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a18067e20 msgr2=0x7f7a1814c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:53.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.477+0000 7f7a1e8b0700 1 --2- 172.21.15.3:0/448123581 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a18067e20 0x7f7a1814c450 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7a080099b0 tx=0x7f7a08009250 comp rx=0 tx=0).stop 2023-10-08T15:37:53.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.477+0000 7f7a1e8b0700 1 -- 172.21.15.3:0/448123581 shutdown_connections 2023-10-08T15:37:53.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.477+0000 7f7a1e8b0700 1 --2- 172.21.15.3:0/448123581 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7a1814d280 0x7f7a1814a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:53.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.477+0000 7f7a1e8b0700 1 --2- 172.21.15.3:0/448123581 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a18067e20 0x7f7a1814c450 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:53.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.477+0000 7f7a1e8b0700 1 -- 172.21.15.3:0/448123581 >> 172.21.15.3:0/448123581 conn(0x7f7a180670e0 msgr2=0x7f7a180674e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:53.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.477+0000 7f7a1e8b0700 1 -- 172.21.15.3:0/448123581 shutdown_connections 2023-10-08T15:37:53.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.477+0000 7f7a1e8b0700 1 -- 172.21.15.3:0/448123581 wait complete. 2023-10-08T15:37:53.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.477+0000 7f7a1e8b0700 1 Processor -- start 2023-10-08T15:37:53.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.477+0000 7f7a1e8b0700 1 -- start start 2023-10-08T15:37:53.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.477+0000 7f7a1e8b0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a18067e20 0x7f7a1814d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:53.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.477+0000 7f7a1e8b0700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7a1806e6f0 0x7f7a1815e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:53.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.477+0000 7f7a1e8b0700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7a1814d280 0x7f7a181429a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:53.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.477+0000 7f7a1e8b0700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1814dc50 con 0x7f7a1814d280 2023-10-08T15:37:53.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.477+0000 7f7a1e8b0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1815ed40 con 0x7f7a18067e20 2023-10-08T15:37:53.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.477+0000 7f7a1e8b0700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a18143a00 con 0x7f7a1806e6f0 2023-10-08T15:37:53.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.477+0000 7f7a1ce4d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7a1814d280 0x7f7a181429a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:53.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.477+0000 7f7a1ce4d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7a1814d280 0x7f7a181429a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59948/0 (socket says 172.21.15.3:59948) 2023-10-08T15:37:53.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.477+0000 7f7a1ce4d700 1 -- 172.21.15.3:0/1113880790 learned_addr learned my addr 172.21.15.3:0/1113880790 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:53.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.477+0000 7f7a17fff700 1 --2- 172.21.15.3:0/1113880790 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a18067e20 0x7f7a1814d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:53.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.477+0000 7f7a0f7fe700 1 --2- 172.21.15.3:0/1113880790 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7a1806e6f0 0x7f7a1815e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:53.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.481+0000 7f7a1ce4d700 1 -- 172.21.15.3:0/1113880790 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7a1806e6f0 msgr2=0x7f7a1815e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:53.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.481+0000 7f7a1ce4d700 1 --2- 172.21.15.3:0/1113880790 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7a1806e6f0 0x7f7a1815e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:53.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.481+0000 7f7a1ce4d700 1 -- 172.21.15.3:0/1113880790 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a18067e20 msgr2=0x7f7a1814d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:53.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.481+0000 7f7a1ce4d700 1 --2- 172.21.15.3:0/1113880790 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a18067e20 0x7f7a1814d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:53.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.481+0000 7f7a1ce4d700 1 -- 172.21.15.3:0/1113880790 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a10009a20 con 0x7f7a1814d280 2023-10-08T15:37:53.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.481+0000 7f7a1ce4d700 1 --2- 172.21.15.3:0/1113880790 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7a1814d280 0x7f7a181429a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7a10009f90 tx=0x7f7a1000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:53.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.481+0000 7f7a14ff9700 1 -- 172.21.15.3:0/1113880790 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1000cbd0 con 0x7f7a1814d280 2023-10-08T15:37:53.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.481+0000 7f7a14ff9700 1 -- 172.21.15.3:0/1113880790 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a1000f040 con 0x7f7a1814d280 2023-10-08T15:37:53.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.481+0000 7f7a1e8b0700 1 -- 172.21.15.3:0/1113880790 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a080094f0 con 0x7f7a1814d280 2023-10-08T15:37:53.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.481+0000 7f7a14ff9700 1 -- 172.21.15.3:0/1113880790 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a10014480 con 0x7f7a1814d280 2023-10-08T15:37:53.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.481+0000 7f7a1e8b0700 1 -- 172.21.15.3:0/1113880790 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a1814def0 con 0x7f7a1814d280 2023-10-08T15:37:53.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.481+0000 7f7a1e8b0700 1 -- 172.21.15.3:0/1113880790 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a1806bad0 con 0x7f7a1814d280 2023-10-08T15:37:53.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.481+0000 7f7a14ff9700 1 -- 172.21.15.3:0/1113880790 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f7a100147f0 con 0x7f7a1814d280 2023-10-08T15:37:53.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.485+0000 7f7a14ff9700 1 --2- 172.21.15.3:0/1113880790 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f79f8060550 0x7f79f8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:53.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.485+0000 7f7a14ff9700 1 -- 172.21.15.3:0/1113880790 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7a1007d220 con 0x7f7a1814d280 2023-10-08T15:37:53.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.485+0000 7f7a17fff700 1 --2- 172.21.15.3:0/1113880790 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f79f8060550 0x7f79f8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:53.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.485+0000 7f7a17fff700 1 --2- 172.21.15.3:0/1113880790 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f79f8060550 0x7f79f8062a00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7a080099b0 tx=0x7f7a08017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:53.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.493+0000 7f7a14ff9700 1 -- 172.21.15.3:0/1113880790 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7a1806bad0 con 0x7f7a1814d280 2023-10-08T15:37:53.657 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.649+0000 7f7a1e8b0700 1 -- 172.21.15.3:0/1113880790 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7a1806bad0 con 0x7f7a1814d280 2023-10-08T15:37:53.657 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.653+0000 7f7a14ff9700 1 -- 172.21.15.3:0/1113880790 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7a1806bad0 con 0x7f7a1814d280 2023-10-08T15:37:53.658 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2023-10-08T15:37:53.660 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.653+0000 7f7a1e8b0700 1 -- 172.21.15.3:0/1113880790 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f79f8060550 msgr2=0x7f79f8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:53.660 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.653+0000 7f7a1e8b0700 1 --2- 172.21.15.3:0/1113880790 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f79f8060550 0x7f79f8062a00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7a080099b0 tx=0x7f7a08017000 comp rx=0 tx=0).stop 2023-10-08T15:37:53.660 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.653+0000 7f7a1e8b0700 1 -- 172.21.15.3:0/1113880790 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7a1814d280 msgr2=0x7f7a181429a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:53.660 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.653+0000 7f7a1e8b0700 1 --2- 172.21.15.3:0/1113880790 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7a1814d280 0x7f7a181429a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7a10009f90 tx=0x7f7a1000b040 comp rx=0 tx=0).stop 2023-10-08T15:37:53.660 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.653+0000 7f7a1e8b0700 1 -- 172.21.15.3:0/1113880790 shutdown_connections 2023-10-08T15:37:53.660 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.653+0000 7f7a1e8b0700 1 --2- 172.21.15.3:0/1113880790 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f79f8060550 0x7f79f8062a00 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:53.660 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.653+0000 7f7a1e8b0700 1 --2- 172.21.15.3:0/1113880790 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7a1814d280 0x7f7a181429a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:53.660 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.653+0000 7f7a1e8b0700 1 --2- 172.21.15.3:0/1113880790 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7a1806e6f0 0x7f7a1815e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:53.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.653+0000 7f7a1e8b0700 1 --2- 172.21.15.3:0/1113880790 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a18067e20 0x7f7a1814d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:53.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.653+0000 7f7a1e8b0700 1 -- 172.21.15.3:0/1113880790 >> 172.21.15.3:0/1113880790 conn(0x7f7a180670e0 msgr2=0x7f7a180674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:53.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.653+0000 7f7a1e8b0700 1 -- 172.21.15.3:0/1113880790 shutdown_connections 2023-10-08T15:37:53.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.653+0000 7f7a1e8b0700 1 -- 172.21.15.3:0/1113880790 wait complete. 2023-10-08T15:37:53.672 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T15:37:53.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.781+0000 7fc826008700 1 Processor -- start 2023-10-08T15:37:53.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.781+0000 7fc826008700 1 -- start start 2023-10-08T15:37:53.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.781+0000 7fc826008700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fc820148ca0 0x7fc82006bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:53.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.781+0000 7fc826008700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc8200bc340 0x7fc8200bc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:53.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.781+0000 7fc826008700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8200a2720 con 0x7fc82006cdf0 2023-10-08T15:37:53.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.781+0000 7fc826008700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc820149c50 con 0x7fc820148ca0 2023-10-08T15:37:53.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.781+0000 7fc826008700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8200a2440 con 0x7fc8200bc340 2023-10-08T15:37:53.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.781+0000 7fc825006700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fc820148ca0 0x7fc82006bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:53.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.781+0000 7fc825006700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fc820148ca0 0x7fc82006bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59964/0 (socket says 172.21.15.3:59964) 2023-10-08T15:37:53.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.781+0000 7fc825006700 1 -- 172.21.15.3:0/805675422 learned_addr learned my addr 172.21.15.3:0/805675422 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:53.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.781+0000 7fc825807700 1 --2- 172.21.15.3:0/805675422 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc8200bc340 0x7fc8200bc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:53.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.781+0000 7fc825006700 1 -- 172.21.15.3:0/805675422 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc8200bc340 msgr2=0x7fc8200bc7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:53.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.781+0000 7fc825006700 1 --2- 172.21.15.3:0/805675422 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc8200bc340 0x7fc8200bc7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:53.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.781+0000 7fc825006700 1 -- 172.21.15.3:0/805675422 >> v1:172.21.15.50:6789/0 conn(0x7fc82006cdf0 legacy=0x7fc82006c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:53.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.781+0000 7fc825006700 1 -- 172.21.15.3:0/805675422 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc82009f2c0 con 0x7fc820148ca0 2023-10-08T15:37:53.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.781+0000 7fc825006700 1 --2- 172.21.15.3:0/805675422 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc820148ca0 0x7fc82006bc90 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc81c0099b0 tx=0x7fc81c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9a7cf8389b51223 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:53.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.781+0000 7fc817fff700 1 -- 172.21.15.3:0/805675422 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81c009ea0 con 0x7fc820148ca0 2023-10-08T15:37:53.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.785+0000 7fc817fff700 1 -- 172.21.15.3:0/805675422 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc81c00b860 con 0x7fc820148ca0 2023-10-08T15:37:53.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.785+0000 7fc817fff700 1 -- 172.21.15.3:0/805675422 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81c00bc00 con 0x7fc820148ca0 2023-10-08T15:37:53.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.785+0000 7fc826008700 1 -- 172.21.15.3:0/805675422 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc820148ca0 msgr2=0x7fc82006bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:53.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.785+0000 7fc826008700 1 --2- 172.21.15.3:0/805675422 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc820148ca0 0x7fc82006bc90 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc81c0099b0 tx=0x7fc81c009250 comp rx=0 tx=0).stop 2023-10-08T15:37:53.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.785+0000 7fc826008700 1 -- 172.21.15.3:0/805675422 shutdown_connections 2023-10-08T15:37:53.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.785+0000 7fc826008700 1 --2- 172.21.15.3:0/805675422 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc8200bc340 0x7fc8200bc7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:53.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.785+0000 7fc826008700 1 --2- 172.21.15.3:0/805675422 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc820148ca0 0x7fc82006bc90 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:53.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.785+0000 7fc826008700 1 -- 172.21.15.3:0/805675422 >> 172.21.15.3:0/805675422 conn(0x7fc82006f340 msgr2=0x7fc8200670e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:53.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.785+0000 7fc826008700 1 -- 172.21.15.3:0/805675422 shutdown_connections 2023-10-08T15:37:53.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.785+0000 7fc826008700 1 -- 172.21.15.3:0/805675422 wait complete. 2023-10-08T15:37:53.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.785+0000 7fc826008700 1 Processor -- start 2023-10-08T15:37:53.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.785+0000 7fc826008700 1 -- start start 2023-10-08T15:37:53.795 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.789+0000 7fc826008700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc82006cdf0 0x7fc8201595e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:53.795 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.789+0000 7fc826008700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc8200bc340 0x7fc82014e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:53.795 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.789+0000 7fc826008700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc820148ca0 0x7fc8200bb690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:53.795 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.789+0000 7fc826008700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc820159bf0 con 0x7fc8200bc340 2023-10-08T15:37:53.795 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.789+0000 7fc826008700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8200b5010 con 0x7fc820148ca0 2023-10-08T15:37:53.795 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.789+0000 7fc826008700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8200b4ce0 con 0x7fc82006cdf0 2023-10-08T15:37:53.795 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.789+0000 7fc824805700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc8200bc340 0x7fc82014e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:53.796 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.789+0000 7fc825807700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc820148ca0 0x7fc8200bb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:53.796 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.789+0000 7fc824805700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc8200bc340 0x7fc82014e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59966/0 (socket says 172.21.15.3:59966) 2023-10-08T15:37:53.796 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.789+0000 7fc824805700 1 -- 172.21.15.3:0/4088485757 learned_addr learned my addr 172.21.15.3:0/4088485757 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:53.796 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.789+0000 7fc825006700 1 --2- 172.21.15.3:0/4088485757 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc82006cdf0 0x7fc8201595e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:53.796 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.789+0000 7fc824805700 1 -- 172.21.15.3:0/4088485757 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc82006cdf0 msgr2=0x7fc8201595e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:53.796 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.789+0000 7fc824805700 1 --2- 172.21.15.3:0/4088485757 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc82006cdf0 0x7fc8201595e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:53.796 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.789+0000 7fc824805700 1 -- 172.21.15.3:0/4088485757 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc820148ca0 msgr2=0x7fc8200bb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:53.796 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.789+0000 7fc824805700 1 --2- 172.21.15.3:0/4088485757 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc820148ca0 0x7fc8200bb690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:53.796 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.789+0000 7fc824805700 1 -- 172.21.15.3:0/4088485757 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc81c0094f0 con 0x7fc8200bc340 2023-10-08T15:37:53.796 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.789+0000 7fc824805700 1 --2- 172.21.15.3:0/4088485757 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc8200bc340 0x7fc82014e110 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc81000c590 tx=0x7fc810007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:53.797 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.789+0000 7fc8157fa700 1 -- 172.21.15.3:0/4088485757 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81000ce80 con 0x7fc8200bc340 2023-10-08T15:37:53.797 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.789+0000 7fc8157fa700 1 -- 172.21.15.3:0/4088485757 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc810011590 con 0x7fc8200bc340 2023-10-08T15:37:53.797 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.789+0000 7fc826008700 1 -- 172.21.15.3:0/4088485757 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc82009ef30 con 0x7fc8200bc340 2023-10-08T15:37:53.798 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.789+0000 7fc8157fa700 1 -- 172.21.15.3:0/4088485757 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc810011930 con 0x7fc8200bc340 2023-10-08T15:37:53.798 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.789+0000 7fc826008700 1 -- 172.21.15.3:0/4088485757 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8200c0760 con 0x7fc8200bc340 2023-10-08T15:37:53.798 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.793+0000 7fc826008700 1 -- 172.21.15.3:0/4088485757 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8200c09e0 con 0x7fc8200bc340 2023-10-08T15:37:53.798 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.793+0000 7fc8157fa700 1 -- 172.21.15.3:0/4088485757 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc810011ca0 con 0x7fc8200bc340 2023-10-08T15:37:53.798 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.793+0000 7fc8157fa700 1 --2- 172.21.15.3:0/4088485757 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc804060580 0x7fc804062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:53.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.793+0000 7fc8157fa700 1 -- 172.21.15.3:0/4088485757 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc81007b990 con 0x7fc8200bc340 2023-10-08T15:37:53.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.793+0000 7fc825006700 1 --2- 172.21.15.3:0/4088485757 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc804060580 0x7fc804062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:53.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.793+0000 7fc825006700 1 --2- 172.21.15.3:0/4088485757 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc804060580 0x7fc804062a30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc81c0099b0 tx=0x7fc81c017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:53.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.801+0000 7fc8157fa700 1 -- 172.21.15.3:0/4088485757 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc8200c09e0 con 0x7fc8200bc340 2023-10-08T15:37:53.967 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.961+0000 7fc826008700 1 -- 172.21.15.3:0/4088485757 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc8200b4b40 con 0x7fc8200bc340 2023-10-08T15:37:53.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.961+0000 7fc8157fa700 1 -- 172.21.15.3:0/4088485757 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc8200b4b40 con 0x7fc8200bc340 2023-10-08T15:37:53.969 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 32 2023-10-08T15:37:53.971 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.965+0000 7fc826008700 1 -- 172.21.15.3:0/4088485757 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc804060580 msgr2=0x7fc804062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:53.971 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.965+0000 7fc826008700 1 --2- 172.21.15.3:0/4088485757 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc804060580 0x7fc804062a30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc81c0099b0 tx=0x7fc81c017000 comp rx=0 tx=0).stop 2023-10-08T15:37:53.972 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.965+0000 7fc826008700 1 -- 172.21.15.3:0/4088485757 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc8200bc340 msgr2=0x7fc82014e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:53.972 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.965+0000 7fc826008700 1 --2- 172.21.15.3:0/4088485757 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc8200bc340 0x7fc82014e110 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc81000c590 tx=0x7fc810007f30 comp rx=0 tx=0).stop 2023-10-08T15:37:53.972 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.965+0000 7fc826008700 1 -- 172.21.15.3:0/4088485757 shutdown_connections 2023-10-08T15:37:53.972 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.965+0000 7fc826008700 1 --2- 172.21.15.3:0/4088485757 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc804060580 0x7fc804062a30 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:53.972 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.965+0000 7fc826008700 1 --2- 172.21.15.3:0/4088485757 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc820148ca0 0x7fc8200bb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:53.972 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.965+0000 7fc826008700 1 --2- 172.21.15.3:0/4088485757 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc8200bc340 0x7fc82014e110 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:53.972 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.965+0000 7fc826008700 1 --2- 172.21.15.3:0/4088485757 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc82006cdf0 0x7fc8201595e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:53.972 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.965+0000 7fc826008700 1 -- 172.21.15.3:0/4088485757 >> 172.21.15.3:0/4088485757 conn(0x7fc82006f340 msgr2=0x7fc82006be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:53.972 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.965+0000 7fc826008700 1 -- 172.21.15.3:0/4088485757 shutdown_connections 2023-10-08T15:37:53.972 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:53.965+0000 7fc826008700 1 -- 172.21.15.3:0/4088485757 wait complete. 2023-10-08T15:37:53.983 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T15:37:54.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.085+0000 7f673f59e700 1 Processor -- start 2023-10-08T15:37:54.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.085+0000 7f673f59e700 1 -- start start 2023-10-08T15:37:54.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.089+0000 7f673f59e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f674006dc00 0x7f674006aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:54.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.089+0000 7f673f59e700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f674006dfd0 0x7f674006cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:54.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.089+0000 7f673f59e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f674006e740 0x7f67400be950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:54.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.089+0000 7f673f59e700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f674014c680 con 0x7f674006dfd0 2023-10-08T15:37:54.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.089+0000 7f673f59e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67401480b0 con 0x7f674006e740 2023-10-08T15:37:54.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.089+0000 7f673f59e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6740148350 con 0x7f674006dc00 2023-10-08T15:37:54.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.089+0000 7f673dd9b700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f674006dfd0 0x7f674006cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:54.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.089+0000 7f673dd9b700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f674006dfd0 0x7f674006cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59982/0 (socket says 172.21.15.3:59982) 2023-10-08T15:37:54.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.089+0000 7f673dd9b700 1 -- 172.21.15.3:0/3220603014 learned_addr learned my addr 172.21.15.3:0/3220603014 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:54.097 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.089+0000 7f673ed9d700 1 --2- 172.21.15.3:0/3220603014 >> v2:172.21.15.50:3300/0 conn(0x7f674006e740 0x7f67400be950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:54.097 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.089+0000 7f673e59c700 1 --2- 172.21.15.3:0/3220603014 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f674006dc00 0x7f674006aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:54.097 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.089+0000 7f673dd9b700 1 -- 172.21.15.3:0/3220603014 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f674006dc00 msgr2=0x7f674006aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:54.097 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.089+0000 7f673dd9b700 1 --2- 172.21.15.3:0/3220603014 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f674006dc00 0x7f674006aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:54.097 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.089+0000 7f673dd9b700 1 -- 172.21.15.3:0/3220603014 >> v2:172.21.15.50:3300/0 conn(0x7f674006e740 msgr2=0x7f67400be950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:54.097 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.089+0000 7f673dd9b700 1 --2- 172.21.15.3:0/3220603014 >> v2:172.21.15.50:3300/0 conn(0x7f674006e740 0x7f67400be950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:54.097 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.089+0000 7f673dd9b700 1 -- 172.21.15.3:0/3220603014 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f674006d4a0 con 0x7f674006dfd0 2023-10-08T15:37:54.097 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.089+0000 7f673dd9b700 1 --2- 172.21.15.3:0/3220603014 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f674006dfd0 0x7f674006cf60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f674006bea0 tx=0x7f673400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e9b4ce8513f95c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:54.097 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.089+0000 7f673d59a700 1 -- 172.21.15.3:0/3220603014 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673400dc50 con 0x7f674006dfd0 2023-10-08T15:37:54.097 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.089+0000 7f673d59a700 1 -- 172.21.15.3:0/3220603014 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f673400ddb0 con 0x7f674006dfd0 2023-10-08T15:37:54.097 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.089+0000 7f673d59a700 1 -- 172.21.15.3:0/3220603014 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67340196d0 con 0x7f674006dfd0 2023-10-08T15:37:54.098 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.089+0000 7f673f59e700 1 -- 172.21.15.3:0/3220603014 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f674006dfd0 msgr2=0x7f674006cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:54.098 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.089+0000 7f673f59e700 1 --2- 172.21.15.3:0/3220603014 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f674006dfd0 0x7f674006cf60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f674006bea0 tx=0x7f673400b4f0 comp rx=0 tx=0).stop 2023-10-08T15:37:54.098 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.093+0000 7f673f59e700 1 -- 172.21.15.3:0/3220603014 shutdown_connections 2023-10-08T15:37:54.099 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.093+0000 7f673f59e700 1 --2- 172.21.15.3:0/3220603014 >> v2:172.21.15.50:3300/0 conn(0x7f674006e740 0x7f67400be950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:54.099 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.093+0000 7f673f59e700 1 --2- 172.21.15.3:0/3220603014 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f674006dfd0 0x7f674006cf60 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:54.099 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.093+0000 7f673f59e700 1 --2- 172.21.15.3:0/3220603014 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f674006dc00 0x7f674006aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:54.099 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.093+0000 7f673f59e700 1 -- 172.21.15.3:0/3220603014 >> 172.21.15.3:0/3220603014 conn(0x7f6740067b60 msgr2=0x7f67400be240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:54.099 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.093+0000 7f673f59e700 1 -- 172.21.15.3:0/3220603014 shutdown_connections 2023-10-08T15:37:54.099 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.093+0000 7f673f59e700 1 -- 172.21.15.3:0/3220603014 wait complete. 2023-10-08T15:37:54.100 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.093+0000 7f673f59e700 1 Processor -- start 2023-10-08T15:37:54.100 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.093+0000 7f673f59e700 1 -- start start 2023-10-08T15:37:54.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.097+0000 7f673f59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f674006dc00 0x7f6740139180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:54.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.097+0000 7f673f59e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f674006dfd0 0x7f674015a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:54.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.097+0000 7f673f59e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f674006e740 0x7f674014b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:54.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.097+0000 7f673f59e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67401568c0 con 0x7f674006e740 2023-10-08T15:37:54.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.097+0000 7f673f59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f674014b740 con 0x7f674006dc00 2023-10-08T15:37:54.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.097+0000 7f673f59e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6740139850 con 0x7f674006dfd0 2023-10-08T15:37:54.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.097+0000 7f673ed9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f674006e740 0x7f674014b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:54.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.097+0000 7f673ed9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f674006e740 0x7f674014b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59990/0 (socket says 172.21.15.3:59990) 2023-10-08T15:37:54.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.097+0000 7f673ed9d700 1 -- 172.21.15.3:0/3316905458 learned_addr learned my addr 172.21.15.3:0/3316905458 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:54.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.097+0000 7f673e59c700 1 --2- 172.21.15.3:0/3316905458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f674006dc00 0x7f6740139180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:54.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.097+0000 7f673dd9b700 1 --2- 172.21.15.3:0/3316905458 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f674006dfd0 0x7f674015a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:54.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.097+0000 7f673ed9d700 1 -- 172.21.15.3:0/3316905458 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f674006dfd0 msgr2=0x7f674015a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:54.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.097+0000 7f673ed9d700 1 --2- 172.21.15.3:0/3316905458 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f674006dfd0 0x7f674015a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:54.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.097+0000 7f673ed9d700 1 -- 172.21.15.3:0/3316905458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f674006dc00 msgr2=0x7f6740139180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:54.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.097+0000 7f673ed9d700 1 --2- 172.21.15.3:0/3316905458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f674006dc00 0x7f6740139180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:54.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.097+0000 7f673ed9d700 1 -- 172.21.15.3:0/3316905458 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f673400b790 con 0x7f674006e740 2023-10-08T15:37:54.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.097+0000 7f673ed9d700 1 --2- 172.21.15.3:0/3316905458 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f674006e740 0x7f674014b200 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6738007f20 tx=0x7f6738009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:54.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.097+0000 7f672e7fc700 1 -- 172.21.15.3:0/3316905458 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673800eca0 con 0x7f674006e740 2023-10-08T15:37:54.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.097+0000 7f672e7fc700 1 -- 172.21.15.3:0/3316905458 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f673800ee20 con 0x7f674006e740 2023-10-08T15:37:54.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.097+0000 7f672e7fc700 1 -- 172.21.15.3:0/3316905458 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6738014670 con 0x7f674006e740 2023-10-08T15:37:54.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.097+0000 7f673f59e700 1 -- 172.21.15.3:0/3316905458 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6740139b30 con 0x7f674006e740 2023-10-08T15:37:54.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.097+0000 7f673f59e700 1 -- 172.21.15.3:0/3316905458 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f674013a2e0 con 0x7f674006e740 2023-10-08T15:37:54.106 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.101+0000 7f673f59e700 1 -- 172.21.15.3:0/3316905458 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67401396c0 con 0x7f674006e740 2023-10-08T15:37:54.106 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.101+0000 7f672e7fc700 1 -- 172.21.15.3:0/3316905458 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f67380149e0 con 0x7f674006e740 2023-10-08T15:37:54.106 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.101+0000 7f672e7fc700 1 --2- 172.21.15.3:0/3316905458 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f6720060550 0x7f6720062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:54.107 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.101+0000 7f672e7fc700 1 -- 172.21.15.3:0/3316905458 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f673807cf40 con 0x7f674006e740 2023-10-08T15:37:54.107 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.101+0000 7f673e59c700 1 --2- 172.21.15.3:0/3316905458 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f6720060550 0x7f6720062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:54.107 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.101+0000 7f673e59c700 1 --2- 172.21.15.3:0/3316905458 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f6720060550 0x7f6720062a00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6730006fd0 tx=0x7f6730008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:54.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.109+0000 7f672e7fc700 1 -- 172.21.15.3:0/3316905458 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f673804d530 con 0x7f674006e740 2023-10-08T15:37:54.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.265+0000 7f673f59e700 1 -- 172.21.15.3:0/3316905458 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f674005ecf0 con 0x7f674006e740 2023-10-08T15:37:54.274 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.269+0000 7f672e7fc700 1 -- 172.21.15.3:0/3316905458 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6738050b50 con 0x7f674006e740 2023-10-08T15:37:54.274 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 64 2023-10-08T15:37:54.276 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.269+0000 7f673f59e700 1 -- 172.21.15.3:0/3316905458 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f6720060550 msgr2=0x7f6720062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:54.276 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.269+0000 7f673f59e700 1 --2- 172.21.15.3:0/3316905458 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f6720060550 0x7f6720062a00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6730006fd0 tx=0x7f6730008040 comp rx=0 tx=0).stop 2023-10-08T15:37:54.276 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.269+0000 7f673f59e700 1 -- 172.21.15.3:0/3316905458 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f674006e740 msgr2=0x7f674014b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:54.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.269+0000 7f673f59e700 1 --2- 172.21.15.3:0/3316905458 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f674006e740 0x7f674014b200 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6738007f20 tx=0x7f6738009860 comp rx=0 tx=0).stop 2023-10-08T15:37:54.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.269+0000 7f673f59e700 1 -- 172.21.15.3:0/3316905458 shutdown_connections 2023-10-08T15:37:54.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.269+0000 7f673f59e700 1 --2- 172.21.15.3:0/3316905458 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f6720060550 0x7f6720062a00 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:54.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.269+0000 7f673f59e700 1 --2- 172.21.15.3:0/3316905458 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f674006e740 0x7f674014b200 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:54.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.269+0000 7f673f59e700 1 --2- 172.21.15.3:0/3316905458 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f674006dfd0 0x7f674015a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:54.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.269+0000 7f673f59e700 1 --2- 172.21.15.3:0/3316905458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f674006dc00 0x7f6740139180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:54.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.269+0000 7f673f59e700 1 -- 172.21.15.3:0/3316905458 >> 172.21.15.3:0/3316905458 conn(0x7f6740067b60 msgr2=0x7f67400bd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:54.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.269+0000 7f673f59e700 1 -- 172.21.15.3:0/3316905458 shutdown_connections 2023-10-08T15:37:54.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.269+0000 7f673f59e700 1 -- 172.21.15.3:0/3316905458 wait complete. 2023-10-08T15:37:54.289 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:37:54.397 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.389+0000 7fb5b1b2c700 1 Processor -- start 2023-10-08T15:37:54.397 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.389+0000 7fb5b1b2c700 1 -- start start 2023-10-08T15:37:54.400 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.393+0000 7fb5b1b2c700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb5ac14a080 0x7fb5ac0baf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:54.400 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.393+0000 7fb5b1b2c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb5ac06df30 0x7fb5ac14c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:54.400 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.393+0000 7fb5b1b2c700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5ac0b4050 con 0x7fb5ac0bab50 2023-10-08T15:37:54.400 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.393+0000 7fb5b1b2c700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5ac146da0 con 0x7fb5ac14a080 2023-10-08T15:37:54.400 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.393+0000 7fb5b1b2c700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ac0b4710 con 0x7fb5ac06df30 2023-10-08T15:37:54.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.393+0000 7fb5abfff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb5ac14a080 0x7fb5ac0baf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:54.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.393+0000 7fb5b0b2a700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fb5ac0bab50 0x7fb5ac149970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:49944/0 (socket says 172.21.15.3:49944) 2023-10-08T15:37:54.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.393+0000 7fb5b0b2a700 1 -- 172.21.15.3:0/3033466899 learned_addr learned my addr 172.21.15.3:0/3033466899 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:54.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.393+0000 7fb5b132b700 1 --2- 172.21.15.3:0/3033466899 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb5ac06df30 0x7fb5ac14c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:54.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.393+0000 7fb5abfff700 1 -- 172.21.15.3:0/3033466899 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb5ac06df30 msgr2=0x7fb5ac14c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:54.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.393+0000 7fb5abfff700 1 --2- 172.21.15.3:0/3033466899 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb5ac06df30 0x7fb5ac14c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:54.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.393+0000 7fb5abfff700 1 -- 172.21.15.3:0/3033466899 >> v1:172.21.15.3:6789/0 conn(0x7fb5ac0bab50 legacy=0x7fb5ac149970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:54.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.393+0000 7fb5ab7fe700 1 -- 172.21.15.3:0/3033466899 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1662093897 0 0) 0x7fb5ac0b4050 con 0x7fb5ac0bab50 2023-10-08T15:37:54.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.393+0000 7fb5abfff700 1 -- 172.21.15.3:0/3033466899 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5ac0b4330 con 0x7fb5ac14a080 2023-10-08T15:37:54.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.393+0000 7fb5abfff700 1 --2- 172.21.15.3:0/3033466899 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb5ac14a080 0x7fb5ac0baf20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb59c009e60 tx=0x7fb59c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2f23ef4303fd346 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:54.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.393+0000 7fb5ab7fe700 1 -- 172.21.15.3:0/3033466899 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59c00e070 con 0x7fb5ac14a080 2023-10-08T15:37:54.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.393+0000 7fb5ab7fe700 1 -- 172.21.15.3:0/3033466899 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb59c00bb60 con 0x7fb5ac14a080 2023-10-08T15:37:54.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.393+0000 7fb5ab7fe700 1 -- 172.21.15.3:0/3033466899 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59c012430 con 0x7fb5ac14a080 2023-10-08T15:37:54.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.393+0000 7fb5b1b2c700 1 -- 172.21.15.3:0/3033466899 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb5ac14a080 msgr2=0x7fb5ac0baf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:54.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.393+0000 7fb5b1b2c700 1 --2- 172.21.15.3:0/3033466899 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb5ac14a080 0x7fb5ac0baf20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb59c009e60 tx=0x7fb59c009780 comp rx=0 tx=0).stop 2023-10-08T15:37:54.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.393+0000 7fb5b1b2c700 1 -- 172.21.15.3:0/3033466899 shutdown_connections 2023-10-08T15:37:54.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.393+0000 7fb5b1b2c700 1 --2- 172.21.15.3:0/3033466899 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb5ac06df30 0x7fb5ac14c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:54.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.393+0000 7fb5b1b2c700 1 --2- 172.21.15.3:0/3033466899 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb5ac14a080 0x7fb5ac0baf20 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:54.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.393+0000 7fb5b1b2c700 1 -- 172.21.15.3:0/3033466899 >> 172.21.15.3:0/3033466899 conn(0x7fb5ac0be4a0 msgr2=0x7fb5ac0ba440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:54.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.393+0000 7fb5b1b2c700 1 -- 172.21.15.3:0/3033466899 shutdown_connections 2023-10-08T15:37:54.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.393+0000 7fb5b1b2c700 1 -- 172.21.15.3:0/3033466899 wait complete. 2023-10-08T15:37:54.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.393+0000 7fb5b1b2c700 1 Processor -- start 2023-10-08T15:37:54.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.393+0000 7fb5b1b2c700 1 -- start start 2023-10-08T15:37:54.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.397+0000 7fb5b1b2c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb5ac06df30 0x7fb5ac0b9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:54.407 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.397+0000 7fb5b1b2c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb5ac0bab50 0x7fb5ac15e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:54.407 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.397+0000 7fb5b1b2c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5ac14a080 0x7fb5ac15e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:54.407 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.397+0000 7fb5b1b2c700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ac0b22f0 con 0x7fb5ac06df30 2023-10-08T15:37:54.407 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.397+0000 7fb5b1b2c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ac0b28b0 con 0x7fb5ac14a080 2023-10-08T15:37:54.407 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.397+0000 7fb5b1b2c700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ac0b9ec0 con 0x7fb5ac0bab50 2023-10-08T15:37:54.407 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.397+0000 7fb5b0b2a700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb5ac06df30 0x7fb5ac0b9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:54.407 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.397+0000 7fb5b0b2a700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb5ac06df30 0x7fb5ac0b9980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60014/0 (socket says 172.21.15.3:60014) 2023-10-08T15:37:54.407 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.397+0000 7fb5b0b2a700 1 -- 172.21.15.3:0/3652977367 learned_addr learned my addr 172.21.15.3:0/3652977367 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:54.408 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.397+0000 7fb5b132b700 1 --2- 172.21.15.3:0/3652977367 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5ac14a080 0x7fb5ac15e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:54.408 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.397+0000 7fb5abfff700 1 --2- 172.21.15.3:0/3652977367 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb5ac0bab50 0x7fb5ac15e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:54.408 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.397+0000 7fb5b0b2a700 1 -- 172.21.15.3:0/3652977367 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb5ac0bab50 msgr2=0x7fb5ac15e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:54.408 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.397+0000 7fb5b0b2a700 1 --2- 172.21.15.3:0/3652977367 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb5ac0bab50 0x7fb5ac15e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:54.408 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.397+0000 7fb5b0b2a700 1 -- 172.21.15.3:0/3652977367 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5ac14a080 msgr2=0x7fb5ac15e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:54.408 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.397+0000 7fb5b0b2a700 1 --2- 172.21.15.3:0/3652977367 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5ac14a080 0x7fb5ac15e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:54.408 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.397+0000 7fb5b0b2a700 1 -- 172.21.15.3:0/3652977367 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb59c009a20 con 0x7fb5ac06df30 2023-10-08T15:37:54.408 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.397+0000 7fb5b0b2a700 1 --2- 172.21.15.3:0/3652977367 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb5ac06df30 0x7fb5ac0b9980 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb5a000c810 tx=0x7fb5a0007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:54.408 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.397+0000 7fb5a8ff9700 1 -- 172.21.15.3:0/3652977367 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a0005b30 con 0x7fb5ac06df30 2023-10-08T15:37:54.408 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.397+0000 7fb5a8ff9700 1 -- 172.21.15.3:0/3652977367 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5a0005c90 con 0x7fb5ac06df30 2023-10-08T15:37:54.408 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.397+0000 7fb5b1b2c700 1 -- 172.21.15.3:0/3652977367 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5ac0b2540 con 0x7fb5ac06df30 2023-10-08T15:37:54.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.397+0000 7fb5a8ff9700 1 -- 172.21.15.3:0/3652977367 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a0007300 con 0x7fb5ac06df30 2023-10-08T15:37:54.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.397+0000 7fb5b1b2c700 1 -- 172.21.15.3:0/3652977367 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5ac15ad20 con 0x7fb5ac06df30 2023-10-08T15:37:54.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.397+0000 7fb5b1b2c700 1 -- 172.21.15.3:0/3652977367 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5ac05ecf0 con 0x7fb5ac06df30 2023-10-08T15:37:54.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.401+0000 7fb5a8ff9700 1 -- 172.21.15.3:0/3652977367 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb5a001b400 con 0x7fb5ac06df30 2023-10-08T15:37:54.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.401+0000 7fb5a8ff9700 1 --2- 172.21.15.3:0/3652977367 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb598060550 0x7fb598062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:54.410 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.401+0000 7fb5a8ff9700 1 -- 172.21.15.3:0/3652977367 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb5a007c350 con 0x7fb5ac06df30 2023-10-08T15:37:54.410 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.401+0000 7fb5abfff700 1 --2- 172.21.15.3:0/3652977367 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb598060550 0x7fb598062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:54.410 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.401+0000 7fb5abfff700 1 --2- 172.21.15.3:0/3652977367 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb598060550 0x7fb598062a00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb59c0097c0 tx=0x7fb59c019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:54.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.409+0000 7fb5a8ff9700 1 -- 172.21.15.3:0/3652977367 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb5a004c920 con 0x7fb5ac06df30 2023-10-08T15:37:54.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.577+0000 7fb5b1b2c700 1 -- 172.21.15.3:0/3652977367 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb5ac06fe00 con 0x7fb5ac06df30 2023-10-08T15:37:54.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.577+0000 7fb5a8ff9700 1 -- 172.21.15.3:0/3652977367 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15254 (secure 0 0 0) 0x7fb5a004ff40 con 0x7fb5ac06df30 2023-10-08T15:37:54.584 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:37:54.584 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":20,"fsid":"7635972e-cd66-4a8f-a231-378db8b3847a","created":"2023-10-08T15:37:08.234594+0000","modified":"2023-10-08T15:37:27.007828+0000","last_up_change":"2023-10-08T15:37:17.537726+0000","last_in_change":"2023-10-08T15:37:10.269178+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:37:16.581590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:37:23.353518+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T15:37:24.365114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"64fb1864-bfdd-4d75-9b41-03fb60085dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33363},{"type":"v1","addr":"172.21.15.3:6801","nonce":33363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33363},{"type":"v1","addr":"172.21.15.3:6803","nonce":33363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":33363},{"type":"v1","addr":"172.21.15.3:6807","nonce":33363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33363},{"type":"v1","addr":"172.21.15.3:6805","nonce":33363}]},"public_addr":"172.21.15.3:6801/33363","cluster_addr":"172.21.15.3:6803/33363","heartbeat_back_addr":"172.21.15.3:6807/33363","heartbeat_front_addr":"172.21.15.3:6805/33363","state":["exists","up"]},{"osd":1,"uuid":"3ca6bd3a-3e8a-4c65-af9c-46148b0c2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33364},{"type":"v1","addr":"172.21.15.3:6820","nonce":33364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33364},{"type":"v1","addr":"172.21.15.3:6824","nonce":33364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33364},{"type":"v1","addr":"172.21.15.3:6831","nonce":33364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33364},{"type":"v1","addr":"172.21.15.3:6828","nonce":33364}]},"public_addr":"172.21.15.3:6820/33364","cluster_addr":"172.21.15.3:6824/33364","heartbeat_back_addr":"172.21.15.3:6831/33364","heartbeat_front_addr":"172.21.15.3:6828/33364","state":["exists","up"]},{"osd":2,"uuid":"6eb9f757-58dd-442f-910d-32401454bce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33366},{"type":"v1","addr":"172.21.15.3:6817","nonce":33366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":33366},{"type":"v1","addr":"172.21.15.3:6821","nonce":33366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6827","nonce":33366},{"type":"v1","addr":"172.21.15.3:6829","nonce":33366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":33366},{"type":"v1","addr":"172.21.15.3:6825","nonce":33366}]},"public_addr":"172.21.15.3:6817/33366","cluster_addr":"172.21.15.3:6821/33366","heartbeat_back_addr":"172.21.15.3:6829/33366","heartbeat_front_addr":"172.21.15.3:6825/33366","state":["exists","up"]},{"osd":3,"uuid":"1c39866b-ac2e-4ea9-a69c-02b01ee4191d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33365},{"type":"v1","addr":"172.21.15.3:6809","nonce":33365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":33365},{"type":"v1","addr":"172.21.15.3:6811","nonce":33365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33365},{"type":"v1","addr":"172.21.15.3:6815","nonce":33365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":33365},{"type":"v1","addr":"172.21.15.3:6813","nonce":33365}]},"public_addr":"172.21.15.3:6809/33365","cluster_addr":"172.21.15.3:6811/33365","heartbeat_back_addr":"172.21.15.3:6815/33365","heartbeat_front_addr":"172.21.15.3:6813/33365","state":["exists","up"]},{"osd":4,"uuid":"15f86b61-b7f1-4780-ae00-9d80a68cb830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":33605},{"type":"v1","addr":"172.21.15.50:6809","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33605},{"type":"v1","addr":"172.21.15.50:6811","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33605},{"type":"v1","addr":"172.21.15.50:6815","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":33605},{"type":"v1","addr":"172.21.15.50:6813","nonce":33605}]},"public_addr":"172.21.15.50:6809/33605","cluster_addr":"172.21.15.50:6811/33605","heartbeat_back_addr":"172.21.15.50:6815/33605","heartbeat_front_addr":"172.21.15.50:6813/33605","state":["exists","up"]},{"osd":5,"uuid":"726c3003-34e6-4d5a-b6e2-f911e13c2118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33606},{"type":"v1","addr":"172.21.15.50:6801","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33606},{"type":"v1","addr":"172.21.15.50:6803","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33606},{"type":"v1","addr":"172.21.15.50:6807","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":33606},{"type":"v1","addr":"172.21.15.50:6805","nonce":33606}]},"public_addr":"172.21.15.50:6801/33606","cluster_addr":"172.21.15.50:6803/33606","heartbeat_back_addr":"172.21.15.50:6807/33606","heartbeat_front_addr":"172.21.15.50:6805/33606","state":["exists","up"]},{"osd":6,"uuid":"401122a4-9988-441f-a5a7-39164434ebcd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":33607},{"type":"v1","addr":"172.21.15.50:6819","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":33607},{"type":"v1","addr":"172.21.15.50:6823","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":33607},{"type":"v1","addr":"172.21.15.50:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":33607},{"type":"v1","addr":"172.21.15.50:6827","nonce":33607}]},"public_addr":"172.21.15.50:6819/33607","cluster_addr":"172.21.15.50:6823/33607","heartbeat_back_addr":"172.21.15.50:6831/33607","heartbeat_front_addr":"172.21.15.50:6827/33607","state":["exists","up"]},{"osd":7,"uuid":"6b3fa236-c9d0-4c4d-82ae-9af4daf6d699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33604},{"type":"v1","addr":"172.21.15.50:6818","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":33604},{"type":"v1","addr":"172.21.15.50:6822","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":33604},{"type":"v1","addr":"172.21.15.50:6830","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":33604},{"type":"v1","addr":"172.21.15.50:6826","nonce":33604}]},"public_addr":"172.21.15.50:6818/33604","cluster_addr":"172.21.15.50:6822/33604","heartbeat_back_addr":"172.21.15.50:6830/33604","heartbeat_front_addr":"172.21.15.50:6826/33604","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.497794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.529417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.873426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.325972+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.443971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.240795+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.739632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.643026+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:37:54.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.581+0000 7fb5b1b2c700 1 -- 172.21.15.3:0/3652977367 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb598060550 msgr2=0x7fb598062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:54.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.581+0000 7fb5b1b2c700 1 --2- 172.21.15.3:0/3652977367 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb598060550 0x7fb598062a00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb59c0097c0 tx=0x7fb59c019000 comp rx=0 tx=0).stop 2023-10-08T15:37:54.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.581+0000 7fb5b1b2c700 1 -- 172.21.15.3:0/3652977367 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb5ac06df30 msgr2=0x7fb5ac0b9980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:54.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.581+0000 7fb5b1b2c700 1 --2- 172.21.15.3:0/3652977367 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb5ac06df30 0x7fb5ac0b9980 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb5a000c810 tx=0x7fb5a0007df0 comp rx=0 tx=0).stop 2023-10-08T15:37:54.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.581+0000 7fb5b1b2c700 1 -- 172.21.15.3:0/3652977367 shutdown_connections 2023-10-08T15:37:54.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.581+0000 7fb5b1b2c700 1 --2- 172.21.15.3:0/3652977367 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb598060550 0x7fb598062a00 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:54.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.581+0000 7fb5b1b2c700 1 --2- 172.21.15.3:0/3652977367 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5ac14a080 0x7fb5ac15e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:54.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.581+0000 7fb5b1b2c700 1 --2- 172.21.15.3:0/3652977367 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb5ac0bab50 0x7fb5ac15e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:54.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.581+0000 7fb5b1b2c700 1 --2- 172.21.15.3:0/3652977367 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb5ac06df30 0x7fb5ac0b9980 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:54.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.581+0000 7fb5b1b2c700 1 -- 172.21.15.3:0/3652977367 >> 172.21.15.3:0/3652977367 conn(0x7fb5ac0be4a0 msgr2=0x7fb5ac06efd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:54.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.581+0000 7fb5b1b2c700 1 -- 172.21.15.3:0/3652977367 shutdown_connections 2023-10-08T15:37:54.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.581+0000 7fb5b1b2c700 1 -- 172.21.15.3:0/3652977367 wait complete. 2023-10-08T15:37:54.598 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T15:37:16.581590+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T15:37:23.353518+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T15:37:24.365114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T15:37:54.598 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T15:37:54.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.705+0000 7f532a499700 1 Processor -- start 2023-10-08T15:37:54.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.705+0000 7f532a499700 1 -- start start 2023-10-08T15:37:54.713 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.705+0000 7f532a499700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f53240beb80 0x7f5324141310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:54.713 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.705+0000 7f532a499700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5324069e10 0x7f5324141850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:54.714 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.705+0000 7f532a499700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f532414add0 0x7f532414b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:54.714 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.705+0000 7f532a499700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53241481f0 con 0x7f53240beb80 2023-10-08T15:37:54.714 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.705+0000 7f532a499700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53240a0f40 con 0x7f532414add0 2023-10-08T15:37:54.714 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.705+0000 7f532a499700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f532406eff0 con 0x7f5324069e10 2023-10-08T15:37:54.714 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.705+0000 7f5329497700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f53240beb80 0x7f5324141310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:54.714 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.705+0000 7f5329497700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f53240beb80 0x7f5324141310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60018/0 (socket says 172.21.15.3:60018) 2023-10-08T15:37:54.714 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.705+0000 7f5329497700 1 -- 172.21.15.3:0/792052055 learned_addr learned my addr 172.21.15.3:0/792052055 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:54.714 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.705+0000 7f5329c98700 1 --2- 172.21.15.3:0/792052055 >> v2:172.21.15.50:3300/0 conn(0x7f532414add0 0x7f532414b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:54.714 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.705+0000 7f5328c96700 1 --2- 172.21.15.3:0/792052055 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5324069e10 0x7f5324141850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:54.716 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.709+0000 7f5329497700 1 -- 172.21.15.3:0/792052055 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5324069e10 msgr2=0x7f5324141850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:54.716 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.709+0000 7f5329497700 1 --2- 172.21.15.3:0/792052055 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5324069e10 0x7f5324141850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:54.716 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.709+0000 7f5329497700 1 -- 172.21.15.3:0/792052055 >> v2:172.21.15.50:3300/0 conn(0x7f532414add0 msgr2=0x7f532414b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:54.716 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.709+0000 7f5329497700 1 --2- 172.21.15.3:0/792052055 >> v2:172.21.15.50:3300/0 conn(0x7f532414add0 0x7f532414b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:54.716 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.709+0000 7f5329497700 1 -- 172.21.15.3:0/792052055 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53241484a0 con 0x7f53240beb80 2023-10-08T15:37:54.716 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.709+0000 7f5329c98700 1 --2- 172.21.15.3:0/792052055 >> v2:172.21.15.50:3300/0 conn(0x7f532414add0 0x7f532414b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:37:54.717 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.709+0000 7f5329497700 1 --2- 172.21.15.3:0/792052055 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f53240beb80 0x7f5324141310 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f532406f5d0 tx=0x7f5314009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ee5b9515c3ea42e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:54.717 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.709+0000 7f531bfff700 1 -- 172.21.15.3:0/792052055 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531400b640 con 0x7f53240beb80 2023-10-08T15:37:54.717 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.709+0000 7f531bfff700 1 -- 172.21.15.3:0/792052055 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f531400b7a0 con 0x7f53240beb80 2023-10-08T15:37:54.717 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.709+0000 7f531bfff700 1 -- 172.21.15.3:0/792052055 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531400bb60 con 0x7f53240beb80 2023-10-08T15:37:54.717 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.709+0000 7f532a499700 1 -- 172.21.15.3:0/792052055 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f53240beb80 msgr2=0x7f5324141310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:54.717 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.709+0000 7f532a499700 1 --2- 172.21.15.3:0/792052055 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f53240beb80 0x7f5324141310 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f532406f5d0 tx=0x7f5314009250 comp rx=0 tx=0).stop 2023-10-08T15:37:54.717 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.709+0000 7f532a499700 1 -- 172.21.15.3:0/792052055 shutdown_connections 2023-10-08T15:37:54.717 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.709+0000 7f532a499700 1 --2- 172.21.15.3:0/792052055 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5324069e10 0x7f5324141850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:54.717 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.709+0000 7f532a499700 1 --2- 172.21.15.3:0/792052055 >> v2:172.21.15.50:3300/0 conn(0x7f532414add0 0x7f532414b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:54.717 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.709+0000 7f532a499700 1 --2- 172.21.15.3:0/792052055 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f53240beb80 0x7f5324141310 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:54.717 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.709+0000 7f532a499700 1 -- 172.21.15.3:0/792052055 >> 172.21.15.3:0/792052055 conn(0x7f5324067b60 msgr2=0x7f53240be240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:54.718 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.709+0000 7f532a499700 1 -- 172.21.15.3:0/792052055 shutdown_connections 2023-10-08T15:37:54.718 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.709+0000 7f532a499700 1 -- 172.21.15.3:0/792052055 wait complete. 2023-10-08T15:37:54.718 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.713+0000 7f532a499700 1 Processor -- start 2023-10-08T15:37:54.718 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.713+0000 7f532a499700 1 -- start start 2023-10-08T15:37:54.720 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.713+0000 7f532a499700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5324069e10 0x7f5324150d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:54.720 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.713+0000 7f532a499700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53240beb80 0x7f5324144160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:54.720 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.713+0000 7f532a499700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f532414add0 0x7f532415b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:54.720 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.713+0000 7f532a499700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5324150330 con 0x7f5324069e10 2023-10-08T15:37:54.720 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.713+0000 7f532a499700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5324140ec0 con 0x7f53240beb80 2023-10-08T15:37:54.720 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.713+0000 7f532a499700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5324150000 con 0x7f532414add0 2023-10-08T15:37:54.720 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.713+0000 7f5329497700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5324069e10 0x7f5324150d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:54.720 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.713+0000 7f5329497700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5324069e10 0x7f5324150d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60032/0 (socket says 172.21.15.3:60032) 2023-10-08T15:37:54.721 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.713+0000 7f5329497700 1 -- 172.21.15.3:0/1936718081 learned_addr learned my addr 172.21.15.3:0/1936718081 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:54.721 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.713+0000 7f5329c98700 1 --2- 172.21.15.3:0/1936718081 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f532414add0 0x7f532415b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:54.721 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.713+0000 7f5328c96700 1 --2- 172.21.15.3:0/1936718081 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53240beb80 0x7f5324144160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:54.721 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.713+0000 7f5329497700 1 -- 172.21.15.3:0/1936718081 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f532414add0 msgr2=0x7f532415b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:54.721 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.713+0000 7f5329497700 1 --2- 172.21.15.3:0/1936718081 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f532414add0 0x7f532415b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:54.721 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.713+0000 7f5329497700 1 -- 172.21.15.3:0/1936718081 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53240beb80 msgr2=0x7f5324144160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:54.721 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.713+0000 7f5329497700 1 --2- 172.21.15.3:0/1936718081 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53240beb80 0x7f5324144160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:54.721 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.713+0000 7f5329497700 1 -- 172.21.15.3:0/1936718081 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f531c009a20 con 0x7f5324069e10 2023-10-08T15:37:54.721 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.713+0000 7f5329497700 1 --2- 172.21.15.3:0/1936718081 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5324069e10 0x7f5324150d10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5324071260 tx=0x7f5314017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:54.722 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.713+0000 7f53197fa700 1 -- 172.21.15.3:0/1936718081 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5314000d10 con 0x7f5324069e10 2023-10-08T15:37:54.722 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.713+0000 7f53197fa700 1 -- 172.21.15.3:0/1936718081 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f531400bb20 con 0x7f5324069e10 2023-10-08T15:37:54.722 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.713+0000 7f532a499700 1 -- 172.21.15.3:0/1936718081 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53140094f0 con 0x7f5324069e10 2023-10-08T15:37:54.722 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.713+0000 7f53197fa700 1 -- 172.21.15.3:0/1936718081 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5314011670 con 0x7f5324069e10 2023-10-08T15:37:54.723 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.713+0000 7f532a499700 1 -- 172.21.15.3:0/1936718081 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53241446a0 con 0x7f5324069e10 2023-10-08T15:37:54.723 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.717+0000 7f532a499700 1 -- 172.21.15.3:0/1936718081 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f532405ecf0 con 0x7f5324069e10 2023-10-08T15:37:54.723 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.717+0000 7f53197fa700 1 -- 172.21.15.3:0/1936718081 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f53140119e0 con 0x7f5324069e10 2023-10-08T15:37:54.723 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.717+0000 7f53197fa700 1 --2- 172.21.15.3:0/1936718081 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5308060550 0x7f5308062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:54.724 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.717+0000 7f53197fa700 1 -- 172.21.15.3:0/1936718081 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f531407de10 con 0x7f5324069e10 2023-10-08T15:37:54.724 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.717+0000 7f5328c96700 1 --2- 172.21.15.3:0/1936718081 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5308060550 0x7f5308062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:54.724 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.717+0000 7f5328c96700 1 --2- 172.21.15.3:0/1936718081 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5308060550 0x7f5308062a00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5324144a30 tx=0x7f53200091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:54.732 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.725+0000 7f53197fa700 1 -- 172.21.15.3:0/1936718081 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f531404e4c0 con 0x7f5324069e10 2023-10-08T15:37:54.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.897+0000 7f532a499700 1 -- 172.21.15.3:0/1936718081 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f53240bef50 con 0x7f5324069e10 2023-10-08T15:37:54.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.897+0000 7f53197fa700 1 -- 172.21.15.3:0/1936718081 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f53140150a0 con 0x7f5324069e10 2023-10-08T15:37:54.902 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2023-10-08T15:37:54.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.897+0000 7f532a499700 1 -- 172.21.15.3:0/1936718081 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5308060550 msgr2=0x7f5308062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:54.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.897+0000 7f532a499700 1 --2- 172.21.15.3:0/1936718081 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5308060550 0x7f5308062a00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5324144a30 tx=0x7f53200091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:54.905 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.897+0000 7f532a499700 1 -- 172.21.15.3:0/1936718081 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5324069e10 msgr2=0x7f5324150d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:54.905 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.897+0000 7f532a499700 1 --2- 172.21.15.3:0/1936718081 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5324069e10 0x7f5324150d10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5324071260 tx=0x7f5314017000 comp rx=0 tx=0).stop 2023-10-08T15:37:54.905 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.897+0000 7f532a499700 1 -- 172.21.15.3:0/1936718081 shutdown_connections 2023-10-08T15:37:54.905 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.897+0000 7f532a499700 1 --2- 172.21.15.3:0/1936718081 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5308060550 0x7f5308062a00 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:54.905 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.897+0000 7f532a499700 1 --2- 172.21.15.3:0/1936718081 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f532414add0 0x7f532415b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:54.905 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.897+0000 7f532a499700 1 --2- 172.21.15.3:0/1936718081 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53240beb80 0x7f5324144160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:54.905 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.897+0000 7f532a499700 1 --2- 172.21.15.3:0/1936718081 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5324069e10 0x7f5324150d10 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:54.905 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.897+0000 7f532a499700 1 -- 172.21.15.3:0/1936718081 >> 172.21.15.3:0/1936718081 conn(0x7f5324067b60 msgr2=0x7f53240bd050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:54.905 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.897+0000 7f532a499700 1 -- 172.21.15.3:0/1936718081 shutdown_connections 2023-10-08T15:37:54.905 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:54.897+0000 7f532a499700 1 -- 172.21.15.3:0/1936718081 wait complete. 2023-10-08T15:37:54.917 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T15:37:55.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.021+0000 7f47aeba8700 1 Processor -- start 2023-10-08T15:37:55.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.021+0000 7f47aeba8700 1 -- start start 2023-10-08T15:37:55.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.021+0000 7f47aeba8700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f47a814bfa0 0x7f47a8068e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:55.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.021+0000 7f47aeba8700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f47a8069360 0x7f47a80bc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:55.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.021+0000 7f47aeba8700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47a8068990 con 0x7f47a80bc2c0 2023-10-08T15:37:55.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.021+0000 7f47aeba8700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47a806a000 con 0x7f47a814bfa0 2023-10-08T15:37:55.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.021+0000 7f47aeba8700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a8068410 con 0x7f47a8069360 2023-10-08T15:37:55.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.025+0000 7f47ad3a5700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f47a814bfa0 0x7f47a8068e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:55.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.025+0000 7f47ae3a7700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f47a8069360 0x7f47a80bc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:55.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.025+0000 7f47adba6700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f47a80bc2c0 0x7f47a806bc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.3:37010/0 (socket says 172.21.15.3:37010) 2023-10-08T15:37:55.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.025+0000 7f47ad3a5700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f47a814bfa0 0x7f47a8068e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.3:40224/0 (socket says 172.21.15.3:40224) 2023-10-08T15:37:55.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.025+0000 7f47adba6700 1 -- 172.21.15.3:0/49295823 learned_addr learned my addr 172.21.15.3:0/49295823 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:55.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.025+0000 7f47ad3a5700 1 -- 172.21.15.3:0/49295823 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f47a8069360 msgr2=0x7f47a80bc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:55.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.025+0000 7f47ad3a5700 1 --2- 172.21.15.3:0/49295823 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f47a8069360 0x7f47a80bc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:55.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.025+0000 7f47ad3a5700 1 -- 172.21.15.3:0/49295823 >> v1:172.21.15.50:6789/0 conn(0x7f47a80bc2c0 legacy=0x7f47a806bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:55.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.025+0000 7f47ad3a5700 1 -- 172.21.15.3:0/49295823 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a806d4e0 con 0x7f47a814bfa0 2023-10-08T15:37:55.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.025+0000 7f47ad3a5700 1 --2- 172.21.15.3:0/49295823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47a814bfa0 0x7f47a8068e20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f47980098e0 tx=0x7f47980091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65e8e6a3a35a068a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:55.033 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.025+0000 7f47acba4700 1 -- 172.21.15.3:0/49295823 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479800b640 con 0x7f47a814bfa0 2023-10-08T15:37:55.033 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.025+0000 7f47acba4700 1 -- 172.21.15.3:0/49295823 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f479800b7a0 con 0x7f47a814bfa0 2023-10-08T15:37:55.033 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.025+0000 7f47acba4700 1 -- 172.21.15.3:0/49295823 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479800bb40 con 0x7f47a814bfa0 2023-10-08T15:37:55.033 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.025+0000 7f47aeba8700 1 -- 172.21.15.3:0/49295823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47a814bfa0 msgr2=0x7f47a8068e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:55.033 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.025+0000 7f47aeba8700 1 --2- 172.21.15.3:0/49295823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47a814bfa0 0x7f47a8068e20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f47980098e0 tx=0x7f47980091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:55.033 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.025+0000 7f47aeba8700 1 -- 172.21.15.3:0/49295823 shutdown_connections 2023-10-08T15:37:55.033 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.025+0000 7f47aeba8700 1 --2- 172.21.15.3:0/49295823 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f47a8069360 0x7f47a80bc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:55.033 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.025+0000 7f47aeba8700 1 --2- 172.21.15.3:0/49295823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47a814bfa0 0x7f47a8068e20 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:55.033 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.025+0000 7f47aeba8700 1 -- 172.21.15.3:0/49295823 >> 172.21.15.3:0/49295823 conn(0x7f47a806f340 msgr2=0x7f47a80670e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:55.033 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.025+0000 7f47aeba8700 1 -- 172.21.15.3:0/49295823 shutdown_connections 2023-10-08T15:37:55.033 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.025+0000 7f47aeba8700 1 -- 172.21.15.3:0/49295823 wait complete. 2023-10-08T15:37:55.034 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.029+0000 7f47aeba8700 1 Processor -- start 2023-10-08T15:37:55.034 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.029+0000 7f47aeba8700 1 -- start start 2023-10-08T15:37:55.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.029+0000 7f47aeba8700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f47a8069360 0x7f47a80bfef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:55.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.029+0000 7f47aeba8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47a80bc2c0 0x7f47a8095e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:55.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.029+0000 7f47aeba8700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f47a814bfa0 0x7f47a8096390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:55.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.029+0000 7f47aeba8700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a809a230 con 0x7f47a8069360 2023-10-08T15:37:55.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.029+0000 7f47aeba8700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a80c0430 con 0x7f47a80bc2c0 2023-10-08T15:37:55.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.029+0000 7f47aeba8700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a8099280 con 0x7f47a814bfa0 2023-10-08T15:37:55.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.029+0000 7f47adba6700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f47a8069360 0x7f47a80bfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:55.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.029+0000 7f47adba6700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f47a8069360 0x7f47a80bfef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60038/0 (socket says 172.21.15.3:60038) 2023-10-08T15:37:55.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.029+0000 7f47adba6700 1 -- 172.21.15.3:0/3098298621 learned_addr learned my addr 172.21.15.3:0/3098298621 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:55.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.029+0000 7f47ad3a5700 1 --2- 172.21.15.3:0/3098298621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47a80bc2c0 0x7f47a8095e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:55.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.029+0000 7f47ae3a7700 1 --2- 172.21.15.3:0/3098298621 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f47a814bfa0 0x7f47a8096390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:55.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.029+0000 7f47adba6700 1 -- 172.21.15.3:0/3098298621 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f47a814bfa0 msgr2=0x7f47a8096390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:55.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.029+0000 7f47adba6700 1 --2- 172.21.15.3:0/3098298621 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f47a814bfa0 0x7f47a8096390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:55.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.029+0000 7f47adba6700 1 -- 172.21.15.3:0/3098298621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47a80bc2c0 msgr2=0x7f47a8095e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:55.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.029+0000 7f47adba6700 1 --2- 172.21.15.3:0/3098298621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47a80bc2c0 0x7f47a8095e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:55.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.029+0000 7f47adba6700 1 -- 172.21.15.3:0/3098298621 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4798009420 con 0x7f47a8069360 2023-10-08T15:37:55.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.029+0000 7f47adba6700 1 --2- 172.21.15.3:0/3098298621 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f47a8069360 0x7f47a80bfef0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f47a400c7c0 tx=0x7f47a4007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:55.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.029+0000 7f479dffb700 1 -- 172.21.15.3:0/3098298621 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a4005b30 con 0x7f47a8069360 2023-10-08T15:37:55.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.029+0000 7f479dffb700 1 -- 172.21.15.3:0/3098298621 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a4005c90 con 0x7f47a8069360 2023-10-08T15:37:55.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.029+0000 7f47aeba8700 1 -- 172.21.15.3:0/3098298621 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47a8098f50 con 0x7f47a8069360 2023-10-08T15:37:55.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.029+0000 7f479dffb700 1 -- 172.21.15.3:0/3098298621 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a4004a80 con 0x7f47a8069360 2023-10-08T15:37:55.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.029+0000 7f47aeba8700 1 -- 172.21.15.3:0/3098298621 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47a815b030 con 0x7f47a8069360 2023-10-08T15:37:55.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.033+0000 7f47aeba8700 1 -- 172.21.15.3:0/3098298621 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47a805ecf0 con 0x7f47a8069360 2023-10-08T15:37:55.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.033+0000 7f479dffb700 1 -- 172.21.15.3:0/3098298621 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f47a40070d0 con 0x7f47a8069360 2023-10-08T15:37:55.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.033+0000 7f479dffb700 1 --2- 172.21.15.3:0/3098298621 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f478c060580 0x7f478c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:55.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.033+0000 7f479dffb700 1 -- 172.21.15.3:0/3098298621 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f47a407bc70 con 0x7f47a8069360 2023-10-08T15:37:55.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.033+0000 7f47ad3a5700 1 --2- 172.21.15.3:0/3098298621 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f478c060580 0x7f478c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:55.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.033+0000 7f47ad3a5700 1 --2- 172.21.15.3:0/3098298621 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f478c060580 0x7f478c062a30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f47980093f0 tx=0x7f4798017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:55.049 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.041+0000 7f479dffb700 1 -- 172.21.15.3:0/3098298621 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f47a404c1c0 con 0x7f47a8069360 2023-10-08T15:37:55.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.197+0000 7f47aeba8700 1 -- 172.21.15.3:0/3098298621 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f47a8099440 con 0x7f47a8069360 2023-10-08T15:37:55.205 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.201+0000 7f479dffb700 1 -- 172.21.15.3:0/3098298621 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f47a404f7e0 con 0x7f47a8069360 2023-10-08T15:37:55.206 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 32 2023-10-08T15:37:55.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.205+0000 7f47aeba8700 1 -- 172.21.15.3:0/3098298621 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f478c060580 msgr2=0x7f478c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:55.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.205+0000 7f47aeba8700 1 --2- 172.21.15.3:0/3098298621 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f478c060580 0x7f478c062a30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f47980093f0 tx=0x7f4798017000 comp rx=0 tx=0).stop 2023-10-08T15:37:55.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.205+0000 7f47aeba8700 1 -- 172.21.15.3:0/3098298621 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f47a8069360 msgr2=0x7f47a80bfef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:55.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.205+0000 7f47aeba8700 1 --2- 172.21.15.3:0/3098298621 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f47a8069360 0x7f47a80bfef0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f47a400c7c0 tx=0x7f47a4007f70 comp rx=0 tx=0).stop 2023-10-08T15:37:55.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.205+0000 7f47aeba8700 1 -- 172.21.15.3:0/3098298621 shutdown_connections 2023-10-08T15:37:55.211 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.205+0000 7f47aeba8700 1 --2- 172.21.15.3:0/3098298621 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f478c060580 0x7f478c062a30 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:55.211 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.205+0000 7f47aeba8700 1 --2- 172.21.15.3:0/3098298621 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f47a814bfa0 0x7f47a8096390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:55.211 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.205+0000 7f47aeba8700 1 --2- 172.21.15.3:0/3098298621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47a80bc2c0 0x7f47a8095e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:55.211 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.205+0000 7f47aeba8700 1 --2- 172.21.15.3:0/3098298621 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f47a8069360 0x7f47a80bfef0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:55.211 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.205+0000 7f47aeba8700 1 -- 172.21.15.3:0/3098298621 >> 172.21.15.3:0/3098298621 conn(0x7f47a806f340 msgr2=0x7f47a814b530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:55.211 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.205+0000 7f47aeba8700 1 -- 172.21.15.3:0/3098298621 shutdown_connections 2023-10-08T15:37:55.211 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.205+0000 7f47aeba8700 1 -- 172.21.15.3:0/3098298621 wait complete. 2023-10-08T15:37:55.225 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T15:37:55.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.333+0000 7ff36b59e700 1 Processor -- start 2023-10-08T15:37:55.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.333+0000 7ff36b59e700 1 -- start start 2023-10-08T15:37:55.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.333+0000 7ff36b59e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff36c0a03d0 0x7ff36c09cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:55.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.333+0000 7ff36b59e700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff36c09e9f0 con 0x7ff36c09d020 2023-10-08T15:37:55.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.333+0000 7ff36b59e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff36c09ee80 con 0x7ff36c14aee0 2023-10-08T15:37:55.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.333+0000 7ff36b59e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff36c09e3a0 con 0x7ff36c0a03d0 2023-10-08T15:37:55.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.333+0000 7ff36ad9d700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7ff36c09d020 0x7ff36c0a0be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:49958/0 (socket says 172.21.15.3:49958) 2023-10-08T15:37:55.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.333+0000 7ff36ad9d700 1 -- 172.21.15.3:0/552261441 learned_addr learned my addr 172.21.15.3:0/552261441 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:55.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.333+0000 7ff369d9b700 1 --2- 172.21.15.3:0/552261441 >> v2:172.21.15.50:3300/0 conn(0x7ff36c0a03d0 0x7ff36c09cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:55.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.333+0000 7ff36959a700 1 -- 172.21.15.3:0/552261441 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1134376998 0 0) 0x7ff36c09e9f0 con 0x7ff36c09d020 2023-10-08T15:37:55.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.333+0000 7ff36959a700 1 -- 172.21.15.3:0/552261441 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff34c003570 con 0x7ff36c09d020 2023-10-08T15:37:55.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.333+0000 7ff36959a700 1 -- 172.21.15.3:0/552261441 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3830695502 0 0) 0x7ff34c003570 con 0x7ff36c09d020 2023-10-08T15:37:55.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.333+0000 7ff36959a700 1 -- 172.21.15.3:0/552261441 >> v2:172.21.15.50:3300/0 conn(0x7ff36c0a03d0 msgr2=0x7ff36c09cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:55.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.333+0000 7ff36959a700 1 --2- 172.21.15.3:0/552261441 >> v2:172.21.15.50:3300/0 conn(0x7ff36c0a03d0 0x7ff36c09cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:55.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.337+0000 7ff36959a700 1 -- 172.21.15.3:0/552261441 >> v1:172.21.15.50:6789/0 conn(0x7ff36c14aee0 legacy=0x7ff36c14b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:55.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.337+0000 7ff36959a700 1 -- 172.21.15.3:0/552261441 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff36c09e680 con 0x7ff36c09d020 2023-10-08T15:37:55.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.337+0000 7ff36959a700 1 -- 172.21.15.3:0/552261441 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2285686191 0 0) 0x7ff3640017f0 con 0x7ff36c09d020 2023-10-08T15:37:55.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.337+0000 7ff36959a700 1 -- 172.21.15.3:0/552261441 >> v1:172.21.15.3:6789/0 conn(0x7ff36c09d020 legacy=0x7ff36c0a0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:55.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.337+0000 7ff36959a700 1 --2- 172.21.15.3:0/552261441 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff34c003a60 0x7ff34c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:55.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.337+0000 7ff36959a700 1 --2- 172.21.15.3:0/552261441 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff34c004810 0x7ff34c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:55.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.337+0000 7ff36959a700 1 --2- 172.21.15.3:0/552261441 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff34c0051c0 0x7ff34c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:55.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.337+0000 7ff36959a700 1 -- 172.21.15.3:0/552261441 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff36c09e3a0 con 0x7ff34c003a60 2023-10-08T15:37:55.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.337+0000 7ff36959a700 1 -- 172.21.15.3:0/552261441 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff34c00c160 con 0x7ff34c0051c0 2023-10-08T15:37:55.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.337+0000 7ff36959a700 1 -- 172.21.15.3:0/552261441 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff34c00c320 con 0x7ff34c004810 2023-10-08T15:37:55.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.337+0000 7ff36a59c700 1 --2- 172.21.15.3:0/552261441 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff34c003a60 0x7ff34c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:55.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.337+0000 7ff369d9b700 1 --2- 172.21.15.3:0/552261441 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff34c004810 0x7ff34c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:55.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.337+0000 7ff36a59c700 1 -- 172.21.15.3:0/552261441 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff34c004810 msgr2=0x7ff34c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:55.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.337+0000 7ff36a59c700 1 --2- 172.21.15.3:0/552261441 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff34c004810 0x7ff34c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:55.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.337+0000 7ff36a59c700 1 -- 172.21.15.3:0/552261441 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff34c0051c0 msgr2=0x7ff34c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:55.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.337+0000 7ff36ad9d700 1 --2- 172.21.15.3:0/552261441 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff34c0051c0 0x7ff34c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:55.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.337+0000 7ff36a59c700 1 --2- 172.21.15.3:0/552261441 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff34c0051c0 0x7ff34c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:55.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.337+0000 7ff36a59c700 1 -- 172.21.15.3:0/552261441 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff34c003570 con 0x7ff34c003a60 2023-10-08T15:37:55.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.337+0000 7ff36ad9d700 1 --2- 172.21.15.3:0/552261441 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff34c0051c0 0x7ff34c00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:37:55.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.337+0000 7ff36ad9d700 1 -- 172.21.15.3:0/552261441 reap_dead start 2023-10-08T15:37:55.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.337+0000 7ff36a59c700 1 --2- 172.21.15.3:0/552261441 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff34c003a60 0x7ff34c003e70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff35c0018b0 tx=0x7ff35c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=457990f7ca53dbe7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:55.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.337+0000 7ff36959a700 1 -- 172.21.15.3:0/552261441 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35c012420 con 0x7ff34c003a60 2023-10-08T15:37:55.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.337+0000 7ff36959a700 1 -- 172.21.15.3:0/552261441 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff35c0125a0 con 0x7ff34c003a60 2023-10-08T15:37:55.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.337+0000 7ff36959a700 1 -- 172.21.15.3:0/552261441 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35c012960 con 0x7ff34c003a60 2023-10-08T15:37:55.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.337+0000 7ff36b59e700 1 -- 172.21.15.3:0/552261441 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff34c003a60 msgr2=0x7ff34c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:55.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.337+0000 7ff36b59e700 1 --2- 172.21.15.3:0/552261441 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff34c003a60 0x7ff34c003e70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff35c0018b0 tx=0x7ff35c007d30 comp rx=0 tx=0).stop 2023-10-08T15:37:55.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.337+0000 7ff36b59e700 1 -- 172.21.15.3:0/552261441 shutdown_connections 2023-10-08T15:37:55.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.337+0000 7ff36b59e700 1 --2- 172.21.15.3:0/552261441 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff34c003a60 0x7ff34c003e70 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:55.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.337+0000 7ff36b59e700 1 -- 172.21.15.3:0/552261441 >> 172.21.15.3:0/552261441 conn(0x7ff36c067b70 msgr2=0x7ff36c0ba650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:55.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.337+0000 7ff36b59e700 1 -- 172.21.15.3:0/552261441 shutdown_connections 2023-10-08T15:37:55.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.337+0000 7ff36b59e700 1 -- 172.21.15.3:0/552261441 wait complete. 2023-10-08T15:37:55.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.337+0000 7ff36b59e700 1 Processor -- start 2023-10-08T15:37:55.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.337+0000 7ff36b59e700 1 -- start start 2023-10-08T15:37:55.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.337+0000 7ff36b59e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff34c003a60 0x7ff36c146dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:55.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.337+0000 7ff36b59e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff36c147b00 0x7ff36c15eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:55.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.337+0000 7ff36b59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff36c0bcfa0 0x7ff36c095a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:55.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.337+0000 7ff36b59e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff36c097810 con 0x7ff36c147b00 2023-10-08T15:37:55.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.337+0000 7ff36b59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff36c146930 con 0x7ff36c0bcfa0 2023-10-08T15:37:55.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.341+0000 7ff36b59e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff36c146350 con 0x7ff34c003a60 2023-10-08T15:37:55.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.341+0000 7ff369d9b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff36c147b00 0x7ff36c15eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:55.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.341+0000 7ff369d9b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff36c147b00 0x7ff36c15eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60060/0 (socket says 172.21.15.3:60060) 2023-10-08T15:37:55.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.341+0000 7ff369d9b700 1 -- 172.21.15.3:0/3712179968 learned_addr learned my addr 172.21.15.3:0/3712179968 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:55.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.341+0000 7ff36a59c700 1 --2- 172.21.15.3:0/3712179968 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff34c003a60 0x7ff36c146dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:55.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.341+0000 7ff36ad9d700 1 --2- 172.21.15.3:0/3712179968 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff36c0bcfa0 0x7ff36c095a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:55.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.341+0000 7ff36a59c700 1 -- 172.21.15.3:0/3712179968 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff36c0bcfa0 msgr2=0x7ff36c095a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:55.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.341+0000 7ff36a59c700 1 --2- 172.21.15.3:0/3712179968 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff36c0bcfa0 0x7ff36c095a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:55.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.341+0000 7ff36a59c700 1 -- 172.21.15.3:0/3712179968 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff36c147b00 msgr2=0x7ff36c15eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:55.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.341+0000 7ff36a59c700 1 --2- 172.21.15.3:0/3712179968 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff36c147b00 0x7ff36c15eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:55.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.341+0000 7ff36a59c700 1 -- 172.21.15.3:0/3712179968 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff36c1465c0 con 0x7ff34c003a60 2023-10-08T15:37:55.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.341+0000 7ff369d9b700 1 --2- 172.21.15.3:0/3712179968 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff36c147b00 0x7ff36c15eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:37:55.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.341+0000 7ff36a59c700 1 --2- 172.21.15.3:0/3712179968 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff34c003a60 0x7ff36c146dc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff35c001880 tx=0x7ff35c015000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:55.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.341+0000 7ff3627fc700 1 -- 172.21.15.3:0/3712179968 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35c012420 con 0x7ff34c003a60 2023-10-08T15:37:55.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.341+0000 7ff3627fc700 1 -- 172.21.15.3:0/3712179968 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff35c001200 con 0x7ff34c003a60 2023-10-08T15:37:55.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.341+0000 7ff36b59e700 1 -- 172.21.15.3:0/3712179968 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff36c15f000 con 0x7ff34c003a60 2023-10-08T15:37:55.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.341+0000 7ff3627fc700 1 -- 172.21.15.3:0/3712179968 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35c0078b0 con 0x7ff34c003a60 2023-10-08T15:37:55.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.341+0000 7ff36b59e700 1 -- 172.21.15.3:0/3712179968 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff36c0bd5b0 con 0x7ff34c003a60 2023-10-08T15:37:55.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.341+0000 7ff36b59e700 1 -- 172.21.15.3:0/3712179968 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff36c05ecf0 con 0x7ff34c003a60 2023-10-08T15:37:55.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.345+0000 7ff3627fc700 1 -- 172.21.15.3:0/3712179968 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff35c01f410 con 0x7ff34c003a60 2023-10-08T15:37:55.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.345+0000 7ff3627fc700 1 --2- 172.21.15.3:0/3712179968 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff350060580 0x7ff350062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:55.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.345+0000 7ff3627fc700 1 -- 172.21.15.3:0/3712179968 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff35c07df20 con 0x7ff34c003a60 2023-10-08T15:37:55.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.345+0000 7ff369d9b700 1 --2- 172.21.15.3:0/3712179968 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff350060580 0x7ff350062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:55.352 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.345+0000 7ff369d9b700 1 --2- 172.21.15.3:0/3712179968 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff350060580 0x7ff350062a30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff36c0bd870 tx=0x7ff3540091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:55.360 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.353+0000 7ff3627fc700 1 -- 172.21.15.3:0/3712179968 <== mon.2 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff35c04e510 con 0x7ff34c003a60 2023-10-08T15:37:55.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.513+0000 7ff36b59e700 1 -- 172.21.15.3:0/3712179968 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff36c09d480 con 0x7ff34c003a60 2023-10-08T15:37:55.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.517+0000 7ff3627fc700 1 -- 172.21.15.3:0/3712179968 <== mon.2 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff35c023020 con 0x7ff34c003a60 2023-10-08T15:37:55.522 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 64 2023-10-08T15:37:55.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.517+0000 7ff36b59e700 1 -- 172.21.15.3:0/3712179968 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff350060580 msgr2=0x7ff350062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:55.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.517+0000 7ff36b59e700 1 --2- 172.21.15.3:0/3712179968 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff350060580 0x7ff350062a30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff36c0bd870 tx=0x7ff3540091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:55.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.517+0000 7ff36b59e700 1 -- 172.21.15.3:0/3712179968 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff34c003a60 msgr2=0x7ff36c146dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:55.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.517+0000 7ff36b59e700 1 --2- 172.21.15.3:0/3712179968 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff34c003a60 0x7ff36c146dc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff35c001880 tx=0x7ff35c015000 comp rx=0 tx=0).stop 2023-10-08T15:37:55.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.517+0000 7ff36b59e700 1 -- 172.21.15.3:0/3712179968 shutdown_connections 2023-10-08T15:37:55.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.517+0000 7ff36b59e700 1 --2- 172.21.15.3:0/3712179968 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff350060580 0x7ff350062a30 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:55.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.517+0000 7ff36b59e700 1 --2- 172.21.15.3:0/3712179968 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff36c0bcfa0 0x7ff36c095a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:55.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.517+0000 7ff36b59e700 1 --2- 172.21.15.3:0/3712179968 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff36c147b00 0x7ff36c15eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:55.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.517+0000 7ff36b59e700 1 --2- 172.21.15.3:0/3712179968 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff34c003a60 0x7ff36c146dc0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:55.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.517+0000 7ff36b59e700 1 -- 172.21.15.3:0/3712179968 >> 172.21.15.3:0/3712179968 conn(0x7ff36c067b70 msgr2=0x7ff36c140650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:55.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.517+0000 7ff36b59e700 1 -- 172.21.15.3:0/3712179968 shutdown_connections 2023-10-08T15:37:55.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.517+0000 7ff36b59e700 1 -- 172.21.15.3:0/3712179968 wait complete. 2023-10-08T15:37:55.537 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:37:55.646 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.641+0000 7f1996eb1700 1 Processor -- start 2023-10-08T15:37:55.647 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.641+0000 7f1996eb1700 1 -- start start 2023-10-08T15:37:55.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.641+0000 7f1996eb1700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f19900b3530 0x7f1990148c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:55.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.641+0000 7f1996eb1700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1990149160 0x7f19901495a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:55.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.641+0000 7f1996eb1700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19900b2ee0 con 0x7f199014cc00 2023-10-08T15:37:55.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.641+0000 7f1996eb1700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19900b3c80 con 0x7f19900b3530 2023-10-08T15:37:55.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.641+0000 7f1996eb1700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f199006d250 con 0x7f1990149160 2023-10-08T15:37:55.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.641+0000 7f198ffff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f19900b3530 0x7f1990148c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:55.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.641+0000 7f198ffff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f19900b3530 0x7f1990148c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60072/0 (socket says 172.21.15.3:60072) 2023-10-08T15:37:55.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.641+0000 7f198ffff700 1 -- 172.21.15.3:0/196106770 learned_addr learned my addr 172.21.15.3:0/196106770 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:55.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.641+0000 7f199544e700 1 --2- 172.21.15.3:0/196106770 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1990149160 0x7f19901495a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:55.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.641+0000 7f198ffff700 1 -- 172.21.15.3:0/196106770 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1990149160 msgr2=0x7f19901495a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:55.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.641+0000 7f198ffff700 1 --2- 172.21.15.3:0/196106770 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1990149160 0x7f19901495a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:55.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.641+0000 7f198ffff700 1 -- 172.21.15.3:0/196106770 >> v1:172.21.15.50:6789/0 conn(0x7f199014cc00 legacy=0x7f199014cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:55.650 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.641+0000 7f198ffff700 1 -- 172.21.15.3:0/196106770 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f199006def0 con 0x7f19900b3530 2023-10-08T15:37:55.650 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.641+0000 7f198ffff700 1 --2- 172.21.15.3:0/196106770 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19900b3530 0x7f1990148c20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f19800099b0 tx=0x7f1980009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bbc5df9c88dbb7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:55.650 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.641+0000 7f198f7fe700 1 -- 172.21.15.3:0/196106770 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198000b860 con 0x7f19900b3530 2023-10-08T15:37:55.650 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.641+0000 7f198f7fe700 1 -- 172.21.15.3:0/196106770 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f198000b9c0 con 0x7f19900b3530 2023-10-08T15:37:55.650 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.641+0000 7f198f7fe700 1 -- 172.21.15.3:0/196106770 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198000bd60 con 0x7f19900b3530 2023-10-08T15:37:55.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.641+0000 7f1996eb1700 1 -- 172.21.15.3:0/196106770 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19900b3530 msgr2=0x7f1990148c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:55.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.641+0000 7f1996eb1700 1 --2- 172.21.15.3:0/196106770 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19900b3530 0x7f1990148c20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f19800099b0 tx=0x7f1980009250 comp rx=0 tx=0).stop 2023-10-08T15:37:55.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.645+0000 7f1996eb1700 1 -- 172.21.15.3:0/196106770 shutdown_connections 2023-10-08T15:37:55.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.645+0000 7f1996eb1700 1 --2- 172.21.15.3:0/196106770 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1990149160 0x7f19901495a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:55.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.645+0000 7f1996eb1700 1 --2- 172.21.15.3:0/196106770 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19900b3530 0x7f1990148c20 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:55.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.645+0000 7f1996eb1700 1 -- 172.21.15.3:0/196106770 >> 172.21.15.3:0/196106770 conn(0x7f19900bdda0 msgr2=0x7f19900be170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:55.652 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.645+0000 7f1996eb1700 1 -- 172.21.15.3:0/196106770 shutdown_connections 2023-10-08T15:37:55.652 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.645+0000 7f1996eb1700 1 -- 172.21.15.3:0/196106770 wait complete. 2023-10-08T15:37:55.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.645+0000 7f1996eb1700 1 Processor -- start 2023-10-08T15:37:55.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.645+0000 7f1996eb1700 1 -- start start 2023-10-08T15:37:55.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.645+0000 7f1996eb1700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f19900b3530 0x7f19900b6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:55.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.645+0000 7f1996eb1700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1990149160 0x7f19900b6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:55.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.645+0000 7f1996eb1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f199014cc00 0x7f19900b74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:55.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.645+0000 7f1996eb1700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1990144c80 con 0x7f1990149160 2023-10-08T15:37:55.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.645+0000 7f1996eb1700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1990145ce0 con 0x7f199014cc00 2023-10-08T15:37:55.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.645+0000 7f1996eb1700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1990145f50 con 0x7f19900b3530 2023-10-08T15:37:55.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.645+0000 7f198ffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1990149160 0x7f19900b6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:55.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.645+0000 7f198ffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1990149160 0x7f19900b6a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60088/0 (socket says 172.21.15.3:60088) 2023-10-08T15:37:55.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.645+0000 7f198ffff700 1 -- 172.21.15.3:0/3429199263 learned_addr learned my addr 172.21.15.3:0/3429199263 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:55.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.645+0000 7f199544e700 1 --2- 172.21.15.3:0/3429199263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f199014cc00 0x7f19900b74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:55.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.645+0000 7f1994c4d700 1 --2- 172.21.15.3:0/3429199263 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f19900b3530 0x7f19900b6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:55.656 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.649+0000 7f198ffff700 1 -- 172.21.15.3:0/3429199263 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f19900b3530 msgr2=0x7f19900b6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:55.656 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.649+0000 7f198ffff700 1 --2- 172.21.15.3:0/3429199263 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f19900b3530 0x7f19900b6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:55.656 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.649+0000 7f198ffff700 1 -- 172.21.15.3:0/3429199263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f199014cc00 msgr2=0x7f19900b74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:55.656 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.649+0000 7f198ffff700 1 --2- 172.21.15.3:0/3429199263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f199014cc00 0x7f19900b74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:55.657 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.649+0000 7f198ffff700 1 -- 172.21.15.3:0/3429199263 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19800094f0 con 0x7f1990149160 2023-10-08T15:37:55.657 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.649+0000 7f198ffff700 1 --2- 172.21.15.3:0/3429199263 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1990149160 0x7f19900b6a90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f199006b9e0 tx=0x7f1980017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:55.657 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.649+0000 7f198cff9700 1 -- 172.21.15.3:0/3429199263 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1980011e40 con 0x7f1990149160 2023-10-08T15:37:55.657 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.649+0000 7f198cff9700 1 -- 172.21.15.3:0/3429199263 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1980024440 con 0x7f1990149160 2023-10-08T15:37:55.657 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.649+0000 7f198cff9700 1 -- 172.21.15.3:0/3429199263 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19800247e0 con 0x7f1990149160 2023-10-08T15:37:55.657 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.649+0000 7f1996eb1700 1 -- 172.21.15.3:0/3429199263 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1990146230 con 0x7f1990149160 2023-10-08T15:37:55.657 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.649+0000 7f1996eb1700 1 -- 172.21.15.3:0/3429199263 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19901467d0 con 0x7f1990149160 2023-10-08T15:37:55.657 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.649+0000 7f1996eb1700 1 -- 172.21.15.3:0/3429199263 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1990146450 con 0x7f1990149160 2023-10-08T15:37:55.658 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.649+0000 7f198cff9700 1 -- 172.21.15.3:0/3429199263 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f198001a420 con 0x7f1990149160 2023-10-08T15:37:55.658 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.653+0000 7f198cff9700 1 --2- 172.21.15.3:0/3429199263 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f197c060550 0x7f197c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:55.658 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.653+0000 7f198cff9700 1 -- 172.21.15.3:0/3429199263 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f198007e650 con 0x7f1990149160 2023-10-08T15:37:55.658 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.653+0000 7f1994c4d700 1 --2- 172.21.15.3:0/3429199263 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f197c060550 0x7f197c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:55.659 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.653+0000 7f1994c4d700 1 --2- 172.21.15.3:0/3429199263 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f197c060550 0x7f197c062a00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f19840039e0 tx=0x7f1984007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:55.666 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.661+0000 7f198cff9700 1 -- 172.21.15.3:0/3429199263 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f198004ec20 con 0x7f1990149160 2023-10-08T15:37:55.829 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.821+0000 7f1996eb1700 1 -- 172.21.15.3:0/3429199263 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1990064530 con 0x7f1990149160 2023-10-08T15:37:55.830 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.825+0000 7f198cff9700 1 -- 172.21.15.3:0/3429199263 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15254 (secure 0 0 0) 0x7f1980052240 con 0x7f1990149160 2023-10-08T15:37:55.831 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:37:55.831 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":20,"fsid":"7635972e-cd66-4a8f-a231-378db8b3847a","created":"2023-10-08T15:37:08.234594+0000","modified":"2023-10-08T15:37:27.007828+0000","last_up_change":"2023-10-08T15:37:17.537726+0000","last_in_change":"2023-10-08T15:37:10.269178+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:37:16.581590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:37:23.353518+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T15:37:24.365114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"64fb1864-bfdd-4d75-9b41-03fb60085dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33363},{"type":"v1","addr":"172.21.15.3:6801","nonce":33363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33363},{"type":"v1","addr":"172.21.15.3:6803","nonce":33363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":33363},{"type":"v1","addr":"172.21.15.3:6807","nonce":33363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33363},{"type":"v1","addr":"172.21.15.3:6805","nonce":33363}]},"public_addr":"172.21.15.3:6801/33363","cluster_addr":"172.21.15.3:6803/33363","heartbeat_back_addr":"172.21.15.3:6807/33363","heartbeat_front_addr":"172.21.15.3:6805/33363","state":["exists","up"]},{"osd":1,"uuid":"3ca6bd3a-3e8a-4c65-af9c-46148b0c2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33364},{"type":"v1","addr":"172.21.15.3:6820","nonce":33364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33364},{"type":"v1","addr":"172.21.15.3:6824","nonce":33364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33364},{"type":"v1","addr":"172.21.15.3:6831","nonce":33364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33364},{"type":"v1","addr":"172.21.15.3:6828","nonce":33364}]},"public_addr":"172.21.15.3:6820/33364","cluster_addr":"172.21.15.3:6824/33364","heartbeat_back_addr":"172.21.15.3:6831/33364","heartbeat_front_addr":"172.21.15.3:6828/33364","state":["exists","up"]},{"osd":2,"uuid":"6eb9f757-58dd-442f-910d-32401454bce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33366},{"type":"v1","addr":"172.21.15.3:6817","nonce":33366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":33366},{"type":"v1","addr":"172.21.15.3:6821","nonce":33366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6827","nonce":33366},{"type":"v1","addr":"172.21.15.3:6829","nonce":33366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":33366},{"type":"v1","addr":"172.21.15.3:6825","nonce":33366}]},"public_addr":"172.21.15.3:6817/33366","cluster_addr":"172.21.15.3:6821/33366","heartbeat_back_addr":"172.21.15.3:6829/33366","heartbeat_front_addr":"172.21.15.3:6825/33366","state":["exists","up"]},{"osd":3,"uuid":"1c39866b-ac2e-4ea9-a69c-02b01ee4191d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33365},{"type":"v1","addr":"172.21.15.3:6809","nonce":33365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":33365},{"type":"v1","addr":"172.21.15.3:6811","nonce":33365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33365},{"type":"v1","addr":"172.21.15.3:6815","nonce":33365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":33365},{"type":"v1","addr":"172.21.15.3:6813","nonce":33365}]},"public_addr":"172.21.15.3:6809/33365","cluster_addr":"172.21.15.3:6811/33365","heartbeat_back_addr":"172.21.15.3:6815/33365","heartbeat_front_addr":"172.21.15.3:6813/33365","state":["exists","up"]},{"osd":4,"uuid":"15f86b61-b7f1-4780-ae00-9d80a68cb830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":33605},{"type":"v1","addr":"172.21.15.50:6809","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33605},{"type":"v1","addr":"172.21.15.50:6811","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33605},{"type":"v1","addr":"172.21.15.50:6815","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":33605},{"type":"v1","addr":"172.21.15.50:6813","nonce":33605}]},"public_addr":"172.21.15.50:6809/33605","cluster_addr":"172.21.15.50:6811/33605","heartbeat_back_addr":"172.21.15.50:6815/33605","heartbeat_front_addr":"172.21.15.50:6813/33605","state":["exists","up"]},{"osd":5,"uuid":"726c3003-34e6-4d5a-b6e2-f911e13c2118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33606},{"type":"v1","addr":"172.21.15.50:6801","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33606},{"type":"v1","addr":"172.21.15.50:6803","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33606},{"type":"v1","addr":"172.21.15.50:6807","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":33606},{"type":"v1","addr":"172.21.15.50:6805","nonce":33606}]},"public_addr":"172.21.15.50:6801/33606","cluster_addr":"172.21.15.50:6803/33606","heartbeat_back_addr":"172.21.15.50:6807/33606","heartbeat_front_addr":"172.21.15.50:6805/33606","state":["exists","up"]},{"osd":6,"uuid":"401122a4-9988-441f-a5a7-39164434ebcd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":33607},{"type":"v1","addr":"172.21.15.50:6819","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":33607},{"type":"v1","addr":"172.21.15.50:6823","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":33607},{"type":"v1","addr":"172.21.15.50:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":33607},{"type":"v1","addr":"172.21.15.50:6827","nonce":33607}]},"public_addr":"172.21.15.50:6819/33607","cluster_addr":"172.21.15.50:6823/33607","heartbeat_back_addr":"172.21.15.50:6831/33607","heartbeat_front_addr":"172.21.15.50:6827/33607","state":["exists","up"]},{"osd":7,"uuid":"6b3fa236-c9d0-4c4d-82ae-9af4daf6d699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33604},{"type":"v1","addr":"172.21.15.50:6818","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":33604},{"type":"v1","addr":"172.21.15.50:6822","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":33604},{"type":"v1","addr":"172.21.15.50:6830","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":33604},{"type":"v1","addr":"172.21.15.50:6826","nonce":33604}]},"public_addr":"172.21.15.50:6818/33604","cluster_addr":"172.21.15.50:6822/33604","heartbeat_back_addr":"172.21.15.50:6830/33604","heartbeat_front_addr":"172.21.15.50:6826/33604","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.497794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.529417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.873426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.325972+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.443971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.240795+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.739632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.643026+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:37:55.833 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.825+0000 7f1996eb1700 1 -- 172.21.15.3:0/3429199263 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f197c060550 msgr2=0x7f197c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:55.833 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.825+0000 7f1996eb1700 1 --2- 172.21.15.3:0/3429199263 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f197c060550 0x7f197c062a00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f19840039e0 tx=0x7f1984007ec0 comp rx=0 tx=0).stop 2023-10-08T15:37:55.833 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.825+0000 7f1996eb1700 1 -- 172.21.15.3:0/3429199263 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1990149160 msgr2=0x7f19900b6a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:55.834 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.825+0000 7f1996eb1700 1 --2- 172.21.15.3:0/3429199263 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1990149160 0x7f19900b6a90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f199006b9e0 tx=0x7f1980017000 comp rx=0 tx=0).stop 2023-10-08T15:37:55.834 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.825+0000 7f1996eb1700 1 -- 172.21.15.3:0/3429199263 shutdown_connections 2023-10-08T15:37:55.834 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.825+0000 7f1996eb1700 1 --2- 172.21.15.3:0/3429199263 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f197c060550 0x7f197c062a00 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:55.834 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.825+0000 7f1996eb1700 1 --2- 172.21.15.3:0/3429199263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f199014cc00 0x7f19900b74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:55.834 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.825+0000 7f1996eb1700 1 --2- 172.21.15.3:0/3429199263 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1990149160 0x7f19900b6a90 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:55.834 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.825+0000 7f1996eb1700 1 --2- 172.21.15.3:0/3429199263 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f19900b3530 0x7f19900b6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:55.834 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.825+0000 7f1996eb1700 1 -- 172.21.15.3:0/3429199263 >> 172.21.15.3:0/3429199263 conn(0x7f19900bdda0 msgr2=0x7f19900bc240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:55.835 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.825+0000 7f1996eb1700 1 -- 172.21.15.3:0/3429199263 shutdown_connections 2023-10-08T15:37:55.835 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.825+0000 7f1996eb1700 1 -- 172.21.15.3:0/3429199263 wait complete. 2023-10-08T15:37:55.846 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T15:37:16.581590+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T15:37:23.353518+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T15:37:24.365114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T15:37:55.849 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T15:37:55.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.957+0000 7fe112e01700 1 Processor -- start 2023-10-08T15:37:55.965 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.957+0000 7fe112e01700 1 -- start start 2023-10-08T15:37:55.967 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.961+0000 7fe112e01700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe10c06c830 0x7fe10c06d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:55.967 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.961+0000 7fe112e01700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fe10c14a8a0 0x7fe10c14ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:55.967 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.961+0000 7fe112e01700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe10c14c0e0 con 0x7fe10c0bf3a0 2023-10-08T15:37:55.967 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.961+0000 7fe112e01700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe10c14c570 con 0x7fe10c14a8a0 2023-10-08T15:37:55.967 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.961+0000 7fe112e01700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe10c14ba90 con 0x7fe10c06c830 2023-10-08T15:37:55.967 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.961+0000 7fe11139e700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fe10c14a8a0 0x7fe10c14ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:55.967 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.961+0000 7fe11139e700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fe10c14a8a0 0x7fe10c14ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60096/0 (socket says 172.21.15.3:60096) 2023-10-08T15:37:55.967 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.961+0000 7fe11139e700 1 -- 172.21.15.3:0/3863105398 learned_addr learned my addr 172.21.15.3:0/3863105398 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:55.967 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.961+0000 7fe110b9d700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fe10c0bf3a0 0x7fe10c06cf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:49972/0 (socket says 172.21.15.3:49972) 2023-10-08T15:37:55.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.961+0000 7fe10bfff700 1 --2- 172.21.15.3:0/3863105398 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe10c06c830 0x7fe10c06d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:55.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.961+0000 7fe11139e700 1 -- 172.21.15.3:0/3863105398 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe10c06c830 msgr2=0x7fe10c06d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:55.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.961+0000 7fe11139e700 1 --2- 172.21.15.3:0/3863105398 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe10c06c830 0x7fe10c06d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:55.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.961+0000 7fe11139e700 1 -- 172.21.15.3:0/3863105398 >> v1:172.21.15.3:6789/0 conn(0x7fe10c0bf3a0 legacy=0x7fe10c06cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:55.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.961+0000 7fe11139e700 1 -- 172.21.15.3:0/3863105398 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe10c14bd70 con 0x7fe10c14a8a0 2023-10-08T15:37:55.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.961+0000 7fe11139e700 1 --2- 172.21.15.3:0/3863105398 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe10c14a8a0 0x7fe10c14ad00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe104009f20 tx=0x7fe104009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2fd3d8dd3b98f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:55.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.961+0000 7fe10b7fe700 1 -- 172.21.15.3:0/3863105398 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10400e070 con 0x7fe10c14a8a0 2023-10-08T15:37:55.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.961+0000 7fe10b7fe700 1 -- 172.21.15.3:0/3863105398 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe10400ba80 con 0x7fe10c14a8a0 2023-10-08T15:37:55.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.961+0000 7fe10b7fe700 1 -- 172.21.15.3:0/3863105398 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1040092e0 con 0x7fe10c14a8a0 2023-10-08T15:37:55.971 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.961+0000 7fe112e01700 1 -- 172.21.15.3:0/3863105398 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe10c14a8a0 msgr2=0x7fe10c14ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:55.971 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.961+0000 7fe112e01700 1 --2- 172.21.15.3:0/3863105398 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe10c14a8a0 0x7fe10c14ad00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe104009f20 tx=0x7fe104009840 comp rx=0 tx=0).stop 2023-10-08T15:37:55.971 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.961+0000 7fe112e01700 1 -- 172.21.15.3:0/3863105398 shutdown_connections 2023-10-08T15:37:55.971 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.961+0000 7fe112e01700 1 --2- 172.21.15.3:0/3863105398 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe10c14a8a0 0x7fe10c14ad00 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:55.971 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.961+0000 7fe112e01700 1 --2- 172.21.15.3:0/3863105398 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe10c06c830 0x7fe10c06d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:55.972 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.961+0000 7fe112e01700 1 -- 172.21.15.3:0/3863105398 >> 172.21.15.3:0/3863105398 conn(0x7fe10c0c2a40 msgr2=0x7fe10c0bea60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:55.972 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.961+0000 7fe112e01700 1 -- 172.21.15.3:0/3863105398 shutdown_connections 2023-10-08T15:37:55.972 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.961+0000 7fe112e01700 1 -- 172.21.15.3:0/3863105398 wait complete. 2023-10-08T15:37:55.972 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.961+0000 7fe112e01700 1 Processor -- start 2023-10-08T15:37:55.972 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.961+0000 7fe112e01700 1 -- start start 2023-10-08T15:37:55.972 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.965+0000 7fe112e01700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe10c06c830 0x7fe10c15ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:55.972 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.965+0000 7fe112e01700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe10c0bf3a0 0x7fe10c1487d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:55.972 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.965+0000 7fe112e01700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe10c14a8a0 0x7fe10c1404d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:55.972 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.965+0000 7fe112e01700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe10c15f1a0 con 0x7fe10c0bf3a0 2023-10-08T15:37:55.972 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.965+0000 7fe112e01700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe10c145680 con 0x7fe10c14a8a0 2023-10-08T15:37:55.972 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.965+0000 7fe112e01700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe10c14a350 con 0x7fe10c06c830 2023-10-08T15:37:55.973 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.965+0000 7fe10bfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe10c0bf3a0 0x7fe10c1487d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:55.973 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.965+0000 7fe10bfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe10c0bf3a0 0x7fe10c1487d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60106/0 (socket says 172.21.15.3:60106) 2023-10-08T15:37:55.973 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.965+0000 7fe10bfff700 1 -- 172.21.15.3:0/2718192781 learned_addr learned my addr 172.21.15.3:0/2718192781 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:55.973 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.965+0000 7fe110b9d700 1 --2- 172.21.15.3:0/2718192781 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe10c06c830 0x7fe10c15ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:55.973 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.965+0000 7fe11139e700 1 --2- 172.21.15.3:0/2718192781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe10c14a8a0 0x7fe10c1404d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:55.973 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.965+0000 7fe10bfff700 1 -- 172.21.15.3:0/2718192781 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe10c06c830 msgr2=0x7fe10c15ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:55.973 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.965+0000 7fe10bfff700 1 --2- 172.21.15.3:0/2718192781 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe10c06c830 0x7fe10c15ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:55.973 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.965+0000 7fe10bfff700 1 -- 172.21.15.3:0/2718192781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe10c14a8a0 msgr2=0x7fe10c1404d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:55.973 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.965+0000 7fe10bfff700 1 --2- 172.21.15.3:0/2718192781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe10c14a8a0 0x7fe10c1404d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:55.973 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.965+0000 7fe10bfff700 1 -- 172.21.15.3:0/2718192781 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe104009ae0 con 0x7fe10c0bf3a0 2023-10-08T15:37:55.974 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.965+0000 7fe10bfff700 1 --2- 172.21.15.3:0/2718192781 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe10c0bf3a0 0x7fe10c1487d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc00d890 tx=0x7fe0fc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:55.974 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.965+0000 7fe108ff9700 1 -- 172.21.15.3:0/2718192781 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0fc0125f0 con 0x7fe10c0bf3a0 2023-10-08T15:37:55.974 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.965+0000 7fe108ff9700 1 -- 172.21.15.3:0/2718192781 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0fc012750 con 0x7fe10c0bf3a0 2023-10-08T15:37:55.974 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.965+0000 7fe112e01700 1 -- 172.21.15.3:0/2718192781 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe10c145030 con 0x7fe10c0bf3a0 2023-10-08T15:37:55.974 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.965+0000 7fe108ff9700 1 -- 172.21.15.3:0/2718192781 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0fc012ad0 con 0x7fe10c0bf3a0 2023-10-08T15:37:55.974 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.965+0000 7fe112e01700 1 -- 172.21.15.3:0/2718192781 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe10c148d10 con 0x7fe10c0bf3a0 2023-10-08T15:37:55.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.965+0000 7fe112e01700 1 -- 172.21.15.3:0/2718192781 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe10c064530 con 0x7fe10c0bf3a0 2023-10-08T15:37:55.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.969+0000 7fe108ff9700 1 -- 172.21.15.3:0/2718192781 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe0fc01e460 con 0x7fe10c0bf3a0 2023-10-08T15:37:55.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.969+0000 7fe108ff9700 1 --2- 172.21.15.3:0/2718192781 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe0f8060550 0x7fe0f8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:55.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.969+0000 7fe108ff9700 1 -- 172.21.15.3:0/2718192781 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe0fc07cdf0 con 0x7fe10c0bf3a0 2023-10-08T15:37:55.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.969+0000 7fe110b9d700 1 --2- 172.21.15.3:0/2718192781 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe0f8060550 0x7fe0f8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:55.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.969+0000 7fe110b9d700 1 --2- 172.21.15.3:0/2718192781 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe0f8060550 0x7fe0f8062a00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe100004fd0 tx=0x7fe100007eb0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:55.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:55.977+0000 7fe108ff9700 1 -- 172.21.15.3:0/2718192781 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe0fc050e70 con 0x7fe10c0bf3a0 2023-10-08T15:37:56.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.133+0000 7fe112e01700 1 -- 172.21.15.3:0/2718192781 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe10c0a2790 con 0x7fe10c0bf3a0 2023-10-08T15:37:56.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.137+0000 7fe108ff9700 1 -- 172.21.15.3:0/2718192781 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe0fc050a00 con 0x7fe10c0bf3a0 2023-10-08T15:37:56.142 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2023-10-08T15:37:56.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.137+0000 7fe112e01700 1 -- 172.21.15.3:0/2718192781 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe0f8060550 msgr2=0x7fe0f8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:56.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.137+0000 7fe112e01700 1 --2- 172.21.15.3:0/2718192781 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe0f8060550 0x7fe0f8062a00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe100004fd0 tx=0x7fe100007eb0 comp rx=0 tx=0).stop 2023-10-08T15:37:56.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.137+0000 7fe112e01700 1 -- 172.21.15.3:0/2718192781 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe10c0bf3a0 msgr2=0x7fe10c1487d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:56.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.137+0000 7fe112e01700 1 --2- 172.21.15.3:0/2718192781 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe10c0bf3a0 0x7fe10c1487d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc00d890 tx=0x7fe0fc008040 comp rx=0 tx=0).stop 2023-10-08T15:37:56.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.137+0000 7fe112e01700 1 -- 172.21.15.3:0/2718192781 shutdown_connections 2023-10-08T15:37:56.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.137+0000 7fe112e01700 1 --2- 172.21.15.3:0/2718192781 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe0f8060550 0x7fe0f8062a00 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:56.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.137+0000 7fe112e01700 1 --2- 172.21.15.3:0/2718192781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe10c14a8a0 0x7fe10c1404d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:56.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.137+0000 7fe112e01700 1 --2- 172.21.15.3:0/2718192781 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe10c0bf3a0 0x7fe10c1487d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:56.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.137+0000 7fe112e01700 1 --2- 172.21.15.3:0/2718192781 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe10c06c830 0x7fe10c15ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:56.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.137+0000 7fe112e01700 1 -- 172.21.15.3:0/2718192781 >> 172.21.15.3:0/2718192781 conn(0x7fe10c0c2a40 msgr2=0x7fe10c147840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:56.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.137+0000 7fe112e01700 1 -- 172.21.15.3:0/2718192781 shutdown_connections 2023-10-08T15:37:56.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.137+0000 7fe112e01700 1 -- 172.21.15.3:0/2718192781 wait complete. 2023-10-08T15:37:56.157 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T15:37:56.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.265+0000 7f384508b700 1 Processor -- start 2023-10-08T15:37:56.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.265+0000 7f384508b700 1 -- start start 2023-10-08T15:37:56.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.269+0000 7f384508b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f38400bf3a0 0x7f384006cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:56.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.269+0000 7f384508b700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f384014c0e0 con 0x7f384006c830 2023-10-08T15:37:56.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.269+0000 7f384508b700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f384014c570 con 0x7f384014a8a0 2023-10-08T15:37:56.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.269+0000 7f384508b700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f384014ba90 con 0x7f38400bf3a0 2023-10-08T15:37:56.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.269+0000 7f383659c700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f384006c830 0x7f384006d490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:49980/0 (socket says 172.21.15.3:49980) 2023-10-08T15:37:56.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.269+0000 7f383659c700 1 -- 172.21.15.3:0/1304948182 learned_addr learned my addr 172.21.15.3:0/1304948182 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:56.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.269+0000 7f383ed9d700 1 --2- 172.21.15.3:0/1304948182 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f38400bf3a0 0x7f384006cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:56.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.269+0000 7f383e59c700 1 -- 172.21.15.3:0/1304948182 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4187856095 0 0) 0x7f384014c0e0 con 0x7f384006c830 2023-10-08T15:37:56.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.269+0000 7f383e59c700 1 -- 172.21.15.3:0/1304948182 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3820003570 con 0x7f384006c830 2023-10-08T15:37:56.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.269+0000 7f383e59c700 1 -- 172.21.15.3:0/1304948182 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2849987044 0 0) 0x7f3820003570 con 0x7f384006c830 2023-10-08T15:37:56.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.269+0000 7f383e59c700 1 -- 172.21.15.3:0/1304948182 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f38400bf3a0 msgr2=0x7f384006cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:56.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.269+0000 7f383e59c700 1 --2- 172.21.15.3:0/1304948182 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f38400bf3a0 0x7f384006cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:56.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.269+0000 7f383e59c700 1 -- 172.21.15.3:0/1304948182 >> v1:172.21.15.50:6789/0 conn(0x7f384014a8a0 legacy=0x7f384014ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:56.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.269+0000 7f383e59c700 1 -- 172.21.15.3:0/1304948182 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f384014bd70 con 0x7f384006c830 2023-10-08T15:37:56.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.269+0000 7f383e59c700 1 -- 172.21.15.3:0/1304948182 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2285686191 0 0) 0x7f3830001470 con 0x7f384006c830 2023-10-08T15:37:56.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.269+0000 7f383e59c700 1 -- 172.21.15.3:0/1304948182 >> v1:172.21.15.3:6789/0 conn(0x7f384006c830 legacy=0x7f384006d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:56.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.269+0000 7f383e59c700 1 --2- 172.21.15.3:0/1304948182 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f38400bf3a0 0x7f3820003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:56.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.269+0000 7f383e59c700 1 --2- 172.21.15.3:0/1304948182 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3820003fd0 0x7f3820004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:56.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.269+0000 7f383e59c700 1 --2- 172.21.15.3:0/1304948182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3820004d50 0x7f38200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:56.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.269+0000 7f383e59c700 1 -- 172.21.15.3:0/1304948182 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384014ba90 con 0x7f3820003fd0 2023-10-08T15:37:56.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.269+0000 7f383e59c700 1 -- 172.21.15.3:0/1304948182 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f382000bb40 con 0x7f3820004d50 2023-10-08T15:37:56.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.269+0000 7f383e59c700 1 -- 172.21.15.3:0/1304948182 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f382000bd00 con 0x7f38400bf3a0 2023-10-08T15:37:56.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.269+0000 7f383659c700 1 --2- 172.21.15.3:0/1304948182 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3820003fd0 0x7f3820004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:56.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.269+0000 7f383ed9d700 1 --2- 172.21.15.3:0/1304948182 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f38400bf3a0 0x7f3820003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:56.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.269+0000 7f383f59e700 1 --2- 172.21.15.3:0/1304948182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3820004d50 0x7f38200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:56.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.269+0000 7f383659c700 1 -- 172.21.15.3:0/1304948182 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f38400bf3a0 msgr2=0x7f3820003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:56.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.269+0000 7f383659c700 1 --2- 172.21.15.3:0/1304948182 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f38400bf3a0 0x7f3820003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:56.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.269+0000 7f383659c700 1 -- 172.21.15.3:0/1304948182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3820004d50 msgr2=0x7f38200051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:56.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.269+0000 7f383659c700 1 --2- 172.21.15.3:0/1304948182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3820004d50 0x7f38200051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:56.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.269+0000 7f383659c700 1 -- 172.21.15.3:0/1304948182 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3820003570 con 0x7f3820003fd0 2023-10-08T15:37:56.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.269+0000 7f383f59e700 1 --2- 172.21.15.3:0/1304948182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3820004d50 0x7f38200051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:37:56.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.269+0000 7f383659c700 1 --2- 172.21.15.3:0/1304948182 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3820003fd0 0x7f3820004810 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f383000c390 tx=0x7f384014c050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=268126f138433f75 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:56.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.269+0000 7f383e59c700 1 -- 172.21.15.3:0/1304948182 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383000cc60 con 0x7f3820003fd0 2023-10-08T15:37:56.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.269+0000 7f383e59c700 1 -- 172.21.15.3:0/1304948182 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f383000ce00 con 0x7f3820003fd0 2023-10-08T15:37:56.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.269+0000 7f383e59c700 1 -- 172.21.15.3:0/1304948182 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3830005b70 con 0x7f3820003fd0 2023-10-08T15:37:56.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.269+0000 7f384508b700 1 -- 172.21.15.3:0/1304948182 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3820003fd0 msgr2=0x7f3820004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:56.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.269+0000 7f384508b700 1 --2- 172.21.15.3:0/1304948182 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3820003fd0 0x7f3820004810 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f383000c390 tx=0x7f384014c050 comp rx=0 tx=0).stop 2023-10-08T15:37:56.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.269+0000 7f383f59e700 1 -- 172.21.15.3:0/1304948182 reap_dead start 2023-10-08T15:37:56.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.269+0000 7f384508b700 1 -- 172.21.15.3:0/1304948182 shutdown_connections 2023-10-08T15:37:56.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.269+0000 7f384508b700 1 -- 172.21.15.3:0/1304948182 >> 172.21.15.3:0/1304948182 conn(0x7f38400c2a40 msgr2=0x7f38400bea60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:56.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.273+0000 7f384508b700 1 -- 172.21.15.3:0/1304948182 shutdown_connections 2023-10-08T15:37:56.282 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.273+0000 7f384508b700 1 -- 172.21.15.3:0/1304948182 wait complete. 2023-10-08T15:37:56.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.273+0000 7f384508b700 1 Processor -- start 2023-10-08T15:37:56.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.273+0000 7f384508b700 1 -- start start 2023-10-08T15:37:56.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.273+0000 7f384508b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3820003fd0 0x7f3840067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:56.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.273+0000 7f384508b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3840142bb0 0x7f384015e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:56.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.273+0000 7f384508b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3840143500 0x7f384015e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:56.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.273+0000 7f384508b700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38400c0d60 con 0x7f3840142bb0 2023-10-08T15:37:56.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.273+0000 7f384508b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3840143fe0 con 0x7f3840143500 2023-10-08T15:37:56.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.273+0000 7f384508b700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3840067b70 con 0x7f3820003fd0 2023-10-08T15:37:56.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.273+0000 7f383659c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3840142bb0 0x7f384015e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:56.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.273+0000 7f383659c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3840142bb0 0x7f384015e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60124/0 (socket says 172.21.15.3:60124) 2023-10-08T15:37:56.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.273+0000 7f383659c700 1 -- 172.21.15.3:0/4143480263 learned_addr learned my addr 172.21.15.3:0/4143480263 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:56.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.273+0000 7f383ed9d700 1 --2- 172.21.15.3:0/4143480263 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3820003fd0 0x7f3840067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:56.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.273+0000 7f383f59e700 1 --2- 172.21.15.3:0/4143480263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3840143500 0x7f384015e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:56.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.273+0000 7f383659c700 1 -- 172.21.15.3:0/4143480263 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3820003fd0 msgr2=0x7f3840067630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:56.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.273+0000 7f383659c700 1 --2- 172.21.15.3:0/4143480263 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3820003fd0 0x7f3840067630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:56.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.273+0000 7f383659c700 1 -- 172.21.15.3:0/4143480263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3840143500 msgr2=0x7f384015e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:56.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.273+0000 7f383659c700 1 --2- 172.21.15.3:0/4143480263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3840143500 0x7f384015e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:56.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.273+0000 7f383659c700 1 -- 172.21.15.3:0/4143480263 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3840143990 con 0x7f3840142bb0 2023-10-08T15:37:56.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.273+0000 7f383f59e700 1 --2- 172.21.15.3:0/4143480263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3840143500 0x7f384015e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:37:56.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.273+0000 7f383659c700 1 --2- 172.21.15.3:0/4143480263 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3840142bb0 0x7f384015e460 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f382000bb10 tx=0x7f3830015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:56.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.273+0000 7f38377fe700 1 -- 172.21.15.3:0/4143480263 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3830000fe0 con 0x7f3840142bb0 2023-10-08T15:37:56.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.273+0000 7f38377fe700 1 -- 172.21.15.3:0/4143480263 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f383000cc60 con 0x7f3840142bb0 2023-10-08T15:37:56.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.273+0000 7f384508b700 1 -- 172.21.15.3:0/4143480263 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3840143c70 con 0x7f3840142bb0 2023-10-08T15:37:56.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.273+0000 7f38377fe700 1 -- 172.21.15.3:0/4143480263 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38300074f0 con 0x7f3840142bb0 2023-10-08T15:37:56.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.273+0000 7f384508b700 1 -- 172.21.15.3:0/4143480263 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38401425f0 con 0x7f3840142bb0 2023-10-08T15:37:56.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.277+0000 7f384508b700 1 -- 172.21.15.3:0/4143480263 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3840064530 con 0x7f3840142bb0 2023-10-08T15:37:56.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.277+0000 7f38377fe700 1 -- 172.21.15.3:0/4143480263 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f3830019070 con 0x7f3840142bb0 2023-10-08T15:37:56.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.277+0000 7f38377fe700 1 --2- 172.21.15.3:0/4143480263 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3824060550 0x7f3824062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:56.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.277+0000 7f38377fe700 1 -- 172.21.15.3:0/4143480263 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f383007d5f0 con 0x7f3840142bb0 2023-10-08T15:37:56.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.277+0000 7f383ed9d700 1 --2- 172.21.15.3:0/4143480263 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3824060550 0x7f3824062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:56.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.277+0000 7f383ed9d700 1 --2- 172.21.15.3:0/4143480263 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3824060550 0x7f3824062a00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3828006f00 tx=0x7f38280091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:56.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.285+0000 7f38377fe700 1 -- 172.21.15.3:0/4143480263 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f383004dbe0 con 0x7f3840142bb0 2023-10-08T15:37:56.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.449+0000 7f384508b700 1 -- 172.21.15.3:0/4143480263 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f38400a2790 con 0x7f3840142bb0 2023-10-08T15:37:56.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.449+0000 7f38377fe700 1 -- 172.21.15.3:0/4143480263 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f383001de60 con 0x7f3840142bb0 2023-10-08T15:37:56.454 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 32 2023-10-08T15:37:56.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.449+0000 7f384508b700 1 -- 172.21.15.3:0/4143480263 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3824060550 msgr2=0x7f3824062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:56.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.449+0000 7f384508b700 1 --2- 172.21.15.3:0/4143480263 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3824060550 0x7f3824062a00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3828006f00 tx=0x7f38280091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:56.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.449+0000 7f384508b700 1 -- 172.21.15.3:0/4143480263 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3840142bb0 msgr2=0x7f384015e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:56.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.449+0000 7f384508b700 1 --2- 172.21.15.3:0/4143480263 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3840142bb0 0x7f384015e460 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f382000bb10 tx=0x7f3830015000 comp rx=0 tx=0).stop 2023-10-08T15:37:56.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.449+0000 7f384508b700 1 -- 172.21.15.3:0/4143480263 shutdown_connections 2023-10-08T15:37:56.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.449+0000 7f384508b700 1 --2- 172.21.15.3:0/4143480263 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3824060550 0x7f3824062a00 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:56.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.449+0000 7f384508b700 1 --2- 172.21.15.3:0/4143480263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3840143500 0x7f384015e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:56.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.449+0000 7f384508b700 1 --2- 172.21.15.3:0/4143480263 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3840142bb0 0x7f384015e460 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:56.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.449+0000 7f384508b700 1 --2- 172.21.15.3:0/4143480263 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3820003fd0 0x7f3840067630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:56.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.449+0000 7f384508b700 1 -- 172.21.15.3:0/4143480263 >> 172.21.15.3:0/4143480263 conn(0x7f38400c2a40 msgr2=0x7f38401447b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:56.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.449+0000 7f384508b700 1 -- 172.21.15.3:0/4143480263 shutdown_connections 2023-10-08T15:37:56.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.449+0000 7f384508b700 1 -- 172.21.15.3:0/4143480263 wait complete. 2023-10-08T15:37:56.474 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T15:37:56.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.585+0000 7fd37b216700 1 Processor -- start 2023-10-08T15:37:56.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.585+0000 7fd37b216700 1 -- start start 2023-10-08T15:37:56.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.585+0000 7fd37b216700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd37406c5c0 0x7fd3740be3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:56.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.585+0000 7fd37b216700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fd3740a7bc0 0x7fd37414bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:56.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.585+0000 7fd37b216700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd37406ced0 con 0x7fd3740a77f0 2023-10-08T15:37:56.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.585+0000 7fd37b216700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd37406e770 con 0x7fd3740a7bc0 2023-10-08T15:37:56.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.585+0000 7fd37b216700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd374069570 con 0x7fd37406c5c0 2023-10-08T15:37:56.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.585+0000 7fd37aa15700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fd3740a7bc0 0x7fd37414bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:56.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.585+0000 7fd37a214700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fd3740a77f0 0x7fd3740a2200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:49990/0 (socket says 172.21.15.3:49990) 2023-10-08T15:37:56.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.585+0000 7fd37a214700 1 -- 172.21.15.3:0/2640889564 learned_addr learned my addr 172.21.15.3:0/2640889564 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:56.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.585+0000 7fd379a13700 1 --2- 172.21.15.3:0/2640889564 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd37406c5c0 0x7fd3740be3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:56.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.585+0000 7fd37aa15700 1 -- 172.21.15.3:0/2640889564 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd37406c5c0 msgr2=0x7fd3740be3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:56.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.585+0000 7fd37aa15700 1 --2- 172.21.15.3:0/2640889564 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd37406c5c0 0x7fd3740be3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:56.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.585+0000 7fd37aa15700 1 -- 172.21.15.3:0/2640889564 >> v1:172.21.15.3:6789/0 conn(0x7fd3740a77f0 legacy=0x7fd3740a2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:56.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.585+0000 7fd37aa15700 1 -- 172.21.15.3:0/2640889564 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd37414c620 con 0x7fd3740a7bc0 2023-10-08T15:37:56.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.585+0000 7fd37aa15700 1 --2- 172.21.15.3:0/2640889564 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd3740a7bc0 0x7fd37414bfb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd36c0098e0 tx=0x7fd36c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7efe7807ecfc94d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:56.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.585+0000 7fd379212700 1 -- 172.21.15.3:0/2640889564 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36c00b640 con 0x7fd3740a7bc0 2023-10-08T15:37:56.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.585+0000 7fd379212700 1 -- 172.21.15.3:0/2640889564 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd36c00b7a0 con 0x7fd3740a7bc0 2023-10-08T15:37:56.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.585+0000 7fd379212700 1 -- 172.21.15.3:0/2640889564 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36c00bb40 con 0x7fd3740a7bc0 2023-10-08T15:37:56.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.589+0000 7fd37b216700 1 -- 172.21.15.3:0/2640889564 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd3740a7bc0 msgr2=0x7fd37414bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:56.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.589+0000 7fd37b216700 1 --2- 172.21.15.3:0/2640889564 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd3740a7bc0 0x7fd37414bfb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd36c0098e0 tx=0x7fd36c0091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:56.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.589+0000 7fd37b216700 1 -- 172.21.15.3:0/2640889564 shutdown_connections 2023-10-08T15:37:56.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.589+0000 7fd37b216700 1 --2- 172.21.15.3:0/2640889564 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd3740a7bc0 0x7fd37414bfb0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:56.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.589+0000 7fd37b216700 1 --2- 172.21.15.3:0/2640889564 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd37406c5c0 0x7fd3740be3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:56.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.589+0000 7fd37b216700 1 -- 172.21.15.3:0/2640889564 >> 172.21.15.3:0/2640889564 conn(0x7fd3740c29f0 msgr2=0x7fd3740a1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:56.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.589+0000 7fd37b216700 1 -- 172.21.15.3:0/2640889564 shutdown_connections 2023-10-08T15:37:56.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.589+0000 7fd37b216700 1 -- 172.21.15.3:0/2640889564 wait complete. 2023-10-08T15:37:56.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.589+0000 7fd37b216700 1 Processor -- start 2023-10-08T15:37:56.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.589+0000 7fd37b216700 1 -- start start 2023-10-08T15:37:56.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.589+0000 7fd37b216700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd37406c5c0 0x7fd3740b7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:56.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.589+0000 7fd37b216700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd3740a77f0 0x7fd37415dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:56.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.589+0000 7fd37b216700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3740a7bc0 0x7fd37414a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:56.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.589+0000 7fd37b216700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3740b8d20 con 0x7fd3740a77f0 2023-10-08T15:37:56.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.589+0000 7fd37b216700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3740b8980 con 0x7fd3740a7bc0 2023-10-08T15:37:56.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.589+0000 7fd37b216700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3740a69a0 con 0x7fd37406c5c0 2023-10-08T15:37:56.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.589+0000 7fd379a13700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd3740a77f0 0x7fd37415dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:56.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.589+0000 7fd379a13700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd3740a77f0 0x7fd37415dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60150/0 (socket says 172.21.15.3:60150) 2023-10-08T15:37:56.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.589+0000 7fd379a13700 1 -- 172.21.15.3:0/664101406 learned_addr learned my addr 172.21.15.3:0/664101406 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:56.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.589+0000 7fd37aa15700 1 --2- 172.21.15.3:0/664101406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3740a7bc0 0x7fd37414a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:56.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.593+0000 7fd37a214700 1 --2- 172.21.15.3:0/664101406 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd37406c5c0 0x7fd3740b7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:56.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.593+0000 7fd379a13700 1 -- 172.21.15.3:0/664101406 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd37406c5c0 msgr2=0x7fd3740b7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:56.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.593+0000 7fd379a13700 1 --2- 172.21.15.3:0/664101406 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd37406c5c0 0x7fd3740b7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:56.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.593+0000 7fd379a13700 1 -- 172.21.15.3:0/664101406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3740a7bc0 msgr2=0x7fd37414a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:56.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.593+0000 7fd379a13700 1 --2- 172.21.15.3:0/664101406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3740a7bc0 0x7fd37414a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:56.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.593+0000 7fd379a13700 1 -- 172.21.15.3:0/664101406 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd36c009420 con 0x7fd3740a77f0 2023-10-08T15:37:56.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.593+0000 7fd379a13700 1 --2- 172.21.15.3:0/664101406 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd3740a77f0 0x7fd37415dcb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd368009f20 tx=0x7fd36800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:56.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.593+0000 7fd3667fc700 1 -- 172.21.15.3:0/664101406 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36800cbd0 con 0x7fd3740a77f0 2023-10-08T15:37:56.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.593+0000 7fd3667fc700 1 -- 172.21.15.3:0/664101406 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd36800f040 con 0x7fd3740a77f0 2023-10-08T15:37:56.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.593+0000 7fd37b216700 1 -- 172.21.15.3:0/664101406 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd37415b870 con 0x7fd3740a77f0 2023-10-08T15:37:56.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.593+0000 7fd3667fc700 1 -- 172.21.15.3:0/664101406 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd368014480 con 0x7fd3740a77f0 2023-10-08T15:37:56.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.593+0000 7fd37b216700 1 -- 172.21.15.3:0/664101406 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd374149300 con 0x7fd3740a77f0 2023-10-08T15:37:56.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.593+0000 7fd37b216700 1 -- 172.21.15.3:0/664101406 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd37405ecf0 con 0x7fd3740a77f0 2023-10-08T15:37:56.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.593+0000 7fd3667fc700 1 -- 172.21.15.3:0/664101406 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fd3680147f0 con 0x7fd3740a77f0 2023-10-08T15:37:56.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.593+0000 7fd3667fc700 1 --2- 172.21.15.3:0/664101406 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd358060550 0x7fd358062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:56.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.593+0000 7fd3667fc700 1 -- 172.21.15.3:0/664101406 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd36807d430 con 0x7fd3740a77f0 2023-10-08T15:37:56.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.597+0000 7fd37a214700 1 --2- 172.21.15.3:0/664101406 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd358060550 0x7fd358062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:56.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.597+0000 7fd37a214700 1 --2- 172.21.15.3:0/664101406 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd358060550 0x7fd358062a00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd370000c00 tx=0x7fd370009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:56.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.601+0000 7fd3667fc700 1 -- 172.21.15.3:0/664101406 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd36804da20 con 0x7fd3740a77f0 2023-10-08T15:37:56.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.765+0000 7fd37b216700 1 -- 172.21.15.3:0/664101406 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd37406cb60 con 0x7fd3740a77f0 2023-10-08T15:37:56.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.765+0000 7fd3667fc700 1 -- 172.21.15.3:0/664101406 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd368051040 con 0x7fd3740a77f0 2023-10-08T15:37:56.771 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 64 2023-10-08T15:37:56.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.769+0000 7fd37b216700 1 -- 172.21.15.3:0/664101406 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd358060550 msgr2=0x7fd358062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:56.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.769+0000 7fd37b216700 1 --2- 172.21.15.3:0/664101406 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd358060550 0x7fd358062a00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd370000c00 tx=0x7fd370009040 comp rx=0 tx=0).stop 2023-10-08T15:37:56.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.769+0000 7fd37b216700 1 -- 172.21.15.3:0/664101406 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd3740a77f0 msgr2=0x7fd37415dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:56.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.769+0000 7fd37b216700 1 --2- 172.21.15.3:0/664101406 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd3740a77f0 0x7fd37415dcb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd368009f20 tx=0x7fd36800b040 comp rx=0 tx=0).stop 2023-10-08T15:37:56.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.769+0000 7fd37b216700 1 -- 172.21.15.3:0/664101406 shutdown_connections 2023-10-08T15:37:56.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.769+0000 7fd37b216700 1 --2- 172.21.15.3:0/664101406 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd358060550 0x7fd358062a00 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:56.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.769+0000 7fd37b216700 1 --2- 172.21.15.3:0/664101406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3740a7bc0 0x7fd37414a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:56.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.769+0000 7fd37b216700 1 --2- 172.21.15.3:0/664101406 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd3740a77f0 0x7fd37415dcb0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:56.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.769+0000 7fd37b216700 1 --2- 172.21.15.3:0/664101406 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd37406c5c0 0x7fd3740b7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:56.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.769+0000 7fd37b216700 1 -- 172.21.15.3:0/664101406 >> 172.21.15.3:0/664101406 conn(0x7fd3740c29f0 msgr2=0x7fd3740c0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:56.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.769+0000 7fd37b216700 1 -- 172.21.15.3:0/664101406 shutdown_connections 2023-10-08T15:37:56.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.769+0000 7fd37b216700 1 -- 172.21.15.3:0/664101406 wait complete. 2023-10-08T15:37:56.794 INFO:tasks.cephfs_test_runner:Starting test: test_drop_cache_command (tasks.cephfs.test_misc.TestCacheDrop) Basic test for checking drop cache command. 2023-10-08T15:37:56.794 INFO:tasks.cephfs_test_runner:test_drop_cache_command (tasks.cephfs.test_misc.TestCacheDrop) 2023-10-08T15:37:56.794 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command' 2023-10-08T15:37:56.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.901+0000 7f9afffff700 1 Processor -- start 2023-10-08T15:37:56.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.901+0000 7f9afffff700 1 -- start start 2023-10-08T15:37:56.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.901+0000 7f9afffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9b000bab50 0x7f9b000baf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:56.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.901+0000 7f9afffff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f9b0014a080 0x7f9b0014c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:56.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.901+0000 7f9afffff700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b000b4050 con 0x7f9b0006df30 2023-10-08T15:37:56.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.901+0000 7f9afffff700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b00146da0 con 0x7f9b0014a080 2023-10-08T15:37:56.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.901+0000 7f9afffff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b000b4710 con 0x7f9b000bab50 2023-10-08T15:37:56.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.901+0000 7f9afe7fc700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f9b0006df30 0x7f9b00149970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:54412/0 (socket says 172.21.15.3:54412) 2023-10-08T15:37:56.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.901+0000 7f9afe7fc700 1 -- 172.21.15.3:0/2201958415 learned_addr learned my addr 172.21.15.3:0/2201958415 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:56.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.901+0000 7f9aff7fe700 1 --2- 172.21.15.3:0/2201958415 >> v2:172.21.15.3:3300/0 conn(0x7f9b0014a080 0x7f9b0014c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:56.912 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.901+0000 7f9afeffd700 1 --2- 172.21.15.3:0/2201958415 >> v2:172.21.15.50:3300/0 conn(0x7f9b000bab50 0x7f9b000baf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:56.912 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.901+0000 7f9afdffb700 1 -- 172.21.15.3:0/2201958415 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3288849429 0 0) 0x7f9b000b4050 con 0x7f9b0006df30 2023-10-08T15:37:56.912 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.901+0000 7f9afdffb700 1 -- 172.21.15.3:0/2201958415 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ae8003570 con 0x7f9b0006df30 2023-10-08T15:37:56.912 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.901+0000 7f9afdffb700 1 -- 172.21.15.3:0/2201958415 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 363023308 0 0) 0x7f9ae8003570 con 0x7f9b0006df30 2023-10-08T15:37:56.912 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.901+0000 7f9afdffb700 1 -- 172.21.15.3:0/2201958415 >> v2:172.21.15.50:3300/0 conn(0x7f9b000bab50 msgr2=0x7f9b000baf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:56.912 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.901+0000 7f9afdffb700 1 --2- 172.21.15.3:0/2201958415 >> v2:172.21.15.50:3300/0 conn(0x7f9b000bab50 0x7f9b000baf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:56.912 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.901+0000 7f9afdffb700 1 -- 172.21.15.3:0/2201958415 >> v2:172.21.15.3:3300/0 conn(0x7f9b0014a080 msgr2=0x7f9b0014c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:56.912 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.901+0000 7f9afdffb700 1 --2- 172.21.15.3:0/2201958415 >> v2:172.21.15.3:3300/0 conn(0x7f9b0014a080 0x7f9b0014c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:56.912 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.901+0000 7f9afdffb700 1 -- 172.21.15.3:0/2201958415 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b000b4330 con 0x7f9b0006df30 2023-10-08T15:37:56.912 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.901+0000 7f9afdffb700 1 -- 172.21.15.3:0/2201958415 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2285686191 0 0) 0x7f9af00017f0 con 0x7f9b0006df30 2023-10-08T15:37:56.912 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.901+0000 7f9afdffb700 1 -- 172.21.15.3:0/2201958415 >> v1:172.21.15.3:6789/0 conn(0x7f9b0006df30 legacy=0x7f9b00149970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:56.913 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.901+0000 7f9afdffb700 1 --2- 172.21.15.3:0/2201958415 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ae8003a60 0x7f9ae8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:56.913 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.901+0000 7f9afdffb700 1 --2- 172.21.15.3:0/2201958415 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9ae8004810 0x7f9ae8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:56.913 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.901+0000 7f9afdffb700 1 --2- 172.21.15.3:0/2201958415 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ae80051c0 0x7f9ae800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:56.913 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.901+0000 7f9afdffb700 1 -- 172.21.15.3:0/2201958415 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b00146da0 con 0x7f9ae8003a60 2023-10-08T15:37:56.913 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.901+0000 7f9afdffb700 1 -- 172.21.15.3:0/2201958415 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b000b4710 con 0x7f9ae80051c0 2023-10-08T15:37:56.913 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.901+0000 7f9afdffb700 1 -- 172.21.15.3:0/2201958415 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae800c050 con 0x7f9ae8004810 2023-10-08T15:37:56.913 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.901+0000 7f9afeffd700 1 --2- 172.21.15.3:0/2201958415 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ae8003a60 0x7f9ae8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:56.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.905+0000 7f9afe7fc700 1 --2- 172.21.15.3:0/2201958415 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9ae8004810 0x7f9ae8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:56.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.905+0000 7f9aff7fe700 1 --2- 172.21.15.3:0/2201958415 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ae80051c0 0x7f9ae800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:56.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.905+0000 7f9afeffd700 1 -- 172.21.15.3:0/2201958415 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9ae8004810 msgr2=0x7f9ae8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:56.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.905+0000 7f9afeffd700 1 --2- 172.21.15.3:0/2201958415 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9ae8004810 0x7f9ae8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:56.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.905+0000 7f9afeffd700 1 -- 172.21.15.3:0/2201958415 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ae80051c0 msgr2=0x7f9ae800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:56.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.905+0000 7f9afeffd700 1 --2- 172.21.15.3:0/2201958415 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ae80051c0 0x7f9ae800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:56.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.905+0000 7f9afeffd700 1 -- 172.21.15.3:0/2201958415 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae8003570 con 0x7f9ae8003a60 2023-10-08T15:37:56.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.905+0000 7f9aff7fe700 1 --2- 172.21.15.3:0/2201958415 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ae80051c0 0x7f9ae800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:37:56.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.905+0000 7f9aff7fe700 1 -- 172.21.15.3:0/2201958415 reap_dead start 2023-10-08T15:37:56.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.905+0000 7f9afeffd700 1 --2- 172.21.15.3:0/2201958415 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ae8003a60 0x7f9ae8003e70 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9af4009c00 tx=0x7f9af40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55feba69b5077f73 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:56.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.905+0000 7f9afdffb700 1 -- 172.21.15.3:0/2201958415 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af400e710 con 0x7f9ae8003a60 2023-10-08T15:37:56.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.905+0000 7f9afdffb700 1 -- 172.21.15.3:0/2201958415 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af400e870 con 0x7f9ae8003a60 2023-10-08T15:37:56.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.905+0000 7f9afdffb700 1 -- 172.21.15.3:0/2201958415 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af400ec30 con 0x7f9ae8003a60 2023-10-08T15:37:56.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.905+0000 7f9afffff700 1 -- 172.21.15.3:0/2201958415 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ae8003a60 msgr2=0x7f9ae8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:56.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.905+0000 7f9afffff700 1 --2- 172.21.15.3:0/2201958415 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ae8003a60 0x7f9ae8003e70 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9af4009c00 tx=0x7f9af40091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:56.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.905+0000 7f9afffff700 1 -- 172.21.15.3:0/2201958415 shutdown_connections 2023-10-08T15:37:56.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.905+0000 7f9afffff700 1 --2- 172.21.15.3:0/2201958415 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ae8003a60 0x7f9ae8003e70 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:56.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.905+0000 7f9afffff700 1 -- 172.21.15.3:0/2201958415 >> 172.21.15.3:0/2201958415 conn(0x7f9b000be4a0 msgr2=0x7f9b000ba440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:56.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.905+0000 7f9afffff700 1 -- 172.21.15.3:0/2201958415 shutdown_connections 2023-10-08T15:37:56.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.905+0000 7f9afffff700 1 -- 172.21.15.3:0/2201958415 wait complete. 2023-10-08T15:37:56.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.905+0000 7f9afffff700 1 Processor -- start 2023-10-08T15:37:56.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.905+0000 7f9afffff700 1 -- start start 2023-10-08T15:37:56.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.909+0000 7f9afffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ae8003a60 0x7f9b0014e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:56.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.909+0000 7f9afffff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9b000b78a0 0x7f9b00145af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:56.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.909+0000 7f9afffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9b00146030 0x7f9b000b85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:56.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.909+0000 7f9afffff700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b000b96a0 con 0x7f9b00146030 2023-10-08T15:37:56.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.909+0000 7f9afffff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0015c730 con 0x7f9ae8003a60 2023-10-08T15:37:56.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.909+0000 7f9afffff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0015c4c0 con 0x7f9b000b78a0 2023-10-08T15:37:56.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.909+0000 7f9aff7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9b00146030 0x7f9b000b85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:56.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.909+0000 7f9aff7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9b00146030 0x7f9b000b85b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57202/0 (socket says 172.21.15.3:57202) 2023-10-08T15:37:56.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.909+0000 7f9aff7fe700 1 -- 172.21.15.3:0/2870976118 learned_addr learned my addr 172.21.15.3:0/2870976118 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:56.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.909+0000 7f9afeffd700 1 --2- 172.21.15.3:0/2870976118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ae8003a60 0x7f9b0014e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:56.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.909+0000 7f9afe7fc700 1 --2- 172.21.15.3:0/2870976118 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9b000b78a0 0x7f9b00145af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:56.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.909+0000 7f9aff7fe700 1 -- 172.21.15.3:0/2870976118 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9b000b78a0 msgr2=0x7f9b00145af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:56.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.909+0000 7f9aff7fe700 1 --2- 172.21.15.3:0/2870976118 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9b000b78a0 0x7f9b00145af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:56.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.909+0000 7f9aff7fe700 1 -- 172.21.15.3:0/2870976118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ae8003a60 msgr2=0x7f9b0014e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:56.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.909+0000 7f9aff7fe700 1 --2- 172.21.15.3:0/2870976118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ae8003a60 0x7f9b0014e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:56.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.909+0000 7f9aff7fe700 1 -- 172.21.15.3:0/2870976118 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b000b7500 con 0x7f9b00146030 2023-10-08T15:37:56.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.909+0000 7f9aff7fe700 1 --2- 172.21.15.3:0/2870976118 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9b00146030 0x7f9b000b85b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9b00070af0 tx=0x7f9af8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:56.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.909+0000 7f9ae6ffd700 1 -- 172.21.15.3:0/2870976118 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af80146d0 con 0x7f9b00146030 2023-10-08T15:37:56.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.909+0000 7f9ae6ffd700 1 -- 172.21.15.3:0/2870976118 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af8014830 con 0x7f9b00146030 2023-10-08T15:37:56.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.909+0000 7f9afffff700 1 -- 172.21.15.3:0/2870976118 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b000b98f0 con 0x7f9b00146030 2023-10-08T15:37:56.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.909+0000 7f9ae6ffd700 1 -- 172.21.15.3:0/2870976118 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af8014bb0 con 0x7f9b00146030 2023-10-08T15:37:56.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.909+0000 7f9afffff700 1 -- 172.21.15.3:0/2870976118 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b001464a0 con 0x7f9b00146030 2023-10-08T15:37:56.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.909+0000 7f9afffff700 1 -- 172.21.15.3:0/2870976118 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b000b82d0 con 0x7f9b00146030 2023-10-08T15:37:56.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.913+0000 7f9ae6ffd700 1 -- 172.21.15.3:0/2870976118 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f9af801f460 con 0x7f9b00146030 2023-10-08T15:37:56.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.913+0000 7f9ae6ffd700 1 --2- 172.21.15.3:0/2870976118 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f9aec060550 0x7f9aec062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:56.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.913+0000 7f9ae6ffd700 1 -- 172.21.15.3:0/2870976118 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9af807c420 con 0x7f9b00146030 2023-10-08T15:37:56.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.913+0000 7f9afeffd700 1 --2- 172.21.15.3:0/2870976118 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f9aec060550 0x7f9aec062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:56.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.913+0000 7f9afeffd700 1 --2- 172.21.15.3:0/2870976118 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f9aec060550 0x7f9aec062a00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9af40091e0 tx=0x7f9af401a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:56.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:56.921+0000 7f9ae6ffd700 1 -- 172.21.15.3:0/2870976118 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9b000b82d0 con 0x7f9b00146030 2023-10-08T15:37:57.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.137+0000 7f9afffff700 1 -- 172.21.15.3:0/2870976118 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command"]} v 0) v1 -- 0x7f9b000b82d0 con 0x7f9b00146030 2023-10-08T15:37:57.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.217+0000 7f9ae6ffd700 1 -- 172.21.15.3:0/2870976118 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command"]}]=0 v47) v1 ==== 142+0+0 (secure 0 0 0) 0x7f9b000b82d0 con 0x7f9b00146030 2023-10-08T15:37:57.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.221+0000 7f9afffff700 1 -- 172.21.15.3:0/2870976118 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f9aec060550 msgr2=0x7f9aec062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:57.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.221+0000 7f9afffff700 1 --2- 172.21.15.3:0/2870976118 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f9aec060550 0x7f9aec062a00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9af40091e0 tx=0x7f9af401a000 comp rx=0 tx=0).stop 2023-10-08T15:37:57.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.221+0000 7f9afffff700 1 -- 172.21.15.3:0/2870976118 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9b00146030 msgr2=0x7f9b000b85b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:57.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.221+0000 7f9afffff700 1 --2- 172.21.15.3:0/2870976118 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9b00146030 0x7f9b000b85b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9b00070af0 tx=0x7f9af8008040 comp rx=0 tx=0).stop 2023-10-08T15:37:57.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.221+0000 7f9afffff700 1 -- 172.21.15.3:0/2870976118 shutdown_connections 2023-10-08T15:37:57.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.221+0000 7f9afffff700 1 --2- 172.21.15.3:0/2870976118 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f9aec060550 0x7f9aec062a00 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:57.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.221+0000 7f9afffff700 1 --2- 172.21.15.3:0/2870976118 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9b00146030 0x7f9b000b85b0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:57.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.221+0000 7f9afffff700 1 --2- 172.21.15.3:0/2870976118 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9b000b78a0 0x7f9b00145af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:57.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.221+0000 7f9afffff700 1 --2- 172.21.15.3:0/2870976118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ae8003a60 0x7f9b0014e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:57.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.221+0000 7f9afffff700 1 -- 172.21.15.3:0/2870976118 >> 172.21.15.3:0/2870976118 conn(0x7f9b000be4a0 msgr2=0x7f9b0006ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:57.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.221+0000 7f9afffff700 1 -- 172.21.15.3:0/2870976118 shutdown_connections 2023-10-08T15:37:57.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.221+0000 7f9afffff700 1 -- 172.21.15.3:0/2870976118 wait complete. 2023-10-08T15:37:57.244 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-08T15:37:57.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.357+0000 7f2bbf59e700 1 Processor -- start 2023-10-08T15:37:57.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.357+0000 7f2bbf59e700 1 -- start start 2023-10-08T15:37:57.367 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.361+0000 7f2bbf59e700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f2bc0148cf0 0x7f2bc00b3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:57.367 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.361+0000 7f2bbf59e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2bc01490c0 0x7f2bc0147f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:57.367 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.361+0000 7f2bbf59e700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bc006e0b0 con 0x7f2bc006ec00 2023-10-08T15:37:57.367 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.361+0000 7f2bbf59e700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bc00b3b30 con 0x7f2bc0148cf0 2023-10-08T15:37:57.367 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.361+0000 7f2bbf59e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc006e390 con 0x7f2bc01490c0 2023-10-08T15:37:57.367 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.361+0000 7f2bbed9d700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f2bc006ec00 0x7f2bc00bf1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:54424/0 (socket says 172.21.15.3:54424) 2023-10-08T15:37:57.367 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.361+0000 7f2bbed9d700 1 -- 172.21.15.3:0/1498586832 learned_addr learned my addr 172.21.15.3:0/1498586832 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:57.367 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.361+0000 7f2bbe59c700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f2bc0148cf0 0x7f2bc00b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:57.367 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.361+0000 7f2bb5d9b700 1 --2- 172.21.15.3:0/1498586832 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2bc01490c0 0x7f2bc0147f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:57.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.361+0000 7f2bbdd9b700 1 -- 172.21.15.3:0/1498586832 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1648029743 0 0) 0x7f2bc006e0b0 con 0x7f2bc006ec00 2023-10-08T15:37:57.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.361+0000 7f2bbdd9b700 1 -- 172.21.15.3:0/1498586832 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2bac003570 con 0x7f2bc006ec00 2023-10-08T15:37:57.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.361+0000 7f2bbe59c700 1 -- 172.21.15.3:0/1498586832 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2bc01490c0 msgr2=0x7f2bc0147f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:57.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.361+0000 7f2bbe59c700 1 --2- 172.21.15.3:0/1498586832 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2bc01490c0 0x7f2bc0147f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:57.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.361+0000 7f2bbe59c700 1 -- 172.21.15.3:0/1498586832 >> v1:172.21.15.3:6789/0 conn(0x7f2bc006ec00 legacy=0x7f2bc00bf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:57.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.361+0000 7f2bbe59c700 1 -- 172.21.15.3:0/1498586832 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc00a2e80 con 0x7f2bc0148cf0 2023-10-08T15:37:57.369 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.361+0000 7f2bbe59c700 1 --2- 172.21.15.3:0/1498586832 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2bc0148cf0 0x7f2bc00b3050 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2bb00098e0 tx=0x7f2bb00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff4c4a0bd5f5637a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:57.369 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.361+0000 7f2bbdd9b700 1 -- 172.21.15.3:0/1498586832 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb0011630 con 0x7f2bc0148cf0 2023-10-08T15:37:57.369 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.361+0000 7f2bbdd9b700 1 -- 172.21.15.3:0/1498586832 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bb0011790 con 0x7f2bc0148cf0 2023-10-08T15:37:57.369 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.361+0000 7f2bbdd9b700 1 -- 172.21.15.3:0/1498586832 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb0011b10 con 0x7f2bc0148cf0 2023-10-08T15:37:57.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.361+0000 7f2bbf59e700 1 -- 172.21.15.3:0/1498586832 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2bc0148cf0 msgr2=0x7f2bc00b3050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:57.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.361+0000 7f2bbf59e700 1 --2- 172.21.15.3:0/1498586832 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2bc0148cf0 0x7f2bc00b3050 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2bb00098e0 tx=0x7f2bb00091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:57.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.361+0000 7f2bbf59e700 1 -- 172.21.15.3:0/1498586832 shutdown_connections 2023-10-08T15:37:57.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.361+0000 7f2bbf59e700 1 --2- 172.21.15.3:0/1498586832 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2bc01490c0 0x7f2bc0147f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:57.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.361+0000 7f2bbf59e700 1 --2- 172.21.15.3:0/1498586832 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2bc0148cf0 0x7f2bc00b3050 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:57.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.361+0000 7f2bbf59e700 1 -- 172.21.15.3:0/1498586832 >> 172.21.15.3:0/1498586832 conn(0x7f2bc0068c80 msgr2=0x7f2bc00beae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:57.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.361+0000 7f2bbf59e700 1 -- 172.21.15.3:0/1498586832 shutdown_connections 2023-10-08T15:37:57.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.361+0000 7f2bbf59e700 1 -- 172.21.15.3:0/1498586832 wait complete. 2023-10-08T15:37:57.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.365+0000 7f2bbf59e700 1 Processor -- start 2023-10-08T15:37:57.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.365+0000 7f2bbf59e700 1 -- start start 2023-10-08T15:37:57.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.365+0000 7f2bbf59e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2bc006ec00 0x7f2bc0146ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:57.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.365+0000 7f2bbf59e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2bc0148cf0 0x7f2bc00b53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:57.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.365+0000 7f2bbf59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2bc01490c0 0x7f2bc014c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:57.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.365+0000 7f2bbf59e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc00b5ed0 con 0x7f2bc006ec00 2023-10-08T15:37:57.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.369+0000 7f2bbf59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc00b5920 con 0x7f2bc01490c0 2023-10-08T15:37:57.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.369+0000 7f2bbf59e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc0145a90 con 0x7f2bc0148cf0 2023-10-08T15:37:57.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.369+0000 7f2bb5d9b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2bc0148cf0 0x7f2bc00b53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:57.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.369+0000 7f2bb5d9b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2bc0148cf0 0x7f2bc00b53e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.3:53918/0 (socket says 172.21.15.3:53918) 2023-10-08T15:37:57.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.369+0000 7f2bbe59c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2bc006ec00 0x7f2bc0146ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:57.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.369+0000 7f2bb5d9b700 1 -- 172.21.15.3:0/1592051775 learned_addr learned my addr 172.21.15.3:0/1592051775 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:57.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.369+0000 7f2bbed9d700 1 --2- 172.21.15.3:0/1592051775 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2bc01490c0 0x7f2bc014c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:57.375 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.369+0000 7f2bbe59c700 1 -- 172.21.15.3:0/1592051775 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2bc0148cf0 msgr2=0x7f2bc00b53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:57.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.369+0000 7f2bbe59c700 1 --2- 172.21.15.3:0/1592051775 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2bc0148cf0 0x7f2bc00b53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:57.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.369+0000 7f2bbe59c700 1 -- 172.21.15.3:0/1592051775 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2bc01490c0 msgr2=0x7f2bc014c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:57.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.369+0000 7f2bbe59c700 1 --2- 172.21.15.3:0/1592051775 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2bc01490c0 0x7f2bc014c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:57.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.369+0000 7f2bbe59c700 1 -- 172.21.15.3:0/1592051775 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb0009420 con 0x7f2bc006ec00 2023-10-08T15:37:57.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.369+0000 7f2bbed9d700 1 --2- 172.21.15.3:0/1592051775 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2bc01490c0 0x7f2bc014c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:37:57.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.369+0000 7f2bb5d9b700 1 --2- 172.21.15.3:0/1592051775 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2bc0148cf0 0x7f2bc00b53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:37:57.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.369+0000 7f2bbe59c700 1 --2- 172.21.15.3:0/1592051775 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2bc006ec00 0x7f2bc0146ec0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2bc004b730 tx=0x7f2bb0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:57.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.369+0000 7f2bb6ffd700 1 -- 172.21.15.3:0/1592051775 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb0011900 con 0x7f2bc006ec00 2023-10-08T15:37:57.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.369+0000 7f2bb6ffd700 1 -- 172.21.15.3:0/1592051775 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bb0011a80 con 0x7f2bc006ec00 2023-10-08T15:37:57.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.369+0000 7f2bbf59e700 1 -- 172.21.15.3:0/1592051775 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bc014ceb0 con 0x7f2bc006ec00 2023-10-08T15:37:57.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.369+0000 7f2bb6ffd700 1 -- 172.21.15.3:0/1592051775 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb001a680 con 0x7f2bc006ec00 2023-10-08T15:37:57.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.369+0000 7f2bbf59e700 1 -- 172.21.15.3:0/1592051775 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bc0158bf0 con 0x7f2bc006ec00 2023-10-08T15:37:57.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.369+0000 7f2bbf59e700 1 -- 172.21.15.3:0/1592051775 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bc00b5aa0 con 0x7f2bc006ec00 2023-10-08T15:37:57.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.373+0000 7f2bb6ffd700 1 -- 172.21.15.3:0/1592051775 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f2bb001aab0 con 0x7f2bc006ec00 2023-10-08T15:37:57.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.373+0000 7f2bb6ffd700 1 --2- 172.21.15.3:0/1592051775 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f2ba0060550 0x7f2ba0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:57.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.373+0000 7f2bb6ffd700 1 -- 172.21.15.3:0/1592051775 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2bb007e2a0 con 0x7f2bc006ec00 2023-10-08T15:37:57.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.373+0000 7f2bb5d9b700 1 --2- 172.21.15.3:0/1592051775 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f2ba0060550 0x7f2ba0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:57.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.373+0000 7f2bb5d9b700 1 --2- 172.21.15.3:0/1592051775 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f2ba0060550 0x7f2ba0062a00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2bc00b6a60 tx=0x7f2ba80091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:57.388 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.381+0000 7f2bb6ffd700 1 -- 172.21.15.3:0/1592051775 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2bc00b5aa0 con 0x7f2bc006ec00 2023-10-08T15:37:57.549 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.541+0000 7f2bbf59e700 1 -- 172.21.15.3:0/1592051775 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f2bc00b5aa0 con 0x7f2bc006ec00 2023-10-08T15:37:57.555 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.549+0000 7f2bb6ffd700 1 -- 172.21.15.3:0/1592051775 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2bc00b5aa0 con 0x7f2bc006ec00 2023-10-08T15:37:57.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.549+0000 7f2bbf59e700 1 -- 172.21.15.3:0/1592051775 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f2ba0060550 msgr2=0x7f2ba0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:57.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.549+0000 7f2bbf59e700 1 --2- 172.21.15.3:0/1592051775 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f2ba0060550 0x7f2ba0062a00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2bc00b6a60 tx=0x7f2ba80091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:57.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.549+0000 7f2bbf59e700 1 -- 172.21.15.3:0/1592051775 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2bc006ec00 msgr2=0x7f2bc0146ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:57.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.549+0000 7f2bbf59e700 1 --2- 172.21.15.3:0/1592051775 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2bc006ec00 0x7f2bc0146ec0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2bc004b730 tx=0x7f2bb0017000 comp rx=0 tx=0).stop 2023-10-08T15:37:57.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.549+0000 7f2bbf59e700 1 -- 172.21.15.3:0/1592051775 shutdown_connections 2023-10-08T15:37:57.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.549+0000 7f2bbf59e700 1 --2- 172.21.15.3:0/1592051775 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f2ba0060550 0x7f2ba0062a00 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:57.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.549+0000 7f2bbf59e700 1 --2- 172.21.15.3:0/1592051775 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2bc01490c0 0x7f2bc014c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:57.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.549+0000 7f2bbf59e700 1 --2- 172.21.15.3:0/1592051775 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2bc0148cf0 0x7f2bc00b53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:57.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.549+0000 7f2bbf59e700 1 --2- 172.21.15.3:0/1592051775 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2bc006ec00 0x7f2bc0146ec0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:57.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.549+0000 7f2bbf59e700 1 -- 172.21.15.3:0/1592051775 >> 172.21.15.3:0/1592051775 conn(0x7f2bc0068c80 msgr2=0x7f2bc00bb530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:57.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.553+0000 7f2bbf59e700 1 -- 172.21.15.3:0/1592051775 shutdown_connections 2023-10-08T15:37:57.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.553+0000 7f2bbf59e700 1 -- 172.21.15.3:0/1592051775 wait complete. 2023-10-08T15:37:57.569 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T15:37:57.570 DEBUG:teuthology.orchestra.run.smithi003:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T15:37:57.590 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T15:37:57.611 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T15:37:57.632 DEBUG:teuthology.orchestra.run.smithi098:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T15:37:57.653 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T15:37:57.673 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T15:37:57.673 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi089.front.sepia.ceph.com... 2023-10-08T15:37:57.674 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T15:37:57.674 DEBUG:teuthology.orchestra.run.smithi089:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-08T15:37:57.698 INFO:teuthology.orchestra.run:waiting for 900 2023-10-08T15:37:57.698 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi089.front.sepia.ceph.com 2023-10-08T15:37:57.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:37:57.698 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-08T15:37:57.730 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi098.front.sepia.ceph.com... 2023-10-08T15:37:57.730 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T15:37:57.730 DEBUG:teuthology.orchestra.run.smithi098:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-10-08T15:37:57.769 INFO:teuthology.orchestra.run:waiting for 900 2023-10-08T15:37:57.769 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi098.front.sepia.ceph.com 2023-10-08T15:37:57.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:37:57.770 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-08T15:37:57.828 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi153.front.sepia.ceph.com... 2023-10-08T15:37:57.828 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T15:37:57.829 DEBUG:teuthology.orchestra.run.smithi153:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-10-08T15:37:57.852 INFO:teuthology.orchestra.run:waiting for 900 2023-10-08T15:37:57.853 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2023-10-08T15:37:57.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:37:57.853 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-08T15:37:57.886 INFO:tasks.cephfs.cephfs_test_case:[, , ] 2023-10-08T15:37:57.887 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:37:58.001 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.993+0000 7f90e4907700 1 Processor -- start 2023-10-08T15:37:58.001 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.993+0000 7f90e4907700 1 -- start start 2023-10-08T15:37:58.002 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.997+0000 7f90e4907700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f90e00be600 0x7f90e014bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:58.002 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.997+0000 7f90e4907700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90e00b1ee0 con 0x7f90e00bbf00 2023-10-08T15:37:58.002 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.997+0000 7f90e4907700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90e00b21c0 con 0x7f90e00bcdd0 2023-10-08T15:37:58.002 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.997+0000 7f90e4907700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90e00b29d0 con 0x7f90e00be600 2023-10-08T15:37:58.002 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.997+0000 7f90df7fe700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f90e00bbf00 0x7f90e014ef80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:54430/0 (socket says 172.21.15.3:54430) 2023-10-08T15:37:58.003 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.997+0000 7f90dffff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f90e00be600 0x7f90e014bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:58.003 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.997+0000 7f90df7fe700 1 -- 172.21.15.3:0/588507345 learned_addr learned my addr 172.21.15.3:0/588507345 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:58.003 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.997+0000 7f90dffff700 1 -- 172.21.15.3:0/588507345 >> v1:172.21.15.50:6789/0 conn(0x7f90e00bcdd0 legacy=0x7f90e014f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:58.003 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.997+0000 7f90dffff700 1 -- 172.21.15.3:0/588507345 >> v1:172.21.15.3:6789/0 conn(0x7f90e00bbf00 legacy=0x7f90e014ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:58.003 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.997+0000 7f90dffff700 1 -- 172.21.15.3:0/588507345 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e00b2530 con 0x7f90e00be600 2023-10-08T15:37:58.003 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:57.997+0000 7f90dffff700 1 --2- 172.21.15.3:0/588507345 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f90e00be600 0x7f90e014bbe0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f90d8009e60 tx=0x7f90d8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb720e60ac56ea91 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:58.005 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.001+0000 7f90deffd700 1 -- 172.21.15.3:0/588507345 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d800e070 con 0x7f90e00be600 2023-10-08T15:37:58.005 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.001+0000 7f90deffd700 1 -- 172.21.15.3:0/588507345 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d800bc30 con 0x7f90e00be600 2023-10-08T15:37:58.005 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.001+0000 7f90deffd700 1 -- 172.21.15.3:0/588507345 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d8012430 con 0x7f90e00be600 2023-10-08T15:37:58.006 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.001+0000 7f90e4907700 1 -- 172.21.15.3:0/588507345 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f90e00be600 msgr2=0x7f90e014bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:58.006 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.001+0000 7f90e4907700 1 --2- 172.21.15.3:0/588507345 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f90e00be600 0x7f90e014bbe0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f90d8009e60 tx=0x7f90d8009780 comp rx=0 tx=0).stop 2023-10-08T15:37:58.007 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.001+0000 7f90e4907700 1 -- 172.21.15.3:0/588507345 shutdown_connections 2023-10-08T15:37:58.007 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.001+0000 7f90e4907700 1 --2- 172.21.15.3:0/588507345 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f90e00be600 0x7f90e014bbe0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:58.007 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.001+0000 7f90e4907700 1 -- 172.21.15.3:0/588507345 >> 172.21.15.3:0/588507345 conn(0x7f90e00bf5e0 msgr2=0x7f90e00bb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:58.007 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.001+0000 7f90e4907700 1 -- 172.21.15.3:0/588507345 shutdown_connections 2023-10-08T15:37:58.007 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.001+0000 7f90e4907700 1 -- 172.21.15.3:0/588507345 wait complete. 2023-10-08T15:37:58.008 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.001+0000 7f90e4907700 1 Processor -- start 2023-10-08T15:37:58.008 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.001+0000 7f90e4907700 1 -- start start 2023-10-08T15:37:58.010 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.005+0000 7f90e4907700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90e00bbf00 0x7f90e0147e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:58.010 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.005+0000 7f90e4907700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f90e00bcdd0 0x7f90e015bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:58.010 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.005+0000 7f90e4907700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f90e00be600 0x7f90e0146b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:58.010 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.005+0000 7f90e4907700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e00be9d0 con 0x7f90e00be600 2023-10-08T15:37:58.010 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.005+0000 7f90e4907700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e0149a90 con 0x7f90e00bbf00 2023-10-08T15:37:58.010 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.005+0000 7f90e4907700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90e015f680 con 0x7f90e00bcdd0 2023-10-08T15:37:58.010 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.005+0000 7f90dffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f90e00be600 0x7f90e0146b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:58.010 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.005+0000 7f90dffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f90e00be600 0x7f90e0146b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57242/0 (socket says 172.21.15.3:57242) 2023-10-08T15:37:58.010 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.005+0000 7f90dffff700 1 -- 172.21.15.3:0/595418314 learned_addr learned my addr 172.21.15.3:0/595418314 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:58.010 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.005+0000 7f90df7fe700 1 --2- 172.21.15.3:0/595418314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90e00bbf00 0x7f90e0147e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:58.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.005+0000 7f90d6ffd700 1 --2- 172.21.15.3:0/595418314 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f90e00bcdd0 0x7f90e015bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:58.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.005+0000 7f90dffff700 1 -- 172.21.15.3:0/595418314 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f90e00bcdd0 msgr2=0x7f90e015bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:58.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.005+0000 7f90dffff700 1 --2- 172.21.15.3:0/595418314 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f90e00bcdd0 0x7f90e015bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:58.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.005+0000 7f90dffff700 1 -- 172.21.15.3:0/595418314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90e00bbf00 msgr2=0x7f90e0147e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:58.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.005+0000 7f90dffff700 1 --2- 172.21.15.3:0/595418314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90e00bbf00 0x7f90e0147e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:58.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.005+0000 7f90dffff700 1 -- 172.21.15.3:0/595418314 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d8009a20 con 0x7f90e00be600 2023-10-08T15:37:58.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.005+0000 7f90dffff700 1 --2- 172.21.15.3:0/595418314 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f90e00be600 0x7f90e0146b80 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f90d80097c0 tx=0x7f90d8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:58.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.005+0000 7f90d7fff700 1 -- 172.21.15.3:0/595418314 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d8012e10 con 0x7f90e00be600 2023-10-08T15:37:58.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.005+0000 7f90d7fff700 1 -- 172.21.15.3:0/595418314 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d801e630 con 0x7f90e00be600 2023-10-08T15:37:58.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.005+0000 7f90e4907700 1 -- 172.21.15.3:0/595418314 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90e00b86c0 con 0x7f90e00be600 2023-10-08T15:37:58.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.005+0000 7f90d7fff700 1 -- 172.21.15.3:0/595418314 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d801e9f0 con 0x7f90e00be600 2023-10-08T15:37:58.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.005+0000 7f90e4907700 1 -- 172.21.15.3:0/595418314 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90e0148380 con 0x7f90e00be600 2023-10-08T15:37:58.013 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.005+0000 7f90e4907700 1 -- 172.21.15.3:0/595418314 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90e00b8bc0 con 0x7f90e00be600 2023-10-08T15:37:58.013 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.009+0000 7f90d7fff700 1 -- 172.21.15.3:0/595418314 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f90d8024070 con 0x7f90e00be600 2023-10-08T15:37:58.014 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.009+0000 7f90d7fff700 1 --2- 172.21.15.3:0/595418314 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f90c0060550 0x7f90c0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:58.014 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.009+0000 7f90d7fff700 1 -- 172.21.15.3:0/595418314 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f90d807efa0 con 0x7f90e00be600 2023-10-08T15:37:58.014 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.009+0000 7f90df7fe700 1 --2- 172.21.15.3:0/595418314 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f90c0060550 0x7f90c0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:58.015 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.009+0000 7f90df7fe700 1 --2- 172.21.15.3:0/595418314 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f90c0060550 0x7f90c0062a00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f90d0007fd0 tx=0x7f90d0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:58.022 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.017+0000 7f90d7fff700 1 -- 172.21.15.3:0/595418314 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f90d80aebe0 con 0x7f90e00be600 2023-10-08T15:37:58.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.217+0000 7f90e4907700 1 -- 172.21.15.3:0/595418314 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f90e005ecf0 con 0x7f90e00be600 2023-10-08T15:37:58.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.221+0000 7f90d7fff700 1 -- 172.21.15.3:0/595418314 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+3073 (secure 0 0 0) 0x7f90d802c020 con 0x7f90e00be600 2023-10-08T15:37:58.227 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:37:58.228 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6833/519836882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":519836882},{"type":"v1","addr":"172.21.15.3:6833","nonce":519836882}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:37:25.379215+0000","modified":"2023-10-08T15:37:28.041086+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/1601527591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1601527591},{"type":"v1","addr":"172.21.15.50:6835","nonce":1601527591}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-08T15:37:58.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.225+0000 7f90e4907700 1 -- 172.21.15.3:0/595418314 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f90c0060550 msgr2=0x7f90c0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:58.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.225+0000 7f90e4907700 1 --2- 172.21.15.3:0/595418314 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f90c0060550 0x7f90c0062a00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f90d0007fd0 tx=0x7f90d0009040 comp rx=0 tx=0).stop 2023-10-08T15:37:58.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.225+0000 7f90e4907700 1 -- 172.21.15.3:0/595418314 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f90e00be600 msgr2=0x7f90e0146b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:58.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.225+0000 7f90e4907700 1 --2- 172.21.15.3:0/595418314 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f90e00be600 0x7f90e0146b80 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f90d80097c0 tx=0x7f90d8019000 comp rx=0 tx=0).stop 2023-10-08T15:37:58.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.225+0000 7f90e4907700 1 -- 172.21.15.3:0/595418314 shutdown_connections 2023-10-08T15:37:58.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.225+0000 7f90e4907700 1 --2- 172.21.15.3:0/595418314 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f90c0060550 0x7f90c0062a00 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:58.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.225+0000 7f90e4907700 1 --2- 172.21.15.3:0/595418314 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f90e00be600 0x7f90e0146b80 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:58.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.225+0000 7f90e4907700 1 --2- 172.21.15.3:0/595418314 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f90e00bcdd0 0x7f90e015bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:58.231 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.225+0000 7f90e4907700 1 --2- 172.21.15.3:0/595418314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90e00bbf00 0x7f90e0147e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:58.231 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.225+0000 7f90e4907700 1 -- 172.21.15.3:0/595418314 >> 172.21.15.3:0/595418314 conn(0x7f90e00bf5e0 msgr2=0x7f90e014a930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:58.231 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.225+0000 7f90e4907700 1 -- 172.21.15.3:0/595418314 shutdown_connections 2023-10-08T15:37:58.231 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.225+0000 7f90e4907700 1 -- 172.21.15.3:0/595418314 wait complete. 2023-10-08T15:37:58.231 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 6 2023-10-08T15:37:58.243 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:37:58.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.341+0000 7f714102a700 1 Processor -- start 2023-10-08T15:37:58.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.341+0000 7f714102a700 1 -- start start 2023-10-08T15:37:58.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.341+0000 7f714102a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f713c0bb0c0 0x7f713c153860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:58.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.341+0000 7f714102a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f713c09e520 0x7f713c06c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:58.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.341+0000 7f714102a700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f713c14fe30 con 0x7f713c0bacf0 2023-10-08T15:37:58.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.341+0000 7f714102a700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f713c09f0e0 con 0x7f713c09e520 2023-10-08T15:37:58.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.341+0000 7f714102a700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f713c14f8b0 con 0x7f713c0bb0c0 2023-10-08T15:37:58.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.341+0000 7f713bfff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f713c0bacf0 0x7f713c1502c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:54446/0 (socket says 172.21.15.3:54446) 2023-10-08T15:37:58.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.341+0000 7f713bfff700 1 -- 172.21.15.3:0/3876666467 learned_addr learned my addr 172.21.15.3:0/3876666467 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:58.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.341+0000 7f713b7fe700 1 --2- 172.21.15.3:0/3876666467 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f713c0bb0c0 0x7f713c153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:58.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.341+0000 7f7140829700 1 --2- 172.21.15.3:0/3876666467 >> v2:172.21.15.50:3300/0 conn(0x7f713c09e520 0x7f713c06c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:58.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.341+0000 7f713affd700 1 -- 172.21.15.3:0/3876666467 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1107948255 0 0) 0x7f713c14fe30 con 0x7f713c0bacf0 2023-10-08T15:37:58.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.341+0000 7f713affd700 1 -- 172.21.15.3:0/3876666467 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7128003570 con 0x7f713c0bacf0 2023-10-08T15:37:58.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.341+0000 7f713b7fe700 1 -- 172.21.15.3:0/3876666467 >> v2:172.21.15.50:3300/0 conn(0x7f713c09e520 msgr2=0x7f713c06c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:58.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.341+0000 7f713b7fe700 1 --2- 172.21.15.3:0/3876666467 >> v2:172.21.15.50:3300/0 conn(0x7f713c09e520 0x7f713c06c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:58.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.341+0000 7f713b7fe700 1 -- 172.21.15.3:0/3876666467 >> v1:172.21.15.3:6789/0 conn(0x7f713c0bacf0 legacy=0x7f713c1502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:58.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.341+0000 7f713b7fe700 1 -- 172.21.15.3:0/3876666467 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f713c14fac0 con 0x7f713c0bb0c0 2023-10-08T15:37:58.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.341+0000 7f7140829700 1 --2- 172.21.15.3:0/3876666467 >> v2:172.21.15.50:3300/0 conn(0x7f713c09e520 0x7f713c06c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:37:58.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.341+0000 7f713b7fe700 1 --2- 172.21.15.3:0/3876666467 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f713c0bb0c0 0x7f713c153860 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7134009e60 tx=0x7f7134009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11b3d22ba28756e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:58.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.341+0000 7f713affd700 1 -- 172.21.15.3:0/3876666467 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713400e070 con 0x7f713c0bb0c0 2023-10-08T15:37:58.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.341+0000 7f713affd700 1 -- 172.21.15.3:0/3876666467 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f713400bab0 con 0x7f713c0bb0c0 2023-10-08T15:37:58.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.341+0000 7f713affd700 1 -- 172.21.15.3:0/3876666467 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713400be70 con 0x7f713c0bb0c0 2023-10-08T15:37:58.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.345+0000 7f714102a700 1 -- 172.21.15.3:0/3876666467 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f713c0bb0c0 msgr2=0x7f713c153860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:58.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.345+0000 7f714102a700 1 --2- 172.21.15.3:0/3876666467 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f713c0bb0c0 0x7f713c153860 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7134009e60 tx=0x7f7134009780 comp rx=0 tx=0).stop 2023-10-08T15:37:58.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.345+0000 7f714102a700 1 -- 172.21.15.3:0/3876666467 shutdown_connections 2023-10-08T15:37:58.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.345+0000 7f714102a700 1 --2- 172.21.15.3:0/3876666467 >> v2:172.21.15.50:3300/0 conn(0x7f713c09e520 0x7f713c06c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:58.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.345+0000 7f714102a700 1 --2- 172.21.15.3:0/3876666467 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f713c0bb0c0 0x7f713c153860 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:58.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.345+0000 7f714102a700 1 -- 172.21.15.3:0/3876666467 >> 172.21.15.3:0/3876666467 conn(0x7f713c0be4a0 msgr2=0x7f713c0ba440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:58.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.345+0000 7f714102a700 1 -- 172.21.15.3:0/3876666467 shutdown_connections 2023-10-08T15:37:58.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.345+0000 7f714102a700 1 -- 172.21.15.3:0/3876666467 wait complete. 2023-10-08T15:37:58.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.345+0000 7f714102a700 1 Processor -- start 2023-10-08T15:37:58.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.345+0000 7f714102a700 1 -- start start 2023-10-08T15:37:58.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.345+0000 7f714102a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f713c09e520 0x7f713c1568a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:58.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.345+0000 7f714102a700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f713c0bacf0 0x7f713c1540f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:58.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.345+0000 7f714102a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f713c0bb0c0 0x7f713c162d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:58.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.345+0000 7f714102a700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713c163a60 con 0x7f713c0bacf0 2023-10-08T15:37:58.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.345+0000 7f714102a700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713c1604c0 con 0x7f713c0bb0c0 2023-10-08T15:37:58.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.345+0000 7f714102a700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f713c160150 con 0x7f713c09e520 2023-10-08T15:37:58.355 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.345+0000 7f713b7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f713c0bacf0 0x7f713c1540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:58.355 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.345+0000 7f713b7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f713c0bacf0 0x7f713c1540f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57246/0 (socket says 172.21.15.3:57246) 2023-10-08T15:37:58.355 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.345+0000 7f713b7fe700 1 -- 172.21.15.3:0/3855535389 learned_addr learned my addr 172.21.15.3:0/3855535389 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:58.355 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.345+0000 7f713bfff700 1 --2- 172.21.15.3:0/3855535389 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f713c09e520 0x7f713c1568a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:58.355 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.345+0000 7f7140829700 1 --2- 172.21.15.3:0/3855535389 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f713c0bb0c0 0x7f713c162d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:58.355 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.345+0000 7f713b7fe700 1 -- 172.21.15.3:0/3855535389 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f713c09e520 msgr2=0x7f713c1568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:58.355 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.345+0000 7f713b7fe700 1 --2- 172.21.15.3:0/3855535389 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f713c09e520 0x7f713c1568a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:58.355 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.345+0000 7f713b7fe700 1 -- 172.21.15.3:0/3855535389 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f713c0bb0c0 msgr2=0x7f713c162d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:58.356 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.345+0000 7f713b7fe700 1 --2- 172.21.15.3:0/3855535389 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f713c0bb0c0 0x7f713c162d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:58.356 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.345+0000 7f713b7fe700 1 -- 172.21.15.3:0/3855535389 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7124009420 con 0x7f713c0bacf0 2023-10-08T15:37:58.356 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.345+0000 7f7140829700 1 --2- 172.21.15.3:0/3855535389 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f713c0bb0c0 0x7f713c162d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:37:58.356 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.345+0000 7f713b7fe700 1 --2- 172.21.15.3:0/3855535389 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f713c0bacf0 0x7f713c1540f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f71340097c0 tx=0x7f7134019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:58.356 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.345+0000 7f7133fff700 1 -- 172.21.15.3:0/3855535389 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7134012c50 con 0x7f713c0bacf0 2023-10-08T15:37:58.356 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.345+0000 7f7133fff700 1 -- 172.21.15.3:0/3855535389 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7134012dd0 con 0x7f713c0bacf0 2023-10-08T15:37:58.356 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.345+0000 7f7133fff700 1 -- 172.21.15.3:0/3855535389 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71340276c0 con 0x7f713c0bacf0 2023-10-08T15:37:58.356 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.345+0000 7f714102a700 1 -- 172.21.15.3:0/3855535389 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7134009a20 con 0x7f713c0bacf0 2023-10-08T15:37:58.356 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.345+0000 7f714102a700 1 -- 172.21.15.3:0/3855535389 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f713c1539b0 con 0x7f713c0bacf0 2023-10-08T15:37:58.357 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.349+0000 7f714102a700 1 -- 172.21.15.3:0/3855535389 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f713c05ecf0 con 0x7f713c0bacf0 2023-10-08T15:37:58.357 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.349+0000 7f7133fff700 1 -- 172.21.15.3:0/3855535389 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f7134024070 con 0x7f713c0bacf0 2023-10-08T15:37:58.357 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.349+0000 7f7133fff700 1 --2- 172.21.15.3:0/3855535389 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f711c060550 0x7f711c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:58.357 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.349+0000 7f7133fff700 1 -- 172.21.15.3:0/3855535389 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f713407ec10 con 0x7f713c0bacf0 2023-10-08T15:37:58.358 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.349+0000 7f713bfff700 1 --2- 172.21.15.3:0/3855535389 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f711c060550 0x7f711c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:58.358 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.349+0000 7f713bfff700 1 --2- 172.21.15.3:0/3855535389 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f711c060550 0x7f711c062a00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f712c007fd0 tx=0x7f712c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:58.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.357+0000 7f7133fff700 1 -- 172.21.15.3:0/3855535389 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f713404f200 con 0x7f713c0bacf0 2023-10-08T15:37:58.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.525+0000 7f714102a700 1 -- 172.21.15.3:0/3855535389 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f713c09eb80 con 0x7f713c0bacf0 2023-10-08T15:37:58.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.525+0000 7f7133fff700 1 -- 172.21.15.3:0/3855535389 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15254 (secure 0 0 0) 0x7f7134052820 con 0x7f713c0bacf0 2023-10-08T15:37:58.532 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:37:58.532 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":20,"fsid":"7635972e-cd66-4a8f-a231-378db8b3847a","created":"2023-10-08T15:37:08.234594+0000","modified":"2023-10-08T15:37:27.007828+0000","last_up_change":"2023-10-08T15:37:17.537726+0000","last_in_change":"2023-10-08T15:37:10.269178+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:37:16.581590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:37:23.353518+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T15:37:24.365114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"64fb1864-bfdd-4d75-9b41-03fb60085dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33363},{"type":"v1","addr":"172.21.15.3:6801","nonce":33363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33363},{"type":"v1","addr":"172.21.15.3:6803","nonce":33363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":33363},{"type":"v1","addr":"172.21.15.3:6807","nonce":33363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33363},{"type":"v1","addr":"172.21.15.3:6805","nonce":33363}]},"public_addr":"172.21.15.3:6801/33363","cluster_addr":"172.21.15.3:6803/33363","heartbeat_back_addr":"172.21.15.3:6807/33363","heartbeat_front_addr":"172.21.15.3:6805/33363","state":["exists","up"]},{"osd":1,"uuid":"3ca6bd3a-3e8a-4c65-af9c-46148b0c2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33364},{"type":"v1","addr":"172.21.15.3:6820","nonce":33364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33364},{"type":"v1","addr":"172.21.15.3:6824","nonce":33364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33364},{"type":"v1","addr":"172.21.15.3:6831","nonce":33364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33364},{"type":"v1","addr":"172.21.15.3:6828","nonce":33364}]},"public_addr":"172.21.15.3:6820/33364","cluster_addr":"172.21.15.3:6824/33364","heartbeat_back_addr":"172.21.15.3:6831/33364","heartbeat_front_addr":"172.21.15.3:6828/33364","state":["exists","up"]},{"osd":2,"uuid":"6eb9f757-58dd-442f-910d-32401454bce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33366},{"type":"v1","addr":"172.21.15.3:6817","nonce":33366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":33366},{"type":"v1","addr":"172.21.15.3:6821","nonce":33366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6827","nonce":33366},{"type":"v1","addr":"172.21.15.3:6829","nonce":33366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":33366},{"type":"v1","addr":"172.21.15.3:6825","nonce":33366}]},"public_addr":"172.21.15.3:6817/33366","cluster_addr":"172.21.15.3:6821/33366","heartbeat_back_addr":"172.21.15.3:6829/33366","heartbeat_front_addr":"172.21.15.3:6825/33366","state":["exists","up"]},{"osd":3,"uuid":"1c39866b-ac2e-4ea9-a69c-02b01ee4191d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33365},{"type":"v1","addr":"172.21.15.3:6809","nonce":33365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":33365},{"type":"v1","addr":"172.21.15.3:6811","nonce":33365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33365},{"type":"v1","addr":"172.21.15.3:6815","nonce":33365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":33365},{"type":"v1","addr":"172.21.15.3:6813","nonce":33365}]},"public_addr":"172.21.15.3:6809/33365","cluster_addr":"172.21.15.3:6811/33365","heartbeat_back_addr":"172.21.15.3:6815/33365","heartbeat_front_addr":"172.21.15.3:6813/33365","state":["exists","up"]},{"osd":4,"uuid":"15f86b61-b7f1-4780-ae00-9d80a68cb830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":33605},{"type":"v1","addr":"172.21.15.50:6809","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33605},{"type":"v1","addr":"172.21.15.50:6811","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33605},{"type":"v1","addr":"172.21.15.50:6815","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":33605},{"type":"v1","addr":"172.21.15.50:6813","nonce":33605}]},"public_addr":"172.21.15.50:6809/33605","cluster_addr":"172.21.15.50:6811/33605","heartbeat_back_addr":"172.21.15.50:6815/33605","heartbeat_front_addr":"172.21.15.50:6813/33605","state":["exists","up"]},{"osd":5,"uuid":"726c3003-34e6-4d5a-b6e2-f911e13c2118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33606},{"type":"v1","addr":"172.21.15.50:6801","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33606},{"type":"v1","addr":"172.21.15.50:6803","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33606},{"type":"v1","addr":"172.21.15.50:6807","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":33606},{"type":"v1","addr":"172.21.15.50:6805","nonce":33606}]},"public_addr":"172.21.15.50:6801/33606","cluster_addr":"172.21.15.50:6803/33606","heartbeat_back_addr":"172.21.15.50:6807/33606","heartbeat_front_addr":"172.21.15.50:6805/33606","state":["exists","up"]},{"osd":6,"uuid":"401122a4-9988-441f-a5a7-39164434ebcd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":33607},{"type":"v1","addr":"172.21.15.50:6819","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":33607},{"type":"v1","addr":"172.21.15.50:6823","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":33607},{"type":"v1","addr":"172.21.15.50:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":33607},{"type":"v1","addr":"172.21.15.50:6827","nonce":33607}]},"public_addr":"172.21.15.50:6819/33607","cluster_addr":"172.21.15.50:6823/33607","heartbeat_back_addr":"172.21.15.50:6831/33607","heartbeat_front_addr":"172.21.15.50:6827/33607","state":["exists","up"]},{"osd":7,"uuid":"6b3fa236-c9d0-4c4d-82ae-9af4daf6d699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33604},{"type":"v1","addr":"172.21.15.50:6818","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":33604},{"type":"v1","addr":"172.21.15.50:6822","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":33604},{"type":"v1","addr":"172.21.15.50:6830","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":33604},{"type":"v1","addr":"172.21.15.50:6826","nonce":33604}]},"public_addr":"172.21.15.50:6818/33604","cluster_addr":"172.21.15.50:6822/33604","heartbeat_back_addr":"172.21.15.50:6830/33604","heartbeat_front_addr":"172.21.15.50:6826/33604","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.497794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.529417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.873426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.325972+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.443971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.240795+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.739632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.643026+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:37:58.534 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.529+0000 7f714102a700 1 -- 172.21.15.3:0/3855535389 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f711c060550 msgr2=0x7f711c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:58.534 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.529+0000 7f714102a700 1 --2- 172.21.15.3:0/3855535389 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f711c060550 0x7f711c062a00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f712c007fd0 tx=0x7f712c009040 comp rx=0 tx=0).stop 2023-10-08T15:37:58.534 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.529+0000 7f714102a700 1 -- 172.21.15.3:0/3855535389 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f713c0bacf0 msgr2=0x7f713c1540f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:58.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.529+0000 7f714102a700 1 --2- 172.21.15.3:0/3855535389 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f713c0bacf0 0x7f713c1540f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f71340097c0 tx=0x7f7134019000 comp rx=0 tx=0).stop 2023-10-08T15:37:58.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.529+0000 7f714102a700 1 -- 172.21.15.3:0/3855535389 shutdown_connections 2023-10-08T15:37:58.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.529+0000 7f714102a700 1 --2- 172.21.15.3:0/3855535389 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f711c060550 0x7f711c062a00 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:58.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.529+0000 7f714102a700 1 --2- 172.21.15.3:0/3855535389 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f713c0bb0c0 0x7f713c162d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:58.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.529+0000 7f714102a700 1 --2- 172.21.15.3:0/3855535389 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f713c0bacf0 0x7f713c1540f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:58.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.529+0000 7f714102a700 1 --2- 172.21.15.3:0/3855535389 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f713c09e520 0x7f713c1568a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:58.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.529+0000 7f714102a700 1 -- 172.21.15.3:0/3855535389 >> 172.21.15.3:0/3855535389 conn(0x7f713c0be4a0 msgr2=0x7f713c0bd0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:58.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.529+0000 7f714102a700 1 -- 172.21.15.3:0/3855535389 shutdown_connections 2023-10-08T15:37:58.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.529+0000 7f714102a700 1 -- 172.21.15.3:0/3855535389 wait complete. 2023-10-08T15:37:58.547 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T15:37:16.581590+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T15:37:23.353518+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T15:37:24.365114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T15:37:58.547 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T15:37:58.656 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.649+0000 7f52f538d700 1 Processor -- start 2023-10-08T15:37:58.657 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.649+0000 7f52f538d700 1 -- start start 2023-10-08T15:37:58.657 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.649+0000 7f52f538d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f52f014aee0 0x7f52f014b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:58.657 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.649+0000 7f52f538d700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52f009e9f0 con 0x7f52f009d1f0 2023-10-08T15:37:58.658 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.653+0000 7f52f538d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52f009ee80 con 0x7f52f00a03d0 2023-10-08T15:37:58.658 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.653+0000 7f52f538d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52f009e3a0 con 0x7f52f014aee0 2023-10-08T15:37:58.658 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.653+0000 7f52f4b8c700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f52f009d1f0 0x7f52f00a0be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:54448/0 (socket says 172.21.15.3:54448) 2023-10-08T15:37:58.658 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.653+0000 7f52f4b8c700 1 -- 172.21.15.3:0/2603989559 learned_addr learned my addr 172.21.15.3:0/2603989559 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:58.658 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.653+0000 7f52effff700 1 --2- 172.21.15.3:0/2603989559 >> v2:172.21.15.50:3300/0 conn(0x7f52f014aee0 0x7f52f014b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:58.659 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.653+0000 7f52eeffd700 1 -- 172.21.15.3:0/2603989559 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4102542572 0 0) 0x7f52f009e9f0 con 0x7f52f009d1f0 2023-10-08T15:37:58.659 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.653+0000 7f52eeffd700 1 -- 172.21.15.3:0/2603989559 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52d8003570 con 0x7f52f009d1f0 2023-10-08T15:37:58.659 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.653+0000 7f52effff700 1 -- 172.21.15.3:0/2603989559 >> v1:172.21.15.50:6789/0 conn(0x7f52f00a03d0 legacy=0x7f52f009cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:58.659 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.653+0000 7f52effff700 1 -- 172.21.15.3:0/2603989559 >> v1:172.21.15.3:6789/0 conn(0x7f52f009d1f0 legacy=0x7f52f00a0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:58.659 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.653+0000 7f52effff700 1 -- 172.21.15.3:0/2603989559 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f009e680 con 0x7f52f014aee0 2023-10-08T15:37:58.660 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.653+0000 7f52effff700 1 --2- 172.21.15.3:0/2603989559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52f014aee0 0x7f52f014b2b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f52e40098e0 tx=0x7f52e40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=afb521b0fa9c1196 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:58.660 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.653+0000 7f52eeffd700 1 -- 172.21.15.3:0/2603989559 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e400b640 con 0x7f52f014aee0 2023-10-08T15:37:58.660 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.653+0000 7f52eeffd700 1 -- 172.21.15.3:0/2603989559 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52e400b7a0 con 0x7f52f014aee0 2023-10-08T15:37:58.660 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.653+0000 7f52eeffd700 1 -- 172.21.15.3:0/2603989559 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e400bb40 con 0x7f52f014aee0 2023-10-08T15:37:58.660 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.653+0000 7f52f538d700 1 -- 172.21.15.3:0/2603989559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52f014aee0 msgr2=0x7f52f014b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:58.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.653+0000 7f52f538d700 1 --2- 172.21.15.3:0/2603989559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52f014aee0 0x7f52f014b2b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f52e40098e0 tx=0x7f52e40091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:58.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.653+0000 7f52f538d700 1 -- 172.21.15.3:0/2603989559 shutdown_connections 2023-10-08T15:37:58.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.653+0000 7f52f538d700 1 --2- 172.21.15.3:0/2603989559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52f014aee0 0x7f52f014b2b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:58.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.653+0000 7f52f538d700 1 -- 172.21.15.3:0/2603989559 >> 172.21.15.3:0/2603989559 conn(0x7f52f0067b70 msgr2=0x7f52f00ba650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:58.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.653+0000 7f52f538d700 1 -- 172.21.15.3:0/2603989559 shutdown_connections 2023-10-08T15:37:58.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.653+0000 7f52f538d700 1 -- 172.21.15.3:0/2603989559 wait complete. 2023-10-08T15:37:58.662 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.657+0000 7f52f538d700 1 Processor -- start 2023-10-08T15:37:58.662 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.657+0000 7f52f538d700 1 -- start start 2023-10-08T15:37:58.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.657+0000 7f52f538d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f52f009d1f0 0x7f52f009c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:58.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.657+0000 7f52f538d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f52f00a03d0 0x7f52f0095a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:58.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.657+0000 7f52f538d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52f014aee0 0x7f52f0142e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:58.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.657+0000 7f52f538d700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f0145b70 con 0x7f52f00a03d0 2023-10-08T15:37:58.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.657+0000 7f52f538d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f0145dc0 con 0x7f52f014aee0 2023-10-08T15:37:58.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.657+0000 7f52f538d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52f01460a0 con 0x7f52f009d1f0 2023-10-08T15:37:58.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.657+0000 7f52ef7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f52f00a03d0 0x7f52f0095a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:58.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.657+0000 7f52ef7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f52f00a03d0 0x7f52f0095a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57254/0 (socket says 172.21.15.3:57254) 2023-10-08T15:37:58.664 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.657+0000 7f52ef7fe700 1 -- 172.21.15.3:0/305421518 learned_addr learned my addr 172.21.15.3:0/305421518 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:58.664 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.657+0000 7f52effff700 1 --2- 172.21.15.3:0/305421518 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f52f009d1f0 0x7f52f009c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:58.664 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.657+0000 7f52f4b8c700 1 --2- 172.21.15.3:0/305421518 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52f014aee0 0x7f52f0142e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:58.665 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.657+0000 7f52ef7fe700 1 -- 172.21.15.3:0/305421518 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f52f009d1f0 msgr2=0x7f52f009c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:58.665 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.657+0000 7f52ef7fe700 1 --2- 172.21.15.3:0/305421518 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f52f009d1f0 0x7f52f009c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:58.665 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.657+0000 7f52ef7fe700 1 -- 172.21.15.3:0/305421518 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52f014aee0 msgr2=0x7f52f0142e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:58.665 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.657+0000 7f52ef7fe700 1 --2- 172.21.15.3:0/305421518 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52f014aee0 0x7f52f0142e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:58.665 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.657+0000 7f52ef7fe700 1 -- 172.21.15.3:0/305421518 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e4009420 con 0x7f52f00a03d0 2023-10-08T15:37:58.666 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.657+0000 7f52ef7fe700 1 --2- 172.21.15.3:0/305421518 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f52f00a03d0 0x7f52f0095a70 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f52e000cb40 tx=0x7f52e0001770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:58.666 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.657+0000 7f52d7fff700 1 -- 172.21.15.3:0/305421518 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e0002060 con 0x7f52f00a03d0 2023-10-08T15:37:58.666 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.657+0000 7f52d7fff700 1 -- 172.21.15.3:0/305421518 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52e000a7e0 con 0x7f52f00a03d0 2023-10-08T15:37:58.666 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.657+0000 7f52d7fff700 1 -- 172.21.15.3:0/305421518 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e000aba0 con 0x7f52f00a03d0 2023-10-08T15:37:58.666 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.657+0000 7f52f538d700 1 -- 172.21.15.3:0/305421518 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52f0146b10 con 0x7f52f00a03d0 2023-10-08T15:37:58.666 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.657+0000 7f52f538d700 1 -- 172.21.15.3:0/305421518 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52f009cc10 con 0x7f52f00a03d0 2023-10-08T15:37:58.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.661+0000 7f52d7fff700 1 -- 172.21.15.3:0/305421518 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f52e0003030 con 0x7f52f00a03d0 2023-10-08T15:37:58.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.661+0000 7f52f538d700 1 -- 172.21.15.3:0/305421518 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52f005ecf0 con 0x7f52f00a03d0 2023-10-08T15:37:58.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.661+0000 7f52d7fff700 1 --2- 172.21.15.3:0/305421518 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f52dc060550 0x7f52dc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:58.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.661+0000 7f52d7fff700 1 -- 172.21.15.3:0/305421518 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f52e007c760 con 0x7f52f00a03d0 2023-10-08T15:37:58.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.661+0000 7f52effff700 1 --2- 172.21.15.3:0/305421518 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f52dc060550 0x7f52dc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:58.668 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.661+0000 7f52effff700 1 --2- 172.21.15.3:0/305421518 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f52dc060550 0x7f52dc062a00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f52e40093f0 tx=0x7f52e4017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:58.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.669+0000 7f52d7fff700 1 -- 172.21.15.3:0/305421518 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f52e004cd30 con 0x7f52f00a03d0 2023-10-08T15:37:58.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.833+0000 7f52f538d700 1 -- 172.21.15.3:0/305421518 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f52f01489f0 con 0x7f52f00a03d0 2023-10-08T15:37:58.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.833+0000 7f52d7fff700 1 -- 172.21.15.3:0/305421518 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f52e0050350 con 0x7f52f00a03d0 2023-10-08T15:37:58.841 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2023-10-08T15:37:58.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.837+0000 7f52f538d700 1 -- 172.21.15.3:0/305421518 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f52dc060550 msgr2=0x7f52dc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:58.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.837+0000 7f52f538d700 1 --2- 172.21.15.3:0/305421518 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f52dc060550 0x7f52dc062a00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f52e40093f0 tx=0x7f52e4017000 comp rx=0 tx=0).stop 2023-10-08T15:37:58.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.837+0000 7f52f538d700 1 -- 172.21.15.3:0/305421518 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f52f00a03d0 msgr2=0x7f52f0095a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:58.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.837+0000 7f52f538d700 1 --2- 172.21.15.3:0/305421518 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f52f00a03d0 0x7f52f0095a70 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f52e000cb40 tx=0x7f52e0001770 comp rx=0 tx=0).stop 2023-10-08T15:37:58.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.837+0000 7f52f538d700 1 -- 172.21.15.3:0/305421518 shutdown_connections 2023-10-08T15:37:58.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.837+0000 7f52f538d700 1 --2- 172.21.15.3:0/305421518 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f52dc060550 0x7f52dc062a00 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:58.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.837+0000 7f52f538d700 1 --2- 172.21.15.3:0/305421518 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52f014aee0 0x7f52f0142e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:58.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.837+0000 7f52f538d700 1 --2- 172.21.15.3:0/305421518 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f52f00a03d0 0x7f52f0095a70 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:58.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.837+0000 7f52f538d700 1 --2- 172.21.15.3:0/305421518 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f52f009d1f0 0x7f52f009c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:58.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.837+0000 7f52f538d700 1 -- 172.21.15.3:0/305421518 >> 172.21.15.3:0/305421518 conn(0x7f52f0067b70 msgr2=0x7f52f006e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:58.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.837+0000 7f52f538d700 1 -- 172.21.15.3:0/305421518 shutdown_connections 2023-10-08T15:37:58.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.837+0000 7f52f538d700 1 -- 172.21.15.3:0/305421518 wait complete. 2023-10-08T15:37:58.854 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T15:37:58.970 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.965+0000 7f800ffff700 1 Processor -- start 2023-10-08T15:37:58.970 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.965+0000 7f800ffff700 1 -- start start 2023-10-08T15:37:58.972 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.965+0000 7f800ffff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f8010147970 0x7f801014c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:58.972 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.965+0000 7f800ffff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f801009f1e0 0x7f80100bad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:58.972 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.965+0000 7f800ffff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80101493a0 con 0x7f80100bb2a0 2023-10-08T15:37:58.972 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.965+0000 7f800ffff700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f801014c760 con 0x7f8010147970 2023-10-08T15:37:58.972 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.965+0000 7f800ffff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f801009df30 con 0x7f801009f1e0 2023-10-08T15:37:58.973 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.965+0000 7f800effd700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f8010147970 0x7f801014c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:58.973 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.965+0000 7f800effd700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f8010147970 0x7f801014c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57258/0 (socket says 172.21.15.3:57258) 2023-10-08T15:37:58.973 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.965+0000 7f80067fc700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f801009f1e0 0x7f80100bad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:58.973 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.965+0000 7f800effd700 1 -- 172.21.15.3:0/3005151544 learned_addr learned my addr 172.21.15.3:0/3005151544 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:58.973 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.965+0000 7f800e7fc700 1 -- 172.21.15.3:0/3005151544 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1023242493 0 0) 0x7f80101493a0 con 0x7f80100bb2a0 2023-10-08T15:37:58.973 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.965+0000 7f800effd700 1 -- 172.21.15.3:0/3005151544 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f801009f1e0 msgr2=0x7f80100bad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:58.973 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.965+0000 7f800effd700 1 --2- 172.21.15.3:0/3005151544 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f801009f1e0 0x7f80100bad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:58.973 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.965+0000 7f800effd700 1 -- 172.21.15.3:0/3005151544 >> v1:172.21.15.50:6789/0 conn(0x7f80100bb2a0 legacy=0x7f8010147d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:58.973 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.965+0000 7f800effd700 1 -- 172.21.15.3:0/3005151544 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80100ba0f0 con 0x7f8010147970 2023-10-08T15:37:58.973 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.965+0000 7f800effd700 1 --2- 172.21.15.3:0/3005151544 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8010147970 0x7f801014c220 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f80000099b0 tx=0x7f8000009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b0d19cc25fd886d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:58.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.965+0000 7f800e7fc700 1 -- 172.21.15.3:0/3005151544 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8000009ea0 con 0x7f8010147970 2023-10-08T15:37:58.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.965+0000 7f800e7fc700 1 -- 172.21.15.3:0/3005151544 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f800000b860 con 0x7f8010147970 2023-10-08T15:37:58.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.965+0000 7f800e7fc700 1 -- 172.21.15.3:0/3005151544 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800000bc00 con 0x7f8010147970 2023-10-08T15:37:58.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.969+0000 7f800ffff700 1 -- 172.21.15.3:0/3005151544 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8010147970 msgr2=0x7f801014c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:58.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.969+0000 7f800ffff700 1 --2- 172.21.15.3:0/3005151544 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8010147970 0x7f801014c220 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f80000099b0 tx=0x7f8000009250 comp rx=0 tx=0).stop 2023-10-08T15:37:58.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.969+0000 7f800ffff700 1 -- 172.21.15.3:0/3005151544 shutdown_connections 2023-10-08T15:37:58.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.969+0000 7f800ffff700 1 --2- 172.21.15.3:0/3005151544 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f801009f1e0 0x7f80100bad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:58.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.969+0000 7f800ffff700 1 --2- 172.21.15.3:0/3005151544 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8010147970 0x7f801014c220 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:58.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.969+0000 7f800ffff700 1 -- 172.21.15.3:0/3005151544 >> 172.21.15.3:0/3005151544 conn(0x7f8010067b70 msgr2=0x7f80100ba650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:58.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.969+0000 7f800ffff700 1 -- 172.21.15.3:0/3005151544 shutdown_connections 2023-10-08T15:37:58.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.969+0000 7f800ffff700 1 -- 172.21.15.3:0/3005151544 wait complete. 2023-10-08T15:37:58.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.969+0000 7f800ffff700 1 Processor -- start 2023-10-08T15:37:58.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.969+0000 7f800ffff700 1 -- start start 2023-10-08T15:37:58.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.973+0000 7f800ffff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f801009f1e0 0x7f80101574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:58.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.973+0000 7f800ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80100bb2a0 0x7f8010156660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:58.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.973+0000 7f800ffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8010147970 0x7f801006eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:58.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.973+0000 7f800ffff700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8010147120 con 0x7f8010147970 2023-10-08T15:37:58.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.973+0000 7f800ffff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801006f060 con 0x7f80100bb2a0 2023-10-08T15:37:58.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.973+0000 7f800ffff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f801006ddf0 con 0x7f801009f1e0 2023-10-08T15:37:58.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.973+0000 7f800f7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8010147970 0x7f801006eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:58.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.973+0000 7f80067fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80100bb2a0 0x7f8010156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:58.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.973+0000 7f80067fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80100bb2a0 0x7f8010156660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.3:39692/0 (socket says 172.21.15.3:39692) 2023-10-08T15:37:58.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.973+0000 7f80067fc700 1 -- 172.21.15.3:0/4232101754 learned_addr learned my addr 172.21.15.3:0/4232101754 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:58.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.973+0000 7f800effd700 1 --2- 172.21.15.3:0/4232101754 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f801009f1e0 0x7f80101574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:58.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.973+0000 7f800f7fe700 1 -- 172.21.15.3:0/4232101754 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f801009f1e0 msgr2=0x7f80101574a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:58.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.973+0000 7f800f7fe700 1 --2- 172.21.15.3:0/4232101754 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f801009f1e0 0x7f80101574a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:58.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.973+0000 7f800f7fe700 1 -- 172.21.15.3:0/4232101754 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80100bb2a0 msgr2=0x7f8010156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:58.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.973+0000 7f800f7fe700 1 --2- 172.21.15.3:0/4232101754 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80100bb2a0 0x7f8010156660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:58.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.973+0000 7f800f7fe700 1 -- 172.21.15.3:0/4232101754 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80000094f0 con 0x7f8010147970 2023-10-08T15:37:58.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.973+0000 7f80067fc700 1 --2- 172.21.15.3:0/4232101754 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80100bb2a0 0x7f8010156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:37:58.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.973+0000 7f800f7fe700 1 --2- 172.21.15.3:0/4232101754 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8010147970 0x7f801006eb20 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f80080012e0 tx=0x7f80080016c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:58.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.973+0000 7f80077fe700 1 -- 172.21.15.3:0/4232101754 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8008012630 con 0x7f8010147970 2023-10-08T15:37:58.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.973+0000 7f800ffff700 1 -- 172.21.15.3:0/4232101754 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f801006e690 con 0x7f8010147970 2023-10-08T15:37:58.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.973+0000 7f80077fe700 1 -- 172.21.15.3:0/4232101754 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8008012790 con 0x7f8010147970 2023-10-08T15:37:58.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.973+0000 7f80077fe700 1 -- 172.21.15.3:0/4232101754 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8008012b50 con 0x7f8010147970 2023-10-08T15:37:58.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.973+0000 7f800ffff700 1 -- 172.21.15.3:0/4232101754 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f801006d3a0 con 0x7f8010147970 2023-10-08T15:37:58.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.973+0000 7f800ffff700 1 -- 172.21.15.3:0/4232101754 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ff40052b0 con 0x7f8010147970 2023-10-08T15:37:58.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.977+0000 7f80077fe700 1 -- 172.21.15.3:0/4232101754 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f8008003030 con 0x7f8010147970 2023-10-08T15:37:58.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.977+0000 7f80077fe700 1 --2- 172.21.15.3:0/4232101754 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7ff0060550 0x7f7ff0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:58.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.977+0000 7f80077fe700 1 -- 172.21.15.3:0/4232101754 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f800807c680 con 0x7f8010147970 2023-10-08T15:37:58.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.977+0000 7f800effd700 1 --2- 172.21.15.3:0/4232101754 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7ff0060550 0x7f7ff0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:58.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.977+0000 7f800effd700 1 --2- 172.21.15.3:0/4232101754 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7ff0060550 0x7f7ff0062a00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f80000099b0 tx=0x7f8000017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:58.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:58.981+0000 7f80077fe700 1 -- 172.21.15.3:0/4232101754 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f800804cc70 con 0x7f8010147970 2023-10-08T15:37:59.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.145+0000 7f800ffff700 1 -- 172.21.15.3:0/4232101754 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7ff4005ae0 con 0x7f8010147970 2023-10-08T15:37:59.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.145+0000 7f80077fe700 1 -- 172.21.15.3:0/4232101754 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8008050290 con 0x7f8010147970 2023-10-08T15:37:59.152 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 32 2023-10-08T15:37:59.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.149+0000 7f800ffff700 1 -- 172.21.15.3:0/4232101754 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7ff0060550 msgr2=0x7f7ff0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:59.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.149+0000 7f800ffff700 1 --2- 172.21.15.3:0/4232101754 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7ff0060550 0x7f7ff0062a00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f80000099b0 tx=0x7f8000017000 comp rx=0 tx=0).stop 2023-10-08T15:37:59.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.149+0000 7f800ffff700 1 -- 172.21.15.3:0/4232101754 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8010147970 msgr2=0x7f801006eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:59.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.149+0000 7f800ffff700 1 --2- 172.21.15.3:0/4232101754 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8010147970 0x7f801006eb20 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f80080012e0 tx=0x7f80080016c0 comp rx=0 tx=0).stop 2023-10-08T15:37:59.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.149+0000 7f800ffff700 1 -- 172.21.15.3:0/4232101754 shutdown_connections 2023-10-08T15:37:59.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.149+0000 7f800ffff700 1 --2- 172.21.15.3:0/4232101754 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7ff0060550 0x7f7ff0062a00 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:59.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.149+0000 7f800ffff700 1 --2- 172.21.15.3:0/4232101754 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8010147970 0x7f801006eb20 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:59.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.149+0000 7f800ffff700 1 --2- 172.21.15.3:0/4232101754 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80100bb2a0 0x7f8010156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:59.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.149+0000 7f800ffff700 1 --2- 172.21.15.3:0/4232101754 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f801009f1e0 0x7f80101574a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:59.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.149+0000 7f800ffff700 1 -- 172.21.15.3:0/4232101754 >> 172.21.15.3:0/4232101754 conn(0x7f8010067b70 msgr2=0x7f80100a2040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:59.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.149+0000 7f800ffff700 1 -- 172.21.15.3:0/4232101754 shutdown_connections 2023-10-08T15:37:59.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.149+0000 7f800ffff700 1 -- 172.21.15.3:0/4232101754 wait complete. 2023-10-08T15:37:59.167 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T15:37:59.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.277+0000 7f7b5eeda700 1 Processor -- start 2023-10-08T15:37:59.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.277+0000 7f7b5eeda700 1 -- start start 2023-10-08T15:37:59.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.281+0000 7f7b5eeda700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7b580bf1f0 0x7f7b580bf5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:59.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.281+0000 7f7b5eeda700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b580b3b60 con 0x7f7b5806f080 2023-10-08T15:37:59.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.281+0000 7f7b5eeda700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b580b3860 con 0x7f7b580a2d50 2023-10-08T15:37:59.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.281+0000 7f7b5eeda700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b5806daf0 con 0x7f7b580bf1f0 2023-10-08T15:37:59.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.281+0000 7f7b5e6d9700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f7b5806f080 0x7f7b5814ea40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:54458/0 (socket says 172.21.15.3:54458) 2023-10-08T15:37:59.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.281+0000 7f7b5e6d9700 1 -- 172.21.15.3:0/3555907152 learned_addr learned my addr 172.21.15.3:0/3555907152 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:59.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.281+0000 7f7b5ded8700 1 --2- 172.21.15.3:0/3555907152 >> v2:172.21.15.50:3300/0 conn(0x7f7b580bf1f0 0x7f7b580bf5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:59.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.281+0000 7f7b5ced6700 1 -- 172.21.15.3:0/3555907152 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1123556544 0 0) 0x7f7b580b3b60 con 0x7f7b5806f080 2023-10-08T15:37:59.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.281+0000 7f7b5ced6700 1 -- 172.21.15.3:0/3555907152 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b44003570 con 0x7f7b5806f080 2023-10-08T15:37:59.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.281+0000 7f7b5ced6700 1 -- 172.21.15.3:0/3555907152 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3525757013 0 0) 0x7f7b580b3860 con 0x7f7b580a2d50 2023-10-08T15:37:59.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.281+0000 7f7b5ced6700 1 -- 172.21.15.3:0/3555907152 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b580b3b60 con 0x7f7b580a2d50 2023-10-08T15:37:59.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.281+0000 7f7b5ded8700 1 -- 172.21.15.3:0/3555907152 >> v1:172.21.15.50:6789/0 conn(0x7f7b580a2d50 legacy=0x7f7b580b1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:59.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.281+0000 7f7b5ced6700 1 -- 172.21.15.3:0/3555907152 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 557175798 0 0) 0x7f7b44003570 con 0x7f7b5806f080 2023-10-08T15:37:59.289 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.281+0000 7f7b5ded8700 1 -- 172.21.15.3:0/3555907152 >> v1:172.21.15.3:6789/0 conn(0x7f7b5806f080 legacy=0x7f7b5814ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:59.289 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.281+0000 7f7b5ded8700 1 -- 172.21.15.3:0/3555907152 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b5806f520 con 0x7f7b580bf1f0 2023-10-08T15:37:59.289 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.281+0000 7f7b5ded8700 1 --2- 172.21.15.3:0/3555907152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b580bf1f0 0x7f7b580bf5c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c0098e0 tx=0x7f7b4c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e029feadc97a1eb9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:59.289 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.281+0000 7f7b5ced6700 1 -- 172.21.15.3:0/3555907152 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b500017f0 con 0x7f7b580bf1f0 2023-10-08T15:37:59.289 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.281+0000 7f7b5ced6700 1 -- 172.21.15.3:0/3555907152 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b4c011420 con 0x7f7b580bf1f0 2023-10-08T15:37:59.289 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.281+0000 7f7b5ced6700 1 -- 172.21.15.3:0/3555907152 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4c0117c0 con 0x7f7b580bf1f0 2023-10-08T15:37:59.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.281+0000 7f7b5eeda700 1 -- 172.21.15.3:0/3555907152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b580bf1f0 msgr2=0x7f7b580bf5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:59.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.281+0000 7f7b5eeda700 1 --2- 172.21.15.3:0/3555907152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b580bf1f0 0x7f7b580bf5c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c0098e0 tx=0x7f7b4c0091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:59.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.281+0000 7f7b5eeda700 1 -- 172.21.15.3:0/3555907152 shutdown_connections 2023-10-08T15:37:59.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.281+0000 7f7b5eeda700 1 --2- 172.21.15.3:0/3555907152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b580bf1f0 0x7f7b580bf5c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:59.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.281+0000 7f7b5eeda700 1 -- 172.21.15.3:0/3555907152 >> 172.21.15.3:0/3555907152 conn(0x7f7b58068c80 msgr2=0x7f7b580beae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:59.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.281+0000 7f7b5eeda700 1 -- 172.21.15.3:0/3555907152 shutdown_connections 2023-10-08T15:37:59.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.281+0000 7f7b5eeda700 1 -- 172.21.15.3:0/3555907152 wait complete. 2023-10-08T15:37:59.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.285+0000 7f7b5eeda700 1 Processor -- start 2023-10-08T15:37:59.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.285+0000 7f7b5eeda700 1 -- start start 2023-10-08T15:37:59.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.285+0000 7f7b5eeda700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b5806f080 0x7f7b5814c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:59.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.285+0000 7f7b5eeda700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b580a2d50 0x7f7b5815e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:59.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.285+0000 7f7b5eeda700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7b580bf1f0 0x7f7b58143b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:59.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.285+0000 7f7b5eeda700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b58144c80 con 0x7f7b580a2d50 2023-10-08T15:37:59.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.285+0000 7f7b5eeda700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5815f470 con 0x7f7b5806f080 2023-10-08T15:37:59.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.285+0000 7f7b5eeda700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b581449a0 con 0x7f7b580bf1f0 2023-10-08T15:37:59.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.285+0000 7f7b5d6d7700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b580a2d50 0x7f7b5815e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:59.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.285+0000 7f7b5e6d9700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7b580bf1f0 0x7f7b58143b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:59.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.285+0000 7f7b5d6d7700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b580a2d50 0x7f7b5815e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57290/0 (socket says 172.21.15.3:57290) 2023-10-08T15:37:59.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.285+0000 7f7b5d6d7700 1 -- 172.21.15.3:0/4232528023 learned_addr learned my addr 172.21.15.3:0/4232528023 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:59.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.285+0000 7f7b5ded8700 1 --2- 172.21.15.3:0/4232528023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b5806f080 0x7f7b5814c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:59.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.285+0000 7f7b5d6d7700 1 -- 172.21.15.3:0/4232528023 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7b580bf1f0 msgr2=0x7f7b58143b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:59.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.285+0000 7f7b5d6d7700 1 --2- 172.21.15.3:0/4232528023 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7b580bf1f0 0x7f7b58143b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:59.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.285+0000 7f7b5d6d7700 1 -- 172.21.15.3:0/4232528023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b5806f080 msgr2=0x7f7b5814c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:59.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.285+0000 7f7b5d6d7700 1 --2- 172.21.15.3:0/4232528023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b5806f080 0x7f7b5814c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:59.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.285+0000 7f7b5d6d7700 1 -- 172.21.15.3:0/4232528023 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b4c009420 con 0x7f7b580a2d50 2023-10-08T15:37:59.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.285+0000 7f7b5d6d7700 1 --2- 172.21.15.3:0/4232528023 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b580a2d50 0x7f7b5815e720 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7b5400c790 tx=0x7f7b54007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:59.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.285+0000 7f7b49ffb700 1 -- 172.21.15.3:0/4232528023 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b54010510 con 0x7f7b580a2d50 2023-10-08T15:37:59.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.285+0000 7f7b49ffb700 1 -- 172.21.15.3:0/4232528023 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b54010690 con 0x7f7b580a2d50 2023-10-08T15:37:59.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.285+0000 7f7b49ffb700 1 -- 172.21.15.3:0/4232528023 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b54010a50 con 0x7f7b580a2d50 2023-10-08T15:37:59.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.285+0000 7f7b5eeda700 1 -- 172.21.15.3:0/4232528023 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b5814e8c0 con 0x7f7b580a2d50 2023-10-08T15:37:59.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.285+0000 7f7b5eeda700 1 -- 172.21.15.3:0/4232528023 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b5815ee00 con 0x7f7b580a2d50 2023-10-08T15:37:59.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.289+0000 7f7b5eeda700 1 -- 172.21.15.3:0/4232528023 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b5805ecf0 con 0x7f7b580a2d50 2023-10-08T15:37:59.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.289+0000 7f7b49ffb700 1 -- 172.21.15.3:0/4232528023 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f7b5401b3b0 con 0x7f7b580a2d50 2023-10-08T15:37:59.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.289+0000 7f7b49ffb700 1 --2- 172.21.15.3:0/4232528023 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7b3c060580 0x7f7b3c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:59.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.289+0000 7f7b49ffb700 1 -- 172.21.15.3:0/4232528023 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7b5407bfa0 con 0x7f7b580a2d50 2023-10-08T15:37:59.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.289+0000 7f7b5ded8700 1 --2- 172.21.15.3:0/4232528023 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7b3c060580 0x7f7b3c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:59.297 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.289+0000 7f7b5ded8700 1 --2- 172.21.15.3:0/4232528023 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7b3c060580 0x7f7b3c062a30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c0093f0 tx=0x7f7b4c016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:59.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.297+0000 7f7b49ffb700 1 -- 172.21.15.3:0/4232528023 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7b5404c4f0 con 0x7f7b580a2d50 2023-10-08T15:37:59.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.457+0000 7f7b5eeda700 1 -- 172.21.15.3:0/4232528023 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7b5806deb0 con 0x7f7b580a2d50 2023-10-08T15:37:59.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.457+0000 7f7b49ffb700 1 -- 172.21.15.3:0/4232528023 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7b54017070 con 0x7f7b580a2d50 2023-10-08T15:37:59.465 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 64 2023-10-08T15:37:59.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.461+0000 7f7b5eeda700 1 -- 172.21.15.3:0/4232528023 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7b3c060580 msgr2=0x7f7b3c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:59.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.461+0000 7f7b5eeda700 1 --2- 172.21.15.3:0/4232528023 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7b3c060580 0x7f7b3c062a30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c0093f0 tx=0x7f7b4c016000 comp rx=0 tx=0).stop 2023-10-08T15:37:59.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.461+0000 7f7b5eeda700 1 -- 172.21.15.3:0/4232528023 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b580a2d50 msgr2=0x7f7b5815e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:59.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.461+0000 7f7b5eeda700 1 --2- 172.21.15.3:0/4232528023 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b580a2d50 0x7f7b5815e720 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7b5400c790 tx=0x7f7b54007e10 comp rx=0 tx=0).stop 2023-10-08T15:37:59.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.461+0000 7f7b5eeda700 1 -- 172.21.15.3:0/4232528023 shutdown_connections 2023-10-08T15:37:59.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.461+0000 7f7b5eeda700 1 --2- 172.21.15.3:0/4232528023 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7b3c060580 0x7f7b3c062a30 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:59.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.461+0000 7f7b5eeda700 1 --2- 172.21.15.3:0/4232528023 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7b580bf1f0 0x7f7b58143b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:59.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.461+0000 7f7b5eeda700 1 --2- 172.21.15.3:0/4232528023 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b580a2d50 0x7f7b5815e720 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:59.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.461+0000 7f7b5eeda700 1 --2- 172.21.15.3:0/4232528023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b5806f080 0x7f7b5814c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:59.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.461+0000 7f7b5eeda700 1 -- 172.21.15.3:0/4232528023 >> 172.21.15.3:0/4232528023 conn(0x7f7b58068c80 msgr2=0x7f7b580bd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:59.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.461+0000 7f7b5eeda700 1 -- 172.21.15.3:0/4232528023 shutdown_connections 2023-10-08T15:37:59.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.461+0000 7f7b5eeda700 1 -- 172.21.15.3:0/4232528023 wait complete. 2023-10-08T15:37:59.483 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:37:59.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.577+0000 7ff0b64b2700 1 Processor -- start 2023-10-08T15:37:59.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.577+0000 7ff0b64b2700 1 -- start start 2023-10-08T15:37:59.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.577+0000 7ff0b64b2700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff0b00a1de0 0x7ff0b014c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:59.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.581+0000 7ff0b64b2700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0b014b8e0 con 0x7ff0b0067310 2023-10-08T15:37:59.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.581+0000 7ff0b64b2700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0b0069080 con 0x7ff0b00bcca0 2023-10-08T15:37:59.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.581+0000 7ff0b64b2700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b00a2550 con 0x7ff0b00a1de0 2023-10-08T15:37:59.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.581+0000 7ff0affff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7ff0b0067310 0x7ff0b014bd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:54472/0 (socket says 172.21.15.3:54472) 2023-10-08T15:37:59.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.581+0000 7ff0a7fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff0b00a1de0 0x7ff0b014c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:59.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.581+0000 7ff0affff700 1 -- 172.21.15.3:0/3324312236 learned_addr learned my addr 172.21.15.3:0/3324312236 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:37:59.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.581+0000 7ff0af7fe700 1 -- 172.21.15.3:0/3324312236 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2983971650 0 0) 0x7ff0b014b8e0 con 0x7ff0b0067310 2023-10-08T15:37:59.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.581+0000 7ff0af7fe700 1 -- 172.21.15.3:0/3324312236 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff09c003570 con 0x7ff0b0067310 2023-10-08T15:37:59.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.581+0000 7ff0af7fe700 1 -- 172.21.15.3:0/3324312236 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 937283684 0 0) 0x7ff0b0069080 con 0x7ff0b00bcca0 2023-10-08T15:37:59.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.581+0000 7ff0a7fff700 1 -- 172.21.15.3:0/3324312236 >> v1:172.21.15.50:6789/0 conn(0x7ff0b00bcca0 legacy=0x7ff0b014a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:59.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.581+0000 7ff0a7fff700 1 -- 172.21.15.3:0/3324312236 >> v1:172.21.15.3:6789/0 conn(0x7ff0b0067310 legacy=0x7ff0b014bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:59.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.581+0000 7ff0a7fff700 1 -- 172.21.15.3:0/3324312236 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0b00a2270 con 0x7ff0b00a1de0 2023-10-08T15:37:59.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.581+0000 7ff0a7fff700 1 --2- 172.21.15.3:0/3324312236 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff0b00a1de0 0x7ff0b014c480 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff098009910 tx=0x7ff0980091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdfe8dfb2e4093df server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:59.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.581+0000 7ff0af7fe700 1 -- 172.21.15.3:0/3324312236 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff09800b680 con 0x7ff0b00a1de0 2023-10-08T15:37:59.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.581+0000 7ff0af7fe700 1 -- 172.21.15.3:0/3324312236 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff09800b7e0 con 0x7ff0b00a1de0 2023-10-08T15:37:59.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.581+0000 7ff0af7fe700 1 -- 172.21.15.3:0/3324312236 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff09800bb60 con 0x7ff0b00a1de0 2023-10-08T15:37:59.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.581+0000 7ff0b64b2700 1 -- 172.21.15.3:0/3324312236 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff0b00a1de0 msgr2=0x7ff0b014c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:59.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.581+0000 7ff0b64b2700 1 --2- 172.21.15.3:0/3324312236 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff0b00a1de0 0x7ff0b014c480 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff098009910 tx=0x7ff0980091a0 comp rx=0 tx=0).stop 2023-10-08T15:37:59.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.581+0000 7ff0b64b2700 1 -- 172.21.15.3:0/3324312236 shutdown_connections 2023-10-08T15:37:59.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.581+0000 7ff0b64b2700 1 --2- 172.21.15.3:0/3324312236 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff0b00a1de0 0x7ff0b014c480 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:59.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.581+0000 7ff0b64b2700 1 -- 172.21.15.3:0/3324312236 >> 172.21.15.3:0/3324312236 conn(0x7ff0b006b9b0 msgr2=0x7ff0b00681f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:59.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.581+0000 7ff0b64b2700 1 -- 172.21.15.3:0/3324312236 shutdown_connections 2023-10-08T15:37:59.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.581+0000 7ff0b64b2700 1 -- 172.21.15.3:0/3324312236 wait complete. 2023-10-08T15:37:59.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.585+0000 7ff0b64b2700 1 Processor -- start 2023-10-08T15:37:59.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.585+0000 7ff0b64b2700 1 -- start start 2023-10-08T15:37:59.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.585+0000 7ff0b64b2700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff0b0067310 0x7ff0b01495d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:59.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.585+0000 7ff0b64b2700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff0b00a1de0 0x7ff0b0151090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:59.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.585+0000 7ff0b64b2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0b00bcca0 0x7ff0b015ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:59.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.585+0000 7ff0b64b2700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b0149b10 con 0x7ff0b00a1de0 2023-10-08T15:37:59.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.585+0000 7ff0b64b2700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b014d920 con 0x7ff0b00bcca0 2023-10-08T15:37:59.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.585+0000 7ff0b64b2700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b014d640 con 0x7ff0b0067310 2023-10-08T15:37:59.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.585+0000 7ff0a7fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff0b00a1de0 0x7ff0b0151090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:59.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.585+0000 7ff0a7fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff0b00a1de0 0x7ff0b0151090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57294/0 (socket says 172.21.15.3:57294) 2023-10-08T15:37:59.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.585+0000 7ff0a7fff700 1 -- 172.21.15.3:0/294742237 learned_addr learned my addr 172.21.15.3:0/294742237 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:59.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.585+0000 7ff0b4a4f700 1 --2- 172.21.15.3:0/294742237 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0b00bcca0 0x7ff0b015ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:59.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.585+0000 7ff0affff700 1 --2- 172.21.15.3:0/294742237 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff0b0067310 0x7ff0b01495d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:59.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.585+0000 7ff0a7fff700 1 -- 172.21.15.3:0/294742237 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff0b0067310 msgr2=0x7ff0b01495d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:59.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.585+0000 7ff0a7fff700 1 --2- 172.21.15.3:0/294742237 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff0b0067310 0x7ff0b01495d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:59.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.585+0000 7ff0a7fff700 1 -- 172.21.15.3:0/294742237 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0b00bcca0 msgr2=0x7ff0b015ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:59.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.585+0000 7ff0a7fff700 1 --2- 172.21.15.3:0/294742237 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0b00bcca0 0x7ff0b015ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:59.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.585+0000 7ff0a7fff700 1 -- 172.21.15.3:0/294742237 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff098009420 con 0x7ff0b00a1de0 2023-10-08T15:37:59.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.585+0000 7ff0a7fff700 1 --2- 172.21.15.3:0/294742237 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff0b00a1de0 0x7ff0b0151090 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff0980093f0 tx=0x7ff098017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:59.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.585+0000 7ff0acff9700 1 -- 172.21.15.3:0/294742237 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff098000d10 con 0x7ff0b00a1de0 2023-10-08T15:37:59.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.585+0000 7ff0acff9700 1 -- 172.21.15.3:0/294742237 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff09800b950 con 0x7ff0b00a1de0 2023-10-08T15:37:59.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.585+0000 7ff0b64b2700 1 -- 172.21.15.3:0/294742237 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0b01515d0 con 0x7ff0b00a1de0 2023-10-08T15:37:59.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.585+0000 7ff0acff9700 1 -- 172.21.15.3:0/294742237 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff098025670 con 0x7ff0b00a1de0 2023-10-08T15:37:59.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.585+0000 7ff0b64b2700 1 -- 172.21.15.3:0/294742237 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0b015b570 con 0x7ff0b00a1de0 2023-10-08T15:37:59.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.589+0000 7ff0b64b2700 1 -- 172.21.15.3:0/294742237 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0b015eb20 con 0x7ff0b00a1de0 2023-10-08T15:37:59.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.589+0000 7ff0acff9700 1 -- 172.21.15.3:0/294742237 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff098023070 con 0x7ff0b00a1de0 2023-10-08T15:37:59.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.589+0000 7ff0acff9700 1 --2- 172.21.15.3:0/294742237 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff090060580 0x7ff090062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:59.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.589+0000 7ff0acff9700 1 -- 172.21.15.3:0/294742237 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff09807da10 con 0x7ff0b00a1de0 2023-10-08T15:37:59.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.589+0000 7ff0affff700 1 --2- 172.21.15.3:0/294742237 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff090060580 0x7ff090062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:59.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.593+0000 7ff0affff700 1 --2- 172.21.15.3:0/294742237 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff090060580 0x7ff090062a30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff0a00058d0 tx=0x7ff0a0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:59.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.601+0000 7ff0acff9700 1 -- 172.21.15.3:0/294742237 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff09804e000 con 0x7ff0b00a1de0 2023-10-08T15:37:59.798 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.793+0000 7ff0b64b2700 1 -- 172.21.15.3:0/294742237 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff0b0064530 con 0x7ff0b00a1de0 2023-10-08T15:37:59.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.793+0000 7ff0acff9700 1 -- 172.21.15.3:0/294742237 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+3073 (secure 0 0 0) 0x7ff098015c20 con 0x7ff0b00a1de0 2023-10-08T15:37:59.799 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:37:59.799 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6833/519836882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":519836882},{"type":"v1","addr":"172.21.15.3:6833","nonce":519836882}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:37:25.379215+0000","modified":"2023-10-08T15:37:28.041086+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/1601527591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1601527591},{"type":"v1","addr":"172.21.15.50:6835","nonce":1601527591}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-08T15:37:59.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.793+0000 7ff0b64b2700 1 -- 172.21.15.3:0/294742237 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff090060580 msgr2=0x7ff090062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:59.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.793+0000 7ff0b64b2700 1 --2- 172.21.15.3:0/294742237 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff090060580 0x7ff090062a30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff0a00058d0 tx=0x7ff0a0009040 comp rx=0 tx=0).stop 2023-10-08T15:37:59.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.793+0000 7ff0b64b2700 1 -- 172.21.15.3:0/294742237 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff0b00a1de0 msgr2=0x7ff0b0151090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:59.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.793+0000 7ff0b64b2700 1 --2- 172.21.15.3:0/294742237 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff0b00a1de0 0x7ff0b0151090 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff0980093f0 tx=0x7ff098017000 comp rx=0 tx=0).stop 2023-10-08T15:37:59.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.793+0000 7ff0b64b2700 1 -- 172.21.15.3:0/294742237 shutdown_connections 2023-10-08T15:37:59.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.793+0000 7ff0b64b2700 1 --2- 172.21.15.3:0/294742237 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff090060580 0x7ff090062a30 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:59.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.797+0000 7ff0b64b2700 1 --2- 172.21.15.3:0/294742237 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0b00bcca0 0x7ff0b015ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:59.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.797+0000 7ff0b64b2700 1 --2- 172.21.15.3:0/294742237 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff0b00a1de0 0x7ff0b0151090 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:59.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.797+0000 7ff0b64b2700 1 --2- 172.21.15.3:0/294742237 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff0b0067310 0x7ff0b01495d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:59.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.797+0000 7ff0b64b2700 1 -- 172.21.15.3:0/294742237 >> 172.21.15.3:0/294742237 conn(0x7ff0b006b9b0 msgr2=0x7ff0b01506a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:59.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.797+0000 7ff0b64b2700 1 -- 172.21.15.3:0/294742237 shutdown_connections 2023-10-08T15:37:59.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.797+0000 7ff0b64b2700 1 -- 172.21.15.3:0/294742237 wait complete. 2023-10-08T15:37:59.803 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 6 2023-10-08T15:37:59.814 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:37:59.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.917+0000 7fe03c866700 1 Processor -- start 2023-10-08T15:37:59.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.917+0000 7fe03c866700 1 -- start start 2023-10-08T15:37:59.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.921+0000 7fe03c866700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe0380a15e0 0x7fe03814b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:59.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.921+0000 7fe03c866700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fe038147e00 0x7fe038148240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:59.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.921+0000 7fe03c866700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe038147970 con 0x7fe038146b70 2023-10-08T15:37:59.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.921+0000 7fe03c866700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe03806de00 con 0x7fe038147e00 2023-10-08T15:37:59.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.921+0000 7fe03c866700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe03814bd90 con 0x7fe0380a15e0 2023-10-08T15:37:59.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.921+0000 7fe037fff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fe038147e00 0x7fe038148240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:59.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.921+0000 7fe037fff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fe038147e00 0x7fe038148240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57300/0 (socket says 172.21.15.3:57300) 2023-10-08T15:37:59.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.921+0000 7fe037fff700 1 -- 172.21.15.3:0/1891996225 learned_addr learned my addr 172.21.15.3:0/1891996225 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:59.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.921+0000 7fe0377fe700 1 --2- 172.21.15.3:0/1891996225 >> v2:172.21.15.50:3300/0 conn(0x7fe0380a15e0 0x7fe03814b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:59.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.921+0000 7fe037fff700 1 -- 172.21.15.3:0/1891996225 >> v2:172.21.15.50:3300/0 conn(0x7fe0380a15e0 msgr2=0x7fe03814b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:37:59.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.921+0000 7fe037fff700 1 --2- 172.21.15.3:0/1891996225 >> v2:172.21.15.50:3300/0 conn(0x7fe0380a15e0 0x7fe03814b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:59.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.921+0000 7fe037fff700 1 -- 172.21.15.3:0/1891996225 >> v1:172.21.15.50:6789/0 conn(0x7fe038146b70 legacy=0x7fe038146fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:59.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.921+0000 7fe037fff700 1 -- 172.21.15.3:0/1891996225 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe038069770 con 0x7fe038147e00 2023-10-08T15:37:59.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.921+0000 7fe037fff700 1 --2- 172.21.15.3:0/1891996225 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe038147e00 0x7fe038148240 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe0380bbd70 tx=0x7fe03000ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6d91b0af39b3aed server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:59.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.921+0000 7fe0367fc700 1 -- 172.21.15.3:0/1891996225 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe030010070 con 0x7fe038147e00 2023-10-08T15:37:59.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.921+0000 7fe0367fc700 1 -- 172.21.15.3:0/1891996225 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe03000dbd0 con 0x7fe038147e00 2023-10-08T15:37:59.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.921+0000 7fe0367fc700 1 -- 172.21.15.3:0/1891996225 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe030016400 con 0x7fe038147e00 2023-10-08T15:37:59.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.921+0000 7fe03c866700 1 -- 172.21.15.3:0/1891996225 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe038147e00 msgr2=0x7fe038148240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:59.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.921+0000 7fe03c866700 1 --2- 172.21.15.3:0/1891996225 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe038147e00 0x7fe038148240 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe0380bbd70 tx=0x7fe03000ba50 comp rx=0 tx=0).stop 2023-10-08T15:37:59.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.921+0000 7fe03c866700 1 -- 172.21.15.3:0/1891996225 shutdown_connections 2023-10-08T15:37:59.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.921+0000 7fe03c866700 1 --2- 172.21.15.3:0/1891996225 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe038147e00 0x7fe038148240 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:59.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.921+0000 7fe03c866700 1 --2- 172.21.15.3:0/1891996225 >> v2:172.21.15.50:3300/0 conn(0x7fe0380a15e0 0x7fe03814b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:59.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.921+0000 7fe03c866700 1 -- 172.21.15.3:0/1891996225 >> 172.21.15.3:0/1891996225 conn(0x7fe0380670e0 msgr2=0x7fe0380674e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:37:59.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.921+0000 7fe03c866700 1 -- 172.21.15.3:0/1891996225 shutdown_connections 2023-10-08T15:37:59.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.921+0000 7fe03c866700 1 -- 172.21.15.3:0/1891996225 wait complete. 2023-10-08T15:37:59.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.925+0000 7fe03c866700 1 Processor -- start 2023-10-08T15:37:59.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.925+0000 7fe03c866700 1 -- start start 2023-10-08T15:37:59.935 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.929+0000 7fe03c866700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe0380a15e0 0x7fe0380b29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:59.935 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.929+0000 7fe03c866700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe038146b70 0x7fe0381458f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:59.935 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.929+0000 7fe03c866700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe038147e00 0x7fe0381407e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:59.935 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.929+0000 7fe03c866700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0380b3c60 con 0x7fe038147e00 2023-10-08T15:37:59.935 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.929+0000 7fe03c866700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0380b2f10 con 0x7fe038146b70 2023-10-08T15:37:59.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.929+0000 7fe03c866700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe038145e30 con 0x7fe0380a15e0 2023-10-08T15:37:59.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.929+0000 7fe037fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe038147e00 0x7fe0381407e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:59.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.929+0000 7fe0377fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe0380a15e0 0x7fe0380b29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:59.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.929+0000 7fe037fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe038147e00 0x7fe0381407e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57302/0 (socket says 172.21.15.3:57302) 2023-10-08T15:37:59.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.929+0000 7fe037fff700 1 -- 172.21.15.3:0/3970335946 learned_addr learned my addr 172.21.15.3:0/3970335946 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:37:59.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.929+0000 7fe0377fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe0380a15e0 0x7fe0380b29d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.3:53992/0 (socket says 172.21.15.3:53992) 2023-10-08T15:37:59.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.929+0000 7fe036ffd700 1 --2- 172.21.15.3:0/3970335946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe038146b70 0x7fe0381458f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:59.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.929+0000 7fe0377fe700 1 -- 172.21.15.3:0/3970335946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe038146b70 msgr2=0x7fe0381458f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:59.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.929+0000 7fe0377fe700 1 --2- 172.21.15.3:0/3970335946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe038146b70 0x7fe0381458f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:59.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.929+0000 7fe0377fe700 1 -- 172.21.15.3:0/3970335946 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe038147e00 msgr2=0x7fe0381407e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:37:59.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.929+0000 7fe0377fe700 1 --2- 172.21.15.3:0/3970335946 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe038147e00 0x7fe0381407e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:37:59.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.929+0000 7fe0377fe700 1 -- 172.21.15.3:0/3970335946 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe03000bcf0 con 0x7fe0380a15e0 2023-10-08T15:37:59.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.929+0000 7fe037fff700 1 --2- 172.21.15.3:0/3970335946 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe038147e00 0x7fe0381407e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:37:59.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.929+0000 7fe0377fe700 1 --2- 172.21.15.3:0/3970335946 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe0380a15e0 0x7fe0380b29d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe02800ea80 tx=0x7fe0280091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:59.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.929+0000 7fe01f7fe700 1 -- 172.21.15.3:0/3970335946 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02800eec0 con 0x7fe0380a15e0 2023-10-08T15:37:59.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.929+0000 7fe01f7fe700 1 -- 172.21.15.3:0/3970335946 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe02800c7f0 con 0x7fe0380a15e0 2023-10-08T15:37:59.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.929+0000 7fe03c866700 1 -- 172.21.15.3:0/3970335946 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0380b3610 con 0x7fe0380a15e0 2023-10-08T15:37:59.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.929+0000 7fe01f7fe700 1 -- 172.21.15.3:0/3970335946 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02800cb70 con 0x7fe0380a15e0 2023-10-08T15:37:59.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.929+0000 7fe03c866700 1 -- 172.21.15.3:0/3970335946 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0381565c0 con 0x7fe0380a15e0 2023-10-08T15:37:59.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.929+0000 7fe03c866700 1 -- 172.21.15.3:0/3970335946 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe03805ecf0 con 0x7fe0380a15e0 2023-10-08T15:37:59.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.933+0000 7fe01f7fe700 1 -- 172.21.15.3:0/3970335946 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe028005a00 con 0x7fe0380a15e0 2023-10-08T15:37:59.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.933+0000 7fe01f7fe700 1 --2- 172.21.15.3:0/3970335946 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe024060580 0x7fe024062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:37:59.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.933+0000 7fe01f7fe700 1 -- 172.21.15.3:0/3970335946 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe02807ce30 con 0x7fe0380a15e0 2023-10-08T15:37:59.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.933+0000 7fe036ffd700 1 --2- 172.21.15.3:0/3970335946 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe024060580 0x7fe024062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:37:59.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.933+0000 7fe036ffd700 1 --2- 172.21.15.3:0/3970335946 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe024060580 0x7fe024062a30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe038142a50 tx=0x7fe02c000bc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:37:59.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:37:59.941+0000 7fe01f7fe700 1 -- 172.21.15.3:0/3970335946 <== mon.2 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe02804d380 con 0x7fe0380a15e0 2023-10-08T15:38:00.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.105+0000 7fe03c866700 1 -- 172.21.15.3:0/3970335946 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe038068c60 con 0x7fe0380a15e0 2023-10-08T15:38:00.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.105+0000 7fe01f7fe700 1 -- 172.21.15.3:0/3970335946 <== mon.2 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15254 (secure 0 0 0) 0x7fe028021090 con 0x7fe0380a15e0 2023-10-08T15:38:00.113 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:38:00.113 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":20,"fsid":"7635972e-cd66-4a8f-a231-378db8b3847a","created":"2023-10-08T15:37:08.234594+0000","modified":"2023-10-08T15:37:27.007828+0000","last_up_change":"2023-10-08T15:37:17.537726+0000","last_in_change":"2023-10-08T15:37:10.269178+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:37:16.581590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:37:23.353518+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T15:37:24.365114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"64fb1864-bfdd-4d75-9b41-03fb60085dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33363},{"type":"v1","addr":"172.21.15.3:6801","nonce":33363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33363},{"type":"v1","addr":"172.21.15.3:6803","nonce":33363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":33363},{"type":"v1","addr":"172.21.15.3:6807","nonce":33363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33363},{"type":"v1","addr":"172.21.15.3:6805","nonce":33363}]},"public_addr":"172.21.15.3:6801/33363","cluster_addr":"172.21.15.3:6803/33363","heartbeat_back_addr":"172.21.15.3:6807/33363","heartbeat_front_addr":"172.21.15.3:6805/33363","state":["exists","up"]},{"osd":1,"uuid":"3ca6bd3a-3e8a-4c65-af9c-46148b0c2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33364},{"type":"v1","addr":"172.21.15.3:6820","nonce":33364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33364},{"type":"v1","addr":"172.21.15.3:6824","nonce":33364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33364},{"type":"v1","addr":"172.21.15.3:6831","nonce":33364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33364},{"type":"v1","addr":"172.21.15.3:6828","nonce":33364}]},"public_addr":"172.21.15.3:6820/33364","cluster_addr":"172.21.15.3:6824/33364","heartbeat_back_addr":"172.21.15.3:6831/33364","heartbeat_front_addr":"172.21.15.3:6828/33364","state":["exists","up"]},{"osd":2,"uuid":"6eb9f757-58dd-442f-910d-32401454bce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33366},{"type":"v1","addr":"172.21.15.3:6817","nonce":33366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":33366},{"type":"v1","addr":"172.21.15.3:6821","nonce":33366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6827","nonce":33366},{"type":"v1","addr":"172.21.15.3:6829","nonce":33366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":33366},{"type":"v1","addr":"172.21.15.3:6825","nonce":33366}]},"public_addr":"172.21.15.3:6817/33366","cluster_addr":"172.21.15.3:6821/33366","heartbeat_back_addr":"172.21.15.3:6829/33366","heartbeat_front_addr":"172.21.15.3:6825/33366","state":["exists","up"]},{"osd":3,"uuid":"1c39866b-ac2e-4ea9-a69c-02b01ee4191d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33365},{"type":"v1","addr":"172.21.15.3:6809","nonce":33365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":33365},{"type":"v1","addr":"172.21.15.3:6811","nonce":33365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33365},{"type":"v1","addr":"172.21.15.3:6815","nonce":33365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":33365},{"type":"v1","addr":"172.21.15.3:6813","nonce":33365}]},"public_addr":"172.21.15.3:6809/33365","cluster_addr":"172.21.15.3:6811/33365","heartbeat_back_addr":"172.21.15.3:6815/33365","heartbeat_front_addr":"172.21.15.3:6813/33365","state":["exists","up"]},{"osd":4,"uuid":"15f86b61-b7f1-4780-ae00-9d80a68cb830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":33605},{"type":"v1","addr":"172.21.15.50:6809","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33605},{"type":"v1","addr":"172.21.15.50:6811","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33605},{"type":"v1","addr":"172.21.15.50:6815","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":33605},{"type":"v1","addr":"172.21.15.50:6813","nonce":33605}]},"public_addr":"172.21.15.50:6809/33605","cluster_addr":"172.21.15.50:6811/33605","heartbeat_back_addr":"172.21.15.50:6815/33605","heartbeat_front_addr":"172.21.15.50:6813/33605","state":["exists","up"]},{"osd":5,"uuid":"726c3003-34e6-4d5a-b6e2-f911e13c2118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33606},{"type":"v1","addr":"172.21.15.50:6801","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33606},{"type":"v1","addr":"172.21.15.50:6803","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33606},{"type":"v1","addr":"172.21.15.50:6807","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":33606},{"type":"v1","addr":"172.21.15.50:6805","nonce":33606}]},"public_addr":"172.21.15.50:6801/33606","cluster_addr":"172.21.15.50:6803/33606","heartbeat_back_addr":"172.21.15.50:6807/33606","heartbeat_front_addr":"172.21.15.50:6805/33606","state":["exists","up"]},{"osd":6,"uuid":"401122a4-9988-441f-a5a7-39164434ebcd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":33607},{"type":"v1","addr":"172.21.15.50:6819","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":33607},{"type":"v1","addr":"172.21.15.50:6823","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":33607},{"type":"v1","addr":"172.21.15.50:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":33607},{"type":"v1","addr":"172.21.15.50:6827","nonce":33607}]},"public_addr":"172.21.15.50:6819/33607","cluster_addr":"172.21.15.50:6823/33607","heartbeat_back_addr":"172.21.15.50:6831/33607","heartbeat_front_addr":"172.21.15.50:6827/33607","state":["exists","up"]},{"osd":7,"uuid":"6b3fa236-c9d0-4c4d-82ae-9af4daf6d699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33604},{"type":"v1","addr":"172.21.15.50:6818","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":33604},{"type":"v1","addr":"172.21.15.50:6822","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":33604},{"type":"v1","addr":"172.21.15.50:6830","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":33604},{"type":"v1","addr":"172.21.15.50:6826","nonce":33604}]},"public_addr":"172.21.15.50:6818/33604","cluster_addr":"172.21.15.50:6822/33604","heartbeat_back_addr":"172.21.15.50:6830/33604","heartbeat_front_addr":"172.21.15.50:6826/33604","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.497794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.529417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.873426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.325972+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.443971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.240795+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.739632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.643026+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:38:00.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.113+0000 7fe03c866700 1 -- 172.21.15.3:0/3970335946 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe024060580 msgr2=0x7fe024062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:00.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.113+0000 7fe03c866700 1 --2- 172.21.15.3:0/3970335946 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe024060580 0x7fe024062a30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe038142a50 tx=0x7fe02c000bc0 comp rx=0 tx=0).stop 2023-10-08T15:38:00.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.113+0000 7fe03c866700 1 -- 172.21.15.3:0/3970335946 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe0380a15e0 msgr2=0x7fe0380b29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:00.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.113+0000 7fe03c866700 1 --2- 172.21.15.3:0/3970335946 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe0380a15e0 0x7fe0380b29d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe02800ea80 tx=0x7fe0280091a0 comp rx=0 tx=0).stop 2023-10-08T15:38:00.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.113+0000 7fe03c866700 1 -- 172.21.15.3:0/3970335946 shutdown_connections 2023-10-08T15:38:00.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.113+0000 7fe03c866700 1 --2- 172.21.15.3:0/3970335946 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe024060580 0x7fe024062a30 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:00.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.113+0000 7fe03c866700 1 --2- 172.21.15.3:0/3970335946 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe038147e00 0x7fe0381407e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:00.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.113+0000 7fe03c866700 1 --2- 172.21.15.3:0/3970335946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe038146b70 0x7fe0381458f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:00.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.113+0000 7fe03c866700 1 --2- 172.21.15.3:0/3970335946 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe0380a15e0 0x7fe0380b29d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:00.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.113+0000 7fe03c866700 1 -- 172.21.15.3:0/3970335946 >> 172.21.15.3:0/3970335946 conn(0x7fe0380670e0 msgr2=0x7fe03814b410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:00.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.113+0000 7fe03c866700 1 -- 172.21.15.3:0/3970335946 shutdown_connections 2023-10-08T15:38:00.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.113+0000 7fe03c866700 1 -- 172.21.15.3:0/3970335946 wait complete. 2023-10-08T15:38:00.132 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T15:38:00.132 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:38:00.231 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.225+0000 7f8980e1c700 1 Processor -- start 2023-10-08T15:38:00.231 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.225+0000 7f8980e1c700 1 -- start start 2023-10-08T15:38:00.232 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.225+0000 7f8980e1c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f897c148c00 0x7f897c148fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:00.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.225+0000 7f8980e1c700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f897c0a31c0 0x7f897c0670e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:00.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.225+0000 7f8980e1c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f897c067620 0x7f897c1498f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:00.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.225+0000 7f8980e1c700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f897c09f7f0 con 0x7f897c0a31c0 2023-10-08T15:38:00.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.225+0000 7f8980e1c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f897c14d510 con 0x7f897c148c00 2023-10-08T15:38:00.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.225+0000 7f8980e1c700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f897c14d7f0 con 0x7f897c067620 2023-10-08T15:38:00.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.225+0000 7f8979d9b700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f897c0a31c0 0x7f897c0670e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:00.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.225+0000 7f8979d9b700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f897c0a31c0 0x7f897c0670e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57314/0 (socket says 172.21.15.3:57314) 2023-10-08T15:38:00.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.225+0000 7f8979d9b700 1 -- 172.21.15.3:0/3912297309 learned_addr learned my addr 172.21.15.3:0/3912297309 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:38:00.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.225+0000 7f897ad9d700 1 --2- 172.21.15.3:0/3912297309 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f897c067620 0x7f897c1498f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:00.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.225+0000 7f897a59c700 1 --2- 172.21.15.3:0/3912297309 >> v2:172.21.15.50:3300/0 conn(0x7f897c148c00 0x7f897c148fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:00.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.225+0000 7f8979d9b700 1 -- 172.21.15.3:0/3912297309 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f897c067620 msgr2=0x7f897c1498f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:38:00.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.225+0000 7f8979d9b700 1 --2- 172.21.15.3:0/3912297309 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f897c067620 0x7f897c1498f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:00.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.225+0000 7f8979d9b700 1 -- 172.21.15.3:0/3912297309 >> v2:172.21.15.50:3300/0 conn(0x7f897c148c00 msgr2=0x7f897c148fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:38:00.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.225+0000 7f8979d9b700 1 --2- 172.21.15.3:0/3912297309 >> v2:172.21.15.50:3300/0 conn(0x7f897c148c00 0x7f897c148fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:00.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.225+0000 7f8979d9b700 1 -- 172.21.15.3:0/3912297309 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f897c0a3a60 con 0x7f897c0a31c0 2023-10-08T15:38:00.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.225+0000 7f897a59c700 1 --2- 172.21.15.3:0/3912297309 >> v2:172.21.15.50:3300/0 conn(0x7f897c148c00 0x7f897c148fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:38:00.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.229+0000 7f8979d9b700 1 --2- 172.21.15.3:0/3912297309 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f897c0a31c0 0x7f897c0670e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f897c067ae0 tx=0x7f8964009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=819185966b6eafce server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:00.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.229+0000 7f897959a700 1 -- 172.21.15.3:0/3912297309 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8964009e70 con 0x7f897c0a31c0 2023-10-08T15:38:00.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.229+0000 7f897959a700 1 -- 172.21.15.3:0/3912297309 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f896400b860 con 0x7f897c0a31c0 2023-10-08T15:38:00.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.229+0000 7f897959a700 1 -- 172.21.15.3:0/3912297309 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896400bc00 con 0x7f897c0a31c0 2023-10-08T15:38:00.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.229+0000 7f8980e1c700 1 -- 172.21.15.3:0/3912297309 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f897c0a31c0 msgr2=0x7f897c0670e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:00.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.229+0000 7f8980e1c700 1 --2- 172.21.15.3:0/3912297309 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f897c0a31c0 0x7f897c0670e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f897c067ae0 tx=0x7f8964009250 comp rx=0 tx=0).stop 2023-10-08T15:38:00.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.229+0000 7f8980e1c700 1 -- 172.21.15.3:0/3912297309 shutdown_connections 2023-10-08T15:38:00.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.229+0000 7f8980e1c700 1 --2- 172.21.15.3:0/3912297309 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f897c067620 0x7f897c1498f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:00.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.229+0000 7f8980e1c700 1 --2- 172.21.15.3:0/3912297309 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f897c0a31c0 0x7f897c0670e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:00.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.229+0000 7f8980e1c700 1 --2- 172.21.15.3:0/3912297309 >> v2:172.21.15.50:3300/0 conn(0x7f897c148c00 0x7f897c148fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:00.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.229+0000 7f8980e1c700 1 -- 172.21.15.3:0/3912297309 >> 172.21.15.3:0/3912297309 conn(0x7f897c06e0d0 msgr2=0x7f897c06e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:00.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.229+0000 7f8980e1c700 1 -- 172.21.15.3:0/3912297309 shutdown_connections 2023-10-08T15:38:00.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.229+0000 7f8980e1c700 1 -- 172.21.15.3:0/3912297309 wait complete. 2023-10-08T15:38:00.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.229+0000 7f8980e1c700 1 Processor -- start 2023-10-08T15:38:00.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.229+0000 7f8980e1c700 1 -- start start 2023-10-08T15:38:00.239 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.233+0000 7f8980e1c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f897c067620 0x7f897c0b5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:00.239 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.233+0000 7f8980e1c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f897c0a31c0 0x7f897c14b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:00.239 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.233+0000 7f8980e1c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f897c148c00 0x7f897c14ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:00.239 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.233+0000 7f8980e1c700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f897c1478d0 con 0x7f897c148c00 2023-10-08T15:38:00.239 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.233+0000 7f8980e1c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f897c147fd0 con 0x7f897c067620 2023-10-08T15:38:00.239 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.233+0000 7f8980e1c700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f897c0b5990 con 0x7f897c0a31c0 2023-10-08T15:38:00.239 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.233+0000 7f897ad9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f897c148c00 0x7f897c14ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:00.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.233+0000 7f897ad9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f897c148c00 0x7f897c14ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57320/0 (socket says 172.21.15.3:57320) 2023-10-08T15:38:00.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.233+0000 7f897ad9d700 1 -- 172.21.15.3:0/3549129174 learned_addr learned my addr 172.21.15.3:0/3549129174 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:38:00.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.233+0000 7f897a59c700 1 --2- 172.21.15.3:0/3549129174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f897c067620 0x7f897c0b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:00.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.233+0000 7f8979d9b700 1 --2- 172.21.15.3:0/3549129174 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f897c0a31c0 0x7f897c14b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:00.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.233+0000 7f897ad9d700 1 -- 172.21.15.3:0/3549129174 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f897c0a31c0 msgr2=0x7f897c14b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:00.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.233+0000 7f897ad9d700 1 --2- 172.21.15.3:0/3549129174 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f897c0a31c0 0x7f897c14b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:00.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.233+0000 7f897ad9d700 1 -- 172.21.15.3:0/3549129174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f897c067620 msgr2=0x7f897c0b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:00.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.233+0000 7f897ad9d700 1 --2- 172.21.15.3:0/3549129174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f897c067620 0x7f897c0b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:00.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.233+0000 7f897ad9d700 1 -- 172.21.15.3:0/3549129174 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89640094f0 con 0x7f897c148c00 2023-10-08T15:38:00.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.233+0000 7f8979d9b700 1 --2- 172.21.15.3:0/3549129174 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f897c0a31c0 0x7f897c14b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:38:00.241 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.233+0000 7f897ad9d700 1 --2- 172.21.15.3:0/3549129174 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f897c148c00 0x7f897c14ba60 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f897400ea50 tx=0x7f89740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:00.241 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.233+0000 7f89727fc700 1 -- 172.21.15.3:0/3549129174 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897400c850 con 0x7f897c148c00 2023-10-08T15:38:00.241 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.233+0000 7f8980e1c700 1 -- 172.21.15.3:0/3549129174 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f897c0bc560 con 0x7f897c148c00 2023-10-08T15:38:00.241 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.233+0000 7f89727fc700 1 -- 172.21.15.3:0/3549129174 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f897400c9d0 con 0x7f897c148c00 2023-10-08T15:38:00.242 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.233+0000 7f89727fc700 1 -- 172.21.15.3:0/3549129174 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897400cd90 con 0x7f897c148c00 2023-10-08T15:38:00.242 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.233+0000 7f8980e1c700 1 -- 172.21.15.3:0/3549129174 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f897c14c140 con 0x7f897c148c00 2023-10-08T15:38:00.242 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.237+0000 7f8980e1c700 1 -- 172.21.15.3:0/3549129174 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f897c0bc6f0 con 0x7f897c148c00 2023-10-08T15:38:00.242 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.237+0000 7f89727fc700 1 -- 172.21.15.3:0/3549129174 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f8974013680 con 0x7f897c148c00 2023-10-08T15:38:00.243 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.237+0000 7f89727fc700 1 --2- 172.21.15.3:0/3549129174 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f895c060580 0x7f895c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:00.243 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.237+0000 7f89727fc700 1 -- 172.21.15.3:0/3549129174 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f897407caf0 con 0x7f897c148c00 2023-10-08T15:38:00.243 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.237+0000 7f897a59c700 1 --2- 172.21.15.3:0/3549129174 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f895c060580 0x7f895c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:00.243 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.237+0000 7f897a59c700 1 --2- 172.21.15.3:0/3549129174 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f895c060580 0x7f895c062a30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f896c0076a0 tx=0x7f896c009930 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:00.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.245+0000 7f89727fc700 1 -- 172.21.15.3:0/3549129174 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f897404d0e0 con 0x7f897c148c00 2023-10-08T15:38:00.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.441+0000 7f8980e1c700 1 -- 172.21.15.3:0/3549129174 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f897c064530 con 0x7f897c148c00 2023-10-08T15:38:00.449 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.441+0000 7f89727fc700 1 -- 172.21.15.3:0/3549129174 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+3073 (secure 0 0 0) 0x7f8974017c20 con 0x7f897c148c00 2023-10-08T15:38:00.449 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:38:00.449 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6833/519836882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":519836882},{"type":"v1","addr":"172.21.15.3:6833","nonce":519836882}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:37:25.379215+0000","modified":"2023-10-08T15:37:28.041086+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/1601527591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1601527591},{"type":"v1","addr":"172.21.15.50:6835","nonce":1601527591}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-08T15:38:00.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.445+0000 7f8980e1c700 1 -- 172.21.15.3:0/3549129174 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f895c060580 msgr2=0x7f895c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:00.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.445+0000 7f8980e1c700 1 --2- 172.21.15.3:0/3549129174 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f895c060580 0x7f895c062a30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f896c0076a0 tx=0x7f896c009930 comp rx=0 tx=0).stop 2023-10-08T15:38:00.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.445+0000 7f8980e1c700 1 -- 172.21.15.3:0/3549129174 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f897c148c00 msgr2=0x7f897c14ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:00.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.445+0000 7f8980e1c700 1 --2- 172.21.15.3:0/3549129174 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f897c148c00 0x7f897c14ba60 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f897400ea50 tx=0x7f89740091a0 comp rx=0 tx=0).stop 2023-10-08T15:38:00.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.445+0000 7f8980e1c700 1 -- 172.21.15.3:0/3549129174 shutdown_connections 2023-10-08T15:38:00.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.445+0000 7f8980e1c700 1 --2- 172.21.15.3:0/3549129174 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f895c060580 0x7f895c062a30 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:00.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.445+0000 7f8980e1c700 1 --2- 172.21.15.3:0/3549129174 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f897c148c00 0x7f897c14ba60 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:00.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.445+0000 7f8980e1c700 1 --2- 172.21.15.3:0/3549129174 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f897c0a31c0 0x7f897c14b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:00.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.445+0000 7f8980e1c700 1 --2- 172.21.15.3:0/3549129174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f897c067620 0x7f897c0b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:00.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.445+0000 7f8980e1c700 1 -- 172.21.15.3:0/3549129174 >> 172.21.15.3:0/3549129174 conn(0x7f897c06e0d0 msgr2=0x7f897c14a040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:00.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.445+0000 7f8980e1c700 1 -- 172.21.15.3:0/3549129174 shutdown_connections 2023-10-08T15:38:00.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.445+0000 7f8980e1c700 1 -- 172.21.15.3:0/3549129174 wait complete. 2023-10-08T15:38:00.453 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 6 2023-10-08T15:38:00.463 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:38:00.569 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.565+0000 7f66e5dde700 1 Processor -- start 2023-10-08T15:38:00.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.565+0000 7f66e5dde700 1 -- start start 2023-10-08T15:38:00.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.565+0000 7f66e5dde700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f66e006d080 0x7f66e0068ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:00.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.565+0000 7f66e5dde700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66e009e490 con 0x7f66e0153ad0 2023-10-08T15:38:00.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.565+0000 7f66e5dde700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66e006ce30 con 0x7f66e00bafe0 2023-10-08T15:38:00.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.565+0000 7f66e5dde700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66e009e6e0 con 0x7f66e006d080 2023-10-08T15:38:00.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.565+0000 7f66dffff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f66e0153ad0 0x7f66e014ef20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:54488/0 (socket says 172.21.15.3:54488) 2023-10-08T15:38:00.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.565+0000 7f66dffff700 1 -- 172.21.15.3:0/944218465 learned_addr learned my addr 172.21.15.3:0/944218465 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:38:00.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.565+0000 7f66d6ffd700 1 --2- 172.21.15.3:0/944218465 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f66e006d080 0x7f66e0068ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:00.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.565+0000 7f66deffd700 1 -- 172.21.15.3:0/944218465 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1417315727 0 0) 0x7f66e009e490 con 0x7f66e0153ad0 2023-10-08T15:38:00.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.565+0000 7f66deffd700 1 -- 172.21.15.3:0/944218465 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66cc003570 con 0x7f66e0153ad0 2023-10-08T15:38:00.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.565+0000 7f66d6ffd700 1 -- 172.21.15.3:0/944218465 >> v1:172.21.15.50:6789/0 conn(0x7f66e00bafe0 legacy=0x7f66e01533c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:00.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.565+0000 7f66d6ffd700 1 -- 172.21.15.3:0/944218465 >> v1:172.21.15.3:6789/0 conn(0x7f66e0153ad0 legacy=0x7f66e014ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:00.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.565+0000 7f66deffd700 1 -- 172.21.15.3:0/944218465 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3483808305 0 0) 0x7f66cc003570 con 0x7f66e0153ad0 2023-10-08T15:38:00.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.565+0000 7f66d6ffd700 1 -- 172.21.15.3:0/944218465 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e0153f70 con 0x7f66e006d080 2023-10-08T15:38:00.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.565+0000 7f66d6ffd700 1 --2- 172.21.15.3:0/944218465 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f66e006d080 0x7f66e0068ab0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f66c8009910 tx=0x7f66c80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d65e7bc450be8cd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:00.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.565+0000 7f66deffd700 1 -- 172.21.15.3:0/944218465 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d80017f0 con 0x7f66e006d080 2023-10-08T15:38:00.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.565+0000 7f66deffd700 1 -- 172.21.15.3:0/944218465 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66c8011420 con 0x7f66e006d080 2023-10-08T15:38:00.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.565+0000 7f66deffd700 1 -- 172.21.15.3:0/944218465 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c80117a0 con 0x7f66e006d080 2023-10-08T15:38:00.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.565+0000 7f66e5dde700 1 -- 172.21.15.3:0/944218465 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f66e006d080 msgr2=0x7f66e0068ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:00.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.565+0000 7f66e5dde700 1 --2- 172.21.15.3:0/944218465 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f66e006d080 0x7f66e0068ab0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f66c8009910 tx=0x7f66c80091a0 comp rx=0 tx=0).stop 2023-10-08T15:38:00.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.565+0000 7f66e5dde700 1 -- 172.21.15.3:0/944218465 shutdown_connections 2023-10-08T15:38:00.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.565+0000 7f66e5dde700 1 --2- 172.21.15.3:0/944218465 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f66e006d080 0x7f66e0068ab0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:00.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.565+0000 7f66e5dde700 1 -- 172.21.15.3:0/944218465 >> 172.21.15.3:0/944218465 conn(0x7f66e00be640 msgr2=0x7f66e00ba6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:00.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.565+0000 7f66e5dde700 1 -- 172.21.15.3:0/944218465 shutdown_connections 2023-10-08T15:38:00.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.565+0000 7f66e5dde700 1 -- 172.21.15.3:0/944218465 wait complete. 2023-10-08T15:38:00.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.569+0000 7f66e5dde700 1 Processor -- start 2023-10-08T15:38:00.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.569+0000 7f66e5dde700 1 -- start start 2023-10-08T15:38:00.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.569+0000 7f66e5dde700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66e006d080 0x7f66e0147850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:00.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.569+0000 7f66e5dde700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f66e00bafe0 0x7f66e00a2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:00.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.569+0000 7f66e5dde700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f66e0153ad0 0x7f66e0162980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:00.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.569+0000 7f66e5dde700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e00bc560 con 0x7f66e0153ad0 2023-10-08T15:38:00.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.569+0000 7f66e5dde700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e00bcae0 con 0x7f66e006d080 2023-10-08T15:38:00.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.569+0000 7f66e5dde700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66e01607a0 con 0x7f66e00bafe0 2023-10-08T15:38:00.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.569+0000 7f66dffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f66e0153ad0 0x7f66e0162980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:00.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.569+0000 7f66dffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f66e0153ad0 0x7f66e0162980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57334/0 (socket says 172.21.15.3:57334) 2023-10-08T15:38:00.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.569+0000 7f66d6ffd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f66e00bafe0 0x7f66e00a2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:00.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.569+0000 7f66dffff700 1 -- 172.21.15.3:0/2008311197 learned_addr learned my addr 172.21.15.3:0/2008311197 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:38:00.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.569+0000 7f66df7fe700 1 --2- 172.21.15.3:0/2008311197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66e006d080 0x7f66e0147850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:00.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.569+0000 7f66dffff700 1 -- 172.21.15.3:0/2008311197 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f66e00bafe0 msgr2=0x7f66e00a2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:00.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.569+0000 7f66dffff700 1 --2- 172.21.15.3:0/2008311197 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f66e00bafe0 0x7f66e00a2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:00.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.569+0000 7f66dffff700 1 -- 172.21.15.3:0/2008311197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66e006d080 msgr2=0x7f66e0147850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:00.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.569+0000 7f66dffff700 1 --2- 172.21.15.3:0/2008311197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66e006d080 0x7f66e0147850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:00.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.569+0000 7f66dffff700 1 -- 172.21.15.3:0/2008311197 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c8009420 con 0x7f66e0153ad0 2023-10-08T15:38:00.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.569+0000 7f66dffff700 1 --2- 172.21.15.3:0/2008311197 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f66e0153ad0 0x7f66e0162980 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f66d800cbc0 tx=0x7f66d80015b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:00.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.569+0000 7f66d7fff700 1 -- 172.21.15.3:0/2008311197 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d8004dc0 con 0x7f66e0153ad0 2023-10-08T15:38:00.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.569+0000 7f66d7fff700 1 -- 172.21.15.3:0/2008311197 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d800a590 con 0x7f66e0153ad0 2023-10-08T15:38:00.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.569+0000 7f66e5dde700 1 -- 172.21.15.3:0/2008311197 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66e00bc770 con 0x7f66e0153ad0 2023-10-08T15:38:00.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.569+0000 7f66d7fff700 1 -- 172.21.15.3:0/2008311197 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d800a950 con 0x7f66e0153ad0 2023-10-08T15:38:00.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.569+0000 7f66e5dde700 1 -- 172.21.15.3:0/2008311197 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66e00bd7f0 con 0x7f66e0153ad0 2023-10-08T15:38:00.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.573+0000 7f66e5dde700 1 -- 172.21.15.3:0/2008311197 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66e0064530 con 0x7f66e0153ad0 2023-10-08T15:38:00.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.573+0000 7f66d7fff700 1 -- 172.21.15.3:0/2008311197 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f66d800ad00 con 0x7f66e0153ad0 2023-10-08T15:38:00.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.573+0000 7f66d7fff700 1 --2- 172.21.15.3:0/2008311197 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f66c0060550 0x7f66c0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:00.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.573+0000 7f66d7fff700 1 -- 172.21.15.3:0/2008311197 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f66d807c110 con 0x7f66e0153ad0 2023-10-08T15:38:00.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.573+0000 7f66df7fe700 1 --2- 172.21.15.3:0/2008311197 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f66c0060550 0x7f66c0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:00.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.577+0000 7f66df7fe700 1 --2- 172.21.15.3:0/2008311197 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f66c0060550 0x7f66c0062a00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f66d0007fd0 tx=0x7f66d0007eb0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:00.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.581+0000 7f66d7fff700 1 -- 172.21.15.3:0/2008311197 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f66d804c6e0 con 0x7f66e0153ad0 2023-10-08T15:38:00.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.781+0000 7f66e5dde700 1 -- 172.21.15.3:0/2008311197 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f66e009ea50 con 0x7f66e0153ad0 2023-10-08T15:38:00.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.781+0000 7f66d7fff700 1 -- 172.21.15.3:0/2008311197 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+3073 (secure 0 0 0) 0x7f66d8018c20 con 0x7f66e0153ad0 2023-10-08T15:38:00.789 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:38:00.789 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6833/519836882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":519836882},{"type":"v1","addr":"172.21.15.3:6833","nonce":519836882}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:37:25.379215+0000","modified":"2023-10-08T15:37:28.041086+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/1601527591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1601527591},{"type":"v1","addr":"172.21.15.50:6835","nonce":1601527591}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-08T15:38:00.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.785+0000 7f66e5dde700 1 -- 172.21.15.3:0/2008311197 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f66c0060550 msgr2=0x7f66c0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:00.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.785+0000 7f66e5dde700 1 --2- 172.21.15.3:0/2008311197 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f66c0060550 0x7f66c0062a00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f66d0007fd0 tx=0x7f66d0007eb0 comp rx=0 tx=0).stop 2023-10-08T15:38:00.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.785+0000 7f66e5dde700 1 -- 172.21.15.3:0/2008311197 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f66e0153ad0 msgr2=0x7f66e0162980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:00.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.785+0000 7f66e5dde700 1 --2- 172.21.15.3:0/2008311197 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f66e0153ad0 0x7f66e0162980 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f66d800cbc0 tx=0x7f66d80015b0 comp rx=0 tx=0).stop 2023-10-08T15:38:00.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.785+0000 7f66e5dde700 1 -- 172.21.15.3:0/2008311197 shutdown_connections 2023-10-08T15:38:00.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.785+0000 7f66e5dde700 1 --2- 172.21.15.3:0/2008311197 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f66c0060550 0x7f66c0062a00 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:00.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.785+0000 7f66e5dde700 1 --2- 172.21.15.3:0/2008311197 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f66e0153ad0 0x7f66e0162980 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:00.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.785+0000 7f66e5dde700 1 --2- 172.21.15.3:0/2008311197 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f66e00bafe0 0x7f66e00a2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:00.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.785+0000 7f66e5dde700 1 --2- 172.21.15.3:0/2008311197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66e006d080 0x7f66e0147850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:00.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.785+0000 7f66e5dde700 1 -- 172.21.15.3:0/2008311197 >> 172.21.15.3:0/2008311197 conn(0x7f66e00be640 msgr2=0x7f66e0149960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:00.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.785+0000 7f66e5dde700 1 -- 172.21.15.3:0/2008311197 shutdown_connections 2023-10-08T15:38:00.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.785+0000 7f66e5dde700 1 -- 172.21.15.3:0/2008311197 wait complete. 2023-10-08T15:38:00.792 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 6 2023-10-08T15:38:00.803 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:38:00.906 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.901+0000 7f7f28c59700 1 Processor -- start 2023-10-08T15:38:00.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.901+0000 7f7f28c59700 1 -- start start 2023-10-08T15:38:00.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.901+0000 7f7f28c59700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f7f240a15e0 0x7f7f2414b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:00.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.901+0000 7f7f28c59700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7f24146b70 0x7f7f24146fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:00.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.901+0000 7f7f28c59700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f24147970 con 0x7f7f24147510 2023-10-08T15:38:00.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.901+0000 7f7f28c59700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f2406de00 con 0x7f7f240a15e0 2023-10-08T15:38:00.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.901+0000 7f7f28c59700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f24070ab0 con 0x7f7f24146b70 2023-10-08T15:38:00.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.901+0000 7f7f237fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f7f240a15e0 0x7f7f2414b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:00.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.901+0000 7f7f237fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f7f240a15e0 0x7f7f2414b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57338/0 (socket says 172.21.15.3:57338) 2023-10-08T15:38:00.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.901+0000 7f7f237fe700 1 -- 172.21.15.3:0/4144617324 learned_addr learned my addr 172.21.15.3:0/4144617324 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:38:00.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.901+0000 7f7f22ffd700 1 --2- 172.21.15.3:0/4144617324 >> v2:172.21.15.50:3300/0 conn(0x7f7f24146b70 0x7f7f24146fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:00.910 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.901+0000 7f7f237fe700 1 -- 172.21.15.3:0/4144617324 >> v2:172.21.15.50:3300/0 conn(0x7f7f24146b70 msgr2=0x7f7f24146fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:38:00.910 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.901+0000 7f7f237fe700 1 --2- 172.21.15.3:0/4144617324 >> v2:172.21.15.50:3300/0 conn(0x7f7f24146b70 0x7f7f24146fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:00.910 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.901+0000 7f7f237fe700 1 -- 172.21.15.3:0/4144617324 >> v1:172.21.15.50:6789/0 conn(0x7f7f24147510 legacy=0x7f7f240703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:00.910 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.901+0000 7f7f237fe700 1 -- 172.21.15.3:0/4144617324 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f2414bd90 con 0x7f7f240a15e0 2023-10-08T15:38:00.910 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.901+0000 7f7f22ffd700 1 --2- 172.21.15.3:0/4144617324 >> v2:172.21.15.50:3300/0 conn(0x7f7f24146b70 0x7f7f24146fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:38:00.910 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.901+0000 7f7f237fe700 1 --2- 172.21.15.3:0/4144617324 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7f240a15e0 0x7f7f2414b850 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7f24067f90 tx=0x7f7f14009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff04778a807a4541 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:00.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.905+0000 7f7f227fc700 1 -- 172.21.15.3:0/4144617324 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1400e070 con 0x7f7f240a15e0 2023-10-08T15:38:00.912 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.905+0000 7f7f227fc700 1 -- 172.21.15.3:0/4144617324 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f1400ba40 con 0x7f7f240a15e0 2023-10-08T15:38:00.912 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.905+0000 7f7f227fc700 1 -- 172.21.15.3:0/4144617324 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f140092e0 con 0x7f7f240a15e0 2023-10-08T15:38:00.912 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.905+0000 7f7f28c59700 1 -- 172.21.15.3:0/4144617324 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7f240a15e0 msgr2=0x7f7f2414b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:00.912 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.905+0000 7f7f28c59700 1 --2- 172.21.15.3:0/4144617324 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7f240a15e0 0x7f7f2414b850 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7f24067f90 tx=0x7f7f14009840 comp rx=0 tx=0).stop 2023-10-08T15:38:00.912 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.905+0000 7f7f28c59700 1 -- 172.21.15.3:0/4144617324 shutdown_connections 2023-10-08T15:38:00.912 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.905+0000 7f7f28c59700 1 --2- 172.21.15.3:0/4144617324 >> v2:172.21.15.50:3300/0 conn(0x7f7f24146b70 0x7f7f24146fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:00.912 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.905+0000 7f7f28c59700 1 --2- 172.21.15.3:0/4144617324 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7f240a15e0 0x7f7f2414b850 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:00.912 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.905+0000 7f7f28c59700 1 -- 172.21.15.3:0/4144617324 >> 172.21.15.3:0/4144617324 conn(0x7f7f240670e0 msgr2=0x7f7f240674e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:00.912 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.905+0000 7f7f28c59700 1 -- 172.21.15.3:0/4144617324 shutdown_connections 2023-10-08T15:38:00.912 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.905+0000 7f7f28c59700 1 -- 172.21.15.3:0/4144617324 wait complete. 2023-10-08T15:38:00.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.905+0000 7f7f28c59700 1 Processor -- start 2023-10-08T15:38:00.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.905+0000 7f7f28c59700 1 -- start start 2023-10-08T15:38:00.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.905+0000 7f7f28c59700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7f240a15e0 0x7f7f240b2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:00.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.909+0000 7f7f28c59700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f24146b70 0x7f7f241598c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:00.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.909+0000 7f7f28c59700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7f24147510 0x7f7f2415c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:00.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.909+0000 7f7f28c59700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f240b4d10 con 0x7f7f240a15e0 2023-10-08T15:38:00.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.909+0000 7f7f28c59700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f240b3db0 con 0x7f7f24146b70 2023-10-08T15:38:00.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.909+0000 7f7f28c59700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2415d320 con 0x7f7f24147510 2023-10-08T15:38:00.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.909+0000 7f7f237fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7f240a15e0 0x7f7f240b2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:00.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.909+0000 7f7f237fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7f240a15e0 0x7f7f240b2010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57344/0 (socket says 172.21.15.3:57344) 2023-10-08T15:38:00.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.909+0000 7f7f237fe700 1 -- 172.21.15.3:0/1412660399 learned_addr learned my addr 172.21.15.3:0/1412660399 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:38:00.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.909+0000 7f7f22ffd700 1 --2- 172.21.15.3:0/1412660399 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f24146b70 0x7f7f241598c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:00.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.909+0000 7f7f23fff700 1 --2- 172.21.15.3:0/1412660399 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7f24147510 0x7f7f2415c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:00.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.909+0000 7f7f237fe700 1 -- 172.21.15.3:0/1412660399 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7f24147510 msgr2=0x7f7f2415c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:00.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.909+0000 7f7f237fe700 1 --2- 172.21.15.3:0/1412660399 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7f24147510 0x7f7f2415c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:00.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.909+0000 7f7f237fe700 1 -- 172.21.15.3:0/1412660399 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f24146b70 msgr2=0x7f7f241598c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:00.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.909+0000 7f7f237fe700 1 --2- 172.21.15.3:0/1412660399 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f24146b70 0x7f7f241598c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:00.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.909+0000 7f7f237fe700 1 -- 172.21.15.3:0/1412660399 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f14009ae0 con 0x7f7f240a15e0 2023-10-08T15:38:00.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.909+0000 7f7f23fff700 1 --2- 172.21.15.3:0/1412660399 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7f24147510 0x7f7f2415c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:38:00.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.909+0000 7f7f237fe700 1 --2- 172.21.15.3:0/1412660399 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7f240a15e0 0x7f7f240b2010 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7f14012000 tx=0x7f7f14018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:00.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.909+0000 7f7f0b7fe700 1 -- 172.21.15.3:0/1412660399 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f140089b0 con 0x7f7f240a15e0 2023-10-08T15:38:00.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.909+0000 7f7f0b7fe700 1 -- 172.21.15.3:0/1412660399 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f14008b30 con 0x7f7f240a15e0 2023-10-08T15:38:00.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.909+0000 7f7f28c59700 1 -- 172.21.15.3:0/1412660399 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f240b49a0 con 0x7f7f240a15e0 2023-10-08T15:38:00.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.909+0000 7f7f0b7fe700 1 -- 172.21.15.3:0/1412660399 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f14026460 con 0x7f7f240a15e0 2023-10-08T15:38:00.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.909+0000 7f7f28c59700 1 -- 172.21.15.3:0/1412660399 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f24159e00 con 0x7f7f240a15e0 2023-10-08T15:38:00.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.909+0000 7f7f28c59700 1 -- 172.21.15.3:0/1412660399 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f2415a050 con 0x7f7f240a15e0 2023-10-08T15:38:00.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.909+0000 7f7f0b7fe700 1 -- 172.21.15.3:0/1412660399 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f7f14003040 con 0x7f7f240a15e0 2023-10-08T15:38:00.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.909+0000 7f7f0b7fe700 1 --2- 172.21.15.3:0/1412660399 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7f10060550 0x7f7f10062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:00.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.909+0000 7f7f0b7fe700 1 -- 172.21.15.3:0/1412660399 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7f1407e520 con 0x7f7f240a15e0 2023-10-08T15:38:00.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.913+0000 7f7f22ffd700 1 --2- 172.21.15.3:0/1412660399 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7f10060550 0x7f7f10062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:00.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.913+0000 7f7f22ffd700 1 --2- 172.21.15.3:0/1412660399 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7f10060550 0x7f7f10062a00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7f18006f00 tx=0x7f7f18008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:00.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:00.921+0000 7f7f0b7fe700 1 -- 172.21.15.3:0/1412660399 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7f1404ebc0 con 0x7f7f240a15e0 2023-10-08T15:38:01.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.081+0000 7f7f28c59700 1 -- 172.21.15.3:0/1412660399 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7f2405ecf0 con 0x7f7f240a15e0 2023-10-08T15:38:01.091 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.085+0000 7f7f0b7fe700 1 -- 172.21.15.3:0/1412660399 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15254 (secure 0 0 0) 0x7f7f1407ce60 con 0x7f7f240a15e0 2023-10-08T15:38:01.091 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:38:01.091 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":20,"fsid":"7635972e-cd66-4a8f-a231-378db8b3847a","created":"2023-10-08T15:37:08.234594+0000","modified":"2023-10-08T15:37:27.007828+0000","last_up_change":"2023-10-08T15:37:17.537726+0000","last_in_change":"2023-10-08T15:37:10.269178+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:37:16.581590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:37:23.353518+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T15:37:24.365114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"64fb1864-bfdd-4d75-9b41-03fb60085dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33363},{"type":"v1","addr":"172.21.15.3:6801","nonce":33363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33363},{"type":"v1","addr":"172.21.15.3:6803","nonce":33363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":33363},{"type":"v1","addr":"172.21.15.3:6807","nonce":33363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33363},{"type":"v1","addr":"172.21.15.3:6805","nonce":33363}]},"public_addr":"172.21.15.3:6801/33363","cluster_addr":"172.21.15.3:6803/33363","heartbeat_back_addr":"172.21.15.3:6807/33363","heartbeat_front_addr":"172.21.15.3:6805/33363","state":["exists","up"]},{"osd":1,"uuid":"3ca6bd3a-3e8a-4c65-af9c-46148b0c2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33364},{"type":"v1","addr":"172.21.15.3:6820","nonce":33364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33364},{"type":"v1","addr":"172.21.15.3:6824","nonce":33364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33364},{"type":"v1","addr":"172.21.15.3:6831","nonce":33364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33364},{"type":"v1","addr":"172.21.15.3:6828","nonce":33364}]},"public_addr":"172.21.15.3:6820/33364","cluster_addr":"172.21.15.3:6824/33364","heartbeat_back_addr":"172.21.15.3:6831/33364","heartbeat_front_addr":"172.21.15.3:6828/33364","state":["exists","up"]},{"osd":2,"uuid":"6eb9f757-58dd-442f-910d-32401454bce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33366},{"type":"v1","addr":"172.21.15.3:6817","nonce":33366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":33366},{"type":"v1","addr":"172.21.15.3:6821","nonce":33366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6827","nonce":33366},{"type":"v1","addr":"172.21.15.3:6829","nonce":33366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":33366},{"type":"v1","addr":"172.21.15.3:6825","nonce":33366}]},"public_addr":"172.21.15.3:6817/33366","cluster_addr":"172.21.15.3:6821/33366","heartbeat_back_addr":"172.21.15.3:6829/33366","heartbeat_front_addr":"172.21.15.3:6825/33366","state":["exists","up"]},{"osd":3,"uuid":"1c39866b-ac2e-4ea9-a69c-02b01ee4191d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33365},{"type":"v1","addr":"172.21.15.3:6809","nonce":33365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":33365},{"type":"v1","addr":"172.21.15.3:6811","nonce":33365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33365},{"type":"v1","addr":"172.21.15.3:6815","nonce":33365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":33365},{"type":"v1","addr":"172.21.15.3:6813","nonce":33365}]},"public_addr":"172.21.15.3:6809/33365","cluster_addr":"172.21.15.3:6811/33365","heartbeat_back_addr":"172.21.15.3:6815/33365","heartbeat_front_addr":"172.21.15.3:6813/33365","state":["exists","up"]},{"osd":4,"uuid":"15f86b61-b7f1-4780-ae00-9d80a68cb830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":33605},{"type":"v1","addr":"172.21.15.50:6809","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33605},{"type":"v1","addr":"172.21.15.50:6811","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33605},{"type":"v1","addr":"172.21.15.50:6815","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":33605},{"type":"v1","addr":"172.21.15.50:6813","nonce":33605}]},"public_addr":"172.21.15.50:6809/33605","cluster_addr":"172.21.15.50:6811/33605","heartbeat_back_addr":"172.21.15.50:6815/33605","heartbeat_front_addr":"172.21.15.50:6813/33605","state":["exists","up"]},{"osd":5,"uuid":"726c3003-34e6-4d5a-b6e2-f911e13c2118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33606},{"type":"v1","addr":"172.21.15.50:6801","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33606},{"type":"v1","addr":"172.21.15.50:6803","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33606},{"type":"v1","addr":"172.21.15.50:6807","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":33606},{"type":"v1","addr":"172.21.15.50:6805","nonce":33606}]},"public_addr":"172.21.15.50:6801/33606","cluster_addr":"172.21.15.50:6803/33606","heartbeat_back_addr":"172.21.15.50:6807/33606","heartbeat_front_addr":"172.21.15.50:6805/33606","state":["exists","up"]},{"osd":6,"uuid":"401122a4-9988-441f-a5a7-39164434ebcd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":33607},{"type":"v1","addr":"172.21.15.50:6819","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":33607},{"type":"v1","addr":"172.21.15.50:6823","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":33607},{"type":"v1","addr":"172.21.15.50:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":33607},{"type":"v1","addr":"172.21.15.50:6827","nonce":33607}]},"public_addr":"172.21.15.50:6819/33607","cluster_addr":"172.21.15.50:6823/33607","heartbeat_back_addr":"172.21.15.50:6831/33607","heartbeat_front_addr":"172.21.15.50:6827/33607","state":["exists","up"]},{"osd":7,"uuid":"6b3fa236-c9d0-4c4d-82ae-9af4daf6d699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33604},{"type":"v1","addr":"172.21.15.50:6818","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":33604},{"type":"v1","addr":"172.21.15.50:6822","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":33604},{"type":"v1","addr":"172.21.15.50:6830","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":33604},{"type":"v1","addr":"172.21.15.50:6826","nonce":33604}]},"public_addr":"172.21.15.50:6818/33604","cluster_addr":"172.21.15.50:6822/33604","heartbeat_back_addr":"172.21.15.50:6830/33604","heartbeat_front_addr":"172.21.15.50:6826/33604","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.497794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.529417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.873426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.325972+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.443971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.240795+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.739632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.643026+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:38:01.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.085+0000 7f7f28c59700 1 -- 172.21.15.3:0/1412660399 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7f10060550 msgr2=0x7f7f10062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:01.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.085+0000 7f7f28c59700 1 --2- 172.21.15.3:0/1412660399 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7f10060550 0x7f7f10062a00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7f18006f00 tx=0x7f7f18008040 comp rx=0 tx=0).stop 2023-10-08T15:38:01.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.085+0000 7f7f28c59700 1 -- 172.21.15.3:0/1412660399 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7f240a15e0 msgr2=0x7f7f240b2010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:01.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.085+0000 7f7f28c59700 1 --2- 172.21.15.3:0/1412660399 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7f240a15e0 0x7f7f240b2010 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7f14012000 tx=0x7f7f14018000 comp rx=0 tx=0).stop 2023-10-08T15:38:01.094 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.085+0000 7f7f28c59700 1 -- 172.21.15.3:0/1412660399 shutdown_connections 2023-10-08T15:38:01.094 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.085+0000 7f7f28c59700 1 --2- 172.21.15.3:0/1412660399 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7f10060550 0x7f7f10062a00 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:01.094 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.085+0000 7f7f28c59700 1 --2- 172.21.15.3:0/1412660399 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7f24147510 0x7f7f2415c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:01.094 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.085+0000 7f7f28c59700 1 --2- 172.21.15.3:0/1412660399 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f24146b70 0x7f7f241598c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:01.094 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.085+0000 7f7f28c59700 1 --2- 172.21.15.3:0/1412660399 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7f240a15e0 0x7f7f240b2010 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:01.094 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.089+0000 7f7f28c59700 1 -- 172.21.15.3:0/1412660399 >> 172.21.15.3:0/1412660399 conn(0x7f7f240670e0 msgr2=0x7f7f240674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:01.094 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.089+0000 7f7f28c59700 1 -- 172.21.15.3:0/1412660399 shutdown_connections 2023-10-08T15:38:01.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.089+0000 7f7f28c59700 1 -- 172.21.15.3:0/1412660399 wait complete. 2023-10-08T15:38:01.106 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-08T15:38:01.219 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.213+0000 7f369f56b700 1 Processor -- start 2023-10-08T15:38:01.219 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.213+0000 7f369f56b700 1 -- start start 2023-10-08T15:38:01.220 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.213+0000 7f369f56b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f369814d330 0x7f36980baf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:01.220 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.213+0000 7f369f56b700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f369814d820 con 0x7f36980a2460 2023-10-08T15:38:01.220 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.213+0000 7f369f56b700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3698149910 con 0x7f36980bab30 2023-10-08T15:38:01.220 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.213+0000 7f369f56b700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f369814a4b0 con 0x7f369814d330 2023-10-08T15:38:01.220 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.213+0000 7f369ed6a700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f36980a2460 0x7f3698149da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:54498/0 (socket says 172.21.15.3:54498) 2023-10-08T15:38:01.220 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.213+0000 7f369ed6a700 1 -- 172.21.15.3:0/538823569 learned_addr learned my addr 172.21.15.3:0/538823569 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:38:01.220 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.213+0000 7f369dd68700 1 --2- 172.21.15.3:0/538823569 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f369814d330 0x7f36980baf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:01.220 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.213+0000 7f369d567700 1 -- 172.21.15.3:0/538823569 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1301619670 0 0) 0x7f369814d820 con 0x7f36980a2460 2023-10-08T15:38:01.221 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.213+0000 7f369d567700 1 -- 172.21.15.3:0/538823569 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3684003570 con 0x7f36980a2460 2023-10-08T15:38:01.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.213+0000 7f369d567700 1 -- 172.21.15.3:0/538823569 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 21052895 0 0) 0x7f3684003570 con 0x7f36980a2460 2023-10-08T15:38:01.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.213+0000 7f369d567700 1 -- 172.21.15.3:0/538823569 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f369814d330 msgr2=0x7f36980baf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:38:01.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.213+0000 7f369d567700 1 --2- 172.21.15.3:0/538823569 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f369814d330 0x7f36980baf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:01.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.213+0000 7f369d567700 1 -- 172.21.15.3:0/538823569 >> v1:172.21.15.50:6789/0 conn(0x7f36980bab30 legacy=0x7f36980a0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:01.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.213+0000 7f369d567700 1 -- 172.21.15.3:0/538823569 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36981495a0 con 0x7f36980a2460 2023-10-08T15:38:01.224 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.213+0000 7f369d567700 1 -- 172.21.15.3:0/538823569 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2285686191 0 0) 0x7f3690001470 con 0x7f36980a2460 2023-10-08T15:38:01.224 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.213+0000 7f369dd68700 1 --2- 172.21.15.3:0/538823569 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f369814d330 0x7f36980baf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:38:01.224 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.213+0000 7f369d567700 1 -- 172.21.15.3:0/538823569 >> v1:172.21.15.3:6789/0 conn(0x7f36980a2460 legacy=0x7f3698149da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:01.224 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.213+0000 7f369d567700 1 --2- 172.21.15.3:0/538823569 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3684003a90 0x7f3684003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:01.224 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.213+0000 7f369d567700 1 --2- 172.21.15.3:0/538823569 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f369814d330 0x7f3684004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:01.224 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.213+0000 7f369d567700 1 --2- 172.21.15.3:0/538823569 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3684004d50 0x7f36840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:01.224 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.213+0000 7f369d567700 1 -- 172.21.15.3:0/538823569 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f369814a4b0 con 0x7f3684004d50 2023-10-08T15:38:01.224 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.213+0000 7f369d567700 1 -- 172.21.15.3:0/538823569 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f368400bb10 con 0x7f3684003a90 2023-10-08T15:38:01.224 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.213+0000 7f369d567700 1 -- 172.21.15.3:0/538823569 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f368400bc80 con 0x7f369814d330 2023-10-08T15:38:01.224 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.213+0000 7f369ed6a700 1 --2- 172.21.15.3:0/538823569 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3684004d50 0x7f36840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:01.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.213+0000 7f369dd68700 1 --2- 172.21.15.3:0/538823569 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f369814d330 0x7f3684004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:01.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.213+0000 7f369e569700 1 --2- 172.21.15.3:0/538823569 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3684003a90 0x7f3684003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:01.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.217+0000 7f369ed6a700 1 -- 172.21.15.3:0/538823569 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f369814d330 msgr2=0x7f3684004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:38:01.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.217+0000 7f369ed6a700 1 --2- 172.21.15.3:0/538823569 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f369814d330 0x7f3684004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:01.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.217+0000 7f369ed6a700 1 -- 172.21.15.3:0/538823569 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3684003a90 msgr2=0x7f3684003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:38:01.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.217+0000 7f369ed6a700 1 --2- 172.21.15.3:0/538823569 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3684003a90 0x7f3684003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:01.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.217+0000 7f369ed6a700 1 -- 172.21.15.3:0/538823569 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3694009a20 con 0x7f3684004d50 2023-10-08T15:38:01.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.217+0000 7f369ed6a700 1 --2- 172.21.15.3:0/538823569 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3684004d50 0x7f36840051c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f369000c3c0 tx=0x7f3690001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f55c441a2388cb54 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:01.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.217+0000 7f369d567700 1 -- 172.21.15.3:0/538823569 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369000cc90 con 0x7f3684004d50 2023-10-08T15:38:01.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.217+0000 7f369d567700 1 -- 172.21.15.3:0/538823569 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f369000ce10 con 0x7f3684004d50 2023-10-08T15:38:01.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.217+0000 7f369d567700 1 -- 172.21.15.3:0/538823569 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3690005b70 con 0x7f3684004d50 2023-10-08T15:38:01.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.217+0000 7f369f56b700 1 -- 172.21.15.3:0/538823569 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3684004d50 msgr2=0x7f36840051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:01.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.217+0000 7f369f56b700 1 --2- 172.21.15.3:0/538823569 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3684004d50 0x7f36840051c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f369000c3c0 tx=0x7f3690001e70 comp rx=0 tx=0).stop 2023-10-08T15:38:01.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.217+0000 7f369ed6a700 1 -- 172.21.15.3:0/538823569 reap_dead start 2023-10-08T15:38:01.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.217+0000 7f369f56b700 1 -- 172.21.15.3:0/538823569 shutdown_connections 2023-10-08T15:38:01.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.217+0000 7f369f56b700 1 -- 172.21.15.3:0/538823569 >> 172.21.15.3:0/538823569 conn(0x7f36980be440 msgr2=0x7f36980ba420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:01.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.217+0000 7f369f56b700 1 -- 172.21.15.3:0/538823569 shutdown_connections 2023-10-08T15:38:01.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.217+0000 7f369f56b700 1 -- 172.21.15.3:0/538823569 wait complete. 2023-10-08T15:38:01.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.217+0000 7f369f56b700 1 Processor -- start 2023-10-08T15:38:01.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.217+0000 7f369f56b700 1 -- start start 2023-10-08T15:38:01.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.221+0000 7f369f56b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3684004d50 0x7f36980965f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:01.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.221+0000 7f369f56b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f369814c530 0x7f3698156d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:01.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.221+0000 7f369f56b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3698157270 0x7f3698143a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:01.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.221+0000 7f369f56b700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3698097270 con 0x7f369814c530 2023-10-08T15:38:01.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.221+0000 7f369f56b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f369814c020 con 0x7f3698157270 2023-10-08T15:38:01.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.221+0000 7f369f56b700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3698157a00 con 0x7f3684004d50 2023-10-08T15:38:01.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.221+0000 7f369dd68700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f369814c530 0x7f3698156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:01.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.221+0000 7f369dd68700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f369814c530 0x7f3698156d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57362/0 (socket says 172.21.15.3:57362) 2023-10-08T15:38:01.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.221+0000 7f369dd68700 1 -- 172.21.15.3:0/367832739 learned_addr learned my addr 172.21.15.3:0/367832739 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:38:01.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.221+0000 7f369e569700 1 --2- 172.21.15.3:0/367832739 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3684004d50 0x7f36980965f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:01.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.221+0000 7f369ed6a700 1 --2- 172.21.15.3:0/367832739 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3698157270 0x7f3698143a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:01.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.221+0000 7f369dd68700 1 -- 172.21.15.3:0/367832739 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3684004d50 msgr2=0x7f36980965f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:01.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.221+0000 7f369dd68700 1 --2- 172.21.15.3:0/367832739 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3684004d50 0x7f36980965f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:01.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.221+0000 7f369dd68700 1 -- 172.21.15.3:0/367832739 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3698157270 msgr2=0x7f3698143a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:01.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.221+0000 7f369dd68700 1 --2- 172.21.15.3:0/367832739 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3698157270 0x7f3698143a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:01.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.221+0000 7f369dd68700 1 -- 172.21.15.3:0/367832739 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f369814bcb0 con 0x7f369814c530 2023-10-08T15:38:01.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.221+0000 7f369dd68700 1 --2- 172.21.15.3:0/367832739 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f369814c530 0x7f3698156d30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f36940154f0 tx=0x7f3694012040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:01.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.221+0000 7f368e7fc700 1 -- 172.21.15.3:0/367832739 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369401b480 con 0x7f369814c530 2023-10-08T15:38:01.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.221+0000 7f369f56b700 1 -- 172.21.15.3:0/367832739 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3698096b30 con 0x7f369814c530 2023-10-08T15:38:01.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.221+0000 7f368e7fc700 1 -- 172.21.15.3:0/367832739 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3694016040 con 0x7f369814c530 2023-10-08T15:38:01.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.221+0000 7f368e7fc700 1 -- 172.21.15.3:0/367832739 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369401b810 con 0x7f369814c530 2023-10-08T15:38:01.231 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.221+0000 7f369f56b700 1 -- 172.21.15.3:0/367832739 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f369814ad20 con 0x7f369814c530 2023-10-08T15:38:01.231 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.221+0000 7f369f56b700 1 -- 172.21.15.3:0/367832739 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36980a1570 con 0x7f369814c530 2023-10-08T15:38:01.231 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.225+0000 7f368e7fc700 1 -- 172.21.15.3:0/367832739 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f369401bc00 con 0x7f369814c530 2023-10-08T15:38:01.232 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.225+0000 7f368e7fc700 1 --2- 172.21.15.3:0/367832739 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f367c060580 0x7f367c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:01.232 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.225+0000 7f368e7fc700 1 -- 172.21.15.3:0/367832739 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3694081f20 con 0x7f369814c530 2023-10-08T15:38:01.232 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.225+0000 7f369e569700 1 --2- 172.21.15.3:0/367832739 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f367c060580 0x7f367c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:01.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.225+0000 7f369e569700 1 --2- 172.21.15.3:0/367832739 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f367c060580 0x7f367c062a30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3688000c00 tx=0x7f3688007d10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:01.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.229+0000 7f368e7fc700 1 -- 172.21.15.3:0/367832739 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3694055f00 con 0x7f369814c530 2023-10-08T15:38:01.431 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.425+0000 7f369f56b700 1 -- 172.21.15.3:0/367832739 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f36980a1570 con 0x7f369814c530 2023-10-08T15:38:01.432 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-10-08T15:38:01.425+0000 7fd2c0727700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T15:38:01.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.433+0000 7f368e7fc700 1 -- 172.21.15.3:0/367832739 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) v1 ==== 161+0+0 (secure 0 0 0) 0x7f36980a1570 con 0x7f369814c530 2023-10-08T15:38:01.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.437+0000 7f369f56b700 1 -- 172.21.15.3:0/367832739 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f367c060580 msgr2=0x7f367c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:01.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.437+0000 7f369f56b700 1 --2- 172.21.15.3:0/367832739 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f367c060580 0x7f367c062a30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3688000c00 tx=0x7f3688007d10 comp rx=0 tx=0).stop 2023-10-08T15:38:01.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.437+0000 7f369f56b700 1 -- 172.21.15.3:0/367832739 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f369814c530 msgr2=0x7f3698156d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:01.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.437+0000 7f369f56b700 1 --2- 172.21.15.3:0/367832739 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f369814c530 0x7f3698156d30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f36940154f0 tx=0x7f3694012040 comp rx=0 tx=0).stop 2023-10-08T15:38:01.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.437+0000 7f369f56b700 1 -- 172.21.15.3:0/367832739 shutdown_connections 2023-10-08T15:38:01.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.437+0000 7f369f56b700 1 --2- 172.21.15.3:0/367832739 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f367c060580 0x7f367c062a30 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:01.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.437+0000 7f369f56b700 1 --2- 172.21.15.3:0/367832739 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3698157270 0x7f3698143a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:01.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.437+0000 7f369f56b700 1 --2- 172.21.15.3:0/367832739 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f369814c530 0x7f3698156d30 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:01.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.437+0000 7f369f56b700 1 --2- 172.21.15.3:0/367832739 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3684004d50 0x7f36980965f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:01.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.437+0000 7f369f56b700 1 -- 172.21.15.3:0/367832739 >> 172.21.15.3:0/367832739 conn(0x7f36980be440 msgr2=0x7f3698068300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:01.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.437+0000 7f369f56b700 1 -- 172.21.15.3:0/367832739 shutdown_connections 2023-10-08T15:38:01.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.437+0000 7f369f56b700 1 -- 172.21.15.3:0/367832739 wait complete. 2023-10-08T15:38:01.445 INFO:tasks.ceph.mds.b.smithi050.stderr: -1739> 2023-10-08T15:37:29.736+0000 7f64d1d48700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T15:38:01.445 INFO:teuthology.orchestra.run.smithi003.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-08T15:38:01.456 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-08T15:38:01.482 INFO:tasks.ceph.mds.b.smithi050.stdout:starting mds.b at 2023-10-08T15:38:01.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.593+0000 7f421aac4700 1 Processor -- start 2023-10-08T15:38:01.631 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.593+0000 7f421aac4700 1 -- start start 2023-10-08T15:38:01.636 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.597+0000 7f421aac4700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4214068e50 0x7f42140a1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:01.636 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.597+0000 7f421aac4700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f421409e590 0x7f42140a0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:01.636 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.597+0000 7f421aac4700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f421414bcf0 con 0x7f42140a26f0 2023-10-08T15:38:01.636 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.597+0000 7f421aac4700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42140a0200 con 0x7f421409e590 2023-10-08T15:38:01.637 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.597+0000 7f421aac4700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f421414b980 con 0x7f4214068e50 2023-10-08T15:38:01.637 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.597+0000 7f42192c1700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f421409e590 0x7f42140a0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:01.637 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.597+0000 7f42192c1700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f421409e590 0x7f42140a0a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57370/0 (socket says 172.21.15.3:57370) 2023-10-08T15:38:01.637 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.597+0000 7f42192c1700 1 -- 172.21.15.3:0/2890917452 learned_addr learned my addr 172.21.15.3:0/2890917452 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:38:01.637 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.597+0000 7f4219ac2700 1 --2- 172.21.15.3:0/2890917452 >> v2:172.21.15.50:3300/0 conn(0x7f4214068e50 0x7f42140a1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:01.637 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.597+0000 7f42192c1700 1 -- 172.21.15.3:0/2890917452 >> v2:172.21.15.50:3300/0 conn(0x7f4214068e50 msgr2=0x7f42140a1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:38:01.637 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.597+0000 7f42192c1700 1 --2- 172.21.15.3:0/2890917452 >> v2:172.21.15.50:3300/0 conn(0x7f4214068e50 0x7f42140a1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:01.637 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.597+0000 7f42192c1700 1 -- 172.21.15.3:0/2890917452 >> v1:172.21.15.50:6789/0 conn(0x7f42140a26f0 legacy=0x7f42140a0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:01.637 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.597+0000 7f42192c1700 1 -- 172.21.15.3:0/2890917452 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f421409fe90 con 0x7f421409e590 2023-10-08T15:38:01.637 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.597+0000 7f4219ac2700 1 --2- 172.21.15.3:0/2890917452 >> v2:172.21.15.50:3300/0 conn(0x7f4214068e50 0x7f42140a1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:38:01.637 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.597+0000 7f42192c1700 1 --2- 172.21.15.3:0/2890917452 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f421409e590 0x7f42140a0a30 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f42140699a0 tx=0x7f4210009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c403abe88a2e262 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:01.638 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.597+0000 7f4218ac0700 1 -- 172.21.15.3:0/2890917452 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421000b860 con 0x7f421409e590 2023-10-08T15:38:01.638 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.597+0000 7f4218ac0700 1 -- 172.21.15.3:0/2890917452 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f421000b9c0 con 0x7f421409e590 2023-10-08T15:38:01.638 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.597+0000 7f4218ac0700 1 -- 172.21.15.3:0/2890917452 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421000bd60 con 0x7f421409e590 2023-10-08T15:38:01.638 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.597+0000 7f421aac4700 1 -- 172.21.15.3:0/2890917452 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f421409e590 msgr2=0x7f42140a0a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:01.638 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.597+0000 7f421aac4700 1 --2- 172.21.15.3:0/2890917452 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f421409e590 0x7f42140a0a30 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f42140699a0 tx=0x7f4210009250 comp rx=0 tx=0).stop 2023-10-08T15:38:01.638 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.597+0000 7f421aac4700 1 -- 172.21.15.3:0/2890917452 shutdown_connections 2023-10-08T15:38:01.638 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.597+0000 7f421aac4700 1 --2- 172.21.15.3:0/2890917452 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f421409e590 0x7f42140a0a30 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:01.638 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.597+0000 7f421aac4700 1 --2- 172.21.15.3:0/2890917452 >> v2:172.21.15.50:3300/0 conn(0x7f4214068e50 0x7f42140a1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:01.638 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.597+0000 7f421aac4700 1 -- 172.21.15.3:0/2890917452 >> 172.21.15.3:0/2890917452 conn(0x7f42140bd9c0 msgr2=0x7f42140bdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:01.638 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.597+0000 7f421aac4700 1 -- 172.21.15.3:0/2890917452 shutdown_connections 2023-10-08T15:38:01.638 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.597+0000 7f421aac4700 1 -- 172.21.15.3:0/2890917452 wait complete. 2023-10-08T15:38:01.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.601+0000 7f421aac4700 1 Processor -- start 2023-10-08T15:38:01.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.601+0000 7f421aac4700 1 -- start start 2023-10-08T15:38:01.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.601+0000 7f421aac4700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4214068e50 0x7f421406e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:01.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.601+0000 7f421aac4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f421409e590 0x7f421413bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:01.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.601+0000 7f421aac4700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f42140a26f0 0x7f421413c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:01.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.601+0000 7f421aac4700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42141416d0 con 0x7f4214068e50 2023-10-08T15:38:01.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.601+0000 7f421aac4700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f421413ec70 con 0x7f421409e590 2023-10-08T15:38:01.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.601+0000 7f421aac4700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f421415c890 con 0x7f42140a26f0 2023-10-08T15:38:01.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.601+0000 7f4219ac2700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4214068e50 0x7f421406e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:01.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.601+0000 7f4219ac2700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4214068e50 0x7f421406e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57378/0 (socket says 172.21.15.3:57378) 2023-10-08T15:38:01.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.601+0000 7f4219ac2700 1 -- 172.21.15.3:0/2532377130 learned_addr learned my addr 172.21.15.3:0/2532377130 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:38:01.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.601+0000 7f42192c1700 1 --2- 172.21.15.3:0/2532377130 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f421409e590 0x7f421413bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:01.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.601+0000 7f421a2c3700 1 --2- 172.21.15.3:0/2532377130 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f42140a26f0 0x7f421413c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:01.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.601+0000 7f4219ac2700 1 -- 172.21.15.3:0/2532377130 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f42140a26f0 msgr2=0x7f421413c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:01.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.601+0000 7f4219ac2700 1 --2- 172.21.15.3:0/2532377130 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f42140a26f0 0x7f421413c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:01.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.601+0000 7f4219ac2700 1 -- 172.21.15.3:0/2532377130 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f421409e590 msgr2=0x7f421413bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:01.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.601+0000 7f4219ac2700 1 --2- 172.21.15.3:0/2532377130 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f421409e590 0x7f421413bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:01.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.601+0000 7f4219ac2700 1 -- 172.21.15.3:0/2532377130 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42100094f0 con 0x7f4214068e50 2023-10-08T15:38:01.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.601+0000 7f421a2c3700 1 --2- 172.21.15.3:0/2532377130 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f42140a26f0 0x7f421413c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:38:01.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.605+0000 7f4219ac2700 1 --2- 172.21.15.3:0/2532377130 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4214068e50 0x7f421406e740 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f420400d1d0 tx=0x7f4204009a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:01.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.605+0000 7f4209ffb700 1 -- 172.21.15.3:0/2532377130 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420400ddc0 con 0x7f4214068e50 2023-10-08T15:38:01.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.605+0000 7f4209ffb700 1 -- 172.21.15.3:0/2532377130 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f420400f040 con 0x7f4214068e50 2023-10-08T15:38:01.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.605+0000 7f421aac4700 1 -- 172.21.15.3:0/2532377130 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f421415bfa0 con 0x7f4214068e50 2023-10-08T15:38:01.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.605+0000 7f4209ffb700 1 -- 172.21.15.3:0/2532377130 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4204015670 con 0x7f4214068e50 2023-10-08T15:38:01.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.605+0000 7f421aac4700 1 -- 172.21.15.3:0/2532377130 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f421415c240 con 0x7f4214068e50 2023-10-08T15:38:01.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.605+0000 7f421aac4700 1 -- 172.21.15.3:0/2532377130 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f421405ecf0 con 0x7f4214068e50 2023-10-08T15:38:01.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.605+0000 7f4209ffb700 1 -- 172.21.15.3:0/2532377130 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4204015a60 con 0x7f4214068e50 2023-10-08T15:38:01.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.605+0000 7f4209ffb700 1 --2- 172.21.15.3:0/2532377130 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4200060550 0x7f4200062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:01.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.605+0000 7f4209ffb700 1 -- 172.21.15.3:0/2532377130 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f420407cd10 con 0x7f4214068e50 2023-10-08T15:38:01.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.605+0000 7f42192c1700 1 --2- 172.21.15.3:0/2532377130 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4200060550 0x7f4200062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:01.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.609+0000 7f42192c1700 1 --2- 172.21.15.3:0/2532377130 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4200060550 0x7f4200062a00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f421409ea10 tx=0x7f4210018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:01.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.613+0000 7f4209ffb700 1 -- 172.21.15.3:0/2532377130 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4204082020 con 0x7f4214068e50 2023-10-08T15:38:01.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:01.817+0000 7f421aac4700 1 -- 172.21.15.3:0/2532377130 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4214069220 con 0x7f4214068e50 2023-10-08T15:38:02.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.437+0000 7f4209ffb700 1 -- 172.21.15.3:0/2532377130 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) v1 ==== 104+0+0 (secure 0 0 0) 0x7f420404d2c0 con 0x7f4214068e50 2023-10-08T15:38:02.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.441+0000 7f421aac4700 1 -- 172.21.15.3:0/2532377130 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4200060550 msgr2=0x7f4200062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:02.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.441+0000 7f421aac4700 1 --2- 172.21.15.3:0/2532377130 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4200060550 0x7f4200062a00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f421409ea10 tx=0x7f4210018000 comp rx=0 tx=0).stop 2023-10-08T15:38:02.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.441+0000 7f421aac4700 1 -- 172.21.15.3:0/2532377130 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4214068e50 msgr2=0x7f421406e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:02.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.441+0000 7f421aac4700 1 --2- 172.21.15.3:0/2532377130 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4214068e50 0x7f421406e740 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f420400d1d0 tx=0x7f4204009a90 comp rx=0 tx=0).stop 2023-10-08T15:38:02.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.441+0000 7f421aac4700 1 -- 172.21.15.3:0/2532377130 shutdown_connections 2023-10-08T15:38:02.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.441+0000 7f421aac4700 1 --2- 172.21.15.3:0/2532377130 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4200060550 0x7f4200062a00 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:02.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.441+0000 7f421aac4700 1 --2- 172.21.15.3:0/2532377130 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f42140a26f0 0x7f421413c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:02.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.441+0000 7f421aac4700 1 --2- 172.21.15.3:0/2532377130 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f421409e590 0x7f421413bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:02.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.441+0000 7f421aac4700 1 --2- 172.21.15.3:0/2532377130 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4214068e50 0x7f421406e740 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:02.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.441+0000 7f421aac4700 1 -- 172.21.15.3:0/2532377130 >> 172.21.15.3:0/2532377130 conn(0x7f42140bd9c0 msgr2=0x7f4214148d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:02.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.441+0000 7f421aac4700 1 -- 172.21.15.3:0/2532377130 shutdown_connections 2023-10-08T15:38:02.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.441+0000 7f421aac4700 1 -- 172.21.15.3:0/2532377130 wait complete. 2023-10-08T15:38:02.462 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-08T15:38:02.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.573+0000 7fa651ff5700 1 Processor -- start 2023-10-08T15:38:02.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.573+0000 7fa651ff5700 1 -- start start 2023-10-08T15:38:02.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.573+0000 7fa651ff5700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fa64c0bae70 0x7fa64c14ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:02.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.573+0000 7fa651ff5700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa64c148360 0x7fa64c1487a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:02.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.573+0000 7fa651ff5700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa64c068c40 con 0x7fa64c0a0d30 2023-10-08T15:38:02.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.573+0000 7fa651ff5700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa64c149410 con 0x7fa64c0bae70 2023-10-08T15:38:02.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.573+0000 7fa651ff5700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa64c06f200 con 0x7fa64c148360 2023-10-08T15:38:02.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.577+0000 7fa64bfff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fa64c0a0d30 0x7fa64c069ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:54510/0 (socket says 172.21.15.3:54510) 2023-10-08T15:38:02.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.577+0000 7fa650ff3700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fa64c0bae70 0x7fa64c14ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:02.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.577+0000 7fa64bfff700 1 -- 172.21.15.3:0/1076643142 learned_addr learned my addr 172.21.15.3:0/1076643142 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:38:02.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.577+0000 7fa6517f4700 1 --2- 172.21.15.3:0/1076643142 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa64c148360 0x7fa64c1487a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:02.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.577+0000 7fa64b7fe700 1 -- 172.21.15.3:0/1076643142 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3598632968 0 0) 0x7fa64c068c40 con 0x7fa64c0a0d30 2023-10-08T15:38:02.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.577+0000 7fa64b7fe700 1 -- 172.21.15.3:0/1076643142 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa634003570 con 0x7fa64c0a0d30 2023-10-08T15:38:02.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.577+0000 7fa650ff3700 1 -- 172.21.15.3:0/1076643142 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa64c148360 msgr2=0x7fa64c1487a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:38:02.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.577+0000 7fa650ff3700 1 --2- 172.21.15.3:0/1076643142 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa64c148360 0x7fa64c1487a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:02.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.577+0000 7fa650ff3700 1 -- 172.21.15.3:0/1076643142 >> v1:172.21.15.3:6789/0 conn(0x7fa64c0a0d30 legacy=0x7fa64c069ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:02.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.577+0000 7fa650ff3700 1 -- 172.21.15.3:0/1076643142 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa64c06ad10 con 0x7fa64c0bae70 2023-10-08T15:38:02.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.577+0000 7fa6517f4700 1 --2- 172.21.15.3:0/1076643142 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa64c148360 0x7fa64c1487a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:38:02.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.577+0000 7fa650ff3700 1 --2- 172.21.15.3:0/1076643142 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa64c0bae70 0x7fa64c14ca30 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa6400098e0 tx=0x7fa6400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dae03e8c04d72978 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:02.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.577+0000 7fa64b7fe700 1 -- 172.21.15.3:0/1076643142 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa640011630 con 0x7fa64c0bae70 2023-10-08T15:38:02.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.577+0000 7fa64b7fe700 1 -- 172.21.15.3:0/1076643142 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa640011790 con 0x7fa64c0bae70 2023-10-08T15:38:02.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.577+0000 7fa64b7fe700 1 -- 172.21.15.3:0/1076643142 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa640011b30 con 0x7fa64c0bae70 2023-10-08T15:38:02.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.577+0000 7fa651ff5700 1 -- 172.21.15.3:0/1076643142 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa64c0bae70 msgr2=0x7fa64c14ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:02.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.577+0000 7fa651ff5700 1 --2- 172.21.15.3:0/1076643142 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa64c0bae70 0x7fa64c14ca30 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa6400098e0 tx=0x7fa6400091a0 comp rx=0 tx=0).stop 2023-10-08T15:38:02.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.577+0000 7fa651ff5700 1 -- 172.21.15.3:0/1076643142 shutdown_connections 2023-10-08T15:38:02.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.577+0000 7fa651ff5700 1 --2- 172.21.15.3:0/1076643142 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa64c148360 0x7fa64c1487a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:02.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.577+0000 7fa651ff5700 1 --2- 172.21.15.3:0/1076643142 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa64c0bae70 0x7fa64c14ca30 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:02.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.577+0000 7fa651ff5700 1 -- 172.21.15.3:0/1076643142 >> 172.21.15.3:0/1076643142 conn(0x7fa64c0670e0 msgr2=0x7fa64c0674e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:02.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.577+0000 7fa651ff5700 1 -- 172.21.15.3:0/1076643142 shutdown_connections 2023-10-08T15:38:02.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.577+0000 7fa651ff5700 1 -- 172.21.15.3:0/1076643142 wait complete. 2023-10-08T15:38:02.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.581+0000 7fa651ff5700 1 Processor -- start 2023-10-08T15:38:02.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.581+0000 7fa651ff5700 1 -- start start 2023-10-08T15:38:02.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.581+0000 7fa651ff5700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa64c0a0d30 0x7fa64c14b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:02.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.581+0000 7fa651ff5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa64c0bae70 0x7fa64c147320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:02.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.581+0000 7fa651ff5700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa64c148360 0x7fa64c14bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:02.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.581+0000 7fa651ff5700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa64c0b32e0 con 0x7fa64c0a0d30 2023-10-08T15:38:02.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.581+0000 7fa651ff5700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa64c144310 con 0x7fa64c0bae70 2023-10-08T15:38:02.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.581+0000 7fa651ff5700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa64c0b2e50 con 0x7fa64c148360 2023-10-08T15:38:02.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.581+0000 7fa650ff3700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa64c0a0d30 0x7fa64c14b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:02.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.581+0000 7fa650ff3700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa64c0a0d30 0x7fa64c14b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57390/0 (socket says 172.21.15.3:57390) 2023-10-08T15:38:02.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.581+0000 7fa650ff3700 1 -- 172.21.15.3:0/1334679138 learned_addr learned my addr 172.21.15.3:0/1334679138 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:38:02.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.581+0000 7fa64bfff700 1 --2- 172.21.15.3:0/1334679138 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa64c0bae70 0x7fa64c147320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:02.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.581+0000 7fa6517f4700 1 --2- 172.21.15.3:0/1334679138 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa64c148360 0x7fa64c14bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:02.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.585+0000 7fa650ff3700 1 -- 172.21.15.3:0/1334679138 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa64c148360 msgr2=0x7fa64c14bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:02.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.585+0000 7fa650ff3700 1 --2- 172.21.15.3:0/1334679138 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa64c148360 0x7fa64c14bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:02.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.585+0000 7fa650ff3700 1 -- 172.21.15.3:0/1334679138 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa64c0bae70 msgr2=0x7fa64c147320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:02.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.585+0000 7fa650ff3700 1 --2- 172.21.15.3:0/1334679138 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa64c0bae70 0x7fa64c147320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:02.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.585+0000 7fa650ff3700 1 -- 172.21.15.3:0/1334679138 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa644009a20 con 0x7fa64c0a0d30 2023-10-08T15:38:02.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.585+0000 7fa650ff3700 1 --2- 172.21.15.3:0/1334679138 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa64c0a0d30 0x7fa64c14b370 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa64c0a23a0 tx=0x7fa640017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:02.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.585+0000 7fa648ff9700 1 -- 172.21.15.3:0/1334679138 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa640011b10 con 0x7fa64c0a0d30 2023-10-08T15:38:02.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.585+0000 7fa648ff9700 1 -- 172.21.15.3:0/1334679138 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa640000cc0 con 0x7fa64c0a0d30 2023-10-08T15:38:02.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.585+0000 7fa651ff5700 1 -- 172.21.15.3:0/1334679138 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa640009420 con 0x7fa64c0a0d30 2023-10-08T15:38:02.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.585+0000 7fa648ff9700 1 -- 172.21.15.3:0/1334679138 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa640025620 con 0x7fa64c0a0d30 2023-10-08T15:38:02.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.585+0000 7fa651ff5700 1 -- 172.21.15.3:0/1334679138 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa64c147860 con 0x7fa64c0a0d30 2023-10-08T15:38:02.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.585+0000 7fa648ff9700 1 -- 172.21.15.3:0/1334679138 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa6400259d0 con 0x7fa64c0a0d30 2023-10-08T15:38:02.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.585+0000 7fa651ff5700 1 -- 172.21.15.3:0/1334679138 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa64c143a40 con 0x7fa64c0a0d30 2023-10-08T15:38:02.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.589+0000 7fa648ff9700 1 --2- 172.21.15.3:0/1334679138 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fa638060550 0x7fa638062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:02.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.589+0000 7fa648ff9700 1 -- 172.21.15.3:0/1334679138 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fa64007df30 con 0x7fa64c0a0d30 2023-10-08T15:38:02.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.589+0000 7fa64bfff700 1 --2- 172.21.15.3:0/1334679138 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fa638060550 0x7fa638062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:02.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.589+0000 7fa64bfff700 1 --2- 172.21.15.3:0/1334679138 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fa638060550 0x7fa638062a00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa64c0b45c0 tx=0x7fa63c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:02.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.593+0000 7fa648ff9700 1 -- 172.21.15.3:0/1334679138 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa64c143a40 con 0x7fa64c0a0d30 2023-10-08T15:38:02.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:02.761+0000 7fa651ff5700 1 -- 172.21.15.3:0/1334679138 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa64c143a40 con 0x7fa64c0a0d30 2023-10-08T15:38:03.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.445+0000 7fa648ff9700 1 -- 172.21.15.3:0/1334679138 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v22) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa64c143a40 con 0x7fa64c0a0d30 2023-10-08T15:38:03.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.453+0000 7fa651ff5700 1 -- 172.21.15.3:0/1334679138 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fa638060550 msgr2=0x7fa638062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:03.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.453+0000 7fa651ff5700 1 --2- 172.21.15.3:0/1334679138 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fa638060550 0x7fa638062a00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa64c0b45c0 tx=0x7fa63c009040 comp rx=0 tx=0).stop 2023-10-08T15:38:03.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.453+0000 7fa651ff5700 1 -- 172.21.15.3:0/1334679138 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa64c0a0d30 msgr2=0x7fa64c14b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:03.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.453+0000 7fa651ff5700 1 --2- 172.21.15.3:0/1334679138 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa64c0a0d30 0x7fa64c14b370 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa64c0a23a0 tx=0x7fa640017000 comp rx=0 tx=0).stop 2023-10-08T15:38:03.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.457+0000 7fa651ff5700 1 -- 172.21.15.3:0/1334679138 shutdown_connections 2023-10-08T15:38:03.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.457+0000 7fa651ff5700 1 --2- 172.21.15.3:0/1334679138 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fa638060550 0x7fa638062a00 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:03.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.457+0000 7fa651ff5700 1 --2- 172.21.15.3:0/1334679138 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa64c148360 0x7fa64c14bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:03.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.457+0000 7fa651ff5700 1 --2- 172.21.15.3:0/1334679138 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa64c0bae70 0x7fa64c147320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:03.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.457+0000 7fa651ff5700 1 --2- 172.21.15.3:0/1334679138 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa64c0a0d30 0x7fa64c14b370 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:03.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.457+0000 7fa651ff5700 1 -- 172.21.15.3:0/1334679138 >> 172.21.15.3:0/1334679138 conn(0x7fa64c0670e0 msgr2=0x7fa64c0674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:03.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.457+0000 7fa651ff5700 1 -- 172.21.15.3:0/1334679138 shutdown_connections 2023-10-08T15:38:03.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.457+0000 7fa651ff5700 1 -- 172.21.15.3:0/1334679138 wait complete. 2023-10-08T15:38:03.463 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'cephfs_metadata' removed 2023-10-08T15:38:03.476 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-08T15:38:03.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.589+0000 7f8716a67700 1 Processor -- start 2023-10-08T15:38:03.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.589+0000 7f8716a67700 1 -- start start 2023-10-08T15:38:03.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.589+0000 7f8716a67700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f871009f5c0 0x7f87100a2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:03.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.593+0000 7f8716a67700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f871009cd80 0x7f871009d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:03.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.593+0000 7f8716a67700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f871014fc50 con 0x7f871014f640 2023-10-08T15:38:03.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.593+0000 7f8716a67700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f871009d220 con 0x7f871009f5c0 2023-10-08T15:38:03.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.593+0000 7f8716a67700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87100a2870 con 0x7f871009cd80 2023-10-08T15:38:03.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.593+0000 7f8715a65700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f871009f5c0 0x7f87100a2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:03.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.593+0000 7f8715a65700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f871009f5c0 0x7f87100a2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57400/0 (socket says 172.21.15.3:57400) 2023-10-08T15:38:03.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.593+0000 7f8715a65700 1 -- 172.21.15.3:0/96438285 learned_addr learned my addr 172.21.15.3:0/96438285 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:38:03.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.593+0000 7f8716266700 1 --2- 172.21.15.3:0/96438285 >> v2:172.21.15.50:3300/0 conn(0x7f871009cd80 0x7f871009d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:03.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.593+0000 7f8715a65700 1 -- 172.21.15.3:0/96438285 >> v2:172.21.15.50:3300/0 conn(0x7f871009cd80 msgr2=0x7f871009d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:38:03.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.593+0000 7f8715a65700 1 --2- 172.21.15.3:0/96438285 >> v2:172.21.15.50:3300/0 conn(0x7f871009cd80 0x7f871009d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:03.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.593+0000 7f8715a65700 1 -- 172.21.15.3:0/96438285 >> v1:172.21.15.50:6789/0 conn(0x7f871014f640 legacy=0x7f871009f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:03.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.593+0000 7f8715a65700 1 -- 172.21.15.3:0/96438285 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87100a1590 con 0x7f871009f5c0 2023-10-08T15:38:03.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.593+0000 7f8715a65700 1 --2- 172.21.15.3:0/96438285 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f871009f5c0 0x7f87100a2270 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f871014fbc0 tx=0x7f870c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cff18286b1b1b32 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:03.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.593+0000 7f8714a63700 1 -- 172.21.15.3:0/96438285 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870c009e70 con 0x7f871009f5c0 2023-10-08T15:38:03.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.593+0000 7f8714a63700 1 -- 172.21.15.3:0/96438285 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f870c00b860 con 0x7f871009f5c0 2023-10-08T15:38:03.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.593+0000 7f8714a63700 1 -- 172.21.15.3:0/96438285 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870c00bc00 con 0x7f871009f5c0 2023-10-08T15:38:03.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.593+0000 7f8716a67700 1 -- 172.21.15.3:0/96438285 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f871009f5c0 msgr2=0x7f87100a2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:03.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.593+0000 7f8716a67700 1 --2- 172.21.15.3:0/96438285 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f871009f5c0 0x7f87100a2270 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f871014fbc0 tx=0x7f870c009250 comp rx=0 tx=0).stop 2023-10-08T15:38:03.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.593+0000 7f8716a67700 1 -- 172.21.15.3:0/96438285 shutdown_connections 2023-10-08T15:38:03.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.593+0000 7f8716a67700 1 --2- 172.21.15.3:0/96438285 >> v2:172.21.15.50:3300/0 conn(0x7f871009cd80 0x7f871009d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:03.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.593+0000 7f8716a67700 1 --2- 172.21.15.3:0/96438285 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f871009f5c0 0x7f87100a2270 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:03.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.593+0000 7f8716a67700 1 -- 172.21.15.3:0/96438285 >> 172.21.15.3:0/96438285 conn(0x7f87100bd9d0 msgr2=0x7f87100bddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:03.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.593+0000 7f8716a67700 1 -- 172.21.15.3:0/96438285 shutdown_connections 2023-10-08T15:38:03.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.593+0000 7f8716a67700 1 -- 172.21.15.3:0/96438285 wait complete. 2023-10-08T15:38:03.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.597+0000 7f8716a67700 1 Processor -- start 2023-10-08T15:38:03.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.597+0000 7f8716a67700 1 -- start start 2023-10-08T15:38:03.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.597+0000 7f8716a67700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f871009cd80 0x7f8710095a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:03.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.597+0000 7f8716a67700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f871009f5c0 0x7f87100bce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:03.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.597+0000 7f8716a67700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f871014f640 0x7f871015fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:03.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.597+0000 7f8716a67700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871006d6c0 con 0x7f871009f5c0 2023-10-08T15:38:03.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.597+0000 7f8716a67700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87100bd3c0 con 0x7f871014f640 2023-10-08T15:38:03.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.597+0000 7f8716a67700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8710096ce0 con 0x7f871009cd80 2023-10-08T15:38:03.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.597+0000 7f8715264700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f871009f5c0 0x7f87100bce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:03.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.597+0000 7f8715264700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f871009f5c0 0x7f87100bce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57416/0 (socket says 172.21.15.3:57416) 2023-10-08T15:38:03.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.597+0000 7f8715264700 1 -- 172.21.15.3:0/3503264883 learned_addr learned my addr 172.21.15.3:0/3503264883 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:38:03.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.597+0000 7f8716266700 1 --2- 172.21.15.3:0/3503264883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f871014f640 0x7f871015fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:03.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.597+0000 7f8715a65700 1 --2- 172.21.15.3:0/3503264883 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f871009cd80 0x7f8710095a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:03.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.597+0000 7f8715264700 1 -- 172.21.15.3:0/3503264883 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f871009cd80 msgr2=0x7f8710095a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:03.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.597+0000 7f8715264700 1 --2- 172.21.15.3:0/3503264883 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f871009cd80 0x7f8710095a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:03.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.597+0000 7f8715264700 1 -- 172.21.15.3:0/3503264883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f871014f640 msgr2=0x7f871015fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:03.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.601+0000 7f8715264700 1 --2- 172.21.15.3:0/3503264883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f871014f640 0x7f871015fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:03.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.601+0000 7f8715264700 1 -- 172.21.15.3:0/3503264883 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f870c0094f0 con 0x7f871009f5c0 2023-10-08T15:38:03.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.601+0000 7f8716266700 1 --2- 172.21.15.3:0/3503264883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f871014f640 0x7f871015fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:38:03.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.601+0000 7f8715264700 1 --2- 172.21.15.3:0/3503264883 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f871009f5c0 0x7f87100bce80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f870000c4e0 tx=0x7f870000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:03.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.601+0000 7f8705ffb700 1 -- 172.21.15.3:0/3503264883 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8700011590 con 0x7f871009f5c0 2023-10-08T15:38:03.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.601+0000 7f8705ffb700 1 -- 172.21.15.3:0/3503264883 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8700011710 con 0x7f871009f5c0 2023-10-08T15:38:03.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.601+0000 7f8705ffb700 1 -- 172.21.15.3:0/3503264883 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8700011ad0 con 0x7f871009f5c0 2023-10-08T15:38:03.608 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.601+0000 7f8716a67700 1 -- 172.21.15.3:0/3503264883 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8710096fc0 con 0x7f871009f5c0 2023-10-08T15:38:03.608 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.601+0000 7f8716a67700 1 -- 172.21.15.3:0/3503264883 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f871015f4f0 con 0x7f871009f5c0 2023-10-08T15:38:03.608 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.601+0000 7f8716a67700 1 -- 172.21.15.3:0/3503264883 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8710096b40 con 0x7f871009f5c0 2023-10-08T15:38:03.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.601+0000 7f8705ffb700 1 -- 172.21.15.3:0/3503264883 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f870001b3b0 con 0x7f871009f5c0 2023-10-08T15:38:03.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.605+0000 7f8705ffb700 1 --2- 172.21.15.3:0/3503264883 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f86f4060580 0x7f86f4062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:03.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.605+0000 7f8705ffb700 1 -- 172.21.15.3:0/3503264883 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5353+0+0 (secure 0 0 0) 0x7f870007bb30 con 0x7f871009f5c0 2023-10-08T15:38:03.610 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.605+0000 7f8715a65700 1 --2- 172.21.15.3:0/3503264883 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f86f4060580 0x7f86f4062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:03.610 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.605+0000 7f8715a65700 1 --2- 172.21.15.3:0/3503264883 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f86f4060580 0x7f86f4062a30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f871014fbc0 tx=0x7f870c017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:03.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.609+0000 7f8705ffb700 1 -- 172.21.15.3:0/3503264883 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8710096b40 con 0x7f871009f5c0 2023-10-08T15:38:03.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:03.773+0000 7f8716a67700 1 -- 172.21.15.3:0/3503264883 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8710096b40 con 0x7f871009f5c0 2023-10-08T15:38:04.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.449+0000 7f8705ffb700 1 -- 172.21.15.3:0/3503264883 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7f8710096b40 con 0x7f871009f5c0 2023-10-08T15:38:04.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.457+0000 7f8716a67700 1 -- 172.21.15.3:0/3503264883 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f86f4060580 msgr2=0x7f86f4062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:04.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.457+0000 7f8716a67700 1 --2- 172.21.15.3:0/3503264883 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f86f4060580 0x7f86f4062a30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f871014fbc0 tx=0x7f870c017000 comp rx=0 tx=0).stop 2023-10-08T15:38:04.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.457+0000 7f8716a67700 1 -- 172.21.15.3:0/3503264883 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f871009f5c0 msgr2=0x7f87100bce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:04.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.457+0000 7f8716a67700 1 --2- 172.21.15.3:0/3503264883 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f871009f5c0 0x7f87100bce80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f870000c4e0 tx=0x7f870000c8a0 comp rx=0 tx=0).stop 2023-10-08T15:38:04.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.461+0000 7f8716a67700 1 -- 172.21.15.3:0/3503264883 shutdown_connections 2023-10-08T15:38:04.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.461+0000 7f8716a67700 1 --2- 172.21.15.3:0/3503264883 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f86f4060580 0x7f86f4062a30 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:04.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.461+0000 7f8716a67700 1 --2- 172.21.15.3:0/3503264883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f871014f640 0x7f871015fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:04.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.461+0000 7f8716a67700 1 --2- 172.21.15.3:0/3503264883 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f871009f5c0 0x7f87100bce80 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:04.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.461+0000 7f8716a67700 1 --2- 172.21.15.3:0/3503264883 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f871009cd80 0x7f8710095a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:04.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.461+0000 7f8716a67700 1 -- 172.21.15.3:0/3503264883 >> 172.21.15.3:0/3503264883 conn(0x7f87100bd9d0 msgr2=0x7f8710152d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:04.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.461+0000 7f8716a67700 1 -- 172.21.15.3:0/3503264883 shutdown_connections 2023-10-08T15:38:04.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.461+0000 7f8716a67700 1 -- 172.21.15.3:0/3503264883 wait complete. 2023-10-08T15:38:04.470 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'cephfs_data' removed 2023-10-08T15:38:04.483 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-08T15:38:04.484 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-08T15:38:04.484 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-08T15:38:04.484 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T15:38:04.484 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-08T15:38:04.484 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-08T15:38:04.484 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-08T15:38:04.484 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T15:38:04.495 INFO:tasks.ceph.mds.a:Stopped 2023-10-08T15:38:04.495 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-08T15:38:04.496 INFO:tasks.ceph.mds.b:Stopped 2023-10-08T15:38:04.496 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-08T15:38:04.498 INFO:tasks.ceph.mds.b:Started 2023-10-08T15:38:04.498 INFO:tasks.ceph.mds.a:Started 2023-10-08T15:38:04.499 DEBUG:teuthology.parallel:result is None 2023-10-08T15:38:04.499 DEBUG:teuthology.parallel:result is None 2023-10-08T15:38:04.499 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-08T15:38:04.565 INFO:tasks.ceph.mds.b.smithi050.stdout:starting mds.b at 2023-10-08T15:38:04.571 INFO:tasks.ceph.mds.a.smithi003.stdout:starting mds.a at 2023-10-08T15:38:04.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.605+0000 7f3e55d5d700 1 Processor -- start 2023-10-08T15:38:04.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.605+0000 7f3e55d5d700 1 -- start start 2023-10-08T15:38:04.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.605+0000 7f3e55d5d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3e500c24e0 0x7f3e500c28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:04.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.605+0000 7f3e55d5d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3e500bc970 0x7f3e500bcdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:04.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.605+0000 7f3e55d5d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e500bfcd0 con 0x7f3e500bddf0 2023-10-08T15:38:04.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.605+0000 7f3e55d5d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e5014c2e0 con 0x7f3e500c24e0 2023-10-08T15:38:04.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.605+0000 7f3e55d5d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e500bff20 con 0x7f3e500bc970 2023-10-08T15:38:04.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.605+0000 7f3e5555c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3e500bc970 0x7f3e500bcdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:04.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.605+0000 7f3e5555c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3e500bc970 0x7f3e500bcdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.3:54136/0 (socket says 172.21.15.3:54136) 2023-10-08T15:38:04.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.605+0000 7f3e5555c700 1 -- 172.21.15.3:0/235019090 learned_addr learned my addr 172.21.15.3:0/235019090 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:38:04.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.605+0000 7f3e54d5b700 1 --2- 172.21.15.3:0/235019090 >> v2:172.21.15.50:3300/0 conn(0x7f3e500c24e0 0x7f3e500c28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:04.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.609+0000 7f3e5555c700 1 -- 172.21.15.3:0/235019090 >> v2:172.21.15.50:3300/0 conn(0x7f3e500c24e0 msgr2=0x7f3e500c28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:38:04.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.609+0000 7f3e5555c700 1 --2- 172.21.15.3:0/235019090 >> v2:172.21.15.50:3300/0 conn(0x7f3e500c24e0 0x7f3e500c28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:04.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.609+0000 7f3e5555c700 1 -- 172.21.15.3:0/235019090 >> v1:172.21.15.50:6789/0 conn(0x7f3e500bddf0 legacy=0x7f3e500c0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:04.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.609+0000 7f3e5555c700 1 -- 172.21.15.3:0/235019090 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e50148e40 con 0x7f3e500bc970 2023-10-08T15:38:04.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.609+0000 7f3e5555c700 1 --2- 172.21.15.3:0/235019090 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3e500bc970 0x7f3e500bcdd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3e48009f20 tx=0x7f3e48009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b919ae97a5eaf1d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:04.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.609+0000 7f3e4f7fe700 1 -- 172.21.15.3:0/235019090 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4800e070 con 0x7f3e500bc970 2023-10-08T15:38:04.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.609+0000 7f3e4f7fe700 1 -- 172.21.15.3:0/235019090 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e4800b9d0 con 0x7f3e500bc970 2023-10-08T15:38:04.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.609+0000 7f3e4f7fe700 1 -- 172.21.15.3:0/235019090 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e480092e0 con 0x7f3e500bc970 2023-10-08T15:38:04.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.609+0000 7f3e55d5d700 1 -- 172.21.15.3:0/235019090 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3e500bc970 msgr2=0x7f3e500bcdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:04.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.609+0000 7f3e55d5d700 1 --2- 172.21.15.3:0/235019090 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3e500bc970 0x7f3e500bcdd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3e48009f20 tx=0x7f3e48009840 comp rx=0 tx=0).stop 2023-10-08T15:38:04.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.609+0000 7f3e55d5d700 1 -- 172.21.15.3:0/235019090 shutdown_connections 2023-10-08T15:38:04.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.609+0000 7f3e55d5d700 1 --2- 172.21.15.3:0/235019090 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3e500bc970 0x7f3e500bcdd0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:04.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.609+0000 7f3e55d5d700 1 --2- 172.21.15.3:0/235019090 >> v2:172.21.15.50:3300/0 conn(0x7f3e500c24e0 0x7f3e500c28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:04.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.609+0000 7f3e55d5d700 1 -- 172.21.15.3:0/235019090 >> 172.21.15.3:0/235019090 conn(0x7f3e500a2310 msgr2=0x7f3e500c1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:04.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.609+0000 7f3e55d5d700 1 -- 172.21.15.3:0/235019090 shutdown_connections 2023-10-08T15:38:04.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.609+0000 7f3e55d5d700 1 -- 172.21.15.3:0/235019090 wait complete. 2023-10-08T15:38:04.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.609+0000 7f3e55d5d700 1 Processor -- start 2023-10-08T15:38:04.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.609+0000 7f3e55d5d700 1 -- start start 2023-10-08T15:38:04.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.609+0000 7f3e55d5d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e500bc970 0x7f3e500b8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:04.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.609+0000 7f3e55d5d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3e500bddf0 0x7f3e500bb750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:04.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.609+0000 7f3e55d5d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e500c24e0 0x7f3e50146040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:04.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.609+0000 7f3e55d5d700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e500b93c0 con 0x7f3e500bc970 2023-10-08T15:38:04.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.609+0000 7f3e55d5d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e500bbc90 con 0x7f3e500c24e0 2023-10-08T15:38:04.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.609+0000 7f3e55d5d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e500b9670 con 0x7f3e500bddf0 2023-10-08T15:38:04.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.609+0000 7f3e54d5b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e500bc970 0x7f3e500b8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:04.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.609+0000 7f3e54d5b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e500bc970 0x7f3e500b8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57464/0 (socket says 172.21.15.3:57464) 2023-10-08T15:38:04.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.609+0000 7f3e54d5b700 1 -- 172.21.15.3:0/3003394024 learned_addr learned my addr 172.21.15.3:0/3003394024 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:38:04.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.609+0000 7f3e5555c700 1 --2- 172.21.15.3:0/3003394024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e500c24e0 0x7f3e50146040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:04.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.609+0000 7f3e4ffff700 1 --2- 172.21.15.3:0/3003394024 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3e500bddf0 0x7f3e500bb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:04.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.613+0000 7f3e54d5b700 1 -- 172.21.15.3:0/3003394024 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3e500bddf0 msgr2=0x7f3e500bb750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:04.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.613+0000 7f3e54d5b700 1 --2- 172.21.15.3:0/3003394024 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3e500bddf0 0x7f3e500bb750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:04.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.613+0000 7f3e54d5b700 1 -- 172.21.15.3:0/3003394024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e500c24e0 msgr2=0x7f3e50146040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:04.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.613+0000 7f3e54d5b700 1 --2- 172.21.15.3:0/3003394024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e500c24e0 0x7f3e50146040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:04.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.613+0000 7f3e54d5b700 1 -- 172.21.15.3:0/3003394024 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e48009ae0 con 0x7f3e500bc970 2023-10-08T15:38:04.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.613+0000 7f3e54d5b700 1 --2- 172.21.15.3:0/3003394024 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e500bc970 0x7f3e500b8e80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3e4400ec80 tx=0x7f3e440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:04.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.613+0000 7f3e4cff9700 1 -- 172.21.15.3:0/3003394024 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4400c850 con 0x7f3e500bc970 2023-10-08T15:38:04.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.613+0000 7f3e4cff9700 1 -- 172.21.15.3:0/3003394024 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e4400c9b0 con 0x7f3e500bc970 2023-10-08T15:38:04.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.613+0000 7f3e4cff9700 1 -- 172.21.15.3:0/3003394024 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4400cd50 con 0x7f3e500bc970 2023-10-08T15:38:04.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.613+0000 7f3e55d5d700 1 -- 172.21.15.3:0/3003394024 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e500b9950 con 0x7f3e500bc970 2023-10-08T15:38:04.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.613+0000 7f3e55d5d700 1 -- 172.21.15.3:0/3003394024 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e5014ac40 con 0x7f3e500bc970 2023-10-08T15:38:04.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.613+0000 7f3e4cff9700 1 -- 172.21.15.3:0/3003394024 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f3e44013680 con 0x7f3e500bc970 2023-10-08T15:38:04.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.613+0000 7f3e55d5d700 1 -- 172.21.15.3:0/3003394024 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e500b9dd0 con 0x7f3e500bc970 2023-10-08T15:38:04.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.613+0000 7f3e4cff9700 1 --2- 172.21.15.3:0/3003394024 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3e34060550 0x7f3e34062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:04.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.613+0000 7f3e4cff9700 1 -- 172.21.15.3:0/3003394024 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f3e4407c750 con 0x7f3e500bc970 2023-10-08T15:38:04.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.613+0000 7f3e4ffff700 1 --2- 172.21.15.3:0/3003394024 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3e34060550 0x7f3e34062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:04.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.617+0000 7f3e4ffff700 1 --2- 172.21.15.3:0/3003394024 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3e34060550 0x7f3e34062a00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3e500bbef0 tx=0x7f3e3c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:04.633 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.625+0000 7f3e4cff9700 1 -- 172.21.15.3:0/3003394024 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3e4404d040 con 0x7f3e500bc970 2023-10-08T15:38:04.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:04.793+0000 7f3e55d5d700 1 -- 172.21.15.3:0/3003394024 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f3e5005ecf0 con 0x7f3e500bc970 2023-10-08T15:38:05.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.469+0000 7f3e4cff9700 1 -- 172.21.15.3:0/3003394024 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v25) v1 ==== 97+0+0 (secure 0 0 0) 0x7f3e44050660 con 0x7f3e500bc970 2023-10-08T15:38:05.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.473+0000 7f3e55d5d700 1 -- 172.21.15.3:0/3003394024 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3e34060550 msgr2=0x7f3e34062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:05.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.473+0000 7f3e55d5d700 1 --2- 172.21.15.3:0/3003394024 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3e34060550 0x7f3e34062a00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3e500bbef0 tx=0x7f3e3c009040 comp rx=0 tx=0).stop 2023-10-08T15:38:05.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.473+0000 7f3e55d5d700 1 -- 172.21.15.3:0/3003394024 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e500bc970 msgr2=0x7f3e500b8e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:05.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.473+0000 7f3e55d5d700 1 --2- 172.21.15.3:0/3003394024 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e500bc970 0x7f3e500b8e80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3e4400ec80 tx=0x7f3e440091a0 comp rx=0 tx=0).stop 2023-10-08T15:38:05.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.473+0000 7f3e55d5d700 1 -- 172.21.15.3:0/3003394024 shutdown_connections 2023-10-08T15:38:05.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.473+0000 7f3e55d5d700 1 --2- 172.21.15.3:0/3003394024 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3e34060550 0x7f3e34062a00 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:05.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.473+0000 7f3e55d5d700 1 --2- 172.21.15.3:0/3003394024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e500c24e0 0x7f3e50146040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:05.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.473+0000 7f3e55d5d700 1 --2- 172.21.15.3:0/3003394024 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3e500bddf0 0x7f3e500bb750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:05.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.473+0000 7f3e55d5d700 1 --2- 172.21.15.3:0/3003394024 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e500bc970 0x7f3e500b8e80 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:05.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.473+0000 7f3e55d5d700 1 -- 172.21.15.3:0/3003394024 >> 172.21.15.3:0/3003394024 conn(0x7f3e500a2310 msgr2=0x7f3e500c0340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:05.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.473+0000 7f3e55d5d700 1 -- 172.21.15.3:0/3003394024 shutdown_connections 2023-10-08T15:38:05.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.473+0000 7f3e55d5d700 1 -- 172.21.15.3:0/3003394024 wait complete. 2023-10-08T15:38:05.481 INFO:teuthology.orchestra.run.smithi003.stderr: removed all blocklist entries 2023-10-08T15:38:05.494 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-08T15:38:05.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.597+0000 7f2d4c2a4700 1 Processor -- start 2023-10-08T15:38:05.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.597+0000 7f2d4c2a4700 1 -- start start 2023-10-08T15:38:05.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.597+0000 7f2d4c2a4700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2d4414aff0 0x7f2d44069020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:05.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.597+0000 7f2d4c2a4700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d44069f70 con 0x7f2d440681f0 2023-10-08T15:38:05.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.597+0000 7f2d4c2a4700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d44069560 con 0x7f2d4414ac20 2023-10-08T15:38:05.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.597+0000 7f2d4c2a4700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d4414b470 con 0x7f2d4414aff0 2023-10-08T15:38:05.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.597+0000 7f2d4983f700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f2d440681f0 0x7f2d44068910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:54538/0 (socket says 172.21.15.3:54538) 2023-10-08T15:38:05.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.601+0000 7f2d4983f700 1 -- 172.21.15.3:0/2937940048 learned_addr learned my addr 172.21.15.3:0/2937940048 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:38:05.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.601+0000 7f2d4a841700 1 --2- 172.21.15.3:0/2937940048 >> v2:172.21.15.50:3300/0 conn(0x7f2d4414aff0 0x7f2d44069020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:05.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.601+0000 7f2d4903e700 1 -- 172.21.15.3:0/2937940048 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1084187065 0 0) 0x7f2d44069f70 con 0x7f2d440681f0 2023-10-08T15:38:05.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.601+0000 7f2d4903e700 1 -- 172.21.15.3:0/2937940048 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d30003570 con 0x7f2d440681f0 2023-10-08T15:38:05.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.601+0000 7f2d4903e700 1 -- 172.21.15.3:0/2937940048 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4032525683 0 0) 0x7f2d44069560 con 0x7f2d4414ac20 2023-10-08T15:38:05.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.601+0000 7f2d4903e700 1 -- 172.21.15.3:0/2937940048 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d44069f70 con 0x7f2d4414ac20 2023-10-08T15:38:05.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.601+0000 7f2d4a841700 1 -- 172.21.15.3:0/2937940048 >> v1:172.21.15.50:6789/0 conn(0x7f2d4414ac20 legacy=0x7f2d440670e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:05.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.601+0000 7f2d4a841700 1 -- 172.21.15.3:0/2937940048 >> v1:172.21.15.3:6789/0 conn(0x7f2d440681f0 legacy=0x7f2d44068910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:05.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.601+0000 7f2d4a841700 1 -- 172.21.15.3:0/2937940048 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d440677f0 con 0x7f2d4414aff0 2023-10-08T15:38:05.608 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.601+0000 7f2d4a841700 1 --2- 172.21.15.3:0/2937940048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d4414aff0 0x7f2d44069020 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c009e60 tx=0x7f2d3c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7abdebc6aac97c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:05.608 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.601+0000 7f2d4903e700 1 -- 172.21.15.3:0/2937940048 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3c00e070 con 0x7f2d4414aff0 2023-10-08T15:38:05.608 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.601+0000 7f2d4903e700 1 -- 172.21.15.3:0/2937940048 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d3c00bab0 con 0x7f2d4414aff0 2023-10-08T15:38:05.608 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.601+0000 7f2d4903e700 1 -- 172.21.15.3:0/2937940048 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3c00be30 con 0x7f2d4414aff0 2023-10-08T15:38:05.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.601+0000 7f2d4c2a4700 1 -- 172.21.15.3:0/2937940048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d4414aff0 msgr2=0x7f2d44069020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:05.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.601+0000 7f2d4c2a4700 1 --2- 172.21.15.3:0/2937940048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d4414aff0 0x7f2d44069020 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c009e60 tx=0x7f2d3c009780 comp rx=0 tx=0).stop 2023-10-08T15:38:05.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.601+0000 7f2d4c2a4700 1 -- 172.21.15.3:0/2937940048 shutdown_connections 2023-10-08T15:38:05.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.601+0000 7f2d4c2a4700 1 --2- 172.21.15.3:0/2937940048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d4414aff0 0x7f2d44069020 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:05.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.601+0000 7f2d4c2a4700 1 -- 172.21.15.3:0/2937940048 >> 172.21.15.3:0/2937940048 conn(0x7f2d4406e0d0 msgr2=0x7f2d4406e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:05.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.601+0000 7f2d4c2a4700 1 -- 172.21.15.3:0/2937940048 shutdown_connections 2023-10-08T15:38:05.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.601+0000 7f2d4c2a4700 1 -- 172.21.15.3:0/2937940048 wait complete. 2023-10-08T15:38:05.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.605+0000 7f2d4c2a4700 1 Processor -- start 2023-10-08T15:38:05.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.605+0000 7f2d4c2a4700 1 -- start start 2023-10-08T15:38:05.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.605+0000 7f2d4c2a4700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2d440681f0 0x7f2d4415b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:05.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.605+0000 7f2d4c2a4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d4414ac20 0x7f2d44148910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:05.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.605+0000 7f2d4c2a4700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2d4414aff0 0x7f2d4414e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:05.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.605+0000 7f2d4c2a4700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4415b890 con 0x7f2d4414aff0 2023-10-08T15:38:05.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.605+0000 7f2d4c2a4700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d44147220 con 0x7f2d4414ac20 2023-10-08T15:38:05.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.605+0000 7f2d4c2a4700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4409f3a0 con 0x7f2d440681f0 2023-10-08T15:38:05.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.605+0000 7f2d4a841700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2d4414aff0 0x7f2d4414e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:05.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.605+0000 7f2d4a841700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2d4414aff0 0x7f2d4414e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57474/0 (socket says 172.21.15.3:57474) 2023-10-08T15:38:05.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.605+0000 7f2d4a841700 1 -- 172.21.15.3:0/3225172923 learned_addr learned my addr 172.21.15.3:0/3225172923 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:38:05.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.605+0000 7f2d4a040700 1 --2- 172.21.15.3:0/3225172923 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2d440681f0 0x7f2d4415b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:05.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.605+0000 7f2d4983f700 1 --2- 172.21.15.3:0/3225172923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d4414ac20 0x7f2d44148910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:05.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.605+0000 7f2d4a841700 1 -- 172.21.15.3:0/3225172923 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2d440681f0 msgr2=0x7f2d4415b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:05.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.609+0000 7f2d4a841700 1 --2- 172.21.15.3:0/3225172923 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2d440681f0 0x7f2d4415b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:05.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.609+0000 7f2d4a841700 1 -- 172.21.15.3:0/3225172923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d4414ac20 msgr2=0x7f2d44148910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:05.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.609+0000 7f2d4a841700 1 --2- 172.21.15.3:0/3225172923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d4414ac20 0x7f2d44148910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:05.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.609+0000 7f2d4a841700 1 -- 172.21.15.3:0/3225172923 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d3c009a20 con 0x7f2d4414aff0 2023-10-08T15:38:05.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.609+0000 7f2d4a841700 1 --2- 172.21.15.3:0/3225172923 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2d4414aff0 0x7f2d4414e0a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2d44067cf0 tx=0x7f2d3c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:05.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.609+0000 7f2d3a7fc700 1 -- 172.21.15.3:0/3225172923 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3c0263f0 con 0x7f2d4414aff0 2023-10-08T15:38:05.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.609+0000 7f2d3a7fc700 1 -- 172.21.15.3:0/3225172923 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d3c026550 con 0x7f2d4414aff0 2023-10-08T15:38:05.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.609+0000 7f2d4c2a4700 1 -- 172.21.15.3:0/3225172923 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d4409f830 con 0x7f2d4414aff0 2023-10-08T15:38:05.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.609+0000 7f2d3a7fc700 1 -- 172.21.15.3:0/3225172923 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3c026910 con 0x7f2d4414aff0 2023-10-08T15:38:05.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.609+0000 7f2d4c2a4700 1 -- 172.21.15.3:0/3225172923 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d44148e50 con 0x7f2d4414aff0 2023-10-08T15:38:05.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.609+0000 7f2d4c2a4700 1 -- 172.21.15.3:0/3225172923 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d4409f530 con 0x7f2d4414aff0 2023-10-08T15:38:05.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.609+0000 7f2d3a7fc700 1 -- 172.21.15.3:0/3225172923 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f2d3c026cc0 con 0x7f2d4414aff0 2023-10-08T15:38:05.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.609+0000 7f2d3a7fc700 1 --2- 172.21.15.3:0/3225172923 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f2d28060550 0x7f2d28062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:05.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.613+0000 7f2d3a7fc700 1 -- 172.21.15.3:0/3225172923 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f2d3c07e480 con 0x7f2d4414aff0 2023-10-08T15:38:05.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.613+0000 7f2d4a040700 1 --2- 172.21.15.3:0/3225172923 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f2d28060550 0x7f2d28062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:05.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.613+0000 7f2d4a040700 1 --2- 172.21.15.3:0/3225172923 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f2d28060550 0x7f2d28062a00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2d40000c00 tx=0x7f2d40009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:05.629 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.621+0000 7f2d3a7fc700 1 -- 172.21.15.3:0/3225172923 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2d3c04edc0 con 0x7f2d4414aff0 2023-10-08T15:38:05.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.857+0000 7f2d4c2a4700 1 -- 172.21.15.3:0/3225172923 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f2d44064530 con 0x7f2d4414aff0 2023-10-08T15:38:05.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.861+0000 7f2d3a7fc700 1 -- 172.21.15.3:0/3225172923 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+5787 (secure 0 0 0) 0x7f2d3c0523e0 con 0x7f2d4414aff0 2023-10-08T15:38:05.866 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:38:05.866 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2023-10-08T15:38:05.866 INFO:teuthology.orchestra.run.smithi003.stdout: "auth_dump": [ 2023-10-08T15:38:05.866 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:38:05.866 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "mds.a", 2023-10-08T15:38:05.867 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCGzCJlniy3BRAAQseQmhA2EOYYPCLL1hMj/g==", 2023-10-08T15:38:05.867 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:38:05.867 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow", 2023-10-08T15:38:05.867 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow *", 2023-10-08T15:38:05.867 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow *", 2023-10-08T15:38:05.867 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:38:05.867 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:38:05.867 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:38:05.867 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:38:05.867 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "mds.b", 2023-10-08T15:38:05.867 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCGzCJl1lNhCRAA/A3Dz/i7z2OM/Mwr00ZSFg==", 2023-10-08T15:38:05.867 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:38:05.868 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow", 2023-10-08T15:38:05.868 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow *", 2023-10-08T15:38:05.868 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow *", 2023-10-08T15:38:05.868 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:38:05.868 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:38:05.868 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:38:05.868 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:38:05.868 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.0", 2023-10-08T15:38:05.868 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCIzCJl5cInMhAAIWzN1t0FivwbJgXlK5WXCg==", 2023-10-08T15:38:05.868 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:38:05.868 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-10-08T15:38:05.869 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-10-08T15:38:05.869 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:38:05.869 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:38:05.869 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:38:05.869 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:38:05.869 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.1", 2023-10-08T15:38:05.869 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCMzCJlZQwWCBAAzzoTedkZwE7oFh4KXjrWZg==", 2023-10-08T15:38:05.869 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:38:05.869 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-10-08T15:38:05.869 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-10-08T15:38:05.869 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:38:05.869 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:38:05.870 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:38:05.870 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:38:05.870 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.2", 2023-10-08T15:38:05.870 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCPzCJlNZM0DRAAgBBNMGbDp8a6VU+mZCpMvQ==", 2023-10-08T15:38:05.870 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:38:05.870 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-10-08T15:38:05.870 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-10-08T15:38:05.870 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:38:05.870 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:38:05.870 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:38:05.874 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:38:05.874 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.3", 2023-10-08T15:38:05.874 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCSzCJltf1tERAAzUJYRvgmxgEtp/IkRsxqmg==", 2023-10-08T15:38:05.874 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:38:05.874 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-10-08T15:38:05.874 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-10-08T15:38:05.874 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:38:05.874 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:38:05.875 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:38:05.875 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:38:05.875 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.4", 2023-10-08T15:38:05.875 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCVzCJlJb2bOBAAZ4hEdc2vznsMuAZpBZlj6Q==", 2023-10-08T15:38:05.875 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:38:05.875 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-10-08T15:38:05.875 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-10-08T15:38:05.875 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:38:05.875 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:38:05.875 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:38:05.875 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:38:05.875 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.5", 2023-10-08T15:38:05.876 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCZzCJlRu4PAhAAgAt508VAQXQwI2L8QyJsag==", 2023-10-08T15:38:05.876 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:38:05.876 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-10-08T15:38:05.876 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-10-08T15:38:05.876 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:38:05.876 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:38:05.876 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:38:05.876 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:38:05.876 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.6", 2023-10-08T15:38:05.876 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCczCJl+1qsBBAArN1IsbopNLd43wJCb73a/A==", 2023-10-08T15:38:05.876 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:38:05.877 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-10-08T15:38:05.877 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-10-08T15:38:05.877 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:38:05.877 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:38:05.877 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:38:05.877 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:38:05.877 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.7", 2023-10-08T15:38:05.877 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCfzCJlMwQhCRAAv/YJwsTJz1eOHFJA/34fDQ==", 2023-10-08T15:38:05.877 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:38:05.877 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-10-08T15:38:05.877 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-10-08T15:38:05.877 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:38:05.878 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:38:05.878 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:38:05.878 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:38:05.878 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "client.0", 2023-10-08T15:38:05.878 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCGzCJlsNS9DBAAAGWd2+fzzFMSRkr2JgMssw==", 2023-10-08T15:38:05.878 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:38:05.878 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow", 2023-10-08T15:38:05.878 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow r", 2023-10-08T15:38:05.878 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow rw", 2023-10-08T15:38:05.878 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow rwx" 2023-10-08T15:38:05.878 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:38:05.879 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:38:05.879 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:38:05.879 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "client.1", 2023-10-08T15:38:05.879 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCGzCJlDRibDxAAgu6Q6umK/yUGAg4R/9Yj+w==", 2023-10-08T15:38:05.879 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:38:05.879 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow", 2023-10-08T15:38:05.879 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow r", 2023-10-08T15:38:05.879 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow rw", 2023-10-08T15:38:05.879 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow rwx" 2023-10-08T15:38:05.879 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:38:05.879 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:38:05.880 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:38:05.880 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "client.2", 2023-10-08T15:38:05.880 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCGzCJlqKuGEhAAUqGYxYztxx87maQJT2LL/g==", 2023-10-08T15:38:05.880 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:38:05.880 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow", 2023-10-08T15:38:05.880 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow r", 2023-10-08T15:38:05.880 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow rw", 2023-10-08T15:38:05.880 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow rwx" 2023-10-08T15:38:05.880 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:38:05.880 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:38:05.880 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:38:05.881 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "client.admin", 2023-10-08T15:38:05.881 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCFzCJltIgDJxAAwtl0Hr7oKzNBMOvXUUnshQ==", 2023-10-08T15:38:05.881 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:38:05.881 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow *", 2023-10-08T15:38:05.881 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow *", 2023-10-08T15:38:05.881 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow *", 2023-10-08T15:38:05.881 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:38:05.881 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:38:05.881 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:38:05.881 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:38:05.881 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "client.bootstrap-mds", 2023-10-08T15:38:05.881 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCkzCJlIjwMDhAAi60RrCJPFFnSvZHat4SQCw==", 2023-10-08T15:38:05.882 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:38:05.882 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile bootstrap-mds" 2023-10-08T15:38:05.882 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:38:05.882 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:38:05.882 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:38:05.882 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "client.bootstrap-mgr", 2023-10-08T15:38:05.882 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCkzCJlZE8MDhAA1Z9+zKpQnynAkI2UW6zs6A==", 2023-10-08T15:38:05.882 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:38:05.882 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-08T15:38:05.882 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:38:05.882 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:38:05.883 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:38:05.883 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "client.bootstrap-osd", 2023-10-08T15:38:05.883 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCkzCJlQGIMDhAAgNY+1iQanS0dse2WE/ya6g==", 2023-10-08T15:38:05.883 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:38:05.883 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile bootstrap-osd" 2023-10-08T15:38:05.883 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:38:05.883 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:38:05.883 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:38:05.883 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "client.bootstrap-rbd", 2023-10-08T15:38:05.883 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCkzCJl2nIMDhAAqPM56tupeuq3qTIfqaUqhg==", 2023-10-08T15:38:05.883 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:38:05.884 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-08T15:38:05.884 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:38:05.884 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:38:05.884 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:38:05.884 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-08T15:38:05.884 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCkzCJlRIYMDhAAbyp/1wRGIYZKBeIwVC87Hw==", 2023-10-08T15:38:05.884 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:38:05.884 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-08T15:38:05.884 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:38:05.884 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:38:05.884 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:38:05.885 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "client.bootstrap-rgw", 2023-10-08T15:38:05.885 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCkzCJlspcMDhAA16VNeQxh3q07ti7uEw+VXQ==", 2023-10-08T15:38:05.885 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:38:05.885 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-08T15:38:05.885 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:38:05.885 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:38:05.885 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:38:05.885 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "mgr.x", 2023-10-08T15:38:05.885 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCGzCJlrnryAhAAe5CNtQTuBHbbPrdMxY2lqA==", 2023-10-08T15:38:05.885 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:38:05.885 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow *", 2023-10-08T15:38:05.885 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile mgr", 2023-10-08T15:38:05.886 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:38:05.886 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:38:05.886 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:38:05.886 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:38:05.886 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "mgr.y", 2023-10-08T15:38:05.886 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCGzCJl8moPABAAjH5iVWRLyeITsMX/nAZoTQ==", 2023-10-08T15:38:05.886 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:38:05.886 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow *", 2023-10-08T15:38:05.886 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile mgr", 2023-10-08T15:38:05.886 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:38:05.886 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:38:05.887 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:38:05.887 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2023-10-08T15:38:05.887 INFO:teuthology.orchestra.run.smithi003.stdout:} 2023-10-08T15:38:05.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.861+0000 7f2d4c2a4700 1 -- 172.21.15.3:0/3225172923 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f2d28060550 msgr2=0x7f2d28062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:05.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.861+0000 7f2d4c2a4700 1 --2- 172.21.15.3:0/3225172923 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f2d28060550 0x7f2d28062a00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2d40000c00 tx=0x7f2d40009040 comp rx=0 tx=0).stop 2023-10-08T15:38:05.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.861+0000 7f2d4c2a4700 1 -- 172.21.15.3:0/3225172923 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2d4414aff0 msgr2=0x7f2d4414e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:05.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.861+0000 7f2d4c2a4700 1 --2- 172.21.15.3:0/3225172923 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2d4414aff0 0x7f2d4414e0a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2d44067cf0 tx=0x7f2d3c019000 comp rx=0 tx=0).stop 2023-10-08T15:38:05.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.861+0000 7f2d4c2a4700 1 -- 172.21.15.3:0/3225172923 shutdown_connections 2023-10-08T15:38:05.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.861+0000 7f2d4c2a4700 1 --2- 172.21.15.3:0/3225172923 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f2d28060550 0x7f2d28062a00 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:05.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.861+0000 7f2d4c2a4700 1 --2- 172.21.15.3:0/3225172923 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2d4414aff0 0x7f2d4414e0a0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:05.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.861+0000 7f2d4c2a4700 1 --2- 172.21.15.3:0/3225172923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d4414ac20 0x7f2d44148910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:05.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.861+0000 7f2d4c2a4700 1 --2- 172.21.15.3:0/3225172923 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2d440681f0 0x7f2d4415b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:05.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.861+0000 7f2d4c2a4700 1 -- 172.21.15.3:0/3225172923 >> 172.21.15.3:0/3225172923 conn(0x7f2d4406e0d0 msgr2=0x7f2d4414be40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:05.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.861+0000 7f2d4c2a4700 1 -- 172.21.15.3:0/3225172923 shutdown_connections 2023-10-08T15:38:05.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.861+0000 7f2d4c2a4700 1 -- 172.21.15.3:0/3225172923 wait complete. 2023-10-08T15:38:05.890 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-08T15:38:05.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.993+0000 7fbbfb59e700 1 Processor -- start 2023-10-08T15:38:05.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.993+0000 7fbbfb59e700 1 -- start start 2023-10-08T15:38:05.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.993+0000 7fbbfb59e700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fbbfc06e830 0x7fbbfc0685c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:05.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.993+0000 7fbbfb59e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbbfc14f4f0 0x7fbbfc14ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:06.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.993+0000 7fbbfb59e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbfc0a0f90 con 0x7fbbfc14f120 2023-10-08T15:38:06.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.993+0000 7fbbfb59e700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbfc06d120 con 0x7fbbfc06e830 2023-10-08T15:38:06.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.993+0000 7fbbfb59e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbfc14f990 con 0x7fbbfc14f4f0 2023-10-08T15:38:06.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.993+0000 7fbbf9d9b700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fbbfc06e830 0x7fbbfc0685c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:06.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.993+0000 7fbbf9d9b700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fbbfc06e830 0x7fbbfc0685c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57488/0 (socket says 172.21.15.3:57488) 2023-10-08T15:38:06.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.993+0000 7fbbf9d9b700 1 -- 172.21.15.3:0/701384967 learned_addr learned my addr 172.21.15.3:0/701384967 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:38:06.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.993+0000 7fbbfad9d700 1 --2- 172.21.15.3:0/701384967 >> v2:172.21.15.50:3300/0 conn(0x7fbbfc14f4f0 0x7fbbfc14ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:06.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.993+0000 7fbbf9d9b700 1 -- 172.21.15.3:0/701384967 >> v2:172.21.15.50:3300/0 conn(0x7fbbfc14f4f0 msgr2=0x7fbbfc14ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:38:06.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.993+0000 7fbbf9d9b700 1 --2- 172.21.15.3:0/701384967 >> v2:172.21.15.50:3300/0 conn(0x7fbbfc14f4f0 0x7fbbfc14ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:06.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.993+0000 7fbbf9d9b700 1 -- 172.21.15.3:0/701384967 >> v1:172.21.15.50:6789/0 conn(0x7fbbfc14f120 legacy=0x7fbbfc0be950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:06.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.993+0000 7fbbf9d9b700 1 -- 172.21.15.3:0/701384967 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbfc069080 con 0x7fbbfc06e830 2023-10-08T15:38:06.001 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.993+0000 7fbbfad9d700 1 --2- 172.21.15.3:0/701384967 >> v2:172.21.15.50:3300/0 conn(0x7fbbfc14f4f0 0x7fbbfc14ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:38:06.001 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.993+0000 7fbbf9d9b700 1 --2- 172.21.15.3:0/701384967 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbbfc06e830 0x7fbbfc0685c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc0700d0 tx=0x7fbbf4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0dcb3a68fbce43c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:06.001 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.993+0000 7fbbf959a700 1 -- 172.21.15.3:0/701384967 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf400e070 con 0x7fbbfc06e830 2023-10-08T15:38:06.001 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.993+0000 7fbbf959a700 1 -- 172.21.15.3:0/701384967 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf400ba50 con 0x7fbbfc06e830 2023-10-08T15:38:06.001 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.993+0000 7fbbf959a700 1 -- 172.21.15.3:0/701384967 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf40092e0 con 0x7fbbfc06e830 2023-10-08T15:38:06.002 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.993+0000 7fbbfb59e700 1 -- 172.21.15.3:0/701384967 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbbfc06e830 msgr2=0x7fbbfc0685c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:06.002 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.993+0000 7fbbfb59e700 1 --2- 172.21.15.3:0/701384967 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbbfc06e830 0x7fbbfc0685c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc0700d0 tx=0x7fbbf4009840 comp rx=0 tx=0).stop 2023-10-08T15:38:06.002 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.993+0000 7fbbfb59e700 1 -- 172.21.15.3:0/701384967 shutdown_connections 2023-10-08T15:38:06.002 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.993+0000 7fbbfb59e700 1 --2- 172.21.15.3:0/701384967 >> v2:172.21.15.50:3300/0 conn(0x7fbbfc14f4f0 0x7fbbfc14ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:06.002 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.993+0000 7fbbfb59e700 1 --2- 172.21.15.3:0/701384967 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbbfc06e830 0x7fbbfc0685c0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:06.003 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.993+0000 7fbbfb59e700 1 -- 172.21.15.3:0/701384967 >> 172.21.15.3:0/701384967 conn(0x7fbbfc067bb0 msgr2=0x7fbbfc0be240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:06.003 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.993+0000 7fbbfb59e700 1 -- 172.21.15.3:0/701384967 shutdown_connections 2023-10-08T15:38:06.003 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.993+0000 7fbbfb59e700 1 -- 172.21.15.3:0/701384967 wait complete. 2023-10-08T15:38:06.003 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.997+0000 7fbbfb59e700 1 Processor -- start 2023-10-08T15:38:06.003 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.997+0000 7fbbfb59e700 1 -- start start 2023-10-08T15:38:06.005 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.997+0000 7fbbfb59e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbbfc06e830 0x7fbbfc1510b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:06.005 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.997+0000 7fbbfb59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbbfc14f120 0x7fbbfc162950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:06.005 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.997+0000 7fbbfb59e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbbfc14f4f0 0x7fbbfc162e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:06.005 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.997+0000 7fbbfb59e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbfc0b26a0 con 0x7fbbfc06e830 2023-10-08T15:38:06.005 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.997+0000 7fbbfb59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbfc0b2210 con 0x7fbbfc14f120 2023-10-08T15:38:06.005 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.997+0000 7fbbfb59e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbfc0b1ee0 con 0x7fbbfc14f4f0 2023-10-08T15:38:06.005 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.997+0000 7fbbfa59c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbbfc06e830 0x7fbbfc1510b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:06.006 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.997+0000 7fbbf9d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbbfc14f120 0x7fbbfc162950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:06.006 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.997+0000 7fbbfa59c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbbfc06e830 0x7fbbfc1510b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57490/0 (socket says 172.21.15.3:57490) 2023-10-08T15:38:06.006 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.997+0000 7fbbfa59c700 1 -- 172.21.15.3:0/1168403772 learned_addr learned my addr 172.21.15.3:0/1168403772 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:38:06.006 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.997+0000 7fbbfad9d700 1 --2- 172.21.15.3:0/1168403772 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbbfc14f4f0 0x7fbbfc162e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:06.006 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.997+0000 7fbbfa59c700 1 -- 172.21.15.3:0/1168403772 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbbfc14f4f0 msgr2=0x7fbbfc162e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:06.006 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.997+0000 7fbbfa59c700 1 --2- 172.21.15.3:0/1168403772 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbbfc14f4f0 0x7fbbfc162e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:06.006 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.997+0000 7fbbfa59c700 1 -- 172.21.15.3:0/1168403772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbbfc14f120 msgr2=0x7fbbfc162950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:06.006 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.997+0000 7fbbfa59c700 1 --2- 172.21.15.3:0/1168403772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbbfc14f120 0x7fbbfc162950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:06.006 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.997+0000 7fbbfa59c700 1 -- 172.21.15.3:0/1168403772 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf4009ae0 con 0x7fbbfc06e830 2023-10-08T15:38:06.006 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.997+0000 7fbbfa59c700 1 --2- 172.21.15.3:0/1168403772 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbbfc06e830 0x7fbbfc1510b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbbf000c590 tx=0x7fbbf000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:06.007 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.997+0000 7fbbea7fc700 1 -- 172.21.15.3:0/1168403772 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf0011590 con 0x7fbbfc06e830 2023-10-08T15:38:06.007 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.997+0000 7fbbea7fc700 1 -- 172.21.15.3:0/1168403772 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf0011710 con 0x7fbbfc06e830 2023-10-08T15:38:06.007 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.997+0000 7fbbfb59e700 1 -- 172.21.15.3:0/1168403772 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbfc0bef50 con 0x7fbbfc06e830 2023-10-08T15:38:06.007 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.997+0000 7fbbea7fc700 1 -- 172.21.15.3:0/1168403772 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf0011ad0 con 0x7fbbfc06e830 2023-10-08T15:38:06.007 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:05.997+0000 7fbbfb59e700 1 -- 172.21.15.3:0/1168403772 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbfc14a6b0 con 0x7fbbfc06e830 2023-10-08T15:38:06.007 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.001+0000 7fbbfb59e700 1 -- 172.21.15.3:0/1168403772 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbfc1515f0 con 0x7fbbfc06e830 2023-10-08T15:38:06.007 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.001+0000 7fbbea7fc700 1 -- 172.21.15.3:0/1168403772 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fbbf001b3b0 con 0x7fbbfc06e830 2023-10-08T15:38:06.008 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.001+0000 7fbbea7fc700 1 --2- 172.21.15.3:0/1168403772 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbbdc060580 0x7fbbdc062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:06.008 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.001+0000 7fbbea7fc700 1 -- 172.21.15.3:0/1168403772 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fbbf007b980 con 0x7fbbfc06e830 2023-10-08T15:38:06.008 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.001+0000 7fbbf9d9b700 1 --2- 172.21.15.3:0/1168403772 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbbdc060580 0x7fbbdc062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:06.009 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.005+0000 7fbbf9d9b700 1 --2- 172.21.15.3:0/1168403772 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbbdc060580 0x7fbbdc062a30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbbf4009880 tx=0x7fbbf4018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:06.013 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.009+0000 7fbbea7fc700 1 -- 172.21.15.3:0/1168403772 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbbf004c220 con 0x7fbbfc06e830 2023-10-08T15:38:06.245 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.237+0000 7fbbfb59e700 1 -- 172.21.15.3:0/1168403772 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fbbfc05ecf0 con 0x7fbbfc06e830 2023-10-08T15:38:06.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.245+0000 7fbbea7fc700 1 -- 172.21.15.3:0/1168403772 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7fbbf0017020 con 0x7fbbfc06e830 2023-10-08T15:38:06.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.249+0000 7fbbfb59e700 1 -- 172.21.15.3:0/1168403772 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbbdc060580 msgr2=0x7fbbdc062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:06.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.249+0000 7fbbfb59e700 1 --2- 172.21.15.3:0/1168403772 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbbdc060580 0x7fbbdc062a30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbbf4009880 tx=0x7fbbf4018000 comp rx=0 tx=0).stop 2023-10-08T15:38:06.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.249+0000 7fbbfb59e700 1 -- 172.21.15.3:0/1168403772 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbbfc06e830 msgr2=0x7fbbfc1510b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:06.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.249+0000 7fbbfb59e700 1 --2- 172.21.15.3:0/1168403772 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbbfc06e830 0x7fbbfc1510b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbbf000c590 tx=0x7fbbf000c8a0 comp rx=0 tx=0).stop 2023-10-08T15:38:06.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.249+0000 7fbbfb59e700 1 -- 172.21.15.3:0/1168403772 shutdown_connections 2023-10-08T15:38:06.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.249+0000 7fbbfb59e700 1 --2- 172.21.15.3:0/1168403772 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbbdc060580 0x7fbbdc062a30 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:06.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.249+0000 7fbbfb59e700 1 --2- 172.21.15.3:0/1168403772 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbbfc14f4f0 0x7fbbfc162e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:06.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.249+0000 7fbbfb59e700 1 --2- 172.21.15.3:0/1168403772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbbfc14f120 0x7fbbfc162950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:06.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.249+0000 7fbbfb59e700 1 --2- 172.21.15.3:0/1168403772 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbbfc06e830 0x7fbbfc1510b0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:06.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.249+0000 7fbbfb59e700 1 -- 172.21.15.3:0/1168403772 >> 172.21.15.3:0/1168403772 conn(0x7fbbfc067bb0 msgr2=0x7fbbfc14dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:06.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.249+0000 7fbbfb59e700 1 -- 172.21.15.3:0/1168403772 shutdown_connections 2023-10-08T15:38:06.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.249+0000 7fbbfb59e700 1 -- 172.21.15.3:0/1168403772 wait complete. 2023-10-08T15:38:06.268 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-08T15:38:06.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.373+0000 7f6cad37c700 1 Processor -- start 2023-10-08T15:38:06.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.373+0000 7f6cad37c700 1 -- start start 2023-10-08T15:38:06.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.373+0000 7f6cad37c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6ca80badb0 0x7f6ca80bb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:06.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.373+0000 7f6cad37c700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f6ca80b43a0 0x7f6ca814d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:06.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.373+0000 7f6cad37c700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ca8149ba0 con 0x7f6ca814a030 2023-10-08T15:38:06.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.373+0000 7f6cad37c700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ca814d990 con 0x7f6ca80b43a0 2023-10-08T15:38:06.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.373+0000 7f6cad37c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ca8149550 con 0x7f6ca80badb0 2023-10-08T15:38:06.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.373+0000 7f6ca67fc700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f6ca80b43a0 0x7f6ca814d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:06.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.373+0000 7f6ca77fe700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f6ca814a030 0x7f6ca80b2960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:54540/0 (socket says 172.21.15.3:54540) 2023-10-08T15:38:06.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.373+0000 7f6ca77fe700 1 -- 172.21.15.3:0/1850985501 learned_addr learned my addr 172.21.15.3:0/1850985501 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:38:06.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.373+0000 7f6ca6ffd700 1 --2- 172.21.15.3:0/1850985501 >> v2:172.21.15.50:3300/0 conn(0x7f6ca80badb0 0x7f6ca80bb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:06.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.373+0000 7f6ca67fc700 1 -- 172.21.15.3:0/1850985501 >> v2:172.21.15.50:3300/0 conn(0x7f6ca80badb0 msgr2=0x7f6ca80bb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:38:06.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.373+0000 7f6ca67fc700 1 --2- 172.21.15.3:0/1850985501 >> v2:172.21.15.50:3300/0 conn(0x7f6ca80badb0 0x7f6ca80bb180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:06.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.373+0000 7f6ca67fc700 1 -- 172.21.15.3:0/1850985501 >> v1:172.21.15.3:6789/0 conn(0x7f6ca814a030 legacy=0x7f6ca80b2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:06.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.373+0000 7f6ca5ffb700 1 -- 172.21.15.3:0/1850985501 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3627929354 0 0) 0x7f6ca8149ba0 con 0x7f6ca814a030 2023-10-08T15:38:06.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.373+0000 7f6ca67fc700 1 -- 172.21.15.3:0/1850985501 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca8149830 con 0x7f6ca80b43a0 2023-10-08T15:38:06.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.373+0000 7f6ca6ffd700 1 --2- 172.21.15.3:0/1850985501 >> v2:172.21.15.50:3300/0 conn(0x7f6ca80badb0 0x7f6ca80bb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:38:06.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.373+0000 7f6ca67fc700 1 --2- 172.21.15.3:0/1850985501 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6ca80b43a0 0x7f6ca814d450 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6ca806e340 tx=0x7f6c9c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=540d9c0fc2cca971 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:06.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.373+0000 7f6ca5ffb700 1 -- 172.21.15.3:0/1850985501 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9c011630 con 0x7f6ca80b43a0 2023-10-08T15:38:06.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.373+0000 7f6ca5ffb700 1 -- 172.21.15.3:0/1850985501 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c9c011790 con 0x7f6ca80b43a0 2023-10-08T15:38:06.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.373+0000 7f6ca5ffb700 1 -- 172.21.15.3:0/1850985501 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9c011b30 con 0x7f6ca80b43a0 2023-10-08T15:38:06.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.373+0000 7f6cad37c700 1 -- 172.21.15.3:0/1850985501 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6ca80b43a0 msgr2=0x7f6ca814d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:06.382 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.373+0000 7f6cad37c700 1 --2- 172.21.15.3:0/1850985501 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6ca80b43a0 0x7f6ca814d450 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6ca806e340 tx=0x7f6c9c0091a0 comp rx=0 tx=0).stop 2023-10-08T15:38:06.382 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.377+0000 7f6cad37c700 1 -- 172.21.15.3:0/1850985501 shutdown_connections 2023-10-08T15:38:06.382 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.377+0000 7f6cad37c700 1 --2- 172.21.15.3:0/1850985501 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6ca80b43a0 0x7f6ca814d450 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:06.382 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.377+0000 7f6cad37c700 1 --2- 172.21.15.3:0/1850985501 >> v2:172.21.15.50:3300/0 conn(0x7f6ca80badb0 0x7f6ca80bb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:06.382 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.377+0000 7f6cad37c700 1 -- 172.21.15.3:0/1850985501 >> 172.21.15.3:0/1850985501 conn(0x7f6ca80be640 msgr2=0x7f6ca80ba6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:06.382 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.377+0000 7f6cad37c700 1 -- 172.21.15.3:0/1850985501 shutdown_connections 2023-10-08T15:38:06.382 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.377+0000 7f6cad37c700 1 -- 172.21.15.3:0/1850985501 wait complete. 2023-10-08T15:38:06.383 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.377+0000 7f6cad37c700 1 Processor -- start 2023-10-08T15:38:06.383 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.377+0000 7f6cad37c700 1 -- start start 2023-10-08T15:38:06.385 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.377+0000 7f6cad37c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6ca80b43a0 0x7f6ca806ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:06.385 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.377+0000 7f6cad37c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6ca80badb0 0x7f6ca80ba330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:06.385 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.377+0000 7f6cad37c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ca814a030 0x7f6ca806be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:06.385 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.377+0000 7f6cad37c700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca815fad0 con 0x7f6ca80b43a0 2023-10-08T15:38:06.385 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.377+0000 7f6cad37c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca8096350 con 0x7f6ca814a030 2023-10-08T15:38:06.386 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.377+0000 7f6cad37c700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca80ba870 con 0x7f6ca80badb0 2023-10-08T15:38:06.386 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.377+0000 7f6ca6ffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6ca80b43a0 0x7f6ca806ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:06.386 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.377+0000 7f6ca77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ca814a030 0x7f6ca806be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:06.386 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.377+0000 7f6ca6ffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6ca80b43a0 0x7f6ca806ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57500/0 (socket says 172.21.15.3:57500) 2023-10-08T15:38:06.386 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.377+0000 7f6ca67fc700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6ca80badb0 0x7f6ca80ba330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:06.386 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.377+0000 7f6ca6ffd700 1 -- 172.21.15.3:0/3279980981 learned_addr learned my addr 172.21.15.3:0/3279980981 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:38:06.386 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.381+0000 7f6ca77fe700 1 -- 172.21.15.3:0/3279980981 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6ca80badb0 msgr2=0x7f6ca80ba330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:06.386 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.381+0000 7f6ca77fe700 1 --2- 172.21.15.3:0/3279980981 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6ca80badb0 0x7f6ca80ba330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:06.386 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.381+0000 7f6ca77fe700 1 -- 172.21.15.3:0/3279980981 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6ca80b43a0 msgr2=0x7f6ca806ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:06.386 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.381+0000 7f6ca77fe700 1 --2- 172.21.15.3:0/3279980981 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6ca80b43a0 0x7f6ca806ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:06.386 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.381+0000 7f6ca77fe700 1 -- 172.21.15.3:0/3279980981 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c980093c0 con 0x7f6ca814a030 2023-10-08T15:38:06.387 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.381+0000 7f6ca77fe700 1 --2- 172.21.15.3:0/3279980981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ca814a030 0x7f6ca806be60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6ca000cbe0 tx=0x7f6ca00019a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:06.387 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.381+0000 7f6c8effd700 1 -- 172.21.15.3:0/3279980981 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca000a8b0 con 0x7f6ca814a030 2023-10-08T15:38:06.387 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.381+0000 7f6c8effd700 1 -- 172.21.15.3:0/3279980981 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca000aa30 con 0x7f6ca814a030 2023-10-08T15:38:06.387 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.381+0000 7f6c8effd700 1 -- 172.21.15.3:0/3279980981 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca000adf0 con 0x7f6ca814a030 2023-10-08T15:38:06.388 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.381+0000 7f6cad37c700 1 -- 172.21.15.3:0/3279980981 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c9c009420 con 0x7f6ca814a030 2023-10-08T15:38:06.388 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.381+0000 7f6cad37c700 1 -- 172.21.15.3:0/3279980981 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ca815b5d0 con 0x7f6ca814a030 2023-10-08T15:38:06.388 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.381+0000 7f6cad37c700 1 -- 172.21.15.3:0/3279980981 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ca806cb30 con 0x7f6ca814a030 2023-10-08T15:38:06.388 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.381+0000 7f6c8effd700 1 -- 172.21.15.3:0/3279980981 <== mon.1 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6ca0007300 con 0x7f6ca814a030 2023-10-08T15:38:06.389 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.385+0000 7f6c8effd700 1 --2- 172.21.15.3:0/3279980981 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f6c94060580 0x7f6c94062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:06.389 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.385+0000 7f6c8effd700 1 -- 172.21.15.3:0/3279980981 <== mon.1 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f6ca007c700 con 0x7f6ca814a030 2023-10-08T15:38:06.390 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.385+0000 7f6ca6ffd700 1 --2- 172.21.15.3:0/3279980981 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f6c94060580 0x7f6c94062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:06.390 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.385+0000 7f6ca6ffd700 1 --2- 172.21.15.3:0/3279980981 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f6c94060580 0x7f6c94062a30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6c98011310 tx=0x7f6c98009120 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:06.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.397+0000 7f6c8effd700 1 -- 172.21.15.3:0/3279980981 <== mon.1 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6ca806cb30 con 0x7f6ca814a030 2023-10-08T15:38:06.625 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.621+0000 7f6cad37c700 1 -- 172.21.15.3:0/3279980981 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f6ca806cb30 con 0x7f6ca814a030 2023-10-08T15:38:06.635 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.629+0000 7f6c8effd700 1 -- 172.21.15.3:0/3279980981 <== mon.1 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f6ca806cb30 con 0x7f6ca814a030 2023-10-08T15:38:06.638 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.633+0000 7f6cad37c700 1 -- 172.21.15.3:0/3279980981 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f6c94060580 msgr2=0x7f6c94062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:06.638 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.633+0000 7f6cad37c700 1 --2- 172.21.15.3:0/3279980981 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f6c94060580 0x7f6c94062a30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6c98011310 tx=0x7f6c98009120 comp rx=0 tx=0).stop 2023-10-08T15:38:06.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.633+0000 7f6cad37c700 1 -- 172.21.15.3:0/3279980981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ca814a030 msgr2=0x7f6ca806be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:06.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.633+0000 7f6cad37c700 1 --2- 172.21.15.3:0/3279980981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ca814a030 0x7f6ca806be60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6ca000cbe0 tx=0x7f6ca00019a0 comp rx=0 tx=0).stop 2023-10-08T15:38:06.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.633+0000 7f6cad37c700 1 -- 172.21.15.3:0/3279980981 shutdown_connections 2023-10-08T15:38:06.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.633+0000 7f6cad37c700 1 --2- 172.21.15.3:0/3279980981 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f6c94060580 0x7f6c94062a30 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:06.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.633+0000 7f6cad37c700 1 --2- 172.21.15.3:0/3279980981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ca814a030 0x7f6ca806be60 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:06.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.633+0000 7f6cad37c700 1 --2- 172.21.15.3:0/3279980981 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6ca80badb0 0x7f6ca80ba330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:06.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.633+0000 7f6cad37c700 1 --2- 172.21.15.3:0/3279980981 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6ca80b43a0 0x7f6ca806ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:06.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.633+0000 7f6cad37c700 1 -- 172.21.15.3:0/3279980981 >> 172.21.15.3:0/3279980981 conn(0x7f6ca80be640 msgr2=0x7f6ca814c360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:06.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.633+0000 7f6cad37c700 1 -- 172.21.15.3:0/3279980981 shutdown_connections 2023-10-08T15:38:06.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.633+0000 7f6cad37c700 1 -- 172.21.15.3:0/3279980981 wait complete. 2023-10-08T15:38:06.652 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-08T15:38:06.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.753+0000 7fcd2ffff700 1 Processor -- start 2023-10-08T15:38:06.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.753+0000 7fcd2ffff700 1 -- start start 2023-10-08T15:38:06.759 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.753+0000 7fcd2ffff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fcd300beb80 0x7fcd301413a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:06.759 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.753+0000 7fcd2ffff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcd3006d770 0x7fcd301418e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:06.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.753+0000 7fcd2ffff700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd3014b150 con 0x7fcd3006c550 2023-10-08T15:38:06.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.753+0000 7fcd2ffff700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd30069970 con 0x7fcd300beb80 2023-10-08T15:38:06.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.753+0000 7fcd2ffff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd300b1c30 con 0x7fcd3006d770 2023-10-08T15:38:06.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.753+0000 7fcd2effd700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fcd300beb80 0x7fcd301413a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:06.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.753+0000 7fcd2f7fe700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fcd3006c550 0x7fcd3006c9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:35234/0 (socket says 172.21.15.3:35234) 2023-10-08T15:38:06.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.753+0000 7fcd2f7fe700 1 -- 172.21.15.3:0/1995709319 learned_addr learned my addr 172.21.15.3:0/1995709319 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:38:06.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.753+0000 7fcd2e7fc700 1 --2- 172.21.15.3:0/1995709319 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcd3006d770 0x7fcd301418e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:06.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.753+0000 7fcd2effd700 1 -- 172.21.15.3:0/1995709319 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcd3006d770 msgr2=0x7fcd301418e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:38:06.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.753+0000 7fcd2effd700 1 --2- 172.21.15.3:0/1995709319 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcd3006d770 0x7fcd301418e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:06.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.753+0000 7fcd2effd700 1 -- 172.21.15.3:0/1995709319 >> v1:172.21.15.3:6789/0 conn(0x7fcd3006c550 legacy=0x7fcd3006c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:06.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.753+0000 7fcd2effd700 1 -- 172.21.15.3:0/1995709319 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd30069690 con 0x7fcd300beb80 2023-10-08T15:38:06.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.753+0000 7fcd2dffb700 1 -- 172.21.15.3:0/1995709319 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4098855113 0 0) 0x7fcd3014b150 con 0x7fcd3006c550 2023-10-08T15:38:06.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.753+0000 7fcd2effd700 1 --2- 172.21.15.3:0/1995709319 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcd300beb80 0x7fcd301413a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fcd240098e0 tx=0x7fcd240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a11635d96dfc4e26 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:06.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.753+0000 7fcd2dffb700 1 -- 172.21.15.3:0/1995709319 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd24009e80 con 0x7fcd300beb80 2023-10-08T15:38:06.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.753+0000 7fcd2dffb700 1 -- 172.21.15.3:0/1995709319 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd2400b860 con 0x7fcd300beb80 2023-10-08T15:38:06.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.753+0000 7fcd2dffb700 1 -- 172.21.15.3:0/1995709319 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2400bbe0 con 0x7fcd300beb80 2023-10-08T15:38:06.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.753+0000 7fcd2ffff700 1 -- 172.21.15.3:0/1995709319 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcd300beb80 msgr2=0x7fcd301413a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:06.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.753+0000 7fcd2ffff700 1 --2- 172.21.15.3:0/1995709319 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcd300beb80 0x7fcd301413a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fcd240098e0 tx=0x7fcd240091a0 comp rx=0 tx=0).stop 2023-10-08T15:38:06.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.753+0000 7fcd2ffff700 1 -- 172.21.15.3:0/1995709319 shutdown_connections 2023-10-08T15:38:06.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.753+0000 7fcd2ffff700 1 --2- 172.21.15.3:0/1995709319 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcd3006d770 0x7fcd301418e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:06.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.753+0000 7fcd2ffff700 1 --2- 172.21.15.3:0/1995709319 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcd300beb80 0x7fcd301413a0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:06.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.753+0000 7fcd2ffff700 1 -- 172.21.15.3:0/1995709319 >> 172.21.15.3:0/1995709319 conn(0x7fcd30067bb0 msgr2=0x7fcd300be240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:06.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.753+0000 7fcd2ffff700 1 -- 172.21.15.3:0/1995709319 shutdown_connections 2023-10-08T15:38:06.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.753+0000 7fcd2ffff700 1 -- 172.21.15.3:0/1995709319 wait complete. 2023-10-08T15:38:06.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.757+0000 7fcd2ffff700 1 Processor -- start 2023-10-08T15:38:06.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.757+0000 7fcd2ffff700 1 -- start start 2023-10-08T15:38:06.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.757+0000 7fcd2ffff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcd3006c550 0x7fcd30144230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:06.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.757+0000 7fcd2ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd3006d770 0x7fcd3009fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:06.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.757+0000 7fcd2ffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcd300beb80 0x7fcd300a0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:06.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.757+0000 7fcd2ffff700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd300b9fc0 con 0x7fcd300beb80 2023-10-08T15:38:06.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.757+0000 7fcd2ffff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd300b90b0 con 0x7fcd3006d770 2023-10-08T15:38:06.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.757+0000 7fcd2ffff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd30144770 con 0x7fcd3006c550 2023-10-08T15:38:06.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.757+0000 7fcd2f7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcd300beb80 0x7fcd300a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:06.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.757+0000 7fcd2f7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcd300beb80 0x7fcd300a0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47960/0 (socket says 172.21.15.3:47960) 2023-10-08T15:38:06.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.757+0000 7fcd2f7fe700 1 -- 172.21.15.3:0/3557404414 learned_addr learned my addr 172.21.15.3:0/3557404414 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:38:06.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.757+0000 7fcd2e7fc700 1 --2- 172.21.15.3:0/3557404414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd3006d770 0x7fcd3009fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:06.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.757+0000 7fcd2effd700 1 --2- 172.21.15.3:0/3557404414 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcd3006c550 0x7fcd30144230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:06.767 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.757+0000 7fcd2f7fe700 1 -- 172.21.15.3:0/3557404414 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcd3006c550 msgr2=0x7fcd30144230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:06.767 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.757+0000 7fcd2f7fe700 1 --2- 172.21.15.3:0/3557404414 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcd3006c550 0x7fcd30144230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:06.767 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.761+0000 7fcd2f7fe700 1 -- 172.21.15.3:0/3557404414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd3006d770 msgr2=0x7fcd3009fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:06.767 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.761+0000 7fcd2f7fe700 1 --2- 172.21.15.3:0/3557404414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd3006d770 0x7fcd3009fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:06.767 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.761+0000 7fcd2f7fe700 1 -- 172.21.15.3:0/3557404414 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd24009420 con 0x7fcd300beb80 2023-10-08T15:38:06.767 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.761+0000 7fcd2f7fe700 1 --2- 172.21.15.3:0/3557404414 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcd300beb80 0x7fcd300a0310 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fcd2800c7e0 tx=0x7fcd28007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:06.767 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.761+0000 7fcd16ffd700 1 -- 172.21.15.3:0/3557404414 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd28005c00 con 0x7fcd300beb80 2023-10-08T15:38:06.767 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.761+0000 7fcd16ffd700 1 -- 172.21.15.3:0/3557404414 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd28005d80 con 0x7fcd300beb80 2023-10-08T15:38:06.767 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.761+0000 7fcd16ffd700 1 -- 172.21.15.3:0/3557404414 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd28007320 con 0x7fcd300beb80 2023-10-08T15:38:06.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.761+0000 7fcd2ffff700 1 -- 172.21.15.3:0/3557404414 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd300b92b0 con 0x7fcd300beb80 2023-10-08T15:38:06.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.761+0000 7fcd2ffff700 1 -- 172.21.15.3:0/3557404414 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd300b2b70 con 0x7fcd300beb80 2023-10-08T15:38:06.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.761+0000 7fcd2ffff700 1 -- 172.21.15.3:0/3557404414 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd3015e4f0 con 0x7fcd300beb80 2023-10-08T15:38:06.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.761+0000 7fcd16ffd700 1 -- 172.21.15.3:0/3557404414 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fcd2801b3b0 con 0x7fcd300beb80 2023-10-08T15:38:06.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.761+0000 7fcd16ffd700 1 --2- 172.21.15.3:0/3557404414 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fcd1c060550 0x7fcd1c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:06.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.761+0000 7fcd16ffd700 1 -- 172.21.15.3:0/3557404414 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fcd2807b9a0 con 0x7fcd300beb80 2023-10-08T15:38:06.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.765+0000 7fcd2effd700 1 --2- 172.21.15.3:0/3557404414 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fcd1c060550 0x7fcd1c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:06.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.765+0000 7fcd2effd700 1 --2- 172.21.15.3:0/3557404414 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fcd1c060550 0x7fcd1c062a00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcd240098e0 tx=0x7fcd24017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:06.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.769+0000 7fcd16ffd700 1 -- 172.21.15.3:0/3557404414 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fcd3015e4f0 con 0x7fcd300beb80 2023-10-08T15:38:06.847 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:38:06.850 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:38:06.852 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:38:06.855 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:38:06.857 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:38:07.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:06.993+0000 7fcd2ffff700 1 -- 172.21.15.3:0/3557404414 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fcd3015e4f0 con 0x7fcd300beb80 2023-10-08T15:38:07.008 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.001+0000 7fcd16ffd700 1 -- 172.21.15.3:0/3557404414 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7fcd3015e4f0 con 0x7fcd300beb80 2023-10-08T15:38:07.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.005+0000 7fcd2ffff700 1 -- 172.21.15.3:0/3557404414 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fcd1c060550 msgr2=0x7fcd1c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:07.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.005+0000 7fcd2ffff700 1 --2- 172.21.15.3:0/3557404414 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fcd1c060550 0x7fcd1c062a00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcd240098e0 tx=0x7fcd24017000 comp rx=0 tx=0).stop 2023-10-08T15:38:07.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.005+0000 7fcd2ffff700 1 -- 172.21.15.3:0/3557404414 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcd300beb80 msgr2=0x7fcd300a0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:07.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.005+0000 7fcd2ffff700 1 --2- 172.21.15.3:0/3557404414 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcd300beb80 0x7fcd300a0310 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fcd2800c7e0 tx=0x7fcd28007d90 comp rx=0 tx=0).stop 2023-10-08T15:38:07.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.005+0000 7fcd2ffff700 1 -- 172.21.15.3:0/3557404414 shutdown_connections 2023-10-08T15:38:07.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.005+0000 7fcd2ffff700 1 --2- 172.21.15.3:0/3557404414 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fcd1c060550 0x7fcd1c062a00 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:07.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.005+0000 7fcd2ffff700 1 --2- 172.21.15.3:0/3557404414 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcd300beb80 0x7fcd300a0310 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:07.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.005+0000 7fcd2ffff700 1 --2- 172.21.15.3:0/3557404414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd3006d770 0x7fcd3009fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:07.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.005+0000 7fcd2ffff700 1 --2- 172.21.15.3:0/3557404414 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcd3006c550 0x7fcd30144230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:07.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.005+0000 7fcd2ffff700 1 -- 172.21.15.3:0/3557404414 >> 172.21.15.3:0/3557404414 conn(0x7fcd30067bb0 msgr2=0x7fcd300a1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:07.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.005+0000 7fcd2ffff700 1 -- 172.21.15.3:0/3557404414 shutdown_connections 2023-10-08T15:38:07.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.005+0000 7fcd2ffff700 1 -- 172.21.15.3:0/3557404414 wait complete. 2023-10-08T15:38:07.024 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-08T15:38:07.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.125+0000 7f83e50b1700 1 Processor -- start 2023-10-08T15:38:07.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.125+0000 7f83e50b1700 1 -- start start 2023-10-08T15:38:07.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.125+0000 7f83e50b1700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f83e00bd4f0 0x7f83e00674b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:07.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.125+0000 7f83e50b1700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83e00bd2b0 con 0x7f83e0068ec0 2023-10-08T15:38:07.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.125+0000 7f83e50b1700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83e00a5940 con 0x7f83e00670e0 2023-10-08T15:38:07.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.125+0000 7f83e50b1700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83e0069f00 con 0x7f83e00bd4f0 2023-10-08T15:38:07.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.125+0000 7f83df7fe700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f83e0068ec0 0x7f83e014aa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:35248/0 (socket says 172.21.15.3:35248) 2023-10-08T15:38:07.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.125+0000 7f83df7fe700 1 -- 172.21.15.3:0/4117115066 learned_addr learned my addr 172.21.15.3:0/4117115066 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:38:07.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.125+0000 7f83e48b0700 1 --2- 172.21.15.3:0/4117115066 >> v2:172.21.15.50:3300/0 conn(0x7f83e00bd4f0 0x7f83e00674b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:07.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.125+0000 7f83deffd700 1 -- 172.21.15.3:0/4117115066 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 888120322 0 0) 0x7f83e00bd2b0 con 0x7f83e0068ec0 2023-10-08T15:38:07.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.125+0000 7f83deffd700 1 -- 172.21.15.3:0/4117115066 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83cc003570 con 0x7f83e0068ec0 2023-10-08T15:38:07.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.125+0000 7f83deffd700 1 -- 172.21.15.3:0/4117115066 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2318077682 0 0) 0x7f83e00a5940 con 0x7f83e00670e0 2023-10-08T15:38:07.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.125+0000 7f83deffd700 1 -- 172.21.15.3:0/4117115066 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83e00bd2b0 con 0x7f83e00670e0 2023-10-08T15:38:07.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.125+0000 7f83deffd700 1 -- 172.21.15.3:0/4117115066 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 335139334 0 0) 0x7f83cc003570 con 0x7f83e0068ec0 2023-10-08T15:38:07.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.125+0000 7f83deffd700 1 -- 172.21.15.3:0/4117115066 >> v2:172.21.15.50:3300/0 conn(0x7f83e00bd4f0 msgr2=0x7f83e00674b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:38:07.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.125+0000 7f83deffd700 1 --2- 172.21.15.3:0/4117115066 >> v2:172.21.15.50:3300/0 conn(0x7f83e00bd4f0 0x7f83e00674b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:07.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.125+0000 7f83deffd700 1 -- 172.21.15.3:0/4117115066 >> v1:172.21.15.50:6789/0 conn(0x7f83e00670e0 legacy=0x7f83e00687b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:07.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.125+0000 7f83deffd700 1 -- 172.21.15.3:0/4117115066 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e014f5a0 con 0x7f83e0068ec0 2023-10-08T15:38:07.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.125+0000 7f83deffd700 1 -- 172.21.15.3:0/4117115066 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2285686191 0 0) 0x7f83d00017f0 con 0x7f83e0068ec0 2023-10-08T15:38:07.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.125+0000 7f83deffd700 1 -- 172.21.15.3:0/4117115066 >> v1:172.21.15.3:6789/0 conn(0x7f83e0068ec0 legacy=0x7f83e014aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:07.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.125+0000 7f83deffd700 1 --2- 172.21.15.3:0/4117115066 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f83cc003bf0 0x7f83cc003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:07.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.125+0000 7f83deffd700 1 --2- 172.21.15.3:0/4117115066 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83cc004810 0x7f83cc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:07.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.125+0000 7f83deffd700 1 --2- 172.21.15.3:0/4117115066 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83cc0051c0 0x7f83cc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:07.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.125+0000 7f83deffd700 1 -- 172.21.15.3:0/4117115066 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e0069f00 con 0x7f83cc004810 2023-10-08T15:38:07.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.125+0000 7f83deffd700 1 -- 172.21.15.3:0/4117115066 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83cc00c160 con 0x7f83cc0051c0 2023-10-08T15:38:07.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.125+0000 7f83deffd700 1 -- 172.21.15.3:0/4117115066 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83cc00c320 con 0x7f83cc003bf0 2023-10-08T15:38:07.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.129+0000 7f83df7fe700 1 --2- 172.21.15.3:0/4117115066 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83cc004810 0x7f83cc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:07.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.129+0000 7f83dffff700 1 --2- 172.21.15.3:0/4117115066 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f83cc003bf0 0x7f83cc003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:07.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.129+0000 7f83e48b0700 1 --2- 172.21.15.3:0/4117115066 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83cc0051c0 0x7f83cc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:07.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.129+0000 7f83df7fe700 1 -- 172.21.15.3:0/4117115066 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f83cc003bf0 msgr2=0x7f83cc003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:38:07.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.129+0000 7f83df7fe700 1 --2- 172.21.15.3:0/4117115066 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f83cc003bf0 0x7f83cc003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:07.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.129+0000 7f83df7fe700 1 -- 172.21.15.3:0/4117115066 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83cc0051c0 msgr2=0x7f83cc00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:38:07.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.129+0000 7f83df7fe700 1 --2- 172.21.15.3:0/4117115066 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83cc0051c0 0x7f83cc00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:07.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.129+0000 7f83df7fe700 1 -- 172.21.15.3:0/4117115066 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83cc003570 con 0x7f83cc004810 2023-10-08T15:38:07.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.129+0000 7f83e48b0700 1 -- 172.21.15.3:0/4117115066 reap_dead start 2023-10-08T15:38:07.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.129+0000 7f83df7fe700 1 --2- 172.21.15.3:0/4117115066 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83cc004810 0x7f83cc004c80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f83e00692e0 tx=0x7f83d0002190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ee82e35bec35ef7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:07.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.129+0000 7f83deffd700 1 -- 172.21.15.3:0/4117115066 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d00070d0 con 0x7f83cc004810 2023-10-08T15:38:07.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.129+0000 7f83deffd700 1 -- 172.21.15.3:0/4117115066 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83d0007230 con 0x7f83cc004810 2023-10-08T15:38:07.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.129+0000 7f83deffd700 1 -- 172.21.15.3:0/4117115066 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d00075f0 con 0x7f83cc004810 2023-10-08T15:38:07.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.129+0000 7f83e50b1700 1 -- 172.21.15.3:0/4117115066 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83cc004810 msgr2=0x7f83cc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:07.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.129+0000 7f83e50b1700 1 --2- 172.21.15.3:0/4117115066 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83cc004810 0x7f83cc004c80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f83e00692e0 tx=0x7f83d0002190 comp rx=0 tx=0).stop 2023-10-08T15:38:07.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.129+0000 7f83e50b1700 1 -- 172.21.15.3:0/4117115066 shutdown_connections 2023-10-08T15:38:07.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.129+0000 7f83e50b1700 1 --2- 172.21.15.3:0/4117115066 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83cc004810 0x7f83cc004c80 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:07.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.129+0000 7f83e50b1700 1 -- 172.21.15.3:0/4117115066 >> 172.21.15.3:0/4117115066 conn(0x7f83e006a760 msgr2=0x7f83e006dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:07.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.129+0000 7f83e50b1700 1 -- 172.21.15.3:0/4117115066 shutdown_connections 2023-10-08T15:38:07.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.129+0000 7f83e50b1700 1 -- 172.21.15.3:0/4117115066 wait complete. 2023-10-08T15:38:07.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.129+0000 7f83e50b1700 1 Processor -- start 2023-10-08T15:38:07.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.129+0000 7f83e50b1700 1 -- start start 2023-10-08T15:38:07.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.133+0000 7f83e50b1700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f83cc004810 0x7f83e015bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:07.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.133+0000 7f83e50b1700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83e00ba3a0 0x7f83e015e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:07.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.133+0000 7f83e50b1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83e015ec50 0x7f83e014c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:07.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.133+0000 7f83e50b1700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e015f430 con 0x7f83e00ba3a0 2023-10-08T15:38:07.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.133+0000 7f83e50b1700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e015f0c0 con 0x7f83e015ec50 2023-10-08T15:38:07.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.133+0000 7f83e50b1700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83e014af40 con 0x7f83cc004810 2023-10-08T15:38:07.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.133+0000 7f83df7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83e00ba3a0 0x7f83e015e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:07.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.133+0000 7f83df7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83e00ba3a0 0x7f83e015e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47978/0 (socket says 172.21.15.3:47978) 2023-10-08T15:38:07.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.133+0000 7f83df7fe700 1 -- 172.21.15.3:0/3585692607 learned_addr learned my addr 172.21.15.3:0/3585692607 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:38:07.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.133+0000 7f83dffff700 1 --2- 172.21.15.3:0/3585692607 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f83cc004810 0x7f83e015bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:07.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.133+0000 7f83e48b0700 1 --2- 172.21.15.3:0/3585692607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83e015ec50 0x7f83e014c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:07.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.133+0000 7f83df7fe700 1 -- 172.21.15.3:0/3585692607 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f83cc004810 msgr2=0x7f83e015bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:07.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.133+0000 7f83df7fe700 1 --2- 172.21.15.3:0/3585692607 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f83cc004810 0x7f83e015bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:07.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.133+0000 7f83df7fe700 1 -- 172.21.15.3:0/3585692607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83e015ec50 msgr2=0x7f83e014c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:07.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.133+0000 7f83df7fe700 1 --2- 172.21.15.3:0/3585692607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83e015ec50 0x7f83e014c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:07.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.133+0000 7f83df7fe700 1 -- 172.21.15.3:0/3585692607 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e014b100 con 0x7f83e00ba3a0 2023-10-08T15:38:07.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.133+0000 7f83df7fe700 1 --2- 172.21.15.3:0/3585692607 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83e00ba3a0 0x7f83e015e710 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f83cc00c130 tx=0x7f83d0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:07.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.133+0000 7f83d7fff700 1 -- 172.21.15.3:0/3585692607 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d0001a90 con 0x7f83e00ba3a0 2023-10-08T15:38:07.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.133+0000 7f83d7fff700 1 -- 172.21.15.3:0/3585692607 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83d001d450 con 0x7f83e00ba3a0 2023-10-08T15:38:07.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.133+0000 7f83e50b1700 1 -- 172.21.15.3:0/3585692607 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83e014e3d0 con 0x7f83e00ba3a0 2023-10-08T15:38:07.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.133+0000 7f83d7fff700 1 -- 172.21.15.3:0/3585692607 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d001d600 con 0x7f83e00ba3a0 2023-10-08T15:38:07.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.133+0000 7f83e50b1700 1 -- 172.21.15.3:0/3585692607 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83e014ce50 con 0x7f83e00ba3a0 2023-10-08T15:38:07.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.133+0000 7f83e50b1700 1 -- 172.21.15.3:0/3585692607 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83e005ecf0 con 0x7f83e00ba3a0 2023-10-08T15:38:07.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.137+0000 7f83d7fff700 1 -- 172.21.15.3:0/3585692607 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f83d0024030 con 0x7f83e00ba3a0 2023-10-08T15:38:07.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.137+0000 7f83d7fff700 1 --2- 172.21.15.3:0/3585692607 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f83c0060550 0x7f83c0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:07.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.137+0000 7f83d7fff700 1 -- 172.21.15.3:0/3585692607 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f83d007e4d0 con 0x7f83e00ba3a0 2023-10-08T15:38:07.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.137+0000 7f83dffff700 1 --2- 172.21.15.3:0/3585692607 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f83c0060550 0x7f83c0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:07.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.137+0000 7f83dffff700 1 --2- 172.21.15.3:0/3585692607 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f83c0060550 0x7f83c0062a00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f83c80010e0 tx=0x7f83c8007d30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:07.151 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.145+0000 7f83d7fff700 1 -- 172.21.15.3:0/3585692607 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f83d004ed70 con 0x7f83e00ba3a0 2023-10-08T15:38:07.365 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.357+0000 7f83e50b1700 1 -- 172.21.15.3:0/3585692607 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f83e00bdf00 con 0x7f83e00ba3a0 2023-10-08T15:38:07.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.365+0000 7f83d7fff700 1 -- 172.21.15.3:0/3585692607 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f83d0052390 con 0x7f83e00ba3a0 2023-10-08T15:38:07.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.365+0000 7f83e50b1700 1 -- 172.21.15.3:0/3585692607 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f83c0060550 msgr2=0x7f83c0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:07.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.365+0000 7f83e50b1700 1 --2- 172.21.15.3:0/3585692607 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f83c0060550 0x7f83c0062a00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f83c80010e0 tx=0x7f83c8007d30 comp rx=0 tx=0).stop 2023-10-08T15:38:07.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.365+0000 7f83e50b1700 1 -- 172.21.15.3:0/3585692607 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83e00ba3a0 msgr2=0x7f83e015e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:07.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.365+0000 7f83e50b1700 1 --2- 172.21.15.3:0/3585692607 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83e00ba3a0 0x7f83e015e710 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f83cc00c130 tx=0x7f83d0016000 comp rx=0 tx=0).stop 2023-10-08T15:38:07.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.365+0000 7f83e50b1700 1 -- 172.21.15.3:0/3585692607 shutdown_connections 2023-10-08T15:38:07.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.365+0000 7f83e50b1700 1 --2- 172.21.15.3:0/3585692607 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f83c0060550 0x7f83c0062a00 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:07.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.365+0000 7f83e50b1700 1 --2- 172.21.15.3:0/3585692607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83e015ec50 0x7f83e014c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:07.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.365+0000 7f83e50b1700 1 --2- 172.21.15.3:0/3585692607 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83e00ba3a0 0x7f83e015e710 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:07.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.365+0000 7f83e50b1700 1 --2- 172.21.15.3:0/3585692607 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f83cc004810 0x7f83e015bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:07.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.365+0000 7f83e50b1700 1 -- 172.21.15.3:0/3585692607 >> 172.21.15.3:0/3585692607 conn(0x7f83e006a760 msgr2=0x7f83e01502d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:07.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.365+0000 7f83e50b1700 1 -- 172.21.15.3:0/3585692607 shutdown_connections 2023-10-08T15:38:07.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.365+0000 7f83e50b1700 1 -- 172.21.15.3:0/3585692607 wait complete. 2023-10-08T15:38:07.385 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-08T15:38:07.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.485+0000 7f3e05fe4700 1 Processor -- start 2023-10-08T15:38:07.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.485+0000 7f3e05fe4700 1 -- start start 2023-10-08T15:38:07.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.489+0000 7f3e05fe4700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f3e000bddf0 0x7f3e000c28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:07.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.489+0000 7f3e05fe4700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3e000bc970 0x7f3e000bcdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:07.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.489+0000 7f3e05fe4700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e000bfcd0 con 0x7f3e000c24e0 2023-10-08T15:38:07.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.489+0000 7f3e05fe4700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e0014c2e0 con 0x7f3e000bddf0 2023-10-08T15:38:07.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.489+0000 7f3e05fe4700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e000bff20 con 0x7f3e000bc970 2023-10-08T15:38:07.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.489+0000 7f3dfffff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f3e000bddf0 0x7f3e000c28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:07.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.489+0000 7f3e04fe2700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3e000c24e0 0x7f3e000c0440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.3:49702/0 (socket says 172.21.15.3:49702) 2023-10-08T15:38:07.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.489+0000 7f3e04fe2700 1 -- 172.21.15.3:0/2967493527 learned_addr learned my addr 172.21.15.3:0/2967493527 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:38:07.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.489+0000 7f3e057e3700 1 --2- 172.21.15.3:0/2967493527 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3e000bc970 0x7f3e000bcdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:07.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.489+0000 7f3dff7fe700 1 -- 172.21.15.3:0/2967493527 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3646708688 0 0) 0x7f3e000bfcd0 con 0x7f3e000c24e0 2023-10-08T15:38:07.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.489+0000 7f3dff7fe700 1 -- 172.21.15.3:0/2967493527 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3de8003570 con 0x7f3e000c24e0 2023-10-08T15:38:07.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.489+0000 7f3dfffff700 1 -- 172.21.15.3:0/2967493527 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3e000bc970 msgr2=0x7f3e000bcdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:38:07.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.489+0000 7f3dfffff700 1 --2- 172.21.15.3:0/2967493527 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3e000bc970 0x7f3e000bcdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:07.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.489+0000 7f3dfffff700 1 -- 172.21.15.3:0/2967493527 >> v1:172.21.15.50:6789/0 conn(0x7f3e000c24e0 legacy=0x7f3e000c0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:07.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.489+0000 7f3dfffff700 1 -- 172.21.15.3:0/2967493527 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e00148e40 con 0x7f3e000bddf0 2023-10-08T15:38:07.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.489+0000 7f3dfffff700 1 --2- 172.21.15.3:0/2967493527 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e000bddf0 0x7f3e000c28b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3df40098e0 tx=0x7f3df40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8104ffccda59e67f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:07.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.489+0000 7f3dff7fe700 1 -- 172.21.15.3:0/2967493527 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df4011630 con 0x7f3e000bddf0 2023-10-08T15:38:07.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.489+0000 7f3dff7fe700 1 -- 172.21.15.3:0/2967493527 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df4011790 con 0x7f3e000bddf0 2023-10-08T15:38:07.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.489+0000 7f3dff7fe700 1 -- 172.21.15.3:0/2967493527 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df4011b30 con 0x7f3e000bddf0 2023-10-08T15:38:07.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.489+0000 7f3e05fe4700 1 -- 172.21.15.3:0/2967493527 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e000bddf0 msgr2=0x7f3e000c28b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:07.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.489+0000 7f3e05fe4700 1 --2- 172.21.15.3:0/2967493527 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e000bddf0 0x7f3e000c28b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3df40098e0 tx=0x7f3df40091a0 comp rx=0 tx=0).stop 2023-10-08T15:38:07.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.489+0000 7f3e05fe4700 1 -- 172.21.15.3:0/2967493527 shutdown_connections 2023-10-08T15:38:07.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.489+0000 7f3e05fe4700 1 --2- 172.21.15.3:0/2967493527 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3e000bc970 0x7f3e000bcdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:07.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.489+0000 7f3e05fe4700 1 --2- 172.21.15.3:0/2967493527 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e000bddf0 0x7f3e000c28b0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:07.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.489+0000 7f3e05fe4700 1 -- 172.21.15.3:0/2967493527 >> 172.21.15.3:0/2967493527 conn(0x7f3e000a2310 msgr2=0x7f3e000c1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:07.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.489+0000 7f3e05fe4700 1 -- 172.21.15.3:0/2967493527 shutdown_connections 2023-10-08T15:38:07.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.489+0000 7f3e05fe4700 1 -- 172.21.15.3:0/2967493527 wait complete. 2023-10-08T15:38:07.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.493+0000 7f3e05fe4700 1 Processor -- start 2023-10-08T15:38:07.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.493+0000 7f3e05fe4700 1 -- start start 2023-10-08T15:38:07.501 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.493+0000 7f3e05fe4700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e000bc970 0x7f3e000ba860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:07.502 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.493+0000 7f3e05fe4700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3e000bddf0 0x7f3e0015e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:07.502 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.493+0000 7f3e05fe4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e000c24e0 0x7f3e0014ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:07.502 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.493+0000 7f3e05fe4700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0015f530 con 0x7f3e000bc970 2023-10-08T15:38:07.502 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.493+0000 7f3e05fe4700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0015f050 con 0x7f3e000c24e0 2023-10-08T15:38:07.502 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.493+0000 7f3e05fe4700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0015ed90 con 0x7f3e000bddf0 2023-10-08T15:38:07.502 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.493+0000 7f3e04fe2700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e000bc970 0x7f3e000ba860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:07.502 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.493+0000 7f3e057e3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e000c24e0 0x7f3e0014ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:07.502 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.493+0000 7f3e04fe2700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e000bc970 0x7f3e000ba860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47996/0 (socket says 172.21.15.3:47996) 2023-10-08T15:38:07.502 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.493+0000 7f3e04fe2700 1 -- 172.21.15.3:0/2482805704 learned_addr learned my addr 172.21.15.3:0/2482805704 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:38:07.502 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.497+0000 7f3dfffff700 1 --2- 172.21.15.3:0/2482805704 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3e000bddf0 0x7f3e0015e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:07.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.497+0000 7f3e04fe2700 1 -- 172.21.15.3:0/2482805704 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3e000bddf0 msgr2=0x7f3e0015e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:07.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.497+0000 7f3e04fe2700 1 --2- 172.21.15.3:0/2482805704 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3e000bddf0 0x7f3e0015e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:07.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.497+0000 7f3e04fe2700 1 -- 172.21.15.3:0/2482805704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e000c24e0 msgr2=0x7f3e0014ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:07.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.497+0000 7f3e04fe2700 1 --2- 172.21.15.3:0/2482805704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e000c24e0 0x7f3e0014ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:07.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.497+0000 7f3e04fe2700 1 -- 172.21.15.3:0/2482805704 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df4009420 con 0x7f3e000bc970 2023-10-08T15:38:07.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.497+0000 7f3e04fe2700 1 --2- 172.21.15.3:0/2482805704 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e000bc970 0x7f3e000ba860 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3df800cd30 tx=0x7f3df8001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:07.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.497+0000 7f3dfcff9700 1 -- 172.21.15.3:0/2482805704 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df800ce90 con 0x7f3e000bc970 2023-10-08T15:38:07.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.497+0000 7f3dfcff9700 1 -- 172.21.15.3:0/2482805704 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df800aac0 con 0x7f3e000bc970 2023-10-08T15:38:07.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.497+0000 7f3e05fe4700 1 -- 172.21.15.3:0/2482805704 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e001482b0 con 0x7f3e000bc970 2023-10-08T15:38:07.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.497+0000 7f3dfcff9700 1 -- 172.21.15.3:0/2482805704 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df800aea0 con 0x7f3e000bc970 2023-10-08T15:38:07.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.497+0000 7f3e05fe4700 1 -- 172.21.15.3:0/2482805704 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e000bbcb0 con 0x7f3e000bc970 2023-10-08T15:38:07.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.497+0000 7f3e05fe4700 1 -- 172.21.15.3:0/2482805704 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e001480d0 con 0x7f3e000bc970 2023-10-08T15:38:07.505 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.497+0000 7f3dfcff9700 1 -- 172.21.15.3:0/2482805704 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f3df8007300 con 0x7f3e000bc970 2023-10-08T15:38:07.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.501+0000 7f3dfcff9700 1 --2- 172.21.15.3:0/2482805704 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3dec060580 0x7f3dec062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:07.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.501+0000 7f3dfcff9700 1 -- 172.21.15.3:0/2482805704 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3df807c7f0 con 0x7f3e000bc970 2023-10-08T15:38:07.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.501+0000 7f3dfffff700 1 --2- 172.21.15.3:0/2482805704 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3dec060580 0x7f3dec062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:07.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.501+0000 7f3dfffff700 1 --2- 172.21.15.3:0/2482805704 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3dec060580 0x7f3dec062a30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3e00153060 tx=0x7f3df4017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:07.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.509+0000 7f3dfcff9700 1 -- 172.21.15.3:0/2482805704 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3df804d1b0 con 0x7f3e000bc970 2023-10-08T15:38:07.734 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.729+0000 7f3e05fe4700 1 -- 172.21.15.3:0/2482805704 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f3e0015f210 con 0x7f3e000bc970 2023-10-08T15:38:07.740 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.733+0000 7f3dfcff9700 1 -- 172.21.15.3:0/2482805704 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f3df80507d0 con 0x7f3e000bc970 2023-10-08T15:38:07.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.737+0000 7f3e05fe4700 1 -- 172.21.15.3:0/2482805704 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3dec060580 msgr2=0x7f3dec062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:07.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.737+0000 7f3e05fe4700 1 --2- 172.21.15.3:0/2482805704 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3dec060580 0x7f3dec062a30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3e00153060 tx=0x7f3df4017000 comp rx=0 tx=0).stop 2023-10-08T15:38:07.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.737+0000 7f3e05fe4700 1 -- 172.21.15.3:0/2482805704 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e000bc970 msgr2=0x7f3e000ba860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:07.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.737+0000 7f3e05fe4700 1 --2- 172.21.15.3:0/2482805704 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e000bc970 0x7f3e000ba860 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3df800cd30 tx=0x7f3df8001b10 comp rx=0 tx=0).stop 2023-10-08T15:38:07.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.737+0000 7f3e05fe4700 1 -- 172.21.15.3:0/2482805704 shutdown_connections 2023-10-08T15:38:07.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.737+0000 7f3e05fe4700 1 --2- 172.21.15.3:0/2482805704 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3dec060580 0x7f3dec062a30 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:07.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.737+0000 7f3e05fe4700 1 --2- 172.21.15.3:0/2482805704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e000c24e0 0x7f3e0014ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:07.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.737+0000 7f3e05fe4700 1 --2- 172.21.15.3:0/2482805704 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3e000bddf0 0x7f3e0015e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:07.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.737+0000 7f3e05fe4700 1 --2- 172.21.15.3:0/2482805704 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e000bc970 0x7f3e000ba860 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:07.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.737+0000 7f3e05fe4700 1 -- 172.21.15.3:0/2482805704 >> 172.21.15.3:0/2482805704 conn(0x7f3e000a2310 msgr2=0x7f3e00067200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:07.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.737+0000 7f3e05fe4700 1 -- 172.21.15.3:0/2482805704 shutdown_connections 2023-10-08T15:38:07.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.737+0000 7f3e05fe4700 1 -- 172.21.15.3:0/2482805704 wait complete. 2023-10-08T15:38:07.759 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-08T15:38:07.869 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.865+0000 7efe0094f700 1 Processor -- start 2023-10-08T15:38:07.870 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.865+0000 7efe0094f700 1 -- start start 2023-10-08T15:38:07.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.865+0000 7efe0094f700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efdfc0bab30 0x7efdfc0baf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:07.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.865+0000 7efe0094f700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7efdfc14d330 0x7efdfc0a0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:07.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.865+0000 7efe0094f700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efdfc0a2460 0x7efdfc149da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:07.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.865+0000 7efe0094f700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdfc14d820 con 0x7efdfc14d330 2023-10-08T15:38:07.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.865+0000 7efe0094f700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdfc149910 con 0x7efdfc0a2460 2023-10-08T15:38:07.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.865+0000 7efe0094f700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc1495a0 con 0x7efdfc0bab30 2023-10-08T15:38:07.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.865+0000 7efdf3fff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7efdfc14d330 0x7efdfc0a0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:07.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.865+0000 7efdf3fff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7efdfc14d330 0x7efdfc0a0920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:48008/0 (socket says 172.21.15.3:48008) 2023-10-08T15:38:07.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.865+0000 7efdf3fff700 1 -- 172.21.15.3:0/952896406 learned_addr learned my addr 172.21.15.3:0/952896406 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:38:07.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.865+0000 7efdfb59e700 1 --2- 172.21.15.3:0/952896406 >> v2:172.21.15.50:3300/0 conn(0x7efdfc0a2460 0x7efdfc149da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:07.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.865+0000 7efdfad9d700 1 --2- 172.21.15.3:0/952896406 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efdfc0bab30 0x7efdfc0baf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:07.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.865+0000 7efdf3fff700 1 -- 172.21.15.3:0/952896406 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efdfc0bab30 msgr2=0x7efdfc0baf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:38:07.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.865+0000 7efdf3fff700 1 --2- 172.21.15.3:0/952896406 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efdfc0bab30 0x7efdfc0baf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:07.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.865+0000 7efdf3fff700 1 -- 172.21.15.3:0/952896406 >> v2:172.21.15.50:3300/0 conn(0x7efdfc0a2460 msgr2=0x7efdfc149da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:38:07.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.865+0000 7efdf3fff700 1 --2- 172.21.15.3:0/952896406 >> v2:172.21.15.50:3300/0 conn(0x7efdfc0a2460 0x7efdfc149da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:07.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.865+0000 7efdf3fff700 1 -- 172.21.15.3:0/952896406 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdfc0a0e60 con 0x7efdfc14d330 2023-10-08T15:38:07.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.865+0000 7efdf3fff700 1 --2- 172.21.15.3:0/952896406 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efdfc14d330 0x7efdfc0a0920 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7efdfc09d310 tx=0x7efde4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52ab0cb86cf5723a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:07.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.865+0000 7efdfa59c700 1 -- 172.21.15.3:0/952896406 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde400b640 con 0x7efdfc14d330 2023-10-08T15:38:07.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.865+0000 7efdfa59c700 1 -- 172.21.15.3:0/952896406 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde400b7a0 con 0x7efdfc14d330 2023-10-08T15:38:07.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.865+0000 7efdfa59c700 1 -- 172.21.15.3:0/952896406 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde400bb60 con 0x7efdfc14d330 2023-10-08T15:38:07.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.865+0000 7efe0094f700 1 -- 172.21.15.3:0/952896406 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efdfc14d330 msgr2=0x7efdfc0a0920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:07.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.865+0000 7efe0094f700 1 --2- 172.21.15.3:0/952896406 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efdfc14d330 0x7efdfc0a0920 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7efdfc09d310 tx=0x7efde4009250 comp rx=0 tx=0).stop 2023-10-08T15:38:07.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.865+0000 7efe0094f700 1 -- 172.21.15.3:0/952896406 shutdown_connections 2023-10-08T15:38:07.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.865+0000 7efe0094f700 1 --2- 172.21.15.3:0/952896406 >> v2:172.21.15.50:3300/0 conn(0x7efdfc0a2460 0x7efdfc149da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:07.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.865+0000 7efe0094f700 1 --2- 172.21.15.3:0/952896406 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efdfc14d330 0x7efdfc0a0920 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:07.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.865+0000 7efe0094f700 1 --2- 172.21.15.3:0/952896406 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efdfc0bab30 0x7efdfc0baf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:07.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.865+0000 7efe0094f700 1 -- 172.21.15.3:0/952896406 >> 172.21.15.3:0/952896406 conn(0x7efdfc0be440 msgr2=0x7efdfc0ba420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:07.875 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.865+0000 7efe0094f700 1 -- 172.21.15.3:0/952896406 shutdown_connections 2023-10-08T15:38:07.875 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.865+0000 7efe0094f700 1 -- 172.21.15.3:0/952896406 wait complete. 2023-10-08T15:38:07.875 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.869+0000 7efe0094f700 1 Processor -- start 2023-10-08T15:38:07.875 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.869+0000 7efe0094f700 1 -- start start 2023-10-08T15:38:07.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.869+0000 7efe0094f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdfc0a2460 0x7efdfc096fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:07.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.869+0000 7efe0094f700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efdfc0bab30 0x7efdfc0bcec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:07.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.869+0000 7efe0094f700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efdfc14d330 0x7efdfc14bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:07.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.869+0000 7efe0094f700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc1586c0 con 0x7efdfc0bab30 2023-10-08T15:38:07.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.869+0000 7efe0094f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc14b850 con 0x7efdfc0a2460 2023-10-08T15:38:07.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.869+0000 7efe0094f700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc14bb30 con 0x7efdfc14d330 2023-10-08T15:38:07.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.869+0000 7efdfad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdfc0a2460 0x7efdfc096fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:07.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.869+0000 7efdf3fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efdfc0bab30 0x7efdfc0bcec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:07.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.869+0000 7efdfad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdfc0a2460 0x7efdfc096fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.3:43476/0 (socket says 172.21.15.3:43476) 2023-10-08T15:38:07.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.869+0000 7efdfad9d700 1 -- 172.21.15.3:0/3948429379 learned_addr learned my addr 172.21.15.3:0/3948429379 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:38:07.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.869+0000 7efdfb59e700 1 --2- 172.21.15.3:0/3948429379 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efdfc14d330 0x7efdfc14bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:07.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.869+0000 7efdf3fff700 1 -- 172.21.15.3:0/3948429379 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efdfc14d330 msgr2=0x7efdfc14bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:07.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.869+0000 7efdf3fff700 1 --2- 172.21.15.3:0/3948429379 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efdfc14d330 0x7efdfc14bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:07.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.869+0000 7efdf3fff700 1 -- 172.21.15.3:0/3948429379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdfc0a2460 msgr2=0x7efdfc096fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:07.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.869+0000 7efdf3fff700 1 --2- 172.21.15.3:0/3948429379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdfc0a2460 0x7efdfc096fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:07.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.869+0000 7efdf3fff700 1 -- 172.21.15.3:0/3948429379 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde40094f0 con 0x7efdfc0bab30 2023-10-08T15:38:07.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.869+0000 7efdfad9d700 1 --2- 172.21.15.3:0/3948429379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdfc0a2460 0x7efdfc096fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:38:07.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.869+0000 7efdf3fff700 1 --2- 172.21.15.3:0/3948429379 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efdfc0bab30 0x7efdfc0bcec0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7efde4013000 tx=0x7efde4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:07.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.869+0000 7efdf2ffd700 1 -- 172.21.15.3:0/3948429379 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde400b910 con 0x7efdfc0bab30 2023-10-08T15:38:07.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.869+0000 7efdf2ffd700 1 -- 172.21.15.3:0/3948429379 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde400ba90 con 0x7efdfc0bab30 2023-10-08T15:38:07.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.869+0000 7efe0094f700 1 -- 172.21.15.3:0/3948429379 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdfc096170 con 0x7efdfc0bab30 2023-10-08T15:38:07.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.869+0000 7efdf2ffd700 1 -- 172.21.15.3:0/3948429379 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde401a6a0 con 0x7efdfc0bab30 2023-10-08T15:38:07.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.869+0000 7efe0094f700 1 -- 172.21.15.3:0/3948429379 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdfc158910 con 0x7efdfc0bab30 2023-10-08T15:38:07.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.873+0000 7efe0094f700 1 -- 172.21.15.3:0/3948429379 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdfc05ecf0 con 0x7efdfc0bab30 2023-10-08T15:38:07.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.873+0000 7efdf2ffd700 1 -- 172.21.15.3:0/3948429379 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7efde401aa50 con 0x7efdfc0bab30 2023-10-08T15:38:07.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.873+0000 7efdf2ffd700 1 --2- 172.21.15.3:0/3948429379 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7efddc060550 0x7efddc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:07.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.873+0000 7efdf2ffd700 1 -- 172.21.15.3:0/3948429379 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4853+0+0 (secure 0 0 0) 0x7efde407d9f0 con 0x7efdfc0bab30 2023-10-08T15:38:07.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.873+0000 7efdfad9d700 1 --2- 172.21.15.3:0/3948429379 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7efddc060550 0x7efddc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:07.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.877+0000 7efdfad9d700 1 --2- 172.21.15.3:0/3948429379 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7efddc060550 0x7efddc062a00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7efdec009fd0 tx=0x7efdec0091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:07.887 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:07.881+0000 7efdf2ffd700 1 -- 172.21.15.3:0/3948429379 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7efde404e3b0 con 0x7efdfc0bab30 2023-10-08T15:38:08.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.097+0000 7efe0094f700 1 -- 172.21.15.3:0/3948429379 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7efdfc06fd90 con 0x7efdfc0bab30 2023-10-08T15:38:08.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.105+0000 7efdf2ffd700 1 -- 172.21.15.3:0/3948429379 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7efde4009350 con 0x7efdfc0bab30 2023-10-08T15:38:08.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.105+0000 7efe0094f700 1 -- 172.21.15.3:0/3948429379 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7efddc060550 msgr2=0x7efddc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:08.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.105+0000 7efe0094f700 1 --2- 172.21.15.3:0/3948429379 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7efddc060550 0x7efddc062a00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7efdec009fd0 tx=0x7efdec0091a0 comp rx=0 tx=0).stop 2023-10-08T15:38:08.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.105+0000 7efe0094f700 1 -- 172.21.15.3:0/3948429379 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efdfc0bab30 msgr2=0x7efdfc0bcec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:08.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.105+0000 7efe0094f700 1 --2- 172.21.15.3:0/3948429379 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efdfc0bab30 0x7efdfc0bcec0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7efde4013000 tx=0x7efde4017000 comp rx=0 tx=0).stop 2023-10-08T15:38:08.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.105+0000 7efe0094f700 1 -- 172.21.15.3:0/3948429379 shutdown_connections 2023-10-08T15:38:08.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.105+0000 7efe0094f700 1 --2- 172.21.15.3:0/3948429379 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7efddc060550 0x7efddc062a00 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:08.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.105+0000 7efe0094f700 1 --2- 172.21.15.3:0/3948429379 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efdfc14d330 0x7efdfc14bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:08.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.105+0000 7efe0094f700 1 --2- 172.21.15.3:0/3948429379 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efdfc0bab30 0x7efdfc0bcec0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:08.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.105+0000 7efe0094f700 1 --2- 172.21.15.3:0/3948429379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdfc0a2460 0x7efdfc096fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:08.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.105+0000 7efe0094f700 1 -- 172.21.15.3:0/3948429379 >> 172.21.15.3:0/3948429379 conn(0x7efdfc0be440 msgr2=0x7efdfc148250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:08.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.105+0000 7efe0094f700 1 -- 172.21.15.3:0/3948429379 shutdown_connections 2023-10-08T15:38:08.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.105+0000 7efe0094f700 1 -- 172.21.15.3:0/3948429379 wait complete. 2023-10-08T15:38:08.125 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:38:08.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.221+0000 7f92f0903700 1 Processor -- start 2023-10-08T15:38:08.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.221+0000 7f92f0903700 1 -- start start 2023-10-08T15:38:08.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.221+0000 7f92f0903700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f92ec0670e0 0x7f92ec0674b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:08.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.221+0000 7f92f0903700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f92ec149040 0x7f92ec09f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:08.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.221+0000 7f92f0903700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92ec0a1440 con 0x7f92ec14d2f0 2023-10-08T15:38:08.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.221+0000 7f92f0903700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92ec0a1900 con 0x7f92ec149040 2023-10-08T15:38:08.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.221+0000 7f92f0903700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92ec1494f0 con 0x7f92ec0670e0 2023-10-08T15:38:08.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.221+0000 7f92ea59c700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f92ec149040 0x7f92ec09f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:08.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.221+0000 7f92ea59c700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f92ec149040 0x7f92ec09f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:48022/0 (socket says 172.21.15.3:48022) 2023-10-08T15:38:08.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.221+0000 7f92ea59c700 1 -- 172.21.15.3:0/2959636431 learned_addr learned my addr 172.21.15.3:0/2959636431 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:38:08.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.221+0000 7f92ead9d700 1 --2- 172.21.15.3:0/2959636431 >> v2:172.21.15.50:3300/0 conn(0x7f92ec0670e0 0x7f92ec0674b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:08.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.221+0000 7f92ea59c700 1 -- 172.21.15.3:0/2959636431 >> v2:172.21.15.50:3300/0 conn(0x7f92ec0670e0 msgr2=0x7f92ec0674b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:38:08.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.221+0000 7f92ea59c700 1 --2- 172.21.15.3:0/2959636431 >> v2:172.21.15.50:3300/0 conn(0x7f92ec0670e0 0x7f92ec0674b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:08.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.221+0000 7f92ea59c700 1 -- 172.21.15.3:0/2959636431 >> v1:172.21.15.50:6789/0 conn(0x7f92ec14d2f0 legacy=0x7f92ec0a0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:08.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.221+0000 7f92ea59c700 1 -- 172.21.15.3:0/2959636431 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92ec1497d0 con 0x7f92ec149040 2023-10-08T15:38:08.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.221+0000 7f92ea59c700 1 --2- 172.21.15.3:0/2959636431 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f92ec149040 0x7f92ec09f800 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f92ec06ddb0 tx=0x7f92dc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7988103cc1a5ad8a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:08.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.221+0000 7f92e9d9b700 1 -- 172.21.15.3:0/2959636431 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92dc009e70 con 0x7f92ec149040 2023-10-08T15:38:08.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.221+0000 7f92e9d9b700 1 -- 172.21.15.3:0/2959636431 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92dc00b860 con 0x7f92ec149040 2023-10-08T15:38:08.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.221+0000 7f92e9d9b700 1 -- 172.21.15.3:0/2959636431 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92dc00bc00 con 0x7f92ec149040 2023-10-08T15:38:08.231 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.225+0000 7f92f0903700 1 -- 172.21.15.3:0/2959636431 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f92ec149040 msgr2=0x7f92ec09f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:08.231 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.225+0000 7f92f0903700 1 --2- 172.21.15.3:0/2959636431 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f92ec149040 0x7f92ec09f800 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f92ec06ddb0 tx=0x7f92dc009250 comp rx=0 tx=0).stop 2023-10-08T15:38:08.231 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.225+0000 7f92f0903700 1 -- 172.21.15.3:0/2959636431 shutdown_connections 2023-10-08T15:38:08.231 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.225+0000 7f92f0903700 1 --2- 172.21.15.3:0/2959636431 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f92ec149040 0x7f92ec09f800 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:08.231 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.225+0000 7f92f0903700 1 --2- 172.21.15.3:0/2959636431 >> v2:172.21.15.50:3300/0 conn(0x7f92ec0670e0 0x7f92ec0674b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:08.231 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.225+0000 7f92f0903700 1 -- 172.21.15.3:0/2959636431 >> 172.21.15.3:0/2959636431 conn(0x7f92ec06dfb0 msgr2=0x7f92ec06e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:08.231 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.225+0000 7f92f0903700 1 -- 172.21.15.3:0/2959636431 shutdown_connections 2023-10-08T15:38:08.231 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.225+0000 7f92f0903700 1 -- 172.21.15.3:0/2959636431 wait complete. 2023-10-08T15:38:08.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.225+0000 7f92f0903700 1 Processor -- start 2023-10-08T15:38:08.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.229+0000 7f92f0903700 1 -- start start 2023-10-08T15:38:08.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.229+0000 7f92f0903700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f92ec0670e0 0x7f92ec09ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:08.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.229+0000 7f92f0903700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f92ec149040 0x7f92ec14bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:08.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.229+0000 7f92f0903700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92ec14d2f0 0x7f92ec09ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:08.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.229+0000 7f92f0903700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92ec146a00 con 0x7f92ec0670e0 2023-10-08T15:38:08.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.229+0000 7f92f0903700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92ec159d00 con 0x7f92ec14d2f0 2023-10-08T15:38:08.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.229+0000 7f92f0903700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92ec14c0d0 con 0x7f92ec149040 2023-10-08T15:38:08.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.229+0000 7f92ead9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f92ec0670e0 0x7f92ec09ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:08.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.229+0000 7f92ead9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f92ec0670e0 0x7f92ec09ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:48024/0 (socket says 172.21.15.3:48024) 2023-10-08T15:38:08.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.229+0000 7f92ead9d700 1 -- 172.21.15.3:0/3777632615 learned_addr learned my addr 172.21.15.3:0/3777632615 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:38:08.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.229+0000 7f92ea59c700 1 --2- 172.21.15.3:0/3777632615 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f92ec149040 0x7f92ec14bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:08.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.229+0000 7f92eb59e700 1 --2- 172.21.15.3:0/3777632615 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92ec14d2f0 0x7f92ec09ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:08.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.229+0000 7f92ead9d700 1 -- 172.21.15.3:0/3777632615 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f92ec149040 msgr2=0x7f92ec14bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:08.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.229+0000 7f92ead9d700 1 --2- 172.21.15.3:0/3777632615 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f92ec149040 0x7f92ec14bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:08.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.229+0000 7f92ead9d700 1 -- 172.21.15.3:0/3777632615 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92ec14d2f0 msgr2=0x7f92ec09ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:08.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.229+0000 7f92ead9d700 1 --2- 172.21.15.3:0/3777632615 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92ec14d2f0 0x7f92ec09ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:08.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.229+0000 7f92ead9d700 1 -- 172.21.15.3:0/3777632615 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92dc0094f0 con 0x7f92ec0670e0 2023-10-08T15:38:08.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.229+0000 7f92ea59c700 1 --2- 172.21.15.3:0/3777632615 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f92ec149040 0x7f92ec14bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:38:08.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.229+0000 7f92eb59e700 1 --2- 172.21.15.3:0/3777632615 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92ec14d2f0 0x7f92ec09ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:38:08.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.229+0000 7f92ead9d700 1 --2- 172.21.15.3:0/3777632615 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f92ec0670e0 0x7f92ec09ecd0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f92e000ec80 tx=0x7f92e00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:08.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.229+0000 7f92d2ffd700 1 -- 172.21.15.3:0/3777632615 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e000c9d0 con 0x7f92ec0670e0 2023-10-08T15:38:08.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.229+0000 7f92d2ffd700 1 -- 172.21.15.3:0/3777632615 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92e000cb30 con 0x7f92ec0670e0 2023-10-08T15:38:08.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.229+0000 7f92f0903700 1 -- 172.21.15.3:0/3777632615 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92ec159990 con 0x7f92ec0670e0 2023-10-08T15:38:08.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.229+0000 7f92d2ffd700 1 -- 172.21.15.3:0/3777632615 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e0013470 con 0x7f92ec0670e0 2023-10-08T15:38:08.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.229+0000 7f92f0903700 1 -- 172.21.15.3:0/3777632615 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92ec09a020 con 0x7f92ec0670e0 2023-10-08T15:38:08.239 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.233+0000 7f92f0903700 1 -- 172.21.15.3:0/3777632615 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92ec05ecf0 con 0x7f92ec0670e0 2023-10-08T15:38:08.239 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.233+0000 7f92d2ffd700 1 -- 172.21.15.3:0/3777632615 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f92e0013820 con 0x7f92ec0670e0 2023-10-08T15:38:08.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.233+0000 7f92d2ffd700 1 --2- 172.21.15.3:0/3777632615 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f92d8060550 0x7f92d8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:08.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.233+0000 7f92d2ffd700 1 -- 172.21.15.3:0/3777632615 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f92e007c860 con 0x7f92ec0670e0 2023-10-08T15:38:08.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.233+0000 7f92ea59c700 1 --2- 172.21.15.3:0/3777632615 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f92d8060550 0x7f92d8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:08.241 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.237+0000 7f92ea59c700 1 --2- 172.21.15.3:0/3777632615 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f92d8060550 0x7f92d8062a00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f92ec06d9c0 tx=0x7f92dc017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:08.248 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.241+0000 7f92d2ffd700 1 -- 172.21.15.3:0/3777632615 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f92e004d100 con 0x7f92ec0670e0 2023-10-08T15:38:08.412 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.405+0000 7f92f0903700 1 -- 172.21.15.3:0/3777632615 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f92ec09fd40 con 0x7f92ec0670e0 2023-10-08T15:38:08.413 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.409+0000 7f92d2ffd700 1 -- 172.21.15.3:0/3777632615 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+12038 (secure 0 0 0) 0x7f92e0050720 con 0x7f92ec0670e0 2023-10-08T15:38:08.414 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:38:08.414 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":25,"fsid":"7635972e-cd66-4a8f-a231-378db8b3847a","created":"2023-10-08T15:37:08.234594+0000","modified":"2023-10-08T15:38:05.467664+0000","last_up_change":"2023-10-08T15:37:17.537726+0000","last_in_change":"2023-10-08T15:37:10.269178+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:37:16.581590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"64fb1864-bfdd-4d75-9b41-03fb60085dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33363},{"type":"v1","addr":"172.21.15.3:6801","nonce":33363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33363},{"type":"v1","addr":"172.21.15.3:6803","nonce":33363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":33363},{"type":"v1","addr":"172.21.15.3:6807","nonce":33363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33363},{"type":"v1","addr":"172.21.15.3:6805","nonce":33363}]},"public_addr":"172.21.15.3:6801/33363","cluster_addr":"172.21.15.3:6803/33363","heartbeat_back_addr":"172.21.15.3:6807/33363","heartbeat_front_addr":"172.21.15.3:6805/33363","state":["exists","up"]},{"osd":1,"uuid":"3ca6bd3a-3e8a-4c65-af9c-46148b0c2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33364},{"type":"v1","addr":"172.21.15.3:6820","nonce":33364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33364},{"type":"v1","addr":"172.21.15.3:6824","nonce":33364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33364},{"type":"v1","addr":"172.21.15.3:6831","nonce":33364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33364},{"type":"v1","addr":"172.21.15.3:6828","nonce":33364}]},"public_addr":"172.21.15.3:6820/33364","cluster_addr":"172.21.15.3:6824/33364","heartbeat_back_addr":"172.21.15.3:6831/33364","heartbeat_front_addr":"172.21.15.3:6828/33364","state":["exists","up"]},{"osd":2,"uuid":"6eb9f757-58dd-442f-910d-32401454bce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33366},{"type":"v1","addr":"172.21.15.3:6817","nonce":33366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":33366},{"type":"v1","addr":"172.21.15.3:6821","nonce":33366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6827","nonce":33366},{"type":"v1","addr":"172.21.15.3:6829","nonce":33366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":33366},{"type":"v1","addr":"172.21.15.3:6825","nonce":33366}]},"public_addr":"172.21.15.3:6817/33366","cluster_addr":"172.21.15.3:6821/33366","heartbeat_back_addr":"172.21.15.3:6829/33366","heartbeat_front_addr":"172.21.15.3:6825/33366","state":["exists","up"]},{"osd":3,"uuid":"1c39866b-ac2e-4ea9-a69c-02b01ee4191d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33365},{"type":"v1","addr":"172.21.15.3:6809","nonce":33365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":33365},{"type":"v1","addr":"172.21.15.3:6811","nonce":33365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33365},{"type":"v1","addr":"172.21.15.3:6815","nonce":33365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":33365},{"type":"v1","addr":"172.21.15.3:6813","nonce":33365}]},"public_addr":"172.21.15.3:6809/33365","cluster_addr":"172.21.15.3:6811/33365","heartbeat_back_addr":"172.21.15.3:6815/33365","heartbeat_front_addr":"172.21.15.3:6813/33365","state":["exists","up"]},{"osd":4,"uuid":"15f86b61-b7f1-4780-ae00-9d80a68cb830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":33605},{"type":"v1","addr":"172.21.15.50:6809","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33605},{"type":"v1","addr":"172.21.15.50:6811","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33605},{"type":"v1","addr":"172.21.15.50:6815","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":33605},{"type":"v1","addr":"172.21.15.50:6813","nonce":33605}]},"public_addr":"172.21.15.50:6809/33605","cluster_addr":"172.21.15.50:6811/33605","heartbeat_back_addr":"172.21.15.50:6815/33605","heartbeat_front_addr":"172.21.15.50:6813/33605","state":["exists","up"]},{"osd":5,"uuid":"726c3003-34e6-4d5a-b6e2-f911e13c2118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33606},{"type":"v1","addr":"172.21.15.50:6801","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33606},{"type":"v1","addr":"172.21.15.50:6803","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33606},{"type":"v1","addr":"172.21.15.50:6807","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":33606},{"type":"v1","addr":"172.21.15.50:6805","nonce":33606}]},"public_addr":"172.21.15.50:6801/33606","cluster_addr":"172.21.15.50:6803/33606","heartbeat_back_addr":"172.21.15.50:6807/33606","heartbeat_front_addr":"172.21.15.50:6805/33606","state":["exists","up"]},{"osd":6,"uuid":"401122a4-9988-441f-a5a7-39164434ebcd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":33607},{"type":"v1","addr":"172.21.15.50:6819","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":33607},{"type":"v1","addr":"172.21.15.50:6823","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":33607},{"type":"v1","addr":"172.21.15.50:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":33607},{"type":"v1","addr":"172.21.15.50:6827","nonce":33607}]},"public_addr":"172.21.15.50:6819/33607","cluster_addr":"172.21.15.50:6823/33607","heartbeat_back_addr":"172.21.15.50:6831/33607","heartbeat_front_addr":"172.21.15.50:6827/33607","state":["exists","up"]},{"osd":7,"uuid":"6b3fa236-c9d0-4c4d-82ae-9af4daf6d699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33604},{"type":"v1","addr":"172.21.15.50:6818","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":33604},{"type":"v1","addr":"172.21.15.50:6822","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":33604},{"type":"v1","addr":"172.21.15.50:6830","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":33604},{"type":"v1","addr":"172.21.15.50:6826","nonce":33604}]},"public_addr":"172.21.15.50:6818/33604","cluster_addr":"172.21.15.50:6822/33604","heartbeat_back_addr":"172.21.15.50:6830/33604","heartbeat_front_addr":"172.21.15.50:6826/33604","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.497794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.529417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.873426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.325972+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.443971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.240795+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.739632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.643026+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:38:08.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.409+0000 7f92f0903700 1 -- 172.21.15.3:0/3777632615 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f92d8060550 msgr2=0x7f92d8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:08.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.409+0000 7f92f0903700 1 --2- 172.21.15.3:0/3777632615 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f92d8060550 0x7f92d8062a00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f92ec06d9c0 tx=0x7f92dc017000 comp rx=0 tx=0).stop 2023-10-08T15:38:08.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.409+0000 7f92f0903700 1 -- 172.21.15.3:0/3777632615 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f92ec0670e0 msgr2=0x7f92ec09ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:08.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.409+0000 7f92f0903700 1 --2- 172.21.15.3:0/3777632615 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f92ec0670e0 0x7f92ec09ecd0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f92e000ec80 tx=0x7f92e00091a0 comp rx=0 tx=0).stop 2023-10-08T15:38:08.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.409+0000 7f92f0903700 1 -- 172.21.15.3:0/3777632615 shutdown_connections 2023-10-08T15:38:08.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.409+0000 7f92f0903700 1 --2- 172.21.15.3:0/3777632615 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f92d8060550 0x7f92d8062a00 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:08.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.409+0000 7f92f0903700 1 --2- 172.21.15.3:0/3777632615 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92ec14d2f0 0x7f92ec09ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:08.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.409+0000 7f92f0903700 1 --2- 172.21.15.3:0/3777632615 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f92ec149040 0x7f92ec14bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:08.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.409+0000 7f92f0903700 1 --2- 172.21.15.3:0/3777632615 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f92ec0670e0 0x7f92ec09ecd0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:08.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.409+0000 7f92f0903700 1 -- 172.21.15.3:0/3777632615 >> 172.21.15.3:0/3777632615 conn(0x7f92ec06dfb0 msgr2=0x7f92ec0be410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:08.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.409+0000 7f92f0903700 1 -- 172.21.15.3:0/3777632615 shutdown_connections 2023-10-08T15:38:08.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.409+0000 7f92f0903700 1 -- 172.21.15.3:0/3777632615 wait complete. 2023-10-08T15:38:08.428 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T15:37:16.581590+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-08T15:38:08.428 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T15:38:08.534 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.529+0000 7fe82de92700 1 Processor -- start 2023-10-08T15:38:08.534 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.529+0000 7fe82de92700 1 -- start start 2023-10-08T15:38:08.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.529+0000 7fe82de92700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe828067e20 0x7fe82809e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:08.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.529+0000 7fe82de92700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe82814f5d0 0x7fe828150f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:08.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.529+0000 7fe82de92700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8280ba480 con 0x7fe828069ab0 2023-10-08T15:38:08.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.529+0000 7fe82de92700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe82809eab0 con 0x7fe82814f5d0 2023-10-08T15:38:08.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.529+0000 7fe82de92700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe828150620 con 0x7fe828067e20 2023-10-08T15:38:08.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.529+0000 7fe81ffff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fe828069ab0 0x7fe82814eec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:35250/0 (socket says 172.21.15.3:35250) 2023-10-08T15:38:08.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.529+0000 7fe81ffff700 1 -- 172.21.15.3:0/3769038152 learned_addr learned my addr 172.21.15.3:0/3769038152 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:38:08.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.529+0000 7fe8277fe700 1 --2- 172.21.15.3:0/3769038152 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe828067e20 0x7fe82809e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:08.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.529+0000 7fe827fff700 1 --2- 172.21.15.3:0/3769038152 >> v2:172.21.15.50:3300/0 conn(0x7fe82814f5d0 0x7fe828150f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:08.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.529+0000 7fe826ffd700 1 -- 172.21.15.3:0/3769038152 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3909552462 0 0) 0x7fe8280ba480 con 0x7fe828069ab0 2023-10-08T15:38:08.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.529+0000 7fe826ffd700 1 -- 172.21.15.3:0/3769038152 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe814003570 con 0x7fe828069ab0 2023-10-08T15:38:08.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.529+0000 7fe827fff700 1 -- 172.21.15.3:0/3769038152 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe828067e20 msgr2=0x7fe82809e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:38:08.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.529+0000 7fe827fff700 1 --2- 172.21.15.3:0/3769038152 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe828067e20 0x7fe82809e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:08.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.529+0000 7fe827fff700 1 -- 172.21.15.3:0/3769038152 >> v1:172.21.15.3:6789/0 conn(0x7fe828069ab0 legacy=0x7fe82814eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:08.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.529+0000 7fe827fff700 1 -- 172.21.15.3:0/3769038152 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe828150900 con 0x7fe82814f5d0 2023-10-08T15:38:08.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.529+0000 7fe8277fe700 1 --2- 172.21.15.3:0/3769038152 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe828067e20 0x7fe82809e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:38:08.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.529+0000 7fe827fff700 1 --2- 172.21.15.3:0/3769038152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe82814f5d0 0x7fe828150f80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe820009e60 tx=0x7fe820009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b46c6ce923157c9c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:08.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.529+0000 7fe826ffd700 1 -- 172.21.15.3:0/3769038152 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82000e070 con 0x7fe82814f5d0 2023-10-08T15:38:08.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.529+0000 7fe826ffd700 1 -- 172.21.15.3:0/3769038152 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe82000bab0 con 0x7fe82814f5d0 2023-10-08T15:38:08.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.529+0000 7fe826ffd700 1 -- 172.21.15.3:0/3769038152 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82000be70 con 0x7fe82814f5d0 2023-10-08T15:38:08.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.533+0000 7fe82de92700 1 -- 172.21.15.3:0/3769038152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe82814f5d0 msgr2=0x7fe828150f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:08.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.533+0000 7fe82de92700 1 --2- 172.21.15.3:0/3769038152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe82814f5d0 0x7fe828150f80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe820009e60 tx=0x7fe820009780 comp rx=0 tx=0).stop 2023-10-08T15:38:08.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.533+0000 7fe82de92700 1 -- 172.21.15.3:0/3769038152 shutdown_connections 2023-10-08T15:38:08.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.533+0000 7fe82de92700 1 --2- 172.21.15.3:0/3769038152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe82814f5d0 0x7fe828150f80 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:08.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.533+0000 7fe82de92700 1 --2- 172.21.15.3:0/3769038152 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe828067e20 0x7fe82809e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:08.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.533+0000 7fe82de92700 1 -- 172.21.15.3:0/3769038152 >> 172.21.15.3:0/3769038152 conn(0x7fe8280670e0 msgr2=0x7fe8280674e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:08.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.533+0000 7fe82de92700 1 -- 172.21.15.3:0/3769038152 shutdown_connections 2023-10-08T15:38:08.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.533+0000 7fe82de92700 1 -- 172.21.15.3:0/3769038152 wait complete. 2023-10-08T15:38:08.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.533+0000 7fe82de92700 1 Processor -- start 2023-10-08T15:38:08.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.533+0000 7fe82de92700 1 -- start start 2023-10-08T15:38:08.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.533+0000 7fe82de92700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe828067e20 0x7fe82815f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:08.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.533+0000 7fe82de92700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe828069ab0 0x7fe8280b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:08.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.533+0000 7fe82de92700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe82814f5d0 0x7fe8280a07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:08.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.533+0000 7fe82de92700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8280b4790 con 0x7fe828069ab0 2023-10-08T15:38:08.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.533+0000 7fe82de92700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe828160060 con 0x7fe82814f5d0 2023-10-08T15:38:08.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.533+0000 7fe82de92700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8280b3720 con 0x7fe828067e20 2023-10-08T15:38:08.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.533+0000 7fe81ffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe828069ab0 0x7fe8280b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:08.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.533+0000 7fe81ffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe828069ab0 0x7fe8280b20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:48040/0 (socket says 172.21.15.3:48040) 2023-10-08T15:38:08.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.533+0000 7fe81ffff700 1 -- 172.21.15.3:0/4119078433 learned_addr learned my addr 172.21.15.3:0/4119078433 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:38:08.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.533+0000 7fe8277fe700 1 --2- 172.21.15.3:0/4119078433 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe828067e20 0x7fe82815f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:08.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.537+0000 7fe827fff700 1 --2- 172.21.15.3:0/4119078433 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe82814f5d0 0x7fe8280a07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:08.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.537+0000 7fe81ffff700 1 -- 172.21.15.3:0/4119078433 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe828067e20 msgr2=0x7fe82815f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:08.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.537+0000 7fe81ffff700 1 --2- 172.21.15.3:0/4119078433 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe828067e20 0x7fe82815f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:08.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.537+0000 7fe81ffff700 1 -- 172.21.15.3:0/4119078433 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe82814f5d0 msgr2=0x7fe8280a07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:08.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.537+0000 7fe81ffff700 1 --2- 172.21.15.3:0/4119078433 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe82814f5d0 0x7fe8280a07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:08.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.537+0000 7fe81ffff700 1 -- 172.21.15.3:0/4119078433 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe818009420 con 0x7fe828069ab0 2023-10-08T15:38:08.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.537+0000 7fe81ffff700 1 --2- 172.21.15.3:0/4119078433 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe828069ab0 0x7fe8280b20a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe81000c7f0 tx=0x7fe810007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:08.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.537+0000 7fe81f7fe700 1 -- 172.21.15.3:0/4119078433 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe810005b30 con 0x7fe828069ab0 2023-10-08T15:38:08.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.537+0000 7fe81f7fe700 1 -- 172.21.15.3:0/4119078433 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe810005cb0 con 0x7fe828069ab0 2023-10-08T15:38:08.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.537+0000 7fe81f7fe700 1 -- 172.21.15.3:0/4119078433 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe810007320 con 0x7fe828069ab0 2023-10-08T15:38:08.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.537+0000 7fe82de92700 1 -- 172.21.15.3:0/4119078433 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe820009a20 con 0x7fe828069ab0 2023-10-08T15:38:08.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.537+0000 7fe82de92700 1 -- 172.21.15.3:0/4119078433 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8280b3430 con 0x7fe828069ab0 2023-10-08T15:38:08.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.537+0000 7fe82de92700 1 -- 172.21.15.3:0/4119078433 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe828064530 con 0x7fe828069ab0 2023-10-08T15:38:08.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.541+0000 7fe81f7fe700 1 -- 172.21.15.3:0/4119078433 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe81001b3b0 con 0x7fe828069ab0 2023-10-08T15:38:08.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.541+0000 7fe81f7fe700 1 --2- 172.21.15.3:0/4119078433 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe808060550 0x7fe808062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:08.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.541+0000 7fe81f7fe700 1 -- 172.21.15.3:0/4119078433 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fe81007b950 con 0x7fe828069ab0 2023-10-08T15:38:08.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.541+0000 7fe8277fe700 1 --2- 172.21.15.3:0/4119078433 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe808060550 0x7fe808062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:08.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.541+0000 7fe8277fe700 1 --2- 172.21.15.3:0/4119078433 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe808060550 0x7fe808062a00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe818009ea0 tx=0x7fe8180091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:08.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.545+0000 7fe81f7fe700 1 -- 172.21.15.3:0/4119078433 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe81004c1f0 con 0x7fe828069ab0 2023-10-08T15:38:08.713 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.705+0000 7fe82de92700 1 -- 172.21.15.3:0/4119078433 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe82809f8b0 con 0x7fe828069ab0 2023-10-08T15:38:08.713 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.709+0000 7fe81f7fe700 1 -- 172.21.15.3:0/4119078433 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe81004f810 con 0x7fe828069ab0 2023-10-08T15:38:08.714 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2023-10-08T15:38:08.716 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.709+0000 7fe82de92700 1 -- 172.21.15.3:0/4119078433 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe808060550 msgr2=0x7fe808062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:08.716 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.709+0000 7fe82de92700 1 --2- 172.21.15.3:0/4119078433 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe808060550 0x7fe808062a00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe818009ea0 tx=0x7fe8180091a0 comp rx=0 tx=0).stop 2023-10-08T15:38:08.716 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.709+0000 7fe82de92700 1 -- 172.21.15.3:0/4119078433 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe828069ab0 msgr2=0x7fe8280b20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:08.716 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.709+0000 7fe82de92700 1 --2- 172.21.15.3:0/4119078433 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe828069ab0 0x7fe8280b20a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe81000c7f0 tx=0x7fe810007e00 comp rx=0 tx=0).stop 2023-10-08T15:38:08.716 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.709+0000 7fe82de92700 1 -- 172.21.15.3:0/4119078433 shutdown_connections 2023-10-08T15:38:08.716 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.709+0000 7fe82de92700 1 --2- 172.21.15.3:0/4119078433 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe808060550 0x7fe808062a00 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:08.716 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.709+0000 7fe82de92700 1 --2- 172.21.15.3:0/4119078433 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe82814f5d0 0x7fe8280a07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:08.716 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.709+0000 7fe82de92700 1 --2- 172.21.15.3:0/4119078433 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe828069ab0 0x7fe8280b20a0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:08.717 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.709+0000 7fe82de92700 1 --2- 172.21.15.3:0/4119078433 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe828067e20 0x7fe82815f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:08.717 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.709+0000 7fe82de92700 1 -- 172.21.15.3:0/4119078433 >> 172.21.15.3:0/4119078433 conn(0x7fe8280670e0 msgr2=0x7fe828155980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:08.717 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.709+0000 7fe82de92700 1 -- 172.21.15.3:0/4119078433 shutdown_connections 2023-10-08T15:38:08.717 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.709+0000 7fe82de92700 1 -- 172.21.15.3:0/4119078433 wait complete. 2023-10-08T15:38:08.731 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T15:38:08.835 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.829+0000 7f8302b6b700 1 Processor -- start 2023-10-08T15:38:08.835 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.829+0000 7f8302b6b700 1 -- start start 2023-10-08T15:38:08.835 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.829+0000 7f8302b6b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f82fc0a10f0 0x7f82fc0a14c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:08.835 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.829+0000 7f8302b6b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f82fc09f3e0 0x7f82fc14d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:08.835 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.829+0000 7f8302b6b700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82fc149bf0 con 0x7f82fc14a080 2023-10-08T15:38:08.835 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.829+0000 7f8302b6b700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82fc1495a0 con 0x7f82fc09f3e0 2023-10-08T15:38:08.835 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.829+0000 7f8302b6b700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82fc149880 con 0x7f82fc0a10f0 2023-10-08T15:38:08.837 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.829+0000 7f8301108700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f82fc14a080 0x7f82fc0670e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:35254/0 (socket says 172.21.15.3:35254) 2023-10-08T15:38:08.837 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.829+0000 7f8301108700 1 -- 172.21.15.3:0/564252549 learned_addr learned my addr 172.21.15.3:0/564252549 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:38:08.837 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.829+0000 7f8300907700 1 --2- 172.21.15.3:0/564252549 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f82fc0a10f0 0x7f82fc0a14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:08.837 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.829+0000 7f82fbfff700 1 --2- 172.21.15.3:0/564252549 >> v2:172.21.15.50:3300/0 conn(0x7f82fc09f3e0 0x7f82fc14d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:08.837 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.829+0000 7f82fb7fe700 1 -- 172.21.15.3:0/564252549 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4048156624 0 0) 0x7f82fc149bf0 con 0x7f82fc14a080 2023-10-08T15:38:08.838 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.829+0000 7f82fb7fe700 1 -- 172.21.15.3:0/564252549 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82dc003570 con 0x7f82fc14a080 2023-10-08T15:38:08.838 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.829+0000 7f8300907700 1 -- 172.21.15.3:0/564252549 >> v2:172.21.15.50:3300/0 conn(0x7f82fc09f3e0 msgr2=0x7f82fc14d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:38:08.838 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.829+0000 7f8300907700 1 --2- 172.21.15.3:0/564252549 >> v2:172.21.15.50:3300/0 conn(0x7f82fc09f3e0 0x7f82fc14d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:08.838 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.829+0000 7f8300907700 1 -- 172.21.15.3:0/564252549 >> v1:172.21.15.3:6789/0 conn(0x7f82fc14a080 legacy=0x7f82fc0670e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:08.838 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.829+0000 7f8300907700 1 -- 172.21.15.3:0/564252549 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82fc0677f0 con 0x7f82fc0a10f0 2023-10-08T15:38:08.838 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.829+0000 7f8300907700 1 --2- 172.21.15.3:0/564252549 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f82fc0a10f0 0x7f82fc0a14c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f82ec0098e0 tx=0x7f82ec0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3f785828ee1149a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:08.838 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.829+0000 7f82fb7fe700 1 -- 172.21.15.3:0/564252549 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ec011630 con 0x7f82fc0a10f0 2023-10-08T15:38:08.838 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.829+0000 7f82fb7fe700 1 -- 172.21.15.3:0/564252549 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82ec011790 con 0x7f82fc0a10f0 2023-10-08T15:38:08.838 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.829+0000 7f82fb7fe700 1 -- 172.21.15.3:0/564252549 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ec011b10 con 0x7f82fc0a10f0 2023-10-08T15:38:08.838 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.829+0000 7f8302b6b700 1 -- 172.21.15.3:0/564252549 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f82fc0a10f0 msgr2=0x7f82fc0a14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:08.838 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.829+0000 7f8302b6b700 1 --2- 172.21.15.3:0/564252549 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f82fc0a10f0 0x7f82fc0a14c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f82ec0098e0 tx=0x7f82ec0091a0 comp rx=0 tx=0).stop 2023-10-08T15:38:08.839 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.833+0000 7f8302b6b700 1 -- 172.21.15.3:0/564252549 shutdown_connections 2023-10-08T15:38:08.839 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.833+0000 7f8302b6b700 1 --2- 172.21.15.3:0/564252549 >> v2:172.21.15.50:3300/0 conn(0x7f82fc09f3e0 0x7f82fc14d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:08.839 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.833+0000 7f8302b6b700 1 --2- 172.21.15.3:0/564252549 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f82fc0a10f0 0x7f82fc0a14c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:08.839 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.833+0000 7f8302b6b700 1 -- 172.21.15.3:0/564252549 >> 172.21.15.3:0/564252549 conn(0x7f82fc06a900 msgr2=0x7f82fc06e150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:08.839 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.833+0000 7f8302b6b700 1 -- 172.21.15.3:0/564252549 shutdown_connections 2023-10-08T15:38:08.839 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.833+0000 7f8302b6b700 1 -- 172.21.15.3:0/564252549 wait complete. 2023-10-08T15:38:08.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.833+0000 7f8302b6b700 1 Processor -- start 2023-10-08T15:38:08.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.833+0000 7f8302b6b700 1 -- start start 2023-10-08T15:38:08.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.833+0000 7f8302b6b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82fc09f3e0 0x7f82fc1599c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:08.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.833+0000 7f8302b6b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f82fc0a10f0 0x7f82fc14bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:08.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.833+0000 7f8302b6b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f82fc14a080 0x7f82fc145620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:08.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.833+0000 7f8302b6b700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82fc097f20 con 0x7f82fc14a080 2023-10-08T15:38:08.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.833+0000 7f8302b6b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82fc159530 con 0x7f82fc09f3e0 2023-10-08T15:38:08.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.833+0000 7f8302b6b700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82fc158f50 con 0x7f82fc0a10f0 2023-10-08T15:38:08.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.833+0000 7f8301108700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f82fc14a080 0x7f82fc145620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:08.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.833+0000 7f8301108700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f82fc14a080 0x7f82fc145620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:48046/0 (socket says 172.21.15.3:48046) 2023-10-08T15:38:08.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.833+0000 7f8301108700 1 -- 172.21.15.3:0/3238489659 learned_addr learned my addr 172.21.15.3:0/3238489659 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:38:08.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.833+0000 7f82fbfff700 1 --2- 172.21.15.3:0/3238489659 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f82fc0a10f0 0x7f82fc14bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:08.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.833+0000 7f8300907700 1 --2- 172.21.15.3:0/3238489659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82fc09f3e0 0x7f82fc1599c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:08.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.833+0000 7f8301108700 1 -- 172.21.15.3:0/3238489659 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f82fc0a10f0 msgr2=0x7f82fc14bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:08.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.833+0000 7f8301108700 1 --2- 172.21.15.3:0/3238489659 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f82fc0a10f0 0x7f82fc14bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:08.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.833+0000 7f8301108700 1 -- 172.21.15.3:0/3238489659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82fc09f3e0 msgr2=0x7f82fc1599c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:08.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.833+0000 7f8301108700 1 --2- 172.21.15.3:0/3238489659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82fc09f3e0 0x7f82fc1599c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:08.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.833+0000 7f8301108700 1 -- 172.21.15.3:0/3238489659 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82ec009420 con 0x7f82fc14a080 2023-10-08T15:38:08.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.833+0000 7f8301108700 1 --2- 172.21.15.3:0/3238489659 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f82fc14a080 0x7f82fc145620 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f82f400cbf0 tx=0x7f82f40019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:08.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.833+0000 7f82f8ff9700 1 -- 172.21.15.3:0/3238489659 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f400a830 con 0x7f82fc14a080 2023-10-08T15:38:08.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.837+0000 7f82f8ff9700 1 -- 172.21.15.3:0/3238489659 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82f400a990 con 0x7f82fc14a080 2023-10-08T15:38:08.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.837+0000 7f8302b6b700 1 -- 172.21.15.3:0/3238489659 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82fc159220 con 0x7f82fc14a080 2023-10-08T15:38:08.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.837+0000 7f82f8ff9700 1 -- 172.21.15.3:0/3238489659 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f400ad50 con 0x7f82fc14a080 2023-10-08T15:38:08.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.837+0000 7f8302b6b700 1 -- 172.21.15.3:0/3238489659 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82fc145b60 con 0x7f82fc14a080 2023-10-08T15:38:08.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.837+0000 7f8302b6b700 1 -- 172.21.15.3:0/3238489659 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82fc1596c0 con 0x7f82fc14a080 2023-10-08T15:38:08.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.837+0000 7f82f8ff9700 1 -- 172.21.15.3:0/3238489659 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f82f4007300 con 0x7f82fc14a080 2023-10-08T15:38:08.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.837+0000 7f82f8ff9700 1 --2- 172.21.15.3:0/3238489659 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f82e0060550 0x7f82e0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:08.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.837+0000 7f82f8ff9700 1 -- 172.21.15.3:0/3238489659 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f82f407c6b0 con 0x7f82fc14a080 2023-10-08T15:38:08.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.837+0000 7f8300907700 1 --2- 172.21.15.3:0/3238489659 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f82e0060550 0x7f82e0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:08.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.841+0000 7f8300907700 1 --2- 172.21.15.3:0/3238489659 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f82e0060550 0x7f82e0062a00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f82ec0091e0 tx=0x7f82ec017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:08.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:08.845+0000 7f82f8ff9700 1 -- 172.21.15.3:0/3238489659 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f82f404d070 con 0x7f82fc14a080 2023-10-08T15:38:09.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.005+0000 7f8302b6b700 1 -- 172.21.15.3:0/3238489659 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f82fc064530 con 0x7f82fc14a080 2023-10-08T15:38:09.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.005+0000 7f82f8ff9700 1 -- 172.21.15.3:0/3238489659 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v25) v1 ==== 84+0+65 (secure 0 0 0) 0x7f82f4050690 con 0x7f82fc14a080 2023-10-08T15:38:09.012 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:38:09.012 INFO:teuthology.orchestra.run.smithi003.stdout:[ 2023-10-08T15:38:09.012 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:38:09.012 INFO:teuthology.orchestra.run.smithi003.stdout: "poolnum": 1, 2023-10-08T15:38:09.012 INFO:teuthology.orchestra.run.smithi003.stdout: "poolname": ".mgr" 2023-10-08T15:38:09.012 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:38:09.013 INFO:teuthology.orchestra.run.smithi003.stdout:] 2023-10-08T15:38:09.013 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.009+0000 7f8302b6b700 1 -- 172.21.15.3:0/3238489659 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f82e0060550 msgr2=0x7f82e0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:09.014 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.009+0000 7f8302b6b700 1 --2- 172.21.15.3:0/3238489659 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f82e0060550 0x7f82e0062a00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f82ec0091e0 tx=0x7f82ec017000 comp rx=0 tx=0).stop 2023-10-08T15:38:09.014 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.009+0000 7f8302b6b700 1 -- 172.21.15.3:0/3238489659 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f82fc14a080 msgr2=0x7f82fc145620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:09.014 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.009+0000 7f8302b6b700 1 --2- 172.21.15.3:0/3238489659 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f82fc14a080 0x7f82fc145620 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f82f400cbf0 tx=0x7f82f40019c0 comp rx=0 tx=0).stop 2023-10-08T15:38:09.014 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.009+0000 7f8302b6b700 1 -- 172.21.15.3:0/3238489659 shutdown_connections 2023-10-08T15:38:09.014 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.009+0000 7f8302b6b700 1 --2- 172.21.15.3:0/3238489659 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f82e0060550 0x7f82e0062a00 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:09.014 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.009+0000 7f8302b6b700 1 --2- 172.21.15.3:0/3238489659 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f82fc14a080 0x7f82fc145620 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:09.014 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.009+0000 7f8302b6b700 1 --2- 172.21.15.3:0/3238489659 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f82fc0a10f0 0x7f82fc14bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:09.015 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.009+0000 7f8302b6b700 1 --2- 172.21.15.3:0/3238489659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82fc09f3e0 0x7f82fc1599c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:09.015 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.009+0000 7f8302b6b700 1 -- 172.21.15.3:0/3238489659 >> 172.21.15.3:0/3238489659 conn(0x7f82fc06a900 msgr2=0x7f82fc0bdc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:09.015 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.009+0000 7f8302b6b700 1 -- 172.21.15.3:0/3238489659 shutdown_connections 2023-10-08T15:38:09.015 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.009+0000 7f8302b6b700 1 -- 172.21.15.3:0/3238489659 wait complete. 2023-10-08T15:38:09.030 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T15:38:09.030 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T15:38:09.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.133+0000 7fb0ea308700 1 Processor -- start 2023-10-08T15:38:09.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.133+0000 7fb0ea308700 1 -- start start 2023-10-08T15:38:09.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.133+0000 7fb0ea308700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb0e40b1e60 0x7fb0e40b2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:09.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.133+0000 7fb0ea308700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb0e40bba60 0x7fb0e40b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:09.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.133+0000 7fb0ea308700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb0e414ca50 0x7fb0e414ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:09.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.133+0000 7fb0ea308700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0e40b3800 con 0x7fb0e40b1e60 2023-10-08T15:38:09.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.133+0000 7fb0ea308700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0e40b3a90 con 0x7fb0e414ca50 2023-10-08T15:38:09.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.133+0000 7fb0ea308700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e40b3f20 con 0x7fb0e40bba60 2023-10-08T15:38:09.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.133+0000 7fb0e3fff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb0e40b1e60 0x7fb0e40b2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:09.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.133+0000 7fb0e3fff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb0e40b1e60 0x7fb0e40b2230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:48054/0 (socket says 172.21.15.3:48054) 2023-10-08T15:38:09.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.133+0000 7fb0e3fff700 1 -- 172.21.15.3:0/170505594 learned_addr learned my addr 172.21.15.3:0/170505594 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:38:09.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.133+0000 7fb0e37fe700 1 --2- 172.21.15.3:0/170505594 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb0e40bba60 0x7fb0e40b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:09.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.133+0000 7fb0e88a5700 1 --2- 172.21.15.3:0/170505594 >> v2:172.21.15.50:3300/0 conn(0x7fb0e414ca50 0x7fb0e414ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:09.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.133+0000 7fb0e3fff700 1 -- 172.21.15.3:0/170505594 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb0e40bba60 msgr2=0x7fb0e40b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:38:09.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.133+0000 7fb0e3fff700 1 --2- 172.21.15.3:0/170505594 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb0e40bba60 0x7fb0e40b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:09.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.133+0000 7fb0e3fff700 1 -- 172.21.15.3:0/170505594 >> v2:172.21.15.50:3300/0 conn(0x7fb0e414ca50 msgr2=0x7fb0e414ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:38:09.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.133+0000 7fb0e3fff700 1 --2- 172.21.15.3:0/170505594 >> v2:172.21.15.50:3300/0 conn(0x7fb0e414ca50 0x7fb0e414ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:09.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.133+0000 7fb0e3fff700 1 -- 172.21.15.3:0/170505594 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e40b2810 con 0x7fb0e40b1e60 2023-10-08T15:38:09.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.133+0000 7fb0e37fe700 1 --2- 172.21.15.3:0/170505594 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb0e40bba60 0x7fb0e40b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:38:09.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.137+0000 7fb0e3fff700 1 --2- 172.21.15.3:0/170505594 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb0e40b1e60 0x7fb0e40b2230 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb0e4070080 tx=0x7fb0d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=195f420c14559725 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:09.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.137+0000 7fb0e2ffd700 1 -- 172.21.15.3:0/170505594 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d400b860 con 0x7fb0e40b1e60 2023-10-08T15:38:09.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.137+0000 7fb0e2ffd700 1 -- 172.21.15.3:0/170505594 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0d400b9c0 con 0x7fb0e40b1e60 2023-10-08T15:38:09.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.137+0000 7fb0e2ffd700 1 -- 172.21.15.3:0/170505594 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d400bd60 con 0x7fb0e40b1e60 2023-10-08T15:38:09.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.137+0000 7fb0ea308700 1 -- 172.21.15.3:0/170505594 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb0e40b1e60 msgr2=0x7fb0e40b2230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:09.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.137+0000 7fb0ea308700 1 --2- 172.21.15.3:0/170505594 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb0e40b1e60 0x7fb0e40b2230 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb0e4070080 tx=0x7fb0d4009250 comp rx=0 tx=0).stop 2023-10-08T15:38:09.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.137+0000 7fb0ea308700 1 -- 172.21.15.3:0/170505594 shutdown_connections 2023-10-08T15:38:09.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.137+0000 7fb0ea308700 1 --2- 172.21.15.3:0/170505594 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb0e40bba60 0x7fb0e40b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:09.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.137+0000 7fb0ea308700 1 --2- 172.21.15.3:0/170505594 >> v2:172.21.15.50:3300/0 conn(0x7fb0e414ca50 0x7fb0e414ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:09.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.137+0000 7fb0ea308700 1 --2- 172.21.15.3:0/170505594 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb0e40b1e60 0x7fb0e40b2230 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:09.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.137+0000 7fb0ea308700 1 -- 172.21.15.3:0/170505594 >> 172.21.15.3:0/170505594 conn(0x7fb0e40be4f0 msgr2=0x7fb0e40be8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:09.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.137+0000 7fb0ea308700 1 -- 172.21.15.3:0/170505594 shutdown_connections 2023-10-08T15:38:09.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.137+0000 7fb0ea308700 1 -- 172.21.15.3:0/170505594 wait complete. 2023-10-08T15:38:09.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.137+0000 7fb0ea308700 1 Processor -- start 2023-10-08T15:38:09.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.137+0000 7fb0ea308700 1 -- start start 2023-10-08T15:38:09.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.141+0000 7fb0ea308700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb0e40b1e60 0x7fb0e4095ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:09.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.141+0000 7fb0ea308700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0e40bba60 0x7fb0e41473a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:09.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.141+0000 7fb0ea308700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb0e414ca50 0x7fb0e41478e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:09.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.141+0000 7fb0ea308700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e40b9ed0 con 0x7fb0e40b1e60 2023-10-08T15:38:09.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.141+0000 7fb0ea308700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e40b6f40 con 0x7fb0e40bba60 2023-10-08T15:38:09.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.141+0000 7fb0ea308700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e4148210 con 0x7fb0e414ca50 2023-10-08T15:38:09.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.141+0000 7fb0e3fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb0e40b1e60 0x7fb0e4095ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:09.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.141+0000 7fb0e3fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb0e40b1e60 0x7fb0e4095ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:48066/0 (socket says 172.21.15.3:48066) 2023-10-08T15:38:09.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.141+0000 7fb0e3fff700 1 -- 172.21.15.3:0/1100368301 learned_addr learned my addr 172.21.15.3:0/1100368301 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:38:09.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.141+0000 7fb0e88a5700 1 --2- 172.21.15.3:0/1100368301 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb0e414ca50 0x7fb0e41478e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:09.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.141+0000 7fb0e37fe700 1 --2- 172.21.15.3:0/1100368301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0e40bba60 0x7fb0e41473a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:09.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.141+0000 7fb0e3fff700 1 -- 172.21.15.3:0/1100368301 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb0e414ca50 msgr2=0x7fb0e41478e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:09.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.141+0000 7fb0e3fff700 1 --2- 172.21.15.3:0/1100368301 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb0e414ca50 0x7fb0e41478e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:09.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.141+0000 7fb0e3fff700 1 -- 172.21.15.3:0/1100368301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0e40bba60 msgr2=0x7fb0e41473a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:09.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.141+0000 7fb0e3fff700 1 --2- 172.21.15.3:0/1100368301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0e40bba60 0x7fb0e41473a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:09.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.141+0000 7fb0e3fff700 1 -- 172.21.15.3:0/1100368301 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d40094f0 con 0x7fb0e40b1e60 2023-10-08T15:38:09.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.141+0000 7fb0e3fff700 1 --2- 172.21.15.3:0/1100368301 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb0e40b1e60 0x7fb0e4095ca0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb0d4009290 tx=0x7fb0d4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:09.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.141+0000 7fb0cbfff700 1 -- 172.21.15.3:0/1100368301 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d401a450 con 0x7fb0e40b1e60 2023-10-08T15:38:09.150 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.141+0000 7fb0cbfff700 1 -- 172.21.15.3:0/1100368301 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0d401a5d0 con 0x7fb0e40b1e60 2023-10-08T15:38:09.150 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.141+0000 7fb0ea308700 1 -- 172.21.15.3:0/1100368301 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0e40b6bf0 con 0x7fb0e40b1e60 2023-10-08T15:38:09.150 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.141+0000 7fb0cbfff700 1 -- 172.21.15.3:0/1100368301 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d401a990 con 0x7fb0e40b1e60 2023-10-08T15:38:09.150 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.141+0000 7fb0ea308700 1 -- 172.21.15.3:0/1100368301 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0e4147e20 con 0x7fb0e40b1e60 2023-10-08T15:38:09.150 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.145+0000 7fb0ea308700 1 -- 172.21.15.3:0/1100368301 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0e4064530 con 0x7fb0e40b1e60 2023-10-08T15:38:09.151 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.145+0000 7fb0cbfff700 1 -- 172.21.15.3:0/1100368301 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb0d401ad00 con 0x7fb0e40b1e60 2023-10-08T15:38:09.151 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.145+0000 7fb0cbfff700 1 --2- 172.21.15.3:0/1100368301 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb0d0060550 0x7fb0d0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:09.151 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.145+0000 7fb0cbfff700 1 -- 172.21.15.3:0/1100368301 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fb0d407daf0 con 0x7fb0e40b1e60 2023-10-08T15:38:09.151 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.145+0000 7fb0e37fe700 1 --2- 172.21.15.3:0/1100368301 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb0d0060550 0x7fb0d0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:09.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.145+0000 7fb0e37fe700 1 --2- 172.21.15.3:0/1100368301 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb0d0060550 0x7fb0d0062a00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb0e4096cf0 tx=0x7fb0d8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:09.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.153+0000 7fb0cbfff700 1 -- 172.21.15.3:0/1100368301 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb0d404e390 con 0x7fb0e40b1e60 2023-10-08T15:38:09.319 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.313+0000 7fb0ea308700 1 -- 172.21.15.3:0/1100368301 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fb0e404b600 con 0x7fb0e40b1e60 2023-10-08T15:38:09.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.497+0000 7fb0cbfff700 1 -- 172.21.15.3:0/1100368301 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v26) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb0d402a0b0 con 0x7fb0e40b1e60 2023-10-08T15:38:09.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.505+0000 7fb0ea308700 1 -- 172.21.15.3:0/1100368301 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb0d0060550 msgr2=0x7fb0d0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:09.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.505+0000 7fb0ea308700 1 --2- 172.21.15.3:0/1100368301 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb0d0060550 0x7fb0d0062a00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb0e4096cf0 tx=0x7fb0d8008040 comp rx=0 tx=0).stop 2023-10-08T15:38:09.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.505+0000 7fb0ea308700 1 -- 172.21.15.3:0/1100368301 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb0e40b1e60 msgr2=0x7fb0e4095ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:09.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.505+0000 7fb0ea308700 1 --2- 172.21.15.3:0/1100368301 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb0e40b1e60 0x7fb0e4095ca0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb0d4009290 tx=0x7fb0d4017000 comp rx=0 tx=0).stop 2023-10-08T15:38:09.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.505+0000 7fb0ea308700 1 -- 172.21.15.3:0/1100368301 shutdown_connections 2023-10-08T15:38:09.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.505+0000 7fb0ea308700 1 --2- 172.21.15.3:0/1100368301 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb0d0060550 0x7fb0d0062a00 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:09.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.505+0000 7fb0ea308700 1 --2- 172.21.15.3:0/1100368301 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb0e414ca50 0x7fb0e41478e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:09.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.505+0000 7fb0ea308700 1 --2- 172.21.15.3:0/1100368301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0e40bba60 0x7fb0e41473a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:09.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.505+0000 7fb0ea308700 1 --2- 172.21.15.3:0/1100368301 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb0e40b1e60 0x7fb0e4095ca0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:09.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.505+0000 7fb0ea308700 1 -- 172.21.15.3:0/1100368301 >> 172.21.15.3:0/1100368301 conn(0x7fb0e40be4f0 msgr2=0x7fb0e406a760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:09.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.505+0000 7fb0ea308700 1 -- 172.21.15.3:0/1100368301 shutdown_connections 2023-10-08T15:38:09.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.505+0000 7fb0ea308700 1 -- 172.21.15.3:0/1100368301 wait complete. 2023-10-08T15:38:09.513 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'cephfs_metadata' created 2023-10-08T15:38:09.526 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T15:38:09.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.633+0000 7f8f08197700 1 Processor -- start 2023-10-08T15:38:09.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.633+0000 7f8f08197700 1 -- start start 2023-10-08T15:38:09.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.633+0000 7f8f08197700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8f000bf3a0 0x7f8f0006d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:09.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.633+0000 7f8f08197700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f8f0014a9d0 0x7f8f0014ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:09.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.633+0000 7f8f08197700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f0014c2f0 con 0x7f8f0006c830 2023-10-08T15:38:09.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.633+0000 7f8f08197700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f000a2800 con 0x7f8f0014a9d0 2023-10-08T15:38:09.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.633+0000 7f8f08197700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0014bca0 con 0x7f8f000bf3a0 2023-10-08T15:38:09.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.633+0000 7f8f06734700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f8f0014a9d0 0x7f8f0014ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:09.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.633+0000 7f8f06734700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f8f0014a9d0 0x7f8f0014ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:48072/0 (socket says 172.21.15.3:48072) 2023-10-08T15:38:09.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.633+0000 7f8f06734700 1 -- 172.21.15.3:0/1084780955 learned_addr learned my addr 172.21.15.3:0/1084780955 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:38:09.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.633+0000 7f8f05732700 1 --1- 172.21.15.3:0/1084780955 >> v1:172.21.15.3:6789/0 conn(0x7f8f0006c830 0x7f8f0006d540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:35270/0 (socket says 172.21.15.3:35270) 2023-10-08T15:38:09.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.633+0000 7f8f05f33700 1 --2- 172.21.15.3:0/1084780955 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8f000bf3a0 0x7f8f0006d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:09.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.633+0000 7f8f06734700 1 -- 172.21.15.3:0/1084780955 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8f000bf3a0 msgr2=0x7f8f0006d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:38:09.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.637+0000 7f8f06734700 1 --2- 172.21.15.3:0/1084780955 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8f000bf3a0 0x7f8f0006d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:09.643 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.637+0000 7f8f06734700 1 -- 172.21.15.3:0/1084780955 >> v1:172.21.15.3:6789/0 conn(0x7f8f0006c830 legacy=0x7f8f0006d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:09.643 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.637+0000 7f8f06734700 1 -- 172.21.15.3:0/1084780955 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f0014bf80 con 0x7f8f0014a9d0 2023-10-08T15:38:09.643 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.637+0000 7f8f06734700 1 --2- 172.21.15.3:0/1084780955 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8f0014a9d0 0x7f8f0014ae50 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8ef80099b0 tx=0x7f8ef8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=349eef1b0a4ca814 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:09.644 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.637+0000 7f8f04f31700 1 -- 172.21.15.3:0/1084780955 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef800b860 con 0x7f8f0014a9d0 2023-10-08T15:38:09.644 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.637+0000 7f8f04f31700 1 -- 172.21.15.3:0/1084780955 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ef800b9c0 con 0x7f8f0014a9d0 2023-10-08T15:38:09.644 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.637+0000 7f8f04f31700 1 -- 172.21.15.3:0/1084780955 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef800bd60 con 0x7f8f0014a9d0 2023-10-08T15:38:09.644 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.637+0000 7f8f08197700 1 -- 172.21.15.3:0/1084780955 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8f0014a9d0 msgr2=0x7f8f0014ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:09.644 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.637+0000 7f8f08197700 1 --2- 172.21.15.3:0/1084780955 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8f0014a9d0 0x7f8f0014ae50 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8ef80099b0 tx=0x7f8ef8009250 comp rx=0 tx=0).stop 2023-10-08T15:38:09.644 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.637+0000 7f8f08197700 1 -- 172.21.15.3:0/1084780955 shutdown_connections 2023-10-08T15:38:09.644 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.637+0000 7f8f08197700 1 --2- 172.21.15.3:0/1084780955 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8f0014a9d0 0x7f8f0014ae50 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:09.645 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.637+0000 7f8f08197700 1 --2- 172.21.15.3:0/1084780955 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8f000bf3a0 0x7f8f0006d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:09.645 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.637+0000 7f8f08197700 1 -- 172.21.15.3:0/1084780955 >> 172.21.15.3:0/1084780955 conn(0x7f8f000c2a80 msgr2=0x7f8f000bea60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:09.645 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.637+0000 7f8f08197700 1 -- 172.21.15.3:0/1084780955 shutdown_connections 2023-10-08T15:38:09.645 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.637+0000 7f8f08197700 1 -- 172.21.15.3:0/1084780955 wait complete. 2023-10-08T15:38:09.645 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.641+0000 7f8f08197700 1 Processor -- start 2023-10-08T15:38:09.645 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.641+0000 7f8f08197700 1 -- start start 2023-10-08T15:38:09.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.641+0000 7f8f08197700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8f0006c830 0x7f8f000c0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:09.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.641+0000 7f8f08197700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f000bf3a0 0x7f8f0014ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:09.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.641+0000 7f8f08197700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8f0014a9d0 0x7f8f00147c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:09.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.641+0000 7f8f08197700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f00148150 con 0x7f8f0006c830 2023-10-08T15:38:09.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.641+0000 7f8f08197700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0014f610 con 0x7f8f000bf3a0 2023-10-08T15:38:09.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.641+0000 7f8f08197700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0014f8f0 con 0x7f8f0014a9d0 2023-10-08T15:38:09.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.641+0000 7f8f05f33700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8f0006c830 0x7f8f000c0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:09.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.641+0000 7f8f05f33700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8f0006c830 0x7f8f000c0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:48078/0 (socket says 172.21.15.3:48078) 2023-10-08T15:38:09.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.641+0000 7f8f05f33700 1 -- 172.21.15.3:0/569109544 learned_addr learned my addr 172.21.15.3:0/569109544 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:38:09.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.641+0000 7f8f05732700 1 --2- 172.21.15.3:0/569109544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f000bf3a0 0x7f8f0014ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:09.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.641+0000 7f8f06734700 1 --2- 172.21.15.3:0/569109544 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8f0014a9d0 0x7f8f00147c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:09.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.641+0000 7f8f05f33700 1 -- 172.21.15.3:0/569109544 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8f0014a9d0 msgr2=0x7f8f00147c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:09.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.641+0000 7f8f05f33700 1 --2- 172.21.15.3:0/569109544 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8f0014a9d0 0x7f8f00147c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:09.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.641+0000 7f8f05f33700 1 -- 172.21.15.3:0/569109544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f000bf3a0 msgr2=0x7f8f0014ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:09.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.641+0000 7f8f05f33700 1 --2- 172.21.15.3:0/569109544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f000bf3a0 0x7f8f0014ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:09.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.641+0000 7f8f05f33700 1 -- 172.21.15.3:0/569109544 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef80094f0 con 0x7f8f0006c830 2023-10-08T15:38:09.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.641+0000 7f8f06734700 1 --2- 172.21.15.3:0/569109544 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8f0014a9d0 0x7f8f00147c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:38:09.650 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.641+0000 7f8f05f33700 1 --2- 172.21.15.3:0/569109544 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8f0006c830 0x7f8f000c0e60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8ef000e190 tx=0x7f8ef0009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:09.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.641+0000 7f8efdffb700 1 -- 172.21.15.3:0/569109544 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef000ed80 con 0x7f8f0006c830 2023-10-08T15:38:09.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.641+0000 7f8efdffb700 1 -- 172.21.15.3:0/569109544 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ef0014420 con 0x7f8f0006c830 2023-10-08T15:38:09.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.641+0000 7f8f08197700 1 -- 172.21.15.3:0/569109544 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f001441d0 con 0x7f8f0006c830 2023-10-08T15:38:09.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.641+0000 7f8efdffb700 1 -- 172.21.15.3:0/569109544 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef00147e0 con 0x7f8f0006c830 2023-10-08T15:38:09.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.641+0000 7f8f08197700 1 -- 172.21.15.3:0/569109544 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f0015ec60 con 0x7f8f0006c830 2023-10-08T15:38:09.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.645+0000 7f8f08197700 1 -- 172.21.15.3:0/569109544 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f0006dab0 con 0x7f8f0006c830 2023-10-08T15:38:09.652 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.645+0000 7f8efdffb700 1 -- 172.21.15.3:0/569109544 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f8ef0014b90 con 0x7f8f0006c830 2023-10-08T15:38:09.652 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.645+0000 7f8efdffb700 1 --2- 172.21.15.3:0/569109544 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8eec060550 0x7f8eec062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:09.652 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.645+0000 7f8efdffb700 1 -- 172.21.15.3:0/569109544 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f8ef007cd50 con 0x7f8f0006c830 2023-10-08T15:38:09.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.645+0000 7f8f05732700 1 --2- 172.21.15.3:0/569109544 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8eec060550 0x7f8eec062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:09.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.649+0000 7f8f05732700 1 --2- 172.21.15.3:0/569109544 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8eec060550 0x7f8eec062a00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8f0014e950 tx=0x7f8ef4007eb0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:09.659 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.653+0000 7f8efdffb700 1 -- 172.21.15.3:0/569109544 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8f0006dab0 con 0x7f8f0006c830 2023-10-08T15:38:09.824 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:09.817+0000 7f8f08197700 1 -- 172.21.15.3:0/569109544 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f8f0006dab0 con 0x7f8f0006c830 2023-10-08T15:38:10.523 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.517+0000 7f8efdffb700 1 -- 172.21.15.3:0/569109544 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v27) v1 ==== 170+0+0 (secure 0 0 0) 0x7f8f0006dab0 con 0x7f8f0006c830 2023-10-08T15:38:10.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.537+0000 7f8f08197700 1 -- 172.21.15.3:0/569109544 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8eec060550 msgr2=0x7f8eec062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:10.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.537+0000 7f8f08197700 1 --2- 172.21.15.3:0/569109544 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8eec060550 0x7f8eec062a00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8f0014e950 tx=0x7f8ef4007eb0 comp rx=0 tx=0).stop 2023-10-08T15:38:10.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.537+0000 7f8f08197700 1 -- 172.21.15.3:0/569109544 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8f0006c830 msgr2=0x7f8f000c0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:10.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.537+0000 7f8f08197700 1 --2- 172.21.15.3:0/569109544 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8f0006c830 0x7f8f000c0e60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8ef000e190 tx=0x7f8ef0009920 comp rx=0 tx=0).stop 2023-10-08T15:38:10.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.537+0000 7f8f08197700 1 -- 172.21.15.3:0/569109544 shutdown_connections 2023-10-08T15:38:10.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.537+0000 7f8f08197700 1 --2- 172.21.15.3:0/569109544 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8eec060550 0x7f8eec062a00 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:10.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.537+0000 7f8f08197700 1 --2- 172.21.15.3:0/569109544 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8f0014a9d0 0x7f8f00147c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:10.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.537+0000 7f8f08197700 1 --2- 172.21.15.3:0/569109544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f000bf3a0 0x7f8f0014ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:10.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.537+0000 7f8f08197700 1 --2- 172.21.15.3:0/569109544 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8f0006c830 0x7f8f000c0e60 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:10.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.537+0000 7f8f08197700 1 -- 172.21.15.3:0/569109544 >> 172.21.15.3:0/569109544 conn(0x7f8f000c2a80 msgr2=0x7f8f00145200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:10.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.537+0000 7f8f08197700 1 -- 172.21.15.3:0/569109544 shutdown_connections 2023-10-08T15:38:10.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.537+0000 7f8f08197700 1 -- 172.21.15.3:0/569109544 wait complete. 2023-10-08T15:38:10.546 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'cephfs_data' created 2023-10-08T15:38:10.556 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T15:38:10.668 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.661+0000 7fa312078700 1 Processor -- start 2023-10-08T15:38:10.668 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.661+0000 7fa312078700 1 -- start start 2023-10-08T15:38:10.669 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.661+0000 7fa312078700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa30c1479f0 0x7fa30c067bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:10.669 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.661+0000 7fa312078700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa30c14bb10 con 0x7fa30c068130 2023-10-08T15:38:10.669 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.661+0000 7fa312078700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa30c1494d0 con 0x7fa30c069ed0 2023-10-08T15:38:10.669 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.661+0000 7fa312078700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa30c06dcc0 con 0x7fa30c1479f0 2023-10-08T15:38:10.670 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.661+0000 7fa30bfff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fa30c068130 0x7fa30c147dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:35276/0 (socket says 172.21.15.3:35276) 2023-10-08T15:38:10.670 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.665+0000 7fa30bfff700 1 -- 172.21.15.3:0/3242854460 learned_addr learned my addr 172.21.15.3:0/3242854460 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:38:10.670 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.665+0000 7fa30b7fe700 1 --2- 172.21.15.3:0/3242854460 >> v2:172.21.15.50:3300/0 conn(0x7fa30c1479f0 0x7fa30c067bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:10.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.665+0000 7fa30a7fc700 1 -- 172.21.15.3:0/3242854460 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 193833978 0 0) 0x7fa30c14bb10 con 0x7fa30c068130 2023-10-08T15:38:10.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.665+0000 7fa30a7fc700 1 -- 172.21.15.3:0/3242854460 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2f4003570 con 0x7fa30c068130 2023-10-08T15:38:10.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.665+0000 7fa30b7fe700 1 -- 172.21.15.3:0/3242854460 >> v1:172.21.15.50:6789/0 conn(0x7fa30c069ed0 legacy=0x7fa30c14bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:10.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.665+0000 7fa30b7fe700 1 -- 172.21.15.3:0/3242854460 >> v1:172.21.15.3:6789/0 conn(0x7fa30c068130 legacy=0x7fa30c147dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:10.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.665+0000 7fa30b7fe700 1 -- 172.21.15.3:0/3242854460 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa30c06d9e0 con 0x7fa30c1479f0 2023-10-08T15:38:10.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.665+0000 7fa30b7fe700 1 --2- 172.21.15.3:0/3242854460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa30c1479f0 0x7fa30c067bf0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa304009e60 tx=0x7fa304009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d356ac2ff12dbf25 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:10.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.665+0000 7fa30a7fc700 1 -- 172.21.15.3:0/3242854460 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30400e070 con 0x7fa30c1479f0 2023-10-08T15:38:10.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.665+0000 7fa30a7fc700 1 -- 172.21.15.3:0/3242854460 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa30400bb60 con 0x7fa30c1479f0 2023-10-08T15:38:10.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.665+0000 7fa30a7fc700 1 -- 172.21.15.3:0/3242854460 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa304012430 con 0x7fa30c1479f0 2023-10-08T15:38:10.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.665+0000 7fa312078700 1 -- 172.21.15.3:0/3242854460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa30c1479f0 msgr2=0x7fa30c067bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:10.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.665+0000 7fa312078700 1 --2- 172.21.15.3:0/3242854460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa30c1479f0 0x7fa30c067bf0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa304009e60 tx=0x7fa304009780 comp rx=0 tx=0).stop 2023-10-08T15:38:10.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.665+0000 7fa312078700 1 -- 172.21.15.3:0/3242854460 shutdown_connections 2023-10-08T15:38:10.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.665+0000 7fa312078700 1 --2- 172.21.15.3:0/3242854460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa30c1479f0 0x7fa30c067bf0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:10.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.665+0000 7fa312078700 1 -- 172.21.15.3:0/3242854460 >> 172.21.15.3:0/3242854460 conn(0x7fa30c0670e0 msgr2=0x7fa30c0674e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:10.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.665+0000 7fa312078700 1 -- 172.21.15.3:0/3242854460 shutdown_connections 2023-10-08T15:38:10.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.665+0000 7fa312078700 1 -- 172.21.15.3:0/3242854460 wait complete. 2023-10-08T15:38:10.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.669+0000 7fa312078700 1 Processor -- start 2023-10-08T15:38:10.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.669+0000 7fa312078700 1 -- start start 2023-10-08T15:38:10.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.669+0000 7fa312078700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa30c068130 0x7fa30c0b9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:10.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.669+0000 7fa312078700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa30c069ed0 0x7fa30c14a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:10.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.669+0000 7fa312078700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa30c1479f0 0x7fa30c145650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:10.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.669+0000 7fa312078700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa30c0b8b80 con 0x7fa30c068130 2023-10-08T15:38:10.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.669+0000 7fa312078700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa30c13fcd0 con 0x7fa30c1479f0 2023-10-08T15:38:10.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.669+0000 7fa312078700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa30c15d4f0 con 0x7fa30c069ed0 2023-10-08T15:38:10.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.669+0000 7fa30b7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa30c068130 0x7fa30c0b9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:10.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.669+0000 7fa30b7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa30c068130 0x7fa30c0b9b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:48088/0 (socket says 172.21.15.3:48088) 2023-10-08T15:38:10.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.669+0000 7fa30b7fe700 1 -- 172.21.15.3:0/265197493 learned_addr learned my addr 172.21.15.3:0/265197493 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:38:10.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.669+0000 7fa30bfff700 1 --2- 172.21.15.3:0/265197493 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa30c1479f0 0x7fa30c145650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:10.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.669+0000 7fa30affd700 1 --2- 172.21.15.3:0/265197493 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa30c069ed0 0x7fa30c14a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:10.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.669+0000 7fa30b7fe700 1 -- 172.21.15.3:0/265197493 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa30c069ed0 msgr2=0x7fa30c14a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:10.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.669+0000 7fa30b7fe700 1 --2- 172.21.15.3:0/265197493 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa30c069ed0 0x7fa30c14a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:10.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.669+0000 7fa30b7fe700 1 -- 172.21.15.3:0/265197493 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa30c1479f0 msgr2=0x7fa30c145650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:10.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.669+0000 7fa30b7fe700 1 --2- 172.21.15.3:0/265197493 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa30c1479f0 0x7fa30c145650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:10.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.669+0000 7fa30b7fe700 1 -- 172.21.15.3:0/265197493 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa304009a20 con 0x7fa30c068130 2023-10-08T15:38:10.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.669+0000 7fa30bfff700 1 --2- 172.21.15.3:0/265197493 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa30c1479f0 0x7fa30c145650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:38:10.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.669+0000 7fa30b7fe700 1 --2- 172.21.15.3:0/265197493 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa30c068130 0x7fa30c0b9b10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa30c063740 tx=0x7fa304019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:10.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.669+0000 7fa2f37fe700 1 -- 172.21.15.3:0/265197493 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa304012ad0 con 0x7fa30c068130 2023-10-08T15:38:10.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.669+0000 7fa2f37fe700 1 -- 172.21.15.3:0/265197493 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa304021070 con 0x7fa30c068130 2023-10-08T15:38:10.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.669+0000 7fa312078700 1 -- 172.21.15.3:0/265197493 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa30c14af20 con 0x7fa30c068130 2023-10-08T15:38:10.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.673+0000 7fa2f37fe700 1 -- 172.21.15.3:0/265197493 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa304012ea0 con 0x7fa30c068130 2023-10-08T15:38:10.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.673+0000 7fa312078700 1 -- 172.21.15.3:0/265197493 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa30c0b6e20 con 0x7fa30c068130 2023-10-08T15:38:10.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.673+0000 7fa312078700 1 -- 172.21.15.3:0/265197493 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa30c064530 con 0x7fa30c068130 2023-10-08T15:38:10.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.673+0000 7fa2f37fe700 1 -- 172.21.15.3:0/265197493 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa304023030 con 0x7fa30c068130 2023-10-08T15:38:10.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.673+0000 7fa2f37fe700 1 --2- 172.21.15.3:0/265197493 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fa2f8060580 0x7fa2f8062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:10.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.673+0000 7fa2f37fe700 1 -- 172.21.15.3:0/265197493 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5605+0+0 (secure 0 0 0) 0x7fa30407e580 con 0x7fa30c068130 2023-10-08T15:38:10.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.673+0000 7fa30affd700 1 --2- 172.21.15.3:0/265197493 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fa2f8060580 0x7fa2f8062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:10.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.677+0000 7fa30affd700 1 --2- 172.21.15.3:0/265197493 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fa2f8060580 0x7fa2f8062a30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa30c0bba50 tx=0x7fa300009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:10.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.685+0000 7fa2f37fe700 1 -- 172.21.15.3:0/265197493 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa30404eb30 con 0x7fa30c068130 2023-10-08T15:38:10.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:10.885+0000 7fa312078700 1 -- 172.21.15.3:0/265197493 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fa30c06ed60 con 0x7fa30c068130 2023-10-08T15:38:11.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.545+0000 7fa2f37fe700 1 -- 172.21.15.3:0/265197493 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v11) v1 ==== 172+0+0 (secure 0 0 0) 0x7fa304052150 con 0x7fa30c068130 2023-10-08T15:38:11.562 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.557+0000 7fa312078700 1 -- 172.21.15.3:0/265197493 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fa2f8060580 msgr2=0x7fa2f8062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:11.562 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.557+0000 7fa312078700 1 --2- 172.21.15.3:0/265197493 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fa2f8060580 0x7fa2f8062a30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa30c0bba50 tx=0x7fa300009040 comp rx=0 tx=0).stop 2023-10-08T15:38:11.562 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.557+0000 7fa312078700 1 -- 172.21.15.3:0/265197493 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa30c068130 msgr2=0x7fa30c0b9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:11.562 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.557+0000 7fa312078700 1 --2- 172.21.15.3:0/265197493 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa30c068130 0x7fa30c0b9b10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa30c063740 tx=0x7fa304019000 comp rx=0 tx=0).stop 2023-10-08T15:38:11.562 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.557+0000 7fa312078700 1 -- 172.21.15.3:0/265197493 shutdown_connections 2023-10-08T15:38:11.562 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.557+0000 7fa312078700 1 --2- 172.21.15.3:0/265197493 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fa2f8060580 0x7fa2f8062a30 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:11.562 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.557+0000 7fa312078700 1 --2- 172.21.15.3:0/265197493 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa30c1479f0 0x7fa30c145650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:11.562 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.557+0000 7fa312078700 1 --2- 172.21.15.3:0/265197493 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa30c069ed0 0x7fa30c14a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:11.562 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.557+0000 7fa312078700 1 --2- 172.21.15.3:0/265197493 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa30c068130 0x7fa30c0b9b10 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:11.563 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.557+0000 7fa312078700 1 -- 172.21.15.3:0/265197493 >> 172.21.15.3:0/265197493 conn(0x7fa30c0670e0 msgr2=0x7fa30c0b1e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:11.563 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.557+0000 7fa312078700 1 -- 172.21.15.3:0/265197493 shutdown_connections 2023-10-08T15:38:11.563 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.557+0000 7fa312078700 1 -- 172.21.15.3:0/265197493 wait complete. 2023-10-08T15:38:11.563 INFO:teuthology.orchestra.run.smithi003.stderr:new fs with metadata pool 4 and data pool 5 2023-10-08T15:38:11.573 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:38:11.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.665+0000 7f5ac2d3e700 1 Processor -- start 2023-10-08T15:38:11.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.665+0000 7f5ac2d3e700 1 -- start start 2023-10-08T15:38:11.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.665+0000 7f5ac2d3e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5abc0a1fd0 0x7f5abc148330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:11.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.665+0000 7f5ac2d3e700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f5abc0bc4f0 0x7f5abc147280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:11.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.665+0000 7f5ac2d3e700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5abc0b3b10 con 0x7f5abc14c6c0 2023-10-08T15:38:11.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.665+0000 7f5ac2d3e700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5abc14b9d0 con 0x7f5abc0bc4f0 2023-10-08T15:38:11.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.665+0000 7f5ac2d3e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5abc14bbe0 con 0x7f5abc0a1fd0 2023-10-08T15:38:11.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.669+0000 7f5ac12db700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f5abc0bc4f0 0x7f5abc147280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:11.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.669+0000 7f5abbfff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f5abc14c6c0 0x7f5abc148870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:35286/0 (socket says 172.21.15.3:35286) 2023-10-08T15:38:11.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.669+0000 7f5abbfff700 1 -- 172.21.15.3:0/551059555 learned_addr learned my addr 172.21.15.3:0/551059555 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:38:11.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.669+0000 7f5ac0ada700 1 --2- 172.21.15.3:0/551059555 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5abc0a1fd0 0x7f5abc148330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:11.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.669+0000 7f5abb7fe700 1 -- 172.21.15.3:0/551059555 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1469271156 0 0) 0x7f5abc0b3b10 con 0x7f5abc14c6c0 2023-10-08T15:38:11.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.669+0000 7f5abb7fe700 1 -- 172.21.15.3:0/551059555 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5aac003570 con 0x7f5abc14c6c0 2023-10-08T15:38:11.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.669+0000 7f5ac12db700 1 -- 172.21.15.3:0/551059555 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5abc0a1fd0 msgr2=0x7f5abc148330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:38:11.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.669+0000 7f5ac12db700 1 --2- 172.21.15.3:0/551059555 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5abc0a1fd0 0x7f5abc148330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:11.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.669+0000 7f5ac12db700 1 -- 172.21.15.3:0/551059555 >> v1:172.21.15.3:6789/0 conn(0x7f5abc14c6c0 legacy=0x7f5abc148870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:11.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.669+0000 7f5ac12db700 1 -- 172.21.15.3:0/551059555 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5abc14bec0 con 0x7f5abc0bc4f0 2023-10-08T15:38:11.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.669+0000 7f5ac12db700 1 --2- 172.21.15.3:0/551059555 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5abc0bc4f0 0x7f5abc147280 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4009e60 tx=0x7f5ab4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aabc362faa47d67 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:11.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.669+0000 7f5abb7fe700 1 -- 172.21.15.3:0/551059555 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab400e070 con 0x7f5abc0bc4f0 2023-10-08T15:38:11.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.669+0000 7f5abb7fe700 1 -- 172.21.15.3:0/551059555 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ab400bab0 con 0x7f5abc0bc4f0 2023-10-08T15:38:11.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.669+0000 7f5abb7fe700 1 -- 172.21.15.3:0/551059555 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab400be70 con 0x7f5abc0bc4f0 2023-10-08T15:38:11.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.669+0000 7f5ac2d3e700 1 -- 172.21.15.3:0/551059555 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5abc0bc4f0 msgr2=0x7f5abc147280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:11.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.669+0000 7f5ac2d3e700 1 --2- 172.21.15.3:0/551059555 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5abc0bc4f0 0x7f5abc147280 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4009e60 tx=0x7f5ab4009780 comp rx=0 tx=0).stop 2023-10-08T15:38:11.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.669+0000 7f5ac2d3e700 1 -- 172.21.15.3:0/551059555 shutdown_connections 2023-10-08T15:38:11.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.669+0000 7f5ac2d3e700 1 --2- 172.21.15.3:0/551059555 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5abc0bc4f0 0x7f5abc147280 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:11.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.669+0000 7f5ac2d3e700 1 --2- 172.21.15.3:0/551059555 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5abc0a1fd0 0x7f5abc148330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:11.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.669+0000 7f5ac2d3e700 1 -- 172.21.15.3:0/551059555 >> 172.21.15.3:0/551059555 conn(0x7f5abc06b9b0 msgr2=0x7f5abc0681f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:11.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.669+0000 7f5ac2d3e700 1 -- 172.21.15.3:0/551059555 shutdown_connections 2023-10-08T15:38:11.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.669+0000 7f5ac2d3e700 1 -- 172.21.15.3:0/551059555 wait complete. 2023-10-08T15:38:11.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.673+0000 7f5ac2d3e700 1 Processor -- start 2023-10-08T15:38:11.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.673+0000 7f5ac2d3e700 1 -- start start 2023-10-08T15:38:11.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.673+0000 7f5ac2d3e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5abc0a1fd0 0x7f5abc158e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:11.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.673+0000 7f5ac2d3e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5abc0bc4f0 0x7f5abc06d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:11.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.673+0000 7f5ac2d3e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5abc14c6c0 0x7f5abc06d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:11.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.673+0000 7f5ac2d3e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5abc06ddd0 con 0x7f5abc0bc4f0 2023-10-08T15:38:11.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.673+0000 7f5ac2d3e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5abc14a6e0 con 0x7f5abc14c6c0 2023-10-08T15:38:11.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.673+0000 7f5ac2d3e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5abc14a090 con 0x7f5abc0a1fd0 2023-10-08T15:38:11.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.673+0000 7f5abbfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5abc0bc4f0 0x7f5abc06d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:11.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.673+0000 7f5abbfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5abc0bc4f0 0x7f5abc06d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:48102/0 (socket says 172.21.15.3:48102) 2023-10-08T15:38:11.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.673+0000 7f5abbfff700 1 -- 172.21.15.3:0/2347663462 learned_addr learned my addr 172.21.15.3:0/2347663462 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:38:11.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.673+0000 7f5ac0ada700 1 --2- 172.21.15.3:0/2347663462 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5abc0a1fd0 0x7f5abc158e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:11.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.673+0000 7f5ac12db700 1 --2- 172.21.15.3:0/2347663462 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5abc14c6c0 0x7f5abc06d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:11.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.673+0000 7f5abbfff700 1 -- 172.21.15.3:0/2347663462 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5abc0a1fd0 msgr2=0x7f5abc158e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:11.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.673+0000 7f5abbfff700 1 --2- 172.21.15.3:0/2347663462 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5abc0a1fd0 0x7f5abc158e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:11.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.673+0000 7f5abbfff700 1 -- 172.21.15.3:0/2347663462 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5abc14c6c0 msgr2=0x7f5abc06d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:11.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.673+0000 7f5abbfff700 1 --2- 172.21.15.3:0/2347663462 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5abc14c6c0 0x7f5abc06d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:11.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.673+0000 7f5abbfff700 1 -- 172.21.15.3:0/2347663462 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab4009a20 con 0x7f5abc0bc4f0 2023-10-08T15:38:11.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.673+0000 7f5abbfff700 1 --2- 172.21.15.3:0/2347663462 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5abc0bc4f0 0x7f5abc06d090 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5aa800ea00 tx=0x7f5aa8007e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:11.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.673+0000 7f5ab8ff9700 1 -- 172.21.15.3:0/2347663462 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa8005b30 con 0x7f5abc0bc4f0 2023-10-08T15:38:11.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.673+0000 7f5ab8ff9700 1 -- 172.21.15.3:0/2347663462 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aa8005c90 con 0x7f5abc0bc4f0 2023-10-08T15:38:11.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.673+0000 7f5ac2d3e700 1 -- 172.21.15.3:0/2347663462 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5abc14a370 con 0x7f5abc0bc4f0 2023-10-08T15:38:11.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.673+0000 7f5ab8ff9700 1 -- 172.21.15.3:0/2347663462 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa8007340 con 0x7f5abc0bc4f0 2023-10-08T15:38:11.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.673+0000 7f5ac2d3e700 1 -- 172.21.15.3:0/2347663462 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5abc14b2d0 con 0x7f5abc0bc4f0 2023-10-08T15:38:11.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.677+0000 7f5ac2d3e700 1 -- 172.21.15.3:0/2347663462 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5abc064530 con 0x7f5abc0bc4f0 2023-10-08T15:38:11.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.677+0000 7f5ab8ff9700 1 -- 172.21.15.3:0/2347663462 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5aa80104a0 con 0x7f5abc0bc4f0 2023-10-08T15:38:11.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.677+0000 7f5ab8ff9700 1 --2- 172.21.15.3:0/2347663462 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5aa0060580 0x7f5aa0062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:11.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.677+0000 7f5ab8ff9700 1 -- 172.21.15.3:0/2347663462 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5aa807e9f0 con 0x7f5abc0bc4f0 2023-10-08T15:38:11.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.677+0000 7f5ac0ada700 1 --2- 172.21.15.3:0/2347663462 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5aa0060580 0x7f5aa0062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:11.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.677+0000 7f5ac0ada700 1 --2- 172.21.15.3:0/2347663462 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5aa0060580 0x7f5aa0062a30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0009db0 tx=0x7f5ab00091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:11.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.685+0000 7f5ab8ff9700 1 -- 172.21.15.3:0/2347663462 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5aa804f060 con 0x7f5abc0bc4f0 2023-10-08T15:38:11.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.849+0000 7f5ac2d3e700 1 -- 172.21.15.3:0/2347663462 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5abc0b2cd0 con 0x7f5abc0bc4f0 2023-10-08T15:38:11.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.849+0000 7f5ab8ff9700 1 -- 172.21.15.3:0/2347663462 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+15267 (secure 0 0 0) 0x7f5aa8052680 con 0x7f5abc0bc4f0 2023-10-08T15:38:11.856 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:38:11.856 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":28,"fsid":"7635972e-cd66-4a8f-a231-378db8b3847a","created":"2023-10-08T15:37:08.234594+0000","modified":"2023-10-08T15:38:10.890992+0000","last_up_change":"2023-10-08T15:37:17.537726+0000","last_in_change":"2023-10-08T15:37:10.269178+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:37:16.581590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:38:09.361822+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-08T15:38:09.863387+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"64fb1864-bfdd-4d75-9b41-03fb60085dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33363},{"type":"v1","addr":"172.21.15.3:6801","nonce":33363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33363},{"type":"v1","addr":"172.21.15.3:6803","nonce":33363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":33363},{"type":"v1","addr":"172.21.15.3:6807","nonce":33363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33363},{"type":"v1","addr":"172.21.15.3:6805","nonce":33363}]},"public_addr":"172.21.15.3:6801/33363","cluster_addr":"172.21.15.3:6803/33363","heartbeat_back_addr":"172.21.15.3:6807/33363","heartbeat_front_addr":"172.21.15.3:6805/33363","state":["exists","up"]},{"osd":1,"uuid":"3ca6bd3a-3e8a-4c65-af9c-46148b0c2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33364},{"type":"v1","addr":"172.21.15.3:6820","nonce":33364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33364},{"type":"v1","addr":"172.21.15.3:6824","nonce":33364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33364},{"type":"v1","addr":"172.21.15.3:6831","nonce":33364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33364},{"type":"v1","addr":"172.21.15.3:6828","nonce":33364}]},"public_addr":"172.21.15.3:6820/33364","cluster_addr":"172.21.15.3:6824/33364","heartbeat_back_addr":"172.21.15.3:6831/33364","heartbeat_front_addr":"172.21.15.3:6828/33364","state":["exists","up"]},{"osd":2,"uuid":"6eb9f757-58dd-442f-910d-32401454bce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33366},{"type":"v1","addr":"172.21.15.3:6817","nonce":33366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":33366},{"type":"v1","addr":"172.21.15.3:6821","nonce":33366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6827","nonce":33366},{"type":"v1","addr":"172.21.15.3:6829","nonce":33366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":33366},{"type":"v1","addr":"172.21.15.3:6825","nonce":33366}]},"public_addr":"172.21.15.3:6817/33366","cluster_addr":"172.21.15.3:6821/33366","heartbeat_back_addr":"172.21.15.3:6829/33366","heartbeat_front_addr":"172.21.15.3:6825/33366","state":["exists","up"]},{"osd":3,"uuid":"1c39866b-ac2e-4ea9-a69c-02b01ee4191d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33365},{"type":"v1","addr":"172.21.15.3:6809","nonce":33365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":33365},{"type":"v1","addr":"172.21.15.3:6811","nonce":33365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33365},{"type":"v1","addr":"172.21.15.3:6815","nonce":33365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":33365},{"type":"v1","addr":"172.21.15.3:6813","nonce":33365}]},"public_addr":"172.21.15.3:6809/33365","cluster_addr":"172.21.15.3:6811/33365","heartbeat_back_addr":"172.21.15.3:6815/33365","heartbeat_front_addr":"172.21.15.3:6813/33365","state":["exists","up"]},{"osd":4,"uuid":"15f86b61-b7f1-4780-ae00-9d80a68cb830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":33605},{"type":"v1","addr":"172.21.15.50:6809","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33605},{"type":"v1","addr":"172.21.15.50:6811","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33605},{"type":"v1","addr":"172.21.15.50:6815","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":33605},{"type":"v1","addr":"172.21.15.50:6813","nonce":33605}]},"public_addr":"172.21.15.50:6809/33605","cluster_addr":"172.21.15.50:6811/33605","heartbeat_back_addr":"172.21.15.50:6815/33605","heartbeat_front_addr":"172.21.15.50:6813/33605","state":["exists","up"]},{"osd":5,"uuid":"726c3003-34e6-4d5a-b6e2-f911e13c2118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33606},{"type":"v1","addr":"172.21.15.50:6801","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33606},{"type":"v1","addr":"172.21.15.50:6803","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33606},{"type":"v1","addr":"172.21.15.50:6807","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":33606},{"type":"v1","addr":"172.21.15.50:6805","nonce":33606}]},"public_addr":"172.21.15.50:6801/33606","cluster_addr":"172.21.15.50:6803/33606","heartbeat_back_addr":"172.21.15.50:6807/33606","heartbeat_front_addr":"172.21.15.50:6805/33606","state":["exists","up"]},{"osd":6,"uuid":"401122a4-9988-441f-a5a7-39164434ebcd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":33607},{"type":"v1","addr":"172.21.15.50:6819","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":33607},{"type":"v1","addr":"172.21.15.50:6823","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":33607},{"type":"v1","addr":"172.21.15.50:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":33607},{"type":"v1","addr":"172.21.15.50:6827","nonce":33607}]},"public_addr":"172.21.15.50:6819/33607","cluster_addr":"172.21.15.50:6823/33607","heartbeat_back_addr":"172.21.15.50:6831/33607","heartbeat_front_addr":"172.21.15.50:6827/33607","state":["exists","up"]},{"osd":7,"uuid":"6b3fa236-c9d0-4c4d-82ae-9af4daf6d699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33604},{"type":"v1","addr":"172.21.15.50:6818","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":33604},{"type":"v1","addr":"172.21.15.50:6822","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":33604},{"type":"v1","addr":"172.21.15.50:6830","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":33604},{"type":"v1","addr":"172.21.15.50:6826","nonce":33604}]},"public_addr":"172.21.15.50:6818/33604","cluster_addr":"172.21.15.50:6822/33604","heartbeat_back_addr":"172.21.15.50:6830/33604","heartbeat_front_addr":"172.21.15.50:6826/33604","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.497794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.529417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.873426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.325972+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.443971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.240795+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.739632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.643026+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:38:11.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.853+0000 7f5ac2d3e700 1 -- 172.21.15.3:0/2347663462 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5aa0060580 msgr2=0x7f5aa0062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:11.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.853+0000 7f5ac2d3e700 1 --2- 172.21.15.3:0/2347663462 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5aa0060580 0x7f5aa0062a30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0009db0 tx=0x7f5ab00091a0 comp rx=0 tx=0).stop 2023-10-08T15:38:11.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.853+0000 7f5ac2d3e700 1 -- 172.21.15.3:0/2347663462 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5abc0bc4f0 msgr2=0x7f5abc06d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:11.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.853+0000 7f5ac2d3e700 1 --2- 172.21.15.3:0/2347663462 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5abc0bc4f0 0x7f5abc06d090 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5aa800ea00 tx=0x7f5aa8007e60 comp rx=0 tx=0).stop 2023-10-08T15:38:11.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.853+0000 7f5ac2d3e700 1 -- 172.21.15.3:0/2347663462 shutdown_connections 2023-10-08T15:38:11.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.853+0000 7f5ac2d3e700 1 --2- 172.21.15.3:0/2347663462 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5aa0060580 0x7f5aa0062a30 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:11.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.853+0000 7f5ac2d3e700 1 --2- 172.21.15.3:0/2347663462 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5abc14c6c0 0x7f5abc06d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:11.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.853+0000 7f5ac2d3e700 1 --2- 172.21.15.3:0/2347663462 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5abc0bc4f0 0x7f5abc06d090 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:11.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.853+0000 7f5ac2d3e700 1 --2- 172.21.15.3:0/2347663462 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5abc0a1fd0 0x7f5abc158e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:11.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.853+0000 7f5ac2d3e700 1 -- 172.21.15.3:0/2347663462 >> 172.21.15.3:0/2347663462 conn(0x7f5abc06b9b0 msgr2=0x7f5abc1420d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:11.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.853+0000 7f5ac2d3e700 1 -- 172.21.15.3:0/2347663462 shutdown_connections 2023-10-08T15:38:11.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.853+0000 7f5ac2d3e700 1 -- 172.21.15.3:0/2347663462 wait complete. 2023-10-08T15:38:11.870 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:38:11.974 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.969+0000 7feaaad33700 1 Processor -- start 2023-10-08T15:38:11.974 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.969+0000 7feaaad33700 1 -- start start 2023-10-08T15:38:11.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.969+0000 7feaaad33700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7feaa40bce50 0x7feaa4147d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:11.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.969+0000 7feaaad33700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feaa406cf60 0x7feaa4148250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:11.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.969+0000 7feaaad33700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaa414bde0 con 0x7feaa40bca80 2023-10-08T15:38:11.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.969+0000 7feaaad33700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaa414b920 con 0x7feaa40bce50 2023-10-08T15:38:11.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.969+0000 7feaaad33700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaa406d6f0 con 0x7feaa406cf60 2023-10-08T15:38:11.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.969+0000 7feaa9d31700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7feaa40bca80 0x7feaa40b2340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:35294/0 (socket says 172.21.15.3:35294) 2023-10-08T15:38:11.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.969+0000 7feaa9d31700 1 -- 172.21.15.3:0/752419673 learned_addr learned my addr 172.21.15.3:0/752419673 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:38:11.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.969+0000 7feaa9530700 1 --2- 172.21.15.3:0/752419673 >> v2:172.21.15.50:3300/0 conn(0x7feaa40bce50 0x7feaa4147d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:11.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.969+0000 7feaaa532700 1 --2- 172.21.15.3:0/752419673 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feaa406cf60 0x7feaa4148250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:11.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.969+0000 7feaa8d2f700 1 -- 172.21.15.3:0/752419673 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1714400538 0 0) 0x7feaa414bde0 con 0x7feaa40bca80 2023-10-08T15:38:11.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.969+0000 7feaa8d2f700 1 -- 172.21.15.3:0/752419673 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea90003570 con 0x7feaa40bca80 2023-10-08T15:38:11.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.969+0000 7feaa9530700 1 -- 172.21.15.3:0/752419673 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feaa406cf60 msgr2=0x7feaa4148250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:38:11.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.969+0000 7feaa9530700 1 --2- 172.21.15.3:0/752419673 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feaa406cf60 0x7feaa4148250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:11.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.969+0000 7feaa9530700 1 -- 172.21.15.3:0/752419673 >> v1:172.21.15.3:6789/0 conn(0x7feaa40bca80 legacy=0x7feaa40b2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:11.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.969+0000 7feaa9530700 1 -- 172.21.15.3:0/752419673 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa414bb00 con 0x7feaa40bce50 2023-10-08T15:38:11.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.969+0000 7feaaa532700 1 --2- 172.21.15.3:0/752419673 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feaa406cf60 0x7feaa4148250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:38:11.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.969+0000 7feaa9530700 1 --2- 172.21.15.3:0/752419673 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feaa40bce50 0x7feaa4147d10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7feaa0009e60 tx=0x7feaa0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6063ecce7f11ca4f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:11.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.969+0000 7feaa8d2f700 1 -- 172.21.15.3:0/752419673 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa000e070 con 0x7feaa40bce50 2023-10-08T15:38:11.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.969+0000 7feaa8d2f700 1 -- 172.21.15.3:0/752419673 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa000bb60 con 0x7feaa40bce50 2023-10-08T15:38:11.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.969+0000 7feaa8d2f700 1 -- 172.21.15.3:0/752419673 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa0012430 con 0x7feaa40bce50 2023-10-08T15:38:11.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.973+0000 7feaaad33700 1 -- 172.21.15.3:0/752419673 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feaa40bce50 msgr2=0x7feaa4147d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:11.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.973+0000 7feaaad33700 1 --2- 172.21.15.3:0/752419673 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feaa40bce50 0x7feaa4147d10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7feaa0009e60 tx=0x7feaa0009780 comp rx=0 tx=0).stop 2023-10-08T15:38:11.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.973+0000 7feaaad33700 1 -- 172.21.15.3:0/752419673 shutdown_connections 2023-10-08T15:38:11.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.973+0000 7feaaad33700 1 --2- 172.21.15.3:0/752419673 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feaa406cf60 0x7feaa4148250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:11.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.973+0000 7feaaad33700 1 --2- 172.21.15.3:0/752419673 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feaa40bce50 0x7feaa4147d10 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:11.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.973+0000 7feaaad33700 1 -- 172.21.15.3:0/752419673 >> 172.21.15.3:0/752419673 conn(0x7feaa40be4a0 msgr2=0x7feaa40ba440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:11.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.973+0000 7feaaad33700 1 -- 172.21.15.3:0/752419673 shutdown_connections 2023-10-08T15:38:11.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.973+0000 7feaaad33700 1 -- 172.21.15.3:0/752419673 wait complete. 2023-10-08T15:38:11.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.973+0000 7feaaad33700 1 Processor -- start 2023-10-08T15:38:11.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.973+0000 7feaaad33700 1 -- start start 2023-10-08T15:38:11.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.977+0000 7feaaad33700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feaa406cf60 0x7feaa415c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:11.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.977+0000 7feaaad33700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feaa40bca80 0x7feaa415c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:11.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.977+0000 7feaaad33700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feaa40bce50 0x7feaa4143bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:11.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.977+0000 7feaaad33700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa41347b0 con 0x7feaa40bca80 2023-10-08T15:38:11.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.977+0000 7feaaad33700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa415cbf0 con 0x7feaa406cf60 2023-10-08T15:38:11.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.977+0000 7feaaad33700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaa41597b0 con 0x7feaa40bce50 2023-10-08T15:38:11.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.977+0000 7feaa9530700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feaa40bca80 0x7feaa415c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:11.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.977+0000 7feaa9530700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feaa40bca80 0x7feaa415c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:48106/0 (socket says 172.21.15.3:48106) 2023-10-08T15:38:11.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.977+0000 7feaa9530700 1 -- 172.21.15.3:0/3479304386 learned_addr learned my addr 172.21.15.3:0/3479304386 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:38:11.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.977+0000 7feaa9d31700 1 --2- 172.21.15.3:0/3479304386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feaa406cf60 0x7feaa415c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:11.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.977+0000 7feaaa532700 1 --2- 172.21.15.3:0/3479304386 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feaa40bce50 0x7feaa4143bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:11.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.977+0000 7feaa9d31700 1 -- 172.21.15.3:0/3479304386 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feaa40bce50 msgr2=0x7feaa4143bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:11.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.977+0000 7feaa9d31700 1 --2- 172.21.15.3:0/3479304386 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feaa40bce50 0x7feaa4143bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:11.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.977+0000 7feaa9d31700 1 -- 172.21.15.3:0/3479304386 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feaa40bca80 msgr2=0x7feaa415c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:11.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.977+0000 7feaa9d31700 1 --2- 172.21.15.3:0/3479304386 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feaa40bca80 0x7feaa415c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:11.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.977+0000 7feaa9d31700 1 -- 172.21.15.3:0/3479304386 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa0009a20 con 0x7feaa406cf60 2023-10-08T15:38:11.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.977+0000 7feaa9d31700 1 --2- 172.21.15.3:0/3479304386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feaa406cf60 0x7feaa415c170 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fea9400c580 tx=0x7fea94007d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:11.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.977+0000 7fea99ffb700 1 -- 172.21.15.3:0/3479304386 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea94005b30 con 0x7feaa406cf60 2023-10-08T15:38:11.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.977+0000 7fea99ffb700 1 -- 172.21.15.3:0/3479304386 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea94005cb0 con 0x7feaa406cf60 2023-10-08T15:38:11.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.977+0000 7feaaad33700 1 -- 172.21.15.3:0/3479304386 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaa41425e0 con 0x7feaa406cf60 2023-10-08T15:38:11.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.977+0000 7fea99ffb700 1 -- 172.21.15.3:0/3479304386 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea94007320 con 0x7feaa406cf60 2023-10-08T15:38:11.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.977+0000 7feaaad33700 1 -- 172.21.15.3:0/3479304386 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaa41594f0 con 0x7feaa406cf60 2023-10-08T15:38:11.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.977+0000 7feaaad33700 1 -- 172.21.15.3:0/3479304386 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaa405ecf0 con 0x7feaa406cf60 2023-10-08T15:38:11.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.981+0000 7fea99ffb700 1 -- 172.21.15.3:0/3479304386 <== mon.1 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fea9401b3b0 con 0x7feaa406cf60 2023-10-08T15:38:11.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.981+0000 7fea99ffb700 1 --2- 172.21.15.3:0/3479304386 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fea88060600 0x7fea88062ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:11.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.981+0000 7fea99ffb700 1 -- 172.21.15.3:0/3479304386 <== mon.1 v2:172.21.15.50:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fea9407bc20 con 0x7feaa406cf60 2023-10-08T15:38:11.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.981+0000 7feaa9530700 1 --2- 172.21.15.3:0/3479304386 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fea88060600 0x7fea88062ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:11.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.981+0000 7feaa9530700 1 --2- 172.21.15.3:0/3479304386 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fea88060600 0x7fea88062ab0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7feaa4154360 tx=0x7feaa0019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:11.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:11.993+0000 7fea99ffb700 1 -- 172.21.15.3:0/3479304386 <== mon.1 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fea9404c170 con 0x7feaa406cf60 2023-10-08T15:38:12.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.157+0000 7feaaad33700 1 -- 172.21.15.3:0/3479304386 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feaa406d8d0 con 0x7feaa406cf60 2023-10-08T15:38:12.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.157+0000 7fea99ffb700 1 -- 172.21.15.3:0/3479304386 <== mon.1 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+15267 (secure 0 0 0) 0x7fea9404f790 con 0x7feaa406cf60 2023-10-08T15:38:12.164 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:38:12.164 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":28,"fsid":"7635972e-cd66-4a8f-a231-378db8b3847a","created":"2023-10-08T15:37:08.234594+0000","modified":"2023-10-08T15:38:10.890992+0000","last_up_change":"2023-10-08T15:37:17.537726+0000","last_in_change":"2023-10-08T15:37:10.269178+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:37:16.581590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:38:09.361822+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-08T15:38:09.863387+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"64fb1864-bfdd-4d75-9b41-03fb60085dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33363},{"type":"v1","addr":"172.21.15.3:6801","nonce":33363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33363},{"type":"v1","addr":"172.21.15.3:6803","nonce":33363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":33363},{"type":"v1","addr":"172.21.15.3:6807","nonce":33363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33363},{"type":"v1","addr":"172.21.15.3:6805","nonce":33363}]},"public_addr":"172.21.15.3:6801/33363","cluster_addr":"172.21.15.3:6803/33363","heartbeat_back_addr":"172.21.15.3:6807/33363","heartbeat_front_addr":"172.21.15.3:6805/33363","state":["exists","up"]},{"osd":1,"uuid":"3ca6bd3a-3e8a-4c65-af9c-46148b0c2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33364},{"type":"v1","addr":"172.21.15.3:6820","nonce":33364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33364},{"type":"v1","addr":"172.21.15.3:6824","nonce":33364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33364},{"type":"v1","addr":"172.21.15.3:6831","nonce":33364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33364},{"type":"v1","addr":"172.21.15.3:6828","nonce":33364}]},"public_addr":"172.21.15.3:6820/33364","cluster_addr":"172.21.15.3:6824/33364","heartbeat_back_addr":"172.21.15.3:6831/33364","heartbeat_front_addr":"172.21.15.3:6828/33364","state":["exists","up"]},{"osd":2,"uuid":"6eb9f757-58dd-442f-910d-32401454bce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33366},{"type":"v1","addr":"172.21.15.3:6817","nonce":33366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":33366},{"type":"v1","addr":"172.21.15.3:6821","nonce":33366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6827","nonce":33366},{"type":"v1","addr":"172.21.15.3:6829","nonce":33366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":33366},{"type":"v1","addr":"172.21.15.3:6825","nonce":33366}]},"public_addr":"172.21.15.3:6817/33366","cluster_addr":"172.21.15.3:6821/33366","heartbeat_back_addr":"172.21.15.3:6829/33366","heartbeat_front_addr":"172.21.15.3:6825/33366","state":["exists","up"]},{"osd":3,"uuid":"1c39866b-ac2e-4ea9-a69c-02b01ee4191d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33365},{"type":"v1","addr":"172.21.15.3:6809","nonce":33365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":33365},{"type":"v1","addr":"172.21.15.3:6811","nonce":33365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33365},{"type":"v1","addr":"172.21.15.3:6815","nonce":33365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":33365},{"type":"v1","addr":"172.21.15.3:6813","nonce":33365}]},"public_addr":"172.21.15.3:6809/33365","cluster_addr":"172.21.15.3:6811/33365","heartbeat_back_addr":"172.21.15.3:6815/33365","heartbeat_front_addr":"172.21.15.3:6813/33365","state":["exists","up"]},{"osd":4,"uuid":"15f86b61-b7f1-4780-ae00-9d80a68cb830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":33605},{"type":"v1","addr":"172.21.15.50:6809","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33605},{"type":"v1","addr":"172.21.15.50:6811","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33605},{"type":"v1","addr":"172.21.15.50:6815","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":33605},{"type":"v1","addr":"172.21.15.50:6813","nonce":33605}]},"public_addr":"172.21.15.50:6809/33605","cluster_addr":"172.21.15.50:6811/33605","heartbeat_back_addr":"172.21.15.50:6815/33605","heartbeat_front_addr":"172.21.15.50:6813/33605","state":["exists","up"]},{"osd":5,"uuid":"726c3003-34e6-4d5a-b6e2-f911e13c2118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33606},{"type":"v1","addr":"172.21.15.50:6801","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33606},{"type":"v1","addr":"172.21.15.50:6803","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33606},{"type":"v1","addr":"172.21.15.50:6807","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":33606},{"type":"v1","addr":"172.21.15.50:6805","nonce":33606}]},"public_addr":"172.21.15.50:6801/33606","cluster_addr":"172.21.15.50:6803/33606","heartbeat_back_addr":"172.21.15.50:6807/33606","heartbeat_front_addr":"172.21.15.50:6805/33606","state":["exists","up"]},{"osd":6,"uuid":"401122a4-9988-441f-a5a7-39164434ebcd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":33607},{"type":"v1","addr":"172.21.15.50:6819","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":33607},{"type":"v1","addr":"172.21.15.50:6823","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":33607},{"type":"v1","addr":"172.21.15.50:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":33607},{"type":"v1","addr":"172.21.15.50:6827","nonce":33607}]},"public_addr":"172.21.15.50:6819/33607","cluster_addr":"172.21.15.50:6823/33607","heartbeat_back_addr":"172.21.15.50:6831/33607","heartbeat_front_addr":"172.21.15.50:6827/33607","state":["exists","up"]},{"osd":7,"uuid":"6b3fa236-c9d0-4c4d-82ae-9af4daf6d699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33604},{"type":"v1","addr":"172.21.15.50:6818","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":33604},{"type":"v1","addr":"172.21.15.50:6822","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":33604},{"type":"v1","addr":"172.21.15.50:6830","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":33604},{"type":"v1","addr":"172.21.15.50:6826","nonce":33604}]},"public_addr":"172.21.15.50:6818/33604","cluster_addr":"172.21.15.50:6822/33604","heartbeat_back_addr":"172.21.15.50:6830/33604","heartbeat_front_addr":"172.21.15.50:6826/33604","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.497794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.529417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.873426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.325972+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.443971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.240795+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.739632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.643026+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:38:12.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.161+0000 7feaaad33700 1 -- 172.21.15.3:0/3479304386 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fea88060600 msgr2=0x7fea88062ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:12.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.161+0000 7feaaad33700 1 --2- 172.21.15.3:0/3479304386 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fea88060600 0x7fea88062ab0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7feaa4154360 tx=0x7feaa0019000 comp rx=0 tx=0).stop 2023-10-08T15:38:12.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.161+0000 7feaaad33700 1 -- 172.21.15.3:0/3479304386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feaa406cf60 msgr2=0x7feaa415c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:12.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.161+0000 7feaaad33700 1 --2- 172.21.15.3:0/3479304386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feaa406cf60 0x7feaa415c170 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fea9400c580 tx=0x7fea94007d50 comp rx=0 tx=0).stop 2023-10-08T15:38:12.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.161+0000 7feaaad33700 1 -- 172.21.15.3:0/3479304386 shutdown_connections 2023-10-08T15:38:12.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.161+0000 7feaaad33700 1 --2- 172.21.15.3:0/3479304386 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fea88060600 0x7fea88062ab0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:12.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.161+0000 7feaaad33700 1 --2- 172.21.15.3:0/3479304386 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feaa40bce50 0x7feaa4143bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:12.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.161+0000 7feaaad33700 1 --2- 172.21.15.3:0/3479304386 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feaa40bca80 0x7feaa415c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:12.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.161+0000 7feaaad33700 1 --2- 172.21.15.3:0/3479304386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feaa406cf60 0x7feaa415c170 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:12.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.161+0000 7feaaad33700 1 -- 172.21.15.3:0/3479304386 >> 172.21.15.3:0/3479304386 conn(0x7feaa40be4a0 msgr2=0x7feaa406be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:12.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.161+0000 7feaaad33700 1 -- 172.21.15.3:0/3479304386 shutdown_connections 2023-10-08T15:38:12.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.161+0000 7feaaad33700 1 -- 172.21.15.3:0/3479304386 wait complete. 2023-10-08T15:38:12.179 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T15:38:12.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.289+0000 7f500cdc1700 1 Processor -- start 2023-10-08T15:38:12.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.289+0000 7f500cdc1700 1 -- start start 2023-10-08T15:38:12.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.293+0000 7f500cdc1700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f500813dff0 0x7f50080bb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:12.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.293+0000 7f500cdc1700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5008069860 0x7f50080a19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:12.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.293+0000 7f500cdc1700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50080692b0 con 0x7f50080a1ef0 2023-10-08T15:38:12.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.293+0000 7f500cdc1700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50080ba930 con 0x7f500813dff0 2023-10-08T15:38:12.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.293+0000 7f500cdc1700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5008068c60 con 0x7f5008069860 2023-10-08T15:38:12.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.293+0000 7f50077fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f500813dff0 0x7f50080bb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:12.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.293+0000 7f5007fff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f50080a1ef0 0x7f500814afe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:35308/0 (socket says 172.21.15.3:35308) 2023-10-08T15:38:12.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.293+0000 7f5007fff700 1 -- 172.21.15.3:0/3373521259 learned_addr learned my addr 172.21.15.3:0/3373521259 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:38:12.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.293+0000 7f4ffffff700 1 --2- 172.21.15.3:0/3373521259 >> v2:172.21.15.50:3300/0 conn(0x7f5008069860 0x7f50080a19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:12.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.293+0000 7f5006ffd700 1 -- 172.21.15.3:0/3373521259 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2644279310 0 0) 0x7f50080692b0 con 0x7f50080a1ef0 2023-10-08T15:38:12.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.293+0000 7f5006ffd700 1 -- 172.21.15.3:0/3373521259 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ff4003570 con 0x7f50080a1ef0 2023-10-08T15:38:12.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.293+0000 7f50077fe700 1 -- 172.21.15.3:0/3373521259 >> v2:172.21.15.50:3300/0 conn(0x7f5008069860 msgr2=0x7f50080a19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:38:12.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.293+0000 7f50077fe700 1 --2- 172.21.15.3:0/3373521259 >> v2:172.21.15.50:3300/0 conn(0x7f5008069860 0x7f50080a19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:12.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.293+0000 7f50077fe700 1 -- 172.21.15.3:0/3373521259 >> v1:172.21.15.3:6789/0 conn(0x7f50080a1ef0 legacy=0x7f500814afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:12.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.293+0000 7f50077fe700 1 -- 172.21.15.3:0/3373521259 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5008068f40 con 0x7f500813dff0 2023-10-08T15:38:12.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.293+0000 7f50077fe700 1 --2- 172.21.15.3:0/3373521259 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f500813dff0 0x7f50080bb600 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5008068770 tx=0x7f4ff80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dac9b307f4ee4939 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:12.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.293+0000 7f5006ffd700 1 -- 172.21.15.3:0/3373521259 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff800c720 con 0x7f500813dff0 2023-10-08T15:38:12.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.293+0000 7f5006ffd700 1 -- 172.21.15.3:0/3373521259 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff800c8a0 con 0x7f500813dff0 2023-10-08T15:38:12.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.293+0000 7f5006ffd700 1 -- 172.21.15.3:0/3373521259 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff800cc60 con 0x7f500813dff0 2023-10-08T15:38:12.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.293+0000 7f500cdc1700 1 -- 172.21.15.3:0/3373521259 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f500813dff0 msgr2=0x7f50080bb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:12.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.293+0000 7f500cdc1700 1 --2- 172.21.15.3:0/3373521259 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f500813dff0 0x7f50080bb600 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5008068770 tx=0x7f4ff80091a0 comp rx=0 tx=0).stop 2023-10-08T15:38:12.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.293+0000 7f500cdc1700 1 -- 172.21.15.3:0/3373521259 shutdown_connections 2023-10-08T15:38:12.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.293+0000 7f500cdc1700 1 --2- 172.21.15.3:0/3373521259 >> v2:172.21.15.50:3300/0 conn(0x7f5008069860 0x7f50080a19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:12.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.293+0000 7f500cdc1700 1 --2- 172.21.15.3:0/3373521259 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f500813dff0 0x7f50080bb600 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:12.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.293+0000 7f500cdc1700 1 -- 172.21.15.3:0/3373521259 >> 172.21.15.3:0/3373521259 conn(0x7f5008067b60 msgr2=0x7f50080a12a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:12.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.293+0000 7f500cdc1700 1 -- 172.21.15.3:0/3373521259 shutdown_connections 2023-10-08T15:38:12.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.293+0000 7f500cdc1700 1 -- 172.21.15.3:0/3373521259 wait complete. 2023-10-08T15:38:12.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.297+0000 7f500cdc1700 1 Processor -- start 2023-10-08T15:38:12.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.297+0000 7f500cdc1700 1 -- start start 2023-10-08T15:38:12.306 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.297+0000 7f500cdc1700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5008069860 0x7f5008143ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:12.306 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.297+0000 7f500cdc1700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f50080a1ef0 0x7f50081415a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:12.306 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.297+0000 7f500cdc1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f500813dff0 0x7f50080b2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:12.306 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.297+0000 7f500cdc1700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500815d310 con 0x7f50080a1ef0 2023-10-08T15:38:12.306 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.297+0000 7f500cdc1700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5008148150 con 0x7f500813dff0 2023-10-08T15:38:12.306 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.297+0000 7f500cdc1700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50081445b0 con 0x7f5008069860 2023-10-08T15:38:12.306 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.297+0000 7f4ffffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f50080a1ef0 0x7f50081415a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:12.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.297+0000 7f4ffffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f50080a1ef0 0x7f50081415a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:48122/0 (socket says 172.21.15.3:48122) 2023-10-08T15:38:12.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.297+0000 7f4ffffff700 1 -- 172.21.15.3:0/654675859 learned_addr learned my addr 172.21.15.3:0/654675859 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:38:12.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.301+0000 7f5007fff700 1 --2- 172.21.15.3:0/654675859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f500813dff0 0x7f50080b2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:12.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.301+0000 7f50077fe700 1 --2- 172.21.15.3:0/654675859 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5008069860 0x7f5008143ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:12.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.301+0000 7f4ffffff700 1 -- 172.21.15.3:0/654675859 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5008069860 msgr2=0x7f5008143ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:12.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.301+0000 7f4ffffff700 1 --2- 172.21.15.3:0/654675859 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5008069860 0x7f5008143ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:12.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.301+0000 7f4ffffff700 1 -- 172.21.15.3:0/654675859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f500813dff0 msgr2=0x7f50080b2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:12.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.301+0000 7f4ffffff700 1 --2- 172.21.15.3:0/654675859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f500813dff0 0x7f50080b2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:12.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.301+0000 7f4ffffff700 1 -- 172.21.15.3:0/654675859 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff8009420 con 0x7f50080a1ef0 2023-10-08T15:38:12.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.301+0000 7f4ffffff700 1 --2- 172.21.15.3:0/654675859 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f50080a1ef0 0x7f50081415a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4ff000ecb0 tx=0x7f4ff00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:12.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.301+0000 7f4fff7fe700 1 -- 172.21.15.3:0/654675859 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff000c9d0 con 0x7f50080a1ef0 2023-10-08T15:38:12.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.301+0000 7f4fff7fe700 1 -- 172.21.15.3:0/654675859 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff000cb30 con 0x7f50080a1ef0 2023-10-08T15:38:12.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.301+0000 7f500cdc1700 1 -- 172.21.15.3:0/654675859 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5008144240 con 0x7f50080a1ef0 2023-10-08T15:38:12.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.301+0000 7f4fff7fe700 1 -- 172.21.15.3:0/654675859 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff0013470 con 0x7f50080a1ef0 2023-10-08T15:38:12.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.301+0000 7f500cdc1700 1 -- 172.21.15.3:0/654675859 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50080b3160 con 0x7f50080a1ef0 2023-10-08T15:38:12.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.301+0000 7f500cdc1700 1 -- 172.21.15.3:0/654675859 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50081440a0 con 0x7f50080a1ef0 2023-10-08T15:38:12.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.301+0000 7f4fff7fe700 1 -- 172.21.15.3:0/654675859 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4ff0013820 con 0x7f50080a1ef0 2023-10-08T15:38:12.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.301+0000 7f4fff7fe700 1 --2- 172.21.15.3:0/654675859 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4fe8060550 0x7f4fe8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:12.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.301+0000 7f4fff7fe700 1 -- 172.21.15.3:0/654675859 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4ff007cac0 con 0x7f50080a1ef0 2023-10-08T15:38:12.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.301+0000 7f50077fe700 1 --2- 172.21.15.3:0/654675859 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4fe8060550 0x7f4fe8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:12.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.305+0000 7f50077fe700 1 --2- 172.21.15.3:0/654675859 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4fe8060550 0x7f4fe8062a00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5008068770 tx=0x7f4ff8018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:12.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.313+0000 7f4fff7fe700 1 -- 172.21.15.3:0/654675859 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f50081440a0 con 0x7f50080a1ef0 2023-10-08T15:38:12.524 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.517+0000 7f500cdc1700 1 -- 172.21.15.3:0/654675859 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f50081446f0 con 0x7f50080a1ef0 2023-10-08T15:38:12.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.537+0000 7f4fff7fe700 1 -- 172.21.15.3:0/654675859 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v12) v1 ==== 118+0+0 (secure 0 0 0) 0x7f50081446f0 con 0x7f50080a1ef0 2023-10-08T15:38:12.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.541+0000 7f500cdc1700 1 -- 172.21.15.3:0/654675859 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4fe8060550 msgr2=0x7f4fe8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:12.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.541+0000 7f500cdc1700 1 --2- 172.21.15.3:0/654675859 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4fe8060550 0x7f4fe8062a00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5008068770 tx=0x7f4ff8018000 comp rx=0 tx=0).stop 2023-10-08T15:38:12.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.541+0000 7f500cdc1700 1 -- 172.21.15.3:0/654675859 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f50080a1ef0 msgr2=0x7f50081415a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:12.548 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.541+0000 7f500cdc1700 1 --2- 172.21.15.3:0/654675859 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f50080a1ef0 0x7f50081415a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4ff000ecb0 tx=0x7f4ff00091a0 comp rx=0 tx=0).stop 2023-10-08T15:38:12.548 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.541+0000 7f500cdc1700 1 -- 172.21.15.3:0/654675859 shutdown_connections 2023-10-08T15:38:12.548 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.541+0000 7f500cdc1700 1 --2- 172.21.15.3:0/654675859 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4fe8060550 0x7f4fe8062a00 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:12.548 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.541+0000 7f500cdc1700 1 --2- 172.21.15.3:0/654675859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f500813dff0 0x7f50080b2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:12.548 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.541+0000 7f500cdc1700 1 --2- 172.21.15.3:0/654675859 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f50080a1ef0 0x7f50081415a0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:12.548 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.541+0000 7f500cdc1700 1 --2- 172.21.15.3:0/654675859 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5008069860 0x7f5008143ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:12.548 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.541+0000 7f500cdc1700 1 -- 172.21.15.3:0/654675859 >> 172.21.15.3:0/654675859 conn(0x7f5008067b60 msgr2=0x7f500806d470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:12.548 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.541+0000 7f500cdc1700 1 -- 172.21.15.3:0/654675859 shutdown_connections 2023-10-08T15:38:12.548 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.541+0000 7f500cdc1700 1 -- 172.21.15.3:0/654675859 wait complete. 2023-10-08T15:38:12.564 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-08T15:38:12.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.673+0000 7fa7fe954700 1 Processor -- start 2023-10-08T15:38:12.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.673+0000 7fa7fe954700 1 -- start start 2023-10-08T15:38:12.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.677+0000 7fa7fe954700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa7f80bc2c0 0x7fa7f814bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:12.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.677+0000 7fa7fe954700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7f8068990 con 0x7fa7f806c0c0 2023-10-08T15:38:12.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.677+0000 7fa7fe954700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7f806d4e0 con 0x7fa7f806bc90 2023-10-08T15:38:12.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.677+0000 7fa7fe954700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7f806a000 con 0x7fa7f80bc2c0 2023-10-08T15:38:12.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.677+0000 7fa7fe153700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fa7f806c0c0 0x7fa7f80bc690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:35318/0 (socket says 172.21.15.3:35318) 2023-10-08T15:38:12.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.677+0000 7fa7fe153700 1 -- 172.21.15.3:0/2349071824 learned_addr learned my addr 172.21.15.3:0/2349071824 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:38:12.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.677+0000 7fa7fd952700 1 --2- 172.21.15.3:0/2349071824 >> v2:172.21.15.50:3300/0 conn(0x7fa7f80bc2c0 0x7fa7f814bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:12.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.677+0000 7fa7fc950700 1 -- 172.21.15.3:0/2349071824 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2937431537 0 0) 0x7fa7f8068990 con 0x7fa7f806c0c0 2023-10-08T15:38:12.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.677+0000 7fa7fc950700 1 -- 172.21.15.3:0/2349071824 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7e4003570 con 0x7fa7f806c0c0 2023-10-08T15:38:12.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.677+0000 7fa7fc950700 1 -- 172.21.15.3:0/2349071824 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2532723657 0 0) 0x7fa7f806d4e0 con 0x7fa7f806bc90 2023-10-08T15:38:12.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.677+0000 7fa7fc950700 1 -- 172.21.15.3:0/2349071824 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7f8068990 con 0x7fa7f806bc90 2023-10-08T15:38:12.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.677+0000 7fa7fd952700 1 -- 172.21.15.3:0/2349071824 >> v1:172.21.15.50:6789/0 conn(0x7fa7f806bc90 legacy=0x7fa7f8068e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:12.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.677+0000 7fa7fd952700 1 -- 172.21.15.3:0/2349071824 >> v1:172.21.15.3:6789/0 conn(0x7fa7f806c0c0 legacy=0x7fa7f80bc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:12.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.677+0000 7fa7fd952700 1 -- 172.21.15.3:0/2349071824 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f8069530 con 0x7fa7f80bc2c0 2023-10-08T15:38:12.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.677+0000 7fa7fd952700 1 --2- 172.21.15.3:0/2349071824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7f80bc2c0 0x7fa7f814bfa0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa7f40098e0 tx=0x7fa7f40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=805faa628fd9f732 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:12.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.677+0000 7fa7fc950700 1 -- 172.21.15.3:0/2349071824 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f4011630 con 0x7fa7f80bc2c0 2023-10-08T15:38:12.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.677+0000 7fa7fc950700 1 -- 172.21.15.3:0/2349071824 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f4011790 con 0x7fa7f80bc2c0 2023-10-08T15:38:12.686 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.677+0000 7fa7fc950700 1 -- 172.21.15.3:0/2349071824 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f4011b30 con 0x7fa7f80bc2c0 2023-10-08T15:38:12.687 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.681+0000 7fa7fe954700 1 -- 172.21.15.3:0/2349071824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7f80bc2c0 msgr2=0x7fa7f814bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:12.687 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.681+0000 7fa7fe954700 1 --2- 172.21.15.3:0/2349071824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7f80bc2c0 0x7fa7f814bfa0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa7f40098e0 tx=0x7fa7f40091a0 comp rx=0 tx=0).stop 2023-10-08T15:38:12.687 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.681+0000 7fa7fe954700 1 -- 172.21.15.3:0/2349071824 shutdown_connections 2023-10-08T15:38:12.687 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.681+0000 7fa7fe954700 1 --2- 172.21.15.3:0/2349071824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7f80bc2c0 0x7fa7f814bfa0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:12.687 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.681+0000 7fa7fe954700 1 -- 172.21.15.3:0/2349071824 >> 172.21.15.3:0/2349071824 conn(0x7fa7f806f340 msgr2=0x7fa7f80670e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:12.687 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.681+0000 7fa7fe954700 1 -- 172.21.15.3:0/2349071824 shutdown_connections 2023-10-08T15:38:12.687 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.681+0000 7fa7fe954700 1 -- 172.21.15.3:0/2349071824 wait complete. 2023-10-08T15:38:12.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.685+0000 7fa7fe954700 1 Processor -- start 2023-10-08T15:38:12.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.685+0000 7fa7fe954700 1 -- start start 2023-10-08T15:38:12.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.685+0000 7fa7fe954700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa7f806bc90 0x7fa7f814eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:12.695 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.689+0000 7fa7fe954700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7f806c0c0 0x7fa7f8149cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:12.695 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.689+0000 7fa7fe954700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa7f80bc2c0 0x7fa7f80ba8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:12.695 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.689+0000 7fa7fe954700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f814e210 con 0x7fa7f80bc2c0 2023-10-08T15:38:12.695 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.689+0000 7fa7fe954700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f814c9d0 con 0x7fa7f806c0c0 2023-10-08T15:38:12.695 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.689+0000 7fa7fe954700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f814cf50 con 0x7fa7f806bc90 2023-10-08T15:38:12.695 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.689+0000 7fa7fe153700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa7f80bc2c0 0x7fa7f80ba8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:12.695 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.689+0000 7fa7fe153700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa7f80bc2c0 0x7fa7f80ba8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:48134/0 (socket says 172.21.15.3:48134) 2023-10-08T15:38:12.695 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.689+0000 7fa7fd952700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa7f806bc90 0x7fa7f814eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:12.695 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.689+0000 7fa7fe153700 1 -- 172.21.15.3:0/3924683170 learned_addr learned my addr 172.21.15.3:0/3924683170 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:38:12.695 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.689+0000 7fa7fd151700 1 --2- 172.21.15.3:0/3924683170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7f806c0c0 0x7fa7f8149cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:12.695 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.689+0000 7fa7fe153700 1 -- 172.21.15.3:0/3924683170 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa7f806bc90 msgr2=0x7fa7f814eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:12.696 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.689+0000 7fa7fe153700 1 --2- 172.21.15.3:0/3924683170 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa7f806bc90 0x7fa7f814eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:12.696 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.689+0000 7fa7fe153700 1 -- 172.21.15.3:0/3924683170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7f806c0c0 msgr2=0x7fa7f8149cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:12.696 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.689+0000 7fa7fe153700 1 --2- 172.21.15.3:0/3924683170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7f806c0c0 0x7fa7f8149cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:12.696 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.689+0000 7fa7fe153700 1 -- 172.21.15.3:0/3924683170 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f4009420 con 0x7fa7f80bc2c0 2023-10-08T15:38:12.696 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.689+0000 7fa7fe153700 1 --2- 172.21.15.3:0/3924683170 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa7f80bc2c0 0x7fa7f80ba8d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa7f000cd00 tx=0x7fa7f0001ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:12.696 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.689+0000 7fa7edffb700 1 -- 172.21.15.3:0/3924683170 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f000ce00 con 0x7fa7f80bc2c0 2023-10-08T15:38:12.696 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.689+0000 7fa7edffb700 1 -- 172.21.15.3:0/3924683170 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f000aa60 con 0x7fa7f80bc2c0 2023-10-08T15:38:12.696 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.689+0000 7fa7fe954700 1 -- 172.21.15.3:0/3924683170 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7f814f2e0 con 0x7fa7f80bc2c0 2023-10-08T15:38:12.697 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.689+0000 7fa7edffb700 1 -- 172.21.15.3:0/3924683170 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f000ae20 con 0x7fa7f80bc2c0 2023-10-08T15:38:12.697 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.689+0000 7fa7fe954700 1 -- 172.21.15.3:0/3924683170 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7f814cbe0 con 0x7fa7f80bc2c0 2023-10-08T15:38:12.697 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.689+0000 7fa7edffb700 1 -- 172.21.15.3:0/3924683170 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa7f0007300 con 0x7fa7f80bc2c0 2023-10-08T15:38:12.698 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.689+0000 7fa7fe954700 1 -- 172.21.15.3:0/3924683170 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7f805ecf0 con 0x7fa7f80bc2c0 2023-10-08T15:38:12.698 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.693+0000 7fa7edffb700 1 --2- 172.21.15.3:0/3924683170 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fa7dc060550 0x7fa7dc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:12.698 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.693+0000 7fa7edffb700 1 -- 172.21.15.3:0/3924683170 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa7f007ca40 con 0x7fa7f80bc2c0 2023-10-08T15:38:12.698 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.693+0000 7fa7fd952700 1 --2- 172.21.15.3:0/3924683170 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fa7dc060550 0x7fa7dc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:12.698 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.693+0000 7fa7fd952700 1 --2- 172.21.15.3:0/3924683170 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fa7dc060550 0x7fa7dc062a00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa7f40093f0 tx=0x7fa7f4017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:12.705 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.701+0000 7fa7edffb700 1 -- 172.21.15.3:0/3924683170 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa7f007ee60 con 0x7fa7f80bc2c0 2023-10-08T15:38:12.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:12.893+0000 7fa7fe954700 1 -- 172.21.15.3:0/3924683170 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fa7f8068620 con 0x7fa7f80bc2c0 2023-10-08T15:38:13.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.549+0000 7fa7edffb700 1 -- 172.21.15.3:0/3924683170 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v13) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa7f004d0b0 con 0x7fa7f80bc2c0 2023-10-08T15:38:13.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.553+0000 7fa7fe954700 1 -- 172.21.15.3:0/3924683170 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fa7dc060550 msgr2=0x7fa7dc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:13.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.553+0000 7fa7fe954700 1 --2- 172.21.15.3:0/3924683170 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fa7dc060550 0x7fa7dc062a00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa7f40093f0 tx=0x7fa7f4017000 comp rx=0 tx=0).stop 2023-10-08T15:38:13.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.553+0000 7fa7fe954700 1 -- 172.21.15.3:0/3924683170 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa7f80bc2c0 msgr2=0x7fa7f80ba8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:13.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.553+0000 7fa7fe954700 1 --2- 172.21.15.3:0/3924683170 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa7f80bc2c0 0x7fa7f80ba8d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa7f000cd00 tx=0x7fa7f0001ac0 comp rx=0 tx=0).stop 2023-10-08T15:38:13.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.553+0000 7fa7fe954700 1 -- 172.21.15.3:0/3924683170 shutdown_connections 2023-10-08T15:38:13.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.553+0000 7fa7fe954700 1 --2- 172.21.15.3:0/3924683170 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fa7dc060550 0x7fa7dc062a00 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:13.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.553+0000 7fa7fe954700 1 --2- 172.21.15.3:0/3924683170 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa7f80bc2c0 0x7fa7f80ba8d0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:13.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.553+0000 7fa7fe954700 1 --2- 172.21.15.3:0/3924683170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7f806c0c0 0x7fa7f8149cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:13.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.553+0000 7fa7fe954700 1 --2- 172.21.15.3:0/3924683170 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa7f806bc90 0x7fa7f814eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:13.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.553+0000 7fa7fe954700 1 -- 172.21.15.3:0/3924683170 >> 172.21.15.3:0/3924683170 conn(0x7fa7f806f340 msgr2=0x7fa7f814ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:13.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.553+0000 7fa7fe954700 1 -- 172.21.15.3:0/3924683170 shutdown_connections 2023-10-08T15:38:13.562 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.553+0000 7fa7fe954700 1 -- 172.21.15.3:0/3924683170 wait complete. 2023-10-08T15:38:13.578 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:38:13.687 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.681+0000 7fd6cb0df700 1 Processor -- start 2023-10-08T15:38:13.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.681+0000 7fd6cb0df700 1 -- start start 2023-10-08T15:38:13.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.681+0000 7fd6cb0df700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd6c40b8a40 0x7fd6c414af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:13.689 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.681+0000 7fd6cb0df700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6c414eb80 con 0x7fd6c40bb0c0 2023-10-08T15:38:13.689 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.681+0000 7fd6cb0df700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6c40b9e50 con 0x7fd6c40bacf0 2023-10-08T15:38:13.689 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.681+0000 7fd6cb0df700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6c40ba130 con 0x7fd6c40b8a40 2023-10-08T15:38:13.689 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.681+0000 7fd6c98dc700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fd6c40bb0c0 0x7fd6c414a870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:35320/0 (socket says 172.21.15.3:35320) 2023-10-08T15:38:13.689 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.681+0000 7fd6c98dc700 1 -- 172.21.15.3:0/3758235973 learned_addr learned my addr 172.21.15.3:0/3758235973 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:38:13.689 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.681+0000 7fd6ca8de700 1 --2- 172.21.15.3:0/3758235973 >> v2:172.21.15.50:3300/0 conn(0x7fd6c40b8a40 0x7fd6c414af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:13.689 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.681+0000 7fd6c90db700 1 -- 172.21.15.3:0/3758235973 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1811609281 0 0) 0x7fd6c414eb80 con 0x7fd6c40bb0c0 2023-10-08T15:38:13.689 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.681+0000 7fd6c90db700 1 -- 172.21.15.3:0/3758235973 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6ac003570 con 0x7fd6c40bb0c0 2023-10-08T15:38:13.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.685+0000 7fd6c90db700 1 -- 172.21.15.3:0/3758235973 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1548483995 0 0) 0x7fd6ac003570 con 0x7fd6c40bb0c0 2023-10-08T15:38:13.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.685+0000 7fd6c90db700 1 -- 172.21.15.3:0/3758235973 >> v2:172.21.15.50:3300/0 conn(0x7fd6c40b8a40 msgr2=0x7fd6c414af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:38:13.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.685+0000 7fd6c90db700 1 --2- 172.21.15.3:0/3758235973 >> v2:172.21.15.50:3300/0 conn(0x7fd6c40b8a40 0x7fd6c414af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:13.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.685+0000 7fd6c90db700 1 -- 172.21.15.3:0/3758235973 >> v1:172.21.15.50:6789/0 conn(0x7fd6c40bacf0 legacy=0x7fd6c414f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:13.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.685+0000 7fd6c90db700 1 -- 172.21.15.3:0/3758235973 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c40b9b20 con 0x7fd6c40bb0c0 2023-10-08T15:38:13.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.685+0000 7fd6c90db700 1 -- 172.21.15.3:0/3758235973 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2285686191 0 0) 0x7fd6b40017f0 con 0x7fd6c40bb0c0 2023-10-08T15:38:13.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.685+0000 7fd6c90db700 1 -- 172.21.15.3:0/3758235973 >> v1:172.21.15.3:6789/0 conn(0x7fd6c40bb0c0 legacy=0x7fd6c414a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:13.693 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.685+0000 7fd6c90db700 1 --2- 172.21.15.3:0/3758235973 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd6ac003a60 0x7fd6ac003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:13.693 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.685+0000 7fd6c90db700 1 --2- 172.21.15.3:0/3758235973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6ac004810 0x7fd6ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:13.693 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.685+0000 7fd6c90db700 1 --2- 172.21.15.3:0/3758235973 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd6ac0051c0 0x7fd6ac00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:13.693 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.685+0000 7fd6c90db700 1 -- 172.21.15.3:0/3758235973 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c40ba130 con 0x7fd6ac0051c0 2023-10-08T15:38:13.693 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.685+0000 7fd6c90db700 1 -- 172.21.15.3:0/3758235973 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ac00c160 con 0x7fd6ac004810 2023-10-08T15:38:13.693 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.685+0000 7fd6c90db700 1 -- 172.21.15.3:0/3758235973 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ac00c320 con 0x7fd6ac003a60 2023-10-08T15:38:13.693 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.685+0000 7fd6ca8de700 1 --2- 172.21.15.3:0/3758235973 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd6ac0051c0 0x7fd6ac00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:13.693 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.685+0000 7fd6c98dc700 1 --2- 172.21.15.3:0/3758235973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6ac004810 0x7fd6ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:13.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.685+0000 7fd6ca0dd700 1 --2- 172.21.15.3:0/3758235973 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd6ac003a60 0x7fd6ac003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:13.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.685+0000 7fd6ca8de700 1 -- 172.21.15.3:0/3758235973 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd6ac003a60 msgr2=0x7fd6ac003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:38:13.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.685+0000 7fd6ca8de700 1 --2- 172.21.15.3:0/3758235973 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd6ac003a60 0x7fd6ac003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:13.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.685+0000 7fd6ca8de700 1 -- 172.21.15.3:0/3758235973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6ac004810 msgr2=0x7fd6ac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:38:13.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.685+0000 7fd6ca8de700 1 --2- 172.21.15.3:0/3758235973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6ac004810 0x7fd6ac004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:13.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.685+0000 7fd6ca8de700 1 -- 172.21.15.3:0/3758235973 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6ac003570 con 0x7fd6ac0051c0 2023-10-08T15:38:13.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.685+0000 7fd6ca0dd700 1 --2- 172.21.15.3:0/3758235973 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd6ac003a60 0x7fd6ac003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:38:13.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.685+0000 7fd6ca8de700 1 -- 172.21.15.3:0/3758235973 reap_dead start 2023-10-08T15:38:13.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.685+0000 7fd6ca8de700 1 --2- 172.21.15.3:0/3758235973 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd6ac0051c0 0x7fd6ac00ba60 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd6c40b8e40 tx=0x7fd6bc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3244ec554cdcc814 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:13.695 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.685+0000 7fd6c90db700 1 -- 172.21.15.3:0/3758235973 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc00e710 con 0x7fd6ac0051c0 2023-10-08T15:38:13.695 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.685+0000 7fd6c90db700 1 -- 172.21.15.3:0/3758235973 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6bc00e890 con 0x7fd6ac0051c0 2023-10-08T15:38:13.695 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.685+0000 7fd6c90db700 1 -- 172.21.15.3:0/3758235973 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc00ec50 con 0x7fd6ac0051c0 2023-10-08T15:38:13.695 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.685+0000 7fd6cb0df700 1 -- 172.21.15.3:0/3758235973 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd6ac0051c0 msgr2=0x7fd6ac00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:13.695 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.685+0000 7fd6cb0df700 1 --2- 172.21.15.3:0/3758235973 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd6ac0051c0 0x7fd6ac00ba60 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd6c40b8e40 tx=0x7fd6bc0091a0 comp rx=0 tx=0).stop 2023-10-08T15:38:13.695 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.685+0000 7fd6cb0df700 1 -- 172.21.15.3:0/3758235973 shutdown_connections 2023-10-08T15:38:13.695 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.685+0000 7fd6cb0df700 1 --2- 172.21.15.3:0/3758235973 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd6ac0051c0 0x7fd6ac00ba60 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:13.695 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.685+0000 7fd6cb0df700 1 -- 172.21.15.3:0/3758235973 >> 172.21.15.3:0/3758235973 conn(0x7fd6c40be4a0 msgr2=0x7fd6c40ba440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:13.695 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.685+0000 7fd6cb0df700 1 -- 172.21.15.3:0/3758235973 shutdown_connections 2023-10-08T15:38:13.696 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.685+0000 7fd6cb0df700 1 -- 172.21.15.3:0/3758235973 wait complete. 2023-10-08T15:38:13.698 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.689+0000 7fd6cb0df700 1 Processor -- start 2023-10-08T15:38:13.698 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.689+0000 7fd6cb0df700 1 -- start start 2023-10-08T15:38:13.698 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.689+0000 7fd6cb0df700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6ac0051c0 0x7fd6c406d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:13.698 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.689+0000 7fd6cb0df700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd6c406d730 0x7fd6c41432e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:13.698 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.689+0000 7fd6cb0df700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd6c4147300 0x7fd6c4143820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:13.698 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.689+0000 7fd6cb0df700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c4141d40 con 0x7fd6c4147300 2023-10-08T15:38:13.698 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.689+0000 7fd6cb0df700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c41466f0 con 0x7fd6ac0051c0 2023-10-08T15:38:13.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.689+0000 7fd6cb0df700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c4141a60 con 0x7fd6c406d730 2023-10-08T15:38:13.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.689+0000 7fd6ca8de700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd6c4147300 0x7fd6c4143820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:13.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.689+0000 7fd6ca8de700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd6c4147300 0x7fd6c4143820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:48158/0 (socket says 172.21.15.3:48158) 2023-10-08T15:38:13.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.689+0000 7fd6ca8de700 1 -- 172.21.15.3:0/4143675720 learned_addr learned my addr 172.21.15.3:0/4143675720 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:38:13.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.689+0000 7fd6ca0dd700 1 --2- 172.21.15.3:0/4143675720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6ac0051c0 0x7fd6c406d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:13.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.689+0000 7fd6c98dc700 1 --2- 172.21.15.3:0/4143675720 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd6c406d730 0x7fd6c41432e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:13.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.689+0000 7fd6ca8de700 1 -- 172.21.15.3:0/4143675720 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd6c406d730 msgr2=0x7fd6c41432e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:13.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.689+0000 7fd6ca8de700 1 --2- 172.21.15.3:0/4143675720 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd6c406d730 0x7fd6c41432e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:13.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.689+0000 7fd6ca8de700 1 -- 172.21.15.3:0/4143675720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6ac0051c0 msgr2=0x7fd6c406d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:13.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.689+0000 7fd6ca8de700 1 --2- 172.21.15.3:0/4143675720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6ac0051c0 0x7fd6c406d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:13.700 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.689+0000 7fd6ca8de700 1 -- 172.21.15.3:0/4143675720 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c41461d0 con 0x7fd6c4147300 2023-10-08T15:38:13.700 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.689+0000 7fd6ca0dd700 1 --2- 172.21.15.3:0/4143675720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6ac0051c0 0x7fd6c406d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:38:13.700 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.689+0000 7fd6ca8de700 1 --2- 172.21.15.3:0/4143675720 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd6c4147300 0x7fd6c4143820 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc009720 tx=0x7fd6bc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:13.700 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.689+0000 7fd6c27fc700 1 -- 172.21.15.3:0/4143675720 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc00e710 con 0x7fd6c4147300 2023-10-08T15:38:13.700 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.689+0000 7fd6c27fc700 1 -- 172.21.15.3:0/4143675720 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6bc009110 con 0x7fd6c4147300 2023-10-08T15:38:13.700 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.689+0000 7fd6cb0df700 1 -- 172.21.15.3:0/4143675720 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6c40a2cf0 con 0x7fd6c4147300 2023-10-08T15:38:13.700 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.689+0000 7fd6c27fc700 1 -- 172.21.15.3:0/4143675720 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc01c680 con 0x7fd6c4147300 2023-10-08T15:38:13.700 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.689+0000 7fd6cb0df700 1 -- 172.21.15.3:0/4143675720 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6c4152e10 con 0x7fd6c4147300 2023-10-08T15:38:13.700 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.693+0000 7fd6cb0df700 1 -- 172.21.15.3:0/4143675720 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6c4146030 con 0x7fd6c4147300 2023-10-08T15:38:13.701 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.693+0000 7fd6c27fc700 1 -- 172.21.15.3:0/4143675720 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fd6bc01ca30 con 0x7fd6c4147300 2023-10-08T15:38:13.701 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.693+0000 7fd6c27fc700 1 --2- 172.21.15.3:0/4143675720 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd6b0060550 0x7fd6b0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:13.701 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.693+0000 7fd6c27fc700 1 -- 172.21.15.3:0/4143675720 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd6bc07e160 con 0x7fd6c4147300 2023-10-08T15:38:13.701 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.693+0000 7fd6ca0dd700 1 --2- 172.21.15.3:0/4143675720 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd6b0060550 0x7fd6b0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:13.702 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.693+0000 7fd6ca0dd700 1 --2- 172.21.15.3:0/4143675720 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd6b0060550 0x7fd6b0062a00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd6b8007bb0 tx=0x7fd6b8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:13.706 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.701+0000 7fd6c27fc700 1 -- 172.21.15.3:0/4143675720 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd6c4146030 con 0x7fd6c4147300 2023-10-08T15:38:13.906 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.901+0000 7fd6cb0df700 1 -- 172.21.15.3:0/4143675720 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd6c4146410 con 0x7fd6c4147300 2023-10-08T15:38:13.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.901+0000 7fd6c27fc700 1 -- 172.21.15.3:0/4143675720 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+3079 (secure 0 0 0) 0x7fd6c4146410 con 0x7fd6c4147300 2023-10-08T15:38:13.907 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:38:13.907 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4736,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3640212670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3640212670},{"type":"v1","addr":"172.21.15.50:6835","nonce":3640212670}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:38:10.891768+0000","modified":"2023-10-08T15:38:13.541239+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4989},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4989":{"gid":4989,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.3:6833/3457348695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":3457348695},{"type":"v1","addr":"172.21.15.3:6833","nonce":3457348695}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-08T15:38:13.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.905+0000 7fd6cb0df700 1 -- 172.21.15.3:0/4143675720 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd6b0060550 msgr2=0x7fd6b0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:13.910 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.905+0000 7fd6cb0df700 1 --2- 172.21.15.3:0/4143675720 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd6b0060550 0x7fd6b0062a00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd6b8007bb0 tx=0x7fd6b8009040 comp rx=0 tx=0).stop 2023-10-08T15:38:13.910 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.905+0000 7fd6cb0df700 1 -- 172.21.15.3:0/4143675720 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd6c4147300 msgr2=0x7fd6c4143820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:13.910 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.905+0000 7fd6cb0df700 1 --2- 172.21.15.3:0/4143675720 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd6c4147300 0x7fd6c4143820 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc009720 tx=0x7fd6bc019000 comp rx=0 tx=0).stop 2023-10-08T15:38:13.910 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.905+0000 7fd6cb0df700 1 -- 172.21.15.3:0/4143675720 shutdown_connections 2023-10-08T15:38:13.910 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.905+0000 7fd6cb0df700 1 --2- 172.21.15.3:0/4143675720 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd6b0060550 0x7fd6b0062a00 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:13.910 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.905+0000 7fd6cb0df700 1 --2- 172.21.15.3:0/4143675720 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd6c4147300 0x7fd6c4143820 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:13.910 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.905+0000 7fd6cb0df700 1 --2- 172.21.15.3:0/4143675720 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd6c406d730 0x7fd6c41432e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:13.910 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.905+0000 7fd6cb0df700 1 --2- 172.21.15.3:0/4143675720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6ac0051c0 0x7fd6c406d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:13.910 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.905+0000 7fd6cb0df700 1 -- 172.21.15.3:0/4143675720 >> 172.21.15.3:0/4143675720 conn(0x7fd6c40be4a0 msgr2=0x7fd6c414c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:13.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.905+0000 7fd6cb0df700 1 -- 172.21.15.3:0/4143675720 shutdown_connections 2023-10-08T15:38:13.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:13.905+0000 7fd6cb0df700 1 -- 172.21.15.3:0/4143675720 wait complete. 2023-10-08T15:38:13.911 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 13 2023-10-08T15:38:13.922 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:38:14.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.025+0000 7f731f3d4700 1 Processor -- start 2023-10-08T15:38:14.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.025+0000 7f731f3d4700 1 -- start start 2023-10-08T15:38:14.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.025+0000 7f731f3d4700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f731814ac20 0x7f731814aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:14.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.025+0000 7f731f3d4700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f73180681f0 0x7f73180670e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:14.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.025+0000 7f731f3d4700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7318069f70 con 0x7f7318067620 2023-10-08T15:38:14.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.025+0000 7f731f3d4700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73180c0b10 con 0x7f73180681f0 2023-10-08T15:38:14.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.025+0000 7f731f3d4700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73180c0c50 con 0x7f731814ac20 2023-10-08T15:38:14.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.025+0000 7f731c96f700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f73180681f0 0x7f73180670e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:14.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.025+0000 7f731c96f700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f73180681f0 0x7f73180670e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:48162/0 (socket says 172.21.15.3:48162) 2023-10-08T15:38:14.033 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.025+0000 7f731c96f700 1 -- 172.21.15.3:0/3080733672 learned_addr learned my addr 172.21.15.3:0/3080733672 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:38:14.033 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.025+0000 7f731d170700 1 --2- 172.21.15.3:0/3080733672 >> v2:172.21.15.50:3300/0 conn(0x7f731814ac20 0x7f731814aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:14.034 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.025+0000 7f731c96f700 1 -- 172.21.15.3:0/3080733672 >> v2:172.21.15.50:3300/0 conn(0x7f731814ac20 msgr2=0x7f731814aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:38:14.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.025+0000 7f731c96f700 1 --2- 172.21.15.3:0/3080733672 >> v2:172.21.15.50:3300/0 conn(0x7f731814ac20 0x7f731814aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:14.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.025+0000 7f731c96f700 1 -- 172.21.15.3:0/3080733672 >> v1:172.21.15.50:6789/0 conn(0x7f7318067620 legacy=0x7f7318068910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:14.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.025+0000 7f731c96f700 1 -- 172.21.15.3:0/3080733672 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f731809ee30 con 0x7f73180681f0 2023-10-08T15:38:14.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.025+0000 7f731d170700 1 --2- 172.21.15.3:0/3080733672 >> v2:172.21.15.50:3300/0 conn(0x7f731814ac20 0x7f731814aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:38:14.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.025+0000 7f731c96f700 1 --2- 172.21.15.3:0/3080733672 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f73180681f0 0x7f73180670e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f73080099b0 tx=0x7f7308009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=831b852ffb1e61e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:14.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.029+0000 7f730ffff700 1 -- 172.21.15.3:0/3080733672 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7308009ea0 con 0x7f73180681f0 2023-10-08T15:38:14.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.029+0000 7f730ffff700 1 -- 172.21.15.3:0/3080733672 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f730800b820 con 0x7f73180681f0 2023-10-08T15:38:14.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.029+0000 7f730ffff700 1 -- 172.21.15.3:0/3080733672 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730800bbc0 con 0x7f73180681f0 2023-10-08T15:38:14.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.029+0000 7f731f3d4700 1 -- 172.21.15.3:0/3080733672 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f73180681f0 msgr2=0x7f73180670e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:14.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.029+0000 7f731f3d4700 1 --2- 172.21.15.3:0/3080733672 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f73180681f0 0x7f73180670e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f73080099b0 tx=0x7f7308009250 comp rx=0 tx=0).stop 2023-10-08T15:38:14.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.029+0000 7f731f3d4700 1 -- 172.21.15.3:0/3080733672 shutdown_connections 2023-10-08T15:38:14.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.029+0000 7f731f3d4700 1 --2- 172.21.15.3:0/3080733672 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f73180681f0 0x7f73180670e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:14.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.029+0000 7f731f3d4700 1 --2- 172.21.15.3:0/3080733672 >> v2:172.21.15.50:3300/0 conn(0x7f731814ac20 0x7f731814aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:14.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.029+0000 7f731f3d4700 1 -- 172.21.15.3:0/3080733672 >> 172.21.15.3:0/3080733672 conn(0x7f731806e0d0 msgr2=0x7f731806e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:14.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.029+0000 7f731f3d4700 1 -- 172.21.15.3:0/3080733672 shutdown_connections 2023-10-08T15:38:14.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.029+0000 7f731f3d4700 1 -- 172.21.15.3:0/3080733672 wait complete. 2023-10-08T15:38:14.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.029+0000 7f731f3d4700 1 Processor -- start 2023-10-08T15:38:14.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.029+0000 7f731f3d4700 1 -- start start 2023-10-08T15:38:14.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.033+0000 7f731f3d4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7318067620 0x7f731815e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:14.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.033+0000 7f731f3d4700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f73180681f0 0x7f731814ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:14.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.033+0000 7f731f3d4700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f731814ac20 0x7f731809f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:14.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.033+0000 7f731f3d4700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f731815f030 con 0x7f73180681f0 2023-10-08T15:38:14.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.033+0000 7f731f3d4700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7318148140 con 0x7f7318067620 2023-10-08T15:38:14.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.033+0000 7f731f3d4700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f731815e9e0 con 0x7f731814ac20 2023-10-08T15:38:14.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.033+0000 7f731c96f700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f73180681f0 0x7f731814ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:14.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.033+0000 7f731c96f700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f73180681f0 0x7f731814ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:48168/0 (socket says 172.21.15.3:48168) 2023-10-08T15:38:14.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.033+0000 7f731c96f700 1 -- 172.21.15.3:0/3734393883 learned_addr learned my addr 172.21.15.3:0/3734393883 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:38:14.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.033+0000 7f731d170700 1 --2- 172.21.15.3:0/3734393883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7318067620 0x7f731815e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:14.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.033+0000 7f731d971700 1 --2- 172.21.15.3:0/3734393883 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f731814ac20 0x7f731809f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:14.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.033+0000 7f731c96f700 1 -- 172.21.15.3:0/3734393883 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f731814ac20 msgr2=0x7f731809f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:14.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.033+0000 7f731c96f700 1 --2- 172.21.15.3:0/3734393883 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f731814ac20 0x7f731809f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:14.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.033+0000 7f731c96f700 1 -- 172.21.15.3:0/3734393883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7318067620 msgr2=0x7f731815e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:14.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.033+0000 7f731c96f700 1 --2- 172.21.15.3:0/3734393883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7318067620 0x7f731815e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:14.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.033+0000 7f731c96f700 1 -- 172.21.15.3:0/3734393883 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7314009a20 con 0x7f73180681f0 2023-10-08T15:38:14.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.033+0000 7f731c96f700 1 --2- 172.21.15.3:0/3734393883 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f73180681f0 0x7f731814ca60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f73080094c0 tx=0x7f7308017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:14.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.033+0000 7f730d7fa700 1 -- 172.21.15.3:0/3734393883 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730800bba0 con 0x7f73180681f0 2023-10-08T15:38:14.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.033+0000 7f730d7fa700 1 -- 172.21.15.3:0/3734393883 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7308011420 con 0x7f73180681f0 2023-10-08T15:38:14.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.033+0000 7f731f3d4700 1 -- 172.21.15.3:0/3734393883 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73080094f0 con 0x7f73180681f0 2023-10-08T15:38:14.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.033+0000 7f730d7fa700 1 -- 172.21.15.3:0/3734393883 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73080117c0 con 0x7f73180681f0 2023-10-08T15:38:14.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.033+0000 7f731f3d4700 1 -- 172.21.15.3:0/3734393883 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f731815ed70 con 0x7f73180681f0 2023-10-08T15:38:14.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.033+0000 7f731f3d4700 1 -- 172.21.15.3:0/3734393883 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f731815f1a0 con 0x7f73180681f0 2023-10-08T15:38:14.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.033+0000 7f730d7fa700 1 -- 172.21.15.3:0/3734393883 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f7308011bb0 con 0x7f73180681f0 2023-10-08T15:38:14.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.037+0000 7f730d7fa700 1 --2- 172.21.15.3:0/3734393883 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f72fc060550 0x7f72fc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:14.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.037+0000 7f730d7fa700 1 -- 172.21.15.3:0/3734393883 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f730807e0a0 con 0x7f73180681f0 2023-10-08T15:38:14.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.037+0000 7f731d170700 1 --2- 172.21.15.3:0/3734393883 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f72fc060550 0x7f72fc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:14.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.037+0000 7f731d170700 1 --2- 172.21.15.3:0/3734393883 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f72fc060550 0x7f72fc062a00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f731400f650 tx=0x7f731400b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:14.048 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.041+0000 7f730d7fa700 1 -- 172.21.15.3:0/3734393883 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f730804e690 con 0x7f73180681f0 2023-10-08T15:38:14.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.201+0000 7f731f3d4700 1 -- 172.21.15.3:0/3734393883 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7318064530 con 0x7f73180681f0 2023-10-08T15:38:14.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.205+0000 7f730d7fa700 1 -- 172.21.15.3:0/3734393883 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+15254 (secure 0 0 0) 0x7f7308011e60 con 0x7f73180681f0 2023-10-08T15:38:14.210 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:38:14.210 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":29,"fsid":"7635972e-cd66-4a8f-a231-378db8b3847a","created":"2023-10-08T15:37:08.234594+0000","modified":"2023-10-08T15:38:12.526270+0000","last_up_change":"2023-10-08T15:37:17.537726+0000","last_in_change":"2023-10-08T15:37:10.269178+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:37:16.581590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:38:09.361822+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-08T15:38:09.863387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"64fb1864-bfdd-4d75-9b41-03fb60085dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33363},{"type":"v1","addr":"172.21.15.3:6801","nonce":33363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33363},{"type":"v1","addr":"172.21.15.3:6803","nonce":33363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":33363},{"type":"v1","addr":"172.21.15.3:6807","nonce":33363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33363},{"type":"v1","addr":"172.21.15.3:6805","nonce":33363}]},"public_addr":"172.21.15.3:6801/33363","cluster_addr":"172.21.15.3:6803/33363","heartbeat_back_addr":"172.21.15.3:6807/33363","heartbeat_front_addr":"172.21.15.3:6805/33363","state":["exists","up"]},{"osd":1,"uuid":"3ca6bd3a-3e8a-4c65-af9c-46148b0c2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33364},{"type":"v1","addr":"172.21.15.3:6820","nonce":33364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33364},{"type":"v1","addr":"172.21.15.3:6824","nonce":33364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33364},{"type":"v1","addr":"172.21.15.3:6831","nonce":33364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33364},{"type":"v1","addr":"172.21.15.3:6828","nonce":33364}]},"public_addr":"172.21.15.3:6820/33364","cluster_addr":"172.21.15.3:6824/33364","heartbeat_back_addr":"172.21.15.3:6831/33364","heartbeat_front_addr":"172.21.15.3:6828/33364","state":["exists","up"]},{"osd":2,"uuid":"6eb9f757-58dd-442f-910d-32401454bce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33366},{"type":"v1","addr":"172.21.15.3:6817","nonce":33366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":33366},{"type":"v1","addr":"172.21.15.3:6821","nonce":33366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6827","nonce":33366},{"type":"v1","addr":"172.21.15.3:6829","nonce":33366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":33366},{"type":"v1","addr":"172.21.15.3:6825","nonce":33366}]},"public_addr":"172.21.15.3:6817/33366","cluster_addr":"172.21.15.3:6821/33366","heartbeat_back_addr":"172.21.15.3:6829/33366","heartbeat_front_addr":"172.21.15.3:6825/33366","state":["exists","up"]},{"osd":3,"uuid":"1c39866b-ac2e-4ea9-a69c-02b01ee4191d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33365},{"type":"v1","addr":"172.21.15.3:6809","nonce":33365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":33365},{"type":"v1","addr":"172.21.15.3:6811","nonce":33365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33365},{"type":"v1","addr":"172.21.15.3:6815","nonce":33365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":33365},{"type":"v1","addr":"172.21.15.3:6813","nonce":33365}]},"public_addr":"172.21.15.3:6809/33365","cluster_addr":"172.21.15.3:6811/33365","heartbeat_back_addr":"172.21.15.3:6815/33365","heartbeat_front_addr":"172.21.15.3:6813/33365","state":["exists","up"]},{"osd":4,"uuid":"15f86b61-b7f1-4780-ae00-9d80a68cb830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":33605},{"type":"v1","addr":"172.21.15.50:6809","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33605},{"type":"v1","addr":"172.21.15.50:6811","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33605},{"type":"v1","addr":"172.21.15.50:6815","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":33605},{"type":"v1","addr":"172.21.15.50:6813","nonce":33605}]},"public_addr":"172.21.15.50:6809/33605","cluster_addr":"172.21.15.50:6811/33605","heartbeat_back_addr":"172.21.15.50:6815/33605","heartbeat_front_addr":"172.21.15.50:6813/33605","state":["exists","up"]},{"osd":5,"uuid":"726c3003-34e6-4d5a-b6e2-f911e13c2118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33606},{"type":"v1","addr":"172.21.15.50:6801","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33606},{"type":"v1","addr":"172.21.15.50:6803","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33606},{"type":"v1","addr":"172.21.15.50:6807","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":33606},{"type":"v1","addr":"172.21.15.50:6805","nonce":33606}]},"public_addr":"172.21.15.50:6801/33606","cluster_addr":"172.21.15.50:6803/33606","heartbeat_back_addr":"172.21.15.50:6807/33606","heartbeat_front_addr":"172.21.15.50:6805/33606","state":["exists","up"]},{"osd":6,"uuid":"401122a4-9988-441f-a5a7-39164434ebcd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":33607},{"type":"v1","addr":"172.21.15.50:6819","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":33607},{"type":"v1","addr":"172.21.15.50:6823","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":33607},{"type":"v1","addr":"172.21.15.50:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":33607},{"type":"v1","addr":"172.21.15.50:6827","nonce":33607}]},"public_addr":"172.21.15.50:6819/33607","cluster_addr":"172.21.15.50:6823/33607","heartbeat_back_addr":"172.21.15.50:6831/33607","heartbeat_front_addr":"172.21.15.50:6827/33607","state":["exists","up"]},{"osd":7,"uuid":"6b3fa236-c9d0-4c4d-82ae-9af4daf6d699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33604},{"type":"v1","addr":"172.21.15.50:6818","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":33604},{"type":"v1","addr":"172.21.15.50:6822","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":33604},{"type":"v1","addr":"172.21.15.50:6830","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":33604},{"type":"v1","addr":"172.21.15.50:6826","nonce":33604}]},"public_addr":"172.21.15.50:6818/33604","cluster_addr":"172.21.15.50:6822/33604","heartbeat_back_addr":"172.21.15.50:6830/33604","heartbeat_front_addr":"172.21.15.50:6826/33604","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.497794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.529417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.873426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.325972+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.443971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.240795+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.739632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.643026+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:38:14.212 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.205+0000 7f731f3d4700 1 -- 172.21.15.3:0/3734393883 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f72fc060550 msgr2=0x7f72fc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:14.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.205+0000 7f731f3d4700 1 --2- 172.21.15.3:0/3734393883 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f72fc060550 0x7f72fc062a00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f731400f650 tx=0x7f731400b040 comp rx=0 tx=0).stop 2023-10-08T15:38:14.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.205+0000 7f731f3d4700 1 -- 172.21.15.3:0/3734393883 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f73180681f0 msgr2=0x7f731814ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:14.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.205+0000 7f731f3d4700 1 --2- 172.21.15.3:0/3734393883 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f73180681f0 0x7f731814ca60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f73080094c0 tx=0x7f7308017000 comp rx=0 tx=0).stop 2023-10-08T15:38:14.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.205+0000 7f731f3d4700 1 -- 172.21.15.3:0/3734393883 shutdown_connections 2023-10-08T15:38:14.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.205+0000 7f731f3d4700 1 --2- 172.21.15.3:0/3734393883 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f72fc060550 0x7f72fc062a00 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:14.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.205+0000 7f731f3d4700 1 --2- 172.21.15.3:0/3734393883 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f731814ac20 0x7f731809f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:14.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.205+0000 7f731f3d4700 1 --2- 172.21.15.3:0/3734393883 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f73180681f0 0x7f731814ca60 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:14.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.205+0000 7f731f3d4700 1 --2- 172.21.15.3:0/3734393883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7318067620 0x7f731815e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:14.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.205+0000 7f731f3d4700 1 -- 172.21.15.3:0/3734393883 >> 172.21.15.3:0/3734393883 conn(0x7f731806e0d0 msgr2=0x7f731806e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:14.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.205+0000 7f731f3d4700 1 -- 172.21.15.3:0/3734393883 shutdown_connections 2023-10-08T15:38:14.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.205+0000 7f731f3d4700 1 -- 172.21.15.3:0/3734393883 wait complete. 2023-10-08T15:38:14.224 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T15:38:14.225 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T15:38:14.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.321+0000 7f0293fff700 1 Processor -- start 2023-10-08T15:38:14.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.325+0000 7f0293fff700 1 -- start start 2023-10-08T15:38:14.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.325+0000 7f0293fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f029414a080 0x7f02940baf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:14.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.325+0000 7f0293fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f029406df30 0x7f029414c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:14.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.325+0000 7f0293fff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02940b4050 con 0x7f02940bab50 2023-10-08T15:38:14.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.325+0000 7f0293fff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0294146da0 con 0x7f029406df30 2023-10-08T15:38:14.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.325+0000 7f0293fff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02940b4710 con 0x7f029414a080 2023-10-08T15:38:14.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.325+0000 7f02937fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f029406df30 0x7f029414c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:14.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.325+0000 7f02927fc700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f029414a080 0x7f02940baf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:14.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.325+0000 7f02937fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f029406df30 0x7f029414c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.3:43710/0 (socket says 172.21.15.3:43710) 2023-10-08T15:38:14.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.325+0000 7f02937fe700 1 -- 172.21.15.3:0/822020548 learned_addr learned my addr 172.21.15.3:0/822020548 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:38:14.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.325+0000 7f02937fe700 1 -- 172.21.15.3:0/822020548 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f029414a080 msgr2=0x7f02940baf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:38:14.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.325+0000 7f02937fe700 1 --2- 172.21.15.3:0/822020548 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f029414a080 0x7f02940baf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:14.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.325+0000 7f02937fe700 1 -- 172.21.15.3:0/822020548 >> v1:172.21.15.50:6789/0 conn(0x7f02940bab50 legacy=0x7f0294149970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:14.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.325+0000 7f02937fe700 1 -- 172.21.15.3:0/822020548 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02940b4330 con 0x7f029406df30 2023-10-08T15:38:14.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.325+0000 7f02937fe700 1 --2- 172.21.15.3:0/822020548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f029406df30 0x7f029414c9c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f028c009f20 tx=0x7f028c009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12226fc9dd2902a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:14.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.325+0000 7f0291ffb700 1 -- 172.21.15.3:0/822020548 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f028c00e070 con 0x7f029406df30 2023-10-08T15:38:14.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.325+0000 7f0291ffb700 1 -- 172.21.15.3:0/822020548 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f028c00b9d0 con 0x7f029406df30 2023-10-08T15:38:14.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.325+0000 7f0291ffb700 1 -- 172.21.15.3:0/822020548 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f028c0092e0 con 0x7f029406df30 2023-10-08T15:38:14.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.329+0000 7f0293fff700 1 -- 172.21.15.3:0/822020548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f029406df30 msgr2=0x7f029414c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:14.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.329+0000 7f0293fff700 1 --2- 172.21.15.3:0/822020548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f029406df30 0x7f029414c9c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f028c009f20 tx=0x7f028c009840 comp rx=0 tx=0).stop 2023-10-08T15:38:14.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.329+0000 7f0293fff700 1 -- 172.21.15.3:0/822020548 shutdown_connections 2023-10-08T15:38:14.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.329+0000 7f0293fff700 1 --2- 172.21.15.3:0/822020548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f029406df30 0x7f029414c9c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:14.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.329+0000 7f0293fff700 1 --2- 172.21.15.3:0/822020548 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f029414a080 0x7f02940baf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:14.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.329+0000 7f0293fff700 1 -- 172.21.15.3:0/822020548 >> 172.21.15.3:0/822020548 conn(0x7f02940be4a0 msgr2=0x7f02940ba440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:14.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.329+0000 7f0293fff700 1 -- 172.21.15.3:0/822020548 shutdown_connections 2023-10-08T15:38:14.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.329+0000 7f0293fff700 1 -- 172.21.15.3:0/822020548 wait complete. 2023-10-08T15:38:14.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.329+0000 7f0293fff700 1 Processor -- start 2023-10-08T15:38:14.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.329+0000 7f0293fff700 1 -- start start 2023-10-08T15:38:14.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.329+0000 7f0293fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f029406df30 0x7f02940b9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:14.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.329+0000 7f0293fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02940bab50 0x7f0294144fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:14.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.329+0000 7f0293fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f029414a080 0x7f0294145500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:14.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.329+0000 7f0293fff700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f029409c560 con 0x7f029406df30 2023-10-08T15:38:14.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.329+0000 7f0293fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02940b1d60 con 0x7f02940bab50 2023-10-08T15:38:14.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.329+0000 7f0293fff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f029415b840 con 0x7f029414a080 2023-10-08T15:38:14.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.329+0000 7f0292ffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f029406df30 0x7f02940b9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:14.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.329+0000 7f02927fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02940bab50 0x7f0294144fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:14.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.329+0000 7f02937fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f029414a080 0x7f0294145500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:14.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.329+0000 7f02937fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f029414a080 0x7f0294145500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.3:37528/0 (socket says 172.21.15.3:37528) 2023-10-08T15:38:14.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.329+0000 7f02937fe700 1 -- 172.21.15.3:0/573104244 learned_addr learned my addr 172.21.15.3:0/573104244 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:38:14.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.329+0000 7f02937fe700 1 -- 172.21.15.3:0/573104244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02940bab50 msgr2=0x7f0294144fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:14.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.329+0000 7f02937fe700 1 --2- 172.21.15.3:0/573104244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02940bab50 0x7f0294144fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:14.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.329+0000 7f02937fe700 1 -- 172.21.15.3:0/573104244 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f029406df30 msgr2=0x7f02940b9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:14.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.329+0000 7f02937fe700 1 --2- 172.21.15.3:0/573104244 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f029406df30 0x7f02940b9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:14.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.329+0000 7f02937fe700 1 -- 172.21.15.3:0/573104244 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f028c009ae0 con 0x7f029414a080 2023-10-08T15:38:14.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.329+0000 7f0292ffd700 1 --2- 172.21.15.3:0/573104244 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f029406df30 0x7f02940b9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:38:14.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.329+0000 7f02937fe700 1 --2- 172.21.15.3:0/573104244 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f029414a080 0x7f0294145500 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f02940bb4b0 tx=0x7f028c018000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:14.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.329+0000 7f027affd700 1 -- 172.21.15.3:0/573104244 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f028c008ad0 con 0x7f029414a080 2023-10-08T15:38:14.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.329+0000 7f027affd700 1 -- 172.21.15.3:0/573104244 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f028c008c30 con 0x7f029414a080 2023-10-08T15:38:14.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.329+0000 7f0293fff700 1 -- 172.21.15.3:0/573104244 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02940b9bb0 con 0x7f029414a080 2023-10-08T15:38:14.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.329+0000 7f027affd700 1 -- 172.21.15.3:0/573104244 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f028c026460 con 0x7f029414a080 2023-10-08T15:38:14.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.333+0000 7f0293fff700 1 -- 172.21.15.3:0/573104244 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f029415b560 con 0x7f029414a080 2023-10-08T15:38:14.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.333+0000 7f0293fff700 1 -- 172.21.15.3:0/573104244 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02940b1ef0 con 0x7f029414a080 2023-10-08T15:38:14.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.333+0000 7f027affd700 1 -- 172.21.15.3:0/573104244 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f028c003040 con 0x7f029414a080 2023-10-08T15:38:14.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.333+0000 7f027affd700 1 --2- 172.21.15.3:0/573104244 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f0280060580 0x7f0280062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:14.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.333+0000 7f027affd700 1 -- 172.21.15.3:0/573104244 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f028c07e500 con 0x7f029414a080 2023-10-08T15:38:14.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.333+0000 7f0292ffd700 1 --2- 172.21.15.3:0/573104244 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f0280060580 0x7f0280062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:14.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.337+0000 7f0292ffd700 1 --2- 172.21.15.3:0/573104244 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f0280060580 0x7f0280062a30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0288001dc0 tx=0x7f0288009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:14.352 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.345+0000 7f027affd700 1 -- 172.21.15.3:0/573104244 <== mon.2 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f028c04eaf0 con 0x7f029414a080 2023-10-08T15:38:14.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.509+0000 7f0293fff700 1 -- 172.21.15.3:0/573104244 --> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f029405ed60 con 0x7f0280060580 2023-10-08T15:38:14.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.525+0000 7f027affd700 1 -- 172.21.15.3:0/573104244 <== mgr.4102 v2:172.21.15.50:6832/33268 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251667 (secure 0 0 0) 0x7f029405ed60 con 0x7f0280060580 2023-10-08T15:38:14.537 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:38:14.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.533+0000 7f0293fff700 1 -- 172.21.15.3:0/573104244 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f0280060580 msgr2=0x7f0280062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:14.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.533+0000 7f0293fff700 1 --2- 172.21.15.3:0/573104244 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f0280060580 0x7f0280062a30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0288001dc0 tx=0x7f0288009040 comp rx=0 tx=0).stop 2023-10-08T15:38:14.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.533+0000 7f0293fff700 1 -- 172.21.15.3:0/573104244 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f029414a080 msgr2=0x7f0294145500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:14.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.533+0000 7f0293fff700 1 --2- 172.21.15.3:0/573104244 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f029414a080 0x7f0294145500 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f02940bb4b0 tx=0x7f028c018000 comp rx=0 tx=0).stop 2023-10-08T15:38:14.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.533+0000 7f0293fff700 1 -- 172.21.15.3:0/573104244 shutdown_connections 2023-10-08T15:38:14.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.533+0000 7f0293fff700 1 --2- 172.21.15.3:0/573104244 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f0280060580 0x7f0280062a30 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:14.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.533+0000 7f0293fff700 1 --2- 172.21.15.3:0/573104244 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f029414a080 0x7f0294145500 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:14.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.533+0000 7f0293fff700 1 --2- 172.21.15.3:0/573104244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02940bab50 0x7f0294144fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:14.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.533+0000 7f0293fff700 1 --2- 172.21.15.3:0/573104244 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f029406df30 0x7f02940b9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:14.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.533+0000 7f0293fff700 1 -- 172.21.15.3:0/573104244 >> 172.21.15.3:0/573104244 conn(0x7f02940be4a0 msgr2=0x7f02940bc160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:14.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.533+0000 7f0293fff700 1 -- 172.21.15.3:0/573104244 shutdown_connections 2023-10-08T15:38:14.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.533+0000 7f0293fff700 1 -- 172.21.15.3:0/573104244 wait complete. 2023-10-08T15:38:14.541 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2023-10-08T15:38:14.553 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":50,"stamp":"2023-10-08T15:38:12.532629+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590458,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":163,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":2401048,"kb_used_data":2264,"kb_used_omap":0,"kb_used_meta":2398720,"kb_avail":752573672,"statfs":{"total":773094113280,"available":770635440128,"internally_reserved":0,"allocated":2318336,"data_stored":1972596,"data_compressed":66282,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":2456289280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.009551"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:10.497535+0000","last_change":"2023-10-08T15:38:10.497535+0000","last_active":"2023-10-08T15:38:10.497535+0000","last_peered":"2023-10-08T15:38:10.497535+0000","last_clean":"2023-10-08T15:38:10.497535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:10.497535+0000","last_undegraded":"2023-10-08T15:38:10.497535+0000","last_fullsized":"2023-10-08T15:38:10.497535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:10.497535+0000","last_change":"2023-10-08T15:38:10.497535+0000","last_active":"2023-10-08T15:38:10.497535+0000","last_peered":"2023-10-08T15:38:10.497535+0000","last_clean":"2023-10-08T15:38:10.497535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:10.497535+0000","last_undegraded":"2023-10-08T15:38:10.497535+0000","last_fullsized":"2023-10-08T15:38:10.497535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":8,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.541983+0000","last_change":"2023-10-08T15:38:11.541983+0000","last_active":"2023-10-08T15:38:11.541983+0000","last_peered":"2023-10-08T15:38:11.541983+0000","last_clean":"2023-10-08T15:38:11.541983+0000","last_became_active":"2023-10-08T15:38:11.541676+0000","last_became_peered":"2023-10-08T15:38:11.541676+0000","last_unstale":"2023-10-08T15:38:11.541983+0000","last_undegraded":"2023-10-08T15:38:11.541983+0000","last_fullsized":"2023-10-08T15:38:11.541983+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:35:02.913467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:10.497535+0000","last_change":"2023-10-08T15:38:10.497535+0000","last_active":"2023-10-08T15:38:10.497535+0000","last_peered":"2023-10-08T15:38:10.497535+0000","last_clean":"2023-10-08T15:38:10.497535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:10.497535+0000","last_undegraded":"2023-10-08T15:38:10.497535+0000","last_fullsized":"2023-10-08T15:38:10.497535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:10.497535+0000","last_change":"2023-10-08T15:38:10.497535+0000","last_active":"2023-10-08T15:38:10.497535+0000","last_peered":"2023-10-08T15:38:10.497535+0000","last_clean":"2023-10-08T15:38:10.497535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:10.497535+0000","last_undegraded":"2023-10-08T15:38:10.497535+0000","last_fullsized":"2023-10-08T15:38:10.497535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:10.497535+0000","last_change":"2023-10-08T15:38:10.497535+0000","last_active":"2023-10-08T15:38:10.497535+0000","last_peered":"2023-10-08T15:38:10.497535+0000","last_clean":"2023-10-08T15:38:10.497535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:10.497535+0000","last_undegraded":"2023-10-08T15:38:10.497535+0000","last_fullsized":"2023-10-08T15:38:10.497535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:10.497535+0000","last_change":"2023-10-08T15:38:10.497535+0000","last_active":"2023-10-08T15:38:10.497535+0000","last_peered":"2023-10-08T15:38:10.497535+0000","last_clean":"2023-10-08T15:38:10.497535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:10.497535+0000","last_undegraded":"2023-10-08T15:38:10.497535+0000","last_fullsized":"2023-10-08T15:38:10.497535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:10.497535+0000","last_change":"2023-10-08T15:38:10.497535+0000","last_active":"2023-10-08T15:38:10.497535+0000","last_peered":"2023-10-08T15:38:10.497535+0000","last_clean":"2023-10-08T15:38:10.497535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:10.497535+0000","last_undegraded":"2023-10-08T15:38:10.497535+0000","last_fullsized":"2023-10-08T15:38:10.497535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:10.497535+0000","last_change":"2023-10-08T15:38:10.497535+0000","last_active":"2023-10-08T15:38:10.497535+0000","last_peered":"2023-10-08T15:38:10.497535+0000","last_clean":"2023-10-08T15:38:10.497535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:10.497535+0000","last_undegraded":"2023-10-08T15:38:10.497535+0000","last_fullsized":"2023-10-08T15:38:10.497535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:10.497535+0000","last_change":"2023-10-08T15:38:10.497535+0000","last_active":"2023-10-08T15:38:10.497535+0000","last_peered":"2023-10-08T15:38:10.497535+0000","last_clean":"2023-10-08T15:38:10.497535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:10.497535+0000","last_undegraded":"2023-10-08T15:38:10.497535+0000","last_fullsized":"2023-10-08T15:38:10.497535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:10.497535+0000","last_change":"2023-10-08T15:38:10.497535+0000","last_active":"2023-10-08T15:38:10.497535+0000","last_peered":"2023-10-08T15:38:10.497535+0000","last_clean":"2023-10-08T15:38:10.497535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:10.497535+0000","last_undegraded":"2023-10-08T15:38:10.497535+0000","last_fullsized":"2023-10-08T15:38:10.497535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":8,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.551057+0000","last_change":"2023-10-08T15:38:11.551057+0000","last_active":"2023-10-08T15:38:11.551057+0000","last_peered":"2023-10-08T15:38:11.551057+0000","last_clean":"2023-10-08T15:38:11.551057+0000","last_became_active":"2023-10-08T15:38:11.548609+0000","last_became_peered":"2023-10-08T15:38:11.548609+0000","last_unstale":"2023-10-08T15:38:11.551057+0000","last_undegraded":"2023-10-08T15:38:11.551057+0000","last_fullsized":"2023-10-08T15:38:11.551057+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:20:17.286315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:10.497535+0000","last_change":"2023-10-08T15:38:10.497535+0000","last_active":"2023-10-08T15:38:10.497535+0000","last_peered":"2023-10-08T15:38:10.497535+0000","last_clean":"2023-10-08T15:38:10.497535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:10.497535+0000","last_undegraded":"2023-10-08T15:38:10.497535+0000","last_fullsized":"2023-10-08T15:38:10.497535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:10.497535+0000","last_change":"2023-10-08T15:38:10.497535+0000","last_active":"2023-10-08T15:38:10.497535+0000","last_peered":"2023-10-08T15:38:10.497535+0000","last_clean":"2023-10-08T15:38:10.497535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:10.497535+0000","last_undegraded":"2023-10-08T15:38:10.497535+0000","last_fullsized":"2023-10-08T15:38:10.497535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":8,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.537162+0000","last_change":"2023-10-08T15:38:11.537162+0000","last_active":"2023-10-08T15:38:11.537162+0000","last_peered":"2023-10-08T15:38:11.537162+0000","last_clean":"2023-10-08T15:38:11.537162+0000","last_became_active":"2023-10-08T15:38:11.536890+0000","last_became_peered":"2023-10-08T15:38:11.536890+0000","last_unstale":"2023-10-08T15:38:11.537162+0000","last_undegraded":"2023-10-08T15:38:11.537162+0000","last_fullsized":"2023-10-08T15:38:11.537162+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:47:51.646205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:10.497535+0000","last_change":"2023-10-08T15:38:10.497535+0000","last_active":"2023-10-08T15:38:10.497535+0000","last_peered":"2023-10-08T15:38:10.497535+0000","last_clean":"2023-10-08T15:38:10.497535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:10.497535+0000","last_undegraded":"2023-10-08T15:38:10.497535+0000","last_fullsized":"2023-10-08T15:38:10.497535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:10.497535+0000","last_change":"2023-10-08T15:38:10.497535+0000","last_active":"2023-10-08T15:38:10.497535+0000","last_peered":"2023-10-08T15:38:10.497535+0000","last_clean":"2023-10-08T15:38:10.497535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:10.497535+0000","last_undegraded":"2023-10-08T15:38:10.497535+0000","last_fullsized":"2023-10-08T15:38:10.497535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:10.497535+0000","last_change":"2023-10-08T15:38:10.497535+0000","last_active":"2023-10-08T15:38:10.497535+0000","last_peered":"2023-10-08T15:38:10.497535+0000","last_clean":"2023-10-08T15:38:10.497535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:10.497535+0000","last_undegraded":"2023-10-08T15:38:10.497535+0000","last_fullsized":"2023-10-08T15:38:10.497535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:10.497535+0000","last_change":"2023-10-08T15:38:10.497535+0000","last_active":"2023-10-08T15:38:10.497535+0000","last_peered":"2023-10-08T15:38:10.497535+0000","last_clean":"2023-10-08T15:38:10.497535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:10.497535+0000","last_undegraded":"2023-10-08T15:38:10.497535+0000","last_fullsized":"2023-10-08T15:38:10.497535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:10.497535+0000","last_change":"2023-10-08T15:38:10.497535+0000","last_active":"2023-10-08T15:38:10.497535+0000","last_peered":"2023-10-08T15:38:10.497535+0000","last_clean":"2023-10-08T15:38:10.497535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:10.497535+0000","last_undegraded":"2023-10-08T15:38:10.497535+0000","last_fullsized":"2023-10-08T15:38:10.497535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:10.497535+0000","last_change":"2023-10-08T15:38:10.497535+0000","last_active":"2023-10-08T15:38:10.497535+0000","last_peered":"2023-10-08T15:38:10.497535+0000","last_clean":"2023-10-08T15:38:10.497535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:10.497535+0000","last_undegraded":"2023-10-08T15:38:10.497535+0000","last_fullsized":"2023-10-08T15:38:10.497535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:10.497535+0000","last_change":"2023-10-08T15:38:10.497535+0000","last_active":"2023-10-08T15:38:10.497535+0000","last_peered":"2023-10-08T15:38:10.497535+0000","last_clean":"2023-10-08T15:38:10.497535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:10.497535+0000","last_undegraded":"2023-10-08T15:38:10.497535+0000","last_fullsized":"2023-10-08T15:38:10.497535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:10.497535+0000","last_change":"2023-10-08T15:38:10.497535+0000","last_active":"2023-10-08T15:38:10.497535+0000","last_peered":"2023-10-08T15:38:10.497535+0000","last_clean":"2023-10-08T15:38:10.497535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:10.497535+0000","last_undegraded":"2023-10-08T15:38:10.497535+0000","last_fullsized":"2023-10-08T15:38:10.497535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":8,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.541554+0000","last_change":"2023-10-08T15:38:11.541554+0000","last_active":"2023-10-08T15:38:11.541554+0000","last_peered":"2023-10-08T15:38:11.541554+0000","last_clean":"2023-10-08T15:38:11.541554+0000","last_became_active":"2023-10-08T15:38:11.541198+0000","last_became_peered":"2023-10-08T15:38:11.541198+0000","last_unstale":"2023-10-08T15:38:11.541554+0000","last_undegraded":"2023-10-08T15:38:11.541554+0000","last_fullsized":"2023-10-08T15:38:11.541554+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:53:06.078185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:10.497535+0000","last_change":"2023-10-08T15:38:10.497535+0000","last_active":"2023-10-08T15:38:10.497535+0000","last_peered":"2023-10-08T15:38:10.497535+0000","last_clean":"2023-10-08T15:38:10.497535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:10.497535+0000","last_undegraded":"2023-10-08T15:38:10.497535+0000","last_fullsized":"2023-10-08T15:38:10.497535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:10.497535+0000","last_change":"2023-10-08T15:38:10.497535+0000","last_active":"2023-10-08T15:38:10.497535+0000","last_peered":"2023-10-08T15:38:10.497535+0000","last_clean":"2023-10-08T15:38:10.497535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:10.497535+0000","last_undegraded":"2023-10-08T15:38:10.497535+0000","last_fullsized":"2023-10-08T15:38:10.497535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:10.497535+0000","last_change":"2023-10-08T15:38:10.497535+0000","last_active":"2023-10-08T15:38:10.497535+0000","last_peered":"2023-10-08T15:38:10.497535+0000","last_clean":"2023-10-08T15:38:10.497535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:10.497535+0000","last_undegraded":"2023-10-08T15:38:10.497535+0000","last_fullsized":"2023-10-08T15:38:10.497535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":8,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.547209+0000","last_change":"2023-10-08T15:38:11.547209+0000","last_active":"2023-10-08T15:38:11.547209+0000","last_peered":"2023-10-08T15:38:11.547209+0000","last_clean":"2023-10-08T15:38:11.547209+0000","last_became_active":"2023-10-08T15:38:11.546921+0000","last_became_peered":"2023-10-08T15:38:11.546921+0000","last_unstale":"2023-10-08T15:38:11.547209+0000","last_undegraded":"2023-10-08T15:38:11.547209+0000","last_fullsized":"2023-10-08T15:38:11.547209+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:31.263101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:10.497535+0000","last_change":"2023-10-08T15:38:10.497535+0000","last_active":"2023-10-08T15:38:10.497535+0000","last_peered":"2023-10-08T15:38:10.497535+0000","last_clean":"2023-10-08T15:38:10.497535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:10.497535+0000","last_undegraded":"2023-10-08T15:38:10.497535+0000","last_fullsized":"2023-10-08T15:38:10.497535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:10.497535+0000","last_change":"2023-10-08T15:38:10.497535+0000","last_active":"2023-10-08T15:38:10.497535+0000","last_peered":"2023-10-08T15:38:10.497535+0000","last_clean":"2023-10-08T15:38:10.497535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:10.497535+0000","last_undegraded":"2023-10-08T15:38:10.497535+0000","last_fullsized":"2023-10-08T15:38:10.497535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:10.497535+0000","last_change":"2023-10-08T15:38:10.497535+0000","last_active":"2023-10-08T15:38:10.497535+0000","last_peered":"2023-10-08T15:38:10.497535+0000","last_clean":"2023-10-08T15:38:10.497535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:10.497535+0000","last_undegraded":"2023-10-08T15:38:10.497535+0000","last_fullsized":"2023-10-08T15:38:10.497535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:10.497535+0000","last_change":"2023-10-08T15:38:10.497535+0000","last_active":"2023-10-08T15:38:10.497535+0000","last_peered":"2023-10-08T15:38:10.497535+0000","last_clean":"2023-10-08T15:38:10.497535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:10.497535+0000","last_undegraded":"2023-10-08T15:38:10.497535+0000","last_fullsized":"2023-10-08T15:38:10.497535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:10.497535+0000","last_change":"2023-10-08T15:38:10.497535+0000","last_active":"2023-10-08T15:38:10.497535+0000","last_peered":"2023-10-08T15:38:10.497535+0000","last_clean":"2023-10-08T15:38:10.497535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:10.497535+0000","last_undegraded":"2023-10-08T15:38:10.497535+0000","last_fullsized":"2023-10-08T15:38:10.497535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:09.486845+0000","last_change":"2023-10-08T15:38:09.486845+0000","last_active":"2023-10-08T15:38:09.486845+0000","last_peered":"2023-10-08T15:38:09.486845+0000","last_clean":"2023-10-08T15:38:09.486845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:09.486845+0000","last_undegraded":"2023-10-08T15:38:09.486845+0000","last_fullsized":"2023-10-08T15:38:09.486845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:10.497535+0000","last_change":"2023-10-08T15:38:10.497535+0000","last_active":"2023-10-08T15:38:10.497535+0000","last_peered":"2023-10-08T15:38:10.497535+0000","last_clean":"2023-10-08T15:38:10.497535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:10.497535+0000","last_undegraded":"2023-10-08T15:38:10.497535+0000","last_fullsized":"2023-10-08T15:38:10.497535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:09.486845+0000","last_change":"2023-10-08T15:38:09.486845+0000","last_active":"2023-10-08T15:38:09.486845+0000","last_peered":"2023-10-08T15:38:09.486845+0000","last_clean":"2023-10-08T15:38:09.486845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:09.486845+0000","last_undegraded":"2023-10-08T15:38:09.486845+0000","last_fullsized":"2023-10-08T15:38:09.486845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:10.497535+0000","last_change":"2023-10-08T15:38:10.497535+0000","last_active":"2023-10-08T15:38:10.497535+0000","last_peered":"2023-10-08T15:38:10.497535+0000","last_clean":"2023-10-08T15:38:10.497535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:10.497535+0000","last_undegraded":"2023-10-08T15:38:10.497535+0000","last_fullsized":"2023-10-08T15:38:10.497535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:09.486845+0000","last_change":"2023-10-08T15:38:09.486845+0000","last_active":"2023-10-08T15:38:09.486845+0000","last_peered":"2023-10-08T15:38:09.486845+0000","last_clean":"2023-10-08T15:38:09.486845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:09.486845+0000","last_undegraded":"2023-10-08T15:38:09.486845+0000","last_fullsized":"2023-10-08T15:38:09.486845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:10.497535+0000","last_change":"2023-10-08T15:38:10.497535+0000","last_active":"2023-10-08T15:38:10.497535+0000","last_peered":"2023-10-08T15:38:10.497535+0000","last_clean":"2023-10-08T15:38:10.497535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:10.497535+0000","last_undegraded":"2023-10-08T15:38:10.497535+0000","last_fullsized":"2023-10-08T15:38:10.497535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:09.486845+0000","last_change":"2023-10-08T15:38:09.486845+0000","last_active":"2023-10-08T15:38:09.486845+0000","last_peered":"2023-10-08T15:38:09.486845+0000","last_clean":"2023-10-08T15:38:09.486845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:09.486845+0000","last_undegraded":"2023-10-08T15:38:09.486845+0000","last_fullsized":"2023-10-08T15:38:09.486845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:10.497535+0000","last_change":"2023-10-08T15:38:10.497535+0000","last_active":"2023-10-08T15:38:10.497535+0000","last_peered":"2023-10-08T15:38:10.497535+0000","last_clean":"2023-10-08T15:38:10.497535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:10.497535+0000","last_undegraded":"2023-10-08T15:38:10.497535+0000","last_fullsized":"2023-10-08T15:38:10.497535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:09.486845+0000","last_change":"2023-10-08T15:38:09.486845+0000","last_active":"2023-10-08T15:38:09.486845+0000","last_peered":"2023-10-08T15:38:09.486845+0000","last_clean":"2023-10-08T15:38:09.486845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:09.486845+0000","last_undegraded":"2023-10-08T15:38:09.486845+0000","last_fullsized":"2023-10-08T15:38:09.486845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":8,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.551248+0000","last_change":"2023-10-08T15:38:11.551248+0000","last_active":"2023-10-08T15:38:11.551248+0000","last_peered":"2023-10-08T15:38:11.551248+0000","last_clean":"2023-10-08T15:38:11.551248+0000","last_became_active":"2023-10-08T15:38:11.550849+0000","last_became_peered":"2023-10-08T15:38:11.550849+0000","last_unstale":"2023-10-08T15:38:11.551248+0000","last_undegraded":"2023-10-08T15:38:11.551248+0000","last_fullsized":"2023-10-08T15:38:11.551248+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:14:23.429299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:09.486845+0000","last_change":"2023-10-08T15:38:09.486845+0000","last_active":"2023-10-08T15:38:09.486845+0000","last_peered":"2023-10-08T15:38:09.486845+0000","last_clean":"2023-10-08T15:38:09.486845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:09.486845+0000","last_undegraded":"2023-10-08T15:38:09.486845+0000","last_fullsized":"2023-10-08T15:38:09.486845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:10.497535+0000","last_change":"2023-10-08T15:38:10.497535+0000","last_active":"2023-10-08T15:38:10.497535+0000","last_peered":"2023-10-08T15:38:10.497535+0000","last_clean":"2023-10-08T15:38:10.497535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:10.497535+0000","last_undegraded":"2023-10-08T15:38:10.497535+0000","last_fullsized":"2023-10-08T15:38:10.497535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:09.486845+0000","last_change":"2023-10-08T15:38:09.486845+0000","last_active":"2023-10-08T15:38:09.486845+0000","last_peered":"2023-10-08T15:38:09.486845+0000","last_clean":"2023-10-08T15:38:09.486845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:09.486845+0000","last_undegraded":"2023-10-08T15:38:09.486845+0000","last_fullsized":"2023-10-08T15:38:09.486845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:10.497535+0000","last_change":"2023-10-08T15:38:10.497535+0000","last_active":"2023-10-08T15:38:10.497535+0000","last_peered":"2023-10-08T15:38:10.497535+0000","last_clean":"2023-10-08T15:38:10.497535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:10.497535+0000","last_undegraded":"2023-10-08T15:38:10.497535+0000","last_fullsized":"2023-10-08T15:38:10.497535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:09.486845+0000","last_change":"2023-10-08T15:38:09.486845+0000","last_active":"2023-10-08T15:38:09.486845+0000","last_peered":"2023-10-08T15:38:09.486845+0000","last_clean":"2023-10-08T15:38:09.486845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:09.486845+0000","last_undegraded":"2023-10-08T15:38:09.486845+0000","last_fullsized":"2023-10-08T15:38:09.486845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":8,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.551628+0000","last_change":"2023-10-08T15:38:11.551628+0000","last_active":"2023-10-08T15:38:11.551628+0000","last_peered":"2023-10-08T15:38:11.551628+0000","last_clean":"2023-10-08T15:38:11.551628+0000","last_became_active":"2023-10-08T15:38:11.551240+0000","last_became_peered":"2023-10-08T15:38:11.551240+0000","last_unstale":"2023-10-08T15:38:11.551628+0000","last_undegraded":"2023-10-08T15:38:11.551628+0000","last_fullsized":"2023-10-08T15:38:11.551628+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:02:56.125680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:09.486845+0000","last_change":"2023-10-08T15:38:09.486845+0000","last_active":"2023-10-08T15:38:09.486845+0000","last_peered":"2023-10-08T15:38:09.486845+0000","last_clean":"2023-10-08T15:38:09.486845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:09.486845+0000","last_undegraded":"2023-10-08T15:38:09.486845+0000","last_fullsized":"2023-10-08T15:38:09.486845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:10.497535+0000","last_change":"2023-10-08T15:38:10.497535+0000","last_active":"2023-10-08T15:38:10.497535+0000","last_peered":"2023-10-08T15:38:10.497535+0000","last_clean":"2023-10-08T15:38:10.497535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:10.497535+0000","last_undegraded":"2023-10-08T15:38:10.497535+0000","last_fullsized":"2023-10-08T15:38:10.497535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:09.486845+0000","last_change":"2023-10-08T15:38:09.486845+0000","last_active":"2023-10-08T15:38:09.486845+0000","last_peered":"2023-10-08T15:38:09.486845+0000","last_clean":"2023-10-08T15:38:09.486845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:09.486845+0000","last_undegraded":"2023-10-08T15:38:09.486845+0000","last_fullsized":"2023-10-08T15:38:09.486845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:10.497535+0000","last_change":"2023-10-08T15:38:10.497535+0000","last_active":"2023-10-08T15:38:10.497535+0000","last_peered":"2023-10-08T15:38:10.497535+0000","last_clean":"2023-10-08T15:38:10.497535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:10.497535+0000","last_undegraded":"2023-10-08T15:38:10.497535+0000","last_fullsized":"2023-10-08T15:38:10.497535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"28'3","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.555394+0000","last_change":"2023-10-08T15:38:10.539699+0000","last_active":"2023-10-08T15:38:11.555394+0000","last_peered":"2023-10-08T15:38:11.555394+0000","last_clean":"2023-10-08T15:38:11.555394+0000","last_became_active":"2023-10-08T15:38:10.539392+0000","last_became_peered":"2023-10-08T15:38:10.539392+0000","last_unstale":"2023-10-08T15:38:11.555394+0000","last_undegraded":"2023-10-08T15:38:11.555394+0000","last_fullsized":"2023-10-08T15:38:11.555394+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:43:47.189672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":8,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.547448+0000","last_change":"2023-10-08T15:38:11.547448+0000","last_active":"2023-10-08T15:38:11.547448+0000","last_peered":"2023-10-08T15:38:11.547448+0000","last_clean":"2023-10-08T15:38:11.547448+0000","last_became_active":"2023-10-08T15:38:11.546789+0000","last_became_peered":"2023-10-08T15:38:11.546789+0000","last_unstale":"2023-10-08T15:38:11.547448+0000","last_undegraded":"2023-10-08T15:38:11.547448+0000","last_fullsized":"2023-10-08T15:38:11.547448+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:01:30.789238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:09.486845+0000","last_change":"2023-10-08T15:38:09.486845+0000","last_active":"2023-10-08T15:38:09.486845+0000","last_peered":"2023-10-08T15:38:09.486845+0000","last_clean":"2023-10-08T15:38:09.486845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:09.486845+0000","last_undegraded":"2023-10-08T15:38:09.486845+0000","last_fullsized":"2023-10-08T15:38:09.486845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:10.497535+0000","last_change":"2023-10-08T15:38:10.497535+0000","last_active":"2023-10-08T15:38:10.497535+0000","last_peered":"2023-10-08T15:38:10.497535+0000","last_clean":"2023-10-08T15:38:10.497535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:10.497535+0000","last_undegraded":"2023-10-08T15:38:10.497535+0000","last_fullsized":"2023-10-08T15:38:10.497535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:09.486845+0000","last_change":"2023-10-08T15:38:09.486845+0000","last_active":"2023-10-08T15:38:09.486845+0000","last_peered":"2023-10-08T15:38:09.486845+0000","last_clean":"2023-10-08T15:38:09.486845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:09.486845+0000","last_undegraded":"2023-10-08T15:38:09.486845+0000","last_fullsized":"2023-10-08T15:38:09.486845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:10.497535+0000","last_change":"2023-10-08T15:38:10.497535+0000","last_active":"2023-10-08T15:38:10.497535+0000","last_peered":"2023-10-08T15:38:10.497535+0000","last_clean":"2023-10-08T15:38:10.497535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:10.497535+0000","last_undegraded":"2023-10-08T15:38:10.497535+0000","last_fullsized":"2023-10-08T15:38:10.497535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:09.486845+0000","last_change":"2023-10-08T15:38:09.486845+0000","last_active":"2023-10-08T15:38:09.486845+0000","last_peered":"2023-10-08T15:38:09.486845+0000","last_clean":"2023-10-08T15:38:09.486845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:09.486845+0000","last_undegraded":"2023-10-08T15:38:09.486845+0000","last_fullsized":"2023-10-08T15:38:09.486845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:10.497535+0000","last_change":"2023-10-08T15:38:10.497535+0000","last_active":"2023-10-08T15:38:10.497535+0000","last_peered":"2023-10-08T15:38:10.497535+0000","last_clean":"2023-10-08T15:38:10.497535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:10.497535+0000","last_undegraded":"2023-10-08T15:38:10.497535+0000","last_fullsized":"2023-10-08T15:38:10.497535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:09.486845+0000","last_change":"2023-10-08T15:38:09.486845+0000","last_active":"2023-10-08T15:38:09.486845+0000","last_peered":"2023-10-08T15:38:09.486845+0000","last_clean":"2023-10-08T15:38:09.486845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:09.486845+0000","last_undegraded":"2023-10-08T15:38:09.486845+0000","last_fullsized":"2023-10-08T15:38:09.486845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:10.497535+0000","last_change":"2023-10-08T15:38:10.497535+0000","last_active":"2023-10-08T15:38:10.497535+0000","last_peered":"2023-10-08T15:38:10.497535+0000","last_clean":"2023-10-08T15:38:10.497535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:10.497535+0000","last_undegraded":"2023-10-08T15:38:10.497535+0000","last_fullsized":"2023-10-08T15:38:10.497535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:09.486845+0000","last_change":"2023-10-08T15:38:09.486845+0000","last_active":"2023-10-08T15:38:09.486845+0000","last_peered":"2023-10-08T15:38:09.486845+0000","last_clean":"2023-10-08T15:38:09.486845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:09.486845+0000","last_undegraded":"2023-10-08T15:38:09.486845+0000","last_fullsized":"2023-10-08T15:38:09.486845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:10.497535+0000","last_change":"2023-10-08T15:38:10.497535+0000","last_active":"2023-10-08T15:38:10.497535+0000","last_peered":"2023-10-08T15:38:10.497535+0000","last_clean":"2023-10-08T15:38:10.497535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:10.497535+0000","last_undegraded":"2023-10-08T15:38:10.497535+0000","last_fullsized":"2023-10-08T15:38:10.497535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:09.486845+0000","last_change":"2023-10-08T15:38:09.486845+0000","last_active":"2023-10-08T15:38:09.486845+0000","last_peered":"2023-10-08T15:38:09.486845+0000","last_clean":"2023-10-08T15:38:09.486845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:09.486845+0000","last_undegraded":"2023-10-08T15:38:09.486845+0000","last_fullsized":"2023-10-08T15:38:09.486845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":8,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.552242+0000","last_change":"2023-10-08T15:38:11.552242+0000","last_active":"2023-10-08T15:38:11.552242+0000","last_peered":"2023-10-08T15:38:11.552242+0000","last_clean":"2023-10-08T15:38:11.552242+0000","last_became_active":"2023-10-08T15:38:11.551833+0000","last_became_peered":"2023-10-08T15:38:11.551833+0000","last_unstale":"2023-10-08T15:38:11.552242+0000","last_undegraded":"2023-10-08T15:38:11.552242+0000","last_fullsized":"2023-10-08T15:38:11.552242+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:54:49.800738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:09.486845+0000","last_change":"2023-10-08T15:38:09.486845+0000","last_active":"2023-10-08T15:38:09.486845+0000","last_peered":"2023-10-08T15:38:09.486845+0000","last_clean":"2023-10-08T15:38:09.486845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:09.486845+0000","last_undegraded":"2023-10-08T15:38:09.486845+0000","last_fullsized":"2023-10-08T15:38:09.486845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:10.497535+0000","last_change":"2023-10-08T15:38:10.497535+0000","last_active":"2023-10-08T15:38:10.497535+0000","last_peered":"2023-10-08T15:38:10.497535+0000","last_clean":"2023-10-08T15:38:10.497535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:10.497535+0000","last_undegraded":"2023-10-08T15:38:10.497535+0000","last_fullsized":"2023-10-08T15:38:10.497535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:09.486845+0000","last_change":"2023-10-08T15:38:09.486845+0000","last_active":"2023-10-08T15:38:09.486845+0000","last_peered":"2023-10-08T15:38:09.486845+0000","last_clean":"2023-10-08T15:38:09.486845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:09.486845+0000","last_undegraded":"2023-10-08T15:38:09.486845+0000","last_fullsized":"2023-10-08T15:38:09.486845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:10.497535+0000","last_change":"2023-10-08T15:38:10.497535+0000","last_active":"2023-10-08T15:38:10.497535+0000","last_peered":"2023-10-08T15:38:10.497535+0000","last_clean":"2023-10-08T15:38:10.497535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:10.497535+0000","last_undegraded":"2023-10-08T15:38:10.497535+0000","last_fullsized":"2023-10-08T15:38:10.497535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:09.486845+0000","last_change":"2023-10-08T15:38:09.486845+0000","last_active":"2023-10-08T15:38:09.486845+0000","last_peered":"2023-10-08T15:38:09.486845+0000","last_clean":"2023-10-08T15:38:09.486845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:09.486845+0000","last_undegraded":"2023-10-08T15:38:09.486845+0000","last_fullsized":"2023-10-08T15:38:09.486845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:10.497535+0000","last_change":"2023-10-08T15:38:10.497535+0000","last_active":"2023-10-08T15:38:10.497535+0000","last_peered":"2023-10-08T15:38:10.497535+0000","last_clean":"2023-10-08T15:38:10.497535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:10.497535+0000","last_undegraded":"2023-10-08T15:38:10.497535+0000","last_fullsized":"2023-10-08T15:38:10.497535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:09.486845+0000","last_change":"2023-10-08T15:38:09.486845+0000","last_active":"2023-10-08T15:38:09.486845+0000","last_peered":"2023-10-08T15:38:09.486845+0000","last_clean":"2023-10-08T15:38:09.486845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:09.486845+0000","last_undegraded":"2023-10-08T15:38:09.486845+0000","last_fullsized":"2023-10-08T15:38:09.486845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:10.497535+0000","last_change":"2023-10-08T15:38:10.497535+0000","last_active":"2023-10-08T15:38:10.497535+0000","last_peered":"2023-10-08T15:38:10.497535+0000","last_clean":"2023-10-08T15:38:10.497535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:10.497535+0000","last_undegraded":"2023-10-08T15:38:10.497535+0000","last_fullsized":"2023-10-08T15:38:10.497535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:09.486845+0000","last_change":"2023-10-08T15:38:09.486845+0000","last_active":"2023-10-08T15:38:09.486845+0000","last_peered":"2023-10-08T15:38:09.486845+0000","last_clean":"2023-10-08T15:38:09.486845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:09.486845+0000","last_undegraded":"2023-10-08T15:38:09.486845+0000","last_fullsized":"2023-10-08T15:38:09.486845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:10.497535+0000","last_change":"2023-10-08T15:38:10.497535+0000","last_active":"2023-10-08T15:38:10.497535+0000","last_peered":"2023-10-08T15:38:10.497535+0000","last_clean":"2023-10-08T15:38:10.497535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:10.497535+0000","last_undegraded":"2023-10-08T15:38:10.497535+0000","last_fullsized":"2023-10-08T15:38:10.497535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:09.486845+0000","last_change":"2023-10-08T15:38:09.486845+0000","last_active":"2023-10-08T15:38:09.486845+0000","last_peered":"2023-10-08T15:38:09.486845+0000","last_clean":"2023-10-08T15:38:09.486845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:09.486845+0000","last_undegraded":"2023-10-08T15:38:09.486845+0000","last_fullsized":"2023-10-08T15:38:09.486845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:10.497535+0000","last_change":"2023-10-08T15:38:10.497535+0000","last_active":"2023-10-08T15:38:10.497535+0000","last_peered":"2023-10-08T15:38:10.497535+0000","last_clean":"2023-10-08T15:38:10.497535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:10.497535+0000","last_undegraded":"2023-10-08T15:38:10.497535+0000","last_fullsized":"2023-10-08T15:38:10.497535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T15:38:10.542706+0000","last_change":"2023-10-08T15:38:10.539680+0000","last_active":"2023-10-08T15:38:10.542706+0000","last_peered":"2023-10-08T15:38:10.542706+0000","last_clean":"2023-10-08T15:38:10.542706+0000","last_became_active":"2023-10-08T15:38:10.539435+0000","last_became_peered":"2023-10-08T15:38:10.539435+0000","last_unstale":"2023-10-08T15:38:10.542706+0000","last_undegraded":"2023-10-08T15:38:10.542706+0000","last_fullsized":"2023-10-08T15:38:10.542706+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:35:35.546466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:10.497535+0000","last_change":"2023-10-08T15:38:10.497535+0000","last_active":"2023-10-08T15:38:10.497535+0000","last_peered":"2023-10-08T15:38:10.497535+0000","last_clean":"2023-10-08T15:38:10.497535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:10.497535+0000","last_undegraded":"2023-10-08T15:38:10.497535+0000","last_fullsized":"2023-10-08T15:38:10.497535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:09.486845+0000","last_change":"2023-10-08T15:38:09.486845+0000","last_active":"2023-10-08T15:38:09.486845+0000","last_peered":"2023-10-08T15:38:09.486845+0000","last_clean":"2023-10-08T15:38:09.486845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:09.486845+0000","last_undegraded":"2023-10-08T15:38:09.486845+0000","last_fullsized":"2023-10-08T15:38:09.486845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":8,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.541941+0000","last_change":"2023-10-08T15:38:11.541941+0000","last_active":"2023-10-08T15:38:11.541941+0000","last_peered":"2023-10-08T15:38:11.541941+0000","last_clean":"2023-10-08T15:38:11.541941+0000","last_became_active":"2023-10-08T15:38:11.541614+0000","last_became_peered":"2023-10-08T15:38:11.541614+0000","last_unstale":"2023-10-08T15:38:11.541941+0000","last_undegraded":"2023-10-08T15:38:11.541941+0000","last_fullsized":"2023-10-08T15:38:11.541941+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:14:30.680408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:09.486845+0000","last_change":"2023-10-08T15:38:09.486845+0000","last_active":"2023-10-08T15:38:09.486845+0000","last_peered":"2023-10-08T15:38:09.486845+0000","last_clean":"2023-10-08T15:38:09.486845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:09.486845+0000","last_undegraded":"2023-10-08T15:38:09.486845+0000","last_fullsized":"2023-10-08T15:38:09.486845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:10.497535+0000","last_change":"2023-10-08T15:38:10.497535+0000","last_active":"2023-10-08T15:38:10.497535+0000","last_peered":"2023-10-08T15:38:10.497535+0000","last_clean":"2023-10-08T15:38:10.497535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:10.497535+0000","last_undegraded":"2023-10-08T15:38:10.497535+0000","last_fullsized":"2023-10-08T15:38:10.497535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:09.486845+0000","last_change":"2023-10-08T15:38:09.486845+0000","last_active":"2023-10-08T15:38:09.486845+0000","last_peered":"2023-10-08T15:38:09.486845+0000","last_clean":"2023-10-08T15:38:09.486845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:09.486845+0000","last_undegraded":"2023-10-08T15:38:09.486845+0000","last_fullsized":"2023-10-08T15:38:09.486845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:10.497535+0000","last_change":"2023-10-08T15:38:10.497535+0000","last_active":"2023-10-08T15:38:10.497535+0000","last_peered":"2023-10-08T15:38:10.497535+0000","last_clean":"2023-10-08T15:38:10.497535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:10.497535+0000","last_undegraded":"2023-10-08T15:38:10.497535+0000","last_fullsized":"2023-10-08T15:38:10.497535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:09.486845+0000","last_change":"2023-10-08T15:38:09.486845+0000","last_active":"2023-10-08T15:38:09.486845+0000","last_peered":"2023-10-08T15:38:09.486845+0000","last_clean":"2023-10-08T15:38:09.486845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:09.486845+0000","last_undegraded":"2023-10-08T15:38:09.486845+0000","last_fullsized":"2023-10-08T15:38:09.486845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:10.497535+0000","last_change":"2023-10-08T15:38:10.497535+0000","last_active":"2023-10-08T15:38:10.497535+0000","last_peered":"2023-10-08T15:38:10.497535+0000","last_clean":"2023-10-08T15:38:10.497535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:10.497535+0000","last_undegraded":"2023-10-08T15:38:10.497535+0000","last_fullsized":"2023-10-08T15:38:10.497535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:09.486845+0000","last_change":"2023-10-08T15:38:09.486845+0000","last_active":"2023-10-08T15:38:09.486845+0000","last_peered":"2023-10-08T15:38:09.486845+0000","last_clean":"2023-10-08T15:38:09.486845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:09.486845+0000","last_undegraded":"2023-10-08T15:38:09.486845+0000","last_fullsized":"2023-10-08T15:38:09.486845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:10.497535+0000","last_change":"2023-10-08T15:38:10.497535+0000","last_active":"2023-10-08T15:38:10.497535+0000","last_peered":"2023-10-08T15:38:10.497535+0000","last_clean":"2023-10-08T15:38:10.497535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:10.497535+0000","last_undegraded":"2023-10-08T15:38:10.497535+0000","last_fullsized":"2023-10-08T15:38:10.497535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:09.486845+0000","last_change":"2023-10-08T15:38:09.486845+0000","last_active":"2023-10-08T15:38:09.486845+0000","last_peered":"2023-10-08T15:38:09.486845+0000","last_clean":"2023-10-08T15:38:09.486845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:09.486845+0000","last_undegraded":"2023-10-08T15:38:09.486845+0000","last_fullsized":"2023-10-08T15:38:09.486845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:10.497535+0000","last_change":"2023-10-08T15:38:10.497535+0000","last_active":"2023-10-08T15:38:10.497535+0000","last_peered":"2023-10-08T15:38:10.497535+0000","last_clean":"2023-10-08T15:38:10.497535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:10.497535+0000","last_undegraded":"2023-10-08T15:38:10.497535+0000","last_fullsized":"2023-10-08T15:38:10.497535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:09.486845+0000","last_change":"2023-10-08T15:38:09.486845+0000","last_active":"2023-10-08T15:38:09.486845+0000","last_peered":"2023-10-08T15:38:09.486845+0000","last_clean":"2023-10-08T15:38:09.486845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:09.486845+0000","last_undegraded":"2023-10-08T15:38:09.486845+0000","last_fullsized":"2023-10-08T15:38:09.486845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:10.497535+0000","last_change":"2023-10-08T15:38:10.497535+0000","last_active":"2023-10-08T15:38:10.497535+0000","last_peered":"2023-10-08T15:38:10.497535+0000","last_clean":"2023-10-08T15:38:10.497535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:10.497535+0000","last_undegraded":"2023-10-08T15:38:10.497535+0000","last_fullsized":"2023-10-08T15:38:10.497535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:38:09.486845+0000","last_change":"2023-10-08T15:38:09.486845+0000","last_active":"2023-10-08T15:38:09.486845+0000","last_peered":"2023-10-08T15:38:09.486845+0000","last_clean":"2023-10-08T15:38:09.486845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:38:09.486845+0000","last_undegraded":"2023-10-08T15:38:09.486845+0000","last_fullsized":"2023-10-08T15:38:09.486845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-08T15:38:05.459679+0000","last_change":"2023-10-08T15:37:19.380955+0000","last_active":"2023-10-08T15:38:05.459679+0000","last_peered":"2023-10-08T15:38:05.459679+0000","last_clean":"2023-10-08T15:38:05.459679+0000","last_became_active":"2023-10-08T15:37:19.378277+0000","last_became_peered":"2023-10-08T15:37:19.378277+0000","last_unstale":"2023-10-08T15:38:05.459679+0000","last_undegraded":"2023-10-08T15:38:05.459679+0000","last_fullsized":"2023-10-08T15:38:05.459679+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:17.537726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:17.537726+0000","last_clean_scrub_stamp":"2023-10-08T15:37:17.537726+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:06:26.612046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":20,"acting":20,"num_store_stats":1},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":4,"acting":4,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66282,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542156,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301712,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070128,"statfs":{"total":96636764160,"available":96327811072,"internally_reserved":0,"allocated":335872,"data_stored":687843,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.161}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.409}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5680000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542157,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":301648,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070192,"statfs":{"total":96636764160,"available":96327876608,"internally_reserved":0,"allocated":270336,"data_stored":97475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2250000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.284}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.359}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.302}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.246}]}]},{"osd":3,"up_from":14,"seq":60129542158,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297552,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074288,"statfs":{"total":96636764160,"available":96332070912,"internally_reserved":0,"allocated":270336,"data_stored":97475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3580000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.502}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.246}]}]},{"osd":2,"up_from":14,"seq":60129542157,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297552,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074288,"statfs":{"total":96636764160,"available":96332070912,"internally_reserved":0,"allocated":270336,"data_stored":97475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542158,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297552,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074288,"statfs":{"total":96636764160,"available":96332070912,"internally_reserved":0,"allocated":270336,"data_stored":97475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.734}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.0119999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.133}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.859}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.3380000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.8979999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2070000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542158,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301712,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070128,"statfs":{"total":96636764160,"available":96327811072,"internally_reserved":0,"allocated":335872,"data_stored":687843,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4339999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.288}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0940000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301672,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070168,"statfs":{"total":96636764160,"available":96327852032,"internally_reserved":0,"allocated":294912,"data_stored":109535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.292}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0840000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.145}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":301648,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070192,"statfs":{"total":96636764160,"available":96327876608,"internally_reserved":0,"allocated":270336,"data_stored":97475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0229999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.107}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T15:38:14.559 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T15:38:14.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.657+0000 7f91c6a6f700 1 Processor -- start 2023-10-08T15:38:14.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.657+0000 7f91c6a6f700 1 -- start start 2023-10-08T15:38:14.666 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.657+0000 7f91c6a6f700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f91c00a1fd0 0x7f91c0148330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:14.666 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.657+0000 7f91c6a6f700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f91c014c6c0 0x7f91c0148870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:14.666 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.657+0000 7f91c6a6f700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f91c0148db0 0x7f91c00b1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:14.666 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.657+0000 7f91c6a6f700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91c014b9d0 con 0x7f91c0148db0 2023-10-08T15:38:14.666 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.657+0000 7f91c6a6f700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91c00b3b10 con 0x7f91c014c6c0 2023-10-08T15:38:14.666 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.657+0000 7f91c6a6f700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91c014bbe0 con 0x7f91c00a1fd0 2023-10-08T15:38:14.666 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.657+0000 7f91c500c700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f91c0148db0 0x7f91c00b1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:14.666 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.661+0000 7f91c500c700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f91c0148db0 0x7f91c00b1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:48186/0 (socket says 172.21.15.3:48186) 2023-10-08T15:38:14.666 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.661+0000 7f91c500c700 1 -- 172.21.15.3:0/2033228953 learned_addr learned my addr 172.21.15.3:0/2033228953 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:38:14.666 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.661+0000 7f91c480b700 1 --2- 172.21.15.3:0/2033228953 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f91c00a1fd0 0x7f91c0148330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:14.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.661+0000 7f91bffff700 1 --2- 172.21.15.3:0/2033228953 >> v2:172.21.15.50:3300/0 conn(0x7f91c014c6c0 0x7f91c0148870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:14.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.661+0000 7f91c500c700 1 -- 172.21.15.3:0/2033228953 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f91c00a1fd0 msgr2=0x7f91c0148330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:38:14.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.661+0000 7f91c500c700 1 --2- 172.21.15.3:0/2033228953 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f91c00a1fd0 0x7f91c0148330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:14.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.661+0000 7f91c500c700 1 -- 172.21.15.3:0/2033228953 >> v2:172.21.15.50:3300/0 conn(0x7f91c014c6c0 msgr2=0x7f91c0148870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:38:14.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.661+0000 7f91c500c700 1 --2- 172.21.15.3:0/2033228953 >> v2:172.21.15.50:3300/0 conn(0x7f91c014c6c0 0x7f91c0148870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:14.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.661+0000 7f91c500c700 1 -- 172.21.15.3:0/2033228953 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c014bec0 con 0x7f91c0148db0 2023-10-08T15:38:14.668 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.661+0000 7f91c500c700 1 --2- 172.21.15.3:0/2033228953 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f91c0148db0 0x7f91c00b1c30 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f91c00bcb70 tx=0x7f91b8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aef70f0f802209a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:14.668 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.661+0000 7f91bf7fe700 1 -- 172.21.15.3:0/2033228953 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b800e070 con 0x7f91c0148db0 2023-10-08T15:38:14.668 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.661+0000 7f91bf7fe700 1 -- 172.21.15.3:0/2033228953 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b800b970 con 0x7f91c0148db0 2023-10-08T15:38:14.668 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.661+0000 7f91bf7fe700 1 -- 172.21.15.3:0/2033228953 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b80092e0 con 0x7f91c0148db0 2023-10-08T15:38:14.669 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.661+0000 7f91c6a6f700 1 -- 172.21.15.3:0/2033228953 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f91c0148db0 msgr2=0x7f91c00b1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:14.669 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.661+0000 7f91c6a6f700 1 --2- 172.21.15.3:0/2033228953 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f91c0148db0 0x7f91c00b1c30 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f91c00bcb70 tx=0x7f91b8009840 comp rx=0 tx=0).stop 2023-10-08T15:38:14.669 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.661+0000 7f91c6a6f700 1 -- 172.21.15.3:0/2033228953 shutdown_connections 2023-10-08T15:38:14.669 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.661+0000 7f91c6a6f700 1 --2- 172.21.15.3:0/2033228953 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f91c0148db0 0x7f91c00b1c30 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:14.669 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.661+0000 7f91c6a6f700 1 --2- 172.21.15.3:0/2033228953 >> v2:172.21.15.50:3300/0 conn(0x7f91c014c6c0 0x7f91c0148870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:14.669 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.661+0000 7f91c6a6f700 1 --2- 172.21.15.3:0/2033228953 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f91c00a1fd0 0x7f91c0148330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:14.669 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.661+0000 7f91c6a6f700 1 -- 172.21.15.3:0/2033228953 >> 172.21.15.3:0/2033228953 conn(0x7f91c006b9b0 msgr2=0x7f91c00681f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:14.669 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.661+0000 7f91c6a6f700 1 -- 172.21.15.3:0/2033228953 shutdown_connections 2023-10-08T15:38:14.669 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.661+0000 7f91c6a6f700 1 -- 172.21.15.3:0/2033228953 wait complete. 2023-10-08T15:38:14.670 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.665+0000 7f91c6a6f700 1 Processor -- start 2023-10-08T15:38:14.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.665+0000 7f91c6a6f700 1 -- start start 2023-10-08T15:38:14.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.665+0000 7f91c6a6f700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f91c00a1fd0 0x7f91c0143160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:14.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.665+0000 7f91c6a6f700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f91c0148db0 0x7f91c015a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:14.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.665+0000 7f91c6a6f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91c014c6c0 0x7f91c014cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:14.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.665+0000 7f91c6a6f700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c014aa90 con 0x7f91c00a1fd0 2023-10-08T15:38:14.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.665+0000 7f91c6a6f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c0159b90 con 0x7f91c014c6c0 2023-10-08T15:38:14.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.665+0000 7f91c6a6f700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91c0159820 con 0x7f91c0148db0 2023-10-08T15:38:14.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.665+0000 7f91c480b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f91c00a1fd0 0x7f91c0143160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:14.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.665+0000 7f91c480b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f91c00a1fd0 0x7f91c0143160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:48196/0 (socket says 172.21.15.3:48196) 2023-10-08T15:38:14.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.665+0000 7f91bffff700 1 --2- 172.21.15.3:0/3375375819 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f91c0148db0 0x7f91c015a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:14.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.665+0000 7f91c480b700 1 -- 172.21.15.3:0/3375375819 learned_addr learned my addr 172.21.15.3:0/3375375819 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:38:14.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.665+0000 7f91c500c700 1 --2- 172.21.15.3:0/3375375819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91c014c6c0 0x7f91c014cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:14.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.665+0000 7f91c480b700 1 -- 172.21.15.3:0/3375375819 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f91c0148db0 msgr2=0x7f91c015a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:14.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.665+0000 7f91c480b700 1 --2- 172.21.15.3:0/3375375819 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f91c0148db0 0x7f91c015a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:14.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.665+0000 7f91c480b700 1 -- 172.21.15.3:0/3375375819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91c014c6c0 msgr2=0x7f91c014cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:14.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.665+0000 7f91c480b700 1 --2- 172.21.15.3:0/3375375819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91c014c6c0 0x7f91c014cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:14.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.665+0000 7f91c480b700 1 -- 172.21.15.3:0/3375375819 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b8009ae0 con 0x7f91c00a1fd0 2023-10-08T15:38:14.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.665+0000 7f91c480b700 1 --2- 172.21.15.3:0/3375375819 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f91c00a1fd0 0x7f91c0143160 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f91b000e950 tx=0x7f91b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:14.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.665+0000 7f91bcff9700 1 -- 172.21.15.3:0/3375375819 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b0013680 con 0x7f91c00a1fd0 2023-10-08T15:38:14.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.665+0000 7f91bcff9700 1 -- 172.21.15.3:0/3375375819 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b0013800 con 0x7f91c00a1fd0 2023-10-08T15:38:14.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.665+0000 7f91c6a6f700 1 -- 172.21.15.3:0/3375375819 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91c0159570 con 0x7f91c00a1fd0 2023-10-08T15:38:14.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.665+0000 7f91bcff9700 1 -- 172.21.15.3:0/3375375819 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b0013bc0 con 0x7f91c00a1fd0 2023-10-08T15:38:14.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.665+0000 7f91c6a6f700 1 -- 172.21.15.3:0/3375375819 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91c01437b0 con 0x7f91c00a1fd0 2023-10-08T15:38:14.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.669+0000 7f91c6a6f700 1 -- 172.21.15.3:0/3375375819 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91c0064530 con 0x7f91c00a1fd0 2023-10-08T15:38:14.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.669+0000 7f91bcff9700 1 -- 172.21.15.3:0/3375375819 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f91b00123d0 con 0x7f91c00a1fd0 2023-10-08T15:38:14.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.669+0000 7f91bcff9700 1 --2- 172.21.15.3:0/3375375819 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f91ac060550 0x7f91ac062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:14.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.669+0000 7f91bcff9700 1 -- 172.21.15.3:0/3375375819 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f91b007c7f0 con 0x7f91c00a1fd0 2023-10-08T15:38:14.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.669+0000 7f91bffff700 1 --2- 172.21.15.3:0/3375375819 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f91ac060550 0x7f91ac062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:14.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.669+0000 7f91bffff700 1 --2- 172.21.15.3:0/3375375819 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f91ac060550 0x7f91ac062a00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f91c00bbbd0 tx=0x7f91b40091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:14.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.677+0000 7f91bcff9700 1 -- 172.21.15.3:0/3375375819 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f91b004cde0 con 0x7f91c00a1fd0 2023-10-08T15:38:14.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.833+0000 7f91c6a6f700 1 -- 172.21.15.3:0/3375375819 --> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f91c0143940 con 0x7f91ac060550 2023-10-08T15:38:14.857 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.853+0000 7f91bcff9700 1 -- 172.21.15.3:0/3375375819 <== mgr.4102 v2:172.21.15.50:6832/33268 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264595 (secure 0 0 0) 0x7f91c0143940 con 0x7f91ac060550 2023-10-08T15:38:14.861 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:38:14.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.857+0000 7f91c6a6f700 1 -- 172.21.15.3:0/3375375819 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f91ac060550 msgr2=0x7f91ac062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:14.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.857+0000 7f91c6a6f700 1 --2- 172.21.15.3:0/3375375819 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f91ac060550 0x7f91ac062a00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f91c00bbbd0 tx=0x7f91b40091a0 comp rx=0 tx=0).stop 2023-10-08T15:38:14.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.857+0000 7f91c6a6f700 1 -- 172.21.15.3:0/3375375819 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f91c00a1fd0 msgr2=0x7f91c0143160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:14.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.857+0000 7f91c6a6f700 1 --2- 172.21.15.3:0/3375375819 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f91c00a1fd0 0x7f91c0143160 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f91b000e950 tx=0x7f91b00091a0 comp rx=0 tx=0).stop 2023-10-08T15:38:14.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.857+0000 7f91c6a6f700 1 -- 172.21.15.3:0/3375375819 shutdown_connections 2023-10-08T15:38:14.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.857+0000 7f91c6a6f700 1 --2- 172.21.15.3:0/3375375819 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f91ac060550 0x7f91ac062a00 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:14.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.857+0000 7f91c6a6f700 1 --2- 172.21.15.3:0/3375375819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91c014c6c0 0x7f91c014cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:14.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.857+0000 7f91c6a6f700 1 --2- 172.21.15.3:0/3375375819 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f91c0148db0 0x7f91c015a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:14.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.857+0000 7f91c6a6f700 1 --2- 172.21.15.3:0/3375375819 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f91c00a1fd0 0x7f91c0143160 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:14.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.857+0000 7f91c6a6f700 1 -- 172.21.15.3:0/3375375819 >> 172.21.15.3:0/3375375819 conn(0x7f91c006b9b0 msgr2=0x7f91c00bd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:14.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.857+0000 7f91c6a6f700 1 -- 172.21.15.3:0/3375375819 shutdown_connections 2023-10-08T15:38:14.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.857+0000 7f91c6a6f700 1 -- 172.21.15.3:0/3375375819 wait complete. 2023-10-08T15:38:14.865 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2023-10-08T15:38:14.877 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":51,"stamp":"2023-10-08T15:38:14.532559+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":121,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2401416,"kb_used_data":2632,"kb_used_omap":0,"kb_used_meta":2398720,"kb_avail":752573304,"statfs":{"total":773094113280,"available":770635063296,"internally_reserved":0,"allocated":2695168,"data_stored":2139765,"data_compressed":66282,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":2456289280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.033149"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.552715+0000","last_change":"2023-10-08T15:38:11.551929+0000","last_active":"2023-10-08T15:38:11.552715+0000","last_peered":"2023-10-08T15:38:11.552715+0000","last_clean":"2023-10-08T15:38:11.552715+0000","last_became_active":"2023-10-08T15:38:11.551626+0000","last_became_peered":"2023-10-08T15:38:11.551626+0000","last_unstale":"2023-10-08T15:38:11.552715+0000","last_undegraded":"2023-10-08T15:38:11.552715+0000","last_fullsized":"2023-10-08T15:38:11.552715+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:28:06.305177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.560765+0000","last_change":"2023-10-08T15:38:11.555661+0000","last_active":"2023-10-08T15:38:11.560765+0000","last_peered":"2023-10-08T15:38:11.560765+0000","last_clean":"2023-10-08T15:38:11.560765+0000","last_became_active":"2023-10-08T15:38:11.555379+0000","last_became_peered":"2023-10-08T15:38:11.555379+0000","last_unstale":"2023-10-08T15:38:11.560765+0000","last_undegraded":"2023-10-08T15:38:11.560765+0000","last_fullsized":"2023-10-08T15:38:11.560765+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:35:02.913467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":8,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.541983+0000","last_change":"2023-10-08T15:38:11.541983+0000","last_active":"2023-10-08T15:38:11.541983+0000","last_peered":"2023-10-08T15:38:11.541983+0000","last_clean":"2023-10-08T15:38:11.541983+0000","last_became_active":"2023-10-08T15:38:11.541676+0000","last_became_peered":"2023-10-08T15:38:11.541676+0000","last_unstale":"2023-10-08T15:38:11.541983+0000","last_undegraded":"2023-10-08T15:38:11.541983+0000","last_fullsized":"2023-10-08T15:38:11.541983+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:35:02.913467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.543753+0000","last_change":"2023-10-08T15:38:11.538622+0000","last_active":"2023-10-08T15:38:11.543753+0000","last_peered":"2023-10-08T15:38:11.543753+0000","last_clean":"2023-10-08T15:38:11.543753+0000","last_became_active":"2023-10-08T15:38:11.538104+0000","last_became_peered":"2023-10-08T15:38:11.538104+0000","last_unstale":"2023-10-08T15:38:11.543753+0000","last_undegraded":"2023-10-08T15:38:11.543753+0000","last_fullsized":"2023-10-08T15:38:11.543753+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:41:04.390338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.553752+0000","last_change":"2023-10-08T15:38:11.549393+0000","last_active":"2023-10-08T15:38:11.553752+0000","last_peered":"2023-10-08T15:38:11.553752+0000","last_clean":"2023-10-08T15:38:11.553752+0000","last_became_active":"2023-10-08T15:38:11.548742+0000","last_became_peered":"2023-10-08T15:38:11.548742+0000","last_unstale":"2023-10-08T15:38:11.553752+0000","last_undegraded":"2023-10-08T15:38:11.553752+0000","last_fullsized":"2023-10-08T15:38:11.553752+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:24:41.038073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.560452+0000","last_change":"2023-10-08T15:38:11.552648+0000","last_active":"2023-10-08T15:38:11.560452+0000","last_peered":"2023-10-08T15:38:11.560452+0000","last_clean":"2023-10-08T15:38:11.560452+0000","last_became_active":"2023-10-08T15:38:11.552305+0000","last_became_peered":"2023-10-08T15:38:11.552305+0000","last_unstale":"2023-10-08T15:38:11.560452+0000","last_undegraded":"2023-10-08T15:38:11.560452+0000","last_fullsized":"2023-10-08T15:38:11.560452+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:06:57.675095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.545958+0000","last_change":"2023-10-08T15:38:11.535259+0000","last_active":"2023-10-08T15:38:11.545958+0000","last_peered":"2023-10-08T15:38:11.545958+0000","last_clean":"2023-10-08T15:38:11.545958+0000","last_became_active":"2023-10-08T15:38:11.534914+0000","last_became_peered":"2023-10-08T15:38:11.534914+0000","last_unstale":"2023-10-08T15:38:11.545958+0000","last_undegraded":"2023-10-08T15:38:11.545958+0000","last_fullsized":"2023-10-08T15:38:11.545958+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:29:43.743351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.546151+0000","last_change":"2023-10-08T15:38:11.542394+0000","last_active":"2023-10-08T15:38:11.546151+0000","last_peered":"2023-10-08T15:38:11.546151+0000","last_clean":"2023-10-08T15:38:11.546151+0000","last_became_active":"2023-10-08T15:38:11.541143+0000","last_became_peered":"2023-10-08T15:38:11.541143+0000","last_unstale":"2023-10-08T15:38:11.546151+0000","last_undegraded":"2023-10-08T15:38:11.546151+0000","last_fullsized":"2023-10-08T15:38:11.546151+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:05:39.675534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":8,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.538825+0000","last_change":"2023-10-08T15:38:11.538825+0000","last_active":"2023-10-08T15:38:11.538825+0000","last_peered":"2023-10-08T15:38:11.538825+0000","last_clean":"2023-10-08T15:38:11.538825+0000","last_became_active":"2023-10-08T15:38:11.538048+0000","last_became_peered":"2023-10-08T15:38:11.538048+0000","last_unstale":"2023-10-08T15:38:11.538825+0000","last_undegraded":"2023-10-08T15:38:11.538825+0000","last_fullsized":"2023-10-08T15:38:11.538825+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:27:54.864087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.557993+0000","last_change":"2023-10-08T15:38:11.550275+0000","last_active":"2023-10-08T15:38:11.557993+0000","last_peered":"2023-10-08T15:38:11.557993+0000","last_clean":"2023-10-08T15:38:11.557993+0000","last_became_active":"2023-10-08T15:38:11.549947+0000","last_became_peered":"2023-10-08T15:38:11.549947+0000","last_unstale":"2023-10-08T15:38:11.557993+0000","last_undegraded":"2023-10-08T15:38:11.557993+0000","last_fullsized":"2023-10-08T15:38:11.557993+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:14:42.422485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.546127+0000","last_change":"2023-10-08T15:38:11.539624+0000","last_active":"2023-10-08T15:38:11.546127+0000","last_peered":"2023-10-08T15:38:11.546127+0000","last_clean":"2023-10-08T15:38:11.546127+0000","last_became_active":"2023-10-08T15:38:11.539320+0000","last_became_peered":"2023-10-08T15:38:11.539320+0000","last_unstale":"2023-10-08T15:38:11.546127+0000","last_undegraded":"2023-10-08T15:38:11.546127+0000","last_fullsized":"2023-10-08T15:38:11.546127+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:20:50.483394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":8,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.551057+0000","last_change":"2023-10-08T15:38:11.551057+0000","last_active":"2023-10-08T15:38:11.551057+0000","last_peered":"2023-10-08T15:38:11.551057+0000","last_clean":"2023-10-08T15:38:11.551057+0000","last_became_active":"2023-10-08T15:38:11.548609+0000","last_became_peered":"2023-10-08T15:38:11.548609+0000","last_unstale":"2023-10-08T15:38:11.551057+0000","last_undegraded":"2023-10-08T15:38:11.551057+0000","last_fullsized":"2023-10-08T15:38:11.551057+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:20:17.286315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.547803+0000","last_change":"2023-10-08T15:38:11.544985+0000","last_active":"2023-10-08T15:38:11.547803+0000","last_peered":"2023-10-08T15:38:11.547803+0000","last_clean":"2023-10-08T15:38:11.547803+0000","last_became_active":"2023-10-08T15:38:11.544644+0000","last_became_peered":"2023-10-08T15:38:11.544644+0000","last_unstale":"2023-10-08T15:38:11.547803+0000","last_undegraded":"2023-10-08T15:38:11.547803+0000","last_fullsized":"2023-10-08T15:38:11.547803+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:24:34.381212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.552499+0000","last_change":"2023-10-08T15:38:11.544314+0000","last_active":"2023-10-08T15:38:11.552499+0000","last_peered":"2023-10-08T15:38:11.552499+0000","last_clean":"2023-10-08T15:38:11.552499+0000","last_became_active":"2023-10-08T15:38:11.543977+0000","last_became_peered":"2023-10-08T15:38:11.543977+0000","last_unstale":"2023-10-08T15:38:11.552499+0000","last_undegraded":"2023-10-08T15:38:11.552499+0000","last_fullsized":"2023-10-08T15:38:11.552499+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:47:51.646205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":8,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.537162+0000","last_change":"2023-10-08T15:38:11.537162+0000","last_active":"2023-10-08T15:38:11.537162+0000","last_peered":"2023-10-08T15:38:11.537162+0000","last_clean":"2023-10-08T15:38:11.537162+0000","last_became_active":"2023-10-08T15:38:11.536890+0000","last_became_peered":"2023-10-08T15:38:11.536890+0000","last_unstale":"2023-10-08T15:38:11.537162+0000","last_undegraded":"2023-10-08T15:38:11.537162+0000","last_fullsized":"2023-10-08T15:38:11.537162+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:47:51.646205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.550454+0000","last_change":"2023-10-08T15:38:11.548587+0000","last_active":"2023-10-08T15:38:11.550454+0000","last_peered":"2023-10-08T15:38:11.550454+0000","last_clean":"2023-10-08T15:38:11.550454+0000","last_became_active":"2023-10-08T15:38:11.548109+0000","last_became_peered":"2023-10-08T15:38:11.548109+0000","last_unstale":"2023-10-08T15:38:11.550454+0000","last_undegraded":"2023-10-08T15:38:11.550454+0000","last_fullsized":"2023-10-08T15:38:11.550454+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:24:47.448475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.545932+0000","last_change":"2023-10-08T15:38:11.535874+0000","last_active":"2023-10-08T15:38:11.545932+0000","last_peered":"2023-10-08T15:38:11.545932+0000","last_clean":"2023-10-08T15:38:11.545932+0000","last_became_active":"2023-10-08T15:38:11.535580+0000","last_became_peered":"2023-10-08T15:38:11.535580+0000","last_unstale":"2023-10-08T15:38:11.545932+0000","last_undegraded":"2023-10-08T15:38:11.545932+0000","last_fullsized":"2023-10-08T15:38:11.545932+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:14:42.422485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.558379+0000","last_change":"2023-10-08T15:38:11.547822+0000","last_active":"2023-10-08T15:38:11.558379+0000","last_peered":"2023-10-08T15:38:11.558379+0000","last_clean":"2023-10-08T15:38:11.558379+0000","last_became_active":"2023-10-08T15:38:11.545286+0000","last_became_peered":"2023-10-08T15:38:11.545286+0000","last_unstale":"2023-10-08T15:38:11.558379+0000","last_undegraded":"2023-10-08T15:38:11.558379+0000","last_fullsized":"2023-10-08T15:38:11.558379+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:01:30.789238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.547200+0000","last_change":"2023-10-08T15:38:11.540328+0000","last_active":"2023-10-08T15:38:11.547200+0000","last_peered":"2023-10-08T15:38:11.547200+0000","last_clean":"2023-10-08T15:38:11.547200+0000","last_became_active":"2023-10-08T15:38:11.539707+0000","last_became_peered":"2023-10-08T15:38:11.539707+0000","last_unstale":"2023-10-08T15:38:11.547200+0000","last_undegraded":"2023-10-08T15:38:11.547200+0000","last_fullsized":"2023-10-08T15:38:11.547200+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:54:49.800738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.552555+0000","last_change":"2023-10-08T15:38:11.547442+0000","last_active":"2023-10-08T15:38:11.552555+0000","last_peered":"2023-10-08T15:38:11.552555+0000","last_clean":"2023-10-08T15:38:11.552555+0000","last_became_active":"2023-10-08T15:38:11.547098+0000","last_became_peered":"2023-10-08T15:38:11.547098+0000","last_unstale":"2023-10-08T15:38:11.552555+0000","last_undegraded":"2023-10-08T15:38:11.552555+0000","last_fullsized":"2023-10-08T15:38:11.552555+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:53:34.775023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":8,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.549670+0000","last_change":"2023-10-08T15:38:11.549670+0000","last_active":"2023-10-08T15:38:11.549670+0000","last_peered":"2023-10-08T15:38:11.549670+0000","last_clean":"2023-10-08T15:38:11.549670+0000","last_became_active":"2023-10-08T15:38:11.549347+0000","last_became_peered":"2023-10-08T15:38:11.549347+0000","last_unstale":"2023-10-08T15:38:11.549670+0000","last_undegraded":"2023-10-08T15:38:11.549670+0000","last_fullsized":"2023-10-08T15:38:11.549670+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:37:31.689970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":8,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.546762+0000","last_change":"2023-10-08T15:38:11.546762+0000","last_active":"2023-10-08T15:38:11.546762+0000","last_peered":"2023-10-08T15:38:11.546762+0000","last_clean":"2023-10-08T15:38:11.546762+0000","last_became_active":"2023-10-08T15:38:11.546479+0000","last_became_peered":"2023-10-08T15:38:11.546479+0000","last_unstale":"2023-10-08T15:38:11.546762+0000","last_undegraded":"2023-10-08T15:38:11.546762+0000","last_fullsized":"2023-10-08T15:38:11.546762+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:55:41.844097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.548591+0000","last_change":"2023-10-08T15:38:11.543360+0000","last_active":"2023-10-08T15:38:11.548591+0000","last_peered":"2023-10-08T15:38:11.548591+0000","last_clean":"2023-10-08T15:38:11.548591+0000","last_became_active":"2023-10-08T15:38:11.543034+0000","last_became_peered":"2023-10-08T15:38:11.543034+0000","last_unstale":"2023-10-08T15:38:11.548591+0000","last_undegraded":"2023-10-08T15:38:11.548591+0000","last_fullsized":"2023-10-08T15:38:11.548591+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:43:48.200362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":8,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.541554+0000","last_change":"2023-10-08T15:38:11.541554+0000","last_active":"2023-10-08T15:38:11.541554+0000","last_peered":"2023-10-08T15:38:11.541554+0000","last_clean":"2023-10-08T15:38:11.541554+0000","last_became_active":"2023-10-08T15:38:11.541198+0000","last_became_peered":"2023-10-08T15:38:11.541198+0000","last_unstale":"2023-10-08T15:38:11.541554+0000","last_undegraded":"2023-10-08T15:38:11.541554+0000","last_fullsized":"2023-10-08T15:38:11.541554+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:53:06.078185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.535038+0000","last_change":"2023-10-08T15:38:11.526034+0000","last_active":"2023-10-08T15:38:11.535038+0000","last_peered":"2023-10-08T15:38:11.535038+0000","last_clean":"2023-10-08T15:38:11.535038+0000","last_became_active":"2023-10-08T15:38:11.525550+0000","last_became_peered":"2023-10-08T15:38:11.525550+0000","last_unstale":"2023-10-08T15:38:11.535038+0000","last_undegraded":"2023-10-08T15:38:11.535038+0000","last_fullsized":"2023-10-08T15:38:11.535038+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:14:58.375418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.558550+0000","last_change":"2023-10-08T15:38:11.548293+0000","last_active":"2023-10-08T15:38:11.558550+0000","last_peered":"2023-10-08T15:38:11.558550+0000","last_clean":"2023-10-08T15:38:11.558550+0000","last_became_active":"2023-10-08T15:38:11.547565+0000","last_became_peered":"2023-10-08T15:38:11.547565+0000","last_unstale":"2023-10-08T15:38:11.558550+0000","last_undegraded":"2023-10-08T15:38:11.558550+0000","last_fullsized":"2023-10-08T15:38:11.558550+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:14:30.680408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.536292+0000","last_change":"2023-10-08T15:38:11.528397+0000","last_active":"2023-10-08T15:38:11.536292+0000","last_peered":"2023-10-08T15:38:11.536292+0000","last_clean":"2023-10-08T15:38:11.536292+0000","last_became_active":"2023-10-08T15:38:11.527702+0000","last_became_peered":"2023-10-08T15:38:11.527702+0000","last_unstale":"2023-10-08T15:38:11.536292+0000","last_undegraded":"2023-10-08T15:38:11.536292+0000","last_fullsized":"2023-10-08T15:38:11.536292+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:08:42.600407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":8,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.547209+0000","last_change":"2023-10-08T15:38:11.547209+0000","last_active":"2023-10-08T15:38:11.547209+0000","last_peered":"2023-10-08T15:38:11.547209+0000","last_clean":"2023-10-08T15:38:11.547209+0000","last_became_active":"2023-10-08T15:38:11.546921+0000","last_became_peered":"2023-10-08T15:38:11.546921+0000","last_unstale":"2023-10-08T15:38:11.547209+0000","last_undegraded":"2023-10-08T15:38:11.547209+0000","last_fullsized":"2023-10-08T15:38:11.547209+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:31.263101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":8,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.546847+0000","last_change":"2023-10-08T15:38:11.546847+0000","last_active":"2023-10-08T15:38:11.546847+0000","last_peered":"2023-10-08T15:38:11.546847+0000","last_clean":"2023-10-08T15:38:11.546847+0000","last_became_active":"2023-10-08T15:38:11.546539+0000","last_became_peered":"2023-10-08T15:38:11.546539+0000","last_unstale":"2023-10-08T15:38:11.546847+0000","last_undegraded":"2023-10-08T15:38:11.546847+0000","last_fullsized":"2023-10-08T15:38:11.546847+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:22:36.402547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.545780+0000","last_change":"2023-10-08T15:38:11.533931+0000","last_active":"2023-10-08T15:38:11.545780+0000","last_peered":"2023-10-08T15:38:11.545780+0000","last_clean":"2023-10-08T15:38:11.545780+0000","last_became_active":"2023-10-08T15:38:11.533589+0000","last_became_peered":"2023-10-08T15:38:11.533589+0000","last_unstale":"2023-10-08T15:38:11.545780+0000","last_undegraded":"2023-10-08T15:38:11.545780+0000","last_fullsized":"2023-10-08T15:38:11.545780+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:32:25.134171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.545290+0000","last_change":"2023-10-08T15:38:11.540688+0000","last_active":"2023-10-08T15:38:11.545290+0000","last_peered":"2023-10-08T15:38:11.545290+0000","last_clean":"2023-10-08T15:38:11.545290+0000","last_became_active":"2023-10-08T15:38:11.540353+0000","last_became_peered":"2023-10-08T15:38:11.540353+0000","last_unstale":"2023-10-08T15:38:11.545290+0000","last_undegraded":"2023-10-08T15:38:11.545290+0000","last_fullsized":"2023-10-08T15:38:11.545290+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:26:06.452541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.546074+0000","last_change":"2023-10-08T15:38:11.536986+0000","last_active":"2023-10-08T15:38:11.546074+0000","last_peered":"2023-10-08T15:38:11.546074+0000","last_clean":"2023-10-08T15:38:11.546074+0000","last_became_active":"2023-10-08T15:38:11.536700+0000","last_became_peered":"2023-10-08T15:38:11.536700+0000","last_unstale":"2023-10-08T15:38:11.546074+0000","last_undegraded":"2023-10-08T15:38:11.546074+0000","last_fullsized":"2023-10-08T15:38:11.546074+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:10:17.237308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.548559+0000","last_change":"2023-10-08T15:38:11.543417+0000","last_active":"2023-10-08T15:38:11.548559+0000","last_peered":"2023-10-08T15:38:11.548559+0000","last_clean":"2023-10-08T15:38:11.548559+0000","last_became_active":"2023-10-08T15:38:11.543093+0000","last_became_peered":"2023-10-08T15:38:11.543093+0000","last_unstale":"2023-10-08T15:38:11.548559+0000","last_undegraded":"2023-10-08T15:38:11.548559+0000","last_fullsized":"2023-10-08T15:38:11.548559+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:18:16.003163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"28'4","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.555011+0000","last_change":"2023-10-08T15:38:10.539507+0000","last_active":"2023-10-08T15:38:11.555011+0000","last_peered":"2023-10-08T15:38:11.555011+0000","last_clean":"2023-10-08T15:38:11.555011+0000","last_became_active":"2023-10-08T15:38:10.539224+0000","last_became_peered":"2023-10-08T15:38:10.539224+0000","last_unstale":"2023-10-08T15:38:11.555011+0000","last_undegraded":"2023-10-08T15:38:11.555011+0000","last_fullsized":"2023-10-08T15:38:11.555011+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:24:40.027383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.545668+0000","last_change":"2023-10-08T15:38:11.539715+0000","last_active":"2023-10-08T15:38:11.545668+0000","last_peered":"2023-10-08T15:38:11.545668+0000","last_clean":"2023-10-08T15:38:11.545668+0000","last_became_active":"2023-10-08T15:38:11.539328+0000","last_became_peered":"2023-10-08T15:38:11.539328+0000","last_unstale":"2023-10-08T15:38:11.545668+0000","last_undegraded":"2023-10-08T15:38:11.545668+0000","last_fullsized":"2023-10-08T15:38:11.545668+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:01:32.838102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"28'1","reported_seq":11,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.548286+0000","last_change":"2023-10-08T15:38:10.531957+0000","last_active":"2023-10-08T15:38:11.548286+0000","last_peered":"2023-10-08T15:38:11.548286+0000","last_clean":"2023-10-08T15:38:11.548286+0000","last_became_active":"2023-10-08T15:38:10.531683+0000","last_became_peered":"2023-10-08T15:38:10.531683+0000","last_unstale":"2023-10-08T15:38:11.548286+0000","last_undegraded":"2023-10-08T15:38:11.548286+0000","last_fullsized":"2023-10-08T15:38:11.548286+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:43:36.372702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":8,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.541112+0000","last_change":"2023-10-08T15:38:11.541112+0000","last_active":"2023-10-08T15:38:11.541112+0000","last_peered":"2023-10-08T15:38:11.541112+0000","last_clean":"2023-10-08T15:38:11.541112+0000","last_became_active":"2023-10-08T15:38:11.540832+0000","last_became_peered":"2023-10-08T15:38:11.540832+0000","last_unstale":"2023-10-08T15:38:11.541112+0000","last_undegraded":"2023-10-08T15:38:11.541112+0000","last_fullsized":"2023-10-08T15:38:11.541112+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:04:21.108244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"28'2","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.560408+0000","last_change":"2023-10-08T15:38:10.535960+0000","last_active":"2023-10-08T15:38:11.560408+0000","last_peered":"2023-10-08T15:38:11.560408+0000","last_clean":"2023-10-08T15:38:11.560408+0000","last_became_active":"2023-10-08T15:38:10.535423+0000","last_became_peered":"2023-10-08T15:38:10.535423+0000","last_unstale":"2023-10-08T15:38:11.560408+0000","last_undegraded":"2023-10-08T15:38:11.560408+0000","last_fullsized":"2023-10-08T15:38:11.560408+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:43:47.189672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.536320+0000","last_change":"2023-10-08T15:38:11.530538+0000","last_active":"2023-10-08T15:38:11.536320+0000","last_peered":"2023-10-08T15:38:11.536320+0000","last_clean":"2023-10-08T15:38:11.536320+0000","last_became_active":"2023-10-08T15:38:11.528096+0000","last_became_peered":"2023-10-08T15:38:11.528096+0000","last_unstale":"2023-10-08T15:38:11.536320+0000","last_undegraded":"2023-10-08T15:38:11.536320+0000","last_fullsized":"2023-10-08T15:38:11.536320+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:44:04.222289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"28'2","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.551660+0000","last_change":"2023-10-08T15:38:10.534444+0000","last_active":"2023-10-08T15:38:11.551660+0000","last_peered":"2023-10-08T15:38:11.551660+0000","last_clean":"2023-10-08T15:38:11.551660+0000","last_became_active":"2023-10-08T15:38:10.534163+0000","last_became_peered":"2023-10-08T15:38:10.534163+0000","last_unstale":"2023-10-08T15:38:11.551660+0000","last_undegraded":"2023-10-08T15:38:11.551660+0000","last_fullsized":"2023-10-08T15:38:11.551660+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:36:51.015310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.546092+0000","last_change":"2023-10-08T15:38:11.537914+0000","last_active":"2023-10-08T15:38:11.546092+0000","last_peered":"2023-10-08T15:38:11.546092+0000","last_clean":"2023-10-08T15:38:11.546092+0000","last_became_active":"2023-10-08T15:38:11.537635+0000","last_became_peered":"2023-10-08T15:38:11.537635+0000","last_unstale":"2023-10-08T15:38:11.546092+0000","last_undegraded":"2023-10-08T15:38:11.546092+0000","last_fullsized":"2023-10-08T15:38:11.546092+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:11:11.332133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"28'1","reported_seq":10,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.536124+0000","last_change":"2023-10-08T15:38:10.541183+0000","last_active":"2023-10-08T15:38:11.536124+0000","last_peered":"2023-10-08T15:38:11.536124+0000","last_clean":"2023-10-08T15:38:11.536124+0000","last_became_active":"2023-10-08T15:38:10.540889+0000","last_became_peered":"2023-10-08T15:38:10.540889+0000","last_unstale":"2023-10-08T15:38:11.536124+0000","last_undegraded":"2023-10-08T15:38:11.536124+0000","last_fullsized":"2023-10-08T15:38:11.536124+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:25:09.595675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":8,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.551248+0000","last_change":"2023-10-08T15:38:11.551248+0000","last_active":"2023-10-08T15:38:11.551248+0000","last_peered":"2023-10-08T15:38:11.551248+0000","last_clean":"2023-10-08T15:38:11.551248+0000","last_became_active":"2023-10-08T15:38:11.550849+0000","last_became_peered":"2023-10-08T15:38:11.550849+0000","last_unstale":"2023-10-08T15:38:11.551248+0000","last_undegraded":"2023-10-08T15:38:11.551248+0000","last_fullsized":"2023-10-08T15:38:11.551248+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:14:23.429299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"28'1","reported_seq":10,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.536819+0000","last_change":"2023-10-08T15:38:10.536235+0000","last_active":"2023-10-08T15:38:11.536819+0000","last_peered":"2023-10-08T15:38:11.536819+0000","last_clean":"2023-10-08T15:38:11.536819+0000","last_became_active":"2023-10-08T15:38:10.535850+0000","last_became_peered":"2023-10-08T15:38:10.535850+0000","last_unstale":"2023-10-08T15:38:11.536819+0000","last_undegraded":"2023-10-08T15:38:11.536819+0000","last_fullsized":"2023-10-08T15:38:11.536819+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:58:48.971033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":8,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.538178+0000","last_change":"2023-10-08T15:38:11.538178+0000","last_active":"2023-10-08T15:38:11.538178+0000","last_peered":"2023-10-08T15:38:11.538178+0000","last_clean":"2023-10-08T15:38:11.538178+0000","last_became_active":"2023-10-08T15:38:11.537310+0000","last_became_peered":"2023-10-08T15:38:11.537310+0000","last_unstale":"2023-10-08T15:38:11.538178+0000","last_undegraded":"2023-10-08T15:38:11.538178+0000","last_fullsized":"2023-10-08T15:38:11.538178+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:30:25.816349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.539715+0000","last_change":"2023-10-08T15:38:10.538692+0000","last_active":"2023-10-08T15:38:11.539715+0000","last_peered":"2023-10-08T15:38:11.539715+0000","last_clean":"2023-10-08T15:38:11.539715+0000","last_became_active":"2023-10-08T15:38:10.538408+0000","last_became_peered":"2023-10-08T15:38:10.538408+0000","last_unstale":"2023-10-08T15:38:11.539715+0000","last_undegraded":"2023-10-08T15:38:11.539715+0000","last_fullsized":"2023-10-08T15:38:11.539715+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:18:14.992473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.546116+0000","last_change":"2023-10-08T15:38:11.541883+0000","last_active":"2023-10-08T15:38:11.546116+0000","last_peered":"2023-10-08T15:38:11.546116+0000","last_clean":"2023-10-08T15:38:11.546116+0000","last_became_active":"2023-10-08T15:38:11.541493+0000","last_became_peered":"2023-10-08T15:38:11.541493+0000","last_unstale":"2023-10-08T15:38:11.546116+0000","last_undegraded":"2023-10-08T15:38:11.546116+0000","last_fullsized":"2023-10-08T15:38:11.546116+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:20:50.483394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T15:38:10.540694+0000","last_change":"2023-10-08T15:38:10.531729+0000","last_active":"2023-10-08T15:38:10.540694+0000","last_peered":"2023-10-08T15:38:10.540694+0000","last_clean":"2023-10-08T15:38:10.540694+0000","last_became_active":"2023-10-08T15:38:10.531314+0000","last_became_peered":"2023-10-08T15:38:10.531314+0000","last_unstale":"2023-10-08T15:38:10.540694+0000","last_undegraded":"2023-10-08T15:38:10.540694+0000","last_fullsized":"2023-10-08T15:38:10.540694+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:06:58.289758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":8,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.551628+0000","last_change":"2023-10-08T15:38:11.551628+0000","last_active":"2023-10-08T15:38:11.551628+0000","last_peered":"2023-10-08T15:38:11.551628+0000","last_clean":"2023-10-08T15:38:11.551628+0000","last_became_active":"2023-10-08T15:38:11.551240+0000","last_became_peered":"2023-10-08T15:38:11.551240+0000","last_unstale":"2023-10-08T15:38:11.551628+0000","last_undegraded":"2023-10-08T15:38:11.551628+0000","last_fullsized":"2023-10-08T15:38:11.551628+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:02:56.125680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.539972+0000","last_change":"2023-10-08T15:38:10.536636+0000","last_active":"2023-10-08T15:38:11.539972+0000","last_peered":"2023-10-08T15:38:11.539972+0000","last_clean":"2023-10-08T15:38:11.539972+0000","last_became_active":"2023-10-08T15:38:10.536160+0000","last_became_peered":"2023-10-08T15:38:10.536160+0000","last_unstale":"2023-10-08T15:38:11.539972+0000","last_undegraded":"2023-10-08T15:38:11.539972+0000","last_fullsized":"2023-10-08T15:38:11.539972+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:22:47.675835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.552138+0000","last_change":"2023-10-08T15:38:11.544599+0000","last_active":"2023-10-08T15:38:11.552138+0000","last_peered":"2023-10-08T15:38:11.552138+0000","last_clean":"2023-10-08T15:38:11.552138+0000","last_became_active":"2023-10-08T15:38:11.543236+0000","last_became_peered":"2023-10-08T15:38:11.543236+0000","last_unstale":"2023-10-08T15:38:11.552138+0000","last_undegraded":"2023-10-08T15:38:11.552138+0000","last_fullsized":"2023-10-08T15:38:11.552138+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:57:26.443783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.526800+0000","last_change":"2023-10-08T15:38:10.535279+0000","last_active":"2023-10-08T15:38:11.526800+0000","last_peered":"2023-10-08T15:38:11.526800+0000","last_clean":"2023-10-08T15:38:11.526800+0000","last_became_active":"2023-10-08T15:38:10.534912+0000","last_became_peered":"2023-10-08T15:38:10.534912+0000","last_unstale":"2023-10-08T15:38:11.526800+0000","last_undegraded":"2023-10-08T15:38:11.526800+0000","last_fullsized":"2023-10-08T15:38:11.526800+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:57:56.374096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.556532+0000","last_change":"2023-10-08T15:38:11.544249+0000","last_active":"2023-10-08T15:38:11.556532+0000","last_peered":"2023-10-08T15:38:11.556532+0000","last_clean":"2023-10-08T15:38:11.556532+0000","last_became_active":"2023-10-08T15:38:11.543922+0000","last_became_peered":"2023-10-08T15:38:11.543922+0000","last_unstale":"2023-10-08T15:38:11.556532+0000","last_undegraded":"2023-10-08T15:38:11.556532+0000","last_fullsized":"2023-10-08T15:38:11.556532+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:20:17.286315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"28'3","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.555394+0000","last_change":"2023-10-08T15:38:10.539699+0000","last_active":"2023-10-08T15:38:11.555394+0000","last_peered":"2023-10-08T15:38:11.555394+0000","last_clean":"2023-10-08T15:38:11.555394+0000","last_became_active":"2023-10-08T15:38:10.539392+0000","last_became_peered":"2023-10-08T15:38:10.539392+0000","last_unstale":"2023-10-08T15:38:11.555394+0000","last_undegraded":"2023-10-08T15:38:11.555394+0000","last_fullsized":"2023-10-08T15:38:11.555394+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:43:47.189672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":8,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.547448+0000","last_change":"2023-10-08T15:38:11.547448+0000","last_active":"2023-10-08T15:38:11.547448+0000","last_peered":"2023-10-08T15:38:11.547448+0000","last_clean":"2023-10-08T15:38:11.547448+0000","last_became_active":"2023-10-08T15:38:11.546789+0000","last_became_peered":"2023-10-08T15:38:11.546789+0000","last_unstale":"2023-10-08T15:38:11.547448+0000","last_undegraded":"2023-10-08T15:38:11.547448+0000","last_fullsized":"2023-10-08T15:38:11.547448+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:01:30.789238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"28'6","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.563413+0000","last_change":"2023-10-08T15:38:10.543529+0000","last_active":"2023-10-08T15:38:11.563413+0000","last_peered":"2023-10-08T15:38:11.563413+0000","last_clean":"2023-10-08T15:38:11.563413+0000","last_became_active":"2023-10-08T15:38:10.543213+0000","last_became_peered":"2023-10-08T15:38:10.543213+0000","last_unstale":"2023-10-08T15:38:11.563413+0000","last_undegraded":"2023-10-08T15:38:11.563413+0000","last_fullsized":"2023-10-08T15:38:11.563413+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:35:35.546466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.535843+0000","last_change":"2023-10-08T15:38:11.533684+0000","last_active":"2023-10-08T15:38:11.535843+0000","last_peered":"2023-10-08T15:38:11.535843+0000","last_clean":"2023-10-08T15:38:11.535843+0000","last_became_active":"2023-10-08T15:38:11.533353+0000","last_became_peered":"2023-10-08T15:38:11.533353+0000","last_unstale":"2023-10-08T15:38:11.535843+0000","last_undegraded":"2023-10-08T15:38:11.535843+0000","last_fullsized":"2023-10-08T15:38:11.535843+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:05:59.830989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"28'2","reported_seq":11,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.553411+0000","last_change":"2023-10-08T15:38:10.537601+0000","last_active":"2023-10-08T15:38:11.553411+0000","last_peered":"2023-10-08T15:38:11.553411+0000","last_clean":"2023-10-08T15:38:11.553411+0000","last_became_active":"2023-10-08T15:38:10.537285+0000","last_became_peered":"2023-10-08T15:38:10.537285+0000","last_unstale":"2023-10-08T15:38:11.553411+0000","last_undegraded":"2023-10-08T15:38:11.553411+0000","last_fullsized":"2023-10-08T15:38:11.553411+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:55.510039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.560551+0000","last_change":"2023-10-08T15:38:11.553142+0000","last_active":"2023-10-08T15:38:11.560551+0000","last_peered":"2023-10-08T15:38:11.560551+0000","last_clean":"2023-10-08T15:38:11.560551+0000","last_became_active":"2023-10-08T15:38:11.552823+0000","last_became_peered":"2023-10-08T15:38:11.552823+0000","last_unstale":"2023-10-08T15:38:11.560551+0000","last_undegraded":"2023-10-08T15:38:11.560551+0000","last_fullsized":"2023-10-08T15:38:11.560551+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:31.263101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.518805+0000","last_change":"2023-10-08T15:38:10.530681+0000","last_active":"2023-10-08T15:38:11.518805+0000","last_peered":"2023-10-08T15:38:11.518805+0000","last_clean":"2023-10-08T15:38:11.518805+0000","last_became_active":"2023-10-08T15:38:10.530403+0000","last_became_peered":"2023-10-08T15:38:10.530403+0000","last_unstale":"2023-10-08T15:38:11.518805+0000","last_undegraded":"2023-10-08T15:38:11.518805+0000","last_fullsized":"2023-10-08T15:38:11.518805+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:43:43.685388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.546043+0000","last_change":"2023-10-08T15:38:11.536951+0000","last_active":"2023-10-08T15:38:11.546043+0000","last_peered":"2023-10-08T15:38:11.546043+0000","last_clean":"2023-10-08T15:38:11.546043+0000","last_became_active":"2023-10-08T15:38:11.536665+0000","last_became_peered":"2023-10-08T15:38:11.536665+0000","last_unstale":"2023-10-08T15:38:11.546043+0000","last_undegraded":"2023-10-08T15:38:11.546043+0000","last_fullsized":"2023-10-08T15:38:11.546043+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:50:15.398066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.539827+0000","last_change":"2023-10-08T15:38:10.538063+0000","last_active":"2023-10-08T15:38:11.539827+0000","last_peered":"2023-10-08T15:38:11.539827+0000","last_clean":"2023-10-08T15:38:11.539827+0000","last_became_active":"2023-10-08T15:38:10.536269+0000","last_became_peered":"2023-10-08T15:38:10.536269+0000","last_unstale":"2023-10-08T15:38:11.539827+0000","last_undegraded":"2023-10-08T15:38:11.539827+0000","last_fullsized":"2023-10-08T15:38:11.539827+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:52:06.685198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.544946+0000","last_change":"2023-10-08T15:38:11.538850+0000","last_active":"2023-10-08T15:38:11.544946+0000","last_peered":"2023-10-08T15:38:11.544946+0000","last_clean":"2023-10-08T15:38:11.544946+0000","last_became_active":"2023-10-08T15:38:11.538541+0000","last_became_peered":"2023-10-08T15:38:11.538541+0000","last_unstale":"2023-10-08T15:38:11.544946+0000","last_undegraded":"2023-10-08T15:38:11.544946+0000","last_fullsized":"2023-10-08T15:38:11.544946+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:17:57.269174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"28'8","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.560847+0000","last_change":"2023-10-08T15:38:10.536547+0000","last_active":"2023-10-08T15:38:11.560847+0000","last_peered":"2023-10-08T15:38:11.560847+0000","last_clean":"2023-10-08T15:38:11.560847+0000","last_became_active":"2023-10-08T15:38:10.536100+0000","last_became_peered":"2023-10-08T15:38:10.536100+0000","last_unstale":"2023-10-08T15:38:11.560847+0000","last_undegraded":"2023-10-08T15:38:11.560847+0000","last_fullsized":"2023-10-08T15:38:11.560847+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:50:22.245343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":8,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.539013+0000","last_change":"2023-10-08T15:38:11.539013+0000","last_active":"2023-10-08T15:38:11.539013+0000","last_peered":"2023-10-08T15:38:11.539013+0000","last_clean":"2023-10-08T15:38:11.539013+0000","last_became_active":"2023-10-08T15:38:11.537226+0000","last_became_peered":"2023-10-08T15:38:11.537226+0000","last_unstale":"2023-10-08T15:38:11.539013+0000","last_undegraded":"2023-10-08T15:38:11.539013+0000","last_fullsized":"2023-10-08T15:38:11.539013+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:51:25.205440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"28'1","reported_seq":11,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.559030+0000","last_change":"2023-10-08T15:38:10.535007+0000","last_active":"2023-10-08T15:38:11.559030+0000","last_peered":"2023-10-08T15:38:11.559030+0000","last_clean":"2023-10-08T15:38:11.559030+0000","last_became_active":"2023-10-08T15:38:10.534703+0000","last_became_peered":"2023-10-08T15:38:10.534703+0000","last_unstale":"2023-10-08T15:38:11.559030+0000","last_undegraded":"2023-10-08T15:38:11.559030+0000","last_fullsized":"2023-10-08T15:38:11.559030+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:10:43.137228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":8,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.552242+0000","last_change":"2023-10-08T15:38:11.552242+0000","last_active":"2023-10-08T15:38:11.552242+0000","last_peered":"2023-10-08T15:38:11.552242+0000","last_clean":"2023-10-08T15:38:11.552242+0000","last_became_active":"2023-10-08T15:38:11.551833+0000","last_became_peered":"2023-10-08T15:38:11.551833+0000","last_unstale":"2023-10-08T15:38:11.552242+0000","last_undegraded":"2023-10-08T15:38:11.552242+0000","last_fullsized":"2023-10-08T15:38:11.552242+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:54:49.800738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"28'2","reported_seq":11,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.553158+0000","last_change":"2023-10-08T15:38:10.530873+0000","last_active":"2023-10-08T15:38:11.553158+0000","last_peered":"2023-10-08T15:38:11.553158+0000","last_clean":"2023-10-08T15:38:11.553158+0000","last_became_active":"2023-10-08T15:38:10.530526+0000","last_became_peered":"2023-10-08T15:38:10.530526+0000","last_unstale":"2023-10-08T15:38:11.553158+0000","last_undegraded":"2023-10-08T15:38:11.553158+0000","last_fullsized":"2023-10-08T15:38:11.553158+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:43:36.372702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.543730+0000","last_change":"2023-10-08T15:38:11.538422+0000","last_active":"2023-10-08T15:38:11.543730+0000","last_peered":"2023-10-08T15:38:11.543730+0000","last_clean":"2023-10-08T15:38:11.543730+0000","last_became_active":"2023-10-08T15:38:11.537728+0000","last_became_peered":"2023-10-08T15:38:11.537728+0000","last_unstale":"2023-10-08T15:38:11.543730+0000","last_undegraded":"2023-10-08T15:38:11.543730+0000","last_fullsized":"2023-10-08T15:38:11.543730+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:44:35.400079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"28'1","reported_seq":10,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.536989+0000","last_change":"2023-10-08T15:38:10.540951+0000","last_active":"2023-10-08T15:38:11.536989+0000","last_peered":"2023-10-08T15:38:11.536989+0000","last_clean":"2023-10-08T15:38:11.536989+0000","last_became_active":"2023-10-08T15:38:10.540284+0000","last_became_peered":"2023-10-08T15:38:10.540284+0000","last_unstale":"2023-10-08T15:38:11.536989+0000","last_undegraded":"2023-10-08T15:38:11.536989+0000","last_fullsized":"2023-10-08T15:38:11.536989+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:18:27.645667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.552379+0000","last_change":"2023-10-08T15:38:11.546548+0000","last_active":"2023-10-08T15:38:11.552379+0000","last_peered":"2023-10-08T15:38:11.552379+0000","last_clean":"2023-10-08T15:38:11.552379+0000","last_became_active":"2023-10-08T15:38:11.546275+0000","last_became_peered":"2023-10-08T15:38:11.546275+0000","last_unstale":"2023-10-08T15:38:11.552379+0000","last_undegraded":"2023-10-08T15:38:11.552379+0000","last_fullsized":"2023-10-08T15:38:11.552379+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:01:54.409897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T15:38:10.541678+0000","last_change":"2023-10-08T15:38:10.537529+0000","last_active":"2023-10-08T15:38:10.541678+0000","last_peered":"2023-10-08T15:38:10.541678+0000","last_clean":"2023-10-08T15:38:10.541678+0000","last_became_active":"2023-10-08T15:38:10.537194+0000","last_became_peered":"2023-10-08T15:38:10.537194+0000","last_unstale":"2023-10-08T15:38:10.541678+0000","last_undegraded":"2023-10-08T15:38:10.541678+0000","last_fullsized":"2023-10-08T15:38:10.541678+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:57:56.374096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.553575+0000","last_change":"2023-10-08T15:38:11.551574+0000","last_active":"2023-10-08T15:38:11.553575+0000","last_peered":"2023-10-08T15:38:11.553575+0000","last_clean":"2023-10-08T15:38:11.553575+0000","last_became_active":"2023-10-08T15:38:11.550140+0000","last_became_peered":"2023-10-08T15:38:11.550140+0000","last_unstale":"2023-10-08T15:38:11.553575+0000","last_undegraded":"2023-10-08T15:38:11.553575+0000","last_fullsized":"2023-10-08T15:38:11.553575+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:33:14.202638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"28'2","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.549763+0000","last_change":"2023-10-08T15:38:10.532551+0000","last_active":"2023-10-08T15:38:11.549763+0000","last_peered":"2023-10-08T15:38:11.549763+0000","last_clean":"2023-10-08T15:38:11.549763+0000","last_became_active":"2023-10-08T15:38:10.531766+0000","last_became_peered":"2023-10-08T15:38:10.531766+0000","last_unstale":"2023-10-08T15:38:11.549763+0000","last_undegraded":"2023-10-08T15:38:11.549763+0000","last_fullsized":"2023-10-08T15:38:11.549763+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:18:27.645667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.553773+0000","last_change":"2023-10-08T15:38:11.549603+0000","last_active":"2023-10-08T15:38:11.553773+0000","last_peered":"2023-10-08T15:38:11.553773+0000","last_clean":"2023-10-08T15:38:11.553773+0000","last_became_active":"2023-10-08T15:38:11.549111+0000","last_became_peered":"2023-10-08T15:38:11.549111+0000","last_unstale":"2023-10-08T15:38:11.553773+0000","last_undegraded":"2023-10-08T15:38:11.553773+0000","last_fullsized":"2023-10-08T15:38:11.553773+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:21:04.871668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.532081+0000","last_change":"2023-10-08T15:38:10.535856+0000","last_active":"2023-10-08T15:38:11.532081+0000","last_peered":"2023-10-08T15:38:11.532081+0000","last_clean":"2023-10-08T15:38:11.532081+0000","last_became_active":"2023-10-08T15:38:10.535549+0000","last_became_peered":"2023-10-08T15:38:10.535549+0000","last_unstale":"2023-10-08T15:38:11.532081+0000","last_undegraded":"2023-10-08T15:38:11.532081+0000","last_fullsized":"2023-10-08T15:38:11.532081+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:24:33.370522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.554233+0000","last_change":"2023-10-08T15:38:11.552392+0000","last_active":"2023-10-08T15:38:11.554233+0000","last_peered":"2023-10-08T15:38:11.554233+0000","last_clean":"2023-10-08T15:38:11.554233+0000","last_became_active":"2023-10-08T15:38:11.551224+0000","last_became_peered":"2023-10-08T15:38:11.551224+0000","last_unstale":"2023-10-08T15:38:11.554233+0000","last_undegraded":"2023-10-08T15:38:11.554233+0000","last_fullsized":"2023-10-08T15:38:11.554233+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:55:53.209220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T15:38:10.541596+0000","last_change":"2023-10-08T15:38:10.535089+0000","last_active":"2023-10-08T15:38:10.541596+0000","last_peered":"2023-10-08T15:38:10.541596+0000","last_clean":"2023-10-08T15:38:10.541596+0000","last_became_active":"2023-10-08T15:38:10.534785+0000","last_became_peered":"2023-10-08T15:38:10.534785+0000","last_unstale":"2023-10-08T15:38:10.541596+0000","last_undegraded":"2023-10-08T15:38:10.541596+0000","last_fullsized":"2023-10-08T15:38:10.541596+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:47:44.284423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.545974+0000","last_change":"2023-10-08T15:38:11.535651+0000","last_active":"2023-10-08T15:38:11.545974+0000","last_peered":"2023-10-08T15:38:11.545974+0000","last_clean":"2023-10-08T15:38:11.545974+0000","last_became_active":"2023-10-08T15:38:11.535309+0000","last_became_peered":"2023-10-08T15:38:11.535309+0000","last_unstale":"2023-10-08T15:38:11.545974+0000","last_undegraded":"2023-10-08T15:38:11.545974+0000","last_fullsized":"2023-10-08T15:38:11.545974+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:03:44.857547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T15:38:10.542706+0000","last_change":"2023-10-08T15:38:10.539680+0000","last_active":"2023-10-08T15:38:10.542706+0000","last_peered":"2023-10-08T15:38:10.542706+0000","last_clean":"2023-10-08T15:38:10.542706+0000","last_became_active":"2023-10-08T15:38:10.539435+0000","last_became_peered":"2023-10-08T15:38:10.539435+0000","last_unstale":"2023-10-08T15:38:10.542706+0000","last_undegraded":"2023-10-08T15:38:10.542706+0000","last_fullsized":"2023-10-08T15:38:10.542706+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:35:35.546466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.552410+0000","last_change":"2023-10-08T15:38:11.547443+0000","last_active":"2023-10-08T15:38:11.552410+0000","last_peered":"2023-10-08T15:38:11.552410+0000","last_clean":"2023-10-08T15:38:11.552410+0000","last_became_active":"2023-10-08T15:38:11.547152+0000","last_became_peered":"2023-10-08T15:38:11.547152+0000","last_unstale":"2023-10-08T15:38:11.552410+0000","last_undegraded":"2023-10-08T15:38:11.552410+0000","last_fullsized":"2023-10-08T15:38:11.552410+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:16:02.600651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"28'2","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.553932+0000","last_change":"2023-10-08T15:38:10.540906+0000","last_active":"2023-10-08T15:38:11.553932+0000","last_peered":"2023-10-08T15:38:11.553932+0000","last_clean":"2023-10-08T15:38:11.553932+0000","last_became_active":"2023-10-08T15:38:10.540592+0000","last_became_peered":"2023-10-08T15:38:10.540592+0000","last_unstale":"2023-10-08T15:38:11.553932+0000","last_undegraded":"2023-10-08T15:38:11.553932+0000","last_fullsized":"2023-10-08T15:38:11.553932+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:30:33.763988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":8,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.541941+0000","last_change":"2023-10-08T15:38:11.541941+0000","last_active":"2023-10-08T15:38:11.541941+0000","last_peered":"2023-10-08T15:38:11.541941+0000","last_clean":"2023-10-08T15:38:11.541941+0000","last_became_active":"2023-10-08T15:38:11.541614+0000","last_became_peered":"2023-10-08T15:38:11.541614+0000","last_unstale":"2023-10-08T15:38:11.541941+0000","last_undegraded":"2023-10-08T15:38:11.541941+0000","last_fullsized":"2023-10-08T15:38:11.541941+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:14:30.680408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.526675+0000","last_change":"2023-10-08T15:38:10.533677+0000","last_active":"2023-10-08T15:38:11.526675+0000","last_peered":"2023-10-08T15:38:11.526675+0000","last_clean":"2023-10-08T15:38:11.526675+0000","last_became_active":"2023-10-08T15:38:10.533329+0000","last_became_peered":"2023-10-08T15:38:10.533329+0000","last_unstale":"2023-10-08T15:38:11.526675+0000","last_undegraded":"2023-10-08T15:38:11.526675+0000","last_fullsized":"2023-10-08T15:38:11.526675+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:47:44.284423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.553741+0000","last_change":"2023-10-08T15:38:11.548197+0000","last_active":"2023-10-08T15:38:11.553741+0000","last_peered":"2023-10-08T15:38:11.553741+0000","last_clean":"2023-10-08T15:38:11.553741+0000","last_became_active":"2023-10-08T15:38:11.547848+0000","last_became_peered":"2023-10-08T15:38:11.547848+0000","last_unstale":"2023-10-08T15:38:11.553741+0000","last_undegraded":"2023-10-08T15:38:11.553741+0000","last_fullsized":"2023-10-08T15:38:11.553741+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:50:23.256033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.520513+0000","last_change":"2023-10-08T15:38:10.538873+0000","last_active":"2023-10-08T15:38:11.520513+0000","last_peered":"2023-10-08T15:38:11.520513+0000","last_clean":"2023-10-08T15:38:11.520513+0000","last_became_active":"2023-10-08T15:38:10.538496+0000","last_became_peered":"2023-10-08T15:38:10.538496+0000","last_unstale":"2023-10-08T15:38:11.520513+0000","last_undegraded":"2023-10-08T15:38:11.520513+0000","last_fullsized":"2023-10-08T15:38:11.520513+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:21:41.554925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.551119+0000","last_change":"2023-10-08T15:38:11.549349+0000","last_active":"2023-10-08T15:38:11.551119+0000","last_peered":"2023-10-08T15:38:11.551119+0000","last_clean":"2023-10-08T15:38:11.551119+0000","last_became_active":"2023-10-08T15:38:11.548967+0000","last_became_peered":"2023-10-08T15:38:11.548967+0000","last_unstale":"2023-10-08T15:38:11.551119+0000","last_undegraded":"2023-10-08T15:38:11.551119+0000","last_fullsized":"2023-10-08T15:38:11.551119+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:33:11.590371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.531866+0000","last_change":"2023-10-08T15:38:10.532759+0000","last_active":"2023-10-08T15:38:11.531866+0000","last_peered":"2023-10-08T15:38:11.531866+0000","last_clean":"2023-10-08T15:38:11.531866+0000","last_became_active":"2023-10-08T15:38:10.532232+0000","last_became_peered":"2023-10-08T15:38:10.532232+0000","last_unstale":"2023-10-08T15:38:11.531866+0000","last_undegraded":"2023-10-08T15:38:11.531866+0000","last_fullsized":"2023-10-08T15:38:11.531866+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:25:09.595675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.550729+0000","last_change":"2023-10-08T15:38:11.547521+0000","last_active":"2023-10-08T15:38:11.550729+0000","last_peered":"2023-10-08T15:38:11.550729+0000","last_clean":"2023-10-08T15:38:11.550729+0000","last_became_active":"2023-10-08T15:38:11.547132+0000","last_became_peered":"2023-10-08T15:38:11.547132+0000","last_unstale":"2023-10-08T15:38:11.550729+0000","last_undegraded":"2023-10-08T15:38:11.550729+0000","last_fullsized":"2023-10-08T15:38:11.550729+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:35:36.557155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.519076+0000","last_change":"2023-10-08T15:38:10.538182+0000","last_active":"2023-10-08T15:38:11.519076+0000","last_peered":"2023-10-08T15:38:11.519076+0000","last_clean":"2023-10-08T15:38:11.519076+0000","last_became_active":"2023-10-08T15:38:10.535564+0000","last_became_peered":"2023-10-08T15:38:10.535564+0000","last_unstale":"2023-10-08T15:38:11.519076+0000","last_undegraded":"2023-10-08T15:38:11.519076+0000","last_fullsized":"2023-10-08T15:38:11.519076+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:53:33.764334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.554711+0000","last_change":"2023-10-08T15:38:11.544150+0000","last_active":"2023-10-08T15:38:11.554711+0000","last_peered":"2023-10-08T15:38:11.554711+0000","last_clean":"2023-10-08T15:38:11.554711+0000","last_became_active":"2023-10-08T15:38:11.543815+0000","last_became_peered":"2023-10-08T15:38:11.543815+0000","last_unstale":"2023-10-08T15:38:11.554711+0000","last_undegraded":"2023-10-08T15:38:11.554711+0000","last_fullsized":"2023-10-08T15:38:11.554711+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:35:07.959560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T15:38:10.541664+0000","last_change":"2023-10-08T15:38:10.536736+0000","last_active":"2023-10-08T15:38:10.541664+0000","last_peered":"2023-10-08T15:38:10.541664+0000","last_clean":"2023-10-08T15:38:10.541664+0000","last_became_active":"2023-10-08T15:38:10.536370+0000","last_became_peered":"2023-10-08T15:38:10.536370+0000","last_unstale":"2023-10-08T15:38:10.541664+0000","last_undegraded":"2023-10-08T15:38:10.541664+0000","last_fullsized":"2023-10-08T15:38:10.541664+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:05:43.846755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":8,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.545670+0000","last_change":"2023-10-08T15:38:11.545670+0000","last_active":"2023-10-08T15:38:11.545670+0000","last_peered":"2023-10-08T15:38:11.545670+0000","last_clean":"2023-10-08T15:38:11.545670+0000","last_became_active":"2023-10-08T15:38:11.545441+0000","last_became_peered":"2023-10-08T15:38:11.545441+0000","last_unstale":"2023-10-08T15:38:11.545670+0000","last_undegraded":"2023-10-08T15:38:11.545670+0000","last_fullsized":"2023-10-08T15:38:11.545670+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:18:16.003163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.540192+0000","last_change":"2023-10-08T15:38:10.536973+0000","last_active":"2023-10-08T15:38:11.540192+0000","last_peered":"2023-10-08T15:38:11.540192+0000","last_clean":"2023-10-08T15:38:11.540192+0000","last_became_active":"2023-10-08T15:38:10.536644+0000","last_became_peered":"2023-10-08T15:38:10.536644+0000","last_unstale":"2023-10-08T15:38:11.540192+0000","last_undegraded":"2023-10-08T15:38:11.540192+0000","last_fullsized":"2023-10-08T15:38:11.540192+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:27:47.321224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.545830+0000","last_change":"2023-10-08T15:38:11.534465+0000","last_active":"2023-10-08T15:38:11.545830+0000","last_peered":"2023-10-08T15:38:11.545830+0000","last_clean":"2023-10-08T15:38:11.545830+0000","last_became_active":"2023-10-08T15:38:11.534185+0000","last_became_peered":"2023-10-08T15:38:11.534185+0000","last_unstale":"2023-10-08T15:38:11.545830+0000","last_undegraded":"2023-10-08T15:38:11.545830+0000","last_fullsized":"2023-10-08T15:38:11.545830+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:10.497535+0000","last_clean_scrub_stamp":"2023-10-08T15:38:10.497535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:05:59.830989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.531920+0000","last_change":"2023-10-08T15:38:10.538925+0000","last_active":"2023-10-08T15:38:11.531920+0000","last_peered":"2023-10-08T15:38:11.531920+0000","last_clean":"2023-10-08T15:38:11.531920+0000","last_became_active":"2023-10-08T15:38:10.538618+0000","last_became_peered":"2023-10-08T15:38:10.538618+0000","last_unstale":"2023-10-08T15:38:11.531920+0000","last_undegraded":"2023-10-08T15:38:11.531920+0000","last_fullsized":"2023-10-08T15:38:11.531920+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:38:09.486845+0000","last_clean_scrub_stamp":"2023-10-08T15:38:09.486845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:16:01.589961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":172,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T15:38:11.528164+0000","last_change":"2023-10-08T15:37:19.380955+0000","last_active":"2023-10-08T15:38:11.528164+0000","last_peered":"2023-10-08T15:38:11.528164+0000","last_clean":"2023-10-08T15:38:11.528164+0000","last_became_active":"2023-10-08T15:37:19.378277+0000","last_became_peered":"2023-10-08T15:37:19.378277+0000","last_unstale":"2023-10-08T15:38:11.528164+0000","last_undegraded":"2023-10-08T15:38:11.528164+0000","last_fullsized":"2023-10-08T15:38:11.528164+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:17.537726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:17.537726+0000","last_clean_scrub_stamp":"2023-10-08T15:37:17.537726+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:06:26.612046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66282,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542157,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301764,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070076,"statfs":{"total":96636764160,"available":96327757824,"internally_reserved":0,"allocated":389120,"data_stored":713044,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.161}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.409}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5680000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542158,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301704,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070136,"statfs":{"total":96636764160,"available":96327819264,"internally_reserved":0,"allocated":327680,"data_stored":123174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0940000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.069}]}]},{"osd":3,"up_from":14,"seq":60129542159,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297616,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074224,"statfs":{"total":96636764160,"available":96332005376,"internally_reserved":0,"allocated":335872,"data_stored":124144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2230000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542158,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":122656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.087}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1419999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542159,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":117856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0840000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]}]},{"osd":0,"up_from":14,"seq":60129542159,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301760,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070080,"statfs":{"total":96636764160,"available":96327761920,"internally_reserved":0,"allocated":385024,"data_stored":712954,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1839999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.22}]}]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301672,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070168,"statfs":{"total":96636764160,"available":96327852032,"internally_reserved":0,"allocated":294912,"data_stored":109535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.292}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0840000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.145}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301692,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070148,"statfs":{"total":96636764160,"available":96327831552,"internally_reserved":0,"allocated":315392,"data_stored":116402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2210000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.335}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.288}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0740000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T15:38:14.882 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-08T15:38:14.882 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-08T15:38:15.002 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.997+0000 7f27f759e700 1 Processor -- start 2023-10-08T15:38:15.002 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.997+0000 7f27f759e700 1 -- start start 2023-10-08T15:38:15.003 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.997+0000 7f27f759e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f27f80a1200 0x7f27f806d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:15.004 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.997+0000 7f27f759e700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27f814bed0 con 0x7f27f814b6d0 2023-10-08T15:38:15.004 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.997+0000 7f27f759e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27f814c170 con 0x7f27f8069920 2023-10-08T15:38:15.004 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.997+0000 7f27f759e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f80694d0 con 0x7f27f80a1200 2023-10-08T15:38:15.004 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.997+0000 7f27f659c700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f27f814b6d0 0x7f27f8068d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:35328/0 (socket says 172.21.15.3:35328) 2023-10-08T15:38:15.004 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.997+0000 7f27f659c700 1 -- 172.21.15.3:0/557971539 learned_addr learned my addr 172.21.15.3:0/557971539 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:38:15.004 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.997+0000 7f27f6d9d700 1 --2- 172.21.15.3:0/557971539 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f27f80a1200 0x7f27f806d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:15.006 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.997+0000 7f27f559a700 1 -- 172.21.15.3:0/557971539 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1562750512 0 0) 0x7f27f814bed0 con 0x7f27f814b6d0 2023-10-08T15:38:15.006 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.997+0000 7f27f559a700 1 -- 172.21.15.3:0/557971539 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27e0003570 con 0x7f27f814b6d0 2023-10-08T15:38:15.006 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.997+0000 7f27f559a700 1 -- 172.21.15.3:0/557971539 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2238052232 0 0) 0x7f27f814c170 con 0x7f27f8069920 2023-10-08T15:38:15.007 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.997+0000 7f27f6d9d700 1 -- 172.21.15.3:0/557971539 >> v1:172.21.15.50:6789/0 conn(0x7f27f8069920 legacy=0x7f27f806c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:15.007 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.997+0000 7f27f6d9d700 1 -- 172.21.15.3:0/557971539 >> v1:172.21.15.3:6789/0 conn(0x7f27f814b6d0 legacy=0x7f27f8068d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:15.007 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.997+0000 7f27f6d9d700 1 -- 172.21.15.3:0/557971539 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f814baa0 con 0x7f27f80a1200 2023-10-08T15:38:15.007 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.997+0000 7f27f6d9d700 1 --2- 172.21.15.3:0/557971539 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f27f80a1200 0x7f27f806d0a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f27f0009e90 tx=0x7f27f0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a26d4a46e0c0eb7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:15.007 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.997+0000 7f27f559a700 1 -- 172.21.15.3:0/557971539 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f000e070 con 0x7f27f80a1200 2023-10-08T15:38:15.007 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.997+0000 7f27f559a700 1 -- 172.21.15.3:0/557971539 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f000bc30 con 0x7f27f80a1200 2023-10-08T15:38:15.007 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:14.997+0000 7f27f559a700 1 -- 172.21.15.3:0/557971539 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f0012430 con 0x7f27f80a1200 2023-10-08T15:38:15.007 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.001+0000 7f27f759e700 1 -- 172.21.15.3:0/557971539 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f27f80a1200 msgr2=0x7f27f806d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:15.008 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.001+0000 7f27f759e700 1 --2- 172.21.15.3:0/557971539 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f27f80a1200 0x7f27f806d0a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f27f0009e90 tx=0x7f27f0009780 comp rx=0 tx=0).stop 2023-10-08T15:38:15.008 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.001+0000 7f27f759e700 1 -- 172.21.15.3:0/557971539 shutdown_connections 2023-10-08T15:38:15.008 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.001+0000 7f27f759e700 1 --2- 172.21.15.3:0/557971539 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f27f80a1200 0x7f27f806d0a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:15.008 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.001+0000 7f27f759e700 1 -- 172.21.15.3:0/557971539 >> 172.21.15.3:0/557971539 conn(0x7f27f80a18a0 msgr2=0x7f27f80a1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:15.008 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.001+0000 7f27f759e700 1 -- 172.21.15.3:0/557971539 shutdown_connections 2023-10-08T15:38:15.008 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.001+0000 7f27f759e700 1 -- 172.21.15.3:0/557971539 wait complete. 2023-10-08T15:38:15.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.001+0000 7f27f759e700 1 Processor -- start 2023-10-08T15:38:15.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.001+0000 7f27f759e700 1 -- start start 2023-10-08T15:38:15.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.005+0000 7f27f759e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27f8069920 0x7f27f80a7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:15.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.005+0000 7f27f759e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f27f80a1200 0x7f27f809a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:15.013 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.005+0000 7f27f759e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f27f814b6d0 0x7f27f80a5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:15.013 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.005+0000 7f27f759e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f809b400 con 0x7f27f814b6d0 2023-10-08T15:38:15.013 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.005+0000 7f27f759e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f809b120 con 0x7f27f8069920 2023-10-08T15:38:15.013 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.005+0000 7f27f759e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f809acb0 con 0x7f27f80a1200 2023-10-08T15:38:15.013 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.005+0000 7f27f6d9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f27f814b6d0 0x7f27f80a5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:15.013 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.005+0000 7f27f659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27f8069920 0x7f27f80a7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:15.013 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.005+0000 7f27f6d9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f27f814b6d0 0x7f27f80a5740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:48204/0 (socket says 172.21.15.3:48204) 2023-10-08T15:38:15.013 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.005+0000 7f27f6d9d700 1 -- 172.21.15.3:0/2557745396 learned_addr learned my addr 172.21.15.3:0/2557745396 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:38:15.014 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.005+0000 7f27f5d9b700 1 --2- 172.21.15.3:0/2557745396 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f27f80a1200 0x7f27f809a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:15.014 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.005+0000 7f27f6d9d700 1 -- 172.21.15.3:0/2557745396 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f27f80a1200 msgr2=0x7f27f809a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:15.014 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.005+0000 7f27f6d9d700 1 --2- 172.21.15.3:0/2557745396 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f27f80a1200 0x7f27f809a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:15.014 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.005+0000 7f27f6d9d700 1 -- 172.21.15.3:0/2557745396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27f8069920 msgr2=0x7f27f80a7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:15.014 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.005+0000 7f27f6d9d700 1 --2- 172.21.15.3:0/2557745396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27f8069920 0x7f27f80a7c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:15.014 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.005+0000 7f27f6d9d700 1 -- 172.21.15.3:0/2557745396 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f0009a20 con 0x7f27f814b6d0 2023-10-08T15:38:15.014 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.005+0000 7f27f659c700 1 --2- 172.21.15.3:0/2557745396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27f8069920 0x7f27f80a7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:38:15.014 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.005+0000 7f27f6d9d700 1 --2- 172.21.15.3:0/2557745396 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f27f814b6d0 0x7f27f80a5740 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f27f0013000 tx=0x7f27f0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:15.015 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.005+0000 7f27e67fc700 1 -- 172.21.15.3:0/2557745396 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f001b420 con 0x7f27f814b6d0 2023-10-08T15:38:15.015 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.005+0000 7f27e67fc700 1 -- 172.21.15.3:0/2557745396 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f001b5a0 con 0x7f27f814b6d0 2023-10-08T15:38:15.015 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.005+0000 7f27f759e700 1 -- 172.21.15.3:0/2557745396 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27f809aed0 con 0x7f27f814b6d0 2023-10-08T15:38:15.015 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.005+0000 7f27e67fc700 1 -- 172.21.15.3:0/2557745396 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f001b960 con 0x7f27f814b6d0 2023-10-08T15:38:15.015 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.005+0000 7f27f759e700 1 -- 172.21.15.3:0/2557745396 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27f8146cd0 con 0x7f27f814b6d0 2023-10-08T15:38:15.015 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.005+0000 7f27f759e700 1 -- 172.21.15.3:0/2557745396 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27f80a7950 con 0x7f27f814b6d0 2023-10-08T15:38:15.016 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.009+0000 7f27e67fc700 1 -- 172.21.15.3:0/2557745396 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f27f001bd50 con 0x7f27f814b6d0 2023-10-08T15:38:15.016 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.009+0000 7f27e67fc700 1 --2- 172.21.15.3:0/2557745396 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f27d8060600 0x7f27d8062ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:15.016 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.009+0000 7f27e67fc700 1 -- 172.21.15.3:0/2557745396 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f27f007e720 con 0x7f27f814b6d0 2023-10-08T15:38:15.016 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.009+0000 7f27f659c700 1 --2- 172.21.15.3:0/2557745396 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f27d8060600 0x7f27d8062ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:15.016 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.009+0000 7f27f659c700 1 --2- 172.21.15.3:0/2557745396 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f27d8060600 0x7f27d8062ab0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f27e8007fd0 tx=0x7f27e8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:15.023 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.017+0000 7f27e67fc700 1 -- 172.21.15.3:0/2557745396 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f27f004ecf0 con 0x7f27f814b6d0 2023-10-08T15:38:15.241 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.237+0000 7f27f759e700 1 -- 172.21.15.3:0/2557745396 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f27f80a7950 con 0x7f27f814b6d0 2023-10-08T15:38:15.248 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.241+0000 7f27e67fc700 1 -- 172.21.15.3:0/2557745396 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+0 (secure 0 0 0) 0x7f27f80a7950 con 0x7f27f814b6d0 2023-10-08T15:38:15.250 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.245+0000 7f27f759e700 1 -- 172.21.15.3:0/2557745396 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f27d8060600 msgr2=0x7f27d8062ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:15.250 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.245+0000 7f27f759e700 1 --2- 172.21.15.3:0/2557745396 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f27d8060600 0x7f27d8062ab0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f27e8007fd0 tx=0x7f27e8009040 comp rx=0 tx=0).stop 2023-10-08T15:38:15.250 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.245+0000 7f27f759e700 1 -- 172.21.15.3:0/2557745396 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f27f814b6d0 msgr2=0x7f27f80a5740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:15.251 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.245+0000 7f27f759e700 1 --2- 172.21.15.3:0/2557745396 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f27f814b6d0 0x7f27f80a5740 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f27f0013000 tx=0x7f27f0019000 comp rx=0 tx=0).stop 2023-10-08T15:38:15.251 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.245+0000 7f27f759e700 1 -- 172.21.15.3:0/2557745396 shutdown_connections 2023-10-08T15:38:15.251 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.245+0000 7f27f759e700 1 --2- 172.21.15.3:0/2557745396 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f27d8060600 0x7f27d8062ab0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:15.251 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.245+0000 7f27f759e700 1 --2- 172.21.15.3:0/2557745396 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f27f814b6d0 0x7f27f80a5740 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:15.251 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.245+0000 7f27f759e700 1 --2- 172.21.15.3:0/2557745396 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f27f80a1200 0x7f27f809a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:15.251 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.245+0000 7f27f759e700 1 --2- 172.21.15.3:0/2557745396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27f8069920 0x7f27f80a7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:15.251 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.245+0000 7f27f759e700 1 -- 172.21.15.3:0/2557745396 >> 172.21.15.3:0/2557745396 conn(0x7f27f80a18a0 msgr2=0x7f27f8068c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:15.251 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.245+0000 7f27f759e700 1 -- 172.21.15.3:0/2557745396 shutdown_connections 2023-10-08T15:38:15.251 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.245+0000 7f27f759e700 1 -- 172.21.15.3:0/2557745396 wait complete. 2023-10-08T15:38:15.252 INFO:teuthology.orchestra.run.smithi003.stderr:updated caps for client.0 2023-10-08T15:38:15.263 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:38:15.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.365+0000 7eff7bfff700 1 Processor -- start 2023-10-08T15:38:15.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.365+0000 7eff7bfff700 1 -- start start 2023-10-08T15:38:15.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.365+0000 7eff7bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7eff7c14ac50 0x7eff7c14b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:15.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.365+0000 7eff7bfff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7eff7c06be60 0x7eff7c06c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:15.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.365+0000 7eff7bfff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff7c14c6b0 con 0x7eff7c06ca70 2023-10-08T15:38:15.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.365+0000 7eff7bfff700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff7c14dc50 con 0x7eff7c06be60 2023-10-08T15:38:15.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.365+0000 7eff7bfff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff7c14c060 con 0x7eff7c14ac50 2023-10-08T15:38:15.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.365+0000 7eff7a7fc700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7eff7c06be60 0x7eff7c06c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:15.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.365+0000 7eff7a7fc700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7eff7c06be60 0x7eff7c06c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:48218/0 (socket says 172.21.15.3:48218) 2023-10-08T15:38:15.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.365+0000 7eff7a7fc700 1 -- 172.21.15.3:0/3719593282 learned_addr learned my addr 172.21.15.3:0/3719593282 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:38:15.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.365+0000 7eff7affd700 1 --2- 172.21.15.3:0/3719593282 >> v2:172.21.15.50:3300/0 conn(0x7eff7c14ac50 0x7eff7c14b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:15.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.365+0000 7eff7a7fc700 1 -- 172.21.15.3:0/3719593282 >> v2:172.21.15.50:3300/0 conn(0x7eff7c14ac50 msgr2=0x7eff7c14b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:38:15.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.365+0000 7eff7a7fc700 1 --2- 172.21.15.3:0/3719593282 >> v2:172.21.15.50:3300/0 conn(0x7eff7c14ac50 0x7eff7c14b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:15.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.365+0000 7eff7a7fc700 1 -- 172.21.15.3:0/3719593282 >> v1:172.21.15.50:6789/0 conn(0x7eff7c06ca70 legacy=0x7eff7c14eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:38:15.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.365+0000 7eff7a7fc700 1 -- 172.21.15.3:0/3719593282 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff7c14c340 con 0x7eff7c06be60 2023-10-08T15:38:15.375 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.365+0000 7eff7affd700 1 --2- 172.21.15.3:0/3719593282 >> v2:172.21.15.50:3300/0 conn(0x7eff7c14ac50 0x7eff7c14b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:38:15.375 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.365+0000 7eff7a7fc700 1 --2- 172.21.15.3:0/3719593282 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7eff7c06be60 0x7eff7c06c530 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7eff7c069ed0 tx=0x7eff6c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3cdb24fbbb84758 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:15.375 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.369+0000 7eff79ffb700 1 -- 172.21.15.3:0/3719593282 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff6c00b820 con 0x7eff7c06be60 2023-10-08T15:38:15.375 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.369+0000 7eff79ffb700 1 -- 172.21.15.3:0/3719593282 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff6c00b980 con 0x7eff7c06be60 2023-10-08T15:38:15.375 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.369+0000 7eff79ffb700 1 -- 172.21.15.3:0/3719593282 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff6c00bd20 con 0x7eff7c06be60 2023-10-08T15:38:15.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.369+0000 7eff7bfff700 1 -- 172.21.15.3:0/3719593282 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7eff7c06be60 msgr2=0x7eff7c06c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:15.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.369+0000 7eff7bfff700 1 --2- 172.21.15.3:0/3719593282 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7eff7c06be60 0x7eff7c06c530 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7eff7c069ed0 tx=0x7eff6c009250 comp rx=0 tx=0).stop 2023-10-08T15:38:15.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.369+0000 7eff7bfff700 1 -- 172.21.15.3:0/3719593282 shutdown_connections 2023-10-08T15:38:15.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.369+0000 7eff7bfff700 1 --2- 172.21.15.3:0/3719593282 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7eff7c06be60 0x7eff7c06c530 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:15.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.369+0000 7eff7bfff700 1 --2- 172.21.15.3:0/3719593282 >> v2:172.21.15.50:3300/0 conn(0x7eff7c14ac50 0x7eff7c14b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:15.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.369+0000 7eff7bfff700 1 -- 172.21.15.3:0/3719593282 >> 172.21.15.3:0/3719593282 conn(0x7eff7c0c1df0 msgr2=0x7eff7c0c21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:15.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.369+0000 7eff7bfff700 1 -- 172.21.15.3:0/3719593282 shutdown_connections 2023-10-08T15:38:15.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.369+0000 7eff7bfff700 1 -- 172.21.15.3:0/3719593282 wait complete. 2023-10-08T15:38:15.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.369+0000 7eff7bfff700 1 Processor -- start 2023-10-08T15:38:15.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.369+0000 7eff7bfff700 1 -- start start 2023-10-08T15:38:15.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.369+0000 7eff7bfff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7eff7c06be60 0x7eff7c0a07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:15.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.369+0000 7eff7bfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7eff7c06ca70 0x7eff7c148750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:15.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.369+0000 7eff7bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff7c14ac50 0x7eff7c09d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:15.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.369+0000 7eff7bfff700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff7c0a1c40 con 0x7eff7c06ca70 2023-10-08T15:38:15.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.369+0000 7eff7bfff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff7c09d2a0 con 0x7eff7c14ac50 2023-10-08T15:38:15.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.369+0000 7eff7bfff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff7c148c90 con 0x7eff7c06be60 2023-10-08T15:38:15.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.373+0000 7eff7a7fc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7eff7c06ca70 0x7eff7c148750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:15.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.373+0000 7eff7a7fc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7eff7c06ca70 0x7eff7c148750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:48226/0 (socket says 172.21.15.3:48226) 2023-10-08T15:38:15.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.373+0000 7eff7a7fc700 1 -- 172.21.15.3:0/2127842404 learned_addr learned my addr 172.21.15.3:0/2127842404 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:38:15.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.373+0000 7eff7b7fe700 1 --2- 172.21.15.3:0/2127842404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff7c14ac50 0x7eff7c09d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:15.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.373+0000 7eff7a7fc700 1 -- 172.21.15.3:0/2127842404 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7eff7c06be60 msgr2=0x7eff7c0a07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:15.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.373+0000 7eff7affd700 1 --2- 172.21.15.3:0/2127842404 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7eff7c06be60 0x7eff7c0a07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:15.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.373+0000 7eff7a7fc700 1 --2- 172.21.15.3:0/2127842404 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7eff7c06be60 0x7eff7c0a07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:15.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.373+0000 7eff7a7fc700 1 -- 172.21.15.3:0/2127842404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff7c14ac50 msgr2=0x7eff7c09d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:15.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.373+0000 7eff7a7fc700 1 --2- 172.21.15.3:0/2127842404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff7c14ac50 0x7eff7c09d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:15.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.373+0000 7eff7a7fc700 1 -- 172.21.15.3:0/2127842404 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff6c0094f0 con 0x7eff7c06ca70 2023-10-08T15:38:15.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.373+0000 7eff7affd700 1 --2- 172.21.15.3:0/2127842404 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7eff7c06be60 0x7eff7c0a07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:38:15.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.373+0000 7eff7a7fc700 1 --2- 172.21.15.3:0/2127842404 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7eff7c06ca70 0x7eff7c148750 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7eff7c070be0 tx=0x7eff6c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:15.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.373+0000 7eff62ffd700 1 -- 172.21.15.3:0/2127842404 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff6c011de0 con 0x7eff7c06ca70 2023-10-08T15:38:15.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.373+0000 7eff62ffd700 1 -- 172.21.15.3:0/2127842404 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff6c020070 con 0x7eff7c06ca70 2023-10-08T15:38:15.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.373+0000 7eff7bfff700 1 -- 172.21.15.3:0/2127842404 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff7c09f3a0 con 0x7eff7c06ca70 2023-10-08T15:38:15.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.373+0000 7eff62ffd700 1 -- 172.21.15.3:0/2127842404 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff6c01b6a0 con 0x7eff7c06ca70 2023-10-08T15:38:15.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.373+0000 7eff7bfff700 1 -- 172.21.15.3:0/2127842404 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff7c0a10e0 con 0x7eff7c06ca70 2023-10-08T15:38:15.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.373+0000 7eff7bfff700 1 -- 172.21.15.3:0/2127842404 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff7c05ecf0 con 0x7eff7c06ca70 2023-10-08T15:38:15.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.377+0000 7eff62ffd700 1 -- 172.21.15.3:0/2127842404 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7eff6c022030 con 0x7eff7c06ca70 2023-10-08T15:38:15.382 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.377+0000 7eff62ffd700 1 --2- 172.21.15.3:0/2127842404 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7eff68060580 0x7eff68062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:15.382 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.377+0000 7eff62ffd700 1 -- 172.21.15.3:0/2127842404 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5705+0+0 (secure 0 0 0) 0x7eff6c07e7a0 con 0x7eff7c06ca70 2023-10-08T15:38:15.383 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.377+0000 7eff7affd700 1 --2- 172.21.15.3:0/2127842404 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7eff68060580 0x7eff68062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:15.383 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.377+0000 7eff7affd700 1 --2- 172.21.15.3:0/2127842404 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7eff68060580 0x7eff68062a30 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7eff70006fd0 tx=0x7eff70008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:15.391 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.385+0000 7eff62ffd700 1 -- 172.21.15.3:0/2127842404 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7eff6c04ed90 con 0x7eff7c06ca70 2023-10-08T15:38:15.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.581+0000 7eff7bfff700 1 -- 172.21.15.3:0/2127842404 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7eff7c05ecf0 con 0x7eff7c06ca70 2023-10-08T15:38:15.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.581+0000 7eff62ffd700 1 -- 172.21.15.3:0/2127842404 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+3079 (secure 0 0 0) 0x7eff6c0523b0 con 0x7eff7c06ca70 2023-10-08T15:38:15.587 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:38:15.587 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4736,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3640212670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3640212670},{"type":"v1","addr":"172.21.15.50:6835","nonce":3640212670}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:38:10.891768+0000","modified":"2023-10-08T15:38:13.541239+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4989},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4989":{"gid":4989,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.3:6833/3457348695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":3457348695},{"type":"v1","addr":"172.21.15.3:6833","nonce":3457348695}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-08T15:38:15.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.581+0000 7eff7bfff700 1 -- 172.21.15.3:0/2127842404 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7eff68060580 msgr2=0x7eff68062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:15.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.581+0000 7eff7bfff700 1 --2- 172.21.15.3:0/2127842404 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7eff68060580 0x7eff68062a30 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7eff70006fd0 tx=0x7eff70008040 comp rx=0 tx=0).stop 2023-10-08T15:38:15.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.581+0000 7eff7bfff700 1 -- 172.21.15.3:0/2127842404 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7eff7c06ca70 msgr2=0x7eff7c148750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:15.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.581+0000 7eff7bfff700 1 --2- 172.21.15.3:0/2127842404 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7eff7c06ca70 0x7eff7c148750 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7eff7c070be0 tx=0x7eff6c016000 comp rx=0 tx=0).stop 2023-10-08T15:38:15.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.585+0000 7eff7bfff700 1 -- 172.21.15.3:0/2127842404 shutdown_connections 2023-10-08T15:38:15.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.585+0000 7eff7bfff700 1 --2- 172.21.15.3:0/2127842404 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7eff68060580 0x7eff68062a30 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:15.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.585+0000 7eff7bfff700 1 --2- 172.21.15.3:0/2127842404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff7c14ac50 0x7eff7c09d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:15.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.585+0000 7eff7bfff700 1 --2- 172.21.15.3:0/2127842404 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7eff7c06ca70 0x7eff7c148750 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:15.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.585+0000 7eff7bfff700 1 --2- 172.21.15.3:0/2127842404 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7eff7c06be60 0x7eff7c0a07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:15.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.585+0000 7eff7bfff700 1 -- 172.21.15.3:0/2127842404 >> 172.21.15.3:0/2127842404 conn(0x7eff7c0c1df0 msgr2=0x7eff7c0685d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:15.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.585+0000 7eff7bfff700 1 -- 172.21.15.3:0/2127842404 shutdown_connections 2023-10-08T15:38:15.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.585+0000 7eff7bfff700 1 -- 172.21.15.3:0/2127842404 wait complete. 2023-10-08T15:38:15.591 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 13 2023-10-08T15:38:15.803 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-08T15:38:10.891768+0000', 'modified': '2023-10-08T15:38:13.541239+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4989}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4989': {'gid': 4989, 'name': 'a', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.3:6833/3457348695', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.3:6832', 'nonce': 3457348695}, {'type': 'v1', 'addr': '172.21.15.3:6833', 'nonce': 3457348695}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-08T15:38:15.803 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-08T15:38:15.803 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-08T15:38:15.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.917+0000 7f23e08aa700 1 Processor -- start 2023-10-08T15:38:15.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.917+0000 7f23e08aa700 1 -- start start 2023-10-08T15:38:15.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.921+0000 7f23e08aa700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f23dc06d770 0x7f23dc147f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:15.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.921+0000 7f23e08aa700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23dc14b150 con 0x7f23dc141ab0 2023-10-08T15:38:15.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.921+0000 7f23e08aa700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23dc0b1c30 con 0x7f23dc0beb80 2023-10-08T15:38:15.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.921+0000 7f23e08aa700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23dc069970 con 0x7f23dc06d770 2023-10-08T15:38:15.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.921+0000 7f23d3fff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f23dc141ab0 0x7f23dc147800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:35344/0 (socket says 172.21.15.3:35344) 2023-10-08T15:38:15.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.921+0000 7f23d3fff700 1 -- 172.21.15.3:0/4147461110 learned_addr learned my addr 172.21.15.3:0/4147461110 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:38:15.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.921+0000 7f23dbfff700 1 --2- 172.21.15.3:0/4147461110 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f23dc06d770 0x7f23dc147f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:15.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.921+0000 7f23daffd700 1 -- 172.21.15.3:0/4147461110 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3602377306 0 0) 0x7f23dc14b150 con 0x7f23dc141ab0 2023-10-08T15:38:15.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.921+0000 7f23daffd700 1 -- 172.21.15.3:0/4147461110 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23c8004680 con 0x7f23dc141ab0 2023-10-08T15:38:15.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.921+0000 7f23daffd700 1 -- 172.21.15.3:0/4147461110 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3170379985 0 0) 0x7f23dc0b1c30 con 0x7f23dc0beb80 2023-10-08T15:38:15.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.921+0000 7f23daffd700 1 -- 172.21.15.3:0/4147461110 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23dc14b150 con 0x7f23dc0beb80 2023-10-08T15:38:15.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.921+0000 7f23dbfff700 1 -- 172.21.15.3:0/4147461110 >> v1:172.21.15.50:6789/0 conn(0x7f23dc0beb80 legacy=0x7f23dc1413a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:15.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.921+0000 7f23dbfff700 1 -- 172.21.15.3:0/4147461110 >> v1:172.21.15.3:6789/0 conn(0x7f23dc141ab0 legacy=0x7f23dc147800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:15.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.921+0000 7f23dbfff700 1 -- 172.21.15.3:0/4147461110 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23dc069690 con 0x7f23dc06d770 2023-10-08T15:38:15.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.921+0000 7f23dbfff700 1 --2- 172.21.15.3:0/4147461110 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f23dc06d770 0x7f23dc147f10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f23d4009e90 tx=0x7f23d4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0d136b5eb7c594b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:15.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.921+0000 7f23daffd700 1 -- 172.21.15.3:0/4147461110 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d400e070 con 0x7f23dc06d770 2023-10-08T15:38:15.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.921+0000 7f23daffd700 1 -- 172.21.15.3:0/4147461110 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23d400bb80 con 0x7f23dc06d770 2023-10-08T15:38:15.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.921+0000 7f23daffd700 1 -- 172.21.15.3:0/4147461110 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d4012430 con 0x7f23dc06d770 2023-10-08T15:38:15.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.921+0000 7f23e08aa700 1 -- 172.21.15.3:0/4147461110 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f23dc06d770 msgr2=0x7f23dc147f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:15.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.921+0000 7f23e08aa700 1 --2- 172.21.15.3:0/4147461110 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f23dc06d770 0x7f23dc147f10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f23d4009e90 tx=0x7f23d4009780 comp rx=0 tx=0).stop 2023-10-08T15:38:15.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.921+0000 7f23e08aa700 1 -- 172.21.15.3:0/4147461110 shutdown_connections 2023-10-08T15:38:15.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.921+0000 7f23e08aa700 1 --2- 172.21.15.3:0/4147461110 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f23dc06d770 0x7f23dc147f10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:15.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.921+0000 7f23e08aa700 1 -- 172.21.15.3:0/4147461110 >> 172.21.15.3:0/4147461110 conn(0x7f23dc067bb0 msgr2=0x7f23dc0be240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:15.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.921+0000 7f23e08aa700 1 -- 172.21.15.3:0/4147461110 shutdown_connections 2023-10-08T15:38:15.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.921+0000 7f23e08aa700 1 -- 172.21.15.3:0/4147461110 wait complete. 2023-10-08T15:38:15.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.925+0000 7f23e08aa700 1 Processor -- start 2023-10-08T15:38:15.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.925+0000 7f23e08aa700 1 -- start start 2023-10-08T15:38:15.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.925+0000 7f23e08aa700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f23dc06d770 0x7f23dc15c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:15.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.925+0000 7f23e08aa700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f23dc0beb80 0x7f23dc0bc170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:15.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.925+0000 7f23e08aa700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23dc141ab0 0x7f23dc0bc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:15.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.925+0000 7f23e08aa700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23dc15c570 con 0x7f23dc06d770 2023-10-08T15:38:15.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.925+0000 7f23e08aa700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23dc0bb990 con 0x7f23dc141ab0 2023-10-08T15:38:15.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.925+0000 7f23e08aa700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23dc15b570 con 0x7f23dc0beb80 2023-10-08T15:38:15.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.925+0000 7f23db7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f23dc06d770 0x7f23dc15c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:15.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.925+0000 7f23db7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f23dc06d770 0x7f23dc15c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:48236/0 (socket says 172.21.15.3:48236) 2023-10-08T15:38:15.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.925+0000 7f23db7fe700 1 -- 172.21.15.3:0/2723175841 learned_addr learned my addr 172.21.15.3:0/2723175841 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:38:15.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.925+0000 7f23dbfff700 1 --2- 172.21.15.3:0/2723175841 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23dc141ab0 0x7f23dc0bc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:15.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.925+0000 7f23d3fff700 1 --2- 172.21.15.3:0/2723175841 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f23dc0beb80 0x7f23dc0bc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:15.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.925+0000 7f23db7fe700 1 -- 172.21.15.3:0/2723175841 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f23dc0beb80 msgr2=0x7f23dc0bc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:15.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.925+0000 7f23db7fe700 1 --2- 172.21.15.3:0/2723175841 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f23dc0beb80 0x7f23dc0bc170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:15.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.925+0000 7f23db7fe700 1 -- 172.21.15.3:0/2723175841 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23dc141ab0 msgr2=0x7f23dc0bc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:15.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.925+0000 7f23db7fe700 1 --2- 172.21.15.3:0/2723175841 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23dc141ab0 0x7f23dc0bc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:15.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.925+0000 7f23db7fe700 1 -- 172.21.15.3:0/2723175841 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d4009a20 con 0x7f23dc06d770 2023-10-08T15:38:15.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.925+0000 7f23d3fff700 1 --2- 172.21.15.3:0/2723175841 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f23dc0beb80 0x7f23dc0bc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:38:15.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.925+0000 7f23db7fe700 1 --2- 172.21.15.3:0/2723175841 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f23dc06d770 0x7f23dc15c030 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f23cc00c790 tx=0x7f23cc007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:15.935 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.929+0000 7f23d37fe700 1 -- 172.21.15.3:0/2723175841 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23cc010510 con 0x7f23dc06d770 2023-10-08T15:38:15.935 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.929+0000 7f23d37fe700 1 -- 172.21.15.3:0/2723175841 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23cc010670 con 0x7f23dc06d770 2023-10-08T15:38:15.935 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.929+0000 7f23e08aa700 1 -- 172.21.15.3:0/2723175841 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23dc0bb6b0 con 0x7f23dc06d770 2023-10-08T15:38:15.935 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.929+0000 7f23d37fe700 1 -- 172.21.15.3:0/2723175841 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23cc010a30 con 0x7f23dc06d770 2023-10-08T15:38:15.935 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.929+0000 7f23e08aa700 1 -- 172.21.15.3:0/2723175841 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23dc15bb10 con 0x7f23dc06d770 2023-10-08T15:38:15.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.929+0000 7f23d37fe700 1 -- 172.21.15.3:0/2723175841 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f23cc01b3b0 con 0x7f23dc06d770 2023-10-08T15:38:15.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.933+0000 7f23d37fe700 1 --2- 172.21.15.3:0/2723175841 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f23bc060550 0x7f23bc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:15.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.933+0000 7f23d37fe700 1 -- 172.21.15.3:0/2723175841 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f23cc07c060 con 0x7f23dc06d770 2023-10-08T15:38:15.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.933+0000 7f23d3fff700 1 --2- 172.21.15.3:0/2723175841 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f23bc060550 0x7f23bc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:15.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.933+0000 7f23e3db5740 1 Processor -- start 2023-10-08T15:38:15.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.933+0000 7f23d3fff700 1 --2- 172.21.15.3:0/2723175841 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f23bc060550 0x7f23bc062a00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f23dc0b80b0 tx=0x7f23c4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:15.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.933+0000 7f23e3db5740 1 -- start start 2023-10-08T15:38:15.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.933+0000 7f23e3db5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x28e7ae0 0x2b1f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:15.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.933+0000 7f23e3db5740 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x28e7710 0x2b1f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:15.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.933+0000 7f23e3db5740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x2932790 0x2b1fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:15.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.933+0000 7f23e3db5740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a92f30 con 0x2932790 2023-10-08T15:38:15.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.933+0000 7f23e3db5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a8eed0 con 0x28e7ae0 2023-10-08T15:38:15.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.933+0000 7f23e3db5740 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x2a550b0 con 0x28e7710 2023-10-08T15:38:15.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.933+0000 7f23dbfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x2932790 0x2b1fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:15.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.933+0000 7f23d3fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x28e7710 0x2b1f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:15.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.933+0000 7f23db7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x28e7ae0 0x2b1f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:15.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.933+0000 7f23dbfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x2932790 0x2b1fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:48242/0 (socket says 172.21.15.3:48242) 2023-10-08T15:38:15.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.933+0000 7f23dbfff700 1 -- 172.21.15.3:0/3211786648 learned_addr learned my addr 172.21.15.3:0/3211786648 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:38:15.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.937+0000 7f23dbfff700 1 -- 172.21.15.3:0/3211786648 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x28e7710 msgr2=0x2b1f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:38:15.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.937+0000 7f23dbfff700 1 --2- 172.21.15.3:0/3211786648 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x28e7710 0x2b1f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:15.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.937+0000 7f23dbfff700 1 -- 172.21.15.3:0/3211786648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x28e7ae0 msgr2=0x2b1f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:38:15.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.937+0000 7f23dbfff700 1 --2- 172.21.15.3:0/3211786648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x28e7ae0 0x2b1f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:15.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.937+0000 7f23dbfff700 1 -- 172.21.15.3:0/3211786648 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x29339e0 con 0x2932790 2023-10-08T15:38:15.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.937+0000 7f23dbfff700 1 --2- 172.21.15.3:0/3211786648 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x2932790 0x2b1fee0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f23d40099f0 tx=0x7f23d4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a327f2fa9ae52075 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:15.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.937+0000 7f23d0ff9700 1 -- 172.21.15.3:0/3211786648 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d4022070 con 0x2932790 2023-10-08T15:38:15.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.937+0000 7f23d0ff9700 1 -- 172.21.15.3:0/3211786648 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23d40096f0 con 0x2932790 2023-10-08T15:38:15.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.937+0000 7f23d0ff9700 1 -- 172.21.15.3:0/3211786648 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d40127f0 con 0x2932790 2023-10-08T15:38:15.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.937+0000 7f23e3db5740 1 -- 172.21.15.3:0/3211786648 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x2932790 msgr2=0x2b1fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:15.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.937+0000 7f23e3db5740 1 --2- 172.21.15.3:0/3211786648 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x2932790 0x2b1fee0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f23d40099f0 tx=0x7f23d4019000 comp rx=0 tx=0).stop 2023-10-08T15:38:15.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.937+0000 7f23e3db5740 1 -- 172.21.15.3:0/3211786648 shutdown_connections 2023-10-08T15:38:15.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.937+0000 7f23e3db5740 1 --2- 172.21.15.3:0/3211786648 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x2932790 0x2b1fee0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:15.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.937+0000 7f23e3db5740 1 --2- 172.21.15.3:0/3211786648 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x28e7710 0x2b1f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:15.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.937+0000 7f23e3db5740 1 --2- 172.21.15.3:0/3211786648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x28e7ae0 0x2b1f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:15.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.937+0000 7f23e3db5740 1 -- 172.21.15.3:0/3211786648 >> 172.21.15.3:0/3211786648 conn(0x28e7eb0 msgr2=0x2b1a810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:15.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.937+0000 7f23e3db5740 1 -- 172.21.15.3:0/3211786648 shutdown_connections 2023-10-08T15:38:15.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.937+0000 7f23e3db5740 1 -- 172.21.15.3:0/3211786648 wait complete. 2023-10-08T15:38:15.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.937+0000 7f23e3db5740 1 -- start start 2023-10-08T15:38:15.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.937+0000 7f23e3db5740 1 Processor -- start 2023-10-08T15:38:15.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.941+0000 7f23e3db5740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x28e7710 0x2b55570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:15.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.941+0000 7f23e3db5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x28e7ae0 0x2b55ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:15.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.941+0000 7f23e3db5740 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x2932790 0x2b565e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:15.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.941+0000 7f23e3db5740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a54d50 con 0x28e7710 2023-10-08T15:38:15.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.941+0000 7f23e3db5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a2d970 con 0x28e7ae0 2023-10-08T15:38:15.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.941+0000 7f23e3db5740 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x2a93810 con 0x2932790 2023-10-08T15:38:15.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.941+0000 7f23e3db5740 10 client.0 _ll_register_callbacks cb 0x2ad86a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T15:38:15.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.941+0000 7f23db7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x28e7710 0x2b55570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:15.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.941+0000 7f23db7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x28e7710 0x2b55570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:48252/0 (socket says 172.21.15.3:48252) 2023-10-08T15:38:15.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.941+0000 7f23db7fe700 1 -- 172.21.15.3:0/3638929339 learned_addr learned my addr 172.21.15.3:0/3638929339 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:38:15.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.941+0000 7f23dbfff700 1 --2- 172.21.15.3:0/3638929339 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x2932790 0x2b565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:15.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.941+0000 7f23d3fff700 1 --2- 172.21.15.3:0/3638929339 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x28e7ae0 0x2b55ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:15.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.941+0000 7f23db7fe700 1 -- 172.21.15.3:0/3638929339 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x2932790 msgr2=0x2b565e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:38:15.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.941+0000 7f23db7fe700 1 --2- 172.21.15.3:0/3638929339 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x2932790 0x2b565e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:15.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.941+0000 7f23db7fe700 1 -- 172.21.15.3:0/3638929339 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x28e7ae0 msgr2=0x2b55ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:38:15.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.941+0000 7f23db7fe700 1 --2- 172.21.15.3:0/3638929339 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x28e7ae0 0x2b55ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:15.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.941+0000 7f23db7fe700 1 -- 172.21.15.3:0/3638929339 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23dc069690 con 0x28e7710 2023-10-08T15:38:15.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.941+0000 7f23d3fff700 1 --2- 172.21.15.3:0/3638929339 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x28e7ae0 0x2b55ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:38:15.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.941+0000 7f23db7fe700 1 --2- 172.21.15.3:0/3638929339 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x28e7710 0x2b55570 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f23cc050010 tx=0x7f23cc01e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2d773e1f296e9f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:15.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.941+0000 7f23b9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2023-10-08T15:38:15.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.941+0000 7f23b9ffb700 1 -- 172.21.15.3:0/3638929339 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23cc069070 con 0x28e7710 2023-10-08T15:38:15.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.941+0000 7f23b9ffb700 1 -- 172.21.15.3:0/3638929339 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f23cc04e450 con 0x28e7710 2023-10-08T15:38:15.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.941+0000 7f23e3db5740 1 -- 172.21.15.3:0/3638929339 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2a2dcc0 con 0x28e7710 2023-10-08T15:38:15.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.941+0000 7f23b9ffb700 1 -- 172.21.15.3:0/3638929339 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7f23cc07a170 con 0x28e7710 2023-10-08T15:38:15.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.941+0000 7f23e3db5740 10 client.5154 fetch_fsmap learned FSMap version 13 2023-10-08T15:38:15.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.941+0000 7f23e3db5740 1 -- 172.21.15.3:0/3638929339 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) v3 -- 0x2a5d370 con 0x28e7710 2023-10-08T15:38:15.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.941+0000 7f23b9ffb700 1 -- 172.21.15.3:0/3638929339 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2a2dcc0 con 0x28e7710 2023-10-08T15:38:15.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.941+0000 7f23b9ffb700 1 -- 172.21.15.3:0/3638929339 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 13) v1 ==== 2010+0+0 (secure 0 0 0) 0x7f23cc04f800 con 0x28e7710 2023-10-08T15:38:15.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.941+0000 7f23e3db5740 10 client.5154 fetch_fsmap finished waiting for FSMap version 13 2023-10-08T15:38:15.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.941+0000 7f23e3db5740 10 client.5154 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-08T15:38:15.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.941+0000 7f23e3db5740 20 client.5154 populate_metadata read hostname 'smithi003' 2023-10-08T15:38:15.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.941+0000 7f23e3db5740 1 --2- 172.21.15.3:0/3638929339 >> [v2:172.21.15.3:6832/3457348695,v1:172.21.15.3:6833/3457348695] conn(0x2b65b90 0x2b67f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:15.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.941+0000 7f23e3db5740 4 client.5154 mds_command: new command op to 4989 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-08T15:38:15.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.941+0000 7f23e3db5740 1 -- 172.21.15.3:0/3638929339 --> [v2:172.21.15.3:6832/3457348695,v1:172.21.15.3:6833/3457348695] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2a313e0 con 0x2b65b90 2023-10-08T15:38:15.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.941+0000 7f23d3fff700 1 --2- 172.21.15.3:0/3638929339 >> [v2:172.21.15.3:6832/3457348695,v1:172.21.15.3:6833/3457348695] conn(0x2b65b90 0x2b67f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:15.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.941+0000 7f23b9ffb700 10 client.5154 ms_handle_connect on v2:172.21.15.3:6832/3457348695 2023-10-08T15:38:15.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.941+0000 7f23d3fff700 1 --2- 172.21.15.3:0/3638929339 >> [v2:172.21.15.3:6832/3457348695,v1:172.21.15.3:6833/3457348695] conn(0x2b65b90 0x2b67f70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b54f9d22268b51a server_cookie=6a0fb306b127c86a in_seq=0 out_seq=0 2023-10-08T15:38:15.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.945+0000 7f23b9ffb700 1 -- 172.21.15.3:0/3638929339 <== mds.0 v2:172.21.15.3:6832/3457348695 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x2a313e0 con 0x2b65b90 2023-10-08T15:38:15.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.945+0000 7f23b9ffb700 10 client.5154 handle_command_reply: tid=0 2023-10-08T15:38:15.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.945+0000 7f23e3db5740 1 client.5154 shutdown 2023-10-08T15:38:15.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.945+0000 7f23e3db5740 1 -- 172.21.15.3:0/3638929339 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x28e7710 msgr2=0x2b55570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:15.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.945+0000 7f23e3db5740 1 --2- 172.21.15.3:0/3638929339 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x28e7710 0x2b55570 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f23cc050010 tx=0x7f23cc01e040 comp rx=0 tx=0).stop 2023-10-08T15:38:15.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.945+0000 7f23e3db5740 1 -- 172.21.15.3:0/3638929339 shutdown_connections 2023-10-08T15:38:15.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.945+0000 7f23e3db5740 1 --2- 172.21.15.3:0/3638929339 >> [v2:172.21.15.3:6832/3457348695,v1:172.21.15.3:6833/3457348695] conn(0x2b65b90 0x2b67f70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:15.957 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.945+0000 7f23e3db5740 1 --2- 172.21.15.3:0/3638929339 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x2932790 0x2b565e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:15.957 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.945+0000 7f23e3db5740 1 --2- 172.21.15.3:0/3638929339 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x28e7ae0 0x2b55ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:15.957 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.945+0000 7f23e3db5740 1 --2- 172.21.15.3:0/3638929339 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x28e7710 0x2b55570 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:15.957 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.945+0000 7f23e3db5740 1 -- 172.21.15.3:0/3638929339 >> 172.21.15.3:0/3638929339 conn(0x28e7eb0 msgr2=0x2b19f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:15.957 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.945+0000 7f23b9ffb700 0 client.5154 ms_handle_reset on v2:172.21.15.3:6832/3457348695 2023-10-08T15:38:15.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.945+0000 7f23e3db5740 1 -- 172.21.15.3:0/3638929339 shutdown_connections 2023-10-08T15:38:15.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.945+0000 7f23e3db5740 1 -- 172.21.15.3:0/3638929339 wait complete. 2023-10-08T15:38:15.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.945+0000 7f23e3db5740 20 client.5154 trim_cache size 0 max 16384 2023-10-08T15:38:15.971 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.965+0000 7f23e3db5740 1 Processor -- start 2023-10-08T15:38:15.971 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.965+0000 7f23e3db5740 1 -- start start 2023-10-08T15:38:15.973 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.965+0000 7f23e3db5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x28e7710 0x2b1f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:15.973 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.965+0000 7f23e3db5740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x28e7ae0 0x2b1f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:15.973 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.965+0000 7f23e3db5740 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x2932790 0x2b1fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:15.973 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.965+0000 7f23e3db5740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a929d0 con 0x28e7ae0 2023-10-08T15:38:15.974 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.965+0000 7f23e3db5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a8ab50 con 0x28e7710 2023-10-08T15:38:15.974 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.965+0000 7f23e3db5740 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x2a91590 con 0x2932790 2023-10-08T15:38:15.974 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.965+0000 7f23d3fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x28e7ae0 0x2b1f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:15.974 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.965+0000 7f23d3fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x28e7ae0 0x2b1f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:48256/0 (socket says 172.21.15.3:48256) 2023-10-08T15:38:15.974 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.965+0000 7f23d3fff700 1 -- 172.21.15.3:0/1230058082 learned_addr learned my addr 172.21.15.3:0/1230058082 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:38:15.974 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.965+0000 7f23dbfff700 1 --2- 172.21.15.3:0/1230058082 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x2932790 0x2b1fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:15.974 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.965+0000 7f23db7fe700 1 --2- 172.21.15.3:0/1230058082 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x28e7710 0x2b1f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:15.974 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.965+0000 7f23d3fff700 1 -- 172.21.15.3:0/1230058082 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x2932790 msgr2=0x2b1fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:38:15.974 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.965+0000 7f23d3fff700 1 --2- 172.21.15.3:0/1230058082 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x2932790 0x2b1fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:15.974 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.965+0000 7f23d3fff700 1 -- 172.21.15.3:0/1230058082 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x28e7710 msgr2=0x2b1f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:38:15.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.965+0000 7f23d3fff700 1 --2- 172.21.15.3:0/1230058082 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x28e7710 0x2b1f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:15.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.965+0000 7f23d3fff700 1 -- 172.21.15.3:0/1230058082 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2a43d80 con 0x28e7ae0 2023-10-08T15:38:15.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.965+0000 7f23dbfff700 1 --2- 172.21.15.3:0/1230058082 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x2932790 0x2b1fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:38:15.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.965+0000 7f23db7fe700 1 --2- 172.21.15.3:0/1230058082 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x28e7710 0x2b1f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:38:15.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.965+0000 7f23d3fff700 1 --2- 172.21.15.3:0/1230058082 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x28e7ae0 0x2b1f5a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f23c40010e0 tx=0x7f23c4017040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3921c1d649f38968 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:15.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.969+0000 7f23d17fa700 1 -- 172.21.15.3:0/1230058082 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c40078c0 con 0x28e7ae0 2023-10-08T15:38:15.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.969+0000 7f23d17fa700 1 -- 172.21.15.3:0/1230058082 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c40260e0 con 0x28e7ae0 2023-10-08T15:38:15.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.969+0000 7f23d17fa700 1 -- 172.21.15.3:0/1230058082 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c4004830 con 0x28e7ae0 2023-10-08T15:38:15.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.969+0000 7f23e3db5740 1 -- 172.21.15.3:0/1230058082 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x28e7ae0 msgr2=0x2b1f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:15.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.969+0000 7f23e3db5740 1 --2- 172.21.15.3:0/1230058082 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x28e7ae0 0x2b1f5a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f23c40010e0 tx=0x7f23c4017040 comp rx=0 tx=0).stop 2023-10-08T15:38:15.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.969+0000 7f23e3db5740 1 -- 172.21.15.3:0/1230058082 shutdown_connections 2023-10-08T15:38:15.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.969+0000 7f23e3db5740 1 --2- 172.21.15.3:0/1230058082 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x2932790 0x2b1fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:15.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.969+0000 7f23e3db5740 1 --2- 172.21.15.3:0/1230058082 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x28e7ae0 0x2b1f5a0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:15.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.969+0000 7f23e3db5740 1 --2- 172.21.15.3:0/1230058082 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x28e7710 0x2b1f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:15.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.969+0000 7f23e3db5740 1 -- 172.21.15.3:0/1230058082 >> 172.21.15.3:0/1230058082 conn(0x28e7eb0 msgr2=0x2b61ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:15.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.969+0000 7f23e3db5740 1 -- 172.21.15.3:0/1230058082 shutdown_connections 2023-10-08T15:38:15.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.969+0000 7f23e3db5740 1 -- 172.21.15.3:0/1230058082 wait complete. 2023-10-08T15:38:15.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.969+0000 7f23e3db5740 1 -- start start 2023-10-08T15:38:15.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.969+0000 7f23e3db5740 1 Processor -- start 2023-10-08T15:38:15.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.969+0000 7f23e3db5740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x28e7710 0x2b79030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:15.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.969+0000 7f23e3db5740 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x28e7ae0 0x2b79570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:15.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.969+0000 7f23e3db5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2932790 0x2b79ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:15.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.969+0000 7f23e3db5740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x2ab5d00 con 0x28e7710 2023-10-08T15:38:15.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.969+0000 7f23e3db5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a64550 con 0x2932790 2023-10-08T15:38:15.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.969+0000 7f23e3db5740 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x2a63610 con 0x28e7ae0 2023-10-08T15:38:15.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.969+0000 7f23e3db5740 10 client.0 _ll_register_callbacks cb 0x29b6d00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T15:38:15.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.969+0000 7f23db7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x28e7710 0x2b79030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:15.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.969+0000 7f23db7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x28e7710 0x2b79030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:48262/0 (socket says 172.21.15.3:48262) 2023-10-08T15:38:15.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.969+0000 7f23db7fe700 1 -- 172.21.15.3:0/1171120371 learned_addr learned my addr 172.21.15.3:0/1171120371 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:38:15.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.969+0000 7f23d3fff700 1 --2- 172.21.15.3:0/1171120371 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x28e7ae0 0x2b79570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:15.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.969+0000 7f23dbfff700 1 --2- 172.21.15.3:0/1171120371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2932790 0x2b79ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:15.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.969+0000 7f23db7fe700 1 -- 172.21.15.3:0/1171120371 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x28e7ae0 msgr2=0x2b79570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:38:15.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.969+0000 7f23db7fe700 1 --2- 172.21.15.3:0/1171120371 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x28e7ae0 0x2b79570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:15.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.969+0000 7f23db7fe700 1 -- 172.21.15.3:0/1171120371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2932790 msgr2=0x2b79ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:38:15.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.969+0000 7f23db7fe700 1 --2- 172.21.15.3:0/1171120371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2932790 0x2b79ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:15.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.969+0000 7f23db7fe700 1 -- 172.21.15.3:0/1171120371 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23c401d040 con 0x28e7710 2023-10-08T15:38:15.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.969+0000 7f23db7fe700 1 --2- 172.21.15.3:0/1171120371 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x28e7710 0x2b79030 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f23cc04c7c0 tx=0x7f23cc067000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6efed97b7ef6ca4c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:15.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.969+0000 7f23b9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2023-10-08T15:38:15.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.973+0000 7f23b9ffb700 1 -- 172.21.15.3:0/1171120371 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23cc069040 con 0x28e7710 2023-10-08T15:38:15.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.973+0000 7f23b9ffb700 1 -- 172.21.15.3:0/1171120371 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f23cc04e450 con 0x28e7710 2023-10-08T15:38:15.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.973+0000 7f23e3db5740 1 -- 172.21.15.3:0/1171120371 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f23d40096f0 con 0x28e7710 2023-10-08T15:38:15.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.973+0000 7f23b9ffb700 1 -- 172.21.15.3:0/1171120371 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7f23cc050a50 con 0x28e7710 2023-10-08T15:38:15.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.973+0000 7f23e3db5740 10 client.5160 fetch_fsmap learned FSMap version 13 2023-10-08T15:38:15.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.973+0000 7f23e3db5740 1 -- 172.21.15.3:0/1171120371 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) v3 -- 0x2a38130 con 0x28e7710 2023-10-08T15:38:15.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.973+0000 7f23b9ffb700 1 -- 172.21.15.3:0/1171120371 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23d40096f0 con 0x28e7710 2023-10-08T15:38:15.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.973+0000 7f23b9ffb700 1 -- 172.21.15.3:0/1171120371 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 13) v1 ==== 2010+0+0 (secure 0 0 0) 0x7f23cc061bb0 con 0x28e7710 2023-10-08T15:38:15.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.973+0000 7f23e3db5740 10 client.5160 fetch_fsmap finished waiting for FSMap version 13 2023-10-08T15:38:15.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.973+0000 7f23e3db5740 10 client.5160 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-08T15:38:15.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.973+0000 7f23e3db5740 20 client.5160 populate_metadata read hostname 'smithi003' 2023-10-08T15:38:15.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.973+0000 7f23e3db5740 1 --2- 172.21.15.3:0/1171120371 >> [v2:172.21.15.3:6832/3457348695,v1:172.21.15.3:6833/3457348695] conn(0x2bb7aa0 0x2bb9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:15.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.973+0000 7f23e3db5740 4 client.5160 mds_command: new command op to 4989 tid=0[{"prefix": "status"}] 2023-10-08T15:38:15.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.973+0000 7f23e3db5740 1 -- 172.21.15.3:0/1171120371 --> [v2:172.21.15.3:6832/3457348695,v1:172.21.15.3:6833/3457348695] -- command(tid 0: {"prefix": "status"}) v1 -- 0x2a63410 con 0x2bb7aa0 2023-10-08T15:38:15.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.973+0000 7f23d3fff700 1 --2- 172.21.15.3:0/1171120371 >> [v2:172.21.15.3:6832/3457348695,v1:172.21.15.3:6833/3457348695] conn(0x2bb7aa0 0x2bb9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:15.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.973+0000 7f23b9ffb700 10 client.5160 ms_handle_connect on v2:172.21.15.3:6832/3457348695 2023-10-08T15:38:15.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.973+0000 7f23d3fff700 1 --2- 172.21.15.3:0/1171120371 >> [v2:172.21.15.3:6832/3457348695,v1:172.21.15.3:6833/3457348695] conn(0x2bb7aa0 0x2bb9e80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db651bb7286c5b14 server_cookie=df2bc68c6944bf85 in_seq=0 out_seq=0 2023-10-08T15:38:15.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.973+0000 7f23b9ffb700 1 -- 172.21.15.3:0/1171120371 <== mds.0 v2:172.21.15.3:6832/3457348695 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x2a63410 con 0x2bb7aa0 2023-10-08T15:38:15.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.973+0000 7f23b9ffb700 10 client.5160 handle_command_reply: tid=0 2023-10-08T15:38:15.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.973+0000 7f23e3db5740 1 client.5160 shutdown 2023-10-08T15:38:15.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.973+0000 7f23e3db5740 1 -- 172.21.15.3:0/1171120371 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x28e7710 msgr2=0x2b79030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:15.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.973+0000 7f23e3db5740 1 --2- 172.21.15.3:0/1171120371 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x28e7710 0x2b79030 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f23cc04c7c0 tx=0x7f23cc067000 comp rx=0 tx=0).stop 2023-10-08T15:38:15.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.973+0000 7f23e3db5740 1 -- 172.21.15.3:0/1171120371 shutdown_connections 2023-10-08T15:38:15.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.973+0000 7f23e3db5740 1 --2- 172.21.15.3:0/1171120371 >> [v2:172.21.15.3:6832/3457348695,v1:172.21.15.3:6833/3457348695] conn(0x2bb7aa0 0x2bb9e80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:15.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.973+0000 7f23e3db5740 1 --2- 172.21.15.3:0/1171120371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2932790 0x2b79ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:15.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.973+0000 7f23b9ffb700 0 client.5160 ms_handle_reset on v2:172.21.15.3:6832/3457348695 2023-10-08T15:38:15.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.973+0000 7f23e3db5740 1 --2- 172.21.15.3:0/1171120371 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x28e7ae0 0x2b79570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:15.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.973+0000 7f23e3db5740 1 --2- 172.21.15.3:0/1171120371 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x28e7710 0x2b79030 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:15.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.973+0000 7f23e3db5740 1 -- 172.21.15.3:0/1171120371 >> 172.21.15.3:0/1171120371 conn(0x28e7eb0 msgr2=0x2b61ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:15.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.973+0000 7f23e3db5740 1 -- 172.21.15.3:0/1171120371 shutdown_connections 2023-10-08T15:38:15.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.973+0000 7f23e3db5740 1 -- 172.21.15.3:0/1171120371 wait complete. 2023-10-08T15:38:15.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.973+0000 7f23e3db5740 20 client.5160 trim_cache size 0 max 16384 2023-10-08T15:38:15.986 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2023-10-08T15:38:15.986 INFO:teuthology.orchestra.run.smithi003.stdout: "cluster_fsid": "7635972e-cd66-4a8f-a231-378db8b3847a", 2023-10-08T15:38:15.986 INFO:teuthology.orchestra.run.smithi003.stdout: "whoami": 0, 2023-10-08T15:38:15.986 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 4989, 2023-10-08T15:38:15.986 INFO:teuthology.orchestra.run.smithi003.stdout: "want_state": "up:active", 2023-10-08T15:38:15.986 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "up:active", 2023-10-08T15:38:15.986 INFO:teuthology.orchestra.run.smithi003.stdout: "fs_name": "cephfs", 2023-10-08T15:38:15.986 INFO:teuthology.orchestra.run.smithi003.stdout: "rank_uptime": 4.4524583849999999, 2023-10-08T15:38:15.987 INFO:teuthology.orchestra.run.smithi003.stdout: "mdsmap_epoch": 13, 2023-10-08T15:38:15.987 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch": 29, 2023-10-08T15:38:15.987 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch_barrier": 29, 2023-10-08T15:38:15.987 INFO:teuthology.orchestra.run.smithi003.stdout: "uptime": 11.406929869000001 2023-10-08T15:38:15.987 INFO:teuthology.orchestra.run.smithi003.stdout:} 2023-10-08T15:38:15.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.977+0000 7f23e08aa700 1 -- 172.21.15.3:0/2723175841 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f23bc060550 msgr2=0x7f23bc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:15.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.977+0000 7f23e08aa700 1 --2- 172.21.15.3:0/2723175841 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f23bc060550 0x7f23bc062a00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f23dc0b80b0 tx=0x7f23c4009040 comp rx=0 tx=0).stop 2023-10-08T15:38:15.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.977+0000 7f23e08aa700 1 -- 172.21.15.3:0/2723175841 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f23dc06d770 msgr2=0x7f23dc15c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:15.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.977+0000 7f23e08aa700 1 --2- 172.21.15.3:0/2723175841 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f23dc06d770 0x7f23dc15c030 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f23cc00c790 tx=0x7f23cc007e10 comp rx=0 tx=0).stop 2023-10-08T15:38:15.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.977+0000 7f23e08aa700 1 -- 172.21.15.3:0/2723175841 shutdown_connections 2023-10-08T15:38:15.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.977+0000 7f23e08aa700 1 --2- 172.21.15.3:0/2723175841 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f23bc060550 0x7f23bc062a00 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:15.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.977+0000 7f23e08aa700 1 --2- 172.21.15.3:0/2723175841 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23dc141ab0 0x7f23dc0bc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:15.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.977+0000 7f23e08aa700 1 --2- 172.21.15.3:0/2723175841 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f23dc0beb80 0x7f23dc0bc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:15.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.977+0000 7f23e08aa700 1 --2- 172.21.15.3:0/2723175841 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f23dc06d770 0x7f23dc15c030 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:15.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.977+0000 7f23e08aa700 1 -- 172.21.15.3:0/2723175841 >> 172.21.15.3:0/2723175841 conn(0x7f23dc067bb0 msgr2=0x7f23dc0a0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:15.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.977+0000 7f23e08aa700 1 -- 172.21.15.3:0/2723175841 shutdown_connections 2023-10-08T15:38:15.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:15.977+0000 7f23e08aa700 1 -- 172.21.15.3:0/2723175841 wait complete. 2023-10-08T15:38:15.998 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T15:38:16.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.101+0000 7f5bc7292700 1 Processor -- start 2023-10-08T15:38:16.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.101+0000 7f5bc7292700 1 -- start start 2023-10-08T15:38:16.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.105+0000 7f5bc7292700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5bc00be150 0x7f5bc00be520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:16.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.105+0000 7f5bc7292700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5bc006c3e0 0x7f5bc014b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:16.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.105+0000 7f5bc7292700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bc006cb60 con 0x7f5bc006be60 2023-10-08T15:38:16.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.105+0000 7f5bc7292700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bc014f8e0 con 0x7f5bc006c3e0 2023-10-08T15:38:16.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.105+0000 7f5bc7292700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc014f5f0 con 0x7f5bc00be150 2023-10-08T15:38:16.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.105+0000 7f5bc482d700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f5bc006be60 0x7f5bc00c26a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:35356/0 (socket says 172.21.15.3:35356) 2023-10-08T15:38:16.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.105+0000 7f5bc482d700 1 -- 172.21.15.3:0/1847541586 learned_addr learned my addr 172.21.15.3:0/1847541586 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:38:16.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.105+0000 7f5bc582f700 1 --2- 172.21.15.3:0/1847541586 >> v2:172.21.15.50:3300/0 conn(0x7f5bc006c3e0 0x7f5bc014b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:16.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.105+0000 7f5bc502e700 1 --2- 172.21.15.3:0/1847541586 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5bc00be150 0x7f5bc00be520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:16.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.105+0000 7f5bb7fff700 1 -- 172.21.15.3:0/1847541586 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2051234982 0 0) 0x7f5bc006cb60 con 0x7f5bc006be60 2023-10-08T15:38:16.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.105+0000 7f5bb7fff700 1 -- 172.21.15.3:0/1847541586 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bac003570 con 0x7f5bc006be60 2023-10-08T15:38:16.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.105+0000 7f5bc502e700 1 -- 172.21.15.3:0/1847541586 >> v2:172.21.15.50:3300/0 conn(0x7f5bc006c3e0 msgr2=0x7f5bc014b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:38:16.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.105+0000 7f5bc502e700 1 --2- 172.21.15.3:0/1847541586 >> v2:172.21.15.50:3300/0 conn(0x7f5bc006c3e0 0x7f5bc014b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:16.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.105+0000 7f5bc502e700 1 -- 172.21.15.3:0/1847541586 >> v1:172.21.15.3:6789/0 conn(0x7f5bc006be60 legacy=0x7f5bc00c26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:16.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.105+0000 7f5bc502e700 1 -- 172.21.15.3:0/1847541586 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc00c2db0 con 0x7f5bc00be150 2023-10-08T15:38:16.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.105+0000 7f5bc502e700 1 --2- 172.21.15.3:0/1847541586 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5bc00be150 0x7f5bc00be520 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5bb00098e0 tx=0x7f5bb00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a76b45d9c9c3364a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:16.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.105+0000 7f5bb7fff700 1 -- 172.21.15.3:0/1847541586 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb0011630 con 0x7f5bc00be150 2023-10-08T15:38:16.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.105+0000 7f5bb7fff700 1 -- 172.21.15.3:0/1847541586 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb0011790 con 0x7f5bc00be150 2023-10-08T15:38:16.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.105+0000 7f5bb7fff700 1 -- 172.21.15.3:0/1847541586 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb0011b30 con 0x7f5bc00be150 2023-10-08T15:38:16.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.105+0000 7f5bc7292700 1 -- 172.21.15.3:0/1847541586 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5bc00be150 msgr2=0x7f5bc00be520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:16.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.105+0000 7f5bc7292700 1 --2- 172.21.15.3:0/1847541586 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5bc00be150 0x7f5bc00be520 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5bb00098e0 tx=0x7f5bb00091a0 comp rx=0 tx=0).stop 2023-10-08T15:38:16.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.105+0000 7f5bc7292700 1 -- 172.21.15.3:0/1847541586 shutdown_connections 2023-10-08T15:38:16.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.105+0000 7f5bc7292700 1 --2- 172.21.15.3:0/1847541586 >> v2:172.21.15.50:3300/0 conn(0x7f5bc006c3e0 0x7f5bc014b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:16.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.105+0000 7f5bc7292700 1 --2- 172.21.15.3:0/1847541586 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5bc00be150 0x7f5bc00be520 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:16.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.105+0000 7f5bc7292700 1 -- 172.21.15.3:0/1847541586 >> 172.21.15.3:0/1847541586 conn(0x7f5bc006e460 msgr2=0x7f5bc00c1f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:16.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.105+0000 7f5bc7292700 1 -- 172.21.15.3:0/1847541586 shutdown_connections 2023-10-08T15:38:16.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.105+0000 7f5bc7292700 1 -- 172.21.15.3:0/1847541586 wait complete. 2023-10-08T15:38:16.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.109+0000 7f5bc7292700 1 Processor -- start 2023-10-08T15:38:16.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.109+0000 7f5bc7292700 1 -- start start 2023-10-08T15:38:16.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.109+0000 7f5bc7292700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5bc006be60 0x7f5bc009c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:16.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.109+0000 7f5bc7292700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5bc006c3e0 0x7f5bc00bef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:16.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.109+0000 7f5bc7292700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5bc00be150 0x7f5bc014db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:16.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.109+0000 7f5bc7292700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc015b1b0 con 0x7f5bc006c3e0 2023-10-08T15:38:16.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.109+0000 7f5bc7292700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc009e7c0 con 0x7f5bc006be60 2023-10-08T15:38:16.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.109+0000 7f5bc7292700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc009e4e0 con 0x7f5bc00be150 2023-10-08T15:38:16.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.109+0000 7f5bc482d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5bc006c3e0 0x7f5bc00bef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:16.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.109+0000 7f5bc482d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5bc006c3e0 0x7f5bc00bef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:48272/0 (socket says 172.21.15.3:48272) 2023-10-08T15:38:16.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.109+0000 7f5bc482d700 1 -- 172.21.15.3:0/3345360318 learned_addr learned my addr 172.21.15.3:0/3345360318 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:38:16.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.109+0000 7f5bc502e700 1 --2- 172.21.15.3:0/3345360318 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5bc006be60 0x7f5bc009c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:16.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.109+0000 7f5bc582f700 1 --2- 172.21.15.3:0/3345360318 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5bc00be150 0x7f5bc014db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:16.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.113+0000 7f5bc482d700 1 -- 172.21.15.3:0/3345360318 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5bc00be150 msgr2=0x7f5bc014db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:16.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.113+0000 7f5bc482d700 1 --2- 172.21.15.3:0/3345360318 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5bc00be150 0x7f5bc014db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:16.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.113+0000 7f5bc482d700 1 -- 172.21.15.3:0/3345360318 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5bc006be60 msgr2=0x7f5bc009c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:16.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.113+0000 7f5bc482d700 1 --2- 172.21.15.3:0/3345360318 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5bc006be60 0x7f5bc009c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:16.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.113+0000 7f5bc482d700 1 -- 172.21.15.3:0/3345360318 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb0009420 con 0x7f5bc006c3e0 2023-10-08T15:38:16.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.113+0000 7f5bc502e700 1 --2- 172.21.15.3:0/3345360318 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5bc006be60 0x7f5bc009c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:38:16.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.113+0000 7f5bc482d700 1 --2- 172.21.15.3:0/3345360318 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5bc006c3e0 0x7f5bc00bef80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc00c7f0 tx=0x7f5bbc007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:16.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.113+0000 7f5bb57fa700 1 -- 172.21.15.3:0/3345360318 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc005cd0 con 0x7f5bc006c3e0 2023-10-08T15:38:16.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.113+0000 7f5bb57fa700 1 -- 172.21.15.3:0/3345360318 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bbc005e50 con 0x7f5bc006c3e0 2023-10-08T15:38:16.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.113+0000 7f5bb57fa700 1 -- 172.21.15.3:0/3345360318 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc007320 con 0x7f5bc006c3e0 2023-10-08T15:38:16.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.113+0000 7f5bc7292700 1 -- 172.21.15.3:0/3345360318 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bc00bf4c0 con 0x7f5bc006c3e0 2023-10-08T15:38:16.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.113+0000 7f5bc7292700 1 -- 172.21.15.3:0/3345360318 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bc009b500 con 0x7f5bc006c3e0 2023-10-08T15:38:16.122 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.113+0000 7f5bc7292700 1 -- 172.21.15.3:0/3345360318 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bc0064530 con 0x7f5bc006c3e0 2023-10-08T15:38:16.122 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.113+0000 7f5bb57fa700 1 -- 172.21.15.3:0/3345360318 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5bbc007690 con 0x7f5bc006c3e0 2023-10-08T15:38:16.123 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.117+0000 7f5bb57fa700 1 --2- 172.21.15.3:0/3345360318 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5ba4060550 0x7f5ba4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:16.123 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.117+0000 7f5bb57fa700 1 -- 172.21.15.3:0/3345360318 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5bbc07be80 con 0x7f5bc006c3e0 2023-10-08T15:38:16.123 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.117+0000 7f5bc502e700 1 --2- 172.21.15.3:0/3345360318 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5ba4060550 0x7f5ba4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:16.124 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.117+0000 7f5bc502e700 1 --2- 172.21.15.3:0/3345360318 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5ba4060550 0x7f5ba4062a00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5bb00091e0 tx=0x7f5bb0017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:16.127 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.121+0000 7f5bb57fa700 1 -- 172.21.15.3:0/3345360318 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5bbc04c3d0 con 0x7f5bc006c3e0 2023-10-08T15:38:16.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.321+0000 7f5bc7292700 1 -- 172.21.15.3:0/3345360318 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5bc004b600 con 0x7f5bc006c3e0 2023-10-08T15:38:16.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.321+0000 7f5bb57fa700 1 -- 172.21.15.3:0/3345360318 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5bbc017020 con 0x7f5bc006c3e0 2023-10-08T15:38:16.495 INFO:teuthology.orchestra.run.smithi003.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T15:38:16.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.325+0000 7f5bc7292700 1 -- 172.21.15.3:0/3345360318 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5ba4060550 msgr2=0x7f5ba4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:16.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.325+0000 7f5bc7292700 1 --2- 172.21.15.3:0/3345360318 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5ba4060550 0x7f5ba4062a00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5bb00091e0 tx=0x7f5bb0017000 comp rx=0 tx=0).stop 2023-10-08T15:38:16.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.325+0000 7f5bc7292700 1 -- 172.21.15.3:0/3345360318 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5bc006c3e0 msgr2=0x7f5bc00bef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:16.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.325+0000 7f5bc7292700 1 --2- 172.21.15.3:0/3345360318 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5bc006c3e0 0x7f5bc00bef80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc00c7f0 tx=0x7f5bbc007e00 comp rx=0 tx=0).stop 2023-10-08T15:38:16.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.325+0000 7f5bc7292700 1 -- 172.21.15.3:0/3345360318 shutdown_connections 2023-10-08T15:38:16.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.325+0000 7f5bc7292700 1 --2- 172.21.15.3:0/3345360318 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5ba4060550 0x7f5ba4062a00 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:16.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.325+0000 7f5bc7292700 1 --2- 172.21.15.3:0/3345360318 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5bc00be150 0x7f5bc014db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:16.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.325+0000 7f5bc7292700 1 --2- 172.21.15.3:0/3345360318 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5bc006c3e0 0x7f5bc00bef80 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:16.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.325+0000 7f5bc7292700 1 --2- 172.21.15.3:0/3345360318 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5bc006be60 0x7f5bc009c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:16.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.325+0000 7f5bc7292700 1 -- 172.21.15.3:0/3345360318 >> 172.21.15.3:0/3345360318 conn(0x7f5bc006e460 msgr2=0x7f5bc014a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:16.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.325+0000 7f5bc7292700 1 -- 172.21.15.3:0/3345360318 shutdown_connections 2023-10-08T15:38:16.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:16.325+0000 7f5bc7292700 1 -- 172.21.15.3:0/3345360318 wait complete. 2023-10-08T15:38:16.499 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-08T15:38:16.499 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T15:38:16.500 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi089.front.sepia.ceph.com 2023-10-08T15:38:16.500 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-08T15:38:16.500 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T15:38:16.500 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-08T15:38:16.500 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-08T15:38:16.500 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T15:38:16.500 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T15:38:16.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:38:16.501 DEBUG:teuthology.orchestra.run.smithi089:> ip addr 2023-10-08T15:38:16.502 INFO:tasks.ceph.mds.a.smithi003.stderr:2023-10-08T15:38:16.477+0000 7f002ddec700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T15:38:16.509 INFO:teuthology.orchestra.run.smithi089.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T15:38:16.509 INFO:teuthology.orchestra.run.smithi089.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T15:38:16.510 INFO:teuthology.orchestra.run.smithi089.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T15:38:16.510 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:38:16.510 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 ::1/128 scope host 2023-10-08T15:38:16.510 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:38:16.510 INFO:teuthology.orchestra.run.smithi089.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T15:38:16.510 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c6 brd ff:ff:ff:ff:ff:ff 2023-10-08T15:38:16.510 INFO:teuthology.orchestra.run.smithi089.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T15:38:16.510 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c7 brd ff:ff:ff:ff:ff:ff 2023-10-08T15:38:16.510 INFO:teuthology.orchestra.run.smithi089.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T15:38:16.510 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:00 brd ff:ff:ff:ff:ff:ff 2023-10-08T15:38:16.510 INFO:teuthology.orchestra.run.smithi089.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T15:38:16.511 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:01 brd ff:ff:ff:ff:ff:ff 2023-10-08T15:38:16.511 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.21.15.89/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-08T15:38:16.511 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft 42500sec preferred_lft 42500sec 2023-10-08T15:38:16.511 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::ec4:7aff:fe8f:d501/64 scope link 2023-10-08T15:38:16.511 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:38:16.511 INFO:teuthology.orchestra.run.smithi089.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-08T15:38:16.511 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 02:42:0d:de:29:b2 brd ff:ff:ff:ff:ff:ff 2023-10-08T15:38:16.511 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-08T15:38:16.511 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:38:16.512 INFO:teuthology.orchestra.run.smithi089.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T15:38:16.512 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 96:c9:6f:4e:3d:df brd ff:ff:ff:ff:ff:ff 2023-10-08T15:38:16.512 INFO:teuthology.orchestra.run.smithi089.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T15:38:16.512 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:38:16.512 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::6c37:4fff:fe02:5a19/64 scope link 2023-10-08T15:38:16.512 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:38:16.512 INFO:teuthology.orchestra.run.smithi089.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T15:38:16.512 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 96:c9:6f:4e:3d:df brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T15:38:16.512 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::94c9:6fff:fe4e:3ddf/64 scope link 2023-10-08T15:38:16.512 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:38:16.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:38:16.513 DEBUG:teuthology.orchestra.run.smithi089:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T15:38:16.529 INFO:teuthology.orchestra.run.smithi089.stdout:1 2023-10-08T15:38:16.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:38:16.530 DEBUG:teuthology.orchestra.run.smithi089:> route 2023-10-08T15:38:16.581 INFO:teuthology.orchestra.run.smithi089.stdout:Kernel IP routing table 2023-10-08T15:38:16.581 INFO:teuthology.orchestra.run.smithi089.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T15:38:16.582 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-08T15:38:16.582 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-08T15:38:16.582 INFO:teuthology.orchestra.run.smithi089.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-08T15:38:16.582 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-10-08T15:38:16.582 INFO:teuthology.orchestra.run.smithi089.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-08T15:38:16.582 INFO:teuthology.orchestra.run.smithi089.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T15:38:16.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:38:16.583 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-10-08T15:38:16.583 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-10-08T15:38:16.583 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-08T15:38:16.583 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-08T15:38:16.583 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-08T15:38:16.583 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-10-08T15:38:16.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:38:16.623 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2023-10-08T15:38:16.628 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T15:38:16.628 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T15:38:16.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:38:16.629 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set brx.0 up 2023-10-08T15:38:16.650 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-08T15:38:16.650 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T15:38:16.650 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-08T15:38:16.699 INFO:teuthology.orchestra.run.smithi089.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-08T15:38:16.699 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T15:38:16.699 DEBUG:teuthology.orchestra.run.smithi089:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-08T15:38:16.706 DEBUG:teuthology.orchestra.run.smithi089:> sudo modprobe fuse 2023-10-08T15:38:16.721 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-08T15:38:16.721 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-08T15:38:16.735 INFO:teuthology.orchestra.run.smithi089.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-08T15:38:16.736 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-08T15:38:16.738 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:38:16.738 DEBUG:teuthology.orchestra.run.smithi089:> ls /sys/fs/fuse/connections 2023-10-08T15:38:16.742 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-08T15:38:16.742 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-08T15:38:16.786 DEBUG:teuthology.orchestra.run.smithi089:> sudo modprobe fuse 2023-10-08T15:38:16.802 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-08T15:38:16.802 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-08T15:38:16.812 INFO:teuthology.orchestra.run.smithi089.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-08T15:38:16.813 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-08T15:38:16.813 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:38:16.813 DEBUG:teuthology.orchestra.run.smithi089:> ls /sys/fs/fuse/connections 2023-10-08T15:38:16.869 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi089.stderr:2023-10-08T15:38:16.862+0000 7f9f61c68380 -1 init, newargv = 0x55c9c1006cf0 newargc=15 2023-10-08T15:38:16.869 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi089.stderr:ceph-fuse[28720]: starting ceph client 2023-10-08T15:38:16.878 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi089.stderr:ceph-fuse[28720]: starting fuse 2023-10-08T15:38:17.964 DEBUG:teuthology.orchestra.run.smithi089:> sudo modprobe fuse 2023-10-08T15:38:17.983 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-08T15:38:17.983 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-08T15:38:17.993 INFO:teuthology.orchestra.run.smithi089.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-08T15:38:17.994 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-08T15:38:17.994 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:38:17.994 DEBUG:teuthology.orchestra.run.smithi089:> ls /sys/fs/fuse/connections 2023-10-08T15:38:18.043 INFO:teuthology.orchestra.run.smithi089.stdout:52 2023-10-08T15:38:18.043 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-10-08T15:38:18.043 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-08T15:38:18.043 DEBUG:teuthology.orchestra.run.smithi089:> import glob 2023-10-08T15:38:18.043 DEBUG:teuthology.orchestra.run.smithi089:> import re 2023-10-08T15:38:18.043 DEBUG:teuthology.orchestra.run.smithi089:> import os 2023-10-08T15:38:18.043 DEBUG:teuthology.orchestra.run.smithi089:> import subprocess 2023-10-08T15:38:18.044 DEBUG:teuthology.orchestra.run.smithi089:> 2023-10-08T15:38:18.044 DEBUG:teuthology.orchestra.run.smithi089:> def _find_admin_socket(client_name): 2023-10-08T15:38:18.044 DEBUG:teuthology.orchestra.run.smithi089:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-08T15:38:18.044 DEBUG:teuthology.orchestra.run.smithi089:> files = glob.glob(asok_path) 2023-10-08T15:38:18.044 DEBUG:teuthology.orchestra.run.smithi089:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-08T15:38:18.044 DEBUG:teuthology.orchestra.run.smithi089:> 2023-10-08T15:38:18.044 DEBUG:teuthology.orchestra.run.smithi089:> # Given a non-glob path, it better be there 2023-10-08T15:38:18.044 DEBUG:teuthology.orchestra.run.smithi089:> if "*" not in asok_path: 2023-10-08T15:38:18.044 DEBUG:teuthology.orchestra.run.smithi089:> assert(len(files) == 1) 2023-10-08T15:38:18.044 DEBUG:teuthology.orchestra.run.smithi089:> return files[0] 2023-10-08T15:38:18.044 DEBUG:teuthology.orchestra.run.smithi089:> 2023-10-08T15:38:18.044 DEBUG:teuthology.orchestra.run.smithi089:> for f in files: 2023-10-08T15:38:18.044 DEBUG:teuthology.orchestra.run.smithi089:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-08T15:38:18.045 DEBUG:teuthology.orchestra.run.smithi089:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-08T15:38:18.045 DEBUG:teuthology.orchestra.run.smithi089:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-08T15:38:18.045 DEBUG:teuthology.orchestra.run.smithi089:> contents = proc_f.read() 2023-10-08T15:38:18.045 DEBUG:teuthology.orchestra.run.smithi089:> if mountpoint in contents: 2023-10-08T15:38:18.045 DEBUG:teuthology.orchestra.run.smithi089:> return f 2023-10-08T15:38:18.045 DEBUG:teuthology.orchestra.run.smithi089:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-08T15:38:18.045 DEBUG:teuthology.orchestra.run.smithi089:> 2023-10-08T15:38:18.045 DEBUG:teuthology.orchestra.run.smithi089:> print(_find_admin_socket("client.0")) 2023-10-08T15:38:18.045 DEBUG:teuthology.orchestra.run.smithi089:> ' 2023-10-08T15:38:18.124 INFO:teuthology.orchestra.run.smithi089.stdout:/var/run/ceph/ceph-client.0.28720.asok 2023-10-08T15:38:18.309 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.28720.asok 2023-10-08T15:38:18.310 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:38:18.310 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.28720.asok status 2023-10-08T15:38:18.403 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2023-10-08T15:38:18.403 INFO:teuthology.orchestra.run.smithi089.stdout: "metadata": { 2023-10-08T15:38:18.403 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph_sha1": "08cac0187919fc3a247efdf445f652e2fb30a647", 2023-10-08T15:38:18.403 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph_version": "ceph version 17.2.6-1320-g08cac018 (08cac0187919fc3a247efdf445f652e2fb30a647) quincy (stable)", 2023-10-08T15:38:18.403 INFO:teuthology.orchestra.run.smithi089.stdout: "entity_id": "0", 2023-10-08T15:38:18.403 INFO:teuthology.orchestra.run.smithi089.stdout: "hostname": "smithi089", 2023-10-08T15:38:18.403 INFO:teuthology.orchestra.run.smithi089.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-08T15:38:18.403 INFO:teuthology.orchestra.run.smithi089.stdout: "pid": "28720", 2023-10-08T15:38:18.404 INFO:teuthology.orchestra.run.smithi089.stdout: "root": "/" 2023-10-08T15:38:18.404 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-10-08T15:38:18.404 INFO:teuthology.orchestra.run.smithi089.stdout: "dentry_count": 0, 2023-10-08T15:38:18.404 INFO:teuthology.orchestra.run.smithi089.stdout: "dentry_pinned_count": 0, 2023-10-08T15:38:18.404 INFO:teuthology.orchestra.run.smithi089.stdout: "id": 5173, 2023-10-08T15:38:18.404 INFO:teuthology.orchestra.run.smithi089.stdout: "inst": { 2023-10-08T15:38:18.404 INFO:teuthology.orchestra.run.smithi089.stdout: "name": { 2023-10-08T15:38:18.404 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "client", 2023-10-08T15:38:18.404 INFO:teuthology.orchestra.run.smithi089.stdout: "num": 5173 2023-10-08T15:38:18.404 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-10-08T15:38:18.404 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": { 2023-10-08T15:38:18.404 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2023-10-08T15:38:18.405 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:0", 2023-10-08T15:38:18.405 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 148172236 2023-10-08T15:38:18.405 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-10-08T15:38:18.405 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-10-08T15:38:18.405 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": { 2023-10-08T15:38:18.405 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2023-10-08T15:38:18.405 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:0", 2023-10-08T15:38:18.405 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 148172236 2023-10-08T15:38:18.405 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-10-08T15:38:18.405 INFO:teuthology.orchestra.run.smithi089.stdout: "inst_str": "client.5173 172.21.15.89:0/148172236", 2023-10-08T15:38:18.405 INFO:teuthology.orchestra.run.smithi089.stdout: "addr_str": "172.21.15.89:0/148172236", 2023-10-08T15:38:18.405 INFO:teuthology.orchestra.run.smithi089.stdout: "inode_count": 1, 2023-10-08T15:38:18.406 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_epoch": 13, 2023-10-08T15:38:18.406 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_epoch": 29, 2023-10-08T15:38:18.406 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_epoch_barrier": 0, 2023-10-08T15:38:18.406 INFO:teuthology.orchestra.run.smithi089.stdout: "blocklisted": false, 2023-10-08T15:38:18.406 INFO:teuthology.orchestra.run.smithi089.stdout: "fs_name": "cephfs" 2023-10-08T15:38:18.406 INFO:teuthology.orchestra.run.smithi089.stdout:} 2023-10-08T15:38:18.412 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:38:18.413 DEBUG:teuthology.orchestra.run.smithi089:> stat --file-system '--printf=%T 2023-10-08T15:38:18.413 DEBUG:teuthology.orchestra.run.smithi089:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-08T15:38:18.420 INFO:teuthology.orchestra.run.smithi089.stdout:fuseblk 2023-10-08T15:38:18.420 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-08T15:38:18.420 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:38:18.420 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-08T15:38:18.434 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_min_caps_per_client 2023-10-08T15:38:18.549 INFO:teuthology.orchestra.run.smithi003.stdout:{"mds_min_caps_per_client":"100"} 2023-10-08T15:38:18.550 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_min_caps_per_client": "100" } 2023-10-08T15:38:18.551 DEBUG:teuthology.orchestra.run.smithi089:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-08T15:38:18.551 DEBUG:teuthology.orchestra.run.smithi089:> import os 2023-10-08T15:38:18.551 DEBUG:teuthology.orchestra.run.smithi089:> import uuid 2023-10-08T15:38:18.551 DEBUG:teuthology.orchestra.run.smithi089:> 2023-10-08T15:38:18.551 DEBUG:teuthology.orchestra.run.smithi089:> n = 1000 2023-10-08T15:38:18.552 DEBUG:teuthology.orchestra.run.smithi089:> create_hard_links = False 2023-10-08T15:38:18.552 DEBUG:teuthology.orchestra.run.smithi089:> if 0 > 0: 2023-10-08T15:38:18.552 DEBUG:teuthology.orchestra.run.smithi089:> create_hard_links = True 2023-10-08T15:38:18.552 DEBUG:teuthology.orchestra.run.smithi089:> path = "/home/ubuntu/cephtest/mnt.0/dc-dir/dc-file" 2023-10-08T15:38:18.552 DEBUG:teuthology.orchestra.run.smithi089:> 2023-10-08T15:38:18.552 DEBUG:teuthology.orchestra.run.smithi089:> dpath = os.path.dirname(path) 2023-10-08T15:38:18.552 DEBUG:teuthology.orchestra.run.smithi089:> fnameprefix = os.path.basename(path) 2023-10-08T15:38:18.553 DEBUG:teuthology.orchestra.run.smithi089:> os.makedirs(dpath, exist_ok=True) 2023-10-08T15:38:18.553 DEBUG:teuthology.orchestra.run.smithi089:> 2023-10-08T15:38:18.553 DEBUG:teuthology.orchestra.run.smithi089:> try: 2023-10-08T15:38:18.553 DEBUG:teuthology.orchestra.run.smithi089:> dirfd = os.open(dpath, os.O_DIRECTORY) 2023-10-08T15:38:18.553 DEBUG:teuthology.orchestra.run.smithi089:> 2023-10-08T15:38:18.553 DEBUG:teuthology.orchestra.run.smithi089:> for i in range(n): 2023-10-08T15:38:18.553 DEBUG:teuthology.orchestra.run.smithi089:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2023-10-08T15:38:18.553 DEBUG:teuthology.orchestra.run.smithi089:> with open(fpath, '"'"'w'"'"') as f: 2023-10-08T15:38:18.554 DEBUG:teuthology.orchestra.run.smithi089:> f.write(f"{i}") 2023-10-08T15:38:18.554 DEBUG:teuthology.orchestra.run.smithi089:> if True: 2023-10-08T15:38:18.554 DEBUG:teuthology.orchestra.run.smithi089:> f.flush() 2023-10-08T15:38:18.554 DEBUG:teuthology.orchestra.run.smithi089:> os.fsync(f.fileno()) 2023-10-08T15:38:18.554 DEBUG:teuthology.orchestra.run.smithi089:> if False: 2023-10-08T15:38:18.554 DEBUG:teuthology.orchestra.run.smithi089:> os.unlink(fpath) 2023-10-08T15:38:18.555 DEBUG:teuthology.orchestra.run.smithi089:> if False: 2023-10-08T15:38:18.555 DEBUG:teuthology.orchestra.run.smithi089:> os.fsync(dirfd) 2023-10-08T15:38:18.555 DEBUG:teuthology.orchestra.run.smithi089:> if create_hard_links: 2023-10-08T15:38:18.555 DEBUG:teuthology.orchestra.run.smithi089:> for j in range(0): 2023-10-08T15:38:18.555 DEBUG:teuthology.orchestra.run.smithi089:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2023-10-08T15:38:18.556 DEBUG:teuthology.orchestra.run.smithi089:> if False: 2023-10-08T15:38:18.556 DEBUG:teuthology.orchestra.run.smithi089:> os.fsync(dirfd) 2023-10-08T15:38:18.556 DEBUG:teuthology.orchestra.run.smithi089:> finally: 2023-10-08T15:38:18.556 DEBUG:teuthology.orchestra.run.smithi089:> os.close(dirfd) 2023-10-08T15:38:18.556 DEBUG:teuthology.orchestra.run.smithi089:> ' 2023-10-08T15:38:28.829 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:38:28.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:28.941+0000 7f41ace18700 1 Processor -- start 2023-10-08T15:38:28.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:28.941+0000 7f41ace18700 1 -- start start 2023-10-08T15:38:28.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:28.941+0000 7f41ace18700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f41a80be150 0x7f41a80be520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:28.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:28.941+0000 7f41ace18700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f41a806be60 0x7f41a80c26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:28.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:28.941+0000 7f41ace18700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41a806cb60 con 0x7f41a80c2be0 2023-10-08T15:38:28.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:28.941+0000 7f41ace18700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41a814f8e0 con 0x7f41a806be60 2023-10-08T15:38:28.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:28.941+0000 7f41ace18700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41a814f5f0 con 0x7f41a80be150 2023-10-08T15:38:28.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:28.941+0000 7f41a5d9b700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f41a806be60 0x7f41a80c26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:28.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:28.941+0000 7f41a5d9b700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f41a806be60 0x7f41a80c26a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:32794/0 (socket says 172.21.15.3:32794) 2023-10-08T15:38:28.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:28.941+0000 7f41a5d9b700 1 -- 172.21.15.3:0/2704447135 learned_addr learned my addr 172.21.15.3:0/2704447135 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:38:28.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:28.941+0000 7f41a659c700 1 --2- 172.21.15.3:0/2704447135 >> v2:172.21.15.50:3300/0 conn(0x7f41a80be150 0x7f41a80be520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:28.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:28.941+0000 7f41a5d9b700 1 -- 172.21.15.3:0/2704447135 >> v2:172.21.15.50:3300/0 conn(0x7f41a80be150 msgr2=0x7f41a80be520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:38:28.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:28.941+0000 7f41a5d9b700 1 --2- 172.21.15.3:0/2704447135 >> v2:172.21.15.50:3300/0 conn(0x7f41a80be150 0x7f41a80be520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:28.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:28.941+0000 7f41a5d9b700 1 -- 172.21.15.3:0/2704447135 >> v1:172.21.15.50:6789/0 conn(0x7f41a80c2be0 legacy=0x7f41a814b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:38:28.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:28.941+0000 7f41a5d9b700 1 -- 172.21.15.3:0/2704447135 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41a814bb00 con 0x7f41a806be60 2023-10-08T15:38:28.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:28.941+0000 7f41a5d9b700 1 --2- 172.21.15.3:0/2704447135 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f41a806be60 0x7f41a80c26a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f41a806ef20 tx=0x7f419c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3307c3aab95fc813 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:28.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:28.941+0000 7f41a559a700 1 -- 172.21.15.3:0/2704447135 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419c00b820 con 0x7f41a806be60 2023-10-08T15:38:28.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:28.941+0000 7f41a559a700 1 -- 172.21.15.3:0/2704447135 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f419c00b980 con 0x7f41a806be60 2023-10-08T15:38:28.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:28.941+0000 7f41a559a700 1 -- 172.21.15.3:0/2704447135 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419c00bd20 con 0x7f41a806be60 2023-10-08T15:38:28.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:28.941+0000 7f41ace18700 1 -- 172.21.15.3:0/2704447135 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f41a806be60 msgr2=0x7f41a80c26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:28.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:28.941+0000 7f41ace18700 1 --2- 172.21.15.3:0/2704447135 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f41a806be60 0x7f41a80c26a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f41a806ef20 tx=0x7f419c009250 comp rx=0 tx=0).stop 2023-10-08T15:38:28.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:28.941+0000 7f41ace18700 1 -- 172.21.15.3:0/2704447135 shutdown_connections 2023-10-08T15:38:28.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:28.941+0000 7f41ace18700 1 --2- 172.21.15.3:0/2704447135 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f41a806be60 0x7f41a80c26a0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:28.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:28.941+0000 7f41ace18700 1 --2- 172.21.15.3:0/2704447135 >> v2:172.21.15.50:3300/0 conn(0x7f41a80be150 0x7f41a80be520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:28.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:28.941+0000 7f41ace18700 1 -- 172.21.15.3:0/2704447135 >> 172.21.15.3:0/2704447135 conn(0x7f41a806e460 msgr2=0x7f41a80c1f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:28.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:28.941+0000 7f41ace18700 1 -- 172.21.15.3:0/2704447135 shutdown_connections 2023-10-08T15:38:28.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:28.941+0000 7f41ace18700 1 -- 172.21.15.3:0/2704447135 wait complete. 2023-10-08T15:38:28.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:28.945+0000 7f41ace18700 1 Processor -- start 2023-10-08T15:38:28.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:28.945+0000 7f41ace18700 1 -- start start 2023-10-08T15:38:28.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:28.945+0000 7f41ace18700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f41a806be60 0x7f41a809fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:28.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:28.945+0000 7f41ace18700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f41a80be150 0x7f41a80bd580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:28.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:28.945+0000 7f41ace18700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41a80c2be0 0x7f41a815e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:28.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:28.945+0000 7f41ace18700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a8148840 con 0x7f41a80be150 2023-10-08T15:38:28.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:28.945+0000 7f41ace18700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a8148560 con 0x7f41a80c2be0 2023-10-08T15:38:28.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:28.945+0000 7f41ace18700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41a80a1690 con 0x7f41a806be60 2023-10-08T15:38:28.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:28.945+0000 7f41a5d9b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f41a80be150 0x7f41a80bd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:28.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:28.945+0000 7f41a5d9b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f41a80be150 0x7f41a80bd580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:32798/0 (socket says 172.21.15.3:32798) 2023-10-08T15:38:28.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:28.945+0000 7f41a5d9b700 1 -- 172.21.15.3:0/622553114 learned_addr learned my addr 172.21.15.3:0/622553114 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:38:28.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:28.945+0000 7f41a659c700 1 --2- 172.21.15.3:0/622553114 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f41a806be60 0x7f41a809fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:28.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:28.945+0000 7f41a6d9d700 1 --2- 172.21.15.3:0/622553114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41a80c2be0 0x7f41a815e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:28.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:28.945+0000 7f41a5d9b700 1 -- 172.21.15.3:0/622553114 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f41a806be60 msgr2=0x7f41a809fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:28.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:28.945+0000 7f41a5d9b700 1 --2- 172.21.15.3:0/622553114 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f41a806be60 0x7f41a809fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:28.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:28.945+0000 7f41a5d9b700 1 -- 172.21.15.3:0/622553114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41a80c2be0 msgr2=0x7f41a815e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:28.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:28.945+0000 7f41a5d9b700 1 --2- 172.21.15.3:0/622553114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41a80c2be0 0x7f41a815e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:28.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:28.945+0000 7f41a5d9b700 1 -- 172.21.15.3:0/622553114 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f419c0094f0 con 0x7f41a80be150 2023-10-08T15:38:28.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:28.945+0000 7f41a6d9d700 1 --2- 172.21.15.3:0/622553114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41a80c2be0 0x7f41a815e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:38:28.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:28.945+0000 7f41a5d9b700 1 --2- 172.21.15.3:0/622553114 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f41a80be150 0x7f41a80bd580 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f419c009290 tx=0x7f419c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:28.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:28.945+0000 7f41967fc700 1 -- 172.21.15.3:0/622553114 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419c011d70 con 0x7f41a80be150 2023-10-08T15:38:28.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:28.945+0000 7f41967fc700 1 -- 172.21.15.3:0/622553114 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f419c020070 con 0x7f41a80be150 2023-10-08T15:38:28.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:28.945+0000 7f41ace18700 1 -- 172.21.15.3:0/622553114 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41a809f030 con 0x7f41a80be150 2023-10-08T15:38:28.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:28.949+0000 7f41967fc700 1 -- 172.21.15.3:0/622553114 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419c01b6a0 con 0x7f41a80be150 2023-10-08T15:38:28.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:28.949+0000 7f41ace18700 1 -- 172.21.15.3:0/622553114 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41a80a2240 con 0x7f41a80be150 2023-10-08T15:38:28.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:28.949+0000 7f41967fc700 1 -- 172.21.15.3:0/622553114 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f419c022030 con 0x7f41a80be150 2023-10-08T15:38:28.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:28.949+0000 7f41ace18700 1 -- 172.21.15.3:0/622553114 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41a81483c0 con 0x7f41a80be150 2023-10-08T15:38:28.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:28.949+0000 7f41967fc700 1 --2- 172.21.15.3:0/622553114 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f41900606d0 0x7f4190062b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:28.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:28.949+0000 7f41967fc700 1 -- 172.21.15.3:0/622553114 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f419c07e650 con 0x7f41a80be150 2023-10-08T15:38:28.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:28.949+0000 7f41a659c700 1 --2- 172.21.15.3:0/622553114 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f41900606d0 0x7f4190062b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:28.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:28.949+0000 7f41a659c700 1 --2- 172.21.15.3:0/622553114 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f41900606d0 0x7f4190062b80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4198006fd0 tx=0x7f4198008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:28.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:28.957+0000 7f41967fc700 1 -- 172.21.15.3:0/622553114 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f41a81483c0 con 0x7f41a80be150 2023-10-08T15:38:29.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.149+0000 7f41ace18700 1 -- 172.21.15.3:0/622553114 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f41a81483c0 con 0x7f41a80be150 2023-10-08T15:38:29.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.157+0000 7f41967fc700 1 -- 172.21.15.3:0/622553114 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+3079 (secure 0 0 0) 0x7f41a81483c0 con 0x7f41a80be150 2023-10-08T15:38:29.157 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:38:29.157 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4736,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3640212670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3640212670},{"type":"v1","addr":"172.21.15.50:6835","nonce":3640212670}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:38:10.891768+0000","modified":"2023-10-08T15:38:13.541239+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4989},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4989":{"gid":4989,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.3:6833/3457348695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":3457348695},{"type":"v1","addr":"172.21.15.3:6833","nonce":3457348695}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-08T15:38:29.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.157+0000 7f41ace18700 1 -- 172.21.15.3:0/622553114 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f41900606d0 msgr2=0x7f4190062b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:29.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.157+0000 7f41ace18700 1 --2- 172.21.15.3:0/622553114 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f41900606d0 0x7f4190062b80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4198006fd0 tx=0x7f4198008040 comp rx=0 tx=0).stop 2023-10-08T15:38:29.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.157+0000 7f41ace18700 1 -- 172.21.15.3:0/622553114 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f41a80be150 msgr2=0x7f41a80bd580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:29.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.157+0000 7f41ace18700 1 --2- 172.21.15.3:0/622553114 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f41a80be150 0x7f41a80bd580 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f419c009290 tx=0x7f419c016000 comp rx=0 tx=0).stop 2023-10-08T15:38:29.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.157+0000 7f41ace18700 1 -- 172.21.15.3:0/622553114 shutdown_connections 2023-10-08T15:38:29.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.157+0000 7f41ace18700 1 --2- 172.21.15.3:0/622553114 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f41900606d0 0x7f4190062b80 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:29.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.157+0000 7f41ace18700 1 --2- 172.21.15.3:0/622553114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41a80c2be0 0x7f41a815e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:29.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.157+0000 7f41ace18700 1 --2- 172.21.15.3:0/622553114 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f41a80be150 0x7f41a80bd580 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:29.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.157+0000 7f41ace18700 1 --2- 172.21.15.3:0/622553114 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f41a806be60 0x7f41a809fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:29.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.157+0000 7f41ace18700 1 -- 172.21.15.3:0/622553114 >> 172.21.15.3:0/622553114 conn(0x7f41a806e460 msgr2=0x7f41a80c2430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:29.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.157+0000 7f41ace18700 1 -- 172.21.15.3:0/622553114 shutdown_connections 2023-10-08T15:38:29.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.157+0000 7f41ace18700 1 -- 172.21.15.3:0/622553114 wait complete. 2023-10-08T15:38:29.161 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 13 2023-10-08T15:38:29.171 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_caps 20 2023-10-08T15:38:29.278 INFO:teuthology.orchestra.run.smithi003.stdout:{"success":"mds_recall_max_caps = '20' (not observed, change may require restart) "} 2023-10-08T15:38:29.279 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_caps = '20' (not observed, change may require restart) " } 2023-10-08T15:38:29.279 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:38:29.390 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.389+0000 7f1bb8f17700 1 Processor -- start 2023-10-08T15:38:29.390 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.389+0000 7f1bb8f17700 1 -- start start 2023-10-08T15:38:29.392 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.389+0000 7f1bb8f17700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1bb40bbf00 0x7f1bb40b3e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:29.392 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.389+0000 7f1bb8f17700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1bb40be470 0x7f1bb414d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:29.392 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.389+0000 7f1bb8f17700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f1bb414d7d0 0x7f1bb40670e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:29.392 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.389+0000 7f1bb8f17700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bb414a870 con 0x7f1bb414d7d0 2023-10-08T15:38:29.393 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.389+0000 7f1bb8f17700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bb414ce00 con 0x7f1bb40be470 2023-10-08T15:38:29.393 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.389+0000 7f1bb8f17700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb40b47f0 con 0x7f1bb40bbf00 2023-10-08T15:38:29.393 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.389+0000 7f1bb3fff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f1bb414d7d0 0x7f1bb40670e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:29.393 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.389+0000 7f1bb37fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1bb40bbf00 0x7f1bb40b3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:29.393 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.389+0000 7f1bb2ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1bb40be470 0x7f1bb414d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:29.393 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.389+0000 7f1bb37fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1bb40bbf00 0x7f1bb40b3e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.3:33684/0 (socket says 172.21.15.3:33684) 2023-10-08T15:38:29.393 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.389+0000 7f1bb37fe700 1 -- 172.21.15.3:0/2006313539 learned_addr learned my addr 172.21.15.3:0/2006313539 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:38:29.393 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.389+0000 7f1bb2ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1bb40be470 0x7f1bb414d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.3:50066/0 (socket says 172.21.15.3:50066) 2023-10-08T15:38:29.393 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.389+0000 7f1bb3fff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f1bb414d7d0 0x7f1bb40670e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:32800/0 (socket says 172.21.15.3:32800) 2023-10-08T15:38:29.394 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.389+0000 7f1bb37fe700 1 -- 172.21.15.3:0/2006313539 >> v2:172.21.15.50:3300/0 conn(0x7f1bb40be470 msgr2=0x7f1bb414d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:38:29.394 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.389+0000 7f1bb37fe700 1 --2- 172.21.15.3:0/2006313539 >> v2:172.21.15.50:3300/0 conn(0x7f1bb40be470 0x7f1bb414d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:29.394 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.389+0000 7f1bb37fe700 1 -- 172.21.15.3:0/2006313539 >> v2:172.21.15.3:3300/0 conn(0x7f1bb414d7d0 msgr2=0x7f1bb40670e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:38:29.394 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.389+0000 7f1bb37fe700 1 --2- 172.21.15.3:0/2006313539 >> v2:172.21.15.3:3300/0 conn(0x7f1bb414d7d0 0x7f1bb40670e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:29.394 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.389+0000 7f1bb37fe700 1 -- 172.21.15.3:0/2006313539 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bb40b4510 con 0x7f1bb40bbf00 2023-10-08T15:38:29.394 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.389+0000 7f1bb2ffd700 1 --2- 172.21.15.3:0/2006313539 >> v2:172.21.15.50:3300/0 conn(0x7f1bb40be470 0x7f1bb414d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:38:29.394 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.389+0000 7f1bb37fe700 1 --2- 172.21.15.3:0/2006313539 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1bb40bbf00 0x7f1bb40b3e40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1bb40bc690 tx=0x7f1ba4009220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40097a835c6fbb26 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:29.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.389+0000 7f1bb27fc700 1 -- 172.21.15.3:0/2006313539 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba4005c10 con 0x7f1bb40bbf00 2023-10-08T15:38:29.396 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.393+0000 7f1bb27fc700 1 -- 172.21.15.3:0/2006313539 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ba4005d70 con 0x7f1bb40bbf00 2023-10-08T15:38:29.396 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.393+0000 7f1bb27fc700 1 -- 172.21.15.3:0/2006313539 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba4006260 con 0x7f1bb40bbf00 2023-10-08T15:38:29.396 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.393+0000 7f1bb8f17700 1 -- 172.21.15.3:0/2006313539 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1bb40bbf00 msgr2=0x7f1bb40b3e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:29.396 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.393+0000 7f1bb8f17700 1 --2- 172.21.15.3:0/2006313539 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1bb40bbf00 0x7f1bb40b3e40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1bb40bc690 tx=0x7f1ba4009220 comp rx=0 tx=0).stop 2023-10-08T15:38:29.396 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.393+0000 7f1bb8f17700 1 -- 172.21.15.3:0/2006313539 shutdown_connections 2023-10-08T15:38:29.396 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.393+0000 7f1bb8f17700 1 --2- 172.21.15.3:0/2006313539 >> v2:172.21.15.3:3300/0 conn(0x7f1bb414d7d0 0x7f1bb40670e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:29.396 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.393+0000 7f1bb8f17700 1 --2- 172.21.15.3:0/2006313539 >> v2:172.21.15.50:3300/0 conn(0x7f1bb40be470 0x7f1bb414d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:29.396 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.393+0000 7f1bb8f17700 1 --2- 172.21.15.3:0/2006313539 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1bb40bbf00 0x7f1bb40b3e40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:29.396 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.393+0000 7f1bb8f17700 1 -- 172.21.15.3:0/2006313539 >> 172.21.15.3:0/2006313539 conn(0x7f1bb40bf5e0 msgr2=0x7f1bb40bb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:29.396 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.393+0000 7f1bb8f17700 1 -- 172.21.15.3:0/2006313539 shutdown_connections 2023-10-08T15:38:29.397 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.393+0000 7f1bb8f17700 1 -- 172.21.15.3:0/2006313539 wait complete. 2023-10-08T15:38:29.397 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.393+0000 7f1bb8f17700 1 Processor -- start 2023-10-08T15:38:29.397 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.393+0000 7f1bb8f17700 1 -- start start 2023-10-08T15:38:29.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.397+0000 7f1bb8f17700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1bb40bbf00 0x7f1bb40b6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:29.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.397+0000 7f1bb8f17700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1bb40be470 0x7f1bb4095ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:29.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.397+0000 7f1bb8f17700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1bb414d7d0 0x7f1bb4159340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:29.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.397+0000 7f1bb8f17700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb40baca0 con 0x7f1bb40bbf00 2023-10-08T15:38:29.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.397+0000 7f1bb8f17700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb40961e0 con 0x7f1bb40be470 2023-10-08T15:38:29.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.397+0000 7f1bb8f17700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb40baef0 con 0x7f1bb414d7d0 2023-10-08T15:38:29.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.397+0000 7f1bb37fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1bb40bbf00 0x7f1bb40b6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:29.400 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.397+0000 7f1bb37fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1bb40bbf00 0x7f1bb40b6d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:32808/0 (socket says 172.21.15.3:32808) 2023-10-08T15:38:29.400 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.397+0000 7f1bb37fe700 1 -- 172.21.15.3:0/3755291380 learned_addr learned my addr 172.21.15.3:0/3755291380 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:38:29.400 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.397+0000 7f1bb3fff700 1 --2- 172.21.15.3:0/3755291380 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1bb414d7d0 0x7f1bb4159340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:29.400 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.397+0000 7f1bb2ffd700 1 --2- 172.21.15.3:0/3755291380 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1bb40be470 0x7f1bb4095ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:29.400 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.397+0000 7f1bb37fe700 1 -- 172.21.15.3:0/3755291380 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1bb414d7d0 msgr2=0x7f1bb4159340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:29.400 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.397+0000 7f1bb37fe700 1 --2- 172.21.15.3:0/3755291380 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1bb414d7d0 0x7f1bb4159340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:29.400 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.397+0000 7f1bb37fe700 1 -- 172.21.15.3:0/3755291380 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1bb40be470 msgr2=0x7f1bb4095ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:29.400 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.397+0000 7f1bb37fe700 1 --2- 172.21.15.3:0/3755291380 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1bb40be470 0x7f1bb4095ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:29.400 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.397+0000 7f1bb37fe700 1 -- 172.21.15.3:0/3755291380 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ba8009420 con 0x7f1bb40bbf00 2023-10-08T15:38:29.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.397+0000 7f1bb2ffd700 1 --2- 172.21.15.3:0/3755291380 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1bb40be470 0x7f1bb4095ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:38:29.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.397+0000 7f1bb37fe700 1 --2- 172.21.15.3:0/3755291380 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1bb40bbf00 0x7f1bb40b6d20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1ba4009f50 tx=0x7f1ba4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:29.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.397+0000 7f1b9b7fe700 1 -- 172.21.15.3:0/3755291380 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba4011800 con 0x7f1bb40bbf00 2023-10-08T15:38:29.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.397+0000 7f1b9b7fe700 1 -- 172.21.15.3:0/3755291380 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ba4020070 con 0x7f1bb40bbf00 2023-10-08T15:38:29.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.397+0000 7f1bb8f17700 1 -- 172.21.15.3:0/3755291380 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ba4009480 con 0x7f1bb40bbf00 2023-10-08T15:38:29.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.397+0000 7f1b9b7fe700 1 -- 172.21.15.3:0/3755291380 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba4011b90 con 0x7f1bb40bbf00 2023-10-08T15:38:29.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.397+0000 7f1bb8f17700 1 -- 172.21.15.3:0/3755291380 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bb4158ad0 con 0x7f1bb40bbf00 2023-10-08T15:38:29.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.397+0000 7f1bb8f17700 1 -- 172.21.15.3:0/3755291380 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bb4158c60 con 0x7f1bb40bbf00 2023-10-08T15:38:29.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.401+0000 7f1b9b7fe700 1 -- 172.21.15.3:0/3755291380 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f1ba4022030 con 0x7f1bb40bbf00 2023-10-08T15:38:29.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.401+0000 7f1b9b7fe700 1 --2- 172.21.15.3:0/3755291380 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1ba0060550 0x7f1ba0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:29.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.401+0000 7f1b9b7fe700 1 -- 172.21.15.3:0/3755291380 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1ba407e2a0 con 0x7f1bb40bbf00 2023-10-08T15:38:29.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.401+0000 7f1bb2ffd700 1 --2- 172.21.15.3:0/3755291380 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1ba0060550 0x7f1ba0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:29.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.401+0000 7f1bb2ffd700 1 --2- 172.21.15.3:0/3755291380 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1ba0060550 0x7f1ba0062a00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1ba80093f0 tx=0x7f1ba8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:29.408 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.405+0000 7f1b9b7fe700 1 -- 172.21.15.3:0/3755291380 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1ba404e890 con 0x7f1bb40bbf00 2023-10-08T15:38:29.610 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.609+0000 7f1bb8f17700 1 -- 172.21.15.3:0/3755291380 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1bb405ecf0 con 0x7f1bb40bbf00 2023-10-08T15:38:29.610 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.609+0000 7f1b9b7fe700 1 -- 172.21.15.3:0/3755291380 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+3079 (secure 0 0 0) 0x7f1ba4051eb0 con 0x7f1bb40bbf00 2023-10-08T15:38:29.611 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:38:29.611 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4736,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3640212670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3640212670},{"type":"v1","addr":"172.21.15.50:6835","nonce":3640212670}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:38:10.891768+0000","modified":"2023-10-08T15:38:13.541239+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4989},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4989":{"gid":4989,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.3:6833/3457348695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":3457348695},{"type":"v1","addr":"172.21.15.3:6833","nonce":3457348695}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-08T15:38:29.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.609+0000 7f1bb8f17700 1 -- 172.21.15.3:0/3755291380 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1ba0060550 msgr2=0x7f1ba0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:29.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.609+0000 7f1bb8f17700 1 --2- 172.21.15.3:0/3755291380 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1ba0060550 0x7f1ba0062a00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1ba80093f0 tx=0x7f1ba8008040 comp rx=0 tx=0).stop 2023-10-08T15:38:29.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.609+0000 7f1bb8f17700 1 -- 172.21.15.3:0/3755291380 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1bb40bbf00 msgr2=0x7f1bb40b6d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:29.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.609+0000 7f1bb8f17700 1 --2- 172.21.15.3:0/3755291380 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1bb40bbf00 0x7f1bb40b6d20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1ba4009f50 tx=0x7f1ba4016000 comp rx=0 tx=0).stop 2023-10-08T15:38:29.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.609+0000 7f1bb8f17700 1 -- 172.21.15.3:0/3755291380 shutdown_connections 2023-10-08T15:38:29.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.609+0000 7f1bb8f17700 1 --2- 172.21.15.3:0/3755291380 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1ba0060550 0x7f1ba0062a00 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:29.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.609+0000 7f1bb8f17700 1 --2- 172.21.15.3:0/3755291380 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1bb414d7d0 0x7f1bb4159340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:29.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.609+0000 7f1bb8f17700 1 --2- 172.21.15.3:0/3755291380 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1bb40be470 0x7f1bb4095ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:29.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.609+0000 7f1bb8f17700 1 --2- 172.21.15.3:0/3755291380 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1bb40bbf00 0x7f1bb40b6d20 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:29.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.609+0000 7f1bb8f17700 1 -- 172.21.15.3:0/3755291380 >> 172.21.15.3:0/3755291380 conn(0x7f1bb40bf5e0 msgr2=0x7f1bb40bcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:29.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.609+0000 7f1bb8f17700 1 -- 172.21.15.3:0/3755291380 shutdown_connections 2023-10-08T15:38:29.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.609+0000 7f1bb8f17700 1 -- 172.21.15.3:0/3755291380 wait complete. 2023-10-08T15:38:29.615 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 13 2023-10-08T15:38:29.624 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_decay_threshold 400 2023-10-08T15:38:29.727 INFO:teuthology.orchestra.run.smithi003.stdout:{"success":"mds_recall_max_decay_threshold = '400' (not observed, change may require restart) "} 2023-10-08T15:38:29.727 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_decay_threshold = '400' (not observed, change may require restart) " } 2023-10-08T15:38:29.728 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 cache drop 2023-10-08T15:38:29.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.841+0000 7f5f4f59e700 1 Processor -- start 2023-10-08T15:38:29.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.841+0000 7f5f4f59e700 1 -- start start 2023-10-08T15:38:29.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.841+0000 7f5f4f59e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5f500b9ff0 0x7f5f500a1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:29.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.841+0000 7f5f4f59e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5f500a1c50 0x7f5f50147b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:29.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.841+0000 7f5f4f59e700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f5014baf0 con 0x7f5f50068e50 2023-10-08T15:38:29.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.841+0000 7f5f4f59e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f5014b880 con 0x7f5f500b9ff0 2023-10-08T15:38:29.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.841+0000 7f5f4f59e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f500a0250 con 0x7f5f500a1c50 2023-10-08T15:38:29.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.841+0000 7f5f4e59c700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f5f50068e50 0x7f5f500a0a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:46792/0 (socket says 172.21.15.3:46792) 2023-10-08T15:38:29.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.841+0000 7f5f4e59c700 1 -- 172.21.15.3:0/2066876210 learned_addr learned my addr 172.21.15.3:0/2066876210 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:38:29.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.841+0000 7f5f4dd9b700 1 --2- 172.21.15.3:0/2066876210 >> v2:172.21.15.50:3300/0 conn(0x7f5f500b9ff0 0x7f5f500a1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:29.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.841+0000 7f5f4ed9d700 1 --2- 172.21.15.3:0/2066876210 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5f500a1c50 0x7f5f50147b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:29.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.841+0000 7f5f4d59a700 1 -- 172.21.15.3:0/2066876210 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1780062913 0 0) 0x7f5f5014baf0 con 0x7f5f50068e50 2023-10-08T15:38:29.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.841+0000 7f5f4d59a700 1 -- 172.21.15.3:0/2066876210 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f38003570 con 0x7f5f50068e50 2023-10-08T15:38:29.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.841+0000 7f5f4dd9b700 1 -- 172.21.15.3:0/2066876210 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5f500a1c50 msgr2=0x7f5f50147b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:38:29.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.841+0000 7f5f4dd9b700 1 --2- 172.21.15.3:0/2066876210 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5f500a1c50 0x7f5f50147b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:29.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.841+0000 7f5f4dd9b700 1 -- 172.21.15.3:0/2066876210 >> v1:172.21.15.3:6789/0 conn(0x7f5f50068e50 legacy=0x7f5f500a0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:29.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.841+0000 7f5f4d59a700 1 -- 172.21.15.3:0/2066876210 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1132641761 0 0) 0x7f5f38003570 con 0x7f5f50068e50 2023-10-08T15:38:29.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.841+0000 7f5f4dd9b700 1 -- 172.21.15.3:0/2066876210 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f5009ff70 con 0x7f5f500b9ff0 2023-10-08T15:38:29.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.841+0000 7f5f4ed9d700 1 --2- 172.21.15.3:0/2066876210 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5f500a1c50 0x7f5f50147b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:38:29.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.841+0000 7f5f4dd9b700 1 --2- 172.21.15.3:0/2066876210 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f500b9ff0 0x7f5f500a1140 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5f400098e0 tx=0x7f5f400091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5cd1f5cf457ba24a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:29.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.845+0000 7f5f4d59a700 1 -- 172.21.15.3:0/2066876210 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f44001470 con 0x7f5f500b9ff0 2023-10-08T15:38:29.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.845+0000 7f5f4d59a700 1 -- 172.21.15.3:0/2066876210 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f40011420 con 0x7f5f500b9ff0 2023-10-08T15:38:29.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.845+0000 7f5f4d59a700 1 -- 172.21.15.3:0/2066876210 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f400117a0 con 0x7f5f500b9ff0 2023-10-08T15:38:29.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.845+0000 7f5f4f59e700 1 -- 172.21.15.3:0/2066876210 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f500b9ff0 msgr2=0x7f5f500a1140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:29.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.845+0000 7f5f4f59e700 1 --2- 172.21.15.3:0/2066876210 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f500b9ff0 0x7f5f500a1140 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5f400098e0 tx=0x7f5f400091a0 comp rx=0 tx=0).stop 2023-10-08T15:38:29.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.845+0000 7f5f4f59e700 1 -- 172.21.15.3:0/2066876210 shutdown_connections 2023-10-08T15:38:29.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.845+0000 7f5f4f59e700 1 --2- 172.21.15.3:0/2066876210 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5f500a1c50 0x7f5f50147b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:29.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.845+0000 7f5f4f59e700 1 --2- 172.21.15.3:0/2066876210 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f500b9ff0 0x7f5f500a1140 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:29.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.845+0000 7f5f4f59e700 1 -- 172.21.15.3:0/2066876210 >> 172.21.15.3:0/2066876210 conn(0x7f5f500bd9c0 msgr2=0x7f5f500bdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:29.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.845+0000 7f5f4f59e700 1 -- 172.21.15.3:0/2066876210 shutdown_connections 2023-10-08T15:38:29.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.845+0000 7f5f4f59e700 1 -- 172.21.15.3:0/2066876210 wait complete. 2023-10-08T15:38:29.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.845+0000 7f5f4f59e700 1 Processor -- start 2023-10-08T15:38:29.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.845+0000 7f5f4f59e700 1 -- start start 2023-10-08T15:38:29.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.849+0000 7f5f4f59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f50068e50 0x7f5f50146020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:29.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.849+0000 7f5f4f59e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5f500a1c50 0x7f5f5015c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:29.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.849+0000 7f5f4f59e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5f500b9ff0 0x7f5f5006e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:29.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.849+0000 7f5f4f59e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5015c930 con 0x7f5f500a1c50 2023-10-08T15:38:29.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.849+0000 7f5f4f59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5006ef20 con 0x7f5f50068e50 2023-10-08T15:38:29.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.849+0000 7f5f4f59e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5015cbe0 con 0x7f5f500b9ff0 2023-10-08T15:38:29.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.849+0000 7f5f4dd9b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5f500a1c50 0x7f5f5015c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:29.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.849+0000 7f5f4dd9b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5f500a1c50 0x7f5f5015c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:32812/0 (socket says 172.21.15.3:32812) 2023-10-08T15:38:29.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.849+0000 7f5f4dd9b700 1 -- 172.21.15.3:0/3418483591 learned_addr learned my addr 172.21.15.3:0/3418483591 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:38:29.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.849+0000 7f5f4ed9d700 1 --2- 172.21.15.3:0/3418483591 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5f500b9ff0 0x7f5f5006e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:29.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.849+0000 7f5f4e59c700 1 --2- 172.21.15.3:0/3418483591 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f50068e50 0x7f5f50146020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:29.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.849+0000 7f5f4dd9b700 1 -- 172.21.15.3:0/3418483591 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5f500b9ff0 msgr2=0x7f5f5006e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:29.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.849+0000 7f5f4dd9b700 1 --2- 172.21.15.3:0/3418483591 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5f500b9ff0 0x7f5f5006e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:29.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.849+0000 7f5f4dd9b700 1 -- 172.21.15.3:0/3418483591 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f50068e50 msgr2=0x7f5f50146020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:29.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.849+0000 7f5f4dd9b700 1 --2- 172.21.15.3:0/3418483591 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f50068e50 0x7f5f50146020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:29.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.849+0000 7f5f4dd9b700 1 -- 172.21.15.3:0/3418483591 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f48009a20 con 0x7f5f500a1c50 2023-10-08T15:38:29.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.849+0000 7f5f4e59c700 1 --2- 172.21.15.3:0/3418483591 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f50068e50 0x7f5f50146020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:38:29.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.849+0000 7f5f4dd9b700 1 --2- 172.21.15.3:0/3418483591 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5f500a1c50 0x7f5f5015c3f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5f50063960 tx=0x7f5f40016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:29.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.849+0000 7f5f3e7fc700 1 -- 172.21.15.3:0/3418483591 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4001cb60 con 0x7f5f500a1c50 2023-10-08T15:38:29.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.849+0000 7f5f3e7fc700 1 -- 172.21.15.3:0/3418483591 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f4001cce0 con 0x7f5f500a1c50 2023-10-08T15:38:29.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.849+0000 7f5f4f59e700 1 -- 172.21.15.3:0/3418483591 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f40009420 con 0x7f5f500a1c50 2023-10-08T15:38:29.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.849+0000 7f5f3e7fc700 1 -- 172.21.15.3:0/3418483591 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4001a6a0 con 0x7f5f500a1c50 2023-10-08T15:38:29.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.849+0000 7f5f4f59e700 1 -- 172.21.15.3:0/3418483591 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f50158c70 con 0x7f5f500a1c50 2023-10-08T15:38:29.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.853+0000 7f5f3e7fc700 1 -- 172.21.15.3:0/3418483591 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5f4001aa90 con 0x7f5f500a1c50 2023-10-08T15:38:29.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.853+0000 7f5f3e7fc700 1 --2- 172.21.15.3:0/3418483591 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5f30060550 0x7f5f30062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:29.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.853+0000 7f5f3e7fc700 1 -- 172.21.15.3:0/3418483591 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5f4007dea0 con 0x7f5f500a1c50 2023-10-08T15:38:29.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.853+0000 7f5f4e59c700 1 --2- 172.21.15.3:0/3418483591 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5f30060550 0x7f5f30062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:29.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.853+0000 7f5f4e59c700 1 --2- 172.21.15.3:0/3418483591 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5f30060550 0x7f5f30062a00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5f44005d40 tx=0x7f5f44001580 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:29.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.853+0000 7f5f571c3740 1 Processor -- start 2023-10-08T15:38:29.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.853+0000 7f5f571c3740 1 -- start start 2023-10-08T15:38:29.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.853+0000 7f5f571c3740 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0xfb8bd0 0x11f12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:29.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.853+0000 7f5f571c3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xfb8800 0x11ee900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:29.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.853+0000 7f5f571c3740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1003880 0x11eee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:29.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.853+0000 7f5f571c3740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x1163fb0 con 0x1003880 2023-10-08T15:38:29.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.853+0000 7f5f571c3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x115ff50 con 0xfb8800 2023-10-08T15:38:29.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.853+0000 7f5f571c3740 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x1126180 con 0xfb8bd0 2023-10-08T15:38:29.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.857+0000 7f5f4ed9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1003880 0x11eee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:29.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.857+0000 7f5f4ed9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1003880 0x11eee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:32816/0 (socket says 172.21.15.3:32816) 2023-10-08T15:38:29.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.857+0000 7f5f4ed9d700 1 -- 172.21.15.3:0/3951565302 learned_addr learned my addr 172.21.15.3:0/3951565302 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:38:29.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.857+0000 7f5f4e59c700 1 --2- 172.21.15.3:0/3951565302 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0xfb8bd0 0x11f12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:29.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.857+0000 7f5f4dd9b700 1 --2- 172.21.15.3:0/3951565302 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xfb8800 0x11ee900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:29.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.857+0000 7f5f4ed9d700 1 -- 172.21.15.3:0/3951565302 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0xfb8bd0 msgr2=0x11f12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:38:29.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.857+0000 7f5f4ed9d700 1 --2- 172.21.15.3:0/3951565302 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0xfb8bd0 0x11f12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:29.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.857+0000 7f5f4ed9d700 1 -- 172.21.15.3:0/3951565302 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xfb8800 msgr2=0x11ee900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:38:29.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.857+0000 7f5f4ed9d700 1 --2- 172.21.15.3:0/3951565302 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xfb8800 0x11ee900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:29.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.857+0000 7f5f4ed9d700 1 -- 172.21.15.3:0/3951565302 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1004ad0 con 0x1003880 2023-10-08T15:38:29.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.857+0000 7f5f4ed9d700 1 --2- 172.21.15.3:0/3951565302 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1003880 0x11eee40 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5f4800f610 tx=0x7f5f4800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dacdc8ba8d3d4f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:29.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.857+0000 7f5f2f7fe700 1 -- 172.21.15.3:0/3951565302 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4800e040 con 0x1003880 2023-10-08T15:38:29.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.857+0000 7f5f2f7fe700 1 -- 172.21.15.3:0/3951565302 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f4800f040 con 0x1003880 2023-10-08T15:38:29.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.857+0000 7f5f2f7fe700 1 -- 172.21.15.3:0/3951565302 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f48015890 con 0x1003880 2023-10-08T15:38:29.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.857+0000 7f5f571c3740 1 -- 172.21.15.3:0/3951565302 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1003880 msgr2=0x11eee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:29.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.857+0000 7f5f571c3740 1 --2- 172.21.15.3:0/3951565302 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1003880 0x11eee40 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5f4800f610 tx=0x7f5f4800b040 comp rx=0 tx=0).stop 2023-10-08T15:38:29.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.857+0000 7f5f571c3740 1 -- 172.21.15.3:0/3951565302 shutdown_connections 2023-10-08T15:38:29.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.857+0000 7f5f571c3740 1 --2- 172.21.15.3:0/3951565302 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1003880 0x11eee40 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:29.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.857+0000 7f5f571c3740 1 --2- 172.21.15.3:0/3951565302 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xfb8800 0x11ee900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:29.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.857+0000 7f5f571c3740 1 --2- 172.21.15.3:0/3951565302 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0xfb8bd0 0x11f12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:29.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.857+0000 7f5f571c3740 1 -- 172.21.15.3:0/3951565302 >> 172.21.15.3:0/3951565302 conn(0xfb8fa0 msgr2=0x11ed1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:29.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.857+0000 7f5f571c3740 1 -- 172.21.15.3:0/3951565302 shutdown_connections 2023-10-08T15:38:29.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.857+0000 7f5f571c3740 1 -- 172.21.15.3:0/3951565302 wait complete. 2023-10-08T15:38:29.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.861+0000 7f5f571c3740 1 -- start start 2023-10-08T15:38:29.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.861+0000 7f5f571c3740 1 Processor -- start 2023-10-08T15:38:29.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.861+0000 7f5f571c3740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0xfb8800 0x11f06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:29.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.861+0000 7f5f571c3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xfb8bd0 0x11f3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:29.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.861+0000 7f5f571c3740 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1003880 0x11f4520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:29.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.861+0000 7f5f571c3740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x1125e20 con 0xfb8800 2023-10-08T15:38:29.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.861+0000 7f5f571c3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x10fe980 con 0xfb8bd0 2023-10-08T15:38:29.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.861+0000 7f5f571c3740 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x110bed0 con 0x1003880 2023-10-08T15:38:29.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.861+0000 7f5f4e59c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0xfb8800 0x11f06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:29.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.861+0000 7f5f571c3740 10 client.0 _ll_register_callbacks cb 0x1102c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T15:38:29.867 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.861+0000 7f5f4e59c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0xfb8800 0x11f06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:32822/0 (socket says 172.21.15.3:32822) 2023-10-08T15:38:29.867 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.861+0000 7f5f4e59c700 1 -- 172.21.15.3:0/1159393258 learned_addr learned my addr 172.21.15.3:0/1159393258 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:38:29.867 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.861+0000 7f5f4dd9b700 1 --2- 172.21.15.3:0/1159393258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xfb8bd0 0x11f3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:29.867 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.861+0000 7f5f4ed9d700 1 --2- 172.21.15.3:0/1159393258 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1003880 0x11f4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:29.867 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.861+0000 7f5f4e59c700 1 -- 172.21.15.3:0/1159393258 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1003880 msgr2=0x11f4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:38:29.867 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.861+0000 7f5f4e59c700 1 --2- 172.21.15.3:0/1159393258 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1003880 0x11f4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:29.867 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.861+0000 7f5f4e59c700 1 -- 172.21.15.3:0/1159393258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xfb8bd0 msgr2=0x11f3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:38:29.867 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.861+0000 7f5f4e59c700 1 --2- 172.21.15.3:0/1159393258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xfb8bd0 0x11f3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:29.867 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.861+0000 7f5f4e59c700 1 -- 172.21.15.3:0/1159393258 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f4800f340 con 0xfb8800 2023-10-08T15:38:29.868 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.861+0000 7f5f4dd9b700 1 --2- 172.21.15.3:0/1159393258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xfb8bd0 0x11f3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:38:29.868 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.861+0000 7f5f4e59c700 1 --2- 172.21.15.3:0/1159393258 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0xfb8800 0x11f06b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5f440137d0 tx=0x7f5f44013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=123039c66f819b30 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:29.868 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.861+0000 7f5f2cff9700 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2023-10-08T15:38:29.868 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.861+0000 7f5f2cff9700 1 -- 172.21.15.3:0/1159393258 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f44012590 con 0xfb8800 2023-10-08T15:38:29.868 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.861+0000 7f5f2cff9700 1 -- 172.21.15.3:0/1159393258 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5f44023af0 con 0xfb8800 2023-10-08T15:38:29.868 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.865+0000 7f5f571c3740 1 -- 172.21.15.3:0/1159393258 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1102460 con 0xfb8800 2023-10-08T15:38:29.868 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.865+0000 7f5f2cff9700 1 -- 172.21.15.3:0/1159393258 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f440126f0 con 0xfb8800 2023-10-08T15:38:29.868 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.865+0000 7f5f571c3740 10 client.5196 fetch_fsmap learned FSMap version 13 2023-10-08T15:38:29.869 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.865+0000 7f5f571c3740 1 -- 172.21.15.3:0/1159393258 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) v3 -- 0x112e380 con 0xfb8800 2023-10-08T15:38:29.869 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.865+0000 7f5f2cff9700 1 -- 172.21.15.3:0/1159393258 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1102460 con 0xfb8800 2023-10-08T15:38:29.869 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.865+0000 7f5f2cff9700 1 -- 172.21.15.3:0/1159393258 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 13) v1 ==== 2010+0+0 (secure 0 0 0) 0x7f5f44012850 con 0xfb8800 2023-10-08T15:38:29.869 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.865+0000 7f5f571c3740 10 client.5196 fetch_fsmap finished waiting for FSMap version 13 2023-10-08T15:38:29.869 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.865+0000 7f5f571c3740 10 client.5196 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2023-10-08T15:38:29.869 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.865+0000 7f5f571c3740 20 client.5196 populate_metadata read hostname 'smithi003' 2023-10-08T15:38:29.869 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.865+0000 7f5f571c3740 1 --2- 172.21.15.3:0/1159393258 >> [v2:172.21.15.3:6832/3457348695,v1:172.21.15.3:6833/3457348695] conn(0x122c800 0x1237720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:29.869 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.865+0000 7f5f571c3740 4 client.5196 mds_command: new command op to 4989 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-08T15:38:29.869 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.865+0000 7f5f571c3740 1 -- 172.21.15.3:0/1159393258 --> [v2:172.21.15.3:6832/3457348695,v1:172.21.15.3:6833/3457348695] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1134420 con 0x122c800 2023-10-08T15:38:29.869 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.865+0000 7f5f4dd9b700 1 --2- 172.21.15.3:0/1159393258 >> [v2:172.21.15.3:6832/3457348695,v1:172.21.15.3:6833/3457348695] conn(0x122c800 0x1237720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:29.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.865+0000 7f5f2cff9700 10 client.5196 ms_handle_connect on v2:172.21.15.3:6832/3457348695 2023-10-08T15:38:29.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.865+0000 7f5f4dd9b700 1 --2- 172.21.15.3:0/1159393258 >> [v2:172.21.15.3:6832/3457348695,v1:172.21.15.3:6833/3457348695] conn(0x122c800 0x1237720 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3b81b350927b80a server_cookie=d2eabe1a9725ebff in_seq=0 out_seq=0 2023-10-08T15:38:29.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.865+0000 7f5f2cff9700 1 -- 172.21.15.3:0/1159393258 <== mds.0 v2:172.21.15.3:6832/3457348695 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x1134420 con 0x122c800 2023-10-08T15:38:29.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.865+0000 7f5f2cff9700 10 client.5196 handle_command_reply: tid=0 2023-10-08T15:38:29.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.865+0000 7f5f571c3740 1 client.5196 shutdown 2023-10-08T15:38:29.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.865+0000 7f5f571c3740 1 -- 172.21.15.3:0/1159393258 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0xfb8800 msgr2=0x11f06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:29.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.865+0000 7f5f571c3740 1 --2- 172.21.15.3:0/1159393258 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0xfb8800 0x11f06b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5f440137d0 tx=0x7f5f44013000 comp rx=0 tx=0).stop 2023-10-08T15:38:29.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.865+0000 7f5f571c3740 1 -- 172.21.15.3:0/1159393258 shutdown_connections 2023-10-08T15:38:29.873 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.865+0000 7f5f571c3740 1 --2- 172.21.15.3:0/1159393258 >> [v2:172.21.15.3:6832/3457348695,v1:172.21.15.3:6833/3457348695] conn(0x122c800 0x1237720 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:29.873 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.865+0000 7f5f571c3740 1 --2- 172.21.15.3:0/1159393258 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1003880 0x11f4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:29.873 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.865+0000 7f5f571c3740 1 --2- 172.21.15.3:0/1159393258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xfb8bd0 0x11f3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:29.873 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.865+0000 7f5f571c3740 1 --2- 172.21.15.3:0/1159393258 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0xfb8800 0x11f06b0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:29.873 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.865+0000 7f5f571c3740 1 -- 172.21.15.3:0/1159393258 >> 172.21.15.3:0/1159393258 conn(0xfb8fa0 msgr2=0x11ec950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:29.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.865+0000 7f5f2cff9700 0 client.5196 ms_handle_reset on v2:172.21.15.3:6832/3457348695 2023-10-08T15:38:29.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.865+0000 7f5f571c3740 1 -- 172.21.15.3:0/1159393258 shutdown_connections 2023-10-08T15:38:29.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.865+0000 7f5f571c3740 1 -- 172.21.15.3:0/1159393258 wait complete. 2023-10-08T15:38:29.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.865+0000 7f5f571c3740 20 client.5196 trim_cache size 0 max 16384 2023-10-08T15:38:29.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.877+0000 7f5f571c3740 1 Processor -- start 2023-10-08T15:38:29.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.877+0000 7f5f571c3740 1 -- start start 2023-10-08T15:38:29.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.877+0000 7f5f571c3740 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0xfb8bd0 0x11f3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:29.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.877+0000 7f5f571c3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1003880 0x11ed960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:29.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.877+0000 7f5f571c3740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x11f44f0 0x11edea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:29.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.877+0000 7f5f571c3740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x1163650 con 0x11f44f0 2023-10-08T15:38:29.883 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.877+0000 7f5f571c3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x122b620 con 0x1003880 2023-10-08T15:38:29.883 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.877+0000 7f5f571c3740 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x11661b0 con 0xfb8bd0 2023-10-08T15:38:29.883 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.881+0000 7f5f4ed9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x11f44f0 0x11edea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:29.883 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.881+0000 7f5f4ed9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x11f44f0 0x11edea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:32832/0 (socket says 172.21.15.3:32832) 2023-10-08T15:38:29.883 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.881+0000 7f5f4ed9d700 1 -- 172.21.15.3:0/3138314112 learned_addr learned my addr 172.21.15.3:0/3138314112 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:38:29.883 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.881+0000 7f5f4dd9b700 1 --2- 172.21.15.3:0/3138314112 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1003880 0x11ed960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:29.883 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.881+0000 7f5f4e59c700 1 --2- 172.21.15.3:0/3138314112 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0xfb8bd0 0x11f3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:29.883 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.881+0000 7f5f4ed9d700 1 -- 172.21.15.3:0/3138314112 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0xfb8bd0 msgr2=0x11f3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:38:29.883 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.881+0000 7f5f4ed9d700 1 --2- 172.21.15.3:0/3138314112 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0xfb8bd0 0x11f3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:29.883 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.881+0000 7f5f4ed9d700 1 -- 172.21.15.3:0/3138314112 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1003880 msgr2=0x11ed960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:38:29.883 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.881+0000 7f5f4ed9d700 1 --2- 172.21.15.3:0/3138314112 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1003880 0x11ed960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:29.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.881+0000 7f5f4ed9d700 1 -- 172.21.15.3:0/3138314112 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1114d90 con 0x11f44f0 2023-10-08T15:38:29.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.881+0000 7f5f4e59c700 1 --2- 172.21.15.3:0/3138314112 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0xfb8bd0 0x11f3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:38:29.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.881+0000 7f5f4ed9d700 1 --2- 172.21.15.3:0/3138314112 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x11f44f0 0x11edea0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x1141e20 tx=0x7f5f4801b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6273529378c6288 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:29.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.881+0000 7f5f2ffff700 1 -- 172.21.15.3:0/3138314112 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4800e040 con 0x11f44f0 2023-10-08T15:38:29.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.881+0000 7f5f2ffff700 1 -- 172.21.15.3:0/3138314112 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f48024040 con 0x11f44f0 2023-10-08T15:38:29.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.881+0000 7f5f2ffff700 1 -- 172.21.15.3:0/3138314112 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4800f1b0 con 0x11f44f0 2023-10-08T15:38:29.885 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.881+0000 7f5f571c3740 1 -- 172.21.15.3:0/3138314112 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x11f44f0 msgr2=0x11edea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:38:29.885 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.881+0000 7f5f571c3740 1 --2- 172.21.15.3:0/3138314112 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x11f44f0 0x11edea0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x1141e20 tx=0x7f5f4801b000 comp rx=0 tx=0).stop 2023-10-08T15:38:29.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.881+0000 7f5f571c3740 1 -- 172.21.15.3:0/3138314112 shutdown_connections 2023-10-08T15:38:29.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.881+0000 7f5f571c3740 1 --2- 172.21.15.3:0/3138314112 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x11f44f0 0x11edea0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:29.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.881+0000 7f5f571c3740 1 --2- 172.21.15.3:0/3138314112 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1003880 0x11ed960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:29.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.881+0000 7f5f571c3740 1 --2- 172.21.15.3:0/3138314112 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0xfb8bd0 0x11f3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:29.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.881+0000 7f5f571c3740 1 -- 172.21.15.3:0/3138314112 >> 172.21.15.3:0/3138314112 conn(0xfb8fa0 msgr2=0x11f38a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:38:29.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.881+0000 7f5f571c3740 1 -- 172.21.15.3:0/3138314112 shutdown_connections 2023-10-08T15:38:29.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.881+0000 7f5f571c3740 1 -- 172.21.15.3:0/3138314112 wait complete. 2023-10-08T15:38:29.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.885+0000 7f5f571c3740 1 -- start start 2023-10-08T15:38:29.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.885+0000 7f5f571c3740 1 Processor -- start 2023-10-08T15:38:29.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.885+0000 7f5f571c3740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0xfb8bd0 0x12866d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:29.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.885+0000 7f5f571c3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1003880 0x1286c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:29.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.885+0000 7f5f571c3740 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x11f44f0 0x124e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:29.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.885+0000 7f5f571c3740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x115bbd0 con 0xfb8bd0 2023-10-08T15:38:29.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.885+0000 7f5f571c3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x115d910 con 0x1003880 2023-10-08T15:38:29.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.885+0000 7f5f571c3740 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x1130c20 con 0x11f44f0 2023-10-08T15:38:29.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.885+0000 7f5f571c3740 10 client.0 _ll_register_callbacks cb 0x1134090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T15:38:29.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.885+0000 7f5f4e59c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0xfb8bd0 0x12866d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:29.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.885+0000 7f5f4e59c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0xfb8bd0 0x12866d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:32838/0 (socket says 172.21.15.3:32838) 2023-10-08T15:38:29.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.885+0000 7f5f4e59c700 1 -- 172.21.15.3:0/934844836 learned_addr learned my addr 172.21.15.3:0/934844836 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:38:29.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.885+0000 7f5f4dd9b700 1 --2- 172.21.15.3:0/934844836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1003880 0x1286c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:29.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.885+0000 7f5f4ed9d700 1 --2- 172.21.15.3:0/934844836 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x11f44f0 0x124e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:29.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.885+0000 7f5f4e59c700 1 -- 172.21.15.3:0/934844836 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x11f44f0 msgr2=0x124e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:38:29.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.885+0000 7f5f4e59c700 1 --2- 172.21.15.3:0/934844836 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x11f44f0 0x124e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:29.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.885+0000 7f5f4e59c700 1 -- 172.21.15.3:0/934844836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1003880 msgr2=0x1286c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:38:29.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.885+0000 7f5f4e59c700 1 --2- 172.21.15.3:0/934844836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1003880 0x1286c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:38:29.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.885+0000 7f5f4e59c700 1 -- 172.21.15.3:0/934844836 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1004ad0 con 0xfb8bd0 2023-10-08T15:38:29.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.885+0000 7f5f4dd9b700 1 --2- 172.21.15.3:0/934844836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1003880 0x1286c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:38:29.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.885+0000 7f5f4e59c700 1 --2- 172.21.15.3:0/934844836 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0xfb8bd0 0x12866d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5f44001550 tx=0x7f5f44017070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9861f6da2dddfd3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:38:29.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.885+0000 7f5f2cff9700 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2023-10-08T15:38:29.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.885+0000 7f5f2cff9700 1 -- 172.21.15.3:0/934844836 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f44032070 con 0xfb8bd0 2023-10-08T15:38:29.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.885+0000 7f5f2cff9700 1 -- 172.21.15.3:0/934844836 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5f4400ee50 con 0xfb8bd0 2023-10-08T15:38:29.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.885+0000 7f5f571c3740 1 -- 172.21.15.3:0/934844836 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5f4800f040 con 0xfb8bd0 2023-10-08T15:38:29.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.889+0000 7f5f2cff9700 1 -- 172.21.15.3:0/934844836 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f44005960 con 0xfb8bd0 2023-10-08T15:38:29.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.889+0000 7f5f571c3740 10 client.5202 fetch_fsmap learned FSMap version 13 2023-10-08T15:38:29.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.889+0000 7f5f571c3740 1 -- 172.21.15.3:0/934844836 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) v3 -- 0x1109140 con 0xfb8bd0 2023-10-08T15:38:29.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.889+0000 7f5f2cff9700 1 -- 172.21.15.3:0/934844836 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f4800f040 con 0xfb8bd0 2023-10-08T15:38:29.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.889+0000 7f5f2cff9700 1 -- 172.21.15.3:0/934844836 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 13) v1 ==== 2010+0+0 (secure 0 0 0) 0x7f5f44022c80 con 0xfb8bd0 2023-10-08T15:38:29.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.889+0000 7f5f571c3740 10 client.5202 fetch_fsmap finished waiting for FSMap version 13 2023-10-08T15:38:29.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.889+0000 7f5f571c3740 10 client.5202 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2023-10-08T15:38:29.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.889+0000 7f5f571c3740 20 client.5202 populate_metadata read hostname 'smithi003' 2023-10-08T15:38:29.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.889+0000 7f5f571c3740 1 --2- 172.21.15.3:0/934844836 >> [v2:172.21.15.3:6832/3457348695,v1:172.21.15.3:6833/3457348695] conn(0x124f2e0 0x124f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:38:29.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.889+0000 7f5f571c3740 4 client.5202 mds_command: new command op to 4989 tid=0[{"prefix": "cache drop"}] 2023-10-08T15:38:29.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.889+0000 7f5f571c3740 1 -- 172.21.15.3:0/934844836 --> [v2:172.21.15.3:6832/3457348695,v1:172.21.15.3:6833/3457348695] -- command(tid 0: {"prefix": "cache drop"}) v1 -- 0x10105d0 con 0x124f2e0 2023-10-08T15:38:29.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.889+0000 7f5f4dd9b700 1 --2- 172.21.15.3:0/934844836 >> [v2:172.21.15.3:6832/3457348695,v1:172.21.15.3:6833/3457348695] conn(0x124f2e0 0x124f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:38:29.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.889+0000 7f5f2cff9700 10 client.5202 ms_handle_connect on v2:172.21.15.3:6832/3457348695 2023-10-08T15:38:29.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:38:29.889+0000 7f5f4dd9b700 1 --2- 172.21.15.3:0/934844836 >> [v2:172.21.15.3:6832/3457348695,v1:172.21.15.3:6833/3457348695] conn(0x124f2e0 0x124f6e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25f3de18c32566cf server_cookie=189b89b8346f93ba in_seq=0 out_seq=0 2023-10-08T15:38:36.901 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:38:36.905 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:38:36.907 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:38:36.909 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:38:36.911 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:39:06.965 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:39:06.968 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:39:06.970 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:39:06.975 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:39:06.977 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:39:37.054 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:39:37.057 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:39:37.060 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:39:37.062 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:39:37.065 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:39:59.272 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.267+0000 7f5f2cff9700 1 -- 172.21.15.3:0/934844836 <== mds.0 v2:172.21.15.3:6832/3457348695 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+387 (crc 0 0 0) 0x10105d0 con 0x124f2e0 2023-10-08T15:39:59.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.267+0000 7f5f2cff9700 10 client.5202 handle_command_reply: tid=0 2023-10-08T15:39:59.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.267+0000 7f5f571c3740 1 client.5202 shutdown 2023-10-08T15:39:59.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.267+0000 7f5f571c3740 1 -- 172.21.15.3:0/934844836 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0xfb8bd0 msgr2=0x12866d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:39:59.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.267+0000 7f5f571c3740 1 --2- 172.21.15.3:0/934844836 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0xfb8bd0 0x12866d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5f44001550 tx=0x7f5f44017070 comp rx=0 tx=0).stop 2023-10-08T15:39:59.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.267+0000 7f5f571c3740 1 -- 172.21.15.3:0/934844836 shutdown_connections 2023-10-08T15:39:59.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.267+0000 7f5f571c3740 1 --2- 172.21.15.3:0/934844836 >> [v2:172.21.15.3:6832/3457348695,v1:172.21.15.3:6833/3457348695] conn(0x124f2e0 0x124f6e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:39:59.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.267+0000 7f5f571c3740 1 --2- 172.21.15.3:0/934844836 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x11f44f0 0x124e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:39:59.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.267+0000 7f5f2cff9700 0 client.5202 ms_handle_reset on v2:172.21.15.3:6832/3457348695 2023-10-08T15:39:59.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.267+0000 7f5f571c3740 1 --2- 172.21.15.3:0/934844836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1003880 0x1286c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:39:59.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.267+0000 7f5f571c3740 1 --2- 172.21.15.3:0/934844836 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0xfb8bd0 0x12866d0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:39:59.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.267+0000 7f5f571c3740 1 -- 172.21.15.3:0/934844836 >> 172.21.15.3:0/934844836 conn(0xfb8fa0 msgr2=0x11ec950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:39:59.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.267+0000 7f5f571c3740 1 -- 172.21.15.3:0/934844836 shutdown_connections 2023-10-08T15:39:59.274 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.267+0000 7f5f571c3740 1 -- 172.21.15.3:0/934844836 wait complete. 2023-10-08T15:39:59.274 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.267+0000 7f5f571c3740 20 client.5202 trim_cache size 0 max 16384 2023-10-08T15:39:59.274 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2023-10-08T15:39:59.274 INFO:teuthology.orchestra.run.smithi003.stdout: "client_recall": { 2023-10-08T15:39:59.274 INFO:teuthology.orchestra.run.smithi003.stdout: "return_code": 0, 2023-10-08T15:39:59.274 INFO:teuthology.orchestra.run.smithi003.stdout: "message": "(0) Success", 2023-10-08T15:39:59.274 INFO:teuthology.orchestra.run.smithi003.stdout: "recalled": 1820 2023-10-08T15:39:59.274 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:39:59.275 INFO:teuthology.orchestra.run.smithi003.stdout: "flush_journal": { 2023-10-08T15:39:59.275 INFO:teuthology.orchestra.run.smithi003.stdout: "return_code": 0, 2023-10-08T15:39:59.275 INFO:teuthology.orchestra.run.smithi003.stdout: "message": "" 2023-10-08T15:39:59.275 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:39:59.275 INFO:teuthology.orchestra.run.smithi003.stdout: "trim_cache": { 2023-10-08T15:39:59.275 INFO:teuthology.orchestra.run.smithi003.stdout: "trimmed": 900 2023-10-08T15:39:59.275 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:39:59.275 INFO:teuthology.orchestra.run.smithi003.stdout: "cache": { 2023-10-08T15:39:59.275 INFO:teuthology.orchestra.run.smithi003.stdout: "pool": { 2023-10-08T15:39:59.275 INFO:teuthology.orchestra.run.smithi003.stdout: "items": 2239, 2023-10-08T15:39:59.275 INFO:teuthology.orchestra.run.smithi003.stdout: "bytes": 364192 2023-10-08T15:39:59.275 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:39:59.276 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:39:59.276 INFO:teuthology.orchestra.run.smithi003.stdout: "duration": 89.380085739999998 2023-10-08T15:39:59.276 INFO:teuthology.orchestra.run.smithi003.stdout:} 2023-10-08T15:39:59.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.267+0000 7f5f4f59e700 1 -- 172.21.15.3:0/3418483591 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5f30060550 msgr2=0x7f5f30062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:39:59.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.267+0000 7f5f4f59e700 1 --2- 172.21.15.3:0/3418483591 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5f30060550 0x7f5f30062a00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5f44005d40 tx=0x7f5f44001580 comp rx=0 tx=0).stop 2023-10-08T15:39:59.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.267+0000 7f5f4f59e700 1 -- 172.21.15.3:0/3418483591 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5f500a1c50 msgr2=0x7f5f5015c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:39:59.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.267+0000 7f5f4f59e700 1 --2- 172.21.15.3:0/3418483591 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5f500a1c50 0x7f5f5015c3f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5f50063960 tx=0x7f5f40016000 comp rx=0 tx=0).stop 2023-10-08T15:39:59.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.271+0000 7f5f4f59e700 1 -- 172.21.15.3:0/3418483591 shutdown_connections 2023-10-08T15:39:59.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.271+0000 7f5f4f59e700 1 --2- 172.21.15.3:0/3418483591 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5f30060550 0x7f5f30062a00 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:39:59.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.271+0000 7f5f4f59e700 1 --2- 172.21.15.3:0/3418483591 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5f500b9ff0 0x7f5f5006e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:39:59.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.271+0000 7f5f4f59e700 1 --2- 172.21.15.3:0/3418483591 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5f500a1c50 0x7f5f5015c3f0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:39:59.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.271+0000 7f5f4f59e700 1 --2- 172.21.15.3:0/3418483591 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f50068e50 0x7f5f50146020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:39:59.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.271+0000 7f5f4f59e700 1 -- 172.21.15.3:0/3418483591 >> 172.21.15.3:0/3418483591 conn(0x7f5f500bd9c0 msgr2=0x7f5f50146950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:39:59.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.271+0000 7f5f4f59e700 1 -- 172.21.15.3:0/3418483591 shutdown_connections 2023-10-08T15:39:59.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.271+0000 7f5f4f59e700 1 -- 172.21.15.3:0/3418483591 wait complete. 2023-10-08T15:39:59.290 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T15:39:59.290 DEBUG:teuthology.orchestra.run.smithi003:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T15:39:59.302 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T15:39:59.323 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T15:39:59.344 DEBUG:teuthology.orchestra.run.smithi098:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T15:39:59.364 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T15:39:59.384 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T15:39:59.384 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi089.front.sepia.ceph.com... 2023-10-08T15:39:59.385 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T15:39:59.385 DEBUG:teuthology.orchestra.run.smithi089:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-08T15:39:59.400 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi089.stderr:ceph-fuse[28720]: fuse finished with error 0 and tester_r 0 2023-10-08T15:39:59.401 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi089.front.sepia.ceph.com 2023-10-08T15:39:59.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:39:59.401 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-08T15:39:59.525 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi098.front.sepia.ceph.com 2023-10-08T15:39:59.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:39:59.526 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-08T15:39:59.532 INFO:teuthology.orchestra.run.smithi098.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-10-08T15:39:59.533 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T15:39:59.533 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2023-10-08T15:39:59.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:39:59.533 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-08T15:39:59.540 INFO:teuthology.orchestra.run.smithi153.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-08T15:39:59.540 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T15:39:59.541 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:39:59.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.651+0000 7f9b0d4ab700 1 Processor -- start 2023-10-08T15:39:59.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.651+0000 7f9b0d4ab700 1 -- start start 2023-10-08T15:39:59.657 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.651+0000 7f9b0d4ab700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f9b080bab50 0x7f9b080baf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:39:59.657 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.651+0000 7f9b0d4ab700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9b0806df30 0x7f9b08149970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:39:59.658 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.651+0000 7f9b0d4ab700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9b08149eb0 0x7f9b0814c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:39:59.659 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.651+0000 7f9b0d4ab700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b08146da0 con 0x7f9b080bab50 2023-10-08T15:39:59.659 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.651+0000 7f9b0d4ab700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b080b4710 con 0x7f9b0806df30 2023-10-08T15:39:59.659 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.651+0000 7f9b0d4ab700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0814a310 con 0x7f9b08149eb0 2023-10-08T15:39:59.660 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.651+0000 7f9b07fff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f9b080bab50 0x7f9b080baf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:39:59.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.651+0000 7f9b07fff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f9b080bab50 0x7f9b080baf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52386/0 (socket says 172.21.15.3:52386) 2023-10-08T15:39:59.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.651+0000 7f9b07fff700 1 -- 172.21.15.3:0/3927518362 learned_addr learned my addr 172.21.15.3:0/3927518362 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:39:59.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.651+0000 7f9b0ccaa700 1 --2- 172.21.15.3:0/3927518362 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9b08149eb0 0x7f9b0814c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:39:59.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.651+0000 7f9aff7fe700 1 --2- 172.21.15.3:0/3927518362 >> v2:172.21.15.50:3300/0 conn(0x7f9b0806df30 0x7f9b08149970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:39:59.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.651+0000 7f9b07fff700 1 -- 172.21.15.3:0/3927518362 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9b08149eb0 msgr2=0x7f9b0814c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:39:59.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.651+0000 7f9b07fff700 1 --2- 172.21.15.3:0/3927518362 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9b08149eb0 0x7f9b0814c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:39:59.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.651+0000 7f9b07fff700 1 -- 172.21.15.3:0/3927518362 >> v2:172.21.15.50:3300/0 conn(0x7f9b0806df30 msgr2=0x7f9b08149970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:39:59.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.651+0000 7f9b07fff700 1 --2- 172.21.15.3:0/3927518362 >> v2:172.21.15.50:3300/0 conn(0x7f9b0806df30 0x7f9b08149970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:39:59.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.651+0000 7f9b07fff700 1 -- 172.21.15.3:0/3927518362 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b080b4050 con 0x7f9b080bab50 2023-10-08T15:39:59.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.651+0000 7f9b07fff700 1 --2- 172.21.15.3:0/3927518362 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9b080bab50 0x7f9b080baf20 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9b08070980 tx=0x7f9af8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e41410efb27b2fd1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:39:59.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.651+0000 7f9b077fe700 1 -- 172.21.15.3:0/3927518362 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af800b640 con 0x7f9b080bab50 2023-10-08T15:39:59.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.651+0000 7f9b077fe700 1 -- 172.21.15.3:0/3927518362 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af800b7a0 con 0x7f9b080bab50 2023-10-08T15:39:59.662 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.651+0000 7f9b077fe700 1 -- 172.21.15.3:0/3927518362 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af800bb40 con 0x7f9b080bab50 2023-10-08T15:39:59.662 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.651+0000 7f9b0d4ab700 1 -- 172.21.15.3:0/3927518362 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9b080bab50 msgr2=0x7f9b080baf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:39:59.662 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.651+0000 7f9b0d4ab700 1 --2- 172.21.15.3:0/3927518362 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9b080bab50 0x7f9b080baf20 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9b08070980 tx=0x7f9af8009250 comp rx=0 tx=0).stop 2023-10-08T15:39:59.662 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.651+0000 7f9b0d4ab700 1 -- 172.21.15.3:0/3927518362 shutdown_connections 2023-10-08T15:39:59.662 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.651+0000 7f9b0d4ab700 1 --2- 172.21.15.3:0/3927518362 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9b08149eb0 0x7f9b0814c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:39:59.662 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.651+0000 7f9b0d4ab700 1 --2- 172.21.15.3:0/3927518362 >> v2:172.21.15.50:3300/0 conn(0x7f9b0806df30 0x7f9b08149970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:39:59.662 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.651+0000 7f9b0d4ab700 1 --2- 172.21.15.3:0/3927518362 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9b080bab50 0x7f9b080baf20 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:39:59.662 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.651+0000 7f9b0d4ab700 1 -- 172.21.15.3:0/3927518362 >> 172.21.15.3:0/3927518362 conn(0x7f9b080be4a0 msgr2=0x7f9b080ba440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:39:59.662 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.651+0000 7f9b0d4ab700 1 -- 172.21.15.3:0/3927518362 shutdown_connections 2023-10-08T15:39:59.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.651+0000 7f9b0d4ab700 1 -- 172.21.15.3:0/3927518362 wait complete. 2023-10-08T15:39:59.666 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.655+0000 7f9b0d4ab700 1 Processor -- start 2023-10-08T15:39:59.666 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.655+0000 7f9b0d4ab700 1 -- start start 2023-10-08T15:39:59.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.655+0000 7f9b0d4ab700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9b0806df30 0x7f9b080b8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:39:59.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.655+0000 7f9b0d4ab700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b080bab50 0x7f9b080b8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:39:59.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.655+0000 7f9b0d4ab700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9b08149eb0 0x7f9b080b6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:39:59.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.655+0000 7f9b0d4ab700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b080b97f0 con 0x7f9b0806df30 2023-10-08T15:39:59.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.655+0000 7f9b0d4ab700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b080b7ec0 con 0x7f9b080bab50 2023-10-08T15:39:59.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.655+0000 7f9b07fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9b0806df30 0x7f9b080b8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:39:59.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.655+0000 7f9b0d4ab700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b080b7bc0 con 0x7f9b08149eb0 2023-10-08T15:39:59.668 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.655+0000 7f9b07fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9b0806df30 0x7f9b080b8fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52400/0 (socket says 172.21.15.3:52400) 2023-10-08T15:39:59.668 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.655+0000 7f9b07fff700 1 -- 172.21.15.3:0/2172908379 learned_addr learned my addr 172.21.15.3:0/2172908379 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:39:59.668 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.655+0000 7f9aff7fe700 1 --2- 172.21.15.3:0/2172908379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b080bab50 0x7f9b080b8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:39:59.668 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.655+0000 7f9b0ccaa700 1 --2- 172.21.15.3:0/2172908379 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9b08149eb0 0x7f9b080b6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:39:59.668 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.655+0000 7f9b07fff700 1 -- 172.21.15.3:0/2172908379 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9b08149eb0 msgr2=0x7f9b080b6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:39:59.668 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.655+0000 7f9b07fff700 1 --2- 172.21.15.3:0/2172908379 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9b08149eb0 0x7f9b080b6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:39:59.668 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.655+0000 7f9b07fff700 1 -- 172.21.15.3:0/2172908379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b080bab50 msgr2=0x7f9b080b8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:39:59.668 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.655+0000 7f9b07fff700 1 --2- 172.21.15.3:0/2172908379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b080bab50 0x7f9b080b8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:39:59.669 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.655+0000 7f9b07fff700 1 -- 172.21.15.3:0/2172908379 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af80094f0 con 0x7f9b0806df30 2023-10-08T15:39:59.669 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.655+0000 7f9b07fff700 1 --2- 172.21.15.3:0/2172908379 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9b0806df30 0x7f9b080b8fe0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f9af8009fd0 tx=0x7f9af8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:39:59.669 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.655+0000 7f9b04ff9700 1 -- 172.21.15.3:0/2172908379 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af800bb20 con 0x7f9b0806df30 2023-10-08T15:39:59.669 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.655+0000 7f9b04ff9700 1 -- 172.21.15.3:0/2172908379 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af8000c90 con 0x7f9b0806df30 2023-10-08T15:39:59.670 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.655+0000 7f9b0d4ab700 1 -- 172.21.15.3:0/2172908379 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b08159430 con 0x7f9b0806df30 2023-10-08T15:39:59.670 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.655+0000 7f9b04ff9700 1 -- 172.21.15.3:0/2172908379 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af8011650 con 0x7f9b0806df30 2023-10-08T15:39:59.670 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.659+0000 7f9b0d4ab700 1 -- 172.21.15.3:0/2172908379 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b08159050 con 0x7f9b0806df30 2023-10-08T15:39:59.670 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.659+0000 7f9b0d4ab700 1 -- 172.21.15.3:0/2172908379 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b08159240 con 0x7f9b0806df30 2023-10-08T15:39:59.670 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.659+0000 7f9b04ff9700 1 -- 172.21.15.3:0/2172908379 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f9af8011a80 con 0x7f9b0806df30 2023-10-08T15:39:59.670 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.659+0000 7f9b04ff9700 1 --2- 172.21.15.3:0/2172908379 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f9ae8060550 0x7f9ae8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:39:59.670 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.659+0000 7f9b04ff9700 1 -- 172.21.15.3:0/2172908379 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9af807db30 con 0x7f9b0806df30 2023-10-08T15:39:59.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.659+0000 7f9aff7fe700 1 --2- 172.21.15.3:0/2172908379 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f9ae8060550 0x7f9ae8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:39:59.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.663+0000 7f9aff7fe700 1 --2- 172.21.15.3:0/2172908379 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f9ae8060550 0x7f9ae8062a00 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9b080b9f30 tx=0x7f9af00091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:39:59.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.667+0000 7f9b04ff9700 1 -- 172.21.15.3:0/2172908379 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9af804e1a0 con 0x7f9b0806df30 2023-10-08T15:39:59.868 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.863+0000 7f9b0d4ab700 1 -- 172.21.15.3:0/2172908379 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9b0805ecf0 con 0x7f9b0806df30 2023-10-08T15:39:59.869 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.863+0000 7f9b04ff9700 1 -- 172.21.15.3:0/2172908379 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+3079 (secure 0 0 0) 0x7f9af8015c20 con 0x7f9b0806df30 2023-10-08T15:39:59.869 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:39:59.869 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4736,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3640212670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3640212670},{"type":"v1","addr":"172.21.15.50:6835","nonce":3640212670}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:38:10.891768+0000","modified":"2023-10-08T15:38:13.541239+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4989},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4989":{"gid":4989,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.3:6833/3457348695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":3457348695},{"type":"v1","addr":"172.21.15.3:6833","nonce":3457348695}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-08T15:39:59.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.867+0000 7f9b0d4ab700 1 -- 172.21.15.3:0/2172908379 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f9ae8060550 msgr2=0x7f9ae8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:39:59.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.867+0000 7f9b0d4ab700 1 --2- 172.21.15.3:0/2172908379 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f9ae8060550 0x7f9ae8062a00 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9b080b9f30 tx=0x7f9af00091a0 comp rx=0 tx=0).stop 2023-10-08T15:39:59.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.867+0000 7f9b0d4ab700 1 -- 172.21.15.3:0/2172908379 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9b0806df30 msgr2=0x7f9b080b8fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:39:59.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.867+0000 7f9b0d4ab700 1 --2- 172.21.15.3:0/2172908379 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9b0806df30 0x7f9b080b8fe0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f9af8009fd0 tx=0x7f9af8017000 comp rx=0 tx=0).stop 2023-10-08T15:39:59.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.867+0000 7f9b0d4ab700 1 -- 172.21.15.3:0/2172908379 shutdown_connections 2023-10-08T15:39:59.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.867+0000 7f9b0d4ab700 1 --2- 172.21.15.3:0/2172908379 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f9ae8060550 0x7f9ae8062a00 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:39:59.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.867+0000 7f9b0d4ab700 1 --2- 172.21.15.3:0/2172908379 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9b08149eb0 0x7f9b080b6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:39:59.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.867+0000 7f9b0d4ab700 1 --2- 172.21.15.3:0/2172908379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b080bab50 0x7f9b080b8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:39:59.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.867+0000 7f9b0d4ab700 1 --2- 172.21.15.3:0/2172908379 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9b0806df30 0x7f9b080b8fe0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:39:59.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.867+0000 7f9b0d4ab700 1 -- 172.21.15.3:0/2172908379 >> 172.21.15.3:0/2172908379 conn(0x7f9b080be4a0 msgr2=0x7f9b0814bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:39:59.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.867+0000 7f9b0d4ab700 1 -- 172.21.15.3:0/2172908379 shutdown_connections 2023-10-08T15:39:59.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.867+0000 7f9b0d4ab700 1 -- 172.21.15.3:0/2172908379 wait complete. 2023-10-08T15:39:59.872 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 13 2023-10-08T15:39:59.883 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:39:59.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.983+0000 7f19012c9700 1 Processor -- start 2023-10-08T15:39:59.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.983+0000 7f19012c9700 1 -- start start 2023-10-08T15:39:59.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.987+0000 7f19012c9700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f18fc0bacf0 0x7f18fc153860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:39:59.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.987+0000 7f19012c9700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18fc14fe30 con 0x7f18fc0bb0c0 2023-10-08T15:39:59.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.987+0000 7f19012c9700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18fc14fac0 con 0x7f18fc09e520 2023-10-08T15:39:59.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.987+0000 7f19012c9700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18fc09f0e0 con 0x7f18fc0bacf0 2023-10-08T15:39:59.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.987+0000 7f18fb7fe700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f18fc0bb0c0 0x7f18fc1502c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:37410/0 (socket says 172.21.15.3:37410) 2023-10-08T15:39:59.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.987+0000 7f18fb7fe700 1 -- 172.21.15.3:0/3604289259 learned_addr learned my addr 172.21.15.3:0/3604289259 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:39:59.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.987+0000 7f18fbfff700 1 --2- 172.21.15.3:0/3604289259 >> v2:172.21.15.50:3300/0 conn(0x7f18fc0bacf0 0x7f18fc153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:39:59.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.987+0000 7f18faffd700 1 -- 172.21.15.3:0/3604289259 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1829761964 0 0) 0x7f18fc14fe30 con 0x7f18fc0bb0c0 2023-10-08T15:39:59.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.987+0000 7f18faffd700 1 -- 172.21.15.3:0/3604289259 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18e4003570 con 0x7f18fc0bb0c0 2023-10-08T15:39:59.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.987+0000 7f18faffd700 1 -- 172.21.15.3:0/3604289259 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4164241478 0 0) 0x7f18e4003570 con 0x7f18fc0bb0c0 2023-10-08T15:39:59.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.987+0000 7f18faffd700 1 -- 172.21.15.3:0/3604289259 >> v2:172.21.15.50:3300/0 conn(0x7f18fc0bacf0 msgr2=0x7f18fc153860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:39:59.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.987+0000 7f18faffd700 1 --2- 172.21.15.3:0/3604289259 >> v2:172.21.15.50:3300/0 conn(0x7f18fc0bacf0 0x7f18fc153860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:39:59.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.987+0000 7f18faffd700 1 -- 172.21.15.3:0/3604289259 >> v1:172.21.15.50:6789/0 conn(0x7f18fc09e520 legacy=0x7f18fc06c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:39:59.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.987+0000 7f18faffd700 1 -- 172.21.15.3:0/3604289259 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18fc09eb80 con 0x7f18fc0bb0c0 2023-10-08T15:39:59.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.987+0000 7f18faffd700 1 -- 172.21.15.3:0/3604289259 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2285686191 0 0) 0x7f18ec0017f0 con 0x7f18fc0bb0c0 2023-10-08T15:39:59.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.987+0000 7f18faffd700 1 -- 172.21.15.3:0/3604289259 >> v1:172.21.15.3:6789/0 conn(0x7f18fc0bb0c0 legacy=0x7f18fc1502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:39:59.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.987+0000 7f18faffd700 1 --2- 172.21.15.3:0/3604289259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18e4003a60 0x7f18e4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:39:59.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.987+0000 7f18faffd700 1 --2- 172.21.15.3:0/3604289259 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f18e4004810 0x7f18e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:39:59.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.987+0000 7f18faffd700 1 --2- 172.21.15.3:0/3604289259 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f18e40051c0 0x7f18e400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:39:59.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.987+0000 7f18faffd700 1 -- 172.21.15.3:0/3604289259 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e400c130 con 0x7f18e40051c0 2023-10-08T15:39:59.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.987+0000 7f18faffd700 1 -- 172.21.15.3:0/3604289259 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e400c2a0 con 0x7f18e4003a60 2023-10-08T15:39:59.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.987+0000 7f18faffd700 1 -- 172.21.15.3:0/3604289259 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18e400c460 con 0x7f18e4004810 2023-10-08T15:39:59.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.987+0000 7f18fbfff700 1 --2- 172.21.15.3:0/3604289259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18e4003a60 0x7f18e4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:39:59.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.987+0000 7f18fb7fe700 1 --2- 172.21.15.3:0/3604289259 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f18e4004810 0x7f18e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:39:59.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.987+0000 7f1900ac8700 1 --2- 172.21.15.3:0/3604289259 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f18e40051c0 0x7f18e400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:39:59.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.987+0000 7f18fbfff700 1 -- 172.21.15.3:0/3604289259 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f18e4004810 msgr2=0x7f18e4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:39:59.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.987+0000 7f18fbfff700 1 --2- 172.21.15.3:0/3604289259 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f18e4004810 0x7f18e4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:39:59.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.987+0000 7f18fbfff700 1 -- 172.21.15.3:0/3604289259 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f18e40051c0 msgr2=0x7f18e400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:39:59.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.987+0000 7f18fbfff700 1 --2- 172.21.15.3:0/3604289259 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f18e40051c0 0x7f18e400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:39:59.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.987+0000 7f1900ac8700 1 -- 172.21.15.3:0/3604289259 reap_dead start 2023-10-08T15:39:59.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.987+0000 7f18fbfff700 1 -- 172.21.15.3:0/3604289259 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e4003570 con 0x7f18e4003a60 2023-10-08T15:39:59.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.987+0000 7f18fbfff700 1 --2- 172.21.15.3:0/3604289259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18e4003a60 0x7f18e4003e70 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f18f0009c00 tx=0x7f18f00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4502ba05d7fbe379 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:39:59.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.987+0000 7f18faffd700 1 -- 172.21.15.3:0/3604289259 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f000e710 con 0x7f18e4003a60 2023-10-08T15:39:59.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.987+0000 7f18faffd700 1 -- 172.21.15.3:0/3604289259 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f000e870 con 0x7f18e4003a60 2023-10-08T15:39:59.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.987+0000 7f18faffd700 1 -- 172.21.15.3:0/3604289259 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f000ec30 con 0x7f18e4003a60 2023-10-08T15:39:59.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.991+0000 7f19012c9700 1 -- 172.21.15.3:0/3604289259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18e4003a60 msgr2=0x7f18e4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:39:59.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.991+0000 7f19012c9700 1 --2- 172.21.15.3:0/3604289259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18e4003a60 0x7f18e4003e70 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f18f0009c00 tx=0x7f18f00091a0 comp rx=0 tx=0).stop 2023-10-08T15:39:59.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.991+0000 7f19012c9700 1 -- 172.21.15.3:0/3604289259 shutdown_connections 2023-10-08T15:39:59.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.991+0000 7f19012c9700 1 --2- 172.21.15.3:0/3604289259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18e4003a60 0x7f18e4003e70 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:39:59.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.991+0000 7f19012c9700 1 -- 172.21.15.3:0/3604289259 >> 172.21.15.3:0/3604289259 conn(0x7f18fc0be4a0 msgr2=0x7f18fc0ba440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:39:59.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.991+0000 7f19012c9700 1 -- 172.21.15.3:0/3604289259 shutdown_connections 2023-10-08T15:39:59.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.991+0000 7f19012c9700 1 -- 172.21.15.3:0/3604289259 wait complete. 2023-10-08T15:39:59.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.991+0000 7f19012c9700 1 Processor -- start 2023-10-08T15:39:59.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.991+0000 7f19012c9700 1 -- start start 2023-10-08T15:39:59.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.991+0000 7f19012c9700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f18e4003a60 0x7f18fc0a2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:39:59.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.991+0000 7f19012c9700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f18fc0a01b0 0x7f18fc151b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:39:59.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.991+0000 7f19012c9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18fc14af90 0x7f18fc14b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:39:59.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.991+0000 7f19012c9700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18fc149970 con 0x7f18fc0a01b0 2023-10-08T15:39:59.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.991+0000 7f19012c9700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18fc0a0e60 con 0x7f18fc14af90 2023-10-08T15:39:59.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.991+0000 7f19012c9700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18fc14b940 con 0x7f18e4003a60 2023-10-08T15:39:59.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.991+0000 7f18fb7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f18fc0a01b0 0x7f18fc151b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:39:59.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.991+0000 7f18fb7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f18fc0a01b0 0x7f18fc151b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52422/0 (socket says 172.21.15.3:52422) 2023-10-08T15:39:59.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.991+0000 7f18fb7fe700 1 -- 172.21.15.3:0/1114831828 learned_addr learned my addr 172.21.15.3:0/1114831828 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:39:59.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.991+0000 7f1900ac8700 1 --2- 172.21.15.3:0/1114831828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18fc14af90 0x7f18fc14b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:39:59.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.991+0000 7f18fbfff700 1 --2- 172.21.15.3:0/1114831828 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f18e4003a60 0x7f18fc0a2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:39:59.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.991+0000 7f18fb7fe700 1 -- 172.21.15.3:0/1114831828 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f18e4003a60 msgr2=0x7f18fc0a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:39:59.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.991+0000 7f18fb7fe700 1 --2- 172.21.15.3:0/1114831828 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f18e4003a60 0x7f18fc0a2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:39:59.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.991+0000 7f18fb7fe700 1 -- 172.21.15.3:0/1114831828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18fc14af90 msgr2=0x7f18fc14b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:39:59.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.991+0000 7f18fb7fe700 1 --2- 172.21.15.3:0/1114831828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18fc14af90 0x7f18fc14b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:39:59.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.991+0000 7f18fb7fe700 1 -- 172.21.15.3:0/1114831828 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18fc0a2590 con 0x7f18fc0a01b0 2023-10-08T15:39:59.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.995+0000 7f18fb7fe700 1 --2- 172.21.15.3:0/1114831828 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f18fc0a01b0 0x7f18fc151b80 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f18ec007ac0 tx=0x7f18ec0021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:00.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.995+0000 7f18e3fff700 1 -- 172.21.15.3:0/1114831828 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ec00ad70 con 0x7f18fc0a01b0 2023-10-08T15:40:00.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.995+0000 7f18e3fff700 1 -- 172.21.15.3:0/1114831828 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18ec0133f0 con 0x7f18fc0a01b0 2023-10-08T15:40:00.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.995+0000 7f19012c9700 1 -- 172.21.15.3:0/1114831828 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18fc0a1fb0 con 0x7f18fc0a01b0 2023-10-08T15:40:00.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.995+0000 7f18e3fff700 1 -- 172.21.15.3:0/1114831828 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ec0137b0 con 0x7f18fc0a01b0 2023-10-08T15:40:00.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.995+0000 7f19012c9700 1 -- 172.21.15.3:0/1114831828 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18fc1520c0 con 0x7f18fc0a01b0 2023-10-08T15:40:00.001 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.995+0000 7f19012c9700 1 -- 172.21.15.3:0/1114831828 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18fc0a2720 con 0x7f18fc0a01b0 2023-10-08T15:40:00.001 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.995+0000 7f18e3fff700 1 -- 172.21.15.3:0/1114831828 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f18ec013b60 con 0x7f18fc0a01b0 2023-10-08T15:40:00.002 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.995+0000 7f18e3fff700 1 --2- 172.21.15.3:0/1114831828 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f18e8060550 0x7f18e8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:00.002 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.995+0000 7f18e3fff700 1 -- 172.21.15.3:0/1114831828 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f18ec07d450 con 0x7f18fc0a01b0 2023-10-08T15:40:00.002 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.995+0000 7f18fbfff700 1 --2- 172.21.15.3:0/1114831828 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f18e8060550 0x7f18e8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:00.003 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.999+0000 7f18fbfff700 1 --2- 172.21.15.3:0/1114831828 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f18e8060550 0x7f18e8062a00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f18f00091e0 tx=0x7f18f001a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:00.005 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:39:59.999+0000 7f18e3fff700 1 -- 172.21.15.3:0/1114831828 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f18ec04db00 con 0x7f18fc0a01b0 2023-10-08T15:40:00.169 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.167+0000 7f19012c9700 1 -- 172.21.15.3:0/1114831828 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f18fc05ecf0 con 0x7f18fc0a01b0 2023-10-08T15:40:00.171 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.167+0000 7f18e3fff700 1 -- 172.21.15.3:0/1114831828 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+15254 (secure 0 0 0) 0x7f18ec051120 con 0x7f18fc0a01b0 2023-10-08T15:40:00.171 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:40:00.172 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":29,"fsid":"7635972e-cd66-4a8f-a231-378db8b3847a","created":"2023-10-08T15:37:08.234594+0000","modified":"2023-10-08T15:38:12.526270+0000","last_up_change":"2023-10-08T15:37:17.537726+0000","last_in_change":"2023-10-08T15:37:10.269178+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:37:16.581590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:38:09.361822+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-08T15:38:09.863387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"64fb1864-bfdd-4d75-9b41-03fb60085dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33363},{"type":"v1","addr":"172.21.15.3:6801","nonce":33363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33363},{"type":"v1","addr":"172.21.15.3:6803","nonce":33363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":33363},{"type":"v1","addr":"172.21.15.3:6807","nonce":33363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33363},{"type":"v1","addr":"172.21.15.3:6805","nonce":33363}]},"public_addr":"172.21.15.3:6801/33363","cluster_addr":"172.21.15.3:6803/33363","heartbeat_back_addr":"172.21.15.3:6807/33363","heartbeat_front_addr":"172.21.15.3:6805/33363","state":["exists","up"]},{"osd":1,"uuid":"3ca6bd3a-3e8a-4c65-af9c-46148b0c2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33364},{"type":"v1","addr":"172.21.15.3:6820","nonce":33364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33364},{"type":"v1","addr":"172.21.15.3:6824","nonce":33364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33364},{"type":"v1","addr":"172.21.15.3:6831","nonce":33364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33364},{"type":"v1","addr":"172.21.15.3:6828","nonce":33364}]},"public_addr":"172.21.15.3:6820/33364","cluster_addr":"172.21.15.3:6824/33364","heartbeat_back_addr":"172.21.15.3:6831/33364","heartbeat_front_addr":"172.21.15.3:6828/33364","state":["exists","up"]},{"osd":2,"uuid":"6eb9f757-58dd-442f-910d-32401454bce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33366},{"type":"v1","addr":"172.21.15.3:6817","nonce":33366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":33366},{"type":"v1","addr":"172.21.15.3:6821","nonce":33366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6827","nonce":33366},{"type":"v1","addr":"172.21.15.3:6829","nonce":33366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":33366},{"type":"v1","addr":"172.21.15.3:6825","nonce":33366}]},"public_addr":"172.21.15.3:6817/33366","cluster_addr":"172.21.15.3:6821/33366","heartbeat_back_addr":"172.21.15.3:6829/33366","heartbeat_front_addr":"172.21.15.3:6825/33366","state":["exists","up"]},{"osd":3,"uuid":"1c39866b-ac2e-4ea9-a69c-02b01ee4191d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33365},{"type":"v1","addr":"172.21.15.3:6809","nonce":33365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":33365},{"type":"v1","addr":"172.21.15.3:6811","nonce":33365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33365},{"type":"v1","addr":"172.21.15.3:6815","nonce":33365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":33365},{"type":"v1","addr":"172.21.15.3:6813","nonce":33365}]},"public_addr":"172.21.15.3:6809/33365","cluster_addr":"172.21.15.3:6811/33365","heartbeat_back_addr":"172.21.15.3:6815/33365","heartbeat_front_addr":"172.21.15.3:6813/33365","state":["exists","up"]},{"osd":4,"uuid":"15f86b61-b7f1-4780-ae00-9d80a68cb830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":33605},{"type":"v1","addr":"172.21.15.50:6809","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33605},{"type":"v1","addr":"172.21.15.50:6811","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33605},{"type":"v1","addr":"172.21.15.50:6815","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":33605},{"type":"v1","addr":"172.21.15.50:6813","nonce":33605}]},"public_addr":"172.21.15.50:6809/33605","cluster_addr":"172.21.15.50:6811/33605","heartbeat_back_addr":"172.21.15.50:6815/33605","heartbeat_front_addr":"172.21.15.50:6813/33605","state":["exists","up"]},{"osd":5,"uuid":"726c3003-34e6-4d5a-b6e2-f911e13c2118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33606},{"type":"v1","addr":"172.21.15.50:6801","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33606},{"type":"v1","addr":"172.21.15.50:6803","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33606},{"type":"v1","addr":"172.21.15.50:6807","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":33606},{"type":"v1","addr":"172.21.15.50:6805","nonce":33606}]},"public_addr":"172.21.15.50:6801/33606","cluster_addr":"172.21.15.50:6803/33606","heartbeat_back_addr":"172.21.15.50:6807/33606","heartbeat_front_addr":"172.21.15.50:6805/33606","state":["exists","up"]},{"osd":6,"uuid":"401122a4-9988-441f-a5a7-39164434ebcd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":33607},{"type":"v1","addr":"172.21.15.50:6819","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":33607},{"type":"v1","addr":"172.21.15.50:6823","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":33607},{"type":"v1","addr":"172.21.15.50:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":33607},{"type":"v1","addr":"172.21.15.50:6827","nonce":33607}]},"public_addr":"172.21.15.50:6819/33607","cluster_addr":"172.21.15.50:6823/33607","heartbeat_back_addr":"172.21.15.50:6831/33607","heartbeat_front_addr":"172.21.15.50:6827/33607","state":["exists","up"]},{"osd":7,"uuid":"6b3fa236-c9d0-4c4d-82ae-9af4daf6d699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33604},{"type":"v1","addr":"172.21.15.50:6818","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":33604},{"type":"v1","addr":"172.21.15.50:6822","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":33604},{"type":"v1","addr":"172.21.15.50:6830","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":33604},{"type":"v1","addr":"172.21.15.50:6826","nonce":33604}]},"public_addr":"172.21.15.50:6818/33604","cluster_addr":"172.21.15.50:6822/33604","heartbeat_back_addr":"172.21.15.50:6830/33604","heartbeat_front_addr":"172.21.15.50:6826/33604","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.497794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.529417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.873426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.325972+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.443971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.240795+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.739632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.643026+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:40:00.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.167+0000 7f19012c9700 1 -- 172.21.15.3:0/1114831828 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f18e8060550 msgr2=0x7f18e8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:00.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.167+0000 7f19012c9700 1 --2- 172.21.15.3:0/1114831828 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f18e8060550 0x7f18e8062a00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f18f00091e0 tx=0x7f18f001a000 comp rx=0 tx=0).stop 2023-10-08T15:40:00.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.167+0000 7f19012c9700 1 -- 172.21.15.3:0/1114831828 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f18fc0a01b0 msgr2=0x7f18fc151b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:00.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.167+0000 7f19012c9700 1 --2- 172.21.15.3:0/1114831828 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f18fc0a01b0 0x7f18fc151b80 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f18ec007ac0 tx=0x7f18ec0021d0 comp rx=0 tx=0).stop 2023-10-08T15:40:00.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.167+0000 7f19012c9700 1 -- 172.21.15.3:0/1114831828 shutdown_connections 2023-10-08T15:40:00.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.167+0000 7f19012c9700 1 --2- 172.21.15.3:0/1114831828 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f18e8060550 0x7f18e8062a00 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:00.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.167+0000 7f19012c9700 1 --2- 172.21.15.3:0/1114831828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18fc14af90 0x7f18fc14b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:00.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.167+0000 7f19012c9700 1 --2- 172.21.15.3:0/1114831828 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f18fc0a01b0 0x7f18fc151b80 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:00.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.167+0000 7f19012c9700 1 --2- 172.21.15.3:0/1114831828 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f18e4003a60 0x7f18fc0a2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:00.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.167+0000 7f19012c9700 1 -- 172.21.15.3:0/1114831828 >> 172.21.15.3:0/1114831828 conn(0x7f18fc0be4a0 msgr2=0x7f18fc14db50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:00.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.171+0000 7f19012c9700 1 -- 172.21.15.3:0/1114831828 shutdown_connections 2023-10-08T15:40:00.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.171+0000 7f19012c9700 1 -- 172.21.15.3:0/1114831828 wait complete. 2023-10-08T15:40:00.186 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T15:37:16.581590+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T15:38:09.361822+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T15:38:09.863387+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T15:40:00.186 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T15:40:00.297 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.295+0000 7fae7bfff700 1 Processor -- start 2023-10-08T15:40:00.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.295+0000 7fae7bfff700 1 -- start start 2023-10-08T15:40:00.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.295+0000 7fae7bfff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fae7c06a980 0x7fae7c1487d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:00.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.295+0000 7fae7bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fae7c068d00 0x7fae7c0babd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:00.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.295+0000 7fae7bfff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae7c069650 con 0x7fae7c0beb80 2023-10-08T15:40:00.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.295+0000 7fae7bfff700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae7c0b2040 con 0x7fae7c06a980 2023-10-08T15:40:00.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.295+0000 7fae7bfff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae7c1491d0 con 0x7fae7c068d00 2023-10-08T15:40:00.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.295+0000 7fae7a7fc700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fae7c06a980 0x7fae7c1487d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:00.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.295+0000 7fae7a7fc700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fae7c06a980 0x7fae7c1487d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52434/0 (socket says 172.21.15.3:52434) 2023-10-08T15:40:00.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.295+0000 7fae7a7fc700 1 -- 172.21.15.3:0/942512481 learned_addr learned my addr 172.21.15.3:0/942512481 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:00.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.295+0000 7fae7b7fe700 1 --2- 172.21.15.3:0/942512481 >> v2:172.21.15.50:3300/0 conn(0x7fae7c068d00 0x7fae7c0babd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:00.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.295+0000 7fae7a7fc700 1 -- 172.21.15.3:0/942512481 >> v2:172.21.15.50:3300/0 conn(0x7fae7c068d00 msgr2=0x7fae7c0babd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:00.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.295+0000 7fae7a7fc700 1 --2- 172.21.15.3:0/942512481 >> v2:172.21.15.50:3300/0 conn(0x7fae7c068d00 0x7fae7c0babd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:00.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.295+0000 7fae7a7fc700 1 -- 172.21.15.3:0/942512481 >> v1:172.21.15.50:6789/0 conn(0x7fae7c0beb80 legacy=0x7fae7c1480c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:00.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.295+0000 7fae7a7fc700 1 -- 172.21.15.3:0/942512481 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae7c0b2250 con 0x7fae7c06a980 2023-10-08T15:40:00.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.295+0000 7fae7a7fc700 1 --2- 172.21.15.3:0/942512481 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fae7c06a980 0x7fae7c1487d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fae7c0b27b0 tx=0x7fae70009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c2598649fdb83c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:00.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.295+0000 7fae79ffb700 1 -- 172.21.15.3:0/942512481 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7000b820 con 0x7fae7c06a980 2023-10-08T15:40:00.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.295+0000 7fae79ffb700 1 -- 172.21.15.3:0/942512481 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae7000b980 con 0x7fae7c06a980 2023-10-08T15:40:00.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.295+0000 7fae79ffb700 1 -- 172.21.15.3:0/942512481 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7000bd40 con 0x7fae7c06a980 2023-10-08T15:40:00.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.295+0000 7fae7bfff700 1 -- 172.21.15.3:0/942512481 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fae7c06a980 msgr2=0x7fae7c1487d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:00.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.295+0000 7fae7bfff700 1 --2- 172.21.15.3:0/942512481 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fae7c06a980 0x7fae7c1487d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fae7c0b27b0 tx=0x7fae70009250 comp rx=0 tx=0).stop 2023-10-08T15:40:00.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.295+0000 7fae7bfff700 1 -- 172.21.15.3:0/942512481 shutdown_connections 2023-10-08T15:40:00.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.295+0000 7fae7bfff700 1 --2- 172.21.15.3:0/942512481 >> v2:172.21.15.50:3300/0 conn(0x7fae7c068d00 0x7fae7c0babd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:00.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.295+0000 7fae7bfff700 1 --2- 172.21.15.3:0/942512481 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fae7c06a980 0x7fae7c1487d0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:00.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.295+0000 7fae7bfff700 1 -- 172.21.15.3:0/942512481 >> 172.21.15.3:0/942512481 conn(0x7fae7c067b60 msgr2=0x7fae7c0be240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:00.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.295+0000 7fae7bfff700 1 -- 172.21.15.3:0/942512481 shutdown_connections 2023-10-08T15:40:00.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.295+0000 7fae7bfff700 1 -- 172.21.15.3:0/942512481 wait complete. 2023-10-08T15:40:00.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.299+0000 7fae7bfff700 1 Processor -- start 2023-10-08T15:40:00.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.299+0000 7fae7bfff700 1 -- start start 2023-10-08T15:40:00.306 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.299+0000 7fae7bfff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fae7c068d00 0x7fae7c0bc040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:00.306 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.299+0000 7fae7bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae7c06a980 0x7fae7c143060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:00.306 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.299+0000 7fae7bfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fae7c0beb80 0x7fae7c1435a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:00.306 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.299+0000 7fae7bfff700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c159430 con 0x7fae7c0beb80 2023-10-08T15:40:00.306 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.299+0000 7fae7bfff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c0bdb50 con 0x7fae7c06a980 2023-10-08T15:40:00.306 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.299+0000 7fae7bfff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c0bde30 con 0x7fae7c068d00 2023-10-08T15:40:00.306 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.299+0000 7fae7b7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fae7c0beb80 0x7fae7c1435a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:00.306 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.299+0000 7fae7b7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fae7c0beb80 0x7fae7c1435a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52442/0 (socket says 172.21.15.3:52442) 2023-10-08T15:40:00.306 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.299+0000 7fae7b7fe700 1 -- 172.21.15.3:0/1169874587 learned_addr learned my addr 172.21.15.3:0/1169874587 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:00.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.299+0000 7fae7a7fc700 1 --2- 172.21.15.3:0/1169874587 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae7c06a980 0x7fae7c143060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:00.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.299+0000 7fae7affd700 1 --2- 172.21.15.3:0/1169874587 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fae7c068d00 0x7fae7c0bc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:00.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.299+0000 7fae7b7fe700 1 -- 172.21.15.3:0/1169874587 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fae7c068d00 msgr2=0x7fae7c0bc040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:00.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.299+0000 7fae7b7fe700 1 --2- 172.21.15.3:0/1169874587 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fae7c068d00 0x7fae7c0bc040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:00.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.299+0000 7fae7b7fe700 1 -- 172.21.15.3:0/1169874587 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae7c06a980 msgr2=0x7fae7c143060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:00.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.299+0000 7fae7b7fe700 1 --2- 172.21.15.3:0/1169874587 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae7c06a980 0x7fae7c143060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:00.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.299+0000 7fae7b7fe700 1 -- 172.21.15.3:0/1169874587 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae700094f0 con 0x7fae7c0beb80 2023-10-08T15:40:00.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.299+0000 7fae7b7fe700 1 --2- 172.21.15.3:0/1169874587 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fae7c0beb80 0x7fae7c1435a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fae7400ceb0 tx=0x7fae74007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:00.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.299+0000 7fae62ffd700 1 -- 172.21.15.3:0/1169874587 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7400ad90 con 0x7fae7c0beb80 2023-10-08T15:40:00.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.299+0000 7fae62ffd700 1 -- 172.21.15.3:0/1169874587 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae74016430 con 0x7fae7c0beb80 2023-10-08T15:40:00.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.299+0000 7fae7bfff700 1 -- 172.21.15.3:0/1169874587 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae7c0bd800 con 0x7fae7c0beb80 2023-10-08T15:40:00.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.299+0000 7fae62ffd700 1 -- 172.21.15.3:0/1169874587 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae740167d0 con 0x7fae7c0beb80 2023-10-08T15:40:00.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.299+0000 7fae7bfff700 1 -- 172.21.15.3:0/1169874587 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae7c159a20 con 0x7fae7c0beb80 2023-10-08T15:40:00.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.303+0000 7fae7bfff700 1 -- 172.21.15.3:0/1169874587 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae7c1595a0 con 0x7fae7c0beb80 2023-10-08T15:40:00.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.303+0000 7fae62ffd700 1 -- 172.21.15.3:0/1169874587 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fae74003020 con 0x7fae7c0beb80 2023-10-08T15:40:00.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.303+0000 7fae62ffd700 1 --2- 172.21.15.3:0/1169874587 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fae68060580 0x7fae68062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:00.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.303+0000 7fae62ffd700 1 -- 172.21.15.3:0/1169874587 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fae74012070 con 0x7fae7c0beb80 2023-10-08T15:40:00.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.303+0000 7fae7affd700 1 --2- 172.21.15.3:0/1169874587 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fae68060580 0x7fae68062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:00.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.303+0000 7fae7affd700 1 --2- 172.21.15.3:0/1169874587 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fae68060580 0x7fae68062a30 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fae6c009af0 tx=0x7fae6c009060 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:00.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.307+0000 7fae62ffd700 1 -- 172.21.15.3:0/1169874587 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fae7c1595a0 con 0x7fae7c0beb80 2023-10-08T15:40:00.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.471+0000 7fae7bfff700 1 -- 172.21.15.3:0/1169874587 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fae7c0bd990 con 0x7fae7c0beb80 2023-10-08T15:40:00.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.471+0000 7fae62ffd700 1 -- 172.21.15.3:0/1169874587 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fae7404db70 con 0x7fae7c0beb80 2023-10-08T15:40:00.476 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2023-10-08T15:40:00.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.475+0000 7fae7bfff700 1 -- 172.21.15.3:0/1169874587 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fae68060580 msgr2=0x7fae68062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:00.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.475+0000 7fae7bfff700 1 --2- 172.21.15.3:0/1169874587 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fae68060580 0x7fae68062a30 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fae6c009af0 tx=0x7fae6c009060 comp rx=0 tx=0).stop 2023-10-08T15:40:00.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.475+0000 7fae7bfff700 1 -- 172.21.15.3:0/1169874587 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fae7c0beb80 msgr2=0x7fae7c1435a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:00.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.475+0000 7fae7bfff700 1 --2- 172.21.15.3:0/1169874587 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fae7c0beb80 0x7fae7c1435a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fae7400ceb0 tx=0x7fae74007870 comp rx=0 tx=0).stop 2023-10-08T15:40:00.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.475+0000 7fae7bfff700 1 -- 172.21.15.3:0/1169874587 shutdown_connections 2023-10-08T15:40:00.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.475+0000 7fae7bfff700 1 --2- 172.21.15.3:0/1169874587 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fae68060580 0x7fae68062a30 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:00.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.475+0000 7fae7bfff700 1 --2- 172.21.15.3:0/1169874587 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fae7c0beb80 0x7fae7c1435a0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:00.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.475+0000 7fae7bfff700 1 --2- 172.21.15.3:0/1169874587 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae7c06a980 0x7fae7c143060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:00.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.475+0000 7fae7bfff700 1 --2- 172.21.15.3:0/1169874587 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fae7c068d00 0x7fae7c0bc040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:00.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.475+0000 7fae7bfff700 1 -- 172.21.15.3:0/1169874587 >> 172.21.15.3:0/1169874587 conn(0x7fae7c067b60 msgr2=0x7fae7c1480c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:00.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.475+0000 7fae7bfff700 1 -- 172.21.15.3:0/1169874587 shutdown_connections 2023-10-08T15:40:00.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.475+0000 7fae7bfff700 1 -- 172.21.15.3:0/1169874587 wait complete. 2023-10-08T15:40:00.496 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T15:40:00.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.611+0000 7f1fe0fd6700 1 Processor -- start 2023-10-08T15:40:00.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.611+0000 7f1fe0fd6700 1 -- start start 2023-10-08T15:40:00.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.611+0000 7f1fe0fd6700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f1fdc06cdf0 0x7f1fdc06c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:00.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.611+0000 7f1fe0fd6700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1fdc0bc340 0x7f1fdc0bc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:00.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.611+0000 7f1fe0fd6700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fdc0a2720 con 0x7f1fdc148ca0 2023-10-08T15:40:00.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.611+0000 7f1fe0fd6700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fdc149c50 con 0x7f1fdc06cdf0 2023-10-08T15:40:00.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.611+0000 7f1fe0fd6700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc0a2440 con 0x7f1fdc0bc340 2023-10-08T15:40:00.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.611+0000 7f1fdb7fe700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f1fdc148ca0 0x7f1fdc06bc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:37414/0 (socket says 172.21.15.3:37414) 2023-10-08T15:40:00.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.611+0000 7f1fdb7fe700 1 -- 172.21.15.3:0/2177919745 learned_addr learned my addr 172.21.15.3:0/2177919745 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:40:00.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.611+0000 7f1fdaffd700 1 --2- 172.21.15.3:0/2177919745 >> v2:172.21.15.3:3300/0 conn(0x7f1fdc06cdf0 0x7f1fdc06c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:00.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.611+0000 7f1fdbfff700 1 --2- 172.21.15.3:0/2177919745 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1fdc0bc340 0x7f1fdc0bc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:00.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.611+0000 7f1fda7fc700 1 -- 172.21.15.3:0/2177919745 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2589277360 0 0) 0x7f1fdc0a2720 con 0x7f1fdc148ca0 2023-10-08T15:40:00.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.611+0000 7f1fda7fc700 1 -- 172.21.15.3:0/2177919745 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fc4003570 con 0x7f1fdc148ca0 2023-10-08T15:40:00.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.611+0000 7f1fdaffd700 1 -- 172.21.15.3:0/2177919745 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1fdc0bc340 msgr2=0x7f1fdc0bc7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:00.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.611+0000 7f1fdaffd700 1 --2- 172.21.15.3:0/2177919745 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1fdc0bc340 0x7f1fdc0bc7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:00.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.611+0000 7f1fdaffd700 1 -- 172.21.15.3:0/2177919745 >> v1:172.21.15.3:6789/0 conn(0x7f1fdc148ca0 legacy=0x7f1fdc06bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:00.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.611+0000 7f1fdaffd700 1 -- 172.21.15.3:0/2177919745 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fdc09f2c0 con 0x7f1fdc06cdf0 2023-10-08T15:40:00.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.611+0000 7f1fdaffd700 1 --2- 172.21.15.3:0/2177919745 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1fdc06cdf0 0x7f1fdc06c3a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1fd00098e0 tx=0x7f1fd00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3103dd2f254db229 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:00.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.611+0000 7f1fda7fc700 1 -- 172.21.15.3:0/2177919745 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd000b640 con 0x7f1fdc06cdf0 2023-10-08T15:40:00.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.611+0000 7f1fda7fc700 1 -- 172.21.15.3:0/2177919745 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd000b7a0 con 0x7f1fdc06cdf0 2023-10-08T15:40:00.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.611+0000 7f1fda7fc700 1 -- 172.21.15.3:0/2177919745 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd000bb40 con 0x7f1fdc06cdf0 2023-10-08T15:40:00.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.615+0000 7f1fe0fd6700 1 -- 172.21.15.3:0/2177919745 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1fdc06cdf0 msgr2=0x7f1fdc06c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:00.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.615+0000 7f1fe0fd6700 1 --2- 172.21.15.3:0/2177919745 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1fdc06cdf0 0x7f1fdc06c3a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1fd00098e0 tx=0x7f1fd00091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:00.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.615+0000 7f1fe0fd6700 1 -- 172.21.15.3:0/2177919745 shutdown_connections 2023-10-08T15:40:00.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.615+0000 7f1fe0fd6700 1 --2- 172.21.15.3:0/2177919745 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1fdc0bc340 0x7f1fdc0bc7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:00.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.615+0000 7f1fe0fd6700 1 --2- 172.21.15.3:0/2177919745 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1fdc06cdf0 0x7f1fdc06c3a0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:00.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.615+0000 7f1fe0fd6700 1 -- 172.21.15.3:0/2177919745 >> 172.21.15.3:0/2177919745 conn(0x7f1fdc06f340 msgr2=0x7f1fdc0670e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:00.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.615+0000 7f1fe0fd6700 1 -- 172.21.15.3:0/2177919745 shutdown_connections 2023-10-08T15:40:00.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.615+0000 7f1fe0fd6700 1 -- 172.21.15.3:0/2177919745 wait complete. 2023-10-08T15:40:00.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.615+0000 7f1fe0fd6700 1 Processor -- start 2023-10-08T15:40:00.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.615+0000 7f1fe0fd6700 1 -- start start 2023-10-08T15:40:00.625 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.619+0000 7f1fe0fd6700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1fdc06cdf0 0x7f1fdc0bf050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:00.625 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.619+0000 7f1fe0fd6700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1fdc0bc340 0x7f1fdc0b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:00.625 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.619+0000 7f1fe0fd6700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fdc148ca0 0x7f1fdc0b7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:00.625 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.619+0000 7f1fe0fd6700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc0b6c10 con 0x7f1fdc06cdf0 2023-10-08T15:40:00.625 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.619+0000 7f1fe0fd6700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc0b71d0 con 0x7f1fdc148ca0 2023-10-08T15:40:00.625 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.619+0000 7f1fe0fd6700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc0b6620 con 0x7f1fdc0bc340 2023-10-08T15:40:00.625 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.619+0000 7f1fdb7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1fdc06cdf0 0x7f1fdc0bf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:00.625 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.619+0000 7f1fdb7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1fdc06cdf0 0x7f1fdc0bf050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52454/0 (socket says 172.21.15.3:52454) 2023-10-08T15:40:00.625 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.619+0000 7f1fdb7fe700 1 -- 172.21.15.3:0/2414714297 learned_addr learned my addr 172.21.15.3:0/2414714297 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:00.625 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.619+0000 7f1fdaffd700 1 --2- 172.21.15.3:0/2414714297 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1fdc0bc340 0x7f1fdc0b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:00.625 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.619+0000 7f1fdbfff700 1 --2- 172.21.15.3:0/2414714297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fdc148ca0 0x7f1fdc0b7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:00.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.619+0000 7f1fdb7fe700 1 -- 172.21.15.3:0/2414714297 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1fdc0bc340 msgr2=0x7f1fdc0b60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:00.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.619+0000 7f1fdb7fe700 1 --2- 172.21.15.3:0/2414714297 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1fdc0bc340 0x7f1fdc0b60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:00.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.619+0000 7f1fdb7fe700 1 -- 172.21.15.3:0/2414714297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fdc148ca0 msgr2=0x7f1fdc0b7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:00.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.619+0000 7f1fdb7fe700 1 --2- 172.21.15.3:0/2414714297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fdc148ca0 0x7f1fdc0b7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:00.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.619+0000 7f1fdb7fe700 1 -- 172.21.15.3:0/2414714297 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd0009420 con 0x7f1fdc06cdf0 2023-10-08T15:40:00.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.619+0000 7f1fdb7fe700 1 --2- 172.21.15.3:0/2414714297 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1fdc06cdf0 0x7f1fdc0bf050 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc00c5c0 tx=0x7f1fcc007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:00.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.619+0000 7f1fc37fe700 1 -- 172.21.15.3:0/2414714297 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc005b30 con 0x7f1fdc06cdf0 2023-10-08T15:40:00.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.619+0000 7f1fc37fe700 1 -- 172.21.15.3:0/2414714297 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fcc005cb0 con 0x7f1fdc06cdf0 2023-10-08T15:40:00.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.619+0000 7f1fc37fe700 1 -- 172.21.15.3:0/2414714297 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc007320 con 0x7f1fdc06cdf0 2023-10-08T15:40:00.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.619+0000 7f1fe0fd6700 1 -- 172.21.15.3:0/2414714297 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fdc0b6e60 con 0x7f1fdc06cdf0 2023-10-08T15:40:00.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.619+0000 7f1fe0fd6700 1 -- 172.21.15.3:0/2414714297 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fdc0b5150 con 0x7f1fdc06cdf0 2023-10-08T15:40:00.627 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.623+0000 7f1fe0fd6700 1 -- 172.21.15.3:0/2414714297 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fdc06d2a0 con 0x7f1fdc06cdf0 2023-10-08T15:40:00.627 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.623+0000 7f1fc37fe700 1 -- 172.21.15.3:0/2414714297 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f1fcc01b3b0 con 0x7f1fdc06cdf0 2023-10-08T15:40:00.627 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.623+0000 7f1fc37fe700 1 --2- 172.21.15.3:0/2414714297 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1fc8060550 0x7f1fc8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:00.627 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.623+0000 7f1fc37fe700 1 -- 172.21.15.3:0/2414714297 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1fcc07bbd0 con 0x7f1fdc06cdf0 2023-10-08T15:40:00.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.623+0000 7f1fdaffd700 1 --2- 172.21.15.3:0/2414714297 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1fc8060550 0x7f1fc8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:00.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.623+0000 7f1fdaffd700 1 --2- 172.21.15.3:0/2414714297 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1fc8060550 0x7f1fc8062a00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1fd00093f0 tx=0x7f1fd0017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:00.633 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.631+0000 7f1fc37fe700 1 -- 172.21.15.3:0/2414714297 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1fdc06d2a0 con 0x7f1fdc06cdf0 2023-10-08T15:40:00.795 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.791+0000 7f1fe0fd6700 1 -- 172.21.15.3:0/2414714297 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1fdc06d2a0 con 0x7f1fdc06cdf0 2023-10-08T15:40:00.796 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.791+0000 7f1fc37fe700 1 -- 172.21.15.3:0/2414714297 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1fdc06d2a0 con 0x7f1fdc06cdf0 2023-10-08T15:40:00.796 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 32 2023-10-08T15:40:00.798 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.795+0000 7f1fe0fd6700 1 -- 172.21.15.3:0/2414714297 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1fc8060550 msgr2=0x7f1fc8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:00.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.795+0000 7f1fe0fd6700 1 --2- 172.21.15.3:0/2414714297 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1fc8060550 0x7f1fc8062a00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1fd00093f0 tx=0x7f1fd0017000 comp rx=0 tx=0).stop 2023-10-08T15:40:00.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.795+0000 7f1fe0fd6700 1 -- 172.21.15.3:0/2414714297 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1fdc06cdf0 msgr2=0x7f1fdc0bf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:00.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.795+0000 7f1fe0fd6700 1 --2- 172.21.15.3:0/2414714297 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1fdc06cdf0 0x7f1fdc0bf050 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc00c5c0 tx=0x7f1fcc007e00 comp rx=0 tx=0).stop 2023-10-08T15:40:00.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.795+0000 7f1fe0fd6700 1 -- 172.21.15.3:0/2414714297 shutdown_connections 2023-10-08T15:40:00.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.795+0000 7f1fe0fd6700 1 --2- 172.21.15.3:0/2414714297 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1fc8060550 0x7f1fc8062a00 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:00.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.795+0000 7f1fe0fd6700 1 --2- 172.21.15.3:0/2414714297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fdc148ca0 0x7f1fdc0b7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:00.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.795+0000 7f1fe0fd6700 1 --2- 172.21.15.3:0/2414714297 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1fdc0bc340 0x7f1fdc0b60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:00.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.795+0000 7f1fe0fd6700 1 --2- 172.21.15.3:0/2414714297 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1fdc06cdf0 0x7f1fdc0bf050 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:00.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.795+0000 7f1fe0fd6700 1 -- 172.21.15.3:0/2414714297 >> 172.21.15.3:0/2414714297 conn(0x7f1fdc06f340 msgr2=0x7f1fdc14d280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:00.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.795+0000 7f1fe0fd6700 1 -- 172.21.15.3:0/2414714297 shutdown_connections 2023-10-08T15:40:00.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.795+0000 7f1fe0fd6700 1 -- 172.21.15.3:0/2414714297 wait complete. 2023-10-08T15:40:00.811 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T15:40:00.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.919+0000 7f3cc3fff700 1 Processor -- start 2023-10-08T15:40:00.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.919+0000 7f3cc3fff700 1 -- start start 2023-10-08T15:40:00.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.919+0000 7f3cc3fff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f3cc406c5c0 0x7f3cc40be3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:00.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.919+0000 7f3cc3fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3cc40a7bc0 0x7f3cc414bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:00.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.919+0000 7f3cc3fff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cc406ced0 con 0x7f3cc40a77f0 2023-10-08T15:40:00.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.919+0000 7f3cc3fff700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cc406e770 con 0x7f3cc406c5c0 2023-10-08T15:40:00.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.919+0000 7f3cc3fff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc4069570 con 0x7f3cc40a7bc0 2023-10-08T15:40:00.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.919+0000 7f3cc27fc700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f3cc406c5c0 0x7f3cc40be3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:00.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.919+0000 7f3cc27fc700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f3cc406c5c0 0x7f3cc40be3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52462/0 (socket says 172.21.15.3:52462) 2023-10-08T15:40:00.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.919+0000 7f3cc27fc700 1 -- 172.21.15.3:0/3470044319 learned_addr learned my addr 172.21.15.3:0/3470044319 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:00.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.919+0000 7f3cc37fe700 1 --2- 172.21.15.3:0/3470044319 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3cc40a7bc0 0x7f3cc414bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:00.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.923+0000 7f3cc27fc700 1 -- 172.21.15.3:0/3470044319 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3cc40a7bc0 msgr2=0x7f3cc414bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:00.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.923+0000 7f3cc27fc700 1 --2- 172.21.15.3:0/3470044319 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3cc40a7bc0 0x7f3cc414bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:00.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.923+0000 7f3cc27fc700 1 -- 172.21.15.3:0/3470044319 >> v1:172.21.15.50:6789/0 conn(0x7f3cc40a77f0 legacy=0x7f3cc40a2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:00.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.923+0000 7f3cc27fc700 1 -- 172.21.15.3:0/3470044319 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc414c620 con 0x7f3cc406c5c0 2023-10-08T15:40:00.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.923+0000 7f3cc27fc700 1 --2- 172.21.15.3:0/3470044319 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3cc406c5c0 0x7f3cc40be3d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f3cb40099b0 tx=0x7f3cb4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb21318613f3f81d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:00.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.923+0000 7f3cc1ffb700 1 -- 172.21.15.3:0/3470044319 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb400b860 con 0x7f3cc406c5c0 2023-10-08T15:40:00.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.923+0000 7f3cc1ffb700 1 -- 172.21.15.3:0/3470044319 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cb400b9c0 con 0x7f3cc406c5c0 2023-10-08T15:40:00.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.923+0000 7f3cc1ffb700 1 -- 172.21.15.3:0/3470044319 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb400bd80 con 0x7f3cc406c5c0 2023-10-08T15:40:00.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.923+0000 7f3cc3fff700 1 -- 172.21.15.3:0/3470044319 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3cc406c5c0 msgr2=0x7f3cc40be3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:00.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.923+0000 7f3cc3fff700 1 --2- 172.21.15.3:0/3470044319 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3cc406c5c0 0x7f3cc40be3d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f3cb40099b0 tx=0x7f3cb4009250 comp rx=0 tx=0).stop 2023-10-08T15:40:00.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.923+0000 7f3cc3fff700 1 -- 172.21.15.3:0/3470044319 shutdown_connections 2023-10-08T15:40:00.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.923+0000 7f3cc3fff700 1 --2- 172.21.15.3:0/3470044319 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3cc40a7bc0 0x7f3cc414bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:00.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.923+0000 7f3cc3fff700 1 --2- 172.21.15.3:0/3470044319 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3cc406c5c0 0x7f3cc40be3d0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:00.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.923+0000 7f3cc3fff700 1 -- 172.21.15.3:0/3470044319 >> 172.21.15.3:0/3470044319 conn(0x7f3cc40c29f0 msgr2=0x7f3cc40a1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:00.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.923+0000 7f3cc3fff700 1 -- 172.21.15.3:0/3470044319 shutdown_connections 2023-10-08T15:40:00.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.923+0000 7f3cc3fff700 1 -- 172.21.15.3:0/3470044319 wait complete. 2023-10-08T15:40:00.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.927+0000 7f3cc3fff700 1 Processor -- start 2023-10-08T15:40:00.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.927+0000 7f3cc3fff700 1 -- start start 2023-10-08T15:40:00.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.927+0000 7f3cc3fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3cc406c5c0 0x7f3cc4147c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:00.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.927+0000 7f3cc3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3cc40a77f0 0x7f3cc414e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:00.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.927+0000 7f3cc3fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3cc40a7bc0 0x7f3cc414ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:00.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.927+0000 7f3cc3fff700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc4163c70 con 0x7f3cc406c5c0 2023-10-08T15:40:00.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.927+0000 7f3cc3fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc4144dd0 con 0x7f3cc40a77f0 2023-10-08T15:40:00.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.927+0000 7f3cc3fff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc414ef60 con 0x7f3cc40a7bc0 2023-10-08T15:40:00.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.927+0000 7f3cc2ffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3cc406c5c0 0x7f3cc4147c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:00.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.927+0000 7f3cc2ffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3cc406c5c0 0x7f3cc4147c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52474/0 (socket says 172.21.15.3:52474) 2023-10-08T15:40:00.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.927+0000 7f3cc2ffd700 1 -- 172.21.15.3:0/906718483 learned_addr learned my addr 172.21.15.3:0/906718483 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:00.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.927+0000 7f3cc27fc700 1 --2- 172.21.15.3:0/906718483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3cc40a77f0 0x7f3cc414e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:00.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.927+0000 7f3cc37fe700 1 --2- 172.21.15.3:0/906718483 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3cc40a7bc0 0x7f3cc414ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:00.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.927+0000 7f3cc2ffd700 1 -- 172.21.15.3:0/906718483 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3cc40a7bc0 msgr2=0x7f3cc414ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:00.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.927+0000 7f3cc2ffd700 1 --2- 172.21.15.3:0/906718483 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3cc40a7bc0 0x7f3cc414ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:00.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.927+0000 7f3cc2ffd700 1 -- 172.21.15.3:0/906718483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3cc40a77f0 msgr2=0x7f3cc414e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:00.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.927+0000 7f3cc2ffd700 1 --2- 172.21.15.3:0/906718483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3cc40a77f0 0x7f3cc414e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:00.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.927+0000 7f3cc2ffd700 1 -- 172.21.15.3:0/906718483 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb40094f0 con 0x7f3cc406c5c0 2023-10-08T15:40:00.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.927+0000 7f3cc2ffd700 1 --2- 172.21.15.3:0/906718483 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3cc406c5c0 0x7f3cc4147c80 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3cb800c5c0 tx=0x7f3cb800c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:00.935 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.927+0000 7f3caaffd700 1 -- 172.21.15.3:0/906718483 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb8011590 con 0x7f3cc406c5c0 2023-10-08T15:40:00.935 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.931+0000 7f3caaffd700 1 -- 172.21.15.3:0/906718483 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cb8011710 con 0x7f3cc406c5c0 2023-10-08T15:40:00.935 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.931+0000 7f3cc3fff700 1 -- 172.21.15.3:0/906718483 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cc41608a0 con 0x7f3cc406c5c0 2023-10-08T15:40:00.935 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.931+0000 7f3caaffd700 1 -- 172.21.15.3:0/906718483 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb8011ad0 con 0x7f3cc406c5c0 2023-10-08T15:40:00.935 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.931+0000 7f3cc3fff700 1 -- 172.21.15.3:0/906718483 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cc4147330 con 0x7f3cc406c5c0 2023-10-08T15:40:00.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.931+0000 7f3cc3fff700 1 -- 172.21.15.3:0/906718483 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cc405ecf0 con 0x7f3cc406c5c0 2023-10-08T15:40:00.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.931+0000 7f3caaffd700 1 -- 172.21.15.3:0/906718483 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f3cb801b3b0 con 0x7f3cc406c5c0 2023-10-08T15:40:00.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.931+0000 7f3caaffd700 1 --2- 172.21.15.3:0/906718483 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3cb0060580 0x7f3cb0062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:00.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.931+0000 7f3caaffd700 1 -- 172.21.15.3:0/906718483 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3cb807bdf0 con 0x7f3cc406c5c0 2023-10-08T15:40:00.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.931+0000 7f3cc27fc700 1 --2- 172.21.15.3:0/906718483 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3cb0060580 0x7f3cb0062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:00.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.935+0000 7f3cc27fc700 1 --2- 172.21.15.3:0/906718483 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3cb0060580 0x7f3cb0062a30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3cb40099b0 tx=0x7f3cb4017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:00.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:00.939+0000 7f3caaffd700 1 -- 172.21.15.3:0/906718483 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3cb804c340 con 0x7f3cc406c5c0 2023-10-08T15:40:01.107 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.103+0000 7f3cc3fff700 1 -- 172.21.15.3:0/906718483 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3cc406cb60 con 0x7f3cc406c5c0 2023-10-08T15:40:01.107 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.103+0000 7f3caaffd700 1 -- 172.21.15.3:0/906718483 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3cb8017020 con 0x7f3cc406c5c0 2023-10-08T15:40:01.108 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 64 2023-10-08T15:40:01.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.107+0000 7f3cc3fff700 1 -- 172.21.15.3:0/906718483 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3cb0060580 msgr2=0x7f3cb0062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:01.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.107+0000 7f3cc3fff700 1 --2- 172.21.15.3:0/906718483 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3cb0060580 0x7f3cb0062a30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3cb40099b0 tx=0x7f3cb4017000 comp rx=0 tx=0).stop 2023-10-08T15:40:01.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.107+0000 7f3cc3fff700 1 -- 172.21.15.3:0/906718483 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3cc406c5c0 msgr2=0x7f3cc4147c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:01.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.107+0000 7f3cc3fff700 1 --2- 172.21.15.3:0/906718483 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3cc406c5c0 0x7f3cc4147c80 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3cb800c5c0 tx=0x7f3cb800c980 comp rx=0 tx=0).stop 2023-10-08T15:40:01.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.107+0000 7f3cc3fff700 1 -- 172.21.15.3:0/906718483 shutdown_connections 2023-10-08T15:40:01.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.107+0000 7f3cc3fff700 1 --2- 172.21.15.3:0/906718483 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3cb0060580 0x7f3cb0062a30 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:01.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.107+0000 7f3cc3fff700 1 --2- 172.21.15.3:0/906718483 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3cc40a7bc0 0x7f3cc414ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:01.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.107+0000 7f3cc3fff700 1 --2- 172.21.15.3:0/906718483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3cc40a77f0 0x7f3cc414e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:01.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.107+0000 7f3cc3fff700 1 --2- 172.21.15.3:0/906718483 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3cc406c5c0 0x7f3cc4147c80 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:01.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.107+0000 7f3cc3fff700 1 -- 172.21.15.3:0/906718483 >> 172.21.15.3:0/906718483 conn(0x7f3cc40c29f0 msgr2=0x7f3cc40bf340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:01.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.107+0000 7f3cc3fff700 1 -- 172.21.15.3:0/906718483 shutdown_connections 2023-10-08T15:40:01.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.107+0000 7f3cc3fff700 1 -- 172.21.15.3:0/906718483 wait complete. 2023-10-08T15:40:01.123 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:40:01.232 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.227+0000 7f70df59e700 1 Processor -- start 2023-10-08T15:40:01.232 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.227+0000 7f70df59e700 1 -- start start 2023-10-08T15:40:01.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.227+0000 7f70df59e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f70e00bab50 0x7f70e00baf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:01.234 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.227+0000 7f70df59e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f70e014a080 0x7f70e014c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:01.234 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.227+0000 7f70df59e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70e00b4050 con 0x7f70e006df30 2023-10-08T15:40:01.234 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.227+0000 7f70df59e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70e0146da0 con 0x7f70e00bab50 2023-10-08T15:40:01.234 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.227+0000 7f70df59e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70e00b4710 con 0x7f70e014a080 2023-10-08T15:40:01.234 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.231+0000 7f70ded9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f70e014a080 0x7f70e014c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:01.234 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.231+0000 7f70ded9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f70e014a080 0x7f70e014c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.3:55396/0 (socket says 172.21.15.3:55396) 2023-10-08T15:40:01.234 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.231+0000 7f70ded9d700 1 -- 172.21.15.3:0/646833616 learned_addr learned my addr 172.21.15.3:0/646833616 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:01.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.231+0000 7f70de59c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f70e00bab50 0x7f70e00baf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:01.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.231+0000 7f70ded9d700 1 -- 172.21.15.3:0/646833616 >> v2:172.21.15.50:3300/0 conn(0x7f70e00bab50 msgr2=0x7f70e00baf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:01.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.231+0000 7f70ded9d700 1 --2- 172.21.15.3:0/646833616 >> v2:172.21.15.50:3300/0 conn(0x7f70e00bab50 0x7f70e00baf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:01.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.231+0000 7f70ded9d700 1 -- 172.21.15.3:0/646833616 >> v1:172.21.15.50:6789/0 conn(0x7f70e006df30 legacy=0x7f70e0149970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:01.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.231+0000 7f70ded9d700 1 -- 172.21.15.3:0/646833616 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e00b4330 con 0x7f70e014a080 2023-10-08T15:40:01.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.231+0000 7f70ded9d700 1 --2- 172.21.15.3:0/646833616 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f70e014a080 0x7f70e014c9c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f70d80099b0 tx=0x7f70d8009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c3da422b4d1c6ed server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:01.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.231+0000 7f70dd59a700 1 -- 172.21.15.3:0/646833616 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d8009ea0 con 0x7f70e014a080 2023-10-08T15:40:01.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.231+0000 7f70dd59a700 1 -- 172.21.15.3:0/646833616 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d800b860 con 0x7f70e014a080 2023-10-08T15:40:01.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.231+0000 7f70dd59a700 1 -- 172.21.15.3:0/646833616 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d800bc00 con 0x7f70e014a080 2023-10-08T15:40:01.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.231+0000 7f70df59e700 1 -- 172.21.15.3:0/646833616 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f70e014a080 msgr2=0x7f70e014c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:01.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.231+0000 7f70df59e700 1 --2- 172.21.15.3:0/646833616 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f70e014a080 0x7f70e014c9c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f70d80099b0 tx=0x7f70d8009250 comp rx=0 tx=0).stop 2023-10-08T15:40:01.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.231+0000 7f70df59e700 1 -- 172.21.15.3:0/646833616 shutdown_connections 2023-10-08T15:40:01.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.231+0000 7f70df59e700 1 --2- 172.21.15.3:0/646833616 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f70e014a080 0x7f70e014c9c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:01.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.231+0000 7f70df59e700 1 --2- 172.21.15.3:0/646833616 >> v2:172.21.15.50:3300/0 conn(0x7f70e00bab50 0x7f70e00baf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:01.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.231+0000 7f70df59e700 1 -- 172.21.15.3:0/646833616 >> 172.21.15.3:0/646833616 conn(0x7f70e00be4a0 msgr2=0x7f70e00ba440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:01.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.231+0000 7f70df59e700 1 -- 172.21.15.3:0/646833616 shutdown_connections 2023-10-08T15:40:01.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.231+0000 7f70df59e700 1 -- 172.21.15.3:0/646833616 wait complete. 2023-10-08T15:40:01.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.231+0000 7f70df59e700 1 Processor -- start 2023-10-08T15:40:01.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.231+0000 7f70df59e700 1 -- start start 2023-10-08T15:40:01.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.235+0000 7f70df59e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f70e006df30 0x7f70e0142470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:01.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.235+0000 7f70df59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70e00bab50 0x7f70e014d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:01.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.235+0000 7f70df59e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f70e014a080 0x7f70e0148380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:01.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.235+0000 7f70df59e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e0149060 con 0x7f70e014a080 2023-10-08T15:40:01.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.235+0000 7f70df59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e0148cf0 con 0x7f70e00bab50 2023-10-08T15:40:01.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.235+0000 7f70df59e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70e014d9f0 con 0x7f70e006df30 2023-10-08T15:40:01.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.235+0000 7f70ded9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f70e014a080 0x7f70e0148380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:01.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.235+0000 7f70ded9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f70e014a080 0x7f70e0148380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52486/0 (socket says 172.21.15.3:52486) 2023-10-08T15:40:01.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.235+0000 7f70ded9d700 1 -- 172.21.15.3:0/2771599246 learned_addr learned my addr 172.21.15.3:0/2771599246 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:01.241 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.235+0000 7f70ddd9b700 1 --2- 172.21.15.3:0/2771599246 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70e00bab50 0x7f70e014d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:01.241 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.235+0000 7f70de59c700 1 --2- 172.21.15.3:0/2771599246 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f70e006df30 0x7f70e0142470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:01.241 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.235+0000 7f70ded9d700 1 -- 172.21.15.3:0/2771599246 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f70e006df30 msgr2=0x7f70e0142470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:01.241 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.235+0000 7f70ded9d700 1 --2- 172.21.15.3:0/2771599246 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f70e006df30 0x7f70e0142470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:01.241 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.235+0000 7f70ded9d700 1 -- 172.21.15.3:0/2771599246 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70e00bab50 msgr2=0x7f70e014d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:01.241 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.235+0000 7f70ded9d700 1 --2- 172.21.15.3:0/2771599246 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70e00bab50 0x7f70e014d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:01.241 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.235+0000 7f70ded9d700 1 -- 172.21.15.3:0/2771599246 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d80094f0 con 0x7f70e014a080 2023-10-08T15:40:01.241 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.235+0000 7f70ded9d700 1 --2- 172.21.15.3:0/2771599246 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f70e014a080 0x7f70e0148380 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f70e00bb4b0 tx=0x7f70d8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:01.241 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.235+0000 7f70ce7fc700 1 -- 172.21.15.3:0/2771599246 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d800baa0 con 0x7f70e014a080 2023-10-08T15:40:01.241 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.235+0000 7f70ce7fc700 1 -- 172.21.15.3:0/2771599246 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d8025420 con 0x7f70e014a080 2023-10-08T15:40:01.241 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.235+0000 7f70df59e700 1 -- 172.21.15.3:0/2771599246 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70e014dbb0 con 0x7f70e014a080 2023-10-08T15:40:01.242 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.235+0000 7f70ce7fc700 1 -- 172.21.15.3:0/2771599246 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d800bc00 con 0x7f70e014a080 2023-10-08T15:40:01.242 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.235+0000 7f70df59e700 1 -- 172.21.15.3:0/2771599246 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70e0148a60 con 0x7f70e014a080 2023-10-08T15:40:01.242 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.235+0000 7f70df59e700 1 -- 172.21.15.3:0/2771599246 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70e014d1d0 con 0x7f70e014a080 2023-10-08T15:40:01.242 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.239+0000 7f70ce7fc700 1 -- 172.21.15.3:0/2771599246 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f70d8023070 con 0x7f70e014a080 2023-10-08T15:40:01.243 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.239+0000 7f70ce7fc700 1 --2- 172.21.15.3:0/2771599246 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f70c0060550 0x7f70c0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:01.243 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.239+0000 7f70ce7fc700 1 -- 172.21.15.3:0/2771599246 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f70d807dcb0 con 0x7f70e014a080 2023-10-08T15:40:01.243 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.239+0000 7f70de59c700 1 --2- 172.21.15.3:0/2771599246 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f70c0060550 0x7f70c0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:01.244 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.239+0000 7f70de59c700 1 --2- 172.21.15.3:0/2771599246 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f70c0060550 0x7f70c0062a00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f70e00b3b20 tx=0x7f70d40091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:01.250 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.247+0000 7f70ce7fc700 1 -- 172.21.15.3:0/2771599246 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f70e014d1d0 con 0x7f70e014a080 2023-10-08T15:40:01.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.447+0000 7f70df59e700 1 -- 172.21.15.3:0/2771599246 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f70e014dbb0 con 0x7f70e014a080 2023-10-08T15:40:01.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.447+0000 7f70ce7fc700 1 -- 172.21.15.3:0/2771599246 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+3079 (secure 0 0 0) 0x7f70d8015c20 con 0x7f70e014a080 2023-10-08T15:40:01.452 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:40:01.452 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4736,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3640212670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3640212670},{"type":"v1","addr":"172.21.15.50:6835","nonce":3640212670}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:38:10.891768+0000","modified":"2023-10-08T15:38:13.541239+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4989},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4989":{"gid":4989,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.3:6833/3457348695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":3457348695},{"type":"v1","addr":"172.21.15.3:6833","nonce":3457348695}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-08T15:40:01.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.451+0000 7f70df59e700 1 -- 172.21.15.3:0/2771599246 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f70c0060550 msgr2=0x7f70c0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:01.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.451+0000 7f70df59e700 1 --2- 172.21.15.3:0/2771599246 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f70c0060550 0x7f70c0062a00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f70e00b3b20 tx=0x7f70d40091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:01.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.451+0000 7f70df59e700 1 -- 172.21.15.3:0/2771599246 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f70e014a080 msgr2=0x7f70e0148380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:01.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.451+0000 7f70df59e700 1 --2- 172.21.15.3:0/2771599246 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f70e014a080 0x7f70e0148380 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f70e00bb4b0 tx=0x7f70d8017000 comp rx=0 tx=0).stop 2023-10-08T15:40:01.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.451+0000 7f70df59e700 1 -- 172.21.15.3:0/2771599246 shutdown_connections 2023-10-08T15:40:01.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.451+0000 7f70df59e700 1 --2- 172.21.15.3:0/2771599246 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f70c0060550 0x7f70c0062a00 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:01.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.451+0000 7f70df59e700 1 --2- 172.21.15.3:0/2771599246 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f70e014a080 0x7f70e0148380 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:01.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.451+0000 7f70df59e700 1 --2- 172.21.15.3:0/2771599246 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70e00bab50 0x7f70e014d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:01.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.451+0000 7f70df59e700 1 --2- 172.21.15.3:0/2771599246 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f70e006df30 0x7f70e0142470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:01.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.451+0000 7f70df59e700 1 -- 172.21.15.3:0/2771599246 >> 172.21.15.3:0/2771599246 conn(0x7f70e00be4a0 msgr2=0x7f70e0067f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:01.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.451+0000 7f70df59e700 1 -- 172.21.15.3:0/2771599246 shutdown_connections 2023-10-08T15:40:01.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.451+0000 7f70df59e700 1 -- 172.21.15.3:0/2771599246 wait complete. 2023-10-08T15:40:01.458 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 13 2023-10-08T15:40:01.472 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:40:01.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.571+0000 7fd7f1e91700 1 Processor -- start 2023-10-08T15:40:01.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.575+0000 7fd7f1e91700 1 -- start start 2023-10-08T15:40:01.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.575+0000 7fd7f1e91700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd7ec14ac50 0x7fd7ec14b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:01.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.575+0000 7fd7f1e91700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7ec14c6b0 con 0x7fd7ec06be60 2023-10-08T15:40:01.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.575+0000 7fd7f1e91700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7ec14c060 con 0x7fd7ec06cc40 2023-10-08T15:40:01.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.575+0000 7fd7f1e91700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ec14c340 con 0x7fd7ec14ac50 2023-10-08T15:40:01.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.575+0000 7fd7ebfff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fd7ec06be60 0x7fd7ec06c530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:37426/0 (socket says 172.21.15.3:37426) 2023-10-08T15:40:01.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.575+0000 7fd7ebfff700 1 -- 172.21.15.3:0/2401878414 learned_addr learned my addr 172.21.15.3:0/2401878414 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:40:01.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.575+0000 7fd7f0e8f700 1 --2- 172.21.15.3:0/2401878414 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd7ec14ac50 0x7fd7ec14b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:01.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.575+0000 7fd7eb7fe700 1 -- 172.21.15.3:0/2401878414 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2075535914 0 0) 0x7fd7ec14c6b0 con 0x7fd7ec06be60 2023-10-08T15:40:01.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.575+0000 7fd7eb7fe700 1 -- 172.21.15.3:0/2401878414 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7d4003570 con 0x7fd7ec06be60 2023-10-08T15:40:01.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.575+0000 7fd7eb7fe700 1 -- 172.21.15.3:0/2401878414 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 771716315 0 0) 0x7fd7ec14c060 con 0x7fd7ec06cc40 2023-10-08T15:40:01.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.575+0000 7fd7eb7fe700 1 -- 172.21.15.3:0/2401878414 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7ec14c6b0 con 0x7fd7ec06cc40 2023-10-08T15:40:01.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.575+0000 7fd7eb7fe700 1 -- 172.21.15.3:0/2401878414 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 321630738 0 0) 0x7fd7d4003570 con 0x7fd7ec06be60 2023-10-08T15:40:01.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.575+0000 7fd7eb7fe700 1 -- 172.21.15.3:0/2401878414 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd7ec14ac50 msgr2=0x7fd7ec14b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:01.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.575+0000 7fd7eb7fe700 1 --2- 172.21.15.3:0/2401878414 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd7ec14ac50 0x7fd7ec14b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:01.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.575+0000 7fd7eb7fe700 1 -- 172.21.15.3:0/2401878414 >> v1:172.21.15.50:6789/0 conn(0x7fd7ec06cc40 legacy=0x7fd7ec14cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:01.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.575+0000 7fd7eb7fe700 1 -- 172.21.15.3:0/2401878414 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7ec14e860 con 0x7fd7ec06be60 2023-10-08T15:40:01.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.575+0000 7fd7eb7fe700 1 -- 172.21.15.3:0/2401878414 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2285686191 0 0) 0x7fd7dc0013f0 con 0x7fd7ec06be60 2023-10-08T15:40:01.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.575+0000 7fd7f0e8f700 1 --2- 172.21.15.3:0/2401878414 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd7ec14ac50 0x7fd7ec14b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:40:01.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.575+0000 7fd7eb7fe700 1 -- 172.21.15.3:0/2401878414 >> v1:172.21.15.3:6789/0 conn(0x7fd7ec06be60 legacy=0x7fd7ec06c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:01.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.575+0000 7fd7eb7fe700 1 --2- 172.21.15.3:0/2401878414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7d4003c20 0x7fd7d4003ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:01.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.575+0000 7fd7eb7fe700 1 --2- 172.21.15.3:0/2401878414 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd7ec14ac50 0x7fd7d4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:01.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.575+0000 7fd7eb7fe700 1 --2- 172.21.15.3:0/2401878414 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd7d4004d50 0x7fd7d40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:01.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.575+0000 7fd7eb7fe700 1 -- 172.21.15.3:0/2401878414 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ec14c340 con 0x7fd7d4004d50 2023-10-08T15:40:01.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.575+0000 7fd7eb7fe700 1 -- 172.21.15.3:0/2401878414 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d400bb10 con 0x7fd7d4003c20 2023-10-08T15:40:01.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.575+0000 7fd7eb7fe700 1 -- 172.21.15.3:0/2401878414 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d400bcd0 con 0x7fd7ec14ac50 2023-10-08T15:40:01.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.575+0000 7fd7f1690700 1 --2- 172.21.15.3:0/2401878414 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd7d4004d50 0x7fd7d40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:01.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.575+0000 7fd7f0e8f700 1 --2- 172.21.15.3:0/2401878414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7d4003c20 0x7fd7d4003ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:01.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.575+0000 7fd7ebfff700 1 --2- 172.21.15.3:0/2401878414 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd7ec14ac50 0x7fd7d4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:01.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.575+0000 7fd7f1690700 1 -- 172.21.15.3:0/2401878414 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd7ec14ac50 msgr2=0x7fd7d4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:01.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.575+0000 7fd7f1690700 1 --2- 172.21.15.3:0/2401878414 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd7ec14ac50 0x7fd7d4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:01.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.575+0000 7fd7f1690700 1 -- 172.21.15.3:0/2401878414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7d4003c20 msgr2=0x7fd7d4003ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:01.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.575+0000 7fd7f1690700 1 --2- 172.21.15.3:0/2401878414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7d4003c20 0x7fd7d4003ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:01.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.575+0000 7fd7f1690700 1 -- 172.21.15.3:0/2401878414 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e0009420 con 0x7fd7d4004d50 2023-10-08T15:40:01.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.575+0000 7fd7f1690700 1 --2- 172.21.15.3:0/2401878414 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd7d4004d50 0x7fd7d40051c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4002120 tx=0x7fd7e40017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1508a66b81a974cd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:01.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.575+0000 7fd7eb7fe700 1 -- 172.21.15.3:0/2401878414 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e4001ab0 con 0x7fd7d4004d50 2023-10-08T15:40:01.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.575+0000 7fd7eb7fe700 1 -- 172.21.15.3:0/2401878414 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e400c980 con 0x7fd7d4004d50 2023-10-08T15:40:01.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.575+0000 7fd7eb7fe700 1 -- 172.21.15.3:0/2401878414 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e400cd20 con 0x7fd7d4004d50 2023-10-08T15:40:01.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.579+0000 7fd7f1e91700 1 -- 172.21.15.3:0/2401878414 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd7d4004d50 msgr2=0x7fd7d40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:01.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.579+0000 7fd7f1e91700 1 --2- 172.21.15.3:0/2401878414 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd7d4004d50 0x7fd7d40051c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4002120 tx=0x7fd7e40017a0 comp rx=0 tx=0).stop 2023-10-08T15:40:01.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.579+0000 7fd7f1690700 1 -- 172.21.15.3:0/2401878414 reap_dead start 2023-10-08T15:40:01.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.579+0000 7fd7f1e91700 1 -- 172.21.15.3:0/2401878414 shutdown_connections 2023-10-08T15:40:01.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.579+0000 7fd7f1e91700 1 -- 172.21.15.3:0/2401878414 >> 172.21.15.3:0/2401878414 conn(0x7fd7ec0c1df0 msgr2=0x7fd7ec0c21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:01.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.579+0000 7fd7f1e91700 1 -- 172.21.15.3:0/2401878414 shutdown_connections 2023-10-08T15:40:01.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.579+0000 7fd7f1e91700 1 -- 172.21.15.3:0/2401878414 wait complete. 2023-10-08T15:40:01.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.579+0000 7fd7f1e91700 1 Processor -- start 2023-10-08T15:40:01.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.579+0000 7fd7f1e91700 1 -- start start 2023-10-08T15:40:01.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.579+0000 7fd7f1e91700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd7ec0befc0 0x7fd7ec1467d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:01.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.579+0000 7fd7f1e91700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7ec0bf390 0x7fd7ec147600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:01.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.579+0000 7fd7f1e91700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd7ec147b40 0x7fd7ec152500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:01.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.579+0000 7fd7f1e91700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ec147170 con 0x7fd7ec147b40 2023-10-08T15:40:01.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.579+0000 7fd7f1e91700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ec09eb40 con 0x7fd7ec0bf390 2023-10-08T15:40:01.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.579+0000 7fd7f1e91700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ec09e580 con 0x7fd7ec0befc0 2023-10-08T15:40:01.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.583+0000 7fd7f1690700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd7ec147b40 0x7fd7ec152500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:01.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.583+0000 7fd7ebfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7ec0bf390 0x7fd7ec147600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:01.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.583+0000 7fd7f0e8f700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd7ec0befc0 0x7fd7ec1467d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:01.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.583+0000 7fd7f1690700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd7ec147b40 0x7fd7ec152500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52506/0 (socket says 172.21.15.3:52506) 2023-10-08T15:40:01.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.583+0000 7fd7f1690700 1 -- 172.21.15.3:0/4078136083 learned_addr learned my addr 172.21.15.3:0/4078136083 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:01.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.583+0000 7fd7f1690700 1 -- 172.21.15.3:0/4078136083 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd7ec0befc0 msgr2=0x7fd7ec1467d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:01.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.583+0000 7fd7f1690700 1 --2- 172.21.15.3:0/4078136083 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd7ec0befc0 0x7fd7ec1467d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:01.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.583+0000 7fd7f1690700 1 -- 172.21.15.3:0/4078136083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7ec0bf390 msgr2=0x7fd7ec147600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:01.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.583+0000 7fd7f1690700 1 --2- 172.21.15.3:0/4078136083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7ec0bf390 0x7fd7ec147600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:01.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.583+0000 7fd7f1690700 1 -- 172.21.15.3:0/4078136083 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7ec09e860 con 0x7fd7ec147b40 2023-10-08T15:40:01.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.583+0000 7fd7f1690700 1 --2- 172.21.15.3:0/4078136083 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd7ec147b40 0x7fd7ec152500 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4003000 tx=0x7fd7e4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:01.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.583+0000 7fd7e8ff9700 1 -- 172.21.15.3:0/4078136083 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e400c6d0 con 0x7fd7ec147b40 2023-10-08T15:40:01.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.583+0000 7fd7e8ff9700 1 -- 172.21.15.3:0/4078136083 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e4001400 con 0x7fd7ec147b40 2023-10-08T15:40:01.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.583+0000 7fd7f1e91700 1 -- 172.21.15.3:0/4078136083 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7ec152a40 con 0x7fd7ec147b40 2023-10-08T15:40:01.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.583+0000 7fd7e8ff9700 1 -- 172.21.15.3:0/4078136083 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e4006ba0 con 0x7fd7ec147b40 2023-10-08T15:40:01.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.583+0000 7fd7f1e91700 1 -- 172.21.15.3:0/4078136083 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7ec1464b0 con 0x7fd7ec147b40 2023-10-08T15:40:01.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.583+0000 7fd7f1e91700 1 -- 172.21.15.3:0/4078136083 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7ec146f40 con 0x7fd7ec147b40 2023-10-08T15:40:01.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.587+0000 7fd7e8ff9700 1 -- 172.21.15.3:0/4078136083 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fd7e4024070 con 0x7fd7ec147b40 2023-10-08T15:40:01.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.587+0000 7fd7e8ff9700 1 --2- 172.21.15.3:0/4078136083 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd7d8060550 0x7fd7d8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:01.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.587+0000 7fd7e8ff9700 1 -- 172.21.15.3:0/4078136083 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd7e407e400 con 0x7fd7ec147b40 2023-10-08T15:40:01.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.587+0000 7fd7f0e8f700 1 --2- 172.21.15.3:0/4078136083 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd7d8060550 0x7fd7d8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:01.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.587+0000 7fd7f0e8f700 1 --2- 172.21.15.3:0/4078136083 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd7d8060550 0x7fd7d8062a00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd7e0006f00 tx=0x7fd7e00091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:01.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.595+0000 7fd7e8ff9700 1 -- 172.21.15.3:0/4078136083 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd7e404e9f0 con 0x7fd7ec147b40 2023-10-08T15:40:01.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.759+0000 7fd7f1e91700 1 -- 172.21.15.3:0/4078136083 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd7ec05ecf0 con 0x7fd7ec147b40 2023-10-08T15:40:01.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.759+0000 7fd7e8ff9700 1 -- 172.21.15.3:0/4078136083 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+15254 (secure 0 0 0) 0x7fd7e401c3b0 con 0x7fd7ec147b40 2023-10-08T15:40:01.764 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:40:01.764 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":29,"fsid":"7635972e-cd66-4a8f-a231-378db8b3847a","created":"2023-10-08T15:37:08.234594+0000","modified":"2023-10-08T15:38:12.526270+0000","last_up_change":"2023-10-08T15:37:17.537726+0000","last_in_change":"2023-10-08T15:37:10.269178+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:37:16.581590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:38:09.361822+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-08T15:38:09.863387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"64fb1864-bfdd-4d75-9b41-03fb60085dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33363},{"type":"v1","addr":"172.21.15.3:6801","nonce":33363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33363},{"type":"v1","addr":"172.21.15.3:6803","nonce":33363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":33363},{"type":"v1","addr":"172.21.15.3:6807","nonce":33363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33363},{"type":"v1","addr":"172.21.15.3:6805","nonce":33363}]},"public_addr":"172.21.15.3:6801/33363","cluster_addr":"172.21.15.3:6803/33363","heartbeat_back_addr":"172.21.15.3:6807/33363","heartbeat_front_addr":"172.21.15.3:6805/33363","state":["exists","up"]},{"osd":1,"uuid":"3ca6bd3a-3e8a-4c65-af9c-46148b0c2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33364},{"type":"v1","addr":"172.21.15.3:6820","nonce":33364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33364},{"type":"v1","addr":"172.21.15.3:6824","nonce":33364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33364},{"type":"v1","addr":"172.21.15.3:6831","nonce":33364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33364},{"type":"v1","addr":"172.21.15.3:6828","nonce":33364}]},"public_addr":"172.21.15.3:6820/33364","cluster_addr":"172.21.15.3:6824/33364","heartbeat_back_addr":"172.21.15.3:6831/33364","heartbeat_front_addr":"172.21.15.3:6828/33364","state":["exists","up"]},{"osd":2,"uuid":"6eb9f757-58dd-442f-910d-32401454bce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33366},{"type":"v1","addr":"172.21.15.3:6817","nonce":33366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":33366},{"type":"v1","addr":"172.21.15.3:6821","nonce":33366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6827","nonce":33366},{"type":"v1","addr":"172.21.15.3:6829","nonce":33366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":33366},{"type":"v1","addr":"172.21.15.3:6825","nonce":33366}]},"public_addr":"172.21.15.3:6817/33366","cluster_addr":"172.21.15.3:6821/33366","heartbeat_back_addr":"172.21.15.3:6829/33366","heartbeat_front_addr":"172.21.15.3:6825/33366","state":["exists","up"]},{"osd":3,"uuid":"1c39866b-ac2e-4ea9-a69c-02b01ee4191d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33365},{"type":"v1","addr":"172.21.15.3:6809","nonce":33365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":33365},{"type":"v1","addr":"172.21.15.3:6811","nonce":33365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33365},{"type":"v1","addr":"172.21.15.3:6815","nonce":33365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":33365},{"type":"v1","addr":"172.21.15.3:6813","nonce":33365}]},"public_addr":"172.21.15.3:6809/33365","cluster_addr":"172.21.15.3:6811/33365","heartbeat_back_addr":"172.21.15.3:6815/33365","heartbeat_front_addr":"172.21.15.3:6813/33365","state":["exists","up"]},{"osd":4,"uuid":"15f86b61-b7f1-4780-ae00-9d80a68cb830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":33605},{"type":"v1","addr":"172.21.15.50:6809","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33605},{"type":"v1","addr":"172.21.15.50:6811","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33605},{"type":"v1","addr":"172.21.15.50:6815","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":33605},{"type":"v1","addr":"172.21.15.50:6813","nonce":33605}]},"public_addr":"172.21.15.50:6809/33605","cluster_addr":"172.21.15.50:6811/33605","heartbeat_back_addr":"172.21.15.50:6815/33605","heartbeat_front_addr":"172.21.15.50:6813/33605","state":["exists","up"]},{"osd":5,"uuid":"726c3003-34e6-4d5a-b6e2-f911e13c2118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33606},{"type":"v1","addr":"172.21.15.50:6801","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33606},{"type":"v1","addr":"172.21.15.50:6803","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33606},{"type":"v1","addr":"172.21.15.50:6807","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":33606},{"type":"v1","addr":"172.21.15.50:6805","nonce":33606}]},"public_addr":"172.21.15.50:6801/33606","cluster_addr":"172.21.15.50:6803/33606","heartbeat_back_addr":"172.21.15.50:6807/33606","heartbeat_front_addr":"172.21.15.50:6805/33606","state":["exists","up"]},{"osd":6,"uuid":"401122a4-9988-441f-a5a7-39164434ebcd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":33607},{"type":"v1","addr":"172.21.15.50:6819","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":33607},{"type":"v1","addr":"172.21.15.50:6823","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":33607},{"type":"v1","addr":"172.21.15.50:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":33607},{"type":"v1","addr":"172.21.15.50:6827","nonce":33607}]},"public_addr":"172.21.15.50:6819/33607","cluster_addr":"172.21.15.50:6823/33607","heartbeat_back_addr":"172.21.15.50:6831/33607","heartbeat_front_addr":"172.21.15.50:6827/33607","state":["exists","up"]},{"osd":7,"uuid":"6b3fa236-c9d0-4c4d-82ae-9af4daf6d699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33604},{"type":"v1","addr":"172.21.15.50:6818","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":33604},{"type":"v1","addr":"172.21.15.50:6822","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":33604},{"type":"v1","addr":"172.21.15.50:6830","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":33604},{"type":"v1","addr":"172.21.15.50:6826","nonce":33604}]},"public_addr":"172.21.15.50:6818/33604","cluster_addr":"172.21.15.50:6822/33604","heartbeat_back_addr":"172.21.15.50:6830/33604","heartbeat_front_addr":"172.21.15.50:6826/33604","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.497794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.529417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.873426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.325972+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.443971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.240795+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.739632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.643026+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:40:01.767 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.763+0000 7fd7f1e91700 1 -- 172.21.15.3:0/4078136083 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd7d8060550 msgr2=0x7fd7d8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:01.767 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.763+0000 7fd7f1e91700 1 --2- 172.21.15.3:0/4078136083 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd7d8060550 0x7fd7d8062a00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd7e0006f00 tx=0x7fd7e00091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:01.767 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.763+0000 7fd7f1e91700 1 -- 172.21.15.3:0/4078136083 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd7ec147b40 msgr2=0x7fd7ec152500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:01.767 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.763+0000 7fd7f1e91700 1 --2- 172.21.15.3:0/4078136083 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd7ec147b40 0x7fd7ec152500 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4003000 tx=0x7fd7e4016000 comp rx=0 tx=0).stop 2023-10-08T15:40:01.767 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.763+0000 7fd7f1e91700 1 -- 172.21.15.3:0/4078136083 shutdown_connections 2023-10-08T15:40:01.767 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.763+0000 7fd7f1e91700 1 --2- 172.21.15.3:0/4078136083 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd7d8060550 0x7fd7d8062a00 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:01.767 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.763+0000 7fd7f1e91700 1 --2- 172.21.15.3:0/4078136083 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd7ec147b40 0x7fd7ec152500 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:01.767 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.763+0000 7fd7f1e91700 1 --2- 172.21.15.3:0/4078136083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7ec0bf390 0x7fd7ec147600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:01.767 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.763+0000 7fd7f1e91700 1 --2- 172.21.15.3:0/4078136083 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd7ec0befc0 0x7fd7ec1467d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:01.767 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.763+0000 7fd7f1e91700 1 -- 172.21.15.3:0/4078136083 >> 172.21.15.3:0/4078136083 conn(0x7fd7ec0c1df0 msgr2=0x7fd7ec14d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:01.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.763+0000 7fd7f1e91700 1 -- 172.21.15.3:0/4078136083 shutdown_connections 2023-10-08T15:40:01.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.763+0000 7fd7f1e91700 1 -- 172.21.15.3:0/4078136083 wait complete. 2023-10-08T15:40:01.779 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T15:40:01.780 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:40:01.887 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.883+0000 7f42cd121700 1 Processor -- start 2023-10-08T15:40:01.887 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.883+0000 7f42cd121700 1 -- start start 2023-10-08T15:40:01.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.883+0000 7f42cd121700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f42c80bcdd0 0x7f42c814f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:01.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.883+0000 7f42cd121700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f42c80be600 0x7f42c814abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:01.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.883+0000 7f42cd121700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42c814fbd0 con 0x7f42c80bbf00 2023-10-08T15:40:01.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.883+0000 7f42cd121700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42c80b29d0 con 0x7f42c80be600 2023-10-08T15:40:01.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.883+0000 7f42cd121700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42c80b1ee0 con 0x7f42c80bcdd0 2023-10-08T15:40:01.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.883+0000 7f42c7fff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f42c80bbf00 0x7f42c814ef80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:37442/0 (socket says 172.21.15.3:37442) 2023-10-08T15:40:01.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.883+0000 7f42c7fff700 1 -- 172.21.15.3:0/1190316811 learned_addr learned my addr 172.21.15.3:0/1190316811 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:40:01.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.883+0000 7f42c77fe700 1 --2- 172.21.15.3:0/1190316811 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f42c80bcdd0 0x7f42c814f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:01.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.883+0000 7f42cc920700 1 --2- 172.21.15.3:0/1190316811 >> v2:172.21.15.50:3300/0 conn(0x7f42c80be600 0x7f42c814abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:01.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.883+0000 7f42c6ffd700 1 -- 172.21.15.3:0/1190316811 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2795962724 0 0) 0x7f42c814fbd0 con 0x7f42c80bbf00 2023-10-08T15:40:01.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.887+0000 7f42c6ffd700 1 -- 172.21.15.3:0/1190316811 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42b0003570 con 0x7f42c80bbf00 2023-10-08T15:40:01.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.887+0000 7f42c77fe700 1 -- 172.21.15.3:0/1190316811 >> v2:172.21.15.50:3300/0 conn(0x7f42c80be600 msgr2=0x7f42c814abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:01.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.887+0000 7f42c77fe700 1 --2- 172.21.15.3:0/1190316811 >> v2:172.21.15.50:3300/0 conn(0x7f42c80be600 0x7f42c814abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:01.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.887+0000 7f42c77fe700 1 -- 172.21.15.3:0/1190316811 >> v1:172.21.15.3:6789/0 conn(0x7f42c80bbf00 legacy=0x7f42c814ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:01.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.887+0000 7f42c77fe700 1 -- 172.21.15.3:0/1190316811 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c80b21c0 con 0x7f42c80bcdd0 2023-10-08T15:40:01.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.887+0000 7f42c77fe700 1 --2- 172.21.15.3:0/1190316811 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f42c80bcdd0 0x7f42c814f690 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f42b80098e0 tx=0x7f42b80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7d7e4c7fe7d332b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:01.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.887+0000 7f42c6ffd700 1 -- 172.21.15.3:0/1190316811 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b8011630 con 0x7f42c80bcdd0 2023-10-08T15:40:01.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.887+0000 7f42c6ffd700 1 -- 172.21.15.3:0/1190316811 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42b8011790 con 0x7f42c80bcdd0 2023-10-08T15:40:01.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.887+0000 7f42c6ffd700 1 -- 172.21.15.3:0/1190316811 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b8011b30 con 0x7f42c80bcdd0 2023-10-08T15:40:01.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.887+0000 7f42cd121700 1 -- 172.21.15.3:0/1190316811 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f42c80bcdd0 msgr2=0x7f42c814f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:01.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.887+0000 7f42cd121700 1 --2- 172.21.15.3:0/1190316811 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f42c80bcdd0 0x7f42c814f690 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f42b80098e0 tx=0x7f42b80091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:01.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.887+0000 7f42cd121700 1 -- 172.21.15.3:0/1190316811 shutdown_connections 2023-10-08T15:40:01.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.887+0000 7f42cd121700 1 --2- 172.21.15.3:0/1190316811 >> v2:172.21.15.50:3300/0 conn(0x7f42c80be600 0x7f42c814abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:01.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.887+0000 7f42cd121700 1 --2- 172.21.15.3:0/1190316811 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f42c80bcdd0 0x7f42c814f690 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:01.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.887+0000 7f42cd121700 1 -- 172.21.15.3:0/1190316811 >> 172.21.15.3:0/1190316811 conn(0x7f42c80bf5e0 msgr2=0x7f42c80bb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:01.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.887+0000 7f42cd121700 1 -- 172.21.15.3:0/1190316811 shutdown_connections 2023-10-08T15:40:01.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.887+0000 7f42cd121700 1 -- 172.21.15.3:0/1190316811 wait complete. 2023-10-08T15:40:01.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.887+0000 7f42cd121700 1 Processor -- start 2023-10-08T15:40:01.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.887+0000 7f42cd121700 1 -- start start 2023-10-08T15:40:01.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.891+0000 7f42cd121700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f42c80bbf00 0x7f42c815e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:01.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.891+0000 7f42cd121700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f42c80bcdd0 0x7f42c80b8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:01.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.891+0000 7f42cd121700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42c80be600 0x7f42c8097b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:01.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.891+0000 7f42cd121700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c8097680 con 0x7f42c80bbf00 2023-10-08T15:40:01.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.891+0000 7f42cd121700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c815ec20 con 0x7f42c80be600 2023-10-08T15:40:01.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.891+0000 7f42cd121700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42c815e960 con 0x7f42c80bcdd0 2023-10-08T15:40:01.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.891+0000 7f42c7fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f42c80bbf00 0x7f42c815e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:01.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.891+0000 7f42c7fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f42c80bbf00 0x7f42c815e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52518/0 (socket says 172.21.15.3:52518) 2023-10-08T15:40:01.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.891+0000 7f42c7fff700 1 -- 172.21.15.3:0/2005247752 learned_addr learned my addr 172.21.15.3:0/2005247752 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:01.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.891+0000 7f42cc920700 1 --2- 172.21.15.3:0/2005247752 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42c80be600 0x7f42c8097b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:01.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.891+0000 7f42c77fe700 1 --2- 172.21.15.3:0/2005247752 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f42c80bcdd0 0x7f42c80b8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:01.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.891+0000 7f42c7fff700 1 -- 172.21.15.3:0/2005247752 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f42c80bcdd0 msgr2=0x7f42c80b8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:01.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.891+0000 7f42c7fff700 1 --2- 172.21.15.3:0/2005247752 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f42c80bcdd0 0x7f42c80b8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:01.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.891+0000 7f42c7fff700 1 -- 172.21.15.3:0/2005247752 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42c80be600 msgr2=0x7f42c8097b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:01.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.891+0000 7f42c7fff700 1 --2- 172.21.15.3:0/2005247752 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42c80be600 0x7f42c8097b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:01.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.891+0000 7f42c7fff700 1 -- 172.21.15.3:0/2005247752 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b8009420 con 0x7f42c80bbf00 2023-10-08T15:40:01.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.891+0000 7f42c7fff700 1 --2- 172.21.15.3:0/2005247752 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f42c80bbf00 0x7f42c815e420 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f42bc00c790 tx=0x7f42bc007c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:01.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.891+0000 7f42affff700 1 -- 172.21.15.3:0/2005247752 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42bc0072e0 con 0x7f42c80bbf00 2023-10-08T15:40:01.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.891+0000 7f42affff700 1 -- 172.21.15.3:0/2005247752 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42bc007440 con 0x7f42c80bbf00 2023-10-08T15:40:01.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.891+0000 7f42cd121700 1 -- 172.21.15.3:0/2005247752 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42c815eec0 con 0x7f42c80bbf00 2023-10-08T15:40:01.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.891+0000 7f42affff700 1 -- 172.21.15.3:0/2005247752 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42bc0057f0 con 0x7f42c80bbf00 2023-10-08T15:40:01.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.891+0000 7f42cd121700 1 -- 172.21.15.3:0/2005247752 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42c80b8790 con 0x7f42c80bbf00 2023-10-08T15:40:01.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.895+0000 7f42cd121700 1 -- 172.21.15.3:0/2005247752 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42c805ecf0 con 0x7f42c80bbf00 2023-10-08T15:40:01.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.895+0000 7f42affff700 1 -- 172.21.15.3:0/2005247752 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f42bc005ba0 con 0x7f42c80bbf00 2023-10-08T15:40:01.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.895+0000 7f42affff700 1 --2- 172.21.15.3:0/2005247752 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f42b4060550 0x7f42b4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:01.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.895+0000 7f42affff700 1 -- 172.21.15.3:0/2005247752 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f42bc07bb50 con 0x7f42c80bbf00 2023-10-08T15:40:01.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.895+0000 7f42c77fe700 1 --2- 172.21.15.3:0/2005247752 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f42b4060550 0x7f42b4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:01.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.895+0000 7f42c77fe700 1 --2- 172.21.15.3:0/2005247752 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f42b4060550 0x7f42b4062a00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f42b80091e0 tx=0x7f42b8017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:01.905 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:01.899+0000 7f42affff700 1 -- 172.21.15.3:0/2005247752 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f42bc049be0 con 0x7f42c80bbf00 2023-10-08T15:40:02.100 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.095+0000 7f42cd121700 1 -- 172.21.15.3:0/2005247752 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f42c80639f0 con 0x7f42c80bbf00 2023-10-08T15:40:02.101 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.095+0000 7f42affff700 1 -- 172.21.15.3:0/2005247752 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+3079 (secure 0 0 0) 0x7f42bc017090 con 0x7f42c80bbf00 2023-10-08T15:40:02.101 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:40:02.101 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4736,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3640212670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3640212670},{"type":"v1","addr":"172.21.15.50:6835","nonce":3640212670}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:38:10.891768+0000","modified":"2023-10-08T15:38:13.541239+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4989},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4989":{"gid":4989,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.3:6833/3457348695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":3457348695},{"type":"v1","addr":"172.21.15.3:6833","nonce":3457348695}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-08T15:40:02.103 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.099+0000 7f42cd121700 1 -- 172.21.15.3:0/2005247752 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f42b4060550 msgr2=0x7f42b4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:02.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.099+0000 7f42cd121700 1 --2- 172.21.15.3:0/2005247752 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f42b4060550 0x7f42b4062a00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f42b80091e0 tx=0x7f42b8017000 comp rx=0 tx=0).stop 2023-10-08T15:40:02.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.099+0000 7f42cd121700 1 -- 172.21.15.3:0/2005247752 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f42c80bbf00 msgr2=0x7f42c815e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:02.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.099+0000 7f42cd121700 1 --2- 172.21.15.3:0/2005247752 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f42c80bbf00 0x7f42c815e420 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f42bc00c790 tx=0x7f42bc007c80 comp rx=0 tx=0).stop 2023-10-08T15:40:02.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.099+0000 7f42cd121700 1 -- 172.21.15.3:0/2005247752 shutdown_connections 2023-10-08T15:40:02.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.099+0000 7f42cd121700 1 --2- 172.21.15.3:0/2005247752 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f42b4060550 0x7f42b4062a00 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:02.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.099+0000 7f42cd121700 1 --2- 172.21.15.3:0/2005247752 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42c80be600 0x7f42c8097b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:02.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.099+0000 7f42cd121700 1 --2- 172.21.15.3:0/2005247752 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f42c80bcdd0 0x7f42c80b8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:02.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.099+0000 7f42cd121700 1 --2- 172.21.15.3:0/2005247752 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f42c80bbf00 0x7f42c815e420 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:02.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.099+0000 7f42cd121700 1 -- 172.21.15.3:0/2005247752 >> 172.21.15.3:0/2005247752 conn(0x7f42c80bf5e0 msgr2=0x7f42c806cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:02.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.099+0000 7f42cd121700 1 -- 172.21.15.3:0/2005247752 shutdown_connections 2023-10-08T15:40:02.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.099+0000 7f42cd121700 1 -- 172.21.15.3:0/2005247752 wait complete. 2023-10-08T15:40:02.106 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 13 2023-10-08T15:40:02.115 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:40:02.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.219+0000 7f8bd90a5700 1 Processor -- start 2023-10-08T15:40:02.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.219+0000 7f8bd90a5700 1 -- start start 2023-10-08T15:40:02.224 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.219+0000 7f8bd90a5700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8bd40bbf00 0x7f8bd40bd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:02.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.219+0000 7f8bd90a5700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f8bd4150b40 0x7f8bd414eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:02.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.219+0000 7f8bd90a5700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bd4153f30 con 0x7f8bd40bd000 2023-10-08T15:40:02.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.219+0000 7f8bd90a5700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bd4154210 con 0x7f8bd4150b40 2023-10-08T15:40:02.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.219+0000 7f8bd90a5700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd414ff10 con 0x7f8bd40bbf00 2023-10-08T15:40:02.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.219+0000 7f8bd88a4700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f8bd4150b40 0x7f8bd414eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:02.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.219+0000 7f8bd88a4700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f8bd4150b40 0x7f8bd414eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52528/0 (socket says 172.21.15.3:52528) 2023-10-08T15:40:02.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.219+0000 7f8bd88a4700 1 -- 172.21.15.3:0/1870564949 learned_addr learned my addr 172.21.15.3:0/1870564949 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:02.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.219+0000 7f8bd3fff700 1 --2- 172.21.15.3:0/1870564949 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8bd40bbf00 0x7f8bd40bd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:02.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.219+0000 7f8bd88a4700 1 -- 172.21.15.3:0/1870564949 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8bd40bbf00 msgr2=0x7f8bd40bd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:02.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.219+0000 7f8bd88a4700 1 --2- 172.21.15.3:0/1870564949 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8bd40bbf00 0x7f8bd40bd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:02.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.219+0000 7f8bd88a4700 1 -- 172.21.15.3:0/1870564949 >> v1:172.21.15.50:6789/0 conn(0x7f8bd40bd000 legacy=0x7f8bd4150430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:02.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.219+0000 7f8bd88a4700 1 -- 172.21.15.3:0/1870564949 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd4153c40 con 0x7f8bd4150b40 2023-10-08T15:40:02.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.219+0000 7f8bd88a4700 1 --2- 172.21.15.3:0/1870564949 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8bd4150b40 0x7f8bd414eb70 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc0099b0 tx=0x7f8bcc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6585218078a22106 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:02.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.219+0000 7f8bd2ffd700 1 -- 172.21.15.3:0/1870564949 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bcc009ea0 con 0x7f8bd4150b40 2023-10-08T15:40:02.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.223+0000 7f8bd2ffd700 1 -- 172.21.15.3:0/1870564949 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bcc00b860 con 0x7f8bd4150b40 2023-10-08T15:40:02.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.223+0000 7f8bd2ffd700 1 -- 172.21.15.3:0/1870564949 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bcc00bc00 con 0x7f8bd4150b40 2023-10-08T15:40:02.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.223+0000 7f8bd90a5700 1 -- 172.21.15.3:0/1870564949 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8bd4150b40 msgr2=0x7f8bd414eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:02.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.223+0000 7f8bd90a5700 1 --2- 172.21.15.3:0/1870564949 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8bd4150b40 0x7f8bd414eb70 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc0099b0 tx=0x7f8bcc009250 comp rx=0 tx=0).stop 2023-10-08T15:40:02.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.223+0000 7f8bd90a5700 1 -- 172.21.15.3:0/1870564949 shutdown_connections 2023-10-08T15:40:02.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.223+0000 7f8bd90a5700 1 --2- 172.21.15.3:0/1870564949 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8bd4150b40 0x7f8bd414eb70 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:02.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.223+0000 7f8bd90a5700 1 --2- 172.21.15.3:0/1870564949 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8bd40bbf00 0x7f8bd40bd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:02.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.223+0000 7f8bd90a5700 1 -- 172.21.15.3:0/1870564949 >> 172.21.15.3:0/1870564949 conn(0x7f8bd40bf5e0 msgr2=0x7f8bd40bb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:02.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.223+0000 7f8bd90a5700 1 -- 172.21.15.3:0/1870564949 shutdown_connections 2023-10-08T15:40:02.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.223+0000 7f8bd90a5700 1 -- 172.21.15.3:0/1870564949 wait complete. 2023-10-08T15:40:02.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.223+0000 7f8bd90a5700 1 Processor -- start 2023-10-08T15:40:02.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.223+0000 7f8bd90a5700 1 -- start start 2023-10-08T15:40:02.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.227+0000 7f8bd90a5700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8bd40bbf00 0x7f8bd40b3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:02.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.227+0000 7f8bd90a5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bd40bd000 0x7f8bd4162500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:02.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.227+0000 7f8bd90a5700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8bd4150b40 0x7f8bd4152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:02.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.227+0000 7f8bd90a5700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd40b3be0 con 0x7f8bd4150b40 2023-10-08T15:40:02.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.227+0000 7f8bd90a5700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd4162a40 con 0x7f8bd40bd000 2023-10-08T15:40:02.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.227+0000 7f8bd90a5700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd4162ce0 con 0x7f8bd40bbf00 2023-10-08T15:40:02.232 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.227+0000 7f8bd3fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8bd40bbf00 0x7f8bd40b3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:02.232 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.227+0000 7f8bd88a4700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8bd4150b40 0x7f8bd4152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:02.232 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.227+0000 7f8bd3fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8bd40bbf00 0x7f8bd40b3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.3:55480/0 (socket says 172.21.15.3:55480) 2023-10-08T15:40:02.232 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.227+0000 7f8bd3fff700 1 -- 172.21.15.3:0/3573890291 learned_addr learned my addr 172.21.15.3:0/3573890291 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:02.232 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.227+0000 7f8bd37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bd40bd000 0x7f8bd4162500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:02.232 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.227+0000 7f8bd3fff700 1 -- 172.21.15.3:0/3573890291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bd40bd000 msgr2=0x7f8bd4162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:02.232 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.227+0000 7f8bd3fff700 1 --2- 172.21.15.3:0/3573890291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bd40bd000 0x7f8bd4162500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:02.232 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.227+0000 7f8bd3fff700 1 -- 172.21.15.3:0/3573890291 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8bd4150b40 msgr2=0x7f8bd4152cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:02.232 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.227+0000 7f8bd3fff700 1 --2- 172.21.15.3:0/3573890291 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8bd4150b40 0x7f8bd4152cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:02.232 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.227+0000 7f8bd3fff700 1 -- 172.21.15.3:0/3573890291 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bcc0094f0 con 0x7f8bd40bbf00 2023-10-08T15:40:02.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.227+0000 7f8bd3fff700 1 --2- 172.21.15.3:0/3573890291 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8bd40bbf00 0x7f8bd40b3130 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8bc400ec80 tx=0x7f8bc4009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:02.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.227+0000 7f8bcbfff700 1 -- 172.21.15.3:0/3573890291 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc400c850 con 0x7f8bd40bbf00 2023-10-08T15:40:02.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.227+0000 7f8bcbfff700 1 -- 172.21.15.3:0/3573890291 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc400c9b0 con 0x7f8bd40bbf00 2023-10-08T15:40:02.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.227+0000 7f8bd90a5700 1 -- 172.21.15.3:0/3573890291 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bd4162fc0 con 0x7f8bd40bbf00 2023-10-08T15:40:02.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.227+0000 7f8bcbfff700 1 -- 172.21.15.3:0/3573890291 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc400cd50 con 0x7f8bd40bbf00 2023-10-08T15:40:02.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.227+0000 7f8bd90a5700 1 -- 172.21.15.3:0/3573890291 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bd415efe0 con 0x7f8bd40bbf00 2023-10-08T15:40:02.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.227+0000 7f8bd90a5700 1 -- 172.21.15.3:0/3573890291 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bd405ecf0 con 0x7f8bd40bbf00 2023-10-08T15:40:02.234 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.231+0000 7f8bcbfff700 1 -- 172.21.15.3:0/3573890291 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f8bc4013680 con 0x7f8bd40bbf00 2023-10-08T15:40:02.234 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.231+0000 7f8bcbfff700 1 --2- 172.21.15.3:0/3573890291 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8bb4060550 0x7f8bb4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:02.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.231+0000 7f8bcbfff700 1 -- 172.21.15.3:0/3573890291 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8bc407d0b0 con 0x7f8bd40bbf00 2023-10-08T15:40:02.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.231+0000 7f8bd37fe700 1 --2- 172.21.15.3:0/3573890291 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8bb4060550 0x7f8bb4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:02.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.231+0000 7f8bd37fe700 1 --2- 172.21.15.3:0/3573890291 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8bb4060550 0x7f8bb4062a00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8bd40bacf0 tx=0x7f8bbc0016f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:02.245 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.239+0000 7f8bcbfff700 1 -- 172.21.15.3:0/3573890291 <== mon.2 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8bc404d680 con 0x7f8bd40bbf00 2023-10-08T15:40:02.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.443+0000 7f8bd90a5700 1 -- 172.21.15.3:0/3573890291 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8bd415efe0 con 0x7f8bd40bbf00 2023-10-08T15:40:02.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.443+0000 7f8bcbfff700 1 -- 172.21.15.3:0/3573890291 <== mon.2 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+3079 (secure 0 0 0) 0x7f8bd415efe0 con 0x7f8bd40bbf00 2023-10-08T15:40:02.447 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:40:02.447 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4736,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3640212670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3640212670},{"type":"v1","addr":"172.21.15.50:6835","nonce":3640212670}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:38:10.891768+0000","modified":"2023-10-08T15:38:13.541239+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4989},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4989":{"gid":4989,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.3:6833/3457348695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":3457348695},{"type":"v1","addr":"172.21.15.3:6833","nonce":3457348695}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-08T15:40:02.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.447+0000 7f8bd90a5700 1 -- 172.21.15.3:0/3573890291 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8bb4060550 msgr2=0x7f8bb4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:02.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.447+0000 7f8bd90a5700 1 --2- 172.21.15.3:0/3573890291 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8bb4060550 0x7f8bb4062a00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8bd40bacf0 tx=0x7f8bbc0016f0 comp rx=0 tx=0).stop 2023-10-08T15:40:02.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.447+0000 7f8bd90a5700 1 -- 172.21.15.3:0/3573890291 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8bd40bbf00 msgr2=0x7f8bd40b3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:02.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.447+0000 7f8bd90a5700 1 --2- 172.21.15.3:0/3573890291 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8bd40bbf00 0x7f8bd40b3130 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8bc400ec80 tx=0x7f8bc4009120 comp rx=0 tx=0).stop 2023-10-08T15:40:02.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.447+0000 7f8bd90a5700 1 -- 172.21.15.3:0/3573890291 shutdown_connections 2023-10-08T15:40:02.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.447+0000 7f8bd90a5700 1 --2- 172.21.15.3:0/3573890291 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8bb4060550 0x7f8bb4062a00 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:02.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.447+0000 7f8bd90a5700 1 --2- 172.21.15.3:0/3573890291 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8bd4150b40 0x7f8bd4152cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:02.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.447+0000 7f8bd90a5700 1 --2- 172.21.15.3:0/3573890291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bd40bd000 0x7f8bd4162500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:02.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.447+0000 7f8bd90a5700 1 --2- 172.21.15.3:0/3573890291 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8bd40bbf00 0x7f8bd40b3130 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:02.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.447+0000 7f8bd90a5700 1 -- 172.21.15.3:0/3573890291 >> 172.21.15.3:0/3573890291 conn(0x7f8bd40bf5e0 msgr2=0x7f8bd40a2350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:02.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.447+0000 7f8bd90a5700 1 -- 172.21.15.3:0/3573890291 shutdown_connections 2023-10-08T15:40:02.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.447+0000 7f8bd90a5700 1 -- 172.21.15.3:0/3573890291 wait complete. 2023-10-08T15:40:02.453 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 13 2023-10-08T15:40:02.467 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:40:02.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.567+0000 7f165758d700 1 Processor -- start 2023-10-08T15:40:02.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.567+0000 7f165758d700 1 -- start start 2023-10-08T15:40:02.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.567+0000 7f165758d700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f165006be60 0x7f165014b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:02.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.567+0000 7f165758d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f165006cc40 0x7f165014cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:02.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.567+0000 7f165758d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f165014c6b0 con 0x7f165014ac50 2023-10-08T15:40:02.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.567+0000 7f165758d700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f165014c060 con 0x7f165006be60 2023-10-08T15:40:02.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.567+0000 7f165758d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f165014c340 con 0x7f165006cc40 2023-10-08T15:40:02.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.567+0000 7f1656d8c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f165006cc40 0x7f165014cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:02.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.567+0000 7f1655d8a700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f165006be60 0x7f165014b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:02.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.567+0000 7f1656d8c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f165006cc40 0x7f165014cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.3:55486/0 (socket says 172.21.15.3:55486) 2023-10-08T15:40:02.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.567+0000 7f1656d8c700 1 -- 172.21.15.3:0/2392947680 learned_addr learned my addr 172.21.15.3:0/2392947680 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:02.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.567+0000 7f1655d8a700 1 -- 172.21.15.3:0/2392947680 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f165006cc40 msgr2=0x7f165014cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:02.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.567+0000 7f1655d8a700 1 --2- 172.21.15.3:0/2392947680 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f165006cc40 0x7f165014cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:02.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.567+0000 7f1655d8a700 1 -- 172.21.15.3:0/2392947680 >> v1:172.21.15.50:6789/0 conn(0x7f165014ac50 legacy=0x7f165006c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:02.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.567+0000 7f1655d8a700 1 -- 172.21.15.3:0/2392947680 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f165014e860 con 0x7f165006be60 2023-10-08T15:40:02.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.567+0000 7f1656d8c700 1 --2- 172.21.15.3:0/2392947680 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f165006cc40 0x7f165014cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:40:02.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.571+0000 7f1655d8a700 1 --2- 172.21.15.3:0/2392947680 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f165006be60 0x7f165014b020 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f164c0098e0 tx=0x7f164c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fc58fab47a1b2e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:02.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.571+0000 7f1655589700 1 -- 172.21.15.3:0/2392947680 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164c00b640 con 0x7f165006be60 2023-10-08T15:40:02.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.571+0000 7f1655589700 1 -- 172.21.15.3:0/2392947680 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f164c00b7a0 con 0x7f165006be60 2023-10-08T15:40:02.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.571+0000 7f1655589700 1 -- 172.21.15.3:0/2392947680 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164c00bb40 con 0x7f165006be60 2023-10-08T15:40:02.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.571+0000 7f165758d700 1 -- 172.21.15.3:0/2392947680 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f165006be60 msgr2=0x7f165014b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:02.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.571+0000 7f165758d700 1 --2- 172.21.15.3:0/2392947680 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f165006be60 0x7f165014b020 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f164c0098e0 tx=0x7f164c0091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:02.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.571+0000 7f165758d700 1 -- 172.21.15.3:0/2392947680 shutdown_connections 2023-10-08T15:40:02.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.571+0000 7f165758d700 1 --2- 172.21.15.3:0/2392947680 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f165006cc40 0x7f165014cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:02.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.571+0000 7f165758d700 1 --2- 172.21.15.3:0/2392947680 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f165006be60 0x7f165014b020 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:02.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.571+0000 7f165758d700 1 -- 172.21.15.3:0/2392947680 >> 172.21.15.3:0/2392947680 conn(0x7f16500c1df0 msgr2=0x7f16500c21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:02.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.571+0000 7f165758d700 1 -- 172.21.15.3:0/2392947680 shutdown_connections 2023-10-08T15:40:02.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.571+0000 7f165758d700 1 -- 172.21.15.3:0/2392947680 wait complete. 2023-10-08T15:40:02.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.571+0000 7f165758d700 1 Processor -- start 2023-10-08T15:40:02.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.571+0000 7f165758d700 1 -- start start 2023-10-08T15:40:02.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.571+0000 7f165758d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f165006be60 0x7f16500c1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:02.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.571+0000 7f165758d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f165006cc40 0x7f1650146190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:02.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.571+0000 7f165758d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f165014ac50 0x7f16501466d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:02.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.571+0000 7f165758d700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1650143550 con 0x7f165006be60 2023-10-08T15:40:02.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.571+0000 7f165758d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1650142e30 con 0x7f165014ac50 2023-10-08T15:40:02.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.571+0000 7f165758d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1650146c10 con 0x7f165006cc40 2023-10-08T15:40:02.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.571+0000 7f165658b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f165006be60 0x7f16500c1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:02.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.571+0000 7f165658b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f165006be60 0x7f16500c1480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52542/0 (socket says 172.21.15.3:52542) 2023-10-08T15:40:02.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.571+0000 7f165658b700 1 -- 172.21.15.3:0/972853084 learned_addr learned my addr 172.21.15.3:0/972853084 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:02.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.575+0000 7f1655d8a700 1 --2- 172.21.15.3:0/972853084 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f165006cc40 0x7f1650146190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:02.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.575+0000 7f1656d8c700 1 --2- 172.21.15.3:0/972853084 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f165014ac50 0x7f16501466d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:02.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.575+0000 7f165658b700 1 -- 172.21.15.3:0/972853084 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f165006cc40 msgr2=0x7f1650146190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:02.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.575+0000 7f165658b700 1 --2- 172.21.15.3:0/972853084 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f165006cc40 0x7f1650146190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:02.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.575+0000 7f165658b700 1 -- 172.21.15.3:0/972853084 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f165014ac50 msgr2=0x7f16501466d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:02.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.575+0000 7f165658b700 1 --2- 172.21.15.3:0/972853084 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f165014ac50 0x7f16501466d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:02.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.575+0000 7f165658b700 1 -- 172.21.15.3:0/972853084 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1648009ae0 con 0x7f165006be60 2023-10-08T15:40:02.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.575+0000 7f1655d8a700 1 --2- 172.21.15.3:0/972853084 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f165006cc40 0x7f1650146190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:40:02.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.575+0000 7f165658b700 1 --2- 172.21.15.3:0/972853084 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f165006be60 0x7f16500c1480 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f164000c4e0 tx=0x7f164000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:02.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.575+0000 7f16467fc700 1 -- 172.21.15.3:0/972853084 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1640011590 con 0x7f165006be60 2023-10-08T15:40:02.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.575+0000 7f16467fc700 1 -- 172.21.15.3:0/972853084 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1640011710 con 0x7f165006be60 2023-10-08T15:40:02.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.575+0000 7f165758d700 1 -- 172.21.15.3:0/972853084 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f164c009420 con 0x7f165006be60 2023-10-08T15:40:02.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.575+0000 7f16467fc700 1 -- 172.21.15.3:0/972853084 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1640011ad0 con 0x7f165006be60 2023-10-08T15:40:02.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.575+0000 7f165758d700 1 -- 172.21.15.3:0/972853084 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16500c0e70 con 0x7f165006be60 2023-10-08T15:40:02.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.575+0000 7f165758d700 1 -- 172.21.15.3:0/972853084 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16500c1060 con 0x7f165006be60 2023-10-08T15:40:02.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.575+0000 7f16467fc700 1 -- 172.21.15.3:0/972853084 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f164001b3b0 con 0x7f165006be60 2023-10-08T15:40:02.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.579+0000 7f16467fc700 1 --2- 172.21.15.3:0/972853084 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1634060550 0x7f1634062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:02.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.579+0000 7f16467fc700 1 -- 172.21.15.3:0/972853084 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f164007bca0 con 0x7f165006be60 2023-10-08T15:40:02.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.579+0000 7f1655d8a700 1 --2- 172.21.15.3:0/972853084 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1634060550 0x7f1634062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:02.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.579+0000 7f1655d8a700 1 --2- 172.21.15.3:0/972853084 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1634060550 0x7f1634062a00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f164c0093f0 tx=0x7f164c017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:02.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.587+0000 7f16467fc700 1 -- 172.21.15.3:0/972853084 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f164004c290 con 0x7f165006be60 2023-10-08T15:40:02.753 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.751+0000 7f165758d700 1 -- 172.21.15.3:0/972853084 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f165005ecf0 con 0x7f165006be60 2023-10-08T15:40:02.755 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.751+0000 7f16467fc700 1 -- 172.21.15.3:0/972853084 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+15254 (secure 0 0 0) 0x7f1640017020 con 0x7f165006be60 2023-10-08T15:40:02.756 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:40:02.756 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":29,"fsid":"7635972e-cd66-4a8f-a231-378db8b3847a","created":"2023-10-08T15:37:08.234594+0000","modified":"2023-10-08T15:38:12.526270+0000","last_up_change":"2023-10-08T15:37:17.537726+0000","last_in_change":"2023-10-08T15:37:10.269178+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:37:16.581590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:38:09.361822+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-08T15:38:09.863387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"64fb1864-bfdd-4d75-9b41-03fb60085dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33363},{"type":"v1","addr":"172.21.15.3:6801","nonce":33363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33363},{"type":"v1","addr":"172.21.15.3:6803","nonce":33363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":33363},{"type":"v1","addr":"172.21.15.3:6807","nonce":33363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33363},{"type":"v1","addr":"172.21.15.3:6805","nonce":33363}]},"public_addr":"172.21.15.3:6801/33363","cluster_addr":"172.21.15.3:6803/33363","heartbeat_back_addr":"172.21.15.3:6807/33363","heartbeat_front_addr":"172.21.15.3:6805/33363","state":["exists","up"]},{"osd":1,"uuid":"3ca6bd3a-3e8a-4c65-af9c-46148b0c2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33364},{"type":"v1","addr":"172.21.15.3:6820","nonce":33364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33364},{"type":"v1","addr":"172.21.15.3:6824","nonce":33364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33364},{"type":"v1","addr":"172.21.15.3:6831","nonce":33364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33364},{"type":"v1","addr":"172.21.15.3:6828","nonce":33364}]},"public_addr":"172.21.15.3:6820/33364","cluster_addr":"172.21.15.3:6824/33364","heartbeat_back_addr":"172.21.15.3:6831/33364","heartbeat_front_addr":"172.21.15.3:6828/33364","state":["exists","up"]},{"osd":2,"uuid":"6eb9f757-58dd-442f-910d-32401454bce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33366},{"type":"v1","addr":"172.21.15.3:6817","nonce":33366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":33366},{"type":"v1","addr":"172.21.15.3:6821","nonce":33366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6827","nonce":33366},{"type":"v1","addr":"172.21.15.3:6829","nonce":33366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":33366},{"type":"v1","addr":"172.21.15.3:6825","nonce":33366}]},"public_addr":"172.21.15.3:6817/33366","cluster_addr":"172.21.15.3:6821/33366","heartbeat_back_addr":"172.21.15.3:6829/33366","heartbeat_front_addr":"172.21.15.3:6825/33366","state":["exists","up"]},{"osd":3,"uuid":"1c39866b-ac2e-4ea9-a69c-02b01ee4191d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33365},{"type":"v1","addr":"172.21.15.3:6809","nonce":33365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":33365},{"type":"v1","addr":"172.21.15.3:6811","nonce":33365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33365},{"type":"v1","addr":"172.21.15.3:6815","nonce":33365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":33365},{"type":"v1","addr":"172.21.15.3:6813","nonce":33365}]},"public_addr":"172.21.15.3:6809/33365","cluster_addr":"172.21.15.3:6811/33365","heartbeat_back_addr":"172.21.15.3:6815/33365","heartbeat_front_addr":"172.21.15.3:6813/33365","state":["exists","up"]},{"osd":4,"uuid":"15f86b61-b7f1-4780-ae00-9d80a68cb830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":33605},{"type":"v1","addr":"172.21.15.50:6809","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33605},{"type":"v1","addr":"172.21.15.50:6811","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33605},{"type":"v1","addr":"172.21.15.50:6815","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":33605},{"type":"v1","addr":"172.21.15.50:6813","nonce":33605}]},"public_addr":"172.21.15.50:6809/33605","cluster_addr":"172.21.15.50:6811/33605","heartbeat_back_addr":"172.21.15.50:6815/33605","heartbeat_front_addr":"172.21.15.50:6813/33605","state":["exists","up"]},{"osd":5,"uuid":"726c3003-34e6-4d5a-b6e2-f911e13c2118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33606},{"type":"v1","addr":"172.21.15.50:6801","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33606},{"type":"v1","addr":"172.21.15.50:6803","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33606},{"type":"v1","addr":"172.21.15.50:6807","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":33606},{"type":"v1","addr":"172.21.15.50:6805","nonce":33606}]},"public_addr":"172.21.15.50:6801/33606","cluster_addr":"172.21.15.50:6803/33606","heartbeat_back_addr":"172.21.15.50:6807/33606","heartbeat_front_addr":"172.21.15.50:6805/33606","state":["exists","up"]},{"osd":6,"uuid":"401122a4-9988-441f-a5a7-39164434ebcd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":33607},{"type":"v1","addr":"172.21.15.50:6819","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":33607},{"type":"v1","addr":"172.21.15.50:6823","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":33607},{"type":"v1","addr":"172.21.15.50:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":33607},{"type":"v1","addr":"172.21.15.50:6827","nonce":33607}]},"public_addr":"172.21.15.50:6819/33607","cluster_addr":"172.21.15.50:6823/33607","heartbeat_back_addr":"172.21.15.50:6831/33607","heartbeat_front_addr":"172.21.15.50:6827/33607","state":["exists","up"]},{"osd":7,"uuid":"6b3fa236-c9d0-4c4d-82ae-9af4daf6d699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33604},{"type":"v1","addr":"172.21.15.50:6818","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":33604},{"type":"v1","addr":"172.21.15.50:6822","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":33604},{"type":"v1","addr":"172.21.15.50:6830","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":33604},{"type":"v1","addr":"172.21.15.50:6826","nonce":33604}]},"public_addr":"172.21.15.50:6818/33604","cluster_addr":"172.21.15.50:6822/33604","heartbeat_back_addr":"172.21.15.50:6830/33604","heartbeat_front_addr":"172.21.15.50:6826/33604","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.497794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.529417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.873426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.325972+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.443971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.240795+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.739632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.643026+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:40:02.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.755+0000 7f165758d700 1 -- 172.21.15.3:0/972853084 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1634060550 msgr2=0x7f1634062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:02.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.755+0000 7f165758d700 1 --2- 172.21.15.3:0/972853084 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1634060550 0x7f1634062a00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f164c0093f0 tx=0x7f164c017000 comp rx=0 tx=0).stop 2023-10-08T15:40:02.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.755+0000 7f165758d700 1 -- 172.21.15.3:0/972853084 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f165006be60 msgr2=0x7f16500c1480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:02.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.755+0000 7f165758d700 1 --2- 172.21.15.3:0/972853084 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f165006be60 0x7f16500c1480 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f164000c4e0 tx=0x7f164000c8a0 comp rx=0 tx=0).stop 2023-10-08T15:40:02.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.755+0000 7f165758d700 1 -- 172.21.15.3:0/972853084 shutdown_connections 2023-10-08T15:40:02.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.755+0000 7f165758d700 1 --2- 172.21.15.3:0/972853084 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1634060550 0x7f1634062a00 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:02.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.755+0000 7f165758d700 1 --2- 172.21.15.3:0/972853084 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f165014ac50 0x7f16501466d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:02.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.755+0000 7f165758d700 1 --2- 172.21.15.3:0/972853084 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f165006cc40 0x7f1650146190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:02.759 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.755+0000 7f165758d700 1 --2- 172.21.15.3:0/972853084 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f165006be60 0x7f16500c1480 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:02.759 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.755+0000 7f165758d700 1 -- 172.21.15.3:0/972853084 >> 172.21.15.3:0/972853084 conn(0x7f16500c1df0 msgr2=0x7f1650068620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:02.759 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.755+0000 7f165758d700 1 -- 172.21.15.3:0/972853084 shutdown_connections 2023-10-08T15:40:02.759 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.755+0000 7f165758d700 1 -- 172.21.15.3:0/972853084 wait complete. 2023-10-08T15:40:02.771 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-08T15:40:02.883 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.879+0000 7fdf170c8700 1 Processor -- start 2023-10-08T15:40:02.883 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.879+0000 7fdf170c8700 1 -- start start 2023-10-08T15:40:02.883 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.879+0000 7fdf170c8700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdf100bddf0 0x7fdf100c28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:02.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.879+0000 7fdf170c8700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf100bfcd0 con 0x7fdf100bc970 2023-10-08T15:40:02.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.879+0000 7fdf170c8700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf1014c2e0 con 0x7fdf100c24e0 2023-10-08T15:40:02.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.879+0000 7fdf170c8700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf100bff20 con 0x7fdf100bddf0 2023-10-08T15:40:02.887 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.879+0000 7fdf168c7700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fdf100bc970 0x7fdf100bcdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:37448/0 (socket says 172.21.15.3:37448) 2023-10-08T15:40:02.887 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.879+0000 7fdf168c7700 1 -- 172.21.15.3:0/2448271791 learned_addr learned my addr 172.21.15.3:0/2448271791 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:40:02.887 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.879+0000 7fdf158c5700 1 --2- 172.21.15.3:0/2448271791 >> v2:172.21.15.50:3300/0 conn(0x7fdf100bddf0 0x7fdf100c28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:02.887 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.879+0000 7fdf150c4700 1 -- 172.21.15.3:0/2448271791 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2459763780 0 0) 0x7fdf100bfcd0 con 0x7fdf100bc970 2023-10-08T15:40:02.887 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.879+0000 7fdf150c4700 1 -- 172.21.15.3:0/2448271791 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdefc003570 con 0x7fdf100bc970 2023-10-08T15:40:02.887 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.879+0000 7fdf150c4700 1 -- 172.21.15.3:0/2448271791 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1176253345 0 0) 0x7fdefc003570 con 0x7fdf100bc970 2023-10-08T15:40:02.887 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.879+0000 7fdf150c4700 1 -- 172.21.15.3:0/2448271791 >> v2:172.21.15.50:3300/0 conn(0x7fdf100bddf0 msgr2=0x7fdf100c28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:02.887 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.879+0000 7fdf150c4700 1 --2- 172.21.15.3:0/2448271791 >> v2:172.21.15.50:3300/0 conn(0x7fdf100bddf0 0x7fdf100c28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:02.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.879+0000 7fdf150c4700 1 -- 172.21.15.3:0/2448271791 >> v1:172.21.15.50:6789/0 conn(0x7fdf100c24e0 legacy=0x7fdf100c0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:02.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.879+0000 7fdf150c4700 1 -- 172.21.15.3:0/2448271791 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf10148e40 con 0x7fdf100bc970 2023-10-08T15:40:02.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.879+0000 7fdf150c4700 1 -- 172.21.15.3:0/2448271791 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2285686191 0 0) 0x7fdf080017f0 con 0x7fdf100bc970 2023-10-08T15:40:02.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.879+0000 7fdf150c4700 1 -- 172.21.15.3:0/2448271791 >> v1:172.21.15.3:6789/0 conn(0x7fdf100bc970 legacy=0x7fdf100bcdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:02.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.879+0000 7fdf150c4700 1 --2- 172.21.15.3:0/2448271791 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdefc003a60 0x7fdefc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:02.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.879+0000 7fdf150c4700 1 --2- 172.21.15.3:0/2448271791 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdefc004810 0x7fdefc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:02.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.879+0000 7fdf150c4700 1 --2- 172.21.15.3:0/2448271791 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdefc0052e0 0x7fdefc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:02.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.879+0000 7fdf150c4700 1 -- 172.21.15.3:0/2448271791 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf100bff20 con 0x7fdefc003a60 2023-10-08T15:40:02.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.879+0000 7fdf150c4700 1 -- 172.21.15.3:0/2448271791 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdefc00c2a0 con 0x7fdefc0052e0 2023-10-08T15:40:02.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.879+0000 7fdf150c4700 1 -- 172.21.15.3:0/2448271791 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdefc00c460 con 0x7fdefc004810 2023-10-08T15:40:02.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.883+0000 7fdf160c6700 1 --2- 172.21.15.3:0/2448271791 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdefc003a60 0x7fdefc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:02.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.883+0000 7fdf168c7700 1 --2- 172.21.15.3:0/2448271791 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdefc0052e0 0x7fdefc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:02.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.883+0000 7fdf158c5700 1 --2- 172.21.15.3:0/2448271791 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdefc004810 0x7fdefc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:02.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.883+0000 7fdf160c6700 1 -- 172.21.15.3:0/2448271791 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdefc004810 msgr2=0x7fdefc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:02.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.883+0000 7fdf160c6700 1 --2- 172.21.15.3:0/2448271791 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdefc004810 0x7fdefc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:02.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.883+0000 7fdf160c6700 1 -- 172.21.15.3:0/2448271791 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdefc0052e0 msgr2=0x7fdefc00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:02.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.883+0000 7fdf160c6700 1 --2- 172.21.15.3:0/2448271791 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdefc0052e0 0x7fdefc00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:02.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.883+0000 7fdf168c7700 1 -- 172.21.15.3:0/2448271791 reap_dead start 2023-10-08T15:40:02.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.883+0000 7fdf160c6700 1 -- 172.21.15.3:0/2448271791 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdefc003570 con 0x7fdefc003a60 2023-10-08T15:40:02.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.883+0000 7fdf160c6700 1 --2- 172.21.15.3:0/2448271791 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdefc003a60 0x7fdefc003e70 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fdf000018b0 tx=0x7fdf00007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4adf3640dd4a4530 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:02.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.883+0000 7fdf150c4700 1 -- 172.21.15.3:0/2448271791 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf00012420 con 0x7fdefc003a60 2023-10-08T15:40:02.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.883+0000 7fdf150c4700 1 -- 172.21.15.3:0/2448271791 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf000125a0 con 0x7fdefc003a60 2023-10-08T15:40:02.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.883+0000 7fdf150c4700 1 -- 172.21.15.3:0/2448271791 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf00012960 con 0x7fdefc003a60 2023-10-08T15:40:02.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.883+0000 7fdf170c8700 1 -- 172.21.15.3:0/2448271791 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdefc003a60 msgr2=0x7fdefc003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:02.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.883+0000 7fdf170c8700 1 --2- 172.21.15.3:0/2448271791 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdefc003a60 0x7fdefc003e70 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fdf000018b0 tx=0x7fdf00007d30 comp rx=0 tx=0).stop 2023-10-08T15:40:02.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.883+0000 7fdf170c8700 1 -- 172.21.15.3:0/2448271791 shutdown_connections 2023-10-08T15:40:02.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.883+0000 7fdf170c8700 1 --2- 172.21.15.3:0/2448271791 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdefc003a60 0x7fdefc003e70 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:02.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.883+0000 7fdf170c8700 1 -- 172.21.15.3:0/2448271791 >> 172.21.15.3:0/2448271791 conn(0x7fdf100a2310 msgr2=0x7fdf100c1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:02.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.883+0000 7fdf170c8700 1 -- 172.21.15.3:0/2448271791 shutdown_connections 2023-10-08T15:40:02.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.883+0000 7fdf170c8700 1 -- 172.21.15.3:0/2448271791 wait complete. 2023-10-08T15:40:02.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.883+0000 7fdf170c8700 1 Processor -- start 2023-10-08T15:40:02.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.883+0000 7fdf170c8700 1 -- start start 2023-10-08T15:40:02.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.887+0000 7fdf170c8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdefc003a60 0x7fdf1015e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:02.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.887+0000 7fdf170c8700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdf1014f2d0 0x7fdf1006e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:02.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.887+0000 7fdf170c8700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf1014e5e0 0x7fdf1014ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:02.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.887+0000 7fdf170c8700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1014fc50 con 0x7fdf1014e5e0 2023-10-08T15:40:02.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.887+0000 7fdf170c8700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1014ef50 con 0x7fdefc003a60 2023-10-08T15:40:02.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.887+0000 7fdf170c8700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1014e150 con 0x7fdf1014f2d0 2023-10-08T15:40:02.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.887+0000 7fdf168c7700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf1014e5e0 0x7fdf1014ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:02.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.887+0000 7fdf168c7700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf1014e5e0 0x7fdf1014ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52558/0 (socket says 172.21.15.3:52558) 2023-10-08T15:40:02.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.887+0000 7fdf168c7700 1 -- 172.21.15.3:0/3293606800 learned_addr learned my addr 172.21.15.3:0/3293606800 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:02.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.887+0000 7fdf160c6700 1 --2- 172.21.15.3:0/3293606800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdefc003a60 0x7fdf1015e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:02.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.887+0000 7fdf158c5700 1 --2- 172.21.15.3:0/3293606800 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdf1014f2d0 0x7fdf1006e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:02.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.887+0000 7fdf168c7700 1 -- 172.21.15.3:0/3293606800 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdf1014f2d0 msgr2=0x7fdf1006e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:02.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.887+0000 7fdf168c7700 1 --2- 172.21.15.3:0/3293606800 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdf1014f2d0 0x7fdf1006e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:02.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.887+0000 7fdf168c7700 1 -- 172.21.15.3:0/3293606800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdefc003a60 msgr2=0x7fdf1015e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:02.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.887+0000 7fdf168c7700 1 --2- 172.21.15.3:0/3293606800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdefc003a60 0x7fdf1015e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:02.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.887+0000 7fdf168c7700 1 -- 172.21.15.3:0/3293606800 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf1015ead0 con 0x7fdf1014e5e0 2023-10-08T15:40:02.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.887+0000 7fdf158c5700 1 --2- 172.21.15.3:0/3293606800 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdf1014f2d0 0x7fdf1006e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:40:02.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.887+0000 7fdf168c7700 1 --2- 172.21.15.3:0/3293606800 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf1014e5e0 0x7fdf1014ea10 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fdf10069e60 tx=0x7fdf0800e440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:02.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.887+0000 7fdf067fc700 1 -- 172.21.15.3:0/3293606800 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf08017070 con 0x7fdf1014e5e0 2023-10-08T15:40:02.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.887+0000 7fdf067fc700 1 -- 172.21.15.3:0/3293606800 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf08007ad0 con 0x7fdf1014e5e0 2023-10-08T15:40:02.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.887+0000 7fdf170c8700 1 -- 172.21.15.3:0/3293606800 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf1014d720 con 0x7fdf1014e5e0 2023-10-08T15:40:02.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.887+0000 7fdf067fc700 1 -- 172.21.15.3:0/3293606800 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0800ee60 con 0x7fdf1014e5e0 2023-10-08T15:40:02.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.887+0000 7fdf170c8700 1 -- 172.21.15.3:0/3293606800 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf1014ad30 con 0x7fdf1014e5e0 2023-10-08T15:40:02.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.887+0000 7fdf170c8700 1 -- 172.21.15.3:0/3293606800 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf1014e2e0 con 0x7fdf1014e5e0 2023-10-08T15:40:02.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.891+0000 7fdf067fc700 1 -- 172.21.15.3:0/3293606800 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fdf08013630 con 0x7fdf1014e5e0 2023-10-08T15:40:02.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.891+0000 7fdf067fc700 1 --2- 172.21.15.3:0/3293606800 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fdef4060550 0x7fdef4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:02.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.891+0000 7fdf067fc700 1 -- 172.21.15.3:0/3293606800 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdf0807c4a0 con 0x7fdf1014e5e0 2023-10-08T15:40:02.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.891+0000 7fdf160c6700 1 --2- 172.21.15.3:0/3293606800 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fdef4060550 0x7fdef4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:02.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.891+0000 7fdf160c6700 1 --2- 172.21.15.3:0/3293606800 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fdef4060550 0x7fdef4062a00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fdf00001010 tx=0x7fdf00015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:02.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:02.895+0000 7fdf067fc700 1 -- 172.21.15.3:0/3293606800 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fdf0804ca90 con 0x7fdf1014e5e0 2023-10-08T15:40:03.098 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.095+0000 7fdf170c8700 1 -- 172.21.15.3:0/3293606800 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fdf1005ecf0 con 0x7fdf1014e5e0 2023-10-08T15:40:03.099 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-10-08T15:40:03.095+0000 7fd2c0727700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T15:40:03.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.103+0000 7fdf067fc700 1 -- 172.21.15.3:0/3293606800 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v14) v1 ==== 161+0+0 (secure 0 0 0) 0x7fdf080500b0 con 0x7fdf1014e5e0 2023-10-08T15:40:03.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.103+0000 7fdf170c8700 1 -- 172.21.15.3:0/3293606800 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fdef4060550 msgr2=0x7fdef4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:03.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.103+0000 7fdf170c8700 1 --2- 172.21.15.3:0/3293606800 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fdef4060550 0x7fdef4062a00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fdf00001010 tx=0x7fdf00015000 comp rx=0 tx=0).stop 2023-10-08T15:40:03.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.103+0000 7fdf170c8700 1 -- 172.21.15.3:0/3293606800 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf1014e5e0 msgr2=0x7fdf1014ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:03.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.103+0000 7fdf170c8700 1 --2- 172.21.15.3:0/3293606800 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf1014e5e0 0x7fdf1014ea10 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fdf10069e60 tx=0x7fdf0800e440 comp rx=0 tx=0).stop 2023-10-08T15:40:03.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.103+0000 7fdf170c8700 1 -- 172.21.15.3:0/3293606800 shutdown_connections 2023-10-08T15:40:03.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.103+0000 7fdf170c8700 1 --2- 172.21.15.3:0/3293606800 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fdef4060550 0x7fdef4062a00 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:03.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.103+0000 7fdf170c8700 1 --2- 172.21.15.3:0/3293606800 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf1014e5e0 0x7fdf1014ea10 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:03.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.103+0000 7fdf170c8700 1 --2- 172.21.15.3:0/3293606800 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdf1014f2d0 0x7fdf1006e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:03.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.103+0000 7fdf170c8700 1 --2- 172.21.15.3:0/3293606800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdefc003a60 0x7fdf1015e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:03.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.103+0000 7fdf170c8700 1 -- 172.21.15.3:0/3293606800 >> 172.21.15.3:0/3293606800 conn(0x7fdf100a2310 msgr2=0x7fdf1006cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:03.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.103+0000 7fdf170c8700 1 -- 172.21.15.3:0/3293606800 shutdown_connections 2023-10-08T15:40:03.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.103+0000 7fdf170c8700 1 -- 172.21.15.3:0/3293606800 wait complete. 2023-10-08T15:40:03.111 INFO:teuthology.orchestra.run.smithi003.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-08T15:40:03.126 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-08T15:40:03.146 INFO:tasks.ceph.mds.a.smithi003.stdout:starting mds.a at 2023-10-08T15:40:03.234 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.231+0000 7f778359e700 1 Processor -- start 2023-10-08T15:40:03.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.231+0000 7f778359e700 1 -- start start 2023-10-08T15:40:03.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.231+0000 7f778359e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f778414b000 0x7f7784068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:03.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.231+0000 7f778359e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f778406d200 0x7f778406d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:03.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.231+0000 7f778359e700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f778406c7b0 con 0x7f778414ac30 2023-10-08T15:40:03.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.231+0000 7f778359e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77840a7e60 con 0x7f778414b000 2023-10-08T15:40:03.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.231+0000 7f778259c700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f778414ac30 0x7f778414bf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:37450/0 (socket says 172.21.15.3:37450) 2023-10-08T15:40:03.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.231+0000 7f778259c700 1 -- 172.21.15.3:0/3090473572 learned_addr learned my addr 172.21.15.3:0/3090473572 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:40:03.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.231+0000 7f778359e700 1 -- 172.21.15.3:0/3090473572 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f778406ca00 con 0x7f778406d200 2023-10-08T15:40:03.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.231+0000 7f7781d9b700 1 --2- 172.21.15.3:0/3090473572 >> v2:172.21.15.50:3300/0 conn(0x7f778414b000 0x7f7784068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:03.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.231+0000 7f7782d9d700 1 --2- 172.21.15.3:0/3090473572 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f778406d200 0x7f778406d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:03.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.231+0000 7f778159a700 1 -- 172.21.15.3:0/3090473572 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1828011416 0 0) 0x7f778406c7b0 con 0x7f778414ac30 2023-10-08T15:40:03.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.231+0000 7f778159a700 1 -- 172.21.15.3:0/3090473572 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f776c003570 con 0x7f778414ac30 2023-10-08T15:40:03.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.231+0000 7f778159a700 1 -- 172.21.15.3:0/3090473572 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2870590064 0 0) 0x7f776c003570 con 0x7f778414ac30 2023-10-08T15:40:03.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.231+0000 7f7781d9b700 1 -- 172.21.15.3:0/3090473572 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f778406d200 msgr2=0x7f778406d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:03.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.231+0000 7f7781d9b700 1 --2- 172.21.15.3:0/3090473572 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f778406d200 0x7f778406d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:03.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.235+0000 7f7781d9b700 1 -- 172.21.15.3:0/3090473572 >> v1:172.21.15.3:6789/0 conn(0x7f778414ac30 legacy=0x7f778414bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:03.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.235+0000 7f7781d9b700 1 -- 172.21.15.3:0/3090473572 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f778406cce0 con 0x7f778414b000 2023-10-08T15:40:03.239 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.235+0000 7f7781d9b700 1 --2- 172.21.15.3:0/3090473572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f778414b000 0x7f7784068390 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f77780098e0 tx=0x7f77780091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a60a059b9fc6e8f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:03.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.235+0000 7f778159a700 1 -- 172.21.15.3:0/3090473572 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77740017f0 con 0x7f778414b000 2023-10-08T15:40:03.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.235+0000 7f778159a700 1 -- 172.21.15.3:0/3090473572 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7778011420 con 0x7f778414b000 2023-10-08T15:40:03.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.235+0000 7f778159a700 1 -- 172.21.15.3:0/3090473572 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77780117a0 con 0x7f778414b000 2023-10-08T15:40:03.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.235+0000 7f778359e700 1 -- 172.21.15.3:0/3090473572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f778414b000 msgr2=0x7f7784068390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:03.241 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.235+0000 7f778359e700 1 --2- 172.21.15.3:0/3090473572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f778414b000 0x7f7784068390 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f77780098e0 tx=0x7f77780091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:03.241 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.235+0000 7f778359e700 1 -- 172.21.15.3:0/3090473572 shutdown_connections 2023-10-08T15:40:03.241 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.235+0000 7f778359e700 1 --2- 172.21.15.3:0/3090473572 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f778406d200 0x7f778406d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:03.241 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.235+0000 7f778359e700 1 --2- 172.21.15.3:0/3090473572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f778414b000 0x7f7784068390 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:03.241 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.235+0000 7f778359e700 1 -- 172.21.15.3:0/3090473572 >> 172.21.15.3:0/3090473572 conn(0x7f77840c1df0 msgr2=0x7f77840c21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:03.242 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.235+0000 7f778359e700 1 -- 172.21.15.3:0/3090473572 shutdown_connections 2023-10-08T15:40:03.242 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.235+0000 7f778359e700 1 -- 172.21.15.3:0/3090473572 wait complete. 2023-10-08T15:40:03.245 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.239+0000 7f778359e700 1 Processor -- start 2023-10-08T15:40:03.245 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.239+0000 7f778359e700 1 -- start start 2023-10-08T15:40:03.245 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.239+0000 7f778359e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f778406d200 0x7f778414edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:03.245 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.239+0000 7f778359e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f778414ac30 0x7f778415b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:03.245 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.239+0000 7f778359e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f778414b000 0x7f778414ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:03.245 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.239+0000 7f778359e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77840b71d0 con 0x7f778406d200 2023-10-08T15:40:03.245 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.239+0000 7f778359e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7784148800 con 0x7f778414ac30 2023-10-08T15:40:03.245 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.239+0000 7f778359e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7784147da0 con 0x7f778414b000 2023-10-08T15:40:03.245 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.239+0000 7f778259c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f778406d200 0x7f778414edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:03.245 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.239+0000 7f778259c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f778406d200 0x7f778414edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52572/0 (socket says 172.21.15.3:52572) 2023-10-08T15:40:03.246 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.239+0000 7f778259c700 1 -- 172.21.15.3:0/3768291056 learned_addr learned my addr 172.21.15.3:0/3768291056 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:03.246 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.239+0000 7f7782d9d700 1 --2- 172.21.15.3:0/3768291056 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f778414b000 0x7f778414ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:03.246 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.239+0000 7f7781d9b700 1 --2- 172.21.15.3:0/3768291056 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f778414ac30 0x7f778415b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:03.246 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.239+0000 7f778259c700 1 -- 172.21.15.3:0/3768291056 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f778414b000 msgr2=0x7f778414ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:03.246 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.239+0000 7f778259c700 1 --2- 172.21.15.3:0/3768291056 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f778414b000 0x7f778414ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:03.246 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.239+0000 7f778259c700 1 -- 172.21.15.3:0/3768291056 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f778414ac30 msgr2=0x7f778415b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:03.246 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.239+0000 7f778259c700 1 --2- 172.21.15.3:0/3768291056 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f778414ac30 0x7f778415b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:03.246 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.239+0000 7f778259c700 1 -- 172.21.15.3:0/3768291056 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7778009420 con 0x7f778406d200 2023-10-08T15:40:03.246 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.239+0000 7f778259c700 1 --2- 172.21.15.3:0/3768291056 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f778406d200 0x7f778414edb0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f777400cc10 tx=0x7f7774001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:03.246 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.239+0000 7f77727fc700 1 -- 172.21.15.3:0/3768291056 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7774004dc0 con 0x7f778406d200 2023-10-08T15:40:03.246 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.239+0000 7f77727fc700 1 -- 172.21.15.3:0/3768291056 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f777400a600 con 0x7f778406d200 2023-10-08T15:40:03.247 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.239+0000 7f77727fc700 1 -- 172.21.15.3:0/3768291056 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f777400a9c0 con 0x7f778406d200 2023-10-08T15:40:03.247 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.239+0000 7f778359e700 1 -- 172.21.15.3:0/3768291056 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7784150b90 con 0x7f778406d200 2023-10-08T15:40:03.247 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.239+0000 7f778359e700 1 -- 172.21.15.3:0/3768291056 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7784151540 con 0x7f778406d200 2023-10-08T15:40:03.248 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.243+0000 7f778359e700 1 -- 172.21.15.3:0/3768291056 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f778405ecf0 con 0x7f778406d200 2023-10-08T15:40:03.248 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.243+0000 7f77727fc700 1 -- 172.21.15.3:0/3768291056 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f7774007150 con 0x7f778406d200 2023-10-08T15:40:03.248 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.243+0000 7f77727fc700 1 --2- 172.21.15.3:0/3768291056 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7764060550 0x7f7764062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:03.248 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.243+0000 7f77727fc700 1 -- 172.21.15.3:0/3768291056 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f777407bf90 con 0x7f778406d200 2023-10-08T15:40:03.248 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.243+0000 7f7781d9b700 1 --2- 172.21.15.3:0/3768291056 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7764060550 0x7f7764062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:03.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.243+0000 7f7781d9b700 1 --2- 172.21.15.3:0/3768291056 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7764060550 0x7f7764062a00 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f77780091e0 tx=0x7f7778016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:03.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.255+0000 7f77727fc700 1 -- 172.21.15.3:0/3768291056 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f777404c510 con 0x7f778406d200 2023-10-08T15:40:03.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:03.451+0000 7f778359e700 1 -- 172.21.15.3:0/3768291056 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f77840688d0 con 0x7f778406d200 2023-10-08T15:40:04.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.107+0000 7f77727fc700 1 -- 172.21.15.3:0/3768291056 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f77740180a0 con 0x7f778406d200 2023-10-08T15:40:04.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.111+0000 7f778359e700 1 -- 172.21.15.3:0/3768291056 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7764060550 msgr2=0x7f7764062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:04.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.111+0000 7f778359e700 1 --2- 172.21.15.3:0/3768291056 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7764060550 0x7f7764062a00 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f77780091e0 tx=0x7f7778016000 comp rx=0 tx=0).stop 2023-10-08T15:40:04.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.111+0000 7f778359e700 1 -- 172.21.15.3:0/3768291056 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f778406d200 msgr2=0x7f778414edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:04.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.111+0000 7f778359e700 1 --2- 172.21.15.3:0/3768291056 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f778406d200 0x7f778414edb0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f777400cc10 tx=0x7f7774001640 comp rx=0 tx=0).stop 2023-10-08T15:40:04.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.111+0000 7f778359e700 1 -- 172.21.15.3:0/3768291056 shutdown_connections 2023-10-08T15:40:04.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.111+0000 7f778359e700 1 --2- 172.21.15.3:0/3768291056 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7764060550 0x7f7764062a00 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:04.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.111+0000 7f778359e700 1 --2- 172.21.15.3:0/3768291056 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f778414b000 0x7f778414ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:04.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.111+0000 7f778359e700 1 --2- 172.21.15.3:0/3768291056 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f778414ac30 0x7f778415b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:04.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.111+0000 7f778359e700 1 --2- 172.21.15.3:0/3768291056 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f778406d200 0x7f778414edb0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:04.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.111+0000 7f778359e700 1 -- 172.21.15.3:0/3768291056 >> 172.21.15.3:0/3768291056 conn(0x7f77840c1df0 msgr2=0x7f77840c11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:04.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.111+0000 7f778359e700 1 -- 172.21.15.3:0/3768291056 shutdown_connections 2023-10-08T15:40:04.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.111+0000 7f778359e700 1 -- 172.21.15.3:0/3768291056 wait complete. 2023-10-08T15:40:04.132 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-08T15:40:04.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.251+0000 7f6ba1420700 1 Processor -- start 2023-10-08T15:40:04.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.251+0000 7f6ba1420700 1 -- start start 2023-10-08T15:40:04.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.251+0000 7f6ba1420700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6b9c06f4e0 0x7f6b9c14cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:04.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.251+0000 7f6ba1420700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6b9c06df60 0x7f6b9c14d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:04.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.251+0000 7f6ba1420700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b9c0b4490 con 0x7f6b9c0bc1d0 2023-10-08T15:40:04.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.251+0000 7f6ba1420700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b9c0b4920 con 0x7f6b9c06f4e0 2023-10-08T15:40:04.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.251+0000 7f6ba1420700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9c0b3e40 con 0x7f6b9c06df60 2023-10-08T15:40:04.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.251+0000 7f6b9b7fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6b9c06df60 0x7f6b9c14d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:04.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.251+0000 7f6b9a7fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6b9c06f4e0 0x7f6b9c14cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:04.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.251+0000 7f6b9affd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6b9c0bc1d0 0x7f6b9c148c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.3:36974/0 (socket says 172.21.15.3:36974) 2023-10-08T15:40:04.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.251+0000 7f6b9b7fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6b9c06df60 0x7f6b9c14d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.3:55554/0 (socket says 172.21.15.3:55554) 2023-10-08T15:40:04.256 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.251+0000 7f6b9a7fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6b9c06f4e0 0x7f6b9c14cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.3:33684/0 (socket says 172.21.15.3:33684) 2023-10-08T15:40:04.257 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.251+0000 7f6b9affd700 1 -- 172.21.15.3:0/1058304823 learned_addr learned my addr 172.21.15.3:0/1058304823 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:40:04.257 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.251+0000 7f6b9b7fe700 1 -- 172.21.15.3:0/1058304823 >> v2:172.21.15.50:3300/0 conn(0x7f6b9c06f4e0 msgr2=0x7f6b9c14cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:04.257 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.251+0000 7f6b9b7fe700 1 --2- 172.21.15.3:0/1058304823 >> v2:172.21.15.50:3300/0 conn(0x7f6b9c06f4e0 0x7f6b9c14cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:04.257 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.251+0000 7f6b9b7fe700 1 -- 172.21.15.3:0/1058304823 >> v1:172.21.15.50:6789/0 conn(0x7f6b9c0bc1d0 legacy=0x7f6b9c148c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:04.257 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.251+0000 7f6b9b7fe700 1 -- 172.21.15.3:0/1058304823 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b9c0b4120 con 0x7f6b9c06df60 2023-10-08T15:40:04.257 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.251+0000 7f6b9b7fe700 1 --2- 172.21.15.3:0/1058304823 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6b9c06df60 0x7f6b9c14d130 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6b94009e60 tx=0x7f6b94009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf671b1536acf84d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:04.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.251+0000 7f6b99ffb700 1 -- 172.21.15.3:0/1058304823 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9400e070 con 0x7f6b9c06df60 2023-10-08T15:40:04.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.251+0000 7f6b99ffb700 1 -- 172.21.15.3:0/1058304823 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b9400bb60 con 0x7f6b9c06df60 2023-10-08T15:40:04.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.251+0000 7f6b99ffb700 1 -- 172.21.15.3:0/1058304823 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b94012430 con 0x7f6b9c06df60 2023-10-08T15:40:04.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.255+0000 7f6ba1420700 1 -- 172.21.15.3:0/1058304823 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6b9c06df60 msgr2=0x7f6b9c14d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:04.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.255+0000 7f6ba1420700 1 --2- 172.21.15.3:0/1058304823 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6b9c06df60 0x7f6b9c14d130 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6b94009e60 tx=0x7f6b94009780 comp rx=0 tx=0).stop 2023-10-08T15:40:04.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.255+0000 7f6ba1420700 1 -- 172.21.15.3:0/1058304823 shutdown_connections 2023-10-08T15:40:04.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.255+0000 7f6ba1420700 1 --2- 172.21.15.3:0/1058304823 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6b9c06df60 0x7f6b9c14d130 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:04.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.255+0000 7f6ba1420700 1 --2- 172.21.15.3:0/1058304823 >> v2:172.21.15.50:3300/0 conn(0x7f6b9c06f4e0 0x7f6b9c14cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:04.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.255+0000 7f6ba1420700 1 -- 172.21.15.3:0/1058304823 >> 172.21.15.3:0/1058304823 conn(0x7f6b9c0bf820 msgr2=0x7f6b9c0bb890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:04.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.255+0000 7f6ba1420700 1 -- 172.21.15.3:0/1058304823 shutdown_connections 2023-10-08T15:40:04.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.255+0000 7f6ba1420700 1 -- 172.21.15.3:0/1058304823 wait complete. 2023-10-08T15:40:04.260 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.255+0000 7f6ba1420700 1 Processor -- start 2023-10-08T15:40:04.260 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.255+0000 7f6ba1420700 1 -- start start 2023-10-08T15:40:04.261 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.255+0000 7f6ba1420700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6b9c06df60 0x7f6b9c15ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:04.261 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.255+0000 7f6ba1420700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b9c06f4e0 0x7f6b9c15c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:04.261 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.255+0000 7f6ba1420700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6b9c0bc1d0 0x7f6b9c14b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:04.261 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.255+0000 7f6ba1420700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9c0b63d0 con 0x7f6b9c06df60 2023-10-08T15:40:04.261 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.255+0000 7f6ba1420700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9c141a50 con 0x7f6b9c06f4e0 2023-10-08T15:40:04.261 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.255+0000 7f6ba1420700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9c15cbe0 con 0x7f6b9c0bc1d0 2023-10-08T15:40:04.261 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.255+0000 7f6b9affd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6b9c06df60 0x7f6b9c15ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:04.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.255+0000 7f6b9a7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b9c06f4e0 0x7f6b9c15c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:04.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.255+0000 7f6b9b7fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6b9c0bc1d0 0x7f6b9c14b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:04.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.255+0000 7f6b9a7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b9c06f4e0 0x7f6b9c15c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.3:33696/0 (socket says 172.21.15.3:33696) 2023-10-08T15:40:04.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.255+0000 7f6b9affd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6b9c06df60 0x7f6b9c15ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52578/0 (socket says 172.21.15.3:52578) 2023-10-08T15:40:04.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.255+0000 7f6b9a7fc700 1 -- 172.21.15.3:0/541728450 learned_addr learned my addr 172.21.15.3:0/541728450 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:04.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.259+0000 7f6b9b7fe700 1 -- 172.21.15.3:0/541728450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b9c06f4e0 msgr2=0x7f6b9c15c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:04.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.259+0000 7f6b9b7fe700 1 --2- 172.21.15.3:0/541728450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b9c06f4e0 0x7f6b9c15c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:04.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.259+0000 7f6b9b7fe700 1 -- 172.21.15.3:0/541728450 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6b9c06df60 msgr2=0x7f6b9c15ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:04.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.259+0000 7f6b9b7fe700 1 --2- 172.21.15.3:0/541728450 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6b9c06df60 0x7f6b9c15ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:04.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.259+0000 7f6b9b7fe700 1 -- 172.21.15.3:0/541728450 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b94009a20 con 0x7f6b9c0bc1d0 2023-10-08T15:40:04.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.259+0000 7f6b9a7fc700 1 --2- 172.21.15.3:0/541728450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b9c06f4e0 0x7f6b9c15c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:40:04.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.259+0000 7f6b9b7fe700 1 --2- 172.21.15.3:0/541728450 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6b9c0bc1d0 0x7f6b9c14b160 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6b94016000 tx=0x7f6b94019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:04.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.259+0000 7f6b82ffd700 1 -- 172.21.15.3:0/541728450 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b94027470 con 0x7f6b9c0bc1d0 2023-10-08T15:40:04.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.259+0000 7f6b82ffd700 1 -- 172.21.15.3:0/541728450 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b940275f0 con 0x7f6b9c0bc1d0 2023-10-08T15:40:04.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.259+0000 7f6b82ffd700 1 -- 172.21.15.3:0/541728450 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b940279b0 con 0x7f6b9c0bc1d0 2023-10-08T15:40:04.265 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.259+0000 7f6ba1420700 1 -- 172.21.15.3:0/541728450 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b9c14b6a0 con 0x7f6b9c0bc1d0 2023-10-08T15:40:04.265 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.259+0000 7f6ba1420700 1 -- 172.21.15.3:0/541728450 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b9c142160 con 0x7f6b9c0bc1d0 2023-10-08T15:40:04.265 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.259+0000 7f6ba1420700 1 -- 172.21.15.3:0/541728450 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b9c141bc0 con 0x7f6b9c0bc1d0 2023-10-08T15:40:04.265 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.263+0000 7f6b82ffd700 1 -- 172.21.15.3:0/541728450 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6b94024070 con 0x7f6b9c0bc1d0 2023-10-08T15:40:04.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.263+0000 7f6b82ffd700 1 --2- 172.21.15.3:0/541728450 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f6b88060580 0x7f6b88062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:04.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.263+0000 7f6b82ffd700 1 -- 172.21.15.3:0/541728450 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f6b9407ef60 con 0x7f6b9c0bc1d0 2023-10-08T15:40:04.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.263+0000 7f6b9affd700 1 --2- 172.21.15.3:0/541728450 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f6b88060580 0x7f6b88062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:04.267 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.263+0000 7f6b9affd700 1 --2- 172.21.15.3:0/541728450 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f6b88060580 0x7f6b88062a30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c007130 tx=0x7f6b8c007eb0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:04.275 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.271+0000 7f6b82ffd700 1 -- 172.21.15.3:0/541728450 <== mon.2 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6b9c141bc0 con 0x7f6b9c0bc1d0 2023-10-08T15:40:04.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:04.435+0000 7f6ba1420700 1 -- 172.21.15.3:0/541728450 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6b9c141bc0 con 0x7f6b9c0bc1d0 2023-10-08T15:40:05.320 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.315+0000 7f6b82ffd700 1 -- 172.21.15.3:0/541728450 <== mon.2 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v31) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6b9c141bc0 con 0x7f6b9c0bc1d0 2023-10-08T15:40:05.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.319+0000 7f6ba1420700 1 -- 172.21.15.3:0/541728450 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f6b88060580 msgr2=0x7f6b88062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:05.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.319+0000 7f6ba1420700 1 --2- 172.21.15.3:0/541728450 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f6b88060580 0x7f6b88062a30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c007130 tx=0x7f6b8c007eb0 comp rx=0 tx=0).stop 2023-10-08T15:40:05.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.319+0000 7f6ba1420700 1 -- 172.21.15.3:0/541728450 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6b9c0bc1d0 msgr2=0x7f6b9c14b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:05.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.319+0000 7f6ba1420700 1 --2- 172.21.15.3:0/541728450 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6b9c0bc1d0 0x7f6b9c14b160 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6b94016000 tx=0x7f6b94019000 comp rx=0 tx=0).stop 2023-10-08T15:40:05.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.323+0000 7f6ba1420700 1 -- 172.21.15.3:0/541728450 shutdown_connections 2023-10-08T15:40:05.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.323+0000 7f6ba1420700 1 --2- 172.21.15.3:0/541728450 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f6b88060580 0x7f6b88062a30 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:05.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.323+0000 7f6ba1420700 1 --2- 172.21.15.3:0/541728450 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6b9c0bc1d0 0x7f6b9c14b160 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:05.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.323+0000 7f6ba1420700 1 --2- 172.21.15.3:0/541728450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b9c06f4e0 0x7f6b9c15c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:05.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.323+0000 7f6ba1420700 1 --2- 172.21.15.3:0/541728450 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6b9c06df60 0x7f6b9c15ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:05.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.323+0000 7f6ba1420700 1 -- 172.21.15.3:0/541728450 >> 172.21.15.3:0/541728450 conn(0x7f6b9c0bf820 msgr2=0x7f6b9c145ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:05.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.323+0000 7f6ba1420700 1 -- 172.21.15.3:0/541728450 shutdown_connections 2023-10-08T15:40:05.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.323+0000 7f6ba1420700 1 -- 172.21.15.3:0/541728450 wait complete. 2023-10-08T15:40:05.328 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'cephfs_metadata' removed 2023-10-08T15:40:05.341 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-08T15:40:05.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.447+0000 7f10dbfff700 1 Processor -- start 2023-10-08T15:40:05.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.447+0000 7f10dbfff700 1 -- start start 2023-10-08T15:40:05.455 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.447+0000 7f10dbfff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f10dc09f5c0 0x7f10dc0a2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:05.455 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.447+0000 7f10dbfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f10dc14f640 0x7f10dc09cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:05.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.447+0000 7f10dbfff700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10dc14fc50 con 0x7f10dc09f990 2023-10-08T15:40:05.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.447+0000 7f10dbfff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10dc0a2870 con 0x7f10dc14f640 2023-10-08T15:40:05.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.447+0000 7f10dbfff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc0a1590 con 0x7f10dc09f5c0 2023-10-08T15:40:05.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.447+0000 7f10db7fe700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f10dc09f990 0x7f10dc09d7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:37466/0 (socket says 172.21.15.3:37466) 2023-10-08T15:40:05.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.447+0000 7f10db7fe700 1 -- 172.21.15.3:0/1541458336 learned_addr learned my addr 172.21.15.3:0/1541458336 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:40:05.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.447+0000 7f10da7fc700 1 --2- 172.21.15.3:0/1541458336 >> v2:172.21.15.50:3300/0 conn(0x7f10dc14f640 0x7f10dc09cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:05.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.447+0000 7f10daffd700 1 --2- 172.21.15.3:0/1541458336 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f10dc09f5c0 0x7f10dc0a2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:05.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.447+0000 7f10d9ffb700 1 -- 172.21.15.3:0/1541458336 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2328064631 0 0) 0x7f10dc14fc50 con 0x7f10dc09f990 2023-10-08T15:40:05.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.447+0000 7f10d9ffb700 1 -- 172.21.15.3:0/1541458336 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10c4003570 con 0x7f10dc09f990 2023-10-08T15:40:05.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.447+0000 7f10d9ffb700 1 -- 172.21.15.3:0/1541458336 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2682304562 0 0) 0x7f10c4003570 con 0x7f10dc09f990 2023-10-08T15:40:05.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.447+0000 7f10d9ffb700 1 -- 172.21.15.3:0/1541458336 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f10dc09f5c0 msgr2=0x7f10dc0a2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:05.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.447+0000 7f10d9ffb700 1 --2- 172.21.15.3:0/1541458336 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f10dc09f5c0 0x7f10dc0a2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:05.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.447+0000 7f10d9ffb700 1 -- 172.21.15.3:0/1541458336 >> v2:172.21.15.50:3300/0 conn(0x7f10dc14f640 msgr2=0x7f10dc09cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:05.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.447+0000 7f10d9ffb700 1 --2- 172.21.15.3:0/1541458336 >> v2:172.21.15.50:3300/0 conn(0x7f10dc14f640 0x7f10dc09cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:05.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.447+0000 7f10d9ffb700 1 -- 172.21.15.3:0/1541458336 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10dc09deb0 con 0x7f10dc09f990 2023-10-08T15:40:05.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.447+0000 7f10d9ffb700 1 -- 172.21.15.3:0/1541458336 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2285686191 0 0) 0x7f10cc001470 con 0x7f10dc09f990 2023-10-08T15:40:05.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.447+0000 7f10d9ffb700 1 -- 172.21.15.3:0/1541458336 >> v1:172.21.15.3:6789/0 conn(0x7f10dc09f990 legacy=0x7f10dc09d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:05.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.447+0000 7f10d9ffb700 1 --2- 172.21.15.3:0/1541458336 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f10dc09f5c0 0x7f10c4003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:05.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.447+0000 7f10d9ffb700 1 --2- 172.21.15.3:0/1541458336 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f10c4003fe0 0x7f10c4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:05.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.447+0000 7f10d9ffb700 1 --2- 172.21.15.3:0/1541458336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10c4004d50 0x7f10c40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:05.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.447+0000 7f10d9ffb700 1 -- 172.21.15.3:0/1541458336 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc0a2870 con 0x7f10c4003fe0 2023-10-08T15:40:05.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.447+0000 7f10d9ffb700 1 -- 172.21.15.3:0/1541458336 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc0a1590 con 0x7f10c4004d50 2023-10-08T15:40:05.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.447+0000 7f10d9ffb700 1 -- 172.21.15.3:0/1541458336 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10c400ba90 con 0x7f10dc09f5c0 2023-10-08T15:40:05.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.447+0000 7f10da7fc700 1 --2- 172.21.15.3:0/1541458336 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f10c4003fe0 0x7f10c4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:05.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.447+0000 7f10daffd700 1 --2- 172.21.15.3:0/1541458336 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f10dc09f5c0 0x7f10c4003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:05.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.447+0000 7f10db7fe700 1 --2- 172.21.15.3:0/1541458336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10c4004d50 0x7f10c40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:05.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.447+0000 7f10da7fc700 1 -- 172.21.15.3:0/1541458336 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f10dc09f5c0 msgr2=0x7f10c4003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:05.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.447+0000 7f10da7fc700 1 --2- 172.21.15.3:0/1541458336 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f10dc09f5c0 0x7f10c4003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:05.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.447+0000 7f10da7fc700 1 -- 172.21.15.3:0/1541458336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10c4004d50 msgr2=0x7f10c40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:05.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.447+0000 7f10da7fc700 1 --2- 172.21.15.3:0/1541458336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10c4004d50 0x7f10c40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:05.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.447+0000 7f10da7fc700 1 -- 172.21.15.3:0/1541458336 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c4003570 con 0x7f10c4003fe0 2023-10-08T15:40:05.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.451+0000 7f10daffd700 1 --2- 172.21.15.3:0/1541458336 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f10dc09f5c0 0x7f10c4003a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:40:05.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.451+0000 7f10db7fe700 1 --2- 172.21.15.3:0/1541458336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10c4004d50 0x7f10c40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:40:05.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.451+0000 7f10da7fc700 1 --2- 172.21.15.3:0/1541458336 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f10c4003fe0 0x7f10c4004810 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f10d0009c00 tx=0x7f10d00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d36034f154f0319 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:05.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.451+0000 7f10d9ffb700 1 -- 172.21.15.3:0/1541458336 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d000e6b0 con 0x7f10c4003fe0 2023-10-08T15:40:05.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.451+0000 7f10d9ffb700 1 -- 172.21.15.3:0/1541458336 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d000e810 con 0x7f10c4003fe0 2023-10-08T15:40:05.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.451+0000 7f10d9ffb700 1 -- 172.21.15.3:0/1541458336 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d000ebd0 con 0x7f10c4003fe0 2023-10-08T15:40:05.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.451+0000 7f10dbfff700 1 -- 172.21.15.3:0/1541458336 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f10c4003fe0 msgr2=0x7f10c4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:05.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.451+0000 7f10dbfff700 1 --2- 172.21.15.3:0/1541458336 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f10c4003fe0 0x7f10c4004810 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f10d0009c00 tx=0x7f10d00091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:05.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.451+0000 7f10db7fe700 1 -- 172.21.15.3:0/1541458336 reap_dead start 2023-10-08T15:40:05.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.451+0000 7f10dbfff700 1 -- 172.21.15.3:0/1541458336 shutdown_connections 2023-10-08T15:40:05.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.451+0000 7f10dbfff700 1 -- 172.21.15.3:0/1541458336 >> 172.21.15.3:0/1541458336 conn(0x7f10dc0bd9d0 msgr2=0x7f10dc0bddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:05.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.451+0000 7f10dbfff700 1 -- 172.21.15.3:0/1541458336 shutdown_connections 2023-10-08T15:40:05.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.451+0000 7f10dbfff700 1 -- 172.21.15.3:0/1541458336 wait complete. 2023-10-08T15:40:05.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.451+0000 7f10dbfff700 1 Processor -- start 2023-10-08T15:40:05.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.451+0000 7f10dbfff700 1 -- start start 2023-10-08T15:40:05.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.451+0000 7f10dbfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10c4003fe0 0x7f10dc14abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:05.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.451+0000 7f10dbfff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f10dc149e60 0x7f10dc06c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:05.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.455+0000 7f10dbfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f10dc06cb00 0x7f10dc162910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:05.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.455+0000 7f10dbfff700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc14b510 con 0x7f10dc06cb00 2023-10-08T15:40:05.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.455+0000 7f10dbfff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc06f0b0 con 0x7f10c4003fe0 2023-10-08T15:40:05.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.455+0000 7f10dbfff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc14b720 con 0x7f10dc149e60 2023-10-08T15:40:05.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.455+0000 7f10db7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f10dc06cb00 0x7f10dc162910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:05.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.455+0000 7f10db7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f10dc06cb00 0x7f10dc162910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52584/0 (socket says 172.21.15.3:52584) 2023-10-08T15:40:05.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.455+0000 7f10db7fe700 1 -- 172.21.15.3:0/2292324054 learned_addr learned my addr 172.21.15.3:0/2292324054 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:05.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.455+0000 7f10daffd700 1 --2- 172.21.15.3:0/2292324054 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10c4003fe0 0x7f10dc14abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:05.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.455+0000 7f10da7fc700 1 --2- 172.21.15.3:0/2292324054 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f10dc149e60 0x7f10dc06c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:05.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.455+0000 7f10db7fe700 1 -- 172.21.15.3:0/2292324054 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f10dc149e60 msgr2=0x7f10dc06c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:05.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.455+0000 7f10db7fe700 1 --2- 172.21.15.3:0/2292324054 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f10dc149e60 0x7f10dc06c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:05.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.455+0000 7f10db7fe700 1 -- 172.21.15.3:0/2292324054 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10c4003fe0 msgr2=0x7f10dc14abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:05.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.455+0000 7f10db7fe700 1 --2- 172.21.15.3:0/2292324054 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10c4003fe0 0x7f10dc14abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:05.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.455+0000 7f10db7fe700 1 -- 172.21.15.3:0/2292324054 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10dc06f540 con 0x7f10dc06cb00 2023-10-08T15:40:05.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.455+0000 7f10da7fc700 1 --2- 172.21.15.3:0/2292324054 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f10dc149e60 0x7f10dc06c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:40:05.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.455+0000 7f10db7fe700 1 --2- 172.21.15.3:0/2292324054 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f10dc06cb00 0x7f10dc162910 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f10cc000c00 tx=0x7f10cc009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:05.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.455+0000 7f10c2ffd700 1 -- 172.21.15.3:0/2292324054 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10cc007360 con 0x7f10dc06cb00 2023-10-08T15:40:05.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.455+0000 7f10c2ffd700 1 -- 172.21.15.3:0/2292324054 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10cc0074c0 con 0x7f10dc06cb00 2023-10-08T15:40:05.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.455+0000 7f10dbfff700 1 -- 172.21.15.3:0/2292324054 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10dc14a320 con 0x7f10dc06cb00 2023-10-08T15:40:05.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.455+0000 7f10c2ffd700 1 -- 172.21.15.3:0/2292324054 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10cc004830 con 0x7f10dc06cb00 2023-10-08T15:40:05.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.455+0000 7f10dbfff700 1 -- 172.21.15.3:0/2292324054 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10dc152c00 con 0x7f10dc06cb00 2023-10-08T15:40:05.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.455+0000 7f10dbfff700 1 -- 172.21.15.3:0/2292324054 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10dc06f240 con 0x7f10dc06cb00 2023-10-08T15:40:05.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.459+0000 7f10c2ffd700 1 -- 172.21.15.3:0/2292324054 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f10cc004ba0 con 0x7f10dc06cb00 2023-10-08T15:40:05.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.459+0000 7f10c2ffd700 1 --2- 172.21.15.3:0/2292324054 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f10c8060580 0x7f10c8062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:05.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.459+0000 7f10c2ffd700 1 -- 172.21.15.3:0/2292324054 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5353+0+0 (secure 0 0 0) 0x7f10cc07b700 con 0x7f10dc06cb00 2023-10-08T15:40:05.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.459+0000 7f10daffd700 1 --2- 172.21.15.3:0/2292324054 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f10c8060580 0x7f10c8062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:05.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.459+0000 7f10daffd700 1 --2- 172.21.15.3:0/2292324054 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f10c8060580 0x7f10c8062a30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f10d4011740 tx=0x7f10d400b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:05.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.467+0000 7f10c2ffd700 1 -- 172.21.15.3:0/2292324054 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f10cc04f8e0 con 0x7f10dc06cb00 2023-10-08T15:40:05.633 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:05.627+0000 7f10dbfff700 1 -- 172.21.15.3:0/2292324054 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f10dc09e040 con 0x7f10dc06cb00 2023-10-08T15:40:06.324 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.319+0000 7f10c2ffd700 1 -- 172.21.15.3:0/2292324054 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v32) v1 ==== 169+0+0 (secure 0 0 0) 0x7f10cc04f470 con 0x7f10dc06cb00 2023-10-08T15:40:06.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.327+0000 7f10dbfff700 1 -- 172.21.15.3:0/2292324054 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f10c8060580 msgr2=0x7f10c8062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:06.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.327+0000 7f10dbfff700 1 --2- 172.21.15.3:0/2292324054 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f10c8060580 0x7f10c8062a30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f10d4011740 tx=0x7f10d400b040 comp rx=0 tx=0).stop 2023-10-08T15:40:06.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.327+0000 7f10dbfff700 1 -- 172.21.15.3:0/2292324054 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f10dc06cb00 msgr2=0x7f10dc162910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:06.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.327+0000 7f10dbfff700 1 --2- 172.21.15.3:0/2292324054 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f10dc06cb00 0x7f10dc162910 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f10cc000c00 tx=0x7f10cc009040 comp rx=0 tx=0).stop 2023-10-08T15:40:06.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.327+0000 7f10dbfff700 1 -- 172.21.15.3:0/2292324054 shutdown_connections 2023-10-08T15:40:06.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.327+0000 7f10dbfff700 1 --2- 172.21.15.3:0/2292324054 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f10c8060580 0x7f10c8062a30 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:06.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.327+0000 7f10dbfff700 1 --2- 172.21.15.3:0/2292324054 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f10dc06cb00 0x7f10dc162910 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:06.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.327+0000 7f10dbfff700 1 --2- 172.21.15.3:0/2292324054 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f10dc149e60 0x7f10dc06c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:06.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.327+0000 7f10dbfff700 1 --2- 172.21.15.3:0/2292324054 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10c4003fe0 0x7f10dc14abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:06.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.327+0000 7f10dbfff700 1 -- 172.21.15.3:0/2292324054 >> 172.21.15.3:0/2292324054 conn(0x7f10dc0bd9d0 msgr2=0x7f10dc0a1790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:06.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.327+0000 7f10dbfff700 1 -- 172.21.15.3:0/2292324054 shutdown_connections 2023-10-08T15:40:06.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.327+0000 7f10dbfff700 1 -- 172.21.15.3:0/2292324054 wait complete. 2023-10-08T15:40:06.335 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'cephfs_data' removed 2023-10-08T15:40:06.349 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-08T15:40:06.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.443+0000 7f5f37fff700 1 Processor -- start 2023-10-08T15:40:06.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.443+0000 7f5f37fff700 1 -- start start 2023-10-08T15:40:06.449 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.443+0000 7f5f37fff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f5f380b30c0 0x7f5f38149540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:06.449 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.443+0000 7f5f37fff700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f380b2760 con 0x7f5f38148a60 2023-10-08T15:40:06.449 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.443+0000 7f5f37fff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f3806c720 con 0x7f5f3806efc0 2023-10-08T15:40:06.449 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.443+0000 7f5f37fff700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f380b6a80 con 0x7f5f380b30c0 2023-10-08T15:40:06.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.447+0000 7f5f36ffd700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f5f38148a60 0x7f5f3806bbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:37476/0 (socket says 172.21.15.3:37476) 2023-10-08T15:40:06.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.447+0000 7f5f36ffd700 1 -- 172.21.15.3:0/1483566546 learned_addr learned my addr 172.21.15.3:0/1483566546 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:40:06.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.447+0000 7f5f377fe700 1 --2- 172.21.15.3:0/1483566546 >> v2:172.21.15.3:3300/0 conn(0x7f5f380b30c0 0x7f5f38149540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:06.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.447+0000 7f5f35ffb700 1 -- 172.21.15.3:0/1483566546 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3078979016 0 0) 0x7f5f380b2760 con 0x7f5f38148a60 2023-10-08T15:40:06.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.447+0000 7f5f35ffb700 1 -- 172.21.15.3:0/1483566546 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f20003570 con 0x7f5f38148a60 2023-10-08T15:40:06.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.447+0000 7f5f35ffb700 1 -- 172.21.15.3:0/1483566546 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 853601119 0 0) 0x7f5f3806c720 con 0x7f5f3806efc0 2023-10-08T15:40:06.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.447+0000 7f5f35ffb700 1 -- 172.21.15.3:0/1483566546 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f380b2760 con 0x7f5f3806efc0 2023-10-08T15:40:06.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.447+0000 7f5f377fe700 1 -- 172.21.15.3:0/1483566546 >> v1:172.21.15.50:6789/0 conn(0x7f5f3806efc0 legacy=0x7f5f38148e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:06.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.447+0000 7f5f35ffb700 1 -- 172.21.15.3:0/1483566546 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3644960917 0 0) 0x7f5f20003570 con 0x7f5f38148a60 2023-10-08T15:40:06.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.447+0000 7f5f377fe700 1 -- 172.21.15.3:0/1483566546 >> v1:172.21.15.3:6789/0 conn(0x7f5f38148a60 legacy=0x7f5f3806bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:06.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.447+0000 7f5f377fe700 1 -- 172.21.15.3:0/1483566546 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f3806ca00 con 0x7f5f380b30c0 2023-10-08T15:40:06.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.447+0000 7f5f377fe700 1 --2- 172.21.15.3:0/1483566546 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5f380b30c0 0x7f5f38149540 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f5f280098e0 tx=0x7f5f280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8050701ac0a04652 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:06.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.447+0000 7f5f35ffb700 1 -- 172.21.15.3:0/1483566546 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f300017f0 con 0x7f5f380b30c0 2023-10-08T15:40:06.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.447+0000 7f5f35ffb700 1 -- 172.21.15.3:0/1483566546 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f28011420 con 0x7f5f380b30c0 2023-10-08T15:40:06.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.447+0000 7f5f35ffb700 1 -- 172.21.15.3:0/1483566546 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f280117c0 con 0x7f5f380b30c0 2023-10-08T15:40:06.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.447+0000 7f5f37fff700 1 -- 172.21.15.3:0/1483566546 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5f380b30c0 msgr2=0x7f5f38149540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:06.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.447+0000 7f5f37fff700 1 --2- 172.21.15.3:0/1483566546 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5f380b30c0 0x7f5f38149540 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f5f280098e0 tx=0x7f5f280091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:06.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.447+0000 7f5f37fff700 1 -- 172.21.15.3:0/1483566546 shutdown_connections 2023-10-08T15:40:06.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.447+0000 7f5f37fff700 1 --2- 172.21.15.3:0/1483566546 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5f380b30c0 0x7f5f38149540 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:06.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.447+0000 7f5f37fff700 1 -- 172.21.15.3:0/1483566546 >> 172.21.15.3:0/1483566546 conn(0x7f5f38067bb0 msgr2=0x7f5f3806e8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:06.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.447+0000 7f5f37fff700 1 -- 172.21.15.3:0/1483566546 shutdown_connections 2023-10-08T15:40:06.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.447+0000 7f5f37fff700 1 -- 172.21.15.3:0/1483566546 wait complete. 2023-10-08T15:40:06.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.451+0000 7f5f37fff700 1 Processor -- start 2023-10-08T15:40:06.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.451+0000 7f5f37fff700 1 -- start start 2023-10-08T15:40:06.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.451+0000 7f5f37fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5f3806efc0 0x7f5f38146f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:06.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.451+0000 7f5f37fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f380b30c0 0x7f5f380b4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:06.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.451+0000 7f5f37fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5f38148a60 0x7f5f3815c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:06.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.451+0000 7f5f37fff700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f380b6180 con 0x7f5f38148a60 2023-10-08T15:40:06.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.451+0000 7f5f37fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f380b5c50 con 0x7f5f380b30c0 2023-10-08T15:40:06.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.451+0000 7f5f37fff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f380be400 con 0x7f5f3806efc0 2023-10-08T15:40:06.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.451+0000 7f5f377fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5f38148a60 0x7f5f3815c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:06.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.451+0000 7f5f36ffd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5f3806efc0 0x7f5f38146f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:06.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.451+0000 7f5f377fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5f38148a60 0x7f5f3815c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52594/0 (socket says 172.21.15.3:52594) 2023-10-08T15:40:06.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.451+0000 7f5f377fe700 1 -- 172.21.15.3:0/3600136165 learned_addr learned my addr 172.21.15.3:0/3600136165 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:06.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.451+0000 7f5f367fc700 1 --2- 172.21.15.3:0/3600136165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f380b30c0 0x7f5f380b4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:06.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.451+0000 7f5f377fe700 1 -- 172.21.15.3:0/3600136165 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5f3806efc0 msgr2=0x7f5f38146f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:06.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.451+0000 7f5f377fe700 1 --2- 172.21.15.3:0/3600136165 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5f3806efc0 0x7f5f38146f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:06.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.451+0000 7f5f377fe700 1 -- 172.21.15.3:0/3600136165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f380b30c0 msgr2=0x7f5f380b4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:06.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.451+0000 7f5f377fe700 1 --2- 172.21.15.3:0/3600136165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f380b30c0 0x7f5f380b4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:06.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.451+0000 7f5f377fe700 1 -- 172.21.15.3:0/3600136165 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f28009420 con 0x7f5f38148a60 2023-10-08T15:40:06.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.451+0000 7f5f377fe700 1 --2- 172.21.15.3:0/3600136165 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5f38148a60 0x7f5f3815c050 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5f280093f0 tx=0x7f5f28016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:06.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.451+0000 7f5f1effd700 1 -- 172.21.15.3:0/3600136165 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2801cc40 con 0x7f5f38148a60 2023-10-08T15:40:06.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.451+0000 7f5f1effd700 1 -- 172.21.15.3:0/3600136165 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f2801cda0 con 0x7f5f38148a60 2023-10-08T15:40:06.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.451+0000 7f5f37fff700 1 -- 172.21.15.3:0/3600136165 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f380be0d0 con 0x7f5f38148a60 2023-10-08T15:40:06.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.451+0000 7f5f1effd700 1 -- 172.21.15.3:0/3600136165 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2801a680 con 0x7f5f38148a60 2023-10-08T15:40:06.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.455+0000 7f5f37fff700 1 -- 172.21.15.3:0/3600136165 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f380b7050 con 0x7f5f38148a60 2023-10-08T15:40:06.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.455+0000 7f5f37fff700 1 -- 172.21.15.3:0/3600136165 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f3805ecf0 con 0x7f5f38148a60 2023-10-08T15:40:06.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.455+0000 7f5f1effd700 1 -- 172.21.15.3:0/3600136165 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5f2801a9f0 con 0x7f5f38148a60 2023-10-08T15:40:06.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.455+0000 7f5f1effd700 1 --2- 172.21.15.3:0/3600136165 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5f24060580 0x7f5f24062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:06.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.455+0000 7f5f1effd700 1 -- 172.21.15.3:0/3600136165 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f5f2807dbc0 con 0x7f5f38148a60 2023-10-08T15:40:06.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.455+0000 7f5f36ffd700 1 --2- 172.21.15.3:0/3600136165 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5f24060580 0x7f5f24062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:06.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.459+0000 7f5f36ffd700 1 --2- 172.21.15.3:0/3600136165 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5f24060580 0x7f5f24062a30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5f30001920 tx=0x7f5f30000f40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:06.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.463+0000 7f5f1effd700 1 -- 172.21.15.3:0/3600136165 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5f2804e4b0 con 0x7f5f38148a60 2023-10-08T15:40:06.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.647+0000 7f5f37fff700 1 -- 172.21.15.3:0/3600136165 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f5f380be540 con 0x7f5f38148a60 2023-10-08T15:40:06.660 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.655+0000 7f5f1effd700 1 -- 172.21.15.3:0/3600136165 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5f28051ad0 con 0x7f5f38148a60 2023-10-08T15:40:06.662 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.659+0000 7f5f37fff700 1 -- 172.21.15.3:0/3600136165 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5f24060580 msgr2=0x7f5f24062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:06.662 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.659+0000 7f5f37fff700 1 --2- 172.21.15.3:0/3600136165 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5f24060580 0x7f5f24062a30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5f30001920 tx=0x7f5f30000f40 comp rx=0 tx=0).stop 2023-10-08T15:40:06.662 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.659+0000 7f5f37fff700 1 -- 172.21.15.3:0/3600136165 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5f38148a60 msgr2=0x7f5f3815c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:06.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.659+0000 7f5f37fff700 1 --2- 172.21.15.3:0/3600136165 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5f38148a60 0x7f5f3815c050 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5f280093f0 tx=0x7f5f28016000 comp rx=0 tx=0).stop 2023-10-08T15:40:06.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.659+0000 7f5f37fff700 1 -- 172.21.15.3:0/3600136165 shutdown_connections 2023-10-08T15:40:06.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.659+0000 7f5f37fff700 1 --2- 172.21.15.3:0/3600136165 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5f24060580 0x7f5f24062a30 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:06.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.659+0000 7f5f37fff700 1 --2- 172.21.15.3:0/3600136165 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5f38148a60 0x7f5f3815c050 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:06.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.659+0000 7f5f37fff700 1 --2- 172.21.15.3:0/3600136165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f380b30c0 0x7f5f380b4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:06.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.659+0000 7f5f37fff700 1 --2- 172.21.15.3:0/3600136165 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5f3806efc0 0x7f5f38146f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:06.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.659+0000 7f5f37fff700 1 -- 172.21.15.3:0/3600136165 >> 172.21.15.3:0/3600136165 conn(0x7f5f38067bb0 msgr2=0x7f5f3814cad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:06.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.659+0000 7f5f37fff700 1 -- 172.21.15.3:0/3600136165 shutdown_connections 2023-10-08T15:40:06.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.659+0000 7f5f37fff700 1 -- 172.21.15.3:0/3600136165 wait complete. 2023-10-08T15:40:06.678 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command' 2023-10-08T15:40:06.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.783+0000 7f244b35c700 1 Processor -- start 2023-10-08T15:40:06.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.783+0000 7f244b35c700 1 -- start start 2023-10-08T15:40:06.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.783+0000 7f244b35c700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f24440670e0 0x7f24440674b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:06.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.783+0000 7f244b35c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f244414d2f0 0x7f24440a0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:06.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.783+0000 7f244b35c700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24440a1440 con 0x7f2444149040 2023-10-08T15:40:06.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.783+0000 7f244b35c700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f244414d810 con 0x7f24440670e0 2023-10-08T15:40:06.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.783+0000 7f244b35c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24440a1900 con 0x7f244414d2f0 2023-10-08T15:40:06.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.787+0000 7f244a35a700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f24440670e0 0x7f24440674b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:06.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.787+0000 7f2449b59700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f2444149040 0x7f244409f800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:47550/0 (socket says 172.21.15.3:47550) 2023-10-08T15:40:06.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.787+0000 7f2449b59700 1 -- 172.21.15.3:0/28372751 learned_addr learned my addr 172.21.15.3:0/28372751 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:40:06.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.787+0000 7f244ab5b700 1 --2- 172.21.15.3:0/28372751 >> v2:172.21.15.50:3300/0 conn(0x7f244414d2f0 0x7f24440a0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:06.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.787+0000 7f244a35a700 1 -- 172.21.15.3:0/28372751 >> v2:172.21.15.50:3300/0 conn(0x7f244414d2f0 msgr2=0x7f24440a0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:06.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.787+0000 7f244a35a700 1 --2- 172.21.15.3:0/28372751 >> v2:172.21.15.50:3300/0 conn(0x7f244414d2f0 0x7f24440a0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:06.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.787+0000 7f244a35a700 1 -- 172.21.15.3:0/28372751 >> v1:172.21.15.3:6789/0 conn(0x7f2444149040 legacy=0x7f244409f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:06.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.787+0000 7f244a35a700 1 -- 172.21.15.3:0/28372751 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24441494f0 con 0x7f24440670e0 2023-10-08T15:40:06.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.787+0000 7f244a35a700 1 --2- 172.21.15.3:0/28372751 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f24440670e0 0x7f24440674b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f24440679f0 tx=0x7f24400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da7434e41caba81f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:06.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.787+0000 7f2449358700 1 -- 172.21.15.3:0/28372751 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2440011630 con 0x7f24440670e0 2023-10-08T15:40:06.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.787+0000 7f2449358700 1 -- 172.21.15.3:0/28372751 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2440011790 con 0x7f24440670e0 2023-10-08T15:40:06.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.787+0000 7f2449358700 1 -- 172.21.15.3:0/28372751 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2440011b30 con 0x7f24440670e0 2023-10-08T15:40:06.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.787+0000 7f244b35c700 1 -- 172.21.15.3:0/28372751 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f24440670e0 msgr2=0x7f24440674b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:06.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.787+0000 7f244b35c700 1 --2- 172.21.15.3:0/28372751 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f24440670e0 0x7f24440674b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f24440679f0 tx=0x7f24400091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:06.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.787+0000 7f244b35c700 1 -- 172.21.15.3:0/28372751 shutdown_connections 2023-10-08T15:40:06.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.787+0000 7f244b35c700 1 --2- 172.21.15.3:0/28372751 >> v2:172.21.15.50:3300/0 conn(0x7f244414d2f0 0x7f24440a0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:06.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.787+0000 7f244b35c700 1 --2- 172.21.15.3:0/28372751 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f24440670e0 0x7f24440674b0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:06.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.787+0000 7f244b35c700 1 -- 172.21.15.3:0/28372751 >> 172.21.15.3:0/28372751 conn(0x7f244406dfb0 msgr2=0x7f244406e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:06.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.787+0000 7f244b35c700 1 -- 172.21.15.3:0/28372751 shutdown_connections 2023-10-08T15:40:06.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.787+0000 7f244b35c700 1 -- 172.21.15.3:0/28372751 wait complete. 2023-10-08T15:40:06.795 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.787+0000 7f244b35c700 1 Processor -- start 2023-10-08T15:40:06.795 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.787+0000 7f244b35c700 1 -- start start 2023-10-08T15:40:06.795 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.787+0000 7f244b35c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f24440670e0 0x7f244415eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:06.795 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.787+0000 7f244b35c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2444149040 0x7f244413ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:06.795 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.791+0000 7f244b35c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f244414d2f0 0x7f2444140510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:06.796 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.791+0000 7f244b35c700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2444144020 con 0x7f2444149040 2023-10-08T15:40:06.796 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.791+0000 7f244b35c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2444140a50 con 0x7f244414d2f0 2023-10-08T15:40:06.796 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.791+0000 7f244b35c700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f244415f420 con 0x7f24440670e0 2023-10-08T15:40:06.796 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.791+0000 7f2449b59700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2444149040 0x7f244413ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:06.796 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.791+0000 7f2449b59700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2444149040 0x7f244413ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36100/0 (socket says 172.21.15.3:36100) 2023-10-08T15:40:06.796 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.791+0000 7f2449b59700 1 -- 172.21.15.3:0/4091620204 learned_addr learned my addr 172.21.15.3:0/4091620204 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:06.796 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.791+0000 7f244a35a700 1 --2- 172.21.15.3:0/4091620204 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f24440670e0 0x7f244415eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:06.796 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.791+0000 7f244ab5b700 1 --2- 172.21.15.3:0/4091620204 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f244414d2f0 0x7f2444140510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:06.796 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.791+0000 7f2449b59700 1 -- 172.21.15.3:0/4091620204 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f24440670e0 msgr2=0x7f244415eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:06.796 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.791+0000 7f2449b59700 1 --2- 172.21.15.3:0/4091620204 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f24440670e0 0x7f244415eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:06.796 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.791+0000 7f2449b59700 1 -- 172.21.15.3:0/4091620204 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f244414d2f0 msgr2=0x7f2444140510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:06.797 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.791+0000 7f2449b59700 1 --2- 172.21.15.3:0/4091620204 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f244414d2f0 0x7f2444140510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:06.797 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.791+0000 7f2449b59700 1 -- 172.21.15.3:0/4091620204 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2440009420 con 0x7f2444149040 2023-10-08T15:40:06.797 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.791+0000 7f2449b59700 1 --2- 172.21.15.3:0/4091620204 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2444149040 0x7f244413ffd0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f243800c5c0 tx=0x7f2438007f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:06.797 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.791+0000 7f24367fc700 1 -- 172.21.15.3:0/4091620204 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2438005b30 con 0x7f2444149040 2023-10-08T15:40:06.797 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.791+0000 7f24367fc700 1 -- 172.21.15.3:0/4091620204 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2438005c90 con 0x7f2444149040 2023-10-08T15:40:06.797 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.791+0000 7f244b35c700 1 -- 172.21.15.3:0/4091620204 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2444143d40 con 0x7f2444149040 2023-10-08T15:40:06.797 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.791+0000 7f24367fc700 1 -- 172.21.15.3:0/4091620204 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2438007320 con 0x7f2444149040 2023-10-08T15:40:06.797 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.791+0000 7f244b35c700 1 -- 172.21.15.3:0/4091620204 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24440bbfe0 con 0x7f2444149040 2023-10-08T15:40:06.798 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.791+0000 7f244b35c700 1 -- 172.21.15.3:0/4091620204 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f244415f5d0 con 0x7f2444149040 2023-10-08T15:40:06.798 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.791+0000 7f24367fc700 1 -- 172.21.15.3:0/4091620204 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f243801c440 con 0x7f2444149040 2023-10-08T15:40:06.798 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.795+0000 7f24367fc700 1 --2- 172.21.15.3:0/4091620204 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f2428060550 0x7f2428062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:06.798 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.795+0000 7f24367fc700 1 -- 172.21.15.3:0/4091620204 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f243807b980 con 0x7f2444149040 2023-10-08T15:40:06.798 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.795+0000 7f244a35a700 1 --2- 172.21.15.3:0/4091620204 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f2428060550 0x7f2428062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:06.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.795+0000 7f244a35a700 1 --2- 172.21.15.3:0/4091620204 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f2428060550 0x7f2428062a00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f24400093f0 tx=0x7f2440017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:06.804 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:06.799+0000 7f24367fc700 1 -- 172.21.15.3:0/4091620204 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f243804c1e0 con 0x7f2444149040 2023-10-08T15:40:07.022 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.019+0000 7f244b35c700 1 -- 172.21.15.3:0/4091620204 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command"]} v 0) v1 -- 0x7f244405ecf0 con 0x7f2444149040 2023-10-08T15:40:07.120 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:40:07.123 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:40:07.125 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:40:07.127 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:40:07.130 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:40:07.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.339+0000 7f24367fc700 1 -- 172.21.15.3:0/4091620204 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command"]}]=0 v125) v1 ==== 139+0+0 (secure 0 0 0) 0x7f243804f800 con 0x7f2444149040 2023-10-08T15:40:07.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.343+0000 7f244b35c700 1 -- 172.21.15.3:0/4091620204 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f2428060550 msgr2=0x7f2428062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:07.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.343+0000 7f244b35c700 1 --2- 172.21.15.3:0/4091620204 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f2428060550 0x7f2428062a00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f24400093f0 tx=0x7f2440017000 comp rx=0 tx=0).stop 2023-10-08T15:40:07.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.343+0000 7f244b35c700 1 -- 172.21.15.3:0/4091620204 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2444149040 msgr2=0x7f244413ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:07.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.343+0000 7f244b35c700 1 --2- 172.21.15.3:0/4091620204 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2444149040 0x7f244413ffd0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f243800c5c0 tx=0x7f2438007f00 comp rx=0 tx=0).stop 2023-10-08T15:40:07.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.343+0000 7f244b35c700 1 -- 172.21.15.3:0/4091620204 shutdown_connections 2023-10-08T15:40:07.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.343+0000 7f244b35c700 1 --2- 172.21.15.3:0/4091620204 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f2428060550 0x7f2428062a00 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:07.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.343+0000 7f244b35c700 1 --2- 172.21.15.3:0/4091620204 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f244414d2f0 0x7f2444140510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:07.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.343+0000 7f244b35c700 1 --2- 172.21.15.3:0/4091620204 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2444149040 0x7f244413ffd0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:07.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.343+0000 7f244b35c700 1 --2- 172.21.15.3:0/4091620204 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f24440670e0 0x7f244415eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:07.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.343+0000 7f244b35c700 1 -- 172.21.15.3:0/4091620204 >> 172.21.15.3:0/4091620204 conn(0x7f244406dfb0 msgr2=0x7f2444147e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:07.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.343+0000 7f244b35c700 1 -- 172.21.15.3:0/4091620204 shutdown_connections 2023-10-08T15:40:07.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.343+0000 7f244b35c700 1 -- 172.21.15.3:0/4091620204 wait complete. 2023-10-08T15:40:07.365 INFO:tasks.cephfs_test_runner:Basic test for checking drop cache command. ... ok 2023-10-08T15:40:07.365 INFO:tasks.cephfs_test_runner:Starting test: test_drop_cache_command_dead (tasks.cephfs.test_misc.TestCacheDrop) Check drop cache command with non-responding client using tell 2023-10-08T15:40:07.365 INFO:tasks.cephfs_test_runner:test_drop_cache_command_dead (tasks.cephfs.test_misc.TestCacheDrop) 2023-10-08T15:40:07.366 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead' 2023-10-08T15:40:07.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.479+0000 7f8f48cb3700 1 Processor -- start 2023-10-08T15:40:07.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.479+0000 7f8f48cb3700 1 -- start start 2023-10-08T15:40:07.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.479+0000 7f8f48cb3700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8f44149040 0x7f8f440674b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:07.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.479+0000 7f8f48cb3700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f440a1440 con 0x7f8f4414d2f0 2023-10-08T15:40:07.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.479+0000 7f8f48cb3700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f441494f0 con 0x7f8f440670e0 2023-10-08T15:40:07.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.479+0000 7f8f48cb3700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f4414d810 con 0x7f8f44149040 2023-10-08T15:40:07.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.483+0000 7f8f43fff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f8f4414d2f0 0x7f8f440a0390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:47564/0 (socket says 172.21.15.3:47564) 2023-10-08T15:40:07.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.483+0000 7f8f43fff700 1 -- 172.21.15.3:0/1641892745 learned_addr learned my addr 172.21.15.3:0/1641892745 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:40:07.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.483+0000 7f8f42ffd700 1 --2- 172.21.15.3:0/1641892745 >> v2:172.21.15.50:3300/0 conn(0x7f8f44149040 0x7f8f440674b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:07.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.483+0000 7f8f427fc700 1 -- 172.21.15.3:0/1641892745 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3383475067 0 0) 0x7f8f441494f0 con 0x7f8f440670e0 2023-10-08T15:40:07.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.483+0000 7f8f427fc700 1 -- 172.21.15.3:0/1641892745 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f30003570 con 0x7f8f440670e0 2023-10-08T15:40:07.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.483+0000 7f8f427fc700 1 -- 172.21.15.3:0/1641892745 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3438072718 0 0) 0x7f8f440a1440 con 0x7f8f4414d2f0 2023-10-08T15:40:07.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.483+0000 7f8f427fc700 1 -- 172.21.15.3:0/1641892745 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f441494f0 con 0x7f8f4414d2f0 2023-10-08T15:40:07.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.483+0000 7f8f427fc700 1 -- 172.21.15.3:0/1641892745 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1172764595 0 0) 0x7f8f441494f0 con 0x7f8f4414d2f0 2023-10-08T15:40:07.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.483+0000 7f8f42ffd700 1 -- 172.21.15.3:0/1641892745 >> v1:172.21.15.50:6789/0 conn(0x7f8f440670e0 legacy=0x7f8f4409f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:07.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.483+0000 7f8f42ffd700 1 -- 172.21.15.3:0/1641892745 >> v1:172.21.15.3:6789/0 conn(0x7f8f4414d2f0 legacy=0x7f8f440a0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:07.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.483+0000 7f8f42ffd700 1 -- 172.21.15.3:0/1641892745 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f441497d0 con 0x7f8f44149040 2023-10-08T15:40:07.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.483+0000 7f8f42ffd700 1 --2- 172.21.15.3:0/1641892745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f44149040 0x7f8f440674b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c009860 tx=0x7f8f2c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57c9c52520364c57 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:07.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.483+0000 7f8f427fc700 1 -- 172.21.15.3:0/1641892745 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c0014e0 con 0x7f8f44149040 2023-10-08T15:40:07.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.483+0000 7f8f427fc700 1 -- 172.21.15.3:0/1641892745 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f2c011420 con 0x7f8f44149040 2023-10-08T15:40:07.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.483+0000 7f8f427fc700 1 -- 172.21.15.3:0/1641892745 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f34001770 con 0x7f8f44149040 2023-10-08T15:40:07.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.483+0000 7f8f48cb3700 1 -- 172.21.15.3:0/1641892745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f44149040 msgr2=0x7f8f440674b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:07.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.483+0000 7f8f48cb3700 1 --2- 172.21.15.3:0/1641892745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f44149040 0x7f8f440674b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c009860 tx=0x7f8f2c0091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:07.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.483+0000 7f8f48cb3700 1 -- 172.21.15.3:0/1641892745 shutdown_connections 2023-10-08T15:40:07.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.483+0000 7f8f48cb3700 1 --2- 172.21.15.3:0/1641892745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f44149040 0x7f8f440674b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:07.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.483+0000 7f8f48cb3700 1 -- 172.21.15.3:0/1641892745 >> 172.21.15.3:0/1641892745 conn(0x7f8f4406dfb0 msgr2=0x7f8f4406e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:07.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.487+0000 7f8f48cb3700 1 -- 172.21.15.3:0/1641892745 shutdown_connections 2023-10-08T15:40:07.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.487+0000 7f8f48cb3700 1 -- 172.21.15.3:0/1641892745 wait complete. 2023-10-08T15:40:07.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.487+0000 7f8f48cb3700 1 Processor -- start 2023-10-08T15:40:07.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.487+0000 7f8f48cb3700 1 -- start start 2023-10-08T15:40:07.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.491+0000 7f8f48cb3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f440670e0 0x7f8f44147d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:07.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.491+0000 7f8f48cb3700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8f44149040 0x7f8f44095d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:07.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.491+0000 7f8f48cb3700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8f4414d2f0 0x7f8f44096290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:07.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.491+0000 7f8f48cb3700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f441474e0 con 0x7f8f4414d2f0 2023-10-08T15:40:07.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.491+0000 7f8f48cb3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f44098d60 con 0x7f8f440670e0 2023-10-08T15:40:07.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.491+0000 7f8f48cb3700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f441482c0 con 0x7f8f44149040 2023-10-08T15:40:07.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.491+0000 7f8f43fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8f4414d2f0 0x7f8f44096290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:07.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.491+0000 7f8f43fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8f4414d2f0 0x7f8f44096290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36110/0 (socket says 172.21.15.3:36110) 2023-10-08T15:40:07.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.491+0000 7f8f42ffd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8f44149040 0x7f8f44095d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:07.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.491+0000 7f8f43fff700 1 -- 172.21.15.3:0/84523482 learned_addr learned my addr 172.21.15.3:0/84523482 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:07.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.491+0000 7f8f437fe700 1 --2- 172.21.15.3:0/84523482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f440670e0 0x7f8f44147d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:07.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.491+0000 7f8f43fff700 1 -- 172.21.15.3:0/84523482 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8f44149040 msgr2=0x7f8f44095d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:07.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.491+0000 7f8f43fff700 1 --2- 172.21.15.3:0/84523482 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8f44149040 0x7f8f44095d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:07.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.491+0000 7f8f43fff700 1 -- 172.21.15.3:0/84523482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f440670e0 msgr2=0x7f8f44147d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:07.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.491+0000 7f8f43fff700 1 --2- 172.21.15.3:0/84523482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f440670e0 0x7f8f44147d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:07.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.491+0000 7f8f43fff700 1 -- 172.21.15.3:0/84523482 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f2c009420 con 0x7f8f4414d2f0 2023-10-08T15:40:07.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.491+0000 7f8f43fff700 1 --2- 172.21.15.3:0/84523482 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8f4414d2f0 0x7f8f44096290 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c00c820 tx=0x7f8f3c0015d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:07.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.491+0000 7f8f3b7fe700 1 -- 172.21.15.3:0/84523482 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c007360 con 0x7f8f4414d2f0 2023-10-08T15:40:07.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.491+0000 7f8f3b7fe700 1 -- 172.21.15.3:0/84523482 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f3c0074e0 con 0x7f8f4414d2f0 2023-10-08T15:40:07.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.491+0000 7f8f3b7fe700 1 -- 172.21.15.3:0/84523482 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c004880 con 0x7f8f4414d2f0 2023-10-08T15:40:07.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.491+0000 7f8f48cb3700 1 -- 172.21.15.3:0/84523482 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f4415d210 con 0x7f8f4414d2f0 2023-10-08T15:40:07.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.491+0000 7f8f48cb3700 1 -- 172.21.15.3:0/84523482 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f4415cde0 con 0x7f8f4414d2f0 2023-10-08T15:40:07.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.495+0000 7f8f3b7fe700 1 -- 172.21.15.3:0/84523482 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f8f3c004c10 con 0x7f8f4414d2f0 2023-10-08T15:40:07.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.495+0000 7f8f48cb3700 1 -- 172.21.15.3:0/84523482 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f440bd200 con 0x7f8f4414d2f0 2023-10-08T15:40:07.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.495+0000 7f8f3b7fe700 1 --2- 172.21.15.3:0/84523482 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8f24060580 0x7f8f24062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:07.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.495+0000 7f8f3b7fe700 1 -- 172.21.15.3:0/84523482 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f8f3c07c2b0 con 0x7f8f4414d2f0 2023-10-08T15:40:07.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.495+0000 7f8f437fe700 1 --2- 172.21.15.3:0/84523482 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8f24060580 0x7f8f24062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:07.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.495+0000 7f8f437fe700 1 --2- 172.21.15.3:0/84523482 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8f24060580 0x7f8f24062a30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8f34007fd0 tx=0x7f8f34009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:07.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.499+0000 7f8f3b7fe700 1 -- 172.21.15.3:0/84523482 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8f440bd200 con 0x7f8f4414d2f0 2023-10-08T15:40:07.725 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:07.719+0000 7f8f48cb3700 1 -- 172.21.15.3:0/84523482 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead"]} v 0) v1 -- 0x7f8f4405ed40 con 0x7f8f4414d2f0 2023-10-08T15:40:08.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.343+0000 7f8f3b7fe700 1 -- 172.21.15.3:0/84523482 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead"]}]=0 v126) v1 ==== 147+0+0 (secure 0 0 0) 0x7f8f3c04cba0 con 0x7f8f4414d2f0 2023-10-08T15:40:08.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.347+0000 7f8f48cb3700 1 -- 172.21.15.3:0/84523482 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8f24060580 msgr2=0x7f8f24062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:08.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.347+0000 7f8f48cb3700 1 --2- 172.21.15.3:0/84523482 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8f24060580 0x7f8f24062a30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8f34007fd0 tx=0x7f8f34009040 comp rx=0 tx=0).stop 2023-10-08T15:40:08.352 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.347+0000 7f8f48cb3700 1 -- 172.21.15.3:0/84523482 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8f4414d2f0 msgr2=0x7f8f44096290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:08.352 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.347+0000 7f8f48cb3700 1 --2- 172.21.15.3:0/84523482 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8f4414d2f0 0x7f8f44096290 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c00c820 tx=0x7f8f3c0015d0 comp rx=0 tx=0).stop 2023-10-08T15:40:08.352 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.347+0000 7f8f48cb3700 1 -- 172.21.15.3:0/84523482 shutdown_connections 2023-10-08T15:40:08.352 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.347+0000 7f8f48cb3700 1 --2- 172.21.15.3:0/84523482 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8f24060580 0x7f8f24062a30 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:08.352 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.347+0000 7f8f48cb3700 1 --2- 172.21.15.3:0/84523482 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8f4414d2f0 0x7f8f44096290 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:08.352 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.347+0000 7f8f48cb3700 1 --2- 172.21.15.3:0/84523482 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8f44149040 0x7f8f44095d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:08.352 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.347+0000 7f8f48cb3700 1 --2- 172.21.15.3:0/84523482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f440670e0 0x7f8f44147d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:08.352 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.347+0000 7f8f48cb3700 1 -- 172.21.15.3:0/84523482 >> 172.21.15.3:0/84523482 conn(0x7f8f4406dfb0 msgr2=0x7f8f440be460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:08.352 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.347+0000 7f8f48cb3700 1 -- 172.21.15.3:0/84523482 shutdown_connections 2023-10-08T15:40:08.352 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.347+0000 7f8f48cb3700 1 -- 172.21.15.3:0/84523482 wait complete. 2023-10-08T15:40:08.370 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-08T15:40:08.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.491+0000 7f691bfff700 1 Processor -- start 2023-10-08T15:40:08.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.491+0000 7f691bfff700 1 -- start start 2023-10-08T15:40:08.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.491+0000 7f691bfff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f691c09f8f0 0x7f691c148d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:08.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.491+0000 7f691bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f691c0a01d0 0x7f691c06dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:08.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.491+0000 7f691bfff700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f691c149d50 con 0x7f691c148980 2023-10-08T15:40:08.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.491+0000 7f691bfff700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f691c14a4c0 con 0x7f691c09f8f0 2023-10-08T15:40:08.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.491+0000 7f691bfff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f691c14a030 con 0x7f691c0a01d0 2023-10-08T15:40:08.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.491+0000 7f691a7fc700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f691c09f8f0 0x7f691c148d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:08.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.491+0000 7f691affd700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f691c148980 0x7f691c0bad60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:47570/0 (socket says 172.21.15.3:47570) 2023-10-08T15:40:08.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.491+0000 7f691affd700 1 -- 172.21.15.3:0/2750738855 learned_addr learned my addr 172.21.15.3:0/2750738855 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:40:08.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.491+0000 7f691b7fe700 1 --2- 172.21.15.3:0/2750738855 >> v2:172.21.15.50:3300/0 conn(0x7f691c0a01d0 0x7f691c06dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:08.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.495+0000 7f691a7fc700 1 -- 172.21.15.3:0/2750738855 >> v2:172.21.15.50:3300/0 conn(0x7f691c0a01d0 msgr2=0x7f691c06dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:08.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.495+0000 7f691a7fc700 1 --2- 172.21.15.3:0/2750738855 >> v2:172.21.15.50:3300/0 conn(0x7f691c0a01d0 0x7f691c06dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:08.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.495+0000 7f691a7fc700 1 -- 172.21.15.3:0/2750738855 >> v1:172.21.15.3:6789/0 conn(0x7f691c148980 legacy=0x7f691c0bad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:08.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.495+0000 7f691a7fc700 1 -- 172.21.15.3:0/2750738855 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f691c0ba280 con 0x7f691c09f8f0 2023-10-08T15:40:08.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.495+0000 7f691b7fe700 1 --2- 172.21.15.3:0/2750738855 >> v2:172.21.15.50:3300/0 conn(0x7f691c0a01d0 0x7f691c06dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:40:08.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.495+0000 7f691a7fc700 1 --2- 172.21.15.3:0/2750738855 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f691c09f8f0 0x7f691c148d50 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f691c0a0840 tx=0x7f690c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=761f5b9a30f24b92 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:08.501 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.495+0000 7f6919ffb700 1 -- 172.21.15.3:0/2750738855 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690c00b6b0 con 0x7f691c09f8f0 2023-10-08T15:40:08.501 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.495+0000 7f6919ffb700 1 -- 172.21.15.3:0/2750738855 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f690c00b810 con 0x7f691c09f8f0 2023-10-08T15:40:08.501 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.495+0000 7f6919ffb700 1 -- 172.21.15.3:0/2750738855 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690c00bbb0 con 0x7f691c09f8f0 2023-10-08T15:40:08.502 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.495+0000 7f691bfff700 1 -- 172.21.15.3:0/2750738855 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f691c09f8f0 msgr2=0x7f691c148d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:08.502 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.495+0000 7f691bfff700 1 --2- 172.21.15.3:0/2750738855 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f691c09f8f0 0x7f691c148d50 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f691c0a0840 tx=0x7f690c0091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:08.502 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.495+0000 7f691bfff700 1 -- 172.21.15.3:0/2750738855 shutdown_connections 2023-10-08T15:40:08.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.495+0000 7f691bfff700 1 --2- 172.21.15.3:0/2750738855 >> v2:172.21.15.50:3300/0 conn(0x7f691c0a01d0 0x7f691c06dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:08.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.495+0000 7f691bfff700 1 --2- 172.21.15.3:0/2750738855 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f691c09f8f0 0x7f691c148d50 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:08.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.495+0000 7f691bfff700 1 -- 172.21.15.3:0/2750738855 >> 172.21.15.3:0/2750738855 conn(0x7f691c067b70 msgr2=0x7f691c0ba650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:08.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.495+0000 7f691bfff700 1 -- 172.21.15.3:0/2750738855 shutdown_connections 2023-10-08T15:40:08.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.495+0000 7f691bfff700 1 -- 172.21.15.3:0/2750738855 wait complete. 2023-10-08T15:40:08.505 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.495+0000 7f691bfff700 1 Processor -- start 2023-10-08T15:40:08.505 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.499+0000 7f691bfff700 1 -- start start 2023-10-08T15:40:08.505 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.499+0000 7f691bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f691c09f8f0 0x7f691c14ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:08.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.499+0000 7f691bfff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f691c0a01d0 0x7f691c15d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:08.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.499+0000 7f691bfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f691c148980 0x7f691c15c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:08.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.499+0000 7f691bfff700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f691c15d5c0 con 0x7f691c148980 2023-10-08T15:40:08.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.499+0000 7f691bfff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f691c15cdb0 con 0x7f691c09f8f0 2023-10-08T15:40:08.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.499+0000 7f691bfff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f691c159ce0 con 0x7f691c0a01d0 2023-10-08T15:40:08.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.499+0000 7f691b7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f691c148980 0x7f691c15c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:08.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.499+0000 7f691affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f691c09f8f0 0x7f691c14ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:08.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.499+0000 7f691a7fc700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f691c0a01d0 0x7f691c15d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:08.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.499+0000 7f691affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f691c09f8f0 0x7f691c14ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.3:51170/0 (socket says 172.21.15.3:51170) 2023-10-08T15:40:08.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.499+0000 7f691b7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f691c148980 0x7f691c15c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36126/0 (socket says 172.21.15.3:36126) 2023-10-08T15:40:08.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.499+0000 7f691a7fc700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f691c0a01d0 0x7f691c15d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.3:48610/0 (socket says 172.21.15.3:48610) 2023-10-08T15:40:08.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.499+0000 7f691affd700 1 -- 172.21.15.3:0/2685682926 learned_addr learned my addr 172.21.15.3:0/2685682926 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:08.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.499+0000 7f691affd700 1 -- 172.21.15.3:0/2685682926 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f691c0a01d0 msgr2=0x7f691c15d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:08.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.499+0000 7f691affd700 1 --2- 172.21.15.3:0/2685682926 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f691c0a01d0 0x7f691c15d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:08.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.499+0000 7f691affd700 1 -- 172.21.15.3:0/2685682926 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f691c148980 msgr2=0x7f691c15c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:08.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.499+0000 7f691affd700 1 --2- 172.21.15.3:0/2685682926 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f691c148980 0x7f691c15c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:08.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.499+0000 7f691affd700 1 -- 172.21.15.3:0/2685682926 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f690c009420 con 0x7f691c09f8f0 2023-10-08T15:40:08.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.499+0000 7f691b7fe700 1 --2- 172.21.15.3:0/2685682926 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f691c148980 0x7f691c15c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:40:08.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.499+0000 7f691affd700 1 --2- 172.21.15.3:0/2685682926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f691c09f8f0 0x7f691c14ddd0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f690400c560 tx=0x7f6904001020 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:08.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.499+0000 7f6912ffd700 1 -- 172.21.15.3:0/2685682926 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6904005b30 con 0x7f691c09f8f0 2023-10-08T15:40:08.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.499+0000 7f6912ffd700 1 -- 172.21.15.3:0/2685682926 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6904005c90 con 0x7f691c09f8f0 2023-10-08T15:40:08.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.499+0000 7f6912ffd700 1 -- 172.21.15.3:0/2685682926 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6904007320 con 0x7f691c09f8f0 2023-10-08T15:40:08.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.499+0000 7f691bfff700 1 -- 172.21.15.3:0/2685682926 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f691c159fc0 con 0x7f691c09f8f0 2023-10-08T15:40:08.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.499+0000 7f691bfff700 1 -- 172.21.15.3:0/2685682926 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f691c097200 con 0x7f691c09f8f0 2023-10-08T15:40:08.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.503+0000 7f691bfff700 1 -- 172.21.15.3:0/2685682926 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f691c159b40 con 0x7f691c09f8f0 2023-10-08T15:40:08.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.503+0000 7f6912ffd700 1 -- 172.21.15.3:0/2685682926 <== mon.1 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f690401b3b0 con 0x7f691c09f8f0 2023-10-08T15:40:08.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.503+0000 7f6912ffd700 1 --2- 172.21.15.3:0/2685682926 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f68fc060550 0x7f68fc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:08.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.507+0000 7f6912ffd700 1 -- 172.21.15.3:0/2685682926 <== mon.1 v2:172.21.15.50:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f690407b830 con 0x7f691c09f8f0 2023-10-08T15:40:08.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.507+0000 7f691a7fc700 1 --2- 172.21.15.3:0/2685682926 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f68fc060550 0x7f68fc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:08.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.507+0000 7f691a7fc700 1 --2- 172.21.15.3:0/2685682926 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f68fc060550 0x7f68fc062a00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f691c09fcf0 tx=0x7f690c017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:08.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.515+0000 7f6912ffd700 1 -- 172.21.15.3:0/2685682926 <== mon.1 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f691c159b40 con 0x7f691c09f8f0 2023-10-08T15:40:08.686 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.683+0000 7f691bfff700 1 -- 172.21.15.3:0/2685682926 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f691c159b40 con 0x7f691c09f8f0 2023-10-08T15:40:08.697 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.695+0000 7f6912ffd700 1 -- 172.21.15.3:0/2685682926 <== mon.1 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f691c159b40 con 0x7f691c09f8f0 2023-10-08T15:40:08.700 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.695+0000 7f691bfff700 1 -- 172.21.15.3:0/2685682926 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f68fc060550 msgr2=0x7f68fc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:08.700 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.695+0000 7f691bfff700 1 --2- 172.21.15.3:0/2685682926 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f68fc060550 0x7f68fc062a00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f691c09fcf0 tx=0x7f690c017000 comp rx=0 tx=0).stop 2023-10-08T15:40:08.700 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.695+0000 7f691bfff700 1 -- 172.21.15.3:0/2685682926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f691c09f8f0 msgr2=0x7f691c14ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:08.701 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.695+0000 7f691bfff700 1 --2- 172.21.15.3:0/2685682926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f691c09f8f0 0x7f691c14ddd0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f690400c560 tx=0x7f6904001020 comp rx=0 tx=0).stop 2023-10-08T15:40:08.701 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.695+0000 7f691bfff700 1 -- 172.21.15.3:0/2685682926 shutdown_connections 2023-10-08T15:40:08.701 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.695+0000 7f691bfff700 1 --2- 172.21.15.3:0/2685682926 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f68fc060550 0x7f68fc062a00 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:08.701 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.695+0000 7f691bfff700 1 --2- 172.21.15.3:0/2685682926 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f691c148980 0x7f691c15c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:08.701 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.695+0000 7f691bfff700 1 --2- 172.21.15.3:0/2685682926 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f691c0a01d0 0x7f691c15d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:08.701 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.695+0000 7f691bfff700 1 --2- 172.21.15.3:0/2685682926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f691c09f8f0 0x7f691c14ddd0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:08.701 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.695+0000 7f691bfff700 1 -- 172.21.15.3:0/2685682926 >> 172.21.15.3:0/2685682926 conn(0x7f691c067b70 msgr2=0x7f691c1480f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:08.701 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.695+0000 7f691bfff700 1 -- 172.21.15.3:0/2685682926 shutdown_connections 2023-10-08T15:40:08.701 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.695+0000 7f691bfff700 1 -- 172.21.15.3:0/2685682926 wait complete. 2023-10-08T15:40:08.717 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T15:40:08.717 DEBUG:teuthology.orchestra.run.smithi003:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T15:40:08.735 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T15:40:08.755 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T15:40:08.775 DEBUG:teuthology.orchestra.run.smithi098:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T15:40:08.796 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T15:40:08.817 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T15:40:08.817 INFO:tasks.cephfs.cephfs_test_case:[, , ] 2023-10-08T15:40:08.817 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:40:08.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.931+0000 7fc619288700 1 Processor -- start 2023-10-08T15:40:08.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.931+0000 7fc619288700 1 -- start start 2023-10-08T15:40:08.935 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.931+0000 7fc619288700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc6140badb0 0x7fc6140bb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:08.935 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.931+0000 7fc619288700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc614149ba0 con 0x7fc61414a030 2023-10-08T15:40:08.935 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.931+0000 7fc619288700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc614149550 con 0x7fc6140b43a0 2023-10-08T15:40:08.935 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.931+0000 7fc619288700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc614149830 con 0x7fc6140badb0 2023-10-08T15:40:08.935 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.931+0000 7fc6137fe700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fc61414a030 0x7fc6140b2960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:47572/0 (socket says 172.21.15.3:47572) 2023-10-08T15:40:08.935 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.931+0000 7fc6137fe700 1 -- 172.21.15.3:0/3448425641 learned_addr learned my addr 172.21.15.3:0/3448425641 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:40:08.935 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.931+0000 7fc612ffd700 1 --2- 172.21.15.3:0/3448425641 >> v2:172.21.15.50:3300/0 conn(0x7fc6140badb0 0x7fc6140bb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:08.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.931+0000 7fc6127fc700 1 -- 172.21.15.3:0/3448425641 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1998698300 0 0) 0x7fc614149ba0 con 0x7fc61414a030 2023-10-08T15:40:08.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.931+0000 7fc6127fc700 1 -- 172.21.15.3:0/3448425641 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5f4003570 con 0x7fc61414a030 2023-10-08T15:40:08.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.931+0000 7fc6127fc700 1 -- 172.21.15.3:0/3448425641 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 787269963 0 0) 0x7fc614149550 con 0x7fc6140b43a0 2023-10-08T15:40:08.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.931+0000 7fc6127fc700 1 -- 172.21.15.3:0/3448425641 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc614149ba0 con 0x7fc6140b43a0 2023-10-08T15:40:08.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.931+0000 7fc6127fc700 1 -- 172.21.15.3:0/3448425641 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3526878256 0 0) 0x7fc5f4003570 con 0x7fc61414a030 2023-10-08T15:40:08.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.931+0000 7fc612ffd700 1 -- 172.21.15.3:0/3448425641 >> v1:172.21.15.50:6789/0 conn(0x7fc6140b43a0 legacy=0x7fc61414d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:08.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.931+0000 7fc612ffd700 1 -- 172.21.15.3:0/3448425641 >> v1:172.21.15.3:6789/0 conn(0x7fc61414a030 legacy=0x7fc6140b2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:08.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.931+0000 7fc612ffd700 1 -- 172.21.15.3:0/3448425641 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6140b3070 con 0x7fc6140badb0 2023-10-08T15:40:08.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.931+0000 7fc612ffd700 1 --2- 172.21.15.3:0/3448425641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6140badb0 0x7fc6140bb180 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc6040098d0 tx=0x7fc604009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd030b6651ba21e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:08.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.931+0000 7fc6127fc700 1 -- 172.21.15.3:0/3448425641 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60c0017f0 con 0x7fc6140badb0 2023-10-08T15:40:08.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.935+0000 7fc6127fc700 1 -- 172.21.15.3:0/3448425641 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc604011420 con 0x7fc6140badb0 2023-10-08T15:40:08.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.935+0000 7fc6127fc700 1 -- 172.21.15.3:0/3448425641 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6040117e0 con 0x7fc6140badb0 2023-10-08T15:40:08.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.935+0000 7fc619288700 1 -- 172.21.15.3:0/3448425641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6140badb0 msgr2=0x7fc6140bb180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:08.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.935+0000 7fc619288700 1 --2- 172.21.15.3:0/3448425641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6140badb0 0x7fc6140bb180 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc6040098d0 tx=0x7fc604009120 comp rx=0 tx=0).stop 2023-10-08T15:40:08.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.935+0000 7fc619288700 1 -- 172.21.15.3:0/3448425641 shutdown_connections 2023-10-08T15:40:08.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.935+0000 7fc619288700 1 --2- 172.21.15.3:0/3448425641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6140badb0 0x7fc6140bb180 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:08.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.935+0000 7fc619288700 1 -- 172.21.15.3:0/3448425641 >> 172.21.15.3:0/3448425641 conn(0x7fc6140be640 msgr2=0x7fc6140ba6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:08.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.935+0000 7fc619288700 1 -- 172.21.15.3:0/3448425641 shutdown_connections 2023-10-08T15:40:08.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.935+0000 7fc619288700 1 -- 172.21.15.3:0/3448425641 wait complete. 2023-10-08T15:40:08.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.935+0000 7fc619288700 1 Processor -- start 2023-10-08T15:40:08.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.935+0000 7fc619288700 1 -- start start 2023-10-08T15:40:08.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.935+0000 7fc619288700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc6140b43a0 0x7fc614068490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:08.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.935+0000 7fc619288700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6140badb0 0x7fc61415be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:08.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.935+0000 7fc619288700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc61414a030 0x7fc614095f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:08.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.935+0000 7fc619288700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc614097ae0 con 0x7fc6140b43a0 2023-10-08T15:40:08.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.935+0000 7fc619288700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61415ba00 con 0x7fc6140badb0 2023-10-08T15:40:08.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.935+0000 7fc619288700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc61415b3f0 con 0x7fc61414a030 2023-10-08T15:40:08.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.935+0000 7fc612ffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc6140b43a0 0x7fc614068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:08.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.935+0000 7fc612ffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc6140b43a0 0x7fc614068490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36128/0 (socket says 172.21.15.3:36128) 2023-10-08T15:40:08.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.935+0000 7fc612ffd700 1 -- 172.21.15.3:0/960973527 learned_addr learned my addr 172.21.15.3:0/960973527 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:08.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.939+0000 7fc6137fe700 1 --2- 172.21.15.3:0/960973527 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc61414a030 0x7fc614095f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:08.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.939+0000 7fc60a7fc700 1 --2- 172.21.15.3:0/960973527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6140badb0 0x7fc61415be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:08.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.939+0000 7fc612ffd700 1 -- 172.21.15.3:0/960973527 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc61414a030 msgr2=0x7fc614095f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:08.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.939+0000 7fc612ffd700 1 --2- 172.21.15.3:0/960973527 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc61414a030 0x7fc614095f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:08.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.939+0000 7fc612ffd700 1 -- 172.21.15.3:0/960973527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6140badb0 msgr2=0x7fc61415be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:08.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.939+0000 7fc612ffd700 1 --2- 172.21.15.3:0/960973527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6140badb0 0x7fc61415be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:08.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.939+0000 7fc612ffd700 1 -- 172.21.15.3:0/960973527 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6040093c0 con 0x7fc6140b43a0 2023-10-08T15:40:08.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.939+0000 7fc612ffd700 1 --2- 172.21.15.3:0/960973527 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc6140b43a0 0x7fc614068490 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc604009ec0 tx=0x7fc604016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:08.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.939+0000 7fc60b7fe700 1 -- 172.21.15.3:0/960973527 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6040090b0 con 0x7fc6140b43a0 2023-10-08T15:40:08.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.939+0000 7fc619288700 1 -- 172.21.15.3:0/960973527 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6140689d0 con 0x7fc6140b43a0 2023-10-08T15:40:08.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.939+0000 7fc60b7fe700 1 -- 172.21.15.3:0/960973527 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc60401cb60 con 0x7fc6140b43a0 2023-10-08T15:40:08.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.939+0000 7fc60b7fe700 1 -- 172.21.15.3:0/960973527 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60401a450 con 0x7fc6140b43a0 2023-10-08T15:40:08.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.939+0000 7fc619288700 1 -- 172.21.15.3:0/960973527 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc61415c3d0 con 0x7fc6140b43a0 2023-10-08T15:40:08.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.939+0000 7fc619288700 1 -- 172.21.15.3:0/960973527 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc614064530 con 0x7fc6140b43a0 2023-10-08T15:40:08.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.939+0000 7fc60b7fe700 1 -- 172.21.15.3:0/960973527 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc60401a880 con 0x7fc6140b43a0 2023-10-08T15:40:08.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.939+0000 7fc60b7fe700 1 --2- 172.21.15.3:0/960973527 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc5f8060550 0x7fc5f8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:08.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.939+0000 7fc60b7fe700 1 -- 172.21.15.3:0/960973527 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fc60407ddd0 con 0x7fc6140b43a0 2023-10-08T15:40:08.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.943+0000 7fc60a7fc700 1 --2- 172.21.15.3:0/960973527 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc5f8060550 0x7fc5f8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:08.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.943+0000 7fc60a7fc700 1 --2- 172.21.15.3:0/960973527 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc5f8060550 0x7fc5f8062a00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc614146300 tx=0x7fc5fc007d30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:08.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:08.951+0000 7fc60b7fe700 1 -- 172.21.15.3:0/960973527 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc60404e6c0 con 0x7fc6140b43a0 2023-10-08T15:40:09.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.143+0000 7fc619288700 1 -- 172.21.15.3:0/960973527 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc61404b600 con 0x7fc6140b43a0 2023-10-08T15:40:09.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.143+0000 7fc60b7fe700 1 -- 172.21.15.3:0/960973527 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+2008 (secure 0 0 0) 0x7fc6040297f0 con 0x7fc6140b43a0 2023-10-08T15:40:09.147 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:40:09.147 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":15,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4736,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3640212670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3640212670},{"type":"v1","addr":"172.21.15.50:6835","nonce":3640212670}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":5274,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6833/591370342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":591370342},{"type":"v1","addr":"172.21.15.3:6833","nonce":591370342}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[]} 2023-10-08T15:40:09.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.147+0000 7fc619288700 1 -- 172.21.15.3:0/960973527 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc5f8060550 msgr2=0x7fc5f8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:09.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.147+0000 7fc619288700 1 --2- 172.21.15.3:0/960973527 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc5f8060550 0x7fc5f8062a00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc614146300 tx=0x7fc5fc007d30 comp rx=0 tx=0).stop 2023-10-08T15:40:09.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.147+0000 7fc619288700 1 -- 172.21.15.3:0/960973527 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc6140b43a0 msgr2=0x7fc614068490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:09.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.147+0000 7fc619288700 1 --2- 172.21.15.3:0/960973527 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc6140b43a0 0x7fc614068490 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc604009ec0 tx=0x7fc604016000 comp rx=0 tx=0).stop 2023-10-08T15:40:09.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.147+0000 7fc619288700 1 -- 172.21.15.3:0/960973527 shutdown_connections 2023-10-08T15:40:09.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.147+0000 7fc619288700 1 --2- 172.21.15.3:0/960973527 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc5f8060550 0x7fc5f8062a00 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:09.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.147+0000 7fc619288700 1 --2- 172.21.15.3:0/960973527 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc61414a030 0x7fc614095f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:09.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.147+0000 7fc619288700 1 --2- 172.21.15.3:0/960973527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6140badb0 0x7fc61415be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:09.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.147+0000 7fc619288700 1 --2- 172.21.15.3:0/960973527 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc6140b43a0 0x7fc614068490 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:09.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.147+0000 7fc619288700 1 -- 172.21.15.3:0/960973527 >> 172.21.15.3:0/960973527 conn(0x7fc6140be640 msgr2=0x7fc614146690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:09.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.147+0000 7fc619288700 1 -- 172.21.15.3:0/960973527 shutdown_connections 2023-10-08T15:40:09.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.147+0000 7fc619288700 1 -- 172.21.15.3:0/960973527 wait complete. 2023-10-08T15:40:09.153 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 15 2023-10-08T15:40:09.166 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-08T15:40:09.166 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-08T15:40:09.167 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-08T15:40:09.167 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T15:40:09.167 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-08T15:40:09.167 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-08T15:40:09.167 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-08T15:40:09.167 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T15:40:09.180 INFO:tasks.ceph.mds.a:Stopped 2023-10-08T15:40:09.180 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-08T15:40:09.182 INFO:tasks.ceph.mds.a:Started 2023-10-08T15:40:09.182 DEBUG:teuthology.parallel:result is None 2023-10-08T15:40:09.183 INFO:tasks.ceph.mds.b:Stopped 2023-10-08T15:40:09.183 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-08T15:40:09.186 INFO:tasks.ceph.mds.b:Started 2023-10-08T15:40:09.186 DEBUG:teuthology.parallel:result is None 2023-10-08T15:40:09.186 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-08T15:40:09.259 INFO:tasks.ceph.mds.a.smithi003.stdout:starting mds.a at 2023-10-08T15:40:09.265 INFO:tasks.ceph.mds.b.smithi050.stdout:starting mds.b at 2023-10-08T15:40:09.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.275+0000 7f2f15a3f700 1 Processor -- start 2023-10-08T15:40:09.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.275+0000 7f2f15a3f700 1 -- start start 2023-10-08T15:40:09.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.275+0000 7f2f15a3f700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f2f100a1fd0 0x7f2f10148330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:09.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.275+0000 7f2f15a3f700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2f1014c6c0 0x7f2f10148870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:09.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.275+0000 7f2f15a3f700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f100b3b10 con 0x7f2f10148db0 2023-10-08T15:40:09.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.275+0000 7f2f15a3f700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f1014b9d0 con 0x7f2f100a1fd0 2023-10-08T15:40:09.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.275+0000 7f2f15a3f700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f1014bbe0 con 0x7f2f1014c6c0 2023-10-08T15:40:09.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.275+0000 7f2f0effd700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f2f100a1fd0 0x7f2f10148330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:09.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.275+0000 7f2f0effd700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f2f100a1fd0 0x7f2f10148330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36154/0 (socket says 172.21.15.3:36154) 2023-10-08T15:40:09.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.275+0000 7f2f0effd700 1 -- 172.21.15.3:0/902676473 learned_addr learned my addr 172.21.15.3:0/902676473 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:09.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.275+0000 7f2f0e7fc700 1 --2- 172.21.15.3:0/902676473 >> v2:172.21.15.50:3300/0 conn(0x7f2f1014c6c0 0x7f2f10148870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:09.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.275+0000 7f2f0effd700 1 -- 172.21.15.3:0/902676473 >> v2:172.21.15.50:3300/0 conn(0x7f2f1014c6c0 msgr2=0x7f2f10148870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:09.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.275+0000 7f2f0effd700 1 --2- 172.21.15.3:0/902676473 >> v2:172.21.15.50:3300/0 conn(0x7f2f1014c6c0 0x7f2f10148870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:09.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.275+0000 7f2f0effd700 1 -- 172.21.15.3:0/902676473 >> v1:172.21.15.50:6789/0 conn(0x7f2f10148db0 legacy=0x7f2f100b1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:09.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.275+0000 7f2f0effd700 1 -- 172.21.15.3:0/902676473 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f1014bec0 con 0x7f2f100a1fd0 2023-10-08T15:40:09.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.275+0000 7f2f0e7fc700 1 --2- 172.21.15.3:0/902676473 >> v2:172.21.15.50:3300/0 conn(0x7f2f1014c6c0 0x7f2f10148870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:40:09.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.279+0000 7f2f0effd700 1 --2- 172.21.15.3:0/902676473 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f100a1fd0 0x7f2f10148330 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2f100bfdf0 tx=0x7f2f00009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4893b1768e8240cc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:09.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.279+0000 7f2f0dffb700 1 -- 172.21.15.3:0/902676473 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0000b7f0 con 0x7f2f100a1fd0 2023-10-08T15:40:09.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.279+0000 7f2f0dffb700 1 -- 172.21.15.3:0/902676473 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f0000b950 con 0x7f2f100a1fd0 2023-10-08T15:40:09.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.279+0000 7f2f0dffb700 1 -- 172.21.15.3:0/902676473 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0000bcf0 con 0x7f2f100a1fd0 2023-10-08T15:40:09.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.279+0000 7f2f15a3f700 1 -- 172.21.15.3:0/902676473 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f100a1fd0 msgr2=0x7f2f10148330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:09.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.279+0000 7f2f15a3f700 1 --2- 172.21.15.3:0/902676473 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f100a1fd0 0x7f2f10148330 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2f100bfdf0 tx=0x7f2f00009250 comp rx=0 tx=0).stop 2023-10-08T15:40:09.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.279+0000 7f2f15a3f700 1 -- 172.21.15.3:0/902676473 shutdown_connections 2023-10-08T15:40:09.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.279+0000 7f2f15a3f700 1 --2- 172.21.15.3:0/902676473 >> v2:172.21.15.50:3300/0 conn(0x7f2f1014c6c0 0x7f2f10148870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:09.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.279+0000 7f2f15a3f700 1 --2- 172.21.15.3:0/902676473 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f100a1fd0 0x7f2f10148330 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:09.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.279+0000 7f2f15a3f700 1 -- 172.21.15.3:0/902676473 >> 172.21.15.3:0/902676473 conn(0x7f2f1006b9b0 msgr2=0x7f2f100681f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:09.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.279+0000 7f2f15a3f700 1 -- 172.21.15.3:0/902676473 shutdown_connections 2023-10-08T15:40:09.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.279+0000 7f2f15a3f700 1 -- 172.21.15.3:0/902676473 wait complete. 2023-10-08T15:40:09.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.279+0000 7f2f15a3f700 1 Processor -- start 2023-10-08T15:40:09.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.279+0000 7f2f15a3f700 1 -- start start 2023-10-08T15:40:09.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.283+0000 7f2f15a3f700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f100a1fd0 0x7f2f1012ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:09.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.283+0000 7f2f15a3f700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2f10148db0 0x7f2f10137d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:09.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.283+0000 7f2f15a3f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f1014c6c0 0x7f2f101382c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:09.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.283+0000 7f2f15a3f700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1006e5e0 con 0x7f2f100a1fd0 2023-10-08T15:40:09.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.283+0000 7f2f15a3f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f100bd270 con 0x7f2f1014c6c0 2023-10-08T15:40:09.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.283+0000 7f2f15a3f700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1014a380 con 0x7f2f10148db0 2023-10-08T15:40:09.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.283+0000 7f2f0effd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f100a1fd0 0x7f2f1012ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:09.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.283+0000 7f2f0effd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f100a1fd0 0x7f2f1012ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36164/0 (socket says 172.21.15.3:36164) 2023-10-08T15:40:09.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.283+0000 7f2f0effd700 1 -- 172.21.15.3:0/1471905231 learned_addr learned my addr 172.21.15.3:0/1471905231 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:09.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.283+0000 7f2f0e7fc700 1 --2- 172.21.15.3:0/1471905231 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2f10148db0 0x7f2f10137d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:09.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.283+0000 7f2f0f7fe700 1 --2- 172.21.15.3:0/1471905231 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f1014c6c0 0x7f2f101382c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:09.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.283+0000 7f2f0effd700 1 -- 172.21.15.3:0/1471905231 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2f10148db0 msgr2=0x7f2f10137d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:09.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.283+0000 7f2f0effd700 1 --2- 172.21.15.3:0/1471905231 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2f10148db0 0x7f2f10137d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:09.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.283+0000 7f2f0effd700 1 -- 172.21.15.3:0/1471905231 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f1014c6c0 msgr2=0x7f2f101382c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:09.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.283+0000 7f2f0effd700 1 --2- 172.21.15.3:0/1471905231 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f1014c6c0 0x7f2f101382c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:09.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.283+0000 7f2f0effd700 1 -- 172.21.15.3:0/1471905231 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f000094f0 con 0x7f2f100a1fd0 2023-10-08T15:40:09.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.283+0000 7f2f0f7fe700 1 --2- 172.21.15.3:0/1471905231 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f1014c6c0 0x7f2f101382c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:40:09.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.283+0000 7f2f0effd700 1 --2- 172.21.15.3:0/1471905231 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f100a1fd0 0x7f2f1012ff40 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2f1006c030 tx=0x7f2f00017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:09.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.283+0000 7f2ef6ffd700 1 -- 172.21.15.3:0/1471905231 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0000bc60 con 0x7f2f100a1fd0 2023-10-08T15:40:09.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.283+0000 7f2ef6ffd700 1 -- 172.21.15.3:0/1471905231 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f0001a630 con 0x7f2f100a1fd0 2023-10-08T15:40:09.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.283+0000 7f2f15a3f700 1 -- 172.21.15.3:0/1471905231 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f1014a660 con 0x7f2f100a1fd0 2023-10-08T15:40:09.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.283+0000 7f2ef6ffd700 1 -- 172.21.15.3:0/1471905231 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0001a9f0 con 0x7f2f100a1fd0 2023-10-08T15:40:09.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.283+0000 7f2f15a3f700 1 -- 172.21.15.3:0/1471905231 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f101498d0 con 0x7f2f100a1fd0 2023-10-08T15:40:09.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.283+0000 7f2ef6ffd700 1 -- 172.21.15.3:0/1471905231 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f2f000253f0 con 0x7f2f100a1fd0 2023-10-08T15:40:09.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.283+0000 7f2f15a3f700 1 -- 172.21.15.3:0/1471905231 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f10064530 con 0x7f2f100a1fd0 2023-10-08T15:40:09.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.287+0000 7f2ef6ffd700 1 --2- 172.21.15.3:0/1471905231 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f2efc060550 0x7f2efc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:09.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.287+0000 7f2ef6ffd700 1 -- 172.21.15.3:0/1471905231 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f2f0007dee0 con 0x7f2f100a1fd0 2023-10-08T15:40:09.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.287+0000 7f2f0e7fc700 1 --2- 172.21.15.3:0/1471905231 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f2efc060550 0x7f2efc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:09.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.287+0000 7f2f0e7fc700 1 --2- 172.21.15.3:0/1471905231 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f2efc060550 0x7f2efc062a00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2f1006e590 tx=0x7f2f04008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:09.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.295+0000 7f2ef6ffd700 1 -- 172.21.15.3:0/1471905231 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2f0004e7d0 con 0x7f2f100a1fd0 2023-10-08T15:40:09.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:09.467+0000 7f2f15a3f700 1 -- 172.21.15.3:0/1471905231 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f2f10149b20 con 0x7f2f100a1fd0 2023-10-08T15:40:10.369 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.363+0000 7f2ef6ffd700 1 -- 172.21.15.3:0/1471905231 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v35) v1 ==== 97+0+0 (secure 0 0 0) 0x7f2f10149b20 con 0x7f2f100a1fd0 2023-10-08T15:40:10.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.367+0000 7f2f15a3f700 1 -- 172.21.15.3:0/1471905231 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f2efc060550 msgr2=0x7f2efc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:10.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.367+0000 7f2f15a3f700 1 --2- 172.21.15.3:0/1471905231 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f2efc060550 0x7f2efc062a00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2f1006e590 tx=0x7f2f04008040 comp rx=0 tx=0).stop 2023-10-08T15:40:10.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.367+0000 7f2f15a3f700 1 -- 172.21.15.3:0/1471905231 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f100a1fd0 msgr2=0x7f2f1012ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:10.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.367+0000 7f2f15a3f700 1 --2- 172.21.15.3:0/1471905231 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f100a1fd0 0x7f2f1012ff40 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2f1006c030 tx=0x7f2f00017000 comp rx=0 tx=0).stop 2023-10-08T15:40:10.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.367+0000 7f2f15a3f700 1 -- 172.21.15.3:0/1471905231 shutdown_connections 2023-10-08T15:40:10.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.367+0000 7f2f15a3f700 1 --2- 172.21.15.3:0/1471905231 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f2efc060550 0x7f2efc062a00 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:10.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.367+0000 7f2f15a3f700 1 --2- 172.21.15.3:0/1471905231 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f1014c6c0 0x7f2f101382c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:10.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.367+0000 7f2f15a3f700 1 --2- 172.21.15.3:0/1471905231 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2f10148db0 0x7f2f10137d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:10.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.367+0000 7f2f15a3f700 1 --2- 172.21.15.3:0/1471905231 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f100a1fd0 0x7f2f1012ff40 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:10.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.367+0000 7f2f15a3f700 1 -- 172.21.15.3:0/1471905231 >> 172.21.15.3:0/1471905231 conn(0x7f2f1006b9b0 msgr2=0x7f2f1013c960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:10.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.367+0000 7f2f15a3f700 1 -- 172.21.15.3:0/1471905231 shutdown_connections 2023-10-08T15:40:10.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.367+0000 7f2f15a3f700 1 -- 172.21.15.3:0/1471905231 wait complete. 2023-10-08T15:40:10.373 INFO:teuthology.orchestra.run.smithi003.stderr: removed all blocklist entries 2023-10-08T15:40:10.388 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-08T15:40:10.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.495+0000 7f52def65700 1 Processor -- start 2023-10-08T15:40:10.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.495+0000 7f52def65700 1 -- start start 2023-10-08T15:40:10.501 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.495+0000 7f52def65700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f52d80bab50 0x7f52d80baf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:10.501 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.495+0000 7f52def65700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f52d806df30 0x7f52d8149970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:10.501 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.495+0000 7f52def65700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f52d8149eb0 0x7f52d814c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:10.501 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.495+0000 7f52def65700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52d8146da0 con 0x7f52d80bab50 2023-10-08T15:40:10.501 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.495+0000 7f52def65700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52d814a330 con 0x7f52d8149eb0 2023-10-08T15:40:10.502 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.495+0000 7f52def65700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d80b4710 con 0x7f52d806df30 2023-10-08T15:40:10.502 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.495+0000 7f52ddf63700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f52d80bab50 0x7f52d80baf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:10.502 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.495+0000 7f52ddf63700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f52d80bab50 0x7f52d80baf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36170/0 (socket says 172.21.15.3:36170) 2023-10-08T15:40:10.502 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.495+0000 7f52ddf63700 1 -- 172.21.15.3:0/111534309 learned_addr learned my addr 172.21.15.3:0/111534309 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:10.502 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.495+0000 7f52de764700 1 --2- 172.21.15.3:0/111534309 >> v2:172.21.15.50:3300/0 conn(0x7f52d8149eb0 0x7f52d814c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:10.502 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.495+0000 7f52dd762700 1 --2- 172.21.15.3:0/111534309 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f52d806df30 0x7f52d8149970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:10.502 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.495+0000 7f52ddf63700 1 -- 172.21.15.3:0/111534309 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f52d806df30 msgr2=0x7f52d8149970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:10.502 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.495+0000 7f52ddf63700 1 --2- 172.21.15.3:0/111534309 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f52d806df30 0x7f52d8149970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:10.502 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.495+0000 7f52ddf63700 1 -- 172.21.15.3:0/111534309 >> v2:172.21.15.50:3300/0 conn(0x7f52d8149eb0 msgr2=0x7f52d814c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:10.502 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.495+0000 7f52ddf63700 1 --2- 172.21.15.3:0/111534309 >> v2:172.21.15.50:3300/0 conn(0x7f52d8149eb0 0x7f52d814c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:10.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.495+0000 7f52ddf63700 1 -- 172.21.15.3:0/111534309 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d80b4050 con 0x7f52d80bab50 2023-10-08T15:40:10.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.499+0000 7f52ddf63700 1 --2- 172.21.15.3:0/111534309 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f52d80bab50 0x7f52d80baf20 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f52d8069590 tx=0x7f52c8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f43564d36a0b2c45 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:10.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.499+0000 7f52dcf61700 1 -- 172.21.15.3:0/111534309 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c800b640 con 0x7f52d80bab50 2023-10-08T15:40:10.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.499+0000 7f52dcf61700 1 -- 172.21.15.3:0/111534309 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c800b7a0 con 0x7f52d80bab50 2023-10-08T15:40:10.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.499+0000 7f52dcf61700 1 -- 172.21.15.3:0/111534309 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c800bb40 con 0x7f52d80bab50 2023-10-08T15:40:10.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.499+0000 7f52def65700 1 -- 172.21.15.3:0/111534309 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f52d80bab50 msgr2=0x7f52d80baf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:10.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.499+0000 7f52def65700 1 --2- 172.21.15.3:0/111534309 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f52d80bab50 0x7f52d80baf20 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f52d8069590 tx=0x7f52c8009250 comp rx=0 tx=0).stop 2023-10-08T15:40:10.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.499+0000 7f52def65700 1 -- 172.21.15.3:0/111534309 shutdown_connections 2023-10-08T15:40:10.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.499+0000 7f52def65700 1 --2- 172.21.15.3:0/111534309 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f52d806df30 0x7f52d8149970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:10.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.499+0000 7f52def65700 1 --2- 172.21.15.3:0/111534309 >> v2:172.21.15.50:3300/0 conn(0x7f52d8149eb0 0x7f52d814c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:10.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.499+0000 7f52def65700 1 --2- 172.21.15.3:0/111534309 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f52d80bab50 0x7f52d80baf20 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:10.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.499+0000 7f52def65700 1 -- 172.21.15.3:0/111534309 >> 172.21.15.3:0/111534309 conn(0x7f52d80be4a0 msgr2=0x7f52d80ba440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:10.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.499+0000 7f52def65700 1 -- 172.21.15.3:0/111534309 shutdown_connections 2023-10-08T15:40:10.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.499+0000 7f52def65700 1 -- 172.21.15.3:0/111534309 wait complete. 2023-10-08T15:40:10.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.499+0000 7f52def65700 1 Processor -- start 2023-10-08T15:40:10.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.499+0000 7f52def65700 1 -- start start 2023-10-08T15:40:10.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.499+0000 7f52def65700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52d806df30 0x7f52d814eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:10.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.499+0000 7f52def65700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f52d80bab50 0x7f52d80b64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:10.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.503+0000 7f52def65700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f52d8149eb0 0x7f52d8145a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:10.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.503+0000 7f52def65700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d815c0b0 con 0x7f52d80bab50 2023-10-08T15:40:10.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.503+0000 7f52def65700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d80b8c20 con 0x7f52d806df30 2023-10-08T15:40:10.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.503+0000 7f52def65700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d80b8610 con 0x7f52d8149eb0 2023-10-08T15:40:10.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.503+0000 7f52dd762700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f52d80bab50 0x7f52d80b64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:10.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.503+0000 7f52dd762700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f52d80bab50 0x7f52d80b64c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36184/0 (socket says 172.21.15.3:36184) 2023-10-08T15:40:10.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.503+0000 7f52dd762700 1 -- 172.21.15.3:0/4196426713 learned_addr learned my addr 172.21.15.3:0/4196426713 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:10.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.503+0000 7f52ddf63700 1 --2- 172.21.15.3:0/4196426713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52d806df30 0x7f52d814eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:10.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.503+0000 7f52de764700 1 --2- 172.21.15.3:0/4196426713 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f52d8149eb0 0x7f52d8145a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:10.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.503+0000 7f52dd762700 1 -- 172.21.15.3:0/4196426713 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f52d8149eb0 msgr2=0x7f52d8145a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:10.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.503+0000 7f52dd762700 1 --2- 172.21.15.3:0/4196426713 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f52d8149eb0 0x7f52d8145a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:10.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.503+0000 7f52dd762700 1 -- 172.21.15.3:0/4196426713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52d806df30 msgr2=0x7f52d814eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:10.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.503+0000 7f52dd762700 1 --2- 172.21.15.3:0/4196426713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52d806df30 0x7f52d814eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:10.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.503+0000 7f52dd762700 1 -- 172.21.15.3:0/4196426713 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c80094f0 con 0x7f52d80bab50 2023-10-08T15:40:10.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.503+0000 7f52dd762700 1 --2- 172.21.15.3:0/4196426713 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f52d80bab50 0x7f52d80b64c0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f52d400ec80 tx=0x7f52d40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:10.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.503+0000 7f52cdffb700 1 -- 172.21.15.3:0/4196426713 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d400c850 con 0x7f52d80bab50 2023-10-08T15:40:10.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.503+0000 7f52cdffb700 1 -- 172.21.15.3:0/4196426713 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52d400c9b0 con 0x7f52d80bab50 2023-10-08T15:40:10.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.503+0000 7f52def65700 1 -- 172.21.15.3:0/4196426713 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52d814f080 con 0x7f52d80bab50 2023-10-08T15:40:10.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.503+0000 7f52cdffb700 1 -- 172.21.15.3:0/4196426713 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d400cd50 con 0x7f52d80bab50 2023-10-08T15:40:10.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.503+0000 7f52def65700 1 -- 172.21.15.3:0/4196426713 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52d815a1a0 con 0x7f52d80bab50 2023-10-08T15:40:10.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.503+0000 7f52def65700 1 -- 172.21.15.3:0/4196426713 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52d80b87d0 con 0x7f52d80bab50 2023-10-08T15:40:10.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.503+0000 7f52cdffb700 1 -- 172.21.15.3:0/4196426713 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f52d4013680 con 0x7f52d80bab50 2023-10-08T15:40:10.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.507+0000 7f52cdffb700 1 --2- 172.21.15.3:0/4196426713 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f52bc060580 0x7f52bc062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:10.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.507+0000 7f52cdffb700 1 -- 172.21.15.3:0/4196426713 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f52d407c6e0 con 0x7f52d80bab50 2023-10-08T15:40:10.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.507+0000 7f52ddf63700 1 --2- 172.21.15.3:0/4196426713 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f52bc060580 0x7f52bc062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:10.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.507+0000 7f52ddf63700 1 --2- 172.21.15.3:0/4196426713 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f52bc060580 0x7f52bc062a30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f52d8069590 tx=0x7f52c8017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:10.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.511+0000 7f52cdffb700 1 -- 172.21.15.3:0/4196426713 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f52d80b87d0 con 0x7f52d80bab50 2023-10-08T15:40:10.740 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.735+0000 7f52def65700 1 -- 172.21.15.3:0/4196426713 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f52d80b87d0 con 0x7f52d80bab50 2023-10-08T15:40:10.741 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.739+0000 7f52cdffb700 1 -- 172.21.15.3:0/4196426713 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) v1 ==== 80+0+4446 (secure 0 0 0) 0x7f52d80b87d0 con 0x7f52d80bab50 2023-10-08T15:40:10.741 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:40:10.741 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2023-10-08T15:40:10.742 INFO:teuthology.orchestra.run.smithi003.stdout: "auth_dump": [ 2023-10-08T15:40:10.742 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:40:10.742 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "mds.a", 2023-10-08T15:40:10.742 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCGzCJlniy3BRAAQseQmhA2EOYYPCLL1hMj/g==", 2023-10-08T15:40:10.742 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:40:10.742 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow", 2023-10-08T15:40:10.742 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow *", 2023-10-08T15:40:10.743 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow *", 2023-10-08T15:40:10.743 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:40:10.743 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:40:10.743 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:40:10.743 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:40:10.743 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "mds.b", 2023-10-08T15:40:10.743 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCGzCJl1lNhCRAA/A3Dz/i7z2OM/Mwr00ZSFg==", 2023-10-08T15:40:10.743 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:40:10.743 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow", 2023-10-08T15:40:10.743 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow *", 2023-10-08T15:40:10.744 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow *", 2023-10-08T15:40:10.744 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:40:10.744 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:40:10.744 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:40:10.744 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:40:10.744 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.0", 2023-10-08T15:40:10.744 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCIzCJl5cInMhAAIWzN1t0FivwbJgXlK5WXCg==", 2023-10-08T15:40:10.744 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:40:10.744 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-10-08T15:40:10.744 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-10-08T15:40:10.744 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:40:10.744 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:40:10.745 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:40:10.745 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:40:10.745 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.1", 2023-10-08T15:40:10.745 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCMzCJlZQwWCBAAzzoTedkZwE7oFh4KXjrWZg==", 2023-10-08T15:40:10.745 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:40:10.745 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-10-08T15:40:10.745 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-10-08T15:40:10.745 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:40:10.745 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:40:10.745 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:40:10.746 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:40:10.746 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.2", 2023-10-08T15:40:10.746 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCPzCJlNZM0DRAAgBBNMGbDp8a6VU+mZCpMvQ==", 2023-10-08T15:40:10.746 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:40:10.746 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-10-08T15:40:10.746 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-10-08T15:40:10.746 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:40:10.747 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:40:10.747 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:40:10.747 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:40:10.747 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.3", 2023-10-08T15:40:10.747 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCSzCJltf1tERAAzUJYRvgmxgEtp/IkRsxqmg==", 2023-10-08T15:40:10.747 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:40:10.747 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-10-08T15:40:10.747 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-10-08T15:40:10.747 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:40:10.747 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:40:10.747 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:40:10.747 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:40:10.748 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.4", 2023-10-08T15:40:10.748 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCVzCJlJb2bOBAAZ4hEdc2vznsMuAZpBZlj6Q==", 2023-10-08T15:40:10.748 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:40:10.748 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-10-08T15:40:10.748 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-10-08T15:40:10.748 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:40:10.748 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:40:10.748 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:40:10.748 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:40:10.748 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.5", 2023-10-08T15:40:10.748 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCZzCJlRu4PAhAAgAt508VAQXQwI2L8QyJsag==", 2023-10-08T15:40:10.748 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:40:10.749 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-10-08T15:40:10.749 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-10-08T15:40:10.749 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:40:10.749 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:40:10.749 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:40:10.749 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:40:10.749 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.6", 2023-10-08T15:40:10.749 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCczCJl+1qsBBAArN1IsbopNLd43wJCb73a/A==", 2023-10-08T15:40:10.749 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:40:10.749 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-10-08T15:40:10.749 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-10-08T15:40:10.749 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:40:10.750 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:40:10.750 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:40:10.750 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:40:10.750 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.7", 2023-10-08T15:40:10.750 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCfzCJlMwQhCRAAv/YJwsTJz1eOHFJA/34fDQ==", 2023-10-08T15:40:10.750 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:40:10.750 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-10-08T15:40:10.750 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-10-08T15:40:10.750 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:40:10.751 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:40:10.751 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:40:10.751 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:40:10.751 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "client.0", 2023-10-08T15:40:10.751 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCGzCJlsNS9DBAAAGWd2+fzzFMSRkr2JgMssw==", 2023-10-08T15:40:10.751 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:40:10.751 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow", 2023-10-08T15:40:10.751 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow r", 2023-10-08T15:40:10.751 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-08T15:40:10.751 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:40:10.751 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:40:10.751 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:40:10.752 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "client.1", 2023-10-08T15:40:10.752 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCGzCJlDRibDxAAgu6Q6umK/yUGAg4R/9Yj+w==", 2023-10-08T15:40:10.752 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:40:10.752 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow", 2023-10-08T15:40:10.752 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow r", 2023-10-08T15:40:10.752 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow rw", 2023-10-08T15:40:10.752 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow rwx" 2023-10-08T15:40:10.752 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:40:10.752 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:40:10.753 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:40:10.753 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "client.2", 2023-10-08T15:40:10.753 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCGzCJlqKuGEhAAUqGYxYztxx87maQJT2LL/g==", 2023-10-08T15:40:10.753 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:40:10.753 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow", 2023-10-08T15:40:10.753 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow r", 2023-10-08T15:40:10.753 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow rw", 2023-10-08T15:40:10.753 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow rwx" 2023-10-08T15:40:10.753 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:40:10.753 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:40:10.754 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:40:10.754 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "client.admin", 2023-10-08T15:40:10.754 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCFzCJltIgDJxAAwtl0Hr7oKzNBMOvXUUnshQ==", 2023-10-08T15:40:10.754 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:40:10.754 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow *", 2023-10-08T15:40:10.754 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow *", 2023-10-08T15:40:10.754 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow *", 2023-10-08T15:40:10.754 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:40:10.754 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:40:10.754 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:40:10.754 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:40:10.754 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "mgr.x", 2023-10-08T15:40:10.755 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCGzCJlrnryAhAAe5CNtQTuBHbbPrdMxY2lqA==", 2023-10-08T15:40:10.755 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:40:10.755 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow *", 2023-10-08T15:40:10.755 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile mgr", 2023-10-08T15:40:10.755 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:40:10.755 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:40:10.755 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:40:10.755 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:40:10.755 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "mgr.y", 2023-10-08T15:40:10.755 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCGzCJl8moPABAAjH5iVWRLyeITsMX/nAZoTQ==", 2023-10-08T15:40:10.755 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:40:10.755 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow *", 2023-10-08T15:40:10.756 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile mgr", 2023-10-08T15:40:10.756 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:40:10.756 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:40:10.756 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:40:10.756 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2023-10-08T15:40:10.756 INFO:teuthology.orchestra.run.smithi003.stdout:} 2023-10-08T15:40:10.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.739+0000 7f52def65700 1 -- 172.21.15.3:0/4196426713 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f52bc060580 msgr2=0x7f52bc062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:10.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.739+0000 7f52def65700 1 --2- 172.21.15.3:0/4196426713 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f52bc060580 0x7f52bc062a30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f52d8069590 tx=0x7f52c8017000 comp rx=0 tx=0).stop 2023-10-08T15:40:10.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.739+0000 7f52def65700 1 -- 172.21.15.3:0/4196426713 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f52d80bab50 msgr2=0x7f52d80b64c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:10.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.739+0000 7f52def65700 1 --2- 172.21.15.3:0/4196426713 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f52d80bab50 0x7f52d80b64c0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f52d400ec80 tx=0x7f52d40091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:10.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.739+0000 7f52def65700 1 -- 172.21.15.3:0/4196426713 shutdown_connections 2023-10-08T15:40:10.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.739+0000 7f52def65700 1 --2- 172.21.15.3:0/4196426713 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f52bc060580 0x7f52bc062a30 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:10.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.739+0000 7f52def65700 1 --2- 172.21.15.3:0/4196426713 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f52d8149eb0 0x7f52d8145a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:10.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.739+0000 7f52def65700 1 --2- 172.21.15.3:0/4196426713 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f52d80bab50 0x7f52d80b64c0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:10.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.739+0000 7f52def65700 1 --2- 172.21.15.3:0/4196426713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52d806df30 0x7f52d814eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:10.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.739+0000 7f52def65700 1 -- 172.21.15.3:0/4196426713 >> 172.21.15.3:0/4196426713 conn(0x7f52d80be4a0 msgr2=0x7f52d80bd100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:10.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.739+0000 7f52def65700 1 -- 172.21.15.3:0/4196426713 shutdown_connections 2023-10-08T15:40:10.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.739+0000 7f52def65700 1 -- 172.21.15.3:0/4196426713 wait complete. 2023-10-08T15:40:10.760 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:40:10.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.859+0000 7f0cff59e700 1 Processor -- start 2023-10-08T15:40:10.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.859+0000 7f0cff59e700 1 -- start start 2023-10-08T15:40:10.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.859+0000 7f0cff59e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0d000bacf0 0x7f0d0006dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:10.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.859+0000 7f0cff59e700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f0d000bb0c0 0x7f0d000b22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:10.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.859+0000 7f0cff59e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d0006d9f0 con 0x7f0d000b1c30 2023-10-08T15:40:10.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.859+0000 7f0cff59e700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d00148170 con 0x7f0d000bb0c0 2023-10-08T15:40:10.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.859+0000 7f0cff59e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d0014c410 con 0x7f0d000bacf0 2023-10-08T15:40:10.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.859+0000 7f0cfdd9b700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f0d000bb0c0 0x7f0d000b22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:10.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.859+0000 7f0cfdd9b700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f0d000bb0c0 0x7f0d000b22b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36194/0 (socket says 172.21.15.3:36194) 2023-10-08T15:40:10.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.859+0000 7f0cfdd9b700 1 -- 172.21.15.3:0/857953713 learned_addr learned my addr 172.21.15.3:0/857953713 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:10.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.859+0000 7f0cfe59c700 1 --2- 172.21.15.3:0/857953713 >> v2:172.21.15.50:3300/0 conn(0x7f0d000bacf0 0x7f0d0006dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:10.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.863+0000 7f0cfdd9b700 1 -- 172.21.15.3:0/857953713 >> v2:172.21.15.50:3300/0 conn(0x7f0d000bacf0 msgr2=0x7f0d0006dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:10.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.863+0000 7f0cfdd9b700 1 --2- 172.21.15.3:0/857953713 >> v2:172.21.15.50:3300/0 conn(0x7f0d000bacf0 0x7f0d0006dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:10.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.863+0000 7f0cfdd9b700 1 -- 172.21.15.3:0/857953713 >> v1:172.21.15.50:6789/0 conn(0x7f0d000b1c30 legacy=0x7f0d00148590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:10.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.863+0000 7f0cfdd9b700 1 -- 172.21.15.3:0/857953713 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d0014c0e0 con 0x7f0d000bb0c0 2023-10-08T15:40:10.867 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.863+0000 7f0cfdd9b700 1 --2- 172.21.15.3:0/857953713 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0d000bb0c0 0x7f0d000b22b0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f0d000bea60 tx=0x7f0cf0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=418274c231764fdf server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:10.868 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.863+0000 7f0cfd59a700 1 -- 172.21.15.3:0/857953713 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf000e070 con 0x7f0d000bb0c0 2023-10-08T15:40:10.868 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.863+0000 7f0cfd59a700 1 -- 172.21.15.3:0/857953713 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf000ba50 con 0x7f0d000bb0c0 2023-10-08T15:40:10.868 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.863+0000 7f0cfd59a700 1 -- 172.21.15.3:0/857953713 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf00092e0 con 0x7f0d000bb0c0 2023-10-08T15:40:10.868 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.863+0000 7f0cff59e700 1 -- 172.21.15.3:0/857953713 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0d000bb0c0 msgr2=0x7f0d000b22b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:10.868 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.863+0000 7f0cff59e700 1 --2- 172.21.15.3:0/857953713 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0d000bb0c0 0x7f0d000b22b0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f0d000bea60 tx=0x7f0cf0009840 comp rx=0 tx=0).stop 2023-10-08T15:40:10.869 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.863+0000 7f0cff59e700 1 -- 172.21.15.3:0/857953713 shutdown_connections 2023-10-08T15:40:10.869 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.863+0000 7f0cff59e700 1 --2- 172.21.15.3:0/857953713 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0d000bb0c0 0x7f0d000b22b0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:10.869 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.863+0000 7f0cff59e700 1 --2- 172.21.15.3:0/857953713 >> v2:172.21.15.50:3300/0 conn(0x7f0d000bacf0 0x7f0d0006dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:10.869 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.863+0000 7f0cff59e700 1 -- 172.21.15.3:0/857953713 >> 172.21.15.3:0/857953713 conn(0x7f0d000be4a0 msgr2=0x7f0d000ba440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:10.869 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.863+0000 7f0cff59e700 1 -- 172.21.15.3:0/857953713 shutdown_connections 2023-10-08T15:40:10.869 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.863+0000 7f0cff59e700 1 -- 172.21.15.3:0/857953713 wait complete. 2023-10-08T15:40:10.869 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.863+0000 7f0cff59e700 1 Processor -- start 2023-10-08T15:40:10.869 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.863+0000 7f0cff59e700 1 -- start start 2023-10-08T15:40:10.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.867+0000 7f0cff59e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0d000b1c30 0x7f0d0006c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:10.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.867+0000 7f0cff59e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0d000bacf0 0x7f0d0006c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:10.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.867+0000 7f0cff59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d000bb0c0 0x7f0d00158e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:10.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.867+0000 7f0cff59e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d00158a40 con 0x7f0d000b1c30 2023-10-08T15:40:10.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.867+0000 7f0cff59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0015ca80 con 0x7f0d000bb0c0 2023-10-08T15:40:10.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.867+0000 7f0cff59e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0015cd60 con 0x7f0d000bacf0 2023-10-08T15:40:10.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.867+0000 7f0cfe59c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0d000b1c30 0x7f0d0006c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:10.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.867+0000 7f0cfe59c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0d000b1c30 0x7f0d0006c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36206/0 (socket says 172.21.15.3:36206) 2023-10-08T15:40:10.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.867+0000 7f0cfe59c700 1 -- 172.21.15.3:0/1015704154 learned_addr learned my addr 172.21.15.3:0/1015704154 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:10.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.867+0000 7f0cfdd9b700 1 --2- 172.21.15.3:0/1015704154 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0d000bacf0 0x7f0d0006c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:10.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.867+0000 7f0cfed9d700 1 --2- 172.21.15.3:0/1015704154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d000bb0c0 0x7f0d00158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:10.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.867+0000 7f0cfe59c700 1 -- 172.21.15.3:0/1015704154 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0d000bacf0 msgr2=0x7f0d0006c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:10.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.867+0000 7f0cfe59c700 1 --2- 172.21.15.3:0/1015704154 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0d000bacf0 0x7f0d0006c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:10.873 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.867+0000 7f0cfe59c700 1 -- 172.21.15.3:0/1015704154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d000bb0c0 msgr2=0x7f0d00158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:10.873 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.867+0000 7f0cfe59c700 1 --2- 172.21.15.3:0/1015704154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d000bb0c0 0x7f0d00158e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:10.873 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.867+0000 7f0cfe59c700 1 -- 172.21.15.3:0/1015704154 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf0009ae0 con 0x7f0d000b1c30 2023-10-08T15:40:10.873 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.867+0000 7f0cfdd9b700 1 --2- 172.21.15.3:0/1015704154 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0d000bacf0 0x7f0d0006c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:40:10.873 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.867+0000 7f0cfed9d700 1 --2- 172.21.15.3:0/1015704154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d000bb0c0 0x7f0d00158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:40:10.873 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.867+0000 7f0cfe59c700 1 --2- 172.21.15.3:0/1015704154 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0d000b1c30 0x7f0d0006c090 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f0cf400d890 tx=0x7f0cf4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:10.873 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.867+0000 7f0cee7fc700 1 -- 172.21.15.3:0/1015704154 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf40125f0 con 0x7f0d000b1c30 2023-10-08T15:40:10.873 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.867+0000 7f0cee7fc700 1 -- 172.21.15.3:0/1015704154 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf4012770 con 0x7f0d000b1c30 2023-10-08T15:40:10.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.867+0000 7f0cee7fc700 1 -- 172.21.15.3:0/1015704154 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf4012b30 con 0x7f0d000b1c30 2023-10-08T15:40:10.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.867+0000 7f0cff59e700 1 -- 172.21.15.3:0/1015704154 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d0013e240 con 0x7f0d000b1c30 2023-10-08T15:40:10.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.867+0000 7f0cff59e700 1 -- 172.21.15.3:0/1015704154 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d0014e450 con 0x7f0d000b1c30 2023-10-08T15:40:10.875 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.867+0000 7f0cff59e700 1 -- 172.21.15.3:0/1015704154 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d0015c8f0 con 0x7f0d000b1c30 2023-10-08T15:40:10.875 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.867+0000 7f0cee7fc700 1 -- 172.21.15.3:0/1015704154 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f0cf401e460 con 0x7f0d000b1c30 2023-10-08T15:40:10.875 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.871+0000 7f0cee7fc700 1 --2- 172.21.15.3:0/1015704154 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f0ce0060550 0x7f0ce0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:10.875 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.871+0000 7f0cee7fc700 1 -- 172.21.15.3:0/1015704154 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f0cf407cc50 con 0x7f0d000b1c30 2023-10-08T15:40:10.875 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.871+0000 7f0cfdd9b700 1 --2- 172.21.15.3:0/1015704154 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f0ce0060550 0x7f0ce0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:10.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.871+0000 7f0cfdd9b700 1 --2- 172.21.15.3:0/1015704154 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f0ce0060550 0x7f0ce0062a00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0d0006cb10 tx=0x7f0cf0018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:10.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:10.875+0000 7f0cee7fc700 1 -- 172.21.15.3:0/1015704154 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0cf404d4f0 con 0x7f0d000b1c30 2023-10-08T15:40:11.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.035+0000 7f0cff59e700 1 -- 172.21.15.3:0/1015704154 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0d00159ba0 con 0x7f0d000b1c30 2023-10-08T15:40:11.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.039+0000 7f0cee7fc700 1 -- 172.21.15.3:0/1015704154 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+12038 (secure 0 0 0) 0x7f0d00159ba0 con 0x7f0d000b1c30 2023-10-08T15:40:11.043 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:40:11.043 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":35,"fsid":"7635972e-cd66-4a8f-a231-378db8b3847a","created":"2023-10-08T15:37:08.234594+0000","modified":"2023-10-08T15:40:10.353091+0000","last_up_change":"2023-10-08T15:37:17.537726+0000","last_in_change":"2023-10-08T15:37:10.269178+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:37:16.581590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"64fb1864-bfdd-4d75-9b41-03fb60085dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33363},{"type":"v1","addr":"172.21.15.3:6801","nonce":33363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33363},{"type":"v1","addr":"172.21.15.3:6803","nonce":33363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":33363},{"type":"v1","addr":"172.21.15.3:6807","nonce":33363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33363},{"type":"v1","addr":"172.21.15.3:6805","nonce":33363}]},"public_addr":"172.21.15.3:6801/33363","cluster_addr":"172.21.15.3:6803/33363","heartbeat_back_addr":"172.21.15.3:6807/33363","heartbeat_front_addr":"172.21.15.3:6805/33363","state":["exists","up"]},{"osd":1,"uuid":"3ca6bd3a-3e8a-4c65-af9c-46148b0c2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33364},{"type":"v1","addr":"172.21.15.3:6820","nonce":33364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33364},{"type":"v1","addr":"172.21.15.3:6824","nonce":33364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33364},{"type":"v1","addr":"172.21.15.3:6831","nonce":33364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33364},{"type":"v1","addr":"172.21.15.3:6828","nonce":33364}]},"public_addr":"172.21.15.3:6820/33364","cluster_addr":"172.21.15.3:6824/33364","heartbeat_back_addr":"172.21.15.3:6831/33364","heartbeat_front_addr":"172.21.15.3:6828/33364","state":["exists","up"]},{"osd":2,"uuid":"6eb9f757-58dd-442f-910d-32401454bce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33366},{"type":"v1","addr":"172.21.15.3:6817","nonce":33366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":33366},{"type":"v1","addr":"172.21.15.3:6821","nonce":33366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6827","nonce":33366},{"type":"v1","addr":"172.21.15.3:6829","nonce":33366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":33366},{"type":"v1","addr":"172.21.15.3:6825","nonce":33366}]},"public_addr":"172.21.15.3:6817/33366","cluster_addr":"172.21.15.3:6821/33366","heartbeat_back_addr":"172.21.15.3:6829/33366","heartbeat_front_addr":"172.21.15.3:6825/33366","state":["exists","up"]},{"osd":3,"uuid":"1c39866b-ac2e-4ea9-a69c-02b01ee4191d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33365},{"type":"v1","addr":"172.21.15.3:6809","nonce":33365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":33365},{"type":"v1","addr":"172.21.15.3:6811","nonce":33365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33365},{"type":"v1","addr":"172.21.15.3:6815","nonce":33365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":33365},{"type":"v1","addr":"172.21.15.3:6813","nonce":33365}]},"public_addr":"172.21.15.3:6809/33365","cluster_addr":"172.21.15.3:6811/33365","heartbeat_back_addr":"172.21.15.3:6815/33365","heartbeat_front_addr":"172.21.15.3:6813/33365","state":["exists","up"]},{"osd":4,"uuid":"15f86b61-b7f1-4780-ae00-9d80a68cb830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":33605},{"type":"v1","addr":"172.21.15.50:6809","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33605},{"type":"v1","addr":"172.21.15.50:6811","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33605},{"type":"v1","addr":"172.21.15.50:6815","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":33605},{"type":"v1","addr":"172.21.15.50:6813","nonce":33605}]},"public_addr":"172.21.15.50:6809/33605","cluster_addr":"172.21.15.50:6811/33605","heartbeat_back_addr":"172.21.15.50:6815/33605","heartbeat_front_addr":"172.21.15.50:6813/33605","state":["exists","up"]},{"osd":5,"uuid":"726c3003-34e6-4d5a-b6e2-f911e13c2118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33606},{"type":"v1","addr":"172.21.15.50:6801","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33606},{"type":"v1","addr":"172.21.15.50:6803","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33606},{"type":"v1","addr":"172.21.15.50:6807","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":33606},{"type":"v1","addr":"172.21.15.50:6805","nonce":33606}]},"public_addr":"172.21.15.50:6801/33606","cluster_addr":"172.21.15.50:6803/33606","heartbeat_back_addr":"172.21.15.50:6807/33606","heartbeat_front_addr":"172.21.15.50:6805/33606","state":["exists","up"]},{"osd":6,"uuid":"401122a4-9988-441f-a5a7-39164434ebcd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":33607},{"type":"v1","addr":"172.21.15.50:6819","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":33607},{"type":"v1","addr":"172.21.15.50:6823","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":33607},{"type":"v1","addr":"172.21.15.50:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":33607},{"type":"v1","addr":"172.21.15.50:6827","nonce":33607}]},"public_addr":"172.21.15.50:6819/33607","cluster_addr":"172.21.15.50:6823/33607","heartbeat_back_addr":"172.21.15.50:6831/33607","heartbeat_front_addr":"172.21.15.50:6827/33607","state":["exists","up"]},{"osd":7,"uuid":"6b3fa236-c9d0-4c4d-82ae-9af4daf6d699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33604},{"type":"v1","addr":"172.21.15.50:6818","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":33604},{"type":"v1","addr":"172.21.15.50:6822","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":33604},{"type":"v1","addr":"172.21.15.50:6830","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":33604},{"type":"v1","addr":"172.21.15.50:6826","nonce":33604}]},"public_addr":"172.21.15.50:6818/33604","cluster_addr":"172.21.15.50:6822/33604","heartbeat_back_addr":"172.21.15.50:6830/33604","heartbeat_front_addr":"172.21.15.50:6826/33604","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.497794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.529417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.873426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.325972+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.443971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.240795+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.739632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.643026+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:40:11.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.039+0000 7f0cff59e700 1 -- 172.21.15.3:0/1015704154 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f0ce0060550 msgr2=0x7f0ce0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:11.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.039+0000 7f0cff59e700 1 --2- 172.21.15.3:0/1015704154 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f0ce0060550 0x7f0ce0062a00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0d0006cb10 tx=0x7f0cf0018000 comp rx=0 tx=0).stop 2023-10-08T15:40:11.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.039+0000 7f0cff59e700 1 -- 172.21.15.3:0/1015704154 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0d000b1c30 msgr2=0x7f0d0006c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:11.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.039+0000 7f0cff59e700 1 --2- 172.21.15.3:0/1015704154 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0d000b1c30 0x7f0d0006c090 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f0cf400d890 tx=0x7f0cf4008040 comp rx=0 tx=0).stop 2023-10-08T15:40:11.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.043+0000 7f0cff59e700 1 -- 172.21.15.3:0/1015704154 shutdown_connections 2023-10-08T15:40:11.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.043+0000 7f0cff59e700 1 --2- 172.21.15.3:0/1015704154 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f0ce0060550 0x7f0ce0062a00 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:11.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.043+0000 7f0cff59e700 1 --2- 172.21.15.3:0/1015704154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d000bb0c0 0x7f0d00158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:11.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.043+0000 7f0cff59e700 1 --2- 172.21.15.3:0/1015704154 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0d000bacf0 0x7f0d0006c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:11.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.043+0000 7f0cff59e700 1 --2- 172.21.15.3:0/1015704154 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0d000b1c30 0x7f0d0006c090 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:11.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.043+0000 7f0cff59e700 1 -- 172.21.15.3:0/1015704154 >> 172.21.15.3:0/1015704154 conn(0x7f0d000be4a0 msgr2=0x7f0d001401f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:11.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.043+0000 7f0cff59e700 1 -- 172.21.15.3:0/1015704154 shutdown_connections 2023-10-08T15:40:11.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.043+0000 7f0cff59e700 1 -- 172.21.15.3:0/1015704154 wait complete. 2023-10-08T15:40:11.058 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T15:37:16.581590+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-08T15:40:11.058 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T15:40:11.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.167+0000 7fd815bb9700 1 Processor -- start 2023-10-08T15:40:11.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.167+0000 7fd815bb9700 1 -- start start 2023-10-08T15:40:11.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.171+0000 7fd815bb9700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd8100a0d30 0x7fd81014d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:11.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.171+0000 7fd815bb9700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8100b22b0 con 0x7fd8100beb80 2023-10-08T15:40:11.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.171+0000 7fd815bb9700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd810069de0 con 0x7fd810068d00 2023-10-08T15:40:11.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.171+0000 7fd815bb9700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8100b28e0 con 0x7fd8100a0d30 2023-10-08T15:40:11.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.171+0000 7fd814bb7700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fd8100beb80 0x7fd81014c9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:47576/0 (socket says 172.21.15.3:47576) 2023-10-08T15:40:11.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.171+0000 7fd814bb7700 1 -- 172.21.15.3:0/2879331456 learned_addr learned my addr 172.21.15.3:0/2879331456 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:40:11.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.171+0000 7fd807fff700 1 --2- 172.21.15.3:0/2879331456 >> v2:172.21.15.50:3300/0 conn(0x7fd8100a0d30 0x7fd81014d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:11.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.171+0000 7fd8077fe700 1 -- 172.21.15.3:0/2879331456 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 531416703 0 0) 0x7fd8100b22b0 con 0x7fd8100beb80 2023-10-08T15:40:11.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.171+0000 7fd8077fe700 1 -- 172.21.15.3:0/2879331456 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7f8003570 con 0x7fd8100beb80 2023-10-08T15:40:11.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.171+0000 7fd807fff700 1 -- 172.21.15.3:0/2879331456 >> v1:172.21.15.50:6789/0 conn(0x7fd810068d00 legacy=0x7fd8101482c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:11.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.171+0000 7fd807fff700 1 -- 172.21.15.3:0/2879331456 >> v1:172.21.15.3:6789/0 conn(0x7fd8100beb80 legacy=0x7fd81014c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:11.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.171+0000 7fd8077fe700 1 -- 172.21.15.3:0/2879331456 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1881109256 0 0) 0x7fd7f8003570 con 0x7fd8100beb80 2023-10-08T15:40:11.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.171+0000 7fd807fff700 1 -- 172.21.15.3:0/2879331456 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8100b1f80 con 0x7fd8100a0d30 2023-10-08T15:40:11.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.171+0000 7fd807fff700 1 --2- 172.21.15.3:0/2879331456 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8100a0d30 0x7fd81014d0d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd8000098e0 tx=0x7fd8000091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44c6bcdb1417f573 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:11.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.171+0000 7fd8077fe700 1 -- 172.21.15.3:0/2879331456 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80c001470 con 0x7fd8100a0d30 2023-10-08T15:40:11.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.171+0000 7fd8077fe700 1 -- 172.21.15.3:0/2879331456 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd800011420 con 0x7fd8100a0d30 2023-10-08T15:40:11.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.171+0000 7fd8077fe700 1 -- 172.21.15.3:0/2879331456 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8000117c0 con 0x7fd8100a0d30 2023-10-08T15:40:11.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.171+0000 7fd815bb9700 1 -- 172.21.15.3:0/2879331456 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8100a0d30 msgr2=0x7fd81014d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:11.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.171+0000 7fd815bb9700 1 --2- 172.21.15.3:0/2879331456 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8100a0d30 0x7fd81014d0d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd8000098e0 tx=0x7fd8000091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:11.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.175+0000 7fd815bb9700 1 -- 172.21.15.3:0/2879331456 shutdown_connections 2023-10-08T15:40:11.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.175+0000 7fd815bb9700 1 --2- 172.21.15.3:0/2879331456 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8100a0d30 0x7fd81014d0d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:11.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.175+0000 7fd815bb9700 1 -- 172.21.15.3:0/2879331456 >> 172.21.15.3:0/2879331456 conn(0x7fd810067b60 msgr2=0x7fd8100be240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:11.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.175+0000 7fd815bb9700 1 -- 172.21.15.3:0/2879331456 shutdown_connections 2023-10-08T15:40:11.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.175+0000 7fd815bb9700 1 -- 172.21.15.3:0/2879331456 wait complete. 2023-10-08T15:40:11.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.175+0000 7fd815bb9700 1 Processor -- start 2023-10-08T15:40:11.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.175+0000 7fd815bb9700 1 -- start start 2023-10-08T15:40:11.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.175+0000 7fd815bb9700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd810068d00 0x7fd8101426c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:11.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.175+0000 7fd815bb9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8100a0d30 0x7fd81013f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:11.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.175+0000 7fd815bb9700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd8100beb80 0x7fd81013f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:11.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.175+0000 7fd815bb9700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8101597a0 con 0x7fd810068d00 2023-10-08T15:40:11.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.175+0000 7fd815bb9700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd810142c00 con 0x7fd8100a0d30 2023-10-08T15:40:11.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.175+0000 7fd815bb9700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd81014c220 con 0x7fd8100beb80 2023-10-08T15:40:11.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.175+0000 7fd814bb7700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd810068d00 0x7fd8101426c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:11.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.175+0000 7fd814bb7700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd810068d00 0x7fd8101426c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36212/0 (socket says 172.21.15.3:36212) 2023-10-08T15:40:11.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.175+0000 7fd807fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8100a0d30 0x7fd81013f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:11.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.175+0000 7fd814bb7700 1 -- 172.21.15.3:0/537640089 learned_addr learned my addr 172.21.15.3:0/537640089 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:11.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.175+0000 7fd8153b8700 1 --2- 172.21.15.3:0/537640089 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd8100beb80 0x7fd81013f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:11.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.179+0000 7fd814bb7700 1 -- 172.21.15.3:0/537640089 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd8100beb80 msgr2=0x7fd81013f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:11.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.179+0000 7fd814bb7700 1 --2- 172.21.15.3:0/537640089 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd8100beb80 0x7fd81013f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:11.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.179+0000 7fd814bb7700 1 -- 172.21.15.3:0/537640089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8100a0d30 msgr2=0x7fd81013f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:11.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.179+0000 7fd814bb7700 1 --2- 172.21.15.3:0/537640089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8100a0d30 0x7fd81013f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:11.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.179+0000 7fd814bb7700 1 -- 172.21.15.3:0/537640089 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd800009420 con 0x7fd810068d00 2023-10-08T15:40:11.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.179+0000 7fd807fff700 1 --2- 172.21.15.3:0/537640089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8100a0d30 0x7fd81013f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:40:11.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.179+0000 7fd814bb7700 1 --2- 172.21.15.3:0/537640089 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd810068d00 0x7fd8101426c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fd80c00cb90 tx=0x7fd80c001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:11.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.179+0000 7fd804ff9700 1 -- 172.21.15.3:0/537640089 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80c007150 con 0x7fd810068d00 2023-10-08T15:40:11.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.179+0000 7fd804ff9700 1 -- 172.21.15.3:0/537640089 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd80c0072d0 con 0x7fd810068d00 2023-10-08T15:40:11.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.179+0000 7fd815bb9700 1 -- 172.21.15.3:0/537640089 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd81014c500 con 0x7fd810068d00 2023-10-08T15:40:11.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.179+0000 7fd804ff9700 1 -- 172.21.15.3:0/537640089 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80c007690 con 0x7fd810068d00 2023-10-08T15:40:11.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.179+0000 7fd815bb9700 1 -- 172.21.15.3:0/537640089 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd810159ea0 con 0x7fd810068d00 2023-10-08T15:40:11.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.179+0000 7fd815bb9700 1 -- 172.21.15.3:0/537640089 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd81014c080 con 0x7fd810068d00 2023-10-08T15:40:11.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.183+0000 7fd804ff9700 1 -- 172.21.15.3:0/537640089 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fd80c004a40 con 0x7fd810068d00 2023-10-08T15:40:11.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.183+0000 7fd804ff9700 1 --2- 172.21.15.3:0/537640089 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd7fc060580 0x7fd7fc062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:11.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.183+0000 7fd804ff9700 1 -- 172.21.15.3:0/537640089 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fd80c07b800 con 0x7fd810068d00 2023-10-08T15:40:11.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.183+0000 7fd807fff700 1 --2- 172.21.15.3:0/537640089 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd7fc060580 0x7fd7fc062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:11.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.183+0000 7fd807fff700 1 --2- 172.21.15.3:0/537640089 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd7fc060580 0x7fd7fc062a30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd800003080 tx=0x7fd800016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:11.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.191+0000 7fd804ff9700 1 -- 172.21.15.3:0/537640089 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd81014c080 con 0x7fd810068d00 2023-10-08T15:40:11.356 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.351+0000 7fd815bb9700 1 -- 172.21.15.3:0/537640089 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd81014c080 con 0x7fd810068d00 2023-10-08T15:40:11.357 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.355+0000 7fd804ff9700 1 -- 172.21.15.3:0/537640089 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd81014c080 con 0x7fd810068d00 2023-10-08T15:40:11.358 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2023-10-08T15:40:11.360 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.355+0000 7fd815bb9700 1 -- 172.21.15.3:0/537640089 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd7fc060580 msgr2=0x7fd7fc062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:11.360 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.355+0000 7fd815bb9700 1 --2- 172.21.15.3:0/537640089 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd7fc060580 0x7fd7fc062a30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd800003080 tx=0x7fd800016000 comp rx=0 tx=0).stop 2023-10-08T15:40:11.360 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.355+0000 7fd815bb9700 1 -- 172.21.15.3:0/537640089 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd810068d00 msgr2=0x7fd8101426c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:11.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.355+0000 7fd815bb9700 1 --2- 172.21.15.3:0/537640089 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd810068d00 0x7fd8101426c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fd80c00cb90 tx=0x7fd80c001a30 comp rx=0 tx=0).stop 2023-10-08T15:40:11.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.355+0000 7fd815bb9700 1 -- 172.21.15.3:0/537640089 shutdown_connections 2023-10-08T15:40:11.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.355+0000 7fd815bb9700 1 --2- 172.21.15.3:0/537640089 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd7fc060580 0x7fd7fc062a30 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:11.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.355+0000 7fd815bb9700 1 --2- 172.21.15.3:0/537640089 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd8100beb80 0x7fd81013f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:11.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.355+0000 7fd815bb9700 1 --2- 172.21.15.3:0/537640089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8100a0d30 0x7fd81013f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:11.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.355+0000 7fd815bb9700 1 --2- 172.21.15.3:0/537640089 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd810068d00 0x7fd8101426c0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:11.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.355+0000 7fd815bb9700 1 -- 172.21.15.3:0/537640089 >> 172.21.15.3:0/537640089 conn(0x7fd810067b60 msgr2=0x7fd8101457e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:11.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.355+0000 7fd815bb9700 1 -- 172.21.15.3:0/537640089 shutdown_connections 2023-10-08T15:40:11.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.355+0000 7fd815bb9700 1 -- 172.21.15.3:0/537640089 wait complete. 2023-10-08T15:40:11.376 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T15:40:11.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.475+0000 7f1b6bcf4700 1 Processor -- start 2023-10-08T15:40:11.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.475+0000 7f1b6bcf4700 1 -- start start 2023-10-08T15:40:11.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.475+0000 7f1b6bcf4700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1b640a15e0 0x7f1b640b2e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:11.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.479+0000 7f1b6bcf4700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f1b640b33b0 0x7f1b6414b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:11.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.479+0000 7f1b6bcf4700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1b6414bb70 0x7f1b6414bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:11.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.479+0000 7f1b6bcf4700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b640a1010 con 0x7f1b640b33b0 2023-10-08T15:40:11.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.479+0000 7f1b6bcf4700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b6406c9a0 con 0x7f1b640a15e0 2023-10-08T15:40:11.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.479+0000 7f1b6bcf4700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6406e110 con 0x7f1b6414bb70 2023-10-08T15:40:11.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.479+0000 7f1b6928f700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f1b640b33b0 0x7f1b6414b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:11.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.479+0000 7f1b6928f700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f1b640b33b0 0x7f1b6414b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36224/0 (socket says 172.21.15.3:36224) 2023-10-08T15:40:11.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.479+0000 7f1b6928f700 1 -- 172.21.15.3:0/2064818933 learned_addr learned my addr 172.21.15.3:0/2064818933 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:11.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.479+0000 7f1b69a90700 1 --2- 172.21.15.3:0/2064818933 >> v2:172.21.15.50:3300/0 conn(0x7f1b640a15e0 0x7f1b640b2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:11.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.479+0000 7f1b6a291700 1 --2- 172.21.15.3:0/2064818933 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1b6414bb70 0x7f1b6414bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:11.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.479+0000 7f1b6928f700 1 -- 172.21.15.3:0/2064818933 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1b6414bb70 msgr2=0x7f1b6414bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:11.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.479+0000 7f1b6928f700 1 --2- 172.21.15.3:0/2064818933 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1b6414bb70 0x7f1b6414bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:11.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.479+0000 7f1b6928f700 1 -- 172.21.15.3:0/2064818933 >> v2:172.21.15.50:3300/0 conn(0x7f1b640a15e0 msgr2=0x7f1b640b2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:11.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.479+0000 7f1b6928f700 1 --2- 172.21.15.3:0/2064818933 >> v2:172.21.15.50:3300/0 conn(0x7f1b640a15e0 0x7f1b640b2e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:11.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.479+0000 7f1b6928f700 1 -- 172.21.15.3:0/2064818933 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b640a0d30 con 0x7f1b640b33b0 2023-10-08T15:40:11.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.479+0000 7f1b6928f700 1 --2- 172.21.15.3:0/2064818933 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1b640b33b0 0x7f1b6414b630 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f1b6406bb50 tx=0x7f1b54009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9741404b9cc59f04 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:11.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.479+0000 7f1b68a8e700 1 -- 172.21.15.3:0/2064818933 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5400b640 con 0x7f1b640b33b0 2023-10-08T15:40:11.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.479+0000 7f1b68a8e700 1 -- 172.21.15.3:0/2064818933 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b5400b7a0 con 0x7f1b640b33b0 2023-10-08T15:40:11.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.479+0000 7f1b68a8e700 1 -- 172.21.15.3:0/2064818933 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5400bb60 con 0x7f1b640b33b0 2023-10-08T15:40:11.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.479+0000 7f1b6bcf4700 1 -- 172.21.15.3:0/2064818933 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1b640b33b0 msgr2=0x7f1b6414b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:11.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.479+0000 7f1b6bcf4700 1 --2- 172.21.15.3:0/2064818933 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1b640b33b0 0x7f1b6414b630 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f1b6406bb50 tx=0x7f1b54009250 comp rx=0 tx=0).stop 2023-10-08T15:40:11.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.479+0000 7f1b6bcf4700 1 -- 172.21.15.3:0/2064818933 shutdown_connections 2023-10-08T15:40:11.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.479+0000 7f1b6bcf4700 1 --2- 172.21.15.3:0/2064818933 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1b6414bb70 0x7f1b6414bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:11.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.479+0000 7f1b6bcf4700 1 --2- 172.21.15.3:0/2064818933 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1b640b33b0 0x7f1b6414b630 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:11.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.479+0000 7f1b6bcf4700 1 --2- 172.21.15.3:0/2064818933 >> v2:172.21.15.50:3300/0 conn(0x7f1b640a15e0 0x7f1b640b2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:11.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.479+0000 7f1b6bcf4700 1 -- 172.21.15.3:0/2064818933 >> 172.21.15.3:0/2064818933 conn(0x7f1b64068720 msgr2=0x7f1b64068b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:11.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.479+0000 7f1b6bcf4700 1 -- 172.21.15.3:0/2064818933 shutdown_connections 2023-10-08T15:40:11.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.479+0000 7f1b6bcf4700 1 -- 172.21.15.3:0/2064818933 wait complete. 2023-10-08T15:40:11.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.483+0000 7f1b6bcf4700 1 Processor -- start 2023-10-08T15:40:11.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.483+0000 7f1b6bcf4700 1 -- start start 2023-10-08T15:40:11.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.483+0000 7f1b6bcf4700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1b640a15e0 0x7f1b6414ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:11.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.483+0000 7f1b6bcf4700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1b640b33b0 0x7f1b64150480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:11.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.483+0000 7f1b6bcf4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b6414bb70 0x7f1b6414d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:11.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.483+0000 7f1b6bcf4700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b640973a0 con 0x7f1b640a15e0 2023-10-08T15:40:11.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.483+0000 7f1b6bcf4700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6414ed30 con 0x7f1b6414bb70 2023-10-08T15:40:11.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.483+0000 7f1b6bcf4700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6414cd30 con 0x7f1b640b33b0 2023-10-08T15:40:11.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.483+0000 7f1b69a90700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1b640a15e0 0x7f1b6414ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:11.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.483+0000 7f1b69a90700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1b640a15e0 0x7f1b6414ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36232/0 (socket says 172.21.15.3:36232) 2023-10-08T15:40:11.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.483+0000 7f1b6a291700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b6414bb70 0x7f1b6414d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:11.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.483+0000 7f1b69a90700 1 -- 172.21.15.3:0/3506108687 learned_addr learned my addr 172.21.15.3:0/3506108687 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:11.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.483+0000 7f1b6928f700 1 --2- 172.21.15.3:0/3506108687 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1b640b33b0 0x7f1b64150480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:11.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.483+0000 7f1b69a90700 1 -- 172.21.15.3:0/3506108687 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1b640b33b0 msgr2=0x7f1b64150480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:11.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.483+0000 7f1b69a90700 1 --2- 172.21.15.3:0/3506108687 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1b640b33b0 0x7f1b64150480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:11.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.483+0000 7f1b69a90700 1 -- 172.21.15.3:0/3506108687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b6414bb70 msgr2=0x7f1b6414d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:11.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.483+0000 7f1b69a90700 1 --2- 172.21.15.3:0/3506108687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b6414bb70 0x7f1b6414d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:11.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.483+0000 7f1b69a90700 1 -- 172.21.15.3:0/3506108687 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b540094f0 con 0x7f1b640a15e0 2023-10-08T15:40:11.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.483+0000 7f1b69a90700 1 --2- 172.21.15.3:0/3506108687 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1b640a15e0 0x7f1b6414ff40 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f1b6000ec80 tx=0x7f1b600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:11.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.483+0000 7f1b59ffb700 1 -- 172.21.15.3:0/3506108687 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6000c850 con 0x7f1b640a15e0 2023-10-08T15:40:11.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.483+0000 7f1b59ffb700 1 -- 172.21.15.3:0/3506108687 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b6000c9b0 con 0x7f1b640a15e0 2023-10-08T15:40:11.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.483+0000 7f1b6bcf4700 1 -- 172.21.15.3:0/3506108687 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b6414d010 con 0x7f1b640a15e0 2023-10-08T15:40:11.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.483+0000 7f1b59ffb700 1 -- 172.21.15.3:0/3506108687 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6000cd50 con 0x7f1b640a15e0 2023-10-08T15:40:11.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.483+0000 7f1b6bcf4700 1 -- 172.21.15.3:0/3506108687 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b6415e9a0 con 0x7f1b640a15e0 2023-10-08T15:40:11.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.487+0000 7f1b6bcf4700 1 -- 172.21.15.3:0/3506108687 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b640a0b90 con 0x7f1b640a15e0 2023-10-08T15:40:11.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.487+0000 7f1b59ffb700 1 -- 172.21.15.3:0/3506108687 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f1b60013680 con 0x7f1b640a15e0 2023-10-08T15:40:11.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.487+0000 7f1b59ffb700 1 --2- 172.21.15.3:0/3506108687 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1b48060550 0x7f1b48062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:11.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.487+0000 7f1b59ffb700 1 -- 172.21.15.3:0/3506108687 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f1b6007c6d0 con 0x7f1b640a15e0 2023-10-08T15:40:11.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.487+0000 7f1b6928f700 1 --2- 172.21.15.3:0/3506108687 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1b48060550 0x7f1b48062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:11.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.491+0000 7f1b6928f700 1 --2- 172.21.15.3:0/3506108687 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1b48060550 0x7f1b48062a00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1b6406bb50 tx=0x7f1b54017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:11.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.495+0000 7f1b59ffb700 1 -- 172.21.15.3:0/3506108687 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1b640a0b90 con 0x7f1b640a15e0 2023-10-08T15:40:11.664 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.659+0000 7f1b6bcf4700 1 -- 172.21.15.3:0/3506108687 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f1b640a0b90 con 0x7f1b640a15e0 2023-10-08T15:40:11.664 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.659+0000 7f1b59ffb700 1 -- 172.21.15.3:0/3506108687 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v35) v1 ==== 84+0+65 (secure 0 0 0) 0x7f1b640a0b90 con 0x7f1b640a15e0 2023-10-08T15:40:11.664 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:40:11.665 INFO:teuthology.orchestra.run.smithi003.stdout:[ 2023-10-08T15:40:11.665 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:40:11.665 INFO:teuthology.orchestra.run.smithi003.stdout: "poolnum": 1, 2023-10-08T15:40:11.665 INFO:teuthology.orchestra.run.smithi003.stdout: "poolname": ".mgr" 2023-10-08T15:40:11.665 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:40:11.665 INFO:teuthology.orchestra.run.smithi003.stdout:] 2023-10-08T15:40:11.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.663+0000 7f1b6bcf4700 1 -- 172.21.15.3:0/3506108687 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1b48060550 msgr2=0x7f1b48062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:11.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.663+0000 7f1b6bcf4700 1 --2- 172.21.15.3:0/3506108687 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1b48060550 0x7f1b48062a00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1b6406bb50 tx=0x7f1b54017000 comp rx=0 tx=0).stop 2023-10-08T15:40:11.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.663+0000 7f1b6bcf4700 1 -- 172.21.15.3:0/3506108687 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1b640a15e0 msgr2=0x7f1b6414ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:11.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.663+0000 7f1b6bcf4700 1 --2- 172.21.15.3:0/3506108687 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1b640a15e0 0x7f1b6414ff40 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f1b6000ec80 tx=0x7f1b600091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:11.668 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.663+0000 7f1b6bcf4700 1 -- 172.21.15.3:0/3506108687 shutdown_connections 2023-10-08T15:40:11.668 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.663+0000 7f1b6bcf4700 1 --2- 172.21.15.3:0/3506108687 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1b48060550 0x7f1b48062a00 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:11.668 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.663+0000 7f1b6bcf4700 1 --2- 172.21.15.3:0/3506108687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b6414bb70 0x7f1b6414d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:11.668 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.663+0000 7f1b6bcf4700 1 --2- 172.21.15.3:0/3506108687 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1b640b33b0 0x7f1b64150480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:11.668 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.663+0000 7f1b6bcf4700 1 --2- 172.21.15.3:0/3506108687 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1b640a15e0 0x7f1b6414ff40 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:11.668 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.663+0000 7f1b6bcf4700 1 -- 172.21.15.3:0/3506108687 >> 172.21.15.3:0/3506108687 conn(0x7f1b64068720 msgr2=0x7f1b640bc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:11.668 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.663+0000 7f1b6bcf4700 1 -- 172.21.15.3:0/3506108687 shutdown_connections 2023-10-08T15:40:11.668 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.663+0000 7f1b6bcf4700 1 -- 172.21.15.3:0/3506108687 wait complete. 2023-10-08T15:40:11.679 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T15:40:11.679 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T15:40:11.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.787+0000 7fccd67af700 1 Processor -- start 2023-10-08T15:40:11.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.787+0000 7fccd67af700 1 -- start start 2023-10-08T15:40:11.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.787+0000 7fccd67af700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fccd00bf3a0 0x7fccd006d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:11.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.787+0000 7fccd67af700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fccd014a9d0 0x7fccd014ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:11.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.787+0000 7fccd67af700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccd014c2f0 con 0x7fccd006c830 2023-10-08T15:40:11.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.787+0000 7fccd67af700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccd00a2800 con 0x7fccd00bf3a0 2023-10-08T15:40:11.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.787+0000 7fccd67af700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccd014bca0 con 0x7fccd014a9d0 2023-10-08T15:40:11.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.787+0000 7fcccffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fccd00bf3a0 0x7fccd006d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:11.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.787+0000 7fccd4d4c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fccd014a9d0 0x7fccd014ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:11.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.787+0000 7fcccffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fccd00bf3a0 0x7fccd006d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.3:51290/0 (socket says 172.21.15.3:51290) 2023-10-08T15:40:11.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.787+0000 7fcccffff700 1 -- 172.21.15.3:0/2442242024 learned_addr learned my addr 172.21.15.3:0/2442242024 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:11.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.787+0000 7fcccffff700 1 -- 172.21.15.3:0/2442242024 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fccd014a9d0 msgr2=0x7fccd014ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:11.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.787+0000 7fcccffff700 1 --2- 172.21.15.3:0/2442242024 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fccd014a9d0 0x7fccd014ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:11.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.787+0000 7fcccffff700 1 -- 172.21.15.3:0/2442242024 >> v1:172.21.15.50:6789/0 conn(0x7fccd006c830 legacy=0x7fccd006d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:11.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.787+0000 7fcccffff700 1 -- 172.21.15.3:0/2442242024 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd014bf80 con 0x7fccd00bf3a0 2023-10-08T15:40:11.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.787+0000 7fcccffff700 1 --2- 172.21.15.3:0/2442242024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccd00bf3a0 0x7fccd006d000 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fccc00099b0 tx=0x7fccc0009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=767816f33276fea7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:11.794 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.787+0000 7fcccf7fe700 1 -- 172.21.15.3:0/2442242024 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc0009ea0 con 0x7fccd00bf3a0 2023-10-08T15:40:11.794 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.787+0000 7fcccf7fe700 1 -- 172.21.15.3:0/2442242024 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccc000b860 con 0x7fccd00bf3a0 2023-10-08T15:40:11.794 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.787+0000 7fcccf7fe700 1 -- 172.21.15.3:0/2442242024 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc000bc00 con 0x7fccd00bf3a0 2023-10-08T15:40:11.794 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.791+0000 7fccd67af700 1 -- 172.21.15.3:0/2442242024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccd00bf3a0 msgr2=0x7fccd006d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:11.794 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.791+0000 7fccd67af700 1 --2- 172.21.15.3:0/2442242024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccd00bf3a0 0x7fccd006d000 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fccc00099b0 tx=0x7fccc0009250 comp rx=0 tx=0).stop 2023-10-08T15:40:11.795 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.791+0000 7fccd67af700 1 -- 172.21.15.3:0/2442242024 shutdown_connections 2023-10-08T15:40:11.795 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.791+0000 7fccd67af700 1 --2- 172.21.15.3:0/2442242024 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fccd014a9d0 0x7fccd014ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:11.795 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.791+0000 7fccd67af700 1 --2- 172.21.15.3:0/2442242024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccd00bf3a0 0x7fccd006d000 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:11.795 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.791+0000 7fccd67af700 1 -- 172.21.15.3:0/2442242024 >> 172.21.15.3:0/2442242024 conn(0x7fccd00c2a80 msgr2=0x7fccd00bea60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:11.795 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.791+0000 7fccd67af700 1 -- 172.21.15.3:0/2442242024 shutdown_connections 2023-10-08T15:40:11.795 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.791+0000 7fccd67af700 1 -- 172.21.15.3:0/2442242024 wait complete. 2023-10-08T15:40:11.795 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.791+0000 7fccd67af700 1 Processor -- start 2023-10-08T15:40:11.796 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.791+0000 7fccd67af700 1 -- start start 2023-10-08T15:40:11.797 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.791+0000 7fccd67af700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fccd006c830 0x7fccd0144720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:11.797 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.791+0000 7fccd67af700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccd00bf3a0 0x7fccd009bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:11.797 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.791+0000 7fccd67af700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fccd014a9d0 0x7fccd00a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:11.797 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.791+0000 7fccd67af700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd009c760 con 0x7fccd014a9d0 2023-10-08T15:40:11.797 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.791+0000 7fccd67af700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd0144c80 con 0x7fccd00bf3a0 2023-10-08T15:40:11.797 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.791+0000 7fccd67af700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccd0144360 con 0x7fccd006c830 2023-10-08T15:40:11.798 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.791+0000 7fccd4d4c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fccd014a9d0 0x7fccd00a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:11.798 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.795+0000 7fccd4d4c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fccd014a9d0 0x7fccd00a1980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36246/0 (socket says 172.21.15.3:36246) 2023-10-08T15:40:11.798 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.795+0000 7fccd4d4c700 1 -- 172.21.15.3:0/1050149616 learned_addr learned my addr 172.21.15.3:0/1050149616 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:11.798 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.795+0000 7fcccffff700 1 --2- 172.21.15.3:0/1050149616 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fccd006c830 0x7fccd0144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:11.798 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.795+0000 7fccc77fe700 1 --2- 172.21.15.3:0/1050149616 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccd00bf3a0 0x7fccd009bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:11.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.795+0000 7fccd4d4c700 1 -- 172.21.15.3:0/1050149616 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fccd006c830 msgr2=0x7fccd0144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:11.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.795+0000 7fccd4d4c700 1 --2- 172.21.15.3:0/1050149616 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fccd006c830 0x7fccd0144720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:11.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.795+0000 7fccd4d4c700 1 -- 172.21.15.3:0/1050149616 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccd00bf3a0 msgr2=0x7fccd009bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:11.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.795+0000 7fccd4d4c700 1 --2- 172.21.15.3:0/1050149616 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccd00bf3a0 0x7fccd009bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:11.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.795+0000 7fccd4d4c700 1 -- 172.21.15.3:0/1050149616 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc00094f0 con 0x7fccd014a9d0 2023-10-08T15:40:11.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.795+0000 7fccd4d4c700 1 --2- 172.21.15.3:0/1050149616 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fccd014a9d0 0x7fccd00a1980 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fccc8009df0 tx=0x7fccc800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:11.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.795+0000 7fccccff9700 1 -- 172.21.15.3:0/1050149616 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc800caa0 con 0x7fccd014a9d0 2023-10-08T15:40:11.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.795+0000 7fccccff9700 1 -- 172.21.15.3:0/1050149616 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccc800f040 con 0x7fccd014a9d0 2023-10-08T15:40:11.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.795+0000 7fccd67af700 1 -- 172.21.15.3:0/1050149616 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccd0144ed0 con 0x7fccd014a9d0 2023-10-08T15:40:11.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.795+0000 7fccccff9700 1 -- 172.21.15.3:0/1050149616 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc800ce50 con 0x7fccd014a9d0 2023-10-08T15:40:11.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.795+0000 7fccd67af700 1 -- 172.21.15.3:0/1050149616 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccd009d750 con 0x7fccd014a9d0 2023-10-08T15:40:11.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.795+0000 7fccd67af700 1 -- 172.21.15.3:0/1050149616 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccd01441c0 con 0x7fccd014a9d0 2023-10-08T15:40:11.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.795+0000 7fccccff9700 1 -- 172.21.15.3:0/1050149616 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fccc8014690 con 0x7fccd014a9d0 2023-10-08T15:40:11.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.799+0000 7fccccff9700 1 --2- 172.21.15.3:0/1050149616 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fccb0060550 0x7fccb0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:11.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.799+0000 7fccccff9700 1 -- 172.21.15.3:0/1050149616 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fccc807cec0 con 0x7fccd014a9d0 2023-10-08T15:40:11.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.799+0000 7fcccffff700 1 --2- 172.21.15.3:0/1050149616 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fccb0060550 0x7fccb0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:11.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.799+0000 7fcccffff700 1 --2- 172.21.15.3:0/1050149616 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fccb0060550 0x7fccb0062a00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fccc00099b0 tx=0x7fccc0017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:11.808 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.803+0000 7fccccff9700 1 -- 172.21.15.3:0/1050149616 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fccd01441c0 con 0x7fccd014a9d0 2023-10-08T15:40:11.972 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:11.967+0000 7fccd67af700 1 -- 172.21.15.3:0/1050149616 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fccd01441c0 con 0x7fccd014a9d0 2023-10-08T15:40:12.390 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.387+0000 7fccccff9700 1 -- 172.21.15.3:0/1050149616 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v36) v1 ==== 138+0+0 (secure 0 0 0) 0x7fccd01441c0 con 0x7fccd014a9d0 2023-10-08T15:40:12.398 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.395+0000 7fccd67af700 1 -- 172.21.15.3:0/1050149616 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fccb0060550 msgr2=0x7fccb0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:12.398 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.395+0000 7fccd67af700 1 --2- 172.21.15.3:0/1050149616 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fccb0060550 0x7fccb0062a00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fccc00099b0 tx=0x7fccc0017000 comp rx=0 tx=0).stop 2023-10-08T15:40:12.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.395+0000 7fccd67af700 1 -- 172.21.15.3:0/1050149616 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fccd014a9d0 msgr2=0x7fccd00a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:12.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.395+0000 7fccd67af700 1 --2- 172.21.15.3:0/1050149616 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fccd014a9d0 0x7fccd00a1980 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fccc8009df0 tx=0x7fccc800b040 comp rx=0 tx=0).stop 2023-10-08T15:40:12.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.395+0000 7fccd67af700 1 -- 172.21.15.3:0/1050149616 shutdown_connections 2023-10-08T15:40:12.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.395+0000 7fccd67af700 1 --2- 172.21.15.3:0/1050149616 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fccb0060550 0x7fccb0062a00 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:12.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.395+0000 7fccd67af700 1 --2- 172.21.15.3:0/1050149616 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fccd014a9d0 0x7fccd00a1980 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:12.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.395+0000 7fccd67af700 1 --2- 172.21.15.3:0/1050149616 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccd00bf3a0 0x7fccd009bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:12.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.395+0000 7fccd67af700 1 --2- 172.21.15.3:0/1050149616 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fccd006c830 0x7fccd0144720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:12.400 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.395+0000 7fccd67af700 1 -- 172.21.15.3:0/1050149616 >> 172.21.15.3:0/1050149616 conn(0x7fccd00c2a80 msgr2=0x7fccd006cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:12.400 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.395+0000 7fccd67af700 1 -- 172.21.15.3:0/1050149616 shutdown_connections 2023-10-08T15:40:12.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.395+0000 7fccd67af700 1 -- 172.21.15.3:0/1050149616 wait complete. 2023-10-08T15:40:12.403 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'cephfs_metadata' created 2023-10-08T15:40:12.415 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T15:40:12.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.527+0000 7febdbfff700 1 Processor -- start 2023-10-08T15:40:12.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.527+0000 7febdbfff700 1 -- start start 2023-10-08T15:40:12.532 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.527+0000 7febdbfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7febdc068da0 0x7febdc069fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:12.532 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.527+0000 7febdbfff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7febdc14af00 0x7febdc14ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:12.532 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.527+0000 7febdbfff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febdc0b9050 con 0x7febdc0bac70 2023-10-08T15:40:12.532 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.527+0000 7febdbfff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febdc0bb440 con 0x7febdc068da0 2023-10-08T15:40:12.532 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.527+0000 7febdbfff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febdc14b380 con 0x7febdc14af00 2023-10-08T15:40:12.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.527+0000 7febdb7fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7febdc14af00 0x7febdc14ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:12.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.527+0000 7febda7fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7febdc068da0 0x7febdc069fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:12.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.527+0000 7febdb7fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7febdc14af00 0x7febdc14ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.3:48730/0 (socket says 172.21.15.3:48730) 2023-10-08T15:40:12.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.527+0000 7febdb7fe700 1 -- 172.21.15.3:0/1914448760 learned_addr learned my addr 172.21.15.3:0/1914448760 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:12.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.527+0000 7febdb7fe700 1 -- 172.21.15.3:0/1914448760 >> v2:172.21.15.50:3300/0 conn(0x7febdc068da0 msgr2=0x7febdc069fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:12.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.527+0000 7febdb7fe700 1 --2- 172.21.15.3:0/1914448760 >> v2:172.21.15.50:3300/0 conn(0x7febdc068da0 0x7febdc069fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:12.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.527+0000 7febdb7fe700 1 -- 172.21.15.3:0/1914448760 >> v1:172.21.15.50:6789/0 conn(0x7febdc0bac70 legacy=0x7febdc14a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:12.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.527+0000 7febdb7fe700 1 -- 172.21.15.3:0/1914448760 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febdc0b8a40 con 0x7febdc14af00 2023-10-08T15:40:12.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.531+0000 7febdb7fe700 1 --2- 172.21.15.3:0/1914448760 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7febdc14af00 0x7febdc14ea80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7febd4009f20 tx=0x7febd4009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88060707e7597762 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:12.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.531+0000 7febd9ffb700 1 -- 172.21.15.3:0/1914448760 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd400e070 con 0x7febdc14af00 2023-10-08T15:40:12.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.531+0000 7febd9ffb700 1 -- 172.21.15.3:0/1914448760 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd400b9d0 con 0x7febdc14af00 2023-10-08T15:40:12.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.531+0000 7febd9ffb700 1 -- 172.21.15.3:0/1914448760 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd40092e0 con 0x7febdc14af00 2023-10-08T15:40:12.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.531+0000 7febdbfff700 1 -- 172.21.15.3:0/1914448760 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7febdc14af00 msgr2=0x7febdc14ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:12.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.531+0000 7febdbfff700 1 --2- 172.21.15.3:0/1914448760 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7febdc14af00 0x7febdc14ea80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7febd4009f20 tx=0x7febd4009840 comp rx=0 tx=0).stop 2023-10-08T15:40:12.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.531+0000 7febdbfff700 1 -- 172.21.15.3:0/1914448760 shutdown_connections 2023-10-08T15:40:12.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.531+0000 7febdbfff700 1 --2- 172.21.15.3:0/1914448760 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7febdc14af00 0x7febdc14ea80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:12.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.531+0000 7febdbfff700 1 --2- 172.21.15.3:0/1914448760 >> v2:172.21.15.50:3300/0 conn(0x7febdc068da0 0x7febdc069fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:12.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.531+0000 7febdbfff700 1 -- 172.21.15.3:0/1914448760 >> 172.21.15.3:0/1914448760 conn(0x7febdc0670e0 msgr2=0x7febdc0674e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:12.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.531+0000 7febdbfff700 1 -- 172.21.15.3:0/1914448760 shutdown_connections 2023-10-08T15:40:12.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.531+0000 7febdbfff700 1 -- 172.21.15.3:0/1914448760 wait complete. 2023-10-08T15:40:12.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.535+0000 7febdbfff700 1 Processor -- start 2023-10-08T15:40:12.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.535+0000 7febdbfff700 1 -- start start 2023-10-08T15:40:12.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.535+0000 7febdbfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7febdc068da0 0x7febdc15e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:12.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.535+0000 7febdbfff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7febdc0bac70 0x7febdc15ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:12.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.535+0000 7febdbfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febdc14af00 0x7febdc0b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:12.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.535+0000 7febdbfff700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febdc0b3470 con 0x7febdc068da0 2023-10-08T15:40:12.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.535+0000 7febdbfff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febdc0b5310 con 0x7febdc14af00 2023-10-08T15:40:12.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.535+0000 7febdbfff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febdc15f190 con 0x7febdc0bac70 2023-10-08T15:40:12.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.535+0000 7febdaffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7febdc068da0 0x7febdc15e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:12.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.535+0000 7febdb7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febdc14af00 0x7febdc0b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:12.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.535+0000 7febda7fc700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7febdc0bac70 0x7febdc15ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:12.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.535+0000 7febdaffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7febdc068da0 0x7febdc15e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36248/0 (socket says 172.21.15.3:36248) 2023-10-08T15:40:12.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.535+0000 7febdaffd700 1 -- 172.21.15.3:0/369181147 learned_addr learned my addr 172.21.15.3:0/369181147 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:12.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.535+0000 7febdaffd700 1 -- 172.21.15.3:0/369181147 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7febdc0bac70 msgr2=0x7febdc15ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:12.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.535+0000 7febdaffd700 1 --2- 172.21.15.3:0/369181147 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7febdc0bac70 0x7febdc15ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:12.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.535+0000 7febdaffd700 1 -- 172.21.15.3:0/369181147 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febdc14af00 msgr2=0x7febdc0b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:12.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.535+0000 7febdaffd700 1 --2- 172.21.15.3:0/369181147 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febdc14af00 0x7febdc0b1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:12.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.535+0000 7febdaffd700 1 -- 172.21.15.3:0/369181147 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd4009ae0 con 0x7febdc068da0 2023-10-08T15:40:12.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.535+0000 7febda7fc700 1 --2- 172.21.15.3:0/369181147 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7febdc0bac70 0x7febdc15ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:40:12.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.535+0000 7febdaffd700 1 --2- 172.21.15.3:0/369181147 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7febdc068da0 0x7febdc15e710 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7febcc00c5c0 tx=0x7febcc00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:12.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.535+0000 7febc2ffd700 1 -- 172.21.15.3:0/369181147 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febcc011590 con 0x7febdc068da0 2023-10-08T15:40:12.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.535+0000 7febc2ffd700 1 -- 172.21.15.3:0/369181147 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febcc011710 con 0x7febdc068da0 2023-10-08T15:40:12.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.535+0000 7febdbfff700 1 -- 172.21.15.3:0/369181147 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febdc0bf140 con 0x7febdc068da0 2023-10-08T15:40:12.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.535+0000 7febc2ffd700 1 -- 172.21.15.3:0/369181147 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febcc011ad0 con 0x7febdc068da0 2023-10-08T15:40:12.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.539+0000 7febdbfff700 1 -- 172.21.15.3:0/369181147 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febdc0bebc0 con 0x7febdc068da0 2023-10-08T15:40:12.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.539+0000 7febdbfff700 1 -- 172.21.15.3:0/369181147 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febdc0b35b0 con 0x7febdc068da0 2023-10-08T15:40:12.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.543+0000 7febc2ffd700 1 -- 172.21.15.3:0/369181147 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7febcc01b3b0 con 0x7febdc068da0 2023-10-08T15:40:12.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.543+0000 7febc2ffd700 1 --2- 172.21.15.3:0/369181147 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7febc8060550 0x7febc8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:12.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.543+0000 7febc2ffd700 1 -- 172.21.15.3:0/369181147 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5223+0+0 (secure 0 0 0) 0x7febcc07bc80 con 0x7febdc068da0 2023-10-08T15:40:12.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.543+0000 7febda7fc700 1 --2- 172.21.15.3:0/369181147 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7febc8060550 0x7febc8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:12.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.543+0000 7febda7fc700 1 --2- 172.21.15.3:0/369181147 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7febc8060550 0x7febc8062a00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7febdc0b8870 tx=0x7febd00091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:12.549 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.543+0000 7febc2ffd700 1 -- 172.21.15.3:0/369181147 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7febcc04c4d0 con 0x7febdc068da0 2023-10-08T15:40:12.709 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:12.703+0000 7febdbfff700 1 -- 172.21.15.3:0/369181147 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7febdc0b35b0 con 0x7febdc068da0 2023-10-08T15:40:13.407 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.399+0000 7febc2ffd700 1 -- 172.21.15.3:0/369181147 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v37) v1 ==== 170+0+0 (secure 0 0 0) 0x7febdc0b35b0 con 0x7febdc068da0 2023-10-08T15:40:13.421 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.415+0000 7febdbfff700 1 -- 172.21.15.3:0/369181147 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7febc8060550 msgr2=0x7febc8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:13.421 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.415+0000 7febdbfff700 1 --2- 172.21.15.3:0/369181147 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7febc8060550 0x7febc8062a00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7febdc0b8870 tx=0x7febd00091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:13.421 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.415+0000 7febdbfff700 1 -- 172.21.15.3:0/369181147 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7febdc068da0 msgr2=0x7febdc15e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:13.421 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.415+0000 7febdbfff700 1 --2- 172.21.15.3:0/369181147 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7febdc068da0 0x7febdc15e710 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7febcc00c5c0 tx=0x7febcc00c8d0 comp rx=0 tx=0).stop 2023-10-08T15:40:13.424 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.419+0000 7febdbfff700 1 -- 172.21.15.3:0/369181147 shutdown_connections 2023-10-08T15:40:13.424 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.419+0000 7febdbfff700 1 --2- 172.21.15.3:0/369181147 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7febc8060550 0x7febc8062a00 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:13.424 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.419+0000 7febdbfff700 1 --2- 172.21.15.3:0/369181147 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febdc14af00 0x7febdc0b1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:13.424 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.419+0000 7febdbfff700 1 --2- 172.21.15.3:0/369181147 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7febdc0bac70 0x7febdc15ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:13.424 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.419+0000 7febdbfff700 1 --2- 172.21.15.3:0/369181147 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7febdc068da0 0x7febdc15e710 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:13.424 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.419+0000 7febdbfff700 1 -- 172.21.15.3:0/369181147 >> 172.21.15.3:0/369181147 conn(0x7febdc0670e0 msgr2=0x7febdc14fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:13.424 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.419+0000 7febdbfff700 1 -- 172.21.15.3:0/369181147 shutdown_connections 2023-10-08T15:40:13.424 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.419+0000 7febdbfff700 1 -- 172.21.15.3:0/369181147 wait complete. 2023-10-08T15:40:13.426 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'cephfs_data' created 2023-10-08T15:40:13.438 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T15:40:13.549 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.543+0000 7fce12cec700 1 Processor -- start 2023-10-08T15:40:13.549 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.543+0000 7fce12cec700 1 -- start start 2023-10-08T15:40:13.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.547+0000 7fce12cec700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fce0c06ef30 0x7fce0c14b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:13.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.547+0000 7fce12cec700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce0c068e00 con 0x7fce0c14e3c0 2023-10-08T15:40:13.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.547+0000 7fce12cec700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce0c14b4b0 con 0x7fce0c06d730 2023-10-08T15:40:13.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.547+0000 7fce12cec700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce0c06e7a0 con 0x7fce0c06ef30 2023-10-08T15:40:13.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.547+0000 7fce11cea700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fce0c14e3c0 0x7fce0c0be950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:47592/0 (socket says 172.21.15.3:47592) 2023-10-08T15:40:13.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.547+0000 7fce11cea700 1 -- 172.21.15.3:0/2725817144 learned_addr learned my addr 172.21.15.3:0/2725817144 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:40:13.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.547+0000 7fce114e9700 1 --2- 172.21.15.3:0/2725817144 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fce0c06ef30 0x7fce0c14b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:13.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.547+0000 7fce10ce8700 1 -- 172.21.15.3:0/2725817144 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1426936289 0 0) 0x7fce0c068e00 con 0x7fce0c14e3c0 2023-10-08T15:40:13.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.547+0000 7fce10ce8700 1 -- 172.21.15.3:0/2725817144 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdf8003570 con 0x7fce0c14e3c0 2023-10-08T15:40:13.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.547+0000 7fce10ce8700 1 -- 172.21.15.3:0/2725817144 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3633237200 0 0) 0x7fce0c14b4b0 con 0x7fce0c06d730 2023-10-08T15:40:13.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.547+0000 7fce10ce8700 1 -- 172.21.15.3:0/2725817144 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce0c068e00 con 0x7fce0c06d730 2023-10-08T15:40:13.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.547+0000 7fce10ce8700 1 -- 172.21.15.3:0/2725817144 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3869104069 0 0) 0x7fcdf8003570 con 0x7fce0c14e3c0 2023-10-08T15:40:13.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.547+0000 7fce10ce8700 1 -- 172.21.15.3:0/2725817144 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fce0c06ef30 msgr2=0x7fce0c14b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:13.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.547+0000 7fce10ce8700 1 --2- 172.21.15.3:0/2725817144 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fce0c06ef30 0x7fce0c14b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:13.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.547+0000 7fce10ce8700 1 -- 172.21.15.3:0/2725817144 >> v1:172.21.15.50:6789/0 conn(0x7fce0c06d730 legacy=0x7fce0c14bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:13.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.547+0000 7fce10ce8700 1 -- 172.21.15.3:0/2725817144 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce0c069050 con 0x7fce0c14e3c0 2023-10-08T15:40:13.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.547+0000 7fce10ce8700 1 -- 172.21.15.3:0/2725817144 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2285686191 0 0) 0x7fce00001470 con 0x7fce0c14e3c0 2023-10-08T15:40:13.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.547+0000 7fce114e9700 1 --2- 172.21.15.3:0/2725817144 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fce0c06ef30 0x7fce0c14b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:40:13.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.547+0000 7fce10ce8700 1 -- 172.21.15.3:0/2725817144 >> v1:172.21.15.3:6789/0 conn(0x7fce0c14e3c0 legacy=0x7fce0c0be950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:13.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.547+0000 7fce10ce8700 1 --2- 172.21.15.3:0/2725817144 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdf8003c20 0x7fcdf8004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:13.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.547+0000 7fce10ce8700 1 --2- 172.21.15.3:0/2725817144 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcdf8004810 0x7fcdf8004c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:13.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.547+0000 7fce10ce8700 1 --2- 172.21.15.3:0/2725817144 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcdf8005140 0x7fcdf800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:13.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.547+0000 7fce10ce8700 1 -- 172.21.15.3:0/2725817144 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0c06e7a0 con 0x7fcdf8005140 2023-10-08T15:40:13.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.547+0000 7fce10ce8700 1 -- 172.21.15.3:0/2725817144 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf800bfa0 con 0x7fcdf8003c20 2023-10-08T15:40:13.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.547+0000 7fce10ce8700 1 -- 172.21.15.3:0/2725817144 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf800c0e0 con 0x7fcdf8004810 2023-10-08T15:40:13.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.547+0000 7fce124eb700 1 --2- 172.21.15.3:0/2725817144 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcdf8005140 0x7fcdf800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:13.555 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.547+0000 7fce114e9700 1 --2- 172.21.15.3:0/2725817144 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcdf8004810 0x7fcdf8004c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:13.555 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.547+0000 7fce11cea700 1 --2- 172.21.15.3:0/2725817144 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdf8003c20 0x7fcdf8004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:13.555 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.547+0000 7fce124eb700 1 -- 172.21.15.3:0/2725817144 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcdf8004810 msgr2=0x7fcdf8004c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:13.555 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.547+0000 7fce124eb700 1 --2- 172.21.15.3:0/2725817144 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcdf8004810 0x7fcdf8004c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:13.555 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.547+0000 7fce124eb700 1 -- 172.21.15.3:0/2725817144 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdf8003c20 msgr2=0x7fcdf8004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:13.555 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.547+0000 7fce124eb700 1 --2- 172.21.15.3:0/2725817144 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdf8003c20 0x7fcdf8004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:13.555 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.547+0000 7fce124eb700 1 -- 172.21.15.3:0/2725817144 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce08009420 con 0x7fcdf8005140 2023-10-08T15:40:13.555 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.547+0000 7fce124eb700 1 --2- 172.21.15.3:0/2725817144 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcdf8005140 0x7fcdf800ba60 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fce04002120 tx=0x7fce040017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4011a7e78e42014 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:13.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.551+0000 7fce10ce8700 1 -- 172.21.15.3:0/2725817144 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce04001ab0 con 0x7fcdf8005140 2023-10-08T15:40:13.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.551+0000 7fce10ce8700 1 -- 172.21.15.3:0/2725817144 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce0400c900 con 0x7fcdf8005140 2023-10-08T15:40:13.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.551+0000 7fce10ce8700 1 -- 172.21.15.3:0/2725817144 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0400cca0 con 0x7fcdf8005140 2023-10-08T15:40:13.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.551+0000 7fce12cec700 1 -- 172.21.15.3:0/2725817144 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcdf8005140 msgr2=0x7fcdf800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:13.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.551+0000 7fce12cec700 1 --2- 172.21.15.3:0/2725817144 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcdf8005140 0x7fcdf800ba60 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fce04002120 tx=0x7fce040017a0 comp rx=0 tx=0).stop 2023-10-08T15:40:13.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.551+0000 7fce124eb700 1 -- 172.21.15.3:0/2725817144 reap_dead start 2023-10-08T15:40:13.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.551+0000 7fce12cec700 1 -- 172.21.15.3:0/2725817144 shutdown_connections 2023-10-08T15:40:13.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.551+0000 7fce12cec700 1 -- 172.21.15.3:0/2725817144 >> 172.21.15.3:0/2725817144 conn(0x7fce0c067b60 msgr2=0x7fce0c0be240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:13.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.551+0000 7fce12cec700 1 -- 172.21.15.3:0/2725817144 shutdown_connections 2023-10-08T15:40:13.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.551+0000 7fce12cec700 1 -- 172.21.15.3:0/2725817144 wait complete. 2023-10-08T15:40:13.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.551+0000 7fce12cec700 1 Processor -- start 2023-10-08T15:40:13.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.551+0000 7fce12cec700 1 -- start start 2023-10-08T15:40:13.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.551+0000 7fce12cec700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce0c0ba5f0 0x7fce0c0ba9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:13.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.551+0000 7fce12cec700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fce0c095b00 0x7fce0c097ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:13.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.551+0000 7fce12cec700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fce0c098430 0x7fce0c148620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:13.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.551+0000 7fce12cec700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0c0961a0 con 0x7fce0c095b00 2023-10-08T15:40:13.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.551+0000 7fce12cec700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0c0baf00 con 0x7fce0c0ba5f0 2023-10-08T15:40:13.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.551+0000 7fce12cec700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce0c0bb7f0 con 0x7fce0c098430 2023-10-08T15:40:13.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.551+0000 7fce114e9700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fce0c095b00 0x7fce0c097ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:13.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.551+0000 7fce114e9700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fce0c095b00 0x7fce0c097ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36262/0 (socket says 172.21.15.3:36262) 2023-10-08T15:40:13.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.551+0000 7fce114e9700 1 -- 172.21.15.3:0/3920563495 learned_addr learned my addr 172.21.15.3:0/3920563495 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:13.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.551+0000 7fce124eb700 1 --2- 172.21.15.3:0/3920563495 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fce0c098430 0x7fce0c148620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:13.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.551+0000 7fce11cea700 1 --2- 172.21.15.3:0/3920563495 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce0c0ba5f0 0x7fce0c0ba9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:13.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.551+0000 7fce114e9700 1 -- 172.21.15.3:0/3920563495 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fce0c098430 msgr2=0x7fce0c148620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:13.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.551+0000 7fce114e9700 1 --2- 172.21.15.3:0/3920563495 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fce0c098430 0x7fce0c148620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:13.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.551+0000 7fce114e9700 1 -- 172.21.15.3:0/3920563495 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce0c0ba5f0 msgr2=0x7fce0c0ba9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:13.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.551+0000 7fce114e9700 1 --2- 172.21.15.3:0/3920563495 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce0c0ba5f0 0x7fce0c0ba9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:13.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.551+0000 7fce114e9700 1 -- 172.21.15.3:0/3920563495 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce0c0979f0 con 0x7fce0c095b00 2023-10-08T15:40:13.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.551+0000 7fce11cea700 1 --2- 172.21.15.3:0/3920563495 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce0c0ba5f0 0x7fce0c0ba9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:40:13.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.555+0000 7fce114e9700 1 --2- 172.21.15.3:0/3920563495 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fce0c095b00 0x7fce0c097ef0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fce08011da0 tx=0x7fce080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:13.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.555+0000 7fcdfdffb700 1 -- 172.21.15.3:0/3920563495 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0800fa60 con 0x7fce0c095b00 2023-10-08T15:40:13.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.555+0000 7fcdfdffb700 1 -- 172.21.15.3:0/3920563495 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce0800fbc0 con 0x7fce0c095b00 2023-10-08T15:40:13.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.555+0000 7fce12cec700 1 -- 172.21.15.3:0/3920563495 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce0c0bba40 con 0x7fce0c095b00 2023-10-08T15:40:13.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.555+0000 7fcdfdffb700 1 -- 172.21.15.3:0/3920563495 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0801d480 con 0x7fce0c095b00 2023-10-08T15:40:13.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.555+0000 7fce12cec700 1 -- 172.21.15.3:0/3920563495 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce0c0988a0 con 0x7fce0c095b00 2023-10-08T15:40:13.562 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.555+0000 7fce12cec700 1 -- 172.21.15.3:0/3920563495 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce0c096310 con 0x7fce0c095b00 2023-10-08T15:40:13.562 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.555+0000 7fcdfdffb700 1 -- 172.21.15.3:0/3920563495 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fce0801d8b0 con 0x7fce0c095b00 2023-10-08T15:40:13.563 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.555+0000 7fcdfdffb700 1 --2- 172.21.15.3:0/3920563495 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fcdf0060550 0x7fcdf0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:13.563 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.555+0000 7fcdfdffb700 1 -- 172.21.15.3:0/3920563495 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5605+0+0 (secure 0 0 0) 0x7fce08018070 con 0x7fce0c095b00 2023-10-08T15:40:13.563 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.555+0000 7fce11cea700 1 --2- 172.21.15.3:0/3920563495 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fcdf0060550 0x7fcdf0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:13.563 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.559+0000 7fce11cea700 1 --2- 172.21.15.3:0/3920563495 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fcdf0060550 0x7fcdf0062a00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fce00001200 tx=0x7fce00009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:13.568 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.563+0000 7fcdfdffb700 1 -- 172.21.15.3:0/3920563495 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fce0c096310 con 0x7fce0c095b00 2023-10-08T15:40:13.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:13.759+0000 7fce12cec700 1 -- 172.21.15.3:0/3920563495 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fce0c0962e0 con 0x7fce0c095b00 2023-10-08T15:40:14.412 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.407+0000 7fcdfdffb700 1 -- 172.21.15.3:0/3920563495 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v17) v1 ==== 172+0+0 (secure 0 0 0) 0x7fce0804dbf0 con 0x7fce0c095b00 2023-10-08T15:40:14.434 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.431+0000 7fce12cec700 1 -- 172.21.15.3:0/3920563495 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fcdf0060550 msgr2=0x7fcdf0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:14.435 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.431+0000 7fce12cec700 1 --2- 172.21.15.3:0/3920563495 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fcdf0060550 0x7fcdf0062a00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fce00001200 tx=0x7fce00009040 comp rx=0 tx=0).stop 2023-10-08T15:40:14.435 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.431+0000 7fce12cec700 1 -- 172.21.15.3:0/3920563495 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fce0c095b00 msgr2=0x7fce0c097ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:14.435 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.431+0000 7fce12cec700 1 --2- 172.21.15.3:0/3920563495 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fce0c095b00 0x7fce0c097ef0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fce08011da0 tx=0x7fce080091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:14.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.431+0000 7fce12cec700 1 -- 172.21.15.3:0/3920563495 shutdown_connections 2023-10-08T15:40:14.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.431+0000 7fce12cec700 1 --2- 172.21.15.3:0/3920563495 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fcdf0060550 0x7fcdf0062a00 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:14.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.431+0000 7fce12cec700 1 --2- 172.21.15.3:0/3920563495 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fce0c098430 0x7fce0c148620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:14.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.431+0000 7fce12cec700 1 --2- 172.21.15.3:0/3920563495 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fce0c095b00 0x7fce0c097ef0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:14.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.431+0000 7fce12cec700 1 --2- 172.21.15.3:0/3920563495 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce0c0ba5f0 0x7fce0c0ba9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:14.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.431+0000 7fce12cec700 1 -- 172.21.15.3:0/3920563495 >> 172.21.15.3:0/3920563495 conn(0x7fce0c067b60 msgr2=0x7fce0c14d260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:14.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.435+0000 7fce12cec700 1 -- 172.21.15.3:0/3920563495 shutdown_connections 2023-10-08T15:40:14.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.435+0000 7fce12cec700 1 -- 172.21.15.3:0/3920563495 wait complete. 2023-10-08T15:40:14.441 INFO:teuthology.orchestra.run.smithi003.stderr:new fs with metadata pool 6 and data pool 7 2023-10-08T15:40:14.454 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:40:14.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.551+0000 7f80bffff700 1 Processor -- start 2023-10-08T15:40:14.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.551+0000 7f80bffff700 1 -- start start 2023-10-08T15:40:14.555 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.551+0000 7f80bffff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f80c00bacf0 0x7f80c0153860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:14.555 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.551+0000 7f80bffff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f80c00bb0c0 0x7f80c01502c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:14.555 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.551+0000 7f80bffff700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80c014fe30 con 0x7f80c009e520 2023-10-08T15:40:14.555 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.551+0000 7f80bffff700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80c009f0e0 con 0x7f80c00bb0c0 2023-10-08T15:40:14.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.551+0000 7f80bffff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80c014f8b0 con 0x7f80c00bacf0 2023-10-08T15:40:14.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.551+0000 7f80bf7fe700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f80c009e520 0x7f80c006c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:47606/0 (socket says 172.21.15.3:47606) 2023-10-08T15:40:14.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.551+0000 7f80be7fc700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f80c00bb0c0 0x7f80c01502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:14.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.551+0000 7f80bf7fe700 1 -- 172.21.15.3:0/3954748661 learned_addr learned my addr 172.21.15.3:0/3954748661 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:40:14.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.551+0000 7f80beffd700 1 --2- 172.21.15.3:0/3954748661 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f80c00bacf0 0x7f80c0153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:14.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.551+0000 7f80bdffb700 1 -- 172.21.15.3:0/3954748661 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2081411719 0 0) 0x7f80c014fe30 con 0x7f80c009e520 2023-10-08T15:40:14.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.551+0000 7f80be7fc700 1 -- 172.21.15.3:0/3954748661 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f80c00bacf0 msgr2=0x7f80c0153860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:14.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.551+0000 7f80be7fc700 1 --2- 172.21.15.3:0/3954748661 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f80c00bacf0 0x7f80c0153860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:14.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.551+0000 7f80be7fc700 1 -- 172.21.15.3:0/3954748661 >> v1:172.21.15.3:6789/0 conn(0x7f80c009e520 legacy=0x7f80c006c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:14.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.551+0000 7f80be7fc700 1 -- 172.21.15.3:0/3954748661 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c014fac0 con 0x7f80c00bb0c0 2023-10-08T15:40:14.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.551+0000 7f80be7fc700 1 --2- 172.21.15.3:0/3954748661 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80c00bb0c0 0x7f80c01502c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f80b0009e60 tx=0x7f80b0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d85ee7de9c19503f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:14.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.551+0000 7f80bdffb700 1 -- 172.21.15.3:0/3954748661 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b000e070 con 0x7f80c00bb0c0 2023-10-08T15:40:14.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.551+0000 7f80bdffb700 1 -- 172.21.15.3:0/3954748661 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b000bb60 con 0x7f80c00bb0c0 2023-10-08T15:40:14.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.551+0000 7f80bdffb700 1 -- 172.21.15.3:0/3954748661 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b0012430 con 0x7f80c00bb0c0 2023-10-08T15:40:14.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.555+0000 7f80bffff700 1 -- 172.21.15.3:0/3954748661 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80c00bb0c0 msgr2=0x7f80c01502c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:14.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.555+0000 7f80bffff700 1 --2- 172.21.15.3:0/3954748661 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80c00bb0c0 0x7f80c01502c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f80b0009e60 tx=0x7f80b0009780 comp rx=0 tx=0).stop 2023-10-08T15:40:14.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.555+0000 7f80bffff700 1 -- 172.21.15.3:0/3954748661 shutdown_connections 2023-10-08T15:40:14.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.555+0000 7f80bffff700 1 --2- 172.21.15.3:0/3954748661 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80c00bb0c0 0x7f80c01502c0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:14.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.555+0000 7f80bffff700 1 --2- 172.21.15.3:0/3954748661 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f80c00bacf0 0x7f80c0153860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:14.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.555+0000 7f80bffff700 1 -- 172.21.15.3:0/3954748661 >> 172.21.15.3:0/3954748661 conn(0x7f80c00be4a0 msgr2=0x7f80c00ba440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:14.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.555+0000 7f80bffff700 1 -- 172.21.15.3:0/3954748661 shutdown_connections 2023-10-08T15:40:14.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.555+0000 7f80bffff700 1 -- 172.21.15.3:0/3954748661 wait complete. 2023-10-08T15:40:14.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.555+0000 7f80bffff700 1 Processor -- start 2023-10-08T15:40:14.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.555+0000 7f80bffff700 1 -- start start 2023-10-08T15:40:14.563 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.559+0000 7f80bffff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f80c009e520 0x7f80c0153350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:14.563 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.559+0000 7f80bffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80c00bacf0 0x7f80c0149660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:14.563 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.559+0000 7f80bffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80c00bb0c0 0x7f80c0149ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:14.563 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.559+0000 7f80bffff700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c0163460 con 0x7f80c00bacf0 2023-10-08T15:40:14.563 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.559+0000 7f80bffff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c0153890 con 0x7f80c00bb0c0 2023-10-08T15:40:14.563 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.559+0000 7f80bffff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80c01630f0 con 0x7f80c009e520 2023-10-08T15:40:14.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.559+0000 7f80be7fc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80c00bacf0 0x7f80c0149660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:14.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.559+0000 7f80be7fc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80c00bacf0 0x7f80c0149660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36284/0 (socket says 172.21.15.3:36284) 2023-10-08T15:40:14.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.559+0000 7f80be7fc700 1 -- 172.21.15.3:0/371213923 learned_addr learned my addr 172.21.15.3:0/371213923 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:14.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.559+0000 7f80beffd700 1 --2- 172.21.15.3:0/371213923 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f80c009e520 0x7f80c0153350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:14.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.559+0000 7f80bf7fe700 1 --2- 172.21.15.3:0/371213923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80c00bb0c0 0x7f80c0149ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:14.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.559+0000 7f80be7fc700 1 -- 172.21.15.3:0/371213923 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f80c009e520 msgr2=0x7f80c0153350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:14.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.559+0000 7f80be7fc700 1 --2- 172.21.15.3:0/371213923 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f80c009e520 0x7f80c0153350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:14.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.559+0000 7f80be7fc700 1 -- 172.21.15.3:0/371213923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80c00bb0c0 msgr2=0x7f80c0149ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:14.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.559+0000 7f80be7fc700 1 --2- 172.21.15.3:0/371213923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80c00bb0c0 0x7f80c0149ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:14.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.559+0000 7f80be7fc700 1 -- 172.21.15.3:0/371213923 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b0009a20 con 0x7f80c00bacf0 2023-10-08T15:40:14.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.559+0000 7f80beffd700 1 --2- 172.21.15.3:0/371213923 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f80c009e520 0x7f80c0153350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:40:14.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.559+0000 7f80be7fc700 1 --2- 172.21.15.3:0/371213923 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80c00bacf0 0x7f80c0149660 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f80b0013000 tx=0x7f80b0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:14.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.559+0000 7f80b6ffd700 1 -- 172.21.15.3:0/371213923 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b0012de0 con 0x7f80c00bacf0 2023-10-08T15:40:14.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.559+0000 7f80b6ffd700 1 -- 172.21.15.3:0/371213923 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b0027470 con 0x7f80c00bacf0 2023-10-08T15:40:14.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.559+0000 7f80bffff700 1 -- 172.21.15.3:0/371213923 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80c0156460 con 0x7f80c00bacf0 2023-10-08T15:40:14.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.559+0000 7f80b6ffd700 1 -- 172.21.15.3:0/371213923 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b0027830 con 0x7f80c00bacf0 2023-10-08T15:40:14.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.559+0000 7f80bffff700 1 -- 172.21.15.3:0/371213923 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80c014a890 con 0x7f80c00bacf0 2023-10-08T15:40:14.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.559+0000 7f80bffff700 1 -- 172.21.15.3:0/371213923 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80c0162f50 con 0x7f80c00bacf0 2023-10-08T15:40:14.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.563+0000 7f80b6ffd700 1 -- 172.21.15.3:0/371213923 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f80b0024070 con 0x7f80c00bacf0 2023-10-08T15:40:14.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.563+0000 7f80b6ffd700 1 --2- 172.21.15.3:0/371213923 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f80a0060580 0x7f80a0062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:14.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.563+0000 7f80b6ffd700 1 -- 172.21.15.3:0/371213923 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f80b007ee30 con 0x7f80c00bacf0 2023-10-08T15:40:14.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.563+0000 7f80beffd700 1 --2- 172.21.15.3:0/371213923 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f80a0060580 0x7f80a0062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:14.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.563+0000 7f80beffd700 1 --2- 172.21.15.3:0/371213923 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f80a0060580 0x7f80a0062a30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f80a8009d80 tx=0x7f80a8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:14.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.567+0000 7f80b6ffd700 1 -- 172.21.15.3:0/371213923 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f80c0162f50 con 0x7f80c00bacf0 2023-10-08T15:40:14.736 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.731+0000 7f80bffff700 1 -- 172.21.15.3:0/371213923 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f80c0162f50 con 0x7f80c00bacf0 2023-10-08T15:40:14.738 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.735+0000 7f80b6ffd700 1 -- 172.21.15.3:0/371213923 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+15267 (secure 0 0 0) 0x7f80c0162f50 con 0x7f80c00bacf0 2023-10-08T15:40:14.738 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:40:14.738 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":38,"fsid":"7635972e-cd66-4a8f-a231-378db8b3847a","created":"2023-10-08T15:37:08.234594+0000","modified":"2023-10-08T15:40:13.764458+0000","last_up_change":"2023-10-08T15:37:17.537726+0000","last_in_change":"2023-10-08T15:37:10.269178+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:37:16.581590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:40:12.013806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-08T15:40:12.747398+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"64fb1864-bfdd-4d75-9b41-03fb60085dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33363},{"type":"v1","addr":"172.21.15.3:6801","nonce":33363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33363},{"type":"v1","addr":"172.21.15.3:6803","nonce":33363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":33363},{"type":"v1","addr":"172.21.15.3:6807","nonce":33363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33363},{"type":"v1","addr":"172.21.15.3:6805","nonce":33363}]},"public_addr":"172.21.15.3:6801/33363","cluster_addr":"172.21.15.3:6803/33363","heartbeat_back_addr":"172.21.15.3:6807/33363","heartbeat_front_addr":"172.21.15.3:6805/33363","state":["exists","up"]},{"osd":1,"uuid":"3ca6bd3a-3e8a-4c65-af9c-46148b0c2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33364},{"type":"v1","addr":"172.21.15.3:6820","nonce":33364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33364},{"type":"v1","addr":"172.21.15.3:6824","nonce":33364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33364},{"type":"v1","addr":"172.21.15.3:6831","nonce":33364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33364},{"type":"v1","addr":"172.21.15.3:6828","nonce":33364}]},"public_addr":"172.21.15.3:6820/33364","cluster_addr":"172.21.15.3:6824/33364","heartbeat_back_addr":"172.21.15.3:6831/33364","heartbeat_front_addr":"172.21.15.3:6828/33364","state":["exists","up"]},{"osd":2,"uuid":"6eb9f757-58dd-442f-910d-32401454bce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33366},{"type":"v1","addr":"172.21.15.3:6817","nonce":33366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":33366},{"type":"v1","addr":"172.21.15.3:6821","nonce":33366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6827","nonce":33366},{"type":"v1","addr":"172.21.15.3:6829","nonce":33366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":33366},{"type":"v1","addr":"172.21.15.3:6825","nonce":33366}]},"public_addr":"172.21.15.3:6817/33366","cluster_addr":"172.21.15.3:6821/33366","heartbeat_back_addr":"172.21.15.3:6829/33366","heartbeat_front_addr":"172.21.15.3:6825/33366","state":["exists","up"]},{"osd":3,"uuid":"1c39866b-ac2e-4ea9-a69c-02b01ee4191d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33365},{"type":"v1","addr":"172.21.15.3:6809","nonce":33365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":33365},{"type":"v1","addr":"172.21.15.3:6811","nonce":33365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33365},{"type":"v1","addr":"172.21.15.3:6815","nonce":33365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":33365},{"type":"v1","addr":"172.21.15.3:6813","nonce":33365}]},"public_addr":"172.21.15.3:6809/33365","cluster_addr":"172.21.15.3:6811/33365","heartbeat_back_addr":"172.21.15.3:6815/33365","heartbeat_front_addr":"172.21.15.3:6813/33365","state":["exists","up"]},{"osd":4,"uuid":"15f86b61-b7f1-4780-ae00-9d80a68cb830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":33605},{"type":"v1","addr":"172.21.15.50:6809","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33605},{"type":"v1","addr":"172.21.15.50:6811","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33605},{"type":"v1","addr":"172.21.15.50:6815","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":33605},{"type":"v1","addr":"172.21.15.50:6813","nonce":33605}]},"public_addr":"172.21.15.50:6809/33605","cluster_addr":"172.21.15.50:6811/33605","heartbeat_back_addr":"172.21.15.50:6815/33605","heartbeat_front_addr":"172.21.15.50:6813/33605","state":["exists","up"]},{"osd":5,"uuid":"726c3003-34e6-4d5a-b6e2-f911e13c2118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33606},{"type":"v1","addr":"172.21.15.50:6801","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33606},{"type":"v1","addr":"172.21.15.50:6803","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33606},{"type":"v1","addr":"172.21.15.50:6807","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":33606},{"type":"v1","addr":"172.21.15.50:6805","nonce":33606}]},"public_addr":"172.21.15.50:6801/33606","cluster_addr":"172.21.15.50:6803/33606","heartbeat_back_addr":"172.21.15.50:6807/33606","heartbeat_front_addr":"172.21.15.50:6805/33606","state":["exists","up"]},{"osd":6,"uuid":"401122a4-9988-441f-a5a7-39164434ebcd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":33607},{"type":"v1","addr":"172.21.15.50:6819","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":33607},{"type":"v1","addr":"172.21.15.50:6823","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":33607},{"type":"v1","addr":"172.21.15.50:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":33607},{"type":"v1","addr":"172.21.15.50:6827","nonce":33607}]},"public_addr":"172.21.15.50:6819/33607","cluster_addr":"172.21.15.50:6823/33607","heartbeat_back_addr":"172.21.15.50:6831/33607","heartbeat_front_addr":"172.21.15.50:6827/33607","state":["exists","up"]},{"osd":7,"uuid":"6b3fa236-c9d0-4c4d-82ae-9af4daf6d699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33604},{"type":"v1","addr":"172.21.15.50:6818","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":33604},{"type":"v1","addr":"172.21.15.50:6822","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":33604},{"type":"v1","addr":"172.21.15.50:6830","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":33604},{"type":"v1","addr":"172.21.15.50:6826","nonce":33604}]},"public_addr":"172.21.15.50:6818/33604","cluster_addr":"172.21.15.50:6822/33604","heartbeat_back_addr":"172.21.15.50:6830/33604","heartbeat_front_addr":"172.21.15.50:6826/33604","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.497794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.529417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.873426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.325972+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.443971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.240795+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.739632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.643026+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:40:14.740 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.735+0000 7f80bffff700 1 -- 172.21.15.3:0/371213923 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f80a0060580 msgr2=0x7f80a0062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:14.741 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.735+0000 7f80bffff700 1 --2- 172.21.15.3:0/371213923 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f80a0060580 0x7f80a0062a30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f80a8009d80 tx=0x7f80a8008040 comp rx=0 tx=0).stop 2023-10-08T15:40:14.741 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.735+0000 7f80bffff700 1 -- 172.21.15.3:0/371213923 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80c00bacf0 msgr2=0x7f80c0149660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:14.741 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.735+0000 7f80bffff700 1 --2- 172.21.15.3:0/371213923 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80c00bacf0 0x7f80c0149660 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f80b0013000 tx=0x7f80b0019000 comp rx=0 tx=0).stop 2023-10-08T15:40:14.741 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.735+0000 7f80bffff700 1 -- 172.21.15.3:0/371213923 shutdown_connections 2023-10-08T15:40:14.741 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.735+0000 7f80bffff700 1 --2- 172.21.15.3:0/371213923 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f80a0060580 0x7f80a0062a30 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:14.741 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.735+0000 7f80bffff700 1 --2- 172.21.15.3:0/371213923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80c00bb0c0 0x7f80c0149ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:14.741 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.735+0000 7f80bffff700 1 --2- 172.21.15.3:0/371213923 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80c00bacf0 0x7f80c0149660 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:14.741 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.735+0000 7f80bffff700 1 --2- 172.21.15.3:0/371213923 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f80c009e520 0x7f80c0153350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:14.741 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.735+0000 7f80bffff700 1 -- 172.21.15.3:0/371213923 >> 172.21.15.3:0/371213923 conn(0x7f80c00be4a0 msgr2=0x7f80c00bd0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:14.741 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.735+0000 7f80bffff700 1 -- 172.21.15.3:0/371213923 shutdown_connections 2023-10-08T15:40:14.742 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.735+0000 7f80bffff700 1 -- 172.21.15.3:0/371213923 wait complete. 2023-10-08T15:40:14.754 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:40:14.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.859+0000 7f44b9e7f700 1 Processor -- start 2023-10-08T15:40:14.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.859+0000 7f44b9e7f700 1 -- start start 2023-10-08T15:40:14.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.859+0000 7f44b9e7f700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f44b414a080 0x7f44b40baf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:14.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.859+0000 7f44b9e7f700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f44b406df30 0x7f44b414c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:14.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.859+0000 7f44b9e7f700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44b40b4050 con 0x7f44b40bab50 2023-10-08T15:40:14.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.859+0000 7f44b9e7f700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44b4146da0 con 0x7f44b414a080 2023-10-08T15:40:14.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.859+0000 7f44b9e7f700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44b40b4710 con 0x7f44b406df30 2023-10-08T15:40:14.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.859+0000 7f44b3fff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f44b414a080 0x7f44b40baf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:14.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.859+0000 7f44b3fff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f44b414a080 0x7f44b40baf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36288/0 (socket says 172.21.15.3:36288) 2023-10-08T15:40:14.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.859+0000 7f44b3fff700 1 -- 172.21.15.3:0/2648362199 learned_addr learned my addr 172.21.15.3:0/2648362199 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:14.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.859+0000 7f44b967e700 1 --2- 172.21.15.3:0/2648362199 >> v2:172.21.15.50:3300/0 conn(0x7f44b406df30 0x7f44b414c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:14.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.859+0000 7f44b3fff700 1 -- 172.21.15.3:0/2648362199 >> v2:172.21.15.50:3300/0 conn(0x7f44b406df30 msgr2=0x7f44b414c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:14.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.859+0000 7f44b3fff700 1 --2- 172.21.15.3:0/2648362199 >> v2:172.21.15.50:3300/0 conn(0x7f44b406df30 0x7f44b414c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:14.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.859+0000 7f44b3fff700 1 -- 172.21.15.3:0/2648362199 >> v1:172.21.15.50:6789/0 conn(0x7f44b40bab50 legacy=0x7f44b4149970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:14.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.859+0000 7f44b3fff700 1 -- 172.21.15.3:0/2648362199 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b40b4330 con 0x7f44b414a080 2023-10-08T15:40:14.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.859+0000 7f44b3fff700 1 --2- 172.21.15.3:0/2648362199 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f44b414a080 0x7f44b40baf20 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f44b40bb6e0 tx=0x7f44ac009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f46ac1a748119f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:14.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.859+0000 7f44b37fe700 1 -- 172.21.15.3:0/2648362199 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ac00e070 con 0x7f44b414a080 2023-10-08T15:40:14.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.859+0000 7f44b37fe700 1 -- 172.21.15.3:0/2648362199 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44ac00ba20 con 0x7f44b414a080 2023-10-08T15:40:14.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.859+0000 7f44b37fe700 1 -- 172.21.15.3:0/2648362199 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ac0092e0 con 0x7f44b414a080 2023-10-08T15:40:14.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.863+0000 7f44b9e7f700 1 -- 172.21.15.3:0/2648362199 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f44b414a080 msgr2=0x7f44b40baf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:14.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.863+0000 7f44b9e7f700 1 --2- 172.21.15.3:0/2648362199 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f44b414a080 0x7f44b40baf20 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f44b40bb6e0 tx=0x7f44ac009840 comp rx=0 tx=0).stop 2023-10-08T15:40:14.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.863+0000 7f44b9e7f700 1 -- 172.21.15.3:0/2648362199 shutdown_connections 2023-10-08T15:40:14.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.863+0000 7f44b9e7f700 1 --2- 172.21.15.3:0/2648362199 >> v2:172.21.15.50:3300/0 conn(0x7f44b406df30 0x7f44b414c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:14.867 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.863+0000 7f44b9e7f700 1 --2- 172.21.15.3:0/2648362199 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f44b414a080 0x7f44b40baf20 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:14.867 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.863+0000 7f44b9e7f700 1 -- 172.21.15.3:0/2648362199 >> 172.21.15.3:0/2648362199 conn(0x7f44b40be4a0 msgr2=0x7f44b40ba440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:14.867 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.863+0000 7f44b9e7f700 1 -- 172.21.15.3:0/2648362199 shutdown_connections 2023-10-08T15:40:14.867 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.863+0000 7f44b9e7f700 1 -- 172.21.15.3:0/2648362199 wait complete. 2023-10-08T15:40:14.868 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.863+0000 7f44b9e7f700 1 Processor -- start 2023-10-08T15:40:14.868 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.863+0000 7f44b9e7f700 1 -- start start 2023-10-08T15:40:14.870 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.863+0000 7f44b9e7f700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f44b406df30 0x7f44b40b9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:14.870 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.863+0000 7f44b9e7f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44b40bab50 0x7f44b414b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:14.870 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.863+0000 7f44b9e7f700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f44b414a080 0x7f44b414b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:14.870 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.863+0000 7f44b9e7f700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b414d9a0 con 0x7f44b414a080 2023-10-08T15:40:14.870 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.863+0000 7f44b9e7f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b414dc80 con 0x7f44b40bab50 2023-10-08T15:40:14.870 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.863+0000 7f44b9e7f700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44b40b9690 con 0x7f44b406df30 2023-10-08T15:40:14.873 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.863+0000 7f44b967e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f44b414a080 0x7f44b414b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:14.873 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.863+0000 7f44b967e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f44b414a080 0x7f44b414b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36304/0 (socket says 172.21.15.3:36304) 2023-10-08T15:40:14.873 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.867+0000 7f44b967e700 1 -- 172.21.15.3:0/2953443828 learned_addr learned my addr 172.21.15.3:0/2953443828 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:14.873 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.867+0000 7f44b8e7d700 1 --2- 172.21.15.3:0/2953443828 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f44b406df30 0x7f44b40b9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:14.873 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.867+0000 7f44b3fff700 1 --2- 172.21.15.3:0/2953443828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44b40bab50 0x7f44b414b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:14.873 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.867+0000 7f44b967e700 1 -- 172.21.15.3:0/2953443828 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f44b406df30 msgr2=0x7f44b40b9150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:14.873 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.867+0000 7f44b967e700 1 --2- 172.21.15.3:0/2953443828 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f44b406df30 0x7f44b40b9150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:14.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.867+0000 7f44b967e700 1 -- 172.21.15.3:0/2953443828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44b40bab50 msgr2=0x7f44b414b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:14.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.867+0000 7f44b967e700 1 --2- 172.21.15.3:0/2953443828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44b40bab50 0x7f44b414b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:14.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.867+0000 7f44b967e700 1 -- 172.21.15.3:0/2953443828 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44ac009ae0 con 0x7f44b414a080 2023-10-08T15:40:14.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.867+0000 7f44b967e700 1 --2- 172.21.15.3:0/2953443828 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f44b414a080 0x7f44b414b5a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f44a400ea80 tx=0x7f44a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:14.875 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.867+0000 7f44b0ff9700 1 -- 172.21.15.3:0/2953443828 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a400eec0 con 0x7f44b414a080 2023-10-08T15:40:14.875 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.867+0000 7f44b0ff9700 1 -- 172.21.15.3:0/2953443828 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a400c7f0 con 0x7f44b414a080 2023-10-08T15:40:14.875 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.867+0000 7f44b9e7f700 1 -- 172.21.15.3:0/2953443828 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44b415d010 con 0x7f44b414a080 2023-10-08T15:40:14.875 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.867+0000 7f44b0ff9700 1 -- 172.21.15.3:0/2953443828 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a400cbb0 con 0x7f44b414a080 2023-10-08T15:40:14.875 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.867+0000 7f44b9e7f700 1 -- 172.21.15.3:0/2953443828 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44b414c9e0 con 0x7f44b414a080 2023-10-08T15:40:14.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.867+0000 7f44b9e7f700 1 -- 172.21.15.3:0/2953443828 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44b414de10 con 0x7f44b414a080 2023-10-08T15:40:14.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.871+0000 7f44b0ff9700 1 -- 172.21.15.3:0/2953443828 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f44a4013470 con 0x7f44b414a080 2023-10-08T15:40:14.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.871+0000 7f44b0ff9700 1 --2- 172.21.15.3:0/2953443828 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4494060550 0x7f4494062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:14.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.871+0000 7f44b0ff9700 1 -- 172.21.15.3:0/2953443828 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f44a407c970 con 0x7f44b414a080 2023-10-08T15:40:14.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.871+0000 7f44b8e7d700 1 --2- 172.21.15.3:0/2953443828 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4494060550 0x7f4494062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:14.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.871+0000 7f44b8e7d700 1 --2- 172.21.15.3:0/2953443828 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4494060550 0x7f4494062a00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f449c003aa0 tx=0x7f449c000bc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:14.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:14.875+0000 7f44b0ff9700 1 -- 172.21.15.3:0/2953443828 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f44a404cf60 con 0x7f44b414a080 2023-10-08T15:40:15.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.039+0000 7f44b9e7f700 1 -- 172.21.15.3:0/2953443828 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f44b405ecf0 con 0x7f44b414a080 2023-10-08T15:40:15.047 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.043+0000 7f44b0ff9700 1 -- 172.21.15.3:0/2953443828 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+15267 (secure 0 0 0) 0x7f44a4050580 con 0x7f44b414a080 2023-10-08T15:40:15.047 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:40:15.047 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":38,"fsid":"7635972e-cd66-4a8f-a231-378db8b3847a","created":"2023-10-08T15:37:08.234594+0000","modified":"2023-10-08T15:40:13.764458+0000","last_up_change":"2023-10-08T15:37:17.537726+0000","last_in_change":"2023-10-08T15:37:10.269178+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:37:16.581590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:40:12.013806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-08T15:40:12.747398+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"64fb1864-bfdd-4d75-9b41-03fb60085dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33363},{"type":"v1","addr":"172.21.15.3:6801","nonce":33363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33363},{"type":"v1","addr":"172.21.15.3:6803","nonce":33363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":33363},{"type":"v1","addr":"172.21.15.3:6807","nonce":33363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33363},{"type":"v1","addr":"172.21.15.3:6805","nonce":33363}]},"public_addr":"172.21.15.3:6801/33363","cluster_addr":"172.21.15.3:6803/33363","heartbeat_back_addr":"172.21.15.3:6807/33363","heartbeat_front_addr":"172.21.15.3:6805/33363","state":["exists","up"]},{"osd":1,"uuid":"3ca6bd3a-3e8a-4c65-af9c-46148b0c2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33364},{"type":"v1","addr":"172.21.15.3:6820","nonce":33364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33364},{"type":"v1","addr":"172.21.15.3:6824","nonce":33364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33364},{"type":"v1","addr":"172.21.15.3:6831","nonce":33364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33364},{"type":"v1","addr":"172.21.15.3:6828","nonce":33364}]},"public_addr":"172.21.15.3:6820/33364","cluster_addr":"172.21.15.3:6824/33364","heartbeat_back_addr":"172.21.15.3:6831/33364","heartbeat_front_addr":"172.21.15.3:6828/33364","state":["exists","up"]},{"osd":2,"uuid":"6eb9f757-58dd-442f-910d-32401454bce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33366},{"type":"v1","addr":"172.21.15.3:6817","nonce":33366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":33366},{"type":"v1","addr":"172.21.15.3:6821","nonce":33366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6827","nonce":33366},{"type":"v1","addr":"172.21.15.3:6829","nonce":33366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":33366},{"type":"v1","addr":"172.21.15.3:6825","nonce":33366}]},"public_addr":"172.21.15.3:6817/33366","cluster_addr":"172.21.15.3:6821/33366","heartbeat_back_addr":"172.21.15.3:6829/33366","heartbeat_front_addr":"172.21.15.3:6825/33366","state":["exists","up"]},{"osd":3,"uuid":"1c39866b-ac2e-4ea9-a69c-02b01ee4191d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33365},{"type":"v1","addr":"172.21.15.3:6809","nonce":33365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":33365},{"type":"v1","addr":"172.21.15.3:6811","nonce":33365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33365},{"type":"v1","addr":"172.21.15.3:6815","nonce":33365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":33365},{"type":"v1","addr":"172.21.15.3:6813","nonce":33365}]},"public_addr":"172.21.15.3:6809/33365","cluster_addr":"172.21.15.3:6811/33365","heartbeat_back_addr":"172.21.15.3:6815/33365","heartbeat_front_addr":"172.21.15.3:6813/33365","state":["exists","up"]},{"osd":4,"uuid":"15f86b61-b7f1-4780-ae00-9d80a68cb830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":33605},{"type":"v1","addr":"172.21.15.50:6809","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33605},{"type":"v1","addr":"172.21.15.50:6811","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33605},{"type":"v1","addr":"172.21.15.50:6815","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":33605},{"type":"v1","addr":"172.21.15.50:6813","nonce":33605}]},"public_addr":"172.21.15.50:6809/33605","cluster_addr":"172.21.15.50:6811/33605","heartbeat_back_addr":"172.21.15.50:6815/33605","heartbeat_front_addr":"172.21.15.50:6813/33605","state":["exists","up"]},{"osd":5,"uuid":"726c3003-34e6-4d5a-b6e2-f911e13c2118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33606},{"type":"v1","addr":"172.21.15.50:6801","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33606},{"type":"v1","addr":"172.21.15.50:6803","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33606},{"type":"v1","addr":"172.21.15.50:6807","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":33606},{"type":"v1","addr":"172.21.15.50:6805","nonce":33606}]},"public_addr":"172.21.15.50:6801/33606","cluster_addr":"172.21.15.50:6803/33606","heartbeat_back_addr":"172.21.15.50:6807/33606","heartbeat_front_addr":"172.21.15.50:6805/33606","state":["exists","up"]},{"osd":6,"uuid":"401122a4-9988-441f-a5a7-39164434ebcd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":33607},{"type":"v1","addr":"172.21.15.50:6819","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":33607},{"type":"v1","addr":"172.21.15.50:6823","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":33607},{"type":"v1","addr":"172.21.15.50:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":33607},{"type":"v1","addr":"172.21.15.50:6827","nonce":33607}]},"public_addr":"172.21.15.50:6819/33607","cluster_addr":"172.21.15.50:6823/33607","heartbeat_back_addr":"172.21.15.50:6831/33607","heartbeat_front_addr":"172.21.15.50:6827/33607","state":["exists","up"]},{"osd":7,"uuid":"6b3fa236-c9d0-4c4d-82ae-9af4daf6d699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33604},{"type":"v1","addr":"172.21.15.50:6818","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":33604},{"type":"v1","addr":"172.21.15.50:6822","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":33604},{"type":"v1","addr":"172.21.15.50:6830","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":33604},{"type":"v1","addr":"172.21.15.50:6826","nonce":33604}]},"public_addr":"172.21.15.50:6818/33604","cluster_addr":"172.21.15.50:6822/33604","heartbeat_back_addr":"172.21.15.50:6830/33604","heartbeat_front_addr":"172.21.15.50:6826/33604","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.497794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.529417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.873426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.325972+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.443971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.240795+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.739632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.643026+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:40:15.049 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.043+0000 7f44b9e7f700 1 -- 172.21.15.3:0/2953443828 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4494060550 msgr2=0x7f4494062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:15.049 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.047+0000 7f44b9e7f700 1 --2- 172.21.15.3:0/2953443828 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4494060550 0x7f4494062a00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f449c003aa0 tx=0x7f449c000bc0 comp rx=0 tx=0).stop 2023-10-08T15:40:15.050 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.047+0000 7f44b9e7f700 1 -- 172.21.15.3:0/2953443828 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f44b414a080 msgr2=0x7f44b414b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:15.050 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.047+0000 7f44b9e7f700 1 --2- 172.21.15.3:0/2953443828 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f44b414a080 0x7f44b414b5a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f44a400ea80 tx=0x7f44a40091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:15.050 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.047+0000 7f44b9e7f700 1 -- 172.21.15.3:0/2953443828 shutdown_connections 2023-10-08T15:40:15.050 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.047+0000 7f44b9e7f700 1 --2- 172.21.15.3:0/2953443828 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4494060550 0x7f4494062a00 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:15.050 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.047+0000 7f44b9e7f700 1 --2- 172.21.15.3:0/2953443828 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f44b414a080 0x7f44b414b5a0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:15.050 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.047+0000 7f44b9e7f700 1 --2- 172.21.15.3:0/2953443828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44b40bab50 0x7f44b414b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:15.050 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.047+0000 7f44b9e7f700 1 --2- 172.21.15.3:0/2953443828 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f44b406df30 0x7f44b40b9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:15.050 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.047+0000 7f44b9e7f700 1 -- 172.21.15.3:0/2953443828 >> 172.21.15.3:0/2953443828 conn(0x7f44b40be4a0 msgr2=0x7f44b4067f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:15.050 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.047+0000 7f44b9e7f700 1 -- 172.21.15.3:0/2953443828 shutdown_connections 2023-10-08T15:40:15.050 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.047+0000 7f44b9e7f700 1 -- 172.21.15.3:0/2953443828 wait complete. 2023-10-08T15:40:15.063 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T15:40:15.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.171+0000 7f8caa9cd700 1 Processor -- start 2023-10-08T15:40:15.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.171+0000 7f8caa9cd700 1 -- start start 2023-10-08T15:40:15.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.171+0000 7f8caa9cd700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f8ca406c830 0x7f8ca406d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:15.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.171+0000 7f8caa9cd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8ca414a8a0 0x7f8ca414acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:15.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.171+0000 7f8caa9cd700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ca414c0e0 con 0x7f8ca40bf3a0 2023-10-08T15:40:15.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.171+0000 7f8caa9cd700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ca414c570 con 0x7f8ca406c830 2023-10-08T15:40:15.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.171+0000 7f8caa9cd700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ca414ba90 con 0x7f8ca414a8a0 2023-10-08T15:40:15.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.171+0000 7f8ca3fff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f8ca40bf3a0 0x7f8ca406cf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:47620/0 (socket says 172.21.15.3:47620) 2023-10-08T15:40:15.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.171+0000 7f8ca3fff700 1 -- 172.21.15.3:0/880111585 learned_addr learned my addr 172.21.15.3:0/880111585 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:40:15.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.171+0000 7f8ca37fe700 1 --2- 172.21.15.3:0/880111585 >> v2:172.21.15.3:3300/0 conn(0x7f8ca406c830 0x7f8ca406d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:15.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.171+0000 7f8ca8f6a700 1 --2- 172.21.15.3:0/880111585 >> v2:172.21.15.50:3300/0 conn(0x7f8ca414a8a0 0x7f8ca414acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:15.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.171+0000 7f8ca2ffd700 1 -- 172.21.15.3:0/880111585 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2487273461 0 0) 0x7f8ca414c0e0 con 0x7f8ca40bf3a0 2023-10-08T15:40:15.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.171+0000 7f8ca2ffd700 1 -- 172.21.15.3:0/880111585 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c90003570 con 0x7f8ca40bf3a0 2023-10-08T15:40:15.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.171+0000 7f8ca37fe700 1 -- 172.21.15.3:0/880111585 >> v2:172.21.15.50:3300/0 conn(0x7f8ca414a8a0 msgr2=0x7f8ca414acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:15.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.171+0000 7f8ca37fe700 1 --2- 172.21.15.3:0/880111585 >> v2:172.21.15.50:3300/0 conn(0x7f8ca414a8a0 0x7f8ca414acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:15.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.171+0000 7f8ca37fe700 1 -- 172.21.15.3:0/880111585 >> v1:172.21.15.3:6789/0 conn(0x7f8ca40bf3a0 legacy=0x7f8ca406cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:15.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.171+0000 7f8ca37fe700 1 -- 172.21.15.3:0/880111585 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca414bd70 con 0x7f8ca406c830 2023-10-08T15:40:15.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.171+0000 7f8ca37fe700 1 --2- 172.21.15.3:0/880111585 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8ca406c830 0x7f8ca406d660 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8ca40bfd00 tx=0x7f8c8c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4a69a7359343452 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:15.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.175+0000 7f8ca2ffd700 1 -- 172.21.15.3:0/880111585 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c011630 con 0x7f8ca406c830 2023-10-08T15:40:15.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.175+0000 7f8ca2ffd700 1 -- 172.21.15.3:0/880111585 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c8c0117b0 con 0x7f8ca406c830 2023-10-08T15:40:15.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.175+0000 7f8ca2ffd700 1 -- 172.21.15.3:0/880111585 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c011b70 con 0x7f8ca406c830 2023-10-08T15:40:15.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.175+0000 7f8caa9cd700 1 -- 172.21.15.3:0/880111585 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8ca406c830 msgr2=0x7f8ca406d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:15.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.175+0000 7f8caa9cd700 1 --2- 172.21.15.3:0/880111585 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8ca406c830 0x7f8ca406d660 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8ca40bfd00 tx=0x7f8c8c0091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:15.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.175+0000 7f8caa9cd700 1 -- 172.21.15.3:0/880111585 shutdown_connections 2023-10-08T15:40:15.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.175+0000 7f8caa9cd700 1 --2- 172.21.15.3:0/880111585 >> v2:172.21.15.50:3300/0 conn(0x7f8ca414a8a0 0x7f8ca414acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:15.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.175+0000 7f8caa9cd700 1 --2- 172.21.15.3:0/880111585 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8ca406c830 0x7f8ca406d660 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:15.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.175+0000 7f8caa9cd700 1 -- 172.21.15.3:0/880111585 >> 172.21.15.3:0/880111585 conn(0x7f8ca40c2a40 msgr2=0x7f8ca40bea60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:15.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.175+0000 7f8caa9cd700 1 -- 172.21.15.3:0/880111585 shutdown_connections 2023-10-08T15:40:15.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.175+0000 7f8caa9cd700 1 -- 172.21.15.3:0/880111585 wait complete. 2023-10-08T15:40:15.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.175+0000 7f8caa9cd700 1 Processor -- start 2023-10-08T15:40:15.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.175+0000 7f8caa9cd700 1 -- start start 2023-10-08T15:40:15.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.175+0000 7f8caa9cd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8ca406c830 0x7f8ca4148ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:15.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.175+0000 7f8caa9cd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ca40bf3a0 0x7f8ca4142d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:15.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.175+0000 7f8caa9cd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8ca414a8a0 0x7f8ca41432b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:15.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.175+0000 7f8caa9cd700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca41437f0 con 0x7f8ca414a8a0 2023-10-08T15:40:15.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.175+0000 7f8caa9cd700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca415aba0 con 0x7f8ca40bf3a0 2023-10-08T15:40:15.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.175+0000 7f8caa9cd700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca415ae60 con 0x7f8ca406c830 2023-10-08T15:40:15.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.175+0000 7f8ca8f6a700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8ca414a8a0 0x7f8ca41432b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:15.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.175+0000 7f8ca8f6a700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8ca414a8a0 0x7f8ca41432b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36320/0 (socket says 172.21.15.3:36320) 2023-10-08T15:40:15.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.175+0000 7f8ca8f6a700 1 -- 172.21.15.3:0/944566032 learned_addr learned my addr 172.21.15.3:0/944566032 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:15.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.175+0000 7f8ca3fff700 1 --2- 172.21.15.3:0/944566032 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8ca406c830 0x7f8ca4148ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:15.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.175+0000 7f8ca37fe700 1 --2- 172.21.15.3:0/944566032 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ca40bf3a0 0x7f8ca4142d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:15.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.175+0000 7f8ca8f6a700 1 -- 172.21.15.3:0/944566032 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8ca406c830 msgr2=0x7f8ca4148ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:15.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.175+0000 7f8ca8f6a700 1 --2- 172.21.15.3:0/944566032 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8ca406c830 0x7f8ca4148ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:15.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.175+0000 7f8ca8f6a700 1 -- 172.21.15.3:0/944566032 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ca40bf3a0 msgr2=0x7f8ca4142d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:15.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.175+0000 7f8ca8f6a700 1 --2- 172.21.15.3:0/944566032 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ca40bf3a0 0x7f8ca4142d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:15.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.175+0000 7f8ca8f6a700 1 -- 172.21.15.3:0/944566032 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c8c009420 con 0x7f8ca414a8a0 2023-10-08T15:40:15.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.179+0000 7f8ca8f6a700 1 --2- 172.21.15.3:0/944566032 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8ca414a8a0 0x7f8ca41432b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c00e8d0 tx=0x7f8c9c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:15.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.179+0000 7f8c9bfff700 1 -- 172.21.15.3:0/944566032 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c013680 con 0x7f8ca414a8a0 2023-10-08T15:40:15.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.179+0000 7f8c9bfff700 1 -- 172.21.15.3:0/944566032 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c9c0137e0 con 0x7f8ca414a8a0 2023-10-08T15:40:15.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.179+0000 7f8caa9cd700 1 -- 172.21.15.3:0/944566032 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ca414d4b0 con 0x7f8ca414a8a0 2023-10-08T15:40:15.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.179+0000 7f8c9bfff700 1 -- 172.21.15.3:0/944566032 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c013ba0 con 0x7f8ca414a8a0 2023-10-08T15:40:15.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.179+0000 7f8caa9cd700 1 -- 172.21.15.3:0/944566032 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ca41490a0 con 0x7f8ca414a8a0 2023-10-08T15:40:15.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.179+0000 7f8caa9cd700 1 -- 172.21.15.3:0/944566032 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ca415afd0 con 0x7f8ca414a8a0 2023-10-08T15:40:15.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.179+0000 7f8c9bfff700 1 -- 172.21.15.3:0/944566032 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f8c9c0123d0 con 0x7f8ca414a8a0 2023-10-08T15:40:15.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.179+0000 7f8c9bfff700 1 --2- 172.21.15.3:0/944566032 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8c84060580 0x7f8c84062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:15.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.179+0000 7f8c9bfff700 1 -- 172.21.15.3:0/944566032 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8c9c07c7f0 con 0x7f8ca414a8a0 2023-10-08T15:40:15.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.179+0000 7f8ca3fff700 1 --2- 172.21.15.3:0/944566032 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8c84060580 0x7f8c84062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:15.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.183+0000 7f8ca3fff700 1 --2- 172.21.15.3:0/944566032 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8c84060580 0x7f8c84062a30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8c94005c50 tx=0x7f8c94009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:15.194 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.191+0000 7f8c9bfff700 1 -- 172.21.15.3:0/944566032 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8c9c04cde0 con 0x7f8ca414a8a0 2023-10-08T15:40:15.390 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.387+0000 7f8caa9cd700 1 -- 172.21.15.3:0/944566032 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f8ca4064530 con 0x7f8ca414a8a0 2023-10-08T15:40:15.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.435+0000 7f8c9bfff700 1 -- 172.21.15.3:0/944566032 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) v1 ==== 118+0+0 (secure 0 0 0) 0x7f8c9c0170b0 con 0x7f8ca414a8a0 2023-10-08T15:40:15.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.439+0000 7f8caa9cd700 1 -- 172.21.15.3:0/944566032 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8c84060580 msgr2=0x7f8c84062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:15.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.439+0000 7f8caa9cd700 1 --2- 172.21.15.3:0/944566032 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8c84060580 0x7f8c84062a30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8c94005c50 tx=0x7f8c94009040 comp rx=0 tx=0).stop 2023-10-08T15:40:15.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.439+0000 7f8caa9cd700 1 -- 172.21.15.3:0/944566032 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8ca414a8a0 msgr2=0x7f8ca41432b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:15.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.439+0000 7f8caa9cd700 1 --2- 172.21.15.3:0/944566032 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8ca414a8a0 0x7f8ca41432b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c00e8d0 tx=0x7f8c9c0091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:15.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.439+0000 7f8caa9cd700 1 -- 172.21.15.3:0/944566032 shutdown_connections 2023-10-08T15:40:15.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.439+0000 7f8caa9cd700 1 --2- 172.21.15.3:0/944566032 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8c84060580 0x7f8c84062a30 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:15.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.439+0000 7f8caa9cd700 1 --2- 172.21.15.3:0/944566032 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8ca414a8a0 0x7f8ca41432b0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:15.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.439+0000 7f8caa9cd700 1 --2- 172.21.15.3:0/944566032 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ca40bf3a0 0x7f8ca4142d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:15.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.439+0000 7f8caa9cd700 1 --2- 172.21.15.3:0/944566032 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8ca406c830 0x7f8ca4148ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:15.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.439+0000 7f8caa9cd700 1 -- 172.21.15.3:0/944566032 >> 172.21.15.3:0/944566032 conn(0x7f8ca40c2a40 msgr2=0x7f8ca4068870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:15.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.439+0000 7f8caa9cd700 1 -- 172.21.15.3:0/944566032 shutdown_connections 2023-10-08T15:40:15.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.439+0000 7f8caa9cd700 1 -- 172.21.15.3:0/944566032 wait complete. 2023-10-08T15:40:15.461 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-08T15:40:15.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.571+0000 7fe2f8f61700 1 Processor -- start 2023-10-08T15:40:15.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.571+0000 7fe2f8f61700 1 -- start start 2023-10-08T15:40:15.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.575+0000 7fe2f8f61700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe2f4148ca0 0x7fe2f406bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:15.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.575+0000 7fe2f8f61700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe2f40bc340 0x7fe2f40bc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:15.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.575+0000 7fe2f8f61700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2f40a2720 con 0x7fe2f406cdf0 2023-10-08T15:40:15.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.575+0000 7fe2f8f61700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2f4149c50 con 0x7fe2f4148ca0 2023-10-08T15:40:15.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.575+0000 7fe2f8f61700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f40a2440 con 0x7fe2f40bc340 2023-10-08T15:40:15.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.575+0000 7fe2f2ffd700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fe2f406cdf0 0x7fe2f406c1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:47624/0 (socket says 172.21.15.3:47624) 2023-10-08T15:40:15.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.575+0000 7fe2f2ffd700 1 -- 172.21.15.3:0/66979457 learned_addr learned my addr 172.21.15.3:0/66979457 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:40:15.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.575+0000 7fe2f3fff700 1 --2- 172.21.15.3:0/66979457 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe2f40bc340 0x7fe2f40bc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:15.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.575+0000 7fe2f37fe700 1 --2- 172.21.15.3:0/66979457 >> v2:172.21.15.50:3300/0 conn(0x7fe2f4148ca0 0x7fe2f406bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:15.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.575+0000 7fe2f27fc700 1 -- 172.21.15.3:0/66979457 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 175684171 0 0) 0x7fe2f40a2720 con 0x7fe2f406cdf0 2023-10-08T15:40:15.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.575+0000 7fe2f27fc700 1 -- 172.21.15.3:0/66979457 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2e0003570 con 0x7fe2f406cdf0 2023-10-08T15:40:15.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.575+0000 7fe2f3fff700 1 -- 172.21.15.3:0/66979457 >> v2:172.21.15.50:3300/0 conn(0x7fe2f4148ca0 msgr2=0x7fe2f406bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:15.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.575+0000 7fe2f3fff700 1 --2- 172.21.15.3:0/66979457 >> v2:172.21.15.50:3300/0 conn(0x7fe2f4148ca0 0x7fe2f406bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:15.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.575+0000 7fe2f3fff700 1 -- 172.21.15.3:0/66979457 >> v1:172.21.15.3:6789/0 conn(0x7fe2f406cdf0 legacy=0x7fe2f406c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:15.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.575+0000 7fe2f3fff700 1 -- 172.21.15.3:0/66979457 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f409f2c0 con 0x7fe2f40bc340 2023-10-08T15:40:15.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.575+0000 7fe2f3fff700 1 --2- 172.21.15.3:0/66979457 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe2f40bc340 0x7fe2f40bc7c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec009e60 tx=0x7fe2ec009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a93125ee0ea07b89 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:15.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.575+0000 7fe2f27fc700 1 -- 172.21.15.3:0/66979457 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec00e070 con 0x7fe2f40bc340 2023-10-08T15:40:15.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.575+0000 7fe2f27fc700 1 -- 172.21.15.3:0/66979457 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2ec00bab0 con 0x7fe2f40bc340 2023-10-08T15:40:15.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.575+0000 7fe2f27fc700 1 -- 172.21.15.3:0/66979457 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec00be70 con 0x7fe2f40bc340 2023-10-08T15:40:15.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.575+0000 7fe2f8f61700 1 -- 172.21.15.3:0/66979457 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe2f40bc340 msgr2=0x7fe2f40bc7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:15.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.575+0000 7fe2f8f61700 1 --2- 172.21.15.3:0/66979457 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe2f40bc340 0x7fe2f40bc7c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec009e60 tx=0x7fe2ec009780 comp rx=0 tx=0).stop 2023-10-08T15:40:15.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.575+0000 7fe2f8f61700 1 -- 172.21.15.3:0/66979457 shutdown_connections 2023-10-08T15:40:15.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.575+0000 7fe2f8f61700 1 --2- 172.21.15.3:0/66979457 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe2f40bc340 0x7fe2f40bc7c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:15.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.575+0000 7fe2f8f61700 1 --2- 172.21.15.3:0/66979457 >> v2:172.21.15.50:3300/0 conn(0x7fe2f4148ca0 0x7fe2f406bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:15.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.575+0000 7fe2f8f61700 1 -- 172.21.15.3:0/66979457 >> 172.21.15.3:0/66979457 conn(0x7fe2f406f340 msgr2=0x7fe2f40670e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:15.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.575+0000 7fe2f8f61700 1 -- 172.21.15.3:0/66979457 shutdown_connections 2023-10-08T15:40:15.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.575+0000 7fe2f8f61700 1 -- 172.21.15.3:0/66979457 wait complete. 2023-10-08T15:40:15.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.579+0000 7fe2f8f61700 1 Processor -- start 2023-10-08T15:40:15.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.579+0000 7fe2f8f61700 1 -- start start 2023-10-08T15:40:15.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.579+0000 7fe2f8f61700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2f406cdf0 0x7fe2f4145a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:15.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.579+0000 7fe2f8f61700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe2f40bc340 0x7fe2f4147c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:15.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.579+0000 7fe2f8f61700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe2f4148ca0 0x7fe2f41591e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:15.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.579+0000 7fe2f8f61700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f414cb00 con 0x7fe2f4148ca0 2023-10-08T15:40:15.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.579+0000 7fe2f8f61700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f414c4b0 con 0x7fe2f406cdf0 2023-10-08T15:40:15.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.579+0000 7fe2f8f61700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f414c790 con 0x7fe2f40bc340 2023-10-08T15:40:15.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.579+0000 7fe2f3fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe2f4148ca0 0x7fe2f41591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:15.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.579+0000 7fe2f3fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe2f4148ca0 0x7fe2f41591e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36324/0 (socket says 172.21.15.3:36324) 2023-10-08T15:40:15.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.579+0000 7fe2f37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2f406cdf0 0x7fe2f4145a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:15.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.579+0000 7fe2f2ffd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe2f40bc340 0x7fe2f4147c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:15.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.579+0000 7fe2f3fff700 1 -- 172.21.15.3:0/3025604236 learned_addr learned my addr 172.21.15.3:0/3025604236 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:15.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.579+0000 7fe2f3fff700 1 -- 172.21.15.3:0/3025604236 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe2f40bc340 msgr2=0x7fe2f4147c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:15.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.579+0000 7fe2f3fff700 1 --2- 172.21.15.3:0/3025604236 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe2f40bc340 0x7fe2f4147c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:15.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.579+0000 7fe2f3fff700 1 -- 172.21.15.3:0/3025604236 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2f406cdf0 msgr2=0x7fe2f4145a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:15.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.579+0000 7fe2f3fff700 1 --2- 172.21.15.3:0/3025604236 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2f406cdf0 0x7fe2f4145a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:15.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.579+0000 7fe2f3fff700 1 -- 172.21.15.3:0/3025604236 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2ec009a20 con 0x7fe2f4148ca0 2023-10-08T15:40:15.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.583+0000 7fe2f3fff700 1 --2- 172.21.15.3:0/3025604236 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe2f4148ca0 0x7fe2f41591e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fe2f406e4a0 tx=0x7fe2ec019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:15.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.583+0000 7fe2eb7fe700 1 -- 172.21.15.3:0/3025604236 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec012e10 con 0x7fe2f4148ca0 2023-10-08T15:40:15.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.583+0000 7fe2eb7fe700 1 -- 172.21.15.3:0/3025604236 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2ec027470 con 0x7fe2f4148ca0 2023-10-08T15:40:15.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.583+0000 7fe2f8f61700 1 -- 172.21.15.3:0/3025604236 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2f4145f80 con 0x7fe2f4148ca0 2023-10-08T15:40:15.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.583+0000 7fe2eb7fe700 1 -- 172.21.15.3:0/3025604236 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec027830 con 0x7fe2f4148ca0 2023-10-08T15:40:15.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.583+0000 7fe2f8f61700 1 -- 172.21.15.3:0/3025604236 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2f41483f0 con 0x7fe2f4148ca0 2023-10-08T15:40:15.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.583+0000 7fe2f8f61700 1 -- 172.21.15.3:0/3025604236 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2f405ecf0 con 0x7fe2f4148ca0 2023-10-08T15:40:15.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.583+0000 7fe2eb7fe700 1 -- 172.21.15.3:0/3025604236 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe2ec024070 con 0x7fe2f4148ca0 2023-10-08T15:40:15.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.587+0000 7fe2eb7fe700 1 --2- 172.21.15.3:0/3025604236 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe2d4060550 0x7fe2d4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:15.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.587+0000 7fe2eb7fe700 1 -- 172.21.15.3:0/3025604236 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe2ec07f110 con 0x7fe2f4148ca0 2023-10-08T15:40:15.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.587+0000 7fe2f37fe700 1 --2- 172.21.15.3:0/3025604236 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe2d4060550 0x7fe2d4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:15.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.587+0000 7fe2f37fe700 1 --2- 172.21.15.3:0/3025604236 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe2d4060550 0x7fe2d4062a00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4009d10 tx=0x7fe2e40091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:15.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.595+0000 7fe2eb7fe700 1 -- 172.21.15.3:0/3025604236 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe2ec04f700 con 0x7fe2f4148ca0 2023-10-08T15:40:15.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:15.795+0000 7fe2f8f61700 1 -- 172.21.15.3:0/3025604236 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fe2f40a31c0 con 0x7fe2f4148ca0 2023-10-08T15:40:16.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.439+0000 7fe2eb7fe700 1 -- 172.21.15.3:0/3025604236 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v19) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe2ec052d20 con 0x7fe2f4148ca0 2023-10-08T15:40:16.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.443+0000 7fe2f8f61700 1 -- 172.21.15.3:0/3025604236 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe2d4060550 msgr2=0x7fe2d4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:16.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.443+0000 7fe2f8f61700 1 --2- 172.21.15.3:0/3025604236 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe2d4060550 0x7fe2d4062a00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4009d10 tx=0x7fe2e40091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:16.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.443+0000 7fe2f8f61700 1 -- 172.21.15.3:0/3025604236 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe2f4148ca0 msgr2=0x7fe2f41591e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:16.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.443+0000 7fe2f8f61700 1 --2- 172.21.15.3:0/3025604236 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe2f4148ca0 0x7fe2f41591e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fe2f406e4a0 tx=0x7fe2ec019000 comp rx=0 tx=0).stop 2023-10-08T15:40:16.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.443+0000 7fe2f8f61700 1 -- 172.21.15.3:0/3025604236 shutdown_connections 2023-10-08T15:40:16.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.443+0000 7fe2f8f61700 1 --2- 172.21.15.3:0/3025604236 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe2d4060550 0x7fe2d4062a00 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:16.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.443+0000 7fe2f8f61700 1 --2- 172.21.15.3:0/3025604236 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe2f4148ca0 0x7fe2f41591e0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:16.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.443+0000 7fe2f8f61700 1 --2- 172.21.15.3:0/3025604236 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe2f40bc340 0x7fe2f4147c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:16.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.443+0000 7fe2f8f61700 1 --2- 172.21.15.3:0/3025604236 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2f406cdf0 0x7fe2f4145a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:16.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.443+0000 7fe2f8f61700 1 -- 172.21.15.3:0/3025604236 >> 172.21.15.3:0/3025604236 conn(0x7fe2f406f340 msgr2=0x7fe2f406bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:16.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.443+0000 7fe2f8f61700 1 -- 172.21.15.3:0/3025604236 shutdown_connections 2023-10-08T15:40:16.449 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.443+0000 7fe2f8f61700 1 -- 172.21.15.3:0/3025604236 wait complete. 2023-10-08T15:40:16.464 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:40:16.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.571+0000 7fe83e7b9700 1 Processor -- start 2023-10-08T15:40:16.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.571+0000 7fe83e7b9700 1 -- start start 2023-10-08T15:40:16.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.571+0000 7fe83e7b9700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe8380a1fd0 0x7fe838148330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:16.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.571+0000 7fe83e7b9700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe83814c6c0 0x7fe838148870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:16.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.571+0000 7fe83e7b9700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fe838148db0 0x7fe8380b1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:16.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.571+0000 7fe83e7b9700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe83814b9d0 con 0x7fe838148db0 2023-10-08T15:40:16.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.571+0000 7fe83e7b9700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8380b3b10 con 0x7fe83814c6c0 2023-10-08T15:40:16.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.571+0000 7fe83e7b9700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe83814bbe0 con 0x7fe8380a1fd0 2023-10-08T15:40:16.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.571+0000 7fe83cd56700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fe838148db0 0x7fe8380b1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:16.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.571+0000 7fe83cd56700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fe838148db0 0x7fe8380b1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36334/0 (socket says 172.21.15.3:36334) 2023-10-08T15:40:16.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.571+0000 7fe83cd56700 1 -- 172.21.15.3:0/1342791376 learned_addr learned my addr 172.21.15.3:0/1342791376 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:16.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.571+0000 7fe8377fe700 1 --2- 172.21.15.3:0/1342791376 >> v2:172.21.15.50:3300/0 conn(0x7fe83814c6c0 0x7fe838148870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:16.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.571+0000 7fe837fff700 1 --2- 172.21.15.3:0/1342791376 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe8380a1fd0 0x7fe838148330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:16.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.571+0000 7fe83cd56700 1 -- 172.21.15.3:0/1342791376 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe8380a1fd0 msgr2=0x7fe838148330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:16.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.571+0000 7fe83cd56700 1 --2- 172.21.15.3:0/1342791376 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe8380a1fd0 0x7fe838148330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:16.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.571+0000 7fe83cd56700 1 -- 172.21.15.3:0/1342791376 >> v2:172.21.15.50:3300/0 conn(0x7fe83814c6c0 msgr2=0x7fe838148870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:16.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.571+0000 7fe83cd56700 1 --2- 172.21.15.3:0/1342791376 >> v2:172.21.15.50:3300/0 conn(0x7fe83814c6c0 0x7fe838148870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:16.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.571+0000 7fe83cd56700 1 -- 172.21.15.3:0/1342791376 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe83814bec0 con 0x7fe838148db0 2023-10-08T15:40:16.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.571+0000 7fe8377fe700 1 --2- 172.21.15.3:0/1342791376 >> v2:172.21.15.50:3300/0 conn(0x7fe83814c6c0 0x7fe838148870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:40:16.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.575+0000 7fe83cd56700 1 --2- 172.21.15.3:0/1342791376 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe838148db0 0x7fe8380b1c30 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fe8380bcb70 tx=0x7fe830009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e849deaaf275513 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:16.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.575+0000 7fe836ffd700 1 -- 172.21.15.3:0/1342791376 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83000b640 con 0x7fe838148db0 2023-10-08T15:40:16.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.575+0000 7fe836ffd700 1 -- 172.21.15.3:0/1342791376 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe83000b7a0 con 0x7fe838148db0 2023-10-08T15:40:16.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.575+0000 7fe836ffd700 1 -- 172.21.15.3:0/1342791376 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83000bb60 con 0x7fe838148db0 2023-10-08T15:40:16.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.575+0000 7fe83e7b9700 1 -- 172.21.15.3:0/1342791376 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe838148db0 msgr2=0x7fe8380b1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:16.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.575+0000 7fe83e7b9700 1 --2- 172.21.15.3:0/1342791376 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe838148db0 0x7fe8380b1c30 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fe8380bcb70 tx=0x7fe830009250 comp rx=0 tx=0).stop 2023-10-08T15:40:16.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.575+0000 7fe83e7b9700 1 -- 172.21.15.3:0/1342791376 shutdown_connections 2023-10-08T15:40:16.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.575+0000 7fe83e7b9700 1 --2- 172.21.15.3:0/1342791376 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe838148db0 0x7fe8380b1c30 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:16.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.575+0000 7fe83e7b9700 1 --2- 172.21.15.3:0/1342791376 >> v2:172.21.15.50:3300/0 conn(0x7fe83814c6c0 0x7fe838148870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:16.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.575+0000 7fe83e7b9700 1 --2- 172.21.15.3:0/1342791376 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe8380a1fd0 0x7fe838148330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:16.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.575+0000 7fe83e7b9700 1 -- 172.21.15.3:0/1342791376 >> 172.21.15.3:0/1342791376 conn(0x7fe83806b9b0 msgr2=0x7fe8380681f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:16.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.575+0000 7fe83e7b9700 1 -- 172.21.15.3:0/1342791376 shutdown_connections 2023-10-08T15:40:16.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.575+0000 7fe83e7b9700 1 -- 172.21.15.3:0/1342791376 wait complete. 2023-10-08T15:40:16.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.575+0000 7fe83e7b9700 1 Processor -- start 2023-10-08T15:40:16.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.575+0000 7fe83e7b9700 1 -- start start 2023-10-08T15:40:16.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.575+0000 7fe83e7b9700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe8380a1fd0 0x7fe83813a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:16.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.575+0000 7fe83e7b9700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe838148db0 0x7fe838139710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:16.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.575+0000 7fe83e7b9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe83814c6c0 0x7fe838139c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:16.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.575+0000 7fe83e7b9700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe83815bc50 con 0x7fe8380a1fd0 2023-10-08T15:40:16.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.575+0000 7fe83e7b9700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe838143060 con 0x7fe83814c6c0 2023-10-08T15:40:16.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.575+0000 7fe83e7b9700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe83813a990 con 0x7fe838148db0 2023-10-08T15:40:16.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.579+0000 7fe837fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe8380a1fd0 0x7fe83813a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:16.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.579+0000 7fe837fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe8380a1fd0 0x7fe83813a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36336/0 (socket says 172.21.15.3:36336) 2023-10-08T15:40:16.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.579+0000 7fe837fff700 1 -- 172.21.15.3:0/3800101329 learned_addr learned my addr 172.21.15.3:0/3800101329 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:16.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.579+0000 7fe83cd56700 1 --2- 172.21.15.3:0/3800101329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe83814c6c0 0x7fe838139c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:16.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.579+0000 7fe8377fe700 1 --2- 172.21.15.3:0/3800101329 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe838148db0 0x7fe838139710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:16.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.579+0000 7fe837fff700 1 -- 172.21.15.3:0/3800101329 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe838148db0 msgr2=0x7fe838139710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:16.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.579+0000 7fe837fff700 1 --2- 172.21.15.3:0/3800101329 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe838148db0 0x7fe838139710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:16.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.579+0000 7fe837fff700 1 -- 172.21.15.3:0/3800101329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe83814c6c0 msgr2=0x7fe838139c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:16.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.579+0000 7fe837fff700 1 --2- 172.21.15.3:0/3800101329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe83814c6c0 0x7fe838139c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:16.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.579+0000 7fe837fff700 1 -- 172.21.15.3:0/3800101329 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe828009a20 con 0x7fe8380a1fd0 2023-10-08T15:40:16.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.579+0000 7fe837fff700 1 --2- 172.21.15.3:0/3800101329 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe8380a1fd0 0x7fe83813a450 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe82c00e930 tx=0x7fe82c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:16.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.579+0000 7fe81ffff700 1 -- 172.21.15.3:0/3800101329 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82c013680 con 0x7fe8380a1fd0 2023-10-08T15:40:16.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.579+0000 7fe81ffff700 1 -- 172.21.15.3:0/3800101329 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe82c0137e0 con 0x7fe8380a1fd0 2023-10-08T15:40:16.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.579+0000 7fe83e7b9700 1 -- 172.21.15.3:0/3800101329 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8300094f0 con 0x7fe8380a1fd0 2023-10-08T15:40:16.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.579+0000 7fe81ffff700 1 -- 172.21.15.3:0/3800101329 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82c013b80 con 0x7fe8380a1fd0 2023-10-08T15:40:16.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.579+0000 7fe83e7b9700 1 -- 172.21.15.3:0/3800101329 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe83815b6b0 con 0x7fe8380a1fd0 2023-10-08T15:40:16.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.579+0000 7fe83e7b9700 1 -- 172.21.15.3:0/3800101329 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe838064530 con 0x7fe8380a1fd0 2023-10-08T15:40:16.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.579+0000 7fe81ffff700 1 -- 172.21.15.3:0/3800101329 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe82c00c3e0 con 0x7fe8380a1fd0 2023-10-08T15:40:16.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.583+0000 7fe81ffff700 1 --2- 172.21.15.3:0/3800101329 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe824060550 0x7fe824062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:16.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.583+0000 7fe81ffff700 1 -- 172.21.15.3:0/3800101329 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe82c07c7f0 con 0x7fe8380a1fd0 2023-10-08T15:40:16.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.583+0000 7fe8377fe700 1 --2- 172.21.15.3:0/3800101329 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe824060550 0x7fe824062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:16.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.583+0000 7fe8377fe700 1 --2- 172.21.15.3:0/3800101329 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe824060550 0x7fe824062a00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe828009fd0 tx=0x7fe82800b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:16.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.591+0000 7fe81ffff700 1 -- 172.21.15.3:0/3800101329 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe82c04cde0 con 0x7fe8380a1fd0 2023-10-08T15:40:16.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.783+0000 7fe83e7b9700 1 -- 172.21.15.3:0/3800101329 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe83806ecf0 con 0x7fe8380a1fd0 2023-10-08T15:40:16.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.783+0000 7fe81ffff700 1 -- 172.21.15.3:0/3800101329 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+3080 (secure 0 0 0) 0x7fe82c021c20 con 0x7fe8380a1fd0 2023-10-08T15:40:16.789 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:40:16.789 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5006,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3286528236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3286528236},{"type":"v1","addr":"172.21.15.50:6835","nonce":3286528236}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:40:13.764784+0000","modified":"2023-10-08T15:40:16.434138+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5337},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5337":{"gid":5337,"name":"a","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.3:6833/3441752211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":3441752211},{"type":"v1","addr":"172.21.15.3:6833","nonce":3441752211}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-08T15:40:16.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.787+0000 7fe83e7b9700 1 -- 172.21.15.3:0/3800101329 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe824060550 msgr2=0x7fe824062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:16.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.787+0000 7fe83e7b9700 1 --2- 172.21.15.3:0/3800101329 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe824060550 0x7fe824062a00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe828009fd0 tx=0x7fe82800b040 comp rx=0 tx=0).stop 2023-10-08T15:40:16.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.787+0000 7fe83e7b9700 1 -- 172.21.15.3:0/3800101329 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe8380a1fd0 msgr2=0x7fe83813a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:16.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.787+0000 7fe83e7b9700 1 --2- 172.21.15.3:0/3800101329 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe8380a1fd0 0x7fe83813a450 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe82c00e930 tx=0x7fe82c0091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:16.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.787+0000 7fe83e7b9700 1 -- 172.21.15.3:0/3800101329 shutdown_connections 2023-10-08T15:40:16.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.787+0000 7fe83e7b9700 1 --2- 172.21.15.3:0/3800101329 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe824060550 0x7fe824062a00 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:16.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.787+0000 7fe83e7b9700 1 --2- 172.21.15.3:0/3800101329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe83814c6c0 0x7fe838139c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:16.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.787+0000 7fe83e7b9700 1 --2- 172.21.15.3:0/3800101329 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe838148db0 0x7fe838139710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:16.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.787+0000 7fe83e7b9700 1 --2- 172.21.15.3:0/3800101329 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe8380a1fd0 0x7fe83813a450 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:16.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.787+0000 7fe83e7b9700 1 -- 172.21.15.3:0/3800101329 >> 172.21.15.3:0/3800101329 conn(0x7fe83806b9b0 msgr2=0x7fe83813de70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:16.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.787+0000 7fe83e7b9700 1 -- 172.21.15.3:0/3800101329 shutdown_connections 2023-10-08T15:40:16.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.787+0000 7fe83e7b9700 1 -- 172.21.15.3:0/3800101329 wait complete. 2023-10-08T15:40:16.793 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 19 2023-10-08T15:40:16.804 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:40:16.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.907+0000 7feeabcc1700 1 Processor -- start 2023-10-08T15:40:16.912 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.907+0000 7feeabcc1700 1 -- start start 2023-10-08T15:40:16.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.911+0000 7feeabcc1700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feea414c6c0 0x7feea4148a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:16.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.911+0000 7feeabcc1700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7feea40bc4f0 0x7feea4147280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:16.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.911+0000 7feeabcc1700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feea40b3b10 con 0x7feea40a1fd0 2023-10-08T15:40:16.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.911+0000 7feeabcc1700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feea414b9d0 con 0x7feea40bc4f0 2023-10-08T15:40:16.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.911+0000 7feeabcc1700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feea414bbe0 con 0x7feea414c6c0 2023-10-08T15:40:16.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.911+0000 7feea9a5d700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7feea40a1fd0 0x7feea4148330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:49598/0 (socket says 172.21.15.3:49598) 2023-10-08T15:40:16.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.911+0000 7feea9a5d700 1 -- 172.21.15.3:0/3026544676 learned_addr learned my addr 172.21.15.3:0/3026544676 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:40:16.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.911+0000 7feeaa25e700 1 --2- 172.21.15.3:0/3026544676 >> v2:172.21.15.50:3300/0 conn(0x7feea40bc4f0 0x7feea4147280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:16.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.911+0000 7feea8a5b700 1 -- 172.21.15.3:0/3026544676 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1514993249 0 0) 0x7feea40b3b10 con 0x7feea40a1fd0 2023-10-08T15:40:16.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.911+0000 7feea925c700 1 --2- 172.21.15.3:0/3026544676 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feea414c6c0 0x7feea4148a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:16.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.911+0000 7feea8a5b700 1 -- 172.21.15.3:0/3026544676 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee90003570 con 0x7feea40a1fd0 2023-10-08T15:40:16.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.911+0000 7feea8a5b700 1 -- 172.21.15.3:0/3026544676 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3982493197 0 0) 0x7fee90003570 con 0x7feea40a1fd0 2023-10-08T15:40:16.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.911+0000 7feea8a5b700 1 -- 172.21.15.3:0/3026544676 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feea414c6c0 msgr2=0x7feea4148a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:16.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.911+0000 7feea8a5b700 1 --2- 172.21.15.3:0/3026544676 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feea414c6c0 0x7feea4148a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:16.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.911+0000 7feea8a5b700 1 -- 172.21.15.3:0/3026544676 >> v2:172.21.15.50:3300/0 conn(0x7feea40bc4f0 msgr2=0x7feea4147280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:16.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.911+0000 7feea8a5b700 1 --2- 172.21.15.3:0/3026544676 >> v2:172.21.15.50:3300/0 conn(0x7feea40bc4f0 0x7feea4147280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:16.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.911+0000 7feea8a5b700 1 -- 172.21.15.3:0/3026544676 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea414bec0 con 0x7feea40a1fd0 2023-10-08T15:40:16.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.911+0000 7feea8a5b700 1 -- 172.21.15.3:0/3026544676 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2285686191 0 0) 0x7feea0001470 con 0x7feea40a1fd0 2023-10-08T15:40:16.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.911+0000 7feea8a5b700 1 -- 172.21.15.3:0/3026544676 >> v1:172.21.15.3:6789/0 conn(0x7feea40a1fd0 legacy=0x7feea4148330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:16.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.911+0000 7feea8a5b700 1 --2- 172.21.15.3:0/3026544676 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feea414c6c0 0x7fee90003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:16.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.911+0000 7feea8a5b700 1 --2- 172.21.15.3:0/3026544676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee90003fe0 0x7fee90004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:16.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.911+0000 7feea8a5b700 1 --2- 172.21.15.3:0/3026544676 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fee90004d50 0x7fee900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:16.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.911+0000 7feea8a5b700 1 -- 172.21.15.3:0/3026544676 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea414b9d0 con 0x7fee90004d50 2023-10-08T15:40:16.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.911+0000 7feea8a5b700 1 -- 172.21.15.3:0/3026544676 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea414bbe0 con 0x7fee90003fe0 2023-10-08T15:40:16.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.911+0000 7feea8a5b700 1 -- 172.21.15.3:0/3026544676 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee9000bb40 con 0x7feea414c6c0 2023-10-08T15:40:16.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.911+0000 7feeaa25e700 1 --2- 172.21.15.3:0/3026544676 >> v2:172.21.15.50:3300/0 conn(0x7feea40bc4f0 0x7feea4147280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:40:16.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.911+0000 7feea9a5d700 1 --2- 172.21.15.3:0/3026544676 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feea414c6c0 0x7fee90003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:16.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.911+0000 7feea925c700 1 --2- 172.21.15.3:0/3026544676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee90003fe0 0x7fee90004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:16.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.911+0000 7feeaa25e700 1 --2- 172.21.15.3:0/3026544676 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fee90004d50 0x7fee900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:16.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.911+0000 7feeaa25e700 1 -- 172.21.15.3:0/3026544676 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feea414c6c0 msgr2=0x7fee90003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:16.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.911+0000 7feeaa25e700 1 --2- 172.21.15.3:0/3026544676 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feea414c6c0 0x7fee90003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:16.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.911+0000 7feeaa25e700 1 -- 172.21.15.3:0/3026544676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee90003fe0 msgr2=0x7fee90004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:16.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.911+0000 7feeaa25e700 1 --2- 172.21.15.3:0/3026544676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee90003fe0 0x7fee90004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:16.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.911+0000 7feeaa25e700 1 -- 172.21.15.3:0/3026544676 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee90003570 con 0x7fee90004d50 2023-10-08T15:40:16.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.911+0000 7feeaa25e700 1 --2- 172.21.15.3:0/3026544676 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fee90004d50 0x7fee900051c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fee9c0094d0 tx=0x7fee9c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e0a9c109cee3062 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:16.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.911+0000 7feea8a5b700 1 -- 172.21.15.3:0/3026544676 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9c00ec40 con 0x7fee90004d50 2023-10-08T15:40:16.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.911+0000 7feea8a5b700 1 -- 172.21.15.3:0/3026544676 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee9c00f040 con 0x7fee90004d50 2023-10-08T15:40:16.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.911+0000 7feea8a5b700 1 -- 172.21.15.3:0/3026544676 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9c014480 con 0x7fee90004d50 2023-10-08T15:40:16.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.915+0000 7feeabcc1700 1 -- 172.21.15.3:0/3026544676 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fee90004d50 msgr2=0x7fee900051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:16.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.915+0000 7feeabcc1700 1 --2- 172.21.15.3:0/3026544676 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fee90004d50 0x7fee900051c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fee9c0094d0 tx=0x7fee9c00b040 comp rx=0 tx=0).stop 2023-10-08T15:40:16.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.915+0000 7feeaa25e700 1 -- 172.21.15.3:0/3026544676 reap_dead start 2023-10-08T15:40:16.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.915+0000 7feeabcc1700 1 -- 172.21.15.3:0/3026544676 shutdown_connections 2023-10-08T15:40:16.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.915+0000 7feeabcc1700 1 -- 172.21.15.3:0/3026544676 >> 172.21.15.3:0/3026544676 conn(0x7feea406b9b0 msgr2=0x7feea40681f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:16.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.915+0000 7feeabcc1700 1 -- 172.21.15.3:0/3026544676 shutdown_connections 2023-10-08T15:40:16.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.915+0000 7feeabcc1700 1 -- 172.21.15.3:0/3026544676 wait complete. 2023-10-08T15:40:16.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.915+0000 7feeabcc1700 1 Processor -- start 2023-10-08T15:40:16.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.915+0000 7feeabcc1700 1 -- start start 2023-10-08T15:40:16.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.919+0000 7feeabcc1700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feea415c5f0 0x7feea415c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:16.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.919+0000 7feeabcc1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feea4134070 0x7feea412da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:16.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.919+0000 7feeabcc1700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feea406e740 0x7feea412df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:16.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.919+0000 7feeabcc1700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea4149400 con 0x7feea415c5f0 2023-10-08T15:40:16.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.919+0000 7feeabcc1700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea413d810 con 0x7feea4134070 2023-10-08T15:40:16.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.919+0000 7feeabcc1700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feea41389e0 con 0x7feea406e740 2023-10-08T15:40:16.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.919+0000 7feea9a5d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feea415c5f0 0x7feea415c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:16.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.919+0000 7feea9a5d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feea415c5f0 0x7feea415c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52620/0 (socket says 172.21.15.3:52620) 2023-10-08T15:40:16.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.919+0000 7feea9a5d700 1 -- 172.21.15.3:0/3152866642 learned_addr learned my addr 172.21.15.3:0/3152866642 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:16.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.919+0000 7feea925c700 1 --2- 172.21.15.3:0/3152866642 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feea4134070 0x7feea412da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:16.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.919+0000 7feeaa25e700 1 --2- 172.21.15.3:0/3152866642 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feea406e740 0x7feea412df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:16.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.919+0000 7feea9a5d700 1 -- 172.21.15.3:0/3152866642 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feea406e740 msgr2=0x7feea412df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:16.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.919+0000 7feea9a5d700 1 --2- 172.21.15.3:0/3152866642 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feea406e740 0x7feea412df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:16.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.919+0000 7feea9a5d700 1 -- 172.21.15.3:0/3152866642 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feea4134070 msgr2=0x7feea412da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:16.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.919+0000 7feea9a5d700 1 --2- 172.21.15.3:0/3152866642 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feea4134070 0x7feea412da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:16.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.919+0000 7feea9a5d700 1 -- 172.21.15.3:0/3152866642 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea415cf00 con 0x7feea415c5f0 2023-10-08T15:40:16.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.919+0000 7feea925c700 1 --2- 172.21.15.3:0/3152866642 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feea4134070 0x7feea412da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:40:16.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.919+0000 7feea9a5d700 1 --2- 172.21.15.3:0/3152866642 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feea415c5f0 0x7feea415c9c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7feea0004890 tx=0x7feea40bc990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:16.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.919+0000 7fee99ffb700 1 -- 172.21.15.3:0/3152866642 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea0018030 con 0x7feea415c5f0 2023-10-08T15:40:16.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.919+0000 7fee99ffb700 1 -- 172.21.15.3:0/3152866642 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea0004e40 con 0x7feea415c5f0 2023-10-08T15:40:16.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.919+0000 7feeabcc1700 1 -- 172.21.15.3:0/3152866642 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feea406ec20 con 0x7feea415c5f0 2023-10-08T15:40:16.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.919+0000 7fee99ffb700 1 -- 172.21.15.3:0/3152866642 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea000fe90 con 0x7feea415c5f0 2023-10-08T15:40:16.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.919+0000 7feeabcc1700 1 -- 172.21.15.3:0/3152866642 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feea4136590 con 0x7feea415c5f0 2023-10-08T15:40:16.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.923+0000 7feeabcc1700 1 -- 172.21.15.3:0/3152866642 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feea413d670 con 0x7feea415c5f0 2023-10-08T15:40:16.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.923+0000 7fee99ffb700 1 -- 172.21.15.3:0/3152866642 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7feea001b070 con 0x7feea415c5f0 2023-10-08T15:40:16.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.923+0000 7fee99ffb700 1 --2- 172.21.15.3:0/3152866642 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fee88060580 0x7fee88062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:16.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.923+0000 7fee99ffb700 1 -- 172.21.15.3:0/3152866642 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5705+0+0 (secure 0 0 0) 0x7feea0019070 con 0x7feea415c5f0 2023-10-08T15:40:16.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.923+0000 7feea925c700 1 --2- 172.21.15.3:0/3152866642 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fee88060580 0x7fee88062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:16.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.923+0000 7feea925c700 1 --2- 172.21.15.3:0/3152866642 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fee88060580 0x7fee88062a30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7feea4148170 tx=0x7fee94008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:16.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:16.931+0000 7fee99ffb700 1 -- 172.21.15.3:0/3152866642 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7feea413d670 con 0x7feea415c5f0 2023-10-08T15:40:17.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.099+0000 7feeabcc1700 1 -- 172.21.15.3:0/3152866642 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feea415d2f0 con 0x7feea415c5f0 2023-10-08T15:40:17.106 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.103+0000 7fee99ffb700 1 -- 172.21.15.3:0/3152866642 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+15254 (secure 0 0 0) 0x7feea415d2f0 con 0x7feea415c5f0 2023-10-08T15:40:17.106 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:40:17.107 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":39,"fsid":"7635972e-cd66-4a8f-a231-378db8b3847a","created":"2023-10-08T15:37:08.234594+0000","modified":"2023-10-08T15:40:15.399080+0000","last_up_change":"2023-10-08T15:37:17.537726+0000","last_in_change":"2023-10-08T15:37:10.269178+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:37:16.581590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:40:12.013806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-08T15:40:12.747398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"64fb1864-bfdd-4d75-9b41-03fb60085dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33363},{"type":"v1","addr":"172.21.15.3:6801","nonce":33363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33363},{"type":"v1","addr":"172.21.15.3:6803","nonce":33363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":33363},{"type":"v1","addr":"172.21.15.3:6807","nonce":33363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33363},{"type":"v1","addr":"172.21.15.3:6805","nonce":33363}]},"public_addr":"172.21.15.3:6801/33363","cluster_addr":"172.21.15.3:6803/33363","heartbeat_back_addr":"172.21.15.3:6807/33363","heartbeat_front_addr":"172.21.15.3:6805/33363","state":["exists","up"]},{"osd":1,"uuid":"3ca6bd3a-3e8a-4c65-af9c-46148b0c2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33364},{"type":"v1","addr":"172.21.15.3:6820","nonce":33364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33364},{"type":"v1","addr":"172.21.15.3:6824","nonce":33364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33364},{"type":"v1","addr":"172.21.15.3:6831","nonce":33364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33364},{"type":"v1","addr":"172.21.15.3:6828","nonce":33364}]},"public_addr":"172.21.15.3:6820/33364","cluster_addr":"172.21.15.3:6824/33364","heartbeat_back_addr":"172.21.15.3:6831/33364","heartbeat_front_addr":"172.21.15.3:6828/33364","state":["exists","up"]},{"osd":2,"uuid":"6eb9f757-58dd-442f-910d-32401454bce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33366},{"type":"v1","addr":"172.21.15.3:6817","nonce":33366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":33366},{"type":"v1","addr":"172.21.15.3:6821","nonce":33366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6827","nonce":33366},{"type":"v1","addr":"172.21.15.3:6829","nonce":33366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":33366},{"type":"v1","addr":"172.21.15.3:6825","nonce":33366}]},"public_addr":"172.21.15.3:6817/33366","cluster_addr":"172.21.15.3:6821/33366","heartbeat_back_addr":"172.21.15.3:6829/33366","heartbeat_front_addr":"172.21.15.3:6825/33366","state":["exists","up"]},{"osd":3,"uuid":"1c39866b-ac2e-4ea9-a69c-02b01ee4191d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33365},{"type":"v1","addr":"172.21.15.3:6809","nonce":33365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":33365},{"type":"v1","addr":"172.21.15.3:6811","nonce":33365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33365},{"type":"v1","addr":"172.21.15.3:6815","nonce":33365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":33365},{"type":"v1","addr":"172.21.15.3:6813","nonce":33365}]},"public_addr":"172.21.15.3:6809/33365","cluster_addr":"172.21.15.3:6811/33365","heartbeat_back_addr":"172.21.15.3:6815/33365","heartbeat_front_addr":"172.21.15.3:6813/33365","state":["exists","up"]},{"osd":4,"uuid":"15f86b61-b7f1-4780-ae00-9d80a68cb830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":33605},{"type":"v1","addr":"172.21.15.50:6809","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33605},{"type":"v1","addr":"172.21.15.50:6811","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33605},{"type":"v1","addr":"172.21.15.50:6815","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":33605},{"type":"v1","addr":"172.21.15.50:6813","nonce":33605}]},"public_addr":"172.21.15.50:6809/33605","cluster_addr":"172.21.15.50:6811/33605","heartbeat_back_addr":"172.21.15.50:6815/33605","heartbeat_front_addr":"172.21.15.50:6813/33605","state":["exists","up"]},{"osd":5,"uuid":"726c3003-34e6-4d5a-b6e2-f911e13c2118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33606},{"type":"v1","addr":"172.21.15.50:6801","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33606},{"type":"v1","addr":"172.21.15.50:6803","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33606},{"type":"v1","addr":"172.21.15.50:6807","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":33606},{"type":"v1","addr":"172.21.15.50:6805","nonce":33606}]},"public_addr":"172.21.15.50:6801/33606","cluster_addr":"172.21.15.50:6803/33606","heartbeat_back_addr":"172.21.15.50:6807/33606","heartbeat_front_addr":"172.21.15.50:6805/33606","state":["exists","up"]},{"osd":6,"uuid":"401122a4-9988-441f-a5a7-39164434ebcd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":33607},{"type":"v1","addr":"172.21.15.50:6819","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":33607},{"type":"v1","addr":"172.21.15.50:6823","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":33607},{"type":"v1","addr":"172.21.15.50:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":33607},{"type":"v1","addr":"172.21.15.50:6827","nonce":33607}]},"public_addr":"172.21.15.50:6819/33607","cluster_addr":"172.21.15.50:6823/33607","heartbeat_back_addr":"172.21.15.50:6831/33607","heartbeat_front_addr":"172.21.15.50:6827/33607","state":["exists","up"]},{"osd":7,"uuid":"6b3fa236-c9d0-4c4d-82ae-9af4daf6d699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33604},{"type":"v1","addr":"172.21.15.50:6818","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":33604},{"type":"v1","addr":"172.21.15.50:6822","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":33604},{"type":"v1","addr":"172.21.15.50:6830","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":33604},{"type":"v1","addr":"172.21.15.50:6826","nonce":33604}]},"public_addr":"172.21.15.50:6818/33604","cluster_addr":"172.21.15.50:6822/33604","heartbeat_back_addr":"172.21.15.50:6830/33604","heartbeat_front_addr":"172.21.15.50:6826/33604","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.497794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.529417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.873426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.325972+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.443971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.240795+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.739632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.643026+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:40:17.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.103+0000 7feeabcc1700 1 -- 172.21.15.3:0/3152866642 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fee88060580 msgr2=0x7fee88062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:17.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.103+0000 7feeabcc1700 1 --2- 172.21.15.3:0/3152866642 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fee88060580 0x7fee88062a30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7feea4148170 tx=0x7fee94008040 comp rx=0 tx=0).stop 2023-10-08T15:40:17.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.103+0000 7feeabcc1700 1 -- 172.21.15.3:0/3152866642 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feea415c5f0 msgr2=0x7feea415c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:17.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.103+0000 7feeabcc1700 1 --2- 172.21.15.3:0/3152866642 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feea415c5f0 0x7feea415c9c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7feea0004890 tx=0x7feea40bc990 comp rx=0 tx=0).stop 2023-10-08T15:40:17.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.103+0000 7feeabcc1700 1 -- 172.21.15.3:0/3152866642 shutdown_connections 2023-10-08T15:40:17.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.103+0000 7feeabcc1700 1 --2- 172.21.15.3:0/3152866642 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fee88060580 0x7fee88062a30 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:17.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.103+0000 7feeabcc1700 1 --2- 172.21.15.3:0/3152866642 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feea406e740 0x7feea412df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:17.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.103+0000 7feeabcc1700 1 --2- 172.21.15.3:0/3152866642 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feea4134070 0x7feea412da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:17.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.103+0000 7feeabcc1700 1 --2- 172.21.15.3:0/3152866642 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feea415c5f0 0x7feea415c9c0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:17.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.103+0000 7feeabcc1700 1 -- 172.21.15.3:0/3152866642 >> 172.21.15.3:0/3152866642 conn(0x7feea406b9b0 msgr2=0x7feea40670e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:17.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.103+0000 7feeabcc1700 1 -- 172.21.15.3:0/3152866642 shutdown_connections 2023-10-08T15:40:17.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.103+0000 7feeabcc1700 1 -- 172.21.15.3:0/3152866642 wait complete. 2023-10-08T15:40:17.121 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T15:40:17.121 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T15:40:17.231 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.227+0000 7f5de0c18700 1 Processor -- start 2023-10-08T15:40:17.232 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.227+0000 7f5de0c18700 1 -- start start 2023-10-08T15:40:17.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.227+0000 7f5de0c18700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5ddc0be5f0 0x7f5ddc0bc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:17.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.227+0000 7f5de0c18700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ddc1495c0 con 0x7f5ddc0bbcd0 2023-10-08T15:40:17.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.227+0000 7f5de0c18700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ddc0bd9e0 con 0x7f5ddc0b3280 2023-10-08T15:40:17.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.227+0000 7f5de0c18700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ddc0b1e80 con 0x7f5ddc0be5f0 2023-10-08T15:40:17.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.227+0000 7f5ddb7fe700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f5ddc0bbcd0 0x7f5ddc0b2310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:49604/0 (socket says 172.21.15.3:49604) 2023-10-08T15:40:17.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.227+0000 7f5ddb7fe700 1 -- 172.21.15.3:0/725280451 learned_addr learned my addr 172.21.15.3:0/725280451 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:40:17.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.227+0000 7f5ddbfff700 1 --2- 172.21.15.3:0/725280451 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5ddc0be5f0 0x7f5ddc0bc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:17.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.227+0000 7f5dda7fc700 1 -- 172.21.15.3:0/725280451 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1431905187 0 0) 0x7f5ddc1495c0 con 0x7f5ddc0bbcd0 2023-10-08T15:40:17.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.227+0000 7f5dda7fc700 1 -- 172.21.15.3:0/725280451 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5dbc003570 con 0x7f5ddc0bbcd0 2023-10-08T15:40:17.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.231+0000 7f5dda7fc700 1 -- 172.21.15.3:0/725280451 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1105732872 0 0) 0x7f5ddc0bd9e0 con 0x7f5ddc0b3280 2023-10-08T15:40:17.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.231+0000 7f5dda7fc700 1 -- 172.21.15.3:0/725280451 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ddc1495c0 con 0x7f5ddc0b3280 2023-10-08T15:40:17.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.231+0000 7f5ddbfff700 1 -- 172.21.15.3:0/725280451 >> v1:172.21.15.50:6789/0 conn(0x7f5ddc0b3280 legacy=0x7f5ddc147970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:17.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.231+0000 7f5ddbfff700 1 -- 172.21.15.3:0/725280451 >> v1:172.21.15.3:6789/0 conn(0x7f5ddc0bbcd0 legacy=0x7f5ddc0b2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:17.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.231+0000 7f5ddbfff700 1 -- 172.21.15.3:0/725280451 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ddc0bd700 con 0x7f5ddc0be5f0 2023-10-08T15:40:17.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.231+0000 7f5ddbfff700 1 --2- 172.21.15.3:0/725280451 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5ddc0be5f0 0x7f5ddc0bc0a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5dd4009e90 tx=0x7f5dd4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7f85519a1575f5b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:17.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.231+0000 7f5dda7fc700 1 -- 172.21.15.3:0/725280451 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd400e070 con 0x7f5ddc0be5f0 2023-10-08T15:40:17.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.231+0000 7f5dda7fc700 1 -- 172.21.15.3:0/725280451 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dd400bb80 con 0x7f5ddc0be5f0 2023-10-08T15:40:17.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.231+0000 7f5dda7fc700 1 -- 172.21.15.3:0/725280451 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd4012430 con 0x7f5ddc0be5f0 2023-10-08T15:40:17.239 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.231+0000 7f5de0c18700 1 -- 172.21.15.3:0/725280451 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5ddc0be5f0 msgr2=0x7f5ddc0bc0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:17.239 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.231+0000 7f5de0c18700 1 --2- 172.21.15.3:0/725280451 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5ddc0be5f0 0x7f5ddc0bc0a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5dd4009e90 tx=0x7f5dd4009780 comp rx=0 tx=0).stop 2023-10-08T15:40:17.239 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.231+0000 7f5de0c18700 1 -- 172.21.15.3:0/725280451 shutdown_connections 2023-10-08T15:40:17.239 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.231+0000 7f5de0c18700 1 --2- 172.21.15.3:0/725280451 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5ddc0be5f0 0x7f5ddc0bc0a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:17.239 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.231+0000 7f5de0c18700 1 -- 172.21.15.3:0/725280451 >> 172.21.15.3:0/725280451 conn(0x7f5ddc0bf5e0 msgr2=0x7f5ddc0bb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:17.239 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.231+0000 7f5de0c18700 1 -- 172.21.15.3:0/725280451 shutdown_connections 2023-10-08T15:40:17.239 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.231+0000 7f5de0c18700 1 -- 172.21.15.3:0/725280451 wait complete. 2023-10-08T15:40:17.245 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.231+0000 7f5de0c18700 1 Processor -- start 2023-10-08T15:40:17.245 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.231+0000 7f5de0c18700 1 -- start start 2023-10-08T15:40:17.245 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.235+0000 7f5de0c18700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ddc0b3280 0x7f5ddc0673a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:17.245 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.235+0000 7f5de0c18700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5ddc0bbcd0 0x7f5ddc095e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:17.245 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.235+0000 7f5de0c18700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5ddc0be5f0 0x7f5ddc096390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:17.246 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.235+0000 7f5de0c18700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ddc159de0 con 0x7f5ddc0bbcd0 2023-10-08T15:40:17.246 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.235+0000 7f5de0c18700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ddc0bacd0 con 0x7f5ddc0b3280 2023-10-08T15:40:17.246 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.235+0000 7f5de0c18700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ddc0baa30 con 0x7f5ddc0be5f0 2023-10-08T15:40:17.246 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.235+0000 7f5ddaffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5ddc0bbcd0 0x7f5ddc095e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:17.246 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.235+0000 7f5ddaffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5ddc0bbcd0 0x7f5ddc095e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52630/0 (socket says 172.21.15.3:52630) 2023-10-08T15:40:17.246 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.235+0000 7f5ddaffd700 1 -- 172.21.15.3:0/930755986 learned_addr learned my addr 172.21.15.3:0/930755986 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:17.247 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.235+0000 7f5ddbfff700 1 --2- 172.21.15.3:0/930755986 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5ddc0be5f0 0x7f5ddc096390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:17.247 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.235+0000 7f5ddb7fe700 1 --2- 172.21.15.3:0/930755986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ddc0b3280 0x7f5ddc0673a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:17.247 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.235+0000 7f5ddaffd700 1 -- 172.21.15.3:0/930755986 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5ddc0be5f0 msgr2=0x7f5ddc096390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:17.247 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.235+0000 7f5ddaffd700 1 --2- 172.21.15.3:0/930755986 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5ddc0be5f0 0x7f5ddc096390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:17.247 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.235+0000 7f5ddaffd700 1 -- 172.21.15.3:0/930755986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ddc0b3280 msgr2=0x7f5ddc0673a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:17.247 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.235+0000 7f5ddaffd700 1 --2- 172.21.15.3:0/930755986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ddc0b3280 0x7f5ddc0673a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:17.248 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.235+0000 7f5ddaffd700 1 -- 172.21.15.3:0/930755986 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd4009a20 con 0x7f5ddc0bbcd0 2023-10-08T15:40:17.248 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.235+0000 7f5ddaffd700 1 --2- 172.21.15.3:0/930755986 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5ddc0bbcd0 0x7f5ddc095e50 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f5dc400c7c0 tx=0x7f5dc4007dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:17.248 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.235+0000 7f5dd37fe700 1 -- 172.21.15.3:0/930755986 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc4002ea0 con 0x7f5ddc0bbcd0 2023-10-08T15:40:17.248 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.235+0000 7f5dd37fe700 1 -- 172.21.15.3:0/930755986 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dc4010510 con 0x7f5ddc0bbcd0 2023-10-08T15:40:17.248 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.235+0000 7f5de0c18700 1 -- 172.21.15.3:0/930755986 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ddc0678e0 con 0x7f5ddc0bbcd0 2023-10-08T15:40:17.248 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.235+0000 7f5dd37fe700 1 -- 172.21.15.3:0/930755986 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc40108b0 con 0x7f5ddc0bbcd0 2023-10-08T15:40:17.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.235+0000 7f5de0c18700 1 -- 172.21.15.3:0/930755986 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ddc0b8900 con 0x7f5ddc0bbcd0 2023-10-08T15:40:17.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.239+0000 7f5de0c18700 1 -- 172.21.15.3:0/930755986 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ddc05ecf0 con 0x7f5ddc0bbcd0 2023-10-08T15:40:17.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.239+0000 7f5dd37fe700 1 -- 172.21.15.3:0/930755986 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5dc4010c60 con 0x7f5ddc0bbcd0 2023-10-08T15:40:17.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.239+0000 7f5dd37fe700 1 --2- 172.21.15.3:0/930755986 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5dc0060550 0x7f5dc0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:17.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.239+0000 7f5dd37fe700 1 -- 172.21.15.3:0/930755986 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5dc407c310 con 0x7f5ddc0bbcd0 2023-10-08T15:40:17.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.239+0000 7f5ddb7fe700 1 --2- 172.21.15.3:0/930755986 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5dc0060550 0x7f5dc0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:17.250 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.239+0000 7f5ddb7fe700 1 --2- 172.21.15.3:0/930755986 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5dc0060550 0x7f5dc0062a00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc007fd0 tx=0x7f5dcc004b10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:17.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.247+0000 7f5dd37fe700 1 -- 172.21.15.3:0/930755986 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5dc404c860 con 0x7f5ddc0bbcd0 2023-10-08T15:40:17.411 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.407+0000 7f5de0c18700 1 -- 172.21.15.3:0/930755986 --> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5ddc0bd3d0 con 0x7f5dc0060550 2023-10-08T15:40:17.430 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.427+0000 7f5dd37fe700 1 -- 172.21.15.3:0/930755986 <== mgr.4102 v2:172.21.15.50:6832/33268 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282087 (secure 0 0 0) 0x7f5ddc0bd3d0 con 0x7f5dc0060550 2023-10-08T15:40:17.434 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:40:17.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.431+0000 7f5de0c18700 1 -- 172.21.15.3:0/930755986 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5dc0060550 msgr2=0x7f5dc0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:17.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.431+0000 7f5de0c18700 1 --2- 172.21.15.3:0/930755986 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5dc0060550 0x7f5dc0062a00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc007fd0 tx=0x7f5dcc004b10 comp rx=0 tx=0).stop 2023-10-08T15:40:17.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.431+0000 7f5de0c18700 1 -- 172.21.15.3:0/930755986 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5ddc0bbcd0 msgr2=0x7f5ddc095e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:17.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.431+0000 7f5de0c18700 1 --2- 172.21.15.3:0/930755986 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5ddc0bbcd0 0x7f5ddc095e50 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f5dc400c7c0 tx=0x7f5dc4007dc0 comp rx=0 tx=0).stop 2023-10-08T15:40:17.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.431+0000 7f5de0c18700 1 -- 172.21.15.3:0/930755986 shutdown_connections 2023-10-08T15:40:17.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.431+0000 7f5de0c18700 1 --2- 172.21.15.3:0/930755986 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5dc0060550 0x7f5dc0062a00 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:17.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.431+0000 7f5de0c18700 1 --2- 172.21.15.3:0/930755986 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5ddc0be5f0 0x7f5ddc096390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:17.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.431+0000 7f5de0c18700 1 --2- 172.21.15.3:0/930755986 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5ddc0bbcd0 0x7f5ddc095e50 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:17.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.431+0000 7f5de0c18700 1 --2- 172.21.15.3:0/930755986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ddc0b3280 0x7f5ddc0673a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:17.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.431+0000 7f5de0c18700 1 -- 172.21.15.3:0/930755986 >> 172.21.15.3:0/930755986 conn(0x7f5ddc0bf5e0 msgr2=0x7f5ddc069650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:17.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.431+0000 7f5de0c18700 1 -- 172.21.15.3:0/930755986 shutdown_connections 2023-10-08T15:40:17.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.431+0000 7f5de0c18700 1 -- 172.21.15.3:0/930755986 wait complete. 2023-10-08T15:40:17.438 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2023-10-08T15:40:17.453 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":122,"stamp":"2023-10-08T15:40:16.576666+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":158,"acting":158,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":23,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2422612,"kb_used_data":3348,"kb_used_omap":0,"kb_used_meta":2419200,"kb_avail":752552108,"statfs":{"total":773094113280,"available":770613358592,"internally_reserved":0,"allocated":3428352,"data_stored":2466429,"data_compressed":66282,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":2477260800},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.187823"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.407258+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:28:34.766239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.385664+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.385664+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.420460+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:30:30.000571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.385664+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.410518+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:00:59.377632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.403772+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:54:57.100270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.421501+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:38:30.636087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.418878+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:12:15.281539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.421558+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:03:53.266232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.420446+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:43:49.275350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.385664+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.408487+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:09:22.352521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.411446+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:38:57.982113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.413482+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:45:40.536163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.409788+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:07:16.107860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.385664+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.385664+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.410694+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:38:30.602209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.408593+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:04:41.815818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.411657+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:42:17.553342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.410705+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:43:36.368485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.409807+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:11:59.571805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.409144+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:39:23.149190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.410900+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:30:04.390806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.408073+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:17:34.699841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.385664+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.385664+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.410577+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:32:14.448543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.385664+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.412760+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:48:45.147119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.406245+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:24:23.445896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.406186+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:41:14.459572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-08T15:40:13.425751+0000","last_change":"2023-10-08T15:40:13.425751+0000","last_active":"2023-10-08T15:40:13.425751+0000","last_peered":"2023-10-08T15:40:13.425751+0000","last_clean":"2023-10-08T15:40:13.425751+0000","last_became_active":"2023-10-08T15:40:13.425422+0000","last_became_peered":"2023-10-08T15:40:13.425422+0000","last_unstale":"2023-10-08T15:40:13.425751+0000","last_undegraded":"2023-10-08T15:40:13.425751+0000","last_fullsized":"2023-10-08T15:40:13.425751+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:18.157723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.410294+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:37:34.755964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:12.373695+0000","last_change":"2023-10-08T15:40:12.392845+0000","last_active":"2023-10-08T15:40:12.373695+0000","last_peered":"2023-10-08T15:40:12.373695+0000","last_clean":"2023-10-08T15:40:12.373695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:12.373695+0000","last_undegraded":"2023-10-08T15:40:12.373695+0000","last_fullsized":"2023-10-08T15:40:12.373695+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:46:12.735503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.385664+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-08T15:40:13.422829+0000","last_change":"2023-10-08T15:40:13.422829+0000","last_active":"2023-10-08T15:40:13.422829+0000","last_peered":"2023-10-08T15:40:13.422829+0000","last_clean":"2023-10-08T15:40:13.422829+0000","last_became_active":"2023-10-08T15:40:13.422518+0000","last_became_peered":"2023-10-08T15:40:13.422518+0000","last_unstale":"2023-10-08T15:40:13.422829+0000","last_undegraded":"2023-10-08T15:40:13.422829+0000","last_fullsized":"2023-10-08T15:40:13.422829+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:50:13.842824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.405994+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:40:37.969828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-08T15:40:13.417157+0000","last_change":"2023-10-08T15:40:13.417157+0000","last_active":"2023-10-08T15:40:13.417157+0000","last_peered":"2023-10-08T15:40:13.417157+0000","last_clean":"2023-10-08T15:40:13.417157+0000","last_became_active":"2023-10-08T15:40:13.416876+0000","last_became_peered":"2023-10-08T15:40:13.416876+0000","last_unstale":"2023-10-08T15:40:13.417157+0000","last_undegraded":"2023-10-08T15:40:13.417157+0000","last_fullsized":"2023-10-08T15:40:13.417157+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:31:45.772524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.385664+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-08T15:40:13.417469+0000","last_change":"2023-10-08T15:40:13.417469+0000","last_active":"2023-10-08T15:40:13.417469+0000","last_peered":"2023-10-08T15:40:13.417469+0000","last_clean":"2023-10-08T15:40:13.417469+0000","last_became_active":"2023-10-08T15:40:13.417134+0000","last_became_peered":"2023-10-08T15:40:13.417134+0000","last_unstale":"2023-10-08T15:40:13.417469+0000","last_undegraded":"2023-10-08T15:40:13.417469+0000","last_fullsized":"2023-10-08T15:40:13.417469+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:38:58.180186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.418205+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:37.158933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:12.373695+0000","last_change":"2023-10-08T15:40:12.395264+0000","last_active":"2023-10-08T15:40:12.373695+0000","last_peered":"2023-10-08T15:40:12.373695+0000","last_clean":"2023-10-08T15:40:12.373695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:12.373695+0000","last_undegraded":"2023-10-08T15:40:12.373695+0000","last_fullsized":"2023-10-08T15:40:12.373695+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:17:52.309327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.420969+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:36:01.348005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:40:12.373695+0000","last_change":"2023-10-08T15:40:12.373695+0000","last_active":"2023-10-08T15:40:12.373695+0000","last_peered":"2023-10-08T15:40:12.373695+0000","last_clean":"2023-10-08T15:40:12.373695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:12.373695+0000","last_undegraded":"2023-10-08T15:40:12.373695+0000","last_fullsized":"2023-10-08T15:40:12.373695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.411084+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:47:34.821453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-08T15:40:13.427181+0000","last_change":"2023-10-08T15:40:13.427181+0000","last_active":"2023-10-08T15:40:13.427181+0000","last_peered":"2023-10-08T15:40:13.427181+0000","last_clean":"2023-10-08T15:40:13.427181+0000","last_became_active":"2023-10-08T15:40:13.425429+0000","last_became_peered":"2023-10-08T15:40:13.425429+0000","last_unstale":"2023-10-08T15:40:13.427181+0000","last_undegraded":"2023-10-08T15:40:13.427181+0000","last_fullsized":"2023-10-08T15:40:13.427181+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:49:42.599600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.385664+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:12.373695+0000","last_change":"2023-10-08T15:40:12.395575+0000","last_active":"2023-10-08T15:40:12.373695+0000","last_peered":"2023-10-08T15:40:12.373695+0000","last_clean":"2023-10-08T15:40:12.373695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:12.373695+0000","last_undegraded":"2023-10-08T15:40:12.373695+0000","last_fullsized":"2023-10-08T15:40:12.373695+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:38:56.970144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.406016+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:00.160396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-08T15:40:13.428311+0000","last_change":"2023-10-08T15:40:13.428311+0000","last_active":"2023-10-08T15:40:13.428311+0000","last_peered":"2023-10-08T15:40:13.428311+0000","last_clean":"2023-10-08T15:40:13.428311+0000","last_became_active":"2023-10-08T15:40:13.427998+0000","last_became_peered":"2023-10-08T15:40:13.427998+0000","last_unstale":"2023-10-08T15:40:13.428311+0000","last_undegraded":"2023-10-08T15:40:13.428311+0000","last_fullsized":"2023-10-08T15:40:13.428311+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:14:50.877335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.411088+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:42:44.785311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-08T15:40:13.426137+0000","last_change":"2023-10-08T15:40:13.426137+0000","last_active":"2023-10-08T15:40:13.426137+0000","last_peered":"2023-10-08T15:40:13.426137+0000","last_clean":"2023-10-08T15:40:13.426137+0000","last_became_active":"2023-10-08T15:40:13.425691+0000","last_became_peered":"2023-10-08T15:40:13.425691+0000","last_unstale":"2023-10-08T15:40:13.426137+0000","last_undegraded":"2023-10-08T15:40:13.426137+0000","last_fullsized":"2023-10-08T15:40:13.426137+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:47:36.657587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.406338+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:46:58.163129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-08T15:40:13.420187+0000","last_change":"2023-10-08T15:40:13.420187+0000","last_active":"2023-10-08T15:40:13.420187+0000","last_peered":"2023-10-08T15:40:13.420187+0000","last_clean":"2023-10-08T15:40:13.420187+0000","last_became_active":"2023-10-08T15:40:13.419818+0000","last_became_peered":"2023-10-08T15:40:13.419818+0000","last_unstale":"2023-10-08T15:40:13.420187+0000","last_undegraded":"2023-10-08T15:40:13.420187+0000","last_fullsized":"2023-10-08T15:40:13.420187+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:34:03.849463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.410947+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:38:56.397317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-08T15:40:13.428224+0000","last_change":"2023-10-08T15:40:13.428224+0000","last_active":"2023-10-08T15:40:13.428224+0000","last_peered":"2023-10-08T15:40:13.428224+0000","last_clean":"2023-10-08T15:40:13.428224+0000","last_became_active":"2023-10-08T15:40:13.427919+0000","last_became_peered":"2023-10-08T15:40:13.427919+0000","last_unstale":"2023-10-08T15:40:13.428224+0000","last_undegraded":"2023-10-08T15:40:13.428224+0000","last_fullsized":"2023-10-08T15:40:13.428224+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:32:49.859693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.417580+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:46:13.747473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-08T15:40:13.415599+0000","last_change":"2023-10-08T15:40:13.415599+0000","last_active":"2023-10-08T15:40:13.415599+0000","last_peered":"2023-10-08T15:40:13.415599+0000","last_clean":"2023-10-08T15:40:13.415599+0000","last_became_active":"2023-10-08T15:40:13.415310+0000","last_became_peered":"2023-10-08T15:40:13.415310+0000","last_unstale":"2023-10-08T15:40:13.415599+0000","last_undegraded":"2023-10-08T15:40:13.415599+0000","last_fullsized":"2023-10-08T15:40:13.415599+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:18:27.690730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.408004+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:57:32.025855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-08T15:40:13.422903+0000","last_change":"2023-10-08T15:40:13.422903+0000","last_active":"2023-10-08T15:40:13.422903+0000","last_peered":"2023-10-08T15:40:13.422903+0000","last_clean":"2023-10-08T15:40:13.422903+0000","last_became_active":"2023-10-08T15:40:13.422586+0000","last_became_peered":"2023-10-08T15:40:13.422586+0000","last_unstale":"2023-10-08T15:40:13.422903+0000","last_undegraded":"2023-10-08T15:40:13.422903+0000","last_fullsized":"2023-10-08T15:40:13.422903+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:45.342530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.402928+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:07:13.974255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-08T15:40:13.427234+0000","last_change":"2023-10-08T15:40:13.427234+0000","last_active":"2023-10-08T15:40:13.427234+0000","last_peered":"2023-10-08T15:40:13.427234+0000","last_clean":"2023-10-08T15:40:13.427234+0000","last_became_active":"2023-10-08T15:40:13.424985+0000","last_became_peered":"2023-10-08T15:40:13.424985+0000","last_unstale":"2023-10-08T15:40:13.427234+0000","last_undegraded":"2023-10-08T15:40:13.427234+0000","last_fullsized":"2023-10-08T15:40:13.427234+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:18:01.774995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.405308+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:47:26.939356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-08T15:40:13.417048+0000","last_change":"2023-10-08T15:40:13.417048+0000","last_active":"2023-10-08T15:40:13.417048+0000","last_peered":"2023-10-08T15:40:13.417048+0000","last_clean":"2023-10-08T15:40:13.417048+0000","last_became_active":"2023-10-08T15:40:13.416724+0000","last_became_peered":"2023-10-08T15:40:13.416724+0000","last_unstale":"2023-10-08T15:40:13.417048+0000","last_undegraded":"2023-10-08T15:40:13.417048+0000","last_fullsized":"2023-10-08T15:40:13.417048+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:19:37.829086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.410971+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:17:53.321297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:12.373695+0000","last_change":"2023-10-08T15:40:12.394588+0000","last_active":"2023-10-08T15:40:12.373695+0000","last_peered":"2023-10-08T15:40:12.373695+0000","last_clean":"2023-10-08T15:40:12.373695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:12.373695+0000","last_undegraded":"2023-10-08T15:40:12.373695+0000","last_fullsized":"2023-10-08T15:40:12.373695+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:43:35.356515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.410806+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:57:21.978994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:40:12.373695+0000","last_change":"2023-10-08T15:40:12.373695+0000","last_active":"2023-10-08T15:40:12.373695+0000","last_peered":"2023-10-08T15:40:12.373695+0000","last_clean":"2023-10-08T15:40:12.373695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:12.373695+0000","last_undegraded":"2023-10-08T15:40:12.373695+0000","last_fullsized":"2023-10-08T15:40:12.373695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.412173+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:47:00.512892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-08T15:40:13.424921+0000","last_change":"2023-10-08T15:40:13.424921+0000","last_active":"2023-10-08T15:40:13.424921+0000","last_peered":"2023-10-08T15:40:13.424921+0000","last_clean":"2023-10-08T15:40:13.424921+0000","last_became_active":"2023-10-08T15:40:13.424591+0000","last_became_peered":"2023-10-08T15:40:13.424591+0000","last_unstale":"2023-10-08T15:40:13.424921+0000","last_undegraded":"2023-10-08T15:40:13.424921+0000","last_fullsized":"2023-10-08T15:40:13.424921+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:55:29.262854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.409973+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:32:47.327437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-08T15:40:13.417299+0000","last_change":"2023-10-08T15:40:13.417299+0000","last_active":"2023-10-08T15:40:13.417299+0000","last_peered":"2023-10-08T15:40:13.417299+0000","last_clean":"2023-10-08T15:40:13.417299+0000","last_became_active":"2023-10-08T15:40:13.416982+0000","last_became_peered":"2023-10-08T15:40:13.416982+0000","last_unstale":"2023-10-08T15:40:13.417299+0000","last_undegraded":"2023-10-08T15:40:13.417299+0000","last_fullsized":"2023-10-08T15:40:13.417299+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:19:37.108661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.405927+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:40:05.133298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:40:12.373695+0000","last_change":"2023-10-08T15:40:12.373695+0000","last_active":"2023-10-08T15:40:12.373695+0000","last_peered":"2023-10-08T15:40:12.373695+0000","last_clean":"2023-10-08T15:40:12.373695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:12.373695+0000","last_undegraded":"2023-10-08T15:40:12.373695+0000","last_fullsized":"2023-10-08T15:40:12.373695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.405368+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:17:27.628792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-08T15:40:13.424876+0000","last_change":"2023-10-08T15:40:13.424876+0000","last_active":"2023-10-08T15:40:13.424876+0000","last_peered":"2023-10-08T15:40:13.424876+0000","last_clean":"2023-10-08T15:40:13.424876+0000","last_became_active":"2023-10-08T15:40:13.424570+0000","last_became_peered":"2023-10-08T15:40:13.424570+0000","last_unstale":"2023-10-08T15:40:13.424876+0000","last_undegraded":"2023-10-08T15:40:13.424876+0000","last_fullsized":"2023-10-08T15:40:13.424876+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:15:27.675296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.418246+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:22:15.419220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-08T15:40:13.414016+0000","last_change":"2023-10-08T15:40:13.414016+0000","last_active":"2023-10-08T15:40:13.414016+0000","last_peered":"2023-10-08T15:40:13.414016+0000","last_clean":"2023-10-08T15:40:13.414016+0000","last_became_active":"2023-10-08T15:40:13.413732+0000","last_became_peered":"2023-10-08T15:40:13.413732+0000","last_unstale":"2023-10-08T15:40:13.414016+0000","last_undegraded":"2023-10-08T15:40:13.414016+0000","last_fullsized":"2023-10-08T15:40:13.414016+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:43:34.768625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.409718+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:23.701420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-08T15:40:13.416965+0000","last_change":"2023-10-08T15:40:13.416965+0000","last_active":"2023-10-08T15:40:13.416965+0000","last_peered":"2023-10-08T15:40:13.416965+0000","last_clean":"2023-10-08T15:40:13.416965+0000","last_became_active":"2023-10-08T15:40:13.416634+0000","last_became_peered":"2023-10-08T15:40:13.416634+0000","last_unstale":"2023-10-08T15:40:13.416965+0000","last_undegraded":"2023-10-08T15:40:13.416965+0000","last_fullsized":"2023-10-08T15:40:13.416965+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:46:04.044725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.411616+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:45:31.344771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-08T15:40:13.423625+0000","last_change":"2023-10-08T15:40:13.423625+0000","last_active":"2023-10-08T15:40:13.423625+0000","last_peered":"2023-10-08T15:40:13.423625+0000","last_clean":"2023-10-08T15:40:13.423625+0000","last_became_active":"2023-10-08T15:40:13.422315+0000","last_became_peered":"2023-10-08T15:40:13.422315+0000","last_unstale":"2023-10-08T15:40:13.423625+0000","last_undegraded":"2023-10-08T15:40:13.423625+0000","last_fullsized":"2023-10-08T15:40:13.423625+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:25:11.825747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.405201+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:31:13.395939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-08T15:40:13.423017+0000","last_change":"2023-10-08T15:40:13.423017+0000","last_active":"2023-10-08T15:40:13.423017+0000","last_peered":"2023-10-08T15:40:13.423017+0000","last_clean":"2023-10-08T15:40:13.423017+0000","last_became_active":"2023-10-08T15:40:13.422248+0000","last_became_peered":"2023-10-08T15:40:13.422248+0000","last_unstale":"2023-10-08T15:40:13.423017+0000","last_undegraded":"2023-10-08T15:40:13.423017+0000","last_fullsized":"2023-10-08T15:40:13.423017+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:07:40.679262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.409388+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:26:20.874012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-08T15:40:13.422628+0000","last_change":"2023-10-08T15:40:13.422628+0000","last_active":"2023-10-08T15:40:13.422628+0000","last_peered":"2023-10-08T15:40:13.422628+0000","last_clean":"2023-10-08T15:40:13.422628+0000","last_became_active":"2023-10-08T15:40:13.422297+0000","last_became_peered":"2023-10-08T15:40:13.422297+0000","last_unstale":"2023-10-08T15:40:13.422628+0000","last_undegraded":"2023-10-08T15:40:13.422628+0000","last_fullsized":"2023-10-08T15:40:13.422628+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:03.198759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.409881+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:54:26.469514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:12.373695+0000","last_change":"2023-10-08T15:40:12.392895+0000","last_active":"2023-10-08T15:40:12.373695+0000","last_peered":"2023-10-08T15:40:12.373695+0000","last_clean":"2023-10-08T15:40:12.373695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:12.373695+0000","last_undegraded":"2023-10-08T15:40:12.373695+0000","last_fullsized":"2023-10-08T15:40:12.373695+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:34:53.583458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.385664+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-08T15:40:13.423501+0000","last_change":"2023-10-08T15:40:13.423501+0000","last_active":"2023-10-08T15:40:13.423501+0000","last_peered":"2023-10-08T15:40:13.423501+0000","last_clean":"2023-10-08T15:40:13.423501+0000","last_became_active":"2023-10-08T15:40:13.423112+0000","last_became_peered":"2023-10-08T15:40:13.423112+0000","last_unstale":"2023-10-08T15:40:13.423501+0000","last_undegraded":"2023-10-08T15:40:13.423501+0000","last_fullsized":"2023-10-08T15:40:13.423501+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:46:45.482090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.385664+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-08T15:40:13.424672+0000","last_change":"2023-10-08T15:40:13.424672+0000","last_active":"2023-10-08T15:40:13.424672+0000","last_peered":"2023-10-08T15:40:13.424672+0000","last_clean":"2023-10-08T15:40:13.424672+0000","last_became_active":"2023-10-08T15:40:13.422477+0000","last_became_peered":"2023-10-08T15:40:13.422477+0000","last_unstale":"2023-10-08T15:40:13.424672+0000","last_undegraded":"2023-10-08T15:40:13.424672+0000","last_fullsized":"2023-10-08T15:40:13.424672+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:28:30.689512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.421007+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:55:34.015542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:40:12.373695+0000","last_change":"2023-10-08T15:40:12.373695+0000","last_active":"2023-10-08T15:40:12.373695+0000","last_peered":"2023-10-08T15:40:12.373695+0000","last_clean":"2023-10-08T15:40:12.373695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:12.373695+0000","last_undegraded":"2023-10-08T15:40:12.373695+0000","last_fullsized":"2023-10-08T15:40:12.373695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":180,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-08T15:40:12.396087+0000","last_change":"2023-10-08T15:37:19.380955+0000","last_active":"2023-10-08T15:40:12.396087+0000","last_peered":"2023-10-08T15:40:12.396087+0000","last_clean":"2023-10-08T15:40:12.396087+0000","last_became_active":"2023-10-08T15:37:19.378277+0000","last_became_peered":"2023-10-08T15:37:19.378277+0000","last_unstale":"2023-10-08T15:40:12.396087+0000","last_undegraded":"2023-10-08T15:40:12.396087+0000","last_fullsized":"2023-10-08T15:40:12.396087+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:17.537726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:17.537726+0000","last_clean_scrub_stamp":"2023-10-08T15:37:17.537726+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:06:26.612046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":100,"acting":100,"num_store_stats":6},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":56,"acting":56,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66282,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542181,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301864,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069976,"statfs":{"total":96636764160,"available":96327655424,"internally_reserved":0,"allocated":491520,"data_stored":758004,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.94399999999999995,"15min":0.95999999999999996},"min":{"1min":0.64700000000000002,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.3460000000000001,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.93000000000000005,"15min":0.93100000000000005},"min":{"1min":0.66300000000000003,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.389,"5min":1.758,"15min":1.758},"last":0.87}]},{"osd":1,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.90700000000000003,"15min":0.89400000000000002},"min":{"1min":0.59799999999999998,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.4299999999999999,"5min":1.474,"15min":1.474},"last":1.1259999999999999},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.96699999999999997,"15min":0.96299999999999997},"min":{"1min":0.71099999999999997,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.70699999999999996}]},{"osd":2,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":1.016,"15min":1.0309999999999999},"min":{"1min":0.66000000000000003,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.268,"5min":1.623,"15min":1.623},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.0009999999999999,"15min":1.006},"min":{"1min":0.72799999999999998,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.1990000000000001,"5min":1.321,"15min":1.321},"last":0.65200000000000002}]},{"osd":3,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":0.98699999999999999,"15min":0.97399999999999998},"min":{"1min":0.82999999999999996,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.222,"5min":1.2110000000000001,"15min":1.2090000000000001},"min":{"1min":1.012,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":1.087}]},{"osd":4,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":1.073,"15min":1.089},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.298,"5min":1.512,"15min":1.512},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.095,"15min":1.1000000000000001},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.353,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":1.1799999999999999}]},{"osd":5,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.2509999999999999,"15min":1.272},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.573,"5min":1.74,"15min":1.74},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.163,"5min":1.236,"15min":1.248},"min":{"1min":0.88700000000000001,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.381,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":1.1519999999999999}]},{"osd":6,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.2969999999999999,"15min":1.3169999999999999},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.4610000000000001,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.228},{"interface":"front","average":{"1min":1.151,"5min":1.2410000000000001,"15min":1.256},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":1.411,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.03}]}]},{"osd":6,"up_from":14,"seq":60129542182,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301788,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070052,"statfs":{"total":96636764160,"available":96327733248,"internally_reserved":0,"allocated":413696,"data_stored":161381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.84199999999999997,"15min":0.82399999999999995},"min":{"1min":0.70699999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.218,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.98399999999999999,"15min":0.997},"min":{"1min":0.71399999999999997,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.1890000000000001,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.1910000000000001}]},{"osd":1,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.94899999999999995,"15min":0.95699999999999996},"min":{"1min":0.70599999999999996,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.2729999999999999,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":1.3520000000000001},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.98599999999999999,"15min":0.98999999999999999},"min":{"1min":0.64600000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.397,"5min":1.853,"15min":1.853},"last":1.071}]},{"osd":2,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.85699999999999998,"15min":0.84599999999999997},"min":{"1min":0.69299999999999995,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.876},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0649999999999999,"15min":1.0760000000000001},"min":{"1min":0.64700000000000002,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.4019999999999999,"5min":1.518,"15min":1.518},"last":1.2529999999999999}]},{"osd":3,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.0169999999999999,"15min":1.02},"min":{"1min":0.78300000000000003,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.3169999999999999,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":1.29},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.071,"15min":1.081},"min":{"1min":0.79600000000000004,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.296,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":1.0449999999999999}]},{"osd":4,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":1.095,"15min":1.115},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.3360000000000001,"5min":1.484,"15min":1.484},"last":1.105},{"interface":"front","average":{"1min":1.121,"5min":1.181,"15min":1.1910000000000001},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.72299999999999998}]},{"osd":5,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.1160000000000001,"15min":1.125},"min":{"1min":0.753,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.329,"5min":1.581,"15min":1.581},"last":0.78200000000000003},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.294,"15min":1.3120000000000001},"min":{"1min":1.0049999999999999,"5min":0.96099999999999997,"15min":0.96099999999999997},"max":{"1min":1.417,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":1.167}]},{"osd":7,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.2709999999999999,"15min":1.2849999999999999},"min":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":1.4550000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.2969999999999999,"15min":1.3109999999999999},"min":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":1.5429999999999999,"5min":2.5630000000000002,"15min":2.5630000000000002},"last":1.135}]}]},{"osd":3,"up_from":14,"seq":60129542183,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305884,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065956,"statfs":{"total":96636764160,"available":96323538944,"internally_reserved":0,"allocated":413696,"data_stored":161381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.71199999999999997,"15min":0.71999999999999997},"min":{"1min":0.51200000000000001,"5min":0.501,"15min":0.501},"max":{"1min":0.96299999999999997,"5min":1.056,"15min":1.056},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.76800000000000002,"15min":0.76200000000000001},"min":{"1min":0.59699999999999998,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.93700000000000006}]},{"osd":1,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.72099999999999997,"15min":0.71299999999999997},"min":{"1min":0.56899999999999995,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.82399999999999995,"15min":0.81200000000000006},"min":{"1min":0.67000000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1870000000000001,"5min":1.256,"15min":1.256},"last":1.038}]},{"osd":2,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.85999999999999999,"15min":0.85399999999999998},"min":{"1min":0.66900000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.337,"5min":1.361,"15min":1.361},"last":1.4419999999999999},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.92200000000000004,"15min":0.92600000000000005},"min":{"1min":0.751,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.228,"5min":1.423,"15min":1.423},"last":0.98399999999999999}]},{"osd":4,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.0820000000000001,"15min":1.0680000000000001},"min":{"1min":0.90000000000000002,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.3879999999999999,"5min":1.504,"15min":1.504},"last":1.153},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.145,"15min":1.155},"min":{"1min":0.85599999999999998,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.4410000000000001,"5min":2.762,"15min":2.762},"last":1.264}]},{"osd":5,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.1679999999999999,"15min":1.1619999999999999},"min":{"1min":0.92800000000000005,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.466,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.3700000000000001},{"interface":"front","average":{"1min":1.22,"5min":1.2330000000000001,"15min":1.2350000000000001},"min":{"1min":0.95899999999999996,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.474,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":1.3280000000000001}]},{"osd":6,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.2889999999999999,"15min":1.304},"min":{"1min":0.97199999999999998,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.569,"5min":2.6890000000000001,"15min":2.6890000000000001},"last":1.415},{"interface":"front","average":{"1min":1.238,"5min":1.2250000000000001,"15min":1.2230000000000001},"min":{"1min":0.89100000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":1.462,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":1.581}]},{"osd":7,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.2649999999999999,"15min":1.2589999999999999},"min":{"1min":0.97699999999999998,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":1.528,"5min":1.738,"15min":1.738},"last":1.528},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.3520000000000001,"15min":1.3620000000000001},"min":{"1min":1.1080000000000001,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.623,"5min":2.5840000000000001,"15min":2.5840000000000001},"last":1.48}]}]},{"osd":2,"up_from":14,"seq":60129542182,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301788,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070052,"statfs":{"total":96636764160,"available":96327733248,"internally_reserved":0,"allocated":413696,"data_stored":161381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.626,"15min":0.621},"min":{"1min":0.48799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.67200000000000004,"15min":0.64900000000000002},"min":{"1min":0.52800000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.97899999999999998}]},{"osd":1,"last update":"Sun Oct 8 15:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.69099999999999995,"15min":0.67700000000000005},"min":{"1min":0.59399999999999997,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.71599999999999997,"15min":0.69199999999999995},"min":{"1min":0.55400000000000005,"5min":0.307,"15min":0.307},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":1.1439999999999999}]},{"osd":3,"last update":"Sun Oct 8 15:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.66600000000000004,"15min":0.64200000000000002},"min":{"1min":0.52300000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.85299999999999998,"15min":0.84299999999999997},"min":{"1min":0.72299999999999998,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.127,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":1.02}]},{"osd":4,"last update":"Sun Oct 8 15:39:23 2023","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.004,"15min":1},"min":{"1min":0.75600000000000001,"5min":0.748,"15min":0.748},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.88400000000000001},{"interface":"front","average":{"1min":1.028,"5min":1.0329999999999999,"15min":1.034},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.4319999999999999,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.2509999999999999}]},{"osd":5,"last update":"Sun Oct 8 15:39:23 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.0589999999999999,"15min":1.0569999999999999},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.091,"5min":1.0640000000000001,"15min":1.0600000000000001},"min":{"1min":0.81000000000000005,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.288,"5min":1.452,"15min":1.452},"last":1.0840000000000001}]},{"osd":6,"last update":"Sun Oct 8 15:39:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.0940000000000001,"15min":1.091},"min":{"1min":0.82699999999999996,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.4159999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.117,"15min":1.105},"min":{"1min":0.85499999999999998,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":1.198}]},{"osd":7,"last update":"Sun Oct 8 15:39:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.159,"15min":1.1499999999999999},"min":{"1min":0.84899999999999998,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.1739999999999999,"15min":1.161},"min":{"1min":0.86299999999999999,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.579,"5min":1.804,"15min":1.804},"last":1.226}]}]},{"osd":1,"up_from":14,"seq":60129542183,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305884,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065956,"statfs":{"total":96636764160,"available":96323538944,"internally_reserved":0,"allocated":413696,"data_stored":161381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.76500000000000001,"15min":0.77500000000000002},"min":{"1min":0.46700000000000003,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.165,"5min":1.734,"15min":1.734},"last":1.0840000000000001},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.96299999999999997,"15min":1},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0509999999999999,"5min":5.7960000000000003,"15min":5.7960000000000003},"last":0.64500000000000002}]},{"osd":2,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.83299999999999996,"15min":0.84699999999999998},"min":{"1min":0.56200000000000006,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.048,"5min":4.0119999999999996,"15min":4.0119999999999996},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.90600000000000003,"15min":0.91000000000000003},"min":{"1min":0.61599999999999999,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.0840000000000001,"5min":1.853,"15min":1.853},"last":0.94699999999999995}]},{"osd":3,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":1.7569999999999999,"5min":1.121,"15min":1.0149999999999999},"min":{"1min":0.73399999999999999,"5min":0.435,"15min":0.435},"max":{"1min":13.388,"5min":13.388,"15min":13.388},"last":0.66700000000000004},{"interface":"front","average":{"1min":1.6899999999999999,"5min":1.2549999999999999,"15min":1.1830000000000001},"min":{"1min":0.66100000000000003,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":13.353,"5min":13.353,"15min":13.353},"last":0.52300000000000002}]},{"osd":4,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":1.2070000000000001,"15min":1.246},"min":{"1min":0.77800000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.246,"5min":5.859,"15min":5.859},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.022,"5min":1.1479999999999999,"15min":1.169},"min":{"1min":0.82199999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.4550000000000001,"5min":4.2679999999999998,"15min":4.2679999999999998},"last":1.038}]},{"osd":5,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.143,"15min":1.151},"min":{"1min":0.85799999999999998,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.5389999999999999,"5min":4.3380000000000001,"15min":4.3380000000000001},"last":1.179},{"interface":"front","average":{"1min":1.216,"5min":1.1890000000000001,"15min":1.1850000000000001},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.589,"5min":2.085,"15min":2.085},"last":1.21}]},{"osd":6,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.359,"15min":1.3919999999999999},"min":{"1min":0.93600000000000005,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.4119999999999999,"5min":5.8979999999999997,"15min":5.8979999999999997},"last":1.125},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.274,"15min":1.284},"min":{"1min":1.0249999999999999,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.4390000000000001,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":0.86399999999999999}]},{"osd":7,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.2549999999999999,"15min":1.2509999999999999},"min":{"1min":0.93400000000000005,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.679,"5min":2.3940000000000001,"15min":2.3940000000000001},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.222,"5min":1.46,"15min":1.5},"min":{"1min":1.0209999999999999,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.387,"5min":5.9299999999999997,"15min":5.9299999999999997},"last":0.998}]}]},{"osd":0,"up_from":14,"seq":60129542183,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301852,"kb_used_data":468,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069988,"statfs":{"total":96636764160,"available":96327667712,"internally_reserved":0,"allocated":479232,"data_stored":751749,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 15:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.81899999999999995,"15min":0.84199999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.3799999999999999,"5min":1.514,"15min":1.514},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.79200000000000004,"15min":0.79800000000000004},"min":{"1min":0.50600000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.999,"5min":1.518,"15min":1.518},"last":0.55900000000000005}]},{"osd":2,"last update":"Sun Oct 8 15:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.84499999999999997,"15min":0.86399999999999999},"min":{"1min":0.55400000000000005,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1539999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.79600000000000004,"15min":0.78900000000000003},"min":{"1min":0.61599999999999999,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.0800000000000001,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.44}]},{"osd":3,"last update":"Sun Oct 8 15:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.75600000000000001,"15min":0.76000000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.091,"5min":1.103,"15min":1.103},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.98499999999999999,"15min":0.995},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.474,"5min":2.3290000000000002,"15min":2.3290000000000002},"last":0.85299999999999998}]},{"osd":4,"last update":"Sun Oct 8 15:39:20 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.085,"15min":1.095},"min":{"1min":0.76000000000000001,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.49,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.093,"15min":1.0980000000000001},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.538,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":1.0880000000000001}]},{"osd":5,"last update":"Sun Oct 8 15:39:20 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0900000000000001,"15min":1.101},"min":{"1min":0.72099999999999997,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.413,"5min":2.214,"15min":2.214},"last":1.222},{"interface":"front","average":{"1min":1.151,"5min":1.323,"15min":1.3520000000000001},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.5269999999999999,"5min":3.4569999999999999,"15min":3.4569999999999999},"last":1.1359999999999999}]},{"osd":6,"last update":"Sun Oct 8 15:39:20 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.29,"15min":1.3080000000000001},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":1.575,"5min":2.532,"15min":2.532},"last":1.044},{"interface":"front","average":{"1min":1.216,"5min":1.244,"15min":1.2490000000000001},"min":{"1min":0.92700000000000005,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.6200000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.99099999999999999}]},{"osd":7,"last update":"Sun Oct 8 15:39:20 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.292,"15min":1.3},"min":{"1min":1.01,"5min":0.98199999999999998,"15min":0.98199999999999998},"max":{"1min":1.571,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.2310000000000001,"15min":1.2350000000000001},"min":{"1min":0.85199999999999998,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.597,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":1.167}]}]},{"osd":5,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":301776,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070064,"statfs":{"total":96636764160,"available":96327745536,"internally_reserved":0,"allocated":401408,"data_stored":155576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.85599999999999998,"15min":0.84799999999999998},"min":{"1min":0.53600000000000003,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":1.1990000000000001},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.90700000000000003,"15min":0.91000000000000003},"min":{"1min":0.67400000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.147,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.67000000000000004}]},{"osd":1,"last update":"Sun Oct 8 15:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.92000000000000004,"15min":0.91100000000000003},"min":{"1min":0.628,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.88,"5min":0.97599999999999998,"15min":0.99199999999999999},"min":{"1min":0.68500000000000005,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1799999999999999,"5min":1.754,"15min":1.754},"last":1.0249999999999999}]},{"osd":2,"last update":"Sun Oct 8 15:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.306,"5min":1.869,"15min":1.869},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.97499999999999998,"5min":1.0109999999999999,"15min":1.0169999999999999},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.484,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.78600000000000003}]},{"osd":3,"last update":"Sun Oct 8 15:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.997,"15min":1.0009999999999999},"min":{"1min":0.78300000000000003,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.2110000000000001,"5min":1.929,"15min":1.929},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.022,"5min":1.101,"15min":1.1140000000000001},"min":{"1min":0.745,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.3140000000000001,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.98299999999999998}]},{"osd":4,"last update":"Sun Oct 8 15:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.0109999999999999,"15min":1.014},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.464,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.085,"15min":1.085},"min":{"1min":0.67600000000000005,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.601,"5min":1.823,"15min":1.823},"last":1.0640000000000001}]},{"osd":6,"last update":"Sun Oct 8 15:39:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.202,"15min":1.2070000000000001},"min":{"1min":0.95899999999999996,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.429,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.165,"5min":1.2290000000000001,"15min":1.24},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.6739999999999999,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.3029999999999999}]},{"osd":7,"last update":"Sun Oct 8 15:39:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.155,"15min":1.167},"min":{"1min":0.89800000000000002,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.272,"5min":2.177,"15min":2.177},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.2190000000000001,"15min":1.2210000000000001},"min":{"1min":1.0089999999999999,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.575,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.167}]}]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301776,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070064,"statfs":{"total":96636764160,"available":96327745536,"internally_reserved":0,"allocated":401408,"data_stored":155576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.82199999999999995,"15min":0.81000000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":1.0269999999999999},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.79000000000000004,"15min":0.78700000000000003},"min":{"1min":0.59199999999999997,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.99399999999999999}]},{"osd":1,"last update":"Sun Oct 8 15:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.84499999999999997,"15min":0.83199999999999996},"min":{"1min":0.66200000000000003,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":1.0920000000000001},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83099999999999996,"15min":0.82999999999999996},"min":{"1min":0.68799999999999994,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.149,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.95999999999999996}]},{"osd":2,"last update":"Sun Oct 8 15:39:20 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.048,"15min":1.034},"min":{"1min":0.80100000000000005,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.3380000000000001,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":1.1220000000000001},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.012,"15min":1.0189999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.268,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.88900000000000001}]},{"osd":3,"last update":"Sun Oct 8 15:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":1.0129999999999999,"15min":1.0189999999999999},"min":{"1min":0.72599999999999998,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.3169999999999999,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.036,"15min":1.0329999999999999},"min":{"1min":0.77400000000000002,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":1.1890000000000001}]},{"osd":5,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":0.98599999999999999,"15min":0.97099999999999997},"min":{"1min":0.79500000000000004,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0649999999999999,"15min":1.0609999999999999},"min":{"1min":0.67800000000000005,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.65300000000000002}]},{"osd":6,"last update":"Sun Oct 8 15:39:20 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.139,"15min":1.147},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.319,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.179,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.91400000000000003,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.4159999999999999,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":1.149}]},{"osd":7,"last update":"Sun Oct 8 15:39:20 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.0740000000000001,"15min":1.0680000000000001},"min":{"1min":0.755,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.85399999999999998},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.196,"15min":1.1910000000000001},"min":{"1min":0.96699999999999997,"5min":0.625,"15min":0.625},"max":{"1min":1.587,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.2150000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T15:40:17.461 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T15:40:17.568 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.563+0000 7f0d4c8a5700 1 Processor -- start 2023-10-08T15:40:17.568 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.563+0000 7f0d4c8a5700 1 -- start start 2023-10-08T15:40:17.569 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.563+0000 7f0d4c8a5700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0d480a1fd0 0x7f0d48148330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:17.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.563+0000 7f0d4c8a5700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f0d4814c6c0 0x7f0d48148870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:17.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.563+0000 7f0d4c8a5700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d480b3b10 con 0x7f0d48148db0 2023-10-08T15:40:17.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.563+0000 7f0d4c8a5700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d4814b9d0 con 0x7f0d4814c6c0 2023-10-08T15:40:17.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.563+0000 7f0d4c8a5700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d4814bbe0 con 0x7f0d480a1fd0 2023-10-08T15:40:17.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.563+0000 7f0d45d9b700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f0d4814c6c0 0x7f0d48148870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:17.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.563+0000 7f0d45d9b700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f0d4814c6c0 0x7f0d48148870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52640/0 (socket says 172.21.15.3:52640) 2023-10-08T15:40:17.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.567+0000 7f0d45d9b700 1 -- 172.21.15.3:0/961651994 learned_addr learned my addr 172.21.15.3:0/961651994 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:17.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.567+0000 7f0d4659c700 1 --2- 172.21.15.3:0/961651994 >> v2:172.21.15.50:3300/0 conn(0x7f0d480a1fd0 0x7f0d48148330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:17.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.567+0000 7f0d45d9b700 1 -- 172.21.15.3:0/961651994 >> v2:172.21.15.50:3300/0 conn(0x7f0d480a1fd0 msgr2=0x7f0d48148330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:17.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.567+0000 7f0d45d9b700 1 --2- 172.21.15.3:0/961651994 >> v2:172.21.15.50:3300/0 conn(0x7f0d480a1fd0 0x7f0d48148330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:17.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.567+0000 7f0d45d9b700 1 -- 172.21.15.3:0/961651994 >> v1:172.21.15.50:6789/0 conn(0x7f0d48148db0 legacy=0x7f0d480b1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:17.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.567+0000 7f0d45d9b700 1 -- 172.21.15.3:0/961651994 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d4814bec0 con 0x7f0d4814c6c0 2023-10-08T15:40:17.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.567+0000 7f0d45d9b700 1 --2- 172.21.15.3:0/961651994 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0d4814c6c0 0x7f0d48148870 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f0d4806ca10 tx=0x7f0d38009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bd2bab2807505f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:17.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.567+0000 7f0d4559a700 1 -- 172.21.15.3:0/961651994 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3800b7f0 con 0x7f0d4814c6c0 2023-10-08T15:40:17.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.567+0000 7f0d4559a700 1 -- 172.21.15.3:0/961651994 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d3800b950 con 0x7f0d4814c6c0 2023-10-08T15:40:17.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.567+0000 7f0d4559a700 1 -- 172.21.15.3:0/961651994 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3800bcf0 con 0x7f0d4814c6c0 2023-10-08T15:40:17.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.567+0000 7f0d4c8a5700 1 -- 172.21.15.3:0/961651994 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0d4814c6c0 msgr2=0x7f0d48148870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:17.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.567+0000 7f0d4c8a5700 1 --2- 172.21.15.3:0/961651994 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0d4814c6c0 0x7f0d48148870 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f0d4806ca10 tx=0x7f0d38009250 comp rx=0 tx=0).stop 2023-10-08T15:40:17.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.567+0000 7f0d4c8a5700 1 -- 172.21.15.3:0/961651994 shutdown_connections 2023-10-08T15:40:17.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.567+0000 7f0d4c8a5700 1 --2- 172.21.15.3:0/961651994 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0d4814c6c0 0x7f0d48148870 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:17.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.567+0000 7f0d4c8a5700 1 --2- 172.21.15.3:0/961651994 >> v2:172.21.15.50:3300/0 conn(0x7f0d480a1fd0 0x7f0d48148330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:17.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.567+0000 7f0d4c8a5700 1 -- 172.21.15.3:0/961651994 >> 172.21.15.3:0/961651994 conn(0x7f0d4806b9b0 msgr2=0x7f0d480681f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:17.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.567+0000 7f0d4c8a5700 1 -- 172.21.15.3:0/961651994 shutdown_connections 2023-10-08T15:40:17.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.567+0000 7f0d4c8a5700 1 -- 172.21.15.3:0/961651994 wait complete. 2023-10-08T15:40:17.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.571+0000 7f0d4c8a5700 1 Processor -- start 2023-10-08T15:40:17.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.571+0000 7f0d4c8a5700 1 -- start start 2023-10-08T15:40:17.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.571+0000 7f0d4c8a5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d480a1fd0 0x7f0d48158ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:17.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.571+0000 7f0d4c8a5700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0d48148db0 0x7f0d481498d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:17.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.571+0000 7f0d4c8a5700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0d4814c6c0 0x7f0d48149e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:17.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.571+0000 7f0d4c8a5700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d48159530 con 0x7f0d4814c6c0 2023-10-08T15:40:17.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.571+0000 7f0d4c8a5700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d480b58e0 con 0x7f0d480a1fd0 2023-10-08T15:40:17.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.571+0000 7f0d4c8a5700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d480b5300 con 0x7f0d48148db0 2023-10-08T15:40:17.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.571+0000 7f0d46d9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0d4814c6c0 0x7f0d48149e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:17.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.571+0000 7f0d46d9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0d4814c6c0 0x7f0d48149e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52650/0 (socket says 172.21.15.3:52650) 2023-10-08T15:40:17.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.571+0000 7f0d46d9d700 1 -- 172.21.15.3:0/450569867 learned_addr learned my addr 172.21.15.3:0/450569867 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:17.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.571+0000 7f0d4659c700 1 --2- 172.21.15.3:0/450569867 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d480a1fd0 0x7f0d48158ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:17.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.571+0000 7f0d45d9b700 1 --2- 172.21.15.3:0/450569867 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0d48148db0 0x7f0d481498d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:17.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.571+0000 7f0d46d9d700 1 -- 172.21.15.3:0/450569867 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0d48148db0 msgr2=0x7f0d481498d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:17.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.571+0000 7f0d46d9d700 1 --2- 172.21.15.3:0/450569867 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0d48148db0 0x7f0d481498d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:17.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.571+0000 7f0d46d9d700 1 -- 172.21.15.3:0/450569867 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d480a1fd0 msgr2=0x7f0d48158ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:17.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.571+0000 7f0d46d9d700 1 --2- 172.21.15.3:0/450569867 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d480a1fd0 0x7f0d48158ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:17.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.571+0000 7f0d46d9d700 1 -- 172.21.15.3:0/450569867 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d380094f0 con 0x7f0d4814c6c0 2023-10-08T15:40:17.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.575+0000 7f0d46d9d700 1 --2- 172.21.15.3:0/450569867 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0d4814c6c0 0x7f0d48149e10 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f0d4000ed70 tx=0x7f0d4000c590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:17.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.575+0000 7f0d367fc700 1 -- 172.21.15.3:0/450569867 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d40002ca0 con 0x7f0d4814c6c0 2023-10-08T15:40:17.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.575+0000 7f0d367fc700 1 -- 172.21.15.3:0/450569867 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d40002e40 con 0x7f0d4814c6c0 2023-10-08T15:40:17.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.575+0000 7f0d4c8a5700 1 -- 172.21.15.3:0/450569867 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d480b86d0 con 0x7f0d4814c6c0 2023-10-08T15:40:17.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.575+0000 7f0d367fc700 1 -- 172.21.15.3:0/450569867 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d40011470 con 0x7f0d4814c6c0 2023-10-08T15:40:17.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.575+0000 7f0d4c8a5700 1 -- 172.21.15.3:0/450569867 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d480b4e60 con 0x7f0d4814c6c0 2023-10-08T15:40:17.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.575+0000 7f0d4c8a5700 1 -- 172.21.15.3:0/450569867 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d48064530 con 0x7f0d4814c6c0 2023-10-08T15:40:17.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.575+0000 7f0d367fc700 1 -- 172.21.15.3:0/450569867 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f0d40023440 con 0x7f0d4814c6c0 2023-10-08T15:40:17.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.579+0000 7f0d367fc700 1 --2- 172.21.15.3:0/450569867 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f0d28060580 0x7f0d28062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:17.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.579+0000 7f0d367fc700 1 -- 172.21.15.3:0/450569867 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0d40015070 con 0x7f0d4814c6c0 2023-10-08T15:40:17.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.579+0000 7f0d4659c700 1 --2- 172.21.15.3:0/450569867 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f0d28060580 0x7f0d28062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:17.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.579+0000 7f0d4659c700 1 --2- 172.21.15.3:0/450569867 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f0d28060580 0x7f0d28062a30 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c006fd0 tx=0x7f0d3c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:17.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.583+0000 7f0d367fc700 1 -- 172.21.15.3:0/450569867 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0d4004fcf0 con 0x7f0d4814c6c0 2023-10-08T15:40:17.742 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.739+0000 7f0d4c8a5700 1 -- 172.21.15.3:0/450569867 --> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0d480b2cd0 con 0x7f0d28060580 2023-10-08T15:40:18.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.755+0000 7f0d367fc700 1 -- 172.21.15.3:0/450569867 <== mgr.4102 v2:172.21.15.50:6832/33268 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282087 (secure 0 0 0) 0x7f0d480b2cd0 con 0x7f0d28060580 2023-10-08T15:40:18.345 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:40:18.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.759+0000 7f0d4c8a5700 1 -- 172.21.15.3:0/450569867 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f0d28060580 msgr2=0x7f0d28062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:18.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.759+0000 7f0d4c8a5700 1 --2- 172.21.15.3:0/450569867 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f0d28060580 0x7f0d28062a30 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c006fd0 tx=0x7f0d3c008040 comp rx=0 tx=0).stop 2023-10-08T15:40:18.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.759+0000 7f0d4c8a5700 1 -- 172.21.15.3:0/450569867 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0d4814c6c0 msgr2=0x7f0d48149e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:18.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.759+0000 7f0d4c8a5700 1 --2- 172.21.15.3:0/450569867 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0d4814c6c0 0x7f0d48149e10 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f0d4000ed70 tx=0x7f0d4000c590 comp rx=0 tx=0).stop 2023-10-08T15:40:18.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.759+0000 7f0d4c8a5700 1 -- 172.21.15.3:0/450569867 shutdown_connections 2023-10-08T15:40:18.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.759+0000 7f0d4c8a5700 1 --2- 172.21.15.3:0/450569867 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f0d28060580 0x7f0d28062a30 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:18.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.759+0000 7f0d4c8a5700 1 --2- 172.21.15.3:0/450569867 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0d4814c6c0 0x7f0d48149e10 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:18.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.759+0000 7f0d4c8a5700 1 --2- 172.21.15.3:0/450569867 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0d48148db0 0x7f0d481498d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:18.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.759+0000 7f0d4c8a5700 1 --2- 172.21.15.3:0/450569867 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d480a1fd0 0x7f0d48158ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:18.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.759+0000 7f0d4c8a5700 1 -- 172.21.15.3:0/450569867 >> 172.21.15.3:0/450569867 conn(0x7f0d4806b9b0 msgr2=0x7f0d48148330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:18.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.759+0000 7f0d4c8a5700 1 -- 172.21.15.3:0/450569867 shutdown_connections 2023-10-08T15:40:18.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:17.759+0000 7f0d4c8a5700 1 -- 172.21.15.3:0/450569867 wait complete. 2023-10-08T15:40:18.349 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2023-10-08T15:40:18.350 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":122,"stamp":"2023-10-08T15:40:16.576666+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":158,"acting":158,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":23,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2422612,"kb_used_data":3348,"kb_used_omap":0,"kb_used_meta":2419200,"kb_avail":752552108,"statfs":{"total":773094113280,"available":770613358592,"internally_reserved":0,"allocated":3428352,"data_stored":2466429,"data_compressed":66282,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":2477260800},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.187823"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.407258+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:28:34.766239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.385664+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.385664+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.420460+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:30:30.000571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.385664+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.410518+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:00:59.377632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.403772+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:54:57.100270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.421501+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:38:30.636087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.418878+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:12:15.281539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.421558+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:03:53.266232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.420446+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:43:49.275350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.385664+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.408487+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:09:22.352521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.411446+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:38:57.982113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.413482+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:45:40.536163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.409788+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:07:16.107860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.385664+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.385664+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.410694+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:38:30.602209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.408593+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:04:41.815818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.411657+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:42:17.553342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.410705+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:43:36.368485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.409807+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:11:59.571805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.409144+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:39:23.149190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.410900+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:30:04.390806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.408073+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:17:34.699841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.385664+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.385664+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.410577+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:32:14.448543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.385664+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.412760+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:48:45.147119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.406245+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:24:23.445896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.406186+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:41:14.459572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-08T15:40:13.425751+0000","last_change":"2023-10-08T15:40:13.425751+0000","last_active":"2023-10-08T15:40:13.425751+0000","last_peered":"2023-10-08T15:40:13.425751+0000","last_clean":"2023-10-08T15:40:13.425751+0000","last_became_active":"2023-10-08T15:40:13.425422+0000","last_became_peered":"2023-10-08T15:40:13.425422+0000","last_unstale":"2023-10-08T15:40:13.425751+0000","last_undegraded":"2023-10-08T15:40:13.425751+0000","last_fullsized":"2023-10-08T15:40:13.425751+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:18.157723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.410294+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:37:34.755964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:12.373695+0000","last_change":"2023-10-08T15:40:12.392845+0000","last_active":"2023-10-08T15:40:12.373695+0000","last_peered":"2023-10-08T15:40:12.373695+0000","last_clean":"2023-10-08T15:40:12.373695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:12.373695+0000","last_undegraded":"2023-10-08T15:40:12.373695+0000","last_fullsized":"2023-10-08T15:40:12.373695+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:46:12.735503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.385664+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-08T15:40:13.422829+0000","last_change":"2023-10-08T15:40:13.422829+0000","last_active":"2023-10-08T15:40:13.422829+0000","last_peered":"2023-10-08T15:40:13.422829+0000","last_clean":"2023-10-08T15:40:13.422829+0000","last_became_active":"2023-10-08T15:40:13.422518+0000","last_became_peered":"2023-10-08T15:40:13.422518+0000","last_unstale":"2023-10-08T15:40:13.422829+0000","last_undegraded":"2023-10-08T15:40:13.422829+0000","last_fullsized":"2023-10-08T15:40:13.422829+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:50:13.842824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.405994+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:40:37.969828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-08T15:40:13.417157+0000","last_change":"2023-10-08T15:40:13.417157+0000","last_active":"2023-10-08T15:40:13.417157+0000","last_peered":"2023-10-08T15:40:13.417157+0000","last_clean":"2023-10-08T15:40:13.417157+0000","last_became_active":"2023-10-08T15:40:13.416876+0000","last_became_peered":"2023-10-08T15:40:13.416876+0000","last_unstale":"2023-10-08T15:40:13.417157+0000","last_undegraded":"2023-10-08T15:40:13.417157+0000","last_fullsized":"2023-10-08T15:40:13.417157+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:31:45.772524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.385664+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-08T15:40:13.417469+0000","last_change":"2023-10-08T15:40:13.417469+0000","last_active":"2023-10-08T15:40:13.417469+0000","last_peered":"2023-10-08T15:40:13.417469+0000","last_clean":"2023-10-08T15:40:13.417469+0000","last_became_active":"2023-10-08T15:40:13.417134+0000","last_became_peered":"2023-10-08T15:40:13.417134+0000","last_unstale":"2023-10-08T15:40:13.417469+0000","last_undegraded":"2023-10-08T15:40:13.417469+0000","last_fullsized":"2023-10-08T15:40:13.417469+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:38:58.180186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.418205+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:37.158933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:12.373695+0000","last_change":"2023-10-08T15:40:12.395264+0000","last_active":"2023-10-08T15:40:12.373695+0000","last_peered":"2023-10-08T15:40:12.373695+0000","last_clean":"2023-10-08T15:40:12.373695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:12.373695+0000","last_undegraded":"2023-10-08T15:40:12.373695+0000","last_fullsized":"2023-10-08T15:40:12.373695+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:17:52.309327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.420969+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:36:01.348005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:40:12.373695+0000","last_change":"2023-10-08T15:40:12.373695+0000","last_active":"2023-10-08T15:40:12.373695+0000","last_peered":"2023-10-08T15:40:12.373695+0000","last_clean":"2023-10-08T15:40:12.373695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:12.373695+0000","last_undegraded":"2023-10-08T15:40:12.373695+0000","last_fullsized":"2023-10-08T15:40:12.373695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.411084+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:47:34.821453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-08T15:40:13.427181+0000","last_change":"2023-10-08T15:40:13.427181+0000","last_active":"2023-10-08T15:40:13.427181+0000","last_peered":"2023-10-08T15:40:13.427181+0000","last_clean":"2023-10-08T15:40:13.427181+0000","last_became_active":"2023-10-08T15:40:13.425429+0000","last_became_peered":"2023-10-08T15:40:13.425429+0000","last_unstale":"2023-10-08T15:40:13.427181+0000","last_undegraded":"2023-10-08T15:40:13.427181+0000","last_fullsized":"2023-10-08T15:40:13.427181+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:49:42.599600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.385664+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:12.373695+0000","last_change":"2023-10-08T15:40:12.395575+0000","last_active":"2023-10-08T15:40:12.373695+0000","last_peered":"2023-10-08T15:40:12.373695+0000","last_clean":"2023-10-08T15:40:12.373695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:12.373695+0000","last_undegraded":"2023-10-08T15:40:12.373695+0000","last_fullsized":"2023-10-08T15:40:12.373695+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:38:56.970144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.406016+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:00.160396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-08T15:40:13.428311+0000","last_change":"2023-10-08T15:40:13.428311+0000","last_active":"2023-10-08T15:40:13.428311+0000","last_peered":"2023-10-08T15:40:13.428311+0000","last_clean":"2023-10-08T15:40:13.428311+0000","last_became_active":"2023-10-08T15:40:13.427998+0000","last_became_peered":"2023-10-08T15:40:13.427998+0000","last_unstale":"2023-10-08T15:40:13.428311+0000","last_undegraded":"2023-10-08T15:40:13.428311+0000","last_fullsized":"2023-10-08T15:40:13.428311+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:14:50.877335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.411088+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:42:44.785311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-08T15:40:13.426137+0000","last_change":"2023-10-08T15:40:13.426137+0000","last_active":"2023-10-08T15:40:13.426137+0000","last_peered":"2023-10-08T15:40:13.426137+0000","last_clean":"2023-10-08T15:40:13.426137+0000","last_became_active":"2023-10-08T15:40:13.425691+0000","last_became_peered":"2023-10-08T15:40:13.425691+0000","last_unstale":"2023-10-08T15:40:13.426137+0000","last_undegraded":"2023-10-08T15:40:13.426137+0000","last_fullsized":"2023-10-08T15:40:13.426137+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:47:36.657587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.406338+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:46:58.163129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-08T15:40:13.420187+0000","last_change":"2023-10-08T15:40:13.420187+0000","last_active":"2023-10-08T15:40:13.420187+0000","last_peered":"2023-10-08T15:40:13.420187+0000","last_clean":"2023-10-08T15:40:13.420187+0000","last_became_active":"2023-10-08T15:40:13.419818+0000","last_became_peered":"2023-10-08T15:40:13.419818+0000","last_unstale":"2023-10-08T15:40:13.420187+0000","last_undegraded":"2023-10-08T15:40:13.420187+0000","last_fullsized":"2023-10-08T15:40:13.420187+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:34:03.849463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.410947+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:38:56.397317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-08T15:40:13.428224+0000","last_change":"2023-10-08T15:40:13.428224+0000","last_active":"2023-10-08T15:40:13.428224+0000","last_peered":"2023-10-08T15:40:13.428224+0000","last_clean":"2023-10-08T15:40:13.428224+0000","last_became_active":"2023-10-08T15:40:13.427919+0000","last_became_peered":"2023-10-08T15:40:13.427919+0000","last_unstale":"2023-10-08T15:40:13.428224+0000","last_undegraded":"2023-10-08T15:40:13.428224+0000","last_fullsized":"2023-10-08T15:40:13.428224+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:32:49.859693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.417580+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:46:13.747473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-08T15:40:13.415599+0000","last_change":"2023-10-08T15:40:13.415599+0000","last_active":"2023-10-08T15:40:13.415599+0000","last_peered":"2023-10-08T15:40:13.415599+0000","last_clean":"2023-10-08T15:40:13.415599+0000","last_became_active":"2023-10-08T15:40:13.415310+0000","last_became_peered":"2023-10-08T15:40:13.415310+0000","last_unstale":"2023-10-08T15:40:13.415599+0000","last_undegraded":"2023-10-08T15:40:13.415599+0000","last_fullsized":"2023-10-08T15:40:13.415599+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:18:27.690730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.408004+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:57:32.025855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-08T15:40:13.422903+0000","last_change":"2023-10-08T15:40:13.422903+0000","last_active":"2023-10-08T15:40:13.422903+0000","last_peered":"2023-10-08T15:40:13.422903+0000","last_clean":"2023-10-08T15:40:13.422903+0000","last_became_active":"2023-10-08T15:40:13.422586+0000","last_became_peered":"2023-10-08T15:40:13.422586+0000","last_unstale":"2023-10-08T15:40:13.422903+0000","last_undegraded":"2023-10-08T15:40:13.422903+0000","last_fullsized":"2023-10-08T15:40:13.422903+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:45.342530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.402928+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:07:13.974255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-08T15:40:13.427234+0000","last_change":"2023-10-08T15:40:13.427234+0000","last_active":"2023-10-08T15:40:13.427234+0000","last_peered":"2023-10-08T15:40:13.427234+0000","last_clean":"2023-10-08T15:40:13.427234+0000","last_became_active":"2023-10-08T15:40:13.424985+0000","last_became_peered":"2023-10-08T15:40:13.424985+0000","last_unstale":"2023-10-08T15:40:13.427234+0000","last_undegraded":"2023-10-08T15:40:13.427234+0000","last_fullsized":"2023-10-08T15:40:13.427234+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:18:01.774995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.405308+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:47:26.939356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-08T15:40:13.417048+0000","last_change":"2023-10-08T15:40:13.417048+0000","last_active":"2023-10-08T15:40:13.417048+0000","last_peered":"2023-10-08T15:40:13.417048+0000","last_clean":"2023-10-08T15:40:13.417048+0000","last_became_active":"2023-10-08T15:40:13.416724+0000","last_became_peered":"2023-10-08T15:40:13.416724+0000","last_unstale":"2023-10-08T15:40:13.417048+0000","last_undegraded":"2023-10-08T15:40:13.417048+0000","last_fullsized":"2023-10-08T15:40:13.417048+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:19:37.829086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.410971+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:17:53.321297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:12.373695+0000","last_change":"2023-10-08T15:40:12.394588+0000","last_active":"2023-10-08T15:40:12.373695+0000","last_peered":"2023-10-08T15:40:12.373695+0000","last_clean":"2023-10-08T15:40:12.373695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:12.373695+0000","last_undegraded":"2023-10-08T15:40:12.373695+0000","last_fullsized":"2023-10-08T15:40:12.373695+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:43:35.356515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.410806+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:57:21.978994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:40:12.373695+0000","last_change":"2023-10-08T15:40:12.373695+0000","last_active":"2023-10-08T15:40:12.373695+0000","last_peered":"2023-10-08T15:40:12.373695+0000","last_clean":"2023-10-08T15:40:12.373695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:12.373695+0000","last_undegraded":"2023-10-08T15:40:12.373695+0000","last_fullsized":"2023-10-08T15:40:12.373695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.412173+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:47:00.512892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-08T15:40:13.424921+0000","last_change":"2023-10-08T15:40:13.424921+0000","last_active":"2023-10-08T15:40:13.424921+0000","last_peered":"2023-10-08T15:40:13.424921+0000","last_clean":"2023-10-08T15:40:13.424921+0000","last_became_active":"2023-10-08T15:40:13.424591+0000","last_became_peered":"2023-10-08T15:40:13.424591+0000","last_unstale":"2023-10-08T15:40:13.424921+0000","last_undegraded":"2023-10-08T15:40:13.424921+0000","last_fullsized":"2023-10-08T15:40:13.424921+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:55:29.262854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.409973+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:32:47.327437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-08T15:40:13.417299+0000","last_change":"2023-10-08T15:40:13.417299+0000","last_active":"2023-10-08T15:40:13.417299+0000","last_peered":"2023-10-08T15:40:13.417299+0000","last_clean":"2023-10-08T15:40:13.417299+0000","last_became_active":"2023-10-08T15:40:13.416982+0000","last_became_peered":"2023-10-08T15:40:13.416982+0000","last_unstale":"2023-10-08T15:40:13.417299+0000","last_undegraded":"2023-10-08T15:40:13.417299+0000","last_fullsized":"2023-10-08T15:40:13.417299+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:19:37.108661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.405927+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:40:05.133298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:40:12.373695+0000","last_change":"2023-10-08T15:40:12.373695+0000","last_active":"2023-10-08T15:40:12.373695+0000","last_peered":"2023-10-08T15:40:12.373695+0000","last_clean":"2023-10-08T15:40:12.373695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:12.373695+0000","last_undegraded":"2023-10-08T15:40:12.373695+0000","last_fullsized":"2023-10-08T15:40:12.373695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.405368+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:17:27.628792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-08T15:40:13.424876+0000","last_change":"2023-10-08T15:40:13.424876+0000","last_active":"2023-10-08T15:40:13.424876+0000","last_peered":"2023-10-08T15:40:13.424876+0000","last_clean":"2023-10-08T15:40:13.424876+0000","last_became_active":"2023-10-08T15:40:13.424570+0000","last_became_peered":"2023-10-08T15:40:13.424570+0000","last_unstale":"2023-10-08T15:40:13.424876+0000","last_undegraded":"2023-10-08T15:40:13.424876+0000","last_fullsized":"2023-10-08T15:40:13.424876+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:15:27.675296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.418246+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:22:15.419220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-08T15:40:13.414016+0000","last_change":"2023-10-08T15:40:13.414016+0000","last_active":"2023-10-08T15:40:13.414016+0000","last_peered":"2023-10-08T15:40:13.414016+0000","last_clean":"2023-10-08T15:40:13.414016+0000","last_became_active":"2023-10-08T15:40:13.413732+0000","last_became_peered":"2023-10-08T15:40:13.413732+0000","last_unstale":"2023-10-08T15:40:13.414016+0000","last_undegraded":"2023-10-08T15:40:13.414016+0000","last_fullsized":"2023-10-08T15:40:13.414016+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:43:34.768625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.409718+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:23.701420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-08T15:40:13.416965+0000","last_change":"2023-10-08T15:40:13.416965+0000","last_active":"2023-10-08T15:40:13.416965+0000","last_peered":"2023-10-08T15:40:13.416965+0000","last_clean":"2023-10-08T15:40:13.416965+0000","last_became_active":"2023-10-08T15:40:13.416634+0000","last_became_peered":"2023-10-08T15:40:13.416634+0000","last_unstale":"2023-10-08T15:40:13.416965+0000","last_undegraded":"2023-10-08T15:40:13.416965+0000","last_fullsized":"2023-10-08T15:40:13.416965+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:46:04.044725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.411616+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:45:31.344771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-08T15:40:13.423625+0000","last_change":"2023-10-08T15:40:13.423625+0000","last_active":"2023-10-08T15:40:13.423625+0000","last_peered":"2023-10-08T15:40:13.423625+0000","last_clean":"2023-10-08T15:40:13.423625+0000","last_became_active":"2023-10-08T15:40:13.422315+0000","last_became_peered":"2023-10-08T15:40:13.422315+0000","last_unstale":"2023-10-08T15:40:13.423625+0000","last_undegraded":"2023-10-08T15:40:13.423625+0000","last_fullsized":"2023-10-08T15:40:13.423625+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:25:11.825747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.405201+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:31:13.395939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-08T15:40:13.423017+0000","last_change":"2023-10-08T15:40:13.423017+0000","last_active":"2023-10-08T15:40:13.423017+0000","last_peered":"2023-10-08T15:40:13.423017+0000","last_clean":"2023-10-08T15:40:13.423017+0000","last_became_active":"2023-10-08T15:40:13.422248+0000","last_became_peered":"2023-10-08T15:40:13.422248+0000","last_unstale":"2023-10-08T15:40:13.423017+0000","last_undegraded":"2023-10-08T15:40:13.423017+0000","last_fullsized":"2023-10-08T15:40:13.423017+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:07:40.679262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.409388+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:26:20.874012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-08T15:40:13.422628+0000","last_change":"2023-10-08T15:40:13.422628+0000","last_active":"2023-10-08T15:40:13.422628+0000","last_peered":"2023-10-08T15:40:13.422628+0000","last_clean":"2023-10-08T15:40:13.422628+0000","last_became_active":"2023-10-08T15:40:13.422297+0000","last_became_peered":"2023-10-08T15:40:13.422297+0000","last_unstale":"2023-10-08T15:40:13.422628+0000","last_undegraded":"2023-10-08T15:40:13.422628+0000","last_fullsized":"2023-10-08T15:40:13.422628+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:03.198759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.409881+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:54:26.469514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:12.373695+0000","last_change":"2023-10-08T15:40:12.392895+0000","last_active":"2023-10-08T15:40:12.373695+0000","last_peered":"2023-10-08T15:40:12.373695+0000","last_clean":"2023-10-08T15:40:12.373695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:12.373695+0000","last_undegraded":"2023-10-08T15:40:12.373695+0000","last_fullsized":"2023-10-08T15:40:12.373695+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:34:53.583458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.385664+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-08T15:40:13.423501+0000","last_change":"2023-10-08T15:40:13.423501+0000","last_active":"2023-10-08T15:40:13.423501+0000","last_peered":"2023-10-08T15:40:13.423501+0000","last_clean":"2023-10-08T15:40:13.423501+0000","last_became_active":"2023-10-08T15:40:13.423112+0000","last_became_peered":"2023-10-08T15:40:13.423112+0000","last_unstale":"2023-10-08T15:40:13.423501+0000","last_undegraded":"2023-10-08T15:40:13.423501+0000","last_fullsized":"2023-10-08T15:40:13.423501+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:46:45.482090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.385664+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-08T15:40:13.424672+0000","last_change":"2023-10-08T15:40:13.424672+0000","last_active":"2023-10-08T15:40:13.424672+0000","last_peered":"2023-10-08T15:40:13.424672+0000","last_clean":"2023-10-08T15:40:13.424672+0000","last_became_active":"2023-10-08T15:40:13.422477+0000","last_became_peered":"2023-10-08T15:40:13.422477+0000","last_unstale":"2023-10-08T15:40:13.424672+0000","last_undegraded":"2023-10-08T15:40:13.424672+0000","last_fullsized":"2023-10-08T15:40:13.424672+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:28:30.689512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:13.385664+0000","last_change":"2023-10-08T15:40:13.421007+0000","last_active":"2023-10-08T15:40:13.385664+0000","last_peered":"2023-10-08T15:40:13.385664+0000","last_clean":"2023-10-08T15:40:13.385664+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:13.385664+0000","last_undegraded":"2023-10-08T15:40:13.385664+0000","last_fullsized":"2023-10-08T15:40:13.385664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:55:34.015542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:40:12.373695+0000","last_change":"2023-10-08T15:40:12.373695+0000","last_active":"2023-10-08T15:40:12.373695+0000","last_peered":"2023-10-08T15:40:12.373695+0000","last_clean":"2023-10-08T15:40:12.373695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:12.373695+0000","last_undegraded":"2023-10-08T15:40:12.373695+0000","last_fullsized":"2023-10-08T15:40:12.373695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":180,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-08T15:40:12.396087+0000","last_change":"2023-10-08T15:37:19.380955+0000","last_active":"2023-10-08T15:40:12.396087+0000","last_peered":"2023-10-08T15:40:12.396087+0000","last_clean":"2023-10-08T15:40:12.396087+0000","last_became_active":"2023-10-08T15:37:19.378277+0000","last_became_peered":"2023-10-08T15:37:19.378277+0000","last_unstale":"2023-10-08T15:40:12.396087+0000","last_undegraded":"2023-10-08T15:40:12.396087+0000","last_fullsized":"2023-10-08T15:40:12.396087+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:17.537726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:17.537726+0000","last_clean_scrub_stamp":"2023-10-08T15:37:17.537726+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:06:26.612046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":100,"acting":100,"num_store_stats":6},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":56,"acting":56,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66282,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542181,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301864,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069976,"statfs":{"total":96636764160,"available":96327655424,"internally_reserved":0,"allocated":491520,"data_stored":758004,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.94399999999999995,"15min":0.95999999999999996},"min":{"1min":0.64700000000000002,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.3460000000000001,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.93000000000000005,"15min":0.93100000000000005},"min":{"1min":0.66300000000000003,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.389,"5min":1.758,"15min":1.758},"last":0.87}]},{"osd":1,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.90700000000000003,"15min":0.89400000000000002},"min":{"1min":0.59799999999999998,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.4299999999999999,"5min":1.474,"15min":1.474},"last":1.1259999999999999},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.96699999999999997,"15min":0.96299999999999997},"min":{"1min":0.71099999999999997,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.70699999999999996}]},{"osd":2,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":1.016,"15min":1.0309999999999999},"min":{"1min":0.66000000000000003,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.268,"5min":1.623,"15min":1.623},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.0009999999999999,"15min":1.006},"min":{"1min":0.72799999999999998,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.1990000000000001,"5min":1.321,"15min":1.321},"last":0.65200000000000002}]},{"osd":3,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":0.98699999999999999,"15min":0.97399999999999998},"min":{"1min":0.82999999999999996,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.222,"5min":1.2110000000000001,"15min":1.2090000000000001},"min":{"1min":1.012,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":1.087}]},{"osd":4,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":1.073,"15min":1.089},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.298,"5min":1.512,"15min":1.512},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.095,"15min":1.1000000000000001},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.353,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":1.1799999999999999}]},{"osd":5,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.2509999999999999,"15min":1.272},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.573,"5min":1.74,"15min":1.74},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.163,"5min":1.236,"15min":1.248},"min":{"1min":0.88700000000000001,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.381,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":1.1519999999999999}]},{"osd":6,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.2969999999999999,"15min":1.3169999999999999},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.4610000000000001,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.228},{"interface":"front","average":{"1min":1.151,"5min":1.2410000000000001,"15min":1.256},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":1.411,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.03}]}]},{"osd":6,"up_from":14,"seq":60129542182,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301788,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070052,"statfs":{"total":96636764160,"available":96327733248,"internally_reserved":0,"allocated":413696,"data_stored":161381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.84199999999999997,"15min":0.82399999999999995},"min":{"1min":0.70699999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.218,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.98399999999999999,"15min":0.997},"min":{"1min":0.71399999999999997,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.1890000000000001,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.1910000000000001}]},{"osd":1,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.94899999999999995,"15min":0.95699999999999996},"min":{"1min":0.70599999999999996,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.2729999999999999,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":1.3520000000000001},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.98599999999999999,"15min":0.98999999999999999},"min":{"1min":0.64600000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.397,"5min":1.853,"15min":1.853},"last":1.071}]},{"osd":2,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.85699999999999998,"15min":0.84599999999999997},"min":{"1min":0.69299999999999995,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.876},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0649999999999999,"15min":1.0760000000000001},"min":{"1min":0.64700000000000002,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.4019999999999999,"5min":1.518,"15min":1.518},"last":1.2529999999999999}]},{"osd":3,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.0169999999999999,"15min":1.02},"min":{"1min":0.78300000000000003,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.3169999999999999,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":1.29},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.071,"15min":1.081},"min":{"1min":0.79600000000000004,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.296,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":1.0449999999999999}]},{"osd":4,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":1.095,"15min":1.115},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.3360000000000001,"5min":1.484,"15min":1.484},"last":1.105},{"interface":"front","average":{"1min":1.121,"5min":1.181,"15min":1.1910000000000001},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.72299999999999998}]},{"osd":5,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.1160000000000001,"15min":1.125},"min":{"1min":0.753,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.329,"5min":1.581,"15min":1.581},"last":0.78200000000000003},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.294,"15min":1.3120000000000001},"min":{"1min":1.0049999999999999,"5min":0.96099999999999997,"15min":0.96099999999999997},"max":{"1min":1.417,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":1.167}]},{"osd":7,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.2709999999999999,"15min":1.2849999999999999},"min":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":1.4550000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.2969999999999999,"15min":1.3109999999999999},"min":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":1.5429999999999999,"5min":2.5630000000000002,"15min":2.5630000000000002},"last":1.135}]}]},{"osd":3,"up_from":14,"seq":60129542183,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305884,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065956,"statfs":{"total":96636764160,"available":96323538944,"internally_reserved":0,"allocated":413696,"data_stored":161381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.71199999999999997,"15min":0.71999999999999997},"min":{"1min":0.51200000000000001,"5min":0.501,"15min":0.501},"max":{"1min":0.96299999999999997,"5min":1.056,"15min":1.056},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.76800000000000002,"15min":0.76200000000000001},"min":{"1min":0.59699999999999998,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.93700000000000006}]},{"osd":1,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.72099999999999997,"15min":0.71299999999999997},"min":{"1min":0.56899999999999995,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.82399999999999995,"15min":0.81200000000000006},"min":{"1min":0.67000000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1870000000000001,"5min":1.256,"15min":1.256},"last":1.038}]},{"osd":2,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.85999999999999999,"15min":0.85399999999999998},"min":{"1min":0.66900000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.337,"5min":1.361,"15min":1.361},"last":1.4419999999999999},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.92200000000000004,"15min":0.92600000000000005},"min":{"1min":0.751,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.228,"5min":1.423,"15min":1.423},"last":0.98399999999999999}]},{"osd":4,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.0820000000000001,"15min":1.0680000000000001},"min":{"1min":0.90000000000000002,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.3879999999999999,"5min":1.504,"15min":1.504},"last":1.153},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.145,"15min":1.155},"min":{"1min":0.85599999999999998,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.4410000000000001,"5min":2.762,"15min":2.762},"last":1.264}]},{"osd":5,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.1679999999999999,"15min":1.1619999999999999},"min":{"1min":0.92800000000000005,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.466,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.3700000000000001},{"interface":"front","average":{"1min":1.22,"5min":1.2330000000000001,"15min":1.2350000000000001},"min":{"1min":0.95899999999999996,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.474,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":1.3280000000000001}]},{"osd":6,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.2889999999999999,"15min":1.304},"min":{"1min":0.97199999999999998,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.569,"5min":2.6890000000000001,"15min":2.6890000000000001},"last":1.415},{"interface":"front","average":{"1min":1.238,"5min":1.2250000000000001,"15min":1.2230000000000001},"min":{"1min":0.89100000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":1.462,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":1.581}]},{"osd":7,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.2649999999999999,"15min":1.2589999999999999},"min":{"1min":0.97699999999999998,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":1.528,"5min":1.738,"15min":1.738},"last":1.528},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.3520000000000001,"15min":1.3620000000000001},"min":{"1min":1.1080000000000001,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.623,"5min":2.5840000000000001,"15min":2.5840000000000001},"last":1.48}]}]},{"osd":2,"up_from":14,"seq":60129542182,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301788,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070052,"statfs":{"total":96636764160,"available":96327733248,"internally_reserved":0,"allocated":413696,"data_stored":161381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.626,"15min":0.621},"min":{"1min":0.48799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.67200000000000004,"15min":0.64900000000000002},"min":{"1min":0.52800000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.97899999999999998}]},{"osd":1,"last update":"Sun Oct 8 15:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.69099999999999995,"15min":0.67700000000000005},"min":{"1min":0.59399999999999997,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.71599999999999997,"15min":0.69199999999999995},"min":{"1min":0.55400000000000005,"5min":0.307,"15min":0.307},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":1.1439999999999999}]},{"osd":3,"last update":"Sun Oct 8 15:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.66600000000000004,"15min":0.64200000000000002},"min":{"1min":0.52300000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.85299999999999998,"15min":0.84299999999999997},"min":{"1min":0.72299999999999998,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.127,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":1.02}]},{"osd":4,"last update":"Sun Oct 8 15:39:23 2023","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.004,"15min":1},"min":{"1min":0.75600000000000001,"5min":0.748,"15min":0.748},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.88400000000000001},{"interface":"front","average":{"1min":1.028,"5min":1.0329999999999999,"15min":1.034},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.4319999999999999,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.2509999999999999}]},{"osd":5,"last update":"Sun Oct 8 15:39:23 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.0589999999999999,"15min":1.0569999999999999},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.091,"5min":1.0640000000000001,"15min":1.0600000000000001},"min":{"1min":0.81000000000000005,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.288,"5min":1.452,"15min":1.452},"last":1.0840000000000001}]},{"osd":6,"last update":"Sun Oct 8 15:39:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.0940000000000001,"15min":1.091},"min":{"1min":0.82699999999999996,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.4159999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.117,"15min":1.105},"min":{"1min":0.85499999999999998,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":1.198}]},{"osd":7,"last update":"Sun Oct 8 15:39:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.159,"15min":1.1499999999999999},"min":{"1min":0.84899999999999998,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.1739999999999999,"15min":1.161},"min":{"1min":0.86299999999999999,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.579,"5min":1.804,"15min":1.804},"last":1.226}]}]},{"osd":1,"up_from":14,"seq":60129542183,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305884,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065956,"statfs":{"total":96636764160,"available":96323538944,"internally_reserved":0,"allocated":413696,"data_stored":161381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.76500000000000001,"15min":0.77500000000000002},"min":{"1min":0.46700000000000003,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.165,"5min":1.734,"15min":1.734},"last":1.0840000000000001},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.96299999999999997,"15min":1},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0509999999999999,"5min":5.7960000000000003,"15min":5.7960000000000003},"last":0.64500000000000002}]},{"osd":2,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.83299999999999996,"15min":0.84699999999999998},"min":{"1min":0.56200000000000006,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.048,"5min":4.0119999999999996,"15min":4.0119999999999996},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.90600000000000003,"15min":0.91000000000000003},"min":{"1min":0.61599999999999999,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.0840000000000001,"5min":1.853,"15min":1.853},"last":0.94699999999999995}]},{"osd":3,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":1.7569999999999999,"5min":1.121,"15min":1.0149999999999999},"min":{"1min":0.73399999999999999,"5min":0.435,"15min":0.435},"max":{"1min":13.388,"5min":13.388,"15min":13.388},"last":0.66700000000000004},{"interface":"front","average":{"1min":1.6899999999999999,"5min":1.2549999999999999,"15min":1.1830000000000001},"min":{"1min":0.66100000000000003,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":13.353,"5min":13.353,"15min":13.353},"last":0.52300000000000002}]},{"osd":4,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":1.2070000000000001,"15min":1.246},"min":{"1min":0.77800000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.246,"5min":5.859,"15min":5.859},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.022,"5min":1.1479999999999999,"15min":1.169},"min":{"1min":0.82199999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.4550000000000001,"5min":4.2679999999999998,"15min":4.2679999999999998},"last":1.038}]},{"osd":5,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.143,"15min":1.151},"min":{"1min":0.85799999999999998,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.5389999999999999,"5min":4.3380000000000001,"15min":4.3380000000000001},"last":1.179},{"interface":"front","average":{"1min":1.216,"5min":1.1890000000000001,"15min":1.1850000000000001},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.589,"5min":2.085,"15min":2.085},"last":1.21}]},{"osd":6,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.359,"15min":1.3919999999999999},"min":{"1min":0.93600000000000005,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.4119999999999999,"5min":5.8979999999999997,"15min":5.8979999999999997},"last":1.125},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.274,"15min":1.284},"min":{"1min":1.0249999999999999,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.4390000000000001,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":0.86399999999999999}]},{"osd":7,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.2549999999999999,"15min":1.2509999999999999},"min":{"1min":0.93400000000000005,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.679,"5min":2.3940000000000001,"15min":2.3940000000000001},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.222,"5min":1.46,"15min":1.5},"min":{"1min":1.0209999999999999,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.387,"5min":5.9299999999999997,"15min":5.9299999999999997},"last":0.998}]}]},{"osd":0,"up_from":14,"seq":60129542183,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301852,"kb_used_data":468,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069988,"statfs":{"total":96636764160,"available":96327667712,"internally_reserved":0,"allocated":479232,"data_stored":751749,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 15:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.81899999999999995,"15min":0.84199999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.3799999999999999,"5min":1.514,"15min":1.514},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.79200000000000004,"15min":0.79800000000000004},"min":{"1min":0.50600000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.999,"5min":1.518,"15min":1.518},"last":0.55900000000000005}]},{"osd":2,"last update":"Sun Oct 8 15:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.84499999999999997,"15min":0.86399999999999999},"min":{"1min":0.55400000000000005,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1539999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.79600000000000004,"15min":0.78900000000000003},"min":{"1min":0.61599999999999999,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.0800000000000001,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.44}]},{"osd":3,"last update":"Sun Oct 8 15:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.75600000000000001,"15min":0.76000000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.091,"5min":1.103,"15min":1.103},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.98499999999999999,"15min":0.995},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.474,"5min":2.3290000000000002,"15min":2.3290000000000002},"last":0.85299999999999998}]},{"osd":4,"last update":"Sun Oct 8 15:39:20 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.085,"15min":1.095},"min":{"1min":0.76000000000000001,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.49,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.093,"15min":1.0980000000000001},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.538,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":1.0880000000000001}]},{"osd":5,"last update":"Sun Oct 8 15:39:20 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0900000000000001,"15min":1.101},"min":{"1min":0.72099999999999997,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.413,"5min":2.214,"15min":2.214},"last":1.222},{"interface":"front","average":{"1min":1.151,"5min":1.323,"15min":1.3520000000000001},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.5269999999999999,"5min":3.4569999999999999,"15min":3.4569999999999999},"last":1.1359999999999999}]},{"osd":6,"last update":"Sun Oct 8 15:39:20 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.29,"15min":1.3080000000000001},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":1.575,"5min":2.532,"15min":2.532},"last":1.044},{"interface":"front","average":{"1min":1.216,"5min":1.244,"15min":1.2490000000000001},"min":{"1min":0.92700000000000005,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.6200000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.99099999999999999}]},{"osd":7,"last update":"Sun Oct 8 15:39:20 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.292,"15min":1.3},"min":{"1min":1.01,"5min":0.98199999999999998,"15min":0.98199999999999998},"max":{"1min":1.571,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.2310000000000001,"15min":1.2350000000000001},"min":{"1min":0.85199999999999998,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.597,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":1.167}]}]},{"osd":5,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":301776,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070064,"statfs":{"total":96636764160,"available":96327745536,"internally_reserved":0,"allocated":401408,"data_stored":155576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.85599999999999998,"15min":0.84799999999999998},"min":{"1min":0.53600000000000003,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":1.1990000000000001},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.90700000000000003,"15min":0.91000000000000003},"min":{"1min":0.67400000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.147,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.67000000000000004}]},{"osd":1,"last update":"Sun Oct 8 15:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.92000000000000004,"15min":0.91100000000000003},"min":{"1min":0.628,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.88,"5min":0.97599999999999998,"15min":0.99199999999999999},"min":{"1min":0.68500000000000005,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1799999999999999,"5min":1.754,"15min":1.754},"last":1.0249999999999999}]},{"osd":2,"last update":"Sun Oct 8 15:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.306,"5min":1.869,"15min":1.869},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.97499999999999998,"5min":1.0109999999999999,"15min":1.0169999999999999},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.484,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.78600000000000003}]},{"osd":3,"last update":"Sun Oct 8 15:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.997,"15min":1.0009999999999999},"min":{"1min":0.78300000000000003,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.2110000000000001,"5min":1.929,"15min":1.929},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.022,"5min":1.101,"15min":1.1140000000000001},"min":{"1min":0.745,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.3140000000000001,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.98299999999999998}]},{"osd":4,"last update":"Sun Oct 8 15:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.0109999999999999,"15min":1.014},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.464,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.085,"15min":1.085},"min":{"1min":0.67600000000000005,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.601,"5min":1.823,"15min":1.823},"last":1.0640000000000001}]},{"osd":6,"last update":"Sun Oct 8 15:39:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.202,"15min":1.2070000000000001},"min":{"1min":0.95899999999999996,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.429,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.165,"5min":1.2290000000000001,"15min":1.24},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.6739999999999999,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.3029999999999999}]},{"osd":7,"last update":"Sun Oct 8 15:39:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.155,"15min":1.167},"min":{"1min":0.89800000000000002,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.272,"5min":2.177,"15min":2.177},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.2190000000000001,"15min":1.2210000000000001},"min":{"1min":1.0089999999999999,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.575,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.167}]}]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301776,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070064,"statfs":{"total":96636764160,"available":96327745536,"internally_reserved":0,"allocated":401408,"data_stored":155576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.82199999999999995,"15min":0.81000000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":1.0269999999999999},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.79000000000000004,"15min":0.78700000000000003},"min":{"1min":0.59199999999999997,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.99399999999999999}]},{"osd":1,"last update":"Sun Oct 8 15:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.84499999999999997,"15min":0.83199999999999996},"min":{"1min":0.66200000000000003,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":1.0920000000000001},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83099999999999996,"15min":0.82999999999999996},"min":{"1min":0.68799999999999994,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.149,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.95999999999999996}]},{"osd":2,"last update":"Sun Oct 8 15:39:20 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.048,"15min":1.034},"min":{"1min":0.80100000000000005,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.3380000000000001,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":1.1220000000000001},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.012,"15min":1.0189999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.268,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.88900000000000001}]},{"osd":3,"last update":"Sun Oct 8 15:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":1.0129999999999999,"15min":1.0189999999999999},"min":{"1min":0.72599999999999998,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.3169999999999999,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.036,"15min":1.0329999999999999},"min":{"1min":0.77400000000000002,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":1.1890000000000001}]},{"osd":5,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":0.98599999999999999,"15min":0.97099999999999997},"min":{"1min":0.79500000000000004,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0649999999999999,"15min":1.0609999999999999},"min":{"1min":0.67800000000000005,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.65300000000000002}]},{"osd":6,"last update":"Sun Oct 8 15:39:20 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.139,"15min":1.147},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.319,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.179,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.91400000000000003,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.4159999999999999,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":1.149}]},{"osd":7,"last update":"Sun Oct 8 15:39:20 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.0740000000000001,"15min":1.0680000000000001},"min":{"1min":0.755,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.85399999999999998},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.196,"15min":1.1910000000000001},"min":{"1min":0.96699999999999997,"5min":0.625,"15min":0.625},"max":{"1min":1.587,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.2150000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T15:40:18.476 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T15:40:18.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.611+0000 7f4550c06700 1 Processor -- start 2023-10-08T15:40:18.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.611+0000 7f4550c06700 1 -- start start 2023-10-08T15:40:18.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.611+0000 7f4550c06700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f454c06df20 0x7f454c0bb990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:18.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.611+0000 7f4550c06700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f454c0bb470 con 0x7f454c0bac80 2023-10-08T15:40:18.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.611+0000 7f4550c06700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f454c14c0e0 con 0x7f454c0bb050 2023-10-08T15:40:18.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.611+0000 7f4550c06700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f454c14c6a0 con 0x7f454c06df20 2023-10-08T15:40:18.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.611+0000 7f454b7fe700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f454c0bac80 0x7f454c06c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:49606/0 (socket says 172.21.15.3:49606) 2023-10-08T15:40:18.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.611+0000 7f454b7fe700 1 -- 172.21.15.3:0/596319212 learned_addr learned my addr 172.21.15.3:0/596319212 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:40:18.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.611+0000 7f454affd700 1 --2- 172.21.15.3:0/596319212 >> v2:172.21.15.50:3300/0 conn(0x7f454c06df20 0x7f454c0bb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:18.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.611+0000 7f454a7fc700 1 -- 172.21.15.3:0/596319212 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 816846235 0 0) 0x7f453c001110 con 0x7f454c0bac80 2023-10-08T15:40:18.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.611+0000 7f454a7fc700 1 -- 172.21.15.3:0/596319212 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4534003570 con 0x7f454c0bac80 2023-10-08T15:40:18.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.611+0000 7f454a7fc700 1 -- 172.21.15.3:0/596319212 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2404756873 0 0) 0x7f4534003570 con 0x7f454c0bac80 2023-10-08T15:40:18.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.611+0000 7f454a7fc700 1 -- 172.21.15.3:0/596319212 >> v2:172.21.15.50:3300/0 conn(0x7f454c06df20 msgr2=0x7f454c0bb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:18.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.611+0000 7f454a7fc700 1 --2- 172.21.15.3:0/596319212 >> v2:172.21.15.50:3300/0 conn(0x7f454c06df20 0x7f454c0bb990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:18.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.611+0000 7f454a7fc700 1 -- 172.21.15.3:0/596319212 >> v1:172.21.15.50:6789/0 conn(0x7f454c0bb050 legacy=0x7f454c06d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:18.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.611+0000 7f454a7fc700 1 -- 172.21.15.3:0/596319212 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f454c14c3c0 con 0x7f454c0bac80 2023-10-08T15:40:18.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.611+0000 7f454a7fc700 1 -- 172.21.15.3:0/596319212 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2285686191 0 0) 0x7f453c001600 con 0x7f454c0bac80 2023-10-08T15:40:18.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.611+0000 7f454a7fc700 1 -- 172.21.15.3:0/596319212 >> v1:172.21.15.3:6789/0 conn(0x7f454c0bac80 legacy=0x7f454c06c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:18.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.611+0000 7f454a7fc700 1 --2- 172.21.15.3:0/596319212 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4534003a60 0x7f4534003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:18.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.611+0000 7f454a7fc700 1 --2- 172.21.15.3:0/596319212 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4534004810 0x7f4534004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:18.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.611+0000 7f454a7fc700 1 --2- 172.21.15.3:0/596319212 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f45340051c0 0x7f453400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:18.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.611+0000 7f454a7fc700 1 -- 172.21.15.3:0/596319212 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f454c14c6a0 con 0x7f45340051c0 2023-10-08T15:40:18.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.611+0000 7f454a7fc700 1 -- 172.21.15.3:0/596319212 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f453400c0d0 con 0x7f4534003a60 2023-10-08T15:40:18.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.611+0000 7f454a7fc700 1 -- 172.21.15.3:0/596319212 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f453400c290 con 0x7f4534004810 2023-10-08T15:40:18.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.615+0000 7f454bfff700 1 --2- 172.21.15.3:0/596319212 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f45340051c0 0x7f453400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:18.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.615+0000 7f454affd700 1 --2- 172.21.15.3:0/596319212 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4534004810 0x7f4534004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:18.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.615+0000 7f454b7fe700 1 --2- 172.21.15.3:0/596319212 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4534003a60 0x7f4534003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:18.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.615+0000 7f454bfff700 1 -- 172.21.15.3:0/596319212 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4534004810 msgr2=0x7f4534004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:18.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.615+0000 7f454bfff700 1 --2- 172.21.15.3:0/596319212 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4534004810 0x7f4534004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:18.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.615+0000 7f454bfff700 1 -- 172.21.15.3:0/596319212 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4534003a60 msgr2=0x7f4534003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:18.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.615+0000 7f454bfff700 1 --2- 172.21.15.3:0/596319212 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4534003a60 0x7f4534003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:18.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.615+0000 7f454bfff700 1 -- 172.21.15.3:0/596319212 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4534003570 con 0x7f45340051c0 2023-10-08T15:40:18.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.615+0000 7f454affd700 1 --2- 172.21.15.3:0/596319212 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4534004810 0x7f4534004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:40:18.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.615+0000 7f454bfff700 1 -- 172.21.15.3:0/596319212 reap_dead start 2023-10-08T15:40:18.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.615+0000 7f454bfff700 1 --2- 172.21.15.3:0/596319212 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f45340051c0 0x7f453400ba60 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f4544001fc0 tx=0x7f4544001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c661ea68734497b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:18.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.615+0000 7f454a7fc700 1 -- 172.21.15.3:0/596319212 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4544001950 con 0x7f45340051c0 2023-10-08T15:40:18.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.615+0000 7f454a7fc700 1 -- 172.21.15.3:0/596319212 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f454400c8b0 con 0x7f45340051c0 2023-10-08T15:40:18.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.615+0000 7f454a7fc700 1 -- 172.21.15.3:0/596319212 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454400cc50 con 0x7f45340051c0 2023-10-08T15:40:18.624 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.615+0000 7f4550c06700 1 -- 172.21.15.3:0/596319212 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f45340051c0 msgr2=0x7f453400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:18.624 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.615+0000 7f4550c06700 1 --2- 172.21.15.3:0/596319212 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f45340051c0 0x7f453400ba60 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f4544001fc0 tx=0x7f4544001640 comp rx=0 tx=0).stop 2023-10-08T15:40:18.624 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.615+0000 7f4550c06700 1 -- 172.21.15.3:0/596319212 shutdown_connections 2023-10-08T15:40:18.624 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.615+0000 7f4550c06700 1 --2- 172.21.15.3:0/596319212 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f45340051c0 0x7f453400ba60 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:18.624 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.615+0000 7f4550c06700 1 -- 172.21.15.3:0/596319212 >> 172.21.15.3:0/596319212 conn(0x7f454c0670e0 msgr2=0x7f454c0674e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:18.624 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.615+0000 7f4550c06700 1 -- 172.21.15.3:0/596319212 shutdown_connections 2023-10-08T15:40:18.624 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.615+0000 7f4550c06700 1 -- 172.21.15.3:0/596319212 wait complete. 2023-10-08T15:40:18.627 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.619+0000 7f4550c06700 1 Processor -- start 2023-10-08T15:40:18.627 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.619+0000 7f4550c06700 1 -- start start 2023-10-08T15:40:18.627 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.619+0000 7f4550c06700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f45340051c0 0x7f454c159f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:18.627 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.619+0000 7f4550c06700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f454c0b5ee0 0x7f454c0a13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:18.627 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.619+0000 7f4550c06700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f454c0a18f0 0x7f454c0b5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:18.627 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.619+0000 7f4550c06700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f454c0b4270 con 0x7f454c0b5ee0 2023-10-08T15:40:18.627 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.619+0000 7f4550c06700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f454c0b3c20 con 0x7f454c0a18f0 2023-10-08T15:40:18.627 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.619+0000 7f4550c06700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f454c0b3f00 con 0x7f45340051c0 2023-10-08T15:40:18.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.619+0000 7f454affd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f454c0b5ee0 0x7f454c0a13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:18.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.619+0000 7f454affd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f454c0b5ee0 0x7f454c0a13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52666/0 (socket says 172.21.15.3:52666) 2023-10-08T15:40:18.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.619+0000 7f454bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f454c0a18f0 0x7f454c0b5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:18.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.619+0000 7f454b7fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f45340051c0 0x7f454c159f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:18.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.619+0000 7f454affd700 1 -- 172.21.15.3:0/3347375114 learned_addr learned my addr 172.21.15.3:0/3347375114 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:18.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.619+0000 7f454bfff700 1 -- 172.21.15.3:0/3347375114 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f45340051c0 msgr2=0x7f454c159f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:18.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.619+0000 7f454bfff700 1 --2- 172.21.15.3:0/3347375114 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f45340051c0 0x7f454c159f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:18.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.619+0000 7f454bfff700 1 -- 172.21.15.3:0/3347375114 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f454c0b5ee0 msgr2=0x7f454c0a13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:18.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.619+0000 7f454bfff700 1 --2- 172.21.15.3:0/3347375114 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f454c0b5ee0 0x7f454c0a13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:18.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.619+0000 7f454bfff700 1 -- 172.21.15.3:0/3347375114 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f454c0b4aa0 con 0x7f454c0a18f0 2023-10-08T15:40:18.629 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.619+0000 7f454affd700 1 --2- 172.21.15.3:0/3347375114 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f454c0b5ee0 0x7f454c0a13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:40:18.629 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.619+0000 7f454b7fe700 1 --2- 172.21.15.3:0/3347375114 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f45340051c0 0x7f454c159f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:40:18.629 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.619+0000 7f454bfff700 1 --2- 172.21.15.3:0/3347375114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f454c0a18f0 0x7f454c0b5120 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f454c0bb420 tx=0x7f4544015000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:18.629 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.619+0000 7f45337fe700 1 -- 172.21.15.3:0/3347375114 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454400c6d0 con 0x7f454c0a18f0 2023-10-08T15:40:18.629 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.623+0000 7f45337fe700 1 -- 172.21.15.3:0/3347375114 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4544012e80 con 0x7f454c0a18f0 2023-10-08T15:40:18.629 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.623+0000 7f4550c06700 1 -- 172.21.15.3:0/3347375114 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f454c0b5660 con 0x7f454c0a18f0 2023-10-08T15:40:18.629 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.623+0000 7f45337fe700 1 -- 172.21.15.3:0/3347375114 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4544006df0 con 0x7f454c0a18f0 2023-10-08T15:40:18.629 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.623+0000 7f4550c06700 1 -- 172.21.15.3:0/3347375114 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f454c0b5ab0 con 0x7f454c0a18f0 2023-10-08T15:40:18.629 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.623+0000 7f4550c06700 1 -- 172.21.15.3:0/3347375114 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f454c15a4b0 con 0x7f454c0a18f0 2023-10-08T15:40:18.630 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.623+0000 7f45337fe700 1 -- 172.21.15.3:0/3347375114 <== mon.1 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f45440263b0 con 0x7f454c0a18f0 2023-10-08T15:40:18.630 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.623+0000 7f45337fe700 1 --2- 172.21.15.3:0/3347375114 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4538060580 0x7f4538062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:18.630 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.623+0000 7f45337fe700 1 -- 172.21.15.3:0/3347375114 <== mon.1 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f454407d1d0 con 0x7f454c0a18f0 2023-10-08T15:40:18.630 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.623+0000 7f454b7fe700 1 --2- 172.21.15.3:0/3347375114 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4538060580 0x7f4538062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:18.630 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.627+0000 7f454b7fe700 1 --2- 172.21.15.3:0/3347375114 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4538060580 0x7f4538062a30 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f453c007b20 tx=0x7f454c149350 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:18.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.635+0000 7f45337fe700 1 -- 172.21.15.3:0/3347375114 <== mon.1 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f454404d880 con 0x7f454c0a18f0 2023-10-08T15:40:18.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.799+0000 7f4550c06700 1 -- 172.21.15.3:0/3347375114 --> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f454c0b40c0 con 0x7f4538060580 2023-10-08T15:40:18.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.811+0000 7f45337fe700 1 -- 172.21.15.3:0/3347375114 <== mgr.4102 v2:172.21.15.50:6832/33268 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287269 (secure 0 0 0) 0x7f454c0b40c0 con 0x7f4538060580 2023-10-08T15:40:18.822 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:40:18.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.819+0000 7f4550c06700 1 -- 172.21.15.3:0/3347375114 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4538060580 msgr2=0x7f4538062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:18.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.819+0000 7f4550c06700 1 --2- 172.21.15.3:0/3347375114 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4538060580 0x7f4538062a30 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f453c007b20 tx=0x7f454c149350 comp rx=0 tx=0).stop 2023-10-08T15:40:18.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.819+0000 7f4550c06700 1 -- 172.21.15.3:0/3347375114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f454c0a18f0 msgr2=0x7f454c0b5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:18.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.819+0000 7f4550c06700 1 --2- 172.21.15.3:0/3347375114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f454c0a18f0 0x7f454c0b5120 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f454c0bb420 tx=0x7f4544015000 comp rx=0 tx=0).stop 2023-10-08T15:40:18.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.819+0000 7f4550c06700 1 -- 172.21.15.3:0/3347375114 shutdown_connections 2023-10-08T15:40:18.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.819+0000 7f4550c06700 1 --2- 172.21.15.3:0/3347375114 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4538060580 0x7f4538062a30 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:18.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.819+0000 7f4550c06700 1 --2- 172.21.15.3:0/3347375114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f454c0a18f0 0x7f454c0b5120 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:18.826 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.819+0000 7f4550c06700 1 --2- 172.21.15.3:0/3347375114 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f454c0b5ee0 0x7f454c0a13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:18.826 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.819+0000 7f4550c06700 1 --2- 172.21.15.3:0/3347375114 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f45340051c0 0x7f454c159f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:18.826 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.819+0000 7f4550c06700 1 -- 172.21.15.3:0/3347375114 >> 172.21.15.3:0/3347375114 conn(0x7f454c0670e0 msgr2=0x7f454c14b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:18.826 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.819+0000 7f4550c06700 1 -- 172.21.15.3:0/3347375114 shutdown_connections 2023-10-08T15:40:18.826 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.819+0000 7f4550c06700 1 -- 172.21.15.3:0/3347375114 wait complete. 2023-10-08T15:40:18.826 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2023-10-08T15:40:18.837 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":123,"stamp":"2023-10-08T15:40:18.577265+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2427060,"kb_used_data":3700,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752547660,"statfs":{"total":773094113280,"available":770608803840,"internally_reserved":0,"allocated":3788800,"data_stored":2624556,"data_compressed":66282,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001777"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.435951+0000","last_change":"2023-10-08T15:40:14.423891+0000","last_active":"2023-10-08T15:40:14.435951+0000","last_peered":"2023-10-08T15:40:14.435951+0000","last_clean":"2023-10-08T15:40:14.435951+0000","last_became_active":"2023-10-08T15:40:14.423583+0000","last_became_peered":"2023-10-08T15:40:14.423583+0000","last_unstale":"2023-10-08T15:40:14.435951+0000","last_undegraded":"2023-10-08T15:40:14.435951+0000","last_fullsized":"2023-10-08T15:40:14.435951+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:28.192248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.428931+0000","last_change":"2023-10-08T15:40:14.428931+0000","last_active":"2023-10-08T15:40:14.428931+0000","last_peered":"2023-10-08T15:40:14.428931+0000","last_clean":"2023-10-08T15:40:14.428931+0000","last_became_active":"2023-10-08T15:40:14.428612+0000","last_became_peered":"2023-10-08T15:40:14.428612+0000","last_unstale":"2023-10-08T15:40:14.428931+0000","last_undegraded":"2023-10-08T15:40:14.428931+0000","last_fullsized":"2023-10-08T15:40:14.428931+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:57:32.025855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.431747+0000","last_change":"2023-10-08T15:40:14.430136+0000","last_active":"2023-10-08T15:40:14.431747+0000","last_peered":"2023-10-08T15:40:14.431747+0000","last_clean":"2023-10-08T15:40:14.431747+0000","last_became_active":"2023-10-08T15:40:14.428007+0000","last_became_peered":"2023-10-08T15:40:14.428007+0000","last_unstale":"2023-10-08T15:40:14.431747+0000","last_undegraded":"2023-10-08T15:40:14.431747+0000","last_fullsized":"2023-10-08T15:40:14.431747+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:32:50.871662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.439617+0000","last_change":"2023-10-08T15:40:14.430064+0000","last_active":"2023-10-08T15:40:14.439617+0000","last_peered":"2023-10-08T15:40:14.439617+0000","last_clean":"2023-10-08T15:40:14.439617+0000","last_became_active":"2023-10-08T15:40:14.428442+0000","last_became_peered":"2023-10-08T15:40:14.428442+0000","last_unstale":"2023-10-08T15:40:14.439617+0000","last_undegraded":"2023-10-08T15:40:14.439617+0000","last_fullsized":"2023-10-08T15:40:14.439617+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:32:50.871662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.427554+0000","last_change":"2023-10-08T15:40:14.427554+0000","last_active":"2023-10-08T15:40:14.427554+0000","last_peered":"2023-10-08T15:40:14.427554+0000","last_clean":"2023-10-08T15:40:14.427554+0000","last_became_active":"2023-10-08T15:40:14.427263+0000","last_became_peered":"2023-10-08T15:40:14.427263+0000","last_unstale":"2023-10-08T15:40:14.427554+0000","last_undegraded":"2023-10-08T15:40:14.427554+0000","last_fullsized":"2023-10-08T15:40:14.427554+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:16:37.068213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.430617+0000","last_change":"2023-10-08T15:40:14.424638+0000","last_active":"2023-10-08T15:40:14.430617+0000","last_peered":"2023-10-08T15:40:14.430617+0000","last_clean":"2023-10-08T15:40:14.430617+0000","last_became_active":"2023-10-08T15:40:14.424340+0000","last_became_peered":"2023-10-08T15:40:14.424340+0000","last_unstale":"2023-10-08T15:40:14.430617+0000","last_undegraded":"2023-10-08T15:40:14.430617+0000","last_fullsized":"2023-10-08T15:40:14.430617+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:15:22.556584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.425697+0000","last_change":"2023-10-08T15:40:14.417067+0000","last_active":"2023-10-08T15:40:14.425697+0000","last_peered":"2023-10-08T15:40:14.425697+0000","last_clean":"2023-10-08T15:40:14.425697+0000","last_became_active":"2023-10-08T15:40:14.416679+0000","last_became_peered":"2023-10-08T15:40:14.416679+0000","last_unstale":"2023-10-08T15:40:14.425697+0000","last_undegraded":"2023-10-08T15:40:14.425697+0000","last_fullsized":"2023-10-08T15:40:14.425697+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:37:17.376921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.439487+0000","last_change":"2023-10-08T15:40:14.428491+0000","last_active":"2023-10-08T15:40:14.439487+0000","last_peered":"2023-10-08T15:40:14.439487+0000","last_clean":"2023-10-08T15:40:14.439487+0000","last_became_active":"2023-10-08T15:40:14.428218+0000","last_became_peered":"2023-10-08T15:40:14.428218+0000","last_unstale":"2023-10-08T15:40:14.439487+0000","last_undegraded":"2023-10-08T15:40:14.439487+0000","last_fullsized":"2023-10-08T15:40:14.439487+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:16:37.068213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.444108+0000","last_change":"2023-10-08T15:40:14.436179+0000","last_active":"2023-10-08T15:40:14.444108+0000","last_peered":"2023-10-08T15:40:14.444108+0000","last_clean":"2023-10-08T15:40:14.444108+0000","last_became_active":"2023-10-08T15:40:14.435907+0000","last_became_peered":"2023-10-08T15:40:14.435907+0000","last_unstale":"2023-10-08T15:40:14.444108+0000","last_undegraded":"2023-10-08T15:40:14.444108+0000","last_fullsized":"2023-10-08T15:40:14.444108+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:19.169692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.439541+0000","last_change":"2023-10-08T15:40:14.429862+0000","last_active":"2023-10-08T15:40:14.439541+0000","last_peered":"2023-10-08T15:40:14.439541+0000","last_clean":"2023-10-08T15:40:14.439541+0000","last_became_active":"2023-10-08T15:40:14.429448+0000","last_became_peered":"2023-10-08T15:40:14.429448+0000","last_unstale":"2023-10-08T15:40:14.439541+0000","last_undegraded":"2023-10-08T15:40:14.439541+0000","last_fullsized":"2023-10-08T15:40:14.439541+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:54:26.469514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.444187+0000","last_change":"2023-10-08T15:40:14.437444+0000","last_active":"2023-10-08T15:40:14.444187+0000","last_peered":"2023-10-08T15:40:14.444187+0000","last_clean":"2023-10-08T15:40:14.444187+0000","last_became_active":"2023-10-08T15:40:14.437109+0000","last_became_peered":"2023-10-08T15:40:14.437109+0000","last_unstale":"2023-10-08T15:40:14.444187+0000","last_undegraded":"2023-10-08T15:40:14.444187+0000","last_fullsized":"2023-10-08T15:40:14.444187+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:55:30.274824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.429541+0000","last_change":"2023-10-08T15:40:14.429541+0000","last_active":"2023-10-08T15:40:14.429541+0000","last_peered":"2023-10-08T15:40:14.429541+0000","last_clean":"2023-10-08T15:40:14.429541+0000","last_became_active":"2023-10-08T15:40:14.429220+0000","last_became_peered":"2023-10-08T15:40:14.429220+0000","last_unstale":"2023-10-08T15:40:14.429541+0000","last_undegraded":"2023-10-08T15:40:14.429541+0000","last_fullsized":"2023-10-08T15:40:14.429541+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:32:50.871662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.429796+0000","last_change":"2023-10-08T15:40:14.424634+0000","last_active":"2023-10-08T15:40:14.429796+0000","last_peered":"2023-10-08T15:40:14.429796+0000","last_clean":"2023-10-08T15:40:14.429796+0000","last_became_active":"2023-10-08T15:40:14.424344+0000","last_became_peered":"2023-10-08T15:40:14.424344+0000","last_unstale":"2023-10-08T15:40:14.429796+0000","last_undegraded":"2023-10-08T15:40:14.429796+0000","last_fullsized":"2023-10-08T15:40:14.429796+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:23.701420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.443836+0000","last_change":"2023-10-08T15:40:14.432495+0000","last_active":"2023-10-08T15:40:14.443836+0000","last_peered":"2023-10-08T15:40:14.443836+0000","last_clean":"2023-10-08T15:40:14.443836+0000","last_became_active":"2023-10-08T15:40:14.431718+0000","last_became_peered":"2023-10-08T15:40:14.431718+0000","last_unstale":"2023-10-08T15:40:14.443836+0000","last_undegraded":"2023-10-08T15:40:14.443836+0000","last_fullsized":"2023-10-08T15:40:14.443836+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:38:59.192155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.430645+0000","last_change":"2023-10-08T15:40:14.425401+0000","last_active":"2023-10-08T15:40:14.430645+0000","last_peered":"2023-10-08T15:40:14.430645+0000","last_clean":"2023-10-08T15:40:14.430645+0000","last_became_active":"2023-10-08T15:40:14.424995+0000","last_became_peered":"2023-10-08T15:40:14.424995+0000","last_unstale":"2023-10-08T15:40:14.430645+0000","last_undegraded":"2023-10-08T15:40:14.430645+0000","last_fullsized":"2023-10-08T15:40:14.430645+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:35:53.516838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.431628+0000","last_change":"2023-10-08T15:40:14.426307+0000","last_active":"2023-10-08T15:40:14.431628+0000","last_peered":"2023-10-08T15:40:14.431628+0000","last_clean":"2023-10-08T15:40:14.431628+0000","last_became_active":"2023-10-08T15:40:14.425764+0000","last_became_peered":"2023-10-08T15:40:14.425764+0000","last_unstale":"2023-10-08T15:40:14.431628+0000","last_undegraded":"2023-10-08T15:40:14.431628+0000","last_fullsized":"2023-10-08T15:40:14.431628+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:47:51.523520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.427782+0000","last_change":"2023-10-08T15:40:14.425512+0000","last_active":"2023-10-08T15:40:14.427782+0000","last_peered":"2023-10-08T15:40:14.427782+0000","last_clean":"2023-10-08T15:40:14.427782+0000","last_became_active":"2023-10-08T15:40:14.425211+0000","last_became_peered":"2023-10-08T15:40:14.425211+0000","last_unstale":"2023-10-08T15:40:14.427782+0000","last_undegraded":"2023-10-08T15:40:14.427782+0000","last_fullsized":"2023-10-08T15:40:14.427782+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:55:30.274824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.440793+0000","last_change":"2023-10-08T15:40:14.438477+0000","last_active":"2023-10-08T15:40:14.440793+0000","last_peered":"2023-10-08T15:40:14.440793+0000","last_clean":"2023-10-08T15:40:14.440793+0000","last_became_active":"2023-10-08T15:40:14.438140+0000","last_became_peered":"2023-10-08T15:40:14.438140+0000","last_unstale":"2023-10-08T15:40:14.440793+0000","last_undegraded":"2023-10-08T15:40:14.440793+0000","last_fullsized":"2023-10-08T15:40:14.440793+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:54:26.469514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.432902+0000","last_change":"2023-10-08T15:40:14.429356+0000","last_active":"2023-10-08T15:40:14.432902+0000","last_peered":"2023-10-08T15:40:14.432902+0000","last_clean":"2023-10-08T15:40:14.432902+0000","last_became_active":"2023-10-08T15:40:14.429006+0000","last_became_peered":"2023-10-08T15:40:14.429006+0000","last_unstale":"2023-10-08T15:40:14.432902+0000","last_undegraded":"2023-10-08T15:40:14.432902+0000","last_fullsized":"2023-10-08T15:40:14.432902+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:59:25.720384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.432988+0000","last_change":"2023-10-08T15:40:14.426309+0000","last_active":"2023-10-08T15:40:14.432988+0000","last_peered":"2023-10-08T15:40:14.432988+0000","last_clean":"2023-10-08T15:40:14.432988+0000","last_became_active":"2023-10-08T15:40:14.426020+0000","last_became_peered":"2023-10-08T15:40:14.426020+0000","last_unstale":"2023-10-08T15:40:14.432988+0000","last_undegraded":"2023-10-08T15:40:14.432988+0000","last_fullsized":"2023-10-08T15:40:14.432988+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:11:59.571805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.426458+0000","last_change":"2023-10-08T15:40:14.422657+0000","last_active":"2023-10-08T15:40:14.426458+0000","last_peered":"2023-10-08T15:40:14.426458+0000","last_clean":"2023-10-08T15:40:14.426458+0000","last_became_active":"2023-10-08T15:40:14.422369+0000","last_became_peered":"2023-10-08T15:40:14.422369+0000","last_unstale":"2023-10-08T15:40:14.426458+0000","last_undegraded":"2023-10-08T15:40:14.426458+0000","last_fullsized":"2023-10-08T15:40:14.426458+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:34:36.429348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.439773+0000","last_change":"2023-10-08T15:40:14.429752+0000","last_active":"2023-10-08T15:40:14.439773+0000","last_peered":"2023-10-08T15:40:14.439773+0000","last_clean":"2023-10-08T15:40:14.439773+0000","last_became_active":"2023-10-08T15:40:14.429492+0000","last_became_peered":"2023-10-08T15:40:14.429492+0000","last_unstale":"2023-10-08T15:40:14.439773+0000","last_undegraded":"2023-10-08T15:40:14.439773+0000","last_fullsized":"2023-10-08T15:40:14.439773+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:46.354499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.447269+0000","last_change":"2023-10-08T15:40:14.445792+0000","last_active":"2023-10-08T15:40:14.447269+0000","last_peered":"2023-10-08T15:40:14.447269+0000","last_clean":"2023-10-08T15:40:14.447269+0000","last_became_active":"2023-10-08T15:40:14.445487+0000","last_became_peered":"2023-10-08T15:40:14.445487+0000","last_unstale":"2023-10-08T15:40:14.447269+0000","last_undegraded":"2023-10-08T15:40:14.447269+0000","last_fullsized":"2023-10-08T15:40:14.447269+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:46:46.494060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.435410+0000","last_change":"2023-10-08T15:40:14.433543+0000","last_active":"2023-10-08T15:40:14.435410+0000","last_peered":"2023-10-08T15:40:14.435410+0000","last_clean":"2023-10-08T15:40:14.435410+0000","last_became_active":"2023-10-08T15:40:14.433202+0000","last_became_peered":"2023-10-08T15:40:14.433202+0000","last_unstale":"2023-10-08T15:40:14.435410+0000","last_undegraded":"2023-10-08T15:40:14.435410+0000","last_fullsized":"2023-10-08T15:40:14.435410+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:02:38.806363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.435355+0000","last_change":"2023-10-08T15:40:14.434060+0000","last_active":"2023-10-08T15:40:14.435355+0000","last_peered":"2023-10-08T15:40:14.435355+0000","last_clean":"2023-10-08T15:40:14.435355+0000","last_became_active":"2023-10-08T15:40:14.433662+0000","last_became_peered":"2023-10-08T15:40:14.433662+0000","last_unstale":"2023-10-08T15:40:14.435355+0000","last_undegraded":"2023-10-08T15:40:14.435355+0000","last_fullsized":"2023-10-08T15:40:14.435355+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:54.703533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.429752+0000","last_change":"2023-10-08T15:40:14.424529+0000","last_active":"2023-10-08T15:40:14.429752+0000","last_peered":"2023-10-08T15:40:14.429752+0000","last_clean":"2023-10-08T15:40:14.429752+0000","last_became_active":"2023-10-08T15:40:14.424220+0000","last_became_peered":"2023-10-08T15:40:14.424220+0000","last_unstale":"2023-10-08T15:40:14.429752+0000","last_undegraded":"2023-10-08T15:40:14.429752+0000","last_fullsized":"2023-10-08T15:40:14.429752+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:46:47.332461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.422109+0000","last_change":"2023-10-08T15:40:14.420119+0000","last_active":"2023-10-08T15:40:14.422109+0000","last_peered":"2023-10-08T15:40:14.422109+0000","last_clean":"2023-10-08T15:40:14.422109+0000","last_became_active":"2023-10-08T15:40:14.419787+0000","last_became_peered":"2023-10-08T15:40:14.419787+0000","last_unstale":"2023-10-08T15:40:14.422109+0000","last_undegraded":"2023-10-08T15:40:14.422109+0000","last_fullsized":"2023-10-08T15:40:14.422109+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:19:38.120631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.426548+0000","last_change":"2023-10-08T15:40:14.426548+0000","last_active":"2023-10-08T15:40:14.426548+0000","last_peered":"2023-10-08T15:40:14.426548+0000","last_clean":"2023-10-08T15:40:14.426548+0000","last_became_active":"2023-10-08T15:40:14.426214+0000","last_became_peered":"2023-10-08T15:40:14.426214+0000","last_unstale":"2023-10-08T15:40:14.426548+0000","last_undegraded":"2023-10-08T15:40:14.426548+0000","last_fullsized":"2023-10-08T15:40:14.426548+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:38:59.192155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.436211+0000","last_change":"2023-10-08T15:40:14.434569+0000","last_active":"2023-10-08T15:40:14.436211+0000","last_peered":"2023-10-08T15:40:14.436211+0000","last_clean":"2023-10-08T15:40:14.436211+0000","last_became_active":"2023-10-08T15:40:14.434260+0000","last_became_peered":"2023-10-08T15:40:14.434260+0000","last_unstale":"2023-10-08T15:40:14.436211+0000","last_undegraded":"2023-10-08T15:40:14.436211+0000","last_fullsized":"2023-10-08T15:40:14.436211+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:50:14.854794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.426864+0000","last_change":"2023-10-08T15:40:14.423639+0000","last_active":"2023-10-08T15:40:14.426864+0000","last_peered":"2023-10-08T15:40:14.426864+0000","last_clean":"2023-10-08T15:40:14.426864+0000","last_became_active":"2023-10-08T15:40:14.423280+0000","last_became_peered":"2023-10-08T15:40:14.423280+0000","last_unstale":"2023-10-08T15:40:14.426864+0000","last_undegraded":"2023-10-08T15:40:14.426864+0000","last_fullsized":"2023-10-08T15:40:14.426864+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:16:37.068213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.430624+0000","last_change":"2023-10-08T15:40:14.423406+0000","last_active":"2023-10-08T15:40:14.430624+0000","last_peered":"2023-10-08T15:40:14.430624+0000","last_clean":"2023-10-08T15:40:14.430624+0000","last_became_active":"2023-10-08T15:40:14.423124+0000","last_became_peered":"2023-10-08T15:40:14.423124+0000","last_unstale":"2023-10-08T15:40:14.430624+0000","last_undegraded":"2023-10-08T15:40:14.430624+0000","last_fullsized":"2023-10-08T15:40:14.430624+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:23:00.391124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.432665+0000","last_change":"2023-10-08T15:40:14.428846+0000","last_active":"2023-10-08T15:40:14.432665+0000","last_peered":"2023-10-08T15:40:14.432665+0000","last_clean":"2023-10-08T15:40:14.432665+0000","last_became_active":"2023-10-08T15:40:14.428576+0000","last_became_peered":"2023-10-08T15:40:14.428576+0000","last_unstale":"2023-10-08T15:40:14.432665+0000","last_undegraded":"2023-10-08T15:40:14.432665+0000","last_fullsized":"2023-10-08T15:40:14.432665+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:56:46.389831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.442722+0000","last_change":"2023-10-08T15:40:14.428097+0000","last_active":"2023-10-08T15:40:14.442722+0000","last_peered":"2023-10-08T15:40:14.442722+0000","last_clean":"2023-10-08T15:40:14.442722+0000","last_became_active":"2023-10-08T15:40:14.427365+0000","last_became_peered":"2023-10-08T15:40:14.427365+0000","last_unstale":"2023-10-08T15:40:14.442722+0000","last_undegraded":"2023-10-08T15:40:14.442722+0000","last_fullsized":"2023-10-08T15:40:14.442722+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:59:25.720384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"38'4","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.440786+0000","last_change":"2023-10-08T15:40:13.425751+0000","last_active":"2023-10-08T15:40:14.440786+0000","last_peered":"2023-10-08T15:40:14.440786+0000","last_clean":"2023-10-08T15:40:14.440786+0000","last_became_active":"2023-10-08T15:40:13.425422+0000","last_became_peered":"2023-10-08T15:40:13.425422+0000","last_unstale":"2023-10-08T15:40:14.440786+0000","last_undegraded":"2023-10-08T15:40:14.440786+0000","last_fullsized":"2023-10-08T15:40:14.440786+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:18.157723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.428792+0000","last_change":"2023-10-08T15:40:14.422467+0000","last_active":"2023-10-08T15:40:14.428792+0000","last_peered":"2023-10-08T15:40:14.428792+0000","last_clean":"2023-10-08T15:40:14.428792+0000","last_became_active":"2023-10-08T15:40:14.422116+0000","last_became_peered":"2023-10-08T15:40:14.422116+0000","last_unstale":"2023-10-08T15:40:14.428792+0000","last_undegraded":"2023-10-08T15:40:14.428792+0000","last_fullsized":"2023-10-08T15:40:14.428792+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:07:41.691232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"38'1","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.439948+0000","last_change":"2023-10-08T15:40:13.427528+0000","last_active":"2023-10-08T15:40:14.439948+0000","last_peered":"2023-10-08T15:40:14.439948+0000","last_clean":"2023-10-08T15:40:14.439948+0000","last_became_active":"2023-10-08T15:40:13.426178+0000","last_became_peered":"2023-10-08T15:40:13.426178+0000","last_unstale":"2023-10-08T15:40:14.439948+0000","last_undegraded":"2023-10-08T15:40:14.439948+0000","last_fullsized":"2023-10-08T15:40:14.439948+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:22:14.407250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.426852+0000","last_change":"2023-10-08T15:40:14.426852+0000","last_active":"2023-10-08T15:40:14.426852+0000","last_peered":"2023-10-08T15:40:14.426852+0000","last_clean":"2023-10-08T15:40:14.426852+0000","last_became_active":"2023-10-08T15:40:14.424903+0000","last_became_peered":"2023-10-08T15:40:14.424903+0000","last_unstale":"2023-10-08T15:40:14.426852+0000","last_undegraded":"2023-10-08T15:40:14.426852+0000","last_fullsized":"2023-10-08T15:40:14.426852+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:46.354499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.445200+0000","last_change":"2023-10-08T15:40:13.422829+0000","last_active":"2023-10-08T15:40:14.445200+0000","last_peered":"2023-10-08T15:40:14.445200+0000","last_clean":"2023-10-08T15:40:14.445200+0000","last_became_active":"2023-10-08T15:40:13.422518+0000","last_became_peered":"2023-10-08T15:40:13.422518+0000","last_unstale":"2023-10-08T15:40:14.445200+0000","last_undegraded":"2023-10-08T15:40:14.445200+0000","last_fullsized":"2023-10-08T15:40:14.445200+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:50:13.842824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.443233+0000","last_change":"2023-10-08T15:40:14.427920+0000","last_active":"2023-10-08T15:40:14.443233+0000","last_peered":"2023-10-08T15:40:14.443233+0000","last_clean":"2023-10-08T15:40:14.443233+0000","last_became_active":"2023-10-08T15:40:14.427648+0000","last_became_peered":"2023-10-08T15:40:14.427648+0000","last_unstale":"2023-10-08T15:40:14.443233+0000","last_undegraded":"2023-10-08T15:40:14.443233+0000","last_fullsized":"2023-10-08T15:40:14.443233+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:18:28.702700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.447461+0000","last_change":"2023-10-08T15:40:13.417157+0000","last_active":"2023-10-08T15:40:14.447461+0000","last_peered":"2023-10-08T15:40:14.447461+0000","last_clean":"2023-10-08T15:40:14.447461+0000","last_became_active":"2023-10-08T15:40:13.416876+0000","last_became_peered":"2023-10-08T15:40:13.416876+0000","last_unstale":"2023-10-08T15:40:14.447461+0000","last_undegraded":"2023-10-08T15:40:14.447461+0000","last_fullsized":"2023-10-08T15:40:14.447461+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:31:45.772524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.426881+0000","last_change":"2023-10-08T15:40:14.425353+0000","last_active":"2023-10-08T15:40:14.426881+0000","last_peered":"2023-10-08T15:40:14.426881+0000","last_clean":"2023-10-08T15:40:14.426881+0000","last_became_active":"2023-10-08T15:40:14.425058+0000","last_became_peered":"2023-10-08T15:40:14.425058+0000","last_unstale":"2023-10-08T15:40:14.426881+0000","last_undegraded":"2023-10-08T15:40:14.426881+0000","last_fullsized":"2023-10-08T15:40:14.426881+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:57:32.025855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"38'1","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.446643+0000","last_change":"2023-10-08T15:40:13.417469+0000","last_active":"2023-10-08T15:40:14.446643+0000","last_peered":"2023-10-08T15:40:14.446643+0000","last_clean":"2023-10-08T15:40:14.446643+0000","last_became_active":"2023-10-08T15:40:13.417134+0000","last_became_peered":"2023-10-08T15:40:13.417134+0000","last_unstale":"2023-10-08T15:40:14.446643+0000","last_undegraded":"2023-10-08T15:40:14.446643+0000","last_fullsized":"2023-10-08T15:40:14.446643+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:38:58.180186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.442814+0000","last_change":"2023-10-08T15:40:14.431556+0000","last_active":"2023-10-08T15:40:14.442814+0000","last_peered":"2023-10-08T15:40:14.442814+0000","last_clean":"2023-10-08T15:40:14.442814+0000","last_became_active":"2023-10-08T15:40:14.431277+0000","last_became_peered":"2023-10-08T15:40:14.431277+0000","last_unstale":"2023-10-08T15:40:14.442814+0000","last_undegraded":"2023-10-08T15:40:14.442814+0000","last_fullsized":"2023-10-08T15:40:14.442814+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:26:20.874012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"38'1","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.439904+0000","last_change":"2023-10-08T15:40:13.421287+0000","last_active":"2023-10-08T15:40:14.439904+0000","last_peered":"2023-10-08T15:40:14.439904+0000","last_clean":"2023-10-08T15:40:14.439904+0000","last_became_active":"2023-10-08T15:40:13.420491+0000","last_became_peered":"2023-10-08T15:40:13.420491+0000","last_unstale":"2023-10-08T15:40:14.439904+0000","last_undegraded":"2023-10-08T15:40:14.439904+0000","last_fullsized":"2023-10-08T15:40:14.439904+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:12:14.269569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.432725+0000","last_change":"2023-10-08T15:40:14.422880+0000","last_active":"2023-10-08T15:40:14.432725+0000","last_peered":"2023-10-08T15:40:14.432725+0000","last_clean":"2023-10-08T15:40:14.432725+0000","last_became_active":"2023-10-08T15:40:14.422555+0000","last_became_peered":"2023-10-08T15:40:14.422555+0000","last_unstale":"2023-10-08T15:40:14.432725+0000","last_undegraded":"2023-10-08T15:40:14.432725+0000","last_fullsized":"2023-10-08T15:40:14.432725+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:19:38.120631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-08T15:40:13.428960+0000","last_change":"2023-10-08T15:40:13.425380+0000","last_active":"2023-10-08T15:40:13.428960+0000","last_peered":"2023-10-08T15:40:13.428960+0000","last_clean":"2023-10-08T15:40:13.428960+0000","last_became_active":"2023-10-08T15:40:13.425091+0000","last_became_peered":"2023-10-08T15:40:13.425091+0000","last_unstale":"2023-10-08T15:40:13.428960+0000","last_undegraded":"2023-10-08T15:40:13.428960+0000","last_fullsized":"2023-10-08T15:40:13.428960+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:30:28.988602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.435277+0000","last_change":"2023-10-08T15:40:14.433565+0000","last_active":"2023-10-08T15:40:14.435277+0000","last_peered":"2023-10-08T15:40:14.435277+0000","last_clean":"2023-10-08T15:40:14.435277+0000","last_became_active":"2023-10-08T15:40:14.433242+0000","last_became_peered":"2023-10-08T15:40:14.433242+0000","last_unstale":"2023-10-08T15:40:14.435277+0000","last_undegraded":"2023-10-08T15:40:14.435277+0000","last_fullsized":"2023-10-08T15:40:14.435277+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:01:49.004201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.418446+0000","last_change":"2023-10-08T15:40:13.427181+0000","last_active":"2023-10-08T15:40:14.418446+0000","last_peered":"2023-10-08T15:40:14.418446+0000","last_clean":"2023-10-08T15:40:14.418446+0000","last_became_active":"2023-10-08T15:40:13.425429+0000","last_became_peered":"2023-10-08T15:40:13.425429+0000","last_unstale":"2023-10-08T15:40:14.418446+0000","last_undegraded":"2023-10-08T15:40:14.418446+0000","last_fullsized":"2023-10-08T15:40:14.418446+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:49:42.599600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.440025+0000","last_change":"2023-10-08T15:40:14.438306+0000","last_active":"2023-10-08T15:40:14.440025+0000","last_peered":"2023-10-08T15:40:14.440025+0000","last_clean":"2023-10-08T15:40:14.440025+0000","last_became_active":"2023-10-08T15:40:14.437961+0000","last_became_peered":"2023-10-08T15:40:14.437961+0000","last_unstale":"2023-10-08T15:40:14.440025+0000","last_undegraded":"2023-10-08T15:40:14.440025+0000","last_fullsized":"2023-10-08T15:40:14.440025+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:26:20.874012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.418871+0000","last_change":"2023-10-08T15:40:13.420695+0000","last_active":"2023-10-08T15:40:14.418871+0000","last_peered":"2023-10-08T15:40:14.418871+0000","last_clean":"2023-10-08T15:40:14.418871+0000","last_became_active":"2023-10-08T15:40:13.420370+0000","last_became_peered":"2023-10-08T15:40:13.420370+0000","last_unstale":"2023-10-08T15:40:14.418871+0000","last_undegraded":"2023-10-08T15:40:14.418871+0000","last_fullsized":"2023-10-08T15:40:14.418871+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:45:30.332801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.432660+0000","last_change":"2023-10-08T15:40:14.418552+0000","last_active":"2023-10-08T15:40:14.432660+0000","last_peered":"2023-10-08T15:40:14.432660+0000","last_clean":"2023-10-08T15:40:14.432660+0000","last_became_active":"2023-10-08T15:40:14.418152+0000","last_became_peered":"2023-10-08T15:40:14.418152+0000","last_unstale":"2023-10-08T15:40:14.432660+0000","last_undegraded":"2023-10-08T15:40:14.432660+0000","last_fullsized":"2023-10-08T15:40:14.432660+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:36:00.388553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.424445+0000","last_change":"2023-10-08T15:40:13.428311+0000","last_active":"2023-10-08T15:40:14.424445+0000","last_peered":"2023-10-08T15:40:14.424445+0000","last_clean":"2023-10-08T15:40:14.424445+0000","last_became_active":"2023-10-08T15:40:13.427998+0000","last_became_peered":"2023-10-08T15:40:13.427998+0000","last_unstale":"2023-10-08T15:40:14.424445+0000","last_undegraded":"2023-10-08T15:40:14.424445+0000","last_fullsized":"2023-10-08T15:40:14.424445+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:14:50.877335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.433766+0000","last_change":"2023-10-08T15:40:14.428424+0000","last_active":"2023-10-08T15:40:14.433766+0000","last_peered":"2023-10-08T15:40:14.433766+0000","last_clean":"2023-10-08T15:40:14.433766+0000","last_became_active":"2023-10-08T15:40:14.428102+0000","last_became_peered":"2023-10-08T15:40:14.428102+0000","last_unstale":"2023-10-08T15:40:14.433766+0000","last_undegraded":"2023-10-08T15:40:14.433766+0000","last_fullsized":"2023-10-08T15:40:14.433766+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:47:29.743549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"38'3","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.448063+0000","last_change":"2023-10-08T15:40:13.426137+0000","last_active":"2023-10-08T15:40:14.448063+0000","last_peered":"2023-10-08T15:40:14.448063+0000","last_clean":"2023-10-08T15:40:14.448063+0000","last_became_active":"2023-10-08T15:40:13.425691+0000","last_became_peered":"2023-10-08T15:40:13.425691+0000","last_unstale":"2023-10-08T15:40:14.448063+0000","last_undegraded":"2023-10-08T15:40:14.448063+0000","last_fullsized":"2023-10-08T15:40:14.448063+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:47:36.657587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.444679+0000","last_change":"2023-10-08T15:40:14.429313+0000","last_active":"2023-10-08T15:40:14.444679+0000","last_peered":"2023-10-08T15:40:14.444679+0000","last_clean":"2023-10-08T15:40:14.444679+0000","last_became_active":"2023-10-08T15:40:14.429002+0000","last_became_peered":"2023-10-08T15:40:14.429002+0000","last_unstale":"2023-10-08T15:40:14.444679+0000","last_undegraded":"2023-10-08T15:40:14.444679+0000","last_fullsized":"2023-10-08T15:40:14.444679+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:18:25.771380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"38'6","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.449213+0000","last_change":"2023-10-08T15:40:13.420187+0000","last_active":"2023-10-08T15:40:14.449213+0000","last_peered":"2023-10-08T15:40:14.449213+0000","last_clean":"2023-10-08T15:40:14.449213+0000","last_became_active":"2023-10-08T15:40:13.419818+0000","last_became_peered":"2023-10-08T15:40:13.419818+0000","last_unstale":"2023-10-08T15:40:14.449213+0000","last_undegraded":"2023-10-08T15:40:14.449213+0000","last_fullsized":"2023-10-08T15:40:14.449213+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:34:03.849463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.431916+0000","last_change":"2023-10-08T15:40:14.427600+0000","last_active":"2023-10-08T15:40:14.431916+0000","last_peered":"2023-10-08T15:40:14.431916+0000","last_clean":"2023-10-08T15:40:14.431916+0000","last_became_active":"2023-10-08T15:40:14.427273+0000","last_became_peered":"2023-10-08T15:40:14.427273+0000","last_unstale":"2023-10-08T15:40:14.431916+0000","last_undegraded":"2023-10-08T15:40:14.431916+0000","last_fullsized":"2023-10-08T15:40:14.431916+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:41:14.459572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.444927+0000","last_change":"2023-10-08T15:40:13.428224+0000","last_active":"2023-10-08T15:40:14.444927+0000","last_peered":"2023-10-08T15:40:14.444927+0000","last_clean":"2023-10-08T15:40:14.444927+0000","last_became_active":"2023-10-08T15:40:13.427919+0000","last_became_peered":"2023-10-08T15:40:13.427919+0000","last_unstale":"2023-10-08T15:40:14.444927+0000","last_undegraded":"2023-10-08T15:40:14.444927+0000","last_fullsized":"2023-10-08T15:40:14.444927+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:32:49.859693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.448939+0000","last_change":"2023-10-08T15:40:14.444596+0000","last_active":"2023-10-08T15:40:14.448939+0000","last_peered":"2023-10-08T15:40:14.448939+0000","last_clean":"2023-10-08T15:40:14.448939+0000","last_became_active":"2023-10-08T15:40:14.444236+0000","last_became_peered":"2023-10-08T15:40:14.444236+0000","last_unstale":"2023-10-08T15:40:14.448939+0000","last_undegraded":"2023-10-08T15:40:14.448939+0000","last_fullsized":"2023-10-08T15:40:14.448939+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:32:47.327437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.408105+0000","last_change":"2023-10-08T15:40:13.415599+0000","last_active":"2023-10-08T15:40:14.408105+0000","last_peered":"2023-10-08T15:40:14.408105+0000","last_clean":"2023-10-08T15:40:14.408105+0000","last_became_active":"2023-10-08T15:40:13.415310+0000","last_became_peered":"2023-10-08T15:40:13.415310+0000","last_unstale":"2023-10-08T15:40:14.408105+0000","last_undegraded":"2023-10-08T15:40:14.408105+0000","last_fullsized":"2023-10-08T15:40:14.408105+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:18:27.690730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.435562+0000","last_change":"2023-10-08T15:40:14.431047+0000","last_active":"2023-10-08T15:40:14.435562+0000","last_peered":"2023-10-08T15:40:14.435562+0000","last_clean":"2023-10-08T15:40:14.435562+0000","last_became_active":"2023-10-08T15:40:14.430767+0000","last_became_peered":"2023-10-08T15:40:14.430767+0000","last_unstale":"2023-10-08T15:40:14.435562+0000","last_undegraded":"2023-10-08T15:40:14.435562+0000","last_fullsized":"2023-10-08T15:40:14.435562+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:55:40.587396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.419235+0000","last_change":"2023-10-08T15:40:13.422903+0000","last_active":"2023-10-08T15:40:14.419235+0000","last_peered":"2023-10-08T15:40:14.419235+0000","last_clean":"2023-10-08T15:40:14.419235+0000","last_became_active":"2023-10-08T15:40:13.422586+0000","last_became_peered":"2023-10-08T15:40:13.422586+0000","last_unstale":"2023-10-08T15:40:14.419235+0000","last_undegraded":"2023-10-08T15:40:14.419235+0000","last_fullsized":"2023-10-08T15:40:14.419235+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:45.342530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.436094+0000","last_change":"2023-10-08T15:40:14.425577+0000","last_active":"2023-10-08T15:40:14.436094+0000","last_peered":"2023-10-08T15:40:14.436094+0000","last_clean":"2023-10-08T15:40:14.436094+0000","last_became_active":"2023-10-08T15:40:14.425279+0000","last_became_peered":"2023-10-08T15:40:14.425279+0000","last_unstale":"2023-10-08T15:40:14.436094+0000","last_undegraded":"2023-10-08T15:40:14.436094+0000","last_fullsized":"2023-10-08T15:40:14.436094+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:25:12.898608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"38'8","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.444619+0000","last_change":"2023-10-08T15:40:13.427234+0000","last_active":"2023-10-08T15:40:14.444619+0000","last_peered":"2023-10-08T15:40:14.444619+0000","last_clean":"2023-10-08T15:40:14.444619+0000","last_became_active":"2023-10-08T15:40:13.424985+0000","last_became_peered":"2023-10-08T15:40:13.424985+0000","last_unstale":"2023-10-08T15:40:14.444619+0000","last_undegraded":"2023-10-08T15:40:14.444619+0000","last_fullsized":"2023-10-08T15:40:14.444619+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:18:01.774995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.426075+0000","last_change":"2023-10-08T15:40:14.416890+0000","last_active":"2023-10-08T15:40:14.426075+0000","last_peered":"2023-10-08T15:40:14.426075+0000","last_clean":"2023-10-08T15:40:14.426075+0000","last_became_active":"2023-10-08T15:40:14.416503+0000","last_became_peered":"2023-10-08T15:40:14.416503+0000","last_unstale":"2023-10-08T15:40:14.426075+0000","last_undegraded":"2023-10-08T15:40:14.426075+0000","last_fullsized":"2023-10-08T15:40:14.426075+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:39:23.149190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"38'1","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.441331+0000","last_change":"2023-10-08T15:40:13.417048+0000","last_active":"2023-10-08T15:40:14.441331+0000","last_peered":"2023-10-08T15:40:14.441331+0000","last_clean":"2023-10-08T15:40:14.441331+0000","last_became_active":"2023-10-08T15:40:13.416724+0000","last_became_peered":"2023-10-08T15:40:13.416724+0000","last_unstale":"2023-10-08T15:40:14.441331+0000","last_undegraded":"2023-10-08T15:40:14.441331+0000","last_fullsized":"2023-10-08T15:40:14.441331+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:19:37.829086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.439342+0000","last_change":"2023-10-08T15:40:14.427679+0000","last_active":"2023-10-08T15:40:14.439342+0000","last_peered":"2023-10-08T15:40:14.439342+0000","last_clean":"2023-10-08T15:40:14.439342+0000","last_became_active":"2023-10-08T15:40:14.427339+0000","last_became_peered":"2023-10-08T15:40:14.427339+0000","last_unstale":"2023-10-08T15:40:14.439342+0000","last_undegraded":"2023-10-08T15:40:14.439342+0000","last_fullsized":"2023-10-08T15:40:14.439342+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:38:56.298194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.446296+0000","last_change":"2023-10-08T15:40:13.424903+0000","last_active":"2023-10-08T15:40:14.446296+0000","last_peered":"2023-10-08T15:40:14.446296+0000","last_clean":"2023-10-08T15:40:14.446296+0000","last_became_active":"2023-10-08T15:40:13.424525+0000","last_became_peered":"2023-10-08T15:40:13.424525+0000","last_unstale":"2023-10-08T15:40:14.446296+0000","last_undegraded":"2023-10-08T15:40:14.446296+0000","last_fullsized":"2023-10-08T15:40:14.446296+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:43:48.263381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.431554+0000","last_change":"2023-10-08T15:40:14.425248+0000","last_active":"2023-10-08T15:40:14.431554+0000","last_peered":"2023-10-08T15:40:14.431554+0000","last_clean":"2023-10-08T15:40:14.431554+0000","last_became_active":"2023-10-08T15:40:14.424900+0000","last_became_peered":"2023-10-08T15:40:14.424900+0000","last_unstale":"2023-10-08T15:40:14.431554+0000","last_undegraded":"2023-10-08T15:40:14.431554+0000","last_fullsized":"2023-10-08T15:40:14.431554+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:28:32.528544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"38'1","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.411751+0000","last_change":"2023-10-08T15:40:13.426037+0000","last_active":"2023-10-08T15:40:14.411751+0000","last_peered":"2023-10-08T15:40:14.411751+0000","last_clean":"2023-10-08T15:40:14.411751+0000","last_became_active":"2023-10-08T15:40:13.425736+0000","last_became_peered":"2023-10-08T15:40:13.425736+0000","last_unstale":"2023-10-08T15:40:14.411751+0000","last_undegraded":"2023-10-08T15:40:14.411751+0000","last_fullsized":"2023-10-08T15:40:14.411751+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:43:48.263381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.447211+0000","last_change":"2023-10-08T15:40:14.445368+0000","last_active":"2023-10-08T15:40:14.447211+0000","last_peered":"2023-10-08T15:40:14.447211+0000","last_clean":"2023-10-08T15:40:14.447211+0000","last_became_active":"2023-10-08T15:40:14.445022+0000","last_became_peered":"2023-10-08T15:40:14.445022+0000","last_unstale":"2023-10-08T15:40:14.447211+0000","last_undegraded":"2023-10-08T15:40:14.447211+0000","last_fullsized":"2023-10-08T15:40:14.447211+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:40:05.133298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.418779+0000","last_change":"2023-10-08T15:40:13.424921+0000","last_active":"2023-10-08T15:40:14.418779+0000","last_peered":"2023-10-08T15:40:14.418779+0000","last_clean":"2023-10-08T15:40:14.418779+0000","last_became_active":"2023-10-08T15:40:13.424591+0000","last_became_peered":"2023-10-08T15:40:13.424591+0000","last_unstale":"2023-10-08T15:40:14.418779+0000","last_undegraded":"2023-10-08T15:40:14.418779+0000","last_fullsized":"2023-10-08T15:40:14.418779+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:55:29.262854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.433474+0000","last_change":"2023-10-08T15:40:14.428843+0000","last_active":"2023-10-08T15:40:14.433474+0000","last_peered":"2023-10-08T15:40:14.433474+0000","last_clean":"2023-10-08T15:40:14.433474+0000","last_became_active":"2023-10-08T15:40:14.428278+0000","last_became_peered":"2023-10-08T15:40:14.428278+0000","last_unstale":"2023-10-08T15:40:14.433474+0000","last_undegraded":"2023-10-08T15:40:14.433474+0000","last_fullsized":"2023-10-08T15:40:14.433474+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:58.495250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.446715+0000","last_change":"2023-10-08T15:40:13.417299+0000","last_active":"2023-10-08T15:40:14.446715+0000","last_peered":"2023-10-08T15:40:14.446715+0000","last_clean":"2023-10-08T15:40:14.446715+0000","last_became_active":"2023-10-08T15:40:13.416982+0000","last_became_peered":"2023-10-08T15:40:13.416982+0000","last_unstale":"2023-10-08T15:40:14.446715+0000","last_undegraded":"2023-10-08T15:40:14.446715+0000","last_fullsized":"2023-10-08T15:40:14.446715+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:19:37.108661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.431264+0000","last_change":"2023-10-08T15:40:14.420668+0000","last_active":"2023-10-08T15:40:14.431264+0000","last_peered":"2023-10-08T15:40:14.431264+0000","last_clean":"2023-10-08T15:40:14.431264+0000","last_became_active":"2023-10-08T15:40:14.419844+0000","last_became_peered":"2023-10-08T15:40:14.419844+0000","last_unstale":"2023-10-08T15:40:14.431264+0000","last_undegraded":"2023-10-08T15:40:14.431264+0000","last_fullsized":"2023-10-08T15:40:14.431264+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:47:51.523520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-08T15:40:13.429061+0000","last_change":"2023-10-08T15:40:13.426040+0000","last_active":"2023-10-08T15:40:13.429061+0000","last_peered":"2023-10-08T15:40:13.429061+0000","last_clean":"2023-10-08T15:40:13.429061+0000","last_became_active":"2023-10-08T15:40:13.425705+0000","last_became_peered":"2023-10-08T15:40:13.425705+0000","last_unstale":"2023-10-08T15:40:13.429061+0000","last_undegraded":"2023-10-08T15:40:13.429061+0000","last_fullsized":"2023-10-08T15:40:13.429061+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:12:14.269569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.425551+0000","last_change":"2023-10-08T15:40:14.413855+0000","last_active":"2023-10-08T15:40:14.425551+0000","last_peered":"2023-10-08T15:40:14.425551+0000","last_clean":"2023-10-08T15:40:14.425551+0000","last_became_active":"2023-10-08T15:40:14.412210+0000","last_became_peered":"2023-10-08T15:40:14.412210+0000","last_unstale":"2023-10-08T15:40:14.425551+0000","last_undegraded":"2023-10-08T15:40:14.425551+0000","last_fullsized":"2023-10-08T15:40:14.425551+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:07:16.107860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.418168+0000","last_change":"2023-10-08T15:40:13.424876+0000","last_active":"2023-10-08T15:40:14.418168+0000","last_peered":"2023-10-08T15:40:14.418168+0000","last_clean":"2023-10-08T15:40:14.418168+0000","last_became_active":"2023-10-08T15:40:13.424570+0000","last_became_peered":"2023-10-08T15:40:13.424570+0000","last_unstale":"2023-10-08T15:40:14.418168+0000","last_undegraded":"2023-10-08T15:40:14.418168+0000","last_fullsized":"2023-10-08T15:40:14.418168+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:15:27.675296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.443967+0000","last_change":"2023-10-08T15:40:14.433524+0000","last_active":"2023-10-08T15:40:14.443967+0000","last_peered":"2023-10-08T15:40:14.443967+0000","last_clean":"2023-10-08T15:40:14.443967+0000","last_became_active":"2023-10-08T15:40:14.433222+0000","last_became_peered":"2023-10-08T15:40:14.433222+0000","last_unstale":"2023-10-08T15:40:14.443967+0000","last_undegraded":"2023-10-08T15:40:14.443967+0000","last_fullsized":"2023-10-08T15:40:14.443967+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:46:05.056695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.407800+0000","last_change":"2023-10-08T15:40:13.414016+0000","last_active":"2023-10-08T15:40:14.407800+0000","last_peered":"2023-10-08T15:40:14.407800+0000","last_clean":"2023-10-08T15:40:14.407800+0000","last_became_active":"2023-10-08T15:40:13.413732+0000","last_became_peered":"2023-10-08T15:40:13.413732+0000","last_unstale":"2023-10-08T15:40:14.407800+0000","last_undegraded":"2023-10-08T15:40:14.407800+0000","last_fullsized":"2023-10-08T15:40:14.407800+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:43:34.768625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.437192+0000","last_change":"2023-10-08T15:40:14.434622+0000","last_active":"2023-10-08T15:40:14.437192+0000","last_peered":"2023-10-08T15:40:14.437192+0000","last_clean":"2023-10-08T15:40:14.437192+0000","last_became_active":"2023-10-08T15:40:14.434234+0000","last_became_peered":"2023-10-08T15:40:14.434234+0000","last_unstale":"2023-10-08T15:40:14.437192+0000","last_undegraded":"2023-10-08T15:40:14.437192+0000","last_fullsized":"2023-10-08T15:40:14.437192+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:40:37.969828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.419085+0000","last_change":"2023-10-08T15:40:13.416965+0000","last_active":"2023-10-08T15:40:14.419085+0000","last_peered":"2023-10-08T15:40:14.419085+0000","last_clean":"2023-10-08T15:40:14.419085+0000","last_became_active":"2023-10-08T15:40:13.416634+0000","last_became_peered":"2023-10-08T15:40:13.416634+0000","last_unstale":"2023-10-08T15:40:14.419085+0000","last_undegraded":"2023-10-08T15:40:14.419085+0000","last_fullsized":"2023-10-08T15:40:14.419085+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:46:04.044725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.437994+0000","last_change":"2023-10-08T15:40:14.425484+0000","last_active":"2023-10-08T15:40:14.437994+0000","last_peered":"2023-10-08T15:40:14.437994+0000","last_clean":"2023-10-08T15:40:14.437994+0000","last_became_active":"2023-10-08T15:40:14.425082+0000","last_became_peered":"2023-10-08T15:40:14.425082+0000","last_unstale":"2023-10-08T15:40:14.437994+0000","last_undegraded":"2023-10-08T15:40:14.437994+0000","last_fullsized":"2023-10-08T15:40:14.437994+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:57:32.025855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.410463+0000","last_change":"2023-10-08T15:40:13.423625+0000","last_active":"2023-10-08T15:40:14.410463+0000","last_peered":"2023-10-08T15:40:14.410463+0000","last_clean":"2023-10-08T15:40:14.410463+0000","last_became_active":"2023-10-08T15:40:13.422315+0000","last_became_peered":"2023-10-08T15:40:13.422315+0000","last_unstale":"2023-10-08T15:40:14.410463+0000","last_undegraded":"2023-10-08T15:40:14.410463+0000","last_fullsized":"2023-10-08T15:40:14.410463+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:25:11.825747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.422351+0000","last_change":"2023-10-08T15:40:14.416301+0000","last_active":"2023-10-08T15:40:14.422351+0000","last_peered":"2023-10-08T15:40:14.422351+0000","last_clean":"2023-10-08T15:40:14.422351+0000","last_became_active":"2023-10-08T15:40:14.415966+0000","last_became_peered":"2023-10-08T15:40:14.415966+0000","last_unstale":"2023-10-08T15:40:14.422351+0000","last_undegraded":"2023-10-08T15:40:14.422351+0000","last_fullsized":"2023-10-08T15:40:14.422351+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:04:06.756439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.426957+0000","last_change":"2023-10-08T15:40:13.423017+0000","last_active":"2023-10-08T15:40:14.426957+0000","last_peered":"2023-10-08T15:40:14.426957+0000","last_clean":"2023-10-08T15:40:14.426957+0000","last_became_active":"2023-10-08T15:40:13.422248+0000","last_became_peered":"2023-10-08T15:40:13.422248+0000","last_unstale":"2023-10-08T15:40:14.426957+0000","last_undegraded":"2023-10-08T15:40:14.426957+0000","last_fullsized":"2023-10-08T15:40:14.426957+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:07:40.679262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.433492+0000","last_change":"2023-10-08T15:40:14.429509+0000","last_active":"2023-10-08T15:40:14.433492+0000","last_peered":"2023-10-08T15:40:14.433492+0000","last_clean":"2023-10-08T15:40:14.433492+0000","last_became_active":"2023-10-08T15:40:14.428968+0000","last_became_peered":"2023-10-08T15:40:14.428968+0000","last_unstale":"2023-10-08T15:40:14.433492+0000","last_undegraded":"2023-10-08T15:40:14.433492+0000","last_fullsized":"2023-10-08T15:40:14.433492+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:18:58.446270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.409367+0000","last_change":"2023-10-08T15:40:13.422628+0000","last_active":"2023-10-08T15:40:14.409367+0000","last_peered":"2023-10-08T15:40:14.409367+0000","last_clean":"2023-10-08T15:40:14.409367+0000","last_became_active":"2023-10-08T15:40:13.422297+0000","last_became_peered":"2023-10-08T15:40:13.422297+0000","last_unstale":"2023-10-08T15:40:14.409367+0000","last_undegraded":"2023-10-08T15:40:14.409367+0000","last_fullsized":"2023-10-08T15:40:14.409367+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:03.198759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.433786+0000","last_change":"2023-10-08T15:40:14.428922+0000","last_active":"2023-10-08T15:40:14.433786+0000","last_peered":"2023-10-08T15:40:14.433786+0000","last_clean":"2023-10-08T15:40:14.433786+0000","last_became_active":"2023-10-08T15:40:14.428220+0000","last_became_peered":"2023-10-08T15:40:14.428220+0000","last_unstale":"2023-10-08T15:40:14.433786+0000","last_undegraded":"2023-10-08T15:40:14.433786+0000","last_fullsized":"2023-10-08T15:40:14.433786+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:33:20.523009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.416231+0000","last_change":"2023-10-08T15:40:13.421651+0000","last_active":"2023-10-08T15:40:14.416231+0000","last_peered":"2023-10-08T15:40:14.416231+0000","last_clean":"2023-10-08T15:40:14.416231+0000","last_became_active":"2023-10-08T15:40:13.421353+0000","last_became_peered":"2023-10-08T15:40:13.421353+0000","last_unstale":"2023-10-08T15:40:14.416231+0000","last_undegraded":"2023-10-08T15:40:14.416231+0000","last_fullsized":"2023-10-08T15:40:14.416231+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:36.146964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.429164+0000","last_change":"2023-10-08T15:40:14.429164+0000","last_active":"2023-10-08T15:40:14.429164+0000","last_peered":"2023-10-08T15:40:14.429164+0000","last_clean":"2023-10-08T15:40:14.429164+0000","last_became_active":"2023-10-08T15:40:14.428857+0000","last_became_peered":"2023-10-08T15:40:14.428857+0000","last_unstale":"2023-10-08T15:40:14.429164+0000","last_undegraded":"2023-10-08T15:40:14.429164+0000","last_fullsized":"2023-10-08T15:40:14.429164+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:19:38.120631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.427151+0000","last_change":"2023-10-08T15:40:13.423501+0000","last_active":"2023-10-08T15:40:14.427151+0000","last_peered":"2023-10-08T15:40:14.427151+0000","last_clean":"2023-10-08T15:40:14.427151+0000","last_became_active":"2023-10-08T15:40:13.423112+0000","last_became_peered":"2023-10-08T15:40:13.423112+0000","last_unstale":"2023-10-08T15:40:14.427151+0000","last_undegraded":"2023-10-08T15:40:14.427151+0000","last_fullsized":"2023-10-08T15:40:14.427151+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:46:45.482090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.431724+0000","last_change":"2023-10-08T15:40:14.430127+0000","last_active":"2023-10-08T15:40:14.431724+0000","last_peered":"2023-10-08T15:40:14.431724+0000","last_clean":"2023-10-08T15:40:14.431724+0000","last_became_active":"2023-10-08T15:40:14.427661+0000","last_became_peered":"2023-10-08T15:40:14.427661+0000","last_unstale":"2023-10-08T15:40:14.431724+0000","last_undegraded":"2023-10-08T15:40:14.431724+0000","last_fullsized":"2023-10-08T15:40:14.431724+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:46.354499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.418694+0000","last_change":"2023-10-08T15:40:13.424672+0000","last_active":"2023-10-08T15:40:14.418694+0000","last_peered":"2023-10-08T15:40:14.418694+0000","last_clean":"2023-10-08T15:40:14.418694+0000","last_became_active":"2023-10-08T15:40:13.422477+0000","last_became_peered":"2023-10-08T15:40:13.422477+0000","last_unstale":"2023-10-08T15:40:14.418694+0000","last_undegraded":"2023-10-08T15:40:14.418694+0000","last_fullsized":"2023-10-08T15:40:14.418694+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:28:30.689512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.448959+0000","last_change":"2023-10-08T15:40:14.444779+0000","last_active":"2023-10-08T15:40:14.448959+0000","last_peered":"2023-10-08T15:40:14.448959+0000","last_clean":"2023-10-08T15:40:14.448959+0000","last_became_active":"2023-10-08T15:40:14.444212+0000","last_became_peered":"2023-10-08T15:40:14.444212+0000","last_unstale":"2023-10-08T15:40:14.448959+0000","last_undegraded":"2023-10-08T15:40:14.448959+0000","last_fullsized":"2023-10-08T15:40:14.448959+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:00:59.377632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"38'2","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.442217+0000","last_change":"2023-10-08T15:40:13.418998+0000","last_active":"2023-10-08T15:40:14.442217+0000","last_peered":"2023-10-08T15:40:14.442217+0000","last_clean":"2023-10-08T15:40:14.442217+0000","last_became_active":"2023-10-08T15:40:13.418647+0000","last_became_peered":"2023-10-08T15:40:13.418647+0000","last_unstale":"2023-10-08T15:40:14.442217+0000","last_undegraded":"2023-10-08T15:40:14.442217+0000","last_fullsized":"2023-10-08T15:40:14.442217+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:38:55.286225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":182,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.407928+0000","last_change":"2023-10-08T15:37:19.380955+0000","last_active":"2023-10-08T15:40:14.407928+0000","last_peered":"2023-10-08T15:40:14.407928+0000","last_clean":"2023-10-08T15:40:14.407928+0000","last_became_active":"2023-10-08T15:37:19.378277+0000","last_became_peered":"2023-10-08T15:37:19.378277+0000","last_unstale":"2023-10-08T15:40:14.407928+0000","last_undegraded":"2023-10-08T15:40:14.407928+0000","last_fullsized":"2023-10-08T15:40:14.407928+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:17.537726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:17.537726+0000","last_clean_scrub_stamp":"2023-10-08T15:37:17.537726+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:06:26.612046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66282,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542182,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305988,"kb_used_data":508,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065852,"statfs":{"total":96636764160,"available":96323432448,"internally_reserved":0,"allocated":520192,"data_stored":771145,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.94399999999999995,"15min":0.95999999999999996},"min":{"1min":0.64700000000000002,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.3460000000000001,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.93000000000000005,"15min":0.93100000000000005},"min":{"1min":0.66300000000000003,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.389,"5min":1.758,"15min":1.758},"last":0.83299999999999996}]},{"osd":1,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.90700000000000003,"15min":0.89400000000000002},"min":{"1min":0.59799999999999998,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.4299999999999999,"5min":1.474,"15min":1.474},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.96699999999999997,"15min":0.96299999999999997},"min":{"1min":0.71099999999999997,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.875}]},{"osd":2,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":1.016,"15min":1.0309999999999999},"min":{"1min":0.66000000000000003,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.268,"5min":1.623,"15min":1.623},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.0009999999999999,"15min":1.006},"min":{"1min":0.72799999999999998,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.1990000000000001,"5min":1.321,"15min":1.321},"last":1.0569999999999999}]},{"osd":3,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":0.98699999999999999,"15min":0.97399999999999998},"min":{"1min":0.82999999999999996,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.032},{"interface":"front","average":{"1min":1.222,"5min":1.2110000000000001,"15min":1.2090000000000001},"min":{"1min":1.012,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.69499999999999995}]},{"osd":4,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":1.073,"15min":1.089},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.298,"5min":1.512,"15min":1.512},"last":0.90900000000000003},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.095,"15min":1.1000000000000001},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.353,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":1.0860000000000001}]},{"osd":5,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.2509999999999999,"15min":1.272},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.573,"5min":1.74,"15min":1.74},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.163,"5min":1.236,"15min":1.248},"min":{"1min":0.88700000000000001,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.381,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":1.109}]},{"osd":6,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.2969999999999999,"15min":1.3169999999999999},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.4610000000000001,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.151,"5min":1.2410000000000001,"15min":1.256},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":1.411,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.80600000000000005}]}]},{"osd":6,"up_from":14,"seq":60129542183,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301832,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070008,"statfs":{"total":96636764160,"available":96327688192,"internally_reserved":0,"allocated":458752,"data_stored":181331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.84199999999999997,"15min":0.82399999999999995},"min":{"1min":0.70699999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.218,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.98399999999999999,"15min":0.997},"min":{"1min":0.71399999999999997,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.1890000000000001,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":0.81999999999999995}]},{"osd":1,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.94899999999999995,"15min":0.95699999999999996},"min":{"1min":0.70599999999999996,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.2729999999999999,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":1.3160000000000001},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.98599999999999999,"15min":0.98999999999999999},"min":{"1min":0.64600000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.397,"5min":1.853,"15min":1.853},"last":1.2689999999999999}]},{"osd":2,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.85699999999999998,"15min":0.84599999999999997},"min":{"1min":0.69299999999999995,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0649999999999999,"15min":1.0760000000000001},"min":{"1min":0.64700000000000002,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.4019999999999999,"5min":1.518,"15min":1.518},"last":1.5049999999999999}]},{"osd":3,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.0169999999999999,"15min":1.02},"min":{"1min":0.78300000000000003,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.3169999999999999,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.071,"15min":1.081},"min":{"1min":0.79600000000000004,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.296,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":0.997}]},{"osd":4,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":1.095,"15min":1.115},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.3360000000000001,"5min":1.484,"15min":1.484},"last":1.6899999999999999},{"interface":"front","average":{"1min":1.121,"5min":1.181,"15min":1.1910000000000001},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":1.399}]},{"osd":5,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.1160000000000001,"15min":1.125},"min":{"1min":0.753,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.329,"5min":1.581,"15min":1.581},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.294,"15min":1.3120000000000001},"min":{"1min":1.0049999999999999,"5min":0.96099999999999997,"15min":0.96099999999999997},"max":{"1min":1.417,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":1.8}]},{"osd":7,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.2709999999999999,"15min":1.2849999999999999},"min":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":1.4550000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":1.643},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.2969999999999999,"15min":1.3109999999999999},"min":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":1.5429999999999999,"5min":2.5630000000000002,"15min":2.5630000000000002},"last":1.4630000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542184,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305932,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065908,"statfs":{"total":96636764160,"available":96323489792,"internally_reserved":0,"allocated":462848,"data_stored":181297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.71199999999999997,"15min":0.71999999999999997},"min":{"1min":0.51200000000000001,"5min":0.501,"15min":0.501},"max":{"1min":0.96299999999999997,"5min":1.056,"15min":1.056},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.76800000000000002,"15min":0.76200000000000001},"min":{"1min":0.59699999999999998,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.66700000000000004}]},{"osd":1,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.72099999999999997,"15min":0.71299999999999997},"min":{"1min":0.56899999999999995,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.82399999999999995,"15min":0.81200000000000006},"min":{"1min":0.67000000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1870000000000001,"5min":1.256,"15min":1.256},"last":1.353}]},{"osd":2,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.85999999999999999,"15min":0.85399999999999998},"min":{"1min":0.66900000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.337,"5min":1.361,"15min":1.361},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.92200000000000004,"15min":0.92600000000000005},"min":{"1min":0.751,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.228,"5min":1.423,"15min":1.423},"last":0.75}]},{"osd":4,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.0820000000000001,"15min":1.0680000000000001},"min":{"1min":0.90000000000000002,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.3879999999999999,"5min":1.504,"15min":1.504},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.145,"15min":1.155},"min":{"1min":0.85599999999999998,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.4410000000000001,"5min":2.762,"15min":2.762},"last":0.98199999999999998}]},{"osd":5,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.1679999999999999,"15min":1.1619999999999999},"min":{"1min":0.92800000000000005,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.466,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.02},{"interface":"front","average":{"1min":1.22,"5min":1.2330000000000001,"15min":1.2350000000000001},"min":{"1min":0.95899999999999996,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.474,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":0.91800000000000004}]},{"osd":6,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.2889999999999999,"15min":1.304},"min":{"1min":0.97199999999999998,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.569,"5min":2.6890000000000001,"15min":2.6890000000000001},"last":1.248},{"interface":"front","average":{"1min":1.238,"5min":1.2250000000000001,"15min":1.2230000000000001},"min":{"1min":0.89100000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":1.462,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":1.286}]},{"osd":7,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.2649999999999999,"15min":1.2589999999999999},"min":{"1min":0.97699999999999998,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":1.528,"5min":1.738,"15min":1.738},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.3520000000000001,"15min":1.3620000000000001},"min":{"1min":1.1080000000000001,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.623,"5min":2.5840000000000001,"15min":2.5840000000000001},"last":1.3300000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542183,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301840,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070000,"statfs":{"total":96636764160,"available":96327680000,"internally_reserved":0,"allocated":466944,"data_stored":182245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.626,"15min":0.621},"min":{"1min":0.48799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.67200000000000004,"15min":0.64900000000000002},"min":{"1min":0.52800000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.61599999999999999}]},{"osd":1,"last update":"Sun Oct 8 15:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.69099999999999995,"15min":0.67700000000000005},"min":{"1min":0.59399999999999997,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.71599999999999997,"15min":0.69199999999999995},"min":{"1min":0.55400000000000005,"5min":0.307,"15min":0.307},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.69399999999999995}]},{"osd":3,"last update":"Sun Oct 8 15:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.66600000000000004,"15min":0.64200000000000002},"min":{"1min":0.52300000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.85299999999999998,"15min":0.84299999999999997},"min":{"1min":0.72299999999999998,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.127,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.65100000000000002}]},{"osd":4,"last update":"Sun Oct 8 15:39:23 2023","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.004,"15min":1},"min":{"1min":0.75600000000000001,"5min":0.748,"15min":0.748},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.028,"5min":1.0329999999999999,"15min":1.034},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.4319999999999999,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.133}]},{"osd":5,"last update":"Sun Oct 8 15:39:23 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.0589999999999999,"15min":1.0569999999999999},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":1.161},{"interface":"front","average":{"1min":1.091,"5min":1.0640000000000001,"15min":1.0600000000000001},"min":{"1min":0.81000000000000005,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.288,"5min":1.452,"15min":1.452},"last":1.2569999999999999}]},{"osd":6,"last update":"Sun Oct 8 15:39:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.0940000000000001,"15min":1.091},"min":{"1min":0.82699999999999996,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.4159999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":1.218},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.117,"15min":1.105},"min":{"1min":0.85499999999999998,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":1.0680000000000001}]},{"osd":7,"last update":"Sun Oct 8 15:39:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.159,"15min":1.1499999999999999},"min":{"1min":0.84899999999999998,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":1.288},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.1739999999999999,"15min":1.161},"min":{"1min":0.86299999999999999,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.579,"5min":1.804,"15min":1.804},"last":1.24}]}]},{"osd":1,"up_from":14,"seq":60129542184,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305924,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065916,"statfs":{"total":96636764160,"available":96323497984,"internally_reserved":0,"allocated":454656,"data_stored":180757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.76500000000000001,"15min":0.77500000000000002},"min":{"1min":0.46700000000000003,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.165,"5min":1.734,"15min":1.734},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.96299999999999997,"15min":1},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0509999999999999,"5min":5.7960000000000003,"15min":5.7960000000000003},"last":0.55900000000000005}]},{"osd":2,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.83299999999999996,"15min":0.84699999999999998},"min":{"1min":0.56200000000000006,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.048,"5min":4.0119999999999996,"15min":4.0119999999999996},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.90600000000000003,"15min":0.91000000000000003},"min":{"1min":0.61599999999999999,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.0840000000000001,"5min":1.853,"15min":1.853},"last":0.69699999999999995}]},{"osd":3,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":1.7569999999999999,"5min":1.121,"15min":1.0149999999999999},"min":{"1min":0.73399999999999999,"5min":0.435,"15min":0.435},"max":{"1min":13.388,"5min":13.388,"15min":13.388},"last":1.002},{"interface":"front","average":{"1min":1.6899999999999999,"5min":1.2549999999999999,"15min":1.1830000000000001},"min":{"1min":0.66100000000000003,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":13.353,"5min":13.353,"15min":13.353},"last":0.92000000000000004}]},{"osd":4,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":1.2070000000000001,"15min":1.246},"min":{"1min":0.77800000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.246,"5min":5.859,"15min":5.859},"last":0.81699999999999995},{"interface":"front","average":{"1min":1.022,"5min":1.1479999999999999,"15min":1.169},"min":{"1min":0.82199999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.4550000000000001,"5min":4.2679999999999998,"15min":4.2679999999999998},"last":0.95699999999999996}]},{"osd":5,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.143,"15min":1.151},"min":{"1min":0.85799999999999998,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.5389999999999999,"5min":4.3380000000000001,"15min":4.3380000000000001},"last":1.123},{"interface":"front","average":{"1min":1.216,"5min":1.1890000000000001,"15min":1.1850000000000001},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.589,"5min":2.085,"15min":2.085},"last":0.73699999999999999}]},{"osd":6,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.359,"15min":1.3919999999999999},"min":{"1min":0.93600000000000005,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.4119999999999999,"5min":5.8979999999999997,"15min":5.8979999999999997},"last":1.323},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.274,"15min":1.284},"min":{"1min":1.0249999999999999,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.4390000000000001,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":1.401}]},{"osd":7,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.2549999999999999,"15min":1.2509999999999999},"min":{"1min":0.93400000000000005,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.679,"5min":2.3940000000000001,"15min":2.3940000000000001},"last":1.266},{"interface":"front","average":{"1min":1.222,"5min":1.46,"15min":1.5},"min":{"1min":1.0209999999999999,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.387,"5min":5.9299999999999997,"15min":5.9299999999999997},"last":1.2190000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542184,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301892,"kb_used_data":508,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069948,"statfs":{"total":96636764160,"available":96327626752,"internally_reserved":0,"allocated":520192,"data_stored":771089,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 15:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.81899999999999995,"15min":0.84199999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.3799999999999999,"5min":1.514,"15min":1.514},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.79200000000000004,"15min":0.79800000000000004},"min":{"1min":0.50600000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.999,"5min":1.518,"15min":1.518},"last":0.55900000000000005}]},{"osd":2,"last update":"Sun Oct 8 15:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.84499999999999997,"15min":0.86399999999999999},"min":{"1min":0.55400000000000005,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1539999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.79600000000000004,"15min":0.78900000000000003},"min":{"1min":0.61599999999999999,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.0800000000000001,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.44}]},{"osd":3,"last update":"Sun Oct 8 15:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.75600000000000001,"15min":0.76000000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.091,"5min":1.103,"15min":1.103},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.98499999999999999,"15min":0.995},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.474,"5min":2.3290000000000002,"15min":2.3290000000000002},"last":0.85299999999999998}]},{"osd":4,"last update":"Sun Oct 8 15:39:20 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.085,"15min":1.095},"min":{"1min":0.76000000000000001,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.49,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.093,"15min":1.0980000000000001},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.538,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":1.0880000000000001}]},{"osd":5,"last update":"Sun Oct 8 15:39:20 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0900000000000001,"15min":1.101},"min":{"1min":0.72099999999999997,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.413,"5min":2.214,"15min":2.214},"last":1.222},{"interface":"front","average":{"1min":1.151,"5min":1.323,"15min":1.3520000000000001},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.5269999999999999,"5min":3.4569999999999999,"15min":3.4569999999999999},"last":1.1359999999999999}]},{"osd":6,"last update":"Sun Oct 8 15:39:20 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.29,"15min":1.3080000000000001},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":1.575,"5min":2.532,"15min":2.532},"last":1.044},{"interface":"front","average":{"1min":1.216,"5min":1.244,"15min":1.2490000000000001},"min":{"1min":0.92700000000000005,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.6200000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.99099999999999999}]},{"osd":7,"last update":"Sun Oct 8 15:39:20 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.292,"15min":1.3},"min":{"1min":1.01,"5min":0.98199999999999998,"15min":0.98199999999999998},"max":{"1min":1.571,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.2310000000000001,"15min":1.2350000000000001},"min":{"1min":0.85199999999999998,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.597,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":1.167}]}]},{"osd":5,"up_from":13,"seq":55834574887,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301816,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070024,"statfs":{"total":96636764160,"available":96327704576,"internally_reserved":0,"allocated":442368,"data_stored":174469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.85599999999999998,"15min":0.84799999999999998},"min":{"1min":0.53600000000000003,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.90700000000000003,"15min":0.91000000000000003},"min":{"1min":0.67400000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.147,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.81399999999999995}]},{"osd":1,"last update":"Sun Oct 8 15:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.92000000000000004,"15min":0.91100000000000003},"min":{"1min":0.628,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.88,"5min":0.97599999999999998,"15min":0.99199999999999999},"min":{"1min":0.68500000000000005,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1799999999999999,"5min":1.754,"15min":1.754},"last":0.56999999999999995}]},{"osd":2,"last update":"Sun Oct 8 15:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.306,"5min":1.869,"15min":1.869},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.97499999999999998,"5min":1.0109999999999999,"15min":1.0169999999999999},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.484,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.86199999999999999}]},{"osd":3,"last update":"Sun Oct 8 15:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.997,"15min":1.0009999999999999},"min":{"1min":0.78300000000000003,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.2110000000000001,"5min":1.929,"15min":1.929},"last":0.92500000000000004},{"interface":"front","average":{"1min":1.022,"5min":1.101,"15min":1.1140000000000001},"min":{"1min":0.745,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.3140000000000001,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":1.169}]},{"osd":4,"last update":"Sun Oct 8 15:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.0109999999999999,"15min":1.014},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.464,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":1.266},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.085,"15min":1.085},"min":{"1min":0.67600000000000005,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.601,"5min":1.823,"15min":1.823},"last":1.073}]},{"osd":6,"last update":"Sun Oct 8 15:39:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.202,"15min":1.2070000000000001},"min":{"1min":0.95899999999999996,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.429,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":1.319},{"interface":"front","average":{"1min":1.165,"5min":1.2290000000000001,"15min":1.24},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.6739999999999999,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.214}]},{"osd":7,"last update":"Sun Oct 8 15:39:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.155,"15min":1.167},"min":{"1min":0.89800000000000002,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.272,"5min":2.177,"15min":2.177},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.2190000000000001,"15min":1.2210000000000001},"min":{"1min":1.0089999999999999,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.575,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.3720000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574887,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301836,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070004,"statfs":{"total":96636764160,"available":96327684096,"internally_reserved":0,"allocated":462848,"data_stored":182223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.82199999999999995,"15min":0.81000000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.79000000000000004,"15min":0.78700000000000003},"min":{"1min":0.59199999999999997,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":1.0429999999999999}]},{"osd":1,"last update":"Sun Oct 8 15:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.84499999999999997,"15min":0.83199999999999996},"min":{"1min":0.66200000000000003,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83099999999999996,"15min":0.82999999999999996},"min":{"1min":0.68799999999999994,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.149,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":1.383}]},{"osd":2,"last update":"Sun Oct 8 15:39:20 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.048,"15min":1.034},"min":{"1min":0.80100000000000005,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.3380000000000001,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":1.2969999999999999},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.012,"15min":1.0189999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.268,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":1.123}]},{"osd":3,"last update":"Sun Oct 8 15:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":1.0129999999999999,"15min":1.0189999999999999},"min":{"1min":0.72599999999999998,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.3169999999999999,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.036,"15min":1.0329999999999999},"min":{"1min":0.77400000000000002,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":1.1499999999999999}]},{"osd":5,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":0.98599999999999999,"15min":0.97099999999999997},"min":{"1min":0.79500000000000004,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0649999999999999,"15min":1.0609999999999999},"min":{"1min":0.67800000000000005,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.83799999999999997}]},{"osd":6,"last update":"Sun Oct 8 15:39:20 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.139,"15min":1.147},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.319,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.204},{"interface":"front","average":{"1min":1.179,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.91400000000000003,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.4159999999999999,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":1.1819999999999999}]},{"osd":7,"last update":"Sun Oct 8 15:39:20 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.0740000000000001,"15min":1.0680000000000001},"min":{"1min":0.755,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.196,"15min":1.1910000000000001},"min":{"1min":0.96699999999999997,"5min":0.625,"15min":0.625},"max":{"1min":1.587,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.077}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T15:40:18.844 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-08T15:40:18.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.943+0000 7f551512d700 1 Processor -- start 2023-10-08T15:40:18.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.943+0000 7f551512d700 1 -- start start 2023-10-08T15:40:18.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.943+0000 7f551512d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f55100bab50 0x7f55100baf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:18.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.943+0000 7f551512d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f551006df30 0x7f5510149970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:18.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.943+0000 7f551512d700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55100b4050 con 0x7f5510149eb0 2023-10-08T15:40:18.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.943+0000 7f551512d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5510146da0 con 0x7f551006df30 2023-10-08T15:40:18.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.943+0000 7f551512d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f551014a330 con 0x7f55100bab50 2023-10-08T15:40:18.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.943+0000 7f551492c700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f5510149eb0 0x7f551014c9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:49612/0 (socket says 172.21.15.3:49612) 2023-10-08T15:40:18.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.943+0000 7f551492c700 1 -- 172.21.15.3:0/66650780 learned_addr learned my addr 172.21.15.3:0/66650780 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:40:18.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.947+0000 7f550ffff700 1 --2- 172.21.15.3:0/66650780 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f55100bab50 0x7f55100baf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:18.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.947+0000 7f550f7fe700 1 --2- 172.21.15.3:0/66650780 >> v2:172.21.15.50:3300/0 conn(0x7f551006df30 0x7f5510149970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:18.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.947+0000 7f550effd700 1 -- 172.21.15.3:0/66650780 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3707779043 0 0) 0x7f55100b4050 con 0x7f5510149eb0 2023-10-08T15:40:18.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.947+0000 7f550effd700 1 -- 172.21.15.3:0/66650780 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54f8003570 con 0x7f5510149eb0 2023-10-08T15:40:18.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.947+0000 7f550ffff700 1 -- 172.21.15.3:0/66650780 >> v2:172.21.15.50:3300/0 conn(0x7f551006df30 msgr2=0x7f5510149970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:18.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.947+0000 7f550ffff700 1 --2- 172.21.15.3:0/66650780 >> v2:172.21.15.50:3300/0 conn(0x7f551006df30 0x7f5510149970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:18.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.947+0000 7f550ffff700 1 -- 172.21.15.3:0/66650780 >> v1:172.21.15.3:6789/0 conn(0x7f5510149eb0 legacy=0x7f551014c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:18.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.947+0000 7f550ffff700 1 -- 172.21.15.3:0/66650780 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55100b4330 con 0x7f55100bab50 2023-10-08T15:40:18.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.947+0000 7f550f7fe700 1 --2- 172.21.15.3:0/66650780 >> v2:172.21.15.50:3300/0 conn(0x7f551006df30 0x7f5510149970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:40:18.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.947+0000 7f550ffff700 1 --2- 172.21.15.3:0/66650780 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f55100bab50 0x7f55100baf20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5508009e60 tx=0x7f5508009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9676b43cbc8db684 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:18.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.947+0000 7f550effd700 1 -- 172.21.15.3:0/66650780 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550800e070 con 0x7f55100bab50 2023-10-08T15:40:18.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.947+0000 7f550effd700 1 -- 172.21.15.3:0/66650780 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f550800bab0 con 0x7f55100bab50 2023-10-08T15:40:18.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.947+0000 7f550effd700 1 -- 172.21.15.3:0/66650780 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550800be70 con 0x7f55100bab50 2023-10-08T15:40:18.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.947+0000 7f551512d700 1 -- 172.21.15.3:0/66650780 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f55100bab50 msgr2=0x7f55100baf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:18.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.947+0000 7f551512d700 1 --2- 172.21.15.3:0/66650780 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f55100bab50 0x7f55100baf20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5508009e60 tx=0x7f5508009780 comp rx=0 tx=0).stop 2023-10-08T15:40:18.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.947+0000 7f551512d700 1 -- 172.21.15.3:0/66650780 shutdown_connections 2023-10-08T15:40:18.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.947+0000 7f551512d700 1 --2- 172.21.15.3:0/66650780 >> v2:172.21.15.50:3300/0 conn(0x7f551006df30 0x7f5510149970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:18.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.947+0000 7f551512d700 1 --2- 172.21.15.3:0/66650780 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f55100bab50 0x7f55100baf20 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:18.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.947+0000 7f551512d700 1 -- 172.21.15.3:0/66650780 >> 172.21.15.3:0/66650780 conn(0x7f55100be4a0 msgr2=0x7f55100ba440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:18.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.947+0000 7f551512d700 1 -- 172.21.15.3:0/66650780 shutdown_connections 2023-10-08T15:40:18.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.947+0000 7f551512d700 1 -- 172.21.15.3:0/66650780 wait complete. 2023-10-08T15:40:18.959 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.947+0000 7f551512d700 1 Processor -- start 2023-10-08T15:40:18.959 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.947+0000 7f551512d700 1 -- start start 2023-10-08T15:40:18.960 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.947+0000 7f551512d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f551006df30 0x7f551014ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:18.960 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.947+0000 7f551512d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5510149eb0 0x7f55101596c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:18.960 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.947+0000 7f551512d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5510158f20 0x7f5510159c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:18.960 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.947+0000 7f551512d700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55100b4710 con 0x7f5510149eb0 2023-10-08T15:40:18.960 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.947+0000 7f551512d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55101459c0 con 0x7f551006df30 2023-10-08T15:40:18.960 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.947+0000 7f551512d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f551015a140 con 0x7f5510158f20 2023-10-08T15:40:18.960 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.951+0000 7f550f7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5510149eb0 0x7f55101596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:18.960 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.951+0000 7f550f7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5510149eb0 0x7f55101596c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52680/0 (socket says 172.21.15.3:52680) 2023-10-08T15:40:18.961 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.951+0000 7f550f7fe700 1 -- 172.21.15.3:0/2783143926 learned_addr learned my addr 172.21.15.3:0/2783143926 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:18.961 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.951+0000 7f551492c700 1 --2- 172.21.15.3:0/2783143926 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5510158f20 0x7f5510159c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:18.961 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.951+0000 7f550ffff700 1 --2- 172.21.15.3:0/2783143926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f551006df30 0x7f551014ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:18.961 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.951+0000 7f550f7fe700 1 -- 172.21.15.3:0/2783143926 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5510158f20 msgr2=0x7f5510159c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:18.961 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.951+0000 7f550f7fe700 1 --2- 172.21.15.3:0/2783143926 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5510158f20 0x7f5510159c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:18.961 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.951+0000 7f550f7fe700 1 -- 172.21.15.3:0/2783143926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f551006df30 msgr2=0x7f551014ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:18.961 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.951+0000 7f550f7fe700 1 --2- 172.21.15.3:0/2783143926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f551006df30 0x7f551014ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:18.961 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.951+0000 7f550f7fe700 1 -- 172.21.15.3:0/2783143926 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5504009420 con 0x7f5510149eb0 2023-10-08T15:40:18.961 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.951+0000 7f550ffff700 1 --2- 172.21.15.3:0/2783143926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f551006df30 0x7f551014ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:40:18.961 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.951+0000 7f550f7fe700 1 --2- 172.21.15.3:0/2783143926 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5510149eb0 0x7f55101596c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f550400ec80 tx=0x7f55040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:18.961 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.951+0000 7f54f7fff700 1 -- 172.21.15.3:0/2783143926 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550400c9d0 con 0x7f5510149eb0 2023-10-08T15:40:18.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.951+0000 7f551512d700 1 -- 172.21.15.3:0/2783143926 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5508009a20 con 0x7f5510149eb0 2023-10-08T15:40:18.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.951+0000 7f54f7fff700 1 -- 172.21.15.3:0/2783143926 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f550400cb30 con 0x7f5510149eb0 2023-10-08T15:40:18.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.951+0000 7f54f7fff700 1 -- 172.21.15.3:0/2783143926 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550400ceb0 con 0x7f5510149eb0 2023-10-08T15:40:18.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.951+0000 7f551512d700 1 -- 172.21.15.3:0/2783143926 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f551015c500 con 0x7f5510149eb0 2023-10-08T15:40:18.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.951+0000 7f551512d700 1 -- 172.21.15.3:0/2783143926 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55100b8480 con 0x7f5510149eb0 2023-10-08T15:40:18.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.951+0000 7f54f7fff700 1 -- 172.21.15.3:0/2783143926 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5504013680 con 0x7f5510149eb0 2023-10-08T15:40:18.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.955+0000 7f54f7fff700 1 --2- 172.21.15.3:0/2783143926 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f54fc060580 0x7f54fc062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:18.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.955+0000 7f54f7fff700 1 -- 172.21.15.3:0/2783143926 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f550407cf40 con 0x7f5510149eb0 2023-10-08T15:40:18.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.955+0000 7f550ffff700 1 --2- 172.21.15.3:0/2783143926 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f54fc060580 0x7f54fc062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:18.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.955+0000 7f550ffff700 1 --2- 172.21.15.3:0/2783143926 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f54fc060580 0x7f54fc062a30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f551006a490 tx=0x7f5508019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:18.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:18.959+0000 7f54f7fff700 1 -- 172.21.15.3:0/2783143926 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f55100b8480 con 0x7f5510149eb0 2023-10-08T15:40:19.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.179+0000 7f551512d700 1 -- 172.21.15.3:0/2783143926 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f55100b8480 con 0x7f5510149eb0 2023-10-08T15:40:19.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.179+0000 7f54f7fff700 1 -- 172.21.15.3:0/2783143926 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1015 (secure 0 0 0) 0x7f5504017410 con 0x7f5510149eb0 2023-10-08T15:40:19.183 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:40:19.183 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"7635972e-cd66-4a8f-a231-378db8b3847a","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":190,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":39,"num_osds":8,"num_up_osds":8,"osd_up_since":1696779437,"num_in_osds":8,"osd_in_since":1696779430,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592674,"bytes_used":2485309440,"bytes_avail":770608803840,"bytes_total":773094113280,"write_bytes_sec":2218,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":19,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"a","status":"up:active","gid":5337}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-10-08T15:39:16.555736+0000","services":{}},"progress_events":{}} 2023-10-08T15:40:19.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.183+0000 7f551512d700 1 -- 172.21.15.3:0/2783143926 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f54fc060580 msgr2=0x7f54fc062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:19.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.183+0000 7f551512d700 1 --2- 172.21.15.3:0/2783143926 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f54fc060580 0x7f54fc062a30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f551006a490 tx=0x7f5508019000 comp rx=0 tx=0).stop 2023-10-08T15:40:19.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.183+0000 7f551512d700 1 -- 172.21.15.3:0/2783143926 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5510149eb0 msgr2=0x7f55101596c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:19.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.183+0000 7f551512d700 1 --2- 172.21.15.3:0/2783143926 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5510149eb0 0x7f55101596c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f550400ec80 tx=0x7f55040091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:19.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.183+0000 7f551512d700 1 -- 172.21.15.3:0/2783143926 shutdown_connections 2023-10-08T15:40:19.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.183+0000 7f551512d700 1 --2- 172.21.15.3:0/2783143926 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f54fc060580 0x7f54fc062a30 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:19.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.183+0000 7f551512d700 1 --2- 172.21.15.3:0/2783143926 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5510158f20 0x7f5510159c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:19.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.183+0000 7f551512d700 1 --2- 172.21.15.3:0/2783143926 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5510149eb0 0x7f55101596c0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:19.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.183+0000 7f551512d700 1 --2- 172.21.15.3:0/2783143926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f551006df30 0x7f551014ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:19.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.183+0000 7f551512d700 1 -- 172.21.15.3:0/2783143926 >> 172.21.15.3:0/2783143926 conn(0x7f55100be4a0 msgr2=0x7f5510067f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:19.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.183+0000 7f551512d700 1 -- 172.21.15.3:0/2783143926 shutdown_connections 2023-10-08T15:40:19.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.183+0000 7f551512d700 1 -- 172.21.15.3:0/2783143926 wait complete. 2023-10-08T15:40:19.199 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-08T15:40:19.199 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T15:40:19.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.351+0000 7f26328ca700 1 Processor -- start 2023-10-08T15:40:19.726 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.351+0000 7f26328ca700 1 -- start start 2023-10-08T15:40:19.726 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.351+0000 7f26328ca700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f262c0bca80 0x7f262c0b2340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:19.726 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.351+0000 7f26328ca700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f262c0bce50 0x7f262c0b2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:19.726 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.351+0000 7f26328ca700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f262c14bde0 con 0x7f262c06cf60 2023-10-08T15:40:19.727 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.351+0000 7f26328ca700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f262c14b920 con 0x7f262c0bca80 2023-10-08T15:40:19.727 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.351+0000 7f26328ca700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f262c0b2dc0 con 0x7f262c0bce50 2023-10-08T15:40:19.727 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.351+0000 7f26310c7700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f262c0bce50 0x7f262c0b2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:19.727 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.351+0000 7f26318c8700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f262c0bca80 0x7f262c0b2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:19.727 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.351+0000 7f26320c9700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f262c06cf60 0x7f262c0bab50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.3:46288/0 (socket says 172.21.15.3:46288) 2023-10-08T15:40:19.728 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.355+0000 7f26320c9700 1 -- 172.21.15.3:0/556504915 learned_addr learned my addr 172.21.15.3:0/556504915 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:40:19.728 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.355+0000 7f26308c6700 1 -- 172.21.15.3:0/556504915 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4177468438 0 0) 0x7f262c14bde0 con 0x7f262c06cf60 2023-10-08T15:40:19.728 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.355+0000 7f26308c6700 1 -- 172.21.15.3:0/556504915 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2618003570 con 0x7f262c06cf60 2023-10-08T15:40:19.728 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.355+0000 7f26310c7700 1 -- 172.21.15.3:0/556504915 >> v2:172.21.15.50:3300/0 conn(0x7f262c0bca80 msgr2=0x7f262c0b2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:19.728 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.355+0000 7f26310c7700 1 --2- 172.21.15.3:0/556504915 >> v2:172.21.15.50:3300/0 conn(0x7f262c0bca80 0x7f262c0b2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:19.728 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.355+0000 7f26310c7700 1 -- 172.21.15.3:0/556504915 >> v1:172.21.15.50:6789/0 conn(0x7f262c06cf60 legacy=0x7f262c0bab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:19.729 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.355+0000 7f26310c7700 1 -- 172.21.15.3:0/556504915 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f262c06d6f0 con 0x7f262c0bce50 2023-10-08T15:40:19.729 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.355+0000 7f26318c8700 1 --2- 172.21.15.3:0/556504915 >> v2:172.21.15.50:3300/0 conn(0x7f262c0bca80 0x7f262c0b2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:40:19.729 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.355+0000 7f26310c7700 1 --2- 172.21.15.3:0/556504915 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f262c0bce50 0x7f262c0b2880 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f261c0098e0 tx=0x7f261c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34095dcbd5b539a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:19.729 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.355+0000 7f26308c6700 1 -- 172.21.15.3:0/556504915 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261c011630 con 0x7f262c0bce50 2023-10-08T15:40:19.729 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.355+0000 7f26308c6700 1 -- 172.21.15.3:0/556504915 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f261c011790 con 0x7f262c0bce50 2023-10-08T15:40:19.730 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.355+0000 7f26308c6700 1 -- 172.21.15.3:0/556504915 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261c011b30 con 0x7f262c0bce50 2023-10-08T15:40:19.730 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.355+0000 7f26328ca700 1 -- 172.21.15.3:0/556504915 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f262c0bce50 msgr2=0x7f262c0b2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:19.730 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.355+0000 7f26328ca700 1 --2- 172.21.15.3:0/556504915 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f262c0bce50 0x7f262c0b2880 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f261c0098e0 tx=0x7f261c0091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:19.730 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.355+0000 7f26328ca700 1 -- 172.21.15.3:0/556504915 shutdown_connections 2023-10-08T15:40:19.730 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.355+0000 7f26328ca700 1 --2- 172.21.15.3:0/556504915 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f262c0bce50 0x7f262c0b2880 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:19.731 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.355+0000 7f26328ca700 1 --2- 172.21.15.3:0/556504915 >> v2:172.21.15.50:3300/0 conn(0x7f262c0bca80 0x7f262c0b2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:19.731 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.355+0000 7f26328ca700 1 -- 172.21.15.3:0/556504915 >> 172.21.15.3:0/556504915 conn(0x7f262c0be4a0 msgr2=0x7f262c0ba440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:19.731 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.355+0000 7f26328ca700 1 -- 172.21.15.3:0/556504915 shutdown_connections 2023-10-08T15:40:19.731 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.355+0000 7f26328ca700 1 -- 172.21.15.3:0/556504915 wait complete. 2023-10-08T15:40:19.736 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.359+0000 7f26328ca700 1 Processor -- start 2023-10-08T15:40:19.797 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.359+0000 7f26328ca700 1 -- start start 2023-10-08T15:40:19.798 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.359+0000 7f26328ca700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f262c06cf60 0x7f262c1505d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:19.798 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.359+0000 7f26328ca700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f262c0bca80 0x7f262c140bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:19.798 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.359+0000 7f26328ca700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f262c0bce50 0x7f262c141100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:19.798 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.359+0000 7f26328ca700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f262c149f80 con 0x7f262c0bca80 2023-10-08T15:40:19.798 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.359+0000 7f26328ca700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f262c14a220 con 0x7f262c06cf60 2023-10-08T15:40:19.798 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.359+0000 7f26328ca700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f262c14a6b0 con 0x7f262c0bce50 2023-10-08T15:40:19.798 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.359+0000 7f26310c7700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f262c0bca80 0x7f262c140bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:19.798 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.359+0000 7f26310c7700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f262c0bca80 0x7f262c140bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52696/0 (socket says 172.21.15.3:52696) 2023-10-08T15:40:19.798 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.359+0000 7f26310c7700 1 -- 172.21.15.3:0/2245497722 learned_addr learned my addr 172.21.15.3:0/2245497722 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:19.798 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.359+0000 7f26318c8700 1 --2- 172.21.15.3:0/2245497722 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f262c06cf60 0x7f262c1505d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:19.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.359+0000 7f26320c9700 1 --2- 172.21.15.3:0/2245497722 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f262c0bce50 0x7f262c141100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:19.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.359+0000 7f26310c7700 1 -- 172.21.15.3:0/2245497722 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f262c0bce50 msgr2=0x7f262c141100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:19.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.359+0000 7f26310c7700 1 --2- 172.21.15.3:0/2245497722 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f262c0bce50 0x7f262c141100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:19.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.359+0000 7f26310c7700 1 -- 172.21.15.3:0/2245497722 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f262c06cf60 msgr2=0x7f262c1505d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:19.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.359+0000 7f26310c7700 1 --2- 172.21.15.3:0/2245497722 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f262c06cf60 0x7f262c1505d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:19.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.359+0000 7f26310c7700 1 -- 172.21.15.3:0/2245497722 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2628009420 con 0x7f262c0bca80 2023-10-08T15:40:19.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.359+0000 7f26320c9700 1 --2- 172.21.15.3:0/2245497722 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f262c0bce50 0x7f262c141100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:40:19.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.359+0000 7f26310c7700 1 --2- 172.21.15.3:0/2245497722 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f262c0bca80 0x7f262c140bc0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f261c009ed0 tx=0x7f261c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:19.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.359+0000 7f2621ffb700 1 -- 172.21.15.3:0/2245497722 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261c000cc0 con 0x7f262c0bca80 2023-10-08T15:40:19.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.359+0000 7f2621ffb700 1 -- 172.21.15.3:0/2245497722 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f261c011900 con 0x7f262c0bca80 2023-10-08T15:40:19.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.359+0000 7f26328ca700 1 -- 172.21.15.3:0/2245497722 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f261c009420 con 0x7f262c0bca80 2023-10-08T15:40:19.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.359+0000 7f2621ffb700 1 -- 172.21.15.3:0/2245497722 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261c025420 con 0x7f262c0bca80 2023-10-08T15:40:19.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.359+0000 7f26328ca700 1 -- 172.21.15.3:0/2245497722 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f262c149bb0 con 0x7f262c0bca80 2023-10-08T15:40:19.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.363+0000 7f26328ca700 1 -- 172.21.15.3:0/2245497722 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f262c05ecf0 con 0x7f262c0bca80 2023-10-08T15:40:19.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.363+0000 7f2621ffb700 1 -- 172.21.15.3:0/2245497722 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f261c023070 con 0x7f262c0bca80 2023-10-08T15:40:19.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.363+0000 7f2621ffb700 1 --2- 172.21.15.3:0/2245497722 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f26100605d0 0x7f2610062a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:19.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.363+0000 7f2621ffb700 1 -- 172.21.15.3:0/2245497722 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f261c07dca0 con 0x7f262c0bca80 2023-10-08T15:40:19.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.363+0000 7f26318c8700 1 --2- 172.21.15.3:0/2245497722 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f26100605d0 0x7f2610062a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:19.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.367+0000 7f26318c8700 1 --2- 172.21.15.3:0/2245497722 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f26100605d0 0x7f2610062a80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2628009f40 tx=0x7f26280091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:19.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.371+0000 7f2621ffb700 1 -- 172.21.15.3:0/2245497722 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f261c04e1f0 con 0x7f262c0bca80 2023-10-08T15:40:19.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.531+0000 7f26328ca700 1 -- 172.21.15.3:0/2245497722 --> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f262c06d8d0 con 0x7f26100605d0 2023-10-08T15:40:19.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.551+0000 7f2621ffb700 1 -- 172.21.15.3:0/2245497722 <== mgr.4102 v2:172.21.15.50:6832/33268 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287269 (secure 0 0 0) 0x7f262c06d8d0 con 0x7f26100605d0 2023-10-08T15:40:19.809 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:40:19.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.555+0000 7f26328ca700 1 -- 172.21.15.3:0/2245497722 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f26100605d0 msgr2=0x7f2610062a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:19.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.555+0000 7f26328ca700 1 --2- 172.21.15.3:0/2245497722 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f26100605d0 0x7f2610062a80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2628009f40 tx=0x7f26280091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:19.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.555+0000 7f26328ca700 1 -- 172.21.15.3:0/2245497722 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f262c0bca80 msgr2=0x7f262c140bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:19.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.555+0000 7f26328ca700 1 --2- 172.21.15.3:0/2245497722 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f262c0bca80 0x7f262c140bc0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f261c009ed0 tx=0x7f261c017000 comp rx=0 tx=0).stop 2023-10-08T15:40:19.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.555+0000 7f26328ca700 1 -- 172.21.15.3:0/2245497722 shutdown_connections 2023-10-08T15:40:19.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.555+0000 7f26328ca700 1 --2- 172.21.15.3:0/2245497722 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f26100605d0 0x7f2610062a80 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:19.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.555+0000 7f26328ca700 1 --2- 172.21.15.3:0/2245497722 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f262c0bce50 0x7f262c141100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:19.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.555+0000 7f26328ca700 1 --2- 172.21.15.3:0/2245497722 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f262c0bca80 0x7f262c140bc0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:19.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.555+0000 7f26328ca700 1 --2- 172.21.15.3:0/2245497722 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f262c06cf60 0x7f262c1505d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:19.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.555+0000 7f26328ca700 1 -- 172.21.15.3:0/2245497722 >> 172.21.15.3:0/2245497722 conn(0x7f262c0be4a0 msgr2=0x7f262c0b24c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:19.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.555+0000 7f26328ca700 1 -- 172.21.15.3:0/2245497722 shutdown_connections 2023-10-08T15:40:19.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:19.555+0000 7f26328ca700 1 -- 172.21.15.3:0/2245497722 wait complete. 2023-10-08T15:40:19.813 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2023-10-08T15:40:19.813 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":123,"stamp":"2023-10-08T15:40:18.577265+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2427060,"kb_used_data":3700,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752547660,"statfs":{"total":773094113280,"available":770608803840,"internally_reserved":0,"allocated":3788800,"data_stored":2624556,"data_compressed":66282,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001777"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.435951+0000","last_change":"2023-10-08T15:40:14.423891+0000","last_active":"2023-10-08T15:40:14.435951+0000","last_peered":"2023-10-08T15:40:14.435951+0000","last_clean":"2023-10-08T15:40:14.435951+0000","last_became_active":"2023-10-08T15:40:14.423583+0000","last_became_peered":"2023-10-08T15:40:14.423583+0000","last_unstale":"2023-10-08T15:40:14.435951+0000","last_undegraded":"2023-10-08T15:40:14.435951+0000","last_fullsized":"2023-10-08T15:40:14.435951+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:28.192248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.428931+0000","last_change":"2023-10-08T15:40:14.428931+0000","last_active":"2023-10-08T15:40:14.428931+0000","last_peered":"2023-10-08T15:40:14.428931+0000","last_clean":"2023-10-08T15:40:14.428931+0000","last_became_active":"2023-10-08T15:40:14.428612+0000","last_became_peered":"2023-10-08T15:40:14.428612+0000","last_unstale":"2023-10-08T15:40:14.428931+0000","last_undegraded":"2023-10-08T15:40:14.428931+0000","last_fullsized":"2023-10-08T15:40:14.428931+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:57:32.025855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.431747+0000","last_change":"2023-10-08T15:40:14.430136+0000","last_active":"2023-10-08T15:40:14.431747+0000","last_peered":"2023-10-08T15:40:14.431747+0000","last_clean":"2023-10-08T15:40:14.431747+0000","last_became_active":"2023-10-08T15:40:14.428007+0000","last_became_peered":"2023-10-08T15:40:14.428007+0000","last_unstale":"2023-10-08T15:40:14.431747+0000","last_undegraded":"2023-10-08T15:40:14.431747+0000","last_fullsized":"2023-10-08T15:40:14.431747+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:32:50.871662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.439617+0000","last_change":"2023-10-08T15:40:14.430064+0000","last_active":"2023-10-08T15:40:14.439617+0000","last_peered":"2023-10-08T15:40:14.439617+0000","last_clean":"2023-10-08T15:40:14.439617+0000","last_became_active":"2023-10-08T15:40:14.428442+0000","last_became_peered":"2023-10-08T15:40:14.428442+0000","last_unstale":"2023-10-08T15:40:14.439617+0000","last_undegraded":"2023-10-08T15:40:14.439617+0000","last_fullsized":"2023-10-08T15:40:14.439617+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:32:50.871662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.427554+0000","last_change":"2023-10-08T15:40:14.427554+0000","last_active":"2023-10-08T15:40:14.427554+0000","last_peered":"2023-10-08T15:40:14.427554+0000","last_clean":"2023-10-08T15:40:14.427554+0000","last_became_active":"2023-10-08T15:40:14.427263+0000","last_became_peered":"2023-10-08T15:40:14.427263+0000","last_unstale":"2023-10-08T15:40:14.427554+0000","last_undegraded":"2023-10-08T15:40:14.427554+0000","last_fullsized":"2023-10-08T15:40:14.427554+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:16:37.068213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.430617+0000","last_change":"2023-10-08T15:40:14.424638+0000","last_active":"2023-10-08T15:40:14.430617+0000","last_peered":"2023-10-08T15:40:14.430617+0000","last_clean":"2023-10-08T15:40:14.430617+0000","last_became_active":"2023-10-08T15:40:14.424340+0000","last_became_peered":"2023-10-08T15:40:14.424340+0000","last_unstale":"2023-10-08T15:40:14.430617+0000","last_undegraded":"2023-10-08T15:40:14.430617+0000","last_fullsized":"2023-10-08T15:40:14.430617+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:15:22.556584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.425697+0000","last_change":"2023-10-08T15:40:14.417067+0000","last_active":"2023-10-08T15:40:14.425697+0000","last_peered":"2023-10-08T15:40:14.425697+0000","last_clean":"2023-10-08T15:40:14.425697+0000","last_became_active":"2023-10-08T15:40:14.416679+0000","last_became_peered":"2023-10-08T15:40:14.416679+0000","last_unstale":"2023-10-08T15:40:14.425697+0000","last_undegraded":"2023-10-08T15:40:14.425697+0000","last_fullsized":"2023-10-08T15:40:14.425697+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:37:17.376921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.439487+0000","last_change":"2023-10-08T15:40:14.428491+0000","last_active":"2023-10-08T15:40:14.439487+0000","last_peered":"2023-10-08T15:40:14.439487+0000","last_clean":"2023-10-08T15:40:14.439487+0000","last_became_active":"2023-10-08T15:40:14.428218+0000","last_became_peered":"2023-10-08T15:40:14.428218+0000","last_unstale":"2023-10-08T15:40:14.439487+0000","last_undegraded":"2023-10-08T15:40:14.439487+0000","last_fullsized":"2023-10-08T15:40:14.439487+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:16:37.068213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.444108+0000","last_change":"2023-10-08T15:40:14.436179+0000","last_active":"2023-10-08T15:40:14.444108+0000","last_peered":"2023-10-08T15:40:14.444108+0000","last_clean":"2023-10-08T15:40:14.444108+0000","last_became_active":"2023-10-08T15:40:14.435907+0000","last_became_peered":"2023-10-08T15:40:14.435907+0000","last_unstale":"2023-10-08T15:40:14.444108+0000","last_undegraded":"2023-10-08T15:40:14.444108+0000","last_fullsized":"2023-10-08T15:40:14.444108+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:19.169692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.439541+0000","last_change":"2023-10-08T15:40:14.429862+0000","last_active":"2023-10-08T15:40:14.439541+0000","last_peered":"2023-10-08T15:40:14.439541+0000","last_clean":"2023-10-08T15:40:14.439541+0000","last_became_active":"2023-10-08T15:40:14.429448+0000","last_became_peered":"2023-10-08T15:40:14.429448+0000","last_unstale":"2023-10-08T15:40:14.439541+0000","last_undegraded":"2023-10-08T15:40:14.439541+0000","last_fullsized":"2023-10-08T15:40:14.439541+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:54:26.469514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.444187+0000","last_change":"2023-10-08T15:40:14.437444+0000","last_active":"2023-10-08T15:40:14.444187+0000","last_peered":"2023-10-08T15:40:14.444187+0000","last_clean":"2023-10-08T15:40:14.444187+0000","last_became_active":"2023-10-08T15:40:14.437109+0000","last_became_peered":"2023-10-08T15:40:14.437109+0000","last_unstale":"2023-10-08T15:40:14.444187+0000","last_undegraded":"2023-10-08T15:40:14.444187+0000","last_fullsized":"2023-10-08T15:40:14.444187+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:55:30.274824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.429541+0000","last_change":"2023-10-08T15:40:14.429541+0000","last_active":"2023-10-08T15:40:14.429541+0000","last_peered":"2023-10-08T15:40:14.429541+0000","last_clean":"2023-10-08T15:40:14.429541+0000","last_became_active":"2023-10-08T15:40:14.429220+0000","last_became_peered":"2023-10-08T15:40:14.429220+0000","last_unstale":"2023-10-08T15:40:14.429541+0000","last_undegraded":"2023-10-08T15:40:14.429541+0000","last_fullsized":"2023-10-08T15:40:14.429541+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:32:50.871662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.429796+0000","last_change":"2023-10-08T15:40:14.424634+0000","last_active":"2023-10-08T15:40:14.429796+0000","last_peered":"2023-10-08T15:40:14.429796+0000","last_clean":"2023-10-08T15:40:14.429796+0000","last_became_active":"2023-10-08T15:40:14.424344+0000","last_became_peered":"2023-10-08T15:40:14.424344+0000","last_unstale":"2023-10-08T15:40:14.429796+0000","last_undegraded":"2023-10-08T15:40:14.429796+0000","last_fullsized":"2023-10-08T15:40:14.429796+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:23.701420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.443836+0000","last_change":"2023-10-08T15:40:14.432495+0000","last_active":"2023-10-08T15:40:14.443836+0000","last_peered":"2023-10-08T15:40:14.443836+0000","last_clean":"2023-10-08T15:40:14.443836+0000","last_became_active":"2023-10-08T15:40:14.431718+0000","last_became_peered":"2023-10-08T15:40:14.431718+0000","last_unstale":"2023-10-08T15:40:14.443836+0000","last_undegraded":"2023-10-08T15:40:14.443836+0000","last_fullsized":"2023-10-08T15:40:14.443836+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:38:59.192155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.430645+0000","last_change":"2023-10-08T15:40:14.425401+0000","last_active":"2023-10-08T15:40:14.430645+0000","last_peered":"2023-10-08T15:40:14.430645+0000","last_clean":"2023-10-08T15:40:14.430645+0000","last_became_active":"2023-10-08T15:40:14.424995+0000","last_became_peered":"2023-10-08T15:40:14.424995+0000","last_unstale":"2023-10-08T15:40:14.430645+0000","last_undegraded":"2023-10-08T15:40:14.430645+0000","last_fullsized":"2023-10-08T15:40:14.430645+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:35:53.516838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.431628+0000","last_change":"2023-10-08T15:40:14.426307+0000","last_active":"2023-10-08T15:40:14.431628+0000","last_peered":"2023-10-08T15:40:14.431628+0000","last_clean":"2023-10-08T15:40:14.431628+0000","last_became_active":"2023-10-08T15:40:14.425764+0000","last_became_peered":"2023-10-08T15:40:14.425764+0000","last_unstale":"2023-10-08T15:40:14.431628+0000","last_undegraded":"2023-10-08T15:40:14.431628+0000","last_fullsized":"2023-10-08T15:40:14.431628+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:47:51.523520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.427782+0000","last_change":"2023-10-08T15:40:14.425512+0000","last_active":"2023-10-08T15:40:14.427782+0000","last_peered":"2023-10-08T15:40:14.427782+0000","last_clean":"2023-10-08T15:40:14.427782+0000","last_became_active":"2023-10-08T15:40:14.425211+0000","last_became_peered":"2023-10-08T15:40:14.425211+0000","last_unstale":"2023-10-08T15:40:14.427782+0000","last_undegraded":"2023-10-08T15:40:14.427782+0000","last_fullsized":"2023-10-08T15:40:14.427782+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:55:30.274824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.440793+0000","last_change":"2023-10-08T15:40:14.438477+0000","last_active":"2023-10-08T15:40:14.440793+0000","last_peered":"2023-10-08T15:40:14.440793+0000","last_clean":"2023-10-08T15:40:14.440793+0000","last_became_active":"2023-10-08T15:40:14.438140+0000","last_became_peered":"2023-10-08T15:40:14.438140+0000","last_unstale":"2023-10-08T15:40:14.440793+0000","last_undegraded":"2023-10-08T15:40:14.440793+0000","last_fullsized":"2023-10-08T15:40:14.440793+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:54:26.469514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.432902+0000","last_change":"2023-10-08T15:40:14.429356+0000","last_active":"2023-10-08T15:40:14.432902+0000","last_peered":"2023-10-08T15:40:14.432902+0000","last_clean":"2023-10-08T15:40:14.432902+0000","last_became_active":"2023-10-08T15:40:14.429006+0000","last_became_peered":"2023-10-08T15:40:14.429006+0000","last_unstale":"2023-10-08T15:40:14.432902+0000","last_undegraded":"2023-10-08T15:40:14.432902+0000","last_fullsized":"2023-10-08T15:40:14.432902+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:59:25.720384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.432988+0000","last_change":"2023-10-08T15:40:14.426309+0000","last_active":"2023-10-08T15:40:14.432988+0000","last_peered":"2023-10-08T15:40:14.432988+0000","last_clean":"2023-10-08T15:40:14.432988+0000","last_became_active":"2023-10-08T15:40:14.426020+0000","last_became_peered":"2023-10-08T15:40:14.426020+0000","last_unstale":"2023-10-08T15:40:14.432988+0000","last_undegraded":"2023-10-08T15:40:14.432988+0000","last_fullsized":"2023-10-08T15:40:14.432988+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:11:59.571805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.426458+0000","last_change":"2023-10-08T15:40:14.422657+0000","last_active":"2023-10-08T15:40:14.426458+0000","last_peered":"2023-10-08T15:40:14.426458+0000","last_clean":"2023-10-08T15:40:14.426458+0000","last_became_active":"2023-10-08T15:40:14.422369+0000","last_became_peered":"2023-10-08T15:40:14.422369+0000","last_unstale":"2023-10-08T15:40:14.426458+0000","last_undegraded":"2023-10-08T15:40:14.426458+0000","last_fullsized":"2023-10-08T15:40:14.426458+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:34:36.429348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.439773+0000","last_change":"2023-10-08T15:40:14.429752+0000","last_active":"2023-10-08T15:40:14.439773+0000","last_peered":"2023-10-08T15:40:14.439773+0000","last_clean":"2023-10-08T15:40:14.439773+0000","last_became_active":"2023-10-08T15:40:14.429492+0000","last_became_peered":"2023-10-08T15:40:14.429492+0000","last_unstale":"2023-10-08T15:40:14.439773+0000","last_undegraded":"2023-10-08T15:40:14.439773+0000","last_fullsized":"2023-10-08T15:40:14.439773+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:46.354499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.447269+0000","last_change":"2023-10-08T15:40:14.445792+0000","last_active":"2023-10-08T15:40:14.447269+0000","last_peered":"2023-10-08T15:40:14.447269+0000","last_clean":"2023-10-08T15:40:14.447269+0000","last_became_active":"2023-10-08T15:40:14.445487+0000","last_became_peered":"2023-10-08T15:40:14.445487+0000","last_unstale":"2023-10-08T15:40:14.447269+0000","last_undegraded":"2023-10-08T15:40:14.447269+0000","last_fullsized":"2023-10-08T15:40:14.447269+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:46:46.494060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.435410+0000","last_change":"2023-10-08T15:40:14.433543+0000","last_active":"2023-10-08T15:40:14.435410+0000","last_peered":"2023-10-08T15:40:14.435410+0000","last_clean":"2023-10-08T15:40:14.435410+0000","last_became_active":"2023-10-08T15:40:14.433202+0000","last_became_peered":"2023-10-08T15:40:14.433202+0000","last_unstale":"2023-10-08T15:40:14.435410+0000","last_undegraded":"2023-10-08T15:40:14.435410+0000","last_fullsized":"2023-10-08T15:40:14.435410+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:02:38.806363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.435355+0000","last_change":"2023-10-08T15:40:14.434060+0000","last_active":"2023-10-08T15:40:14.435355+0000","last_peered":"2023-10-08T15:40:14.435355+0000","last_clean":"2023-10-08T15:40:14.435355+0000","last_became_active":"2023-10-08T15:40:14.433662+0000","last_became_peered":"2023-10-08T15:40:14.433662+0000","last_unstale":"2023-10-08T15:40:14.435355+0000","last_undegraded":"2023-10-08T15:40:14.435355+0000","last_fullsized":"2023-10-08T15:40:14.435355+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:54.703533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.429752+0000","last_change":"2023-10-08T15:40:14.424529+0000","last_active":"2023-10-08T15:40:14.429752+0000","last_peered":"2023-10-08T15:40:14.429752+0000","last_clean":"2023-10-08T15:40:14.429752+0000","last_became_active":"2023-10-08T15:40:14.424220+0000","last_became_peered":"2023-10-08T15:40:14.424220+0000","last_unstale":"2023-10-08T15:40:14.429752+0000","last_undegraded":"2023-10-08T15:40:14.429752+0000","last_fullsized":"2023-10-08T15:40:14.429752+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:46:47.332461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.422109+0000","last_change":"2023-10-08T15:40:14.420119+0000","last_active":"2023-10-08T15:40:14.422109+0000","last_peered":"2023-10-08T15:40:14.422109+0000","last_clean":"2023-10-08T15:40:14.422109+0000","last_became_active":"2023-10-08T15:40:14.419787+0000","last_became_peered":"2023-10-08T15:40:14.419787+0000","last_unstale":"2023-10-08T15:40:14.422109+0000","last_undegraded":"2023-10-08T15:40:14.422109+0000","last_fullsized":"2023-10-08T15:40:14.422109+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:19:38.120631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.426548+0000","last_change":"2023-10-08T15:40:14.426548+0000","last_active":"2023-10-08T15:40:14.426548+0000","last_peered":"2023-10-08T15:40:14.426548+0000","last_clean":"2023-10-08T15:40:14.426548+0000","last_became_active":"2023-10-08T15:40:14.426214+0000","last_became_peered":"2023-10-08T15:40:14.426214+0000","last_unstale":"2023-10-08T15:40:14.426548+0000","last_undegraded":"2023-10-08T15:40:14.426548+0000","last_fullsized":"2023-10-08T15:40:14.426548+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:38:59.192155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.436211+0000","last_change":"2023-10-08T15:40:14.434569+0000","last_active":"2023-10-08T15:40:14.436211+0000","last_peered":"2023-10-08T15:40:14.436211+0000","last_clean":"2023-10-08T15:40:14.436211+0000","last_became_active":"2023-10-08T15:40:14.434260+0000","last_became_peered":"2023-10-08T15:40:14.434260+0000","last_unstale":"2023-10-08T15:40:14.436211+0000","last_undegraded":"2023-10-08T15:40:14.436211+0000","last_fullsized":"2023-10-08T15:40:14.436211+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:50:14.854794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.426864+0000","last_change":"2023-10-08T15:40:14.423639+0000","last_active":"2023-10-08T15:40:14.426864+0000","last_peered":"2023-10-08T15:40:14.426864+0000","last_clean":"2023-10-08T15:40:14.426864+0000","last_became_active":"2023-10-08T15:40:14.423280+0000","last_became_peered":"2023-10-08T15:40:14.423280+0000","last_unstale":"2023-10-08T15:40:14.426864+0000","last_undegraded":"2023-10-08T15:40:14.426864+0000","last_fullsized":"2023-10-08T15:40:14.426864+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:16:37.068213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.430624+0000","last_change":"2023-10-08T15:40:14.423406+0000","last_active":"2023-10-08T15:40:14.430624+0000","last_peered":"2023-10-08T15:40:14.430624+0000","last_clean":"2023-10-08T15:40:14.430624+0000","last_became_active":"2023-10-08T15:40:14.423124+0000","last_became_peered":"2023-10-08T15:40:14.423124+0000","last_unstale":"2023-10-08T15:40:14.430624+0000","last_undegraded":"2023-10-08T15:40:14.430624+0000","last_fullsized":"2023-10-08T15:40:14.430624+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:23:00.391124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.432665+0000","last_change":"2023-10-08T15:40:14.428846+0000","last_active":"2023-10-08T15:40:14.432665+0000","last_peered":"2023-10-08T15:40:14.432665+0000","last_clean":"2023-10-08T15:40:14.432665+0000","last_became_active":"2023-10-08T15:40:14.428576+0000","last_became_peered":"2023-10-08T15:40:14.428576+0000","last_unstale":"2023-10-08T15:40:14.432665+0000","last_undegraded":"2023-10-08T15:40:14.432665+0000","last_fullsized":"2023-10-08T15:40:14.432665+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:56:46.389831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.442722+0000","last_change":"2023-10-08T15:40:14.428097+0000","last_active":"2023-10-08T15:40:14.442722+0000","last_peered":"2023-10-08T15:40:14.442722+0000","last_clean":"2023-10-08T15:40:14.442722+0000","last_became_active":"2023-10-08T15:40:14.427365+0000","last_became_peered":"2023-10-08T15:40:14.427365+0000","last_unstale":"2023-10-08T15:40:14.442722+0000","last_undegraded":"2023-10-08T15:40:14.442722+0000","last_fullsized":"2023-10-08T15:40:14.442722+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:59:25.720384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"38'4","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.440786+0000","last_change":"2023-10-08T15:40:13.425751+0000","last_active":"2023-10-08T15:40:14.440786+0000","last_peered":"2023-10-08T15:40:14.440786+0000","last_clean":"2023-10-08T15:40:14.440786+0000","last_became_active":"2023-10-08T15:40:13.425422+0000","last_became_peered":"2023-10-08T15:40:13.425422+0000","last_unstale":"2023-10-08T15:40:14.440786+0000","last_undegraded":"2023-10-08T15:40:14.440786+0000","last_fullsized":"2023-10-08T15:40:14.440786+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:18.157723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.428792+0000","last_change":"2023-10-08T15:40:14.422467+0000","last_active":"2023-10-08T15:40:14.428792+0000","last_peered":"2023-10-08T15:40:14.428792+0000","last_clean":"2023-10-08T15:40:14.428792+0000","last_became_active":"2023-10-08T15:40:14.422116+0000","last_became_peered":"2023-10-08T15:40:14.422116+0000","last_unstale":"2023-10-08T15:40:14.428792+0000","last_undegraded":"2023-10-08T15:40:14.428792+0000","last_fullsized":"2023-10-08T15:40:14.428792+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:07:41.691232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"38'1","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.439948+0000","last_change":"2023-10-08T15:40:13.427528+0000","last_active":"2023-10-08T15:40:14.439948+0000","last_peered":"2023-10-08T15:40:14.439948+0000","last_clean":"2023-10-08T15:40:14.439948+0000","last_became_active":"2023-10-08T15:40:13.426178+0000","last_became_peered":"2023-10-08T15:40:13.426178+0000","last_unstale":"2023-10-08T15:40:14.439948+0000","last_undegraded":"2023-10-08T15:40:14.439948+0000","last_fullsized":"2023-10-08T15:40:14.439948+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:22:14.407250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.426852+0000","last_change":"2023-10-08T15:40:14.426852+0000","last_active":"2023-10-08T15:40:14.426852+0000","last_peered":"2023-10-08T15:40:14.426852+0000","last_clean":"2023-10-08T15:40:14.426852+0000","last_became_active":"2023-10-08T15:40:14.424903+0000","last_became_peered":"2023-10-08T15:40:14.424903+0000","last_unstale":"2023-10-08T15:40:14.426852+0000","last_undegraded":"2023-10-08T15:40:14.426852+0000","last_fullsized":"2023-10-08T15:40:14.426852+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:46.354499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.445200+0000","last_change":"2023-10-08T15:40:13.422829+0000","last_active":"2023-10-08T15:40:14.445200+0000","last_peered":"2023-10-08T15:40:14.445200+0000","last_clean":"2023-10-08T15:40:14.445200+0000","last_became_active":"2023-10-08T15:40:13.422518+0000","last_became_peered":"2023-10-08T15:40:13.422518+0000","last_unstale":"2023-10-08T15:40:14.445200+0000","last_undegraded":"2023-10-08T15:40:14.445200+0000","last_fullsized":"2023-10-08T15:40:14.445200+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:50:13.842824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.443233+0000","last_change":"2023-10-08T15:40:14.427920+0000","last_active":"2023-10-08T15:40:14.443233+0000","last_peered":"2023-10-08T15:40:14.443233+0000","last_clean":"2023-10-08T15:40:14.443233+0000","last_became_active":"2023-10-08T15:40:14.427648+0000","last_became_peered":"2023-10-08T15:40:14.427648+0000","last_unstale":"2023-10-08T15:40:14.443233+0000","last_undegraded":"2023-10-08T15:40:14.443233+0000","last_fullsized":"2023-10-08T15:40:14.443233+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:18:28.702700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.447461+0000","last_change":"2023-10-08T15:40:13.417157+0000","last_active":"2023-10-08T15:40:14.447461+0000","last_peered":"2023-10-08T15:40:14.447461+0000","last_clean":"2023-10-08T15:40:14.447461+0000","last_became_active":"2023-10-08T15:40:13.416876+0000","last_became_peered":"2023-10-08T15:40:13.416876+0000","last_unstale":"2023-10-08T15:40:14.447461+0000","last_undegraded":"2023-10-08T15:40:14.447461+0000","last_fullsized":"2023-10-08T15:40:14.447461+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:31:45.772524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.426881+0000","last_change":"2023-10-08T15:40:14.425353+0000","last_active":"2023-10-08T15:40:14.426881+0000","last_peered":"2023-10-08T15:40:14.426881+0000","last_clean":"2023-10-08T15:40:14.426881+0000","last_became_active":"2023-10-08T15:40:14.425058+0000","last_became_peered":"2023-10-08T15:40:14.425058+0000","last_unstale":"2023-10-08T15:40:14.426881+0000","last_undegraded":"2023-10-08T15:40:14.426881+0000","last_fullsized":"2023-10-08T15:40:14.426881+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:57:32.025855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"38'1","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.446643+0000","last_change":"2023-10-08T15:40:13.417469+0000","last_active":"2023-10-08T15:40:14.446643+0000","last_peered":"2023-10-08T15:40:14.446643+0000","last_clean":"2023-10-08T15:40:14.446643+0000","last_became_active":"2023-10-08T15:40:13.417134+0000","last_became_peered":"2023-10-08T15:40:13.417134+0000","last_unstale":"2023-10-08T15:40:14.446643+0000","last_undegraded":"2023-10-08T15:40:14.446643+0000","last_fullsized":"2023-10-08T15:40:14.446643+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:38:58.180186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.442814+0000","last_change":"2023-10-08T15:40:14.431556+0000","last_active":"2023-10-08T15:40:14.442814+0000","last_peered":"2023-10-08T15:40:14.442814+0000","last_clean":"2023-10-08T15:40:14.442814+0000","last_became_active":"2023-10-08T15:40:14.431277+0000","last_became_peered":"2023-10-08T15:40:14.431277+0000","last_unstale":"2023-10-08T15:40:14.442814+0000","last_undegraded":"2023-10-08T15:40:14.442814+0000","last_fullsized":"2023-10-08T15:40:14.442814+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:26:20.874012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"38'1","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.439904+0000","last_change":"2023-10-08T15:40:13.421287+0000","last_active":"2023-10-08T15:40:14.439904+0000","last_peered":"2023-10-08T15:40:14.439904+0000","last_clean":"2023-10-08T15:40:14.439904+0000","last_became_active":"2023-10-08T15:40:13.420491+0000","last_became_peered":"2023-10-08T15:40:13.420491+0000","last_unstale":"2023-10-08T15:40:14.439904+0000","last_undegraded":"2023-10-08T15:40:14.439904+0000","last_fullsized":"2023-10-08T15:40:14.439904+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:12:14.269569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.432725+0000","last_change":"2023-10-08T15:40:14.422880+0000","last_active":"2023-10-08T15:40:14.432725+0000","last_peered":"2023-10-08T15:40:14.432725+0000","last_clean":"2023-10-08T15:40:14.432725+0000","last_became_active":"2023-10-08T15:40:14.422555+0000","last_became_peered":"2023-10-08T15:40:14.422555+0000","last_unstale":"2023-10-08T15:40:14.432725+0000","last_undegraded":"2023-10-08T15:40:14.432725+0000","last_fullsized":"2023-10-08T15:40:14.432725+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:19:38.120631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-08T15:40:13.428960+0000","last_change":"2023-10-08T15:40:13.425380+0000","last_active":"2023-10-08T15:40:13.428960+0000","last_peered":"2023-10-08T15:40:13.428960+0000","last_clean":"2023-10-08T15:40:13.428960+0000","last_became_active":"2023-10-08T15:40:13.425091+0000","last_became_peered":"2023-10-08T15:40:13.425091+0000","last_unstale":"2023-10-08T15:40:13.428960+0000","last_undegraded":"2023-10-08T15:40:13.428960+0000","last_fullsized":"2023-10-08T15:40:13.428960+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:30:28.988602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.435277+0000","last_change":"2023-10-08T15:40:14.433565+0000","last_active":"2023-10-08T15:40:14.435277+0000","last_peered":"2023-10-08T15:40:14.435277+0000","last_clean":"2023-10-08T15:40:14.435277+0000","last_became_active":"2023-10-08T15:40:14.433242+0000","last_became_peered":"2023-10-08T15:40:14.433242+0000","last_unstale":"2023-10-08T15:40:14.435277+0000","last_undegraded":"2023-10-08T15:40:14.435277+0000","last_fullsized":"2023-10-08T15:40:14.435277+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:01:49.004201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.418446+0000","last_change":"2023-10-08T15:40:13.427181+0000","last_active":"2023-10-08T15:40:14.418446+0000","last_peered":"2023-10-08T15:40:14.418446+0000","last_clean":"2023-10-08T15:40:14.418446+0000","last_became_active":"2023-10-08T15:40:13.425429+0000","last_became_peered":"2023-10-08T15:40:13.425429+0000","last_unstale":"2023-10-08T15:40:14.418446+0000","last_undegraded":"2023-10-08T15:40:14.418446+0000","last_fullsized":"2023-10-08T15:40:14.418446+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:49:42.599600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.440025+0000","last_change":"2023-10-08T15:40:14.438306+0000","last_active":"2023-10-08T15:40:14.440025+0000","last_peered":"2023-10-08T15:40:14.440025+0000","last_clean":"2023-10-08T15:40:14.440025+0000","last_became_active":"2023-10-08T15:40:14.437961+0000","last_became_peered":"2023-10-08T15:40:14.437961+0000","last_unstale":"2023-10-08T15:40:14.440025+0000","last_undegraded":"2023-10-08T15:40:14.440025+0000","last_fullsized":"2023-10-08T15:40:14.440025+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:26:20.874012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.418871+0000","last_change":"2023-10-08T15:40:13.420695+0000","last_active":"2023-10-08T15:40:14.418871+0000","last_peered":"2023-10-08T15:40:14.418871+0000","last_clean":"2023-10-08T15:40:14.418871+0000","last_became_active":"2023-10-08T15:40:13.420370+0000","last_became_peered":"2023-10-08T15:40:13.420370+0000","last_unstale":"2023-10-08T15:40:14.418871+0000","last_undegraded":"2023-10-08T15:40:14.418871+0000","last_fullsized":"2023-10-08T15:40:14.418871+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:45:30.332801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.432660+0000","last_change":"2023-10-08T15:40:14.418552+0000","last_active":"2023-10-08T15:40:14.432660+0000","last_peered":"2023-10-08T15:40:14.432660+0000","last_clean":"2023-10-08T15:40:14.432660+0000","last_became_active":"2023-10-08T15:40:14.418152+0000","last_became_peered":"2023-10-08T15:40:14.418152+0000","last_unstale":"2023-10-08T15:40:14.432660+0000","last_undegraded":"2023-10-08T15:40:14.432660+0000","last_fullsized":"2023-10-08T15:40:14.432660+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:36:00.388553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.424445+0000","last_change":"2023-10-08T15:40:13.428311+0000","last_active":"2023-10-08T15:40:14.424445+0000","last_peered":"2023-10-08T15:40:14.424445+0000","last_clean":"2023-10-08T15:40:14.424445+0000","last_became_active":"2023-10-08T15:40:13.427998+0000","last_became_peered":"2023-10-08T15:40:13.427998+0000","last_unstale":"2023-10-08T15:40:14.424445+0000","last_undegraded":"2023-10-08T15:40:14.424445+0000","last_fullsized":"2023-10-08T15:40:14.424445+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:14:50.877335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.433766+0000","last_change":"2023-10-08T15:40:14.428424+0000","last_active":"2023-10-08T15:40:14.433766+0000","last_peered":"2023-10-08T15:40:14.433766+0000","last_clean":"2023-10-08T15:40:14.433766+0000","last_became_active":"2023-10-08T15:40:14.428102+0000","last_became_peered":"2023-10-08T15:40:14.428102+0000","last_unstale":"2023-10-08T15:40:14.433766+0000","last_undegraded":"2023-10-08T15:40:14.433766+0000","last_fullsized":"2023-10-08T15:40:14.433766+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:47:29.743549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"38'3","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.448063+0000","last_change":"2023-10-08T15:40:13.426137+0000","last_active":"2023-10-08T15:40:14.448063+0000","last_peered":"2023-10-08T15:40:14.448063+0000","last_clean":"2023-10-08T15:40:14.448063+0000","last_became_active":"2023-10-08T15:40:13.425691+0000","last_became_peered":"2023-10-08T15:40:13.425691+0000","last_unstale":"2023-10-08T15:40:14.448063+0000","last_undegraded":"2023-10-08T15:40:14.448063+0000","last_fullsized":"2023-10-08T15:40:14.448063+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:47:36.657587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.444679+0000","last_change":"2023-10-08T15:40:14.429313+0000","last_active":"2023-10-08T15:40:14.444679+0000","last_peered":"2023-10-08T15:40:14.444679+0000","last_clean":"2023-10-08T15:40:14.444679+0000","last_became_active":"2023-10-08T15:40:14.429002+0000","last_became_peered":"2023-10-08T15:40:14.429002+0000","last_unstale":"2023-10-08T15:40:14.444679+0000","last_undegraded":"2023-10-08T15:40:14.444679+0000","last_fullsized":"2023-10-08T15:40:14.444679+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:18:25.771380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"38'6","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.449213+0000","last_change":"2023-10-08T15:40:13.420187+0000","last_active":"2023-10-08T15:40:14.449213+0000","last_peered":"2023-10-08T15:40:14.449213+0000","last_clean":"2023-10-08T15:40:14.449213+0000","last_became_active":"2023-10-08T15:40:13.419818+0000","last_became_peered":"2023-10-08T15:40:13.419818+0000","last_unstale":"2023-10-08T15:40:14.449213+0000","last_undegraded":"2023-10-08T15:40:14.449213+0000","last_fullsized":"2023-10-08T15:40:14.449213+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:34:03.849463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.431916+0000","last_change":"2023-10-08T15:40:14.427600+0000","last_active":"2023-10-08T15:40:14.431916+0000","last_peered":"2023-10-08T15:40:14.431916+0000","last_clean":"2023-10-08T15:40:14.431916+0000","last_became_active":"2023-10-08T15:40:14.427273+0000","last_became_peered":"2023-10-08T15:40:14.427273+0000","last_unstale":"2023-10-08T15:40:14.431916+0000","last_undegraded":"2023-10-08T15:40:14.431916+0000","last_fullsized":"2023-10-08T15:40:14.431916+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:41:14.459572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.444927+0000","last_change":"2023-10-08T15:40:13.428224+0000","last_active":"2023-10-08T15:40:14.444927+0000","last_peered":"2023-10-08T15:40:14.444927+0000","last_clean":"2023-10-08T15:40:14.444927+0000","last_became_active":"2023-10-08T15:40:13.427919+0000","last_became_peered":"2023-10-08T15:40:13.427919+0000","last_unstale":"2023-10-08T15:40:14.444927+0000","last_undegraded":"2023-10-08T15:40:14.444927+0000","last_fullsized":"2023-10-08T15:40:14.444927+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:32:49.859693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.448939+0000","last_change":"2023-10-08T15:40:14.444596+0000","last_active":"2023-10-08T15:40:14.448939+0000","last_peered":"2023-10-08T15:40:14.448939+0000","last_clean":"2023-10-08T15:40:14.448939+0000","last_became_active":"2023-10-08T15:40:14.444236+0000","last_became_peered":"2023-10-08T15:40:14.444236+0000","last_unstale":"2023-10-08T15:40:14.448939+0000","last_undegraded":"2023-10-08T15:40:14.448939+0000","last_fullsized":"2023-10-08T15:40:14.448939+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:32:47.327437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.408105+0000","last_change":"2023-10-08T15:40:13.415599+0000","last_active":"2023-10-08T15:40:14.408105+0000","last_peered":"2023-10-08T15:40:14.408105+0000","last_clean":"2023-10-08T15:40:14.408105+0000","last_became_active":"2023-10-08T15:40:13.415310+0000","last_became_peered":"2023-10-08T15:40:13.415310+0000","last_unstale":"2023-10-08T15:40:14.408105+0000","last_undegraded":"2023-10-08T15:40:14.408105+0000","last_fullsized":"2023-10-08T15:40:14.408105+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:18:27.690730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.435562+0000","last_change":"2023-10-08T15:40:14.431047+0000","last_active":"2023-10-08T15:40:14.435562+0000","last_peered":"2023-10-08T15:40:14.435562+0000","last_clean":"2023-10-08T15:40:14.435562+0000","last_became_active":"2023-10-08T15:40:14.430767+0000","last_became_peered":"2023-10-08T15:40:14.430767+0000","last_unstale":"2023-10-08T15:40:14.435562+0000","last_undegraded":"2023-10-08T15:40:14.435562+0000","last_fullsized":"2023-10-08T15:40:14.435562+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:55:40.587396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.419235+0000","last_change":"2023-10-08T15:40:13.422903+0000","last_active":"2023-10-08T15:40:14.419235+0000","last_peered":"2023-10-08T15:40:14.419235+0000","last_clean":"2023-10-08T15:40:14.419235+0000","last_became_active":"2023-10-08T15:40:13.422586+0000","last_became_peered":"2023-10-08T15:40:13.422586+0000","last_unstale":"2023-10-08T15:40:14.419235+0000","last_undegraded":"2023-10-08T15:40:14.419235+0000","last_fullsized":"2023-10-08T15:40:14.419235+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:45.342530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.436094+0000","last_change":"2023-10-08T15:40:14.425577+0000","last_active":"2023-10-08T15:40:14.436094+0000","last_peered":"2023-10-08T15:40:14.436094+0000","last_clean":"2023-10-08T15:40:14.436094+0000","last_became_active":"2023-10-08T15:40:14.425279+0000","last_became_peered":"2023-10-08T15:40:14.425279+0000","last_unstale":"2023-10-08T15:40:14.436094+0000","last_undegraded":"2023-10-08T15:40:14.436094+0000","last_fullsized":"2023-10-08T15:40:14.436094+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:25:12.898608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"38'8","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.444619+0000","last_change":"2023-10-08T15:40:13.427234+0000","last_active":"2023-10-08T15:40:14.444619+0000","last_peered":"2023-10-08T15:40:14.444619+0000","last_clean":"2023-10-08T15:40:14.444619+0000","last_became_active":"2023-10-08T15:40:13.424985+0000","last_became_peered":"2023-10-08T15:40:13.424985+0000","last_unstale":"2023-10-08T15:40:14.444619+0000","last_undegraded":"2023-10-08T15:40:14.444619+0000","last_fullsized":"2023-10-08T15:40:14.444619+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:18:01.774995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.426075+0000","last_change":"2023-10-08T15:40:14.416890+0000","last_active":"2023-10-08T15:40:14.426075+0000","last_peered":"2023-10-08T15:40:14.426075+0000","last_clean":"2023-10-08T15:40:14.426075+0000","last_became_active":"2023-10-08T15:40:14.416503+0000","last_became_peered":"2023-10-08T15:40:14.416503+0000","last_unstale":"2023-10-08T15:40:14.426075+0000","last_undegraded":"2023-10-08T15:40:14.426075+0000","last_fullsized":"2023-10-08T15:40:14.426075+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:39:23.149190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"38'1","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.441331+0000","last_change":"2023-10-08T15:40:13.417048+0000","last_active":"2023-10-08T15:40:14.441331+0000","last_peered":"2023-10-08T15:40:14.441331+0000","last_clean":"2023-10-08T15:40:14.441331+0000","last_became_active":"2023-10-08T15:40:13.416724+0000","last_became_peered":"2023-10-08T15:40:13.416724+0000","last_unstale":"2023-10-08T15:40:14.441331+0000","last_undegraded":"2023-10-08T15:40:14.441331+0000","last_fullsized":"2023-10-08T15:40:14.441331+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:19:37.829086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.439342+0000","last_change":"2023-10-08T15:40:14.427679+0000","last_active":"2023-10-08T15:40:14.439342+0000","last_peered":"2023-10-08T15:40:14.439342+0000","last_clean":"2023-10-08T15:40:14.439342+0000","last_became_active":"2023-10-08T15:40:14.427339+0000","last_became_peered":"2023-10-08T15:40:14.427339+0000","last_unstale":"2023-10-08T15:40:14.439342+0000","last_undegraded":"2023-10-08T15:40:14.439342+0000","last_fullsized":"2023-10-08T15:40:14.439342+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:38:56.298194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.446296+0000","last_change":"2023-10-08T15:40:13.424903+0000","last_active":"2023-10-08T15:40:14.446296+0000","last_peered":"2023-10-08T15:40:14.446296+0000","last_clean":"2023-10-08T15:40:14.446296+0000","last_became_active":"2023-10-08T15:40:13.424525+0000","last_became_peered":"2023-10-08T15:40:13.424525+0000","last_unstale":"2023-10-08T15:40:14.446296+0000","last_undegraded":"2023-10-08T15:40:14.446296+0000","last_fullsized":"2023-10-08T15:40:14.446296+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:43:48.263381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.431554+0000","last_change":"2023-10-08T15:40:14.425248+0000","last_active":"2023-10-08T15:40:14.431554+0000","last_peered":"2023-10-08T15:40:14.431554+0000","last_clean":"2023-10-08T15:40:14.431554+0000","last_became_active":"2023-10-08T15:40:14.424900+0000","last_became_peered":"2023-10-08T15:40:14.424900+0000","last_unstale":"2023-10-08T15:40:14.431554+0000","last_undegraded":"2023-10-08T15:40:14.431554+0000","last_fullsized":"2023-10-08T15:40:14.431554+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:28:32.528544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"38'1","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.411751+0000","last_change":"2023-10-08T15:40:13.426037+0000","last_active":"2023-10-08T15:40:14.411751+0000","last_peered":"2023-10-08T15:40:14.411751+0000","last_clean":"2023-10-08T15:40:14.411751+0000","last_became_active":"2023-10-08T15:40:13.425736+0000","last_became_peered":"2023-10-08T15:40:13.425736+0000","last_unstale":"2023-10-08T15:40:14.411751+0000","last_undegraded":"2023-10-08T15:40:14.411751+0000","last_fullsized":"2023-10-08T15:40:14.411751+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:43:48.263381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.447211+0000","last_change":"2023-10-08T15:40:14.445368+0000","last_active":"2023-10-08T15:40:14.447211+0000","last_peered":"2023-10-08T15:40:14.447211+0000","last_clean":"2023-10-08T15:40:14.447211+0000","last_became_active":"2023-10-08T15:40:14.445022+0000","last_became_peered":"2023-10-08T15:40:14.445022+0000","last_unstale":"2023-10-08T15:40:14.447211+0000","last_undegraded":"2023-10-08T15:40:14.447211+0000","last_fullsized":"2023-10-08T15:40:14.447211+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:40:05.133298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.418779+0000","last_change":"2023-10-08T15:40:13.424921+0000","last_active":"2023-10-08T15:40:14.418779+0000","last_peered":"2023-10-08T15:40:14.418779+0000","last_clean":"2023-10-08T15:40:14.418779+0000","last_became_active":"2023-10-08T15:40:13.424591+0000","last_became_peered":"2023-10-08T15:40:13.424591+0000","last_unstale":"2023-10-08T15:40:14.418779+0000","last_undegraded":"2023-10-08T15:40:14.418779+0000","last_fullsized":"2023-10-08T15:40:14.418779+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:55:29.262854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.433474+0000","last_change":"2023-10-08T15:40:14.428843+0000","last_active":"2023-10-08T15:40:14.433474+0000","last_peered":"2023-10-08T15:40:14.433474+0000","last_clean":"2023-10-08T15:40:14.433474+0000","last_became_active":"2023-10-08T15:40:14.428278+0000","last_became_peered":"2023-10-08T15:40:14.428278+0000","last_unstale":"2023-10-08T15:40:14.433474+0000","last_undegraded":"2023-10-08T15:40:14.433474+0000","last_fullsized":"2023-10-08T15:40:14.433474+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:58.495250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.446715+0000","last_change":"2023-10-08T15:40:13.417299+0000","last_active":"2023-10-08T15:40:14.446715+0000","last_peered":"2023-10-08T15:40:14.446715+0000","last_clean":"2023-10-08T15:40:14.446715+0000","last_became_active":"2023-10-08T15:40:13.416982+0000","last_became_peered":"2023-10-08T15:40:13.416982+0000","last_unstale":"2023-10-08T15:40:14.446715+0000","last_undegraded":"2023-10-08T15:40:14.446715+0000","last_fullsized":"2023-10-08T15:40:14.446715+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:19:37.108661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.431264+0000","last_change":"2023-10-08T15:40:14.420668+0000","last_active":"2023-10-08T15:40:14.431264+0000","last_peered":"2023-10-08T15:40:14.431264+0000","last_clean":"2023-10-08T15:40:14.431264+0000","last_became_active":"2023-10-08T15:40:14.419844+0000","last_became_peered":"2023-10-08T15:40:14.419844+0000","last_unstale":"2023-10-08T15:40:14.431264+0000","last_undegraded":"2023-10-08T15:40:14.431264+0000","last_fullsized":"2023-10-08T15:40:14.431264+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:47:51.523520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-08T15:40:13.429061+0000","last_change":"2023-10-08T15:40:13.426040+0000","last_active":"2023-10-08T15:40:13.429061+0000","last_peered":"2023-10-08T15:40:13.429061+0000","last_clean":"2023-10-08T15:40:13.429061+0000","last_became_active":"2023-10-08T15:40:13.425705+0000","last_became_peered":"2023-10-08T15:40:13.425705+0000","last_unstale":"2023-10-08T15:40:13.429061+0000","last_undegraded":"2023-10-08T15:40:13.429061+0000","last_fullsized":"2023-10-08T15:40:13.429061+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:12:14.269569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.425551+0000","last_change":"2023-10-08T15:40:14.413855+0000","last_active":"2023-10-08T15:40:14.425551+0000","last_peered":"2023-10-08T15:40:14.425551+0000","last_clean":"2023-10-08T15:40:14.425551+0000","last_became_active":"2023-10-08T15:40:14.412210+0000","last_became_peered":"2023-10-08T15:40:14.412210+0000","last_unstale":"2023-10-08T15:40:14.425551+0000","last_undegraded":"2023-10-08T15:40:14.425551+0000","last_fullsized":"2023-10-08T15:40:14.425551+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:07:16.107860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.418168+0000","last_change":"2023-10-08T15:40:13.424876+0000","last_active":"2023-10-08T15:40:14.418168+0000","last_peered":"2023-10-08T15:40:14.418168+0000","last_clean":"2023-10-08T15:40:14.418168+0000","last_became_active":"2023-10-08T15:40:13.424570+0000","last_became_peered":"2023-10-08T15:40:13.424570+0000","last_unstale":"2023-10-08T15:40:14.418168+0000","last_undegraded":"2023-10-08T15:40:14.418168+0000","last_fullsized":"2023-10-08T15:40:14.418168+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:15:27.675296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.443967+0000","last_change":"2023-10-08T15:40:14.433524+0000","last_active":"2023-10-08T15:40:14.443967+0000","last_peered":"2023-10-08T15:40:14.443967+0000","last_clean":"2023-10-08T15:40:14.443967+0000","last_became_active":"2023-10-08T15:40:14.433222+0000","last_became_peered":"2023-10-08T15:40:14.433222+0000","last_unstale":"2023-10-08T15:40:14.443967+0000","last_undegraded":"2023-10-08T15:40:14.443967+0000","last_fullsized":"2023-10-08T15:40:14.443967+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:46:05.056695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.407800+0000","last_change":"2023-10-08T15:40:13.414016+0000","last_active":"2023-10-08T15:40:14.407800+0000","last_peered":"2023-10-08T15:40:14.407800+0000","last_clean":"2023-10-08T15:40:14.407800+0000","last_became_active":"2023-10-08T15:40:13.413732+0000","last_became_peered":"2023-10-08T15:40:13.413732+0000","last_unstale":"2023-10-08T15:40:14.407800+0000","last_undegraded":"2023-10-08T15:40:14.407800+0000","last_fullsized":"2023-10-08T15:40:14.407800+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:43:34.768625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.437192+0000","last_change":"2023-10-08T15:40:14.434622+0000","last_active":"2023-10-08T15:40:14.437192+0000","last_peered":"2023-10-08T15:40:14.437192+0000","last_clean":"2023-10-08T15:40:14.437192+0000","last_became_active":"2023-10-08T15:40:14.434234+0000","last_became_peered":"2023-10-08T15:40:14.434234+0000","last_unstale":"2023-10-08T15:40:14.437192+0000","last_undegraded":"2023-10-08T15:40:14.437192+0000","last_fullsized":"2023-10-08T15:40:14.437192+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:40:37.969828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.419085+0000","last_change":"2023-10-08T15:40:13.416965+0000","last_active":"2023-10-08T15:40:14.419085+0000","last_peered":"2023-10-08T15:40:14.419085+0000","last_clean":"2023-10-08T15:40:14.419085+0000","last_became_active":"2023-10-08T15:40:13.416634+0000","last_became_peered":"2023-10-08T15:40:13.416634+0000","last_unstale":"2023-10-08T15:40:14.419085+0000","last_undegraded":"2023-10-08T15:40:14.419085+0000","last_fullsized":"2023-10-08T15:40:14.419085+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:46:04.044725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.437994+0000","last_change":"2023-10-08T15:40:14.425484+0000","last_active":"2023-10-08T15:40:14.437994+0000","last_peered":"2023-10-08T15:40:14.437994+0000","last_clean":"2023-10-08T15:40:14.437994+0000","last_became_active":"2023-10-08T15:40:14.425082+0000","last_became_peered":"2023-10-08T15:40:14.425082+0000","last_unstale":"2023-10-08T15:40:14.437994+0000","last_undegraded":"2023-10-08T15:40:14.437994+0000","last_fullsized":"2023-10-08T15:40:14.437994+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:57:32.025855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.410463+0000","last_change":"2023-10-08T15:40:13.423625+0000","last_active":"2023-10-08T15:40:14.410463+0000","last_peered":"2023-10-08T15:40:14.410463+0000","last_clean":"2023-10-08T15:40:14.410463+0000","last_became_active":"2023-10-08T15:40:13.422315+0000","last_became_peered":"2023-10-08T15:40:13.422315+0000","last_unstale":"2023-10-08T15:40:14.410463+0000","last_undegraded":"2023-10-08T15:40:14.410463+0000","last_fullsized":"2023-10-08T15:40:14.410463+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:25:11.825747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.422351+0000","last_change":"2023-10-08T15:40:14.416301+0000","last_active":"2023-10-08T15:40:14.422351+0000","last_peered":"2023-10-08T15:40:14.422351+0000","last_clean":"2023-10-08T15:40:14.422351+0000","last_became_active":"2023-10-08T15:40:14.415966+0000","last_became_peered":"2023-10-08T15:40:14.415966+0000","last_unstale":"2023-10-08T15:40:14.422351+0000","last_undegraded":"2023-10-08T15:40:14.422351+0000","last_fullsized":"2023-10-08T15:40:14.422351+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:04:06.756439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.426957+0000","last_change":"2023-10-08T15:40:13.423017+0000","last_active":"2023-10-08T15:40:14.426957+0000","last_peered":"2023-10-08T15:40:14.426957+0000","last_clean":"2023-10-08T15:40:14.426957+0000","last_became_active":"2023-10-08T15:40:13.422248+0000","last_became_peered":"2023-10-08T15:40:13.422248+0000","last_unstale":"2023-10-08T15:40:14.426957+0000","last_undegraded":"2023-10-08T15:40:14.426957+0000","last_fullsized":"2023-10-08T15:40:14.426957+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:07:40.679262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.433492+0000","last_change":"2023-10-08T15:40:14.429509+0000","last_active":"2023-10-08T15:40:14.433492+0000","last_peered":"2023-10-08T15:40:14.433492+0000","last_clean":"2023-10-08T15:40:14.433492+0000","last_became_active":"2023-10-08T15:40:14.428968+0000","last_became_peered":"2023-10-08T15:40:14.428968+0000","last_unstale":"2023-10-08T15:40:14.433492+0000","last_undegraded":"2023-10-08T15:40:14.433492+0000","last_fullsized":"2023-10-08T15:40:14.433492+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:18:58.446270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.409367+0000","last_change":"2023-10-08T15:40:13.422628+0000","last_active":"2023-10-08T15:40:14.409367+0000","last_peered":"2023-10-08T15:40:14.409367+0000","last_clean":"2023-10-08T15:40:14.409367+0000","last_became_active":"2023-10-08T15:40:13.422297+0000","last_became_peered":"2023-10-08T15:40:13.422297+0000","last_unstale":"2023-10-08T15:40:14.409367+0000","last_undegraded":"2023-10-08T15:40:14.409367+0000","last_fullsized":"2023-10-08T15:40:14.409367+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:03.198759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.433786+0000","last_change":"2023-10-08T15:40:14.428922+0000","last_active":"2023-10-08T15:40:14.433786+0000","last_peered":"2023-10-08T15:40:14.433786+0000","last_clean":"2023-10-08T15:40:14.433786+0000","last_became_active":"2023-10-08T15:40:14.428220+0000","last_became_peered":"2023-10-08T15:40:14.428220+0000","last_unstale":"2023-10-08T15:40:14.433786+0000","last_undegraded":"2023-10-08T15:40:14.433786+0000","last_fullsized":"2023-10-08T15:40:14.433786+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:33:20.523009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.416231+0000","last_change":"2023-10-08T15:40:13.421651+0000","last_active":"2023-10-08T15:40:14.416231+0000","last_peered":"2023-10-08T15:40:14.416231+0000","last_clean":"2023-10-08T15:40:14.416231+0000","last_became_active":"2023-10-08T15:40:13.421353+0000","last_became_peered":"2023-10-08T15:40:13.421353+0000","last_unstale":"2023-10-08T15:40:14.416231+0000","last_undegraded":"2023-10-08T15:40:14.416231+0000","last_fullsized":"2023-10-08T15:40:14.416231+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:36.146964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.429164+0000","last_change":"2023-10-08T15:40:14.429164+0000","last_active":"2023-10-08T15:40:14.429164+0000","last_peered":"2023-10-08T15:40:14.429164+0000","last_clean":"2023-10-08T15:40:14.429164+0000","last_became_active":"2023-10-08T15:40:14.428857+0000","last_became_peered":"2023-10-08T15:40:14.428857+0000","last_unstale":"2023-10-08T15:40:14.429164+0000","last_undegraded":"2023-10-08T15:40:14.429164+0000","last_fullsized":"2023-10-08T15:40:14.429164+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:19:38.120631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.427151+0000","last_change":"2023-10-08T15:40:13.423501+0000","last_active":"2023-10-08T15:40:14.427151+0000","last_peered":"2023-10-08T15:40:14.427151+0000","last_clean":"2023-10-08T15:40:14.427151+0000","last_became_active":"2023-10-08T15:40:13.423112+0000","last_became_peered":"2023-10-08T15:40:13.423112+0000","last_unstale":"2023-10-08T15:40:14.427151+0000","last_undegraded":"2023-10-08T15:40:14.427151+0000","last_fullsized":"2023-10-08T15:40:14.427151+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:46:45.482090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.431724+0000","last_change":"2023-10-08T15:40:14.430127+0000","last_active":"2023-10-08T15:40:14.431724+0000","last_peered":"2023-10-08T15:40:14.431724+0000","last_clean":"2023-10-08T15:40:14.431724+0000","last_became_active":"2023-10-08T15:40:14.427661+0000","last_became_peered":"2023-10-08T15:40:14.427661+0000","last_unstale":"2023-10-08T15:40:14.431724+0000","last_undegraded":"2023-10-08T15:40:14.431724+0000","last_fullsized":"2023-10-08T15:40:14.431724+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:46.354499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.418694+0000","last_change":"2023-10-08T15:40:13.424672+0000","last_active":"2023-10-08T15:40:14.418694+0000","last_peered":"2023-10-08T15:40:14.418694+0000","last_clean":"2023-10-08T15:40:14.418694+0000","last_became_active":"2023-10-08T15:40:13.422477+0000","last_became_peered":"2023-10-08T15:40:13.422477+0000","last_unstale":"2023-10-08T15:40:14.418694+0000","last_undegraded":"2023-10-08T15:40:14.418694+0000","last_fullsized":"2023-10-08T15:40:14.418694+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:28:30.689512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.448959+0000","last_change":"2023-10-08T15:40:14.444779+0000","last_active":"2023-10-08T15:40:14.448959+0000","last_peered":"2023-10-08T15:40:14.448959+0000","last_clean":"2023-10-08T15:40:14.448959+0000","last_became_active":"2023-10-08T15:40:14.444212+0000","last_became_peered":"2023-10-08T15:40:14.444212+0000","last_unstale":"2023-10-08T15:40:14.448959+0000","last_undegraded":"2023-10-08T15:40:14.448959+0000","last_fullsized":"2023-10-08T15:40:14.448959+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:00:59.377632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"38'2","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.442217+0000","last_change":"2023-10-08T15:40:13.418998+0000","last_active":"2023-10-08T15:40:14.442217+0000","last_peered":"2023-10-08T15:40:14.442217+0000","last_clean":"2023-10-08T15:40:14.442217+0000","last_became_active":"2023-10-08T15:40:13.418647+0000","last_became_peered":"2023-10-08T15:40:13.418647+0000","last_unstale":"2023-10-08T15:40:14.442217+0000","last_undegraded":"2023-10-08T15:40:14.442217+0000","last_fullsized":"2023-10-08T15:40:14.442217+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:38:55.286225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":182,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.407928+0000","last_change":"2023-10-08T15:37:19.380955+0000","last_active":"2023-10-08T15:40:14.407928+0000","last_peered":"2023-10-08T15:40:14.407928+0000","last_clean":"2023-10-08T15:40:14.407928+0000","last_became_active":"2023-10-08T15:37:19.378277+0000","last_became_peered":"2023-10-08T15:37:19.378277+0000","last_unstale":"2023-10-08T15:40:14.407928+0000","last_undegraded":"2023-10-08T15:40:14.407928+0000","last_fullsized":"2023-10-08T15:40:14.407928+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:17.537726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:17.537726+0000","last_clean_scrub_stamp":"2023-10-08T15:37:17.537726+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:06:26.612046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66282,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542182,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305988,"kb_used_data":508,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065852,"statfs":{"total":96636764160,"available":96323432448,"internally_reserved":0,"allocated":520192,"data_stored":771145,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.94399999999999995,"15min":0.95999999999999996},"min":{"1min":0.64700000000000002,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.3460000000000001,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.93000000000000005,"15min":0.93100000000000005},"min":{"1min":0.66300000000000003,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.389,"5min":1.758,"15min":1.758},"last":0.83299999999999996}]},{"osd":1,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.90700000000000003,"15min":0.89400000000000002},"min":{"1min":0.59799999999999998,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.4299999999999999,"5min":1.474,"15min":1.474},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.96699999999999997,"15min":0.96299999999999997},"min":{"1min":0.71099999999999997,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.875}]},{"osd":2,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":1.016,"15min":1.0309999999999999},"min":{"1min":0.66000000000000003,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.268,"5min":1.623,"15min":1.623},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.0009999999999999,"15min":1.006},"min":{"1min":0.72799999999999998,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.1990000000000001,"5min":1.321,"15min":1.321},"last":1.0569999999999999}]},{"osd":3,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":0.98699999999999999,"15min":0.97399999999999998},"min":{"1min":0.82999999999999996,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.032},{"interface":"front","average":{"1min":1.222,"5min":1.2110000000000001,"15min":1.2090000000000001},"min":{"1min":1.012,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.69499999999999995}]},{"osd":4,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":1.073,"15min":1.089},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.298,"5min":1.512,"15min":1.512},"last":0.90900000000000003},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.095,"15min":1.1000000000000001},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.353,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":1.0860000000000001}]},{"osd":5,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.2509999999999999,"15min":1.272},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.573,"5min":1.74,"15min":1.74},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.163,"5min":1.236,"15min":1.248},"min":{"1min":0.88700000000000001,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.381,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":1.109}]},{"osd":6,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.2969999999999999,"15min":1.3169999999999999},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.4610000000000001,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.151,"5min":1.2410000000000001,"15min":1.256},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":1.411,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.80600000000000005}]}]},{"osd":6,"up_from":14,"seq":60129542183,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301832,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070008,"statfs":{"total":96636764160,"available":96327688192,"internally_reserved":0,"allocated":458752,"data_stored":181331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.84199999999999997,"15min":0.82399999999999995},"min":{"1min":0.70699999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.218,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.98399999999999999,"15min":0.997},"min":{"1min":0.71399999999999997,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.1890000000000001,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":0.81999999999999995}]},{"osd":1,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.94899999999999995,"15min":0.95699999999999996},"min":{"1min":0.70599999999999996,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.2729999999999999,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":1.3160000000000001},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.98599999999999999,"15min":0.98999999999999999},"min":{"1min":0.64600000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.397,"5min":1.853,"15min":1.853},"last":1.2689999999999999}]},{"osd":2,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.85699999999999998,"15min":0.84599999999999997},"min":{"1min":0.69299999999999995,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0649999999999999,"15min":1.0760000000000001},"min":{"1min":0.64700000000000002,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.4019999999999999,"5min":1.518,"15min":1.518},"last":1.5049999999999999}]},{"osd":3,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.0169999999999999,"15min":1.02},"min":{"1min":0.78300000000000003,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.3169999999999999,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.071,"15min":1.081},"min":{"1min":0.79600000000000004,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.296,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":0.997}]},{"osd":4,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":1.095,"15min":1.115},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.3360000000000001,"5min":1.484,"15min":1.484},"last":1.6899999999999999},{"interface":"front","average":{"1min":1.121,"5min":1.181,"15min":1.1910000000000001},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":1.399}]},{"osd":5,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.1160000000000001,"15min":1.125},"min":{"1min":0.753,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.329,"5min":1.581,"15min":1.581},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.294,"15min":1.3120000000000001},"min":{"1min":1.0049999999999999,"5min":0.96099999999999997,"15min":0.96099999999999997},"max":{"1min":1.417,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":1.8}]},{"osd":7,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.2709999999999999,"15min":1.2849999999999999},"min":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":1.4550000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":1.643},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.2969999999999999,"15min":1.3109999999999999},"min":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":1.5429999999999999,"5min":2.5630000000000002,"15min":2.5630000000000002},"last":1.4630000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542184,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305932,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065908,"statfs":{"total":96636764160,"available":96323489792,"internally_reserved":0,"allocated":462848,"data_stored":181297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.71199999999999997,"15min":0.71999999999999997},"min":{"1min":0.51200000000000001,"5min":0.501,"15min":0.501},"max":{"1min":0.96299999999999997,"5min":1.056,"15min":1.056},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.76800000000000002,"15min":0.76200000000000001},"min":{"1min":0.59699999999999998,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.66700000000000004}]},{"osd":1,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.72099999999999997,"15min":0.71299999999999997},"min":{"1min":0.56899999999999995,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.82399999999999995,"15min":0.81200000000000006},"min":{"1min":0.67000000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1870000000000001,"5min":1.256,"15min":1.256},"last":1.353}]},{"osd":2,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.85999999999999999,"15min":0.85399999999999998},"min":{"1min":0.66900000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.337,"5min":1.361,"15min":1.361},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.92200000000000004,"15min":0.92600000000000005},"min":{"1min":0.751,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.228,"5min":1.423,"15min":1.423},"last":0.75}]},{"osd":4,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.0820000000000001,"15min":1.0680000000000001},"min":{"1min":0.90000000000000002,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.3879999999999999,"5min":1.504,"15min":1.504},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.145,"15min":1.155},"min":{"1min":0.85599999999999998,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.4410000000000001,"5min":2.762,"15min":2.762},"last":0.98199999999999998}]},{"osd":5,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.1679999999999999,"15min":1.1619999999999999},"min":{"1min":0.92800000000000005,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.466,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.02},{"interface":"front","average":{"1min":1.22,"5min":1.2330000000000001,"15min":1.2350000000000001},"min":{"1min":0.95899999999999996,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.474,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":0.91800000000000004}]},{"osd":6,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.2889999999999999,"15min":1.304},"min":{"1min":0.97199999999999998,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.569,"5min":2.6890000000000001,"15min":2.6890000000000001},"last":1.248},{"interface":"front","average":{"1min":1.238,"5min":1.2250000000000001,"15min":1.2230000000000001},"min":{"1min":0.89100000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":1.462,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":1.286}]},{"osd":7,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.2649999999999999,"15min":1.2589999999999999},"min":{"1min":0.97699999999999998,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":1.528,"5min":1.738,"15min":1.738},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.3520000000000001,"15min":1.3620000000000001},"min":{"1min":1.1080000000000001,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.623,"5min":2.5840000000000001,"15min":2.5840000000000001},"last":1.3300000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542183,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301840,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070000,"statfs":{"total":96636764160,"available":96327680000,"internally_reserved":0,"allocated":466944,"data_stored":182245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.626,"15min":0.621},"min":{"1min":0.48799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.67200000000000004,"15min":0.64900000000000002},"min":{"1min":0.52800000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.61599999999999999}]},{"osd":1,"last update":"Sun Oct 8 15:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.69099999999999995,"15min":0.67700000000000005},"min":{"1min":0.59399999999999997,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.71599999999999997,"15min":0.69199999999999995},"min":{"1min":0.55400000000000005,"5min":0.307,"15min":0.307},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.69399999999999995}]},{"osd":3,"last update":"Sun Oct 8 15:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.66600000000000004,"15min":0.64200000000000002},"min":{"1min":0.52300000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.85299999999999998,"15min":0.84299999999999997},"min":{"1min":0.72299999999999998,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.127,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.65100000000000002}]},{"osd":4,"last update":"Sun Oct 8 15:39:23 2023","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.004,"15min":1},"min":{"1min":0.75600000000000001,"5min":0.748,"15min":0.748},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.028,"5min":1.0329999999999999,"15min":1.034},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.4319999999999999,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.133}]},{"osd":5,"last update":"Sun Oct 8 15:39:23 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.0589999999999999,"15min":1.0569999999999999},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":1.161},{"interface":"front","average":{"1min":1.091,"5min":1.0640000000000001,"15min":1.0600000000000001},"min":{"1min":0.81000000000000005,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.288,"5min":1.452,"15min":1.452},"last":1.2569999999999999}]},{"osd":6,"last update":"Sun Oct 8 15:39:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.0940000000000001,"15min":1.091},"min":{"1min":0.82699999999999996,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.4159999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":1.218},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.117,"15min":1.105},"min":{"1min":0.85499999999999998,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":1.0680000000000001}]},{"osd":7,"last update":"Sun Oct 8 15:39:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.159,"15min":1.1499999999999999},"min":{"1min":0.84899999999999998,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":1.288},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.1739999999999999,"15min":1.161},"min":{"1min":0.86299999999999999,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.579,"5min":1.804,"15min":1.804},"last":1.24}]}]},{"osd":1,"up_from":14,"seq":60129542184,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305924,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065916,"statfs":{"total":96636764160,"available":96323497984,"internally_reserved":0,"allocated":454656,"data_stored":180757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.76500000000000001,"15min":0.77500000000000002},"min":{"1min":0.46700000000000003,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.165,"5min":1.734,"15min":1.734},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.96299999999999997,"15min":1},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0509999999999999,"5min":5.7960000000000003,"15min":5.7960000000000003},"last":0.55900000000000005}]},{"osd":2,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.83299999999999996,"15min":0.84699999999999998},"min":{"1min":0.56200000000000006,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.048,"5min":4.0119999999999996,"15min":4.0119999999999996},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.90600000000000003,"15min":0.91000000000000003},"min":{"1min":0.61599999999999999,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.0840000000000001,"5min":1.853,"15min":1.853},"last":0.69699999999999995}]},{"osd":3,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":1.7569999999999999,"5min":1.121,"15min":1.0149999999999999},"min":{"1min":0.73399999999999999,"5min":0.435,"15min":0.435},"max":{"1min":13.388,"5min":13.388,"15min":13.388},"last":1.002},{"interface":"front","average":{"1min":1.6899999999999999,"5min":1.2549999999999999,"15min":1.1830000000000001},"min":{"1min":0.66100000000000003,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":13.353,"5min":13.353,"15min":13.353},"last":0.92000000000000004}]},{"osd":4,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":1.2070000000000001,"15min":1.246},"min":{"1min":0.77800000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.246,"5min":5.859,"15min":5.859},"last":0.81699999999999995},{"interface":"front","average":{"1min":1.022,"5min":1.1479999999999999,"15min":1.169},"min":{"1min":0.82199999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.4550000000000001,"5min":4.2679999999999998,"15min":4.2679999999999998},"last":0.95699999999999996}]},{"osd":5,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.143,"15min":1.151},"min":{"1min":0.85799999999999998,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.5389999999999999,"5min":4.3380000000000001,"15min":4.3380000000000001},"last":1.123},{"interface":"front","average":{"1min":1.216,"5min":1.1890000000000001,"15min":1.1850000000000001},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.589,"5min":2.085,"15min":2.085},"last":0.73699999999999999}]},{"osd":6,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.359,"15min":1.3919999999999999},"min":{"1min":0.93600000000000005,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.4119999999999999,"5min":5.8979999999999997,"15min":5.8979999999999997},"last":1.323},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.274,"15min":1.284},"min":{"1min":1.0249999999999999,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.4390000000000001,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":1.401}]},{"osd":7,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.2549999999999999,"15min":1.2509999999999999},"min":{"1min":0.93400000000000005,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.679,"5min":2.3940000000000001,"15min":2.3940000000000001},"last":1.266},{"interface":"front","average":{"1min":1.222,"5min":1.46,"15min":1.5},"min":{"1min":1.0209999999999999,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.387,"5min":5.9299999999999997,"15min":5.9299999999999997},"last":1.2190000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542184,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301892,"kb_used_data":508,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069948,"statfs":{"total":96636764160,"available":96327626752,"internally_reserved":0,"allocated":520192,"data_stored":771089,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 15:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.81899999999999995,"15min":0.84199999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.3799999999999999,"5min":1.514,"15min":1.514},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.79200000000000004,"15min":0.79800000000000004},"min":{"1min":0.50600000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.999,"5min":1.518,"15min":1.518},"last":0.55900000000000005}]},{"osd":2,"last update":"Sun Oct 8 15:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.84499999999999997,"15min":0.86399999999999999},"min":{"1min":0.55400000000000005,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1539999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.79600000000000004,"15min":0.78900000000000003},"min":{"1min":0.61599999999999999,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.0800000000000001,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.44}]},{"osd":3,"last update":"Sun Oct 8 15:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.75600000000000001,"15min":0.76000000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.091,"5min":1.103,"15min":1.103},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.98499999999999999,"15min":0.995},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.474,"5min":2.3290000000000002,"15min":2.3290000000000002},"last":0.85299999999999998}]},{"osd":4,"last update":"Sun Oct 8 15:39:20 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.085,"15min":1.095},"min":{"1min":0.76000000000000001,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.49,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.093,"15min":1.0980000000000001},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.538,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":1.0880000000000001}]},{"osd":5,"last update":"Sun Oct 8 15:39:20 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0900000000000001,"15min":1.101},"min":{"1min":0.72099999999999997,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.413,"5min":2.214,"15min":2.214},"last":1.222},{"interface":"front","average":{"1min":1.151,"5min":1.323,"15min":1.3520000000000001},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.5269999999999999,"5min":3.4569999999999999,"15min":3.4569999999999999},"last":1.1359999999999999}]},{"osd":6,"last update":"Sun Oct 8 15:39:20 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.29,"15min":1.3080000000000001},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":1.575,"5min":2.532,"15min":2.532},"last":1.044},{"interface":"front","average":{"1min":1.216,"5min":1.244,"15min":1.2490000000000001},"min":{"1min":0.92700000000000005,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.6200000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.99099999999999999}]},{"osd":7,"last update":"Sun Oct 8 15:39:20 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.292,"15min":1.3},"min":{"1min":1.01,"5min":0.98199999999999998,"15min":0.98199999999999998},"max":{"1min":1.571,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.2310000000000001,"15min":1.2350000000000001},"min":{"1min":0.85199999999999998,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.597,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":1.167}]}]},{"osd":5,"up_from":13,"seq":55834574887,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301816,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070024,"statfs":{"total":96636764160,"available":96327704576,"internally_reserved":0,"allocated":442368,"data_stored":174469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.85599999999999998,"15min":0.84799999999999998},"min":{"1min":0.53600000000000003,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.90700000000000003,"15min":0.91000000000000003},"min":{"1min":0.67400000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.147,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.81399999999999995}]},{"osd":1,"last update":"Sun Oct 8 15:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.92000000000000004,"15min":0.91100000000000003},"min":{"1min":0.628,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.88,"5min":0.97599999999999998,"15min":0.99199999999999999},"min":{"1min":0.68500000000000005,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1799999999999999,"5min":1.754,"15min":1.754},"last":0.56999999999999995}]},{"osd":2,"last update":"Sun Oct 8 15:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.306,"5min":1.869,"15min":1.869},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.97499999999999998,"5min":1.0109999999999999,"15min":1.0169999999999999},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.484,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.86199999999999999}]},{"osd":3,"last update":"Sun Oct 8 15:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.997,"15min":1.0009999999999999},"min":{"1min":0.78300000000000003,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.2110000000000001,"5min":1.929,"15min":1.929},"last":0.92500000000000004},{"interface":"front","average":{"1min":1.022,"5min":1.101,"15min":1.1140000000000001},"min":{"1min":0.745,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.3140000000000001,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":1.169}]},{"osd":4,"last update":"Sun Oct 8 15:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.0109999999999999,"15min":1.014},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.464,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":1.266},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.085,"15min":1.085},"min":{"1min":0.67600000000000005,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.601,"5min":1.823,"15min":1.823},"last":1.073}]},{"osd":6,"last update":"Sun Oct 8 15:39:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.202,"15min":1.2070000000000001},"min":{"1min":0.95899999999999996,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.429,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":1.319},{"interface":"front","average":{"1min":1.165,"5min":1.2290000000000001,"15min":1.24},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.6739999999999999,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.214}]},{"osd":7,"last update":"Sun Oct 8 15:39:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.155,"15min":1.167},"min":{"1min":0.89800000000000002,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.272,"5min":2.177,"15min":2.177},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.2190000000000001,"15min":1.2210000000000001},"min":{"1min":1.0089999999999999,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.575,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.3720000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574887,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301836,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070004,"statfs":{"total":96636764160,"available":96327684096,"internally_reserved":0,"allocated":462848,"data_stored":182223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.82199999999999995,"15min":0.81000000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.79000000000000004,"15min":0.78700000000000003},"min":{"1min":0.59199999999999997,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":1.0429999999999999}]},{"osd":1,"last update":"Sun Oct 8 15:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.84499999999999997,"15min":0.83199999999999996},"min":{"1min":0.66200000000000003,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83099999999999996,"15min":0.82999999999999996},"min":{"1min":0.68799999999999994,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.149,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":1.383}]},{"osd":2,"last update":"Sun Oct 8 15:39:20 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.048,"15min":1.034},"min":{"1min":0.80100000000000005,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.3380000000000001,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":1.2969999999999999},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.012,"15min":1.0189999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.268,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":1.123}]},{"osd":3,"last update":"Sun Oct 8 15:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":1.0129999999999999,"15min":1.0189999999999999},"min":{"1min":0.72599999999999998,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.3169999999999999,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.036,"15min":1.0329999999999999},"min":{"1min":0.77400000000000002,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":1.1499999999999999}]},{"osd":5,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":0.98599999999999999,"15min":0.97099999999999997},"min":{"1min":0.79500000000000004,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0649999999999999,"15min":1.0609999999999999},"min":{"1min":0.67800000000000005,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.83799999999999997}]},{"osd":6,"last update":"Sun Oct 8 15:39:20 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.139,"15min":1.147},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.319,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.204},{"interface":"front","average":{"1min":1.179,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.91400000000000003,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.4159999999999999,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":1.1819999999999999}]},{"osd":7,"last update":"Sun Oct 8 15:39:20 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.0740000000000001,"15min":1.0680000000000001},"min":{"1min":0.755,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.196,"15min":1.1910000000000001},"min":{"1min":0.96699999999999997,"5min":0.625,"15min":0.625},"max":{"1min":1.587,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.077}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T15:40:20.011 INFO:tasks.ceph.mds.a.smithi003.stderr:2023-10-08T15:40:19.703+0000 7f724e261700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T15:40:23.012 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T15:40:23.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.131+0000 7fc6214f0700 1 Processor -- start 2023-10-08T15:40:23.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.131+0000 7fc6214f0700 1 -- start start 2023-10-08T15:40:23.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.131+0000 7fc6214f0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc61c09ef40 0x7fc61c0c0590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:23.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.131+0000 7fc6214f0700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fc61c0ba440 0x7fc61c14eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:23.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.131+0000 7fc6214f0700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc61c153a70 con 0x7fc61c067310 2023-10-08T15:40:23.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.131+0000 7fc6214f0700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc61c09f460 con 0x7fc61c0ba440 2023-10-08T15:40:23.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.131+0000 7fc6214f0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc61c153de0 con 0x7fc61c09ef40 2023-10-08T15:40:23.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.131+0000 7fc61bfff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fc61c067310 0x7fc61c0bfe80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:49620/0 (socket says 172.21.15.3:49620) 2023-10-08T15:40:23.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.131+0000 7fc61bfff700 1 -- 172.21.15.3:0/2177255814 learned_addr learned my addr 172.21.15.3:0/2177255814 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:40:23.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.131+0000 7fc620cef700 1 --2- 172.21.15.3:0/2177255814 >> v2:172.21.15.3:3300/0 conn(0x7fc61c0ba440 0x7fc61c14eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:23.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.131+0000 7fc61b7fe700 1 --2- 172.21.15.3:0/2177255814 >> v2:172.21.15.50:3300/0 conn(0x7fc61c09ef40 0x7fc61c0c0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:23.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.131+0000 7fc620cef700 1 -- 172.21.15.3:0/2177255814 >> v2:172.21.15.50:3300/0 conn(0x7fc61c09ef40 msgr2=0x7fc61c0c0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:23.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.131+0000 7fc620cef700 1 --2- 172.21.15.3:0/2177255814 >> v2:172.21.15.50:3300/0 conn(0x7fc61c09ef40 0x7fc61c0c0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:23.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.131+0000 7fc620cef700 1 -- 172.21.15.3:0/2177255814 >> v1:172.21.15.3:6789/0 conn(0x7fc61c067310 legacy=0x7fc61c0bfe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:23.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.131+0000 7fc620cef700 1 -- 172.21.15.3:0/2177255814 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc61c0bc410 con 0x7fc61c0ba440 2023-10-08T15:40:23.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.131+0000 7fc620cef700 1 --2- 172.21.15.3:0/2177255814 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc61c0ba440 0x7fc61c14eaa0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc61c0bc920 tx=0x7fc60c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7f6628141a387d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:23.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.131+0000 7fc61affd700 1 -- 172.21.15.3:0/2177255814 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60c005c60 con 0x7fc61c0ba440 2023-10-08T15:40:23.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.131+0000 7fc61affd700 1 -- 172.21.15.3:0/2177255814 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc60c005e00 con 0x7fc61c0ba440 2023-10-08T15:40:23.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.131+0000 7fc61affd700 1 -- 172.21.15.3:0/2177255814 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60c006280 con 0x7fc61c0ba440 2023-10-08T15:40:23.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.135+0000 7fc6214f0700 1 -- 172.21.15.3:0/2177255814 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc61c0ba440 msgr2=0x7fc61c14eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:23.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.135+0000 7fc6214f0700 1 --2- 172.21.15.3:0/2177255814 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc61c0ba440 0x7fc61c14eaa0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc61c0bc920 tx=0x7fc60c0091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:23.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.135+0000 7fc6214f0700 1 -- 172.21.15.3:0/2177255814 shutdown_connections 2023-10-08T15:40:23.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.135+0000 7fc6214f0700 1 --2- 172.21.15.3:0/2177255814 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc61c0ba440 0x7fc61c14eaa0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:23.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.135+0000 7fc6214f0700 1 --2- 172.21.15.3:0/2177255814 >> v2:172.21.15.50:3300/0 conn(0x7fc61c09ef40 0x7fc61c0c0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:23.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.135+0000 7fc6214f0700 1 -- 172.21.15.3:0/2177255814 >> 172.21.15.3:0/2177255814 conn(0x7fc61c06dfb0 msgr2=0x7fc61c06e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:23.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.135+0000 7fc6214f0700 1 -- 172.21.15.3:0/2177255814 shutdown_connections 2023-10-08T15:40:23.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.135+0000 7fc6214f0700 1 -- 172.21.15.3:0/2177255814 wait complete. 2023-10-08T15:40:23.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.135+0000 7fc6214f0700 1 Processor -- start 2023-10-08T15:40:23.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.135+0000 7fc6214f0700 1 -- start start 2023-10-08T15:40:23.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.139+0000 7fc6214f0700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc61c067310 0x7fc61c161e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:23.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.139+0000 7fc6214f0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc61c09ef40 0x7fc61c1546e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:23.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.139+0000 7fc6214f0700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc61c0ba440 0x7fc61c0a0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:23.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.139+0000 7fc6214f0700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61c0a0570 con 0x7fc61c067310 2023-10-08T15:40:23.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.139+0000 7fc6214f0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61c0a0b30 con 0x7fc61c09ef40 2023-10-08T15:40:23.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.139+0000 7fc6214f0700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc61c160690 con 0x7fc61c0ba440 2023-10-08T15:40:23.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.139+0000 7fc61bfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc61c067310 0x7fc61c161e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:23.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.139+0000 7fc61bfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc61c067310 0x7fc61c161e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52712/0 (socket says 172.21.15.3:52712) 2023-10-08T15:40:23.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.139+0000 7fc61bfff700 1 -- 172.21.15.3:0/3326972048 learned_addr learned my addr 172.21.15.3:0/3326972048 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:23.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.139+0000 7fc61b7fe700 1 --2- 172.21.15.3:0/3326972048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc61c09ef40 0x7fc61c1546e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:23.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.139+0000 7fc620cef700 1 --2- 172.21.15.3:0/3326972048 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc61c0ba440 0x7fc61c0a0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:23.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.139+0000 7fc61bfff700 1 -- 172.21.15.3:0/3326972048 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc61c0ba440 msgr2=0x7fc61c0a0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:23.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.139+0000 7fc61bfff700 1 --2- 172.21.15.3:0/3326972048 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc61c0ba440 0x7fc61c0a0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:23.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.139+0000 7fc61bfff700 1 -- 172.21.15.3:0/3326972048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc61c09ef40 msgr2=0x7fc61c1546e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:23.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.139+0000 7fc61bfff700 1 --2- 172.21.15.3:0/3326972048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc61c09ef40 0x7fc61c1546e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:23.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.139+0000 7fc61bfff700 1 -- 172.21.15.3:0/3326972048 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc60c009420 con 0x7fc61c067310 2023-10-08T15:40:23.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.139+0000 7fc620cef700 1 --2- 172.21.15.3:0/3326972048 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc61c0ba440 0x7fc61c0a0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:40:23.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.139+0000 7fc61bfff700 1 --2- 172.21.15.3:0/3326972048 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc61c067310 0x7fc61c161e40 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc61000c7f0 tx=0x7fc610007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:23.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.139+0000 7fc603fff700 1 -- 172.21.15.3:0/3326972048 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc610005b30 con 0x7fc61c067310 2023-10-08T15:40:23.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.139+0000 7fc603fff700 1 -- 172.21.15.3:0/3326972048 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc610005cb0 con 0x7fc61c067310 2023-10-08T15:40:23.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.139+0000 7fc603fff700 1 -- 172.21.15.3:0/3326972048 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc610004a80 con 0x7fc61c067310 2023-10-08T15:40:23.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.139+0000 7fc6214f0700 1 -- 172.21.15.3:0/3326972048 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc61c156670 con 0x7fc61c067310 2023-10-08T15:40:23.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.139+0000 7fc6214f0700 1 -- 172.21.15.3:0/3326972048 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc61c14d080 con 0x7fc61c067310 2023-10-08T15:40:23.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.139+0000 7fc6214f0700 1 -- 172.21.15.3:0/3326972048 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc61c0a0960 con 0x7fc61c067310 2023-10-08T15:40:23.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.143+0000 7fc603fff700 1 -- 172.21.15.3:0/3326972048 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc6100070d0 con 0x7fc61c067310 2023-10-08T15:40:23.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.143+0000 7fc603fff700 1 --2- 172.21.15.3:0/3326972048 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc608060620 0x7fc608062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:23.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.143+0000 7fc603fff700 1 -- 172.21.15.3:0/3326972048 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc61007bab0 con 0x7fc61c067310 2023-10-08T15:40:23.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.143+0000 7fc61b7fe700 1 --2- 172.21.15.3:0/3326972048 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc608060620 0x7fc608062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:23.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.143+0000 7fc61b7fe700 1 --2- 172.21.15.3:0/3326972048 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc608060620 0x7fc608062ad0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc614009fd0 tx=0x7fc61400b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:23.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.151+0000 7fc603fff700 1 -- 172.21.15.3:0/3326972048 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc610049be0 con 0x7fc61c067310 2023-10-08T15:40:23.320 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.315+0000 7fc6214f0700 1 -- 172.21.15.3:0/3326972048 --> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc61c0a0c70 con 0x7fc608060620 2023-10-08T15:40:23.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.331+0000 7fc603fff700 1 -- 172.21.15.3:0/3326972048 <== mgr.4102 v2:172.21.15.50:6832/33268 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287297 (secure 0 0 0) 0x7fc61400f040 con 0x7fc608060620 2023-10-08T15:40:23.340 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:40:23.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.339+0000 7fc6214f0700 1 -- 172.21.15.3:0/3326972048 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc608060620 msgr2=0x7fc608062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:23.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.339+0000 7fc6214f0700 1 --2- 172.21.15.3:0/3326972048 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc608060620 0x7fc608062ad0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc614009fd0 tx=0x7fc61400b040 comp rx=0 tx=0).stop 2023-10-08T15:40:23.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.339+0000 7fc6214f0700 1 -- 172.21.15.3:0/3326972048 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc61c067310 msgr2=0x7fc61c161e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:23.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.339+0000 7fc6214f0700 1 --2- 172.21.15.3:0/3326972048 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc61c067310 0x7fc61c161e40 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc61000c7f0 tx=0x7fc610007f70 comp rx=0 tx=0).stop 2023-10-08T15:40:23.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.339+0000 7fc6214f0700 1 -- 172.21.15.3:0/3326972048 shutdown_connections 2023-10-08T15:40:23.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.339+0000 7fc6214f0700 1 --2- 172.21.15.3:0/3326972048 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc608060620 0x7fc608062ad0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:23.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.339+0000 7fc6214f0700 1 --2- 172.21.15.3:0/3326972048 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc61c0ba440 0x7fc61c0a0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:23.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.339+0000 7fc6214f0700 1 --2- 172.21.15.3:0/3326972048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc61c09ef40 0x7fc61c1546e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:23.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.339+0000 7fc6214f0700 1 --2- 172.21.15.3:0/3326972048 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc61c067310 0x7fc61c161e40 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:23.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.339+0000 7fc6214f0700 1 -- 172.21.15.3:0/3326972048 >> 172.21.15.3:0/3326972048 conn(0x7fc61c06dfb0 msgr2=0x7fc61c0be6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:23.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.339+0000 7fc6214f0700 1 -- 172.21.15.3:0/3326972048 shutdown_connections 2023-10-08T15:40:23.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.339+0000 7fc6214f0700 1 -- 172.21.15.3:0/3326972048 wait complete. 2023-10-08T15:40:23.344 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2023-10-08T15:40:23.358 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":125,"stamp":"2023-10-08T15:40:22.578733+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2427072,"kb_used_data":3712,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752547648,"statfs":{"total":773094113280,"available":770608791552,"internally_reserved":0,"allocated":3801088,"data_stored":2630844,"data_compressed":66282,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.174469"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.435951+0000","last_change":"2023-10-08T15:40:14.423891+0000","last_active":"2023-10-08T15:40:14.435951+0000","last_peered":"2023-10-08T15:40:14.435951+0000","last_clean":"2023-10-08T15:40:14.435951+0000","last_became_active":"2023-10-08T15:40:14.423583+0000","last_became_peered":"2023-10-08T15:40:14.423583+0000","last_unstale":"2023-10-08T15:40:14.435951+0000","last_undegraded":"2023-10-08T15:40:14.435951+0000","last_fullsized":"2023-10-08T15:40:14.435951+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:28.192248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.432580+0000","last_change":"2023-10-08T15:40:14.428931+0000","last_active":"2023-10-08T15:40:14.432580+0000","last_peered":"2023-10-08T15:40:14.432580+0000","last_clean":"2023-10-08T15:40:14.432580+0000","last_became_active":"2023-10-08T15:40:14.428612+0000","last_became_peered":"2023-10-08T15:40:14.428612+0000","last_unstale":"2023-10-08T15:40:14.432580+0000","last_undegraded":"2023-10-08T15:40:14.432580+0000","last_fullsized":"2023-10-08T15:40:14.432580+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:57:32.025855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.431747+0000","last_change":"2023-10-08T15:40:14.430136+0000","last_active":"2023-10-08T15:40:14.431747+0000","last_peered":"2023-10-08T15:40:14.431747+0000","last_clean":"2023-10-08T15:40:14.431747+0000","last_became_active":"2023-10-08T15:40:14.428007+0000","last_became_peered":"2023-10-08T15:40:14.428007+0000","last_unstale":"2023-10-08T15:40:14.431747+0000","last_undegraded":"2023-10-08T15:40:14.431747+0000","last_fullsized":"2023-10-08T15:40:14.431747+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:32:50.871662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.439617+0000","last_change":"2023-10-08T15:40:14.430064+0000","last_active":"2023-10-08T15:40:14.439617+0000","last_peered":"2023-10-08T15:40:14.439617+0000","last_clean":"2023-10-08T15:40:14.439617+0000","last_became_active":"2023-10-08T15:40:14.428442+0000","last_became_peered":"2023-10-08T15:40:14.428442+0000","last_unstale":"2023-10-08T15:40:14.439617+0000","last_undegraded":"2023-10-08T15:40:14.439617+0000","last_fullsized":"2023-10-08T15:40:14.439617+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:32:50.871662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.430602+0000","last_change":"2023-10-08T15:40:14.427554+0000","last_active":"2023-10-08T15:40:14.430602+0000","last_peered":"2023-10-08T15:40:14.430602+0000","last_clean":"2023-10-08T15:40:14.430602+0000","last_became_active":"2023-10-08T15:40:14.427263+0000","last_became_peered":"2023-10-08T15:40:14.427263+0000","last_unstale":"2023-10-08T15:40:14.430602+0000","last_undegraded":"2023-10-08T15:40:14.430602+0000","last_fullsized":"2023-10-08T15:40:14.430602+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:16:37.068213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.430617+0000","last_change":"2023-10-08T15:40:14.424638+0000","last_active":"2023-10-08T15:40:14.430617+0000","last_peered":"2023-10-08T15:40:14.430617+0000","last_clean":"2023-10-08T15:40:14.430617+0000","last_became_active":"2023-10-08T15:40:14.424340+0000","last_became_peered":"2023-10-08T15:40:14.424340+0000","last_unstale":"2023-10-08T15:40:14.430617+0000","last_undegraded":"2023-10-08T15:40:14.430617+0000","last_fullsized":"2023-10-08T15:40:14.430617+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:15:22.556584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.425697+0000","last_change":"2023-10-08T15:40:14.417067+0000","last_active":"2023-10-08T15:40:14.425697+0000","last_peered":"2023-10-08T15:40:14.425697+0000","last_clean":"2023-10-08T15:40:14.425697+0000","last_became_active":"2023-10-08T15:40:14.416679+0000","last_became_peered":"2023-10-08T15:40:14.416679+0000","last_unstale":"2023-10-08T15:40:14.425697+0000","last_undegraded":"2023-10-08T15:40:14.425697+0000","last_fullsized":"2023-10-08T15:40:14.425697+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:37:17.376921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.439487+0000","last_change":"2023-10-08T15:40:14.428491+0000","last_active":"2023-10-08T15:40:14.439487+0000","last_peered":"2023-10-08T15:40:14.439487+0000","last_clean":"2023-10-08T15:40:14.439487+0000","last_became_active":"2023-10-08T15:40:14.428218+0000","last_became_peered":"2023-10-08T15:40:14.428218+0000","last_unstale":"2023-10-08T15:40:14.439487+0000","last_undegraded":"2023-10-08T15:40:14.439487+0000","last_fullsized":"2023-10-08T15:40:14.439487+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:16:37.068213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.444108+0000","last_change":"2023-10-08T15:40:14.436179+0000","last_active":"2023-10-08T15:40:14.444108+0000","last_peered":"2023-10-08T15:40:14.444108+0000","last_clean":"2023-10-08T15:40:14.444108+0000","last_became_active":"2023-10-08T15:40:14.435907+0000","last_became_peered":"2023-10-08T15:40:14.435907+0000","last_unstale":"2023-10-08T15:40:14.444108+0000","last_undegraded":"2023-10-08T15:40:14.444108+0000","last_fullsized":"2023-10-08T15:40:14.444108+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:19.169692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.439541+0000","last_change":"2023-10-08T15:40:14.429862+0000","last_active":"2023-10-08T15:40:14.439541+0000","last_peered":"2023-10-08T15:40:14.439541+0000","last_clean":"2023-10-08T15:40:14.439541+0000","last_became_active":"2023-10-08T15:40:14.429448+0000","last_became_peered":"2023-10-08T15:40:14.429448+0000","last_unstale":"2023-10-08T15:40:14.439541+0000","last_undegraded":"2023-10-08T15:40:14.439541+0000","last_fullsized":"2023-10-08T15:40:14.439541+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:54:26.469514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.444187+0000","last_change":"2023-10-08T15:40:14.437444+0000","last_active":"2023-10-08T15:40:14.444187+0000","last_peered":"2023-10-08T15:40:14.444187+0000","last_clean":"2023-10-08T15:40:14.444187+0000","last_became_active":"2023-10-08T15:40:14.437109+0000","last_became_peered":"2023-10-08T15:40:14.437109+0000","last_unstale":"2023-10-08T15:40:14.444187+0000","last_undegraded":"2023-10-08T15:40:14.444187+0000","last_fullsized":"2023-10-08T15:40:14.444187+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:55:30.274824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.432670+0000","last_change":"2023-10-08T15:40:14.429541+0000","last_active":"2023-10-08T15:40:14.432670+0000","last_peered":"2023-10-08T15:40:14.432670+0000","last_clean":"2023-10-08T15:40:14.432670+0000","last_became_active":"2023-10-08T15:40:14.429220+0000","last_became_peered":"2023-10-08T15:40:14.429220+0000","last_unstale":"2023-10-08T15:40:14.432670+0000","last_undegraded":"2023-10-08T15:40:14.432670+0000","last_fullsized":"2023-10-08T15:40:14.432670+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:32:50.871662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.429796+0000","last_change":"2023-10-08T15:40:14.424634+0000","last_active":"2023-10-08T15:40:14.429796+0000","last_peered":"2023-10-08T15:40:14.429796+0000","last_clean":"2023-10-08T15:40:14.429796+0000","last_became_active":"2023-10-08T15:40:14.424344+0000","last_became_peered":"2023-10-08T15:40:14.424344+0000","last_unstale":"2023-10-08T15:40:14.429796+0000","last_undegraded":"2023-10-08T15:40:14.429796+0000","last_fullsized":"2023-10-08T15:40:14.429796+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:23.701420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.443836+0000","last_change":"2023-10-08T15:40:14.432495+0000","last_active":"2023-10-08T15:40:14.443836+0000","last_peered":"2023-10-08T15:40:14.443836+0000","last_clean":"2023-10-08T15:40:14.443836+0000","last_became_active":"2023-10-08T15:40:14.431718+0000","last_became_peered":"2023-10-08T15:40:14.431718+0000","last_unstale":"2023-10-08T15:40:14.443836+0000","last_undegraded":"2023-10-08T15:40:14.443836+0000","last_fullsized":"2023-10-08T15:40:14.443836+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:38:59.192155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.430645+0000","last_change":"2023-10-08T15:40:14.425401+0000","last_active":"2023-10-08T15:40:14.430645+0000","last_peered":"2023-10-08T15:40:14.430645+0000","last_clean":"2023-10-08T15:40:14.430645+0000","last_became_active":"2023-10-08T15:40:14.424995+0000","last_became_peered":"2023-10-08T15:40:14.424995+0000","last_unstale":"2023-10-08T15:40:14.430645+0000","last_undegraded":"2023-10-08T15:40:14.430645+0000","last_fullsized":"2023-10-08T15:40:14.430645+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:35:53.516838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.431628+0000","last_change":"2023-10-08T15:40:14.426307+0000","last_active":"2023-10-08T15:40:14.431628+0000","last_peered":"2023-10-08T15:40:14.431628+0000","last_clean":"2023-10-08T15:40:14.431628+0000","last_became_active":"2023-10-08T15:40:14.425764+0000","last_became_peered":"2023-10-08T15:40:14.425764+0000","last_unstale":"2023-10-08T15:40:14.431628+0000","last_undegraded":"2023-10-08T15:40:14.431628+0000","last_fullsized":"2023-10-08T15:40:14.431628+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:47:51.523520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.427782+0000","last_change":"2023-10-08T15:40:14.425512+0000","last_active":"2023-10-08T15:40:14.427782+0000","last_peered":"2023-10-08T15:40:14.427782+0000","last_clean":"2023-10-08T15:40:14.427782+0000","last_became_active":"2023-10-08T15:40:14.425211+0000","last_became_peered":"2023-10-08T15:40:14.425211+0000","last_unstale":"2023-10-08T15:40:14.427782+0000","last_undegraded":"2023-10-08T15:40:14.427782+0000","last_fullsized":"2023-10-08T15:40:14.427782+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:55:30.274824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.440793+0000","last_change":"2023-10-08T15:40:14.438477+0000","last_active":"2023-10-08T15:40:14.440793+0000","last_peered":"2023-10-08T15:40:14.440793+0000","last_clean":"2023-10-08T15:40:14.440793+0000","last_became_active":"2023-10-08T15:40:14.438140+0000","last_became_peered":"2023-10-08T15:40:14.438140+0000","last_unstale":"2023-10-08T15:40:14.440793+0000","last_undegraded":"2023-10-08T15:40:14.440793+0000","last_fullsized":"2023-10-08T15:40:14.440793+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:54:26.469514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.432902+0000","last_change":"2023-10-08T15:40:14.429356+0000","last_active":"2023-10-08T15:40:14.432902+0000","last_peered":"2023-10-08T15:40:14.432902+0000","last_clean":"2023-10-08T15:40:14.432902+0000","last_became_active":"2023-10-08T15:40:14.429006+0000","last_became_peered":"2023-10-08T15:40:14.429006+0000","last_unstale":"2023-10-08T15:40:14.432902+0000","last_undegraded":"2023-10-08T15:40:14.432902+0000","last_fullsized":"2023-10-08T15:40:14.432902+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:59:25.720384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.432988+0000","last_change":"2023-10-08T15:40:14.426309+0000","last_active":"2023-10-08T15:40:14.432988+0000","last_peered":"2023-10-08T15:40:14.432988+0000","last_clean":"2023-10-08T15:40:14.432988+0000","last_became_active":"2023-10-08T15:40:14.426020+0000","last_became_peered":"2023-10-08T15:40:14.426020+0000","last_unstale":"2023-10-08T15:40:14.432988+0000","last_undegraded":"2023-10-08T15:40:14.432988+0000","last_fullsized":"2023-10-08T15:40:14.432988+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:11:59.571805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.426458+0000","last_change":"2023-10-08T15:40:14.422657+0000","last_active":"2023-10-08T15:40:14.426458+0000","last_peered":"2023-10-08T15:40:14.426458+0000","last_clean":"2023-10-08T15:40:14.426458+0000","last_became_active":"2023-10-08T15:40:14.422369+0000","last_became_peered":"2023-10-08T15:40:14.422369+0000","last_unstale":"2023-10-08T15:40:14.426458+0000","last_undegraded":"2023-10-08T15:40:14.426458+0000","last_fullsized":"2023-10-08T15:40:14.426458+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:34:36.429348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.439773+0000","last_change":"2023-10-08T15:40:14.429752+0000","last_active":"2023-10-08T15:40:14.439773+0000","last_peered":"2023-10-08T15:40:14.439773+0000","last_clean":"2023-10-08T15:40:14.439773+0000","last_became_active":"2023-10-08T15:40:14.429492+0000","last_became_peered":"2023-10-08T15:40:14.429492+0000","last_unstale":"2023-10-08T15:40:14.439773+0000","last_undegraded":"2023-10-08T15:40:14.439773+0000","last_fullsized":"2023-10-08T15:40:14.439773+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:46.354499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.447269+0000","last_change":"2023-10-08T15:40:14.445792+0000","last_active":"2023-10-08T15:40:14.447269+0000","last_peered":"2023-10-08T15:40:14.447269+0000","last_clean":"2023-10-08T15:40:14.447269+0000","last_became_active":"2023-10-08T15:40:14.445487+0000","last_became_peered":"2023-10-08T15:40:14.445487+0000","last_unstale":"2023-10-08T15:40:14.447269+0000","last_undegraded":"2023-10-08T15:40:14.447269+0000","last_fullsized":"2023-10-08T15:40:14.447269+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:46:46.494060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.435410+0000","last_change":"2023-10-08T15:40:14.433543+0000","last_active":"2023-10-08T15:40:14.435410+0000","last_peered":"2023-10-08T15:40:14.435410+0000","last_clean":"2023-10-08T15:40:14.435410+0000","last_became_active":"2023-10-08T15:40:14.433202+0000","last_became_peered":"2023-10-08T15:40:14.433202+0000","last_unstale":"2023-10-08T15:40:14.435410+0000","last_undegraded":"2023-10-08T15:40:14.435410+0000","last_fullsized":"2023-10-08T15:40:14.435410+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:02:38.806363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.435355+0000","last_change":"2023-10-08T15:40:14.434060+0000","last_active":"2023-10-08T15:40:14.435355+0000","last_peered":"2023-10-08T15:40:14.435355+0000","last_clean":"2023-10-08T15:40:14.435355+0000","last_became_active":"2023-10-08T15:40:14.433662+0000","last_became_peered":"2023-10-08T15:40:14.433662+0000","last_unstale":"2023-10-08T15:40:14.435355+0000","last_undegraded":"2023-10-08T15:40:14.435355+0000","last_fullsized":"2023-10-08T15:40:14.435355+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:54.703533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.429752+0000","last_change":"2023-10-08T15:40:14.424529+0000","last_active":"2023-10-08T15:40:14.429752+0000","last_peered":"2023-10-08T15:40:14.429752+0000","last_clean":"2023-10-08T15:40:14.429752+0000","last_became_active":"2023-10-08T15:40:14.424220+0000","last_became_peered":"2023-10-08T15:40:14.424220+0000","last_unstale":"2023-10-08T15:40:14.429752+0000","last_undegraded":"2023-10-08T15:40:14.429752+0000","last_fullsized":"2023-10-08T15:40:14.429752+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:46:47.332461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.422109+0000","last_change":"2023-10-08T15:40:14.420119+0000","last_active":"2023-10-08T15:40:14.422109+0000","last_peered":"2023-10-08T15:40:14.422109+0000","last_clean":"2023-10-08T15:40:14.422109+0000","last_became_active":"2023-10-08T15:40:14.419787+0000","last_became_peered":"2023-10-08T15:40:14.419787+0000","last_unstale":"2023-10-08T15:40:14.422109+0000","last_undegraded":"2023-10-08T15:40:14.422109+0000","last_fullsized":"2023-10-08T15:40:14.422109+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:19:38.120631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.430534+0000","last_change":"2023-10-08T15:40:14.426548+0000","last_active":"2023-10-08T15:40:14.430534+0000","last_peered":"2023-10-08T15:40:14.430534+0000","last_clean":"2023-10-08T15:40:14.430534+0000","last_became_active":"2023-10-08T15:40:14.426214+0000","last_became_peered":"2023-10-08T15:40:14.426214+0000","last_unstale":"2023-10-08T15:40:14.430534+0000","last_undegraded":"2023-10-08T15:40:14.430534+0000","last_fullsized":"2023-10-08T15:40:14.430534+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:38:59.192155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.436211+0000","last_change":"2023-10-08T15:40:14.434569+0000","last_active":"2023-10-08T15:40:14.436211+0000","last_peered":"2023-10-08T15:40:14.436211+0000","last_clean":"2023-10-08T15:40:14.436211+0000","last_became_active":"2023-10-08T15:40:14.434260+0000","last_became_peered":"2023-10-08T15:40:14.434260+0000","last_unstale":"2023-10-08T15:40:14.436211+0000","last_undegraded":"2023-10-08T15:40:14.436211+0000","last_fullsized":"2023-10-08T15:40:14.436211+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:50:14.854794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.426864+0000","last_change":"2023-10-08T15:40:14.423639+0000","last_active":"2023-10-08T15:40:14.426864+0000","last_peered":"2023-10-08T15:40:14.426864+0000","last_clean":"2023-10-08T15:40:14.426864+0000","last_became_active":"2023-10-08T15:40:14.423280+0000","last_became_peered":"2023-10-08T15:40:14.423280+0000","last_unstale":"2023-10-08T15:40:14.426864+0000","last_undegraded":"2023-10-08T15:40:14.426864+0000","last_fullsized":"2023-10-08T15:40:14.426864+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:16:37.068213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.430624+0000","last_change":"2023-10-08T15:40:14.423406+0000","last_active":"2023-10-08T15:40:14.430624+0000","last_peered":"2023-10-08T15:40:14.430624+0000","last_clean":"2023-10-08T15:40:14.430624+0000","last_became_active":"2023-10-08T15:40:14.423124+0000","last_became_peered":"2023-10-08T15:40:14.423124+0000","last_unstale":"2023-10-08T15:40:14.430624+0000","last_undegraded":"2023-10-08T15:40:14.430624+0000","last_fullsized":"2023-10-08T15:40:14.430624+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:23:00.391124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.432665+0000","last_change":"2023-10-08T15:40:14.428846+0000","last_active":"2023-10-08T15:40:14.432665+0000","last_peered":"2023-10-08T15:40:14.432665+0000","last_clean":"2023-10-08T15:40:14.432665+0000","last_became_active":"2023-10-08T15:40:14.428576+0000","last_became_peered":"2023-10-08T15:40:14.428576+0000","last_unstale":"2023-10-08T15:40:14.432665+0000","last_undegraded":"2023-10-08T15:40:14.432665+0000","last_fullsized":"2023-10-08T15:40:14.432665+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:56:46.389831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.442722+0000","last_change":"2023-10-08T15:40:14.428097+0000","last_active":"2023-10-08T15:40:14.442722+0000","last_peered":"2023-10-08T15:40:14.442722+0000","last_clean":"2023-10-08T15:40:14.442722+0000","last_became_active":"2023-10-08T15:40:14.427365+0000","last_became_peered":"2023-10-08T15:40:14.427365+0000","last_unstale":"2023-10-08T15:40:14.442722+0000","last_undegraded":"2023-10-08T15:40:14.442722+0000","last_fullsized":"2023-10-08T15:40:14.442722+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:59:25.720384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"38'4","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.440786+0000","last_change":"2023-10-08T15:40:13.425751+0000","last_active":"2023-10-08T15:40:14.440786+0000","last_peered":"2023-10-08T15:40:14.440786+0000","last_clean":"2023-10-08T15:40:14.440786+0000","last_became_active":"2023-10-08T15:40:13.425422+0000","last_became_peered":"2023-10-08T15:40:13.425422+0000","last_unstale":"2023-10-08T15:40:14.440786+0000","last_undegraded":"2023-10-08T15:40:14.440786+0000","last_fullsized":"2023-10-08T15:40:14.440786+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:18.157723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.428792+0000","last_change":"2023-10-08T15:40:14.422467+0000","last_active":"2023-10-08T15:40:14.428792+0000","last_peered":"2023-10-08T15:40:14.428792+0000","last_clean":"2023-10-08T15:40:14.428792+0000","last_became_active":"2023-10-08T15:40:14.422116+0000","last_became_peered":"2023-10-08T15:40:14.422116+0000","last_unstale":"2023-10-08T15:40:14.428792+0000","last_undegraded":"2023-10-08T15:40:14.428792+0000","last_fullsized":"2023-10-08T15:40:14.428792+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:07:41.691232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"38'1","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.439948+0000","last_change":"2023-10-08T15:40:13.427528+0000","last_active":"2023-10-08T15:40:14.439948+0000","last_peered":"2023-10-08T15:40:14.439948+0000","last_clean":"2023-10-08T15:40:14.439948+0000","last_became_active":"2023-10-08T15:40:13.426178+0000","last_became_peered":"2023-10-08T15:40:13.426178+0000","last_unstale":"2023-10-08T15:40:14.439948+0000","last_undegraded":"2023-10-08T15:40:14.439948+0000","last_fullsized":"2023-10-08T15:40:14.439948+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:22:14.407250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.430553+0000","last_change":"2023-10-08T15:40:14.426852+0000","last_active":"2023-10-08T15:40:14.430553+0000","last_peered":"2023-10-08T15:40:14.430553+0000","last_clean":"2023-10-08T15:40:14.430553+0000","last_became_active":"2023-10-08T15:40:14.424903+0000","last_became_peered":"2023-10-08T15:40:14.424903+0000","last_unstale":"2023-10-08T15:40:14.430553+0000","last_undegraded":"2023-10-08T15:40:14.430553+0000","last_fullsized":"2023-10-08T15:40:14.430553+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:46.354499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.445200+0000","last_change":"2023-10-08T15:40:13.422829+0000","last_active":"2023-10-08T15:40:14.445200+0000","last_peered":"2023-10-08T15:40:14.445200+0000","last_clean":"2023-10-08T15:40:14.445200+0000","last_became_active":"2023-10-08T15:40:13.422518+0000","last_became_peered":"2023-10-08T15:40:13.422518+0000","last_unstale":"2023-10-08T15:40:14.445200+0000","last_undegraded":"2023-10-08T15:40:14.445200+0000","last_fullsized":"2023-10-08T15:40:14.445200+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:50:13.842824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.443233+0000","last_change":"2023-10-08T15:40:14.427920+0000","last_active":"2023-10-08T15:40:14.443233+0000","last_peered":"2023-10-08T15:40:14.443233+0000","last_clean":"2023-10-08T15:40:14.443233+0000","last_became_active":"2023-10-08T15:40:14.427648+0000","last_became_peered":"2023-10-08T15:40:14.427648+0000","last_unstale":"2023-10-08T15:40:14.443233+0000","last_undegraded":"2023-10-08T15:40:14.443233+0000","last_fullsized":"2023-10-08T15:40:14.443233+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:18:28.702700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.447461+0000","last_change":"2023-10-08T15:40:13.417157+0000","last_active":"2023-10-08T15:40:14.447461+0000","last_peered":"2023-10-08T15:40:14.447461+0000","last_clean":"2023-10-08T15:40:14.447461+0000","last_became_active":"2023-10-08T15:40:13.416876+0000","last_became_peered":"2023-10-08T15:40:13.416876+0000","last_unstale":"2023-10-08T15:40:14.447461+0000","last_undegraded":"2023-10-08T15:40:14.447461+0000","last_fullsized":"2023-10-08T15:40:14.447461+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:31:45.772524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.426881+0000","last_change":"2023-10-08T15:40:14.425353+0000","last_active":"2023-10-08T15:40:14.426881+0000","last_peered":"2023-10-08T15:40:14.426881+0000","last_clean":"2023-10-08T15:40:14.426881+0000","last_became_active":"2023-10-08T15:40:14.425058+0000","last_became_peered":"2023-10-08T15:40:14.425058+0000","last_unstale":"2023-10-08T15:40:14.426881+0000","last_undegraded":"2023-10-08T15:40:14.426881+0000","last_fullsized":"2023-10-08T15:40:14.426881+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:57:32.025855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"38'1","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.446643+0000","last_change":"2023-10-08T15:40:13.417469+0000","last_active":"2023-10-08T15:40:14.446643+0000","last_peered":"2023-10-08T15:40:14.446643+0000","last_clean":"2023-10-08T15:40:14.446643+0000","last_became_active":"2023-10-08T15:40:13.417134+0000","last_became_peered":"2023-10-08T15:40:13.417134+0000","last_unstale":"2023-10-08T15:40:14.446643+0000","last_undegraded":"2023-10-08T15:40:14.446643+0000","last_fullsized":"2023-10-08T15:40:14.446643+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:38:58.180186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.442814+0000","last_change":"2023-10-08T15:40:14.431556+0000","last_active":"2023-10-08T15:40:14.442814+0000","last_peered":"2023-10-08T15:40:14.442814+0000","last_clean":"2023-10-08T15:40:14.442814+0000","last_became_active":"2023-10-08T15:40:14.431277+0000","last_became_peered":"2023-10-08T15:40:14.431277+0000","last_unstale":"2023-10-08T15:40:14.442814+0000","last_undegraded":"2023-10-08T15:40:14.442814+0000","last_fullsized":"2023-10-08T15:40:14.442814+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:26:20.874012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"38'1","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.439904+0000","last_change":"2023-10-08T15:40:13.421287+0000","last_active":"2023-10-08T15:40:14.439904+0000","last_peered":"2023-10-08T15:40:14.439904+0000","last_clean":"2023-10-08T15:40:14.439904+0000","last_became_active":"2023-10-08T15:40:13.420491+0000","last_became_peered":"2023-10-08T15:40:13.420491+0000","last_unstale":"2023-10-08T15:40:14.439904+0000","last_undegraded":"2023-10-08T15:40:14.439904+0000","last_fullsized":"2023-10-08T15:40:14.439904+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:12:14.269569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.432725+0000","last_change":"2023-10-08T15:40:14.422880+0000","last_active":"2023-10-08T15:40:14.432725+0000","last_peered":"2023-10-08T15:40:14.432725+0000","last_clean":"2023-10-08T15:40:14.432725+0000","last_became_active":"2023-10-08T15:40:14.422555+0000","last_became_peered":"2023-10-08T15:40:14.422555+0000","last_unstale":"2023-10-08T15:40:14.432725+0000","last_undegraded":"2023-10-08T15:40:14.432725+0000","last_fullsized":"2023-10-08T15:40:14.432725+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:19:38.120631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.411523+0000","last_change":"2023-10-08T15:40:13.425380+0000","last_active":"2023-10-08T15:40:14.411523+0000","last_peered":"2023-10-08T15:40:14.411523+0000","last_clean":"2023-10-08T15:40:14.411523+0000","last_became_active":"2023-10-08T15:40:13.425091+0000","last_became_peered":"2023-10-08T15:40:13.425091+0000","last_unstale":"2023-10-08T15:40:14.411523+0000","last_undegraded":"2023-10-08T15:40:14.411523+0000","last_fullsized":"2023-10-08T15:40:14.411523+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:30:28.988602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.435277+0000","last_change":"2023-10-08T15:40:14.433565+0000","last_active":"2023-10-08T15:40:14.435277+0000","last_peered":"2023-10-08T15:40:14.435277+0000","last_clean":"2023-10-08T15:40:14.435277+0000","last_became_active":"2023-10-08T15:40:14.433242+0000","last_became_peered":"2023-10-08T15:40:14.433242+0000","last_unstale":"2023-10-08T15:40:14.435277+0000","last_undegraded":"2023-10-08T15:40:14.435277+0000","last_fullsized":"2023-10-08T15:40:14.435277+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:01:49.004201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.418446+0000","last_change":"2023-10-08T15:40:13.427181+0000","last_active":"2023-10-08T15:40:14.418446+0000","last_peered":"2023-10-08T15:40:14.418446+0000","last_clean":"2023-10-08T15:40:14.418446+0000","last_became_active":"2023-10-08T15:40:13.425429+0000","last_became_peered":"2023-10-08T15:40:13.425429+0000","last_unstale":"2023-10-08T15:40:14.418446+0000","last_undegraded":"2023-10-08T15:40:14.418446+0000","last_fullsized":"2023-10-08T15:40:14.418446+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:49:42.599600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.440025+0000","last_change":"2023-10-08T15:40:14.438306+0000","last_active":"2023-10-08T15:40:14.440025+0000","last_peered":"2023-10-08T15:40:14.440025+0000","last_clean":"2023-10-08T15:40:14.440025+0000","last_became_active":"2023-10-08T15:40:14.437961+0000","last_became_peered":"2023-10-08T15:40:14.437961+0000","last_unstale":"2023-10-08T15:40:14.440025+0000","last_undegraded":"2023-10-08T15:40:14.440025+0000","last_fullsized":"2023-10-08T15:40:14.440025+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:26:20.874012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.418871+0000","last_change":"2023-10-08T15:40:13.420695+0000","last_active":"2023-10-08T15:40:14.418871+0000","last_peered":"2023-10-08T15:40:14.418871+0000","last_clean":"2023-10-08T15:40:14.418871+0000","last_became_active":"2023-10-08T15:40:13.420370+0000","last_became_peered":"2023-10-08T15:40:13.420370+0000","last_unstale":"2023-10-08T15:40:14.418871+0000","last_undegraded":"2023-10-08T15:40:14.418871+0000","last_fullsized":"2023-10-08T15:40:14.418871+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:45:30.332801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.432660+0000","last_change":"2023-10-08T15:40:14.418552+0000","last_active":"2023-10-08T15:40:14.432660+0000","last_peered":"2023-10-08T15:40:14.432660+0000","last_clean":"2023-10-08T15:40:14.432660+0000","last_became_active":"2023-10-08T15:40:14.418152+0000","last_became_peered":"2023-10-08T15:40:14.418152+0000","last_unstale":"2023-10-08T15:40:14.432660+0000","last_undegraded":"2023-10-08T15:40:14.432660+0000","last_fullsized":"2023-10-08T15:40:14.432660+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:36:00.388553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.424445+0000","last_change":"2023-10-08T15:40:13.428311+0000","last_active":"2023-10-08T15:40:14.424445+0000","last_peered":"2023-10-08T15:40:14.424445+0000","last_clean":"2023-10-08T15:40:14.424445+0000","last_became_active":"2023-10-08T15:40:13.427998+0000","last_became_peered":"2023-10-08T15:40:13.427998+0000","last_unstale":"2023-10-08T15:40:14.424445+0000","last_undegraded":"2023-10-08T15:40:14.424445+0000","last_fullsized":"2023-10-08T15:40:14.424445+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:14:50.877335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.433766+0000","last_change":"2023-10-08T15:40:14.428424+0000","last_active":"2023-10-08T15:40:14.433766+0000","last_peered":"2023-10-08T15:40:14.433766+0000","last_clean":"2023-10-08T15:40:14.433766+0000","last_became_active":"2023-10-08T15:40:14.428102+0000","last_became_peered":"2023-10-08T15:40:14.428102+0000","last_unstale":"2023-10-08T15:40:14.433766+0000","last_undegraded":"2023-10-08T15:40:14.433766+0000","last_fullsized":"2023-10-08T15:40:14.433766+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:47:29.743549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"38'3","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.448063+0000","last_change":"2023-10-08T15:40:13.426137+0000","last_active":"2023-10-08T15:40:14.448063+0000","last_peered":"2023-10-08T15:40:14.448063+0000","last_clean":"2023-10-08T15:40:14.448063+0000","last_became_active":"2023-10-08T15:40:13.425691+0000","last_became_peered":"2023-10-08T15:40:13.425691+0000","last_unstale":"2023-10-08T15:40:14.448063+0000","last_undegraded":"2023-10-08T15:40:14.448063+0000","last_fullsized":"2023-10-08T15:40:14.448063+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:47:36.657587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.444679+0000","last_change":"2023-10-08T15:40:14.429313+0000","last_active":"2023-10-08T15:40:14.444679+0000","last_peered":"2023-10-08T15:40:14.444679+0000","last_clean":"2023-10-08T15:40:14.444679+0000","last_became_active":"2023-10-08T15:40:14.429002+0000","last_became_peered":"2023-10-08T15:40:14.429002+0000","last_unstale":"2023-10-08T15:40:14.444679+0000","last_undegraded":"2023-10-08T15:40:14.444679+0000","last_fullsized":"2023-10-08T15:40:14.444679+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:18:25.771380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"38'6","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.449213+0000","last_change":"2023-10-08T15:40:13.420187+0000","last_active":"2023-10-08T15:40:14.449213+0000","last_peered":"2023-10-08T15:40:14.449213+0000","last_clean":"2023-10-08T15:40:14.449213+0000","last_became_active":"2023-10-08T15:40:13.419818+0000","last_became_peered":"2023-10-08T15:40:13.419818+0000","last_unstale":"2023-10-08T15:40:14.449213+0000","last_undegraded":"2023-10-08T15:40:14.449213+0000","last_fullsized":"2023-10-08T15:40:14.449213+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:34:03.849463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.431916+0000","last_change":"2023-10-08T15:40:14.427600+0000","last_active":"2023-10-08T15:40:14.431916+0000","last_peered":"2023-10-08T15:40:14.431916+0000","last_clean":"2023-10-08T15:40:14.431916+0000","last_became_active":"2023-10-08T15:40:14.427273+0000","last_became_peered":"2023-10-08T15:40:14.427273+0000","last_unstale":"2023-10-08T15:40:14.431916+0000","last_undegraded":"2023-10-08T15:40:14.431916+0000","last_fullsized":"2023-10-08T15:40:14.431916+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:41:14.459572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.444927+0000","last_change":"2023-10-08T15:40:13.428224+0000","last_active":"2023-10-08T15:40:14.444927+0000","last_peered":"2023-10-08T15:40:14.444927+0000","last_clean":"2023-10-08T15:40:14.444927+0000","last_became_active":"2023-10-08T15:40:13.427919+0000","last_became_peered":"2023-10-08T15:40:13.427919+0000","last_unstale":"2023-10-08T15:40:14.444927+0000","last_undegraded":"2023-10-08T15:40:14.444927+0000","last_fullsized":"2023-10-08T15:40:14.444927+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:32:49.859693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.448939+0000","last_change":"2023-10-08T15:40:14.444596+0000","last_active":"2023-10-08T15:40:14.448939+0000","last_peered":"2023-10-08T15:40:14.448939+0000","last_clean":"2023-10-08T15:40:14.448939+0000","last_became_active":"2023-10-08T15:40:14.444236+0000","last_became_peered":"2023-10-08T15:40:14.444236+0000","last_unstale":"2023-10-08T15:40:14.448939+0000","last_undegraded":"2023-10-08T15:40:14.448939+0000","last_fullsized":"2023-10-08T15:40:14.448939+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:32:47.327437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.408105+0000","last_change":"2023-10-08T15:40:13.415599+0000","last_active":"2023-10-08T15:40:14.408105+0000","last_peered":"2023-10-08T15:40:14.408105+0000","last_clean":"2023-10-08T15:40:14.408105+0000","last_became_active":"2023-10-08T15:40:13.415310+0000","last_became_peered":"2023-10-08T15:40:13.415310+0000","last_unstale":"2023-10-08T15:40:14.408105+0000","last_undegraded":"2023-10-08T15:40:14.408105+0000","last_fullsized":"2023-10-08T15:40:14.408105+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:18:27.690730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.435562+0000","last_change":"2023-10-08T15:40:14.431047+0000","last_active":"2023-10-08T15:40:14.435562+0000","last_peered":"2023-10-08T15:40:14.435562+0000","last_clean":"2023-10-08T15:40:14.435562+0000","last_became_active":"2023-10-08T15:40:14.430767+0000","last_became_peered":"2023-10-08T15:40:14.430767+0000","last_unstale":"2023-10-08T15:40:14.435562+0000","last_undegraded":"2023-10-08T15:40:14.435562+0000","last_fullsized":"2023-10-08T15:40:14.435562+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:55:40.587396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.419235+0000","last_change":"2023-10-08T15:40:13.422903+0000","last_active":"2023-10-08T15:40:14.419235+0000","last_peered":"2023-10-08T15:40:14.419235+0000","last_clean":"2023-10-08T15:40:14.419235+0000","last_became_active":"2023-10-08T15:40:13.422586+0000","last_became_peered":"2023-10-08T15:40:13.422586+0000","last_unstale":"2023-10-08T15:40:14.419235+0000","last_undegraded":"2023-10-08T15:40:14.419235+0000","last_fullsized":"2023-10-08T15:40:14.419235+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:45.342530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.436094+0000","last_change":"2023-10-08T15:40:14.425577+0000","last_active":"2023-10-08T15:40:14.436094+0000","last_peered":"2023-10-08T15:40:14.436094+0000","last_clean":"2023-10-08T15:40:14.436094+0000","last_became_active":"2023-10-08T15:40:14.425279+0000","last_became_peered":"2023-10-08T15:40:14.425279+0000","last_unstale":"2023-10-08T15:40:14.436094+0000","last_undegraded":"2023-10-08T15:40:14.436094+0000","last_fullsized":"2023-10-08T15:40:14.436094+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:25:12.898608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"38'8","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.444619+0000","last_change":"2023-10-08T15:40:13.427234+0000","last_active":"2023-10-08T15:40:14.444619+0000","last_peered":"2023-10-08T15:40:14.444619+0000","last_clean":"2023-10-08T15:40:14.444619+0000","last_became_active":"2023-10-08T15:40:13.424985+0000","last_became_peered":"2023-10-08T15:40:13.424985+0000","last_unstale":"2023-10-08T15:40:14.444619+0000","last_undegraded":"2023-10-08T15:40:14.444619+0000","last_fullsized":"2023-10-08T15:40:14.444619+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:18:01.774995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.426075+0000","last_change":"2023-10-08T15:40:14.416890+0000","last_active":"2023-10-08T15:40:14.426075+0000","last_peered":"2023-10-08T15:40:14.426075+0000","last_clean":"2023-10-08T15:40:14.426075+0000","last_became_active":"2023-10-08T15:40:14.416503+0000","last_became_peered":"2023-10-08T15:40:14.416503+0000","last_unstale":"2023-10-08T15:40:14.426075+0000","last_undegraded":"2023-10-08T15:40:14.426075+0000","last_fullsized":"2023-10-08T15:40:14.426075+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:39:23.149190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"38'1","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.441331+0000","last_change":"2023-10-08T15:40:13.417048+0000","last_active":"2023-10-08T15:40:14.441331+0000","last_peered":"2023-10-08T15:40:14.441331+0000","last_clean":"2023-10-08T15:40:14.441331+0000","last_became_active":"2023-10-08T15:40:13.416724+0000","last_became_peered":"2023-10-08T15:40:13.416724+0000","last_unstale":"2023-10-08T15:40:14.441331+0000","last_undegraded":"2023-10-08T15:40:14.441331+0000","last_fullsized":"2023-10-08T15:40:14.441331+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:19:37.829086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.439342+0000","last_change":"2023-10-08T15:40:14.427679+0000","last_active":"2023-10-08T15:40:14.439342+0000","last_peered":"2023-10-08T15:40:14.439342+0000","last_clean":"2023-10-08T15:40:14.439342+0000","last_became_active":"2023-10-08T15:40:14.427339+0000","last_became_peered":"2023-10-08T15:40:14.427339+0000","last_unstale":"2023-10-08T15:40:14.439342+0000","last_undegraded":"2023-10-08T15:40:14.439342+0000","last_fullsized":"2023-10-08T15:40:14.439342+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:38:56.298194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.446296+0000","last_change":"2023-10-08T15:40:13.424903+0000","last_active":"2023-10-08T15:40:14.446296+0000","last_peered":"2023-10-08T15:40:14.446296+0000","last_clean":"2023-10-08T15:40:14.446296+0000","last_became_active":"2023-10-08T15:40:13.424525+0000","last_became_peered":"2023-10-08T15:40:13.424525+0000","last_unstale":"2023-10-08T15:40:14.446296+0000","last_undegraded":"2023-10-08T15:40:14.446296+0000","last_fullsized":"2023-10-08T15:40:14.446296+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:43:48.263381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.431554+0000","last_change":"2023-10-08T15:40:14.425248+0000","last_active":"2023-10-08T15:40:14.431554+0000","last_peered":"2023-10-08T15:40:14.431554+0000","last_clean":"2023-10-08T15:40:14.431554+0000","last_became_active":"2023-10-08T15:40:14.424900+0000","last_became_peered":"2023-10-08T15:40:14.424900+0000","last_unstale":"2023-10-08T15:40:14.431554+0000","last_undegraded":"2023-10-08T15:40:14.431554+0000","last_fullsized":"2023-10-08T15:40:14.431554+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:28:32.528544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"38'1","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.446413+0000","last_change":"2023-10-08T15:40:13.426037+0000","last_active":"2023-10-08T15:40:14.446413+0000","last_peered":"2023-10-08T15:40:14.446413+0000","last_clean":"2023-10-08T15:40:14.446413+0000","last_became_active":"2023-10-08T15:40:13.425736+0000","last_became_peered":"2023-10-08T15:40:13.425736+0000","last_unstale":"2023-10-08T15:40:14.446413+0000","last_undegraded":"2023-10-08T15:40:14.446413+0000","last_fullsized":"2023-10-08T15:40:14.446413+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:43:48.263381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.447211+0000","last_change":"2023-10-08T15:40:14.445368+0000","last_active":"2023-10-08T15:40:14.447211+0000","last_peered":"2023-10-08T15:40:14.447211+0000","last_clean":"2023-10-08T15:40:14.447211+0000","last_became_active":"2023-10-08T15:40:14.445022+0000","last_became_peered":"2023-10-08T15:40:14.445022+0000","last_unstale":"2023-10-08T15:40:14.447211+0000","last_undegraded":"2023-10-08T15:40:14.447211+0000","last_fullsized":"2023-10-08T15:40:14.447211+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:40:05.133298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.418779+0000","last_change":"2023-10-08T15:40:13.424921+0000","last_active":"2023-10-08T15:40:14.418779+0000","last_peered":"2023-10-08T15:40:14.418779+0000","last_clean":"2023-10-08T15:40:14.418779+0000","last_became_active":"2023-10-08T15:40:13.424591+0000","last_became_peered":"2023-10-08T15:40:13.424591+0000","last_unstale":"2023-10-08T15:40:14.418779+0000","last_undegraded":"2023-10-08T15:40:14.418779+0000","last_fullsized":"2023-10-08T15:40:14.418779+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:55:29.262854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.433474+0000","last_change":"2023-10-08T15:40:14.428843+0000","last_active":"2023-10-08T15:40:14.433474+0000","last_peered":"2023-10-08T15:40:14.433474+0000","last_clean":"2023-10-08T15:40:14.433474+0000","last_became_active":"2023-10-08T15:40:14.428278+0000","last_became_peered":"2023-10-08T15:40:14.428278+0000","last_unstale":"2023-10-08T15:40:14.433474+0000","last_undegraded":"2023-10-08T15:40:14.433474+0000","last_fullsized":"2023-10-08T15:40:14.433474+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:58.495250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.446715+0000","last_change":"2023-10-08T15:40:13.417299+0000","last_active":"2023-10-08T15:40:14.446715+0000","last_peered":"2023-10-08T15:40:14.446715+0000","last_clean":"2023-10-08T15:40:14.446715+0000","last_became_active":"2023-10-08T15:40:13.416982+0000","last_became_peered":"2023-10-08T15:40:13.416982+0000","last_unstale":"2023-10-08T15:40:14.446715+0000","last_undegraded":"2023-10-08T15:40:14.446715+0000","last_fullsized":"2023-10-08T15:40:14.446715+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:19:37.108661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.431264+0000","last_change":"2023-10-08T15:40:14.420668+0000","last_active":"2023-10-08T15:40:14.431264+0000","last_peered":"2023-10-08T15:40:14.431264+0000","last_clean":"2023-10-08T15:40:14.431264+0000","last_became_active":"2023-10-08T15:40:14.419844+0000","last_became_peered":"2023-10-08T15:40:14.419844+0000","last_unstale":"2023-10-08T15:40:14.431264+0000","last_undegraded":"2023-10-08T15:40:14.431264+0000","last_fullsized":"2023-10-08T15:40:14.431264+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:47:51.523520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.410933+0000","last_change":"2023-10-08T15:40:13.426040+0000","last_active":"2023-10-08T15:40:14.410933+0000","last_peered":"2023-10-08T15:40:14.410933+0000","last_clean":"2023-10-08T15:40:14.410933+0000","last_became_active":"2023-10-08T15:40:13.425705+0000","last_became_peered":"2023-10-08T15:40:13.425705+0000","last_unstale":"2023-10-08T15:40:14.410933+0000","last_undegraded":"2023-10-08T15:40:14.410933+0000","last_fullsized":"2023-10-08T15:40:14.410933+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:12:14.269569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.425551+0000","last_change":"2023-10-08T15:40:14.413855+0000","last_active":"2023-10-08T15:40:14.425551+0000","last_peered":"2023-10-08T15:40:14.425551+0000","last_clean":"2023-10-08T15:40:14.425551+0000","last_became_active":"2023-10-08T15:40:14.412210+0000","last_became_peered":"2023-10-08T15:40:14.412210+0000","last_unstale":"2023-10-08T15:40:14.425551+0000","last_undegraded":"2023-10-08T15:40:14.425551+0000","last_fullsized":"2023-10-08T15:40:14.425551+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:07:16.107860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.418168+0000","last_change":"2023-10-08T15:40:13.424876+0000","last_active":"2023-10-08T15:40:14.418168+0000","last_peered":"2023-10-08T15:40:14.418168+0000","last_clean":"2023-10-08T15:40:14.418168+0000","last_became_active":"2023-10-08T15:40:13.424570+0000","last_became_peered":"2023-10-08T15:40:13.424570+0000","last_unstale":"2023-10-08T15:40:14.418168+0000","last_undegraded":"2023-10-08T15:40:14.418168+0000","last_fullsized":"2023-10-08T15:40:14.418168+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:15:27.675296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.443967+0000","last_change":"2023-10-08T15:40:14.433524+0000","last_active":"2023-10-08T15:40:14.443967+0000","last_peered":"2023-10-08T15:40:14.443967+0000","last_clean":"2023-10-08T15:40:14.443967+0000","last_became_active":"2023-10-08T15:40:14.433222+0000","last_became_peered":"2023-10-08T15:40:14.433222+0000","last_unstale":"2023-10-08T15:40:14.443967+0000","last_undegraded":"2023-10-08T15:40:14.443967+0000","last_fullsized":"2023-10-08T15:40:14.443967+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:46:05.056695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.407800+0000","last_change":"2023-10-08T15:40:13.414016+0000","last_active":"2023-10-08T15:40:14.407800+0000","last_peered":"2023-10-08T15:40:14.407800+0000","last_clean":"2023-10-08T15:40:14.407800+0000","last_became_active":"2023-10-08T15:40:13.413732+0000","last_became_peered":"2023-10-08T15:40:13.413732+0000","last_unstale":"2023-10-08T15:40:14.407800+0000","last_undegraded":"2023-10-08T15:40:14.407800+0000","last_fullsized":"2023-10-08T15:40:14.407800+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:43:34.768625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.437192+0000","last_change":"2023-10-08T15:40:14.434622+0000","last_active":"2023-10-08T15:40:14.437192+0000","last_peered":"2023-10-08T15:40:14.437192+0000","last_clean":"2023-10-08T15:40:14.437192+0000","last_became_active":"2023-10-08T15:40:14.434234+0000","last_became_peered":"2023-10-08T15:40:14.434234+0000","last_unstale":"2023-10-08T15:40:14.437192+0000","last_undegraded":"2023-10-08T15:40:14.437192+0000","last_fullsized":"2023-10-08T15:40:14.437192+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:40:37.969828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.419085+0000","last_change":"2023-10-08T15:40:13.416965+0000","last_active":"2023-10-08T15:40:14.419085+0000","last_peered":"2023-10-08T15:40:14.419085+0000","last_clean":"2023-10-08T15:40:14.419085+0000","last_became_active":"2023-10-08T15:40:13.416634+0000","last_became_peered":"2023-10-08T15:40:13.416634+0000","last_unstale":"2023-10-08T15:40:14.419085+0000","last_undegraded":"2023-10-08T15:40:14.419085+0000","last_fullsized":"2023-10-08T15:40:14.419085+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:46:04.044725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.437994+0000","last_change":"2023-10-08T15:40:14.425484+0000","last_active":"2023-10-08T15:40:14.437994+0000","last_peered":"2023-10-08T15:40:14.437994+0000","last_clean":"2023-10-08T15:40:14.437994+0000","last_became_active":"2023-10-08T15:40:14.425082+0000","last_became_peered":"2023-10-08T15:40:14.425082+0000","last_unstale":"2023-10-08T15:40:14.437994+0000","last_undegraded":"2023-10-08T15:40:14.437994+0000","last_fullsized":"2023-10-08T15:40:14.437994+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:57:32.025855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.410463+0000","last_change":"2023-10-08T15:40:13.423625+0000","last_active":"2023-10-08T15:40:14.410463+0000","last_peered":"2023-10-08T15:40:14.410463+0000","last_clean":"2023-10-08T15:40:14.410463+0000","last_became_active":"2023-10-08T15:40:13.422315+0000","last_became_peered":"2023-10-08T15:40:13.422315+0000","last_unstale":"2023-10-08T15:40:14.410463+0000","last_undegraded":"2023-10-08T15:40:14.410463+0000","last_fullsized":"2023-10-08T15:40:14.410463+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:25:11.825747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.422351+0000","last_change":"2023-10-08T15:40:14.416301+0000","last_active":"2023-10-08T15:40:14.422351+0000","last_peered":"2023-10-08T15:40:14.422351+0000","last_clean":"2023-10-08T15:40:14.422351+0000","last_became_active":"2023-10-08T15:40:14.415966+0000","last_became_peered":"2023-10-08T15:40:14.415966+0000","last_unstale":"2023-10-08T15:40:14.422351+0000","last_undegraded":"2023-10-08T15:40:14.422351+0000","last_fullsized":"2023-10-08T15:40:14.422351+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:04:06.756439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.426957+0000","last_change":"2023-10-08T15:40:13.423017+0000","last_active":"2023-10-08T15:40:14.426957+0000","last_peered":"2023-10-08T15:40:14.426957+0000","last_clean":"2023-10-08T15:40:14.426957+0000","last_became_active":"2023-10-08T15:40:13.422248+0000","last_became_peered":"2023-10-08T15:40:13.422248+0000","last_unstale":"2023-10-08T15:40:14.426957+0000","last_undegraded":"2023-10-08T15:40:14.426957+0000","last_fullsized":"2023-10-08T15:40:14.426957+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:07:40.679262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.433492+0000","last_change":"2023-10-08T15:40:14.429509+0000","last_active":"2023-10-08T15:40:14.433492+0000","last_peered":"2023-10-08T15:40:14.433492+0000","last_clean":"2023-10-08T15:40:14.433492+0000","last_became_active":"2023-10-08T15:40:14.428968+0000","last_became_peered":"2023-10-08T15:40:14.428968+0000","last_unstale":"2023-10-08T15:40:14.433492+0000","last_undegraded":"2023-10-08T15:40:14.433492+0000","last_fullsized":"2023-10-08T15:40:14.433492+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:18:58.446270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.409367+0000","last_change":"2023-10-08T15:40:13.422628+0000","last_active":"2023-10-08T15:40:14.409367+0000","last_peered":"2023-10-08T15:40:14.409367+0000","last_clean":"2023-10-08T15:40:14.409367+0000","last_became_active":"2023-10-08T15:40:13.422297+0000","last_became_peered":"2023-10-08T15:40:13.422297+0000","last_unstale":"2023-10-08T15:40:14.409367+0000","last_undegraded":"2023-10-08T15:40:14.409367+0000","last_fullsized":"2023-10-08T15:40:14.409367+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:03.198759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.433786+0000","last_change":"2023-10-08T15:40:14.428922+0000","last_active":"2023-10-08T15:40:14.433786+0000","last_peered":"2023-10-08T15:40:14.433786+0000","last_clean":"2023-10-08T15:40:14.433786+0000","last_became_active":"2023-10-08T15:40:14.428220+0000","last_became_peered":"2023-10-08T15:40:14.428220+0000","last_unstale":"2023-10-08T15:40:14.433786+0000","last_undegraded":"2023-10-08T15:40:14.433786+0000","last_fullsized":"2023-10-08T15:40:14.433786+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:33:20.523009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.416231+0000","last_change":"2023-10-08T15:40:13.421651+0000","last_active":"2023-10-08T15:40:14.416231+0000","last_peered":"2023-10-08T15:40:14.416231+0000","last_clean":"2023-10-08T15:40:14.416231+0000","last_became_active":"2023-10-08T15:40:13.421353+0000","last_became_peered":"2023-10-08T15:40:13.421353+0000","last_unstale":"2023-10-08T15:40:14.416231+0000","last_undegraded":"2023-10-08T15:40:14.416231+0000","last_fullsized":"2023-10-08T15:40:14.416231+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:36.146964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.432629+0000","last_change":"2023-10-08T15:40:14.429164+0000","last_active":"2023-10-08T15:40:14.432629+0000","last_peered":"2023-10-08T15:40:14.432629+0000","last_clean":"2023-10-08T15:40:14.432629+0000","last_became_active":"2023-10-08T15:40:14.428857+0000","last_became_peered":"2023-10-08T15:40:14.428857+0000","last_unstale":"2023-10-08T15:40:14.432629+0000","last_undegraded":"2023-10-08T15:40:14.432629+0000","last_fullsized":"2023-10-08T15:40:14.432629+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:19:38.120631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.427151+0000","last_change":"2023-10-08T15:40:13.423501+0000","last_active":"2023-10-08T15:40:14.427151+0000","last_peered":"2023-10-08T15:40:14.427151+0000","last_clean":"2023-10-08T15:40:14.427151+0000","last_became_active":"2023-10-08T15:40:13.423112+0000","last_became_peered":"2023-10-08T15:40:13.423112+0000","last_unstale":"2023-10-08T15:40:14.427151+0000","last_undegraded":"2023-10-08T15:40:14.427151+0000","last_fullsized":"2023-10-08T15:40:14.427151+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:46:45.482090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.431724+0000","last_change":"2023-10-08T15:40:14.430127+0000","last_active":"2023-10-08T15:40:14.431724+0000","last_peered":"2023-10-08T15:40:14.431724+0000","last_clean":"2023-10-08T15:40:14.431724+0000","last_became_active":"2023-10-08T15:40:14.427661+0000","last_became_peered":"2023-10-08T15:40:14.427661+0000","last_unstale":"2023-10-08T15:40:14.431724+0000","last_undegraded":"2023-10-08T15:40:14.431724+0000","last_fullsized":"2023-10-08T15:40:14.431724+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:46.354499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.418694+0000","last_change":"2023-10-08T15:40:13.424672+0000","last_active":"2023-10-08T15:40:14.418694+0000","last_peered":"2023-10-08T15:40:14.418694+0000","last_clean":"2023-10-08T15:40:14.418694+0000","last_became_active":"2023-10-08T15:40:13.422477+0000","last_became_peered":"2023-10-08T15:40:13.422477+0000","last_unstale":"2023-10-08T15:40:14.418694+0000","last_undegraded":"2023-10-08T15:40:14.418694+0000","last_fullsized":"2023-10-08T15:40:14.418694+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:28:30.689512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.448959+0000","last_change":"2023-10-08T15:40:14.444779+0000","last_active":"2023-10-08T15:40:14.448959+0000","last_peered":"2023-10-08T15:40:14.448959+0000","last_clean":"2023-10-08T15:40:14.448959+0000","last_became_active":"2023-10-08T15:40:14.444212+0000","last_became_peered":"2023-10-08T15:40:14.444212+0000","last_unstale":"2023-10-08T15:40:14.448959+0000","last_undegraded":"2023-10-08T15:40:14.448959+0000","last_fullsized":"2023-10-08T15:40:14.448959+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.385664+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.385664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:00:59.377632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.442338+0000","last_change":"2023-10-08T15:40:13.418998+0000","last_active":"2023-10-08T15:40:14.442338+0000","last_peered":"2023-10-08T15:40:14.442338+0000","last_clean":"2023-10-08T15:40:14.442338+0000","last_became_active":"2023-10-08T15:40:13.418647+0000","last_became_peered":"2023-10-08T15:40:13.418647+0000","last_unstale":"2023-10-08T15:40:14.442338+0000","last_undegraded":"2023-10-08T15:40:14.442338+0000","last_fullsized":"2023-10-08T15:40:14.442338+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:12.373695+0000","last_clean_scrub_stamp":"2023-10-08T15:40:12.373695+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:38:55.286225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":182,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T15:40:14.407928+0000","last_change":"2023-10-08T15:37:19.380955+0000","last_active":"2023-10-08T15:40:14.407928+0000","last_peered":"2023-10-08T15:40:14.407928+0000","last_clean":"2023-10-08T15:40:14.407928+0000","last_became_active":"2023-10-08T15:37:19.378277+0000","last_became_peered":"2023-10-08T15:37:19.378277+0000","last_unstale":"2023-10-08T15:40:14.407928+0000","last_undegraded":"2023-10-08T15:40:14.407928+0000","last_fullsized":"2023-10-08T15:40:14.407928+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:17.537726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:17.537726+0000","last_clean_scrub_stamp":"2023-10-08T15:37:17.537726+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:06:26.612046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66282,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542182,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305988,"kb_used_data":508,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065852,"statfs":{"total":96636764160,"available":96323432448,"internally_reserved":0,"allocated":520192,"data_stored":771145,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.94399999999999995,"15min":0.95999999999999996},"min":{"1min":0.64700000000000002,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.3460000000000001,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.93000000000000005,"15min":0.93100000000000005},"min":{"1min":0.66300000000000003,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.389,"5min":1.758,"15min":1.758},"last":0.83299999999999996}]},{"osd":1,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.90700000000000003,"15min":0.89400000000000002},"min":{"1min":0.59799999999999998,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.4299999999999999,"5min":1.474,"15min":1.474},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.96699999999999997,"15min":0.96299999999999997},"min":{"1min":0.71099999999999997,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.875}]},{"osd":2,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":1.016,"15min":1.0309999999999999},"min":{"1min":0.66000000000000003,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.268,"5min":1.623,"15min":1.623},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.0009999999999999,"15min":1.006},"min":{"1min":0.72799999999999998,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.1990000000000001,"5min":1.321,"15min":1.321},"last":1.0569999999999999}]},{"osd":3,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":0.98699999999999999,"15min":0.97399999999999998},"min":{"1min":0.82999999999999996,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.032},{"interface":"front","average":{"1min":1.222,"5min":1.2110000000000001,"15min":1.2090000000000001},"min":{"1min":1.012,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.69499999999999995}]},{"osd":4,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":1.073,"15min":1.089},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.298,"5min":1.512,"15min":1.512},"last":0.90900000000000003},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.095,"15min":1.1000000000000001},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.353,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":1.0860000000000001}]},{"osd":5,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.2509999999999999,"15min":1.272},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.573,"5min":1.74,"15min":1.74},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.163,"5min":1.236,"15min":1.248},"min":{"1min":0.88700000000000001,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.381,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":1.109}]},{"osd":6,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.2969999999999999,"15min":1.3169999999999999},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.4610000000000001,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.151,"5min":1.2410000000000001,"15min":1.256},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":1.411,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.80600000000000005}]}]},{"osd":6,"up_from":14,"seq":60129542183,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301832,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070008,"statfs":{"total":96636764160,"available":96327688192,"internally_reserved":0,"allocated":458752,"data_stored":181331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.84199999999999997,"15min":0.82399999999999995},"min":{"1min":0.70699999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.218,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.98399999999999999,"15min":0.997},"min":{"1min":0.71399999999999997,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.1890000000000001,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":0.81999999999999995}]},{"osd":1,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.94899999999999995,"15min":0.95699999999999996},"min":{"1min":0.70599999999999996,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.2729999999999999,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":1.3160000000000001},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.98599999999999999,"15min":0.98999999999999999},"min":{"1min":0.64600000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.397,"5min":1.853,"15min":1.853},"last":1.2689999999999999}]},{"osd":2,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.85699999999999998,"15min":0.84599999999999997},"min":{"1min":0.69299999999999995,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0649999999999999,"15min":1.0760000000000001},"min":{"1min":0.64700000000000002,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.4019999999999999,"5min":1.518,"15min":1.518},"last":1.5049999999999999}]},{"osd":3,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.0169999999999999,"15min":1.02},"min":{"1min":0.78300000000000003,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.3169999999999999,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.071,"15min":1.081},"min":{"1min":0.79600000000000004,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.296,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":0.997}]},{"osd":4,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":1.095,"15min":1.115},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.3360000000000001,"5min":1.484,"15min":1.484},"last":1.6899999999999999},{"interface":"front","average":{"1min":1.121,"5min":1.181,"15min":1.1910000000000001},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":1.399}]},{"osd":5,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.1160000000000001,"15min":1.125},"min":{"1min":0.753,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.329,"5min":1.581,"15min":1.581},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.294,"15min":1.3120000000000001},"min":{"1min":1.0049999999999999,"5min":0.96099999999999997,"15min":0.96099999999999997},"max":{"1min":1.417,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":1.8}]},{"osd":7,"last update":"Sun Oct 8 15:39:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.2709999999999999,"15min":1.2849999999999999},"min":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":1.4550000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":1.643},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.2969999999999999,"15min":1.3109999999999999},"min":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":1.5429999999999999,"5min":2.5630000000000002,"15min":2.5630000000000002},"last":1.4630000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542184,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305932,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065908,"statfs":{"total":96636764160,"available":96323489792,"internally_reserved":0,"allocated":462848,"data_stored":181297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.71199999999999997,"15min":0.71999999999999997},"min":{"1min":0.51200000000000001,"5min":0.501,"15min":0.501},"max":{"1min":0.96299999999999997,"5min":1.056,"15min":1.056},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.76800000000000002,"15min":0.76200000000000001},"min":{"1min":0.59699999999999998,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.66700000000000004}]},{"osd":1,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.72099999999999997,"15min":0.71299999999999997},"min":{"1min":0.56899999999999995,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.82399999999999995,"15min":0.81200000000000006},"min":{"1min":0.67000000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1870000000000001,"5min":1.256,"15min":1.256},"last":1.353}]},{"osd":2,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.85999999999999999,"15min":0.85399999999999998},"min":{"1min":0.66900000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.337,"5min":1.361,"15min":1.361},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.92200000000000004,"15min":0.92600000000000005},"min":{"1min":0.751,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.228,"5min":1.423,"15min":1.423},"last":0.75}]},{"osd":4,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.0820000000000001,"15min":1.0680000000000001},"min":{"1min":0.90000000000000002,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.3879999999999999,"5min":1.504,"15min":1.504},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.145,"15min":1.155},"min":{"1min":0.85599999999999998,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.4410000000000001,"5min":2.762,"15min":2.762},"last":0.98199999999999998}]},{"osd":5,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.1679999999999999,"15min":1.1619999999999999},"min":{"1min":0.92800000000000005,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.466,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.02},{"interface":"front","average":{"1min":1.22,"5min":1.2330000000000001,"15min":1.2350000000000001},"min":{"1min":0.95899999999999996,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.474,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":0.91800000000000004}]},{"osd":6,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.2889999999999999,"15min":1.304},"min":{"1min":0.97199999999999998,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.569,"5min":2.6890000000000001,"15min":2.6890000000000001},"last":1.248},{"interface":"front","average":{"1min":1.238,"5min":1.2250000000000001,"15min":1.2230000000000001},"min":{"1min":0.89100000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":1.462,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":1.286}]},{"osd":7,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.2649999999999999,"15min":1.2589999999999999},"min":{"1min":0.97699999999999998,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":1.528,"5min":1.738,"15min":1.738},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.3520000000000001,"15min":1.3620000000000001},"min":{"1min":1.1080000000000001,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.623,"5min":2.5840000000000001,"15min":2.5840000000000001},"last":1.3300000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542183,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301840,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070000,"statfs":{"total":96636764160,"available":96327680000,"internally_reserved":0,"allocated":466944,"data_stored":182245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.626,"15min":0.621},"min":{"1min":0.48799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.67200000000000004,"15min":0.64900000000000002},"min":{"1min":0.52800000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.61599999999999999}]},{"osd":1,"last update":"Sun Oct 8 15:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.69099999999999995,"15min":0.67700000000000005},"min":{"1min":0.59399999999999997,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.71599999999999997,"15min":0.69199999999999995},"min":{"1min":0.55400000000000005,"5min":0.307,"15min":0.307},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.69399999999999995}]},{"osd":3,"last update":"Sun Oct 8 15:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.66600000000000004,"15min":0.64200000000000002},"min":{"1min":0.52300000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.85299999999999998,"15min":0.84299999999999997},"min":{"1min":0.72299999999999998,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.127,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.65100000000000002}]},{"osd":4,"last update":"Sun Oct 8 15:39:23 2023","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.004,"15min":1},"min":{"1min":0.75600000000000001,"5min":0.748,"15min":0.748},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.028,"5min":1.0329999999999999,"15min":1.034},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.4319999999999999,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.133}]},{"osd":5,"last update":"Sun Oct 8 15:39:23 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.0589999999999999,"15min":1.0569999999999999},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":1.161},{"interface":"front","average":{"1min":1.091,"5min":1.0640000000000001,"15min":1.0600000000000001},"min":{"1min":0.81000000000000005,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.288,"5min":1.452,"15min":1.452},"last":1.2569999999999999}]},{"osd":6,"last update":"Sun Oct 8 15:39:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.0940000000000001,"15min":1.091},"min":{"1min":0.82699999999999996,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.4159999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":1.218},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.117,"15min":1.105},"min":{"1min":0.85499999999999998,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":1.0680000000000001}]},{"osd":7,"last update":"Sun Oct 8 15:39:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.159,"15min":1.1499999999999999},"min":{"1min":0.84899999999999998,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":1.288},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.1739999999999999,"15min":1.161},"min":{"1min":0.86299999999999999,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.579,"5min":1.804,"15min":1.804},"last":1.24}]}]},{"osd":1,"up_from":14,"seq":60129542184,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305924,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065916,"statfs":{"total":96636764160,"available":96323497984,"internally_reserved":0,"allocated":454656,"data_stored":180757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.76500000000000001,"15min":0.77500000000000002},"min":{"1min":0.46700000000000003,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.165,"5min":1.734,"15min":1.734},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.96299999999999997,"15min":1},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0509999999999999,"5min":5.7960000000000003,"15min":5.7960000000000003},"last":0.55900000000000005}]},{"osd":2,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.83299999999999996,"15min":0.84699999999999998},"min":{"1min":0.56200000000000006,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.048,"5min":4.0119999999999996,"15min":4.0119999999999996},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.90600000000000003,"15min":0.91000000000000003},"min":{"1min":0.61599999999999999,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.0840000000000001,"5min":1.853,"15min":1.853},"last":0.69699999999999995}]},{"osd":3,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":1.7569999999999999,"5min":1.121,"15min":1.0149999999999999},"min":{"1min":0.73399999999999999,"5min":0.435,"15min":0.435},"max":{"1min":13.388,"5min":13.388,"15min":13.388},"last":1.002},{"interface":"front","average":{"1min":1.6899999999999999,"5min":1.2549999999999999,"15min":1.1830000000000001},"min":{"1min":0.66100000000000003,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":13.353,"5min":13.353,"15min":13.353},"last":0.92000000000000004}]},{"osd":4,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":1.2070000000000001,"15min":1.246},"min":{"1min":0.77800000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.246,"5min":5.859,"15min":5.859},"last":0.81699999999999995},{"interface":"front","average":{"1min":1.022,"5min":1.1479999999999999,"15min":1.169},"min":{"1min":0.82199999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.4550000000000001,"5min":4.2679999999999998,"15min":4.2679999999999998},"last":0.95699999999999996}]},{"osd":5,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.143,"15min":1.151},"min":{"1min":0.85799999999999998,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.5389999999999999,"5min":4.3380000000000001,"15min":4.3380000000000001},"last":1.123},{"interface":"front","average":{"1min":1.216,"5min":1.1890000000000001,"15min":1.1850000000000001},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.589,"5min":2.085,"15min":2.085},"last":0.73699999999999999}]},{"osd":6,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.359,"15min":1.3919999999999999},"min":{"1min":0.93600000000000005,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.4119999999999999,"5min":5.8979999999999997,"15min":5.8979999999999997},"last":1.323},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.274,"15min":1.284},"min":{"1min":1.0249999999999999,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.4390000000000001,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":1.401}]},{"osd":7,"last update":"Sun Oct 8 15:39:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.2549999999999999,"15min":1.2509999999999999},"min":{"1min":0.93400000000000005,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.679,"5min":2.3940000000000001,"15min":2.3940000000000001},"last":1.266},{"interface":"front","average":{"1min":1.222,"5min":1.46,"15min":1.5},"min":{"1min":1.0209999999999999,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.387,"5min":5.9299999999999997,"15min":5.9299999999999997},"last":1.2190000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542184,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301892,"kb_used_data":508,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069948,"statfs":{"total":96636764160,"available":96327626752,"internally_reserved":0,"allocated":520192,"data_stored":771089,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 15:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.81899999999999995,"15min":0.84199999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.3799999999999999,"5min":1.514,"15min":1.514},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.79200000000000004,"15min":0.79800000000000004},"min":{"1min":0.50600000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.999,"5min":1.518,"15min":1.518},"last":0.55900000000000005}]},{"osd":2,"last update":"Sun Oct 8 15:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.84499999999999997,"15min":0.86399999999999999},"min":{"1min":0.55400000000000005,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1539999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.79600000000000004,"15min":0.78900000000000003},"min":{"1min":0.61599999999999999,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.0800000000000001,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.44}]},{"osd":3,"last update":"Sun Oct 8 15:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.75600000000000001,"15min":0.76000000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.091,"5min":1.103,"15min":1.103},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.98499999999999999,"15min":0.995},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.474,"5min":2.3290000000000002,"15min":2.3290000000000002},"last":0.85299999999999998}]},{"osd":4,"last update":"Sun Oct 8 15:39:20 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.085,"15min":1.095},"min":{"1min":0.76000000000000001,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.49,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.093,"15min":1.0980000000000001},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.538,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":1.0880000000000001}]},{"osd":5,"last update":"Sun Oct 8 15:39:20 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0900000000000001,"15min":1.101},"min":{"1min":0.72099999999999997,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.413,"5min":2.214,"15min":2.214},"last":1.222},{"interface":"front","average":{"1min":1.151,"5min":1.323,"15min":1.3520000000000001},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.5269999999999999,"5min":3.4569999999999999,"15min":3.4569999999999999},"last":1.1359999999999999}]},{"osd":6,"last update":"Sun Oct 8 15:39:20 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.29,"15min":1.3080000000000001},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":1.575,"5min":2.532,"15min":2.532},"last":1.044},{"interface":"front","average":{"1min":1.216,"5min":1.244,"15min":1.2490000000000001},"min":{"1min":0.92700000000000005,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.6200000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.99099999999999999}]},{"osd":7,"last update":"Sun Oct 8 15:39:20 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.292,"15min":1.3},"min":{"1min":1.01,"5min":0.98199999999999998,"15min":0.98199999999999998},"max":{"1min":1.571,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.2310000000000001,"15min":1.2350000000000001},"min":{"1min":0.85199999999999998,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.597,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":1.167}]}]},{"osd":5,"up_from":13,"seq":55834574888,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301828,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070012,"statfs":{"total":96636764160,"available":96327692288,"internally_reserved":0,"allocated":454656,"data_stored":180757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.85599999999999998,"15min":0.84799999999999998},"min":{"1min":0.53600000000000003,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.90700000000000003,"15min":0.91000000000000003},"min":{"1min":0.67400000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.147,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":1.0880000000000001}]},{"osd":1,"last update":"Sun Oct 8 15:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.92000000000000004,"15min":0.91100000000000003},"min":{"1min":0.628,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.88,"5min":0.97599999999999998,"15min":0.99199999999999999},"min":{"1min":0.68500000000000005,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1799999999999999,"5min":1.754,"15min":1.754},"last":0.78700000000000003}]},{"osd":2,"last update":"Sun Oct 8 15:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.306,"5min":1.869,"15min":1.869},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.97499999999999998,"5min":1.0109999999999999,"15min":1.0169999999999999},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.484,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":1.0580000000000001}]},{"osd":3,"last update":"Sun Oct 8 15:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.997,"15min":1.0009999999999999},"min":{"1min":0.78300000000000003,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.2110000000000001,"5min":1.929,"15min":1.929},"last":1.038},{"interface":"front","average":{"1min":1.022,"5min":1.101,"15min":1.1140000000000001},"min":{"1min":0.745,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.3140000000000001,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":1.0740000000000001}]},{"osd":4,"last update":"Sun Oct 8 15:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.0109999999999999,"15min":1.014},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.464,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.085,"15min":1.085},"min":{"1min":0.67600000000000005,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.601,"5min":1.823,"15min":1.823},"last":0.91400000000000003}]},{"osd":6,"last update":"Sun Oct 8 15:39:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.202,"15min":1.2070000000000001},"min":{"1min":0.95899999999999996,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.429,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.165,"5min":1.2290000000000001,"15min":1.24},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.6739999999999999,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.73699999999999999}]},{"osd":7,"last update":"Sun Oct 8 15:39:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.155,"15min":1.167},"min":{"1min":0.89800000000000002,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.272,"5min":2.177,"15min":2.177},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.2190000000000001,"15min":1.2210000000000001},"min":{"1min":1.0089999999999999,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.575,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.014}]}]},{"osd":4,"up_from":13,"seq":55834574888,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301836,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070004,"statfs":{"total":96636764160,"available":96327684096,"internally_reserved":0,"allocated":462848,"data_stored":182223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.83699999999999997,"15min":0.81499999999999995},"min":{"1min":0.66200000000000003,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.125,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.80900000000000005,"15min":0.79300000000000004},"min":{"1min":0.52600000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.66400000000000003}]},{"osd":1,"last update":"Sun Oct 8 15:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.86399999999999999,"15min":0.83799999999999997},"min":{"1min":0.68100000000000005,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.85299999999999998,"15min":0.83699999999999997},"min":{"1min":0.67600000000000005,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.80600000000000005}]},{"osd":2,"last update":"Sun Oct 8 15:40:20 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0449999999999999,"15min":1.0329999999999999},"min":{"1min":0.72299999999999998,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.3080000000000001,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":1.046},{"interface":"front","average":{"1min":1.071,"5min":1.022,"15min":1.022},"min":{"1min":0.86399999999999999,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.234,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":1.1399999999999999}]},{"osd":3,"last update":"Sun Oct 8 15:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":1.004,"15min":1.016},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.2529999999999999,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.042,"15min":1.0349999999999999},"min":{"1min":0.68999999999999995,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":1.0629999999999999}]},{"osd":5,"last update":"Sun Oct 8 15:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.98199999999999998,"15min":0.96999999999999997},"min":{"1min":0.70599999999999996,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.343,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0660000000000001,"15min":1.0620000000000001},"min":{"1min":0.65300000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.3500000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":1.256}]},{"osd":6,"last update":"Sun Oct 8 15:40:20 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.1240000000000001,"15min":1.1419999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.3540000000000001,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.1859999999999999,"15min":1.1819999999999999},"min":{"1min":0.98599999999999999,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":1.333}]},{"osd":7,"last update":"Sun Oct 8 15:40:20 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.0820000000000001,"15min":1.0700000000000001},"min":{"1min":0.78100000000000003,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.387,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.196,"15min":1.1910000000000001},"min":{"1min":0.97399999999999998,"5min":0.625,"15min":0.625},"max":{"1min":1.4550000000000001,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.111}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T15:40:23.364 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-08T15:40:23.365 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-08T15:40:23.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.479+0000 7f356bf0f700 1 Processor -- start 2023-10-08T15:40:23.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.479+0000 7f356bf0f700 1 -- start start 2023-10-08T15:40:23.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.479+0000 7f356bf0f700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f35640bf3a0 0x7f356406d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:23.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.479+0000 7f356bf0f700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f356406c830 0x7f356406d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:23.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.483+0000 7f356bf0f700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f356414c2f0 con 0x7f356406da80 2023-10-08T15:40:23.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.483+0000 7f356bf0f700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35640a2800 con 0x7f356406c830 2023-10-08T15:40:23.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.483+0000 7f356bf0f700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f356414b9e0 con 0x7f35640bf3a0 2023-10-08T15:40:23.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.483+0000 7f35694aa700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f356406c830 0x7f356406d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:23.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.483+0000 7f35694aa700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f356406c830 0x7f356406d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52720/0 (socket says 172.21.15.3:52720) 2023-10-08T15:40:23.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.483+0000 7f35694aa700 1 -- 172.21.15.3:0/1907526936 learned_addr learned my addr 172.21.15.3:0/1907526936 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:23.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.483+0000 7f3569cab700 1 --2- 172.21.15.3:0/1907526936 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f35640bf3a0 0x7f356406d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:23.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.483+0000 7f35694aa700 1 -- 172.21.15.3:0/1907526936 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f35640bf3a0 msgr2=0x7f356406d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:23.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.483+0000 7f35694aa700 1 --2- 172.21.15.3:0/1907526936 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f35640bf3a0 0x7f356406d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:23.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.483+0000 7f35694aa700 1 -- 172.21.15.3:0/1907526936 >> v1:172.21.15.50:6789/0 conn(0x7f356406da80 legacy=0x7f356414ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:23.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.483+0000 7f35694aa700 1 -- 172.21.15.3:0/1907526936 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f356414bca0 con 0x7f356406c830 2023-10-08T15:40:23.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.483+0000 7f35694aa700 1 --2- 172.21.15.3:0/1907526936 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f356406c830 0x7f356406d540 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f35600099b0 tx=0x7f3560009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=855e83316a765382 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:23.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.483+0000 7f3568ca9700 1 -- 172.21.15.3:0/1907526936 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356000b860 con 0x7f356406c830 2023-10-08T15:40:23.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.483+0000 7f3568ca9700 1 -- 172.21.15.3:0/1907526936 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f356000b9c0 con 0x7f356406c830 2023-10-08T15:40:23.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.483+0000 7f3568ca9700 1 -- 172.21.15.3:0/1907526936 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356000bd80 con 0x7f356406c830 2023-10-08T15:40:23.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.483+0000 7f356bf0f700 1 -- 172.21.15.3:0/1907526936 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f356406c830 msgr2=0x7f356406d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:23.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.483+0000 7f356bf0f700 1 --2- 172.21.15.3:0/1907526936 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f356406c830 0x7f356406d540 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f35600099b0 tx=0x7f3560009250 comp rx=0 tx=0).stop 2023-10-08T15:40:23.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.483+0000 7f356bf0f700 1 -- 172.21.15.3:0/1907526936 shutdown_connections 2023-10-08T15:40:23.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.483+0000 7f356bf0f700 1 --2- 172.21.15.3:0/1907526936 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f356406c830 0x7f356406d540 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:23.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.483+0000 7f356bf0f700 1 --2- 172.21.15.3:0/1907526936 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f35640bf3a0 0x7f356406d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:23.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.483+0000 7f356bf0f700 1 -- 172.21.15.3:0/1907526936 >> 172.21.15.3:0/1907526936 conn(0x7f35640c2a80 msgr2=0x7f35640bea60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:23.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.483+0000 7f356bf0f700 1 -- 172.21.15.3:0/1907526936 shutdown_connections 2023-10-08T15:40:23.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.483+0000 7f356bf0f700 1 -- 172.21.15.3:0/1907526936 wait complete. 2023-10-08T15:40:23.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.487+0000 7f356bf0f700 1 Processor -- start 2023-10-08T15:40:23.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.487+0000 7f356bf0f700 1 -- start start 2023-10-08T15:40:23.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.487+0000 7f356bf0f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f356406c830 0x7f356414ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:23.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.487+0000 7f356bf0f700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f356406da80 0x7f35640c0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:23.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.487+0000 7f356bf0f700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f35640bf3a0 0x7f3564144410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:23.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.487+0000 7f356bf0f700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f356409c3c0 con 0x7f356406da80 2023-10-08T15:40:23.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.487+0000 7f356bf0f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f356414f220 con 0x7f356406c830 2023-10-08T15:40:23.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.487+0000 7f356bf0f700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f356414f4d0 con 0x7f35640bf3a0 2023-10-08T15:40:23.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.487+0000 7f35694aa700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f356406da80 0x7f35640c0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:23.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.487+0000 7f35694aa700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f356406da80 0x7f35640c0a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52724/0 (socket says 172.21.15.3:52724) 2023-10-08T15:40:23.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.487+0000 7f35694aa700 1 -- 172.21.15.3:0/3255437700 learned_addr learned my addr 172.21.15.3:0/3255437700 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:23.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.487+0000 7f3569cab700 1 --2- 172.21.15.3:0/3255437700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f356406c830 0x7f356414ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:23.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.487+0000 7f356a4ac700 1 --2- 172.21.15.3:0/3255437700 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f35640bf3a0 0x7f3564144410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:23.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.487+0000 7f35694aa700 1 -- 172.21.15.3:0/3255437700 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f35640bf3a0 msgr2=0x7f3564144410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:23.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.487+0000 7f35694aa700 1 --2- 172.21.15.3:0/3255437700 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f35640bf3a0 0x7f3564144410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:23.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.487+0000 7f35694aa700 1 -- 172.21.15.3:0/3255437700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f356406c830 msgr2=0x7f356414ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:23.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.487+0000 7f35694aa700 1 --2- 172.21.15.3:0/3255437700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f356406c830 0x7f356414ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:23.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.487+0000 7f35694aa700 1 -- 172.21.15.3:0/3255437700 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35600094f0 con 0x7f356406da80 2023-10-08T15:40:23.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.487+0000 7f3569cab700 1 --2- 172.21.15.3:0/3255437700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f356406c830 0x7f356414ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:40:23.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.487+0000 7f35694aa700 1 --2- 172.21.15.3:0/3255437700 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f356406da80 0x7f35640c0a80 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f3560006fd0 tx=0x7f3560017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:23.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.487+0000 7f3559ffb700 1 -- 172.21.15.3:0/3255437700 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356001f070 con 0x7f356406da80 2023-10-08T15:40:23.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.487+0000 7f3559ffb700 1 -- 172.21.15.3:0/3255437700 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3560006b10 con 0x7f356406da80 2023-10-08T15:40:23.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.487+0000 7f356bf0f700 1 -- 172.21.15.3:0/3255437700 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f356414f7b0 con 0x7f356406da80 2023-10-08T15:40:23.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.487+0000 7f3559ffb700 1 -- 172.21.15.3:0/3255437700 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356001a650 con 0x7f356406da80 2023-10-08T15:40:23.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.487+0000 7f356bf0f700 1 -- 172.21.15.3:0/3255437700 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f356415ae30 con 0x7f356406da80 2023-10-08T15:40:23.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.491+0000 7f3559ffb700 1 -- 172.21.15.3:0/3255437700 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f356001aa00 con 0x7f356406da80 2023-10-08T15:40:23.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.491+0000 7f356bf0f700 1 -- 172.21.15.3:0/3255437700 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f356415b020 con 0x7f356406da80 2023-10-08T15:40:23.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.491+0000 7f3559ffb700 1 --2- 172.21.15.3:0/3255437700 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3548060580 0x7f3548062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:23.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.491+0000 7f3559ffb700 1 -- 172.21.15.3:0/3255437700 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f356007dd10 con 0x7f356406da80 2023-10-08T15:40:23.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.491+0000 7f3569cab700 1 --2- 172.21.15.3:0/3255437700 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3548060580 0x7f3548062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:23.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.491+0000 7f3569cab700 1 --2- 172.21.15.3:0/3255437700 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3548060580 0x7f3548062a30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3554006fd0 tx=0x7f3554008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:23.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.503+0000 7f3559ffb700 1 -- 172.21.15.3:0/3255437700 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3560083020 con 0x7f356406da80 2023-10-08T15:40:23.721 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.719+0000 7f356bf0f700 1 -- 172.21.15.3:0/3255437700 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f3564064530 con 0x7f356406da80 2023-10-08T15:40:23.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.727+0000 7f3559ffb700 1 -- 172.21.15.3:0/3255437700 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) v1 ==== 190+0+0 (secure 0 0 0) 0x7f35600150e0 con 0x7f356406da80 2023-10-08T15:40:23.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.727+0000 7f356bf0f700 1 -- 172.21.15.3:0/3255437700 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3548060580 msgr2=0x7f3548062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:23.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.727+0000 7f356bf0f700 1 --2- 172.21.15.3:0/3255437700 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3548060580 0x7f3548062a30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3554006fd0 tx=0x7f3554008040 comp rx=0 tx=0).stop 2023-10-08T15:40:23.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.727+0000 7f356bf0f700 1 -- 172.21.15.3:0/3255437700 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f356406da80 msgr2=0x7f35640c0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:23.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.727+0000 7f356bf0f700 1 --2- 172.21.15.3:0/3255437700 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f356406da80 0x7f35640c0a80 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f3560006fd0 tx=0x7f3560017000 comp rx=0 tx=0).stop 2023-10-08T15:40:23.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.727+0000 7f356bf0f700 1 -- 172.21.15.3:0/3255437700 shutdown_connections 2023-10-08T15:40:23.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.727+0000 7f356bf0f700 1 --2- 172.21.15.3:0/3255437700 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3548060580 0x7f3548062a30 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:23.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.731+0000 7f356bf0f700 1 --2- 172.21.15.3:0/3255437700 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f35640bf3a0 0x7f3564144410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:23.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.731+0000 7f356bf0f700 1 --2- 172.21.15.3:0/3255437700 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f356406da80 0x7f35640c0a80 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:23.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.731+0000 7f356bf0f700 1 --2- 172.21.15.3:0/3255437700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f356406c830 0x7f356414ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:23.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.731+0000 7f356bf0f700 1 -- 172.21.15.3:0/3255437700 >> 172.21.15.3:0/3255437700 conn(0x7f35640c2a80 msgr2=0x7f3564146640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:23.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.731+0000 7f356bf0f700 1 -- 172.21.15.3:0/3255437700 shutdown_connections 2023-10-08T15:40:23.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.731+0000 7f356bf0f700 1 -- 172.21.15.3:0/3255437700 wait complete. 2023-10-08T15:40:23.771 INFO:teuthology.orchestra.run.smithi003.stderr:updated caps for client.0 2023-10-08T15:40:23.771 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:40:23.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.879+0000 7f46754f0700 1 Processor -- start 2023-10-08T15:40:23.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.879+0000 7f46754f0700 1 -- start start 2023-10-08T15:40:23.887 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.883+0000 7f46754f0700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f46700a15e0 0x7f467014b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:23.887 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.883+0000 7f46754f0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4670146b70 0x7f4670146fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:23.887 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.883+0000 7f46754f0700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4670147970 con 0x7f4670147510 2023-10-08T15:40:23.887 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.883+0000 7f46754f0700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f467006de00 con 0x7f46700a15e0 2023-10-08T15:40:23.887 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.883+0000 7f46754f0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f467014bd90 con 0x7f4670146b70 2023-10-08T15:40:23.887 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.883+0000 7f466ffff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f46700a15e0 0x7f467014b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:23.887 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.883+0000 7f4674cef700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f4670147510 0x7f4670147e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:49634/0 (socket says 172.21.15.3:49634) 2023-10-08T15:40:23.887 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.883+0000 7f4674cef700 1 -- 172.21.15.3:0/1862921015 learned_addr learned my addr 172.21.15.3:0/1862921015 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:40:23.887 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.883+0000 7f4667fff700 1 --2- 172.21.15.3:0/1862921015 >> v2:172.21.15.50:3300/0 conn(0x7f4670146b70 0x7f4670146fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:23.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.883+0000 7f466ffff700 1 -- 172.21.15.3:0/1862921015 >> v2:172.21.15.50:3300/0 conn(0x7f4670146b70 msgr2=0x7f4670146fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:23.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.883+0000 7f466ffff700 1 --2- 172.21.15.3:0/1862921015 >> v2:172.21.15.50:3300/0 conn(0x7f4670146b70 0x7f4670146fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:23.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.883+0000 7f466ffff700 1 -- 172.21.15.3:0/1862921015 >> v1:172.21.15.3:6789/0 conn(0x7f4670147510 legacy=0x7f4670147e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:23.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.883+0000 7f466ffff700 1 -- 172.21.15.3:0/1862921015 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4670069770 con 0x7f46700a15e0 2023-10-08T15:40:23.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.883+0000 7f466ffff700 1 --2- 172.21.15.3:0/1862921015 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f46700a15e0 0x7f467014b850 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4670067f90 tx=0x7f466000b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=995a6bd19951c7e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:23.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.883+0000 7f466f7fe700 1 -- 172.21.15.3:0/1862921015 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466000da30 con 0x7f46700a15e0 2023-10-08T15:40:23.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.883+0000 7f466f7fe700 1 -- 172.21.15.3:0/1862921015 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f466000db90 con 0x7f46700a15e0 2023-10-08T15:40:23.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.883+0000 7f466f7fe700 1 -- 172.21.15.3:0/1862921015 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4660017410 con 0x7f46700a15e0 2023-10-08T15:40:23.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.883+0000 7f46754f0700 1 -- 172.21.15.3:0/1862921015 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f46700a15e0 msgr2=0x7f467014b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:23.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.883+0000 7f46754f0700 1 --2- 172.21.15.3:0/1862921015 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f46700a15e0 0x7f467014b850 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4670067f90 tx=0x7f466000b430 comp rx=0 tx=0).stop 2023-10-08T15:40:23.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.883+0000 7f46754f0700 1 -- 172.21.15.3:0/1862921015 shutdown_connections 2023-10-08T15:40:23.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.883+0000 7f46754f0700 1 --2- 172.21.15.3:0/1862921015 >> v2:172.21.15.50:3300/0 conn(0x7f4670146b70 0x7f4670146fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:23.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.883+0000 7f46754f0700 1 --2- 172.21.15.3:0/1862921015 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f46700a15e0 0x7f467014b850 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:23.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.883+0000 7f46754f0700 1 -- 172.21.15.3:0/1862921015 >> 172.21.15.3:0/1862921015 conn(0x7f46700670e0 msgr2=0x7f46700674e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:23.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.883+0000 7f46754f0700 1 -- 172.21.15.3:0/1862921015 shutdown_connections 2023-10-08T15:40:23.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.883+0000 7f46754f0700 1 -- 172.21.15.3:0/1862921015 wait complete. 2023-10-08T15:40:23.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.887+0000 7f46754f0700 1 Processor -- start 2023-10-08T15:40:23.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.887+0000 7f46754f0700 1 -- start start 2023-10-08T15:40:23.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.887+0000 7f46754f0700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f46700a15e0 0x7f46700b24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:23.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.887+0000 7f46754f0700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4670146b70 0x7f4670145f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:23.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.887+0000 7f46754f0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4670147510 0x7f4670156f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:23.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.887+0000 7f46754f0700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467014df30 con 0x7f4670146b70 2023-10-08T15:40:23.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.887+0000 7f46754f0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46700b4580 con 0x7f4670147510 2023-10-08T15:40:23.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.887+0000 7f46754f0700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4670156820 con 0x7f46700a15e0 2023-10-08T15:40:23.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.887+0000 7f4667fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4670146b70 0x7f4670145f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:23.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.887+0000 7f4667fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4670146b70 0x7f4670145f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52736/0 (socket says 172.21.15.3:52736) 2023-10-08T15:40:23.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.887+0000 7f4667fff700 1 -- 172.21.15.3:0/2543691846 learned_addr learned my addr 172.21.15.3:0/2543691846 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:23.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.887+0000 7f4674cef700 1 --2- 172.21.15.3:0/2543691846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4670147510 0x7f4670156f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:23.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.887+0000 7f466ffff700 1 --2- 172.21.15.3:0/2543691846 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f46700a15e0 0x7f46700b24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:23.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.887+0000 7f4667fff700 1 -- 172.21.15.3:0/2543691846 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f46700a15e0 msgr2=0x7f46700b24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:23.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.887+0000 7f4667fff700 1 --2- 172.21.15.3:0/2543691846 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f46700a15e0 0x7f46700b24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:23.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.887+0000 7f4667fff700 1 -- 172.21.15.3:0/2543691846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4670147510 msgr2=0x7f4670156f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:23.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.887+0000 7f4667fff700 1 --2- 172.21.15.3:0/2543691846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4670147510 0x7f4670156f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:23.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.887+0000 7f4667fff700 1 -- 172.21.15.3:0/2543691846 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f466000b6d0 con 0x7f4670146b70 2023-10-08T15:40:23.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.887+0000 7f466ffff700 1 --2- 172.21.15.3:0/2543691846 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f46700a15e0 0x7f46700b24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:40:23.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.887+0000 7f4667fff700 1 --2- 172.21.15.3:0/2543691846 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4670146b70 0x7f4670145f20 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f465800ec80 tx=0x7f46580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:23.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.887+0000 7f466cff9700 1 -- 172.21.15.3:0/2543691846 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465800c9d0 con 0x7f4670146b70 2023-10-08T15:40:23.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.887+0000 7f466cff9700 1 -- 172.21.15.3:0/2543691846 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f465800cb30 con 0x7f4670146b70 2023-10-08T15:40:23.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.887+0000 7f46754f0700 1 -- 172.21.15.3:0/2543691846 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4670156ac0 con 0x7f4670146b70 2023-10-08T15:40:23.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.887+0000 7f466cff9700 1 -- 172.21.15.3:0/2543691846 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4658013470 con 0x7f4670146b70 2023-10-08T15:40:23.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.887+0000 7f46754f0700 1 -- 172.21.15.3:0/2543691846 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4670146460 con 0x7f4670146b70 2023-10-08T15:40:23.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.891+0000 7f466cff9700 1 -- 172.21.15.3:0/2543691846 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4658013820 con 0x7f4670146b70 2023-10-08T15:40:23.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.891+0000 7f46754f0700 1 -- 172.21.15.3:0/2543691846 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f467005ecf0 con 0x7f4670146b70 2023-10-08T15:40:23.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.891+0000 7f466cff9700 1 --2- 172.21.15.3:0/2543691846 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4650060550 0x7f4650062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:23.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.891+0000 7f466cff9700 1 -- 172.21.15.3:0/2543691846 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f465807cb10 con 0x7f4670146b70 2023-10-08T15:40:23.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.891+0000 7f466ffff700 1 --2- 172.21.15.3:0/2543691846 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4650060550 0x7f4650062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:23.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.891+0000 7f466ffff700 1 --2- 172.21.15.3:0/2543691846 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4650060550 0x7f4650062a00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f466000b470 tx=0x7f4660019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:23.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:23.899+0000 7f466cff9700 1 -- 172.21.15.3:0/2543691846 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f465804d060 con 0x7f4670146b70 2023-10-08T15:40:24.098 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.095+0000 7f46754f0700 1 -- 172.21.15.3:0/2543691846 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4670068c60 con 0x7f4670146b70 2023-10-08T15:40:24.107 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.095+0000 7f466cff9700 1 -- 172.21.15.3:0/2543691846 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+3080 (secure 0 0 0) 0x7f4658017c20 con 0x7f4670146b70 2023-10-08T15:40:24.107 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:40:24.107 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5006,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3286528236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3286528236},{"type":"v1","addr":"172.21.15.50:6835","nonce":3286528236}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:40:13.764784+0000","modified":"2023-10-08T15:40:16.434138+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5337},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5337":{"gid":5337,"name":"a","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.3:6833/3441752211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":3441752211},{"type":"v1","addr":"172.21.15.3:6833","nonce":3441752211}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-08T15:40:24.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.095+0000 7f46754f0700 1 -- 172.21.15.3:0/2543691846 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4650060550 msgr2=0x7f4650062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:24.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.095+0000 7f46754f0700 1 --2- 172.21.15.3:0/2543691846 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4650060550 0x7f4650062a00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f466000b470 tx=0x7f4660019000 comp rx=0 tx=0).stop 2023-10-08T15:40:24.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.095+0000 7f46754f0700 1 -- 172.21.15.3:0/2543691846 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4670146b70 msgr2=0x7f4670145f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:24.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.095+0000 7f46754f0700 1 --2- 172.21.15.3:0/2543691846 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4670146b70 0x7f4670145f20 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f465800ec80 tx=0x7f46580091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.095+0000 7f46754f0700 1 -- 172.21.15.3:0/2543691846 shutdown_connections 2023-10-08T15:40:24.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.095+0000 7f46754f0700 1 --2- 172.21.15.3:0/2543691846 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4650060550 0x7f4650062a00 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.095+0000 7f46754f0700 1 --2- 172.21.15.3:0/2543691846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4670147510 0x7f4670156f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.095+0000 7f46754f0700 1 --2- 172.21.15.3:0/2543691846 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4670146b70 0x7f4670145f20 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.095+0000 7f46754f0700 1 --2- 172.21.15.3:0/2543691846 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f46700a15e0 0x7f46700b24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.095+0000 7f46754f0700 1 -- 172.21.15.3:0/2543691846 >> 172.21.15.3:0/2543691846 conn(0x7f46700670e0 msgr2=0x7f46700bd200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:24.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.099+0000 7f46754f0700 1 -- 172.21.15.3:0/2543691846 shutdown_connections 2023-10-08T15:40:24.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.099+0000 7f46754f0700 1 -- 172.21.15.3:0/2543691846 wait complete. 2023-10-08T15:40:24.110 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 19 2023-10-08T15:40:24.315 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 19, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-08T15:40:13.764784+0000', 'modified': '2023-10-08T15:40:16.434138+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5337}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5337': {'gid': 5337, 'name': 'a', 'rank': 0, 'incarnation': 17, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.3:6833/3441752211', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.3:6832', 'nonce': 3441752211}, {'type': 'v1', 'addr': '172.21.15.3:6833', 'nonce': 3441752211}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-08T15:40:24.348 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-08T15:40:24.349 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-08T15:40:24.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.467+0000 7fefda3fc700 1 Processor -- start 2023-10-08T15:40:24.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.467+0000 7fefda3fc700 1 -- start start 2023-10-08T15:40:24.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.467+0000 7fefda3fc700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fefd406d6e0 0x7fefd406c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:24.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.467+0000 7fefda3fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fefd40badb0 0x7fefd4147fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:24.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.467+0000 7fefda3fc700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefd414bcc0 con 0x7fefd4147c10 2023-10-08T15:40:24.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.467+0000 7fefda3fc700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefd406db10 con 0x7fefd40badb0 2023-10-08T15:40:24.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.467+0000 7fefda3fc700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefd406cd60 con 0x7fefd406d6e0 2023-10-08T15:40:24.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.467+0000 7fefd8999700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fefd40badb0 0x7fefd4147fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:24.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.467+0000 7fefcbfff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fefd406d6e0 0x7fefd406c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:24.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.467+0000 7fefd8999700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fefd40badb0 0x7fefd4147fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.3:58924/0 (socket says 172.21.15.3:58924) 2023-10-08T15:40:24.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.467+0000 7fefd8999700 1 -- 172.21.15.3:0/569932888 learned_addr learned my addr 172.21.15.3:0/569932888 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:24.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.467+0000 7fefcbfff700 1 -- 172.21.15.3:0/569932888 >> v2:172.21.15.50:3300/0 conn(0x7fefd40badb0 msgr2=0x7fefd4147fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:24.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.467+0000 7fefcbfff700 1 --2- 172.21.15.3:0/569932888 >> v2:172.21.15.50:3300/0 conn(0x7fefd40badb0 0x7fefd4147fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.467+0000 7fefcbfff700 1 -- 172.21.15.3:0/569932888 >> v1:172.21.15.50:6789/0 conn(0x7fefd4147c10 legacy=0x7fefd414c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:24.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.467+0000 7fefcbfff700 1 -- 172.21.15.3:0/569932888 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd414c860 con 0x7fefd406d6e0 2023-10-08T15:40:24.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.467+0000 7fefd8999700 1 --2- 172.21.15.3:0/569932888 >> v2:172.21.15.50:3300/0 conn(0x7fefd40badb0 0x7fefd4147fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:40:24.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.467+0000 7fefcbfff700 1 --2- 172.21.15.3:0/569932888 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fefd406d6e0 0x7fefd406c820 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fefbc0098e0 tx=0x7fefbc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8efd4294ee7ad73 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:24.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.467+0000 7fefd37fe700 1 -- 172.21.15.3:0/569932888 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefbc00b640 con 0x7fefd406d6e0 2023-10-08T15:40:24.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.467+0000 7fefd37fe700 1 -- 172.21.15.3:0/569932888 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefbc00b7a0 con 0x7fefd406d6e0 2023-10-08T15:40:24.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.467+0000 7fefd37fe700 1 -- 172.21.15.3:0/569932888 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefbc00bb40 con 0x7fefd406d6e0 2023-10-08T15:40:24.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.471+0000 7fefda3fc700 1 -- 172.21.15.3:0/569932888 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fefd406d6e0 msgr2=0x7fefd406c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:24.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.471+0000 7fefda3fc700 1 --2- 172.21.15.3:0/569932888 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fefd406d6e0 0x7fefd406c820 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fefbc0098e0 tx=0x7fefbc0091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.471+0000 7fefda3fc700 1 -- 172.21.15.3:0/569932888 shutdown_connections 2023-10-08T15:40:24.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.471+0000 7fefda3fc700 1 --2- 172.21.15.3:0/569932888 >> v2:172.21.15.50:3300/0 conn(0x7fefd40badb0 0x7fefd4147fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.471+0000 7fefda3fc700 1 --2- 172.21.15.3:0/569932888 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fefd406d6e0 0x7fefd406c820 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.471+0000 7fefda3fc700 1 -- 172.21.15.3:0/569932888 >> 172.21.15.3:0/569932888 conn(0x7fefd40be640 msgr2=0x7fefd40ba6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:24.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.471+0000 7fefda3fc700 1 -- 172.21.15.3:0/569932888 shutdown_connections 2023-10-08T15:40:24.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.471+0000 7fefda3fc700 1 -- 172.21.15.3:0/569932888 wait complete. 2023-10-08T15:40:24.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.471+0000 7fefda3fc700 1 Processor -- start 2023-10-08T15:40:24.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.471+0000 7fefda3fc700 1 -- start start 2023-10-08T15:40:24.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.471+0000 7fefda3fc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fefd406d6e0 0x7fefd4145fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:24.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.471+0000 7fefda3fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefd40badb0 0x7fefd415e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:24.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.471+0000 7fefda3fc700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fefd4147c10 0x7fefd414f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:24.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.471+0000 7fefda3fc700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd40b5620 con 0x7fefd406d6e0 2023-10-08T15:40:24.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.471+0000 7fefda3fc700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd4145150 con 0x7fefd40badb0 2023-10-08T15:40:24.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.471+0000 7fefda3fc700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefd40b5190 con 0x7fefd4147c10 2023-10-08T15:40:24.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.471+0000 7fefd3fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fefd406d6e0 0x7fefd4145fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:24.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.471+0000 7fefcbfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefd40badb0 0x7fefd415e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:24.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.475+0000 7fefd3fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fefd406d6e0 0x7fefd4145fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52752/0 (socket says 172.21.15.3:52752) 2023-10-08T15:40:24.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.475+0000 7fefcbfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefd40badb0 0x7fefd415e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.3:58926/0 (socket says 172.21.15.3:58926) 2023-10-08T15:40:24.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.475+0000 7fefd3fff700 1 -- 172.21.15.3:0/3265739778 learned_addr learned my addr 172.21.15.3:0/3265739778 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:24.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.475+0000 7fefd8999700 1 --2- 172.21.15.3:0/3265739778 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fefd4147c10 0x7fefd414f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:24.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.475+0000 7fefd3fff700 1 -- 172.21.15.3:0/3265739778 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fefd4147c10 msgr2=0x7fefd414f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:24.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.475+0000 7fefd3fff700 1 --2- 172.21.15.3:0/3265739778 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fefd4147c10 0x7fefd414f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.475+0000 7fefd3fff700 1 -- 172.21.15.3:0/3265739778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefd40badb0 msgr2=0x7fefd415e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:24.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.475+0000 7fefd3fff700 1 --2- 172.21.15.3:0/3265739778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefd40badb0 0x7fefd415e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.475+0000 7fefd3fff700 1 -- 172.21.15.3:0/3265739778 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefcc009ae0 con 0x7fefd406d6e0 2023-10-08T15:40:24.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.475+0000 7fefd3fff700 1 --2- 172.21.15.3:0/3265739778 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fefd406d6e0 0x7fefd4145fa0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fefc400c540 tx=0x7fefc4001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:24.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.475+0000 7fefd0ff9700 1 -- 172.21.15.3:0/3265739778 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc4011590 con 0x7fefd406d6e0 2023-10-08T15:40:24.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.475+0000 7fefd0ff9700 1 -- 172.21.15.3:0/3265739778 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc40116f0 con 0x7fefd406d6e0 2023-10-08T15:40:24.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.475+0000 7fefda3fc700 1 -- 172.21.15.3:0/3265739778 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefbc009420 con 0x7fefd406d6e0 2023-10-08T15:40:24.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.475+0000 7fefd0ff9700 1 -- 172.21.15.3:0/3265739778 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc4011ab0 con 0x7fefd406d6e0 2023-10-08T15:40:24.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.475+0000 7fefda3fc700 1 -- 172.21.15.3:0/3265739778 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefd415ee80 con 0x7fefd406d6e0 2023-10-08T15:40:24.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.475+0000 7fefd0ff9700 1 -- 172.21.15.3:0/3265739778 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fefc401b3b0 con 0x7fefd406d6e0 2023-10-08T15:40:24.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.479+0000 7fefd0ff9700 1 --2- 172.21.15.3:0/3265739778 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fefb4060580 0x7fefb4062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:24.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.479+0000 7fefd0ff9700 1 -- 172.21.15.3:0/3265739778 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fefc407ba20 con 0x7fefd406d6e0 2023-10-08T15:40:24.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.479+0000 7fefcbfff700 1 --2- 172.21.15.3:0/3265739778 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fefb4060580 0x7fefb4062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:24.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.479+0000 7fefdc6a5740 1 Processor -- start 2023-10-08T15:40:24.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.479+0000 7fefdc6a5740 1 -- start start 2023-10-08T15:40:24.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.479+0000 7fefcbfff700 1 --2- 172.21.15.3:0/3265739778 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fefb4060580 0x7fefb4062a30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fefbc0091e0 tx=0x7fefbc017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:24.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.479+0000 7fefdc6a5740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1cfeae0 0x1f36460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:24.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.479+0000 7fefdc6a5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1cfe710 0x1f369a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:24.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.479+0000 7fefdc6a5740 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1d49790 0x1f36ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:24.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.479+0000 7fefdc6a5740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ea9f30 con 0x1cfeae0 2023-10-08T15:40:24.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.479+0000 7fefdc6a5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ea5ed0 con 0x1cfe710 2023-10-08T15:40:24.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.479+0000 7fefdc6a5740 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x1e6c0b0 con 0x1d49790 2023-10-08T15:40:24.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.479+0000 7fefd3fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1cfeae0 0x1f36460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:24.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.479+0000 7fefd3fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1cfeae0 0x1f36460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52758/0 (socket says 172.21.15.3:52758) 2023-10-08T15:40:24.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.479+0000 7fefd3fff700 1 -- 172.21.15.3:0/1205614555 learned_addr learned my addr 172.21.15.3:0/1205614555 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:24.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.479+0000 7fefcbfff700 1 --2- 172.21.15.3:0/1205614555 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1cfe710 0x1f369a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:24.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.479+0000 7fefd8999700 1 --2- 172.21.15.3:0/1205614555 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1d49790 0x1f36ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:24.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.479+0000 7fefd3fff700 1 -- 172.21.15.3:0/1205614555 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1d49790 msgr2=0x1f36ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:24.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.479+0000 7fefd3fff700 1 --2- 172.21.15.3:0/1205614555 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1d49790 0x1f36ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.479+0000 7fefd3fff700 1 -- 172.21.15.3:0/1205614555 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1cfe710 msgr2=0x1f369a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:24.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.479+0000 7fefd3fff700 1 --2- 172.21.15.3:0/1205614555 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1cfe710 0x1f369a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.479+0000 7fefd3fff700 1 -- 172.21.15.3:0/1205614555 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1d4a9e0 con 0x1cfeae0 2023-10-08T15:40:24.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.479+0000 7fefd3fff700 1 --2- 172.21.15.3:0/1205614555 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1cfeae0 0x1f36460 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fefc404fd10 tx=0x7fefc4079ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bff32062e5dcd7b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:24.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.479+0000 7fefc97fa700 1 -- 172.21.15.3:0/1205614555 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc4065170 con 0x1cfeae0 2023-10-08T15:40:24.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.479+0000 7fefc97fa700 1 -- 172.21.15.3:0/1205614555 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc4056cb0 con 0x1cfeae0 2023-10-08T15:40:24.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.479+0000 7fefc97fa700 1 -- 172.21.15.3:0/1205614555 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc404dec0 con 0x1cfeae0 2023-10-08T15:40:24.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.483+0000 7fefdc6a5740 1 -- 172.21.15.3:0/1205614555 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1cfeae0 msgr2=0x1f36460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:24.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.483+0000 7fefdc6a5740 1 --2- 172.21.15.3:0/1205614555 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1cfeae0 0x1f36460 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fefc404fd10 tx=0x7fefc4079ea0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.483+0000 7fefdc6a5740 1 -- 172.21.15.3:0/1205614555 shutdown_connections 2023-10-08T15:40:24.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.483+0000 7fefdc6a5740 1 --2- 172.21.15.3:0/1205614555 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1d49790 0x1f36ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.483+0000 7fefdc6a5740 1 --2- 172.21.15.3:0/1205614555 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1cfe710 0x1f369a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.483+0000 7fefdc6a5740 1 --2- 172.21.15.3:0/1205614555 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1cfeae0 0x1f36460 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.483+0000 7fefdc6a5740 1 -- 172.21.15.3:0/1205614555 >> 172.21.15.3:0/1205614555 conn(0x1cfeeb0 msgr2=0x1f31810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:24.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.483+0000 7fefdc6a5740 1 -- 172.21.15.3:0/1205614555 shutdown_connections 2023-10-08T15:40:24.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.483+0000 7fefdc6a5740 1 -- 172.21.15.3:0/1205614555 wait complete. 2023-10-08T15:40:24.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.483+0000 7fefdc6a5740 1 -- start start 2023-10-08T15:40:24.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.483+0000 7fefdc6a5740 1 Processor -- start 2023-10-08T15:40:24.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.487+0000 7fefdc6a5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1cfe710 0x1f6c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:24.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.487+0000 7fefdc6a5740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1cfeae0 0x1f6cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:24.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.487+0000 7fefdc6a5740 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1d49790 0x1f6d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:24.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.487+0000 7fefdc6a5740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e6bd50 con 0x1cfeae0 2023-10-08T15:40:24.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.487+0000 7fefdc6a5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e44970 con 0x1cfe710 2023-10-08T15:40:24.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.487+0000 7fefdc6a5740 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x1e51ec0 con 0x1d49790 2023-10-08T15:40:24.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.487+0000 7fefdc6a5740 10 client.0 _ll_register_callbacks cb 0x1eef6a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T15:40:24.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.487+0000 7fefcbfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1cfeae0 0x1f6cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:24.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.487+0000 7fefd3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1cfe710 0x1f6c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:24.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.487+0000 7fefcbfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1cfeae0 0x1f6cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52760/0 (socket says 172.21.15.3:52760) 2023-10-08T15:40:24.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.487+0000 7fefd3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1cfe710 0x1f6c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.3:58930/0 (socket says 172.21.15.3:58930) 2023-10-08T15:40:24.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.487+0000 7fefcbfff700 1 -- 172.21.15.3:0/4261808758 learned_addr learned my addr 172.21.15.3:0/4261808758 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:24.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.487+0000 7fefd8999700 1 --2- 172.21.15.3:0/4261808758 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1d49790 0x1f6d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:24.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.487+0000 7fefcbfff700 1 -- 172.21.15.3:0/4261808758 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1d49790 msgr2=0x1f6d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:24.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.487+0000 7fefcbfff700 1 --2- 172.21.15.3:0/4261808758 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1d49790 0x1f6d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.487+0000 7fefcbfff700 1 -- 172.21.15.3:0/4261808758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1cfe710 msgr2=0x1f6c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:24.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.487+0000 7fefcbfff700 1 --2- 172.21.15.3:0/4261808758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1cfe710 0x1f6c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.487+0000 7fefcbfff700 1 -- 172.21.15.3:0/4261808758 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefd415ee80 con 0x1cfeae0 2023-10-08T15:40:24.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.487+0000 7fefcbfff700 1 --2- 172.21.15.3:0/4261808758 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1cfeae0 0x1f6cab0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fefbc00b770 tx=0x7fefbc021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ba0c35b4070a8f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:24.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.487+0000 7fefb27fc700 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2023-10-08T15:40:24.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.487+0000 7fefb27fc700 1 -- 172.21.15.3:0/4261808758 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefbc030070 con 0x1cfeae0 2023-10-08T15:40:24.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.487+0000 7fefb27fc700 1 -- 172.21.15.3:0/4261808758 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fefbc029420 con 0x1cfeae0 2023-10-08T15:40:24.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.487+0000 7fefdc6a5740 1 -- 172.21.15.3:0/4261808758 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1e44cc0 con 0x1cfeae0 2023-10-08T15:40:24.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.487+0000 7fefb27fc700 1 -- 172.21.15.3:0/4261808758 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7fefbc021070 con 0x1cfeae0 2023-10-08T15:40:24.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.487+0000 7fefdc6a5740 10 client.5484 fetch_fsmap learned FSMap version 19 2023-10-08T15:40:24.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.487+0000 7fefdc6a5740 1 -- 172.21.15.3:0/4261808758 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x1e74370 con 0x1cfeae0 2023-10-08T15:40:24.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.487+0000 7fefb27fc700 1 -- 172.21.15.3:0/4261808758 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1e44cc0 con 0x1cfeae0 2023-10-08T15:40:24.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.487+0000 7fefb27fc700 1 -- 172.21.15.3:0/4261808758 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 19) v1 ==== 2010+0+0 (secure 0 0 0) 0x7fefbc035ca0 con 0x1cfeae0 2023-10-08T15:40:24.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.487+0000 7fefdc6a5740 10 client.5484 fetch_fsmap finished waiting for FSMap version 19 2023-10-08T15:40:24.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.487+0000 7fefdc6a5740 10 client.5484 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-08T15:40:24.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.487+0000 7fefdc6a5740 20 client.5484 populate_metadata read hostname 'smithi003' 2023-10-08T15:40:24.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.487+0000 7fefdc6a5740 1 --2- 172.21.15.3:0/4261808758 >> [v2:172.21.15.3:6832/3441752211,v1:172.21.15.3:6833/3441752211] conn(0x1f7cb90 0x1f7ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:24.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.487+0000 7fefdc6a5740 4 client.5484 mds_command: new command op to 5337 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-08T15:40:24.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.487+0000 7fefdc6a5740 1 -- 172.21.15.3:0/4261808758 --> [v2:172.21.15.3:6832/3441752211,v1:172.21.15.3:6833/3441752211] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1e483e0 con 0x1f7cb90 2023-10-08T15:40:24.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.487+0000 7fefd3fff700 1 --2- 172.21.15.3:0/4261808758 >> [v2:172.21.15.3:6832/3441752211,v1:172.21.15.3:6833/3441752211] conn(0x1f7cb90 0x1f7ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:24.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.487+0000 7fefb27fc700 10 client.5484 ms_handle_connect on v2:172.21.15.3:6832/3441752211 2023-10-08T15:40:24.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.487+0000 7fefd3fff700 1 --2- 172.21.15.3:0/4261808758 >> [v2:172.21.15.3:6832/3441752211,v1:172.21.15.3:6833/3441752211] conn(0x1f7cb90 0x1f7ef70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97cf96e79c3c7cae server_cookie=4044501c88bf0642 in_seq=0 out_seq=0 2023-10-08T15:40:24.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.491+0000 7fefb27fc700 1 -- 172.21.15.3:0/4261808758 <== mds.0 v2:172.21.15.3:6832/3441752211 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x1e483e0 con 0x1f7cb90 2023-10-08T15:40:24.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.491+0000 7fefb27fc700 10 client.5484 handle_command_reply: tid=0 2023-10-08T15:40:24.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.491+0000 7fefdc6a5740 1 client.5484 shutdown 2023-10-08T15:40:24.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.491+0000 7fefdc6a5740 1 -- 172.21.15.3:0/4261808758 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1cfeae0 msgr2=0x1f6cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:24.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.491+0000 7fefdc6a5740 1 --2- 172.21.15.3:0/4261808758 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1cfeae0 0x1f6cab0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fefbc00b770 tx=0x7fefbc021000 comp rx=0 tx=0).stop 2023-10-08T15:40:24.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.491+0000 7fefdc6a5740 1 -- 172.21.15.3:0/4261808758 shutdown_connections 2023-10-08T15:40:24.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.491+0000 7fefdc6a5740 1 --2- 172.21.15.3:0/4261808758 >> [v2:172.21.15.3:6832/3441752211,v1:172.21.15.3:6833/3441752211] conn(0x1f7cb90 0x1f7ef70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.491+0000 7fefdc6a5740 1 --2- 172.21.15.3:0/4261808758 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1d49790 0x1f6d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.491+0000 7fefb27fc700 0 client.5484 ms_handle_reset on v2:172.21.15.3:6832/3441752211 2023-10-08T15:40:24.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.491+0000 7fefdc6a5740 1 --2- 172.21.15.3:0/4261808758 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1cfeae0 0x1f6cab0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.491+0000 7fefdc6a5740 1 --2- 172.21.15.3:0/4261808758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1cfe710 0x1f6c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.491+0000 7fefdc6a5740 1 -- 172.21.15.3:0/4261808758 >> 172.21.15.3:0/4261808758 conn(0x1cfeeb0 msgr2=0x1f30f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:24.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.491+0000 7fefdc6a5740 1 -- 172.21.15.3:0/4261808758 shutdown_connections 2023-10-08T15:40:24.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.491+0000 7fefdc6a5740 1 -- 172.21.15.3:0/4261808758 wait complete. 2023-10-08T15:40:24.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.491+0000 7fefdc6a5740 20 client.5484 trim_cache size 0 max 16384 2023-10-08T15:40:24.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.511+0000 7fefdc6a5740 1 Processor -- start 2023-10-08T15:40:24.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.511+0000 7fefdc6a5740 1 -- start start 2023-10-08T15:40:24.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.511+0000 7fefdc6a5740 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1cfe710 0x1f79c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:24.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.511+0000 7fefdc6a5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1cfeae0 0x1f34050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:24.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.511+0000 7fefdc6a5740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1d49790 0x1f34590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:24.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.511+0000 7fefdc6a5740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ea3890 con 0x1d49790 2023-10-08T15:40:24.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.511+0000 7fefdc6a5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ea1b50 con 0x1cfeae0 2023-10-08T15:40:24.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.511+0000 7fefdc6a5740 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x1d7b650 con 0x1cfe710 2023-10-08T15:40:24.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.511+0000 7fefd8999700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1d49790 0x1f34590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:24.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.511+0000 7fefd8999700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1d49790 0x1f34590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52772/0 (socket says 172.21.15.3:52772) 2023-10-08T15:40:24.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.511+0000 7fefcbfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1cfeae0 0x1f34050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:24.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.511+0000 7fefd8999700 1 -- 172.21.15.3:0/1675780988 learned_addr learned my addr 172.21.15.3:0/1675780988 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:24.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.511+0000 7fefd3fff700 1 --2- 172.21.15.3:0/1675780988 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1cfe710 0x1f79c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:24.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.511+0000 7fefd8999700 1 -- 172.21.15.3:0/1675780988 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1cfe710 msgr2=0x1f79c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:24.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.511+0000 7fefd8999700 1 --2- 172.21.15.3:0/1675780988 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1cfe710 0x1f79c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.511+0000 7fefd8999700 1 -- 172.21.15.3:0/1675780988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1cfeae0 msgr2=0x1f34050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:24.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.511+0000 7fefd8999700 1 --2- 172.21.15.3:0/1675780988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1cfeae0 0x1f34050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.511+0000 7fefd8999700 1 -- 172.21.15.3:0/1675780988 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1e5ad80 con 0x1d49790 2023-10-08T15:40:24.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.511+0000 7fefd8999700 1 --2- 172.21.15.3:0/1675780988 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1d49790 0x1f34590 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fefcc0118b0 tx=0x7fefcc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34396af2fa53fc1c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:24.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.511+0000 7fefc9ffb700 1 -- 172.21.15.3:0/1675780988 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefcc00e040 con 0x1d49790 2023-10-08T15:40:24.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.511+0000 7fefc9ffb700 1 -- 172.21.15.3:0/1675780988 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefcc00f040 con 0x1d49790 2023-10-08T15:40:24.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.511+0000 7fefc9ffb700 1 -- 172.21.15.3:0/1675780988 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefcc017a30 con 0x1d49790 2023-10-08T15:40:24.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.515+0000 7fefdc6a5740 1 -- 172.21.15.3:0/1675780988 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1d49790 msgr2=0x1f34590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:24.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.515+0000 7fefdc6a5740 1 --2- 172.21.15.3:0/1675780988 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1d49790 0x1f34590 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fefcc0118b0 tx=0x7fefcc00b040 comp rx=0 tx=0).stop 2023-10-08T15:40:24.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.515+0000 7fefdc6a5740 1 -- 172.21.15.3:0/1675780988 shutdown_connections 2023-10-08T15:40:24.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.515+0000 7fefdc6a5740 1 --2- 172.21.15.3:0/1675780988 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1d49790 0x1f34590 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.515+0000 7fefdc6a5740 1 --2- 172.21.15.3:0/1675780988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1cfeae0 0x1f34050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.515+0000 7fefdc6a5740 1 --2- 172.21.15.3:0/1675780988 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1cfe710 0x1f79c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.515+0000 7fefdc6a5740 1 -- 172.21.15.3:0/1675780988 >> 172.21.15.3:0/1675780988 conn(0x1cfeeb0 msgr2=0x1fc0700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:24.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.515+0000 7fefdc6a5740 1 -- 172.21.15.3:0/1675780988 shutdown_connections 2023-10-08T15:40:24.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.515+0000 7fefdc6a5740 1 -- 172.21.15.3:0/1675780988 wait complete. 2023-10-08T15:40:24.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.515+0000 7fefdc6a5740 1 -- start start 2023-10-08T15:40:24.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.515+0000 7fefdc6a5740 1 Processor -- start 2023-10-08T15:40:24.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.519+0000 7fefdc6a5740 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1cfe710 0x1f36d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:24.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.519+0000 7fefdc6a5740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1cfeae0 0x1f37240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:24.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.519+0000 7fefdc6a5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1d49790 0x1f37780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:24.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.519+0000 7fefdc6a5740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e46b80 con 0x1cfeae0 2023-10-08T15:40:24.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.519+0000 7fefdc6a5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ea4d60 con 0x1d49790 2023-10-08T15:40:24.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.519+0000 7fefdc6a5740 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x1d777c0 con 0x1cfe710 2023-10-08T15:40:24.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.519+0000 7fefdc6a5740 10 client.0 _ll_register_callbacks cb 0x1dcdd00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T15:40:24.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.519+0000 7fefcbfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1cfeae0 0x1f37240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:24.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.519+0000 7fefcbfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1cfeae0 0x1f37240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52782/0 (socket says 172.21.15.3:52782) 2023-10-08T15:40:24.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.519+0000 7fefcbfff700 1 -- 172.21.15.3:0/3886940869 learned_addr learned my addr 172.21.15.3:0/3886940869 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:24.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.519+0000 7fefd3fff700 1 --2- 172.21.15.3:0/3886940869 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1cfe710 0x1f36d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:24.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.519+0000 7fefd8999700 1 --2- 172.21.15.3:0/3886940869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1d49790 0x1f37780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:24.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.519+0000 7fefcbfff700 1 -- 172.21.15.3:0/3886940869 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1cfe710 msgr2=0x1f36d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:24.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.519+0000 7fefcbfff700 1 --2- 172.21.15.3:0/3886940869 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1cfe710 0x1f36d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.519+0000 7fefcbfff700 1 -- 172.21.15.3:0/3886940869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1d49790 msgr2=0x1f37780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:24.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.519+0000 7fefcbfff700 1 --2- 172.21.15.3:0/3886940869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1d49790 0x1f37780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.519+0000 7fefcbfff700 1 -- 172.21.15.3:0/3886940869 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefcc0115e0 con 0x1cfeae0 2023-10-08T15:40:24.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.519+0000 7fefd3fff700 1 --2- 172.21.15.3:0/3886940869 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1cfe710 0x1f36d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:40:24.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.519+0000 7fefd8999700 1 --2- 172.21.15.3:0/3886940869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1d49790 0x1f37780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:40:24.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.519+0000 7fefcbfff700 1 --2- 172.21.15.3:0/3886940869 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1cfeae0 0x1f37240 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fefbc0098e0 tx=0x7fefbc02c050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a0985bb06300779 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:24.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.519+0000 7fefb27fc700 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2023-10-08T15:40:24.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.519+0000 7fefb27fc700 1 -- 172.21.15.3:0/3886940869 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefbc030070 con 0x1cfeae0 2023-10-08T15:40:24.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.519+0000 7fefb27fc700 1 -- 172.21.15.3:0/3886940869 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fefbc029d70 con 0x1cfeae0 2023-10-08T15:40:24.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.519+0000 7fefdc6a5740 1 -- 172.21.15.3:0/3886940869 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fefc4056cb0 con 0x1cfeae0 2023-10-08T15:40:24.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.519+0000 7fefb27fc700 1 -- 172.21.15.3:0/3886940869 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7fefbc021040 con 0x1cfeae0 2023-10-08T15:40:24.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.519+0000 7fefdc6a5740 10 client.5490 fetch_fsmap learned FSMap version 19 2023-10-08T15:40:24.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.519+0000 7fefdc6a5740 1 -- 172.21.15.3:0/3886940869 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x1e4f130 con 0x1cfeae0 2023-10-08T15:40:24.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.519+0000 7fefb27fc700 1 -- 172.21.15.3:0/3886940869 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc4056cb0 con 0x1cfeae0 2023-10-08T15:40:24.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.519+0000 7fefb27fc700 1 -- 172.21.15.3:0/3886940869 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 19) v1 ==== 2010+0+0 (secure 0 0 0) 0x7fefbc011420 con 0x1cfeae0 2023-10-08T15:40:24.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.519+0000 7fefdc6a5740 10 client.5490 fetch_fsmap finished waiting for FSMap version 19 2023-10-08T15:40:24.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.519+0000 7fefdc6a5740 10 client.5490 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-08T15:40:24.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.519+0000 7fefdc6a5740 20 client.5490 populate_metadata read hostname 'smithi003' 2023-10-08T15:40:24.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.519+0000 7fefdc6a5740 1 --2- 172.21.15.3:0/3886940869 >> [v2:172.21.15.3:6832/3441752211,v1:172.21.15.3:6833/3441752211] conn(0x1fce9d0 0x1fd0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:24.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.519+0000 7fefdc6a5740 4 client.5490 mds_command: new command op to 5337 tid=0[{"prefix": "status"}] 2023-10-08T15:40:24.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.519+0000 7fefdc6a5740 1 -- 172.21.15.3:0/3886940869 --> [v2:172.21.15.3:6832/3441752211,v1:172.21.15.3:6833/3441752211] -- command(tid 0: {"prefix": "status"}) v1 -- 0x1e7a410 con 0x1fce9d0 2023-10-08T15:40:24.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.519+0000 7fefd3fff700 1 --2- 172.21.15.3:0/3886940869 >> [v2:172.21.15.3:6832/3441752211,v1:172.21.15.3:6833/3441752211] conn(0x1fce9d0 0x1fd0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:24.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.519+0000 7fefb27fc700 10 client.5490 ms_handle_connect on v2:172.21.15.3:6832/3441752211 2023-10-08T15:40:24.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.519+0000 7fefd3fff700 1 --2- 172.21.15.3:0/3886940869 >> [v2:172.21.15.3:6832/3441752211,v1:172.21.15.3:6833/3441752211] conn(0x1fce9d0 0x1fd0db0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf718fcbf36bc688 server_cookie=86195c60bd9c6a7d in_seq=0 out_seq=0 2023-10-08T15:40:24.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.519+0000 7fefb27fc700 1 -- 172.21.15.3:0/3886940869 <== mds.0 v2:172.21.15.3:6832/3441752211 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x1e7a410 con 0x1fce9d0 2023-10-08T15:40:24.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.519+0000 7fefb27fc700 10 client.5490 handle_command_reply: tid=0 2023-10-08T15:40:24.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.519+0000 7fefdc6a5740 1 client.5490 shutdown 2023-10-08T15:40:24.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.519+0000 7fefdc6a5740 1 -- 172.21.15.3:0/3886940869 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1cfeae0 msgr2=0x1f37240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:24.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.523+0000 7fefdc6a5740 1 --2- 172.21.15.3:0/3886940869 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1cfeae0 0x1f37240 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fefbc0098e0 tx=0x7fefbc02c050 comp rx=0 tx=0).stop 2023-10-08T15:40:24.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.523+0000 7fefdc6a5740 1 -- 172.21.15.3:0/3886940869 shutdown_connections 2023-10-08T15:40:24.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.523+0000 7fefdc6a5740 1 --2- 172.21.15.3:0/3886940869 >> [v2:172.21.15.3:6832/3441752211,v1:172.21.15.3:6833/3441752211] conn(0x1fce9d0 0x1fd0db0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.523+0000 7fefdc6a5740 1 --2- 172.21.15.3:0/3886940869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1d49790 0x1f37780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.523+0000 7fefb27fc700 0 client.5490 ms_handle_reset on v2:172.21.15.3:6832/3441752211 2023-10-08T15:40:24.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.523+0000 7fefdc6a5740 1 --2- 172.21.15.3:0/3886940869 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1cfeae0 0x1f37240 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.523+0000 7fefdc6a5740 1 --2- 172.21.15.3:0/3886940869 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1cfe710 0x1f36d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.523+0000 7fefdc6a5740 1 -- 172.21.15.3:0/3886940869 >> 172.21.15.3:0/3886940869 conn(0x1cfeeb0 msgr2=0x1f794c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:24.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.523+0000 7fefdc6a5740 1 -- 172.21.15.3:0/3886940869 shutdown_connections 2023-10-08T15:40:24.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.523+0000 7fefdc6a5740 1 -- 172.21.15.3:0/3886940869 wait complete. 2023-10-08T15:40:24.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.523+0000 7fefdc6a5740 20 client.5490 trim_cache size 0 max 16384 2023-10-08T15:40:24.614 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2023-10-08T15:40:24.615 INFO:teuthology.orchestra.run.smithi003.stdout: "cluster_fsid": "7635972e-cd66-4a8f-a231-378db8b3847a", 2023-10-08T15:40:24.615 INFO:teuthology.orchestra.run.smithi003.stdout: "whoami": 0, 2023-10-08T15:40:24.615 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 5337, 2023-10-08T15:40:24.615 INFO:teuthology.orchestra.run.smithi003.stdout: "want_state": "up:active", 2023-10-08T15:40:24.615 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "up:active", 2023-10-08T15:40:24.615 INFO:teuthology.orchestra.run.smithi003.stdout: "fs_name": "cephfs", 2023-10-08T15:40:24.615 INFO:teuthology.orchestra.run.smithi003.stdout: "rank_uptime": 10.124530354999999, 2023-10-08T15:40:24.615 INFO:teuthology.orchestra.run.smithi003.stdout: "mdsmap_epoch": 19, 2023-10-08T15:40:24.615 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch": 39, 2023-10-08T15:40:24.615 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch_barrier": 39, 2023-10-08T15:40:24.615 INFO:teuthology.orchestra.run.smithi003.stdout: "uptime": 15.262242171 2023-10-08T15:40:24.616 INFO:teuthology.orchestra.run.smithi003.stdout:} 2023-10-08T15:40:24.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.523+0000 7fefda3fc700 1 -- 172.21.15.3:0/3265739778 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fefb4060580 msgr2=0x7fefb4062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:24.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.523+0000 7fefda3fc700 1 --2- 172.21.15.3:0/3265739778 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fefb4060580 0x7fefb4062a30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fefbc0091e0 tx=0x7fefbc017000 comp rx=0 tx=0).stop 2023-10-08T15:40:24.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.523+0000 7fefda3fc700 1 -- 172.21.15.3:0/3265739778 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fefd406d6e0 msgr2=0x7fefd4145fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:24.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.523+0000 7fefda3fc700 1 --2- 172.21.15.3:0/3265739778 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fefd406d6e0 0x7fefd4145fa0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fefc400c540 tx=0x7fefc4001070 comp rx=0 tx=0).stop 2023-10-08T15:40:24.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.523+0000 7fefda3fc700 1 -- 172.21.15.3:0/3265739778 shutdown_connections 2023-10-08T15:40:24.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.523+0000 7fefda3fc700 1 --2- 172.21.15.3:0/3265739778 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fefb4060580 0x7fefb4062a30 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.523+0000 7fefda3fc700 1 --2- 172.21.15.3:0/3265739778 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fefd4147c10 0x7fefd414f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.523+0000 7fefda3fc700 1 --2- 172.21.15.3:0/3265739778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefd40badb0 0x7fefd415e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.523+0000 7fefda3fc700 1 --2- 172.21.15.3:0/3265739778 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fefd406d6e0 0x7fefd4145fa0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.523+0000 7fefda3fc700 1 -- 172.21.15.3:0/3265739778 >> 172.21.15.3:0/3265739778 conn(0x7fefd40be640 msgr2=0x7fefd40ba680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:24.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.523+0000 7fefda3fc700 1 -- 172.21.15.3:0/3265739778 shutdown_connections 2023-10-08T15:40:24.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.523+0000 7fefda3fc700 1 -- 172.21.15.3:0/3265739778 wait complete. 2023-10-08T15:40:24.618 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T15:40:24.734 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.731+0000 7fc240ca3700 1 Processor -- start 2023-10-08T15:40:24.739 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.731+0000 7fc240ca3700 1 -- start start 2023-10-08T15:40:24.741 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.731+0000 7fc240ca3700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fc23c0bacf0 0x7fc23c14f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:24.741 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.731+0000 7fc240ca3700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc23c0bb0c0 0x7fc23c14f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:24.741 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.731+0000 7fc240ca3700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc23c14eb80 con 0x7fc23c0b8a40 2023-10-08T15:40:24.741 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.731+0000 7fc240ca3700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc23c14fa90 con 0x7fc23c0bacf0 2023-10-08T15:40:24.742 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.731+0000 7fc240ca3700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc23c0b9e50 con 0x7fc23c0bb0c0 2023-10-08T15:40:24.742 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.731+0000 7fc23b7fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fc23c0bacf0 0x7fc23c14f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:24.742 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.731+0000 7fc23bfff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fc23c0b8a40 0x7fc23c0bc8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:49648/0 (socket says 172.21.15.3:49648) 2023-10-08T15:40:24.742 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.731+0000 7fc23bfff700 1 -- 172.21.15.3:0/1191291651 learned_addr learned my addr 172.21.15.3:0/1191291651 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:40:24.742 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.731+0000 7fc23affd700 1 --2- 172.21.15.3:0/1191291651 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc23c0bb0c0 0x7fc23c14f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:24.742 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.731+0000 7fc23a7fc700 1 -- 172.21.15.3:0/1191291651 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3639478020 0 0) 0x7fc23c14eb80 con 0x7fc23c0b8a40 2023-10-08T15:40:24.742 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.731+0000 7fc23a7fc700 1 -- 172.21.15.3:0/1191291651 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc224003570 con 0x7fc23c0b8a40 2023-10-08T15:40:24.742 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.731+0000 7fc23affd700 1 -- 172.21.15.3:0/1191291651 >> v2:172.21.15.3:3300/0 conn(0x7fc23c0bacf0 msgr2=0x7fc23c14f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:24.742 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.731+0000 7fc23affd700 1 --2- 172.21.15.3:0/1191291651 >> v2:172.21.15.3:3300/0 conn(0x7fc23c0bacf0 0x7fc23c14f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.742 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.731+0000 7fc23affd700 1 -- 172.21.15.3:0/1191291651 >> v1:172.21.15.3:6789/0 conn(0x7fc23c0b8a40 legacy=0x7fc23c0bc8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:24.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.731+0000 7fc23affd700 1 -- 172.21.15.3:0/1191291651 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc23c0ba130 con 0x7fc23c0bb0c0 2023-10-08T15:40:24.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.731+0000 7fc23affd700 1 --2- 172.21.15.3:0/1191291651 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc23c0bb0c0 0x7fc23c14f550 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc22c0098e0 tx=0x7fc22c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=572cd6392496b924 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:24.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.731+0000 7fc23a7fc700 1 -- 172.21.15.3:0/1191291651 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22c011630 con 0x7fc23c0bb0c0 2023-10-08T15:40:24.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.731+0000 7fc23a7fc700 1 -- 172.21.15.3:0/1191291651 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc22c011790 con 0x7fc23c0bb0c0 2023-10-08T15:40:24.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.731+0000 7fc23a7fc700 1 -- 172.21.15.3:0/1191291651 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22c011b10 con 0x7fc23c0bb0c0 2023-10-08T15:40:24.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.735+0000 7fc240ca3700 1 -- 172.21.15.3:0/1191291651 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc23c0bb0c0 msgr2=0x7fc23c14f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:24.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.735+0000 7fc240ca3700 1 --2- 172.21.15.3:0/1191291651 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc23c0bb0c0 0x7fc23c14f550 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc22c0098e0 tx=0x7fc22c0091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.735+0000 7fc240ca3700 1 -- 172.21.15.3:0/1191291651 shutdown_connections 2023-10-08T15:40:24.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.735+0000 7fc240ca3700 1 --2- 172.21.15.3:0/1191291651 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc23c0bb0c0 0x7fc23c14f550 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.735+0000 7fc240ca3700 1 --2- 172.21.15.3:0/1191291651 >> v2:172.21.15.3:3300/0 conn(0x7fc23c0bacf0 0x7fc23c14f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.735+0000 7fc240ca3700 1 -- 172.21.15.3:0/1191291651 >> 172.21.15.3:0/1191291651 conn(0x7fc23c0be4a0 msgr2=0x7fc23c0ba440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:24.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.735+0000 7fc240ca3700 1 -- 172.21.15.3:0/1191291651 shutdown_connections 2023-10-08T15:40:24.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.735+0000 7fc240ca3700 1 -- 172.21.15.3:0/1191291651 wait complete. 2023-10-08T15:40:24.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.735+0000 7fc240ca3700 1 Processor -- start 2023-10-08T15:40:24.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.739+0000 7fc240ca3700 1 -- start start 2023-10-08T15:40:24.746 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.739+0000 7fc240ca3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc23c0b8a40 0x7fc23c144d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:24.746 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.739+0000 7fc240ca3700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc23c0bacf0 0x7fc23c15b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:24.746 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.739+0000 7fc240ca3700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc23c0bb0c0 0x7fc23c146c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:24.746 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.739+0000 7fc240ca3700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc23c15b090 con 0x7fc23c0bacf0 2023-10-08T15:40:24.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.739+0000 7fc240ca3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc23c14a180 con 0x7fc23c0b8a40 2023-10-08T15:40:24.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.739+0000 7fc240ca3700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc23c15aa40 con 0x7fc23c0bb0c0 2023-10-08T15:40:24.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.739+0000 7fc23affd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc23c0bacf0 0x7fc23c15b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:24.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.739+0000 7fc23affd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc23c0bacf0 0x7fc23c15b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52812/0 (socket says 172.21.15.3:52812) 2023-10-08T15:40:24.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.739+0000 7fc23affd700 1 -- 172.21.15.3:0/485449110 learned_addr learned my addr 172.21.15.3:0/485449110 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:24.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.739+0000 7fc23b7fe700 1 --2- 172.21.15.3:0/485449110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc23c0b8a40 0x7fc23c144d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:24.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.739+0000 7fc23bfff700 1 --2- 172.21.15.3:0/485449110 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc23c0bb0c0 0x7fc23c146c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:24.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.739+0000 7fc23affd700 1 -- 172.21.15.3:0/485449110 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc23c0bb0c0 msgr2=0x7fc23c146c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:24.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.739+0000 7fc23affd700 1 --2- 172.21.15.3:0/485449110 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc23c0bb0c0 0x7fc23c146c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.748 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.739+0000 7fc23affd700 1 -- 172.21.15.3:0/485449110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc23c0b8a40 msgr2=0x7fc23c144d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:24.748 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.739+0000 7fc23affd700 1 --2- 172.21.15.3:0/485449110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc23c0b8a40 0x7fc23c144d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.748 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.739+0000 7fc23affd700 1 -- 172.21.15.3:0/485449110 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc22c009420 con 0x7fc23c0bacf0 2023-10-08T15:40:24.748 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.739+0000 7fc23affd700 1 --2- 172.21.15.3:0/485449110 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc23c0bacf0 0x7fc23c15b520 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fc22c013000 tx=0x7fc22c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:24.748 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.739+0000 7fc2237fe700 1 -- 172.21.15.3:0/485449110 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22c011900 con 0x7fc23c0bacf0 2023-10-08T15:40:24.748 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.739+0000 7fc2237fe700 1 -- 172.21.15.3:0/485449110 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc22c011a80 con 0x7fc23c0bacf0 2023-10-08T15:40:24.748 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.739+0000 7fc240ca3700 1 -- 172.21.15.3:0/485449110 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc23c15ad20 con 0x7fc23c0bacf0 2023-10-08T15:40:24.748 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.739+0000 7fc2237fe700 1 -- 172.21.15.3:0/485449110 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22c01a680 con 0x7fc23c0bacf0 2023-10-08T15:40:24.749 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.739+0000 7fc240ca3700 1 -- 172.21.15.3:0/485449110 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc23c15ba60 con 0x7fc23c0bacf0 2023-10-08T15:40:24.749 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.743+0000 7fc240ca3700 1 -- 172.21.15.3:0/485449110 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc23c15b240 con 0x7fc23c0bacf0 2023-10-08T15:40:24.749 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.743+0000 7fc2237fe700 1 -- 172.21.15.3:0/485449110 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc22c01aa70 con 0x7fc23c0bacf0 2023-10-08T15:40:24.750 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.743+0000 7fc2237fe700 1 --2- 172.21.15.3:0/485449110 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc228060580 0x7fc228062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:24.750 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.743+0000 7fc2237fe700 1 -- 172.21.15.3:0/485449110 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc22c07e3a0 con 0x7fc23c0bacf0 2023-10-08T15:40:24.750 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.743+0000 7fc23b7fe700 1 --2- 172.21.15.3:0/485449110 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc228060580 0x7fc228062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:24.750 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.743+0000 7fc23b7fe700 1 --2- 172.21.15.3:0/485449110 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc228060580 0x7fc228062a30 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc230009db0 tx=0x7fc2300091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:24.753 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.751+0000 7fc2237fe700 1 -- 172.21.15.3:0/485449110 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc22c04e8f0 con 0x7fc23c0bacf0 2023-10-08T15:40:24.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.947+0000 7fc240ca3700 1 -- 172.21.15.3:0/485449110 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc23c05ecf0 con 0x7fc23c0bacf0 2023-10-08T15:40:24.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.947+0000 7fc2237fe700 1 -- 172.21.15.3:0/485449110 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v19) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc22c051f10 con 0x7fc23c0bacf0 2023-10-08T15:40:24.953 INFO:teuthology.orchestra.run.smithi003.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T15:40:24.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.951+0000 7fc240ca3700 1 -- 172.21.15.3:0/485449110 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc228060580 msgr2=0x7fc228062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:24.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.951+0000 7fc240ca3700 1 --2- 172.21.15.3:0/485449110 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc228060580 0x7fc228062a30 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc230009db0 tx=0x7fc2300091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.951+0000 7fc240ca3700 1 -- 172.21.15.3:0/485449110 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc23c0bacf0 msgr2=0x7fc23c15b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:24.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.951+0000 7fc240ca3700 1 --2- 172.21.15.3:0/485449110 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc23c0bacf0 0x7fc23c15b520 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fc22c013000 tx=0x7fc22c017000 comp rx=0 tx=0).stop 2023-10-08T15:40:24.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.951+0000 7fc240ca3700 1 -- 172.21.15.3:0/485449110 shutdown_connections 2023-10-08T15:40:24.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.951+0000 7fc240ca3700 1 --2- 172.21.15.3:0/485449110 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc228060580 0x7fc228062a30 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.951+0000 7fc240ca3700 1 --2- 172.21.15.3:0/485449110 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc23c0bb0c0 0x7fc23c146c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.951+0000 7fc240ca3700 1 --2- 172.21.15.3:0/485449110 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc23c0bacf0 0x7fc23c15b520 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.951+0000 7fc240ca3700 1 --2- 172.21.15.3:0/485449110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc23c0b8a40 0x7fc23c144d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.951+0000 7fc240ca3700 1 -- 172.21.15.3:0/485449110 >> 172.21.15.3:0/485449110 conn(0x7fc23c0be4a0 msgr2=0x7fc23c14e500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:24.957 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.951+0000 7fc240ca3700 1 -- 172.21.15.3:0/485449110 shutdown_connections 2023-10-08T15:40:24.957 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:24.951+0000 7fc240ca3700 1 -- 172.21.15.3:0/485449110 wait complete. 2023-10-08T15:40:24.971 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-08T15:40:24.971 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T15:40:24.971 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi089.front.sepia.ceph.com 2023-10-08T15:40:24.971 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-08T15:40:24.971 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T15:40:24.971 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-08T15:40:24.971 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-08T15:40:24.971 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T15:40:24.971 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T15:40:24.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:24.972 DEBUG:teuthology.orchestra.run.smithi089:> ip addr 2023-10-08T15:40:24.980 INFO:teuthology.orchestra.run.smithi089.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T15:40:24.980 INFO:teuthology.orchestra.run.smithi089.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T15:40:24.980 INFO:teuthology.orchestra.run.smithi089.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T15:40:24.980 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:40:24.980 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 ::1/128 scope host 2023-10-08T15:40:24.980 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:40:24.980 INFO:teuthology.orchestra.run.smithi089.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T15:40:24.980 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c6 brd ff:ff:ff:ff:ff:ff 2023-10-08T15:40:24.980 INFO:teuthology.orchestra.run.smithi089.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T15:40:24.981 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c7 brd ff:ff:ff:ff:ff:ff 2023-10-08T15:40:24.981 INFO:teuthology.orchestra.run.smithi089.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T15:40:24.981 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:00 brd ff:ff:ff:ff:ff:ff 2023-10-08T15:40:24.981 INFO:teuthology.orchestra.run.smithi089.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T15:40:24.981 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:01 brd ff:ff:ff:ff:ff:ff 2023-10-08T15:40:24.981 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.21.15.89/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-08T15:40:24.981 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft 42372sec preferred_lft 42372sec 2023-10-08T15:40:24.981 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::ec4:7aff:fe8f:d501/64 scope link 2023-10-08T15:40:24.981 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:40:24.981 INFO:teuthology.orchestra.run.smithi089.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-08T15:40:24.981 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 02:42:0d:de:29:b2 brd ff:ff:ff:ff:ff:ff 2023-10-08T15:40:24.981 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-08T15:40:24.982 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:40:24.982 INFO:teuthology.orchestra.run.smithi089.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T15:40:24.982 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 96:c9:6f:4e:3d:df brd ff:ff:ff:ff:ff:ff 2023-10-08T15:40:24.982 INFO:teuthology.orchestra.run.smithi089.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T15:40:24.982 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:40:24.982 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::6c37:4fff:fe02:5a19/64 scope link 2023-10-08T15:40:24.982 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:40:24.982 INFO:teuthology.orchestra.run.smithi089.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T15:40:24.982 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 96:c9:6f:4e:3d:df brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T15:40:24.982 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::94c9:6fff:fe4e:3ddf/64 scope link 2023-10-08T15:40:24.982 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:40:24.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:24.983 DEBUG:teuthology.orchestra.run.smithi089:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T15:40:25.035 INFO:teuthology.orchestra.run.smithi089.stdout:1 2023-10-08T15:40:25.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:25.038 DEBUG:teuthology.orchestra.run.smithi089:> route 2023-10-08T15:40:25.047 INFO:teuthology.orchestra.run.smithi089.stdout:Kernel IP routing table 2023-10-08T15:40:25.047 INFO:teuthology.orchestra.run.smithi089.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T15:40:25.047 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-08T15:40:25.047 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-08T15:40:25.047 INFO:teuthology.orchestra.run.smithi089.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-08T15:40:25.047 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-10-08T15:40:25.047 INFO:teuthology.orchestra.run.smithi089.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-08T15:40:25.047 INFO:teuthology.orchestra.run.smithi089.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T15:40:25.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:25.048 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-10-08T15:40:25.048 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-10-08T15:40:25.048 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-08T15:40:25.048 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-08T15:40:25.048 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-08T15:40:25.048 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-10-08T15:40:25.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:25.088 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2023-10-08T15:40:25.094 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T15:40:25.094 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T15:40:25.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:25.094 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set brx.0 up 2023-10-08T15:40:25.153 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-08T15:40:25.153 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T15:40:25.154 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-08T15:40:25.158 INFO:teuthology.orchestra.run.smithi089.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-08T15:40:25.159 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T15:40:25.159 DEBUG:teuthology.orchestra.run.smithi089:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-08T15:40:25.165 DEBUG:teuthology.orchestra.run.smithi089:> sudo modprobe fuse 2023-10-08T15:40:25.177 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-08T15:40:25.177 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-08T15:40:25.192 INFO:teuthology.orchestra.run.smithi089.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-08T15:40:25.193 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-08T15:40:25.193 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:40:25.194 DEBUG:teuthology.orchestra.run.smithi089:> ls /sys/fs/fuse/connections 2023-10-08T15:40:25.199 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-08T15:40:25.199 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-08T15:40:25.201 DEBUG:teuthology.orchestra.run.smithi089:> sudo modprobe fuse 2023-10-08T15:40:25.217 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-08T15:40:25.218 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-08T15:40:25.231 INFO:teuthology.orchestra.run.smithi089.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-08T15:40:25.232 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-08T15:40:25.232 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:40:25.233 DEBUG:teuthology.orchestra.run.smithi089:> ls /sys/fs/fuse/connections 2023-10-08T15:40:25.280 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi089.stderr:2023-10-08T15:40:25.275+0000 7fe92f513380 -1 init, newargv = 0x55b40492ac90 newargc=15 2023-10-08T15:40:25.281 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi089.stderr:ceph-fuse[28924]: starting ceph client 2023-10-08T15:40:25.291 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi089.stderr:ceph-fuse[28924]: starting fuse 2023-10-08T15:40:26.339 DEBUG:teuthology.orchestra.run.smithi089:> sudo modprobe fuse 2023-10-08T15:40:26.357 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-08T15:40:26.358 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-08T15:40:26.418 INFO:teuthology.orchestra.run.smithi089.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-08T15:40:26.419 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-08T15:40:26.420 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:40:26.420 DEBUG:teuthology.orchestra.run.smithi089:> ls /sys/fs/fuse/connections 2023-10-08T15:40:26.426 INFO:teuthology.orchestra.run.smithi089.stdout:52 2023-10-08T15:40:26.426 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-10-08T15:40:26.427 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-08T15:40:26.427 DEBUG:teuthology.orchestra.run.smithi089:> import glob 2023-10-08T15:40:26.427 DEBUG:teuthology.orchestra.run.smithi089:> import re 2023-10-08T15:40:26.427 DEBUG:teuthology.orchestra.run.smithi089:> import os 2023-10-08T15:40:26.427 DEBUG:teuthology.orchestra.run.smithi089:> import subprocess 2023-10-08T15:40:26.427 DEBUG:teuthology.orchestra.run.smithi089:> 2023-10-08T15:40:26.427 DEBUG:teuthology.orchestra.run.smithi089:> def _find_admin_socket(client_name): 2023-10-08T15:40:26.427 DEBUG:teuthology.orchestra.run.smithi089:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-08T15:40:26.427 DEBUG:teuthology.orchestra.run.smithi089:> files = glob.glob(asok_path) 2023-10-08T15:40:26.428 DEBUG:teuthology.orchestra.run.smithi089:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-08T15:40:26.428 DEBUG:teuthology.orchestra.run.smithi089:> 2023-10-08T15:40:26.428 DEBUG:teuthology.orchestra.run.smithi089:> # Given a non-glob path, it better be there 2023-10-08T15:40:26.428 DEBUG:teuthology.orchestra.run.smithi089:> if "*" not in asok_path: 2023-10-08T15:40:26.428 DEBUG:teuthology.orchestra.run.smithi089:> assert(len(files) == 1) 2023-10-08T15:40:26.428 DEBUG:teuthology.orchestra.run.smithi089:> return files[0] 2023-10-08T15:40:26.428 DEBUG:teuthology.orchestra.run.smithi089:> 2023-10-08T15:40:26.428 DEBUG:teuthology.orchestra.run.smithi089:> for f in files: 2023-10-08T15:40:26.428 DEBUG:teuthology.orchestra.run.smithi089:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-08T15:40:26.428 DEBUG:teuthology.orchestra.run.smithi089:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-08T15:40:26.428 DEBUG:teuthology.orchestra.run.smithi089:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-08T15:40:26.428 DEBUG:teuthology.orchestra.run.smithi089:> contents = proc_f.read() 2023-10-08T15:40:26.429 DEBUG:teuthology.orchestra.run.smithi089:> if mountpoint in contents: 2023-10-08T15:40:26.429 DEBUG:teuthology.orchestra.run.smithi089:> return f 2023-10-08T15:40:26.429 DEBUG:teuthology.orchestra.run.smithi089:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-08T15:40:26.429 DEBUG:teuthology.orchestra.run.smithi089:> 2023-10-08T15:40:26.429 DEBUG:teuthology.orchestra.run.smithi089:> print(_find_admin_socket("client.0")) 2023-10-08T15:40:26.429 DEBUG:teuthology.orchestra.run.smithi089:> ' 2023-10-08T15:40:26.507 INFO:teuthology.orchestra.run.smithi089.stdout:/var/run/ceph/ceph-client.0.28924.asok 2023-10-08T15:40:26.694 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.28924.asok 2023-10-08T15:40:26.694 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:40:26.694 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.28924.asok status 2023-10-08T15:40:26.789 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2023-10-08T15:40:26.789 INFO:teuthology.orchestra.run.smithi089.stdout: "metadata": { 2023-10-08T15:40:26.789 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph_sha1": "08cac0187919fc3a247efdf445f652e2fb30a647", 2023-10-08T15:40:26.789 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph_version": "ceph version 17.2.6-1320-g08cac018 (08cac0187919fc3a247efdf445f652e2fb30a647) quincy (stable)", 2023-10-08T15:40:26.790 INFO:teuthology.orchestra.run.smithi089.stdout: "entity_id": "0", 2023-10-08T15:40:26.790 INFO:teuthology.orchestra.run.smithi089.stdout: "hostname": "smithi089", 2023-10-08T15:40:26.790 INFO:teuthology.orchestra.run.smithi089.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-08T15:40:26.790 INFO:teuthology.orchestra.run.smithi089.stdout: "pid": "28924", 2023-10-08T15:40:26.790 INFO:teuthology.orchestra.run.smithi089.stdout: "root": "/" 2023-10-08T15:40:26.790 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-10-08T15:40:26.790 INFO:teuthology.orchestra.run.smithi089.stdout: "dentry_count": 0, 2023-10-08T15:40:26.790 INFO:teuthology.orchestra.run.smithi089.stdout: "dentry_pinned_count": 0, 2023-10-08T15:40:26.790 INFO:teuthology.orchestra.run.smithi089.stdout: "id": 5518, 2023-10-08T15:40:26.790 INFO:teuthology.orchestra.run.smithi089.stdout: "inst": { 2023-10-08T15:40:26.790 INFO:teuthology.orchestra.run.smithi089.stdout: "name": { 2023-10-08T15:40:26.791 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "client", 2023-10-08T15:40:26.791 INFO:teuthology.orchestra.run.smithi089.stdout: "num": 5518 2023-10-08T15:40:26.791 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-10-08T15:40:26.791 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": { 2023-10-08T15:40:26.791 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2023-10-08T15:40:26.791 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:0", 2023-10-08T15:40:26.791 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 3441094055 2023-10-08T15:40:26.791 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-10-08T15:40:26.791 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-10-08T15:40:26.791 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": { 2023-10-08T15:40:26.791 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2023-10-08T15:40:26.791 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:0", 2023-10-08T15:40:26.792 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 3441094055 2023-10-08T15:40:26.792 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-10-08T15:40:26.792 INFO:teuthology.orchestra.run.smithi089.stdout: "inst_str": "client.5518 172.21.15.89:0/3441094055", 2023-10-08T15:40:26.792 INFO:teuthology.orchestra.run.smithi089.stdout: "addr_str": "172.21.15.89:0/3441094055", 2023-10-08T15:40:26.792 INFO:teuthology.orchestra.run.smithi089.stdout: "inode_count": 1, 2023-10-08T15:40:26.792 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_epoch": 19, 2023-10-08T15:40:26.792 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_epoch": 39, 2023-10-08T15:40:26.792 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_epoch_barrier": 0, 2023-10-08T15:40:26.792 INFO:teuthology.orchestra.run.smithi089.stdout: "blocklisted": false, 2023-10-08T15:40:26.792 INFO:teuthology.orchestra.run.smithi089.stdout: "fs_name": "cephfs" 2023-10-08T15:40:26.792 INFO:teuthology.orchestra.run.smithi089.stdout:} 2023-10-08T15:40:26.798 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:40:26.799 DEBUG:teuthology.orchestra.run.smithi089:> stat --file-system '--printf=%T 2023-10-08T15:40:26.799 DEBUG:teuthology.orchestra.run.smithi089:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-08T15:40:26.807 INFO:teuthology.orchestra.run.smithi089.stdout:fuseblk 2023-10-08T15:40:26.807 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-08T15:40:26.807 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:40:26.807 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-08T15:40:26.820 DEBUG:teuthology.orchestra.run.smithi089:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-08T15:40:26.820 DEBUG:teuthology.orchestra.run.smithi089:> import os 2023-10-08T15:40:26.820 DEBUG:teuthology.orchestra.run.smithi089:> import uuid 2023-10-08T15:40:26.820 DEBUG:teuthology.orchestra.run.smithi089:> 2023-10-08T15:40:26.820 DEBUG:teuthology.orchestra.run.smithi089:> n = 1000 2023-10-08T15:40:26.820 DEBUG:teuthology.orchestra.run.smithi089:> create_hard_links = False 2023-10-08T15:40:26.820 DEBUG:teuthology.orchestra.run.smithi089:> if 0 > 0: 2023-10-08T15:40:26.820 DEBUG:teuthology.orchestra.run.smithi089:> create_hard_links = True 2023-10-08T15:40:26.820 DEBUG:teuthology.orchestra.run.smithi089:> path = "/home/ubuntu/cephtest/mnt.0/dc-dir/dc-file" 2023-10-08T15:40:26.820 DEBUG:teuthology.orchestra.run.smithi089:> 2023-10-08T15:40:26.820 DEBUG:teuthology.orchestra.run.smithi089:> dpath = os.path.dirname(path) 2023-10-08T15:40:26.821 DEBUG:teuthology.orchestra.run.smithi089:> fnameprefix = os.path.basename(path) 2023-10-08T15:40:26.821 DEBUG:teuthology.orchestra.run.smithi089:> os.makedirs(dpath, exist_ok=True) 2023-10-08T15:40:26.821 DEBUG:teuthology.orchestra.run.smithi089:> 2023-10-08T15:40:26.821 DEBUG:teuthology.orchestra.run.smithi089:> try: 2023-10-08T15:40:26.821 DEBUG:teuthology.orchestra.run.smithi089:> dirfd = os.open(dpath, os.O_DIRECTORY) 2023-10-08T15:40:26.821 DEBUG:teuthology.orchestra.run.smithi089:> 2023-10-08T15:40:26.821 DEBUG:teuthology.orchestra.run.smithi089:> for i in range(n): 2023-10-08T15:40:26.821 DEBUG:teuthology.orchestra.run.smithi089:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2023-10-08T15:40:26.821 DEBUG:teuthology.orchestra.run.smithi089:> with open(fpath, '"'"'w'"'"') as f: 2023-10-08T15:40:26.821 DEBUG:teuthology.orchestra.run.smithi089:> f.write(f"{i}") 2023-10-08T15:40:26.821 DEBUG:teuthology.orchestra.run.smithi089:> if True: 2023-10-08T15:40:26.821 DEBUG:teuthology.orchestra.run.smithi089:> f.flush() 2023-10-08T15:40:26.822 DEBUG:teuthology.orchestra.run.smithi089:> os.fsync(f.fileno()) 2023-10-08T15:40:26.822 DEBUG:teuthology.orchestra.run.smithi089:> if False: 2023-10-08T15:40:26.822 DEBUG:teuthology.orchestra.run.smithi089:> os.unlink(fpath) 2023-10-08T15:40:26.822 DEBUG:teuthology.orchestra.run.smithi089:> if False: 2023-10-08T15:40:26.822 DEBUG:teuthology.orchestra.run.smithi089:> os.fsync(dirfd) 2023-10-08T15:40:26.822 DEBUG:teuthology.orchestra.run.smithi089:> if create_hard_links: 2023-10-08T15:40:26.822 DEBUG:teuthology.orchestra.run.smithi089:> for j in range(0): 2023-10-08T15:40:26.822 DEBUG:teuthology.orchestra.run.smithi089:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2023-10-08T15:40:26.822 DEBUG:teuthology.orchestra.run.smithi089:> if False: 2023-10-08T15:40:26.822 DEBUG:teuthology.orchestra.run.smithi089:> os.fsync(dirfd) 2023-10-08T15:40:26.822 DEBUG:teuthology.orchestra.run.smithi089:> finally: 2023-10-08T15:40:26.822 DEBUG:teuthology.orchestra.run.smithi089:> os.close(dirfd) 2023-10-08T15:40:26.822 DEBUG:teuthology.orchestra.run.smithi089:> ' 2023-10-08T15:40:37.203 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:40:37.206 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:40:37.208 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:40:37.211 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:40:37.214 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:40:37.891 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:40:38.008 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.003+0000 7f9922881700 1 Processor -- start 2023-10-08T15:40:38.009 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.003+0000 7f9922881700 1 -- start start 2023-10-08T15:40:38.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.007+0000 7f9922881700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f991c0bacf0 0x7f991c06dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:38.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.007+0000 7f9922881700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f991c0b1c30 0x7f991c148590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:38.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.007+0000 7f9922881700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f991c06d9f0 con 0x7f991c0bb0c0 2023-10-08T15:40:38.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.007+0000 7f9922881700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f991c148170 con 0x7f991c0bacf0 2023-10-08T15:40:38.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.007+0000 7f9922881700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f991c14c410 con 0x7f991c0b1c30 2023-10-08T15:40:38.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.007+0000 7f992107e700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f991c0bb0c0 0x7f991c0b22b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:43684/0 (socket says 172.21.15.3:43684) 2023-10-08T15:40:38.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.007+0000 7f992107e700 1 -- 172.21.15.3:0/1112384825 learned_addr learned my addr 172.21.15.3:0/1112384825 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:40:38.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.007+0000 7f992187f700 1 --2- 172.21.15.3:0/1112384825 >> v2:172.21.15.3:3300/0 conn(0x7f991c0bacf0 0x7f991c06dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:38.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.007+0000 7f9922080700 1 --2- 172.21.15.3:0/1112384825 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f991c0b1c30 0x7f991c148590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:38.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.007+0000 7f992087d700 1 -- 172.21.15.3:0/1112384825 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 389547444 0 0) 0x7f991c06d9f0 con 0x7f991c0bb0c0 2023-10-08T15:40:38.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.007+0000 7f992087d700 1 -- 172.21.15.3:0/1112384825 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9908005780 con 0x7f991c0bb0c0 2023-10-08T15:40:38.013 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.007+0000 7f9922080700 1 -- 172.21.15.3:0/1112384825 >> v2:172.21.15.3:3300/0 conn(0x7f991c0bacf0 msgr2=0x7f991c06dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:38.013 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.007+0000 7f9922080700 1 --2- 172.21.15.3:0/1112384825 >> v2:172.21.15.3:3300/0 conn(0x7f991c0bacf0 0x7f991c06dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.013 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.007+0000 7f9922080700 1 -- 172.21.15.3:0/1112384825 >> v1:172.21.15.3:6789/0 conn(0x7f991c0bb0c0 legacy=0x7f991c0b22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:38.013 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.007+0000 7f9922080700 1 -- 172.21.15.3:0/1112384825 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f991c14c0e0 con 0x7f991c0b1c30 2023-10-08T15:40:38.013 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.007+0000 7f9922080700 1 --2- 172.21.15.3:0/1112384825 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f991c0b1c30 0x7f991c148590 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9914009e60 tx=0x7f9914009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3fbca032f2812c6b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:38.013 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.007+0000 7f992087d700 1 -- 172.21.15.3:0/1112384825 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991400e070 con 0x7f991c0b1c30 2023-10-08T15:40:38.013 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.007+0000 7f992087d700 1 -- 172.21.15.3:0/1112384825 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f991400bab0 con 0x7f991c0b1c30 2023-10-08T15:40:38.013 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.007+0000 7f992087d700 1 -- 172.21.15.3:0/1112384825 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991400be70 con 0x7f991c0b1c30 2023-10-08T15:40:38.016 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.007+0000 7f9922881700 1 -- 172.21.15.3:0/1112384825 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f991c0b1c30 msgr2=0x7f991c148590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:38.016 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.007+0000 7f9922881700 1 --2- 172.21.15.3:0/1112384825 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f991c0b1c30 0x7f991c148590 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9914009e60 tx=0x7f9914009780 comp rx=0 tx=0).stop 2023-10-08T15:40:38.016 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.007+0000 7f9922881700 1 -- 172.21.15.3:0/1112384825 shutdown_connections 2023-10-08T15:40:38.016 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.007+0000 7f9922881700 1 --2- 172.21.15.3:0/1112384825 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f991c0b1c30 0x7f991c148590 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.016 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.007+0000 7f9922881700 1 --2- 172.21.15.3:0/1112384825 >> v2:172.21.15.3:3300/0 conn(0x7f991c0bacf0 0x7f991c06dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.016 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.007+0000 7f9922881700 1 -- 172.21.15.3:0/1112384825 >> 172.21.15.3:0/1112384825 conn(0x7f991c0be4a0 msgr2=0x7f991c0ba440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:38.016 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.007+0000 7f9922881700 1 -- 172.21.15.3:0/1112384825 shutdown_connections 2023-10-08T15:40:38.017 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.007+0000 7f9922881700 1 -- 172.21.15.3:0/1112384825 wait complete. 2023-10-08T15:40:38.017 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.011+0000 7f9922881700 1 Processor -- start 2023-10-08T15:40:38.017 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.011+0000 7f9922881700 1 -- start start 2023-10-08T15:40:38.017 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.011+0000 7f9922881700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f991c0b1c30 0x7f991c1416d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:38.017 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.011+0000 7f9922881700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f991c0bacf0 0x7f991c140900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:38.017 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.011+0000 7f9922881700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f991c0bb0c0 0x7f991c0b9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:38.017 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.011+0000 7f9922881700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f991c145db0 con 0x7f991c0bb0c0 2023-10-08T15:40:38.017 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.011+0000 7f9922881700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f991c146330 con 0x7f991c0bacf0 2023-10-08T15:40:38.017 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.011+0000 7f9922881700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f991c141f80 con 0x7f991c0b1c30 2023-10-08T15:40:38.017 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.011+0000 7f9922080700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f991c0bb0c0 0x7f991c0b9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:38.017 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.011+0000 7f9922080700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f991c0bb0c0 0x7f991c0b9830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54266/0 (socket says 172.21.15.3:54266) 2023-10-08T15:40:38.017 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.011+0000 7f9922080700 1 -- 172.21.15.3:0/1194360831 learned_addr learned my addr 172.21.15.3:0/1194360831 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:38.018 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.011+0000 7f992187f700 1 --2- 172.21.15.3:0/1194360831 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f991c0b1c30 0x7f991c1416d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:38.018 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.011+0000 7f992107e700 1 --2- 172.21.15.3:0/1194360831 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f991c0bacf0 0x7f991c140900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:38.018 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.011+0000 7f9922080700 1 -- 172.21.15.3:0/1194360831 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f991c0b1c30 msgr2=0x7f991c1416d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:38.018 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.011+0000 7f9922080700 1 --2- 172.21.15.3:0/1194360831 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f991c0b1c30 0x7f991c1416d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.018 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.011+0000 7f9922080700 1 -- 172.21.15.3:0/1194360831 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f991c0bacf0 msgr2=0x7f991c140900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:38.018 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.011+0000 7f9922080700 1 --2- 172.21.15.3:0/1194360831 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f991c0bacf0 0x7f991c140900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.018 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.011+0000 7f9922080700 1 -- 172.21.15.3:0/1194360831 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9914009a20 con 0x7f991c0bb0c0 2023-10-08T15:40:38.018 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.011+0000 7f992107e700 1 --2- 172.21.15.3:0/1194360831 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f991c0bacf0 0x7f991c140900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:40:38.018 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.011+0000 7f992187f700 1 --2- 172.21.15.3:0/1194360831 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f991c0b1c30 0x7f991c1416d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:40:38.018 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.011+0000 7f9922080700 1 --2- 172.21.15.3:0/1194360831 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f991c0bb0c0 0x7f991c0b9830 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f991c070be0 tx=0x7f9914019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:38.019 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.011+0000 7f9911ffb700 1 -- 172.21.15.3:0/1194360831 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9914027470 con 0x7f991c0bb0c0 2023-10-08T15:40:38.019 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.011+0000 7f9911ffb700 1 -- 172.21.15.3:0/1194360831 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99140275f0 con 0x7f991c0bb0c0 2023-10-08T15:40:38.019 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.011+0000 7f9922881700 1 -- 172.21.15.3:0/1194360831 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f991c141c10 con 0x7f991c0bb0c0 2023-10-08T15:40:38.019 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.011+0000 7f9911ffb700 1 -- 172.21.15.3:0/1194360831 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99140279b0 con 0x7f991c0bb0c0 2023-10-08T15:40:38.019 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.011+0000 7f9922881700 1 -- 172.21.15.3:0/1194360831 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f991c140e40 con 0x7f991c0bb0c0 2023-10-08T15:40:38.020 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.015+0000 7f9922881700 1 -- 172.21.15.3:0/1194360831 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f991c1464e0 con 0x7f991c0bb0c0 2023-10-08T15:40:38.020 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.015+0000 7f9911ffb700 1 -- 172.21.15.3:0/1194360831 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f9914024070 con 0x7f991c0bb0c0 2023-10-08T15:40:38.020 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.015+0000 7f9911ffb700 1 --2- 172.21.15.3:0/1194360831 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f9900060550 0x7f9900062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:38.020 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.015+0000 7f9911ffb700 1 -- 172.21.15.3:0/1194360831 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f991407f200 con 0x7f991c0bb0c0 2023-10-08T15:40:38.020 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.015+0000 7f992187f700 1 --2- 172.21.15.3:0/1194360831 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f9900060550 0x7f9900062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:38.021 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.019+0000 7f992187f700 1 --2- 172.21.15.3:0/1194360831 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f9900060550 0x7f9900062a00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9918009d80 tx=0x7f9918008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:38.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.019+0000 7f9911ffb700 1 -- 172.21.15.3:0/1194360831 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f991404f750 con 0x7f991c0bb0c0 2023-10-08T15:40:38.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.219+0000 7f9922881700 1 -- 172.21.15.3:0/1194360831 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f991c145ef0 con 0x7f991c0bb0c0 2023-10-08T15:40:38.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.219+0000 7f9911ffb700 1 -- 172.21.15.3:0/1194360831 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+3080 (secure 0 0 0) 0x7f9914052d70 con 0x7f991c0bb0c0 2023-10-08T15:40:38.223 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:40:38.223 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5006,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3286528236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3286528236},{"type":"v1","addr":"172.21.15.50:6835","nonce":3286528236}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:40:13.764784+0000","modified":"2023-10-08T15:40:16.434138+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5337},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5337":{"gid":5337,"name":"a","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.3:6833/3441752211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":3441752211},{"type":"v1","addr":"172.21.15.3:6833","nonce":3441752211}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-08T15:40:38.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.223+0000 7f9922881700 1 -- 172.21.15.3:0/1194360831 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f9900060550 msgr2=0x7f9900062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:38.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.223+0000 7f9922881700 1 --2- 172.21.15.3:0/1194360831 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f9900060550 0x7f9900062a00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9918009d80 tx=0x7f9918008040 comp rx=0 tx=0).stop 2023-10-08T15:40:38.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.223+0000 7f9922881700 1 -- 172.21.15.3:0/1194360831 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f991c0bb0c0 msgr2=0x7f991c0b9830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:38.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.223+0000 7f9922881700 1 --2- 172.21.15.3:0/1194360831 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f991c0bb0c0 0x7f991c0b9830 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f991c070be0 tx=0x7f9914019000 comp rx=0 tx=0).stop 2023-10-08T15:40:38.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.223+0000 7f9922881700 1 -- 172.21.15.3:0/1194360831 shutdown_connections 2023-10-08T15:40:38.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.223+0000 7f9922881700 1 --2- 172.21.15.3:0/1194360831 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f9900060550 0x7f9900062a00 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.223+0000 7f9922881700 1 --2- 172.21.15.3:0/1194360831 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f991c0bb0c0 0x7f991c0b9830 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.223+0000 7f9922881700 1 --2- 172.21.15.3:0/1194360831 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f991c0bacf0 0x7f991c140900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.223+0000 7f9922881700 1 --2- 172.21.15.3:0/1194360831 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f991c0b1c30 0x7f991c1416d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.223+0000 7f9922881700 1 -- 172.21.15.3:0/1194360831 >> 172.21.15.3:0/1194360831 conn(0x7f991c0be4a0 msgr2=0x7f991c06d4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:38.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.223+0000 7f9922881700 1 -- 172.21.15.3:0/1194360831 shutdown_connections 2023-10-08T15:40:38.227 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.223+0000 7f9922881700 1 -- 172.21.15.3:0/1194360831 wait complete. 2023-10-08T15:40:38.227 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 19 2023-10-08T15:40:38.237 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_caps 20 2023-10-08T15:40:38.343 INFO:teuthology.orchestra.run.smithi003.stdout:{"success":"mds_recall_max_caps = '20' (not observed, change may require restart) "} 2023-10-08T15:40:38.344 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_caps = '20' (not observed, change may require restart) " } 2023-10-08T15:40:38.344 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:40:38.455 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.451+0000 7fd644cc0700 1 Processor -- start 2023-10-08T15:40:38.455 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.451+0000 7fd644cc0700 1 -- start start 2023-10-08T15:40:38.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.451+0000 7fd644cc0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd6400bbcd0 0x7fd6400bc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:38.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.451+0000 7fd644cc0700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fd6400be5f0 0x7fd640147970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:38.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.451+0000 7fd644cc0700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6401495c0 con 0x7fd6400b3280 2023-10-08T15:40:38.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.451+0000 7fd644cc0700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6400bd9e0 con 0x7fd6400be5f0 2023-10-08T15:40:38.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.451+0000 7fd644cc0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6400b1e80 con 0x7fd6400bbcd0 2023-10-08T15:40:38.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.451+0000 7fd63effd700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fd6400b3280 0x7fd6400b2310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:43694/0 (socket says 172.21.15.3:43694) 2023-10-08T15:40:38.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.451+0000 7fd63effd700 1 -- 172.21.15.3:0/292905149 learned_addr learned my addr 172.21.15.3:0/292905149 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:40:38.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.451+0000 7fd63ffff700 1 --2- 172.21.15.3:0/292905149 >> v2:172.21.15.3:3300/0 conn(0x7fd6400be5f0 0x7fd640147970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:38.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.451+0000 7fd63f7fe700 1 --2- 172.21.15.3:0/292905149 >> v2:172.21.15.50:3300/0 conn(0x7fd6400bbcd0 0x7fd6400bc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:38.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.451+0000 7fd63ffff700 1 -- 172.21.15.3:0/292905149 >> v2:172.21.15.50:3300/0 conn(0x7fd6400bbcd0 msgr2=0x7fd6400bc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:38.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.451+0000 7fd63ffff700 1 --2- 172.21.15.3:0/292905149 >> v2:172.21.15.50:3300/0 conn(0x7fd6400bbcd0 0x7fd6400bc0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.451+0000 7fd63ffff700 1 -- 172.21.15.3:0/292905149 >> v1:172.21.15.3:6789/0 conn(0x7fd6400b3280 legacy=0x7fd6400b2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:38.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.451+0000 7fd63ffff700 1 -- 172.21.15.3:0/292905149 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6400bd700 con 0x7fd6400be5f0 2023-10-08T15:40:38.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.451+0000 7fd63e7fc700 1 -- 172.21.15.3:0/292905149 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1152749380 0 0) 0x7fd6401495c0 con 0x7fd6400b3280 2023-10-08T15:40:38.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.451+0000 7fd63ffff700 1 --2- 172.21.15.3:0/292905149 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd6400be5f0 0x7fd640147970 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd64006e110 tx=0x7fd638009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57250638a2e415d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:38.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.455+0000 7fd63e7fc700 1 -- 172.21.15.3:0/292905149 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63800e070 con 0x7fd6400be5f0 2023-10-08T15:40:38.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.455+0000 7fd63e7fc700 1 -- 172.21.15.3:0/292905149 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd63800bb60 con 0x7fd6400be5f0 2023-10-08T15:40:38.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.455+0000 7fd63e7fc700 1 -- 172.21.15.3:0/292905149 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd638012430 con 0x7fd6400be5f0 2023-10-08T15:40:38.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.455+0000 7fd644cc0700 1 -- 172.21.15.3:0/292905149 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd6400be5f0 msgr2=0x7fd640147970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:38.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.455+0000 7fd644cc0700 1 --2- 172.21.15.3:0/292905149 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd6400be5f0 0x7fd640147970 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd64006e110 tx=0x7fd638009780 comp rx=0 tx=0).stop 2023-10-08T15:40:38.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.455+0000 7fd644cc0700 1 -- 172.21.15.3:0/292905149 shutdown_connections 2023-10-08T15:40:38.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.455+0000 7fd644cc0700 1 --2- 172.21.15.3:0/292905149 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd6400be5f0 0x7fd640147970 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.455+0000 7fd644cc0700 1 --2- 172.21.15.3:0/292905149 >> v2:172.21.15.50:3300/0 conn(0x7fd6400bbcd0 0x7fd6400bc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.455+0000 7fd644cc0700 1 -- 172.21.15.3:0/292905149 >> 172.21.15.3:0/292905149 conn(0x7fd6400bf5e0 msgr2=0x7fd6400bb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:38.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.455+0000 7fd644cc0700 1 -- 172.21.15.3:0/292905149 shutdown_connections 2023-10-08T15:40:38.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.455+0000 7fd644cc0700 1 -- 172.21.15.3:0/292905149 wait complete. 2023-10-08T15:40:38.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.459+0000 7fd644cc0700 1 Processor -- start 2023-10-08T15:40:38.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.459+0000 7fd644cc0700 1 -- start start 2023-10-08T15:40:38.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.459+0000 7fd644cc0700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd6400b3280 0x7fd64014edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:38.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.459+0000 7fd644cc0700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd6400bbcd0 0x7fd640158f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:38.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.459+0000 7fd644cc0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6400be5f0 0x7fd640159440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:38.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.459+0000 7fd644cc0700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6400b7f90 con 0x7fd6400b3280 2023-10-08T15:40:38.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.459+0000 7fd644cc0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd640145af0 con 0x7fd6400be5f0 2023-10-08T15:40:38.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.459+0000 7fd644cc0700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd64015ccd0 con 0x7fd6400bbcd0 2023-10-08T15:40:38.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.459+0000 7fd63f7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd6400b3280 0x7fd64014edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:38.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.459+0000 7fd63f7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd6400b3280 0x7fd64014edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54288/0 (socket says 172.21.15.3:54288) 2023-10-08T15:40:38.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.459+0000 7fd63f7fe700 1 -- 172.21.15.3:0/2611153826 learned_addr learned my addr 172.21.15.3:0/2611153826 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:38.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.459+0000 7fd63effd700 1 --2- 172.21.15.3:0/2611153826 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd6400bbcd0 0x7fd640158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:38.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.459+0000 7fd63ffff700 1 --2- 172.21.15.3:0/2611153826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6400be5f0 0x7fd640159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:38.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.459+0000 7fd63f7fe700 1 -- 172.21.15.3:0/2611153826 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd6400bbcd0 msgr2=0x7fd640158f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:38.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.459+0000 7fd63f7fe700 1 --2- 172.21.15.3:0/2611153826 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd6400bbcd0 0x7fd640158f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.459+0000 7fd63f7fe700 1 -- 172.21.15.3:0/2611153826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6400be5f0 msgr2=0x7fd640159440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:38.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.459+0000 7fd63f7fe700 1 --2- 172.21.15.3:0/2611153826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6400be5f0 0x7fd640159440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.459+0000 7fd63f7fe700 1 -- 172.21.15.3:0/2611153826 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd638009a20 con 0x7fd6400b3280 2023-10-08T15:40:38.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.459+0000 7fd63f7fe700 1 --2- 172.21.15.3:0/2611153826 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd6400b3280 0x7fd64014edb0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fd63000ec80 tx=0x7fd630009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:38.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.459+0000 7fd6277fe700 1 -- 172.21.15.3:0/2611153826 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd630009680 con 0x7fd6400b3280 2023-10-08T15:40:38.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.459+0000 7fd644cc0700 1 -- 172.21.15.3:0/2611153826 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd64014f2f0 con 0x7fd6400b3280 2023-10-08T15:40:38.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.459+0000 7fd644cc0700 1 -- 172.21.15.3:0/2611153826 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd640159980 con 0x7fd6400b3280 2023-10-08T15:40:38.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.459+0000 7fd6277fe700 1 -- 172.21.15.3:0/2611153826 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd63000ca60 con 0x7fd6400b3280 2023-10-08T15:40:38.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.459+0000 7fd6277fe700 1 -- 172.21.15.3:0/2611153826 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63000cbd0 con 0x7fd6400b3280 2023-10-08T15:40:38.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.463+0000 7fd6277fe700 1 -- 172.21.15.3:0/2611153826 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fd630013470 con 0x7fd6400b3280 2023-10-08T15:40:38.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.463+0000 7fd644cc0700 1 -- 172.21.15.3:0/2611153826 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6200052b0 con 0x7fd6400b3280 2023-10-08T15:40:38.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.463+0000 7fd6277fe700 1 --2- 172.21.15.3:0/2611153826 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd62c060550 0x7fd62c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:38.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.463+0000 7fd6277fe700 1 -- 172.21.15.3:0/2611153826 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd63007d000 con 0x7fd6400b3280 2023-10-08T15:40:38.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.463+0000 7fd63effd700 1 --2- 172.21.15.3:0/2611153826 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd62c060550 0x7fd62c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:38.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.463+0000 7fd63effd700 1 --2- 172.21.15.3:0/2611153826 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd62c060550 0x7fd62c062a00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd6400b3d20 tx=0x7fd634007d30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:38.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.471+0000 7fd6277fe700 1 -- 172.21.15.3:0/2611153826 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd63004d5f0 con 0x7fd6400b3280 2023-10-08T15:40:38.670 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.667+0000 7fd644cc0700 1 -- 172.21.15.3:0/2611153826 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd620005560 con 0x7fd6400b3280 2023-10-08T15:40:38.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.667+0000 7fd6277fe700 1 -- 172.21.15.3:0/2611153826 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+3080 (secure 0 0 0) 0x7fd630021c20 con 0x7fd6400b3280 2023-10-08T15:40:38.671 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:40:38.671 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5006,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3286528236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3286528236},{"type":"v1","addr":"172.21.15.50:6835","nonce":3286528236}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:40:13.764784+0000","modified":"2023-10-08T15:40:16.434138+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5337},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5337":{"gid":5337,"name":"a","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.3:6833/3441752211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":3441752211},{"type":"v1","addr":"172.21.15.3:6833","nonce":3441752211}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-08T15:40:38.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.667+0000 7fd644cc0700 1 -- 172.21.15.3:0/2611153826 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd62c060550 msgr2=0x7fd62c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:38.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.667+0000 7fd644cc0700 1 --2- 172.21.15.3:0/2611153826 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd62c060550 0x7fd62c062a00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd6400b3d20 tx=0x7fd634007d30 comp rx=0 tx=0).stop 2023-10-08T15:40:38.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.667+0000 7fd644cc0700 1 -- 172.21.15.3:0/2611153826 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd6400b3280 msgr2=0x7fd64014edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:38.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.667+0000 7fd644cc0700 1 --2- 172.21.15.3:0/2611153826 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd6400b3280 0x7fd64014edb0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fd63000ec80 tx=0x7fd630009120 comp rx=0 tx=0).stop 2023-10-08T15:40:38.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.667+0000 7fd644cc0700 1 -- 172.21.15.3:0/2611153826 shutdown_connections 2023-10-08T15:40:38.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.671+0000 7fd644cc0700 1 --2- 172.21.15.3:0/2611153826 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd62c060550 0x7fd62c062a00 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.671+0000 7fd644cc0700 1 --2- 172.21.15.3:0/2611153826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6400be5f0 0x7fd640159440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.671+0000 7fd644cc0700 1 --2- 172.21.15.3:0/2611153826 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd6400bbcd0 0x7fd640158f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.671+0000 7fd644cc0700 1 --2- 172.21.15.3:0/2611153826 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd6400b3280 0x7fd64014edb0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.671+0000 7fd644cc0700 1 -- 172.21.15.3:0/2611153826 >> 172.21.15.3:0/2611153826 conn(0x7fd6400bf5e0 msgr2=0x7fd640147420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:38.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.671+0000 7fd644cc0700 1 -- 172.21.15.3:0/2611153826 shutdown_connections 2023-10-08T15:40:38.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.671+0000 7fd644cc0700 1 -- 172.21.15.3:0/2611153826 wait complete. 2023-10-08T15:40:38.675 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 19 2023-10-08T15:40:38.690 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_decay_threshold 400 2023-10-08T15:40:38.793 INFO:teuthology.orchestra.run.smithi003.stdout:{"success":"mds_recall_max_decay_threshold = '400' (not observed, change may require restart) "} 2023-10-08T15:40:38.794 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_decay_threshold = '400' (not observed, change may require restart) " } 2023-10-08T15:40:38.794 INFO:tasks.cephfs.mount:Suspending the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T15:40:38.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:38.794 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set brx.0 down 2023-10-08T15:40:38.813 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 cache drop 2023-10-08T15:40:38.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.923+0000 7ff7bd9f8700 1 Processor -- start 2023-10-08T15:40:38.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.923+0000 7ff7bd9f8700 1 -- start start 2023-10-08T15:40:38.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.927+0000 7ff7bd9f8700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7ff7b8153fa0 0x7ff7b8156380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:38.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.927+0000 7ff7bd9f8700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7b814c2f0 con 0x7ff7b806c830 2023-10-08T15:40:38.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.927+0000 7ff7bd9f8700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7b80a2800 con 0x7ff7b80bf3a0 2023-10-08T15:40:38.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.927+0000 7ff7bd9f8700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7b806de20 con 0x7ff7b8153fa0 2023-10-08T15:40:38.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.927+0000 7ff7b77fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7ff7b8153fa0 0x7ff7b8156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:38.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.927+0000 7ff7b67fc700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7ff7b806c830 0x7ff7b806d710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:43698/0 (socket says 172.21.15.3:43698) 2023-10-08T15:40:38.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.927+0000 7ff7b67fc700 1 -- 172.21.15.3:0/537654538 learned_addr learned my addr 172.21.15.3:0/537654538 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:40:38.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.927+0000 7ff7b77fe700 1 -- 172.21.15.3:0/537654538 >> v1:172.21.15.50:6789/0 conn(0x7ff7b80bf3a0 legacy=0x7ff7b806d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:38.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.927+0000 7ff7b77fe700 1 -- 172.21.15.3:0/537654538 >> v1:172.21.15.3:6789/0 conn(0x7ff7b806c830 legacy=0x7ff7b806d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:38.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.927+0000 7ff7b77fe700 1 -- 172.21.15.3:0/537654538 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b814b9e0 con 0x7ff7b8153fa0 2023-10-08T15:40:38.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.927+0000 7ff7b77fe700 1 --2- 172.21.15.3:0/537654538 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff7b8153fa0 0x7ff7b8156380 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ff7b806df60 tx=0x7ff7b0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e226d8b440227a24 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:38.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.927+0000 7ff7b5ffb700 1 -- 172.21.15.3:0/537654538 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b000e070 con 0x7ff7b8153fa0 2023-10-08T15:40:38.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.927+0000 7ff7b5ffb700 1 -- 172.21.15.3:0/537654538 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b000bb30 con 0x7ff7b8153fa0 2023-10-08T15:40:38.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.927+0000 7ff7b5ffb700 1 -- 172.21.15.3:0/537654538 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b000bed0 con 0x7ff7b8153fa0 2023-10-08T15:40:38.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.927+0000 7ff7bd9f8700 1 -- 172.21.15.3:0/537654538 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff7b8153fa0 msgr2=0x7ff7b8156380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:38.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.927+0000 7ff7bd9f8700 1 --2- 172.21.15.3:0/537654538 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff7b8153fa0 0x7ff7b8156380 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ff7b806df60 tx=0x7ff7b0009780 comp rx=0 tx=0).stop 2023-10-08T15:40:38.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.927+0000 7ff7bd9f8700 1 -- 172.21.15.3:0/537654538 shutdown_connections 2023-10-08T15:40:38.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.927+0000 7ff7bd9f8700 1 --2- 172.21.15.3:0/537654538 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff7b8153fa0 0x7ff7b8156380 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.927+0000 7ff7bd9f8700 1 -- 172.21.15.3:0/537654538 >> 172.21.15.3:0/537654538 conn(0x7ff7b80c2a80 msgr2=0x7ff7b80bea60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:38.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.927+0000 7ff7bd9f8700 1 -- 172.21.15.3:0/537654538 shutdown_connections 2023-10-08T15:40:38.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.927+0000 7ff7bd9f8700 1 -- 172.21.15.3:0/537654538 wait complete. 2023-10-08T15:40:38.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.931+0000 7ff7bd9f8700 1 Processor -- start 2023-10-08T15:40:38.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.931+0000 7ff7bd9f8700 1 -- start start 2023-10-08T15:40:38.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.931+0000 7ff7bd9f8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7b806c830 0x7ff7b813b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:38.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.931+0000 7ff7bd9f8700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff7b80bf3a0 0x7ff7b813f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:38.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.931+0000 7ff7bd9f8700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff7b8153fa0 0x7ff7b814f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:38.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.931+0000 7ff7bd9f8700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b815f230 con 0x7ff7b8153fa0 2023-10-08T15:40:38.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.931+0000 7ff7bd9f8700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b8140e50 con 0x7ff7b806c830 2023-10-08T15:40:38.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.931+0000 7ff7bd9f8700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b8141270 con 0x7ff7b80bf3a0 2023-10-08T15:40:38.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.931+0000 7ff7b77fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff7b8153fa0 0x7ff7b814f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:38.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.931+0000 7ff7b77fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff7b8153fa0 0x7ff7b814f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54302/0 (socket says 172.21.15.3:54302) 2023-10-08T15:40:38.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.931+0000 7ff7b77fe700 1 -- 172.21.15.3:0/3563762897 learned_addr learned my addr 172.21.15.3:0/3563762897 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:38.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.931+0000 7ff7b67fc700 1 --2- 172.21.15.3:0/3563762897 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff7b80bf3a0 0x7ff7b813f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:38.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.931+0000 7ff7b6ffd700 1 --2- 172.21.15.3:0/3563762897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7b806c830 0x7ff7b813b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:38.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.931+0000 7ff7b77fe700 1 -- 172.21.15.3:0/3563762897 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff7b80bf3a0 msgr2=0x7ff7b813f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:38.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.931+0000 7ff7b77fe700 1 --2- 172.21.15.3:0/3563762897 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff7b80bf3a0 0x7ff7b813f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.931+0000 7ff7b77fe700 1 -- 172.21.15.3:0/3563762897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7b806c830 msgr2=0x7ff7b813b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:38.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.931+0000 7ff7b77fe700 1 --2- 172.21.15.3:0/3563762897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7b806c830 0x7ff7b813b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.931+0000 7ff7b77fe700 1 -- 172.21.15.3:0/3563762897 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b0009a20 con 0x7ff7b8153fa0 2023-10-08T15:40:38.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.931+0000 7ff7b77fe700 1 --2- 172.21.15.3:0/3563762897 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff7b8153fa0 0x7ff7b814f110 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7ff7b000b6c0 tx=0x7ff7b0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:38.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.931+0000 7ff79effd700 1 -- 172.21.15.3:0/3563762897 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b0026460 con 0x7ff7b8153fa0 2023-10-08T15:40:38.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.931+0000 7ff79effd700 1 -- 172.21.15.3:0/3563762897 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b00265c0 con 0x7ff7b8153fa0 2023-10-08T15:40:38.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.931+0000 7ff7bd9f8700 1 -- 172.21.15.3:0/3563762897 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7b815f6f0 con 0x7ff7b8153fa0 2023-10-08T15:40:38.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.931+0000 7ff79effd700 1 -- 172.21.15.3:0/3563762897 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b0026960 con 0x7ff7b8153fa0 2023-10-08T15:40:38.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.931+0000 7ff7bd9f8700 1 -- 172.21.15.3:0/3563762897 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7b815f410 con 0x7ff7b8153fa0 2023-10-08T15:40:38.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.935+0000 7ff79effd700 1 -- 172.21.15.3:0/3563762897 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff7b001d420 con 0x7ff7b8153fa0 2023-10-08T15:40:38.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.935+0000 7ff79effd700 1 --2- 172.21.15.3:0/3563762897 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff7a4060550 0x7ff7a4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:38.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.935+0000 7ff79effd700 1 -- 172.21.15.3:0/3563762897 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff7b007eea0 con 0x7ff7b8153fa0 2023-10-08T15:40:38.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.935+0000 7ff7b6ffd700 1 --2- 172.21.15.3:0/3563762897 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff7a4060550 0x7ff7a4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:38.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.939+0000 7ff7b6ffd700 1 --2- 172.21.15.3:0/3563762897 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff7a4060550 0x7ff7a4062a00 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac003880 tx=0x7ff7ac009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:38.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.939+0000 7ff7bfca1740 1 Processor -- start 2023-10-08T15:40:38.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.939+0000 7ff7bfca1740 1 -- start start 2023-10-08T15:40:38.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.939+0000 7ff7bfca1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x10aebd0 0x12e72b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:38.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.939+0000 7ff7bfca1740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x10ae800 0x12e4900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:38.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.939+0000 7ff7bfca1740 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x10f9880 0x12e4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:38.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.939+0000 7ff7bfca1740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x1259fb0 con 0x10ae800 2023-10-08T15:40:38.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.939+0000 7ff7bfca1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x1255f50 con 0x10aebd0 2023-10-08T15:40:38.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.939+0000 7ff7bfca1740 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x121c180 con 0x10f9880 2023-10-08T15:40:38.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.939+0000 7ff7b6ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x10aebd0 0x12e72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:38.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.939+0000 7ff7b67fc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x10ae800 0x12e4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:38.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.939+0000 7ff7b77fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x10f9880 0x12e4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:38.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.939+0000 7ff7b6ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x10aebd0 0x12e72b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.3:42620/0 (socket says 172.21.15.3:42620) 2023-10-08T15:40:38.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.939+0000 7ff7b67fc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x10ae800 0x12e4900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54314/0 (socket says 172.21.15.3:54314) 2023-10-08T15:40:38.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.939+0000 7ff7b6ffd700 1 -- 172.21.15.3:0/2162386478 learned_addr learned my addr 172.21.15.3:0/2162386478 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:38.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.939+0000 7ff7b67fc700 1 -- 172.21.15.3:0/2162386478 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x10f9880 msgr2=0x12e4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:38.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.939+0000 7ff7b67fc700 1 --2- 172.21.15.3:0/2162386478 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x10f9880 0x12e4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.939+0000 7ff7b67fc700 1 -- 172.21.15.3:0/2162386478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x10aebd0 msgr2=0x12e72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:38.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.939+0000 7ff7b67fc700 1 --2- 172.21.15.3:0/2162386478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x10aebd0 0x12e72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.939+0000 7ff7b67fc700 1 -- 172.21.15.3:0/2162386478 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x10faad0 con 0x10ae800 2023-10-08T15:40:38.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.939+0000 7ff7b6ffd700 1 --2- 172.21.15.3:0/2162386478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x10aebd0 0x12e72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:40:38.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.939+0000 7ff7b67fc700 1 --2- 172.21.15.3:0/2162386478 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x10ae800 0x12e4900 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7ff7b81436d0 tx=0x7ff7a8009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9e7133d3ba77848 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:38.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.939+0000 7ff797fff700 1 -- 172.21.15.3:0/2162386478 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a8005b10 con 0x10ae800 2023-10-08T15:40:38.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.939+0000 7ff797fff700 1 -- 172.21.15.3:0/2162386478 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7a8005c70 con 0x10ae800 2023-10-08T15:40:38.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.939+0000 7ff797fff700 1 -- 172.21.15.3:0/2162386478 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a8007110 con 0x10ae800 2023-10-08T15:40:38.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.943+0000 7ff7bfca1740 1 -- 172.21.15.3:0/2162386478 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x10ae800 msgr2=0x12e4900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:38.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.943+0000 7ff7bfca1740 1 --2- 172.21.15.3:0/2162386478 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x10ae800 0x12e4900 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7ff7b81436d0 tx=0x7ff7a8009040 comp rx=0 tx=0).stop 2023-10-08T15:40:38.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.943+0000 7ff7bfca1740 1 -- 172.21.15.3:0/2162386478 shutdown_connections 2023-10-08T15:40:38.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.943+0000 7ff7bfca1740 1 --2- 172.21.15.3:0/2162386478 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x10f9880 0x12e4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.943+0000 7ff7bfca1740 1 --2- 172.21.15.3:0/2162386478 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x10ae800 0x12e4900 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.943+0000 7ff7bfca1740 1 --2- 172.21.15.3:0/2162386478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x10aebd0 0x12e72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.943+0000 7ff7bfca1740 1 -- 172.21.15.3:0/2162386478 >> 172.21.15.3:0/2162386478 conn(0x10aefa0 msgr2=0x12e31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:38.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.943+0000 7ff7bfca1740 1 -- 172.21.15.3:0/2162386478 shutdown_connections 2023-10-08T15:40:38.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.943+0000 7ff7bfca1740 1 -- 172.21.15.3:0/2162386478 wait complete. 2023-10-08T15:40:38.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.943+0000 7ff7bfca1740 1 -- start start 2023-10-08T15:40:38.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.943+0000 7ff7bfca1740 1 Processor -- start 2023-10-08T15:40:38.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.943+0000 7ff7bfca1740 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x10ae800 0x12e66b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:38.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.943+0000 7ff7bfca1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x10aebd0 0x12e9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:38.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.943+0000 7ff7bfca1740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x10f9880 0x12ea520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:38.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.943+0000 7ff7bfca1740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x121be20 con 0x10f9880 2023-10-08T15:40:38.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.943+0000 7ff7bfca1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x11f4980 con 0x10aebd0 2023-10-08T15:40:38.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.943+0000 7ff7bfca1740 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x11cfda0 con 0x10ae800 2023-10-08T15:40:38.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.943+0000 7ff7b77fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x10f9880 0x12ea520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:38.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.943+0000 7ff7b77fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x10f9880 0x12ea520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54318/0 (socket says 172.21.15.3:54318) 2023-10-08T15:40:38.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.943+0000 7ff7b6ffd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x10ae800 0x12e66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:38.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.943+0000 7ff7b77fe700 1 -- 172.21.15.3:0/2475097673 learned_addr learned my addr 172.21.15.3:0/2475097673 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:38.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.943+0000 7ff7b67fc700 1 --2- 172.21.15.3:0/2475097673 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x10aebd0 0x12e9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:38.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.943+0000 7ff7bfca1740 10 client.0 _ll_register_callbacks cb 0x11f8c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T15:40:38.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.947+0000 7ff7b77fe700 1 -- 172.21.15.3:0/2475097673 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x10ae800 msgr2=0x12e66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:38.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.947+0000 7ff7b77fe700 1 --2- 172.21.15.3:0/2475097673 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x10ae800 0x12e66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.947+0000 7ff7b77fe700 1 -- 172.21.15.3:0/2475097673 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x10aebd0 msgr2=0x12e9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:38.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.947+0000 7ff7b77fe700 1 --2- 172.21.15.3:0/2475097673 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x10aebd0 0x12e9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.947+0000 7ff7b77fe700 1 -- 172.21.15.3:0/2475097673 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7ac00f040 con 0x10f9880 2023-10-08T15:40:38.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.947+0000 7ff7b77fe700 1 --2- 172.21.15.3:0/2475097673 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x10f9880 0x12ea520 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff7b00099a0 tx=0x7ff7b007d280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7402f78f0d8b7b94 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:38.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.947+0000 7ff7957fa700 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2023-10-08T15:40:38.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.947+0000 7ff7957fa700 1 -- 172.21.15.3:0/2475097673 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b000e070 con 0x10f9880 2023-10-08T15:40:38.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.947+0000 7ff7957fa700 1 -- 172.21.15.3:0/2475097673 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff7b005a090 con 0x10f9880 2023-10-08T15:40:38.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.947+0000 7ff7bfca1740 1 -- 172.21.15.3:0/2475097673 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x11f8460 con 0x10f9880 2023-10-08T15:40:38.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.947+0000 7ff7957fa700 1 -- 172.21.15.3:0/2475097673 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff7b0051450 con 0x10f9880 2023-10-08T15:40:38.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.947+0000 7ff7bfca1740 10 client.5535 fetch_fsmap learned FSMap version 19 2023-10-08T15:40:38.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.947+0000 7ff7bfca1740 1 -- 172.21.15.3:0/2475097673 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x7ff7a800f040 con 0x10f9880 2023-10-08T15:40:38.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.947+0000 7ff7957fa700 1 -- 172.21.15.3:0/2475097673 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x11f8460 con 0x10f9880 2023-10-08T15:40:38.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.947+0000 7ff7957fa700 1 -- 172.21.15.3:0/2475097673 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 19) v1 ==== 2010+0+0 (secure 0 0 0) 0x7ff7b006d160 con 0x10f9880 2023-10-08T15:40:38.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.947+0000 7ff7bfca1740 10 client.5535 fetch_fsmap finished waiting for FSMap version 19 2023-10-08T15:40:38.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.947+0000 7ff7bfca1740 10 client.5535 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2023-10-08T15:40:38.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.947+0000 7ff7bfca1740 20 client.5535 populate_metadata read hostname 'smithi003' 2023-10-08T15:40:38.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.947+0000 7ff7bfca1740 1 --2- 172.21.15.3:0/2475097673 >> [v2:172.21.15.3:6832/3441752211,v1:172.21.15.3:6833/3441752211] conn(0x1322830 0x132d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:38.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.947+0000 7ff7bfca1740 4 client.5535 mds_command: new command op to 5337 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-08T15:40:38.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.947+0000 7ff7bfca1740 1 -- 172.21.15.3:0/2475097673 --> [v2:172.21.15.3:6832/3441752211,v1:172.21.15.3:6833/3441752211] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x122a420 con 0x1322830 2023-10-08T15:40:38.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.947+0000 7ff7b6ffd700 1 --2- 172.21.15.3:0/2475097673 >> [v2:172.21.15.3:6832/3441752211,v1:172.21.15.3:6833/3441752211] conn(0x1322830 0x132d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:38.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.947+0000 7ff7957fa700 10 client.5535 ms_handle_connect on v2:172.21.15.3:6832/3441752211 2023-10-08T15:40:38.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.947+0000 7ff7b6ffd700 1 --2- 172.21.15.3:0/2475097673 >> [v2:172.21.15.3:6832/3441752211,v1:172.21.15.3:6833/3441752211] conn(0x1322830 0x132d720 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a03678742f7a699 server_cookie=d86305283846a5a8 in_seq=0 out_seq=0 2023-10-08T15:40:38.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.947+0000 7ff7957fa700 1 -- 172.21.15.3:0/2475097673 <== mds.0 v2:172.21.15.3:6832/3441752211 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x122a420 con 0x1322830 2023-10-08T15:40:38.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.947+0000 7ff7957fa700 10 client.5535 handle_command_reply: tid=0 2023-10-08T15:40:38.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.947+0000 7ff7bfca1740 1 client.5535 shutdown 2023-10-08T15:40:38.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.947+0000 7ff7bfca1740 1 -- 172.21.15.3:0/2475097673 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x10f9880 msgr2=0x12ea520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:38.957 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.947+0000 7ff7bfca1740 1 --2- 172.21.15.3:0/2475097673 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x10f9880 0x12ea520 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff7b00099a0 tx=0x7ff7b007d280 comp rx=0 tx=0).stop 2023-10-08T15:40:38.957 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.947+0000 7ff7bfca1740 1 -- 172.21.15.3:0/2475097673 shutdown_connections 2023-10-08T15:40:38.957 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.947+0000 7ff7bfca1740 1 --2- 172.21.15.3:0/2475097673 >> [v2:172.21.15.3:6832/3441752211,v1:172.21.15.3:6833/3441752211] conn(0x1322830 0x132d720 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.957 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.947+0000 7ff7bfca1740 1 --2- 172.21.15.3:0/2475097673 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x10f9880 0x12ea520 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.957 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.947+0000 7ff7bfca1740 1 --2- 172.21.15.3:0/2475097673 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x10aebd0 0x12e9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.957 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.947+0000 7ff7bfca1740 1 --2- 172.21.15.3:0/2475097673 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x10ae800 0x12e66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.957 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.947+0000 7ff7957fa700 0 client.5535 ms_handle_reset on v2:172.21.15.3:6832/3441752211 2023-10-08T15:40:38.957 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.947+0000 7ff7bfca1740 1 -- 172.21.15.3:0/2475097673 >> 172.21.15.3:0/2475097673 conn(0x10aefa0 msgr2=0x12e2950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:38.957 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.947+0000 7ff7bfca1740 1 -- 172.21.15.3:0/2475097673 shutdown_connections 2023-10-08T15:40:38.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.947+0000 7ff7bfca1740 1 -- 172.21.15.3:0/2475097673 wait complete. 2023-10-08T15:40:38.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.951+0000 7ff7bfca1740 20 client.5535 trim_cache size 0 max 16384 2023-10-08T15:40:38.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.963+0000 7ff7bfca1740 1 Processor -- start 2023-10-08T15:40:38.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.963+0000 7ff7bfca1740 1 -- start start 2023-10-08T15:40:38.969 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.963+0000 7ff7bfca1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x10ae800 0x12e5510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:38.969 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.963+0000 7ff7bfca1740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x10aebd0 0x12e3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:38.969 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.963+0000 7ff7bfca1740 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x10f9880 0x12e3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:38.969 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.963+0000 7ff7bfca1740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x1250870 con 0x10aebd0 2023-10-08T15:40:38.969 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.963+0000 7ff7bfca1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x1219bc0 con 0x10ae800 2023-10-08T15:40:38.969 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.963+0000 7ff7bfca1740 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x1226c20 con 0x10f9880 2023-10-08T15:40:38.970 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.967+0000 7ff7b67fc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x10aebd0 0x12e3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:38.970 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.967+0000 7ff7b67fc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x10aebd0 0x12e3960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54322/0 (socket says 172.21.15.3:54322) 2023-10-08T15:40:38.970 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.967+0000 7ff7b67fc700 1 -- 172.21.15.3:0/199431404 learned_addr learned my addr 172.21.15.3:0/199431404 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:38.970 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.967+0000 7ff7b6ffd700 1 --2- 172.21.15.3:0/199431404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x10ae800 0x12e5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:38.970 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.967+0000 7ff7b77fe700 1 --2- 172.21.15.3:0/199431404 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x10f9880 0x12e3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:38.972 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.967+0000 7ff7b67fc700 1 -- 172.21.15.3:0/199431404 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x10f9880 msgr2=0x12e3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:38.972 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.967+0000 7ff7b67fc700 1 --2- 172.21.15.3:0/199431404 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x10f9880 0x12e3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.972 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.967+0000 7ff7b67fc700 1 -- 172.21.15.3:0/199431404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x10ae800 msgr2=0x12e5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:38.972 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.967+0000 7ff7b67fc700 1 --2- 172.21.15.3:0/199431404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x10ae800 0x12e5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.972 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.967+0000 7ff7b67fc700 1 -- 172.21.15.3:0/199431404 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1224380 con 0x10aebd0 2023-10-08T15:40:38.972 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.967+0000 7ff7b6ffd700 1 --2- 172.21.15.3:0/199431404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x10ae800 0x12e5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:40:38.972 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.967+0000 7ff7b67fc700 1 --2- 172.21.15.3:0/199431404 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x10aebd0 0x12e3960 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8007f40 tx=0x7ff7a8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca6ad8522f97ddd2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:38.972 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.967+0000 7ff79cff9700 1 -- 172.21.15.3:0/199431404 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a8005de0 con 0x10aebd0 2023-10-08T15:40:38.972 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.967+0000 7ff79cff9700 1 -- 172.21.15.3:0/199431404 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7a8025070 con 0x10aebd0 2023-10-08T15:40:38.973 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.967+0000 7ff79cff9700 1 -- 172.21.15.3:0/199431404 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a8000c30 con 0x10aebd0 2023-10-08T15:40:38.973 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.967+0000 7ff7bfca1740 1 -- 172.21.15.3:0/199431404 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x10aebd0 msgr2=0x12e3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:38.973 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.967+0000 7ff7bfca1740 1 --2- 172.21.15.3:0/199431404 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x10aebd0 0x12e3960 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8007f40 tx=0x7ff7a8019000 comp rx=0 tx=0).stop 2023-10-08T15:40:38.973 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.967+0000 7ff7bfca1740 1 -- 172.21.15.3:0/199431404 shutdown_connections 2023-10-08T15:40:38.973 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.967+0000 7ff7bfca1740 1 --2- 172.21.15.3:0/199431404 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x10f9880 0x12e3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.973 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.967+0000 7ff7bfca1740 1 --2- 172.21.15.3:0/199431404 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x10aebd0 0x12e3960 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.973 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.967+0000 7ff7bfca1740 1 --2- 172.21.15.3:0/199431404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x10ae800 0x12e5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.973 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.967+0000 7ff7bfca1740 1 -- 172.21.15.3:0/199431404 >> 172.21.15.3:0/199431404 conn(0x10aefa0 msgr2=0x12e98a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:38.973 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.967+0000 7ff7bfca1740 1 -- 172.21.15.3:0/199431404 shutdown_connections 2023-10-08T15:40:38.973 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.967+0000 7ff7bfca1740 1 -- 172.21.15.3:0/199431404 wait complete. 2023-10-08T15:40:38.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.967+0000 7ff7bfca1740 1 -- start start 2023-10-08T15:40:38.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.967+0000 7ff7bfca1740 1 Processor -- start 2023-10-08T15:40:38.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.971+0000 7ff7bfca1740 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x10ae800 0x1377400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:38.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.971+0000 7ff7bfca1740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x10aebd0 0x1377940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:38.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.971+0000 7ff7bfca1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x10f9880 0x133f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:38.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.971+0000 7ff7bfca1740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x127d310 con 0x10aebd0 2023-10-08T15:40:38.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.971+0000 7ff7bfca1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x1221680 con 0x10f9880 2023-10-08T15:40:38.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.971+0000 7ff7bfca1740 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x1172180 con 0x10ae800 2023-10-08T15:40:38.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.971+0000 7ff7bfca1740 10 client.0 _ll_register_callbacks cb 0x122a090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T15:40:38.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.971+0000 7ff7b67fc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x10aebd0 0x1377940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:38.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.971+0000 7ff7b6ffd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x10ae800 0x1377400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:38.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.971+0000 7ff7b67fc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x10aebd0 0x1377940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54334/0 (socket says 172.21.15.3:54334) 2023-10-08T15:40:38.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.971+0000 7ff7b67fc700 1 -- 172.21.15.3:0/1067731511 learned_addr learned my addr 172.21.15.3:0/1067731511 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:38.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.971+0000 7ff7b77fe700 1 --2- 172.21.15.3:0/1067731511 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x10f9880 0x133f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:38.978 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.971+0000 7ff7b67fc700 1 -- 172.21.15.3:0/1067731511 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x10ae800 msgr2=0x1377400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:38.978 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.971+0000 7ff7b67fc700 1 --2- 172.21.15.3:0/1067731511 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x10ae800 0x1377400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.978 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.971+0000 7ff7b67fc700 1 -- 172.21.15.3:0/1067731511 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x10f9880 msgr2=0x133f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:38.978 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.971+0000 7ff7b67fc700 1 --2- 172.21.15.3:0/1067731511 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x10f9880 0x133f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.978 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.971+0000 7ff7b67fc700 1 -- 172.21.15.3:0/1067731511 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7b80a2800 con 0x10aebd0 2023-10-08T15:40:38.978 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.971+0000 7ff7b77fe700 1 --2- 172.21.15.3:0/1067731511 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x10f9880 0x133f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:40:38.978 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.971+0000 7ff7b67fc700 1 --2- 172.21.15.3:0/1067731511 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x10aebd0 0x1377940 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7ff7b8063180 tx=0x7ff7a8023070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a20f5042ae81ee25 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:38.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.971+0000 7ff7957fa700 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2023-10-08T15:40:38.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.971+0000 7ff7957fa700 1 -- 172.21.15.3:0/1067731511 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a8031030 con 0x10aebd0 2023-10-08T15:40:38.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.971+0000 7ff7957fa700 1 -- 172.21.15.3:0/1067731511 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff7a8032070 con 0x10aebd0 2023-10-08T15:40:38.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.971+0000 7ff7bfca1740 1 -- 172.21.15.3:0/1067731511 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff7a8005c70 con 0x10aebd0 2023-10-08T15:40:38.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.971+0000 7ff7957fa700 1 -- 172.21.15.3:0/1067731511 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff7a8000d00 con 0x10aebd0 2023-10-08T15:40:38.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.971+0000 7ff7bfca1740 10 client.5541 fetch_fsmap learned FSMap version 19 2023-10-08T15:40:38.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.971+0000 7ff7bfca1740 1 -- 172.21.15.3:0/1067731511 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x10faad0 con 0x10aebd0 2023-10-08T15:40:38.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.971+0000 7ff7957fa700 1 -- 172.21.15.3:0/1067731511 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7a8005c70 con 0x10aebd0 2023-10-08T15:40:38.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.971+0000 7ff7957fa700 1 -- 172.21.15.3:0/1067731511 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 19) v1 ==== 2010+0+0 (secure 0 0 0) 0x7ff7a802acd0 con 0x10aebd0 2023-10-08T15:40:38.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.971+0000 7ff7bfca1740 10 client.5541 fetch_fsmap finished waiting for FSMap version 19 2023-10-08T15:40:38.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.971+0000 7ff7bfca1740 10 client.5541 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2023-10-08T15:40:38.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.971+0000 7ff7bfca1740 20 client.5541 populate_metadata read hostname 'smithi003' 2023-10-08T15:40:38.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.971+0000 7ff7bfca1740 1 --2- 172.21.15.3:0/1067731511 >> [v2:172.21.15.3:6832/3441752211,v1:172.21.15.3:6833/3441752211] conn(0x133fac0 0x133fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:38.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.971+0000 7ff7bfca1740 4 client.5541 mds_command: new command op to 5337 tid=0[{"prefix": "cache drop"}] 2023-10-08T15:40:38.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.971+0000 7ff7bfca1740 1 -- 172.21.15.3:0/1067731511 --> [v2:172.21.15.3:6832/3441752211,v1:172.21.15.3:6833/3441752211] -- command(tid 0: {"prefix": "cache drop"}) v1 -- 0x11065d0 con 0x133fac0 2023-10-08T15:40:38.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.975+0000 7ff7b6ffd700 1 --2- 172.21.15.3:0/1067731511 >> [v2:172.21.15.3:6832/3441752211,v1:172.21.15.3:6833/3441752211] conn(0x133fac0 0x133fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:38.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.975+0000 7ff7957fa700 10 client.5541 ms_handle_connect on v2:172.21.15.3:6832/3441752211 2023-10-08T15:40:38.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:38.975+0000 7ff7b6ffd700 1 --2- 172.21.15.3:0/1067731511 >> [v2:172.21.15.3:6832/3441752211,v1:172.21.15.3:6833/3441752211] conn(0x133fac0 0x133fe90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=10e17becc3986c7a server_cookie=da713b339609e7f1 in_seq=0 out_seq=0 2023-10-08T15:40:50.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:50.195+0000 7ff7957fa700 1 -- 172.21.15.3:0/1067731511 <== mds.0 v2:172.21.15.3:6832/3441752211 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+380 (crc 0 0 0) 0x11065d0 con 0x133fac0 2023-10-08T15:40:50.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:50.195+0000 7ff7957fa700 10 client.5541 handle_command_reply: tid=0 2023-10-08T15:40:50.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:50.195+0000 7ff7bfca1740 1 client.5541 shutdown 2023-10-08T15:40:50.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:50.195+0000 7ff7bfca1740 1 -- 172.21.15.3:0/1067731511 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x10aebd0 msgr2=0x1377940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:50.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:50.195+0000 7ff7bfca1740 1 --2- 172.21.15.3:0/1067731511 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x10aebd0 0x1377940 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7ff7b8063180 tx=0x7ff7a8023070 comp rx=0 tx=0).stop 2023-10-08T15:40:50.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:50.195+0000 7ff7bfca1740 1 -- 172.21.15.3:0/1067731511 shutdown_connections 2023-10-08T15:40:50.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:50.195+0000 7ff7bfca1740 1 --2- 172.21.15.3:0/1067731511 >> [v2:172.21.15.3:6832/3441752211,v1:172.21.15.3:6833/3441752211] conn(0x133fac0 0x133fe90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:50.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:50.195+0000 7ff7bfca1740 1 --2- 172.21.15.3:0/1067731511 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x10f9880 0x133f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:50.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:50.195+0000 7ff7957fa700 0 client.5541 ms_handle_reset on v2:172.21.15.3:6832/3441752211 2023-10-08T15:40:50.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:50.195+0000 7ff7bfca1740 1 --2- 172.21.15.3:0/1067731511 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x10aebd0 0x1377940 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:50.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:50.195+0000 7ff7bfca1740 1 --2- 172.21.15.3:0/1067731511 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x10ae800 0x1377400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:50.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:50.195+0000 7ff7bfca1740 1 -- 172.21.15.3:0/1067731511 >> 172.21.15.3:0/1067731511 conn(0x10aefa0 msgr2=0x12e2950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:50.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:50.195+0000 7ff7bfca1740 1 -- 172.21.15.3:0/1067731511 shutdown_connections 2023-10-08T15:40:50.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:50.195+0000 7ff7bfca1740 1 -- 172.21.15.3:0/1067731511 wait complete. 2023-10-08T15:40:50.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:50.195+0000 7ff7bfca1740 20 client.5541 trim_cache size 0 max 16384 2023-10-08T15:40:50.200 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2023-10-08T15:40:50.201 INFO:teuthology.orchestra.run.smithi003.stdout: "client_recall": { 2023-10-08T15:40:50.201 INFO:teuthology.orchestra.run.smithi003.stdout: "return_code": 0, 2023-10-08T15:40:50.201 INFO:teuthology.orchestra.run.smithi003.stdout: "message": "(0) Success", 2023-10-08T15:40:50.201 INFO:teuthology.orchestra.run.smithi003.stdout: "recalled": 220 2023-10-08T15:40:50.201 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:40:50.201 INFO:teuthology.orchestra.run.smithi003.stdout: "flush_journal": { 2023-10-08T15:40:50.201 INFO:teuthology.orchestra.run.smithi003.stdout: "return_code": 0, 2023-10-08T15:40:50.201 INFO:teuthology.orchestra.run.smithi003.stdout: "message": "" 2023-10-08T15:40:50.201 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:40:50.201 INFO:teuthology.orchestra.run.smithi003.stdout: "trim_cache": { 2023-10-08T15:40:50.202 INFO:teuthology.orchestra.run.smithi003.stdout: "trimmed": 0 2023-10-08T15:40:50.202 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:40:50.202 INFO:teuthology.orchestra.run.smithi003.stdout: "cache": { 2023-10-08T15:40:50.202 INFO:teuthology.orchestra.run.smithi003.stdout: "pool": { 2023-10-08T15:40:50.202 INFO:teuthology.orchestra.run.smithi003.stdout: "items": 20636, 2023-10-08T15:40:50.202 INFO:teuthology.orchestra.run.smithi003.stdout: "bytes": 3168784 2023-10-08T15:40:50.202 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:40:50.202 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:40:50.202 INFO:teuthology.orchestra.run.smithi003.stdout: "duration": 11.219709992 2023-10-08T15:40:50.202 INFO:teuthology.orchestra.run.smithi003.stdout:} 2023-10-08T15:40:50.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:50.195+0000 7ff7bd9f8700 1 -- 172.21.15.3:0/3563762897 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff7a4060550 msgr2=0x7ff7a4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:50.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:50.195+0000 7ff7bd9f8700 1 --2- 172.21.15.3:0/3563762897 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff7a4060550 0x7ff7a4062a00 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac003880 tx=0x7ff7ac009040 comp rx=0 tx=0).stop 2023-10-08T15:40:50.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:50.195+0000 7ff7bd9f8700 1 -- 172.21.15.3:0/3563762897 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff7b8153fa0 msgr2=0x7ff7b814f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:50.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:50.195+0000 7ff7bd9f8700 1 --2- 172.21.15.3:0/3563762897 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff7b8153fa0 0x7ff7b814f110 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7ff7b000b6c0 tx=0x7ff7b0018000 comp rx=0 tx=0).stop 2023-10-08T15:40:50.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:50.195+0000 7ff7bd9f8700 1 -- 172.21.15.3:0/3563762897 shutdown_connections 2023-10-08T15:40:50.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:50.195+0000 7ff7bd9f8700 1 --2- 172.21.15.3:0/3563762897 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff7a4060550 0x7ff7a4062a00 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:50.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:50.195+0000 7ff7bd9f8700 1 --2- 172.21.15.3:0/3563762897 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff7b8153fa0 0x7ff7b814f110 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:50.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:50.195+0000 7ff7bd9f8700 1 --2- 172.21.15.3:0/3563762897 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff7b80bf3a0 0x7ff7b813f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:50.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:50.195+0000 7ff7bd9f8700 1 --2- 172.21.15.3:0/3563762897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7b806c830 0x7ff7b813b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:50.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:50.195+0000 7ff7bd9f8700 1 -- 172.21.15.3:0/3563762897 >> 172.21.15.3:0/3563762897 conn(0x7ff7b80c2a80 msgr2=0x7ff7b8144260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:50.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:50.195+0000 7ff7bd9f8700 1 -- 172.21.15.3:0/3563762897 shutdown_connections 2023-10-08T15:40:50.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:50.195+0000 7ff7bd9f8700 1 -- 172.21.15.3:0/3563762897 wait complete. 2023-10-08T15:40:50.215 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T15:40:50.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:50.215 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set brx.0 up 2023-10-08T15:40:50.233 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T15:40:50.233 DEBUG:teuthology.orchestra.run.smithi003:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T15:40:50.251 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T15:40:50.270 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T15:40:50.296 DEBUG:teuthology.orchestra.run.smithi098:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T15:40:50.317 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T15:40:50.338 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T15:40:50.339 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi089.front.sepia.ceph.com... 2023-10-08T15:40:50.339 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T15:40:50.339 DEBUG:teuthology.orchestra.run.smithi089:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-08T15:40:50.352 INFO:teuthology.orchestra.run.smithi089.stderr:fusermount: failed to unmount /home/ubuntu/cephtest/mnt.0: Device or resource busy 2023-10-08T15:40:50.353 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T15:40:50.354 INFO:tasks.cephfs.fuse_mount:Failed to unmount ceph-fuse on ubuntu@smithi089.front.sepia.ceph.com, aborting... 2023-10-08T15:40:50.354 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:40:50.354 DEBUG:teuthology.orchestra.run.smithi089:> sudo PATH=/usr/sbin:$PATH lsof ; ps auxf 2023-10-08T15:40:50.537 INFO:teuthology.orchestra.run.smithi089.stdout:COMMAND PID TID TASKCMD USER FD TYPE DEVICE SIZE/OFF NODE NAME 2023-10-08T15:40:50.537 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.538 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.538 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root txt REG 8,1 1620224 10711 /usr/lib/systemd/systemd 2023-10-08T15:40:50.538 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:50.538 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root mem REG 8,1 178528 12765 /usr/lib/x86_64-linux-gnu/libudev.so.1.6.17 2023-10-08T15:40:50.538 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root mem REG 8,1 1575112 10736 /usr/lib/x86_64-linux-gnu/libunistring.so.2.1.0 2023-10-08T15:40:50.538 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root mem REG 8,1 137584 8109 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.28.0 2023-10-08T15:40:50.538 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root mem REG 8,1 67912 8783 /usr/lib/x86_64-linux-gnu/libjson-c.so.4.0.0 2023-10-08T15:40:50.538 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root mem REG 8,1 34872 10626 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-10-08T15:40:50.538 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root mem REG 8,1 431472 10641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-10-08T15:40:50.538 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root DEL REG 8,1 8351 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-10-08T15:40:50.538 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root DEL REG 8,1 8794 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:50.539 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root mem REG 8,1 686160 8833 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.4 2023-10-08T15:40:50.539 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root mem REG 8,1 27064 8001 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-10-08T15:40:50.539 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.539 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root mem REG 8,1 584392 8917 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.9.0 2023-10-08T15:40:50.539 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.539 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:50.539 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root mem REG 8,1 129248 13039 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.2 2023-10-08T15:40:50.539 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root mem REG 8,1 35440 10678 /usr/lib/x86_64-linux-gnu/libip4tc.so.2.0.0 2023-10-08T15:40:50.539 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root mem REG 8,1 129096 10669 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.6 2023-10-08T15:40:50.539 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root mem REG 8,1 1168056 8360 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.2.5 2023-10-08T15:40:50.539 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root mem REG 8,1 417328 8800 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.5.0 2023-10-08T15:40:50.540 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root mem REG 8,1 202760 8017 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-10-08T15:40:50.540 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root mem REG 8,1 31120 10630 /usr/lib/x86_64-linux-gnu/libcap.so.2.32 2023-10-08T15:40:50.540 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root mem REG 8,1 351352 9401 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-10-08T15:40:50.540 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root mem REG 8,1 39088 8336 /usr/lib/x86_64-linux-gnu/libacl.so.1.1.2253 2023-10-08T15:40:50.540 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root mem REG 8,1 80736 8771 /usr/lib/x86_64-linux-gnu/libapparmor.so.1.6.1 2023-10-08T15:40:50.540 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root mem REG 8,1 112848 8859 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.5 2023-10-08T15:40:50.540 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root mem REG 8,1 133200 8347 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-10-08T15:40:50.540 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root mem REG 8,1 68320 8384 /usr/lib/x86_64-linux-gnu/libpam.so.0.84.2 2023-10-08T15:40:50.540 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root mem REG 8,1 387768 8064 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-10-08T15:40:50.540 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root mem REG 8,1 163200 8942 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-10-08T15:40:50.540 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root mem REG 8,1 133568 8867 /usr/lib/x86_64-linux-gnu/libseccomp.so.2.5.1 2023-10-08T15:40:50.540 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:50.541 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root mem REG 8,1 2454472 8914 /usr/lib/systemd/libsystemd-shared-245.so 2023-10-08T15:40:50.541 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.541 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.541 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 0u CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.541 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 1u CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.541 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 2u CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.541 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 3w CHR 1,11 0t0 12 /dev/kmsg 2023-10-08T15:40:50.541 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 4u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.541 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 5u a_inode 0,14 0 13377 [signalfd] 2023-10-08T15:40:50.541 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 6r a_inode 0,14 0 13377 inotify 2023-10-08T15:40:50.542 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 7r DIR 0,29 0 1 /sys/fs/cgroup/unified 2023-10-08T15:40:50.542 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 8u a_inode 0,14 0 13377 [timerfd] 2023-10-08T15:40:50.542 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 9u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.542 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 10r REG 0,5 0 13528 /proc/1/mountinfo 2023-10-08T15:40:50.542 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 11r a_inode 0,14 0 13377 inotify 2023-10-08T15:40:50.542 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 12r a_inode 0,14 0 13377 inotify 2023-10-08T15:40:50.542 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 13r a_inode 0,14 0 13377 inotify 2023-10-08T15:40:50.542 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 14r REG 0,5 0 4026532079 /proc/swaps 2023-10-08T15:40:50.542 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 15u netlink 0t0 13529 KOBJECT_UEVENT 2023-10-08T15:40:50.542 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 16r a_inode 0,14 0 13377 inotify 2023-10-08T15:40:50.542 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 17u a_inode 0,14 0 13377 bpf-prog 2023-10-08T15:40:50.543 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 18u a_inode 0,14 0 13377 bpf-prog 2023-10-08T15:40:50.543 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 19u unix 0xffff8f3919f44c80 0t0 13533 /run/systemd/private type=STREAM 2023-10-08T15:40:50.543 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 20u unix 0xffff8f3919f41980 0t0 13535 /run/systemd/userdb/io.systemd.DynamicUser type=STREAM 2023-10-08T15:40:50.543 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 23u a_inode 0,14 0 13377 bpf-prog 2023-10-08T15:40:50.543 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 24u a_inode 0,14 0 13377 bpf-prog 2023-10-08T15:40:50.543 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 26r CHR 10,235 0t0 413 /dev/autofs 2023-10-08T15:40:50.543 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 27u a_inode 0,14 0 13377 bpf-prog 2023-10-08T15:40:50.543 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 28u a_inode 0,14 0 13377 [timerfd] 2023-10-08T15:40:50.543 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 29u a_inode 0,14 0 13377 bpf-prog 2023-10-08T15:40:50.543 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 32u unix 0xffff8f3919f45940 0t0 13530 /run/systemd/notify type=DGRAM 2023-10-08T15:40:50.544 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 33u unix 0xffff8f3919f42640 0t0 13531 type=DGRAM 2023-10-08T15:40:50.544 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 46u unix 0xffff8f3919f42ec0 0t0 13532 type=DGRAM 2023-10-08T15:40:50.544 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 48u unix 0xffff8f3919b01dc0 0t0 17134 type=DGRAM 2023-10-08T15:40:50.544 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 49u netlink 0t0 17135 AUDIT 2023-10-08T15:40:50.544 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 52u unix 0xffff8f3919f40cc0 0t0 13574 /run/udev/control type=SEQPACKET 2023-10-08T15:40:50.544 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 53u unix 0xffff8f3919f44400 0t0 13560 /run/systemd/fsck.progress type=STREAM 2023-10-08T15:40:50.544 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 54u unix 0xffff8f3919b01100 0t0 164532 /run/systemd/journal/stdout type=STREAM 2023-10-08T15:40:50.544 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 55u a_inode 0,14 0 13377 [timerfd] 2023-10-08T15:40:50.544 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 59u unix 0xffff8f390dc272c0 0t0 163396 /run/systemd/journal/stdout type=STREAM 2023-10-08T15:40:50.544 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 61u unix 0xffff8f390f51e600 0t0 162891 /run/systemd/journal/stdout type=STREAM 2023-10-08T15:40:50.545 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 62u unix 0xffff8f390dc25d80 0t0 20000 type=STREAM 2023-10-08T15:40:50.545 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 63u unix 0xffff8f38df8caa80 0t0 145086 /run/systemd/journal/stdout type=STREAM 2023-10-08T15:40:50.545 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 64u unix 0xffff8f39151ad940 0t0 20533 /run/systemd/journal/stdout type=STREAM 2023-10-08T15:40:50.545 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 65u unix 0xffff8f391233bb80 0t0 19957 /run/systemd/journal/stdout type=STREAM 2023-10-08T15:40:50.545 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 66u unix 0xffff8f3912e80000 0t0 17276 /run/systemd/journal/stdout type=STREAM 2023-10-08T15:40:50.545 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 67u unix 0xffff8f3910a78880 0t0 21617 /run/systemd/journal/stdout type=STREAM 2023-10-08T15:40:50.545 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 68u unix 0xffff8f39120ec400 0t0 21618 /run/systemd/journal/stdout type=STREAM 2023-10-08T15:40:50.545 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 69u unix 0xffff8f39180be1c0 0t0 489 /run/systemd/journal/stdout type=STREAM 2023-10-08T15:40:50.545 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 70u unix 0xffff8f39180d2200 0t0 490 /run/systemd/journal/stdout type=STREAM 2023-10-08T15:40:50.545 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 71u unix 0xffff8f39181172c0 0t0 21704 /run/systemd/journal/stdout type=STREAM 2023-10-08T15:40:50.545 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 72u unix 0xffff8f39181a3740 0t0 21707 /run/systemd/journal/stdout type=STREAM 2023-10-08T15:40:50.546 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 73u unix 0xffff8f3916db5500 0t0 21770 /run/systemd/journal/stdout type=STREAM 2023-10-08T15:40:50.546 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 74u unix 0xffff8f3916ba1100 0t0 23200 /run/systemd/journal/stdout type=STREAM 2023-10-08T15:40:50.546 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 75u unix 0xffff8f391674c400 0t0 25811 /run/systemd/journal/stdout type=STREAM 2023-10-08T15:40:50.546 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 76u unix 0xffff8f3915c4d940 0t0 23481 /run/systemd/journal/stdout type=STREAM 2023-10-08T15:40:50.546 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 77u unix 0xffff8f39165c8cc0 0t0 23482 /run/systemd/journal/stdout type=STREAM 2023-10-08T15:40:50.546 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 78u unix 0xffff8f391650e1c0 0t0 26781 /run/systemd/journal/stdout type=STREAM 2023-10-08T15:40:50.546 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 92u unix 0xffff8f3914c0f2c0 0t0 22473 /run/systemd/journal/stdout type=STREAM 2023-10-08T15:40:50.546 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 109u unix 0xffff8f39122550c0 0t0 107950 /run/systemd/journal/stdout type=STREAM 2023-10-08T15:40:50.546 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 115u unix 0xffff8f3912255d80 0t0 165542 /run/systemd/journal/stdout type=STREAM 2023-10-08T15:40:50.546 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 116u unix 0xffff8f3919f42200 0t0 13544 /run/lvm/lvmpolld.socket type=STREAM 2023-10-08T15:40:50.547 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 117u unix 0xffff8f3919f40000 0t0 13568 /run/systemd/journal/dev-log type=DGRAM 2023-10-08T15:40:50.547 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 118u unix 0xffff8f390f519980 0t0 18225 /run/uuidd/request type=STREAM 2023-10-08T15:40:50.547 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 119r FIFO 0,13 0t0 13542 pipe 2023-10-08T15:40:50.547 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 120u unix 0xffff8f3919f40880 0t0 13546 /run/rpcbind.sock type=STREAM 2023-10-08T15:40:50.547 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 121u IPv4 17532 0t0 TCP *:sunrpc (LISTEN) 2023-10-08T15:40:50.547 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 122u IPv4 183 0t0 UDP *:sunrpc 2023-10-08T15:40:50.547 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 125u IPv6 18576 0t0 TCP *:sunrpc (LISTEN) 2023-10-08T15:40:50.547 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 126u IPv6 186 0t0 UDP *:sunrpc 2023-10-08T15:40:50.547 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 127u netlink 0t0 13567 AUDIT 2023-10-08T15:40:50.547 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 128u FIFO 0,25 0t0 354 /run/initctl 2023-10-08T15:40:50.548 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 129u unix 0xffff8f3919f46a40 0t0 14258 @ISCSIADM_ABSTRACT_NAMESPACE type=STREAM 2023-10-08T15:40:50.548 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 130u unix 0xffff8f3914c0aec0 0t0 466 /run/dbus/system_bus_socket type=STREAM 2023-10-08T15:40:50.548 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 131u unix 0xffff8f3919f472c0 0t0 13570 /run/systemd/journal/stdout type=STREAM 2023-10-08T15:40:50.548 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 132u unix 0xffff8f3919f41dc0 0t0 13572 /run/systemd/journal/socket type=DGRAM 2023-10-08T15:40:50.548 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 133u unix 0xffff8f38c72c6a40 0t0 143260 /run/docker.sock type=STREAM 2023-10-08T15:40:50.548 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 134u CHR 10,242 0t0 4 /dev/rfkill 2023-10-08T15:40:50.548 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 135u unix 0xffff8f3919f46e80 0t0 13558 /run/systemd/journal/syslog type=DGRAM 2023-10-08T15:40:50.548 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 136u FIFO 0,25 0t0 347 /run/dmeventd-server 2023-10-08T15:40:50.548 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 137u FIFO 0,25 0t0 348 /run/dmeventd-client 2023-10-08T15:40:50.548 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1 root 138u netlink 0t0 13576 KOBJECT_UEVENT 2023-10-08T15:40:50.549 INFO:teuthology.orchestra.run.smithi089.stdout:kthreadd 2 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.549 INFO:teuthology.orchestra.run.smithi089.stdout:kthreadd 2 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.549 INFO:teuthology.orchestra.run.smithi089.stdout:kthreadd 2 root txt unknown /proc/2/exe 2023-10-08T15:40:50.549 INFO:teuthology.orchestra.run.smithi089.stdout:rcu_gp 3 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.549 INFO:teuthology.orchestra.run.smithi089.stdout:rcu_gp 3 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.549 INFO:teuthology.orchestra.run.smithi089.stdout:rcu_gp 3 root txt unknown /proc/3/exe 2023-10-08T15:40:50.549 INFO:teuthology.orchestra.run.smithi089.stdout:rcu_par_g 4 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.549 INFO:teuthology.orchestra.run.smithi089.stdout:rcu_par_g 4 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.549 INFO:teuthology.orchestra.run.smithi089.stdout:rcu_par_g 4 root txt unknown /proc/4/exe 2023-10-08T15:40:50.550 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/0 5 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.550 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/0 5 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.550 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/0 5 root txt unknown /proc/5/exe 2023-10-08T15:40:50.550 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/0 6 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.550 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/0 6 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.550 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/0 6 root txt unknown /proc/6/exe 2023-10-08T15:40:50.550 INFO:teuthology.orchestra.run.smithi089.stdout:mm_percpu 8 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.550 INFO:teuthology.orchestra.run.smithi089.stdout:mm_percpu 8 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.550 INFO:teuthology.orchestra.run.smithi089.stdout:mm_percpu 8 root txt unknown /proc/8/exe 2023-10-08T15:40:50.551 INFO:teuthology.orchestra.run.smithi089.stdout:ksoftirqd 9 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.551 INFO:teuthology.orchestra.run.smithi089.stdout:ksoftirqd 9 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.551 INFO:teuthology.orchestra.run.smithi089.stdout:ksoftirqd 9 root txt unknown /proc/9/exe 2023-10-08T15:40:50.551 INFO:teuthology.orchestra.run.smithi089.stdout:rcu_sched 10 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.551 INFO:teuthology.orchestra.run.smithi089.stdout:rcu_sched 10 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.551 INFO:teuthology.orchestra.run.smithi089.stdout:rcu_sched 10 root txt unknown /proc/10/exe 2023-10-08T15:40:50.551 INFO:teuthology.orchestra.run.smithi089.stdout:migration 11 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.551 INFO:teuthology.orchestra.run.smithi089.stdout:migration 11 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.551 INFO:teuthology.orchestra.run.smithi089.stdout:migration 11 root txt unknown /proc/11/exe 2023-10-08T15:40:50.551 INFO:teuthology.orchestra.run.smithi089.stdout:idle_inje 12 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.551 INFO:teuthology.orchestra.run.smithi089.stdout:idle_inje 12 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.551 INFO:teuthology.orchestra.run.smithi089.stdout:idle_inje 12 root txt unknown /proc/12/exe 2023-10-08T15:40:50.552 INFO:teuthology.orchestra.run.smithi089.stdout:cpuhp/0 14 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.552 INFO:teuthology.orchestra.run.smithi089.stdout:cpuhp/0 14 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.552 INFO:teuthology.orchestra.run.smithi089.stdout:cpuhp/0 14 root txt unknown /proc/14/exe 2023-10-08T15:40:50.552 INFO:teuthology.orchestra.run.smithi089.stdout:cpuhp/1 15 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.552 INFO:teuthology.orchestra.run.smithi089.stdout:cpuhp/1 15 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.552 INFO:teuthology.orchestra.run.smithi089.stdout:cpuhp/1 15 root txt unknown /proc/15/exe 2023-10-08T15:40:50.552 INFO:teuthology.orchestra.run.smithi089.stdout:idle_inje 16 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.552 INFO:teuthology.orchestra.run.smithi089.stdout:idle_inje 16 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.552 INFO:teuthology.orchestra.run.smithi089.stdout:idle_inje 16 root txt unknown /proc/16/exe 2023-10-08T15:40:50.552 INFO:teuthology.orchestra.run.smithi089.stdout:migration 17 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.552 INFO:teuthology.orchestra.run.smithi089.stdout:migration 17 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.552 INFO:teuthology.orchestra.run.smithi089.stdout:migration 17 root txt unknown /proc/17/exe 2023-10-08T15:40:50.553 INFO:teuthology.orchestra.run.smithi089.stdout:ksoftirqd 18 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.553 INFO:teuthology.orchestra.run.smithi089.stdout:ksoftirqd 18 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.553 INFO:teuthology.orchestra.run.smithi089.stdout:ksoftirqd 18 root txt unknown /proc/18/exe 2023-10-08T15:40:50.553 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/1 20 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.553 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/1 20 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.553 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/1 20 root txt unknown /proc/20/exe 2023-10-08T15:40:50.553 INFO:teuthology.orchestra.run.smithi089.stdout:cpuhp/2 21 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.553 INFO:teuthology.orchestra.run.smithi089.stdout:cpuhp/2 21 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.553 INFO:teuthology.orchestra.run.smithi089.stdout:cpuhp/2 21 root txt unknown /proc/21/exe 2023-10-08T15:40:50.553 INFO:teuthology.orchestra.run.smithi089.stdout:idle_inje 22 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.553 INFO:teuthology.orchestra.run.smithi089.stdout:idle_inje 22 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.554 INFO:teuthology.orchestra.run.smithi089.stdout:idle_inje 22 root txt unknown /proc/22/exe 2023-10-08T15:40:50.554 INFO:teuthology.orchestra.run.smithi089.stdout:migration 23 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.554 INFO:teuthology.orchestra.run.smithi089.stdout:migration 23 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.554 INFO:teuthology.orchestra.run.smithi089.stdout:migration 23 root txt unknown /proc/23/exe 2023-10-08T15:40:50.554 INFO:teuthology.orchestra.run.smithi089.stdout:ksoftirqd 24 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.554 INFO:teuthology.orchestra.run.smithi089.stdout:ksoftirqd 24 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.554 INFO:teuthology.orchestra.run.smithi089.stdout:ksoftirqd 24 root txt unknown /proc/24/exe 2023-10-08T15:40:50.554 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/2 26 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.554 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/2 26 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.554 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/2 26 root txt unknown /proc/26/exe 2023-10-08T15:40:50.554 INFO:teuthology.orchestra.run.smithi089.stdout:cpuhp/3 27 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.555 INFO:teuthology.orchestra.run.smithi089.stdout:cpuhp/3 27 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.555 INFO:teuthology.orchestra.run.smithi089.stdout:cpuhp/3 27 root txt unknown /proc/27/exe 2023-10-08T15:40:50.555 INFO:teuthology.orchestra.run.smithi089.stdout:idle_inje 28 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.555 INFO:teuthology.orchestra.run.smithi089.stdout:idle_inje 28 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.555 INFO:teuthology.orchestra.run.smithi089.stdout:idle_inje 28 root txt unknown /proc/28/exe 2023-10-08T15:40:50.555 INFO:teuthology.orchestra.run.smithi089.stdout:migration 29 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.555 INFO:teuthology.orchestra.run.smithi089.stdout:migration 29 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.555 INFO:teuthology.orchestra.run.smithi089.stdout:migration 29 root txt unknown /proc/29/exe 2023-10-08T15:40:50.555 INFO:teuthology.orchestra.run.smithi089.stdout:ksoftirqd 30 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.556 INFO:teuthology.orchestra.run.smithi089.stdout:ksoftirqd 30 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.556 INFO:teuthology.orchestra.run.smithi089.stdout:ksoftirqd 30 root txt unknown /proc/30/exe 2023-10-08T15:40:50.556 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/3 32 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.556 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/3 32 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.556 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/3 32 root txt unknown /proc/32/exe 2023-10-08T15:40:50.556 INFO:teuthology.orchestra.run.smithi089.stdout:cpuhp/4 33 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.556 INFO:teuthology.orchestra.run.smithi089.stdout:cpuhp/4 33 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.556 INFO:teuthology.orchestra.run.smithi089.stdout:cpuhp/4 33 root txt unknown /proc/33/exe 2023-10-08T15:40:50.556 INFO:teuthology.orchestra.run.smithi089.stdout:idle_inje 34 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.556 INFO:teuthology.orchestra.run.smithi089.stdout:idle_inje 34 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.557 INFO:teuthology.orchestra.run.smithi089.stdout:idle_inje 34 root txt unknown /proc/34/exe 2023-10-08T15:40:50.557 INFO:teuthology.orchestra.run.smithi089.stdout:migration 35 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.557 INFO:teuthology.orchestra.run.smithi089.stdout:migration 35 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.557 INFO:teuthology.orchestra.run.smithi089.stdout:migration 35 root txt unknown /proc/35/exe 2023-10-08T15:40:50.557 INFO:teuthology.orchestra.run.smithi089.stdout:ksoftirqd 36 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.557 INFO:teuthology.orchestra.run.smithi089.stdout:ksoftirqd 36 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.557 INFO:teuthology.orchestra.run.smithi089.stdout:ksoftirqd 36 root txt unknown /proc/36/exe 2023-10-08T15:40:50.557 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/4 38 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.557 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/4 38 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.558 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/4 38 root txt unknown /proc/38/exe 2023-10-08T15:40:50.558 INFO:teuthology.orchestra.run.smithi089.stdout:cpuhp/5 39 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.558 INFO:teuthology.orchestra.run.smithi089.stdout:cpuhp/5 39 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.558 INFO:teuthology.orchestra.run.smithi089.stdout:cpuhp/5 39 root txt unknown /proc/39/exe 2023-10-08T15:40:50.558 INFO:teuthology.orchestra.run.smithi089.stdout:idle_inje 40 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.558 INFO:teuthology.orchestra.run.smithi089.stdout:idle_inje 40 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.558 INFO:teuthology.orchestra.run.smithi089.stdout:idle_inje 40 root txt unknown /proc/40/exe 2023-10-08T15:40:50.558 INFO:teuthology.orchestra.run.smithi089.stdout:migration 41 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.559 INFO:teuthology.orchestra.run.smithi089.stdout:migration 41 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.559 INFO:teuthology.orchestra.run.smithi089.stdout:migration 41 root txt unknown /proc/41/exe 2023-10-08T15:40:50.559 INFO:teuthology.orchestra.run.smithi089.stdout:ksoftirqd 42 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.559 INFO:teuthology.orchestra.run.smithi089.stdout:ksoftirqd 42 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.559 INFO:teuthology.orchestra.run.smithi089.stdout:ksoftirqd 42 root txt unknown /proc/42/exe 2023-10-08T15:40:50.559 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/5 44 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.559 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/5 44 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.559 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/5 44 root txt unknown /proc/44/exe 2023-10-08T15:40:50.559 INFO:teuthology.orchestra.run.smithi089.stdout:cpuhp/6 45 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.559 INFO:teuthology.orchestra.run.smithi089.stdout:cpuhp/6 45 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.560 INFO:teuthology.orchestra.run.smithi089.stdout:cpuhp/6 45 root txt unknown /proc/45/exe 2023-10-08T15:40:50.560 INFO:teuthology.orchestra.run.smithi089.stdout:idle_inje 46 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.560 INFO:teuthology.orchestra.run.smithi089.stdout:idle_inje 46 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.560 INFO:teuthology.orchestra.run.smithi089.stdout:idle_inje 46 root txt unknown /proc/46/exe 2023-10-08T15:40:50.560 INFO:teuthology.orchestra.run.smithi089.stdout:migration 47 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.560 INFO:teuthology.orchestra.run.smithi089.stdout:migration 47 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.560 INFO:teuthology.orchestra.run.smithi089.stdout:migration 47 root txt unknown /proc/47/exe 2023-10-08T15:40:50.560 INFO:teuthology.orchestra.run.smithi089.stdout:ksoftirqd 48 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.560 INFO:teuthology.orchestra.run.smithi089.stdout:ksoftirqd 48 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.561 INFO:teuthology.orchestra.run.smithi089.stdout:ksoftirqd 48 root txt unknown /proc/48/exe 2023-10-08T15:40:50.561 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/6 50 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.561 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/6 50 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.561 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/6 50 root txt unknown /proc/50/exe 2023-10-08T15:40:50.561 INFO:teuthology.orchestra.run.smithi089.stdout:cpuhp/7 51 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.561 INFO:teuthology.orchestra.run.smithi089.stdout:cpuhp/7 51 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.561 INFO:teuthology.orchestra.run.smithi089.stdout:cpuhp/7 51 root txt unknown /proc/51/exe 2023-10-08T15:40:50.561 INFO:teuthology.orchestra.run.smithi089.stdout:idle_inje 52 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.562 INFO:teuthology.orchestra.run.smithi089.stdout:idle_inje 52 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.562 INFO:teuthology.orchestra.run.smithi089.stdout:idle_inje 52 root txt unknown /proc/52/exe 2023-10-08T15:40:50.562 INFO:teuthology.orchestra.run.smithi089.stdout:migration 53 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.562 INFO:teuthology.orchestra.run.smithi089.stdout:migration 53 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.562 INFO:teuthology.orchestra.run.smithi089.stdout:migration 53 root txt unknown /proc/53/exe 2023-10-08T15:40:50.562 INFO:teuthology.orchestra.run.smithi089.stdout:ksoftirqd 54 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.562 INFO:teuthology.orchestra.run.smithi089.stdout:ksoftirqd 54 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.562 INFO:teuthology.orchestra.run.smithi089.stdout:ksoftirqd 54 root txt unknown /proc/54/exe 2023-10-08T15:40:50.563 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/7 56 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.563 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/7 56 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.563 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/7 56 root txt unknown /proc/56/exe 2023-10-08T15:40:50.563 INFO:teuthology.orchestra.run.smithi089.stdout:kdevtmpfs 57 root cwd DIR 0,6 4240 2 / 2023-10-08T15:40:50.563 INFO:teuthology.orchestra.run.smithi089.stdout:kdevtmpfs 57 root rtd DIR 0,6 4240 2 / 2023-10-08T15:40:50.563 INFO:teuthology.orchestra.run.smithi089.stdout:kdevtmpfs 57 root txt unknown /proc/57/exe 2023-10-08T15:40:50.563 INFO:teuthology.orchestra.run.smithi089.stdout:netns 58 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.563 INFO:teuthology.orchestra.run.smithi089.stdout:netns 58 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.563 INFO:teuthology.orchestra.run.smithi089.stdout:netns 58 root txt unknown /proc/58/exe 2023-10-08T15:40:50.564 INFO:teuthology.orchestra.run.smithi089.stdout:rcu_tasks 59 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.564 INFO:teuthology.orchestra.run.smithi089.stdout:rcu_tasks 59 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.564 INFO:teuthology.orchestra.run.smithi089.stdout:rcu_tasks 59 root txt unknown /proc/59/exe 2023-10-08T15:40:50.564 INFO:teuthology.orchestra.run.smithi089.stdout:kauditd 60 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.564 INFO:teuthology.orchestra.run.smithi089.stdout:kauditd 60 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.564 INFO:teuthology.orchestra.run.smithi089.stdout:kauditd 60 root txt unknown /proc/60/exe 2023-10-08T15:40:50.564 INFO:teuthology.orchestra.run.smithi089.stdout:khungtask 63 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.564 INFO:teuthology.orchestra.run.smithi089.stdout:khungtask 63 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.564 INFO:teuthology.orchestra.run.smithi089.stdout:khungtask 63 root txt unknown /proc/63/exe 2023-10-08T15:40:50.565 INFO:teuthology.orchestra.run.smithi089.stdout:oom_reape 64 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.565 INFO:teuthology.orchestra.run.smithi089.stdout:oom_reape 64 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.565 INFO:teuthology.orchestra.run.smithi089.stdout:oom_reape 64 root txt unknown /proc/64/exe 2023-10-08T15:40:50.565 INFO:teuthology.orchestra.run.smithi089.stdout:writeback 65 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.565 INFO:teuthology.orchestra.run.smithi089.stdout:writeback 65 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.565 INFO:teuthology.orchestra.run.smithi089.stdout:writeback 65 root txt unknown /proc/65/exe 2023-10-08T15:40:50.565 INFO:teuthology.orchestra.run.smithi089.stdout:kcompactd 66 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.565 INFO:teuthology.orchestra.run.smithi089.stdout:kcompactd 66 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.566 INFO:teuthology.orchestra.run.smithi089.stdout:kcompactd 66 root txt unknown /proc/66/exe 2023-10-08T15:40:50.566 INFO:teuthology.orchestra.run.smithi089.stdout:ksmd 67 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.566 INFO:teuthology.orchestra.run.smithi089.stdout:ksmd 67 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.566 INFO:teuthology.orchestra.run.smithi089.stdout:ksmd 67 root txt unknown /proc/67/exe 2023-10-08T15:40:50.566 INFO:teuthology.orchestra.run.smithi089.stdout:khugepage 68 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.566 INFO:teuthology.orchestra.run.smithi089.stdout:khugepage 68 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.566 INFO:teuthology.orchestra.run.smithi089.stdout:khugepage 68 root txt unknown /proc/68/exe 2023-10-08T15:40:50.566 INFO:teuthology.orchestra.run.smithi089.stdout:kintegrit 114 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.567 INFO:teuthology.orchestra.run.smithi089.stdout:kintegrit 114 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.567 INFO:teuthology.orchestra.run.smithi089.stdout:kintegrit 114 root txt unknown /proc/114/exe 2023-10-08T15:40:50.567 INFO:teuthology.orchestra.run.smithi089.stdout:kblockd 115 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.567 INFO:teuthology.orchestra.run.smithi089.stdout:kblockd 115 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.567 INFO:teuthology.orchestra.run.smithi089.stdout:kblockd 115 root txt unknown /proc/115/exe 2023-10-08T15:40:50.567 INFO:teuthology.orchestra.run.smithi089.stdout:blkcg_pun 116 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.567 INFO:teuthology.orchestra.run.smithi089.stdout:blkcg_pun 116 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.567 INFO:teuthology.orchestra.run.smithi089.stdout:blkcg_pun 116 root txt unknown /proc/116/exe 2023-10-08T15:40:50.568 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/0 117 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.568 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/0 117 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.568 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/0 117 root txt unknown /proc/117/exe 2023-10-08T15:40:50.568 INFO:teuthology.orchestra.run.smithi089.stdout:tpm_dev_w 123 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.568 INFO:teuthology.orchestra.run.smithi089.stdout:tpm_dev_w 123 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.568 INFO:teuthology.orchestra.run.smithi089.stdout:tpm_dev_w 123 root txt unknown /proc/123/exe 2023-10-08T15:40:50.568 INFO:teuthology.orchestra.run.smithi089.stdout:ata_sff 124 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.568 INFO:teuthology.orchestra.run.smithi089.stdout:ata_sff 124 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.568 INFO:teuthology.orchestra.run.smithi089.stdout:ata_sff 124 root txt unknown /proc/124/exe 2023-10-08T15:40:50.568 INFO:teuthology.orchestra.run.smithi089.stdout:md 125 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.568 INFO:teuthology.orchestra.run.smithi089.stdout:md 125 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.569 INFO:teuthology.orchestra.run.smithi089.stdout:md 125 root txt unknown /proc/125/exe 2023-10-08T15:40:50.569 INFO:teuthology.orchestra.run.smithi089.stdout:edac-poll 126 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.569 INFO:teuthology.orchestra.run.smithi089.stdout:edac-poll 126 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.569 INFO:teuthology.orchestra.run.smithi089.stdout:edac-poll 126 root txt unknown /proc/126/exe 2023-10-08T15:40:50.569 INFO:teuthology.orchestra.run.smithi089.stdout:devfreq_w 127 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.569 INFO:teuthology.orchestra.run.smithi089.stdout:devfreq_w 127 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.569 INFO:teuthology.orchestra.run.smithi089.stdout:devfreq_w 127 root txt unknown /proc/127/exe 2023-10-08T15:40:50.569 INFO:teuthology.orchestra.run.smithi089.stdout:watchdogd 128 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.569 INFO:teuthology.orchestra.run.smithi089.stdout:watchdogd 128 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.569 INFO:teuthology.orchestra.run.smithi089.stdout:watchdogd 128 root txt unknown /proc/128/exe 2023-10-08T15:40:50.569 INFO:teuthology.orchestra.run.smithi089.stdout:kswapd0 131 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.569 INFO:teuthology.orchestra.run.smithi089.stdout:kswapd0 131 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.570 INFO:teuthology.orchestra.run.smithi089.stdout:kswapd0 131 root txt unknown /proc/131/exe 2023-10-08T15:40:50.570 INFO:teuthology.orchestra.run.smithi089.stdout:ecryptfs- 132 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.570 INFO:teuthology.orchestra.run.smithi089.stdout:ecryptfs- 132 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.570 INFO:teuthology.orchestra.run.smithi089.stdout:ecryptfs- 132 root txt unknown /proc/132/exe 2023-10-08T15:40:50.570 INFO:teuthology.orchestra.run.smithi089.stdout:kthrotld 134 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.570 INFO:teuthology.orchestra.run.smithi089.stdout:kthrotld 134 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.570 INFO:teuthology.orchestra.run.smithi089.stdout:kthrotld 134 root txt unknown /proc/134/exe 2023-10-08T15:40:50.570 INFO:teuthology.orchestra.run.smithi089.stdout:acpi_ther 135 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.570 INFO:teuthology.orchestra.run.smithi089.stdout:acpi_ther 135 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.570 INFO:teuthology.orchestra.run.smithi089.stdout:acpi_ther 135 root txt unknown /proc/135/exe 2023-10-08T15:40:50.571 INFO:teuthology.orchestra.run.smithi089.stdout:vfio-irqf 136 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.571 INFO:teuthology.orchestra.run.smithi089.stdout:vfio-irqf 136 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.571 INFO:teuthology.orchestra.run.smithi089.stdout:vfio-irqf 136 root txt unknown /proc/136/exe 2023-10-08T15:40:50.571 INFO:teuthology.orchestra.run.smithi089.stdout:ipv6_addr 140 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.571 INFO:teuthology.orchestra.run.smithi089.stdout:ipv6_addr 140 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.571 INFO:teuthology.orchestra.run.smithi089.stdout:ipv6_addr 140 root txt unknown /proc/140/exe 2023-10-08T15:40:50.571 INFO:teuthology.orchestra.run.smithi089.stdout:kstrp 149 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.571 INFO:teuthology.orchestra.run.smithi089.stdout:kstrp 149 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.571 INFO:teuthology.orchestra.run.smithi089.stdout:kstrp 149 root txt unknown /proc/149/exe 2023-10-08T15:40:50.571 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/u 152 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.571 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/u 152 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.572 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/u 152 root txt unknown /proc/152/exe 2023-10-08T15:40:50.572 INFO:teuthology.orchestra.run.smithi089.stdout:charger_m 165 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.572 INFO:teuthology.orchestra.run.smithi089.stdout:charger_m 165 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.572 INFO:teuthology.orchestra.run.smithi089.stdout:charger_m 165 root txt unknown /proc/165/exe 2023-10-08T15:40:50.572 INFO:teuthology.orchestra.run.smithi089.stdout:nvme-wq 221 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.572 INFO:teuthology.orchestra.run.smithi089.stdout:nvme-wq 221 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.572 INFO:teuthology.orchestra.run.smithi089.stdout:nvme-wq 221 root txt unknown /proc/221/exe 2023-10-08T15:40:50.572 INFO:teuthology.orchestra.run.smithi089.stdout:nvme-rese 222 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.572 INFO:teuthology.orchestra.run.smithi089.stdout:nvme-rese 222 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.572 INFO:teuthology.orchestra.run.smithi089.stdout:nvme-rese 222 root txt unknown /proc/222/exe 2023-10-08T15:40:50.572 INFO:teuthology.orchestra.run.smithi089.stdout:nvme-dele 223 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.573 INFO:teuthology.orchestra.run.smithi089.stdout:nvme-dele 223 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.573 INFO:teuthology.orchestra.run.smithi089.stdout:nvme-dele 223 root txt unknown /proc/223/exe 2023-10-08T15:40:50.573 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/2 224 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.573 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/2 224 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.573 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/2 224 root txt unknown /proc/224/exe 2023-10-08T15:40:50.573 INFO:teuthology.orchestra.run.smithi089.stdout:ixgbe 228 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.573 INFO:teuthology.orchestra.run.smithi089.stdout:ixgbe 228 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.573 INFO:teuthology.orchestra.run.smithi089.stdout:ixgbe 228 root txt unknown /proc/228/exe 2023-10-08T15:40:50.573 INFO:teuthology.orchestra.run.smithi089.stdout:scsi_eh_0 230 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.573 INFO:teuthology.orchestra.run.smithi089.stdout:scsi_eh_0 230 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.574 INFO:teuthology.orchestra.run.smithi089.stdout:scsi_eh_0 230 root txt unknown /proc/230/exe 2023-10-08T15:40:50.574 INFO:teuthology.orchestra.run.smithi089.stdout:scsi_tmf_ 231 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.574 INFO:teuthology.orchestra.run.smithi089.stdout:scsi_tmf_ 231 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.574 INFO:teuthology.orchestra.run.smithi089.stdout:scsi_tmf_ 231 root txt unknown /proc/231/exe 2023-10-08T15:40:50.574 INFO:teuthology.orchestra.run.smithi089.stdout:scsi_eh_1 232 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.574 INFO:teuthology.orchestra.run.smithi089.stdout:scsi_eh_1 232 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.574 INFO:teuthology.orchestra.run.smithi089.stdout:scsi_eh_1 232 root txt unknown /proc/232/exe 2023-10-08T15:40:50.574 INFO:teuthology.orchestra.run.smithi089.stdout:scsi_tmf_ 233 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.574 INFO:teuthology.orchestra.run.smithi089.stdout:scsi_tmf_ 233 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.574 INFO:teuthology.orchestra.run.smithi089.stdout:scsi_tmf_ 233 root txt unknown /proc/233/exe 2023-10-08T15:40:50.574 INFO:teuthology.orchestra.run.smithi089.stdout:scsi_eh_2 234 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.574 INFO:teuthology.orchestra.run.smithi089.stdout:scsi_eh_2 234 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.575 INFO:teuthology.orchestra.run.smithi089.stdout:scsi_eh_2 234 root txt unknown /proc/234/exe 2023-10-08T15:40:50.575 INFO:teuthology.orchestra.run.smithi089.stdout:scsi_tmf_ 235 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.575 INFO:teuthology.orchestra.run.smithi089.stdout:scsi_tmf_ 235 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.575 INFO:teuthology.orchestra.run.smithi089.stdout:scsi_tmf_ 235 root txt unknown /proc/235/exe 2023-10-08T15:40:50.575 INFO:teuthology.orchestra.run.smithi089.stdout:scsi_eh_3 236 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.575 INFO:teuthology.orchestra.run.smithi089.stdout:scsi_eh_3 236 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.575 INFO:teuthology.orchestra.run.smithi089.stdout:scsi_eh_3 236 root txt unknown /proc/236/exe 2023-10-08T15:40:50.575 INFO:teuthology.orchestra.run.smithi089.stdout:scsi_tmf_ 237 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.575 INFO:teuthology.orchestra.run.smithi089.stdout:scsi_tmf_ 237 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.575 INFO:teuthology.orchestra.run.smithi089.stdout:scsi_tmf_ 237 root txt unknown /proc/237/exe 2023-10-08T15:40:50.576 INFO:teuthology.orchestra.run.smithi089.stdout:scsi_eh_4 242 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.576 INFO:teuthology.orchestra.run.smithi089.stdout:scsi_eh_4 242 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.576 INFO:teuthology.orchestra.run.smithi089.stdout:scsi_eh_4 242 root txt unknown /proc/242/exe 2023-10-08T15:40:50.576 INFO:teuthology.orchestra.run.smithi089.stdout:scsi_tmf_ 243 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.576 INFO:teuthology.orchestra.run.smithi089.stdout:scsi_tmf_ 243 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.576 INFO:teuthology.orchestra.run.smithi089.stdout:scsi_tmf_ 243 root txt unknown /proc/243/exe 2023-10-08T15:40:50.576 INFO:teuthology.orchestra.run.smithi089.stdout:scsi_eh_5 244 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.576 INFO:teuthology.orchestra.run.smithi089.stdout:scsi_eh_5 244 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.576 INFO:teuthology.orchestra.run.smithi089.stdout:scsi_eh_5 244 root txt unknown /proc/244/exe 2023-10-08T15:40:50.576 INFO:teuthology.orchestra.run.smithi089.stdout:scsi_tmf_ 245 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.576 INFO:teuthology.orchestra.run.smithi089.stdout:scsi_tmf_ 245 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.577 INFO:teuthology.orchestra.run.smithi089.stdout:scsi_tmf_ 245 root txt unknown /proc/245/exe 2023-10-08T15:40:50.577 INFO:teuthology.orchestra.run.smithi089.stdout:scsi_eh_6 246 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.577 INFO:teuthology.orchestra.run.smithi089.stdout:scsi_eh_6 246 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.577 INFO:teuthology.orchestra.run.smithi089.stdout:scsi_eh_6 246 root txt unknown /proc/246/exe 2023-10-08T15:40:50.577 INFO:teuthology.orchestra.run.smithi089.stdout:scsi_tmf_ 247 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.577 INFO:teuthology.orchestra.run.smithi089.stdout:scsi_tmf_ 247 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.577 INFO:teuthology.orchestra.run.smithi089.stdout:scsi_tmf_ 247 root txt unknown /proc/247/exe 2023-10-08T15:40:50.577 INFO:teuthology.orchestra.run.smithi089.stdout:scsi_eh_7 248 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.577 INFO:teuthology.orchestra.run.smithi089.stdout:scsi_eh_7 248 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.577 INFO:teuthology.orchestra.run.smithi089.stdout:scsi_eh_7 248 root txt unknown /proc/248/exe 2023-10-08T15:40:50.577 INFO:teuthology.orchestra.run.smithi089.stdout:scsi_tmf_ 249 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.578 INFO:teuthology.orchestra.run.smithi089.stdout:scsi_tmf_ 249 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.578 INFO:teuthology.orchestra.run.smithi089.stdout:scsi_tmf_ 249 root txt unknown /proc/249/exe 2023-10-08T15:40:50.578 INFO:teuthology.orchestra.run.smithi089.stdout:scsi_eh_8 250 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.578 INFO:teuthology.orchestra.run.smithi089.stdout:scsi_eh_8 250 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.578 INFO:teuthology.orchestra.run.smithi089.stdout:scsi_eh_8 250 root txt unknown /proc/250/exe 2023-10-08T15:40:50.578 INFO:teuthology.orchestra.run.smithi089.stdout:scsi_tmf_ 251 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.578 INFO:teuthology.orchestra.run.smithi089.stdout:scsi_tmf_ 251 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.578 INFO:teuthology.orchestra.run.smithi089.stdout:scsi_tmf_ 251 root txt unknown /proc/251/exe 2023-10-08T15:40:50.578 INFO:teuthology.orchestra.run.smithi089.stdout:scsi_eh_9 252 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.579 INFO:teuthology.orchestra.run.smithi089.stdout:scsi_eh_9 252 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.579 INFO:teuthology.orchestra.run.smithi089.stdout:scsi_eh_9 252 root txt unknown /proc/252/exe 2023-10-08T15:40:50.579 INFO:teuthology.orchestra.run.smithi089.stdout:scsi_tmf_ 253 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.579 INFO:teuthology.orchestra.run.smithi089.stdout:scsi_tmf_ 253 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.579 INFO:teuthology.orchestra.run.smithi089.stdout:scsi_tmf_ 253 root txt unknown /proc/253/exe 2023-10-08T15:40:50.579 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/u 255 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.579 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/u 255 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.579 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/u 255 root txt unknown /proc/255/exe 2023-10-08T15:40:50.579 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/u 256 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.579 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/u 256 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.580 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/u 256 root txt unknown /proc/256/exe 2023-10-08T15:40:50.580 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/4 258 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.580 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/4 258 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.580 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/4 258 root txt unknown /proc/258/exe 2023-10-08T15:40:50.580 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/5 305 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.580 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/5 305 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.580 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/5 305 root txt unknown /proc/305/exe 2023-10-08T15:40:50.580 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/6 307 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.580 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/6 307 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.581 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/6 307 root txt unknown /proc/307/exe 2023-10-08T15:40:50.581 INFO:teuthology.orchestra.run.smithi089.stdout:jbd2/sda1 308 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.581 INFO:teuthology.orchestra.run.smithi089.stdout:jbd2/sda1 308 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.581 INFO:teuthology.orchestra.run.smithi089.stdout:jbd2/sda1 308 root txt unknown /proc/308/exe 2023-10-08T15:40:50.581 INFO:teuthology.orchestra.run.smithi089.stdout:ext4-rsv- 309 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.581 INFO:teuthology.orchestra.run.smithi089.stdout:ext4-rsv- 309 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.581 INFO:teuthology.orchestra.run.smithi089.stdout:ext4-rsv- 309 root txt unknown /proc/309/exe 2023-10-08T15:40:50.581 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/1 310 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.581 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/1 310 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.582 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/1 310 root txt unknown /proc/310/exe 2023-10-08T15:40:50.582 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/3 322 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.582 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/3 322 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.582 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/3 322 root txt unknown /proc/322/exe 2023-10-08T15:40:50.582 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/7 327 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.582 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/7 327 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.582 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/7 327 root txt unknown /proc/327/exe 2023-10-08T15:40:50.582 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/0 344 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.582 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/0 344 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.583 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/0 344 root txt unknown /proc/344/exe 2023-10-08T15:40:50.583 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/2 358 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.583 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/2 358 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.583 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/2 358 root txt unknown /proc/358/exe 2023-10-08T15:40:50.583 INFO:teuthology.orchestra.run.smithi089.stdout:rpciod 360 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.583 INFO:teuthology.orchestra.run.smithi089.stdout:rpciod 360 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.583 INFO:teuthology.orchestra.run.smithi089.stdout:rpciod 360 root txt unknown /proc/360/exe 2023-10-08T15:40:50.583 INFO:teuthology.orchestra.run.smithi089.stdout:xprtiod 361 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.583 INFO:teuthology.orchestra.run.smithi089.stdout:xprtiod 361 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.584 INFO:teuthology.orchestra.run.smithi089.stdout:xprtiod 361 root txt unknown /proc/361/exe 2023-10-08T15:40:50.584 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.584 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.584 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root txt REG 8,1 162032 10860 /usr/lib/systemd/systemd-journald 2023-10-08T15:40:50.584 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root mem REG 8,1 16777216 1048577 /var/log/journal/a3be24a71451430bbe7befa8e4390c43/system.journal 2023-10-08T15:40:50.584 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root mem REG 8,1 8388608 1645 /var/log/journal/a3be24a71451430bbe7befa8e4390c43/user-1000.journal 2023-10-08T15:40:50.584 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root mem REG 8,1 27064 8001 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-10-08T15:40:50.584 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:50.584 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root mem REG 8,1 178528 12765 /usr/lib/x86_64-linux-gnu/libudev.so.1.6.17 2023-10-08T15:40:50.585 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root mem REG 8,1 133200 8347 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-10-08T15:40:50.585 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root mem REG 8,1 686160 8833 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.4 2023-10-08T15:40:50.585 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root mem REG 8,1 1575112 10736 /usr/lib/x86_64-linux-gnu/libunistring.so.2.1.0 2023-10-08T15:40:50.585 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root mem REG 8,1 137584 8109 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.28.0 2023-10-08T15:40:50.585 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root mem REG 8,1 67912 8783 /usr/lib/x86_64-linux-gnu/libjson-c.so.4.0.0 2023-10-08T15:40:50.585 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root mem REG 8,1 34872 10626 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-10-08T15:40:50.585 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root DEL REG 8,1 8794 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:50.585 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root mem REG 8,1 431472 10641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-10-08T15:40:50.585 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root DEL REG 8,1 8351 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-10-08T15:40:50.586 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.586 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root mem REG 8,1 584392 8917 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.9.0 2023-10-08T15:40:50.586 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.586 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:50.586 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root mem REG 8,1 133568 8867 /usr/lib/x86_64-linux-gnu/libseccomp.so.2.5.1 2023-10-08T15:40:50.586 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:50.586 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root mem REG 8,1 68320 8384 /usr/lib/x86_64-linux-gnu/libpam.so.0.84.2 2023-10-08T15:40:50.586 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root mem REG 8,1 387768 8064 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-10-08T15:40:50.586 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root mem REG 8,1 129248 13039 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.2 2023-10-08T15:40:50.587 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root mem REG 8,1 112848 8859 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.5 2023-10-08T15:40:50.587 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root mem REG 8,1 35440 10678 /usr/lib/x86_64-linux-gnu/libip4tc.so.2.0.0 2023-10-08T15:40:50.587 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root mem REG 8,1 129096 10669 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.6 2023-10-08T15:40:50.587 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root mem REG 8,1 1168056 8360 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.2.5 2023-10-08T15:40:50.587 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root mem REG 8,1 417328 8800 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.5.0 2023-10-08T15:40:50.587 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root mem REG 8,1 202760 8017 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-10-08T15:40:50.587 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root mem REG 8,1 31120 10630 /usr/lib/x86_64-linux-gnu/libcap.so.2.32 2023-10-08T15:40:50.587 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root mem REG 8,1 351352 9401 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-10-08T15:40:50.587 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root mem REG 8,1 39088 8336 /usr/lib/x86_64-linux-gnu/libacl.so.1.1.2253 2023-10-08T15:40:50.588 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root mem REG 8,1 163200 8942 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-10-08T15:40:50.588 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root mem REG 8,1 2454472 8914 /usr/lib/systemd/libsystemd-shared-245.so 2023-10-08T15:40:50.588 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.588 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.588 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root mem REG 0,25 8 369 /run/systemd/journal/kernel-seqnum 2023-10-08T15:40:50.588 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.588 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root 1w CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.588 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root 2w CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.588 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root 3u unix 0xffff8f3919f472c0 0t0 13570 /run/systemd/journal/stdout type=STREAM 2023-10-08T15:40:50.588 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root 4u unix 0xffff8f3919f41dc0 0t0 13572 /run/systemd/journal/socket type=DGRAM 2023-10-08T15:40:50.589 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root 5u unix 0xffff8f3919f40000 0t0 13568 /run/systemd/journal/dev-log type=DGRAM 2023-10-08T15:40:50.589 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root 6u netlink 0t0 13567 AUDIT 2023-10-08T15:40:50.589 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root 7w CHR 1,11 0t0 12 /dev/kmsg 2023-10-08T15:40:50.589 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root 8u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.589 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root 9u CHR 1,11 0t0 12 /dev/kmsg 2023-10-08T15:40:50.589 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root 10u unix 0xffff8f3914c0d940 0t0 301 /run/systemd/journal/io.systemd.journal type=STREAM 2023-10-08T15:40:50.589 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root 11r REG 0,5 0 302 /proc/sys/kernel/hostname 2023-10-08T15:40:50.589 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root 12u a_inode 0,14 0 13377 [signalfd] 2023-10-08T15:40:50.590 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root 13u a_inode 0,14 0 13377 [signalfd] 2023-10-08T15:40:50.590 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root 14u a_inode 0,14 0 13377 [signalfd] 2023-10-08T15:40:50.590 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root 15u unix 0xffff8f39197abfc0 0t0 303 type=DGRAM 2023-10-08T15:40:50.590 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root 16u unix 0xffff8f38df8caa80 0t0 145086 /run/systemd/journal/stdout type=STREAM 2023-10-08T15:40:50.590 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root 17u a_inode 0,14 0 13377 [timerfd] 2023-10-08T15:40:50.590 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root 18u unix 0xffff8f3912e80000 0t0 17276 /run/systemd/journal/stdout type=STREAM 2023-10-08T15:40:50.590 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root 19u unix 0xffff8f3910a78880 0t0 21617 /run/systemd/journal/stdout type=STREAM 2023-10-08T15:40:50.590 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root 20u unix 0xffff8f39151ad940 0t0 20533 /run/systemd/journal/stdout type=STREAM 2023-10-08T15:40:50.591 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root 21u REG 8,1 16777216 1048577 /var/log/journal/a3be24a71451430bbe7befa8e4390c43/system.journal 2023-10-08T15:40:50.591 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root 22u unix 0xffff8f391233bb80 0t0 19957 /run/systemd/journal/stdout type=STREAM 2023-10-08T15:40:50.591 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root 23u unix 0xffff8f39120ec400 0t0 21618 /run/systemd/journal/stdout type=STREAM 2023-10-08T15:40:50.591 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root 24u unix 0xffff8f3916db5500 0t0 21770 /run/systemd/journal/stdout type=STREAM 2023-10-08T15:40:50.591 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root 25u unix 0xffff8f39180be1c0 0t0 489 /run/systemd/journal/stdout type=STREAM 2023-10-08T15:40:50.591 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root 26u unix 0xffff8f39180d2200 0t0 490 /run/systemd/journal/stdout type=STREAM 2023-10-08T15:40:50.591 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root 27u unix 0xffff8f3914c0f2c0 0t0 22473 /run/systemd/journal/stdout type=STREAM 2023-10-08T15:40:50.591 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root 28u unix 0xffff8f39181172c0 0t0 21704 /run/systemd/journal/stdout type=STREAM 2023-10-08T15:40:50.591 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root 29u unix 0xffff8f39181a3740 0t0 21707 /run/systemd/journal/stdout type=STREAM 2023-10-08T15:40:50.591 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root 30u unix 0xffff8f391650e1c0 0t0 26781 /run/systemd/journal/stdout type=STREAM 2023-10-08T15:40:50.592 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root 31u unix 0xffff8f3916ba1100 0t0 23200 /run/systemd/journal/stdout type=STREAM 2023-10-08T15:40:50.592 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root 32u REG 8,1 8388608 1645 /var/log/journal/a3be24a71451430bbe7befa8e4390c43/user-1000.journal 2023-10-08T15:40:50.592 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root 33u unix 0xffff8f391674c400 0t0 25811 /run/systemd/journal/stdout type=STREAM 2023-10-08T15:40:50.592 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root 34u unix 0xffff8f39122550c0 0t0 107950 /run/systemd/journal/stdout type=STREAM 2023-10-08T15:40:50.592 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root 35u unix 0xffff8f3915c4d940 0t0 23481 /run/systemd/journal/stdout type=STREAM 2023-10-08T15:40:50.592 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root 36u unix 0xffff8f39165c8cc0 0t0 23482 /run/systemd/journal/stdout type=STREAM 2023-10-08T15:40:50.592 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root 37u unix 0xffff8f390f51e600 0t0 162891 /run/systemd/journal/stdout type=STREAM 2023-10-08T15:40:50.592 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root 38u unix 0xffff8f3912255d80 0t0 165542 /run/systemd/journal/stdout type=STREAM 2023-10-08T15:40:50.592 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root 39u unix 0xffff8f390dc272c0 0t0 163396 /run/systemd/journal/stdout type=STREAM 2023-10-08T15:40:50.592 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-j 363 root 42u unix 0xffff8f3919b01100 0t0 164532 /run/systemd/journal/stdout type=STREAM 2023-10-08T15:40:50.593 INFO:teuthology.orchestra.run.smithi089.stdout:ext4lazyi 377 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.593 INFO:teuthology.orchestra.run.smithi089.stdout:ext4lazyi 377 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.593 INFO:teuthology.orchestra.run.smithi089.stdout:ext4lazyi 377 root txt unknown /proc/377/exe 2023-10-08T15:40:50.593 INFO:teuthology.orchestra.run.smithi089.stdout:iscsi_eh 382 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.593 INFO:teuthology.orchestra.run.smithi089.stdout:iscsi_eh 382 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.593 INFO:teuthology.orchestra.run.smithi089.stdout:iscsi_eh 382 root txt unknown /proc/382/exe 2023-10-08T15:40:50.593 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/7 383 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.593 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/7 383 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.593 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/7 383 root txt unknown /proc/383/exe 2023-10-08T15:40:50.593 INFO:teuthology.orchestra.run.smithi089.stdout:blkmapd 389 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.594 INFO:teuthology.orchestra.run.smithi089.stdout:blkmapd 389 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.594 INFO:teuthology.orchestra.run.smithi089.stdout:blkmapd 389 root txt REG 8,1 34968 20847 /usr/sbin/blkmapd 2023-10-08T15:40:50.594 INFO:teuthology.orchestra.run.smithi089.stdout:blkmapd 389 root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.594 INFO:teuthology.orchestra.run.smithi089.stdout:blkmapd 389 root mem REG 8,1 584392 8917 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.9.0 2023-10-08T15:40:50.594 INFO:teuthology.orchestra.run.smithi089.stdout:blkmapd 389 root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.594 INFO:teuthology.orchestra.run.smithi089.stdout:blkmapd 389 root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:50.594 INFO:teuthology.orchestra.run.smithi089.stdout:blkmapd 389 root mem REG 8,1 178528 12765 /usr/lib/x86_64-linux-gnu/libudev.so.1.6.17 2023-10-08T15:40:50.595 INFO:teuthology.orchestra.run.smithi089.stdout:blkmapd 389 root mem REG 8,1 163200 8942 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-10-08T15:40:50.595 INFO:teuthology.orchestra.run.smithi089.stdout:blkmapd 389 root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.595 INFO:teuthology.orchestra.run.smithi089.stdout:blkmapd 389 root mem REG 8,1 431472 10641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-10-08T15:40:50.595 INFO:teuthology.orchestra.run.smithi089.stdout:blkmapd 389 root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.595 INFO:teuthology.orchestra.run.smithi089.stdout:blkmapd 389 root 0u CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.595 INFO:teuthology.orchestra.run.smithi089.stdout:blkmapd 389 root 1u CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.595 INFO:teuthology.orchestra.run.smithi089.stdout:blkmapd 389 root 2u CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.595 INFO:teuthology.orchestra.run.smithi089.stdout:blkmapd 389 root 3wW REG 0,25 4 390 /run/blkmapd.pid 2023-10-08T15:40:50.595 INFO:teuthology.orchestra.run.smithi089.stdout:blkmapd 389 root 4r a_inode 0,14 0 13377 inotify 2023-10-08T15:40:50.595 INFO:teuthology.orchestra.run.smithi089.stdout:blkmapd 389 root 5u unix 0xffff8f3913f45d80 0t0 13887 type=DGRAM 2023-10-08T15:40:50.596 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/2 402 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.596 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/2 402 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.596 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/2 402 root txt unknown /proc/402/exe 2023-10-08T15:40:50.596 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-u 408 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.596 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-u 408 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.596 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-u 408 root txt REG 8,1 744008 13211 /usr/lib/systemd/systemd-udevd 2023-10-08T15:40:50.596 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-u 408 root mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:50.596 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-u 408 root mem REG 8,1 749113 1048623 /usr/lib/modules/5.4.0-164-generic/modules.symbols.bin 2023-10-08T15:40:50.596 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-u 408 root mem REG 8,1 1389809 1048620 /usr/lib/modules/5.4.0-164-generic/modules.alias.bin 2023-10-08T15:40:50.596 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-u 408 root mem REG 8,1 853748 1048629 /usr/lib/modules/5.4.0-164-generic/modules.dep.bin 2023-10-08T15:40:50.597 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-u 408 root mem REG 8,1 9956330 8976 /usr/lib/udev/hwdb.bin 2023-10-08T15:40:50.597 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-u 408 root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.597 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-u 408 root mem REG 8,1 584392 8917 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.9.0 2023-10-08T15:40:50.597 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-u 408 root DEL REG 8,1 8794 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:50.597 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-u 408 root mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:50.597 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-u 408 root mem REG 8,1 686160 8833 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.4 2023-10-08T15:40:50.597 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-u 408 root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.597 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-u 408 root mem REG 8,1 163200 8942 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-10-08T15:40:50.597 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-u 408 root mem REG 8,1 351352 9401 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-10-08T15:40:50.597 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-u 408 root mem REG 8,1 39088 8336 /usr/lib/x86_64-linux-gnu/libacl.so.1.1.2253 2023-10-08T15:40:50.597 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-u 408 root mem REG 8,1 112848 8859 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.5 2023-10-08T15:40:50.598 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-u 408 root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.598 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-u 408 root mem REG 8,1 10257 1048624 /usr/lib/modules/5.4.0-164-generic/modules.builtin.bin 2023-10-08T15:40:50.598 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-u 408 root mem REG 8,1 25062 1048625 /usr/lib/modules/5.4.0-164-generic/modules.builtin.alias.bin 2023-10-08T15:40:50.598 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-u 408 root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.598 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-u 408 root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.598 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-u 408 root 1u unix 0xffff8f390f51cc80 0t0 18150 type=STREAM 2023-10-08T15:40:50.598 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-u 408 root 2u unix 0xffff8f390f51cc80 0t0 18150 type=STREAM 2023-10-08T15:40:50.598 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-u 408 root 3u unix 0xffff8f3919f40cc0 0t0 13574 /run/udev/control type=SEQPACKET 2023-10-08T15:40:50.598 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-u 408 root 4u netlink 0t0 13576 KOBJECT_UEVENT 2023-10-08T15:40:50.598 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-u 408 root 5u unix 0xffff8f39151aa640 0t0 18159 type=DGRAM 2023-10-08T15:40:50.598 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-u 408 root 6u unix 0xffff8f39151a9540 0t0 18161 type=DGRAM 2023-10-08T15:40:50.599 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-u 408 root 7u unix 0xffff8f39151aea40 0t0 18162 type=DGRAM 2023-10-08T15:40:50.599 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-u 408 root 8r a_inode 0,14 0 13377 inotify 2023-10-08T15:40:50.599 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-u 408 root 9u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.599 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-u 408 root 10u a_inode 0,14 0 13377 [signalfd] 2023-10-08T15:40:50.599 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-u 408 root 11u a_inode 0,14 0 13377 [timerfd] 2023-10-08T15:40:50.599 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-u 408 root 12r REG 8,1 9956330 8976 /usr/lib/udev/hwdb.bin 2023-10-08T15:40:50.599 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-u 408 root 13u a_inode 0,14 0 13377 [timerfd] 2023-10-08T15:40:50.599 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/3 412 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.599 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/3 412 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.599 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/3 412 root txt unknown /proc/412/exe 2023-10-08T15:40:50.599 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/3 414 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.600 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/3 414 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.600 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/3 414 root txt unknown /proc/414/exe 2023-10-08T15:40:50.600 INFO:teuthology.orchestra.run.smithi089.stdout:rpc.idmap 422 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.600 INFO:teuthology.orchestra.run.smithi089.stdout:rpc.idmap 422 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.600 INFO:teuthology.orchestra.run.smithi089.stdout:rpc.idmap 422 root txt REG 8,1 43696 20853 /usr/sbin/rpc.idmapd 2023-10-08T15:40:50.600 INFO:teuthology.orchestra.run.smithi089.stdout:rpc.idmap 422 root mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:50.600 INFO:teuthology.orchestra.run.smithi089.stdout:rpc.idmap 422 root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.600 INFO:teuthology.orchestra.run.smithi089.stdout:rpc.idmap 422 root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.600 INFO:teuthology.orchestra.run.smithi089.stdout:rpc.idmap 422 root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.600 INFO:teuthology.orchestra.run.smithi089.stdout:rpc.idmap 422 root mem REG 8,1 34664 18842 /usr/lib/x86_64-linux-gnu/libnfsidmap.so.0.3.0 2023-10-08T15:40:50.601 INFO:teuthology.orchestra.run.smithi089.stdout:rpc.idmap 422 root mem REG 8,1 346672 18575 /usr/lib/x86_64-linux-gnu/libevent-2.1.so.7.0.0 2023-10-08T15:40:50.601 INFO:teuthology.orchestra.run.smithi089.stdout:rpc.idmap 422 root mem REG 8,1 14264 105539 /usr/lib/x86_64-linux-gnu/libnfsidmap/nsswitch.so 2023-10-08T15:40:50.601 INFO:teuthology.orchestra.run.smithi089.stdout:rpc.idmap 422 root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.601 INFO:teuthology.orchestra.run.smithi089.stdout:rpc.idmap 422 root 0u CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.601 INFO:teuthology.orchestra.run.smithi089.stdout:rpc.idmap 422 root 1u CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.601 INFO:teuthology.orchestra.run.smithi089.stdout:rpc.idmap 422 root 2u CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.601 INFO:teuthology.orchestra.run.smithi089.stdout:rpc.idmap 422 root 4u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.601 INFO:teuthology.orchestra.run.smithi089.stdout:rpc.idmap 422 root 5r FIFO 0,13 0t0 19109 pipe 2023-10-08T15:40:50.601 INFO:teuthology.orchestra.run.smithi089.stdout:rpc.idmap 422 root 6w FIFO 0,13 0t0 19109 pipe 2023-10-08T15:40:50.601 INFO:teuthology.orchestra.run.smithi089.stdout:rpc.idmap 422 root 7u REG 0,5 0 4026532448 /proc/422/net/rpc/nfs4.nametoid/channel 2023-10-08T15:40:50.601 INFO:teuthology.orchestra.run.smithi089.stdout:rpc.idmap 422 root 8u REG 0,5 0 4026532444 /proc/422/net/rpc/nfs4.idtoname/channel 2023-10-08T15:40:50.602 INFO:teuthology.orchestra.run.smithi089.stdout:rpc.idmap 422 root 9r DIR 0,46 0 103 /run/rpc_pipefs/nfs 2023-10-08T15:40:50.602 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-n 458 systemd-network cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.602 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-n 458 systemd-network rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.602 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-n 458 systemd-network txt REG 8,1 2241536 10884 /usr/lib/systemd/systemd-networkd 2023-10-08T15:40:50.602 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-n 458 systemd-network mem REG 8,1 27064 8001 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-10-08T15:40:50.602 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-n 458 systemd-network mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:50.602 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-n 458 systemd-network mem REG 8,1 178528 12765 /usr/lib/x86_64-linux-gnu/libudev.so.1.6.17 2023-10-08T15:40:50.602 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-n 458 systemd-network mem REG 8,1 133200 8347 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-10-08T15:40:50.602 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-n 458 systemd-network mem REG 8,1 686160 8833 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.4 2023-10-08T15:40:50.602 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-n 458 systemd-network mem REG 8,1 137584 8109 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.28.0 2023-10-08T15:40:50.603 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-n 458 systemd-network mem REG 8,1 67912 8783 /usr/lib/x86_64-linux-gnu/libjson-c.so.4.0.0 2023-10-08T15:40:50.603 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-n 458 systemd-network mem REG 8,1 34872 10626 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-10-08T15:40:50.603 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-n 458 systemd-network DEL REG 8,1 8794 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:50.603 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-n 458 systemd-network mem REG 8,1 431472 10641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-10-08T15:40:50.603 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-n 458 systemd-network DEL REG 8,1 8351 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-10-08T15:40:50.603 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-n 458 systemd-network mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.603 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-n 458 systemd-network mem REG 8,1 584392 8917 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.9.0 2023-10-08T15:40:50.603 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-n 458 systemd-network mem REG 8,1 1575112 10736 /usr/lib/x86_64-linux-gnu/libunistring.so.2.1.0 2023-10-08T15:40:50.603 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-n 458 systemd-network mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:50.603 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-n 458 systemd-network mem REG 8,1 133568 8867 /usr/lib/x86_64-linux-gnu/libseccomp.so.2.5.1 2023-10-08T15:40:50.603 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-n 458 systemd-network mem REG 8,1 68320 8384 /usr/lib/x86_64-linux-gnu/libpam.so.0.84.2 2023-10-08T15:40:50.603 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-n 458 systemd-network mem REG 8,1 387768 8064 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-10-08T15:40:50.604 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-n 458 systemd-network mem REG 8,1 129248 13039 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.2 2023-10-08T15:40:50.604 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-n 458 systemd-network mem REG 8,1 112848 8859 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.5 2023-10-08T15:40:50.604 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-n 458 systemd-network mem REG 8,1 1168056 8360 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.2.5 2023-10-08T15:40:50.604 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-n 458 systemd-network mem REG 8,1 417328 8800 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.5.0 2023-10-08T15:40:50.604 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-n 458 systemd-network mem REG 8,1 202760 8017 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-10-08T15:40:50.604 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-n 458 systemd-network mem REG 8,1 351352 9401 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-10-08T15:40:50.604 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-n 458 systemd-network mem REG 8,1 39088 8336 /usr/lib/x86_64-linux-gnu/libacl.so.1.1.2253 2023-10-08T15:40:50.604 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-n 458 systemd-network mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.604 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-n 458 systemd-network mem REG 8,1 163200 8942 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-10-08T15:40:50.604 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-n 458 systemd-network mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:50.605 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-n 458 systemd-network mem REG 8,1 35440 10678 /usr/lib/x86_64-linux-gnu/libip4tc.so.2.0.0 2023-10-08T15:40:50.605 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-n 458 systemd-network mem REG 8,1 129096 10669 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.6 2023-10-08T15:40:50.605 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-n 458 systemd-network mem REG 8,1 31120 10630 /usr/lib/x86_64-linux-gnu/libcap.so.2.32 2023-10-08T15:40:50.605 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-n 458 systemd-network mem REG 8,1 2454472 8914 /usr/lib/systemd/libsystemd-shared-245.so 2023-10-08T15:40:50.605 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-n 458 systemd-network mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.605 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-n 458 systemd-network mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.605 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-n 458 systemd-network 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.605 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-n 458 systemd-network 1u unix 0xffff8f390dd8cc80 0t0 21169 type=STREAM 2023-10-08T15:40:50.606 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-n 458 systemd-network 2u unix 0xffff8f390dd8cc80 0t0 21169 type=STREAM 2023-10-08T15:40:50.606 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-n 458 systemd-network 3u unix 0xffff8f391233b740 0t0 21207 type=DGRAM 2023-10-08T15:40:50.606 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-n 458 systemd-network 4u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.606 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-n 458 systemd-network 5u a_inode 0,14 0 13377 [timerfd] 2023-10-08T15:40:50.606 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-n 458 systemd-network 6u a_inode 0,14 0 13377 [signalfd] 2023-10-08T15:40:50.606 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-n 458 systemd-network 7u netlink 0t0 21209 ROUTE 2023-10-08T15:40:50.606 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-n 458 systemd-network 8u a_inode 0,14 0 13377 [timerfd] 2023-10-08T15:40:50.606 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-n 458 systemd-network 9u netlink 0t0 21210 GENERIC 2023-10-08T15:40:50.606 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-n 458 systemd-network 10u netlink 0t0 21211 KOBJECT_UEVENT 2023-10-08T15:40:50.606 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-n 458 systemd-network 11u unix 0xffff8f391233d0c0 0t0 21212 type=DGRAM 2023-10-08T15:40:50.607 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-n 458 systemd-network 12u unix 0xffff8f391233bfc0 0t0 21213 type=DGRAM 2023-10-08T15:40:50.607 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-n 458 systemd-network 13u unix 0xffff8f391233ea40 0t0 21214 type=DGRAM 2023-10-08T15:40:50.607 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-n 458 systemd-network 14u unix 0xffff8f391233aec0 0t0 21215 type=DGRAM 2023-10-08T15:40:50.607 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-n 458 systemd-network 15u pack 21591 0t0 35020 type=SOCK_RAW 2023-10-08T15:40:50.607 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-n 458 systemd-network 16u unix 0xffff8f39120ad940 0t0 14236 type=STREAM 2023-10-08T15:40:50.607 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-n 458 systemd-network 18u a_inode 0,14 0 13377 [timerfd] 2023-10-08T15:40:50.607 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-n 458 systemd-network 19u raw6 0t0 25612 00000000000000000000000000000000:003A->00000000000000000000000000000000:0000 st=07 2023-10-08T15:40:50.607 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-n 458 systemd-network 20u IPv4 25618 0t0 UDP smithi089.front.sepia.ceph.com:bootpc 2023-10-08T15:40:50.607 INFO:teuthology.orchestra.run.smithi089.stdout:rpcbind 465 _rpc cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.608 INFO:teuthology.orchestra.run.smithi089.stdout:rpcbind 465 _rpc rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.608 INFO:teuthology.orchestra.run.smithi089.stdout:rpcbind 465 _rpc txt REG 8,1 59952 16357 /usr/sbin/rpcbind 2023-10-08T15:40:50.608 INFO:teuthology.orchestra.run.smithi089.stdout:rpcbind 465 _rpc mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:50.608 INFO:teuthology.orchestra.run.smithi089.stdout:rpcbind 465 _rpc mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.608 INFO:teuthology.orchestra.run.smithi089.stdout:rpcbind 465 _rpc mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:50.608 INFO:teuthology.orchestra.run.smithi089.stdout:rpcbind 465 _rpc mem REG 8,1 22600 15019 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.8 2023-10-08T15:40:50.608 INFO:teuthology.orchestra.run.smithi089.stdout:rpcbind 465 _rpc mem REG 8,1 137584 8109 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.28.0 2023-10-08T15:40:50.608 INFO:teuthology.orchestra.run.smithi089.stdout:rpcbind 465 _rpc mem REG 8,1 56096 15015 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-10-08T15:40:50.608 INFO:teuthology.orchestra.run.smithi089.stdout:rpcbind 465 _rpc mem REG 8,1 22600 9279 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-10-08T15:40:50.609 INFO:teuthology.orchestra.run.smithi089.stdout:rpcbind 465 _rpc mem REG 8,1 191040 15017 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-10-08T15:40:50.609 INFO:teuthology.orchestra.run.smithi089.stdout:rpcbind 465 _rpc mem REG 8,1 902016 15021 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-10-08T15:40:50.609 INFO:teuthology.orchestra.run.smithi089.stdout:rpcbind 465 _rpc mem REG 8,1 105560 13403 /usr/lib/x86_64-linux-gnu/libnsl-2.31.so 2023-10-08T15:40:50.609 INFO:teuthology.orchestra.run.smithi089.stdout:rpcbind 465 _rpc mem REG 8,1 1168056 8360 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.2.5 2023-10-08T15:40:50.609 INFO:teuthology.orchestra.run.smithi089.stdout:rpcbind 465 _rpc mem REG 8,1 129248 13039 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.2 2023-10-08T15:40:50.609 INFO:teuthology.orchestra.run.smithi089.stdout:rpcbind 465 _rpc mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:50.609 INFO:teuthology.orchestra.run.smithi089.stdout:rpcbind 465 _rpc mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:50.609 INFO:teuthology.orchestra.run.smithi089.stdout:rpcbind 465 _rpc mem REG 8,1 309712 15024 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-10-08T15:40:50.609 INFO:teuthology.orchestra.run.smithi089.stdout:rpcbind 465 _rpc mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.610 INFO:teuthology.orchestra.run.smithi089.stdout:rpcbind 465 _rpc mem REG 8,1 44848 15918 /usr/lib/x86_64-linux-gnu/libwrap.so.0.7.6 2023-10-08T15:40:50.610 INFO:teuthology.orchestra.run.smithi089.stdout:rpcbind 465 _rpc mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.610 INFO:teuthology.orchestra.run.smithi089.stdout:rpcbind 465 _rpc mem REG 8,1 709496 10741 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.28.0 2023-10-08T15:40:50.610 INFO:teuthology.orchestra.run.smithi089.stdout:rpcbind 465 _rpc mem REG 8,1 186992 16353 /usr/lib/x86_64-linux-gnu/libtirpc.so.3.0.0 2023-10-08T15:40:50.610 INFO:teuthology.orchestra.run.smithi089.stdout:rpcbind 465 _rpc mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.610 INFO:teuthology.orchestra.run.smithi089.stdout:rpcbind 465 _rpc 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.610 INFO:teuthology.orchestra.run.smithi089.stdout:rpcbind 465 _rpc 1u unix 0xffff8f3919f45d80 0t0 14071 type=STREAM 2023-10-08T15:40:50.610 INFO:teuthology.orchestra.run.smithi089.stdout:rpcbind 465 _rpc 2u unix 0xffff8f3919f45d80 0t0 14071 type=STREAM 2023-10-08T15:40:50.610 INFO:teuthology.orchestra.run.smithi089.stdout:rpcbind 465 _rpc 3u unix 0xffff8f3919f40880 0t0 13546 /run/rpcbind.sock type=STREAM 2023-10-08T15:40:50.611 INFO:teuthology.orchestra.run.smithi089.stdout:rpcbind 465 _rpc 4u IPv4 17532 0t0 TCP *:sunrpc (LISTEN) 2023-10-08T15:40:50.611 INFO:teuthology.orchestra.run.smithi089.stdout:rpcbind 465 _rpc 5u IPv4 183 0t0 UDP *:sunrpc 2023-10-08T15:40:50.611 INFO:teuthology.orchestra.run.smithi089.stdout:rpcbind 465 _rpc 6u IPv6 18576 0t0 TCP *:sunrpc (LISTEN) 2023-10-08T15:40:50.611 INFO:teuthology.orchestra.run.smithi089.stdout:rpcbind 465 _rpc 7u IPv6 186 0t0 UDP *:sunrpc 2023-10-08T15:40:50.611 INFO:teuthology.orchestra.run.smithi089.stdout:rpcbind 465 _rpc 8rW REG 0,25 0 686 /run/rpcbind.lock 2023-10-08T15:40:50.611 INFO:teuthology.orchestra.run.smithi089.stdout:rpcbind 465 _rpc 9u sock 0,9 0t0 21409 protocol: UDPv6 2023-10-08T15:40:50.611 INFO:teuthology.orchestra.run.smithi089.stdout:rpcbind 465 _rpc 10u unix 0xffff8f3915487700 0t0 1014 /run/rpcbind.sock type=STREAM 2023-10-08T15:40:50.611 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/1 467 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.611 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/1 467 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.612 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/1 467 root txt unknown /proc/467/exe 2023-10-08T15:40:50.612 INFO:teuthology.orchestra.run.smithi089.stdout:ipmi-msgh 469 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.612 INFO:teuthology.orchestra.run.smithi089.stdout:ipmi-msgh 469 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.612 INFO:teuthology.orchestra.run.smithi089.stdout:ipmi-msgh 469 root txt unknown /proc/469/exe 2023-10-08T15:40:50.612 INFO:teuthology.orchestra.run.smithi089.stdout:cryptd 492 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.612 INFO:teuthology.orchestra.run.smithi089.stdout:cryptd 492 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.612 INFO:teuthology.orchestra.run.smithi089.stdout:cryptd 492 root txt unknown /proc/492/exe 2023-10-08T15:40:50.612 INFO:teuthology.orchestra.run.smithi089.stdout:ttm_swap 511 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.613 INFO:teuthology.orchestra.run.smithi089.stdout:ttm_swap 511 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.613 INFO:teuthology.orchestra.run.smithi089.stdout:ttm_swap 511 root txt unknown /proc/511/exe 2023-10-08T15:40:50.613 INFO:teuthology.orchestra.run.smithi089.stdout:kipmi0 523 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.613 INFO:teuthology.orchestra.run.smithi089.stdout:kipmi0 523 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.613 INFO:teuthology.orchestra.run.smithi089.stdout:kipmi0 523 root txt unknown /proc/523/exe 2023-10-08T15:40:50.613 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.613 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.613 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 root txt REG 8,1 203192 72433 /usr/lib/accountsservice/accounts-daemon 2023-10-08T15:40:50.613 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 root mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:50.613 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:50.613 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 root mem REG 8,1 104984 8251 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-10-08T15:40:50.614 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 root mem REG 8,1 1956992 8082 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28 2023-10-08T15:40:50.614 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 root mem REG 8,1 133640 18368 /usr/lib/x86_64-linux-gnu/libproxy.so.1.0.0 2023-10-08T15:40:50.614 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 root mem REG 8,1 67656 101921 /usr/lib/x86_64-linux-gnu/gio/modules/libdconfsettings.so 2023-10-08T15:40:50.614 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 root mem REG 8,1 6017584 10873 /usr/lib/locale/locale-archive 2023-10-08T15:40:50.614 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 root mem REG 8,1 137584 8109 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.28.0 2023-10-08T15:40:50.614 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 root mem REG 8,1 1168056 8360 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.2.5 2023-10-08T15:40:50.614 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 root mem REG 8,1 129248 13039 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.2 2023-10-08T15:40:50.614 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 root mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:50.614 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 root mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:50.614 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 root mem REG 8,1 584392 8917 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.9.0 2023-10-08T15:40:50.615 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 root mem REG 8,1 351352 9401 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-10-08T15:40:50.615 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 root mem REG 8,1 709496 10741 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.28.0 2023-10-08T15:40:50.615 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 root mem REG 8,1 465008 11338 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-10-08T15:40:50.615 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 root mem REG 8,1 43416 10645 /usr/lib/x86_64-linux-gnu/libffi.so.7.1.0 2023-10-08T15:40:50.615 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.615 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 root mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:50.615 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 root mem REG 8,1 163200 8942 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-10-08T15:40:50.615 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 root mem REG 8,1 387768 8064 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-10-08T15:40:50.615 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.615 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:50.616 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 root mem REG 8,1 18640 9386 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.6400.6 2023-10-08T15:40:50.616 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.616 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 root mem REG 8,1 126472 12515 /usr/lib/x86_64-linux-gnu/libpolkit-gobject-1.so.0.0.0 2023-10-08T15:40:50.616 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 root mem REG 8,1 1207920 9384 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.6400.6 2023-10-08T15:40:50.616 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 root mem REG 8,1 387448 9388 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.6400.6 2023-10-08T15:40:50.616 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 root mem REG 8,1 1957200 9382 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.6400.6 2023-10-08T15:40:50.616 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 root mem REG 8,1 18696 13609 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-10-08T15:40:50.616 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 root mem REG 8,1 27002 13665 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-10-08T15:40:50.616 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.616 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.617 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 root 1u unix 0xffff8f3919f47b40 0t0 22573 type=STREAM 2023-10-08T15:40:50.617 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 root 2u unix 0xffff8f3919f47b40 0t0 22573 type=STREAM 2023-10-08T15:40:50.617 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 root 3u a_inode 0,14 0 13377 [eventfd] 2023-10-08T15:40:50.617 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 root 4u a_inode 0,14 0 13377 [eventfd] 2023-10-08T15:40:50.617 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 root 5u unix 0xffff8f391808a200 0t0 23603 type=STREAM 2023-10-08T15:40:50.617 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 root 6u a_inode 0,14 0 13377 [eventfd] 2023-10-08T15:40:50.617 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 root 7r a_inode 0,14 0 13377 inotify 2023-10-08T15:40:50.617 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 564 gmain root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.618 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 564 gmain root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.618 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 564 gmain root txt REG 8,1 203192 72433 /usr/lib/accountsservice/accounts-daemon 2023-10-08T15:40:50.618 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 564 gmain root mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:50.618 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 564 gmain root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:50.618 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 564 gmain root mem REG 8,1 104984 8251 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-10-08T15:40:50.618 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 564 gmain root mem REG 8,1 1956992 8082 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28 2023-10-08T15:40:50.618 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 564 gmain root mem REG 8,1 133640 18368 /usr/lib/x86_64-linux-gnu/libproxy.so.1.0.0 2023-10-08T15:40:50.618 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 564 gmain root mem REG 8,1 67656 101921 /usr/lib/x86_64-linux-gnu/gio/modules/libdconfsettings.so 2023-10-08T15:40:50.619 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 564 gmain root mem REG 8,1 6017584 10873 /usr/lib/locale/locale-archive 2023-10-08T15:40:50.619 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 564 gmain root mem REG 8,1 137584 8109 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.28.0 2023-10-08T15:40:50.619 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 564 gmain root mem REG 8,1 1168056 8360 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.2.5 2023-10-08T15:40:50.619 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 564 gmain root mem REG 8,1 129248 13039 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.2 2023-10-08T15:40:50.619 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 564 gmain root mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:50.619 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 564 gmain root mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:50.619 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 564 gmain root mem REG 8,1 584392 8917 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.9.0 2023-10-08T15:40:50.619 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 564 gmain root mem REG 8,1 351352 9401 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-10-08T15:40:50.619 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 564 gmain root mem REG 8,1 709496 10741 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.28.0 2023-10-08T15:40:50.619 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 564 gmain root mem REG 8,1 465008 11338 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-10-08T15:40:50.620 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 564 gmain root mem REG 8,1 43416 10645 /usr/lib/x86_64-linux-gnu/libffi.so.7.1.0 2023-10-08T15:40:50.620 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 564 gmain root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.620 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 564 gmain root mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:50.620 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 564 gmain root mem REG 8,1 163200 8942 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-10-08T15:40:50.620 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 564 gmain root mem REG 8,1 387768 8064 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-10-08T15:40:50.620 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 564 gmain root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.620 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 564 gmain root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:50.620 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 564 gmain root mem REG 8,1 18640 9386 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.6400.6 2023-10-08T15:40:50.621 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 564 gmain root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.621 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 564 gmain root mem REG 8,1 126472 12515 /usr/lib/x86_64-linux-gnu/libpolkit-gobject-1.so.0.0.0 2023-10-08T15:40:50.621 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 564 gmain root mem REG 8,1 1207920 9384 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.6400.6 2023-10-08T15:40:50.621 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 564 gmain root mem REG 8,1 387448 9388 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.6400.6 2023-10-08T15:40:50.621 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 564 gmain root mem REG 8,1 1957200 9382 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.6400.6 2023-10-08T15:40:50.621 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 564 gmain root mem REG 8,1 18696 13609 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-10-08T15:40:50.621 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 564 gmain root mem REG 8,1 27002 13665 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-10-08T15:40:50.621 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 564 gmain root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.622 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 564 gmain root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.622 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 564 gmain root 1u unix 0xffff8f3919f47b40 0t0 22573 type=STREAM 2023-10-08T15:40:50.622 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 564 gmain root 2u unix 0xffff8f3919f47b40 0t0 22573 type=STREAM 2023-10-08T15:40:50.622 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 564 gmain root 3u a_inode 0,14 0 13377 [eventfd] 2023-10-08T15:40:50.622 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 564 gmain root 4u a_inode 0,14 0 13377 [eventfd] 2023-10-08T15:40:50.622 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 564 gmain root 5u unix 0xffff8f391808a200 0t0 23603 type=STREAM 2023-10-08T15:40:50.622 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 564 gmain root 6u a_inode 0,14 0 13377 [eventfd] 2023-10-08T15:40:50.622 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 564 gmain root 7r a_inode 0,14 0 13377 inotify 2023-10-08T15:40:50.622 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 581 gdbus root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.623 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 581 gdbus root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.623 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 581 gdbus root txt REG 8,1 203192 72433 /usr/lib/accountsservice/accounts-daemon 2023-10-08T15:40:50.623 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 581 gdbus root mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:50.623 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 581 gdbus root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:50.623 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 581 gdbus root mem REG 8,1 104984 8251 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-10-08T15:40:50.623 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 581 gdbus root mem REG 8,1 1956992 8082 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28 2023-10-08T15:40:50.623 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 581 gdbus root mem REG 8,1 133640 18368 /usr/lib/x86_64-linux-gnu/libproxy.so.1.0.0 2023-10-08T15:40:50.623 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 581 gdbus root mem REG 8,1 67656 101921 /usr/lib/x86_64-linux-gnu/gio/modules/libdconfsettings.so 2023-10-08T15:40:50.623 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 581 gdbus root mem REG 8,1 6017584 10873 /usr/lib/locale/locale-archive 2023-10-08T15:40:50.623 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 581 gdbus root mem REG 8,1 137584 8109 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.28.0 2023-10-08T15:40:50.624 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 581 gdbus root mem REG 8,1 1168056 8360 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.2.5 2023-10-08T15:40:50.624 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 581 gdbus root mem REG 8,1 129248 13039 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.2 2023-10-08T15:40:50.624 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 581 gdbus root mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:50.624 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 581 gdbus root mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:50.624 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 581 gdbus root mem REG 8,1 584392 8917 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.9.0 2023-10-08T15:40:50.624 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 581 gdbus root mem REG 8,1 351352 9401 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-10-08T15:40:50.624 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 581 gdbus root mem REG 8,1 709496 10741 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.28.0 2023-10-08T15:40:50.624 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 581 gdbus root mem REG 8,1 465008 11338 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-10-08T15:40:50.624 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 581 gdbus root mem REG 8,1 43416 10645 /usr/lib/x86_64-linux-gnu/libffi.so.7.1.0 2023-10-08T15:40:50.625 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 581 gdbus root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.625 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 581 gdbus root mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:50.625 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 581 gdbus root mem REG 8,1 163200 8942 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-10-08T15:40:50.625 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 581 gdbus root mem REG 8,1 387768 8064 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-10-08T15:40:50.625 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 581 gdbus root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.625 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 581 gdbus root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:50.625 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 581 gdbus root mem REG 8,1 18640 9386 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.6400.6 2023-10-08T15:40:50.625 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 581 gdbus root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.625 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 581 gdbus root mem REG 8,1 126472 12515 /usr/lib/x86_64-linux-gnu/libpolkit-gobject-1.so.0.0.0 2023-10-08T15:40:50.625 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 581 gdbus root mem REG 8,1 1207920 9384 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.6400.6 2023-10-08T15:40:50.625 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 581 gdbus root mem REG 8,1 387448 9388 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.6400.6 2023-10-08T15:40:50.626 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 581 gdbus root mem REG 8,1 1957200 9382 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.6400.6 2023-10-08T15:40:50.626 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 581 gdbus root mem REG 8,1 18696 13609 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-10-08T15:40:50.626 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 581 gdbus root mem REG 8,1 27002 13665 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-10-08T15:40:50.626 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 581 gdbus root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.626 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 581 gdbus root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.626 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 581 gdbus root 1u unix 0xffff8f3919f47b40 0t0 22573 type=STREAM 2023-10-08T15:40:50.626 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 581 gdbus root 2u unix 0xffff8f3919f47b40 0t0 22573 type=STREAM 2023-10-08T15:40:50.626 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 581 gdbus root 3u a_inode 0,14 0 13377 [eventfd] 2023-10-08T15:40:50.626 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 581 gdbus root 4u a_inode 0,14 0 13377 [eventfd] 2023-10-08T15:40:50.626 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 581 gdbus root 5u unix 0xffff8f391808a200 0t0 23603 type=STREAM 2023-10-08T15:40:50.627 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 581 gdbus root 6u a_inode 0,14 0 13377 [eventfd] 2023-10-08T15:40:50.627 INFO:teuthology.orchestra.run.smithi089.stdout:accounts- 560 581 gdbus root 7r a_inode 0,14 0 13377 inotify 2023-10-08T15:40:50.627 INFO:teuthology.orchestra.run.smithi089.stdout:dbus-daem 561 messagebus cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.627 INFO:teuthology.orchestra.run.smithi089.stdout:dbus-daem 561 messagebus rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.627 INFO:teuthology.orchestra.run.smithi089.stdout:dbus-daem 561 messagebus txt REG 8,1 249032 8204 /usr/bin/dbus-daemon 2023-10-08T15:40:50.627 INFO:teuthology.orchestra.run.smithi089.stdout:dbus-daem 561 messagebus mem REG 8,1 239896 8375 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-10-08T15:40:50.627 INFO:teuthology.orchestra.run.smithi089.stdout:dbus-daem 561 messagebus mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:50.627 INFO:teuthology.orchestra.run.smithi089.stdout:dbus-daem 561 messagebus mem REG 8,1 137584 8109 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.28.0 2023-10-08T15:40:50.627 INFO:teuthology.orchestra.run.smithi089.stdout:dbus-daem 561 messagebus mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.627 INFO:teuthology.orchestra.run.smithi089.stdout:dbus-daem 561 messagebus mem REG 8,1 584392 8917 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.9.0 2023-10-08T15:40:50.627 INFO:teuthology.orchestra.run.smithi089.stdout:dbus-daem 561 messagebus mem REG 8,1 1168056 8360 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.2.5 2023-10-08T15:40:50.628 INFO:teuthology.orchestra.run.smithi089.stdout:dbus-daem 561 messagebus mem REG 8,1 129248 13039 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.2 2023-10-08T15:40:50.628 INFO:teuthology.orchestra.run.smithi089.stdout:dbus-daem 561 messagebus mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:50.628 INFO:teuthology.orchestra.run.smithi089.stdout:dbus-daem 561 messagebus mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:50.628 INFO:teuthology.orchestra.run.smithi089.stdout:dbus-daem 561 messagebus mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.628 INFO:teuthology.orchestra.run.smithi089.stdout:dbus-daem 561 messagebus mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.628 INFO:teuthology.orchestra.run.smithi089.stdout:dbus-daem 561 messagebus mem REG 8,1 80736 8771 /usr/lib/x86_64-linux-gnu/libapparmor.so.1.6.1 2023-10-08T15:40:50.628 INFO:teuthology.orchestra.run.smithi089.stdout:dbus-daem 561 messagebus mem REG 8,1 27064 8001 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-10-08T15:40:50.628 INFO:teuthology.orchestra.run.smithi089.stdout:dbus-daem 561 messagebus mem REG 8,1 133200 8347 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-10-08T15:40:50.628 INFO:teuthology.orchestra.run.smithi089.stdout:dbus-daem 561 messagebus mem REG 8,1 163200 8942 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-10-08T15:40:50.628 INFO:teuthology.orchestra.run.smithi089.stdout:dbus-daem 561 messagebus mem REG 8,1 182560 8776 /usr/lib/x86_64-linux-gnu/libexpat.so.1.6.11 2023-10-08T15:40:50.628 INFO:teuthology.orchestra.run.smithi089.stdout:dbus-daem 561 messagebus mem REG 8,1 709496 10741 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.28.0 2023-10-08T15:40:50.628 INFO:teuthology.orchestra.run.smithi089.stdout:dbus-daem 561 messagebus mem REG 8,1 325944 8767 /usr/lib/x86_64-linux-gnu/libdbus-1.so.3.19.11 2023-10-08T15:40:50.629 INFO:teuthology.orchestra.run.smithi089.stdout:dbus-daem 561 messagebus mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.629 INFO:teuthology.orchestra.run.smithi089.stdout:dbus-daem 561 messagebus 0u CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.629 INFO:teuthology.orchestra.run.smithi089.stdout:dbus-daem 561 messagebus 1u unix 0xffff8f390f51a200 0t0 18405 type=STREAM 2023-10-08T15:40:50.629 INFO:teuthology.orchestra.run.smithi089.stdout:dbus-daem 561 messagebus 2u unix 0xffff8f390f51a200 0t0 18405 type=STREAM 2023-10-08T15:40:50.629 INFO:teuthology.orchestra.run.smithi089.stdout:dbus-daem 561 messagebus 3u unix 0xffff8f3914c0aec0 0t0 466 /run/dbus/system_bus_socket type=STREAM 2023-10-08T15:40:50.629 INFO:teuthology.orchestra.run.smithi089.stdout:dbus-daem 561 messagebus 4u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.629 INFO:teuthology.orchestra.run.smithi089.stdout:dbus-daem 561 messagebus 5u sock 0,9 0t0 20081 protocol: NETLINK 2023-10-08T15:40:50.629 INFO:teuthology.orchestra.run.smithi089.stdout:dbus-daem 561 messagebus 6u unix 0xffff8f391829e600 0t0 20084 type=DGRAM 2023-10-08T15:40:50.629 INFO:teuthology.orchestra.run.smithi089.stdout:dbus-daem 561 messagebus 7r a_inode 0,14 0 13377 inotify 2023-10-08T15:40:50.629 INFO:teuthology.orchestra.run.smithi089.stdout:dbus-daem 561 messagebus 8u unix 0xffff8f391829c400 0t0 20085 type=STREAM 2023-10-08T15:40:50.629 INFO:teuthology.orchestra.run.smithi089.stdout:dbus-daem 561 messagebus 9u unix 0xffff8f391829f2c0 0t0 20086 type=STREAM 2023-10-08T15:40:50.629 INFO:teuthology.orchestra.run.smithi089.stdout:dbus-daem 561 messagebus 10u unix 0xffff8f39120ad500 0t0 20087 /run/dbus/system_bus_socket type=STREAM 2023-10-08T15:40:50.630 INFO:teuthology.orchestra.run.smithi089.stdout:dbus-daem 561 messagebus 11u unix 0xffff8f390dc26a40 0t0 20088 /run/dbus/system_bus_socket type=STREAM 2023-10-08T15:40:50.630 INFO:teuthology.orchestra.run.smithi089.stdout:dbus-daem 561 messagebus 12u unix 0xffff8f391808d0c0 0t0 20089 /run/dbus/system_bus_socket type=STREAM 2023-10-08T15:40:50.630 INFO:teuthology.orchestra.run.smithi089.stdout:dbus-daem 561 messagebus 13u unix 0xffff8f39181a5940 0t0 21717 /run/dbus/system_bus_socket type=STREAM 2023-10-08T15:40:50.630 INFO:teuthology.orchestra.run.smithi089.stdout:dbus-daem 561 messagebus 14u unix 0xffff8f391221d0c0 0t0 25623 /run/dbus/system_bus_socket type=STREAM 2023-10-08T15:40:50.630 INFO:teuthology.orchestra.run.smithi089.stdout:dbus-daem 561 messagebus 15u unix 0xffff8f39173cbb80 0t0 25617 /run/dbus/system_bus_socket type=STREAM 2023-10-08T15:40:50.630 INFO:teuthology.orchestra.run.smithi089.stdout:dbus-daem 561 messagebus 16u unix 0xffff8f3916c76a40 0t0 810 /run/dbus/system_bus_socket type=STREAM 2023-10-08T15:40:50.630 INFO:teuthology.orchestra.run.smithi089.stdout:dbus-daem 561 messagebus 17u unix 0xffff8f39165bf2c0 0t0 27709 /run/dbus/system_bus_socket type=STREAM 2023-10-08T15:40:50.630 INFO:teuthology.orchestra.run.smithi089.stdout:dbus-daem 561 messagebus 18u unix 0xffff8f38d09c6a40 0t0 160374 /run/dbus/system_bus_socket type=STREAM 2023-10-08T15:40:50.630 INFO:teuthology.orchestra.run.smithi089.stdout:dbus-daem 561 messagebus 19u unix 0xffff8f39118f3fc0 0t0 29027 /run/dbus/system_bus_socket type=STREAM 2023-10-08T15:40:50.630 INFO:teuthology.orchestra.run.smithi089.stdout:dbus-daem 561 messagebus 20u unix 0xffff8f390ff91540 0t0 108800 /run/dbus/system_bus_socket type=STREAM 2023-10-08T15:40:50.630 INFO:teuthology.orchestra.run.smithi089.stdout:dbus-daem 561 messagebus 21u unix 0xffff8f38c72dfb40 0t0 165645 /run/dbus/system_bus_socket type=STREAM 2023-10-08T15:40:50.631 INFO:teuthology.orchestra.run.smithi089.stdout:dbus-daem 561 messagebus 24u unix 0xffff8f3911b1c840 0t0 163418 /run/dbus/system_bus_socket type=STREAM 2023-10-08T15:40:50.631 INFO:teuthology.orchestra.run.smithi089.stdout:irqbalanc 568 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.631 INFO:teuthology.orchestra.run.smithi089.stdout:irqbalanc 568 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.631 INFO:teuthology.orchestra.run.smithi089.stdout:irqbalanc 568 root txt REG 8,1 64432 12612 /usr/sbin/irqbalance 2023-10-08T15:40:50.631 INFO:teuthology.orchestra.run.smithi089.stdout:irqbalanc 568 root mem REG 8,1 137584 8109 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.28.0 2023-10-08T15:40:50.631 INFO:teuthology.orchestra.run.smithi089.stdout:irqbalanc 568 root mem REG 8,1 1168056 8360 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.2.5 2023-10-08T15:40:50.631 INFO:teuthology.orchestra.run.smithi089.stdout:irqbalanc 568 root mem REG 8,1 129248 13039 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.2 2023-10-08T15:40:50.631 INFO:teuthology.orchestra.run.smithi089.stdout:irqbalanc 568 root mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:50.631 INFO:teuthology.orchestra.run.smithi089.stdout:irqbalanc 568 root mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:50.631 INFO:teuthology.orchestra.run.smithi089.stdout:irqbalanc 568 root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.631 INFO:teuthology.orchestra.run.smithi089.stdout:irqbalanc 568 root mem REG 8,1 465008 11338 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-10-08T15:40:50.631 INFO:teuthology.orchestra.run.smithi089.stdout:irqbalanc 568 root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.632 INFO:teuthology.orchestra.run.smithi089.stdout:irqbalanc 568 root mem REG 8,1 47960 12609 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-10-08T15:40:50.632 INFO:teuthology.orchestra.run.smithi089.stdout:irqbalanc 568 root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:50.632 INFO:teuthology.orchestra.run.smithi089.stdout:irqbalanc 568 root mem REG 8,1 709496 10741 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.28.0 2023-10-08T15:40:50.632 INFO:teuthology.orchestra.run.smithi089.stdout:irqbalanc 568 root mem REG 8,1 1207920 9384 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.6400.6 2023-10-08T15:40:50.632 INFO:teuthology.orchestra.run.smithi089.stdout:irqbalanc 568 root mem REG 8,1 27064 8001 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-10-08T15:40:50.632 INFO:teuthology.orchestra.run.smithi089.stdout:irqbalanc 568 root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.632 INFO:teuthology.orchestra.run.smithi089.stdout:irqbalanc 568 root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.632 INFO:teuthology.orchestra.run.smithi089.stdout:irqbalanc 568 root 1u unix 0xffff8f3919b061c0 0t0 21687 type=STREAM 2023-10-08T15:40:50.632 INFO:teuthology.orchestra.run.smithi089.stdout:irqbalanc 568 root 2u unix 0xffff8f3919b061c0 0t0 21687 type=STREAM 2023-10-08T15:40:50.632 INFO:teuthology.orchestra.run.smithi089.stdout:irqbalanc 568 root 3u a_inode 0,14 0 13377 [eventfd] 2023-10-08T15:40:50.633 INFO:teuthology.orchestra.run.smithi089.stdout:irqbalanc 568 root 4u a_inode 0,14 0 13377 [eventfd] 2023-10-08T15:40:50.633 INFO:teuthology.orchestra.run.smithi089.stdout:irqbalanc 568 root 5u unix 0xffff8f39180b9100 0t0 21693 /run/irqbalance//irqbalance568.sock type=STREAM 2023-10-08T15:40:50.633 INFO:teuthology.orchestra.run.smithi089.stdout:irqbalanc 568 570 gmain root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.633 INFO:teuthology.orchestra.run.smithi089.stdout:irqbalanc 568 570 gmain root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.633 INFO:teuthology.orchestra.run.smithi089.stdout:irqbalanc 568 570 gmain root txt REG 8,1 64432 12612 /usr/sbin/irqbalance 2023-10-08T15:40:50.633 INFO:teuthology.orchestra.run.smithi089.stdout:irqbalanc 568 570 gmain root mem REG 8,1 137584 8109 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.28.0 2023-10-08T15:40:50.633 INFO:teuthology.orchestra.run.smithi089.stdout:irqbalanc 568 570 gmain root mem REG 8,1 1168056 8360 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.2.5 2023-10-08T15:40:50.633 INFO:teuthology.orchestra.run.smithi089.stdout:irqbalanc 568 570 gmain root mem REG 8,1 129248 13039 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.2 2023-10-08T15:40:50.633 INFO:teuthology.orchestra.run.smithi089.stdout:irqbalanc 568 570 gmain root mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:50.633 INFO:teuthology.orchestra.run.smithi089.stdout:irqbalanc 568 570 gmain root mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:50.633 INFO:teuthology.orchestra.run.smithi089.stdout:irqbalanc 568 570 gmain root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.634 INFO:teuthology.orchestra.run.smithi089.stdout:irqbalanc 568 570 gmain root mem REG 8,1 465008 11338 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-10-08T15:40:50.634 INFO:teuthology.orchestra.run.smithi089.stdout:irqbalanc 568 570 gmain root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.634 INFO:teuthology.orchestra.run.smithi089.stdout:irqbalanc 568 570 gmain root mem REG 8,1 47960 12609 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-10-08T15:40:50.634 INFO:teuthology.orchestra.run.smithi089.stdout:irqbalanc 568 570 gmain root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:50.634 INFO:teuthology.orchestra.run.smithi089.stdout:irqbalanc 568 570 gmain root mem REG 8,1 709496 10741 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.28.0 2023-10-08T15:40:50.634 INFO:teuthology.orchestra.run.smithi089.stdout:irqbalanc 568 570 gmain root mem REG 8,1 1207920 9384 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.6400.6 2023-10-08T15:40:50.634 INFO:teuthology.orchestra.run.smithi089.stdout:irqbalanc 568 570 gmain root mem REG 8,1 27064 8001 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-10-08T15:40:50.634 INFO:teuthology.orchestra.run.smithi089.stdout:irqbalanc 568 570 gmain root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.634 INFO:teuthology.orchestra.run.smithi089.stdout:irqbalanc 568 570 gmain root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.634 INFO:teuthology.orchestra.run.smithi089.stdout:irqbalanc 568 570 gmain root 1u unix 0xffff8f3919b061c0 0t0 21687 type=STREAM 2023-10-08T15:40:50.634 INFO:teuthology.orchestra.run.smithi089.stdout:irqbalanc 568 570 gmain root 2u unix 0xffff8f3919b061c0 0t0 21687 type=STREAM 2023-10-08T15:40:50.635 INFO:teuthology.orchestra.run.smithi089.stdout:irqbalanc 568 570 gmain root 3u a_inode 0,14 0 13377 [eventfd] 2023-10-08T15:40:50.635 INFO:teuthology.orchestra.run.smithi089.stdout:irqbalanc 568 570 gmain root 4u a_inode 0,14 0 13377 [eventfd] 2023-10-08T15:40:50.635 INFO:teuthology.orchestra.run.smithi089.stdout:irqbalanc 568 570 gmain root 5u unix 0xffff8f39180b9100 0t0 21693 /run/irqbalance//irqbalance568.sock type=STREAM 2023-10-08T15:40:50.635 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.635 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.635 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root txt REG 8,1 987576 21343 /usr/bin/lttng-sessiond 2023-10-08T15:40:50.635 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root mem REG 8,1 749113 1048623 /usr/lib/modules/5.4.0-164-generic/modules.symbols.bin 2023-10-08T15:40:50.635 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root mem REG 8,1 1389809 1048620 /usr/lib/modules/5.4.0-164-generic/modules.alias.bin 2023-10-08T15:40:50.635 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root mem REG 8,1 853748 1048629 /usr/lib/modules/5.4.0-164-generic/modules.dep.bin 2023-10-08T15:40:50.636 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:50.636 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root mem REG 8,1 104984 8251 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-10-08T15:40:50.636 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root mem REG 8,1 1956992 8082 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28 2023-10-08T15:40:50.636 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root mem REG 8,1 28046896 10299 /usr/lib/x86_64-linux-gnu/libicudata.so.66.1 2023-10-08T15:40:50.636 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root mem REG 8,1 47960 12609 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-10-08T15:40:50.636 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:50.636 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:50.636 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root mem REG 8,1 1976648 10310 /usr/lib/x86_64-linux-gnu/libicuuc.so.66.1 2023-10-08T15:40:50.636 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root DEL REG 8,1 8794 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:50.637 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:50.637 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root mem REG 8,1 686160 8833 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.4 2023-10-08T15:40:50.637 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.637 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.637 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:50.637 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root mem REG 8,1 43136 21280 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.6.1.0 2023-10-08T15:40:50.637 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root mem REG 8,1 273576 18735 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.4.0.0 2023-10-08T15:40:50.637 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root mem REG 8,1 1799408 10319 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.10 2023-10-08T15:40:50.637 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.638 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root DEL REG 8,1 8351 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-10-08T15:40:50.638 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root mem REG 8,1 39480 21286 /usr/lib/x86_64-linux-gnu/liburcu.so.6.1.0 2023-10-08T15:40:50.638 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root mem REG 8,1 22520 21281 /usr/lib/x86_64-linux-gnu/liburcu-common.so.6.1.0 2023-10-08T15:40:50.638 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root mem REG 8,1 444816 21295 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-10-08T15:40:50.638 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root mem REG 8,1 112848 8859 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.5 2023-10-08T15:40:50.638 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root mem REG 8,1 10257 1048624 /usr/lib/modules/5.4.0-164-generic/modules.builtin.bin 2023-10-08T15:40:50.638 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root mem REG 8,1 25062 1048625 /usr/lib/modules/5.4.0-164-generic/modules.builtin.alias.bin 2023-10-08T15:40:50.638 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.638 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root mem REG 0,26 4096 3 /dev/shm/lttng-ust-wait-8 2023-10-08T15:40:50.639 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.639 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 1u unix 0xffff8f3919f43b80 0t0 22746 type=STREAM 2023-10-08T15:40:50.639 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 2u unix 0xffff8f3919f43b80 0t0 22746 type=STREAM 2023-10-08T15:40:50.639 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 3wW REG 0,25 0 785 /run/lttng/lttng-sessiond.lck 2023-10-08T15:40:50.639 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 4u unix 0xffff8f3917acaa80 0t0 675 type=STREAM 2023-10-08T15:40:50.639 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 5r FIFO 0,13 0t0 677 pipe 2023-10-08T15:40:50.639 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 6w FIFO 0,13 0t0 677 pipe 2023-10-08T15:40:50.639 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 7r FIFO 0,13 0t0 678 pipe 2023-10-08T15:40:50.639 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 8w FIFO 0,13 0t0 678 pipe 2023-10-08T15:40:50.640 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 9r FIFO 0,13 0t0 679 pipe 2023-10-08T15:40:50.640 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 10w FIFO 0,13 0t0 679 pipe 2023-10-08T15:40:50.640 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 11r FIFO 0,13 0t0 680 pipe 2023-10-08T15:40:50.640 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 12w FIFO 0,13 0t0 680 pipe 2023-10-08T15:40:50.640 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 13r FIFO 0,13 0t0 681 pipe 2023-10-08T15:40:50.640 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 14w FIFO 0,13 0t0 681 pipe 2023-10-08T15:40:50.640 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 15r FIFO 0,13 0t0 682 pipe 2023-10-08T15:40:50.640 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 16w FIFO 0,13 0t0 682 pipe 2023-10-08T15:40:50.641 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 17r FIFO 0,13 0t0 683 pipe 2023-10-08T15:40:50.641 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 18w FIFO 0,13 0t0 683 pipe 2023-10-08T15:40:50.641 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 19u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.641 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 20u unix 0xffff8f3917ace600 0t0 688 /var/run/lttng/kconsumerd/error type=STREAM 2023-10-08T15:40:50.641 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 21u unix 0xffff8f3917accc80 0t0 689 /var/run/lttng/ustconsumerd64/error type=STREAM 2023-10-08T15:40:50.641 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 22u unix 0xffff8f3917acb740 0t0 690 /var/run/lttng/ustconsumerd32/error type=STREAM 2023-10-08T15:40:50.641 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 23r FIFO 0,13 0t0 691 pipe 2023-10-08T15:40:50.641 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 24w FIFO 0,13 0t0 691 pipe 2023-10-08T15:40:50.641 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 25r FIFO 0,13 0t0 692 pipe 2023-10-08T15:40:50.641 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 26w FIFO 0,13 0t0 692 pipe 2023-10-08T15:40:50.642 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 27r FIFO 0,13 0t0 693 pipe 2023-10-08T15:40:50.642 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 28w FIFO 0,13 0t0 693 pipe 2023-10-08T15:40:50.642 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 29r FIFO 0,13 0t0 696 pipe 2023-10-08T15:40:50.642 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 30w FIFO 0,13 0t0 696 pipe 2023-10-08T15:40:50.642 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 31u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.642 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 32u unix 0xffff8f3917acdd80 0t0 697 /var/run/lttng/sessiond-health type=STREAM 2023-10-08T15:40:50.642 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 33r FIFO 0,13 0t0 20176 pipe 2023-10-08T15:40:50.642 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 34w FIFO 0,13 0t0 20176 pipe 2023-10-08T15:40:50.643 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 35u unix 0xffff8f3917b1a200 0t0 23795 /var/run/lttng/sessiond-notification type=STREAM 2023-10-08T15:40:50.643 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 36u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.643 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 37r FIFO 0,13 0t0 20177 pipe 2023-10-08T15:40:50.643 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 38w FIFO 0,13 0t0 20177 pipe 2023-10-08T15:40:50.643 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 39r FIFO 0,13 0t0 20178 pipe 2023-10-08T15:40:50.643 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 40w FIFO 0,13 0t0 20178 pipe 2023-10-08T15:40:50.643 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 41u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.643 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 42u unix 0xffff8f3917b2e600 0t0 20179 /var/run/lttng/client-lttng-sessiond type=STREAM 2023-10-08T15:40:50.644 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 43u unix 0xffff8f3917b1e1c0 0t0 23796 type=STREAM 2023-10-08T15:40:50.644 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 44u unix 0xffff8f3917b19dc0 0t0 698 /var/run/lttng/sessiond-notification type=STREAM 2023-10-08T15:40:50.644 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 45u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.644 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 46r FIFO 0,13 0t0 699 pipe 2023-10-08T15:40:50.644 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 47w FIFO 0,13 0t0 699 pipe 2023-10-08T15:40:50.644 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 48u unix 0xffff8f3917aca640 0t0 700 /var/run/lttng/lttng-ust-sock-8 type=STREAM 2023-10-08T15:40:50.644 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 49u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.644 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 50r FIFO 0,13 0t0 701 pipe 2023-10-08T15:40:50.644 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 51w FIFO 0,13 0t0 701 pipe 2023-10-08T15:40:50.645 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 52r FIFO 0,13 0t0 702 pipe 2023-10-08T15:40:50.645 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 53w FIFO 0,13 0t0 702 pipe 2023-10-08T15:40:50.645 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 54u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.645 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 55r FIFO 0,13 0t0 703 pipe 2023-10-08T15:40:50.645 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 56w FIFO 0,13 0t0 703 pipe 2023-10-08T15:40:50.645 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 57u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.645 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 58u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.645 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 59u IPv4 23799 0t0 TCP localhost:5345 (LISTEN) 2023-10-08T15:40:50.645 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 60r FIFO 0,13 0t0 704 pipe 2023-10-08T15:40:50.646 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 61w FIFO 0,13 0t0 704 pipe 2023-10-08T15:40:50.646 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 62u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.646 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 root 63u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.646 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.646 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.646 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root txt REG 8,1 987576 21343 /usr/bin/lttng-sessiond 2023-10-08T15:40:50.646 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root mem REG 8,1 749113 1048623 /usr/lib/modules/5.4.0-164-generic/modules.symbols.bin 2023-10-08T15:40:50.646 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root mem REG 8,1 1389809 1048620 /usr/lib/modules/5.4.0-164-generic/modules.alias.bin 2023-10-08T15:40:50.646 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root mem REG 8,1 853748 1048629 /usr/lib/modules/5.4.0-164-generic/modules.dep.bin 2023-10-08T15:40:50.647 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:50.647 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root mem REG 8,1 104984 8251 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-10-08T15:40:50.647 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root mem REG 8,1 1956992 8082 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28 2023-10-08T15:40:50.647 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root mem REG 8,1 28046896 10299 /usr/lib/x86_64-linux-gnu/libicudata.so.66.1 2023-10-08T15:40:50.647 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root mem REG 8,1 47960 12609 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-10-08T15:40:50.647 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:50.647 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:50.647 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root mem REG 8,1 1976648 10310 /usr/lib/x86_64-linux-gnu/libicuuc.so.66.1 2023-10-08T15:40:50.648 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root DEL REG 8,1 8794 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:50.648 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:50.648 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root mem REG 8,1 686160 8833 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.4 2023-10-08T15:40:50.648 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.648 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.648 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:50.648 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root mem REG 8,1 43136 21280 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.6.1.0 2023-10-08T15:40:50.648 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root mem REG 8,1 273576 18735 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.4.0.0 2023-10-08T15:40:50.648 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root mem REG 8,1 1799408 10319 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.10 2023-10-08T15:40:50.649 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.649 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root DEL REG 8,1 8351 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-10-08T15:40:50.649 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root mem REG 8,1 39480 21286 /usr/lib/x86_64-linux-gnu/liburcu.so.6.1.0 2023-10-08T15:40:50.649 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root mem REG 8,1 22520 21281 /usr/lib/x86_64-linux-gnu/liburcu-common.so.6.1.0 2023-10-08T15:40:50.649 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root mem REG 8,1 444816 21295 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-10-08T15:40:50.649 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root mem REG 8,1 112848 8859 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.5 2023-10-08T15:40:50.649 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root mem REG 8,1 10257 1048624 /usr/lib/modules/5.4.0-164-generic/modules.builtin.bin 2023-10-08T15:40:50.649 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root mem REG 8,1 25062 1048625 /usr/lib/modules/5.4.0-164-generic/modules.builtin.alias.bin 2023-10-08T15:40:50.650 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.650 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root mem REG 0,26 4096 3 /dev/shm/lttng-ust-wait-8 2023-10-08T15:40:50.650 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.650 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 1u unix 0xffff8f3919f43b80 0t0 22746 type=STREAM 2023-10-08T15:40:50.650 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 2u unix 0xffff8f3919f43b80 0t0 22746 type=STREAM 2023-10-08T15:40:50.650 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 3wW REG 0,25 0 785 /run/lttng/lttng-sessiond.lck 2023-10-08T15:40:50.650 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 4u unix 0xffff8f3917acaa80 0t0 675 type=STREAM 2023-10-08T15:40:50.650 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 5r FIFO 0,13 0t0 677 pipe 2023-10-08T15:40:50.650 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 6w FIFO 0,13 0t0 677 pipe 2023-10-08T15:40:50.651 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 7r FIFO 0,13 0t0 678 pipe 2023-10-08T15:40:50.651 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 8w FIFO 0,13 0t0 678 pipe 2023-10-08T15:40:50.651 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 9r FIFO 0,13 0t0 679 pipe 2023-10-08T15:40:50.651 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 10w FIFO 0,13 0t0 679 pipe 2023-10-08T15:40:50.651 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 11r FIFO 0,13 0t0 680 pipe 2023-10-08T15:40:50.651 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 12w FIFO 0,13 0t0 680 pipe 2023-10-08T15:40:50.651 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 13r FIFO 0,13 0t0 681 pipe 2023-10-08T15:40:50.651 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 14w FIFO 0,13 0t0 681 pipe 2023-10-08T15:40:50.651 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 15r FIFO 0,13 0t0 682 pipe 2023-10-08T15:40:50.652 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 16w FIFO 0,13 0t0 682 pipe 2023-10-08T15:40:50.652 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 17r FIFO 0,13 0t0 683 pipe 2023-10-08T15:40:50.652 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 18w FIFO 0,13 0t0 683 pipe 2023-10-08T15:40:50.652 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 19u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.652 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 20u unix 0xffff8f3917ace600 0t0 688 /var/run/lttng/kconsumerd/error type=STREAM 2023-10-08T15:40:50.652 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 21u unix 0xffff8f3917accc80 0t0 689 /var/run/lttng/ustconsumerd64/error type=STREAM 2023-10-08T15:40:50.652 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 22u unix 0xffff8f3917acb740 0t0 690 /var/run/lttng/ustconsumerd32/error type=STREAM 2023-10-08T15:40:50.652 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 23r FIFO 0,13 0t0 691 pipe 2023-10-08T15:40:50.652 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 24w FIFO 0,13 0t0 691 pipe 2023-10-08T15:40:50.653 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 25r FIFO 0,13 0t0 692 pipe 2023-10-08T15:40:50.653 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 26w FIFO 0,13 0t0 692 pipe 2023-10-08T15:40:50.653 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 27r FIFO 0,13 0t0 693 pipe 2023-10-08T15:40:50.653 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 28w FIFO 0,13 0t0 693 pipe 2023-10-08T15:40:50.653 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 29r FIFO 0,13 0t0 696 pipe 2023-10-08T15:40:50.653 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 30w FIFO 0,13 0t0 696 pipe 2023-10-08T15:40:50.653 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 31u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.653 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 32u unix 0xffff8f3917acdd80 0t0 697 /var/run/lttng/sessiond-health type=STREAM 2023-10-08T15:40:50.654 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 33r FIFO 0,13 0t0 20176 pipe 2023-10-08T15:40:50.654 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 34w FIFO 0,13 0t0 20176 pipe 2023-10-08T15:40:50.654 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 35u unix 0xffff8f3917b1a200 0t0 23795 /var/run/lttng/sessiond-notification type=STREAM 2023-10-08T15:40:50.654 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 36u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.654 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 37r FIFO 0,13 0t0 20177 pipe 2023-10-08T15:40:50.654 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 38w FIFO 0,13 0t0 20177 pipe 2023-10-08T15:40:50.654 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 39r FIFO 0,13 0t0 20178 pipe 2023-10-08T15:40:50.654 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 40w FIFO 0,13 0t0 20178 pipe 2023-10-08T15:40:50.654 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 41u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.654 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 42u unix 0xffff8f3917b2e600 0t0 20179 /var/run/lttng/client-lttng-sessiond type=STREAM 2023-10-08T15:40:50.654 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 43u unix 0xffff8f3917b1e1c0 0t0 23796 type=STREAM 2023-10-08T15:40:50.655 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 44u unix 0xffff8f3917b19dc0 0t0 698 /var/run/lttng/sessiond-notification type=STREAM 2023-10-08T15:40:50.655 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 45u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.655 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 46r FIFO 0,13 0t0 699 pipe 2023-10-08T15:40:50.655 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 47w FIFO 0,13 0t0 699 pipe 2023-10-08T15:40:50.655 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 48u unix 0xffff8f3917aca640 0t0 700 /var/run/lttng/lttng-ust-sock-8 type=STREAM 2023-10-08T15:40:50.655 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 49u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.655 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 50r FIFO 0,13 0t0 701 pipe 2023-10-08T15:40:50.655 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 51w FIFO 0,13 0t0 701 pipe 2023-10-08T15:40:50.655 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 52r FIFO 0,13 0t0 702 pipe 2023-10-08T15:40:50.655 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 53w FIFO 0,13 0t0 702 pipe 2023-10-08T15:40:50.655 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 54u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.655 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 55r FIFO 0,13 0t0 703 pipe 2023-10-08T15:40:50.656 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 56w FIFO 0,13 0t0 703 pipe 2023-10-08T15:40:50.656 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 57u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.656 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 58u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.656 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 59u IPv4 23799 0t0 TCP localhost:5345 (LISTEN) 2023-10-08T15:40:50.656 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 60r FIFO 0,13 0t0 704 pipe 2023-10-08T15:40:50.656 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 61w FIFO 0,13 0t0 704 pipe 2023-10-08T15:40:50.656 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 62u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.656 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 608 lttng-ses root 63u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.656 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.656 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.656 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root txt REG 8,1 987576 21343 /usr/bin/lttng-sessiond 2023-10-08T15:40:50.656 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root mem REG 8,1 749113 1048623 /usr/lib/modules/5.4.0-164-generic/modules.symbols.bin 2023-10-08T15:40:50.657 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root mem REG 8,1 1389809 1048620 /usr/lib/modules/5.4.0-164-generic/modules.alias.bin 2023-10-08T15:40:50.657 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root mem REG 8,1 853748 1048629 /usr/lib/modules/5.4.0-164-generic/modules.dep.bin 2023-10-08T15:40:50.657 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:50.657 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root mem REG 8,1 104984 8251 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-10-08T15:40:50.657 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root mem REG 8,1 1956992 8082 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28 2023-10-08T15:40:50.657 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root mem REG 8,1 28046896 10299 /usr/lib/x86_64-linux-gnu/libicudata.so.66.1 2023-10-08T15:40:50.657 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root mem REG 8,1 47960 12609 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-10-08T15:40:50.657 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:50.657 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:50.657 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root mem REG 8,1 1976648 10310 /usr/lib/x86_64-linux-gnu/libicuuc.so.66.1 2023-10-08T15:40:50.657 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root DEL REG 8,1 8794 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:50.658 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:50.658 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root mem REG 8,1 686160 8833 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.4 2023-10-08T15:40:50.658 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.658 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.658 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:50.658 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root mem REG 8,1 43136 21280 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.6.1.0 2023-10-08T15:40:50.658 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root mem REG 8,1 273576 18735 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.4.0.0 2023-10-08T15:40:50.658 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root mem REG 8,1 1799408 10319 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.10 2023-10-08T15:40:50.658 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.658 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root DEL REG 8,1 8351 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-10-08T15:40:50.658 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root mem REG 8,1 39480 21286 /usr/lib/x86_64-linux-gnu/liburcu.so.6.1.0 2023-10-08T15:40:50.659 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root mem REG 8,1 22520 21281 /usr/lib/x86_64-linux-gnu/liburcu-common.so.6.1.0 2023-10-08T15:40:50.659 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root mem REG 8,1 444816 21295 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-10-08T15:40:50.659 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root mem REG 8,1 112848 8859 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.5 2023-10-08T15:40:50.659 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root mem REG 8,1 10257 1048624 /usr/lib/modules/5.4.0-164-generic/modules.builtin.bin 2023-10-08T15:40:50.659 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root mem REG 8,1 25062 1048625 /usr/lib/modules/5.4.0-164-generic/modules.builtin.alias.bin 2023-10-08T15:40:50.659 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.659 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root mem REG 0,26 4096 3 /dev/shm/lttng-ust-wait-8 2023-10-08T15:40:50.659 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.659 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 1u unix 0xffff8f3919f43b80 0t0 22746 type=STREAM 2023-10-08T15:40:50.659 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 2u unix 0xffff8f3919f43b80 0t0 22746 type=STREAM 2023-10-08T15:40:50.659 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 3wW REG 0,25 0 785 /run/lttng/lttng-sessiond.lck 2023-10-08T15:40:50.660 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 4u unix 0xffff8f3917acaa80 0t0 675 type=STREAM 2023-10-08T15:40:50.660 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 5r FIFO 0,13 0t0 677 pipe 2023-10-08T15:40:50.660 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 6w FIFO 0,13 0t0 677 pipe 2023-10-08T15:40:50.660 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 7r FIFO 0,13 0t0 678 pipe 2023-10-08T15:40:50.660 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 8w FIFO 0,13 0t0 678 pipe 2023-10-08T15:40:50.660 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 9r FIFO 0,13 0t0 679 pipe 2023-10-08T15:40:50.660 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 10w FIFO 0,13 0t0 679 pipe 2023-10-08T15:40:50.660 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 11r FIFO 0,13 0t0 680 pipe 2023-10-08T15:40:50.660 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 12w FIFO 0,13 0t0 680 pipe 2023-10-08T15:40:50.660 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 13r FIFO 0,13 0t0 681 pipe 2023-10-08T15:40:50.660 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 14w FIFO 0,13 0t0 681 pipe 2023-10-08T15:40:50.661 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 15r FIFO 0,13 0t0 682 pipe 2023-10-08T15:40:50.661 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 16w FIFO 0,13 0t0 682 pipe 2023-10-08T15:40:50.661 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 17r FIFO 0,13 0t0 683 pipe 2023-10-08T15:40:50.661 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 18w FIFO 0,13 0t0 683 pipe 2023-10-08T15:40:50.661 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 19u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.661 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 20u unix 0xffff8f3917ace600 0t0 688 /var/run/lttng/kconsumerd/error type=STREAM 2023-10-08T15:40:50.661 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 21u unix 0xffff8f3917accc80 0t0 689 /var/run/lttng/ustconsumerd64/error type=STREAM 2023-10-08T15:40:50.661 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 22u unix 0xffff8f3917acb740 0t0 690 /var/run/lttng/ustconsumerd32/error type=STREAM 2023-10-08T15:40:50.661 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 23r FIFO 0,13 0t0 691 pipe 2023-10-08T15:40:50.661 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 24w FIFO 0,13 0t0 691 pipe 2023-10-08T15:40:50.661 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 25r FIFO 0,13 0t0 692 pipe 2023-10-08T15:40:50.662 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 26w FIFO 0,13 0t0 692 pipe 2023-10-08T15:40:50.662 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 27r FIFO 0,13 0t0 693 pipe 2023-10-08T15:40:50.662 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 28w FIFO 0,13 0t0 693 pipe 2023-10-08T15:40:50.662 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 29r FIFO 0,13 0t0 696 pipe 2023-10-08T15:40:50.662 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 30w FIFO 0,13 0t0 696 pipe 2023-10-08T15:40:50.662 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 31u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.662 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 32u unix 0xffff8f3917acdd80 0t0 697 /var/run/lttng/sessiond-health type=STREAM 2023-10-08T15:40:50.662 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 33r FIFO 0,13 0t0 20176 pipe 2023-10-08T15:40:50.662 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 34w FIFO 0,13 0t0 20176 pipe 2023-10-08T15:40:50.662 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 35u unix 0xffff8f3917b1a200 0t0 23795 /var/run/lttng/sessiond-notification type=STREAM 2023-10-08T15:40:50.662 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 36u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.663 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 37r FIFO 0,13 0t0 20177 pipe 2023-10-08T15:40:50.663 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 38w FIFO 0,13 0t0 20177 pipe 2023-10-08T15:40:50.663 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 39r FIFO 0,13 0t0 20178 pipe 2023-10-08T15:40:50.663 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 40w FIFO 0,13 0t0 20178 pipe 2023-10-08T15:40:50.663 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 41u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.663 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 42u unix 0xffff8f3917b2e600 0t0 20179 /var/run/lttng/client-lttng-sessiond type=STREAM 2023-10-08T15:40:50.663 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 43u unix 0xffff8f3917b1e1c0 0t0 23796 type=STREAM 2023-10-08T15:40:50.663 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 44u unix 0xffff8f3917b19dc0 0t0 698 /var/run/lttng/sessiond-notification type=STREAM 2023-10-08T15:40:50.663 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 45u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.664 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 46r FIFO 0,13 0t0 699 pipe 2023-10-08T15:40:50.664 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 47w FIFO 0,13 0t0 699 pipe 2023-10-08T15:40:50.664 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 48u unix 0xffff8f3917aca640 0t0 700 /var/run/lttng/lttng-ust-sock-8 type=STREAM 2023-10-08T15:40:50.664 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 49u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.664 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 50r FIFO 0,13 0t0 701 pipe 2023-10-08T15:40:50.664 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 51w FIFO 0,13 0t0 701 pipe 2023-10-08T15:40:50.664 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 52r FIFO 0,13 0t0 702 pipe 2023-10-08T15:40:50.664 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 53w FIFO 0,13 0t0 702 pipe 2023-10-08T15:40:50.664 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 54u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.664 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 55r FIFO 0,13 0t0 703 pipe 2023-10-08T15:40:50.664 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 56w FIFO 0,13 0t0 703 pipe 2023-10-08T15:40:50.665 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 57u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.665 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 58u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.665 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 59u IPv4 23799 0t0 TCP localhost:5345 (LISTEN) 2023-10-08T15:40:50.665 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 60r FIFO 0,13 0t0 704 pipe 2023-10-08T15:40:50.665 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 61w FIFO 0,13 0t0 704 pipe 2023-10-08T15:40:50.665 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 62u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.665 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 609 lttng-ses root 63u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.665 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.666 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.666 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root txt REG 8,1 987576 21343 /usr/bin/lttng-sessiond 2023-10-08T15:40:50.666 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root mem REG 8,1 749113 1048623 /usr/lib/modules/5.4.0-164-generic/modules.symbols.bin 2023-10-08T15:40:50.666 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root mem REG 8,1 1389809 1048620 /usr/lib/modules/5.4.0-164-generic/modules.alias.bin 2023-10-08T15:40:50.666 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root mem REG 8,1 853748 1048629 /usr/lib/modules/5.4.0-164-generic/modules.dep.bin 2023-10-08T15:40:50.666 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:50.666 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root mem REG 8,1 104984 8251 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-10-08T15:40:50.666 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root mem REG 8,1 1956992 8082 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28 2023-10-08T15:40:50.666 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root mem REG 8,1 28046896 10299 /usr/lib/x86_64-linux-gnu/libicudata.so.66.1 2023-10-08T15:40:50.667 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root mem REG 8,1 47960 12609 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-10-08T15:40:50.667 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:50.667 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:50.667 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root mem REG 8,1 1976648 10310 /usr/lib/x86_64-linux-gnu/libicuuc.so.66.1 2023-10-08T15:40:50.667 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root DEL REG 8,1 8794 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:50.667 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:50.667 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root mem REG 8,1 686160 8833 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.4 2023-10-08T15:40:50.667 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.667 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.668 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:50.668 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root mem REG 8,1 43136 21280 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.6.1.0 2023-10-08T15:40:50.668 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root mem REG 8,1 273576 18735 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.4.0.0 2023-10-08T15:40:50.668 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root mem REG 8,1 1799408 10319 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.10 2023-10-08T15:40:50.668 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.668 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root DEL REG 8,1 8351 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-10-08T15:40:50.668 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root mem REG 8,1 39480 21286 /usr/lib/x86_64-linux-gnu/liburcu.so.6.1.0 2023-10-08T15:40:50.668 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root mem REG 8,1 22520 21281 /usr/lib/x86_64-linux-gnu/liburcu-common.so.6.1.0 2023-10-08T15:40:50.669 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root mem REG 8,1 444816 21295 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-10-08T15:40:50.669 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root mem REG 8,1 112848 8859 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.5 2023-10-08T15:40:50.669 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root mem REG 8,1 10257 1048624 /usr/lib/modules/5.4.0-164-generic/modules.builtin.bin 2023-10-08T15:40:50.669 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root mem REG 8,1 25062 1048625 /usr/lib/modules/5.4.0-164-generic/modules.builtin.alias.bin 2023-10-08T15:40:50.669 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.669 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root mem REG 0,26 4096 3 /dev/shm/lttng-ust-wait-8 2023-10-08T15:40:50.669 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.669 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 1u unix 0xffff8f3919f43b80 0t0 22746 type=STREAM 2023-10-08T15:40:50.669 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 2u unix 0xffff8f3919f43b80 0t0 22746 type=STREAM 2023-10-08T15:40:50.670 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 3wW REG 0,25 0 785 /run/lttng/lttng-sessiond.lck 2023-10-08T15:40:50.670 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 4u unix 0xffff8f3917acaa80 0t0 675 type=STREAM 2023-10-08T15:40:50.670 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 5r FIFO 0,13 0t0 677 pipe 2023-10-08T15:40:50.670 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 6w FIFO 0,13 0t0 677 pipe 2023-10-08T15:40:50.670 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 7r FIFO 0,13 0t0 678 pipe 2023-10-08T15:40:50.670 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 8w FIFO 0,13 0t0 678 pipe 2023-10-08T15:40:50.670 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 9r FIFO 0,13 0t0 679 pipe 2023-10-08T15:40:50.670 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 10w FIFO 0,13 0t0 679 pipe 2023-10-08T15:40:50.670 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 11r FIFO 0,13 0t0 680 pipe 2023-10-08T15:40:50.670 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 12w FIFO 0,13 0t0 680 pipe 2023-10-08T15:40:50.671 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 13r FIFO 0,13 0t0 681 pipe 2023-10-08T15:40:50.671 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 14w FIFO 0,13 0t0 681 pipe 2023-10-08T15:40:50.671 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 15r FIFO 0,13 0t0 682 pipe 2023-10-08T15:40:50.671 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 16w FIFO 0,13 0t0 682 pipe 2023-10-08T15:40:50.671 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 17r FIFO 0,13 0t0 683 pipe 2023-10-08T15:40:50.671 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 18w FIFO 0,13 0t0 683 pipe 2023-10-08T15:40:50.671 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 19u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.671 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 20u unix 0xffff8f3917ace600 0t0 688 /var/run/lttng/kconsumerd/error type=STREAM 2023-10-08T15:40:50.671 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 21u unix 0xffff8f3917accc80 0t0 689 /var/run/lttng/ustconsumerd64/error type=STREAM 2023-10-08T15:40:50.672 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 22u unix 0xffff8f3917acb740 0t0 690 /var/run/lttng/ustconsumerd32/error type=STREAM 2023-10-08T15:40:50.672 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 23r FIFO 0,13 0t0 691 pipe 2023-10-08T15:40:50.672 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 24w FIFO 0,13 0t0 691 pipe 2023-10-08T15:40:50.672 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 25r FIFO 0,13 0t0 692 pipe 2023-10-08T15:40:50.672 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 26w FIFO 0,13 0t0 692 pipe 2023-10-08T15:40:50.672 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 27r FIFO 0,13 0t0 693 pipe 2023-10-08T15:40:50.672 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 28w FIFO 0,13 0t0 693 pipe 2023-10-08T15:40:50.672 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 29r FIFO 0,13 0t0 696 pipe 2023-10-08T15:40:50.672 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 30w FIFO 0,13 0t0 696 pipe 2023-10-08T15:40:50.673 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 31u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.673 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 32u unix 0xffff8f3917acdd80 0t0 697 /var/run/lttng/sessiond-health type=STREAM 2023-10-08T15:40:50.673 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 33r FIFO 0,13 0t0 20176 pipe 2023-10-08T15:40:50.673 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 34w FIFO 0,13 0t0 20176 pipe 2023-10-08T15:40:50.673 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 35u unix 0xffff8f3917b1a200 0t0 23795 /var/run/lttng/sessiond-notification type=STREAM 2023-10-08T15:40:50.673 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 36u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.673 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 37r FIFO 0,13 0t0 20177 pipe 2023-10-08T15:40:50.673 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 38w FIFO 0,13 0t0 20177 pipe 2023-10-08T15:40:50.673 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 39r FIFO 0,13 0t0 20178 pipe 2023-10-08T15:40:50.673 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 40w FIFO 0,13 0t0 20178 pipe 2023-10-08T15:40:50.673 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 41u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.673 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 42u unix 0xffff8f3917b2e600 0t0 20179 /var/run/lttng/client-lttng-sessiond type=STREAM 2023-10-08T15:40:50.674 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 43u unix 0xffff8f3917b1e1c0 0t0 23796 type=STREAM 2023-10-08T15:40:50.674 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 44u unix 0xffff8f3917b19dc0 0t0 698 /var/run/lttng/sessiond-notification type=STREAM 2023-10-08T15:40:50.674 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 45u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.674 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 46r FIFO 0,13 0t0 699 pipe 2023-10-08T15:40:50.674 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 47w FIFO 0,13 0t0 699 pipe 2023-10-08T15:40:50.674 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 48u unix 0xffff8f3917aca640 0t0 700 /var/run/lttng/lttng-ust-sock-8 type=STREAM 2023-10-08T15:40:50.674 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 49u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.674 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 50r FIFO 0,13 0t0 701 pipe 2023-10-08T15:40:50.674 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 51w FIFO 0,13 0t0 701 pipe 2023-10-08T15:40:50.674 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 52r FIFO 0,13 0t0 702 pipe 2023-10-08T15:40:50.675 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 53w FIFO 0,13 0t0 702 pipe 2023-10-08T15:40:50.675 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 54u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.675 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 55r FIFO 0,13 0t0 703 pipe 2023-10-08T15:40:50.675 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 56w FIFO 0,13 0t0 703 pipe 2023-10-08T15:40:50.675 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 57u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.675 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 58u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.675 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 59u IPv4 23799 0t0 TCP localhost:5345 (LISTEN) 2023-10-08T15:40:50.675 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 60r FIFO 0,13 0t0 704 pipe 2023-10-08T15:40:50.675 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 61w FIFO 0,13 0t0 704 pipe 2023-10-08T15:40:50.675 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 62u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.676 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 610 lttng-ses root 63u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.676 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.676 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.676 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root txt REG 8,1 987576 21343 /usr/bin/lttng-sessiond 2023-10-08T15:40:50.676 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root mem REG 8,1 749113 1048623 /usr/lib/modules/5.4.0-164-generic/modules.symbols.bin 2023-10-08T15:40:50.676 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root mem REG 8,1 1389809 1048620 /usr/lib/modules/5.4.0-164-generic/modules.alias.bin 2023-10-08T15:40:50.676 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root mem REG 8,1 853748 1048629 /usr/lib/modules/5.4.0-164-generic/modules.dep.bin 2023-10-08T15:40:50.676 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:50.676 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root mem REG 8,1 104984 8251 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-10-08T15:40:50.676 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root mem REG 8,1 1956992 8082 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28 2023-10-08T15:40:50.677 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root mem REG 8,1 28046896 10299 /usr/lib/x86_64-linux-gnu/libicudata.so.66.1 2023-10-08T15:40:50.677 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root mem REG 8,1 47960 12609 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-10-08T15:40:50.677 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:50.677 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:50.677 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root mem REG 8,1 1976648 10310 /usr/lib/x86_64-linux-gnu/libicuuc.so.66.1 2023-10-08T15:40:50.677 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root DEL REG 8,1 8794 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:50.677 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:50.677 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root mem REG 8,1 686160 8833 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.4 2023-10-08T15:40:50.678 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.678 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.678 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:50.678 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root mem REG 8,1 43136 21280 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.6.1.0 2023-10-08T15:40:50.678 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root mem REG 8,1 273576 18735 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.4.0.0 2023-10-08T15:40:50.678 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root mem REG 8,1 1799408 10319 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.10 2023-10-08T15:40:50.678 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.678 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root DEL REG 8,1 8351 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-10-08T15:40:50.678 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root mem REG 8,1 39480 21286 /usr/lib/x86_64-linux-gnu/liburcu.so.6.1.0 2023-10-08T15:40:50.678 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root mem REG 8,1 22520 21281 /usr/lib/x86_64-linux-gnu/liburcu-common.so.6.1.0 2023-10-08T15:40:50.679 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root mem REG 8,1 444816 21295 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-10-08T15:40:50.679 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root mem REG 8,1 112848 8859 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.5 2023-10-08T15:40:50.679 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root mem REG 8,1 10257 1048624 /usr/lib/modules/5.4.0-164-generic/modules.builtin.bin 2023-10-08T15:40:50.679 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root mem REG 8,1 25062 1048625 /usr/lib/modules/5.4.0-164-generic/modules.builtin.alias.bin 2023-10-08T15:40:50.679 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.679 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root mem REG 0,26 4096 3 /dev/shm/lttng-ust-wait-8 2023-10-08T15:40:50.679 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.679 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 1u unix 0xffff8f3919f43b80 0t0 22746 type=STREAM 2023-10-08T15:40:50.679 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 2u unix 0xffff8f3919f43b80 0t0 22746 type=STREAM 2023-10-08T15:40:50.680 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 3wW REG 0,25 0 785 /run/lttng/lttng-sessiond.lck 2023-10-08T15:40:50.680 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 4u unix 0xffff8f3917acaa80 0t0 675 type=STREAM 2023-10-08T15:40:50.680 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 5r FIFO 0,13 0t0 677 pipe 2023-10-08T15:40:50.680 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 6w FIFO 0,13 0t0 677 pipe 2023-10-08T15:40:50.680 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 7r FIFO 0,13 0t0 678 pipe 2023-10-08T15:40:50.680 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 8w FIFO 0,13 0t0 678 pipe 2023-10-08T15:40:50.680 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 9r FIFO 0,13 0t0 679 pipe 2023-10-08T15:40:50.680 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 10w FIFO 0,13 0t0 679 pipe 2023-10-08T15:40:50.680 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 11r FIFO 0,13 0t0 680 pipe 2023-10-08T15:40:50.681 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 12w FIFO 0,13 0t0 680 pipe 2023-10-08T15:40:50.681 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 13r FIFO 0,13 0t0 681 pipe 2023-10-08T15:40:50.681 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 14w FIFO 0,13 0t0 681 pipe 2023-10-08T15:40:50.681 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 15r FIFO 0,13 0t0 682 pipe 2023-10-08T15:40:50.681 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 16w FIFO 0,13 0t0 682 pipe 2023-10-08T15:40:50.681 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 17r FIFO 0,13 0t0 683 pipe 2023-10-08T15:40:50.681 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 18w FIFO 0,13 0t0 683 pipe 2023-10-08T15:40:50.681 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 19u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.681 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 20u unix 0xffff8f3917ace600 0t0 688 /var/run/lttng/kconsumerd/error type=STREAM 2023-10-08T15:40:50.682 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 21u unix 0xffff8f3917accc80 0t0 689 /var/run/lttng/ustconsumerd64/error type=STREAM 2023-10-08T15:40:50.682 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 22u unix 0xffff8f3917acb740 0t0 690 /var/run/lttng/ustconsumerd32/error type=STREAM 2023-10-08T15:40:50.682 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 23r FIFO 0,13 0t0 691 pipe 2023-10-08T15:40:50.682 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 24w FIFO 0,13 0t0 691 pipe 2023-10-08T15:40:50.682 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 25r FIFO 0,13 0t0 692 pipe 2023-10-08T15:40:50.682 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 26w FIFO 0,13 0t0 692 pipe 2023-10-08T15:40:50.682 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 27r FIFO 0,13 0t0 693 pipe 2023-10-08T15:40:50.682 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 28w FIFO 0,13 0t0 693 pipe 2023-10-08T15:40:50.682 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 29r FIFO 0,13 0t0 696 pipe 2023-10-08T15:40:50.683 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 30w FIFO 0,13 0t0 696 pipe 2023-10-08T15:40:50.683 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 31u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.683 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 32u unix 0xffff8f3917acdd80 0t0 697 /var/run/lttng/sessiond-health type=STREAM 2023-10-08T15:40:50.683 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 33r FIFO 0,13 0t0 20176 pipe 2023-10-08T15:40:50.683 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 34w FIFO 0,13 0t0 20176 pipe 2023-10-08T15:40:50.683 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 35u unix 0xffff8f3917b1a200 0t0 23795 /var/run/lttng/sessiond-notification type=STREAM 2023-10-08T15:40:50.683 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 36u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.683 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 37r FIFO 0,13 0t0 20177 pipe 2023-10-08T15:40:50.683 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 38w FIFO 0,13 0t0 20177 pipe 2023-10-08T15:40:50.685 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 39r FIFO 0,13 0t0 20178 pipe 2023-10-08T15:40:50.685 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 40w FIFO 0,13 0t0 20178 pipe 2023-10-08T15:40:50.685 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 41u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.685 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 42u unix 0xffff8f3917b2e600 0t0 20179 /var/run/lttng/client-lttng-sessiond type=STREAM 2023-10-08T15:40:50.685 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 43u unix 0xffff8f3917b1e1c0 0t0 23796 type=STREAM 2023-10-08T15:40:50.685 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 44u unix 0xffff8f3917b19dc0 0t0 698 /var/run/lttng/sessiond-notification type=STREAM 2023-10-08T15:40:50.685 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 45u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.685 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 46r FIFO 0,13 0t0 699 pipe 2023-10-08T15:40:50.685 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 47w FIFO 0,13 0t0 699 pipe 2023-10-08T15:40:50.686 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 48u unix 0xffff8f3917aca640 0t0 700 /var/run/lttng/lttng-ust-sock-8 type=STREAM 2023-10-08T15:40:50.686 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 49u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.686 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 50r FIFO 0,13 0t0 701 pipe 2023-10-08T15:40:50.686 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 51w FIFO 0,13 0t0 701 pipe 2023-10-08T15:40:50.686 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 52r FIFO 0,13 0t0 702 pipe 2023-10-08T15:40:50.686 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 53w FIFO 0,13 0t0 702 pipe 2023-10-08T15:40:50.686 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 54u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.686 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 55r FIFO 0,13 0t0 703 pipe 2023-10-08T15:40:50.686 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 56w FIFO 0,13 0t0 703 pipe 2023-10-08T15:40:50.686 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 57u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.686 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 58u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.687 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 59u IPv4 23799 0t0 TCP localhost:5345 (LISTEN) 2023-10-08T15:40:50.687 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 60r FIFO 0,13 0t0 704 pipe 2023-10-08T15:40:50.687 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 61w FIFO 0,13 0t0 704 pipe 2023-10-08T15:40:50.687 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 62u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.687 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 611 lttng-ses root 63u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.687 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.687 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.687 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root txt REG 8,1 987576 21343 /usr/bin/lttng-sessiond 2023-10-08T15:40:50.687 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root mem REG 8,1 749113 1048623 /usr/lib/modules/5.4.0-164-generic/modules.symbols.bin 2023-10-08T15:40:50.688 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root mem REG 8,1 1389809 1048620 /usr/lib/modules/5.4.0-164-generic/modules.alias.bin 2023-10-08T15:40:50.688 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root mem REG 8,1 853748 1048629 /usr/lib/modules/5.4.0-164-generic/modules.dep.bin 2023-10-08T15:40:50.688 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:50.688 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root mem REG 8,1 104984 8251 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-10-08T15:40:50.688 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root mem REG 8,1 1956992 8082 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28 2023-10-08T15:40:50.688 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root mem REG 8,1 28046896 10299 /usr/lib/x86_64-linux-gnu/libicudata.so.66.1 2023-10-08T15:40:50.688 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root mem REG 8,1 47960 12609 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-10-08T15:40:50.688 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:50.688 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:50.688 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root mem REG 8,1 1976648 10310 /usr/lib/x86_64-linux-gnu/libicuuc.so.66.1 2023-10-08T15:40:50.688 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root DEL REG 8,1 8794 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:50.689 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:50.689 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root mem REG 8,1 686160 8833 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.4 2023-10-08T15:40:50.689 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.689 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.689 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:50.689 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root mem REG 8,1 43136 21280 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.6.1.0 2023-10-08T15:40:50.689 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root mem REG 8,1 273576 18735 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.4.0.0 2023-10-08T15:40:50.689 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root mem REG 8,1 1799408 10319 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.10 2023-10-08T15:40:50.689 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.689 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root DEL REG 8,1 8351 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-10-08T15:40:50.689 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root mem REG 8,1 39480 21286 /usr/lib/x86_64-linux-gnu/liburcu.so.6.1.0 2023-10-08T15:40:50.690 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root mem REG 8,1 22520 21281 /usr/lib/x86_64-linux-gnu/liburcu-common.so.6.1.0 2023-10-08T15:40:50.690 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root mem REG 8,1 444816 21295 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-10-08T15:40:50.690 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root mem REG 8,1 112848 8859 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.5 2023-10-08T15:40:50.690 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root mem REG 8,1 10257 1048624 /usr/lib/modules/5.4.0-164-generic/modules.builtin.bin 2023-10-08T15:40:50.690 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root mem REG 8,1 25062 1048625 /usr/lib/modules/5.4.0-164-generic/modules.builtin.alias.bin 2023-10-08T15:40:50.690 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.690 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root mem REG 0,26 4096 3 /dev/shm/lttng-ust-wait-8 2023-10-08T15:40:50.690 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.690 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 1u unix 0xffff8f3919f43b80 0t0 22746 type=STREAM 2023-10-08T15:40:50.690 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 2u unix 0xffff8f3919f43b80 0t0 22746 type=STREAM 2023-10-08T15:40:50.690 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 3wW REG 0,25 0 785 /run/lttng/lttng-sessiond.lck 2023-10-08T15:40:50.691 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 4u unix 0xffff8f3917acaa80 0t0 675 type=STREAM 2023-10-08T15:40:50.691 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 5r FIFO 0,13 0t0 677 pipe 2023-10-08T15:40:50.691 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 6w FIFO 0,13 0t0 677 pipe 2023-10-08T15:40:50.691 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 7r FIFO 0,13 0t0 678 pipe 2023-10-08T15:40:50.691 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 8w FIFO 0,13 0t0 678 pipe 2023-10-08T15:40:50.691 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 9r FIFO 0,13 0t0 679 pipe 2023-10-08T15:40:50.691 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 10w FIFO 0,13 0t0 679 pipe 2023-10-08T15:40:50.691 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 11r FIFO 0,13 0t0 680 pipe 2023-10-08T15:40:50.691 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 12w FIFO 0,13 0t0 680 pipe 2023-10-08T15:40:50.691 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 13r FIFO 0,13 0t0 681 pipe 2023-10-08T15:40:50.691 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 14w FIFO 0,13 0t0 681 pipe 2023-10-08T15:40:50.692 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 15r FIFO 0,13 0t0 682 pipe 2023-10-08T15:40:50.692 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 16w FIFO 0,13 0t0 682 pipe 2023-10-08T15:40:50.692 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 17r FIFO 0,13 0t0 683 pipe 2023-10-08T15:40:50.692 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 18w FIFO 0,13 0t0 683 pipe 2023-10-08T15:40:50.692 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 19u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.692 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 20u unix 0xffff8f3917ace600 0t0 688 /var/run/lttng/kconsumerd/error type=STREAM 2023-10-08T15:40:50.692 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 21u unix 0xffff8f3917accc80 0t0 689 /var/run/lttng/ustconsumerd64/error type=STREAM 2023-10-08T15:40:50.692 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 22u unix 0xffff8f3917acb740 0t0 690 /var/run/lttng/ustconsumerd32/error type=STREAM 2023-10-08T15:40:50.692 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 23r FIFO 0,13 0t0 691 pipe 2023-10-08T15:40:50.692 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 24w FIFO 0,13 0t0 691 pipe 2023-10-08T15:40:50.692 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 25r FIFO 0,13 0t0 692 pipe 2023-10-08T15:40:50.693 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 26w FIFO 0,13 0t0 692 pipe 2023-10-08T15:40:50.693 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 27r FIFO 0,13 0t0 693 pipe 2023-10-08T15:40:50.693 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 28w FIFO 0,13 0t0 693 pipe 2023-10-08T15:40:50.693 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 29r FIFO 0,13 0t0 696 pipe 2023-10-08T15:40:50.693 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 30w FIFO 0,13 0t0 696 pipe 2023-10-08T15:40:50.693 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 31u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.693 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 32u unix 0xffff8f3917acdd80 0t0 697 /var/run/lttng/sessiond-health type=STREAM 2023-10-08T15:40:50.693 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 33r FIFO 0,13 0t0 20176 pipe 2023-10-08T15:40:50.693 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 34w FIFO 0,13 0t0 20176 pipe 2023-10-08T15:40:50.693 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 35u unix 0xffff8f3917b1a200 0t0 23795 /var/run/lttng/sessiond-notification type=STREAM 2023-10-08T15:40:50.694 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 36u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.694 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 37r FIFO 0,13 0t0 20177 pipe 2023-10-08T15:40:50.694 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 38w FIFO 0,13 0t0 20177 pipe 2023-10-08T15:40:50.694 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 39r FIFO 0,13 0t0 20178 pipe 2023-10-08T15:40:50.694 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 40w FIFO 0,13 0t0 20178 pipe 2023-10-08T15:40:50.694 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 41u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.694 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 42u unix 0xffff8f3917b2e600 0t0 20179 /var/run/lttng/client-lttng-sessiond type=STREAM 2023-10-08T15:40:50.694 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 43u unix 0xffff8f3917b1e1c0 0t0 23796 type=STREAM 2023-10-08T15:40:50.694 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 44u unix 0xffff8f3917b19dc0 0t0 698 /var/run/lttng/sessiond-notification type=STREAM 2023-10-08T15:40:50.695 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 45u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.695 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 46r FIFO 0,13 0t0 699 pipe 2023-10-08T15:40:50.695 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 47w FIFO 0,13 0t0 699 pipe 2023-10-08T15:40:50.695 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 48u unix 0xffff8f3917aca640 0t0 700 /var/run/lttng/lttng-ust-sock-8 type=STREAM 2023-10-08T15:40:50.695 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 49u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.695 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 50r FIFO 0,13 0t0 701 pipe 2023-10-08T15:40:50.695 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 51w FIFO 0,13 0t0 701 pipe 2023-10-08T15:40:50.695 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 52r FIFO 0,13 0t0 702 pipe 2023-10-08T15:40:50.695 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 53w FIFO 0,13 0t0 702 pipe 2023-10-08T15:40:50.695 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 54u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.696 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 55r FIFO 0,13 0t0 703 pipe 2023-10-08T15:40:50.696 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 56w FIFO 0,13 0t0 703 pipe 2023-10-08T15:40:50.696 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 57u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.696 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 58u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.696 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 59u IPv4 23799 0t0 TCP localhost:5345 (LISTEN) 2023-10-08T15:40:50.696 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 60r FIFO 0,13 0t0 704 pipe 2023-10-08T15:40:50.696 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 61w FIFO 0,13 0t0 704 pipe 2023-10-08T15:40:50.696 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 62u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.696 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 612 lttng-ses root 63u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.697 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.697 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.697 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root txt REG 8,1 987576 21343 /usr/bin/lttng-sessiond 2023-10-08T15:40:50.697 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root mem REG 8,1 749113 1048623 /usr/lib/modules/5.4.0-164-generic/modules.symbols.bin 2023-10-08T15:40:50.697 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root mem REG 8,1 1389809 1048620 /usr/lib/modules/5.4.0-164-generic/modules.alias.bin 2023-10-08T15:40:50.697 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root mem REG 8,1 853748 1048629 /usr/lib/modules/5.4.0-164-generic/modules.dep.bin 2023-10-08T15:40:50.697 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:50.697 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root mem REG 8,1 104984 8251 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-10-08T15:40:50.697 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root mem REG 8,1 1956992 8082 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28 2023-10-08T15:40:50.698 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root mem REG 8,1 28046896 10299 /usr/lib/x86_64-linux-gnu/libicudata.so.66.1 2023-10-08T15:40:50.698 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root mem REG 8,1 47960 12609 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-10-08T15:40:50.698 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:50.698 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:50.698 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root mem REG 8,1 1976648 10310 /usr/lib/x86_64-linux-gnu/libicuuc.so.66.1 2023-10-08T15:40:50.698 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root DEL REG 8,1 8794 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:50.698 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:50.698 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root mem REG 8,1 686160 8833 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.4 2023-10-08T15:40:50.698 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.699 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.699 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:50.699 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root mem REG 8,1 43136 21280 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.6.1.0 2023-10-08T15:40:50.699 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root mem REG 8,1 273576 18735 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.4.0.0 2023-10-08T15:40:50.699 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root mem REG 8,1 1799408 10319 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.10 2023-10-08T15:40:50.699 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.699 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root DEL REG 8,1 8351 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-10-08T15:40:50.699 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root mem REG 8,1 39480 21286 /usr/lib/x86_64-linux-gnu/liburcu.so.6.1.0 2023-10-08T15:40:50.699 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root mem REG 8,1 22520 21281 /usr/lib/x86_64-linux-gnu/liburcu-common.so.6.1.0 2023-10-08T15:40:50.700 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root mem REG 8,1 444816 21295 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-10-08T15:40:50.700 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root mem REG 8,1 112848 8859 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.5 2023-10-08T15:40:50.700 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root mem REG 8,1 10257 1048624 /usr/lib/modules/5.4.0-164-generic/modules.builtin.bin 2023-10-08T15:40:50.700 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root mem REG 8,1 25062 1048625 /usr/lib/modules/5.4.0-164-generic/modules.builtin.alias.bin 2023-10-08T15:40:50.700 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.700 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root mem REG 0,26 4096 3 /dev/shm/lttng-ust-wait-8 2023-10-08T15:40:50.700 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.700 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 1u unix 0xffff8f3919f43b80 0t0 22746 type=STREAM 2023-10-08T15:40:50.700 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 2u unix 0xffff8f3919f43b80 0t0 22746 type=STREAM 2023-10-08T15:40:50.701 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 3wW REG 0,25 0 785 /run/lttng/lttng-sessiond.lck 2023-10-08T15:40:50.701 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 4u unix 0xffff8f3917acaa80 0t0 675 type=STREAM 2023-10-08T15:40:50.701 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 5r FIFO 0,13 0t0 677 pipe 2023-10-08T15:40:50.701 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 6w FIFO 0,13 0t0 677 pipe 2023-10-08T15:40:50.701 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 7r FIFO 0,13 0t0 678 pipe 2023-10-08T15:40:50.701 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 8w FIFO 0,13 0t0 678 pipe 2023-10-08T15:40:50.701 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 9r FIFO 0,13 0t0 679 pipe 2023-10-08T15:40:50.701 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 10w FIFO 0,13 0t0 679 pipe 2023-10-08T15:40:50.701 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 11r FIFO 0,13 0t0 680 pipe 2023-10-08T15:40:50.702 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 12w FIFO 0,13 0t0 680 pipe 2023-10-08T15:40:50.702 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 13r FIFO 0,13 0t0 681 pipe 2023-10-08T15:40:50.702 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 14w FIFO 0,13 0t0 681 pipe 2023-10-08T15:40:50.702 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 15r FIFO 0,13 0t0 682 pipe 2023-10-08T15:40:50.702 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 16w FIFO 0,13 0t0 682 pipe 2023-10-08T15:40:50.702 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 17r FIFO 0,13 0t0 683 pipe 2023-10-08T15:40:50.702 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 18w FIFO 0,13 0t0 683 pipe 2023-10-08T15:40:50.702 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 19u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.702 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 20u unix 0xffff8f3917ace600 0t0 688 /var/run/lttng/kconsumerd/error type=STREAM 2023-10-08T15:40:50.703 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 21u unix 0xffff8f3917accc80 0t0 689 /var/run/lttng/ustconsumerd64/error type=STREAM 2023-10-08T15:40:50.703 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 22u unix 0xffff8f3917acb740 0t0 690 /var/run/lttng/ustconsumerd32/error type=STREAM 2023-10-08T15:40:50.703 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 23r FIFO 0,13 0t0 691 pipe 2023-10-08T15:40:50.703 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 24w FIFO 0,13 0t0 691 pipe 2023-10-08T15:40:50.703 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 25r FIFO 0,13 0t0 692 pipe 2023-10-08T15:40:50.703 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 26w FIFO 0,13 0t0 692 pipe 2023-10-08T15:40:50.703 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 27r FIFO 0,13 0t0 693 pipe 2023-10-08T15:40:50.703 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 28w FIFO 0,13 0t0 693 pipe 2023-10-08T15:40:50.703 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 29r FIFO 0,13 0t0 696 pipe 2023-10-08T15:40:50.704 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 30w FIFO 0,13 0t0 696 pipe 2023-10-08T15:40:50.704 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 31u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.704 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 32u unix 0xffff8f3917acdd80 0t0 697 /var/run/lttng/sessiond-health type=STREAM 2023-10-08T15:40:50.704 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 33r FIFO 0,13 0t0 20176 pipe 2023-10-08T15:40:50.704 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 34w FIFO 0,13 0t0 20176 pipe 2023-10-08T15:40:50.704 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 35u unix 0xffff8f3917b1a200 0t0 23795 /var/run/lttng/sessiond-notification type=STREAM 2023-10-08T15:40:50.704 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 36u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.704 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 37r FIFO 0,13 0t0 20177 pipe 2023-10-08T15:40:50.704 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 38w FIFO 0,13 0t0 20177 pipe 2023-10-08T15:40:50.704 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 39r FIFO 0,13 0t0 20178 pipe 2023-10-08T15:40:50.705 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 40w FIFO 0,13 0t0 20178 pipe 2023-10-08T15:40:50.705 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 41u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.705 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 42u unix 0xffff8f3917b2e600 0t0 20179 /var/run/lttng/client-lttng-sessiond type=STREAM 2023-10-08T15:40:50.705 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 43u unix 0xffff8f3917b1e1c0 0t0 23796 type=STREAM 2023-10-08T15:40:50.705 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 44u unix 0xffff8f3917b19dc0 0t0 698 /var/run/lttng/sessiond-notification type=STREAM 2023-10-08T15:40:50.705 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 45u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.705 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 46r FIFO 0,13 0t0 699 pipe 2023-10-08T15:40:50.705 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 47w FIFO 0,13 0t0 699 pipe 2023-10-08T15:40:50.705 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 48u unix 0xffff8f3917aca640 0t0 700 /var/run/lttng/lttng-ust-sock-8 type=STREAM 2023-10-08T15:40:50.706 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 49u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.706 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 50r FIFO 0,13 0t0 701 pipe 2023-10-08T15:40:50.706 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 51w FIFO 0,13 0t0 701 pipe 2023-10-08T15:40:50.706 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 52r FIFO 0,13 0t0 702 pipe 2023-10-08T15:40:50.706 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 53w FIFO 0,13 0t0 702 pipe 2023-10-08T15:40:50.706 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 54u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.706 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 55r FIFO 0,13 0t0 703 pipe 2023-10-08T15:40:50.706 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 56w FIFO 0,13 0t0 703 pipe 2023-10-08T15:40:50.706 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 57u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.706 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 58u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.707 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 59u IPv4 23799 0t0 TCP localhost:5345 (LISTEN) 2023-10-08T15:40:50.707 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 60r FIFO 0,13 0t0 704 pipe 2023-10-08T15:40:50.707 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 61w FIFO 0,13 0t0 704 pipe 2023-10-08T15:40:50.707 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 62u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.707 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 613 lttng-ses root 63u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.707 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.707 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.707 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root txt REG 8,1 987576 21343 /usr/bin/lttng-sessiond 2023-10-08T15:40:50.707 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root mem REG 8,1 749113 1048623 /usr/lib/modules/5.4.0-164-generic/modules.symbols.bin 2023-10-08T15:40:50.708 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root mem REG 8,1 1389809 1048620 /usr/lib/modules/5.4.0-164-generic/modules.alias.bin 2023-10-08T15:40:50.708 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root mem REG 8,1 853748 1048629 /usr/lib/modules/5.4.0-164-generic/modules.dep.bin 2023-10-08T15:40:50.708 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:50.708 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root mem REG 8,1 104984 8251 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-10-08T15:40:50.708 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root mem REG 8,1 1956992 8082 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28 2023-10-08T15:40:50.708 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root mem REG 8,1 28046896 10299 /usr/lib/x86_64-linux-gnu/libicudata.so.66.1 2023-10-08T15:40:50.708 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root mem REG 8,1 47960 12609 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-10-08T15:40:50.709 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:50.709 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:50.709 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root mem REG 8,1 1976648 10310 /usr/lib/x86_64-linux-gnu/libicuuc.so.66.1 2023-10-08T15:40:50.709 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root DEL REG 8,1 8794 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:50.709 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:50.709 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root mem REG 8,1 686160 8833 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.4 2023-10-08T15:40:50.709 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.709 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.709 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:50.709 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root mem REG 8,1 43136 21280 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.6.1.0 2023-10-08T15:40:50.710 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root mem REG 8,1 273576 18735 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.4.0.0 2023-10-08T15:40:50.710 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root mem REG 8,1 1799408 10319 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.10 2023-10-08T15:40:50.710 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.710 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root DEL REG 8,1 8351 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-10-08T15:40:50.710 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root mem REG 8,1 39480 21286 /usr/lib/x86_64-linux-gnu/liburcu.so.6.1.0 2023-10-08T15:40:50.710 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root mem REG 8,1 22520 21281 /usr/lib/x86_64-linux-gnu/liburcu-common.so.6.1.0 2023-10-08T15:40:50.710 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root mem REG 8,1 444816 21295 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-10-08T15:40:50.710 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root mem REG 8,1 112848 8859 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.5 2023-10-08T15:40:50.710 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root mem REG 8,1 10257 1048624 /usr/lib/modules/5.4.0-164-generic/modules.builtin.bin 2023-10-08T15:40:50.710 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root mem REG 8,1 25062 1048625 /usr/lib/modules/5.4.0-164-generic/modules.builtin.alias.bin 2023-10-08T15:40:50.711 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.711 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root mem REG 0,26 4096 3 /dev/shm/lttng-ust-wait-8 2023-10-08T15:40:50.711 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.711 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 1u unix 0xffff8f3919f43b80 0t0 22746 type=STREAM 2023-10-08T15:40:50.711 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 2u unix 0xffff8f3919f43b80 0t0 22746 type=STREAM 2023-10-08T15:40:50.711 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 3wW REG 0,25 0 785 /run/lttng/lttng-sessiond.lck 2023-10-08T15:40:50.711 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 4u unix 0xffff8f3917acaa80 0t0 675 type=STREAM 2023-10-08T15:40:50.711 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 5r FIFO 0,13 0t0 677 pipe 2023-10-08T15:40:50.711 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 6w FIFO 0,13 0t0 677 pipe 2023-10-08T15:40:50.712 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 7r FIFO 0,13 0t0 678 pipe 2023-10-08T15:40:50.712 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 8w FIFO 0,13 0t0 678 pipe 2023-10-08T15:40:50.712 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 9r FIFO 0,13 0t0 679 pipe 2023-10-08T15:40:50.712 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 10w FIFO 0,13 0t0 679 pipe 2023-10-08T15:40:50.712 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 11r FIFO 0,13 0t0 680 pipe 2023-10-08T15:40:50.712 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 12w FIFO 0,13 0t0 680 pipe 2023-10-08T15:40:50.712 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 13r FIFO 0,13 0t0 681 pipe 2023-10-08T15:40:50.712 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 14w FIFO 0,13 0t0 681 pipe 2023-10-08T15:40:50.712 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 15r FIFO 0,13 0t0 682 pipe 2023-10-08T15:40:50.712 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 16w FIFO 0,13 0t0 682 pipe 2023-10-08T15:40:50.712 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 17r FIFO 0,13 0t0 683 pipe 2023-10-08T15:40:50.713 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 18w FIFO 0,13 0t0 683 pipe 2023-10-08T15:40:50.713 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 19u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.713 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 20u unix 0xffff8f3917ace600 0t0 688 /var/run/lttng/kconsumerd/error type=STREAM 2023-10-08T15:40:50.713 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 21u unix 0xffff8f3917accc80 0t0 689 /var/run/lttng/ustconsumerd64/error type=STREAM 2023-10-08T15:40:50.713 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 22u unix 0xffff8f3917acb740 0t0 690 /var/run/lttng/ustconsumerd32/error type=STREAM 2023-10-08T15:40:50.713 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 23r FIFO 0,13 0t0 691 pipe 2023-10-08T15:40:50.713 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 24w FIFO 0,13 0t0 691 pipe 2023-10-08T15:40:50.713 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 25r FIFO 0,13 0t0 692 pipe 2023-10-08T15:40:50.713 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 26w FIFO 0,13 0t0 692 pipe 2023-10-08T15:40:50.713 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 27r FIFO 0,13 0t0 693 pipe 2023-10-08T15:40:50.713 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 28w FIFO 0,13 0t0 693 pipe 2023-10-08T15:40:50.713 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 29r FIFO 0,13 0t0 696 pipe 2023-10-08T15:40:50.714 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 30w FIFO 0,13 0t0 696 pipe 2023-10-08T15:40:50.714 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 31u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.714 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 32u unix 0xffff8f3917acdd80 0t0 697 /var/run/lttng/sessiond-health type=STREAM 2023-10-08T15:40:50.714 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 33r FIFO 0,13 0t0 20176 pipe 2023-10-08T15:40:50.714 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 34w FIFO 0,13 0t0 20176 pipe 2023-10-08T15:40:50.714 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 35u unix 0xffff8f3917b1a200 0t0 23795 /var/run/lttng/sessiond-notification type=STREAM 2023-10-08T15:40:50.714 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 36u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.714 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 37r FIFO 0,13 0t0 20177 pipe 2023-10-08T15:40:50.714 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 38w FIFO 0,13 0t0 20177 pipe 2023-10-08T15:40:50.715 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 39r FIFO 0,13 0t0 20178 pipe 2023-10-08T15:40:50.715 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 40w FIFO 0,13 0t0 20178 pipe 2023-10-08T15:40:50.715 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 41u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.715 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 42u unix 0xffff8f3917b2e600 0t0 20179 /var/run/lttng/client-lttng-sessiond type=STREAM 2023-10-08T15:40:50.715 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 43u unix 0xffff8f3917b1e1c0 0t0 23796 type=STREAM 2023-10-08T15:40:50.715 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 44u unix 0xffff8f3917b19dc0 0t0 698 /var/run/lttng/sessiond-notification type=STREAM 2023-10-08T15:40:50.715 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 45u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.715 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 46r FIFO 0,13 0t0 699 pipe 2023-10-08T15:40:50.715 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 47w FIFO 0,13 0t0 699 pipe 2023-10-08T15:40:50.715 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 48u unix 0xffff8f3917aca640 0t0 700 /var/run/lttng/lttng-ust-sock-8 type=STREAM 2023-10-08T15:40:50.715 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 49u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.715 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 50r FIFO 0,13 0t0 701 pipe 2023-10-08T15:40:50.716 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 51w FIFO 0,13 0t0 701 pipe 2023-10-08T15:40:50.716 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 52r FIFO 0,13 0t0 702 pipe 2023-10-08T15:40:50.716 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 53w FIFO 0,13 0t0 702 pipe 2023-10-08T15:40:50.716 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 54u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.716 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 55r FIFO 0,13 0t0 703 pipe 2023-10-08T15:40:50.716 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 56w FIFO 0,13 0t0 703 pipe 2023-10-08T15:40:50.716 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 57u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.716 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 58u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.716 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 59u IPv4 23799 0t0 TCP localhost:5345 (LISTEN) 2023-10-08T15:40:50.716 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 60r FIFO 0,13 0t0 704 pipe 2023-10-08T15:40:50.716 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 61w FIFO 0,13 0t0 704 pipe 2023-10-08T15:40:50.716 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 62u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.717 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 614 lttng-ses root 63u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.717 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.717 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.717 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root txt REG 8,1 987576 21343 /usr/bin/lttng-sessiond 2023-10-08T15:40:50.717 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root mem REG 8,1 749113 1048623 /usr/lib/modules/5.4.0-164-generic/modules.symbols.bin 2023-10-08T15:40:50.717 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root mem REG 8,1 1389809 1048620 /usr/lib/modules/5.4.0-164-generic/modules.alias.bin 2023-10-08T15:40:50.717 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root mem REG 8,1 853748 1048629 /usr/lib/modules/5.4.0-164-generic/modules.dep.bin 2023-10-08T15:40:50.717 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:50.717 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root mem REG 8,1 104984 8251 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-10-08T15:40:50.717 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root mem REG 8,1 1956992 8082 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28 2023-10-08T15:40:50.717 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root mem REG 8,1 28046896 10299 /usr/lib/x86_64-linux-gnu/libicudata.so.66.1 2023-10-08T15:40:50.717 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root mem REG 8,1 47960 12609 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-10-08T15:40:50.718 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:50.718 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:50.718 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root mem REG 8,1 1976648 10310 /usr/lib/x86_64-linux-gnu/libicuuc.so.66.1 2023-10-08T15:40:50.718 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root DEL REG 8,1 8794 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:50.718 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:50.718 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root mem REG 8,1 686160 8833 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.4 2023-10-08T15:40:50.718 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.718 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.718 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:50.718 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root mem REG 8,1 43136 21280 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.6.1.0 2023-10-08T15:40:50.718 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root mem REG 8,1 273576 18735 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.4.0.0 2023-10-08T15:40:50.718 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root mem REG 8,1 1799408 10319 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.10 2023-10-08T15:40:50.719 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.719 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root DEL REG 8,1 8351 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-10-08T15:40:50.719 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root mem REG 8,1 39480 21286 /usr/lib/x86_64-linux-gnu/liburcu.so.6.1.0 2023-10-08T15:40:50.719 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root mem REG 8,1 22520 21281 /usr/lib/x86_64-linux-gnu/liburcu-common.so.6.1.0 2023-10-08T15:40:50.719 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root mem REG 8,1 444816 21295 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-10-08T15:40:50.719 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root mem REG 8,1 112848 8859 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.5 2023-10-08T15:40:50.719 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root mem REG 8,1 10257 1048624 /usr/lib/modules/5.4.0-164-generic/modules.builtin.bin 2023-10-08T15:40:50.719 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root mem REG 8,1 25062 1048625 /usr/lib/modules/5.4.0-164-generic/modules.builtin.alias.bin 2023-10-08T15:40:50.719 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.719 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root mem REG 0,26 4096 3 /dev/shm/lttng-ust-wait-8 2023-10-08T15:40:50.719 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.719 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 1u unix 0xffff8f3919f43b80 0t0 22746 type=STREAM 2023-10-08T15:40:50.720 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 2u unix 0xffff8f3919f43b80 0t0 22746 type=STREAM 2023-10-08T15:40:50.720 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 3wW REG 0,25 0 785 /run/lttng/lttng-sessiond.lck 2023-10-08T15:40:50.720 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 4u unix 0xffff8f3917acaa80 0t0 675 type=STREAM 2023-10-08T15:40:50.720 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 5r FIFO 0,13 0t0 677 pipe 2023-10-08T15:40:50.720 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 6w FIFO 0,13 0t0 677 pipe 2023-10-08T15:40:50.720 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 7r FIFO 0,13 0t0 678 pipe 2023-10-08T15:40:50.720 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 8w FIFO 0,13 0t0 678 pipe 2023-10-08T15:40:50.720 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 9r FIFO 0,13 0t0 679 pipe 2023-10-08T15:40:50.720 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 10w FIFO 0,13 0t0 679 pipe 2023-10-08T15:40:50.720 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 11r FIFO 0,13 0t0 680 pipe 2023-10-08T15:40:50.721 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 12w FIFO 0,13 0t0 680 pipe 2023-10-08T15:40:50.721 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 13r FIFO 0,13 0t0 681 pipe 2023-10-08T15:40:50.721 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 14w FIFO 0,13 0t0 681 pipe 2023-10-08T15:40:50.721 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 15r FIFO 0,13 0t0 682 pipe 2023-10-08T15:40:50.721 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 16w FIFO 0,13 0t0 682 pipe 2023-10-08T15:40:50.721 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 17r FIFO 0,13 0t0 683 pipe 2023-10-08T15:40:50.721 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 18w FIFO 0,13 0t0 683 pipe 2023-10-08T15:40:50.721 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 19u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.721 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 20u unix 0xffff8f3917ace600 0t0 688 /var/run/lttng/kconsumerd/error type=STREAM 2023-10-08T15:40:50.722 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 21u unix 0xffff8f3917accc80 0t0 689 /var/run/lttng/ustconsumerd64/error type=STREAM 2023-10-08T15:40:50.722 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 22u unix 0xffff8f3917acb740 0t0 690 /var/run/lttng/ustconsumerd32/error type=STREAM 2023-10-08T15:40:50.722 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 23r FIFO 0,13 0t0 691 pipe 2023-10-08T15:40:50.722 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 24w FIFO 0,13 0t0 691 pipe 2023-10-08T15:40:50.722 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 25r FIFO 0,13 0t0 692 pipe 2023-10-08T15:40:50.722 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 26w FIFO 0,13 0t0 692 pipe 2023-10-08T15:40:50.722 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 27r FIFO 0,13 0t0 693 pipe 2023-10-08T15:40:50.722 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 28w FIFO 0,13 0t0 693 pipe 2023-10-08T15:40:50.722 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 29r FIFO 0,13 0t0 696 pipe 2023-10-08T15:40:50.723 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 30w FIFO 0,13 0t0 696 pipe 2023-10-08T15:40:50.723 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 31u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.723 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 32u unix 0xffff8f3917acdd80 0t0 697 /var/run/lttng/sessiond-health type=STREAM 2023-10-08T15:40:50.723 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 33r FIFO 0,13 0t0 20176 pipe 2023-10-08T15:40:50.723 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 34w FIFO 0,13 0t0 20176 pipe 2023-10-08T15:40:50.723 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 35u unix 0xffff8f3917b1a200 0t0 23795 /var/run/lttng/sessiond-notification type=STREAM 2023-10-08T15:40:50.723 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 36u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.723 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 37r FIFO 0,13 0t0 20177 pipe 2023-10-08T15:40:50.723 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 38w FIFO 0,13 0t0 20177 pipe 2023-10-08T15:40:50.723 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 39r FIFO 0,13 0t0 20178 pipe 2023-10-08T15:40:50.723 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 40w FIFO 0,13 0t0 20178 pipe 2023-10-08T15:40:50.724 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 41u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.724 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 42u unix 0xffff8f3917b2e600 0t0 20179 /var/run/lttng/client-lttng-sessiond type=STREAM 2023-10-08T15:40:50.724 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 43u unix 0xffff8f3917b1e1c0 0t0 23796 type=STREAM 2023-10-08T15:40:50.724 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 44u unix 0xffff8f3917b19dc0 0t0 698 /var/run/lttng/sessiond-notification type=STREAM 2023-10-08T15:40:50.724 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 45u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.724 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 46r FIFO 0,13 0t0 699 pipe 2023-10-08T15:40:50.724 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 47w FIFO 0,13 0t0 699 pipe 2023-10-08T15:40:50.724 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 48u unix 0xffff8f3917aca640 0t0 700 /var/run/lttng/lttng-ust-sock-8 type=STREAM 2023-10-08T15:40:50.724 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 49u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.725 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 50r FIFO 0,13 0t0 701 pipe 2023-10-08T15:40:50.725 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 51w FIFO 0,13 0t0 701 pipe 2023-10-08T15:40:50.725 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 52r FIFO 0,13 0t0 702 pipe 2023-10-08T15:40:50.725 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 53w FIFO 0,13 0t0 702 pipe 2023-10-08T15:40:50.725 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 54u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.725 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 55r FIFO 0,13 0t0 703 pipe 2023-10-08T15:40:50.725 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 56w FIFO 0,13 0t0 703 pipe 2023-10-08T15:40:50.725 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 57u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.725 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 58u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.725 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 59u IPv4 23799 0t0 TCP localhost:5345 (LISTEN) 2023-10-08T15:40:50.725 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 60r FIFO 0,13 0t0 704 pipe 2023-10-08T15:40:50.726 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 61w FIFO 0,13 0t0 704 pipe 2023-10-08T15:40:50.726 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 62u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.726 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 615 lttng-ses root 63u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.726 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.726 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.726 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root txt REG 8,1 987576 21343 /usr/bin/lttng-sessiond 2023-10-08T15:40:50.726 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root mem REG 8,1 749113 1048623 /usr/lib/modules/5.4.0-164-generic/modules.symbols.bin 2023-10-08T15:40:50.726 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root mem REG 8,1 1389809 1048620 /usr/lib/modules/5.4.0-164-generic/modules.alias.bin 2023-10-08T15:40:50.727 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root mem REG 8,1 853748 1048629 /usr/lib/modules/5.4.0-164-generic/modules.dep.bin 2023-10-08T15:40:50.727 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:50.727 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root mem REG 8,1 104984 8251 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-10-08T15:40:50.727 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root mem REG 8,1 1956992 8082 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28 2023-10-08T15:40:50.727 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root mem REG 8,1 28046896 10299 /usr/lib/x86_64-linux-gnu/libicudata.so.66.1 2023-10-08T15:40:50.727 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root mem REG 8,1 47960 12609 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-10-08T15:40:50.727 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:50.727 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:50.727 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root mem REG 8,1 1976648 10310 /usr/lib/x86_64-linux-gnu/libicuuc.so.66.1 2023-10-08T15:40:50.728 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root DEL REG 8,1 8794 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:50.728 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:50.728 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root mem REG 8,1 686160 8833 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.4 2023-10-08T15:40:50.728 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.728 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.728 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:50.728 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root mem REG 8,1 43136 21280 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.6.1.0 2023-10-08T15:40:50.728 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root mem REG 8,1 273576 18735 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.4.0.0 2023-10-08T15:40:50.728 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root mem REG 8,1 1799408 10319 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.10 2023-10-08T15:40:50.728 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.729 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root DEL REG 8,1 8351 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-10-08T15:40:50.729 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root mem REG 8,1 39480 21286 /usr/lib/x86_64-linux-gnu/liburcu.so.6.1.0 2023-10-08T15:40:50.729 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root mem REG 8,1 22520 21281 /usr/lib/x86_64-linux-gnu/liburcu-common.so.6.1.0 2023-10-08T15:40:50.729 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root mem REG 8,1 444816 21295 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-10-08T15:40:50.729 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root mem REG 8,1 112848 8859 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.5 2023-10-08T15:40:50.729 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root mem REG 8,1 10257 1048624 /usr/lib/modules/5.4.0-164-generic/modules.builtin.bin 2023-10-08T15:40:50.729 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root mem REG 8,1 25062 1048625 /usr/lib/modules/5.4.0-164-generic/modules.builtin.alias.bin 2023-10-08T15:40:50.729 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.729 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root mem REG 0,26 4096 3 /dev/shm/lttng-ust-wait-8 2023-10-08T15:40:50.729 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.730 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 1u unix 0xffff8f3919f43b80 0t0 22746 type=STREAM 2023-10-08T15:40:50.730 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 2u unix 0xffff8f3919f43b80 0t0 22746 type=STREAM 2023-10-08T15:40:50.730 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 3wW REG 0,25 0 785 /run/lttng/lttng-sessiond.lck 2023-10-08T15:40:50.730 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 4u unix 0xffff8f3917acaa80 0t0 675 type=STREAM 2023-10-08T15:40:50.730 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 5r FIFO 0,13 0t0 677 pipe 2023-10-08T15:40:50.730 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 6w FIFO 0,13 0t0 677 pipe 2023-10-08T15:40:50.730 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 7r FIFO 0,13 0t0 678 pipe 2023-10-08T15:40:50.730 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 8w FIFO 0,13 0t0 678 pipe 2023-10-08T15:40:50.731 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 9r FIFO 0,13 0t0 679 pipe 2023-10-08T15:40:50.731 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 10w FIFO 0,13 0t0 679 pipe 2023-10-08T15:40:50.731 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 11r FIFO 0,13 0t0 680 pipe 2023-10-08T15:40:50.731 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 12w FIFO 0,13 0t0 680 pipe 2023-10-08T15:40:50.731 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 13r FIFO 0,13 0t0 681 pipe 2023-10-08T15:40:50.731 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 14w FIFO 0,13 0t0 681 pipe 2023-10-08T15:40:50.731 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 15r FIFO 0,13 0t0 682 pipe 2023-10-08T15:40:50.731 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 16w FIFO 0,13 0t0 682 pipe 2023-10-08T15:40:50.731 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 17r FIFO 0,13 0t0 683 pipe 2023-10-08T15:40:50.732 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 18w FIFO 0,13 0t0 683 pipe 2023-10-08T15:40:50.732 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 19u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.732 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 20u unix 0xffff8f3917ace600 0t0 688 /var/run/lttng/kconsumerd/error type=STREAM 2023-10-08T15:40:50.732 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 21u unix 0xffff8f3917accc80 0t0 689 /var/run/lttng/ustconsumerd64/error type=STREAM 2023-10-08T15:40:50.732 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 22u unix 0xffff8f3917acb740 0t0 690 /var/run/lttng/ustconsumerd32/error type=STREAM 2023-10-08T15:40:50.732 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 23r FIFO 0,13 0t0 691 pipe 2023-10-08T15:40:50.732 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 24w FIFO 0,13 0t0 691 pipe 2023-10-08T15:40:50.732 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 25r FIFO 0,13 0t0 692 pipe 2023-10-08T15:40:50.732 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 26w FIFO 0,13 0t0 692 pipe 2023-10-08T15:40:50.732 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 27r FIFO 0,13 0t0 693 pipe 2023-10-08T15:40:50.733 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 28w FIFO 0,13 0t0 693 pipe 2023-10-08T15:40:50.733 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 29r FIFO 0,13 0t0 696 pipe 2023-10-08T15:40:50.733 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 30w FIFO 0,13 0t0 696 pipe 2023-10-08T15:40:50.733 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 31u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.733 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 32u unix 0xffff8f3917acdd80 0t0 697 /var/run/lttng/sessiond-health type=STREAM 2023-10-08T15:40:50.733 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 33r FIFO 0,13 0t0 20176 pipe 2023-10-08T15:40:50.733 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 34w FIFO 0,13 0t0 20176 pipe 2023-10-08T15:40:50.733 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 35u unix 0xffff8f3917b1a200 0t0 23795 /var/run/lttng/sessiond-notification type=STREAM 2023-10-08T15:40:50.733 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 36u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.733 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 37r FIFO 0,13 0t0 20177 pipe 2023-10-08T15:40:50.734 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 38w FIFO 0,13 0t0 20177 pipe 2023-10-08T15:40:50.734 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 39r FIFO 0,13 0t0 20178 pipe 2023-10-08T15:40:50.734 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 40w FIFO 0,13 0t0 20178 pipe 2023-10-08T15:40:50.734 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 41u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.734 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 42u unix 0xffff8f3917b2e600 0t0 20179 /var/run/lttng/client-lttng-sessiond type=STREAM 2023-10-08T15:40:50.734 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 43u unix 0xffff8f3917b1e1c0 0t0 23796 type=STREAM 2023-10-08T15:40:50.734 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 44u unix 0xffff8f3917b19dc0 0t0 698 /var/run/lttng/sessiond-notification type=STREAM 2023-10-08T15:40:50.734 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 45u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.734 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 46r FIFO 0,13 0t0 699 pipe 2023-10-08T15:40:50.734 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 47w FIFO 0,13 0t0 699 pipe 2023-10-08T15:40:50.734 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 48u unix 0xffff8f3917aca640 0t0 700 /var/run/lttng/lttng-ust-sock-8 type=STREAM 2023-10-08T15:40:50.735 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 49u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.735 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 50r FIFO 0,13 0t0 701 pipe 2023-10-08T15:40:50.735 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 51w FIFO 0,13 0t0 701 pipe 2023-10-08T15:40:50.735 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 52r FIFO 0,13 0t0 702 pipe 2023-10-08T15:40:50.735 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 53w FIFO 0,13 0t0 702 pipe 2023-10-08T15:40:50.735 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 54u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.735 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 55r FIFO 0,13 0t0 703 pipe 2023-10-08T15:40:50.735 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 56w FIFO 0,13 0t0 703 pipe 2023-10-08T15:40:50.735 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 57u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.736 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 58u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.736 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 59u IPv4 23799 0t0 TCP localhost:5345 (LISTEN) 2023-10-08T15:40:50.736 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 60r FIFO 0,13 0t0 704 pipe 2023-10-08T15:40:50.736 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 61w FIFO 0,13 0t0 704 pipe 2023-10-08T15:40:50.736 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 62u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.736 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 616 lttng-ses root 63u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.736 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.736 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.736 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root txt REG 8,1 987576 21343 /usr/bin/lttng-sessiond 2023-10-08T15:40:50.737 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root mem REG 8,1 749113 1048623 /usr/lib/modules/5.4.0-164-generic/modules.symbols.bin 2023-10-08T15:40:50.737 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root mem REG 8,1 1389809 1048620 /usr/lib/modules/5.4.0-164-generic/modules.alias.bin 2023-10-08T15:40:50.737 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root mem REG 8,1 853748 1048629 /usr/lib/modules/5.4.0-164-generic/modules.dep.bin 2023-10-08T15:40:50.737 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:50.737 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root mem REG 8,1 104984 8251 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-10-08T15:40:50.737 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root mem REG 8,1 1956992 8082 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28 2023-10-08T15:40:50.737 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root mem REG 8,1 28046896 10299 /usr/lib/x86_64-linux-gnu/libicudata.so.66.1 2023-10-08T15:40:50.737 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root mem REG 8,1 47960 12609 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-10-08T15:40:50.737 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:50.737 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:50.738 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root mem REG 8,1 1976648 10310 /usr/lib/x86_64-linux-gnu/libicuuc.so.66.1 2023-10-08T15:40:50.738 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root DEL REG 8,1 8794 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:50.738 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:50.738 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root mem REG 8,1 686160 8833 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.4 2023-10-08T15:40:50.738 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.738 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.738 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:50.738 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root mem REG 8,1 43136 21280 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.6.1.0 2023-10-08T15:40:50.739 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root mem REG 8,1 273576 18735 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.4.0.0 2023-10-08T15:40:50.739 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root mem REG 8,1 1799408 10319 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.10 2023-10-08T15:40:50.739 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.739 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root DEL REG 8,1 8351 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-10-08T15:40:50.739 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root mem REG 8,1 39480 21286 /usr/lib/x86_64-linux-gnu/liburcu.so.6.1.0 2023-10-08T15:40:50.739 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root mem REG 8,1 22520 21281 /usr/lib/x86_64-linux-gnu/liburcu-common.so.6.1.0 2023-10-08T15:40:50.739 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root mem REG 8,1 444816 21295 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-10-08T15:40:50.739 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root mem REG 8,1 112848 8859 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.5 2023-10-08T15:40:50.739 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root mem REG 8,1 10257 1048624 /usr/lib/modules/5.4.0-164-generic/modules.builtin.bin 2023-10-08T15:40:50.739 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root mem REG 8,1 25062 1048625 /usr/lib/modules/5.4.0-164-generic/modules.builtin.alias.bin 2023-10-08T15:40:50.739 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.740 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root mem REG 0,26 4096 3 /dev/shm/lttng-ust-wait-8 2023-10-08T15:40:50.740 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.740 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 1u unix 0xffff8f3919f43b80 0t0 22746 type=STREAM 2023-10-08T15:40:50.740 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 2u unix 0xffff8f3919f43b80 0t0 22746 type=STREAM 2023-10-08T15:40:50.740 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 3wW REG 0,25 0 785 /run/lttng/lttng-sessiond.lck 2023-10-08T15:40:50.740 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 4u unix 0xffff8f3917acaa80 0t0 675 type=STREAM 2023-10-08T15:40:50.740 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 5r FIFO 0,13 0t0 677 pipe 2023-10-08T15:40:50.740 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 6w FIFO 0,13 0t0 677 pipe 2023-10-08T15:40:50.740 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 7r FIFO 0,13 0t0 678 pipe 2023-10-08T15:40:50.740 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 8w FIFO 0,13 0t0 678 pipe 2023-10-08T15:40:50.741 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 9r FIFO 0,13 0t0 679 pipe 2023-10-08T15:40:50.741 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 10w FIFO 0,13 0t0 679 pipe 2023-10-08T15:40:50.741 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 11r FIFO 0,13 0t0 680 pipe 2023-10-08T15:40:50.741 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 12w FIFO 0,13 0t0 680 pipe 2023-10-08T15:40:50.741 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 13r FIFO 0,13 0t0 681 pipe 2023-10-08T15:40:50.741 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 14w FIFO 0,13 0t0 681 pipe 2023-10-08T15:40:50.741 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 15r FIFO 0,13 0t0 682 pipe 2023-10-08T15:40:50.741 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 16w FIFO 0,13 0t0 682 pipe 2023-10-08T15:40:50.741 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 17r FIFO 0,13 0t0 683 pipe 2023-10-08T15:40:50.741 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 18w FIFO 0,13 0t0 683 pipe 2023-10-08T15:40:50.741 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 19u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.741 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 20u unix 0xffff8f3917ace600 0t0 688 /var/run/lttng/kconsumerd/error type=STREAM 2023-10-08T15:40:50.742 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 21u unix 0xffff8f3917accc80 0t0 689 /var/run/lttng/ustconsumerd64/error type=STREAM 2023-10-08T15:40:50.742 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 22u unix 0xffff8f3917acb740 0t0 690 /var/run/lttng/ustconsumerd32/error type=STREAM 2023-10-08T15:40:50.742 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 23r FIFO 0,13 0t0 691 pipe 2023-10-08T15:40:50.742 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 24w FIFO 0,13 0t0 691 pipe 2023-10-08T15:40:50.742 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 25r FIFO 0,13 0t0 692 pipe 2023-10-08T15:40:50.742 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 26w FIFO 0,13 0t0 692 pipe 2023-10-08T15:40:50.742 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 27r FIFO 0,13 0t0 693 pipe 2023-10-08T15:40:50.742 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 28w FIFO 0,13 0t0 693 pipe 2023-10-08T15:40:50.742 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 29r FIFO 0,13 0t0 696 pipe 2023-10-08T15:40:50.742 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 30w FIFO 0,13 0t0 696 pipe 2023-10-08T15:40:50.742 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 31u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.743 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 32u unix 0xffff8f3917acdd80 0t0 697 /var/run/lttng/sessiond-health type=STREAM 2023-10-08T15:40:50.743 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 33r FIFO 0,13 0t0 20176 pipe 2023-10-08T15:40:50.743 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 34w FIFO 0,13 0t0 20176 pipe 2023-10-08T15:40:50.743 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 35u unix 0xffff8f3917b1a200 0t0 23795 /var/run/lttng/sessiond-notification type=STREAM 2023-10-08T15:40:50.743 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 36u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.743 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 37r FIFO 0,13 0t0 20177 pipe 2023-10-08T15:40:50.743 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 38w FIFO 0,13 0t0 20177 pipe 2023-10-08T15:40:50.743 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 39r FIFO 0,13 0t0 20178 pipe 2023-10-08T15:40:50.743 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 40w FIFO 0,13 0t0 20178 pipe 2023-10-08T15:40:50.743 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 41u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.743 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 42u unix 0xffff8f3917b2e600 0t0 20179 /var/run/lttng/client-lttng-sessiond type=STREAM 2023-10-08T15:40:50.743 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 43u unix 0xffff8f3917b1e1c0 0t0 23796 type=STREAM 2023-10-08T15:40:50.743 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 44u unix 0xffff8f3917b19dc0 0t0 698 /var/run/lttng/sessiond-notification type=STREAM 2023-10-08T15:40:50.744 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 45u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.744 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 46r FIFO 0,13 0t0 699 pipe 2023-10-08T15:40:50.744 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 47w FIFO 0,13 0t0 699 pipe 2023-10-08T15:40:50.744 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 48u unix 0xffff8f3917aca640 0t0 700 /var/run/lttng/lttng-ust-sock-8 type=STREAM 2023-10-08T15:40:50.744 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 49u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.744 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 50r FIFO 0,13 0t0 701 pipe 2023-10-08T15:40:50.744 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 51w FIFO 0,13 0t0 701 pipe 2023-10-08T15:40:50.744 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 52r FIFO 0,13 0t0 702 pipe 2023-10-08T15:40:50.744 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 53w FIFO 0,13 0t0 702 pipe 2023-10-08T15:40:50.744 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 54u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.744 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 55r FIFO 0,13 0t0 703 pipe 2023-10-08T15:40:50.744 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 56w FIFO 0,13 0t0 703 pipe 2023-10-08T15:40:50.745 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 57u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.745 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 58u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.745 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 59u IPv4 23799 0t0 TCP localhost:5345 (LISTEN) 2023-10-08T15:40:50.745 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 60r FIFO 0,13 0t0 704 pipe 2023-10-08T15:40:50.745 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 61w FIFO 0,13 0t0 704 pipe 2023-10-08T15:40:50.745 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 62u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.745 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 617 lttng-ses root 63u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.745 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.745 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.745 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root txt REG 8,1 987576 21343 /usr/bin/lttng-sessiond 2023-10-08T15:40:50.745 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root mem REG 8,1 749113 1048623 /usr/lib/modules/5.4.0-164-generic/modules.symbols.bin 2023-10-08T15:40:50.745 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root mem REG 8,1 1389809 1048620 /usr/lib/modules/5.4.0-164-generic/modules.alias.bin 2023-10-08T15:40:50.746 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root mem REG 8,1 853748 1048629 /usr/lib/modules/5.4.0-164-generic/modules.dep.bin 2023-10-08T15:40:50.746 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:50.746 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root mem REG 8,1 104984 8251 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-10-08T15:40:50.746 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root mem REG 8,1 1956992 8082 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28 2023-10-08T15:40:50.746 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root mem REG 8,1 28046896 10299 /usr/lib/x86_64-linux-gnu/libicudata.so.66.1 2023-10-08T15:40:50.746 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root mem REG 8,1 47960 12609 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-10-08T15:40:50.746 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:50.746 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:50.746 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root mem REG 8,1 1976648 10310 /usr/lib/x86_64-linux-gnu/libicuuc.so.66.1 2023-10-08T15:40:50.746 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root DEL REG 8,1 8794 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:50.746 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:50.747 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root mem REG 8,1 686160 8833 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.4 2023-10-08T15:40:50.747 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.747 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.747 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:50.747 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root mem REG 8,1 43136 21280 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.6.1.0 2023-10-08T15:40:50.747 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root mem REG 8,1 273576 18735 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.4.0.0 2023-10-08T15:40:50.747 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root mem REG 8,1 1799408 10319 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.10 2023-10-08T15:40:50.747 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.747 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root DEL REG 8,1 8351 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-10-08T15:40:50.747 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root mem REG 8,1 39480 21286 /usr/lib/x86_64-linux-gnu/liburcu.so.6.1.0 2023-10-08T15:40:50.747 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root mem REG 8,1 22520 21281 /usr/lib/x86_64-linux-gnu/liburcu-common.so.6.1.0 2023-10-08T15:40:50.748 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root mem REG 8,1 444816 21295 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-10-08T15:40:50.748 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root mem REG 8,1 112848 8859 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.5 2023-10-08T15:40:50.748 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root mem REG 8,1 10257 1048624 /usr/lib/modules/5.4.0-164-generic/modules.builtin.bin 2023-10-08T15:40:50.748 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root mem REG 8,1 25062 1048625 /usr/lib/modules/5.4.0-164-generic/modules.builtin.alias.bin 2023-10-08T15:40:50.748 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.748 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root mem REG 0,26 4096 3 /dev/shm/lttng-ust-wait-8 2023-10-08T15:40:50.748 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.748 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 1u unix 0xffff8f3919f43b80 0t0 22746 type=STREAM 2023-10-08T15:40:50.748 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 2u unix 0xffff8f3919f43b80 0t0 22746 type=STREAM 2023-10-08T15:40:50.748 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 3wW REG 0,25 0 785 /run/lttng/lttng-sessiond.lck 2023-10-08T15:40:50.748 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 4u unix 0xffff8f3917acaa80 0t0 675 type=STREAM 2023-10-08T15:40:50.748 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 5r FIFO 0,13 0t0 677 pipe 2023-10-08T15:40:50.749 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 6w FIFO 0,13 0t0 677 pipe 2023-10-08T15:40:50.749 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 7r FIFO 0,13 0t0 678 pipe 2023-10-08T15:40:50.749 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 8w FIFO 0,13 0t0 678 pipe 2023-10-08T15:40:50.749 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 9r FIFO 0,13 0t0 679 pipe 2023-10-08T15:40:50.749 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 10w FIFO 0,13 0t0 679 pipe 2023-10-08T15:40:50.749 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 11r FIFO 0,13 0t0 680 pipe 2023-10-08T15:40:50.749 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 12w FIFO 0,13 0t0 680 pipe 2023-10-08T15:40:50.749 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 13r FIFO 0,13 0t0 681 pipe 2023-10-08T15:40:50.749 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 14w FIFO 0,13 0t0 681 pipe 2023-10-08T15:40:50.749 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 15r FIFO 0,13 0t0 682 pipe 2023-10-08T15:40:50.749 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 16w FIFO 0,13 0t0 682 pipe 2023-10-08T15:40:50.749 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 17r FIFO 0,13 0t0 683 pipe 2023-10-08T15:40:50.749 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 18w FIFO 0,13 0t0 683 pipe 2023-10-08T15:40:50.750 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 19u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.750 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 20u unix 0xffff8f3917ace600 0t0 688 /var/run/lttng/kconsumerd/error type=STREAM 2023-10-08T15:40:50.750 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 21u unix 0xffff8f3917accc80 0t0 689 /var/run/lttng/ustconsumerd64/error type=STREAM 2023-10-08T15:40:50.750 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 22u unix 0xffff8f3917acb740 0t0 690 /var/run/lttng/ustconsumerd32/error type=STREAM 2023-10-08T15:40:50.750 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 23r FIFO 0,13 0t0 691 pipe 2023-10-08T15:40:50.750 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 24w FIFO 0,13 0t0 691 pipe 2023-10-08T15:40:50.750 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 25r FIFO 0,13 0t0 692 pipe 2023-10-08T15:40:50.750 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 26w FIFO 0,13 0t0 692 pipe 2023-10-08T15:40:50.750 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 27r FIFO 0,13 0t0 693 pipe 2023-10-08T15:40:50.750 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 28w FIFO 0,13 0t0 693 pipe 2023-10-08T15:40:50.750 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 29r FIFO 0,13 0t0 696 pipe 2023-10-08T15:40:50.751 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 30w FIFO 0,13 0t0 696 pipe 2023-10-08T15:40:50.751 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 31u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.751 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 32u unix 0xffff8f3917acdd80 0t0 697 /var/run/lttng/sessiond-health type=STREAM 2023-10-08T15:40:50.751 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 33r FIFO 0,13 0t0 20176 pipe 2023-10-08T15:40:50.751 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 34w FIFO 0,13 0t0 20176 pipe 2023-10-08T15:40:50.751 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 35u unix 0xffff8f3917b1a200 0t0 23795 /var/run/lttng/sessiond-notification type=STREAM 2023-10-08T15:40:50.751 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 36u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.751 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 37r FIFO 0,13 0t0 20177 pipe 2023-10-08T15:40:50.751 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 38w FIFO 0,13 0t0 20177 pipe 2023-10-08T15:40:50.751 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 39r FIFO 0,13 0t0 20178 pipe 2023-10-08T15:40:50.752 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 40w FIFO 0,13 0t0 20178 pipe 2023-10-08T15:40:50.752 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 41u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.752 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 42u unix 0xffff8f3917b2e600 0t0 20179 /var/run/lttng/client-lttng-sessiond type=STREAM 2023-10-08T15:40:50.752 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 43u unix 0xffff8f3917b1e1c0 0t0 23796 type=STREAM 2023-10-08T15:40:50.752 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 44u unix 0xffff8f3917b19dc0 0t0 698 /var/run/lttng/sessiond-notification type=STREAM 2023-10-08T15:40:50.752 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 45u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.752 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 46r FIFO 0,13 0t0 699 pipe 2023-10-08T15:40:50.752 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 47w FIFO 0,13 0t0 699 pipe 2023-10-08T15:40:50.753 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 48u unix 0xffff8f3917aca640 0t0 700 /var/run/lttng/lttng-ust-sock-8 type=STREAM 2023-10-08T15:40:50.753 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 49u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.753 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 50r FIFO 0,13 0t0 701 pipe 2023-10-08T15:40:50.753 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 51w FIFO 0,13 0t0 701 pipe 2023-10-08T15:40:50.753 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 52r FIFO 0,13 0t0 702 pipe 2023-10-08T15:40:50.753 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 53w FIFO 0,13 0t0 702 pipe 2023-10-08T15:40:50.753 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 54u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.753 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 55r FIFO 0,13 0t0 703 pipe 2023-10-08T15:40:50.753 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 56w FIFO 0,13 0t0 703 pipe 2023-10-08T15:40:50.753 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 57u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.753 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 58u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.754 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 59u IPv4 23799 0t0 TCP localhost:5345 (LISTEN) 2023-10-08T15:40:50.754 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 60r FIFO 0,13 0t0 704 pipe 2023-10-08T15:40:50.754 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 61w FIFO 0,13 0t0 704 pipe 2023-10-08T15:40:50.754 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 62u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.754 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 618 lttng-ses root 63u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.754 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.754 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.754 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root txt REG 8,1 987576 21343 /usr/bin/lttng-sessiond 2023-10-08T15:40:50.754 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root mem REG 8,1 749113 1048623 /usr/lib/modules/5.4.0-164-generic/modules.symbols.bin 2023-10-08T15:40:50.755 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root mem REG 8,1 1389809 1048620 /usr/lib/modules/5.4.0-164-generic/modules.alias.bin 2023-10-08T15:40:50.755 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root mem REG 8,1 853748 1048629 /usr/lib/modules/5.4.0-164-generic/modules.dep.bin 2023-10-08T15:40:50.755 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:50.755 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root mem REG 8,1 104984 8251 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-10-08T15:40:50.755 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root mem REG 8,1 1956992 8082 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28 2023-10-08T15:40:50.755 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root mem REG 8,1 28046896 10299 /usr/lib/x86_64-linux-gnu/libicudata.so.66.1 2023-10-08T15:40:50.755 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root mem REG 8,1 47960 12609 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-10-08T15:40:50.755 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:50.755 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:50.755 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root mem REG 8,1 1976648 10310 /usr/lib/x86_64-linux-gnu/libicuuc.so.66.1 2023-10-08T15:40:50.756 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root DEL REG 8,1 8794 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:50.756 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:50.756 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root mem REG 8,1 686160 8833 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.4 2023-10-08T15:40:50.756 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.756 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.756 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:50.756 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root mem REG 8,1 43136 21280 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.6.1.0 2023-10-08T15:40:50.756 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root mem REG 8,1 273576 18735 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.4.0.0 2023-10-08T15:40:50.756 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root mem REG 8,1 1799408 10319 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.10 2023-10-08T15:40:50.757 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.757 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root DEL REG 8,1 8351 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-10-08T15:40:50.757 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root mem REG 8,1 39480 21286 /usr/lib/x86_64-linux-gnu/liburcu.so.6.1.0 2023-10-08T15:40:50.757 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root mem REG 8,1 22520 21281 /usr/lib/x86_64-linux-gnu/liburcu-common.so.6.1.0 2023-10-08T15:40:50.757 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root mem REG 8,1 444816 21295 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-10-08T15:40:50.757 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root mem REG 8,1 112848 8859 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.5 2023-10-08T15:40:50.757 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root mem REG 8,1 10257 1048624 /usr/lib/modules/5.4.0-164-generic/modules.builtin.bin 2023-10-08T15:40:50.757 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root mem REG 8,1 25062 1048625 /usr/lib/modules/5.4.0-164-generic/modules.builtin.alias.bin 2023-10-08T15:40:50.757 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.758 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root mem REG 0,26 4096 3 /dev/shm/lttng-ust-wait-8 2023-10-08T15:40:50.758 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.758 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 1u unix 0xffff8f3919f43b80 0t0 22746 type=STREAM 2023-10-08T15:40:50.758 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 2u unix 0xffff8f3919f43b80 0t0 22746 type=STREAM 2023-10-08T15:40:50.758 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 3wW REG 0,25 0 785 /run/lttng/lttng-sessiond.lck 2023-10-08T15:40:50.758 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 4u unix 0xffff8f3917acaa80 0t0 675 type=STREAM 2023-10-08T15:40:50.758 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 5r FIFO 0,13 0t0 677 pipe 2023-10-08T15:40:50.758 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 6w FIFO 0,13 0t0 677 pipe 2023-10-08T15:40:50.759 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 7r FIFO 0,13 0t0 678 pipe 2023-10-08T15:40:50.759 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 8w FIFO 0,13 0t0 678 pipe 2023-10-08T15:40:50.759 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 9r FIFO 0,13 0t0 679 pipe 2023-10-08T15:40:50.759 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 10w FIFO 0,13 0t0 679 pipe 2023-10-08T15:40:50.759 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 11r FIFO 0,13 0t0 680 pipe 2023-10-08T15:40:50.759 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 12w FIFO 0,13 0t0 680 pipe 2023-10-08T15:40:50.759 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 13r FIFO 0,13 0t0 681 pipe 2023-10-08T15:40:50.759 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 14w FIFO 0,13 0t0 681 pipe 2023-10-08T15:40:50.759 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 15r FIFO 0,13 0t0 682 pipe 2023-10-08T15:40:50.760 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 16w FIFO 0,13 0t0 682 pipe 2023-10-08T15:40:50.760 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 17r FIFO 0,13 0t0 683 pipe 2023-10-08T15:40:50.760 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 18w FIFO 0,13 0t0 683 pipe 2023-10-08T15:40:50.760 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 19u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.760 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 20u unix 0xffff8f3917ace600 0t0 688 /var/run/lttng/kconsumerd/error type=STREAM 2023-10-08T15:40:50.760 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 21u unix 0xffff8f3917accc80 0t0 689 /var/run/lttng/ustconsumerd64/error type=STREAM 2023-10-08T15:40:50.760 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 22u unix 0xffff8f3917acb740 0t0 690 /var/run/lttng/ustconsumerd32/error type=STREAM 2023-10-08T15:40:50.760 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 23r FIFO 0,13 0t0 691 pipe 2023-10-08T15:40:50.760 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 24w FIFO 0,13 0t0 691 pipe 2023-10-08T15:40:50.761 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 25r FIFO 0,13 0t0 692 pipe 2023-10-08T15:40:50.761 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 26w FIFO 0,13 0t0 692 pipe 2023-10-08T15:40:50.761 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 27r FIFO 0,13 0t0 693 pipe 2023-10-08T15:40:50.761 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 28w FIFO 0,13 0t0 693 pipe 2023-10-08T15:40:50.761 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 29r FIFO 0,13 0t0 696 pipe 2023-10-08T15:40:50.761 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 30w FIFO 0,13 0t0 696 pipe 2023-10-08T15:40:50.761 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 31u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.761 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 32u unix 0xffff8f3917acdd80 0t0 697 /var/run/lttng/sessiond-health type=STREAM 2023-10-08T15:40:50.761 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 33r FIFO 0,13 0t0 20176 pipe 2023-10-08T15:40:50.762 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 34w FIFO 0,13 0t0 20176 pipe 2023-10-08T15:40:50.762 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 35u unix 0xffff8f3917b1a200 0t0 23795 /var/run/lttng/sessiond-notification type=STREAM 2023-10-08T15:40:50.762 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 36u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.762 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 37r FIFO 0,13 0t0 20177 pipe 2023-10-08T15:40:50.762 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 38w FIFO 0,13 0t0 20177 pipe 2023-10-08T15:40:50.762 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 39r FIFO 0,13 0t0 20178 pipe 2023-10-08T15:40:50.762 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 40w FIFO 0,13 0t0 20178 pipe 2023-10-08T15:40:50.762 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 41u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.763 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 42u unix 0xffff8f3917b2e600 0t0 20179 /var/run/lttng/client-lttng-sessiond type=STREAM 2023-10-08T15:40:50.763 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 43u unix 0xffff8f3917b1e1c0 0t0 23796 type=STREAM 2023-10-08T15:40:50.763 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 44u unix 0xffff8f3917b19dc0 0t0 698 /var/run/lttng/sessiond-notification type=STREAM 2023-10-08T15:40:50.763 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 45u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.763 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 46r FIFO 0,13 0t0 699 pipe 2023-10-08T15:40:50.763 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 47w FIFO 0,13 0t0 699 pipe 2023-10-08T15:40:50.763 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 48u unix 0xffff8f3917aca640 0t0 700 /var/run/lttng/lttng-ust-sock-8 type=STREAM 2023-10-08T15:40:50.763 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 49u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.763 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 50r FIFO 0,13 0t0 701 pipe 2023-10-08T15:40:50.763 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 51w FIFO 0,13 0t0 701 pipe 2023-10-08T15:40:50.764 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 52r FIFO 0,13 0t0 702 pipe 2023-10-08T15:40:50.764 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 53w FIFO 0,13 0t0 702 pipe 2023-10-08T15:40:50.764 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 54u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.764 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 55r FIFO 0,13 0t0 703 pipe 2023-10-08T15:40:50.764 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 56w FIFO 0,13 0t0 703 pipe 2023-10-08T15:40:50.764 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 57u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.764 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 58u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.764 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 59u IPv4 23799 0t0 TCP localhost:5345 (LISTEN) 2023-10-08T15:40:50.764 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 60r FIFO 0,13 0t0 704 pipe 2023-10-08T15:40:50.764 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 61w FIFO 0,13 0t0 704 pipe 2023-10-08T15:40:50.765 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 62u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.765 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 619 lttng-ses root 63u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.765 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.765 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.765 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root txt REG 8,1 987576 21343 /usr/bin/lttng-sessiond 2023-10-08T15:40:50.765 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root mem REG 8,1 749113 1048623 /usr/lib/modules/5.4.0-164-generic/modules.symbols.bin 2023-10-08T15:40:50.765 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root mem REG 8,1 1389809 1048620 /usr/lib/modules/5.4.0-164-generic/modules.alias.bin 2023-10-08T15:40:50.765 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root mem REG 8,1 853748 1048629 /usr/lib/modules/5.4.0-164-generic/modules.dep.bin 2023-10-08T15:40:50.765 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:50.766 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root mem REG 8,1 104984 8251 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-10-08T15:40:50.766 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root mem REG 8,1 1956992 8082 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28 2023-10-08T15:40:50.766 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root mem REG 8,1 28046896 10299 /usr/lib/x86_64-linux-gnu/libicudata.so.66.1 2023-10-08T15:40:50.766 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root mem REG 8,1 47960 12609 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-10-08T15:40:50.766 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:50.766 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:50.766 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root mem REG 8,1 1976648 10310 /usr/lib/x86_64-linux-gnu/libicuuc.so.66.1 2023-10-08T15:40:50.766 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root DEL REG 8,1 8794 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:50.766 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:50.767 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root mem REG 8,1 686160 8833 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.4 2023-10-08T15:40:50.767 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.767 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.767 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:50.767 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root mem REG 8,1 43136 21280 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.6.1.0 2023-10-08T15:40:50.767 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root mem REG 8,1 273576 18735 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.4.0.0 2023-10-08T15:40:50.767 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root mem REG 8,1 1799408 10319 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.10 2023-10-08T15:40:50.767 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.767 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root DEL REG 8,1 8351 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-10-08T15:40:50.767 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root mem REG 8,1 39480 21286 /usr/lib/x86_64-linux-gnu/liburcu.so.6.1.0 2023-10-08T15:40:50.768 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root mem REG 8,1 22520 21281 /usr/lib/x86_64-linux-gnu/liburcu-common.so.6.1.0 2023-10-08T15:40:50.768 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root mem REG 8,1 444816 21295 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-10-08T15:40:50.768 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root mem REG 8,1 112848 8859 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.5 2023-10-08T15:40:50.768 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root mem REG 8,1 10257 1048624 /usr/lib/modules/5.4.0-164-generic/modules.builtin.bin 2023-10-08T15:40:50.768 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root mem REG 8,1 25062 1048625 /usr/lib/modules/5.4.0-164-generic/modules.builtin.alias.bin 2023-10-08T15:40:50.768 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.768 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root mem REG 0,26 4096 3 /dev/shm/lttng-ust-wait-8 2023-10-08T15:40:50.768 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.768 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 1u unix 0xffff8f3919f43b80 0t0 22746 type=STREAM 2023-10-08T15:40:50.768 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 2u unix 0xffff8f3919f43b80 0t0 22746 type=STREAM 2023-10-08T15:40:50.769 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 3wW REG 0,25 0 785 /run/lttng/lttng-sessiond.lck 2023-10-08T15:40:50.769 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 4u unix 0xffff8f3917acaa80 0t0 675 type=STREAM 2023-10-08T15:40:50.769 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 5r FIFO 0,13 0t0 677 pipe 2023-10-08T15:40:50.769 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 6w FIFO 0,13 0t0 677 pipe 2023-10-08T15:40:50.769 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 7r FIFO 0,13 0t0 678 pipe 2023-10-08T15:40:50.769 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 8w FIFO 0,13 0t0 678 pipe 2023-10-08T15:40:50.769 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 9r FIFO 0,13 0t0 679 pipe 2023-10-08T15:40:50.769 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 10w FIFO 0,13 0t0 679 pipe 2023-10-08T15:40:50.769 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 11r FIFO 0,13 0t0 680 pipe 2023-10-08T15:40:50.769 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 12w FIFO 0,13 0t0 680 pipe 2023-10-08T15:40:50.769 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 13r FIFO 0,13 0t0 681 pipe 2023-10-08T15:40:50.769 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 14w FIFO 0,13 0t0 681 pipe 2023-10-08T15:40:50.770 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 15r FIFO 0,13 0t0 682 pipe 2023-10-08T15:40:50.770 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 16w FIFO 0,13 0t0 682 pipe 2023-10-08T15:40:50.770 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 17r FIFO 0,13 0t0 683 pipe 2023-10-08T15:40:50.770 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 18w FIFO 0,13 0t0 683 pipe 2023-10-08T15:40:50.770 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 19u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.770 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 20u unix 0xffff8f3917ace600 0t0 688 /var/run/lttng/kconsumerd/error type=STREAM 2023-10-08T15:40:50.770 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 21u unix 0xffff8f3917accc80 0t0 689 /var/run/lttng/ustconsumerd64/error type=STREAM 2023-10-08T15:40:50.770 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 22u unix 0xffff8f3917acb740 0t0 690 /var/run/lttng/ustconsumerd32/error type=STREAM 2023-10-08T15:40:50.770 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 23r FIFO 0,13 0t0 691 pipe 2023-10-08T15:40:50.770 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 24w FIFO 0,13 0t0 691 pipe 2023-10-08T15:40:50.770 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 25r FIFO 0,13 0t0 692 pipe 2023-10-08T15:40:50.771 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 26w FIFO 0,13 0t0 692 pipe 2023-10-08T15:40:50.771 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 27r FIFO 0,13 0t0 693 pipe 2023-10-08T15:40:50.771 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 28w FIFO 0,13 0t0 693 pipe 2023-10-08T15:40:50.771 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 29r FIFO 0,13 0t0 696 pipe 2023-10-08T15:40:50.771 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 30w FIFO 0,13 0t0 696 pipe 2023-10-08T15:40:50.771 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 31u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.771 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 32u unix 0xffff8f3917acdd80 0t0 697 /var/run/lttng/sessiond-health type=STREAM 2023-10-08T15:40:50.771 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 33r FIFO 0,13 0t0 20176 pipe 2023-10-08T15:40:50.771 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 34w FIFO 0,13 0t0 20176 pipe 2023-10-08T15:40:50.771 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 35u unix 0xffff8f3917b1a200 0t0 23795 /var/run/lttng/sessiond-notification type=STREAM 2023-10-08T15:40:50.771 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 36u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.771 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 37r FIFO 0,13 0t0 20177 pipe 2023-10-08T15:40:50.772 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 38w FIFO 0,13 0t0 20177 pipe 2023-10-08T15:40:50.772 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 39r FIFO 0,13 0t0 20178 pipe 2023-10-08T15:40:50.772 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 40w FIFO 0,13 0t0 20178 pipe 2023-10-08T15:40:50.772 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 41u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.772 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 42u unix 0xffff8f3917b2e600 0t0 20179 /var/run/lttng/client-lttng-sessiond type=STREAM 2023-10-08T15:40:50.772 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 43u unix 0xffff8f3917b1e1c0 0t0 23796 type=STREAM 2023-10-08T15:40:50.772 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 44u unix 0xffff8f3917b19dc0 0t0 698 /var/run/lttng/sessiond-notification type=STREAM 2023-10-08T15:40:50.772 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 45u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.772 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 46r FIFO 0,13 0t0 699 pipe 2023-10-08T15:40:50.772 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 47w FIFO 0,13 0t0 699 pipe 2023-10-08T15:40:50.772 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 48u unix 0xffff8f3917aca640 0t0 700 /var/run/lttng/lttng-ust-sock-8 type=STREAM 2023-10-08T15:40:50.772 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 49u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.773 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 50r FIFO 0,13 0t0 701 pipe 2023-10-08T15:40:50.773 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 51w FIFO 0,13 0t0 701 pipe 2023-10-08T15:40:50.773 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 52r FIFO 0,13 0t0 702 pipe 2023-10-08T15:40:50.773 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 53w FIFO 0,13 0t0 702 pipe 2023-10-08T15:40:50.773 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 54u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.773 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 55r FIFO 0,13 0t0 703 pipe 2023-10-08T15:40:50.773 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 56w FIFO 0,13 0t0 703 pipe 2023-10-08T15:40:50.773 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 57u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.773 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 58u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.773 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 59u IPv4 23799 0t0 TCP localhost:5345 (LISTEN) 2023-10-08T15:40:50.773 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 60r FIFO 0,13 0t0 704 pipe 2023-10-08T15:40:50.774 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 61w FIFO 0,13 0t0 704 pipe 2023-10-08T15:40:50.774 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 62u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.774 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-ses 569 620 lttng-ses root 63u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.774 INFO:teuthology.orchestra.run.smithi089.stdout:networkd- 573 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.774 INFO:teuthology.orchestra.run.smithi089.stdout:networkd- 573 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.774 INFO:teuthology.orchestra.run.smithi089.stdout:networkd- 573 root txt REG 8,1 5502744 11325 /usr/bin/python3.8 2023-10-08T15:40:50.774 INFO:teuthology.orchestra.run.smithi089.stdout:networkd- 573 root mem REG 8,1 74848 8355 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-10-08T15:40:50.774 INFO:teuthology.orchestra.run.smithi089.stdout:networkd- 573 root mem REG 8,1 137584 8109 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.28.0 2023-10-08T15:40:50.774 INFO:teuthology.orchestra.run.smithi089.stdout:networkd- 573 root mem REG 8,1 1168056 8360 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.2.5 2023-10-08T15:40:50.774 INFO:teuthology.orchestra.run.smithi089.stdout:networkd- 573 root mem REG 8,1 129248 13039 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.2 2023-10-08T15:40:50.774 INFO:teuthology.orchestra.run.smithi089.stdout:networkd- 573 root mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:50.774 INFO:teuthology.orchestra.run.smithi089.stdout:networkd- 573 root mem REG 8,1 709496 10741 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.28.0 2023-10-08T15:40:50.775 INFO:teuthology.orchestra.run.smithi089.stdout:networkd- 573 root mem REG 8,1 325944 8767 /usr/lib/x86_64-linux-gnu/libdbus-1.so.3.19.11 2023-10-08T15:40:50.775 INFO:teuthology.orchestra.run.smithi089.stdout:networkd- 573 root mem REG 8,1 172192 25161 /usr/lib/python3/dist-packages/_dbus_bindings.cpython-38-x86_64-linux-gnu.so 2023-10-08T15:40:50.775 INFO:teuthology.orchestra.run.smithi089.stdout:networkd- 573 root mem REG 8,1 191948 22711 /usr/lib/x86_64-linux-gnu/girepository-1.0/GLib-2.0.typelib 2023-10-08T15:40:50.775 INFO:teuthology.orchestra.run.smithi089.stdout:networkd- 573 root mem REG 8,1 584392 8917 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.9.0 2023-10-08T15:40:50.775 INFO:teuthology.orchestra.run.smithi089.stdout:networkd- 573 root mem REG 8,1 351352 9401 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-10-08T15:40:50.775 INFO:teuthology.orchestra.run.smithi089.stdout:networkd- 573 root mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:50.775 INFO:teuthology.orchestra.run.smithi089.stdout:networkd- 573 root mem REG 8,1 163200 8942 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-10-08T15:40:50.775 INFO:teuthology.orchestra.run.smithi089.stdout:networkd- 573 root mem REG 8,1 387768 8064 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-10-08T15:40:50.775 INFO:teuthology.orchestra.run.smithi089.stdout:networkd- 573 root mem REG 8,1 1957200 9382 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.6400.6 2023-10-08T15:40:50.775 INFO:teuthology.orchestra.run.smithi089.stdout:networkd- 573 root mem REG 8,1 465008 11338 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-10-08T15:40:50.775 INFO:teuthology.orchestra.run.smithi089.stdout:networkd- 573 root mem REG 8,1 223424 9396 /usr/lib/x86_64-linux-gnu/libgirepository-1.0.so.1.0.0 2023-10-08T15:40:50.775 INFO:teuthology.orchestra.run.smithi089.stdout:networkd- 573 root mem REG 8,1 387448 9388 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.6400.6 2023-10-08T15:40:50.776 INFO:teuthology.orchestra.run.smithi089.stdout:networkd- 573 root mem REG 8,1 1207920 9384 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.6400.6 2023-10-08T15:40:50.776 INFO:teuthology.orchestra.run.smithi089.stdout:networkd- 573 root mem REG 8,1 344656 25203 /usr/lib/python3/dist-packages/gi/_gi.cpython-38-x86_64-linux-gnu.so 2023-10-08T15:40:50.776 INFO:teuthology.orchestra.run.smithi089.stdout:networkd- 573 root mem REG 8,1 45832 24533 /usr/lib/python3.8/lib-dynload/_lzma.cpython-38-x86_64-linux-gnu.so 2023-10-08T15:40:50.776 INFO:teuthology.orchestra.run.smithi089.stdout:networkd- 573 root mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:50.776 INFO:teuthology.orchestra.run.smithi089.stdout:networkd- 573 root mem REG 8,1 18640 9386 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.6400.6 2023-10-08T15:40:50.776 INFO:teuthology.orchestra.run.smithi089.stdout:networkd- 573 root mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:50.776 INFO:teuthology.orchestra.run.smithi089.stdout:networkd- 573 root mem REG 8,1 43416 10645 /usr/lib/x86_64-linux-gnu/libffi.so.7.1.0 2023-10-08T15:40:50.776 INFO:teuthology.orchestra.run.smithi089.stdout:networkd- 573 root mem REG 8,1 28520 24516 /usr/lib/python3.8/lib-dynload/_bz2.cpython-38-x86_64-linux-gnu.so 2023-10-08T15:40:50.776 INFO:teuthology.orchestra.run.smithi089.stdout:networkd- 573 root mem REG 8,1 23080 25162 /usr/lib/python3/dist-packages/_dbus_glib_bindings.cpython-38-x86_64-linux-gnu.so 2023-10-08T15:40:50.776 INFO:teuthology.orchestra.run.smithi089.stdout:networkd- 573 root mem REG 8,1 78088 24531 /usr/lib/python3.8/lib-dynload/_json.cpython-38-x86_64-linux-gnu.so 2023-10-08T15:40:50.776 INFO:teuthology.orchestra.run.smithi089.stdout:networkd- 573 root mem REG 8,1 6017584 10873 /usr/lib/locale/locale-archive 2023-10-08T15:40:50.776 INFO:teuthology.orchestra.run.smithi089.stdout:networkd- 573 root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:50.777 INFO:teuthology.orchestra.run.smithi089.stdout:networkd- 573 root mem REG 8,1 182560 8776 /usr/lib/x86_64-linux-gnu/libexpat.so.1.6.11 2023-10-08T15:40:50.777 INFO:teuthology.orchestra.run.smithi089.stdout:networkd- 573 root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:50.777 INFO:teuthology.orchestra.run.smithi089.stdout:networkd- 573 root mem REG 8,1 14880 13415 /usr/lib/x86_64-linux-gnu/libutil-2.31.so 2023-10-08T15:40:50.777 INFO:teuthology.orchestra.run.smithi089.stdout:networkd- 573 root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.777 INFO:teuthology.orchestra.run.smithi089.stdout:networkd- 573 root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.777 INFO:teuthology.orchestra.run.smithi089.stdout:networkd- 573 root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.777 INFO:teuthology.orchestra.run.smithi089.stdout:networkd- 573 root mem REG 8,1 18696 13609 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-10-08T15:40:50.777 INFO:teuthology.orchestra.run.smithi089.stdout:networkd- 573 root mem REG 8,1 27002 13665 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-10-08T15:40:50.777 INFO:teuthology.orchestra.run.smithi089.stdout:networkd- 573 root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.777 INFO:teuthology.orchestra.run.smithi089.stdout:networkd- 573 root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.777 INFO:teuthology.orchestra.run.smithi089.stdout:networkd- 573 root 1u unix 0xffff8f390dc23b80 0t0 20078 type=STREAM 2023-10-08T15:40:50.777 INFO:teuthology.orchestra.run.smithi089.stdout:networkd- 573 root 2u unix 0xffff8f390dc23b80 0t0 20078 type=STREAM 2023-10-08T15:40:50.778 INFO:teuthology.orchestra.run.smithi089.stdout:networkd- 573 root 3u unix 0xffff8f3916c73b80 0t0 22907 type=STREAM 2023-10-08T15:40:50.778 INFO:teuthology.orchestra.run.smithi089.stdout:networkd- 573 root 4u a_inode 0,14 0 13377 [eventfd] 2023-10-08T15:40:50.778 INFO:teuthology.orchestra.run.smithi089.stdout:networkd- 573 root 5u unix 0xffff8f3916c70880 0t0 22909 type=STREAM 2023-10-08T15:40:50.778 INFO:teuthology.orchestra.run.smithi089.stdout:networkd- 573 root 6u unix 0xffff8f3916c75d80 0t0 22910 type=STREAM 2023-10-08T15:40:50.778 INFO:teuthology.orchestra.run.smithi089.stdout:smartd 576 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.778 INFO:teuthology.orchestra.run.smithi089.stdout:smartd 576 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.778 INFO:teuthology.orchestra.run.smithi089.stdout:smartd 576 root txt REG 8,1 712104 16203 /usr/sbin/smartd 2023-10-08T15:40:50.778 INFO:teuthology.orchestra.run.smithi089.stdout:smartd 576 root mem REG 8,1 137584 8109 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.28.0 2023-10-08T15:40:50.778 INFO:teuthology.orchestra.run.smithi089.stdout:smartd 576 root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:50.779 INFO:teuthology.orchestra.run.smithi089.stdout:smartd 576 root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.779 INFO:teuthology.orchestra.run.smithi089.stdout:smartd 576 root mem REG 8,1 584392 8917 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.9.0 2023-10-08T15:40:50.779 INFO:teuthology.orchestra.run.smithi089.stdout:smartd 576 root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.779 INFO:teuthology.orchestra.run.smithi089.stdout:smartd 576 root mem REG 8,1 1168056 8360 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.2.5 2023-10-08T15:40:50.779 INFO:teuthology.orchestra.run.smithi089.stdout:smartd 576 root mem REG 8,1 129248 13039 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.2 2023-10-08T15:40:50.779 INFO:teuthology.orchestra.run.smithi089.stdout:smartd 576 root mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:50.779 INFO:teuthology.orchestra.run.smithi089.stdout:smartd 576 root mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:50.779 INFO:teuthology.orchestra.run.smithi089.stdout:smartd 576 root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.779 INFO:teuthology.orchestra.run.smithi089.stdout:smartd 576 root mem REG 8,1 104984 8251 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-10-08T15:40:50.780 INFO:teuthology.orchestra.run.smithi089.stdout:smartd 576 root mem REG 8,1 1956992 8082 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28 2023-10-08T15:40:50.780 INFO:teuthology.orchestra.run.smithi089.stdout:smartd 576 root mem REG 8,1 163200 8942 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-10-08T15:40:50.780 INFO:teuthology.orchestra.run.smithi089.stdout:smartd 576 root mem REG 8,1 709496 10741 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.28.0 2023-10-08T15:40:50.780 INFO:teuthology.orchestra.run.smithi089.stdout:smartd 576 root mem REG 8,1 27064 8001 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-10-08T15:40:50.780 INFO:teuthology.orchestra.run.smithi089.stdout:smartd 576 root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.780 INFO:teuthology.orchestra.run.smithi089.stdout:smartd 576 root 0u CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.780 INFO:teuthology.orchestra.run.smithi089.stdout:smartd 576 root 1u CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.780 INFO:teuthology.orchestra.run.smithi089.stdout:smartd 576 root 2u CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.780 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-l 578 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.781 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-l 578 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.781 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-l 578 root txt REG 8,1 268576 10868 /usr/lib/systemd/systemd-logind 2023-10-08T15:40:50.781 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-l 578 root mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:50.781 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-l 578 root mem REG 8,1 27064 8001 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-10-08T15:40:50.781 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-l 578 root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:50.781 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-l 578 root mem REG 8,1 178528 12765 /usr/lib/x86_64-linux-gnu/libudev.so.1.6.17 2023-10-08T15:40:50.781 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-l 578 root mem REG 8,1 584392 8917 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.9.0 2023-10-08T15:40:50.781 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-l 578 root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.781 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-l 578 root mem REG 8,1 133200 8347 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-10-08T15:40:50.781 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-l 578 root mem REG 8,1 686160 8833 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.4 2023-10-08T15:40:50.782 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-l 578 root mem REG 8,1 1575112 10736 /usr/lib/x86_64-linux-gnu/libunistring.so.2.1.0 2023-10-08T15:40:50.782 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-l 578 root mem REG 8,1 137584 8109 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.28.0 2023-10-08T15:40:50.782 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-l 578 root mem REG 8,1 67912 8783 /usr/lib/x86_64-linux-gnu/libjson-c.so.4.0.0 2023-10-08T15:40:50.782 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-l 578 root mem REG 8,1 34872 10626 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-10-08T15:40:50.782 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-l 578 root DEL REG 8,1 8794 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:50.782 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-l 578 root mem REG 8,1 431472 10641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-10-08T15:40:50.782 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-l 578 root DEL REG 8,1 8351 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-10-08T15:40:50.782 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-l 578 root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.782 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-l 578 root mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:50.783 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-l 578 root mem REG 8,1 163200 8942 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-10-08T15:40:50.783 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-l 578 root mem REG 8,1 133568 8867 /usr/lib/x86_64-linux-gnu/libseccomp.so.2.5.1 2023-10-08T15:40:50.783 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-l 578 root mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:50.783 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-l 578 root mem REG 8,1 68320 8384 /usr/lib/x86_64-linux-gnu/libpam.so.0.84.2 2023-10-08T15:40:50.783 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-l 578 root mem REG 8,1 387768 8064 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-10-08T15:40:50.783 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-l 578 root mem REG 8,1 129248 13039 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.2 2023-10-08T15:40:50.783 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-l 578 root mem REG 8,1 112848 8859 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.5 2023-10-08T15:40:50.783 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-l 578 root mem REG 8,1 35440 10678 /usr/lib/x86_64-linux-gnu/libip4tc.so.2.0.0 2023-10-08T15:40:50.783 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-l 578 root mem REG 8,1 129096 10669 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.6 2023-10-08T15:40:50.783 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-l 578 root mem REG 8,1 1168056 8360 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.2.5 2023-10-08T15:40:50.784 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-l 578 root mem REG 8,1 417328 8800 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.5.0 2023-10-08T15:40:50.784 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-l 578 root mem REG 8,1 202760 8017 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-10-08T15:40:50.784 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-l 578 root mem REG 8,1 31120 10630 /usr/lib/x86_64-linux-gnu/libcap.so.2.32 2023-10-08T15:40:50.784 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-l 578 root mem REG 8,1 351352 9401 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-10-08T15:40:50.784 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-l 578 root mem REG 8,1 39088 8336 /usr/lib/x86_64-linux-gnu/libacl.so.1.1.2253 2023-10-08T15:40:50.784 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-l 578 root mem REG 8,1 2454472 8914 /usr/lib/systemd/libsystemd-shared-245.so 2023-10-08T15:40:50.784 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-l 578 root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.784 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-l 578 root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.784 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-l 578 root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.785 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-l 578 root 1u unix 0xffff8f39122572c0 0t0 19254 type=STREAM 2023-10-08T15:40:50.785 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-l 578 root 2u unix 0xffff8f39122572c0 0t0 19254 type=STREAM 2023-10-08T15:40:50.785 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-l 578 root 3u unix 0xffff8f39181a7700 0t0 19262 type=DGRAM 2023-10-08T15:40:50.785 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-l 578 root 4u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.785 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-l 578 root 5u a_inode 0,14 0 13377 [signalfd] 2023-10-08T15:40:50.785 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-l 578 root 6u a_inode 0,14 0 13377 [timerfd] 2023-10-08T15:40:50.785 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-l 578 root 7r REG 0,23 4096 27157 /sys/devices/virtual/tty/tty0/active 2023-10-08T15:40:50.785 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-l 578 root 8u netlink 0t0 19268 KOBJECT_UEVENT 2023-10-08T15:40:50.785 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-l 578 root 9r a_inode 0,14 0 13377 inotify 2023-10-08T15:40:50.785 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-l 578 root 10r FIFO 0,25 0t0 828 /run/systemd/inhibit/1.ref 2023-10-08T15:40:50.786 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-l 578 root 11u netlink 0t0 19269 KOBJECT_UEVENT 2023-10-08T15:40:50.786 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-l 578 root 12u netlink 0t0 19270 KOBJECT_UEVENT 2023-10-08T15:40:50.786 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-l 578 root 13u netlink 0t0 19271 KOBJECT_UEVENT 2023-10-08T15:40:50.786 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-l 578 root 14u unix 0xffff8f39181a7b40 0t0 19272 type=STREAM 2023-10-08T15:40:50.786 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-l 578 root 15u a_inode 0,14 0 13377 [timerfd] 2023-10-08T15:40:50.786 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-l 578 root 16u CHR 13,65 0t0 153 /dev/input/event1 2023-10-08T15:40:50.786 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-l 578 root 17u CHR 13,64 0t0 152 /dev/input/event0 2023-10-08T15:40:50.786 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-l 578 root 18u CHR 13,66 0t0 392 /dev/input/event2 2023-10-08T15:40:50.786 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-l 578 root 19u CHR 4,6 0t0 27 /dev/tty6 2023-10-08T15:40:50.787 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-l 578 root 20r FIFO 0,25 0t0 842 /run/systemd/sessions/4.ref 2023-10-08T15:40:50.787 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-l 578 root 22r FIFO 0,25 0t0 881 /run/systemd/inhibit/9.ref 2023-10-08T15:40:50.787 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-l 578 root 23r FIFO 0,25 0t0 886 /run/systemd/inhibit/10.ref 2023-10-08T15:40:50.787 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/4 600 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.787 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/4 600 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.787 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/4 600 root txt unknown /proc/600/exe 2023-10-08T15:40:50.787 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-run 607 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.787 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-run 607 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.787 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-run 607 root txt REG 8,1 987576 21343 /usr/bin/lttng-sessiond 2023-10-08T15:40:50.788 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-run 607 root mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:50.788 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-run 607 root mem REG 8,1 104984 8251 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-10-08T15:40:50.788 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-run 607 root mem REG 8,1 1956992 8082 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28 2023-10-08T15:40:50.788 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-run 607 root mem REG 8,1 28046896 10299 /usr/lib/x86_64-linux-gnu/libicudata.so.66.1 2023-10-08T15:40:50.788 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-run 607 root mem REG 8,1 47960 12609 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-10-08T15:40:50.788 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-run 607 root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:50.788 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-run 607 root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:50.788 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-run 607 root mem REG 8,1 1976648 10310 /usr/lib/x86_64-linux-gnu/libicuuc.so.66.1 2023-10-08T15:40:50.788 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-run 607 root DEL REG 8,1 8794 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:50.789 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-run 607 root mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:50.789 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-run 607 root mem REG 8,1 686160 8833 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.4 2023-10-08T15:40:50.789 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-run 607 root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.789 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-run 607 root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.789 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-run 607 root mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:50.789 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-run 607 root mem REG 8,1 43136 21280 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.6.1.0 2023-10-08T15:40:50.789 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-run 607 root mem REG 8,1 273576 18735 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.4.0.0 2023-10-08T15:40:50.789 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-run 607 root mem REG 8,1 1799408 10319 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.10 2023-10-08T15:40:50.789 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-run 607 root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.790 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-run 607 root DEL REG 8,1 8351 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-10-08T15:40:50.790 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-run 607 root mem REG 8,1 39480 21286 /usr/lib/x86_64-linux-gnu/liburcu.so.6.1.0 2023-10-08T15:40:50.790 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-run 607 root mem REG 8,1 22520 21281 /usr/lib/x86_64-linux-gnu/liburcu-common.so.6.1.0 2023-10-08T15:40:50.790 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-run 607 root mem REG 8,1 444816 21295 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-10-08T15:40:50.790 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-run 607 root mem REG 8,1 112848 8859 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.5 2023-10-08T15:40:50.790 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-run 607 root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.790 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-run 607 root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.790 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-run 607 root 1u unix 0xffff8f3919f43b80 0t0 22746 type=STREAM 2023-10-08T15:40:50.790 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-run 607 root 2u unix 0xffff8f3919f43b80 0t0 22746 type=STREAM 2023-10-08T15:40:50.790 INFO:teuthology.orchestra.run.smithi089.stdout:lttng-run 607 root 5u unix 0xffff8f3917acee80 0t0 676 type=STREAM 2023-10-08T15:40:50.791 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.791 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.791 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 root txt REG 8,1 521200 10229 /usr/sbin/dhclient 2023-10-08T15:40:50.791 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 root mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:50.791 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 root DEL REG 8,1 8794 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:50.791 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.791 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.791 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.791 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 root mem REG 8,1 483960 9727 /usr/lib/x86_64-linux-gnu/libisc-export.so.1105.0.0 2023-10-08T15:40:50.792 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 root mem REG 8,1 2306384 9736 /usr/lib/x86_64-linux-gnu/libdns-export.so.1109.0.1 2023-10-08T15:40:50.792 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.792 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 root 0u CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.792 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 root 1u CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.792 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 root 2u CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.792 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 root 3u unix 0xffff8f39152b9980 0t0 20183 type=DGRAM 2023-10-08T15:40:50.792 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 root 4r FIFO 0,13 0t0 23834 pipe 2023-10-08T15:40:50.792 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 root 6w FIFO 0,13 0t0 23834 pipe 2023-10-08T15:40:50.792 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 root 7w REG 8,1 1118 152 /var/lib/dhcp/dhclient.enp3s0f1.leases 2023-10-08T15:40:50.792 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 root 8u pack 23868 0t0 ALL type=SOCK_RAW 2023-10-08T15:40:50.792 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 root 9u IPv4 23869 0t0 UDP *:bootpc 2023-10-08T15:40:50.792 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 643 isc-worke root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.793 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 643 isc-worke root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.793 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 643 isc-worke root txt REG 8,1 521200 10229 /usr/sbin/dhclient 2023-10-08T15:40:50.793 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 643 isc-worke root mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:50.793 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 643 isc-worke root DEL REG 8,1 8794 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:50.793 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 643 isc-worke root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.793 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 643 isc-worke root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.793 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 643 isc-worke root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.793 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 643 isc-worke root mem REG 8,1 483960 9727 /usr/lib/x86_64-linux-gnu/libisc-export.so.1105.0.0 2023-10-08T15:40:50.793 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 643 isc-worke root mem REG 8,1 2306384 9736 /usr/lib/x86_64-linux-gnu/libdns-export.so.1109.0.1 2023-10-08T15:40:50.794 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 643 isc-worke root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.794 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 643 isc-worke root 0u CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.794 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 643 isc-worke root 1u CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.794 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 643 isc-worke root 2u CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.794 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 643 isc-worke root 3u unix 0xffff8f39152b9980 0t0 20183 type=DGRAM 2023-10-08T15:40:50.794 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 643 isc-worke root 4r FIFO 0,13 0t0 23834 pipe 2023-10-08T15:40:50.794 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 643 isc-worke root 6w FIFO 0,13 0t0 23834 pipe 2023-10-08T15:40:50.794 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 643 isc-worke root 7w REG 8,1 1118 152 /var/lib/dhcp/dhclient.enp3s0f1.leases 2023-10-08T15:40:50.794 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 643 isc-worke root 8u pack 23868 0t0 ALL type=SOCK_RAW 2023-10-08T15:40:50.794 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 643 isc-worke root 9u IPv4 23869 0t0 UDP *:bootpc 2023-10-08T15:40:50.795 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 644 isc-socke root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.795 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 644 isc-socke root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.795 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 644 isc-socke root txt REG 8,1 521200 10229 /usr/sbin/dhclient 2023-10-08T15:40:50.795 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 644 isc-socke root mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:50.795 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 644 isc-socke root DEL REG 8,1 8794 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:50.795 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 644 isc-socke root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.795 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 644 isc-socke root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.795 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 644 isc-socke root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.795 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 644 isc-socke root mem REG 8,1 483960 9727 /usr/lib/x86_64-linux-gnu/libisc-export.so.1105.0.0 2023-10-08T15:40:50.795 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 644 isc-socke root mem REG 8,1 2306384 9736 /usr/lib/x86_64-linux-gnu/libdns-export.so.1109.0.1 2023-10-08T15:40:50.796 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 644 isc-socke root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.796 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 644 isc-socke root 0u CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.796 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 644 isc-socke root 1u CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.796 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 644 isc-socke root 2u CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.796 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 644 isc-socke root 3u unix 0xffff8f39152b9980 0t0 20183 type=DGRAM 2023-10-08T15:40:50.796 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 644 isc-socke root 4r FIFO 0,13 0t0 23834 pipe 2023-10-08T15:40:50.796 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 644 isc-socke root 6w FIFO 0,13 0t0 23834 pipe 2023-10-08T15:40:50.796 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 644 isc-socke root 7w REG 8,1 1118 152 /var/lib/dhcp/dhclient.enp3s0f1.leases 2023-10-08T15:40:50.796 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 644 isc-socke root 8u pack 23868 0t0 ALL type=SOCK_RAW 2023-10-08T15:40:50.796 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 644 isc-socke root 9u IPv4 23869 0t0 UDP *:bootpc 2023-10-08T15:40:50.797 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 645 isc-timer root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.797 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 645 isc-timer root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.797 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 645 isc-timer root txt REG 8,1 521200 10229 /usr/sbin/dhclient 2023-10-08T15:40:50.797 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 645 isc-timer root mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:50.797 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 645 isc-timer root DEL REG 8,1 8794 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:50.797 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 645 isc-timer root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.797 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 645 isc-timer root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.797 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 645 isc-timer root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.797 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 645 isc-timer root mem REG 8,1 483960 9727 /usr/lib/x86_64-linux-gnu/libisc-export.so.1105.0.0 2023-10-08T15:40:50.797 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 645 isc-timer root mem REG 8,1 2306384 9736 /usr/lib/x86_64-linux-gnu/libdns-export.so.1109.0.1 2023-10-08T15:40:50.797 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 645 isc-timer root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.798 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 645 isc-timer root 0u CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.798 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 645 isc-timer root 1u CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.798 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 645 isc-timer root 2u CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.798 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 645 isc-timer root 3u unix 0xffff8f39152b9980 0t0 20183 type=DGRAM 2023-10-08T15:40:50.798 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 645 isc-timer root 4r FIFO 0,13 0t0 23834 pipe 2023-10-08T15:40:50.798 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 645 isc-timer root 6w FIFO 0,13 0t0 23834 pipe 2023-10-08T15:40:50.798 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 645 isc-timer root 7w REG 8,1 1118 152 /var/lib/dhcp/dhclient.enp3s0f1.leases 2023-10-08T15:40:50.798 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 645 isc-timer root 8u pack 23868 0t0 ALL type=SOCK_RAW 2023-10-08T15:40:50.798 INFO:teuthology.orchestra.run.smithi089.stdout:dhclient 638 645 isc-timer root 9u IPv4 23869 0t0 UDP *:bootpc 2023-10-08T15:40:50.798 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.798 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.799 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 root txt REG 8,1 121504 105897 /usr/lib/policykit-1/polkitd 2023-10-08T15:40:50.799 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 root mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:50.799 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 root mem REG 8,1 67656 101921 /usr/lib/x86_64-linux-gnu/gio/modules/libdconfsettings.so 2023-10-08T15:40:50.799 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:50.799 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 root mem REG 8,1 104984 8251 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-10-08T15:40:50.799 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 root mem REG 8,1 1956992 8082 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28 2023-10-08T15:40:50.799 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 root mem REG 8,1 133640 18368 /usr/lib/x86_64-linux-gnu/libproxy.so.1.0.0 2023-10-08T15:40:50.799 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 root mem REG 8,1 137584 8109 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.28.0 2023-10-08T15:40:50.799 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 root mem REG 8,1 584392 8917 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.9.0 2023-10-08T15:40:50.799 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 root mem REG 8,1 351352 9401 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-10-08T15:40:50.799 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 root mem REG 8,1 1168056 8360 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.2.5 2023-10-08T15:40:50.800 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 root mem REG 8,1 129248 13039 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.2 2023-10-08T15:40:50.800 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 root mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:50.800 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 root mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:50.800 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 root mem REG 8,1 465008 11338 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-10-08T15:40:50.800 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 root mem REG 8,1 43416 10645 /usr/lib/x86_64-linux-gnu/libffi.so.7.1.0 2023-10-08T15:40:50.800 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 root mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:50.800 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 root mem REG 8,1 163200 8942 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-10-08T15:40:50.800 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 root mem REG 8,1 387768 8064 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-10-08T15:40:50.800 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.800 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:50.800 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 root mem REG 8,1 18640 9386 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.6400.6 2023-10-08T15:40:50.800 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.801 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.801 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 root mem REG 8,1 182560 8776 /usr/lib/x86_64-linux-gnu/libexpat.so.1.6.11 2023-10-08T15:40:50.801 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 root mem REG 8,1 709496 10741 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.28.0 2023-10-08T15:40:50.801 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 root mem REG 8,1 1207920 9384 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.6400.6 2023-10-08T15:40:50.801 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 root mem REG 8,1 387448 9388 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.6400.6 2023-10-08T15:40:50.801 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 root mem REG 8,1 1957200 9382 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.6400.6 2023-10-08T15:40:50.801 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 root mem REG 8,1 126472 12515 /usr/lib/x86_64-linux-gnu/libpolkit-gobject-1.so.0.0.0 2023-10-08T15:40:50.801 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 root mem REG 8,1 27002 13665 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-10-08T15:40:50.801 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.801 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 root 0u CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.801 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 root 1u CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.801 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 root 2u CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.802 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 root 3u a_inode 0,14 0 13377 [eventfd] 2023-10-08T15:40:50.802 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 root 4u a_inode 0,14 0 13377 [signalfd] 2023-10-08T15:40:50.802 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 root 5u a_inode 0,14 0 13377 [eventfd] 2023-10-08T15:40:50.802 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 root 6u unix 0xffff8f39173ccc80 0t0 21766 type=STREAM 2023-10-08T15:40:50.802 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 root 7u a_inode 0,14 0 13377 [eventfd] 2023-10-08T15:40:50.802 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 root 8r a_inode 0,14 0 13377 inotify 2023-10-08T15:40:50.802 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 root 9r a_inode 0,14 0 13377 inotify 2023-10-08T15:40:50.802 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 657 gmain root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.802 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 657 gmain root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.802 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 657 gmain root txt REG 8,1 121504 105897 /usr/lib/policykit-1/polkitd 2023-10-08T15:40:50.803 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 657 gmain root mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:50.803 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 657 gmain root mem REG 8,1 67656 101921 /usr/lib/x86_64-linux-gnu/gio/modules/libdconfsettings.so 2023-10-08T15:40:50.803 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 657 gmain root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:50.803 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 657 gmain root mem REG 8,1 104984 8251 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-10-08T15:40:50.803 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 657 gmain root mem REG 8,1 1956992 8082 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28 2023-10-08T15:40:50.803 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 657 gmain root mem REG 8,1 133640 18368 /usr/lib/x86_64-linux-gnu/libproxy.so.1.0.0 2023-10-08T15:40:50.803 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 657 gmain root mem REG 8,1 137584 8109 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.28.0 2023-10-08T15:40:50.803 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 657 gmain root mem REG 8,1 584392 8917 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.9.0 2023-10-08T15:40:50.803 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 657 gmain root mem REG 8,1 351352 9401 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-10-08T15:40:50.803 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 657 gmain root mem REG 8,1 1168056 8360 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.2.5 2023-10-08T15:40:50.803 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 657 gmain root mem REG 8,1 129248 13039 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.2 2023-10-08T15:40:50.803 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 657 gmain root mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:50.804 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 657 gmain root mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:50.804 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 657 gmain root mem REG 8,1 465008 11338 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-10-08T15:40:50.804 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 657 gmain root mem REG 8,1 43416 10645 /usr/lib/x86_64-linux-gnu/libffi.so.7.1.0 2023-10-08T15:40:50.804 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 657 gmain root mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:50.804 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 657 gmain root mem REG 8,1 163200 8942 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-10-08T15:40:50.804 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 657 gmain root mem REG 8,1 387768 8064 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-10-08T15:40:50.804 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 657 gmain root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.804 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 657 gmain root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:50.804 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 657 gmain root mem REG 8,1 18640 9386 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.6400.6 2023-10-08T15:40:50.804 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 657 gmain root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.804 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 657 gmain root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.804 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 657 gmain root mem REG 8,1 182560 8776 /usr/lib/x86_64-linux-gnu/libexpat.so.1.6.11 2023-10-08T15:40:50.805 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 657 gmain root mem REG 8,1 709496 10741 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.28.0 2023-10-08T15:40:50.805 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 657 gmain root mem REG 8,1 1207920 9384 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.6400.6 2023-10-08T15:40:50.805 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 657 gmain root mem REG 8,1 387448 9388 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.6400.6 2023-10-08T15:40:50.805 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 657 gmain root mem REG 8,1 1957200 9382 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.6400.6 2023-10-08T15:40:50.805 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 657 gmain root mem REG 8,1 126472 12515 /usr/lib/x86_64-linux-gnu/libpolkit-gobject-1.so.0.0.0 2023-10-08T15:40:50.805 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 657 gmain root mem REG 8,1 27002 13665 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-10-08T15:40:50.805 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 657 gmain root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.805 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 657 gmain root 0u CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.805 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 657 gmain root 1u CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.805 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 657 gmain root 2u CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.805 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 657 gmain root 3u a_inode 0,14 0 13377 [eventfd] 2023-10-08T15:40:50.805 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 657 gmain root 4u a_inode 0,14 0 13377 [signalfd] 2023-10-08T15:40:50.806 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 657 gmain root 5u a_inode 0,14 0 13377 [eventfd] 2023-10-08T15:40:50.806 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 657 gmain root 6u unix 0xffff8f39173ccc80 0t0 21766 type=STREAM 2023-10-08T15:40:50.806 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 657 gmain root 7u a_inode 0,14 0 13377 [eventfd] 2023-10-08T15:40:50.806 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 657 gmain root 8r a_inode 0,14 0 13377 inotify 2023-10-08T15:40:50.806 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 657 gmain root 9r a_inode 0,14 0 13377 inotify 2023-10-08T15:40:50.806 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 659 gdbus root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.806 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 659 gdbus root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.806 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 659 gdbus root txt REG 8,1 121504 105897 /usr/lib/policykit-1/polkitd 2023-10-08T15:40:50.806 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 659 gdbus root mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:50.806 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 659 gdbus root mem REG 8,1 67656 101921 /usr/lib/x86_64-linux-gnu/gio/modules/libdconfsettings.so 2023-10-08T15:40:50.806 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 659 gdbus root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:50.807 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 659 gdbus root mem REG 8,1 104984 8251 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-10-08T15:40:50.807 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 659 gdbus root mem REG 8,1 1956992 8082 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28 2023-10-08T15:40:50.807 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 659 gdbus root mem REG 8,1 133640 18368 /usr/lib/x86_64-linux-gnu/libproxy.so.1.0.0 2023-10-08T15:40:50.807 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 659 gdbus root mem REG 8,1 137584 8109 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.28.0 2023-10-08T15:40:50.807 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 659 gdbus root mem REG 8,1 584392 8917 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.9.0 2023-10-08T15:40:50.807 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 659 gdbus root mem REG 8,1 351352 9401 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-10-08T15:40:50.807 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 659 gdbus root mem REG 8,1 1168056 8360 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.2.5 2023-10-08T15:40:50.807 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 659 gdbus root mem REG 8,1 129248 13039 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.2 2023-10-08T15:40:50.807 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 659 gdbus root mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:50.807 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 659 gdbus root mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:50.807 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 659 gdbus root mem REG 8,1 465008 11338 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-10-08T15:40:50.808 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 659 gdbus root mem REG 8,1 43416 10645 /usr/lib/x86_64-linux-gnu/libffi.so.7.1.0 2023-10-08T15:40:50.808 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 659 gdbus root mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:50.808 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 659 gdbus root mem REG 8,1 163200 8942 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-10-08T15:40:50.808 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 659 gdbus root mem REG 8,1 387768 8064 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-10-08T15:40:50.808 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 659 gdbus root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.808 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 659 gdbus root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:50.808 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 659 gdbus root mem REG 8,1 18640 9386 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.6400.6 2023-10-08T15:40:50.808 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 659 gdbus root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.808 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 659 gdbus root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.809 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 659 gdbus root mem REG 8,1 182560 8776 /usr/lib/x86_64-linux-gnu/libexpat.so.1.6.11 2023-10-08T15:40:50.809 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 659 gdbus root mem REG 8,1 709496 10741 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.28.0 2023-10-08T15:40:50.809 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 659 gdbus root mem REG 8,1 1207920 9384 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.6400.6 2023-10-08T15:40:50.809 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 659 gdbus root mem REG 8,1 387448 9388 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.6400.6 2023-10-08T15:40:50.809 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 659 gdbus root mem REG 8,1 1957200 9382 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.6400.6 2023-10-08T15:40:50.809 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 659 gdbus root mem REG 8,1 126472 12515 /usr/lib/x86_64-linux-gnu/libpolkit-gobject-1.so.0.0.0 2023-10-08T15:40:50.809 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 659 gdbus root mem REG 8,1 27002 13665 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-10-08T15:40:50.809 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 659 gdbus root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.809 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 659 gdbus root 0u CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.810 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 659 gdbus root 1u CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.810 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 659 gdbus root 2u CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.810 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 659 gdbus root 3u a_inode 0,14 0 13377 [eventfd] 2023-10-08T15:40:50.810 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 659 gdbus root 4u a_inode 0,14 0 13377 [signalfd] 2023-10-08T15:40:50.810 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 659 gdbus root 5u a_inode 0,14 0 13377 [eventfd] 2023-10-08T15:40:50.810 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 659 gdbus root 6u unix 0xffff8f39173ccc80 0t0 21766 type=STREAM 2023-10-08T15:40:50.810 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 659 gdbus root 7u a_inode 0,14 0 13377 [eventfd] 2023-10-08T15:40:50.810 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 659 gdbus root 8r a_inode 0,14 0 13377 inotify 2023-10-08T15:40:50.810 INFO:teuthology.orchestra.run.smithi089.stdout:polkitd 656 659 gdbus root 9r a_inode 0,14 0 13377 inotify 2023-10-08T15:40:50.810 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-r 679 systemd-resolve cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.811 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-r 679 systemd-resolve rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.811 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-r 679 systemd-resolve txt REG 8,1 415968 10902 /usr/lib/systemd/systemd-resolved 2023-10-08T15:40:50.811 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-r 679 systemd-resolve mem REG 8,1 27064 8001 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-10-08T15:40:50.811 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-r 679 systemd-resolve mem REG 8,1 178528 12765 /usr/lib/x86_64-linux-gnu/libudev.so.1.6.17 2023-10-08T15:40:50.811 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-r 679 systemd-resolve mem REG 8,1 43416 10645 /usr/lib/x86_64-linux-gnu/libffi.so.7.1.0 2023-10-08T15:40:50.811 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-r 679 systemd-resolve mem REG 8,1 584392 8917 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.9.0 2023-10-08T15:40:50.811 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-r 679 systemd-resolve mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.811 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-r 679 systemd-resolve mem REG 8,1 133200 8347 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-10-08T15:40:50.811 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-r 679 systemd-resolve mem REG 8,1 686160 8833 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.4 2023-10-08T15:40:50.811 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-r 679 systemd-resolve mem REG 8,1 67912 8783 /usr/lib/x86_64-linux-gnu/libjson-c.so.4.0.0 2023-10-08T15:40:50.812 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-r 679 systemd-resolve mem REG 8,1 34872 10626 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-10-08T15:40:50.812 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-r 679 systemd-resolve DEL REG 8,1 8794 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:50.812 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-r 679 systemd-resolve mem REG 8,1 431472 10641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-10-08T15:40:50.812 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-r 679 systemd-resolve DEL REG 8,1 8351 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-10-08T15:40:50.812 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-r 679 systemd-resolve mem REG 8,1 534880 10650 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.0 2023-10-08T15:40:50.812 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-r 679 systemd-resolve mem REG 8,1 219976 8813 /usr/lib/x86_64-linux-gnu/libhogweed.so.5.0 2023-10-08T15:40:50.812 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-r 679 systemd-resolve mem REG 8,1 231592 8806 /usr/lib/x86_64-linux-gnu/libnettle.so.7.0 2023-10-08T15:40:50.812 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-r 679 systemd-resolve mem REG 8,1 84120 10728 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.0 2023-10-08T15:40:50.812 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-r 679 systemd-resolve mem REG 8,1 1265624 8816 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-10-08T15:40:50.813 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-r 679 systemd-resolve mem REG 8,1 1575112 10736 /usr/lib/x86_64-linux-gnu/libunistring.so.2.1.0 2023-10-08T15:40:50.813 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-r 679 systemd-resolve mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.813 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-r 679 systemd-resolve mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:50.813 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-r 679 systemd-resolve mem REG 8,1 163200 8942 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-10-08T15:40:50.813 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-r 679 systemd-resolve mem REG 8,1 133568 8867 /usr/lib/x86_64-linux-gnu/libseccomp.so.2.5.1 2023-10-08T15:40:50.813 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-r 679 systemd-resolve mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:50.813 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-r 679 systemd-resolve mem REG 8,1 68320 8384 /usr/lib/x86_64-linux-gnu/libpam.so.0.84.2 2023-10-08T15:40:50.813 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-r 679 systemd-resolve mem REG 8,1 387768 8064 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-10-08T15:40:50.813 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-r 679 systemd-resolve mem REG 8,1 129248 13039 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.2 2023-10-08T15:40:50.814 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-r 679 systemd-resolve mem REG 8,1 112848 8859 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.5 2023-10-08T15:40:50.814 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-r 679 systemd-resolve mem REG 8,1 35440 10678 /usr/lib/x86_64-linux-gnu/libip4tc.so.2.0.0 2023-10-08T15:40:50.814 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-r 679 systemd-resolve mem REG 8,1 417328 8800 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.5.0 2023-10-08T15:40:50.814 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-r 679 systemd-resolve mem REG 8,1 202760 8017 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-10-08T15:40:50.814 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-r 679 systemd-resolve mem REG 8,1 31120 10630 /usr/lib/x86_64-linux-gnu/libcap.so.2.32 2023-10-08T15:40:50.814 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-r 679 systemd-resolve mem REG 8,1 351352 9401 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-10-08T15:40:50.814 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-r 679 systemd-resolve mem REG 8,1 39088 8336 /usr/lib/x86_64-linux-gnu/libacl.so.1.1.2253 2023-10-08T15:40:50.814 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-r 679 systemd-resolve mem REG 8,1 1168056 8360 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.2.5 2023-10-08T15:40:50.814 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-r 679 systemd-resolve mem REG 8,1 1914336 8822 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.27.0 2023-10-08T15:40:50.815 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-r 679 systemd-resolve mem REG 8,1 129096 10669 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.6 2023-10-08T15:40:50.815 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-r 679 systemd-resolve mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:50.815 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-r 679 systemd-resolve mem REG 8,1 137584 8109 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.28.0 2023-10-08T15:40:50.815 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-r 679 systemd-resolve mem REG 8,1 2454472 8914 /usr/lib/systemd/libsystemd-shared-245.so 2023-10-08T15:40:50.815 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-r 679 systemd-resolve mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.815 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-r 679 systemd-resolve mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.815 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-r 679 systemd-resolve 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.815 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-r 679 systemd-resolve 1u unix 0xffff8f3919f41540 0t0 22996 type=STREAM 2023-10-08T15:40:50.815 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-r 679 systemd-resolve 2u unix 0xffff8f3919f41540 0t0 22996 type=STREAM 2023-10-08T15:40:50.816 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-r 679 systemd-resolve 3u unix 0xffff8f3912219980 0t0 23905 type=DGRAM 2023-10-08T15:40:50.816 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-r 679 systemd-resolve 4u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.816 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-r 679 systemd-resolve 5u a_inode 0,14 0 13377 [signalfd] 2023-10-08T15:40:50.816 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-r 679 systemd-resolve 6u a_inode 0,14 0 13377 [timerfd] 2023-10-08T15:40:50.816 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-r 679 systemd-resolve 7r REG 0,5 0 302 /proc/sys/kernel/hostname 2023-10-08T15:40:50.816 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-r 679 systemd-resolve 8r a_inode 0,14 0 13377 inotify 2023-10-08T15:40:50.816 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-r 679 systemd-resolve 9u netlink 0t0 23907 ROUTE 2023-10-08T15:40:50.816 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-r 679 systemd-resolve 10u a_inode 0,14 0 13377 [timerfd] 2023-10-08T15:40:50.816 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-r 679 systemd-resolve 11u unix 0xffff8f391221c400 0t0 23908 type=STREAM 2023-10-08T15:40:50.816 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-r 679 systemd-resolve 12u IPv4 23909 0t0 UDP localhost:domain 2023-10-08T15:40:50.817 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-r 679 systemd-resolve 13u IPv4 23910 0t0 TCP localhost:domain (LISTEN) 2023-10-08T15:40:50.817 INFO:teuthology.orchestra.run.smithi089.stdout:systemd-r 679 systemd-resolve 14u a_inode 0,14 0 13377 [timerfd] 2023-10-08T15:40:50.817 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/1 680 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.817 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/1 680 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.817 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/1 680 root txt unknown /proc/680/exe 2023-10-08T15:40:50.817 INFO:teuthology.orchestra.run.smithi089.stdout:rpc.mount 824 root cwd DIR 8,1 4096 5078 /var/lib/nfs 2023-10-08T15:40:50.817 INFO:teuthology.orchestra.run.smithi089.stdout:rpc.mount 824 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.817 INFO:teuthology.orchestra.run.smithi089.stdout:rpc.mount 824 root txt REG 8,1 116152 20889 /usr/sbin/rpc.mountd 2023-10-08T15:40:50.817 INFO:teuthology.orchestra.run.smithi089.stdout:rpc.mount 824 root mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:50.817 INFO:teuthology.orchestra.run.smithi089.stdout:rpc.mount 824 root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.818 INFO:teuthology.orchestra.run.smithi089.stdout:rpc.mount 824 root mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:50.818 INFO:teuthology.orchestra.run.smithi089.stdout:rpc.mount 824 root mem REG 8,1 22600 15019 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.8 2023-10-08T15:40:50.818 INFO:teuthology.orchestra.run.smithi089.stdout:rpc.mount 824 root mem REG 8,1 56096 15015 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-10-08T15:40:50.818 INFO:teuthology.orchestra.run.smithi089.stdout:rpc.mount 824 root mem REG 8,1 22600 9279 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-10-08T15:40:50.818 INFO:teuthology.orchestra.run.smithi089.stdout:rpc.mount 824 root mem REG 8,1 191040 15017 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-10-08T15:40:50.818 INFO:teuthology.orchestra.run.smithi089.stdout:rpc.mount 824 root mem REG 8,1 902016 15021 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-10-08T15:40:50.818 INFO:teuthology.orchestra.run.smithi089.stdout:rpc.mount 824 root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.818 INFO:teuthology.orchestra.run.smithi089.stdout:rpc.mount 824 root mem REG 8,1 309712 15024 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-10-08T15:40:50.818 INFO:teuthology.orchestra.run.smithi089.stdout:rpc.mount 824 root mem REG 8,1 105560 13403 /usr/lib/x86_64-linux-gnu/libnsl-2.31.so 2023-10-08T15:40:50.819 INFO:teuthology.orchestra.run.smithi089.stdout:rpc.mount 824 root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.819 INFO:teuthology.orchestra.run.smithi089.stdout:rpc.mount 824 root mem REG 8,1 186992 16353 /usr/lib/x86_64-linux-gnu/libtirpc.so.3.0.0 2023-10-08T15:40:50.819 INFO:teuthology.orchestra.run.smithi089.stdout:rpc.mount 824 root mem REG 8,1 351352 9401 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-10-08T15:40:50.819 INFO:teuthology.orchestra.run.smithi089.stdout:rpc.mount 824 root mem REG 8,1 44848 15918 /usr/lib/x86_64-linux-gnu/libwrap.so.0.7.6 2023-10-08T15:40:50.819 INFO:teuthology.orchestra.run.smithi089.stdout:rpc.mount 824 root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.819 INFO:teuthology.orchestra.run.smithi089.stdout:rpc.mount 824 root 0u CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.819 INFO:teuthology.orchestra.run.smithi089.stdout:rpc.mount 824 root 1u CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.819 INFO:teuthology.orchestra.run.smithi089.stdout:rpc.mount 824 root 2u CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.819 INFO:teuthology.orchestra.run.smithi089.stdout:rpc.mount 824 root 3u REG 0,5 0 4026532416 /proc/822/net/rpc/auth.unix.ip/channel 2023-10-08T15:40:50.819 INFO:teuthology.orchestra.run.smithi089.stdout:rpc.mount 824 root 4u REG 0,5 0 4026532420 /proc/822/net/rpc/auth.unix.gid/channel 2023-10-08T15:40:50.820 INFO:teuthology.orchestra.run.smithi089.stdout:rpc.mount 824 root 5u REG 0,5 0 4026532436 /proc/822/net/rpc/nfsd.export/channel 2023-10-08T15:40:50.820 INFO:teuthology.orchestra.run.smithi089.stdout:rpc.mount 824 root 6u REG 0,5 0 4026532440 /proc/822/net/rpc/nfsd.fh/channel 2023-10-08T15:40:50.820 INFO:teuthology.orchestra.run.smithi089.stdout:rpc.mount 824 root 7r REG 8,1 0 991 /var/lib/nfs/etab (deleted) 2023-10-08T15:40:50.820 INFO:teuthology.orchestra.run.smithi089.stdout:rpc.mount 824 root 8u IPv4 21863 0t0 UDP *:37940 2023-10-08T15:40:50.820 INFO:teuthology.orchestra.run.smithi089.stdout:rpc.mount 824 root 9u IPv4 21865 0t0 TCP *:59745 (LISTEN) 2023-10-08T15:40:50.820 INFO:teuthology.orchestra.run.smithi089.stdout:rpc.mount 824 root 10u IPv6 21867 0t0 UDP *:37017 2023-10-08T15:40:50.820 INFO:teuthology.orchestra.run.smithi089.stdout:rpc.mount 824 root 11u IPv6 21869 0t0 TCP *:43863 (LISTEN) 2023-10-08T15:40:50.820 INFO:teuthology.orchestra.run.smithi089.stdout:rpc.mount 824 root 12u IPv4 21871 0t0 UDP *:54244 2023-10-08T15:40:50.820 INFO:teuthology.orchestra.run.smithi089.stdout:rpc.mount 824 root 13u IPv4 21873 0t0 TCP *:51125 (LISTEN) 2023-10-08T15:40:50.820 INFO:teuthology.orchestra.run.smithi089.stdout:rpc.mount 824 root 14u IPv6 21875 0t0 UDP *:33047 2023-10-08T15:40:50.821 INFO:teuthology.orchestra.run.smithi089.stdout:rpc.mount 824 root 15u IPv6 21877 0t0 TCP *:39613 (LISTEN) 2023-10-08T15:40:50.821 INFO:teuthology.orchestra.run.smithi089.stdout:rpc.mount 824 root 16u IPv4 21879 0t0 UDP *:43601 2023-10-08T15:40:50.821 INFO:teuthology.orchestra.run.smithi089.stdout:rpc.mount 824 root 17u IPv4 21881 0t0 TCP *:47195 (LISTEN) 2023-10-08T15:40:50.821 INFO:teuthology.orchestra.run.smithi089.stdout:rpc.mount 824 root 18u IPv6 21883 0t0 UDP *:55339 2023-10-08T15:40:50.821 INFO:teuthology.orchestra.run.smithi089.stdout:rpc.mount 824 root 19u IPv6 21885 0t0 TCP *:39449 (LISTEN) 2023-10-08T15:40:50.821 INFO:teuthology.orchestra.run.smithi089.stdout:rpc.mount 824 root 20u unix 0xffff8f3918ed3b80 0t0 26645 type=DGRAM 2023-10-08T15:40:50.821 INFO:teuthology.orchestra.run.smithi089.stdout:cron 845 root cwd DIR 8,1 4096 852 /var/spool/cron 2023-10-08T15:40:50.821 INFO:teuthology.orchestra.run.smithi089.stdout:cron 845 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.821 INFO:teuthology.orchestra.run.smithi089.stdout:cron 845 root txt REG 8,1 55944 11982 /usr/sbin/cron 2023-10-08T15:40:50.822 INFO:teuthology.orchestra.run.smithi089.stdout:cron 845 root mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:50.822 INFO:teuthology.orchestra.run.smithi089.stdout:cron 845 root mem REG 8,1 6017584 10873 /usr/lib/locale/locale-archive 2023-10-08T15:40:50.822 INFO:teuthology.orchestra.run.smithi089.stdout:cron 845 root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.822 INFO:teuthology.orchestra.run.smithi089.stdout:cron 845 root mem REG 8,1 27064 8001 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-10-08T15:40:50.822 INFO:teuthology.orchestra.run.smithi089.stdout:cron 845 root mem REG 8,1 584392 8917 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.9.0 2023-10-08T15:40:50.822 INFO:teuthology.orchestra.run.smithi089.stdout:cron 845 root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.822 INFO:teuthology.orchestra.run.smithi089.stdout:cron 845 root mem REG 8,1 133200 8347 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-10-08T15:40:50.822 INFO:teuthology.orchestra.run.smithi089.stdout:cron 845 root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.822 INFO:teuthology.orchestra.run.smithi089.stdout:cron 845 root mem REG 8,1 163200 8942 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-10-08T15:40:50.822 INFO:teuthology.orchestra.run.smithi089.stdout:cron 845 root mem REG 8,1 68320 8384 /usr/lib/x86_64-linux-gnu/libpam.so.0.84.2 2023-10-08T15:40:50.823 INFO:teuthology.orchestra.run.smithi089.stdout:cron 845 root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.823 INFO:teuthology.orchestra.run.smithi089.stdout:cron 845 root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.823 INFO:teuthology.orchestra.run.smithi089.stdout:cron 845 root 1u unix 0xffff8f390dc23740 0t0 20280 type=STREAM 2023-10-08T15:40:50.823 INFO:teuthology.orchestra.run.smithi089.stdout:cron 845 root 2u unix 0xffff8f390dc23740 0t0 20280 type=STREAM 2023-10-08T15:40:50.823 INFO:teuthology.orchestra.run.smithi089.stdout:cron 845 root 3uW REG 0,25 4 816 /run/crond.pid 2023-10-08T15:40:50.823 INFO:teuthology.orchestra.run.smithi089.stdout:cron 845 root 4u unix 0xffff8f3916ba72c0 0t0 20281 type=DGRAM 2023-10-08T15:40:50.823 INFO:teuthology.orchestra.run.smithi089.stdout:nrpe 849 nagios cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.823 INFO:teuthology.orchestra.run.smithi089.stdout:nrpe 849 nagios rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.823 INFO:teuthology.orchestra.run.smithi089.stdout:nrpe 849 nagios txt REG 8,1 79128 16212 /usr/sbin/nrpe 2023-10-08T15:40:50.823 INFO:teuthology.orchestra.run.smithi089.stdout:nrpe 849 nagios mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:50.824 INFO:teuthology.orchestra.run.smithi089.stdout:nrpe 849 nagios mem REG 8,1 105560 13403 /usr/lib/x86_64-linux-gnu/libnsl-2.31.so 2023-10-08T15:40:50.824 INFO:teuthology.orchestra.run.smithi089.stdout:nrpe 849 nagios mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.824 INFO:teuthology.orchestra.run.smithi089.stdout:nrpe 849 nagios mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.824 INFO:teuthology.orchestra.run.smithi089.stdout:nrpe 849 nagios mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.824 INFO:teuthology.orchestra.run.smithi089.stdout:nrpe 849 nagios mem REG 8,1 44848 15918 /usr/lib/x86_64-linux-gnu/libwrap.so.0.7.6 2023-10-08T15:40:50.824 INFO:teuthology.orchestra.run.smithi089.stdout:nrpe 849 nagios DEL REG 8,1 8794 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:50.824 INFO:teuthology.orchestra.run.smithi089.stdout:nrpe 849 nagios DEL REG 8,1 8795 /usr/lib/x86_64-linux-gnu/libssl.so.1.1 2023-10-08T15:40:50.824 INFO:teuthology.orchestra.run.smithi089.stdout:nrpe 849 nagios mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.824 INFO:teuthology.orchestra.run.smithi089.stdout:nrpe 849 nagios 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.825 INFO:teuthology.orchestra.run.smithi089.stdout:nrpe 849 nagios 1w CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.825 INFO:teuthology.orchestra.run.smithi089.stdout:nrpe 849 nagios 2w CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.825 INFO:teuthology.orchestra.run.smithi089.stdout:nrpe 849 nagios 3u unix 0xffff8f39154dee80 0t0 25969 type=DGRAM 2023-10-08T15:40:50.825 INFO:teuthology.orchestra.run.smithi089.stdout:nrpe 849 nagios 4u IPv4 25977 0t0 TCP *:nrpe (LISTEN) 2023-10-08T15:40:50.825 INFO:teuthology.orchestra.run.smithi089.stdout:nrpe 849 nagios 5u IPv6 25978 0t0 TCP *:nrpe (LISTEN) 2023-10-08T15:40:50.825 INFO:teuthology.orchestra.run.smithi089.stdout:tgtd 859 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.825 INFO:teuthology.orchestra.run.smithi089.stdout:tgtd 859 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.825 INFO:teuthology.orchestra.run.smithi089.stdout:tgtd 859 root txt REG 8,1 420456 16534 /usr/sbin/tgtd 2023-10-08T15:40:50.825 INFO:teuthology.orchestra.run.smithi089.stdout:tgtd 859 root mem REG 8,1 137584 8109 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.28.0 2023-10-08T15:40:50.825 INFO:teuthology.orchestra.run.smithi089.stdout:tgtd 859 root mem REG 8,1 1168056 8360 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.2.5 2023-10-08T15:40:50.826 INFO:teuthology.orchestra.run.smithi089.stdout:tgtd 859 root mem REG 8,1 129248 13039 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.2 2023-10-08T15:40:50.826 INFO:teuthology.orchestra.run.smithi089.stdout:tgtd 859 root mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:50.826 INFO:teuthology.orchestra.run.smithi089.stdout:tgtd 859 root mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:50.826 INFO:teuthology.orchestra.run.smithi089.stdout:tgtd 859 root mem REG 8,1 137912 13038 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-10-08T15:40:50.826 INFO:teuthology.orchestra.run.smithi089.stdout:tgtd 859 root mem REG 8,1 477584 16364 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-10-08T15:40:50.826 INFO:teuthology.orchestra.run.smithi089.stdout:tgtd 859 root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.826 INFO:teuthology.orchestra.run.smithi089.stdout:tgtd 859 root mem REG 8,1 709496 10741 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.28.0 2023-10-08T15:40:50.826 INFO:teuthology.orchestra.run.smithi089.stdout:tgtd 859 root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.826 INFO:teuthology.orchestra.run.smithi089.stdout:tgtd 859 root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.826 INFO:teuthology.orchestra.run.smithi089.stdout:tgtd 859 root mem REG 8,1 117920 16368 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.2.28.0 2023-10-08T15:40:50.827 INFO:teuthology.orchestra.run.smithi089.stdout:tgtd 859 root mem REG 8,1 121552 16366 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.8.28.0 2023-10-08T15:40:50.827 INFO:teuthology.orchestra.run.smithi089.stdout:tgtd 859 root mem REG 8,1 14336 7405 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-10-08T15:40:50.827 INFO:teuthology.orchestra.run.smithi089.stdout:tgtd 859 root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.827 INFO:teuthology.orchestra.run.smithi089.stdout:tgtd 859 root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.827 INFO:teuthology.orchestra.run.smithi089.stdout:tgtd 859 root 1u unix 0xffff8f3919f43fc0 0t0 23403 type=STREAM 2023-10-08T15:40:50.827 INFO:teuthology.orchestra.run.smithi089.stdout:tgtd 859 root 2u unix 0xffff8f3919f43fc0 0t0 23403 type=STREAM 2023-10-08T15:40:50.827 INFO:teuthology.orchestra.run.smithi089.stdout:tgtd 859 root 3u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.827 INFO:teuthology.orchestra.run.smithi089.stdout:tgtd 859 root 4ww REG 0,25 0 832 /run/tgtd/socket.0.lock 2023-10-08T15:40:50.827 INFO:teuthology.orchestra.run.smithi089.stdout:tgtd 859 root 5u unix 0xffff8f391674dd80 0t0 23486 /var/run/tgtd/socket.0 type=STREAM 2023-10-08T15:40:50.827 INFO:teuthology.orchestra.run.smithi089.stdout:tgtd 859 root 6u IPv4 23490 0t0 TCP *:iscsi-target (LISTEN) 2023-10-08T15:40:50.827 INFO:teuthology.orchestra.run.smithi089.stdout:tgtd 859 root 7u IPv6 23491 0t0 TCP *:iscsi-target (LISTEN) 2023-10-08T15:40:50.828 INFO:teuthology.orchestra.run.smithi089.stdout:tgtd 859 root 8u a_inode 0,14 0 13377 [timerfd] 2023-10-08T15:40:50.828 INFO:teuthology.orchestra.run.smithi089.stdout:tgtd 859 root 9u a_inode 0,14 0 13377 [signalfd] 2023-10-08T15:40:50.828 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.828 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.828 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 root txt REG 8,1 5502744 11325 /usr/bin/python3.8 2023-10-08T15:40:50.828 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 root mem REG 8,1 178528 12765 /usr/lib/x86_64-linux-gnu/libudev.so.1.6.17 2023-10-08T15:40:50.828 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 root mem REG 8,1 686160 8833 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.4 2023-10-08T15:40:50.828 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 root mem REG 8,1 74848 8355 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-10-08T15:40:50.828 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 root mem REG 8,1 104984 8251 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-10-08T15:40:50.828 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 root mem REG 8,1 1956992 8082 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28 2023-10-08T15:40:50.828 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 root mem REG 8,1 1953248 10522 /usr/lib/x86_64-linux-gnu/libapt-pkg.so.6.0.0 2023-10-08T15:40:50.828 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 root mem REG 8,1 359376 26252 /usr/lib/python3/dist-packages/apt_pkg.cpython-38-x86_64-linux-gnu.so 2023-10-08T15:40:50.829 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 root mem REG 8,1 191948 22711 /usr/lib/x86_64-linux-gnu/girepository-1.0/GLib-2.0.typelib 2023-10-08T15:40:50.829 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 root mem REG 8,1 584392 8917 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.9.0 2023-10-08T15:40:50.829 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 root mem REG 8,1 351352 9401 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-10-08T15:40:50.829 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 root mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:50.829 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 root mem REG 8,1 163200 8942 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-10-08T15:40:50.829 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 root mem REG 8,1 387768 8064 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-10-08T15:40:50.829 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 root mem REG 8,1 1957200 9382 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.6400.6 2023-10-08T15:40:50.829 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 root mem REG 8,1 223424 9396 /usr/lib/x86_64-linux-gnu/libgirepository-1.0.so.1.0.0 2023-10-08T15:40:50.829 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 root mem REG 8,1 387448 9388 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.6400.6 2023-10-08T15:40:50.829 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 root mem REG 8,1 344656 25203 /usr/lib/python3/dist-packages/gi/_gi.cpython-38-x86_64-linux-gnu.so 2023-10-08T15:40:50.829 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 root mem REG 8,1 465008 11338 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-10-08T15:40:50.830 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 root mem REG 8,1 1207920 9384 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.6400.6 2023-10-08T15:40:50.830 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 root mem REG 8,1 137584 8109 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.28.0 2023-10-08T15:40:50.830 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 root mem REG 8,1 1168056 8360 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.2.5 2023-10-08T15:40:50.830 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 root mem REG 8,1 129248 13039 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.2 2023-10-08T15:40:50.830 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 root mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:50.830 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 root mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:50.830 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 root mem REG 8,1 709496 10741 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.28.0 2023-10-08T15:40:50.830 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 root mem REG 8,1 325944 8767 /usr/lib/x86_64-linux-gnu/libdbus-1.so.3.19.11 2023-10-08T15:40:50.830 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 root mem REG 8,1 172192 25161 /usr/lib/python3/dist-packages/_dbus_bindings.cpython-38-x86_64-linux-gnu.so 2023-10-08T15:40:50.830 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 root mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:50.831 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 root mem REG 8,1 43416 10645 /usr/lib/x86_64-linux-gnu/libffi.so.7.1.0 2023-10-08T15:40:50.831 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 root mem REG 8,1 18640 9386 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.6400.6 2023-10-08T15:40:50.831 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 root mem REG 8,1 23080 25162 /usr/lib/python3/dist-packages/_dbus_glib_bindings.cpython-38-x86_64-linux-gnu.so 2023-10-08T15:40:50.831 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 root mem REG 8,1 19632 24537 /usr/lib/python3.8/lib-dynload/_queue.cpython-38-x86_64-linux-gnu.so 2023-10-08T15:40:50.831 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 root mem REG 8,1 6017584 10873 /usr/lib/locale/locale-archive 2023-10-08T15:40:50.831 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:50.831 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 root mem REG 8,1 182560 8776 /usr/lib/x86_64-linux-gnu/libexpat.so.1.6.11 2023-10-08T15:40:50.831 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:50.831 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 root mem REG 8,1 14880 13415 /usr/lib/x86_64-linux-gnu/libutil-2.31.so 2023-10-08T15:40:50.832 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.832 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.832 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.832 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 root mem REG 8,1 18696 13609 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-10-08T15:40:50.832 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 root mem REG 8,1 27002 13665 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-10-08T15:40:50.832 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.832 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.832 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 root 1u unix 0xffff8f3919f45500 0t0 23480 type=STREAM 2023-10-08T15:40:50.832 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 root 2u unix 0xffff8f3919f45500 0t0 23480 type=STREAM 2023-10-08T15:40:50.832 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 root 3w REG 8,1 0 1648 /var/log/unattended-upgrades/unattended-upgrades-shutdown.log 2023-10-08T15:40:50.832 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 root 4u unix 0xffff8f39165b8880 0t0 28758 type=STREAM 2023-10-08T15:40:50.833 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 root 5u a_inode 0,14 0 13377 [eventfd] 2023-10-08T15:40:50.833 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 root 6u a_inode 0,14 0 13377 [eventfd] 2023-10-08T15:40:50.833 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 root 7u unix 0xffff8f39165b9540 0t0 28761 type=STREAM 2023-10-08T15:40:50.833 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 root 8w FIFO 0,25 0t0 828 /run/systemd/inhibit/1.ref 2023-10-08T15:40:50.833 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 root 9u unix 0xffff8f39165b8cc0 0t0 28762 type=STREAM 2023-10-08T15:40:50.833 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 998 gmain root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.833 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 998 gmain root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.833 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 998 gmain root txt REG 8,1 5502744 11325 /usr/bin/python3.8 2023-10-08T15:40:50.833 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 998 gmain root mem REG 8,1 178528 12765 /usr/lib/x86_64-linux-gnu/libudev.so.1.6.17 2023-10-08T15:40:50.833 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 998 gmain root mem REG 8,1 686160 8833 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.4 2023-10-08T15:40:50.834 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 998 gmain root mem REG 8,1 74848 8355 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-10-08T15:40:50.834 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 998 gmain root mem REG 8,1 104984 8251 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-10-08T15:40:50.834 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 998 gmain root mem REG 8,1 1956992 8082 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28 2023-10-08T15:40:50.834 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 998 gmain root mem REG 8,1 1953248 10522 /usr/lib/x86_64-linux-gnu/libapt-pkg.so.6.0.0 2023-10-08T15:40:50.834 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 998 gmain root mem REG 8,1 359376 26252 /usr/lib/python3/dist-packages/apt_pkg.cpython-38-x86_64-linux-gnu.so 2023-10-08T15:40:50.834 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 998 gmain root mem REG 8,1 191948 22711 /usr/lib/x86_64-linux-gnu/girepository-1.0/GLib-2.0.typelib 2023-10-08T15:40:50.834 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 998 gmain root mem REG 8,1 584392 8917 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.9.0 2023-10-08T15:40:50.834 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 998 gmain root mem REG 8,1 351352 9401 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-10-08T15:40:50.834 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 998 gmain root mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:50.834 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 998 gmain root mem REG 8,1 163200 8942 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-10-08T15:40:50.834 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 998 gmain root mem REG 8,1 387768 8064 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-10-08T15:40:50.835 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 998 gmain root mem REG 8,1 1957200 9382 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.6400.6 2023-10-08T15:40:50.835 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 998 gmain root mem REG 8,1 223424 9396 /usr/lib/x86_64-linux-gnu/libgirepository-1.0.so.1.0.0 2023-10-08T15:40:50.835 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 998 gmain root mem REG 8,1 387448 9388 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.6400.6 2023-10-08T15:40:50.835 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 998 gmain root mem REG 8,1 344656 25203 /usr/lib/python3/dist-packages/gi/_gi.cpython-38-x86_64-linux-gnu.so 2023-10-08T15:40:50.835 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 998 gmain root mem REG 8,1 465008 11338 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-10-08T15:40:50.835 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 998 gmain root mem REG 8,1 1207920 9384 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.6400.6 2023-10-08T15:40:50.835 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 998 gmain root mem REG 8,1 137584 8109 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.28.0 2023-10-08T15:40:50.835 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 998 gmain root mem REG 8,1 1168056 8360 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.2.5 2023-10-08T15:40:50.835 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 998 gmain root mem REG 8,1 129248 13039 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.2 2023-10-08T15:40:50.835 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 998 gmain root mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:50.835 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 998 gmain root mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:50.836 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 998 gmain root mem REG 8,1 709496 10741 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.28.0 2023-10-08T15:40:50.836 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 998 gmain root mem REG 8,1 325944 8767 /usr/lib/x86_64-linux-gnu/libdbus-1.so.3.19.11 2023-10-08T15:40:50.836 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 998 gmain root mem REG 8,1 172192 25161 /usr/lib/python3/dist-packages/_dbus_bindings.cpython-38-x86_64-linux-gnu.so 2023-10-08T15:40:50.836 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 998 gmain root mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:50.836 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 998 gmain root mem REG 8,1 43416 10645 /usr/lib/x86_64-linux-gnu/libffi.so.7.1.0 2023-10-08T15:40:50.836 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 998 gmain root mem REG 8,1 18640 9386 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.6400.6 2023-10-08T15:40:50.836 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 998 gmain root mem REG 8,1 23080 25162 /usr/lib/python3/dist-packages/_dbus_glib_bindings.cpython-38-x86_64-linux-gnu.so 2023-10-08T15:40:50.836 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 998 gmain root mem REG 8,1 19632 24537 /usr/lib/python3.8/lib-dynload/_queue.cpython-38-x86_64-linux-gnu.so 2023-10-08T15:40:50.836 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 998 gmain root mem REG 8,1 6017584 10873 /usr/lib/locale/locale-archive 2023-10-08T15:40:50.837 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 998 gmain root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:50.837 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 998 gmain root mem REG 8,1 182560 8776 /usr/lib/x86_64-linux-gnu/libexpat.so.1.6.11 2023-10-08T15:40:50.837 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 998 gmain root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:50.837 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 998 gmain root mem REG 8,1 14880 13415 /usr/lib/x86_64-linux-gnu/libutil-2.31.so 2023-10-08T15:40:50.837 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 998 gmain root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.837 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 998 gmain root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.837 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 998 gmain root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.837 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 998 gmain root mem REG 8,1 18696 13609 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-10-08T15:40:50.837 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 998 gmain root mem REG 8,1 27002 13665 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-10-08T15:40:50.837 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 998 gmain root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.838 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 998 gmain root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.838 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 998 gmain root 1u unix 0xffff8f3919f45500 0t0 23480 type=STREAM 2023-10-08T15:40:50.838 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 998 gmain root 2u unix 0xffff8f3919f45500 0t0 23480 type=STREAM 2023-10-08T15:40:50.838 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 998 gmain root 3w REG 8,1 0 1648 /var/log/unattended-upgrades/unattended-upgrades-shutdown.log 2023-10-08T15:40:50.838 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 998 gmain root 4u unix 0xffff8f39165b8880 0t0 28758 type=STREAM 2023-10-08T15:40:50.838 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 998 gmain root 5u a_inode 0,14 0 13377 [eventfd] 2023-10-08T15:40:50.838 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 998 gmain root 6u a_inode 0,14 0 13377 [eventfd] 2023-10-08T15:40:50.838 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 998 gmain root 7u unix 0xffff8f39165b9540 0t0 28761 type=STREAM 2023-10-08T15:40:50.838 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 998 gmain root 8w FIFO 0,25 0t0 828 /run/systemd/inhibit/1.ref 2023-10-08T15:40:50.839 INFO:teuthology.orchestra.run.smithi089.stdout:unattende 861 998 gmain root 9u unix 0xffff8f39165b8cc0 0t0 28762 type=STREAM 2023-10-08T15:40:50.839 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.839 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.839 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 root txt REG 8,1 60313584 17486 /usr/bin/containerd 2023-10-08T15:40:50.839 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.839 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.839 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.839 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 root mem-W REG 8,1 32768 5431 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-10-08T15:40:50.840 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.840 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.840 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 root 1u unix 0xffff8f39165cd0c0 0t0 24087 type=STREAM 2023-10-08T15:40:50.840 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 root 2u unix 0xffff8f39165cd0c0 0t0 24087 type=STREAM 2023-10-08T15:40:50.840 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 root 3uW REG 8,1 32768 5431 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-10-08T15:40:50.840 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 root 4u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.840 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 root 5u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.840 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 root 6r a_inode 0,14 0 13377 inotify 2023-10-08T15:40:50.840 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 root 7u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.841 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 root 8r FIFO 0,13 0t0 22287 pipe 2023-10-08T15:40:50.841 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 root 9w FIFO 0,13 0t0 22287 pipe 2023-10-08T15:40:50.841 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 root 10u unix 0xffff8f39133c6e80 0t0 27744 /run/containerd/containerd.sock.ttrpc type=STREAM 2023-10-08T15:40:50.841 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 root 11u unix 0xffff8f39169c4400 0t0 26147 /run/containerd/containerd.sock type=STREAM 2023-10-08T15:40:50.841 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 root 12u IPv4 27745 0t0 TCP localhost:34273 (LISTEN) 2023-10-08T15:40:50.841 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 root 13u unix 0xffff8f38c5533fc0 0t0 151777 /run/containerd/containerd.sock type=STREAM 2023-10-08T15:40:50.841 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 root 14u unix 0xffff8f38df8ce1c0 0t0 151779 /run/containerd/containerd.sock type=STREAM 2023-10-08T15:40:50.841 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1096 container root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.841 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1096 container root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.842 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1096 container root txt REG 8,1 60313584 17486 /usr/bin/containerd 2023-10-08T15:40:50.842 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1096 container root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.842 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1096 container root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.842 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1096 container root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.842 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1096 container root mem-W REG 8,1 32768 5431 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-10-08T15:40:50.842 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1096 container root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.842 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1096 container root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.842 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1096 container root 1u unix 0xffff8f39165cd0c0 0t0 24087 type=STREAM 2023-10-08T15:40:50.842 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1096 container root 2u unix 0xffff8f39165cd0c0 0t0 24087 type=STREAM 2023-10-08T15:40:50.843 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1096 container root 3uW REG 8,1 32768 5431 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-10-08T15:40:50.843 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1096 container root 4u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.843 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1096 container root 5u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.843 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1096 container root 6r a_inode 0,14 0 13377 inotify 2023-10-08T15:40:50.843 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1096 container root 7u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.843 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1096 container root 8r FIFO 0,13 0t0 22287 pipe 2023-10-08T15:40:50.843 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1096 container root 9w FIFO 0,13 0t0 22287 pipe 2023-10-08T15:40:50.843 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1096 container root 10u unix 0xffff8f39133c6e80 0t0 27744 /run/containerd/containerd.sock.ttrpc type=STREAM 2023-10-08T15:40:50.843 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1096 container root 11u unix 0xffff8f39169c4400 0t0 26147 /run/containerd/containerd.sock type=STREAM 2023-10-08T15:40:50.844 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1096 container root 12u IPv4 27745 0t0 TCP localhost:34273 (LISTEN) 2023-10-08T15:40:50.844 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1096 container root 13u unix 0xffff8f38c5533fc0 0t0 151777 /run/containerd/containerd.sock type=STREAM 2023-10-08T15:40:50.844 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1096 container root 14u unix 0xffff8f38df8ce1c0 0t0 151779 /run/containerd/containerd.sock type=STREAM 2023-10-08T15:40:50.844 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1097 container root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.844 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1097 container root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.844 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1097 container root txt REG 8,1 60313584 17486 /usr/bin/containerd 2023-10-08T15:40:50.844 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1097 container root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.844 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1097 container root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.844 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1097 container root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.844 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1097 container root mem-W REG 8,1 32768 5431 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-10-08T15:40:50.845 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1097 container root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.845 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1097 container root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.845 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1097 container root 1u unix 0xffff8f39165cd0c0 0t0 24087 type=STREAM 2023-10-08T15:40:50.845 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1097 container root 2u unix 0xffff8f39165cd0c0 0t0 24087 type=STREAM 2023-10-08T15:40:50.845 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1097 container root 3uW REG 8,1 32768 5431 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-10-08T15:40:50.845 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1097 container root 4u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.845 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1097 container root 5u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.845 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1097 container root 6r a_inode 0,14 0 13377 inotify 2023-10-08T15:40:50.846 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1097 container root 7u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.846 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1097 container root 8r FIFO 0,13 0t0 22287 pipe 2023-10-08T15:40:50.846 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1097 container root 9w FIFO 0,13 0t0 22287 pipe 2023-10-08T15:40:50.846 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1097 container root 10u unix 0xffff8f39133c6e80 0t0 27744 /run/containerd/containerd.sock.ttrpc type=STREAM 2023-10-08T15:40:50.846 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1097 container root 11u unix 0xffff8f39169c4400 0t0 26147 /run/containerd/containerd.sock type=STREAM 2023-10-08T15:40:50.846 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1097 container root 12u IPv4 27745 0t0 TCP localhost:34273 (LISTEN) 2023-10-08T15:40:50.846 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1097 container root 13u unix 0xffff8f38c5533fc0 0t0 151777 /run/containerd/containerd.sock type=STREAM 2023-10-08T15:40:50.846 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1097 container root 14u unix 0xffff8f38df8ce1c0 0t0 151779 /run/containerd/containerd.sock type=STREAM 2023-10-08T15:40:50.846 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1098 container root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.847 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1098 container root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.847 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1098 container root txt REG 8,1 60313584 17486 /usr/bin/containerd 2023-10-08T15:40:50.847 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1098 container root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.847 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1098 container root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.847 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1098 container root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.847 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1098 container root mem-W REG 8,1 32768 5431 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-10-08T15:40:50.847 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1098 container root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.847 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1098 container root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.847 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1098 container root 1u unix 0xffff8f39165cd0c0 0t0 24087 type=STREAM 2023-10-08T15:40:50.848 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1098 container root 2u unix 0xffff8f39165cd0c0 0t0 24087 type=STREAM 2023-10-08T15:40:50.848 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1098 container root 3uW REG 8,1 32768 5431 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-10-08T15:40:50.848 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1098 container root 4u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.848 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1098 container root 5u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.848 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1098 container root 6r a_inode 0,14 0 13377 inotify 2023-10-08T15:40:50.848 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1098 container root 7u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.848 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1098 container root 8r FIFO 0,13 0t0 22287 pipe 2023-10-08T15:40:50.848 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1098 container root 9w FIFO 0,13 0t0 22287 pipe 2023-10-08T15:40:50.848 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1098 container root 10u unix 0xffff8f39133c6e80 0t0 27744 /run/containerd/containerd.sock.ttrpc type=STREAM 2023-10-08T15:40:50.848 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1098 container root 11u unix 0xffff8f39169c4400 0t0 26147 /run/containerd/containerd.sock type=STREAM 2023-10-08T15:40:50.849 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1098 container root 12u IPv4 27745 0t0 TCP localhost:34273 (LISTEN) 2023-10-08T15:40:50.849 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1098 container root 13u unix 0xffff8f38c5533fc0 0t0 151777 /run/containerd/containerd.sock type=STREAM 2023-10-08T15:40:50.849 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1098 container root 14u unix 0xffff8f38df8ce1c0 0t0 151779 /run/containerd/containerd.sock type=STREAM 2023-10-08T15:40:50.849 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1099 container root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.849 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1099 container root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.849 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1099 container root txt REG 8,1 60313584 17486 /usr/bin/containerd 2023-10-08T15:40:50.849 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1099 container root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.849 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1099 container root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.849 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1099 container root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.849 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1099 container root mem-W REG 8,1 32768 5431 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-10-08T15:40:50.850 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1099 container root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.850 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1099 container root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.850 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1099 container root 1u unix 0xffff8f39165cd0c0 0t0 24087 type=STREAM 2023-10-08T15:40:50.850 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1099 container root 2u unix 0xffff8f39165cd0c0 0t0 24087 type=STREAM 2023-10-08T15:40:50.850 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1099 container root 3uW REG 8,1 32768 5431 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-10-08T15:40:50.850 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1099 container root 4u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.850 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1099 container root 5u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.850 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1099 container root 6r a_inode 0,14 0 13377 inotify 2023-10-08T15:40:50.850 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1099 container root 7u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.851 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1099 container root 8r FIFO 0,13 0t0 22287 pipe 2023-10-08T15:40:50.851 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1099 container root 9w FIFO 0,13 0t0 22287 pipe 2023-10-08T15:40:50.851 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1099 container root 10u unix 0xffff8f39133c6e80 0t0 27744 /run/containerd/containerd.sock.ttrpc type=STREAM 2023-10-08T15:40:50.851 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1099 container root 11u unix 0xffff8f39169c4400 0t0 26147 /run/containerd/containerd.sock type=STREAM 2023-10-08T15:40:50.851 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1099 container root 12u IPv4 27745 0t0 TCP localhost:34273 (LISTEN) 2023-10-08T15:40:50.851 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1099 container root 13u unix 0xffff8f38c5533fc0 0t0 151777 /run/containerd/containerd.sock type=STREAM 2023-10-08T15:40:50.851 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1099 container root 14u unix 0xffff8f38df8ce1c0 0t0 151779 /run/containerd/containerd.sock type=STREAM 2023-10-08T15:40:50.851 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1100 container root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.851 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1100 container root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.852 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1100 container root txt REG 8,1 60313584 17486 /usr/bin/containerd 2023-10-08T15:40:50.852 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1100 container root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.852 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1100 container root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.852 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1100 container root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.852 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1100 container root mem-W REG 8,1 32768 5431 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-10-08T15:40:50.852 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1100 container root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.852 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1100 container root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.852 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1100 container root 1u unix 0xffff8f39165cd0c0 0t0 24087 type=STREAM 2023-10-08T15:40:50.852 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1100 container root 2u unix 0xffff8f39165cd0c0 0t0 24087 type=STREAM 2023-10-08T15:40:50.853 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1100 container root 3uW REG 8,1 32768 5431 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-10-08T15:40:50.853 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1100 container root 4u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.853 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1100 container root 5u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.853 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1100 container root 6r a_inode 0,14 0 13377 inotify 2023-10-08T15:40:50.853 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1100 container root 7u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.853 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1100 container root 8r FIFO 0,13 0t0 22287 pipe 2023-10-08T15:40:50.853 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1100 container root 9w FIFO 0,13 0t0 22287 pipe 2023-10-08T15:40:50.853 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1100 container root 10u unix 0xffff8f39133c6e80 0t0 27744 /run/containerd/containerd.sock.ttrpc type=STREAM 2023-10-08T15:40:50.853 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1100 container root 11u unix 0xffff8f39169c4400 0t0 26147 /run/containerd/containerd.sock type=STREAM 2023-10-08T15:40:50.853 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1100 container root 12u IPv4 27745 0t0 TCP localhost:34273 (LISTEN) 2023-10-08T15:40:50.854 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1100 container root 13u unix 0xffff8f38c5533fc0 0t0 151777 /run/containerd/containerd.sock type=STREAM 2023-10-08T15:40:50.854 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1100 container root 14u unix 0xffff8f38df8ce1c0 0t0 151779 /run/containerd/containerd.sock type=STREAM 2023-10-08T15:40:50.854 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1115 container root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.854 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1115 container root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.854 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1115 container root txt REG 8,1 60313584 17486 /usr/bin/containerd 2023-10-08T15:40:50.854 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1115 container root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.854 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1115 container root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.854 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1115 container root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.854 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1115 container root mem-W REG 8,1 32768 5431 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-10-08T15:40:50.854 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1115 container root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.854 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1115 container root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.855 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1115 container root 1u unix 0xffff8f39165cd0c0 0t0 24087 type=STREAM 2023-10-08T15:40:50.855 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1115 container root 2u unix 0xffff8f39165cd0c0 0t0 24087 type=STREAM 2023-10-08T15:40:50.855 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1115 container root 3uW REG 8,1 32768 5431 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-10-08T15:40:50.855 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1115 container root 4u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.855 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1115 container root 5u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.855 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1115 container root 6r a_inode 0,14 0 13377 inotify 2023-10-08T15:40:50.855 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1115 container root 7u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.855 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1115 container root 8r FIFO 0,13 0t0 22287 pipe 2023-10-08T15:40:50.855 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1115 container root 9w FIFO 0,13 0t0 22287 pipe 2023-10-08T15:40:50.855 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1115 container root 10u unix 0xffff8f39133c6e80 0t0 27744 /run/containerd/containerd.sock.ttrpc type=STREAM 2023-10-08T15:40:50.855 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1115 container root 11u unix 0xffff8f39169c4400 0t0 26147 /run/containerd/containerd.sock type=STREAM 2023-10-08T15:40:50.856 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1115 container root 12u IPv4 27745 0t0 TCP localhost:34273 (LISTEN) 2023-10-08T15:40:50.856 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1115 container root 13u unix 0xffff8f38c5533fc0 0t0 151777 /run/containerd/containerd.sock type=STREAM 2023-10-08T15:40:50.856 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1115 container root 14u unix 0xffff8f38df8ce1c0 0t0 151779 /run/containerd/containerd.sock type=STREAM 2023-10-08T15:40:50.856 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1116 container root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.856 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1116 container root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.856 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1116 container root txt REG 8,1 60313584 17486 /usr/bin/containerd 2023-10-08T15:40:50.856 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1116 container root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.856 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1116 container root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.856 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1116 container root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.856 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1116 container root mem-W REG 8,1 32768 5431 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-10-08T15:40:50.856 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1116 container root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.856 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1116 container root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.857 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1116 container root 1u unix 0xffff8f39165cd0c0 0t0 24087 type=STREAM 2023-10-08T15:40:50.857 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1116 container root 2u unix 0xffff8f39165cd0c0 0t0 24087 type=STREAM 2023-10-08T15:40:50.857 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1116 container root 3uW REG 8,1 32768 5431 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-10-08T15:40:50.857 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1116 container root 4u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.857 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1116 container root 5u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.857 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1116 container root 6r a_inode 0,14 0 13377 inotify 2023-10-08T15:40:50.857 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1116 container root 7u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.857 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1116 container root 8r FIFO 0,13 0t0 22287 pipe 2023-10-08T15:40:50.857 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1116 container root 9w FIFO 0,13 0t0 22287 pipe 2023-10-08T15:40:50.857 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1116 container root 10u unix 0xffff8f39133c6e80 0t0 27744 /run/containerd/containerd.sock.ttrpc type=STREAM 2023-10-08T15:40:50.857 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1116 container root 11u unix 0xffff8f39169c4400 0t0 26147 /run/containerd/containerd.sock type=STREAM 2023-10-08T15:40:50.858 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1116 container root 12u IPv4 27745 0t0 TCP localhost:34273 (LISTEN) 2023-10-08T15:40:50.858 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1116 container root 13u unix 0xffff8f38c5533fc0 0t0 151777 /run/containerd/containerd.sock type=STREAM 2023-10-08T15:40:50.858 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1116 container root 14u unix 0xffff8f38df8ce1c0 0t0 151779 /run/containerd/containerd.sock type=STREAM 2023-10-08T15:40:50.858 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1122 container root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.858 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1122 container root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.858 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1122 container root txt REG 8,1 60313584 17486 /usr/bin/containerd 2023-10-08T15:40:50.858 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1122 container root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.858 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1122 container root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.858 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1122 container root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.858 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1122 container root mem-W REG 8,1 32768 5431 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-10-08T15:40:50.859 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1122 container root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.859 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1122 container root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.859 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1122 container root 1u unix 0xffff8f39165cd0c0 0t0 24087 type=STREAM 2023-10-08T15:40:50.859 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1122 container root 2u unix 0xffff8f39165cd0c0 0t0 24087 type=STREAM 2023-10-08T15:40:50.859 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1122 container root 3uW REG 8,1 32768 5431 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-10-08T15:40:50.859 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1122 container root 4u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.859 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1122 container root 5u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.859 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1122 container root 6r a_inode 0,14 0 13377 inotify 2023-10-08T15:40:50.859 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1122 container root 7u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.859 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1122 container root 8r FIFO 0,13 0t0 22287 pipe 2023-10-08T15:40:50.859 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1122 container root 9w FIFO 0,13 0t0 22287 pipe 2023-10-08T15:40:50.859 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1122 container root 10u unix 0xffff8f39133c6e80 0t0 27744 /run/containerd/containerd.sock.ttrpc type=STREAM 2023-10-08T15:40:50.860 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1122 container root 11u unix 0xffff8f39169c4400 0t0 26147 /run/containerd/containerd.sock type=STREAM 2023-10-08T15:40:50.860 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1122 container root 12u IPv4 27745 0t0 TCP localhost:34273 (LISTEN) 2023-10-08T15:40:50.860 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1122 container root 13u unix 0xffff8f38c5533fc0 0t0 151777 /run/containerd/containerd.sock type=STREAM 2023-10-08T15:40:50.860 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1122 container root 14u unix 0xffff8f38df8ce1c0 0t0 151779 /run/containerd/containerd.sock type=STREAM 2023-10-08T15:40:50.860 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1123 container root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.860 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1123 container root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.860 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1123 container root txt REG 8,1 60313584 17486 /usr/bin/containerd 2023-10-08T15:40:50.860 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1123 container root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.860 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1123 container root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.860 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1123 container root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.860 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1123 container root mem-W REG 8,1 32768 5431 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-10-08T15:40:50.860 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1123 container root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.861 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1123 container root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.861 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1123 container root 1u unix 0xffff8f39165cd0c0 0t0 24087 type=STREAM 2023-10-08T15:40:50.861 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1123 container root 2u unix 0xffff8f39165cd0c0 0t0 24087 type=STREAM 2023-10-08T15:40:50.861 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1123 container root 3uW REG 8,1 32768 5431 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-10-08T15:40:50.861 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1123 container root 4u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.861 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1123 container root 5u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.861 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1123 container root 6r a_inode 0,14 0 13377 inotify 2023-10-08T15:40:50.861 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1123 container root 7u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.861 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1123 container root 8r FIFO 0,13 0t0 22287 pipe 2023-10-08T15:40:50.861 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1123 container root 9w FIFO 0,13 0t0 22287 pipe 2023-10-08T15:40:50.861 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1123 container root 10u unix 0xffff8f39133c6e80 0t0 27744 /run/containerd/containerd.sock.ttrpc type=STREAM 2023-10-08T15:40:50.862 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1123 container root 11u unix 0xffff8f39169c4400 0t0 26147 /run/containerd/containerd.sock type=STREAM 2023-10-08T15:40:50.862 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1123 container root 12u IPv4 27745 0t0 TCP localhost:34273 (LISTEN) 2023-10-08T15:40:50.862 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1123 container root 13u unix 0xffff8f38c5533fc0 0t0 151777 /run/containerd/containerd.sock type=STREAM 2023-10-08T15:40:50.862 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1123 container root 14u unix 0xffff8f38df8ce1c0 0t0 151779 /run/containerd/containerd.sock type=STREAM 2023-10-08T15:40:50.862 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1124 container root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.862 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1124 container root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.862 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1124 container root txt REG 8,1 60313584 17486 /usr/bin/containerd 2023-10-08T15:40:50.862 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1124 container root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.862 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1124 container root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.862 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1124 container root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.862 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1124 container root mem-W REG 8,1 32768 5431 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-10-08T15:40:50.862 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1124 container root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.863 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1124 container root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.863 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1124 container root 1u unix 0xffff8f39165cd0c0 0t0 24087 type=STREAM 2023-10-08T15:40:50.863 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1124 container root 2u unix 0xffff8f39165cd0c0 0t0 24087 type=STREAM 2023-10-08T15:40:50.863 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1124 container root 3uW REG 8,1 32768 5431 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-10-08T15:40:50.863 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1124 container root 4u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.863 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1124 container root 5u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.863 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1124 container root 6r a_inode 0,14 0 13377 inotify 2023-10-08T15:40:50.863 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1124 container root 7u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.863 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1124 container root 8r FIFO 0,13 0t0 22287 pipe 2023-10-08T15:40:50.863 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1124 container root 9w FIFO 0,13 0t0 22287 pipe 2023-10-08T15:40:50.864 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1124 container root 10u unix 0xffff8f39133c6e80 0t0 27744 /run/containerd/containerd.sock.ttrpc type=STREAM 2023-10-08T15:40:50.864 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1124 container root 11u unix 0xffff8f39169c4400 0t0 26147 /run/containerd/containerd.sock type=STREAM 2023-10-08T15:40:50.864 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1124 container root 12u IPv4 27745 0t0 TCP localhost:34273 (LISTEN) 2023-10-08T15:40:50.864 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1124 container root 13u unix 0xffff8f38c5533fc0 0t0 151777 /run/containerd/containerd.sock type=STREAM 2023-10-08T15:40:50.864 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1124 container root 14u unix 0xffff8f38df8ce1c0 0t0 151779 /run/containerd/containerd.sock type=STREAM 2023-10-08T15:40:50.864 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1125 container root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.864 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1125 container root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.864 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1125 container root txt REG 8,1 60313584 17486 /usr/bin/containerd 2023-10-08T15:40:50.865 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1125 container root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.865 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1125 container root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.865 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1125 container root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.865 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1125 container root mem-W REG 8,1 32768 5431 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-10-08T15:40:50.865 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1125 container root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.865 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1125 container root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.865 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1125 container root 1u unix 0xffff8f39165cd0c0 0t0 24087 type=STREAM 2023-10-08T15:40:50.865 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1125 container root 2u unix 0xffff8f39165cd0c0 0t0 24087 type=STREAM 2023-10-08T15:40:50.865 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1125 container root 3uW REG 8,1 32768 5431 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-10-08T15:40:50.865 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1125 container root 4u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.865 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1125 container root 5u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.866 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1125 container root 6r a_inode 0,14 0 13377 inotify 2023-10-08T15:40:50.866 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1125 container root 7u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.866 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1125 container root 8r FIFO 0,13 0t0 22287 pipe 2023-10-08T15:40:50.866 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1125 container root 9w FIFO 0,13 0t0 22287 pipe 2023-10-08T15:40:50.866 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1125 container root 10u unix 0xffff8f39133c6e80 0t0 27744 /run/containerd/containerd.sock.ttrpc type=STREAM 2023-10-08T15:40:50.866 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1125 container root 11u unix 0xffff8f39169c4400 0t0 26147 /run/containerd/containerd.sock type=STREAM 2023-10-08T15:40:50.866 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1125 container root 12u IPv4 27745 0t0 TCP localhost:34273 (LISTEN) 2023-10-08T15:40:50.866 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1125 container root 13u unix 0xffff8f38c5533fc0 0t0 151777 /run/containerd/containerd.sock type=STREAM 2023-10-08T15:40:50.866 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1125 container root 14u unix 0xffff8f38df8ce1c0 0t0 151779 /run/containerd/containerd.sock type=STREAM 2023-10-08T15:40:50.866 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1130 container root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.866 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1130 container root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.867 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1130 container root txt REG 8,1 60313584 17486 /usr/bin/containerd 2023-10-08T15:40:50.867 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1130 container root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.867 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1130 container root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.867 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1130 container root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.867 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1130 container root mem-W REG 8,1 32768 5431 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-10-08T15:40:50.867 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1130 container root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.867 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1130 container root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.867 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1130 container root 1u unix 0xffff8f39165cd0c0 0t0 24087 type=STREAM 2023-10-08T15:40:50.867 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1130 container root 2u unix 0xffff8f39165cd0c0 0t0 24087 type=STREAM 2023-10-08T15:40:50.867 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1130 container root 3uW REG 8,1 32768 5431 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-10-08T15:40:50.867 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1130 container root 4u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.867 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1130 container root 5u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.868 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1130 container root 6r a_inode 0,14 0 13377 inotify 2023-10-08T15:40:50.868 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1130 container root 7u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.868 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1130 container root 8r FIFO 0,13 0t0 22287 pipe 2023-10-08T15:40:50.868 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1130 container root 9w FIFO 0,13 0t0 22287 pipe 2023-10-08T15:40:50.868 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1130 container root 10u unix 0xffff8f39133c6e80 0t0 27744 /run/containerd/containerd.sock.ttrpc type=STREAM 2023-10-08T15:40:50.868 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1130 container root 11u unix 0xffff8f39169c4400 0t0 26147 /run/containerd/containerd.sock type=STREAM 2023-10-08T15:40:50.868 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1130 container root 12u IPv4 27745 0t0 TCP localhost:34273 (LISTEN) 2023-10-08T15:40:50.868 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1130 container root 13u unix 0xffff8f38c5533fc0 0t0 151777 /run/containerd/containerd.sock type=STREAM 2023-10-08T15:40:50.868 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1130 container root 14u unix 0xffff8f38df8ce1c0 0t0 151779 /run/containerd/containerd.sock type=STREAM 2023-10-08T15:40:50.868 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1153 container root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.868 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1153 container root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.868 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1153 container root txt REG 8,1 60313584 17486 /usr/bin/containerd 2023-10-08T15:40:50.869 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1153 container root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.869 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1153 container root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.869 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1153 container root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.869 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1153 container root mem-W REG 8,1 32768 5431 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-10-08T15:40:50.869 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1153 container root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.869 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1153 container root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.869 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1153 container root 1u unix 0xffff8f39165cd0c0 0t0 24087 type=STREAM 2023-10-08T15:40:50.869 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1153 container root 2u unix 0xffff8f39165cd0c0 0t0 24087 type=STREAM 2023-10-08T15:40:50.869 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1153 container root 3uW REG 8,1 32768 5431 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-10-08T15:40:50.869 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1153 container root 4u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.870 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1153 container root 5u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.870 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1153 container root 6r a_inode 0,14 0 13377 inotify 2023-10-08T15:40:50.870 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1153 container root 7u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.870 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1153 container root 8r FIFO 0,13 0t0 22287 pipe 2023-10-08T15:40:50.870 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1153 container root 9w FIFO 0,13 0t0 22287 pipe 2023-10-08T15:40:50.871 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1153 container root 10u unix 0xffff8f39133c6e80 0t0 27744 /run/containerd/containerd.sock.ttrpc type=STREAM 2023-10-08T15:40:50.871 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1153 container root 11u unix 0xffff8f39169c4400 0t0 26147 /run/containerd/containerd.sock type=STREAM 2023-10-08T15:40:50.871 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1153 container root 12u IPv4 27745 0t0 TCP localhost:34273 (LISTEN) 2023-10-08T15:40:50.871 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1153 container root 13u unix 0xffff8f38c5533fc0 0t0 151777 /run/containerd/containerd.sock type=STREAM 2023-10-08T15:40:50.871 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1153 container root 14u unix 0xffff8f38df8ce1c0 0t0 151779 /run/containerd/containerd.sock type=STREAM 2023-10-08T15:40:50.871 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1154 container root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.871 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1154 container root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.871 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1154 container root txt REG 8,1 60313584 17486 /usr/bin/containerd 2023-10-08T15:40:50.871 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1154 container root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.871 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1154 container root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.872 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1154 container root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.872 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1154 container root mem-W REG 8,1 32768 5431 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-10-08T15:40:50.872 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1154 container root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.872 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1154 container root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.872 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1154 container root 1u unix 0xffff8f39165cd0c0 0t0 24087 type=STREAM 2023-10-08T15:40:50.872 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1154 container root 2u unix 0xffff8f39165cd0c0 0t0 24087 type=STREAM 2023-10-08T15:40:50.872 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1154 container root 3uW REG 8,1 32768 5431 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-10-08T15:40:50.872 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1154 container root 4u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.872 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1154 container root 5u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.872 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1154 container root 6r a_inode 0,14 0 13377 inotify 2023-10-08T15:40:50.873 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1154 container root 7u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.873 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1154 container root 8r FIFO 0,13 0t0 22287 pipe 2023-10-08T15:40:50.873 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1154 container root 9w FIFO 0,13 0t0 22287 pipe 2023-10-08T15:40:50.873 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1154 container root 10u unix 0xffff8f39133c6e80 0t0 27744 /run/containerd/containerd.sock.ttrpc type=STREAM 2023-10-08T15:40:50.873 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1154 container root 11u unix 0xffff8f39169c4400 0t0 26147 /run/containerd/containerd.sock type=STREAM 2023-10-08T15:40:50.873 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1154 container root 12u IPv4 27745 0t0 TCP localhost:34273 (LISTEN) 2023-10-08T15:40:50.873 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1154 container root 13u unix 0xffff8f38c5533fc0 0t0 151777 /run/containerd/containerd.sock type=STREAM 2023-10-08T15:40:50.873 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1154 container root 14u unix 0xffff8f38df8ce1c0 0t0 151779 /run/containerd/containerd.sock type=STREAM 2023-10-08T15:40:50.873 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1155 container root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.874 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1155 container root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.874 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1155 container root txt REG 8,1 60313584 17486 /usr/bin/containerd 2023-10-08T15:40:50.874 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1155 container root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.874 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1155 container root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.874 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1155 container root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.874 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1155 container root mem-W REG 8,1 32768 5431 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-10-08T15:40:50.874 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1155 container root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.874 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1155 container root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.875 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1155 container root 1u unix 0xffff8f39165cd0c0 0t0 24087 type=STREAM 2023-10-08T15:40:50.875 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1155 container root 2u unix 0xffff8f39165cd0c0 0t0 24087 type=STREAM 2023-10-08T15:40:50.875 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1155 container root 3uW REG 8,1 32768 5431 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-10-08T15:40:50.875 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1155 container root 4u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.875 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1155 container root 5u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.875 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1155 container root 6r a_inode 0,14 0 13377 inotify 2023-10-08T15:40:50.875 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1155 container root 7u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.875 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1155 container root 8r FIFO 0,13 0t0 22287 pipe 2023-10-08T15:40:50.875 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1155 container root 9w FIFO 0,13 0t0 22287 pipe 2023-10-08T15:40:50.875 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1155 container root 10u unix 0xffff8f39133c6e80 0t0 27744 /run/containerd/containerd.sock.ttrpc type=STREAM 2023-10-08T15:40:50.876 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1155 container root 11u unix 0xffff8f39169c4400 0t0 26147 /run/containerd/containerd.sock type=STREAM 2023-10-08T15:40:50.876 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1155 container root 12u IPv4 27745 0t0 TCP localhost:34273 (LISTEN) 2023-10-08T15:40:50.876 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1155 container root 13u unix 0xffff8f38c5533fc0 0t0 151777 /run/containerd/containerd.sock type=STREAM 2023-10-08T15:40:50.876 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1155 container root 14u unix 0xffff8f38df8ce1c0 0t0 151779 /run/containerd/containerd.sock type=STREAM 2023-10-08T15:40:50.876 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1156 container root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.876 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1156 container root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.876 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1156 container root txt REG 8,1 60313584 17486 /usr/bin/containerd 2023-10-08T15:40:50.876 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1156 container root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.876 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1156 container root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.877 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1156 container root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.877 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1156 container root mem-W REG 8,1 32768 5431 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-10-08T15:40:50.877 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1156 container root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.877 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1156 container root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.877 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1156 container root 1u unix 0xffff8f39165cd0c0 0t0 24087 type=STREAM 2023-10-08T15:40:50.877 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1156 container root 2u unix 0xffff8f39165cd0c0 0t0 24087 type=STREAM 2023-10-08T15:40:50.877 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1156 container root 3uW REG 8,1 32768 5431 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-10-08T15:40:50.877 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1156 container root 4u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.877 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1156 container root 5u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.878 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1156 container root 6r a_inode 0,14 0 13377 inotify 2023-10-08T15:40:50.878 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1156 container root 7u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.878 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1156 container root 8r FIFO 0,13 0t0 22287 pipe 2023-10-08T15:40:50.878 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1156 container root 9w FIFO 0,13 0t0 22287 pipe 2023-10-08T15:40:50.878 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1156 container root 10u unix 0xffff8f39133c6e80 0t0 27744 /run/containerd/containerd.sock.ttrpc type=STREAM 2023-10-08T15:40:50.878 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1156 container root 11u unix 0xffff8f39169c4400 0t0 26147 /run/containerd/containerd.sock type=STREAM 2023-10-08T15:40:50.878 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1156 container root 12u IPv4 27745 0t0 TCP localhost:34273 (LISTEN) 2023-10-08T15:40:50.878 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1156 container root 13u unix 0xffff8f38c5533fc0 0t0 151777 /run/containerd/containerd.sock type=STREAM 2023-10-08T15:40:50.879 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 1156 container root 14u unix 0xffff8f38df8ce1c0 0t0 151779 /run/containerd/containerd.sock type=STREAM 2023-10-08T15:40:50.879 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 6406 container root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.879 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 6406 container root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.879 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 6406 container root txt REG 8,1 60313584 17486 /usr/bin/containerd 2023-10-08T15:40:50.879 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 6406 container root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.879 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 6406 container root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.879 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 6406 container root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.879 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 6406 container root mem-W REG 8,1 32768 5431 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-10-08T15:40:50.879 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 6406 container root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.880 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 6406 container root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.880 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 6406 container root 1u unix 0xffff8f39165cd0c0 0t0 24087 type=STREAM 2023-10-08T15:40:50.880 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 6406 container root 2u unix 0xffff8f39165cd0c0 0t0 24087 type=STREAM 2023-10-08T15:40:50.880 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 6406 container root 3uW REG 8,1 32768 5431 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-10-08T15:40:50.880 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 6406 container root 4u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.880 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 6406 container root 5u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.880 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 6406 container root 6r a_inode 0,14 0 13377 inotify 2023-10-08T15:40:50.880 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 6406 container root 7u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.880 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 6406 container root 8r FIFO 0,13 0t0 22287 pipe 2023-10-08T15:40:50.880 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 6406 container root 9w FIFO 0,13 0t0 22287 pipe 2023-10-08T15:40:50.881 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 6406 container root 10u unix 0xffff8f39133c6e80 0t0 27744 /run/containerd/containerd.sock.ttrpc type=STREAM 2023-10-08T15:40:50.881 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 6406 container root 11u unix 0xffff8f39169c4400 0t0 26147 /run/containerd/containerd.sock type=STREAM 2023-10-08T15:40:50.881 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 6406 container root 12u IPv4 27745 0t0 TCP localhost:34273 (LISTEN) 2023-10-08T15:40:50.881 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 6406 container root 13u unix 0xffff8f38c5533fc0 0t0 151777 /run/containerd/containerd.sock type=STREAM 2023-10-08T15:40:50.881 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 6406 container root 14u unix 0xffff8f38df8ce1c0 0t0 151779 /run/containerd/containerd.sock type=STREAM 2023-10-08T15:40:50.881 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 23925 container root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.881 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 23925 container root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.881 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 23925 container root txt REG 8,1 60313584 17486 /usr/bin/containerd 2023-10-08T15:40:50.881 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 23925 container root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.881 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 23925 container root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.882 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 23925 container root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.882 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 23925 container root mem-W REG 8,1 32768 5431 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-10-08T15:40:50.882 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 23925 container root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.882 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 23925 container root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.882 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 23925 container root 1u unix 0xffff8f39165cd0c0 0t0 24087 type=STREAM 2023-10-08T15:40:50.882 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 23925 container root 2u unix 0xffff8f39165cd0c0 0t0 24087 type=STREAM 2023-10-08T15:40:50.882 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 23925 container root 3uW REG 8,1 32768 5431 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-10-08T15:40:50.882 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 23925 container root 4u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.882 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 23925 container root 5u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.883 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 23925 container root 6r a_inode 0,14 0 13377 inotify 2023-10-08T15:40:50.883 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 23925 container root 7u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.883 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 23925 container root 8r FIFO 0,13 0t0 22287 pipe 2023-10-08T15:40:50.883 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 23925 container root 9w FIFO 0,13 0t0 22287 pipe 2023-10-08T15:40:50.883 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 23925 container root 10u unix 0xffff8f39133c6e80 0t0 27744 /run/containerd/containerd.sock.ttrpc type=STREAM 2023-10-08T15:40:50.883 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 23925 container root 11u unix 0xffff8f39169c4400 0t0 26147 /run/containerd/containerd.sock type=STREAM 2023-10-08T15:40:50.884 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 23925 container root 12u IPv4 27745 0t0 TCP localhost:34273 (LISTEN) 2023-10-08T15:40:50.884 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 23925 container root 13u unix 0xffff8f38c5533fc0 0t0 151777 /run/containerd/containerd.sock type=STREAM 2023-10-08T15:40:50.884 INFO:teuthology.orchestra.run.smithi089.stdout:container 862 23925 container root 14u unix 0xffff8f38df8ce1c0 0t0 151779 /run/containerd/containerd.sock type=STREAM 2023-10-08T15:40:50.884 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 978 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.884 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 978 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.884 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 978 root txt REG 8,1 876328 15978 /usr/sbin/sshd 2023-10-08T15:40:50.884 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 978 root mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:50.885 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 978 root mem REG 8,1 137584 8109 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.28.0 2023-10-08T15:40:50.885 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 978 root mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:50.885 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 978 root mem REG 8,1 22600 15019 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.8 2023-10-08T15:40:50.885 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 978 root mem REG 8,1 56096 15015 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-10-08T15:40:50.885 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 978 root mem REG 8,1 191040 15017 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-10-08T15:40:50.885 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 978 root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.885 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 978 root mem REG 8,1 1168056 8360 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.2.5 2023-10-08T15:40:50.885 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 978 root mem REG 8,1 129248 13039 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.2 2023-10-08T15:40:50.885 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 978 root mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:50.886 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 978 root mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:50.886 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 978 root mem REG 8,1 584392 8917 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.9.0 2023-10-08T15:40:50.886 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 978 root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.886 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 978 root mem REG 8,1 27064 8001 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-10-08T15:40:50.886 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 978 root mem REG 8,1 105560 13403 /usr/lib/x86_64-linux-gnu/libnsl-2.31.so 2023-10-08T15:40:50.886 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 978 root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.886 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 978 root mem REG 8,1 22600 9279 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-10-08T15:40:50.886 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 978 root mem REG 8,1 902016 15021 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-10-08T15:40:50.886 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 978 root mem REG 8,1 309712 15024 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-10-08T15:40:50.886 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 978 root mem REG 8,1 202760 8017 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-10-08T15:40:50.887 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 978 root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:50.887 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 978 root mem REG 8,1 14880 13415 /usr/lib/x86_64-linux-gnu/libutil-2.31.so 2023-10-08T15:40:50.887 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 978 root DEL REG 8,1 8794 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:50.887 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 978 root mem REG 8,1 709496 10741 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.28.0 2023-10-08T15:40:50.887 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 978 root mem REG 8,1 163200 8942 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-10-08T15:40:50.887 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 978 root mem REG 8,1 68320 8384 /usr/lib/x86_64-linux-gnu/libpam.so.0.84.2 2023-10-08T15:40:50.887 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 978 root mem REG 8,1 133200 8347 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-10-08T15:40:50.889 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 978 root mem REG 8,1 44848 15918 /usr/lib/x86_64-linux-gnu/libwrap.so.0.7.6 2023-10-08T15:40:50.889 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 978 root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.889 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 978 root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.889 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 978 root 1u unix 0xffff8f391650d0c0 0t0 20477 type=STREAM 2023-10-08T15:40:50.889 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 978 root 2u unix 0xffff8f391650d0c0 0t0 20477 type=STREAM 2023-10-08T15:40:50.889 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 978 root 3u IPv4 28676 0t0 TCP *:ssh (LISTEN) 2023-10-08T15:40:50.889 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 978 root 4u IPv6 28678 0t0 TCP *:ssh (LISTEN) 2023-10-08T15:40:50.889 INFO:teuthology.orchestra.run.smithi089.stdout:ib-comp-w 979 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.889 INFO:teuthology.orchestra.run.smithi089.stdout:ib-comp-w 979 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.890 INFO:teuthology.orchestra.run.smithi089.stdout:ib-comp-w 979 root txt unknown /proc/979/exe 2023-10-08T15:40:50.890 INFO:teuthology.orchestra.run.smithi089.stdout:ib-comp-u 980 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.890 INFO:teuthology.orchestra.run.smithi089.stdout:ib-comp-u 980 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.890 INFO:teuthology.orchestra.run.smithi089.stdout:ib-comp-u 980 root txt unknown /proc/980/exe 2023-10-08T15:40:50.890 INFO:teuthology.orchestra.run.smithi089.stdout:ib_mcast 981 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.890 INFO:teuthology.orchestra.run.smithi089.stdout:ib_mcast 981 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.890 INFO:teuthology.orchestra.run.smithi089.stdout:ib_mcast 981 root txt unknown /proc/981/exe 2023-10-08T15:40:50.890 INFO:teuthology.orchestra.run.smithi089.stdout:ib_nl_sa_ 982 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.890 INFO:teuthology.orchestra.run.smithi089.stdout:ib_nl_sa_ 982 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.890 INFO:teuthology.orchestra.run.smithi089.stdout:ib_nl_sa_ 982 root txt unknown /proc/982/exe 2023-10-08T15:40:50.890 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/u 984 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.891 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/u 984 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.891 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/u 984 root txt unknown /proc/984/exe 2023-10-08T15:40:50.891 INFO:teuthology.orchestra.run.smithi089.stdout:lockd 985 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.891 INFO:teuthology.orchestra.run.smithi089.stdout:lockd 985 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.891 INFO:teuthology.orchestra.run.smithi089.stdout:lockd 985 root txt unknown /proc/985/exe 2023-10-08T15:40:50.891 INFO:teuthology.orchestra.run.smithi089.stdout:rdma_cm 999 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.891 INFO:teuthology.orchestra.run.smithi089.stdout:rdma_cm 999 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.891 INFO:teuthology.orchestra.run.smithi089.stdout:rdma_cm 999 root txt unknown /proc/999/exe 2023-10-08T15:40:50.891 INFO:teuthology.orchestra.run.smithi089.stdout:agetty 1083 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.891 INFO:teuthology.orchestra.run.smithi089.stdout:agetty 1083 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.891 INFO:teuthology.orchestra.run.smithi089.stdout:agetty 1083 root txt REG 8,1 69000 8233 /usr/sbin/agetty (deleted) 2023-10-08T15:40:50.891 INFO:teuthology.orchestra.run.smithi089.stdout:agetty 1083 root mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:50.892 INFO:teuthology.orchestra.run.smithi089.stdout:agetty 1083 root mem REG 8,1 6017584 10873 /usr/lib/locale/locale-archive 2023-10-08T15:40:50.892 INFO:teuthology.orchestra.run.smithi089.stdout:agetty 1083 root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.892 INFO:teuthology.orchestra.run.smithi089.stdout:agetty 1083 root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.892 INFO:teuthology.orchestra.run.smithi089.stdout:agetty 1083 root 0u CHR 4,65 0t0 90 /dev/ttyS1 2023-10-08T15:40:50.892 INFO:teuthology.orchestra.run.smithi089.stdout:agetty 1083 root 1u CHR 4,65 0t0 90 /dev/ttyS1 2023-10-08T15:40:50.892 INFO:teuthology.orchestra.run.smithi089.stdout:agetty 1083 root 2u CHR 4,65 0t0 90 /dev/ttyS1 2023-10-08T15:40:50.892 INFO:teuthology.orchestra.run.smithi089.stdout:agetty 1083 root 4r a_inode 0,14 0 13377 inotify 2023-10-08T15:40:50.892 INFO:teuthology.orchestra.run.smithi089.stdout:nfsd 1086 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.892 INFO:teuthology.orchestra.run.smithi089.stdout:nfsd 1086 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.892 INFO:teuthology.orchestra.run.smithi089.stdout:nfsd 1086 root txt unknown /proc/1086/exe 2023-10-08T15:40:50.892 INFO:teuthology.orchestra.run.smithi089.stdout:agetty 1087 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.893 INFO:teuthology.orchestra.run.smithi089.stdout:agetty 1087 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.893 INFO:teuthology.orchestra.run.smithi089.stdout:agetty 1087 root txt REG 8,1 69000 8233 /usr/sbin/agetty (deleted) 2023-10-08T15:40:50.893 INFO:teuthology.orchestra.run.smithi089.stdout:agetty 1087 root mem REG 8,1 201272 8613 /usr/lib/locale/C.UTF-8/LC_CTYPE 2023-10-08T15:40:50.893 INFO:teuthology.orchestra.run.smithi089.stdout:agetty 1087 root mem REG 8,1 6017584 10873 /usr/lib/locale/locale-archive 2023-10-08T15:40:50.893 INFO:teuthology.orchestra.run.smithi089.stdout:agetty 1087 root mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:50.893 INFO:teuthology.orchestra.run.smithi089.stdout:agetty 1087 root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.893 INFO:teuthology.orchestra.run.smithi089.stdout:agetty 1087 root mem REG 8,1 27002 13665 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-10-08T15:40:50.893 INFO:teuthology.orchestra.run.smithi089.stdout:agetty 1087 root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.893 INFO:teuthology.orchestra.run.smithi089.stdout:agetty 1087 root 0u CHR 4,1 0t0 22 /dev/tty1 2023-10-08T15:40:50.893 INFO:teuthology.orchestra.run.smithi089.stdout:agetty 1087 root 1u CHR 4,1 0t0 22 /dev/tty1 2023-10-08T15:40:50.893 INFO:teuthology.orchestra.run.smithi089.stdout:agetty 1087 root 2u CHR 4,1 0t0 22 /dev/tty1 2023-10-08T15:40:50.894 INFO:teuthology.orchestra.run.smithi089.stdout:agetty 1087 root 4r a_inode 0,14 0 13377 inotify 2023-10-08T15:40:50.894 INFO:teuthology.orchestra.run.smithi089.stdout:nfsd 1088 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.894 INFO:teuthology.orchestra.run.smithi089.stdout:nfsd 1088 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.894 INFO:teuthology.orchestra.run.smithi089.stdout:nfsd 1088 root txt unknown /proc/1088/exe 2023-10-08T15:40:50.894 INFO:teuthology.orchestra.run.smithi089.stdout:nfsd 1089 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.894 INFO:teuthology.orchestra.run.smithi089.stdout:nfsd 1089 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.894 INFO:teuthology.orchestra.run.smithi089.stdout:nfsd 1089 root txt unknown /proc/1089/exe 2023-10-08T15:40:50.894 INFO:teuthology.orchestra.run.smithi089.stdout:nfsd 1090 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.894 INFO:teuthology.orchestra.run.smithi089.stdout:nfsd 1090 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.894 INFO:teuthology.orchestra.run.smithi089.stdout:nfsd 1090 root txt unknown /proc/1090/exe 2023-10-08T15:40:50.894 INFO:teuthology.orchestra.run.smithi089.stdout:nfsd 1091 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.895 INFO:teuthology.orchestra.run.smithi089.stdout:nfsd 1091 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.895 INFO:teuthology.orchestra.run.smithi089.stdout:nfsd 1091 root txt unknown /proc/1091/exe 2023-10-08T15:40:50.895 INFO:teuthology.orchestra.run.smithi089.stdout:nfsd 1092 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.895 INFO:teuthology.orchestra.run.smithi089.stdout:nfsd 1092 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.895 INFO:teuthology.orchestra.run.smithi089.stdout:nfsd 1092 root txt unknown /proc/1092/exe 2023-10-08T15:40:50.895 INFO:teuthology.orchestra.run.smithi089.stdout:nfsd 1093 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.895 INFO:teuthology.orchestra.run.smithi089.stdout:nfsd 1093 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.895 INFO:teuthology.orchestra.run.smithi089.stdout:nfsd 1093 root txt unknown /proc/1093/exe 2023-10-08T15:40:50.895 INFO:teuthology.orchestra.run.smithi089.stdout:nfsd 1094 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.895 INFO:teuthology.orchestra.run.smithi089.stdout:nfsd 1094 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.895 INFO:teuthology.orchestra.run.smithi089.stdout:nfsd 1094 root txt unknown /proc/1094/exe 2023-10-08T15:40:50.896 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/5 1095 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.896 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/5 1095 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.896 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/5 1095 root txt unknown /proc/1095/exe 2023-10-08T15:40:50.896 INFO:teuthology.orchestra.run.smithi089.stdout:collectl 1166 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.896 INFO:teuthology.orchestra.run.smithi089.stdout:collectl 1166 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.896 INFO:teuthology.orchestra.run.smithi089.stdout:collectl 1166 root txt REG 8,1 3478464 8988 /usr/bin/perl 2023-10-08T15:40:50.896 INFO:teuthology.orchestra.run.smithi089.stdout:collectl 1166 root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:50.896 INFO:teuthology.orchestra.run.smithi089.stdout:collectl 1166 root mem REG 8,1 35424 77013 /usr/lib/x86_64-linux-gnu/perl/5.30.0/auto/Time/HiRes/HiRes.so 2023-10-08T15:40:50.897 INFO:teuthology.orchestra.run.smithi089.stdout:collectl 1166 root mem REG 8,1 64296 76909 /usr/lib/x86_64-linux-gnu/perl/5.30.0/auto/Compress/Raw/Zlib/Zlib.so 2023-10-08T15:40:50.897 INFO:teuthology.orchestra.run.smithi089.stdout:collectl 1166 root mem REG 8,1 56208 76971 /usr/lib/x86_64-linux-gnu/perl/5.30.0/auto/List/Util/Util.so 2023-10-08T15:40:50.897 INFO:teuthology.orchestra.run.smithi089.stdout:collectl 1166 root mem REG 8,1 23064 77006 /usr/lib/x86_64-linux-gnu/perl/5.30.0/auto/Sys/Syslog/Syslog.so 2023-10-08T15:40:50.897 INFO:teuthology.orchestra.run.smithi089.stdout:collectl 1166 root mem REG 8,1 31520 76949 /usr/lib/x86_64-linux-gnu/perl/5.30.0/auto/File/Glob/Glob.so 2023-10-08T15:40:50.897 INFO:teuthology.orchestra.run.smithi089.stdout:collectl 1166 root mem REG 8,1 18984 76911 /usr/lib/x86_64-linux-gnu/perl/5.30.0/auto/Cwd/Cwd.so 2023-10-08T15:40:50.897 INFO:teuthology.orchestra.run.smithi089.stdout:collectl 1166 root mem REG 8,1 47832 76999 /usr/lib/x86_64-linux-gnu/perl/5.30.0/auto/Socket/Socket.so 2023-10-08T15:40:50.897 INFO:teuthology.orchestra.run.smithi089.stdout:collectl 1166 root mem REG 8,1 23152 76965 /usr/lib/x86_64-linux-gnu/perl/5.30.0/auto/IO/IO.so 2023-10-08T15:40:50.897 INFO:teuthology.orchestra.run.smithi089.stdout:collectl 1166 root mem REG 8,1 110384 76986 /usr/lib/x86_64-linux-gnu/perl/5.30.0/auto/POSIX/POSIX.so 2023-10-08T15:40:50.898 INFO:teuthology.orchestra.run.smithi089.stdout:collectl 1166 root mem REG 8,1 6017584 10873 /usr/lib/locale/locale-archive 2023-10-08T15:40:50.898 INFO:teuthology.orchestra.run.smithi089.stdout:collectl 1166 root mem REG 8,1 202760 8017 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-10-08T15:40:50.898 INFO:teuthology.orchestra.run.smithi089.stdout:collectl 1166 root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.898 INFO:teuthology.orchestra.run.smithi089.stdout:collectl 1166 root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.898 INFO:teuthology.orchestra.run.smithi089.stdout:collectl 1166 root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:50.898 INFO:teuthology.orchestra.run.smithi089.stdout:collectl 1166 root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.898 INFO:teuthology.orchestra.run.smithi089.stdout:collectl 1166 root mem REG 8,1 14768 77010 /usr/lib/x86_64-linux-gnu/perl/5.30.0/auto/Tie/Hash/NamedCapture/NamedCapture.so 2023-10-08T15:40:50.898 INFO:teuthology.orchestra.run.smithi089.stdout:collectl 1166 root mem REG 8,1 22896 76944 /usr/lib/x86_64-linux-gnu/perl/5.30.0/auto/Fcntl/Fcntl.so 2023-10-08T15:40:50.898 INFO:teuthology.orchestra.run.smithi089.stdout:collectl 1166 root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.898 INFO:teuthology.orchestra.run.smithi089.stdout:collectl 1166 root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.899 INFO:teuthology.orchestra.run.smithi089.stdout:collectl 1166 root 1w CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.899 INFO:teuthology.orchestra.run.smithi089.stdout:collectl 1166 root 2w CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.899 INFO:teuthology.orchestra.run.smithi089.stdout:collectl 1166 root 3r DIR 0,5 0 1 /proc 2023-10-08T15:40:50.899 INFO:teuthology.orchestra.run.smithi089.stdout:collectl 1166 root 4w REG 8,1 451568 1656 /var/log/collectl/smithi089-20231008-152640.raw.gz 2023-10-08T15:40:50.899 INFO:teuthology.orchestra.run.smithi089.stdout:none 1184 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.899 INFO:teuthology.orchestra.run.smithi089.stdout:none 1184 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.899 INFO:teuthology.orchestra.run.smithi089.stdout:none 1184 root txt REG 0,1 17032 25158 / (deleted) 2023-10-08T15:40:50.899 INFO:teuthology.orchestra.run.smithi089.stdout:none 1184 root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.900 INFO:teuthology.orchestra.run.smithi089.stdout:none 1184 root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.900 INFO:teuthology.orchestra.run.smithi089.stdout:none 1184 root 0r FIFO 0,13 0t0 29839 pipe 2023-10-08T15:40:50.900 INFO:teuthology.orchestra.run.smithi089.stdout:none 1184 root 1w FIFO 0,13 0t0 29840 pipe 2023-10-08T15:40:50.900 INFO:teuthology.orchestra.run.smithi089.stdout:none 1184 root 2w CHR 1,11 0t0 12 /dev/kmsg 2023-10-08T15:40:50.900 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.900 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.900 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu txt REG 8,1 1620224 10711 /usr/lib/systemd/systemd 2023-10-08T15:40:50.901 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:50.901 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu mem REG 8,1 178528 12765 /usr/lib/x86_64-linux-gnu/libudev.so.1.6.17 2023-10-08T15:40:50.901 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu mem REG 8,1 1575112 10736 /usr/lib/x86_64-linux-gnu/libunistring.so.2.1.0 2023-10-08T15:40:50.901 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu mem REG 8,1 137584 8109 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.28.0 2023-10-08T15:40:50.901 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu mem REG 8,1 67912 8783 /usr/lib/x86_64-linux-gnu/libjson-c.so.4.0.0 2023-10-08T15:40:50.901 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu mem REG 8,1 34872 10626 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-10-08T15:40:50.901 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu mem REG 8,1 431472 10641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-10-08T15:40:50.901 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu DEL REG 8,1 8351 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-10-08T15:40:50.902 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu DEL REG 8,1 8794 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:50.902 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu mem REG 8,1 686160 8833 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.4 2023-10-08T15:40:50.902 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu mem REG 8,1 27064 8001 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-10-08T15:40:50.902 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.902 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu mem REG 8,1 584392 8917 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.9.0 2023-10-08T15:40:50.902 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.902 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:50.902 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu mem REG 8,1 129248 13039 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.2 2023-10-08T15:40:50.903 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu mem REG 8,1 35440 10678 /usr/lib/x86_64-linux-gnu/libip4tc.so.2.0.0 2023-10-08T15:40:50.903 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu mem REG 8,1 129096 10669 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.6 2023-10-08T15:40:50.903 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu mem REG 8,1 1168056 8360 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.2.5 2023-10-08T15:40:50.903 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu mem REG 8,1 417328 8800 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.5.0 2023-10-08T15:40:50.903 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu mem REG 8,1 202760 8017 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-10-08T15:40:50.903 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu mem REG 8,1 31120 10630 /usr/lib/x86_64-linux-gnu/libcap.so.2.32 2023-10-08T15:40:50.903 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu mem REG 8,1 351352 9401 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-10-08T15:40:50.903 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu mem REG 8,1 39088 8336 /usr/lib/x86_64-linux-gnu/libacl.so.1.1.2253 2023-10-08T15:40:50.904 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu mem REG 8,1 80736 8771 /usr/lib/x86_64-linux-gnu/libapparmor.so.1.6.1 2023-10-08T15:40:50.904 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu mem REG 8,1 112848 8859 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.5 2023-10-08T15:40:50.904 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu mem REG 8,1 133200 8347 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-10-08T15:40:50.904 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu mem REG 8,1 68320 8384 /usr/lib/x86_64-linux-gnu/libpam.so.0.84.2 2023-10-08T15:40:50.904 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu mem REG 8,1 387768 8064 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-10-08T15:40:50.904 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu mem REG 8,1 163200 8942 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-10-08T15:40:50.904 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu mem REG 8,1 133568 8867 /usr/lib/x86_64-linux-gnu/libseccomp.so.2.5.1 2023-10-08T15:40:50.904 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:50.904 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu mem REG 8,1 2454472 8914 /usr/lib/systemd/libsystemd-shared-245.so 2023-10-08T15:40:50.905 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.905 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.905 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.905 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu 1u unix 0xffff8f3914c08000 0t0 30096 type=STREAM 2023-10-08T15:40:50.905 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu 2u unix 0xffff8f3914c08000 0t0 30096 type=STREAM 2023-10-08T15:40:50.905 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu 3u unix 0xffff8f3911fc8440 0t0 30112 type=DGRAM 2023-10-08T15:40:50.905 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu 4u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.905 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu 5u a_inode 0,14 0 13377 [signalfd] 2023-10-08T15:40:50.905 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu 6r a_inode 0,14 0 13377 inotify 2023-10-08T15:40:50.905 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu 7r DIR 0,29 0 1381 /sys/fs/cgroup/unified/user.slice/user-1000.slice/user@1000.service 2023-10-08T15:40:50.906 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu 8u a_inode 0,14 0 13377 [timerfd] 2023-10-08T15:40:50.906 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu 9u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.906 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu 10r REG 0,5 0 22481 /proc/1328/mountinfo 2023-10-08T15:40:50.906 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu 11r a_inode 0,14 0 13377 inotify 2023-10-08T15:40:50.906 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu 12u unix 0xffff8f39118f1100 0t0 22496 /run/user/1000/bus type=STREAM 2023-10-08T15:40:50.906 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu 13r a_inode 0,14 0 13377 inotify 2023-10-08T15:40:50.906 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu 14r REG 0,5 0 4026532079 /proc/swaps 2023-10-08T15:40:50.906 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu 15u netlink 0t0 22482 KOBJECT_UEVENT 2023-10-08T15:40:50.907 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu 16u unix 0xffff8f39118f0cc0 0t0 22488 /run/user/1000/systemd/notify type=DGRAM 2023-10-08T15:40:50.907 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu 17u unix 0xffff8f39118f1dc0 0t0 22489 type=DGRAM 2023-10-08T15:40:50.907 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu 18u unix 0xffff8f39118f6a40 0t0 22490 type=DGRAM 2023-10-08T15:40:50.907 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu 19u unix 0xffff8f39118f7b40 0t0 22491 /run/user/1000/systemd/private type=STREAM 2023-10-08T15:40:50.907 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu 20u unix 0xffff8f39118f3300 0t0 22492 type=STREAM 2023-10-08T15:40:50.907 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu 21u a_inode 0,14 0 13377 [timerfd] 2023-10-08T15:40:50.907 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu 26u unix 0xffff8f39118f3740 0t0 22497 /run/user/1000/gnupg/S.dirmngr type=STREAM 2023-10-08T15:40:50.907 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu 27u unix 0xffff8f39118f5940 0t0 22498 /run/user/1000/gnupg/S.gpg-agent.browser type=STREAM 2023-10-08T15:40:50.907 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu 28u unix 0xffff8f39118f3b80 0t0 22499 /run/user/1000/gnupg/S.gpg-agent.extra type=STREAM 2023-10-08T15:40:50.907 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu 29u unix 0xffff8f39118f7700 0t0 22500 /run/user/1000/gnupg/S.gpg-agent.ssh type=STREAM 2023-10-08T15:40:50.908 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu 30u unix 0xffff8f39118f0880 0t0 22501 /run/user/1000/gnupg/S.gpg-agent type=STREAM 2023-10-08T15:40:50.908 INFO:teuthology.orchestra.run.smithi089.stdout:systemd 1328 ubuntu 31u unix 0xffff8f39118f2640 0t0 22502 /run/user/1000/pk-debconf-socket type=STREAM 2023-10-08T15:40:50.908 INFO:teuthology.orchestra.run.smithi089.stdout:(sd-pam) 1329 ubuntu cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.908 INFO:teuthology.orchestra.run.smithi089.stdout:(sd-pam) 1329 ubuntu rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.908 INFO:teuthology.orchestra.run.smithi089.stdout:(sd-pam) 1329 ubuntu txt REG 8,1 1620224 10711 /usr/lib/systemd/systemd 2023-10-08T15:40:50.908 INFO:teuthology.orchestra.run.smithi089.stdout:(sd-pam) 1329 ubuntu mem REG 8,1 14728 8386 /usr/lib/x86_64-linux-gnu/libpam_misc.so.0.82.1 2023-10-08T15:40:50.908 INFO:teuthology.orchestra.run.smithi089.stdout:(sd-pam) 1329 ubuntu mem REG 8,1 18424 12487 /usr/lib/x86_64-linux-gnu/security/pam_cap.so 2023-10-08T15:40:50.908 INFO:teuthology.orchestra.run.smithi089.stdout:(sd-pam) 1329 ubuntu mem REG 8,1 475944 8779 /usr/lib/x86_64-linux-gnu/security/pam_systemd.so 2023-10-08T15:40:50.909 INFO:teuthology.orchestra.run.smithi089.stdout:(sd-pam) 1329 ubuntu mem REG 8,1 14624 8696 /usr/lib/x86_64-linux-gnu/security/pam_umask.so 2023-10-08T15:40:50.909 INFO:teuthology.orchestra.run.smithi089.stdout:(sd-pam) 1329 ubuntu mem REG 8,1 27136 8672 /usr/lib/x86_64-linux-gnu/security/pam_limits.so 2023-10-08T15:40:50.909 INFO:teuthology.orchestra.run.smithi089.stdout:(sd-pam) 1329 ubuntu mem REG 8,1 14584 8675 /usr/lib/x86_64-linux-gnu/security/pam_loginuid.so 2023-10-08T15:40:50.909 INFO:teuthology.orchestra.run.smithi089.stdout:(sd-pam) 1329 ubuntu mem REG 8,1 27088 8686 /usr/lib/x86_64-linux-gnu/security/pam_selinux.so 2023-10-08T15:40:50.909 INFO:teuthology.orchestra.run.smithi089.stdout:(sd-pam) 1329 ubuntu mem REG 8,1 105560 13403 /usr/lib/x86_64-linux-gnu/libnsl-2.31.so 2023-10-08T15:40:50.909 INFO:teuthology.orchestra.run.smithi089.stdout:(sd-pam) 1329 ubuntu mem REG 8,1 64504 8697 /usr/lib/x86_64-linux-gnu/security/pam_unix.so 2023-10-08T15:40:50.909 INFO:teuthology.orchestra.run.smithi089.stdout:(sd-pam) 1329 ubuntu mem REG 8,1 239896 8375 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-10-08T15:40:50.909 INFO:teuthology.orchestra.run.smithi089.stdout:(sd-pam) 1329 ubuntu mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:50.909 INFO:teuthology.orchestra.run.smithi089.stdout:(sd-pam) 1329 ubuntu mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:50.910 INFO:teuthology.orchestra.run.smithi089.stdout:(sd-pam) 1329 ubuntu mem REG 8,1 178528 12765 /usr/lib/x86_64-linux-gnu/libudev.so.1.6.17 2023-10-08T15:40:50.910 INFO:teuthology.orchestra.run.smithi089.stdout:(sd-pam) 1329 ubuntu mem REG 8,1 1575112 10736 /usr/lib/x86_64-linux-gnu/libunistring.so.2.1.0 2023-10-08T15:40:50.910 INFO:teuthology.orchestra.run.smithi089.stdout:(sd-pam) 1329 ubuntu mem REG 8,1 137584 8109 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.28.0 2023-10-08T15:40:50.910 INFO:teuthology.orchestra.run.smithi089.stdout:(sd-pam) 1329 ubuntu mem REG 8,1 67912 8783 /usr/lib/x86_64-linux-gnu/libjson-c.so.4.0.0 2023-10-08T15:40:50.910 INFO:teuthology.orchestra.run.smithi089.stdout:(sd-pam) 1329 ubuntu mem REG 8,1 34872 10626 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-10-08T15:40:50.910 INFO:teuthology.orchestra.run.smithi089.stdout:(sd-pam) 1329 ubuntu mem REG 8,1 431472 10641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-10-08T15:40:50.910 INFO:teuthology.orchestra.run.smithi089.stdout:(sd-pam) 1329 ubuntu DEL REG 8,1 8351 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-10-08T15:40:50.910 INFO:teuthology.orchestra.run.smithi089.stdout:(sd-pam) 1329 ubuntu DEL REG 8,1 8794 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:50.910 INFO:teuthology.orchestra.run.smithi089.stdout:(sd-pam) 1329 ubuntu mem REG 8,1 686160 8833 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.4 2023-10-08T15:40:50.911 INFO:teuthology.orchestra.run.smithi089.stdout:(sd-pam) 1329 ubuntu mem REG 8,1 27064 8001 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-10-08T15:40:50.911 INFO:teuthology.orchestra.run.smithi089.stdout:(sd-pam) 1329 ubuntu mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.911 INFO:teuthology.orchestra.run.smithi089.stdout:(sd-pam) 1329 ubuntu mem REG 8,1 584392 8917 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.9.0 2023-10-08T15:40:50.911 INFO:teuthology.orchestra.run.smithi089.stdout:(sd-pam) 1329 ubuntu mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.911 INFO:teuthology.orchestra.run.smithi089.stdout:(sd-pam) 1329 ubuntu mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:50.911 INFO:teuthology.orchestra.run.smithi089.stdout:(sd-pam) 1329 ubuntu mem REG 8,1 129248 13039 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.2 2023-10-08T15:40:50.911 INFO:teuthology.orchestra.run.smithi089.stdout:(sd-pam) 1329 ubuntu mem REG 8,1 35440 10678 /usr/lib/x86_64-linux-gnu/libip4tc.so.2.0.0 2023-10-08T15:40:50.911 INFO:teuthology.orchestra.run.smithi089.stdout:(sd-pam) 1329 ubuntu mem REG 8,1 129096 10669 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.6 2023-10-08T15:40:50.911 INFO:teuthology.orchestra.run.smithi089.stdout:(sd-pam) 1329 ubuntu mem REG 8,1 1168056 8360 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.2.5 2023-10-08T15:40:50.912 INFO:teuthology.orchestra.run.smithi089.stdout:(sd-pam) 1329 ubuntu mem REG 8,1 417328 8800 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.5.0 2023-10-08T15:40:50.912 INFO:teuthology.orchestra.run.smithi089.stdout:(sd-pam) 1329 ubuntu mem REG 8,1 202760 8017 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-10-08T15:40:50.912 INFO:teuthology.orchestra.run.smithi089.stdout:(sd-pam) 1329 ubuntu mem REG 8,1 31120 10630 /usr/lib/x86_64-linux-gnu/libcap.so.2.32 2023-10-08T15:40:50.912 INFO:teuthology.orchestra.run.smithi089.stdout:(sd-pam) 1329 ubuntu mem REG 8,1 351352 9401 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-10-08T15:40:50.912 INFO:teuthology.orchestra.run.smithi089.stdout:(sd-pam) 1329 ubuntu mem REG 8,1 39088 8336 /usr/lib/x86_64-linux-gnu/libacl.so.1.1.2253 2023-10-08T15:40:50.912 INFO:teuthology.orchestra.run.smithi089.stdout:(sd-pam) 1329 ubuntu mem REG 8,1 80736 8771 /usr/lib/x86_64-linux-gnu/libapparmor.so.1.6.1 2023-10-08T15:40:50.912 INFO:teuthology.orchestra.run.smithi089.stdout:(sd-pam) 1329 ubuntu mem REG 8,1 112848 8859 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.5 2023-10-08T15:40:50.912 INFO:teuthology.orchestra.run.smithi089.stdout:(sd-pam) 1329 ubuntu mem REG 8,1 133200 8347 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-10-08T15:40:50.912 INFO:teuthology.orchestra.run.smithi089.stdout:(sd-pam) 1329 ubuntu mem REG 8,1 68320 8384 /usr/lib/x86_64-linux-gnu/libpam.so.0.84.2 2023-10-08T15:40:50.912 INFO:teuthology.orchestra.run.smithi089.stdout:(sd-pam) 1329 ubuntu mem REG 8,1 387768 8064 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-10-08T15:40:50.913 INFO:teuthology.orchestra.run.smithi089.stdout:(sd-pam) 1329 ubuntu mem REG 8,1 163200 8942 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-10-08T15:40:50.913 INFO:teuthology.orchestra.run.smithi089.stdout:(sd-pam) 1329 ubuntu mem REG 8,1 133568 8867 /usr/lib/x86_64-linux-gnu/libseccomp.so.2.5.1 2023-10-08T15:40:50.913 INFO:teuthology.orchestra.run.smithi089.stdout:(sd-pam) 1329 ubuntu mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:50.913 INFO:teuthology.orchestra.run.smithi089.stdout:(sd-pam) 1329 ubuntu mem REG 8,1 2454472 8914 /usr/lib/systemd/libsystemd-shared-245.so 2023-10-08T15:40:50.913 INFO:teuthology.orchestra.run.smithi089.stdout:(sd-pam) 1329 ubuntu mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.913 INFO:teuthology.orchestra.run.smithi089.stdout:(sd-pam) 1329 ubuntu mem REG 8,1 14448 8681 /usr/lib/x86_64-linux-gnu/security/pam_permit.so 2023-10-08T15:40:50.913 INFO:teuthology.orchestra.run.smithi089.stdout:(sd-pam) 1329 ubuntu mem REG 8,1 14048 8659 /usr/lib/x86_64-linux-gnu/security/pam_deny.so 2023-10-08T15:40:50.913 INFO:teuthology.orchestra.run.smithi089.stdout:(sd-pam) 1329 ubuntu mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.913 INFO:teuthology.orchestra.run.smithi089.stdout:(sd-pam) 1329 ubuntu 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.914 INFO:teuthology.orchestra.run.smithi089.stdout:(sd-pam) 1329 ubuntu 1u unix 0xffff8f3914c08000 0t0 30096 type=STREAM 2023-10-08T15:40:50.914 INFO:teuthology.orchestra.run.smithi089.stdout:(sd-pam) 1329 ubuntu 2u unix 0xffff8f3914c08000 0t0 30096 type=STREAM 2023-10-08T15:40:50.914 INFO:teuthology.orchestra.run.smithi089.stdout:(sd-pam) 1329 ubuntu 3u a_inode 0,14 0 13377 [eventfd] 2023-10-08T15:40:50.914 INFO:teuthology.orchestra.run.smithi089.stdout:(sd-pam) 1329 ubuntu 4u a_inode 0,14 0 13377 [eventfd] 2023-10-08T15:40:50.914 INFO:teuthology.orchestra.run.smithi089.stdout:(sd-pam) 1329 ubuntu 6w FIFO 0,13 0t0 30097 pipe 2023-10-08T15:40:50.914 INFO:teuthology.orchestra.run.smithi089.stdout:(sd-pam) 1329 ubuntu 7u unix 0xffff8f3911fc9980 0t0 30106 type=DGRAM 2023-10-08T15:40:50.914 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 syslog cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.914 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 syslog rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.915 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 syslog txt REG 8,1 727248 11334 /usr/sbin/rsyslogd 2023-10-08T15:40:50.915 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 syslog mem REG 8,1 239896 8375 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-10-08T15:40:50.915 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 syslog mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:50.915 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 syslog mem REG 8,1 23856 22490 /usr/lib/x86_64-linux-gnu/rsyslog/imklog.so 2023-10-08T15:40:50.915 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 syslog mem REG 8,1 41112 22497 /usr/lib/x86_64-linux-gnu/rsyslog/imuxsock.so 2023-10-08T15:40:50.915 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 syslog mem REG 8,1 137584 8109 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.28.0 2023-10-08T15:40:50.915 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 syslog mem REG 8,1 1168056 8360 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.2.5 2023-10-08T15:40:50.915 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 syslog mem REG 8,1 129248 13039 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.2 2023-10-08T15:40:50.915 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 syslog mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:50.915 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 syslog mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:50.915 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 syslog mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.915 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 syslog DEL REG 8,1 8351 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-10-08T15:40:50.916 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 syslog mem REG 8,1 709496 10741 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.28.0 2023-10-08T15:40:50.916 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 syslog mem REG 8,1 43720 12438 /usr/lib/x86_64-linux-gnu/libfastjson.so.4.2.0 2023-10-08T15:40:50.916 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 syslog mem REG 8,1 14344 12436 /usr/lib/x86_64-linux-gnu/libestr.so.0.0.0 2023-10-08T15:40:50.916 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 syslog mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.916 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 syslog mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.916 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 syslog mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:50.916 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 syslog mem REG 8,1 31704 22498 /usr/lib/x86_64-linux-gnu/rsyslog/lmnet.so 2023-10-08T15:40:50.916 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 syslog mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.916 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 syslog 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.916 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 syslog 1w CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.917 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 syslog 2w CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.917 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 syslog 3u unix 0xffff8f3919f46e80 0t0 13558 /run/systemd/journal/syslog type=DGRAM 2023-10-08T15:40:50.917 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 syslog 4r CHR 1,9 0t0 11 /dev/urandom 2023-10-08T15:40:50.917 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 syslog 5r REG 0,5 0 4026532039 /proc/kmsg 2023-10-08T15:40:50.917 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 syslog 6u unix 0xffff8f39192e0000 0t0 27834 type=DGRAM 2023-10-08T15:40:50.917 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 syslog 7w REG 8,1 526981 1667 /var/log/syslog 2023-10-08T15:40:50.917 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 syslog 8w REG 8,1 717939 924117 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T15:40:50.917 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 syslog 9w REG 8,1 365999 5086 /var/log/auth.log 2023-10-08T15:40:50.917 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 syslog 10w REG 8,1 112527 1214 /var/log/kern.log 2023-10-08T15:40:50.917 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 syslog 11w REG 8,1 1755 924116 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T15:40:50.917 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1383 in:imuxso syslog cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.918 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1383 in:imuxso syslog rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.918 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1383 in:imuxso syslog txt REG 8,1 727248 11334 /usr/sbin/rsyslogd 2023-10-08T15:40:50.918 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1383 in:imuxso syslog mem REG 8,1 239896 8375 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-10-08T15:40:50.918 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1383 in:imuxso syslog mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:50.918 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1383 in:imuxso syslog mem REG 8,1 23856 22490 /usr/lib/x86_64-linux-gnu/rsyslog/imklog.so 2023-10-08T15:40:50.918 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1383 in:imuxso syslog mem REG 8,1 41112 22497 /usr/lib/x86_64-linux-gnu/rsyslog/imuxsock.so 2023-10-08T15:40:50.918 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1383 in:imuxso syslog mem REG 8,1 137584 8109 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.28.0 2023-10-08T15:40:50.918 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1383 in:imuxso syslog mem REG 8,1 1168056 8360 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.2.5 2023-10-08T15:40:50.918 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1383 in:imuxso syslog mem REG 8,1 129248 13039 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.2 2023-10-08T15:40:50.918 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1383 in:imuxso syslog mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:50.918 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1383 in:imuxso syslog mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:50.919 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1383 in:imuxso syslog mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.919 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1383 in:imuxso syslog DEL REG 8,1 8351 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-10-08T15:40:50.919 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1383 in:imuxso syslog mem REG 8,1 709496 10741 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.28.0 2023-10-08T15:40:50.919 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1383 in:imuxso syslog mem REG 8,1 43720 12438 /usr/lib/x86_64-linux-gnu/libfastjson.so.4.2.0 2023-10-08T15:40:50.919 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1383 in:imuxso syslog mem REG 8,1 14344 12436 /usr/lib/x86_64-linux-gnu/libestr.so.0.0.0 2023-10-08T15:40:50.919 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1383 in:imuxso syslog mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.919 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1383 in:imuxso syslog mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.919 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1383 in:imuxso syslog mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:50.919 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1383 in:imuxso syslog mem REG 8,1 31704 22498 /usr/lib/x86_64-linux-gnu/rsyslog/lmnet.so 2023-10-08T15:40:50.919 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1383 in:imuxso syslog mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.919 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1383 in:imuxso syslog 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.920 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1383 in:imuxso syslog 1w CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.920 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1383 in:imuxso syslog 2w CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.920 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1383 in:imuxso syslog 3u unix 0xffff8f3919f46e80 0t0 13558 /run/systemd/journal/syslog type=DGRAM 2023-10-08T15:40:50.920 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1383 in:imuxso syslog 4r CHR 1,9 0t0 11 /dev/urandom 2023-10-08T15:40:50.920 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1383 in:imuxso syslog 5r REG 0,5 0 4026532039 /proc/kmsg 2023-10-08T15:40:50.920 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1383 in:imuxso syslog 6u unix 0xffff8f39192e0000 0t0 27834 type=DGRAM 2023-10-08T15:40:50.920 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1383 in:imuxso syslog 7w REG 8,1 526981 1667 /var/log/syslog 2023-10-08T15:40:50.920 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1383 in:imuxso syslog 8w REG 8,1 717939 924117 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T15:40:50.920 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1383 in:imuxso syslog 9w REG 8,1 365999 5086 /var/log/auth.log 2023-10-08T15:40:50.920 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1383 in:imuxso syslog 10w REG 8,1 112527 1214 /var/log/kern.log 2023-10-08T15:40:50.920 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1383 in:imuxso syslog 11w REG 8,1 1755 924116 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T15:40:50.921 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1385 in:imklog syslog cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.921 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1385 in:imklog syslog rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.921 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1385 in:imklog syslog txt REG 8,1 727248 11334 /usr/sbin/rsyslogd 2023-10-08T15:40:50.921 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1385 in:imklog syslog mem REG 8,1 239896 8375 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-10-08T15:40:50.921 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1385 in:imklog syslog mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:50.921 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1385 in:imklog syslog mem REG 8,1 23856 22490 /usr/lib/x86_64-linux-gnu/rsyslog/imklog.so 2023-10-08T15:40:50.921 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1385 in:imklog syslog mem REG 8,1 41112 22497 /usr/lib/x86_64-linux-gnu/rsyslog/imuxsock.so 2023-10-08T15:40:50.921 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1385 in:imklog syslog mem REG 8,1 137584 8109 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.28.0 2023-10-08T15:40:50.921 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1385 in:imklog syslog mem REG 8,1 1168056 8360 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.2.5 2023-10-08T15:40:50.921 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1385 in:imklog syslog mem REG 8,1 129248 13039 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.2 2023-10-08T15:40:50.921 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1385 in:imklog syslog mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:50.921 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1385 in:imklog syslog mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:50.922 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1385 in:imklog syslog mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.922 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1385 in:imklog syslog DEL REG 8,1 8351 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-10-08T15:40:50.922 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1385 in:imklog syslog mem REG 8,1 709496 10741 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.28.0 2023-10-08T15:40:50.922 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1385 in:imklog syslog mem REG 8,1 43720 12438 /usr/lib/x86_64-linux-gnu/libfastjson.so.4.2.0 2023-10-08T15:40:50.922 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1385 in:imklog syslog mem REG 8,1 14344 12436 /usr/lib/x86_64-linux-gnu/libestr.so.0.0.0 2023-10-08T15:40:50.922 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1385 in:imklog syslog mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.922 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1385 in:imklog syslog mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.922 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1385 in:imklog syslog mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:50.922 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1385 in:imklog syslog mem REG 8,1 31704 22498 /usr/lib/x86_64-linux-gnu/rsyslog/lmnet.so 2023-10-08T15:40:50.922 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1385 in:imklog syslog mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.922 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1385 in:imklog syslog 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.923 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1385 in:imklog syslog 1w CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.923 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1385 in:imklog syslog 2w CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.923 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1385 in:imklog syslog 3u unix 0xffff8f3919f46e80 0t0 13558 /run/systemd/journal/syslog type=DGRAM 2023-10-08T15:40:50.923 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1385 in:imklog syslog 4r CHR 1,9 0t0 11 /dev/urandom 2023-10-08T15:40:50.923 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1385 in:imklog syslog 5r REG 0,5 0 4026532039 /proc/kmsg 2023-10-08T15:40:50.923 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1385 in:imklog syslog 6u unix 0xffff8f39192e0000 0t0 27834 type=DGRAM 2023-10-08T15:40:50.923 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1385 in:imklog syslog 7w REG 8,1 526981 1667 /var/log/syslog 2023-10-08T15:40:50.923 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1385 in:imklog syslog 8w REG 8,1 717939 924117 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T15:40:50.923 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1385 in:imklog syslog 9w REG 8,1 365999 5086 /var/log/auth.log 2023-10-08T15:40:50.923 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1385 in:imklog syslog 10w REG 8,1 112527 1214 /var/log/kern.log 2023-10-08T15:40:50.923 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1385 in:imklog syslog 11w REG 8,1 1755 924116 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T15:40:50.924 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1386 rs:main syslog cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.924 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1386 rs:main syslog rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.924 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1386 rs:main syslog txt REG 8,1 727248 11334 /usr/sbin/rsyslogd 2023-10-08T15:40:50.924 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1386 rs:main syslog mem REG 8,1 239896 8375 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-10-08T15:40:50.924 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1386 rs:main syslog mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:50.924 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1386 rs:main syslog mem REG 8,1 23856 22490 /usr/lib/x86_64-linux-gnu/rsyslog/imklog.so 2023-10-08T15:40:50.924 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1386 rs:main syslog mem REG 8,1 41112 22497 /usr/lib/x86_64-linux-gnu/rsyslog/imuxsock.so 2023-10-08T15:40:50.924 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1386 rs:main syslog mem REG 8,1 137584 8109 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.28.0 2023-10-08T15:40:50.924 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1386 rs:main syslog mem REG 8,1 1168056 8360 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.2.5 2023-10-08T15:40:50.925 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1386 rs:main syslog mem REG 8,1 129248 13039 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.2 2023-10-08T15:40:50.925 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1386 rs:main syslog mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:50.925 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1386 rs:main syslog mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:50.925 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1386 rs:main syslog mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.925 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1386 rs:main syslog DEL REG 8,1 8351 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-10-08T15:40:50.925 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1386 rs:main syslog mem REG 8,1 709496 10741 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.28.0 2023-10-08T15:40:50.925 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1386 rs:main syslog mem REG 8,1 43720 12438 /usr/lib/x86_64-linux-gnu/libfastjson.so.4.2.0 2023-10-08T15:40:50.925 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1386 rs:main syslog mem REG 8,1 14344 12436 /usr/lib/x86_64-linux-gnu/libestr.so.0.0.0 2023-10-08T15:40:50.925 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1386 rs:main syslog mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.925 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1386 rs:main syslog mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.926 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1386 rs:main syslog mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:50.926 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1386 rs:main syslog mem REG 8,1 31704 22498 /usr/lib/x86_64-linux-gnu/rsyslog/lmnet.so 2023-10-08T15:40:50.926 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1386 rs:main syslog mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.926 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1386 rs:main syslog 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.926 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1386 rs:main syslog 1w CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.926 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1386 rs:main syslog 2w CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.926 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1386 rs:main syslog 3u unix 0xffff8f3919f46e80 0t0 13558 /run/systemd/journal/syslog type=DGRAM 2023-10-08T15:40:50.926 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1386 rs:main syslog 4r CHR 1,9 0t0 11 /dev/urandom 2023-10-08T15:40:50.926 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1386 rs:main syslog 5r REG 0,5 0 4026532039 /proc/kmsg 2023-10-08T15:40:50.927 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1386 rs:main syslog 6u unix 0xffff8f39192e0000 0t0 27834 type=DGRAM 2023-10-08T15:40:50.927 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1386 rs:main syslog 7w REG 8,1 526981 1667 /var/log/syslog 2023-10-08T15:40:50.927 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1386 rs:main syslog 8w REG 8,1 717939 924117 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T15:40:50.927 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1386 rs:main syslog 9w REG 8,1 365999 5086 /var/log/auth.log 2023-10-08T15:40:50.927 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1386 rs:main syslog 10w REG 8,1 112527 1214 /var/log/kern.log 2023-10-08T15:40:50.927 INFO:teuthology.orchestra.run.smithi089.stdout:rsyslogd 1382 1386 rs:main syslog 11w REG 8,1 1755 924116 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T15:40:50.927 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.927 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.927 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root txt REG 8,1 289288 105910 /usr/lib/packagekit/packagekitd 2023-10-08T15:40:50.927 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root mem REG 8,1 28046896 10299 /usr/lib/x86_64-linux-gnu/libicudata.so.66.1 2023-10-08T15:40:50.928 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root mem REG 8,1 137784 15763 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.7 2023-10-08T15:40:50.928 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root mem REG 8,1 129096 10669 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.6 2023-10-08T15:40:50.928 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root mem REG 8,1 1575112 10736 /usr/lib/x86_64-linux-gnu/libunistring.so.2.1.0 2023-10-08T15:40:50.928 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root mem REG 8,1 56096 15015 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-10-08T15:40:50.928 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root mem REG 8,1 191040 15017 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-10-08T15:40:50.928 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root mem REG 8,1 902016 15021 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-10-08T15:40:50.928 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root mem REG 8,1 1976648 10310 /usr/lib/x86_64-linux-gnu/libicuuc.so.66.1 2023-10-08T15:40:50.928 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root mem REG 8,1 51512 15764 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.7 2023-10-08T15:40:50.928 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root mem REG 8,1 309712 15024 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-10-08T15:40:50.928 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root mem REG 8,1 178528 12765 /usr/lib/x86_64-linux-gnu/libudev.so.1.6.17 2023-10-08T15:40:50.929 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root mem REG 8,1 686160 8833 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.4 2023-10-08T15:40:50.929 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root mem REG 8,1 1799408 10319 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.10 2023-10-08T15:40:50.929 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root mem REG 8,1 22600 15019 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.8 2023-10-08T15:40:50.929 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root mem REG 8,1 71672 15241 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-10-08T15:40:50.929 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root mem REG 8,1 74848 8355 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-10-08T15:40:50.929 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root mem REG 8,1 334248 18469 /usr/lib/x86_64-linux-gnu/libstemmer.so.0d.0.0 2023-10-08T15:40:50.929 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root mem REG 8,1 133336 12518 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-10-08T15:40:50.929 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root mem REG 8,1 92304 15027 /usr/lib/x86_64-linux-gnu/liblmdb.so.0.0.0 2023-10-08T15:40:50.929 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root mem REG 8,1 633560 18427 /usr/lib/x86_64-linux-gnu/libsoup-2.4.so.1.9.0 2023-10-08T15:40:50.929 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root mem REG 8,1 1953248 10522 /usr/lib/x86_64-linux-gnu/libapt-pkg.so.6.0.0 2023-10-08T15:40:50.929 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root mem REG 8,1 1329768 18380 /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0.1603.0 2023-10-08T15:40:50.929 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root mem REG 8,1 393608 18471 /usr/lib/x86_64-linux-gnu/libappstream.so.0.12.10 2023-10-08T15:40:50.930 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root mem REG 8,1 403256 105914 /usr/lib/x86_64-linux-gnu/packagekit-backend/libpk_backend_aptcc.so 2023-10-08T15:40:50.930 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:50.930 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root mem REG 8,1 67656 101921 /usr/lib/x86_64-linux-gnu/gio/modules/libdconfsettings.so 2023-10-08T15:40:50.930 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root mem REG 8,1 104984 8251 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-10-08T15:40:50.930 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root mem REG 8,1 1956992 8082 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28 2023-10-08T15:40:50.930 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root mem REG 8,1 133640 18368 /usr/lib/x86_64-linux-gnu/libproxy.so.1.0.0 2023-10-08T15:40:50.930 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root mem REG 8,1 22600 9279 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-10-08T15:40:50.930 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root mem REG 8,1 14880 13415 /usr/lib/x86_64-linux-gnu/libutil-2.31.so 2023-10-08T15:40:50.930 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root mem REG 8,1 6017584 10873 /usr/lib/locale/locale-archive 2023-10-08T15:40:50.930 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root mem REG 8,1 137584 8109 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.28.0 2023-10-08T15:40:50.931 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root mem REG 8,1 584392 8917 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.9.0 2023-10-08T15:40:50.931 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root mem REG 8,1 351352 9401 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-10-08T15:40:50.931 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root mem REG 8,1 1168056 8360 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.2.5 2023-10-08T15:40:50.931 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root mem REG 8,1 129248 13039 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.2 2023-10-08T15:40:50.931 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:50.931 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:50.931 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root mem REG 8,1 465008 11338 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-10-08T15:40:50.931 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root mem REG 8,1 43416 10645 /usr/lib/x86_64-linux-gnu/libffi.so.7.1.0 2023-10-08T15:40:50.931 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:50.931 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root mem REG 8,1 163200 8942 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-10-08T15:40:50.931 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root mem REG 8,1 387768 8064 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-10-08T15:40:50.932 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:50.932 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:50.932 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.932 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.932 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.932 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root mem REG 8,1 709496 10741 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.28.0 2023-10-08T15:40:50.932 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root mem REG 8,1 1207920 9384 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.6400.6 2023-10-08T15:40:50.932 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root mem REG 8,1 387448 9388 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.6400.6 2023-10-08T15:40:50.932 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root mem REG 8,1 1957200 9382 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.6400.6 2023-10-08T15:40:50.932 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root mem REG 8,1 126472 12515 /usr/lib/x86_64-linux-gnu/libpolkit-gobject-1.so.0.0.0 2023-10-08T15:40:50.933 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root mem REG 8,1 393512 18183 /usr/lib/x86_64-linux-gnu/libpackagekit-glib2.so.18.1.3 2023-10-08T15:40:50.933 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root mem REG 8,1 1212216 11329 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-10-08T15:40:50.933 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root mem REG 8,1 18640 9386 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.6400.6 2023-10-08T15:40:50.933 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root mem REG 8,1 18696 13609 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-10-08T15:40:50.933 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root mem REG 8,1 27002 13665 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-10-08T15:40:50.933 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.933 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.933 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root 1u unix 0xffff8f3912257700 0t0 109975 type=STREAM 2023-10-08T15:40:50.933 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root 2u unix 0xffff8f3912257700 0t0 109975 type=STREAM 2023-10-08T15:40:50.934 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root 3u unix 0xffff8f390ff93fc0 0t0 109976 type=DGRAM 2023-10-08T15:40:50.934 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root 4u a_inode 0,14 0 13377 [eventfd] 2023-10-08T15:40:50.934 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root 5u netlink 0t0 109979 ROUTE 2023-10-08T15:40:50.934 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root 6u a_inode 0,14 0 13377 [eventfd] 2023-10-08T15:40:50.934 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root 7u unix 0xffff8f390ff93740 0t0 109980 type=STREAM 2023-10-08T15:40:50.934 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root 8u a_inode 0,14 0 13377 [eventfd] 2023-10-08T15:40:50.934 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root 9r a_inode 0,14 0 13377 inotify 2023-10-08T15:40:50.934 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 root 10u REG 8,1 32768 4950 /var/lib/PackageKit/transactions.db 2023-10-08T15:40:50.934 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.935 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.935 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root txt REG 8,1 289288 105910 /usr/lib/packagekit/packagekitd 2023-10-08T15:40:50.935 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root mem REG 8,1 28046896 10299 /usr/lib/x86_64-linux-gnu/libicudata.so.66.1 2023-10-08T15:40:50.935 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root mem REG 8,1 137784 15763 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.7 2023-10-08T15:40:50.935 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root mem REG 8,1 129096 10669 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.6 2023-10-08T15:40:50.935 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root mem REG 8,1 1575112 10736 /usr/lib/x86_64-linux-gnu/libunistring.so.2.1.0 2023-10-08T15:40:50.935 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root mem REG 8,1 56096 15015 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-10-08T15:40:50.935 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root mem REG 8,1 191040 15017 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-10-08T15:40:50.935 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root mem REG 8,1 902016 15021 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-10-08T15:40:50.935 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root mem REG 8,1 1976648 10310 /usr/lib/x86_64-linux-gnu/libicuuc.so.66.1 2023-10-08T15:40:50.936 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root mem REG 8,1 51512 15764 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.7 2023-10-08T15:40:50.936 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root mem REG 8,1 309712 15024 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-10-08T15:40:50.936 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root mem REG 8,1 178528 12765 /usr/lib/x86_64-linux-gnu/libudev.so.1.6.17 2023-10-08T15:40:50.936 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root mem REG 8,1 686160 8833 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.4 2023-10-08T15:40:50.936 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root mem REG 8,1 1799408 10319 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.10 2023-10-08T15:40:50.936 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root mem REG 8,1 22600 15019 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.8 2023-10-08T15:40:50.936 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root mem REG 8,1 71672 15241 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-10-08T15:40:50.936 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root mem REG 8,1 74848 8355 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-10-08T15:40:50.936 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root mem REG 8,1 334248 18469 /usr/lib/x86_64-linux-gnu/libstemmer.so.0d.0.0 2023-10-08T15:40:50.937 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root mem REG 8,1 133336 12518 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-10-08T15:40:50.937 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root mem REG 8,1 92304 15027 /usr/lib/x86_64-linux-gnu/liblmdb.so.0.0.0 2023-10-08T15:40:50.937 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root mem REG 8,1 633560 18427 /usr/lib/x86_64-linux-gnu/libsoup-2.4.so.1.9.0 2023-10-08T15:40:50.937 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root mem REG 8,1 1953248 10522 /usr/lib/x86_64-linux-gnu/libapt-pkg.so.6.0.0 2023-10-08T15:40:50.937 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root mem REG 8,1 1329768 18380 /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0.1603.0 2023-10-08T15:40:50.937 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root mem REG 8,1 393608 18471 /usr/lib/x86_64-linux-gnu/libappstream.so.0.12.10 2023-10-08T15:40:50.937 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root mem REG 8,1 403256 105914 /usr/lib/x86_64-linux-gnu/packagekit-backend/libpk_backend_aptcc.so 2023-10-08T15:40:50.937 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:50.937 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root mem REG 8,1 67656 101921 /usr/lib/x86_64-linux-gnu/gio/modules/libdconfsettings.so 2023-10-08T15:40:50.938 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root mem REG 8,1 104984 8251 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-10-08T15:40:50.938 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root mem REG 8,1 1956992 8082 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28 2023-10-08T15:40:50.938 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root mem REG 8,1 133640 18368 /usr/lib/x86_64-linux-gnu/libproxy.so.1.0.0 2023-10-08T15:40:50.938 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root mem REG 8,1 22600 9279 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-10-08T15:40:50.938 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root mem REG 8,1 14880 13415 /usr/lib/x86_64-linux-gnu/libutil-2.31.so 2023-10-08T15:40:50.938 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root mem REG 8,1 6017584 10873 /usr/lib/locale/locale-archive 2023-10-08T15:40:50.938 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root mem REG 8,1 137584 8109 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.28.0 2023-10-08T15:40:50.938 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root mem REG 8,1 584392 8917 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.9.0 2023-10-08T15:40:50.938 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root mem REG 8,1 351352 9401 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-10-08T15:40:50.939 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root mem REG 8,1 1168056 8360 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.2.5 2023-10-08T15:40:50.939 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root mem REG 8,1 129248 13039 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.2 2023-10-08T15:40:50.939 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:50.939 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:50.939 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root mem REG 8,1 465008 11338 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-10-08T15:40:50.939 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root mem REG 8,1 43416 10645 /usr/lib/x86_64-linux-gnu/libffi.so.7.1.0 2023-10-08T15:40:50.939 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:50.939 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root mem REG 8,1 163200 8942 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-10-08T15:40:50.939 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root mem REG 8,1 387768 8064 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-10-08T15:40:50.940 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:50.940 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:50.940 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.940 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.940 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.940 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root mem REG 8,1 709496 10741 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.28.0 2023-10-08T15:40:50.940 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root mem REG 8,1 1207920 9384 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.6400.6 2023-10-08T15:40:50.940 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root mem REG 8,1 387448 9388 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.6400.6 2023-10-08T15:40:50.940 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root mem REG 8,1 1957200 9382 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.6400.6 2023-10-08T15:40:50.941 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root mem REG 8,1 126472 12515 /usr/lib/x86_64-linux-gnu/libpolkit-gobject-1.so.0.0.0 2023-10-08T15:40:50.941 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root mem REG 8,1 393512 18183 /usr/lib/x86_64-linux-gnu/libpackagekit-glib2.so.18.1.3 2023-10-08T15:40:50.941 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root mem REG 8,1 1212216 11329 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-10-08T15:40:50.941 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root mem REG 8,1 18640 9386 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.6400.6 2023-10-08T15:40:50.941 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root mem REG 8,1 18696 13609 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-10-08T15:40:50.941 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root mem REG 8,1 27002 13665 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-10-08T15:40:50.941 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.941 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.941 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root 1u unix 0xffff8f3912257700 0t0 109975 type=STREAM 2023-10-08T15:40:50.942 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root 2u unix 0xffff8f3912257700 0t0 109975 type=STREAM 2023-10-08T15:40:50.942 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root 3u unix 0xffff8f390ff93fc0 0t0 109976 type=DGRAM 2023-10-08T15:40:50.942 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root 4u a_inode 0,14 0 13377 [eventfd] 2023-10-08T15:40:50.942 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root 5u netlink 0t0 109979 ROUTE 2023-10-08T15:40:50.942 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root 6u a_inode 0,14 0 13377 [eventfd] 2023-10-08T15:40:50.942 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root 7u unix 0xffff8f390ff93740 0t0 109980 type=STREAM 2023-10-08T15:40:50.942 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root 8u a_inode 0,14 0 13377 [eventfd] 2023-10-08T15:40:50.942 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root 9r a_inode 0,14 0 13377 inotify 2023-10-08T15:40:50.942 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13727 gmain root 10u REG 8,1 32768 4950 /var/lib/PackageKit/transactions.db 2023-10-08T15:40:50.943 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.943 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.943 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root txt REG 8,1 289288 105910 /usr/lib/packagekit/packagekitd 2023-10-08T15:40:50.943 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root mem REG 8,1 28046896 10299 /usr/lib/x86_64-linux-gnu/libicudata.so.66.1 2023-10-08T15:40:50.943 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root mem REG 8,1 137784 15763 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.7 2023-10-08T15:40:50.943 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root mem REG 8,1 129096 10669 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.6 2023-10-08T15:40:50.943 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root mem REG 8,1 1575112 10736 /usr/lib/x86_64-linux-gnu/libunistring.so.2.1.0 2023-10-08T15:40:50.943 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root mem REG 8,1 56096 15015 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-10-08T15:40:50.943 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root mem REG 8,1 191040 15017 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-10-08T15:40:50.944 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root mem REG 8,1 902016 15021 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-10-08T15:40:50.944 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root mem REG 8,1 1976648 10310 /usr/lib/x86_64-linux-gnu/libicuuc.so.66.1 2023-10-08T15:40:50.944 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root mem REG 8,1 51512 15764 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.7 2023-10-08T15:40:50.944 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root mem REG 8,1 309712 15024 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-10-08T15:40:50.944 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root mem REG 8,1 178528 12765 /usr/lib/x86_64-linux-gnu/libudev.so.1.6.17 2023-10-08T15:40:50.944 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root mem REG 8,1 686160 8833 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.4 2023-10-08T15:40:50.944 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root mem REG 8,1 1799408 10319 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.10 2023-10-08T15:40:50.944 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root mem REG 8,1 22600 15019 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.8 2023-10-08T15:40:50.944 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root mem REG 8,1 71672 15241 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-10-08T15:40:50.945 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root mem REG 8,1 74848 8355 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-10-08T15:40:50.945 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root mem REG 8,1 334248 18469 /usr/lib/x86_64-linux-gnu/libstemmer.so.0d.0.0 2023-10-08T15:40:50.945 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root mem REG 8,1 133336 12518 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-10-08T15:40:50.945 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root mem REG 8,1 92304 15027 /usr/lib/x86_64-linux-gnu/liblmdb.so.0.0.0 2023-10-08T15:40:50.945 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root mem REG 8,1 633560 18427 /usr/lib/x86_64-linux-gnu/libsoup-2.4.so.1.9.0 2023-10-08T15:40:50.945 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root mem REG 8,1 1953248 10522 /usr/lib/x86_64-linux-gnu/libapt-pkg.so.6.0.0 2023-10-08T15:40:50.945 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root mem REG 8,1 1329768 18380 /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0.1603.0 2023-10-08T15:40:50.945 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root mem REG 8,1 393608 18471 /usr/lib/x86_64-linux-gnu/libappstream.so.0.12.10 2023-10-08T15:40:50.945 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root mem REG 8,1 403256 105914 /usr/lib/x86_64-linux-gnu/packagekit-backend/libpk_backend_aptcc.so 2023-10-08T15:40:50.946 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:50.946 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root mem REG 8,1 67656 101921 /usr/lib/x86_64-linux-gnu/gio/modules/libdconfsettings.so 2023-10-08T15:40:50.946 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root mem REG 8,1 104984 8251 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-10-08T15:40:50.946 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root mem REG 8,1 1956992 8082 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28 2023-10-08T15:40:50.946 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root mem REG 8,1 133640 18368 /usr/lib/x86_64-linux-gnu/libproxy.so.1.0.0 2023-10-08T15:40:50.946 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root mem REG 8,1 22600 9279 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-10-08T15:40:50.946 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root mem REG 8,1 14880 13415 /usr/lib/x86_64-linux-gnu/libutil-2.31.so 2023-10-08T15:40:50.946 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root mem REG 8,1 6017584 10873 /usr/lib/locale/locale-archive 2023-10-08T15:40:50.946 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root mem REG 8,1 137584 8109 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.28.0 2023-10-08T15:40:50.946 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root mem REG 8,1 584392 8917 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.9.0 2023-10-08T15:40:50.947 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root mem REG 8,1 351352 9401 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-10-08T15:40:50.947 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root mem REG 8,1 1168056 8360 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.2.5 2023-10-08T15:40:50.947 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root mem REG 8,1 129248 13039 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.2 2023-10-08T15:40:50.947 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:50.947 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:50.947 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root mem REG 8,1 465008 11338 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-10-08T15:40:50.947 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root mem REG 8,1 43416 10645 /usr/lib/x86_64-linux-gnu/libffi.so.7.1.0 2023-10-08T15:40:50.947 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:50.947 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root mem REG 8,1 163200 8942 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-10-08T15:40:50.947 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root mem REG 8,1 387768 8064 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-10-08T15:40:50.947 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:50.948 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:50.948 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.948 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.948 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.948 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root mem REG 8,1 709496 10741 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.28.0 2023-10-08T15:40:50.948 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root mem REG 8,1 1207920 9384 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.6400.6 2023-10-08T15:40:50.948 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root mem REG 8,1 387448 9388 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.6400.6 2023-10-08T15:40:50.948 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root mem REG 8,1 1957200 9382 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.6400.6 2023-10-08T15:40:50.948 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root mem REG 8,1 126472 12515 /usr/lib/x86_64-linux-gnu/libpolkit-gobject-1.so.0.0.0 2023-10-08T15:40:50.948 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root mem REG 8,1 393512 18183 /usr/lib/x86_64-linux-gnu/libpackagekit-glib2.so.18.1.3 2023-10-08T15:40:50.948 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root mem REG 8,1 1212216 11329 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-10-08T15:40:50.949 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root mem REG 8,1 18640 9386 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.6400.6 2023-10-08T15:40:50.949 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root mem REG 8,1 18696 13609 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-10-08T15:40:50.949 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root mem REG 8,1 27002 13665 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-10-08T15:40:50.949 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.949 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.949 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root 1u unix 0xffff8f3912257700 0t0 109975 type=STREAM 2023-10-08T15:40:50.949 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root 2u unix 0xffff8f3912257700 0t0 109975 type=STREAM 2023-10-08T15:40:50.949 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root 3u unix 0xffff8f390ff93fc0 0t0 109976 type=DGRAM 2023-10-08T15:40:50.949 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root 4u a_inode 0,14 0 13377 [eventfd] 2023-10-08T15:40:50.949 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root 5u netlink 0t0 109979 ROUTE 2023-10-08T15:40:50.949 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root 6u a_inode 0,14 0 13377 [eventfd] 2023-10-08T15:40:50.950 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root 7u unix 0xffff8f390ff93740 0t0 109980 type=STREAM 2023-10-08T15:40:50.950 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root 8u a_inode 0,14 0 13377 [eventfd] 2023-10-08T15:40:50.950 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root 9r a_inode 0,14 0 13377 inotify 2023-10-08T15:40:50.950 INFO:teuthology.orchestra.run.smithi089.stdout:packageki 13720 13728 gdbus root 10u REG 8,1 32768 4950 /var/lib/PackageKit/transactions.db 2023-10-08T15:40:50.950 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/u 17501 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.950 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/u 17501 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.950 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/u 17501 root txt unknown /proc/17501/exe 2023-10-08T15:40:50.950 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/4 17538 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.950 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/4 17538 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.950 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/4 17538 root txt unknown /proc/17538/exe 2023-10-08T15:40:50.950 INFO:teuthology.orchestra.run.smithi089.stdout:kdmflush 17893 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.951 INFO:teuthology.orchestra.run.smithi089.stdout:kdmflush 17893 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.951 INFO:teuthology.orchestra.run.smithi089.stdout:kdmflush 17893 root txt unknown /proc/17893/exe 2023-10-08T15:40:50.951 INFO:teuthology.orchestra.run.smithi089.stdout:kdmflush 17924 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.951 INFO:teuthology.orchestra.run.smithi089.stdout:kdmflush 17924 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.951 INFO:teuthology.orchestra.run.smithi089.stdout:kdmflush 17924 root txt unknown /proc/17924/exe 2023-10-08T15:40:50.951 INFO:teuthology.orchestra.run.smithi089.stdout:kdmflush 17955 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.951 INFO:teuthology.orchestra.run.smithi089.stdout:kdmflush 17955 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.951 INFO:teuthology.orchestra.run.smithi089.stdout:kdmflush 17955 root txt unknown /proc/17955/exe 2023-10-08T15:40:50.951 INFO:teuthology.orchestra.run.smithi089.stdout:kdmflush 17986 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.951 INFO:teuthology.orchestra.run.smithi089.stdout:kdmflush 17986 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.951 INFO:teuthology.orchestra.run.smithi089.stdout:kdmflush 17986 root txt unknown /proc/17986/exe 2023-10-08T15:40:50.951 INFO:teuthology.orchestra.run.smithi089.stdout:kdmflush 18017 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.952 INFO:teuthology.orchestra.run.smithi089.stdout:kdmflush 18017 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.952 INFO:teuthology.orchestra.run.smithi089.stdout:kdmflush 18017 root txt unknown /proc/18017/exe 2023-10-08T15:40:50.952 INFO:teuthology.orchestra.run.smithi089.stdout:xfsalloc 18207 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.952 INFO:teuthology.orchestra.run.smithi089.stdout:xfsalloc 18207 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.952 INFO:teuthology.orchestra.run.smithi089.stdout:xfsalloc 18207 root txt unknown /proc/18207/exe 2023-10-08T15:40:50.952 INFO:teuthology.orchestra.run.smithi089.stdout:xfs_mru_c 18208 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.952 INFO:teuthology.orchestra.run.smithi089.stdout:xfs_mru_c 18208 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.952 INFO:teuthology.orchestra.run.smithi089.stdout:xfs_mru_c 18208 root txt unknown /proc/18208/exe 2023-10-08T15:40:50.952 INFO:teuthology.orchestra.run.smithi089.stdout:xfs-buf/d 18209 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.952 INFO:teuthology.orchestra.run.smithi089.stdout:xfs-buf/d 18209 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.952 INFO:teuthology.orchestra.run.smithi089.stdout:xfs-buf/d 18209 root txt unknown /proc/18209/exe 2023-10-08T15:40:50.953 INFO:teuthology.orchestra.run.smithi089.stdout:xfs-conv/ 18210 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.953 INFO:teuthology.orchestra.run.smithi089.stdout:xfs-conv/ 18210 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.953 INFO:teuthology.orchestra.run.smithi089.stdout:xfs-conv/ 18210 root txt unknown /proc/18210/exe 2023-10-08T15:40:50.953 INFO:teuthology.orchestra.run.smithi089.stdout:xfs-cil/d 18211 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.953 INFO:teuthology.orchestra.run.smithi089.stdout:xfs-cil/d 18211 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.953 INFO:teuthology.orchestra.run.smithi089.stdout:xfs-cil/d 18211 root txt unknown /proc/18211/exe 2023-10-08T15:40:50.953 INFO:teuthology.orchestra.run.smithi089.stdout:xfs-recla 18212 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.953 INFO:teuthology.orchestra.run.smithi089.stdout:xfs-recla 18212 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.953 INFO:teuthology.orchestra.run.smithi089.stdout:xfs-recla 18212 root txt unknown /proc/18212/exe 2023-10-08T15:40:50.953 INFO:teuthology.orchestra.run.smithi089.stdout:xfs-eofbl 18213 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.953 INFO:teuthology.orchestra.run.smithi089.stdout:xfs-eofbl 18213 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.953 INFO:teuthology.orchestra.run.smithi089.stdout:xfs-eofbl 18213 root txt unknown /proc/18213/exe 2023-10-08T15:40:50.954 INFO:teuthology.orchestra.run.smithi089.stdout:xfs-log/d 18214 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.954 INFO:teuthology.orchestra.run.smithi089.stdout:xfs-log/d 18214 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.954 INFO:teuthology.orchestra.run.smithi089.stdout:xfs-log/d 18214 root txt unknown /proc/18214/exe 2023-10-08T15:40:50.954 INFO:teuthology.orchestra.run.smithi089.stdout:xfsaild/d 18215 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.954 INFO:teuthology.orchestra.run.smithi089.stdout:xfsaild/d 18215 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.954 INFO:teuthology.orchestra.run.smithi089.stdout:xfsaild/d 18215 root txt unknown /proc/18215/exe 2023-10-08T15:40:50.954 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/5 21022 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.954 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/5 21022 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.954 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/5 21022 root txt unknown /proc/21022/exe 2023-10-08T15:40:50.954 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/6 21339 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.954 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/6 21339 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.954 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/6 21339 root txt unknown /proc/21339/exe 2023-10-08T15:40:50.955 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/6 21341 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.955 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/6 21341 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.955 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/6 21341 root txt unknown /proc/21341/exe 2023-10-08T15:40:50.955 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.955 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.955 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 root txt REG 8,1 83568776 25295 /usr/bin/dockerd 2023-10-08T15:40:50.955 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 root mem-W REG 8,1 16384 3416 /var/lib/docker/buildkit/history.db 2023-10-08T15:40:50.955 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 root mem-W REG 8,1 32768 5539 /var/lib/docker/buildkit/cache.db 2023-10-08T15:40:50.956 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 root mem-W REG 8,1 16384 5537 /var/lib/docker/buildkit/metadata_v2.db 2023-10-08T15:40:50.956 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 root mem REG 8,1 239896 8375 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-10-08T15:40:50.956 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 root mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:50.956 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 root mem-W REG 8,1 16384 5536 /var/lib/docker/buildkit/snapshots.db 2023-10-08T15:40:50.956 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 root mem-W REG 8,1 16384 5535 /var/lib/docker/buildkit/containerdmeta.db 2023-10-08T15:40:50.956 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 root mem REG 8,1 584392 8917 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.9.0 2023-10-08T15:40:50.956 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 root mem REG 8,1 137584 8109 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.28.0 2023-10-08T15:40:50.956 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:50.956 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 root mem REG 8,1 178528 12765 /usr/lib/x86_64-linux-gnu/libudev.so.1.6.17 2023-10-08T15:40:50.957 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 root mem REG 8,1 163200 8942 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-10-08T15:40:50.957 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 root mem REG 8,1 1168056 8360 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.2.5 2023-10-08T15:40:50.957 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 root mem REG 8,1 129248 13039 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.2 2023-10-08T15:40:50.957 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 root mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:50.957 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 root mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:50.957 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.957 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 root mem REG 8,1 431472 10641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-10-08T15:40:50.957 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.957 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 root mem REG 8,1 709496 10741 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.28.0 2023-10-08T15:40:50.957 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.958 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 root mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:50.958 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 root mem-W REG 8,1 32768 5514 /var/lib/docker/volumes/metadata.db 2023-10-08T15:40:50.958 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.958 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.958 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 root 1u unix 0xffff8f390dc24400 0t0 148115 type=STREAM 2023-10-08T15:40:50.958 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 root 2u unix 0xffff8f390dc24400 0t0 148115 type=STREAM 2023-10-08T15:40:50.958 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 root 3u unix 0xffff8f38c5591980 0t0 151776 /var/run/docker/metrics.sock type=STREAM 2023-10-08T15:40:50.958 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 root 4u unix 0xffff8f38c72c6a40 0t0 143260 /run/docker.sock type=STREAM 2023-10-08T15:40:50.958 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 root 5u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.959 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 root 6r FIFO 0,13 0t0 148118 pipe 2023-10-08T15:40:50.959 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 root 7w FIFO 0,13 0t0 148118 pipe 2023-10-08T15:40:50.959 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 root 8u unix 0xffff8f38c5530880 0t0 152765 type=STREAM 2023-10-08T15:40:50.959 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 root 9u unix 0xffff8f38df8cb740 0t0 148119 type=STREAM 2023-10-08T15:40:50.959 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 root 10uW REG 8,1 32768 5514 /var/lib/docker/volumes/metadata.db 2023-10-08T15:40:50.959 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 root 11r REG 0,4 0 4026532000 net 2023-10-08T15:40:50.959 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 root 12u netlink 0t0 146374 ROUTE 2023-10-08T15:40:50.959 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 root 13u netlink 0t0 146375 XFRM 2023-10-08T15:40:50.959 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 root 14u netlink 0t0 146376 NETFILTER 2023-10-08T15:40:50.959 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 root 15u unix 0xffff8f3911d9bb80 0t0 146421 /var/run/docker/libnetwork/016ab9653432.sock type=STREAM 2023-10-08T15:40:50.960 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 root 16uW REG 8,1 16384 5535 /var/lib/docker/buildkit/containerdmeta.db 2023-10-08T15:40:50.960 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 root 17uW REG 8,1 16384 5536 /var/lib/docker/buildkit/snapshots.db 2023-10-08T15:40:50.960 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 root 18uW REG 8,1 16384 5537 /var/lib/docker/buildkit/metadata_v2.db 2023-10-08T15:40:50.960 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 root 19uW REG 8,1 32768 5539 /var/lib/docker/buildkit/cache.db 2023-10-08T15:40:50.960 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 root 20uW REG 8,1 16384 3416 /var/lib/docker/buildkit/history.db 2023-10-08T15:40:50.960 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22635 dockerd root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.960 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22635 dockerd root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.960 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22635 dockerd root txt REG 8,1 83568776 25295 /usr/bin/dockerd 2023-10-08T15:40:50.960 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22635 dockerd root mem-W REG 8,1 16384 3416 /var/lib/docker/buildkit/history.db 2023-10-08T15:40:50.960 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22635 dockerd root mem-W REG 8,1 32768 5539 /var/lib/docker/buildkit/cache.db 2023-10-08T15:40:50.961 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22635 dockerd root mem-W REG 8,1 16384 5537 /var/lib/docker/buildkit/metadata_v2.db 2023-10-08T15:40:50.961 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22635 dockerd root mem REG 8,1 239896 8375 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-10-08T15:40:50.961 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22635 dockerd root mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:50.961 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22635 dockerd root mem-W REG 8,1 16384 5536 /var/lib/docker/buildkit/snapshots.db 2023-10-08T15:40:50.961 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22635 dockerd root mem-W REG 8,1 16384 5535 /var/lib/docker/buildkit/containerdmeta.db 2023-10-08T15:40:50.961 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22635 dockerd root mem REG 8,1 584392 8917 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.9.0 2023-10-08T15:40:50.961 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22635 dockerd root mem REG 8,1 137584 8109 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.28.0 2023-10-08T15:40:50.961 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22635 dockerd root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:50.961 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22635 dockerd root mem REG 8,1 178528 12765 /usr/lib/x86_64-linux-gnu/libudev.so.1.6.17 2023-10-08T15:40:50.962 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22635 dockerd root mem REG 8,1 163200 8942 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-10-08T15:40:50.962 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22635 dockerd root mem REG 8,1 1168056 8360 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.2.5 2023-10-08T15:40:50.962 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22635 dockerd root mem REG 8,1 129248 13039 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.2 2023-10-08T15:40:50.962 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22635 dockerd root mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:50.962 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22635 dockerd root mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:50.962 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22635 dockerd root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.962 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22635 dockerd root mem REG 8,1 431472 10641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-10-08T15:40:50.962 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22635 dockerd root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.962 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22635 dockerd root mem REG 8,1 709496 10741 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.28.0 2023-10-08T15:40:50.963 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22635 dockerd root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.963 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22635 dockerd root mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:50.963 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22635 dockerd root mem-W REG 8,1 32768 5514 /var/lib/docker/volumes/metadata.db 2023-10-08T15:40:50.963 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22635 dockerd root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.963 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22635 dockerd root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.963 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22635 dockerd root 1u unix 0xffff8f390dc24400 0t0 148115 type=STREAM 2023-10-08T15:40:50.963 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22635 dockerd root 2u unix 0xffff8f390dc24400 0t0 148115 type=STREAM 2023-10-08T15:40:50.963 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22635 dockerd root 3u unix 0xffff8f38c5591980 0t0 151776 /var/run/docker/metrics.sock type=STREAM 2023-10-08T15:40:50.963 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22635 dockerd root 4u unix 0xffff8f38c72c6a40 0t0 143260 /run/docker.sock type=STREAM 2023-10-08T15:40:50.963 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22635 dockerd root 5u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.964 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22635 dockerd root 6r FIFO 0,13 0t0 148118 pipe 2023-10-08T15:40:50.964 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22635 dockerd root 7w FIFO 0,13 0t0 148118 pipe 2023-10-08T15:40:50.964 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22635 dockerd root 8u unix 0xffff8f38c5530880 0t0 152765 type=STREAM 2023-10-08T15:40:50.964 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22635 dockerd root 9u unix 0xffff8f38df8cb740 0t0 148119 type=STREAM 2023-10-08T15:40:50.964 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22635 dockerd root 10uW REG 8,1 32768 5514 /var/lib/docker/volumes/metadata.db 2023-10-08T15:40:50.964 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22635 dockerd root 11r REG 0,4 0 4026532000 net 2023-10-08T15:40:50.964 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22635 dockerd root 12u netlink 0t0 146374 ROUTE 2023-10-08T15:40:50.964 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22635 dockerd root 13u netlink 0t0 146375 XFRM 2023-10-08T15:40:50.964 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22635 dockerd root 14u netlink 0t0 146376 NETFILTER 2023-10-08T15:40:50.965 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22635 dockerd root 15u unix 0xffff8f3911d9bb80 0t0 146421 /var/run/docker/libnetwork/016ab9653432.sock type=STREAM 2023-10-08T15:40:50.965 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22635 dockerd root 16uW REG 8,1 16384 5535 /var/lib/docker/buildkit/containerdmeta.db 2023-10-08T15:40:50.965 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22635 dockerd root 17uW REG 8,1 16384 5536 /var/lib/docker/buildkit/snapshots.db 2023-10-08T15:40:50.965 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22635 dockerd root 18uW REG 8,1 16384 5537 /var/lib/docker/buildkit/metadata_v2.db 2023-10-08T15:40:50.965 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22635 dockerd root 19uW REG 8,1 32768 5539 /var/lib/docker/buildkit/cache.db 2023-10-08T15:40:50.965 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22635 dockerd root 20uW REG 8,1 16384 3416 /var/lib/docker/buildkit/history.db 2023-10-08T15:40:50.965 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22636 dockerd root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.965 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22636 dockerd root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.965 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22636 dockerd root txt REG 8,1 83568776 25295 /usr/bin/dockerd 2023-10-08T15:40:50.965 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22636 dockerd root mem-W REG 8,1 16384 3416 /var/lib/docker/buildkit/history.db 2023-10-08T15:40:50.966 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22636 dockerd root mem-W REG 8,1 32768 5539 /var/lib/docker/buildkit/cache.db 2023-10-08T15:40:50.966 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22636 dockerd root mem-W REG 8,1 16384 5537 /var/lib/docker/buildkit/metadata_v2.db 2023-10-08T15:40:50.966 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22636 dockerd root mem REG 8,1 239896 8375 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-10-08T15:40:50.966 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22636 dockerd root mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:50.966 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22636 dockerd root mem-W REG 8,1 16384 5536 /var/lib/docker/buildkit/snapshots.db 2023-10-08T15:40:50.966 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22636 dockerd root mem-W REG 8,1 16384 5535 /var/lib/docker/buildkit/containerdmeta.db 2023-10-08T15:40:50.966 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22636 dockerd root mem REG 8,1 584392 8917 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.9.0 2023-10-08T15:40:50.966 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22636 dockerd root mem REG 8,1 137584 8109 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.28.0 2023-10-08T15:40:50.966 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22636 dockerd root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:50.966 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22636 dockerd root mem REG 8,1 178528 12765 /usr/lib/x86_64-linux-gnu/libudev.so.1.6.17 2023-10-08T15:40:50.967 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22636 dockerd root mem REG 8,1 163200 8942 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-10-08T15:40:50.967 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22636 dockerd root mem REG 8,1 1168056 8360 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.2.5 2023-10-08T15:40:50.967 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22636 dockerd root mem REG 8,1 129248 13039 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.2 2023-10-08T15:40:50.967 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22636 dockerd root mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:50.967 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22636 dockerd root mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:50.967 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22636 dockerd root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.967 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22636 dockerd root mem REG 8,1 431472 10641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-10-08T15:40:50.967 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22636 dockerd root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.967 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22636 dockerd root mem REG 8,1 709496 10741 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.28.0 2023-10-08T15:40:50.968 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22636 dockerd root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.968 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22636 dockerd root mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:50.968 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22636 dockerd root mem-W REG 8,1 32768 5514 /var/lib/docker/volumes/metadata.db 2023-10-08T15:40:50.968 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22636 dockerd root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.968 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22636 dockerd root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.968 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22636 dockerd root 1u unix 0xffff8f390dc24400 0t0 148115 type=STREAM 2023-10-08T15:40:50.968 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22636 dockerd root 2u unix 0xffff8f390dc24400 0t0 148115 type=STREAM 2023-10-08T15:40:50.968 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22636 dockerd root 3u unix 0xffff8f38c5591980 0t0 151776 /var/run/docker/metrics.sock type=STREAM 2023-10-08T15:40:50.968 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22636 dockerd root 4u unix 0xffff8f38c72c6a40 0t0 143260 /run/docker.sock type=STREAM 2023-10-08T15:40:50.968 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22636 dockerd root 5u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.969 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22636 dockerd root 6r FIFO 0,13 0t0 148118 pipe 2023-10-08T15:40:50.969 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22636 dockerd root 7w FIFO 0,13 0t0 148118 pipe 2023-10-08T15:40:50.969 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22636 dockerd root 8u unix 0xffff8f38c5530880 0t0 152765 type=STREAM 2023-10-08T15:40:50.969 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22636 dockerd root 9u unix 0xffff8f38df8cb740 0t0 148119 type=STREAM 2023-10-08T15:40:50.969 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22636 dockerd root 10uW REG 8,1 32768 5514 /var/lib/docker/volumes/metadata.db 2023-10-08T15:40:50.969 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22636 dockerd root 11r REG 0,4 0 4026532000 net 2023-10-08T15:40:50.969 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22636 dockerd root 12u netlink 0t0 146374 ROUTE 2023-10-08T15:40:50.969 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22636 dockerd root 13u netlink 0t0 146375 XFRM 2023-10-08T15:40:50.969 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22636 dockerd root 14u netlink 0t0 146376 NETFILTER 2023-10-08T15:40:50.969 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22636 dockerd root 15u unix 0xffff8f3911d9bb80 0t0 146421 /var/run/docker/libnetwork/016ab9653432.sock type=STREAM 2023-10-08T15:40:50.970 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22636 dockerd root 16uW REG 8,1 16384 5535 /var/lib/docker/buildkit/containerdmeta.db 2023-10-08T15:40:50.970 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22636 dockerd root 17uW REG 8,1 16384 5536 /var/lib/docker/buildkit/snapshots.db 2023-10-08T15:40:50.970 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22636 dockerd root 18uW REG 8,1 16384 5537 /var/lib/docker/buildkit/metadata_v2.db 2023-10-08T15:40:50.970 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22636 dockerd root 19uW REG 8,1 32768 5539 /var/lib/docker/buildkit/cache.db 2023-10-08T15:40:50.970 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22636 dockerd root 20uW REG 8,1 16384 3416 /var/lib/docker/buildkit/history.db 2023-10-08T15:40:50.970 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22637 dockerd root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.970 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22637 dockerd root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.970 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22637 dockerd root txt REG 8,1 83568776 25295 /usr/bin/dockerd 2023-10-08T15:40:50.970 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22637 dockerd root mem-W REG 8,1 16384 3416 /var/lib/docker/buildkit/history.db 2023-10-08T15:40:50.970 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22637 dockerd root mem-W REG 8,1 32768 5539 /var/lib/docker/buildkit/cache.db 2023-10-08T15:40:50.971 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22637 dockerd root mem-W REG 8,1 16384 5537 /var/lib/docker/buildkit/metadata_v2.db 2023-10-08T15:40:50.971 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22637 dockerd root mem REG 8,1 239896 8375 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-10-08T15:40:50.971 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22637 dockerd root mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:50.971 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22637 dockerd root mem-W REG 8,1 16384 5536 /var/lib/docker/buildkit/snapshots.db 2023-10-08T15:40:50.971 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22637 dockerd root mem-W REG 8,1 16384 5535 /var/lib/docker/buildkit/containerdmeta.db 2023-10-08T15:40:50.971 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22637 dockerd root mem REG 8,1 584392 8917 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.9.0 2023-10-08T15:40:50.971 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22637 dockerd root mem REG 8,1 137584 8109 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.28.0 2023-10-08T15:40:50.971 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22637 dockerd root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:50.971 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22637 dockerd root mem REG 8,1 178528 12765 /usr/lib/x86_64-linux-gnu/libudev.so.1.6.17 2023-10-08T15:40:50.971 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22637 dockerd root mem REG 8,1 163200 8942 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-10-08T15:40:50.972 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22637 dockerd root mem REG 8,1 1168056 8360 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.2.5 2023-10-08T15:40:50.972 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22637 dockerd root mem REG 8,1 129248 13039 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.2 2023-10-08T15:40:50.972 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22637 dockerd root mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:50.972 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22637 dockerd root mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:50.972 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22637 dockerd root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.972 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22637 dockerd root mem REG 8,1 431472 10641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-10-08T15:40:50.972 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22637 dockerd root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.972 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22637 dockerd root mem REG 8,1 709496 10741 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.28.0 2023-10-08T15:40:50.972 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22637 dockerd root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.973 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22637 dockerd root mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:50.973 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22637 dockerd root mem-W REG 8,1 32768 5514 /var/lib/docker/volumes/metadata.db 2023-10-08T15:40:50.973 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22637 dockerd root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.973 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22637 dockerd root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.973 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22637 dockerd root 1u unix 0xffff8f390dc24400 0t0 148115 type=STREAM 2023-10-08T15:40:50.973 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22637 dockerd root 2u unix 0xffff8f390dc24400 0t0 148115 type=STREAM 2023-10-08T15:40:50.973 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22637 dockerd root 3u unix 0xffff8f38c5591980 0t0 151776 /var/run/docker/metrics.sock type=STREAM 2023-10-08T15:40:50.973 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22637 dockerd root 4u unix 0xffff8f38c72c6a40 0t0 143260 /run/docker.sock type=STREAM 2023-10-08T15:40:50.973 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22637 dockerd root 5u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.973 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22637 dockerd root 6r FIFO 0,13 0t0 148118 pipe 2023-10-08T15:40:50.974 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22637 dockerd root 7w FIFO 0,13 0t0 148118 pipe 2023-10-08T15:40:50.974 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22637 dockerd root 8u unix 0xffff8f38c5530880 0t0 152765 type=STREAM 2023-10-08T15:40:50.974 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22637 dockerd root 9u unix 0xffff8f38df8cb740 0t0 148119 type=STREAM 2023-10-08T15:40:50.974 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22637 dockerd root 10uW REG 8,1 32768 5514 /var/lib/docker/volumes/metadata.db 2023-10-08T15:40:50.974 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22637 dockerd root 11r REG 0,4 0 4026532000 net 2023-10-08T15:40:50.974 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22637 dockerd root 12u netlink 0t0 146374 ROUTE 2023-10-08T15:40:50.974 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22637 dockerd root 13u netlink 0t0 146375 XFRM 2023-10-08T15:40:50.974 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22637 dockerd root 14u netlink 0t0 146376 NETFILTER 2023-10-08T15:40:50.974 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22637 dockerd root 15u unix 0xffff8f3911d9bb80 0t0 146421 /var/run/docker/libnetwork/016ab9653432.sock type=STREAM 2023-10-08T15:40:50.974 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22637 dockerd root 16uW REG 8,1 16384 5535 /var/lib/docker/buildkit/containerdmeta.db 2023-10-08T15:40:50.974 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22637 dockerd root 17uW REG 8,1 16384 5536 /var/lib/docker/buildkit/snapshots.db 2023-10-08T15:40:50.975 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22637 dockerd root 18uW REG 8,1 16384 5537 /var/lib/docker/buildkit/metadata_v2.db 2023-10-08T15:40:50.975 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22637 dockerd root 19uW REG 8,1 32768 5539 /var/lib/docker/buildkit/cache.db 2023-10-08T15:40:50.975 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22637 dockerd root 20uW REG 8,1 16384 3416 /var/lib/docker/buildkit/history.db 2023-10-08T15:40:50.975 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22638 dockerd root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.975 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22638 dockerd root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.975 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22638 dockerd root txt REG 8,1 83568776 25295 /usr/bin/dockerd 2023-10-08T15:40:50.975 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22638 dockerd root mem-W REG 8,1 16384 3416 /var/lib/docker/buildkit/history.db 2023-10-08T15:40:50.975 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22638 dockerd root mem-W REG 8,1 32768 5539 /var/lib/docker/buildkit/cache.db 2023-10-08T15:40:50.975 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22638 dockerd root mem-W REG 8,1 16384 5537 /var/lib/docker/buildkit/metadata_v2.db 2023-10-08T15:40:50.975 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22638 dockerd root mem REG 8,1 239896 8375 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-10-08T15:40:50.975 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22638 dockerd root mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:50.975 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22638 dockerd root mem-W REG 8,1 16384 5536 /var/lib/docker/buildkit/snapshots.db 2023-10-08T15:40:50.976 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22638 dockerd root mem-W REG 8,1 16384 5535 /var/lib/docker/buildkit/containerdmeta.db 2023-10-08T15:40:50.976 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22638 dockerd root mem REG 8,1 584392 8917 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.9.0 2023-10-08T15:40:50.976 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22638 dockerd root mem REG 8,1 137584 8109 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.28.0 2023-10-08T15:40:50.976 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22638 dockerd root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:50.976 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22638 dockerd root mem REG 8,1 178528 12765 /usr/lib/x86_64-linux-gnu/libudev.so.1.6.17 2023-10-08T15:40:50.976 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22638 dockerd root mem REG 8,1 163200 8942 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-10-08T15:40:50.976 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22638 dockerd root mem REG 8,1 1168056 8360 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.2.5 2023-10-08T15:40:50.976 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22638 dockerd root mem REG 8,1 129248 13039 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.2 2023-10-08T15:40:50.976 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22638 dockerd root mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:50.976 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22638 dockerd root mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:50.976 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22638 dockerd root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.976 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22638 dockerd root mem REG 8,1 431472 10641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-10-08T15:40:50.977 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22638 dockerd root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.977 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22638 dockerd root mem REG 8,1 709496 10741 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.28.0 2023-10-08T15:40:50.977 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22638 dockerd root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.977 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22638 dockerd root mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:50.977 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22638 dockerd root mem-W REG 8,1 32768 5514 /var/lib/docker/volumes/metadata.db 2023-10-08T15:40:50.977 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22638 dockerd root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.977 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22638 dockerd root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.977 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22638 dockerd root 1u unix 0xffff8f390dc24400 0t0 148115 type=STREAM 2023-10-08T15:40:50.977 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22638 dockerd root 2u unix 0xffff8f390dc24400 0t0 148115 type=STREAM 2023-10-08T15:40:50.977 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22638 dockerd root 3u unix 0xffff8f38c5591980 0t0 151776 /var/run/docker/metrics.sock type=STREAM 2023-10-08T15:40:50.977 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22638 dockerd root 4u unix 0xffff8f38c72c6a40 0t0 143260 /run/docker.sock type=STREAM 2023-10-08T15:40:50.978 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22638 dockerd root 5u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.978 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22638 dockerd root 6r FIFO 0,13 0t0 148118 pipe 2023-10-08T15:40:50.978 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22638 dockerd root 7w FIFO 0,13 0t0 148118 pipe 2023-10-08T15:40:50.978 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22638 dockerd root 8u unix 0xffff8f38c5530880 0t0 152765 type=STREAM 2023-10-08T15:40:50.978 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22638 dockerd root 9u unix 0xffff8f38df8cb740 0t0 148119 type=STREAM 2023-10-08T15:40:50.978 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22638 dockerd root 10uW REG 8,1 32768 5514 /var/lib/docker/volumes/metadata.db 2023-10-08T15:40:50.978 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22638 dockerd root 11r REG 0,4 0 4026532000 net 2023-10-08T15:40:50.978 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22638 dockerd root 12u netlink 0t0 146374 ROUTE 2023-10-08T15:40:50.978 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22638 dockerd root 13u netlink 0t0 146375 XFRM 2023-10-08T15:40:50.978 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22638 dockerd root 14u netlink 0t0 146376 NETFILTER 2023-10-08T15:40:50.978 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22638 dockerd root 15u unix 0xffff8f3911d9bb80 0t0 146421 /var/run/docker/libnetwork/016ab9653432.sock type=STREAM 2023-10-08T15:40:50.979 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22638 dockerd root 16uW REG 8,1 16384 5535 /var/lib/docker/buildkit/containerdmeta.db 2023-10-08T15:40:50.979 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22638 dockerd root 17uW REG 8,1 16384 5536 /var/lib/docker/buildkit/snapshots.db 2023-10-08T15:40:50.979 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22638 dockerd root 18uW REG 8,1 16384 5537 /var/lib/docker/buildkit/metadata_v2.db 2023-10-08T15:40:50.979 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22638 dockerd root 19uW REG 8,1 32768 5539 /var/lib/docker/buildkit/cache.db 2023-10-08T15:40:50.979 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22638 dockerd root 20uW REG 8,1 16384 3416 /var/lib/docker/buildkit/history.db 2023-10-08T15:40:50.979 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22639 dockerd root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.979 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22639 dockerd root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.979 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22639 dockerd root txt REG 8,1 83568776 25295 /usr/bin/dockerd 2023-10-08T15:40:50.979 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22639 dockerd root mem-W REG 8,1 16384 3416 /var/lib/docker/buildkit/history.db 2023-10-08T15:40:50.979 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22639 dockerd root mem-W REG 8,1 32768 5539 /var/lib/docker/buildkit/cache.db 2023-10-08T15:40:50.979 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22639 dockerd root mem-W REG 8,1 16384 5537 /var/lib/docker/buildkit/metadata_v2.db 2023-10-08T15:40:50.979 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22639 dockerd root mem REG 8,1 239896 8375 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-10-08T15:40:50.980 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22639 dockerd root mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:50.980 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22639 dockerd root mem-W REG 8,1 16384 5536 /var/lib/docker/buildkit/snapshots.db 2023-10-08T15:40:50.980 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22639 dockerd root mem-W REG 8,1 16384 5535 /var/lib/docker/buildkit/containerdmeta.db 2023-10-08T15:40:50.980 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22639 dockerd root mem REG 8,1 584392 8917 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.9.0 2023-10-08T15:40:50.980 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22639 dockerd root mem REG 8,1 137584 8109 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.28.0 2023-10-08T15:40:50.980 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22639 dockerd root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:50.980 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22639 dockerd root mem REG 8,1 178528 12765 /usr/lib/x86_64-linux-gnu/libudev.so.1.6.17 2023-10-08T15:40:50.980 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22639 dockerd root mem REG 8,1 163200 8942 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-10-08T15:40:50.980 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22639 dockerd root mem REG 8,1 1168056 8360 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.2.5 2023-10-08T15:40:50.980 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22639 dockerd root mem REG 8,1 129248 13039 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.2 2023-10-08T15:40:50.980 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22639 dockerd root mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:50.980 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22639 dockerd root mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:50.981 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22639 dockerd root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.981 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22639 dockerd root mem REG 8,1 431472 10641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-10-08T15:40:50.981 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22639 dockerd root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.981 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22639 dockerd root mem REG 8,1 709496 10741 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.28.0 2023-10-08T15:40:50.981 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22639 dockerd root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.981 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22639 dockerd root mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:50.981 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22639 dockerd root mem-W REG 8,1 32768 5514 /var/lib/docker/volumes/metadata.db 2023-10-08T15:40:50.981 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22639 dockerd root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.981 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22639 dockerd root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.981 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22639 dockerd root 1u unix 0xffff8f390dc24400 0t0 148115 type=STREAM 2023-10-08T15:40:50.981 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22639 dockerd root 2u unix 0xffff8f390dc24400 0t0 148115 type=STREAM 2023-10-08T15:40:50.982 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22639 dockerd root 3u unix 0xffff8f38c5591980 0t0 151776 /var/run/docker/metrics.sock type=STREAM 2023-10-08T15:40:50.982 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22639 dockerd root 4u unix 0xffff8f38c72c6a40 0t0 143260 /run/docker.sock type=STREAM 2023-10-08T15:40:50.982 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22639 dockerd root 5u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.982 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22639 dockerd root 6r FIFO 0,13 0t0 148118 pipe 2023-10-08T15:40:50.982 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22639 dockerd root 7w FIFO 0,13 0t0 148118 pipe 2023-10-08T15:40:50.982 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22639 dockerd root 8u unix 0xffff8f38c5530880 0t0 152765 type=STREAM 2023-10-08T15:40:50.982 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22639 dockerd root 9u unix 0xffff8f38df8cb740 0t0 148119 type=STREAM 2023-10-08T15:40:50.982 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22639 dockerd root 10uW REG 8,1 32768 5514 /var/lib/docker/volumes/metadata.db 2023-10-08T15:40:50.982 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22639 dockerd root 11r REG 0,4 0 4026532000 net 2023-10-08T15:40:50.982 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22639 dockerd root 12u netlink 0t0 146374 ROUTE 2023-10-08T15:40:50.982 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22639 dockerd root 13u netlink 0t0 146375 XFRM 2023-10-08T15:40:50.983 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22639 dockerd root 14u netlink 0t0 146376 NETFILTER 2023-10-08T15:40:50.983 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22639 dockerd root 15u unix 0xffff8f3911d9bb80 0t0 146421 /var/run/docker/libnetwork/016ab9653432.sock type=STREAM 2023-10-08T15:40:50.983 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22639 dockerd root 16uW REG 8,1 16384 5535 /var/lib/docker/buildkit/containerdmeta.db 2023-10-08T15:40:50.983 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22639 dockerd root 17uW REG 8,1 16384 5536 /var/lib/docker/buildkit/snapshots.db 2023-10-08T15:40:50.983 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22639 dockerd root 18uW REG 8,1 16384 5537 /var/lib/docker/buildkit/metadata_v2.db 2023-10-08T15:40:50.983 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22639 dockerd root 19uW REG 8,1 32768 5539 /var/lib/docker/buildkit/cache.db 2023-10-08T15:40:50.983 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22639 dockerd root 20uW REG 8,1 16384 3416 /var/lib/docker/buildkit/history.db 2023-10-08T15:40:50.983 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22640 dockerd root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.983 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22640 dockerd root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.984 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22640 dockerd root txt REG 8,1 83568776 25295 /usr/bin/dockerd 2023-10-08T15:40:50.984 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22640 dockerd root mem-W REG 8,1 16384 3416 /var/lib/docker/buildkit/history.db 2023-10-08T15:40:50.984 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22640 dockerd root mem-W REG 8,1 32768 5539 /var/lib/docker/buildkit/cache.db 2023-10-08T15:40:50.984 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22640 dockerd root mem-W REG 8,1 16384 5537 /var/lib/docker/buildkit/metadata_v2.db 2023-10-08T15:40:50.984 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22640 dockerd root mem REG 8,1 239896 8375 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-10-08T15:40:50.984 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22640 dockerd root mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:50.984 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22640 dockerd root mem-W REG 8,1 16384 5536 /var/lib/docker/buildkit/snapshots.db 2023-10-08T15:40:50.984 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22640 dockerd root mem-W REG 8,1 16384 5535 /var/lib/docker/buildkit/containerdmeta.db 2023-10-08T15:40:50.984 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22640 dockerd root mem REG 8,1 584392 8917 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.9.0 2023-10-08T15:40:50.984 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22640 dockerd root mem REG 8,1 137584 8109 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.28.0 2023-10-08T15:40:50.984 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22640 dockerd root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:50.985 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22640 dockerd root mem REG 8,1 178528 12765 /usr/lib/x86_64-linux-gnu/libudev.so.1.6.17 2023-10-08T15:40:50.985 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22640 dockerd root mem REG 8,1 163200 8942 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-10-08T15:40:50.985 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22640 dockerd root mem REG 8,1 1168056 8360 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.2.5 2023-10-08T15:40:50.985 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22640 dockerd root mem REG 8,1 129248 13039 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.2 2023-10-08T15:40:50.985 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22640 dockerd root mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:50.985 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22640 dockerd root mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:50.985 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22640 dockerd root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.985 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22640 dockerd root mem REG 8,1 431472 10641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-10-08T15:40:50.985 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22640 dockerd root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.986 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22640 dockerd root mem REG 8,1 709496 10741 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.28.0 2023-10-08T15:40:50.986 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22640 dockerd root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.986 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22640 dockerd root mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:50.986 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22640 dockerd root mem-W REG 8,1 32768 5514 /var/lib/docker/volumes/metadata.db 2023-10-08T15:40:50.986 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22640 dockerd root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.986 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22640 dockerd root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.986 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22640 dockerd root 1u unix 0xffff8f390dc24400 0t0 148115 type=STREAM 2023-10-08T15:40:50.986 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22640 dockerd root 2u unix 0xffff8f390dc24400 0t0 148115 type=STREAM 2023-10-08T15:40:50.986 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22640 dockerd root 3u unix 0xffff8f38c5591980 0t0 151776 /var/run/docker/metrics.sock type=STREAM 2023-10-08T15:40:50.987 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22640 dockerd root 4u unix 0xffff8f38c72c6a40 0t0 143260 /run/docker.sock type=STREAM 2023-10-08T15:40:50.987 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22640 dockerd root 5u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.987 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22640 dockerd root 6r FIFO 0,13 0t0 148118 pipe 2023-10-08T15:40:50.987 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22640 dockerd root 7w FIFO 0,13 0t0 148118 pipe 2023-10-08T15:40:50.987 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22640 dockerd root 8u unix 0xffff8f38c5530880 0t0 152765 type=STREAM 2023-10-08T15:40:50.987 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22640 dockerd root 9u unix 0xffff8f38df8cb740 0t0 148119 type=STREAM 2023-10-08T15:40:50.987 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22640 dockerd root 10uW REG 8,1 32768 5514 /var/lib/docker/volumes/metadata.db 2023-10-08T15:40:50.987 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22640 dockerd root 11r REG 0,4 0 4026532000 net 2023-10-08T15:40:50.987 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22640 dockerd root 12u netlink 0t0 146374 ROUTE 2023-10-08T15:40:50.987 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22640 dockerd root 13u netlink 0t0 146375 XFRM 2023-10-08T15:40:50.988 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22640 dockerd root 14u netlink 0t0 146376 NETFILTER 2023-10-08T15:40:50.988 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22640 dockerd root 15u unix 0xffff8f3911d9bb80 0t0 146421 /var/run/docker/libnetwork/016ab9653432.sock type=STREAM 2023-10-08T15:40:50.988 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22640 dockerd root 16uW REG 8,1 16384 5535 /var/lib/docker/buildkit/containerdmeta.db 2023-10-08T15:40:50.988 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22640 dockerd root 17uW REG 8,1 16384 5536 /var/lib/docker/buildkit/snapshots.db 2023-10-08T15:40:50.988 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22640 dockerd root 18uW REG 8,1 16384 5537 /var/lib/docker/buildkit/metadata_v2.db 2023-10-08T15:40:50.988 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22640 dockerd root 19uW REG 8,1 32768 5539 /var/lib/docker/buildkit/cache.db 2023-10-08T15:40:50.988 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22640 dockerd root 20uW REG 8,1 16384 3416 /var/lib/docker/buildkit/history.db 2023-10-08T15:40:50.988 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22641 dockerd root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.988 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22641 dockerd root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.989 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22641 dockerd root txt REG 8,1 83568776 25295 /usr/bin/dockerd 2023-10-08T15:40:50.989 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22641 dockerd root mem-W REG 8,1 16384 3416 /var/lib/docker/buildkit/history.db 2023-10-08T15:40:50.989 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22641 dockerd root mem-W REG 8,1 32768 5539 /var/lib/docker/buildkit/cache.db 2023-10-08T15:40:50.989 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22641 dockerd root mem-W REG 8,1 16384 5537 /var/lib/docker/buildkit/metadata_v2.db 2023-10-08T15:40:50.989 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22641 dockerd root mem REG 8,1 239896 8375 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-10-08T15:40:50.989 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22641 dockerd root mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:50.989 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22641 dockerd root mem-W REG 8,1 16384 5536 /var/lib/docker/buildkit/snapshots.db 2023-10-08T15:40:50.989 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22641 dockerd root mem-W REG 8,1 16384 5535 /var/lib/docker/buildkit/containerdmeta.db 2023-10-08T15:40:50.989 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22641 dockerd root mem REG 8,1 584392 8917 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.9.0 2023-10-08T15:40:50.990 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22641 dockerd root mem REG 8,1 137584 8109 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.28.0 2023-10-08T15:40:50.990 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22641 dockerd root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:50.990 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22641 dockerd root mem REG 8,1 178528 12765 /usr/lib/x86_64-linux-gnu/libudev.so.1.6.17 2023-10-08T15:40:50.990 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22641 dockerd root mem REG 8,1 163200 8942 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-10-08T15:40:50.990 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22641 dockerd root mem REG 8,1 1168056 8360 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.2.5 2023-10-08T15:40:50.990 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22641 dockerd root mem REG 8,1 129248 13039 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.2 2023-10-08T15:40:50.990 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22641 dockerd root mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:50.990 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22641 dockerd root mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:50.990 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22641 dockerd root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.990 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22641 dockerd root mem REG 8,1 431472 10641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-10-08T15:40:50.990 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22641 dockerd root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.991 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22641 dockerd root mem REG 8,1 709496 10741 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.28.0 2023-10-08T15:40:50.991 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22641 dockerd root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.991 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22641 dockerd root mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:50.991 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22641 dockerd root mem-W REG 8,1 32768 5514 /var/lib/docker/volumes/metadata.db 2023-10-08T15:40:50.991 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22641 dockerd root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.991 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22641 dockerd root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.991 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22641 dockerd root 1u unix 0xffff8f390dc24400 0t0 148115 type=STREAM 2023-10-08T15:40:50.991 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22641 dockerd root 2u unix 0xffff8f390dc24400 0t0 148115 type=STREAM 2023-10-08T15:40:50.991 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22641 dockerd root 3u unix 0xffff8f38c5591980 0t0 151776 /var/run/docker/metrics.sock type=STREAM 2023-10-08T15:40:50.991 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22641 dockerd root 4u unix 0xffff8f38c72c6a40 0t0 143260 /run/docker.sock type=STREAM 2023-10-08T15:40:50.992 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22641 dockerd root 5u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.992 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22641 dockerd root 6r FIFO 0,13 0t0 148118 pipe 2023-10-08T15:40:50.992 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22641 dockerd root 7w FIFO 0,13 0t0 148118 pipe 2023-10-08T15:40:50.992 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22641 dockerd root 8u unix 0xffff8f38c5530880 0t0 152765 type=STREAM 2023-10-08T15:40:50.992 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22641 dockerd root 9u unix 0xffff8f38df8cb740 0t0 148119 type=STREAM 2023-10-08T15:40:50.992 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22641 dockerd root 10uW REG 8,1 32768 5514 /var/lib/docker/volumes/metadata.db 2023-10-08T15:40:50.992 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22641 dockerd root 11r REG 0,4 0 4026532000 net 2023-10-08T15:40:50.992 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22641 dockerd root 12u netlink 0t0 146374 ROUTE 2023-10-08T15:40:50.992 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22641 dockerd root 13u netlink 0t0 146375 XFRM 2023-10-08T15:40:50.992 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22641 dockerd root 14u netlink 0t0 146376 NETFILTER 2023-10-08T15:40:50.992 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22641 dockerd root 15u unix 0xffff8f3911d9bb80 0t0 146421 /var/run/docker/libnetwork/016ab9653432.sock type=STREAM 2023-10-08T15:40:50.993 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22641 dockerd root 16uW REG 8,1 16384 5535 /var/lib/docker/buildkit/containerdmeta.db 2023-10-08T15:40:50.993 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22641 dockerd root 17uW REG 8,1 16384 5536 /var/lib/docker/buildkit/snapshots.db 2023-10-08T15:40:50.993 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22641 dockerd root 18uW REG 8,1 16384 5537 /var/lib/docker/buildkit/metadata_v2.db 2023-10-08T15:40:50.993 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22641 dockerd root 19uW REG 8,1 32768 5539 /var/lib/docker/buildkit/cache.db 2023-10-08T15:40:50.993 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22641 dockerd root 20uW REG 8,1 16384 3416 /var/lib/docker/buildkit/history.db 2023-10-08T15:40:50.993 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22642 dockerd root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.993 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22642 dockerd root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.993 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22642 dockerd root txt REG 8,1 83568776 25295 /usr/bin/dockerd 2023-10-08T15:40:50.993 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22642 dockerd root mem-W REG 8,1 16384 3416 /var/lib/docker/buildkit/history.db 2023-10-08T15:40:50.994 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22642 dockerd root mem-W REG 8,1 32768 5539 /var/lib/docker/buildkit/cache.db 2023-10-08T15:40:50.994 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22642 dockerd root mem-W REG 8,1 16384 5537 /var/lib/docker/buildkit/metadata_v2.db 2023-10-08T15:40:50.994 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22642 dockerd root mem REG 8,1 239896 8375 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-10-08T15:40:50.994 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22642 dockerd root mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:50.994 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22642 dockerd root mem-W REG 8,1 16384 5536 /var/lib/docker/buildkit/snapshots.db 2023-10-08T15:40:50.994 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22642 dockerd root mem-W REG 8,1 16384 5535 /var/lib/docker/buildkit/containerdmeta.db 2023-10-08T15:40:50.994 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22642 dockerd root mem REG 8,1 584392 8917 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.9.0 2023-10-08T15:40:50.994 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22642 dockerd root mem REG 8,1 137584 8109 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.28.0 2023-10-08T15:40:50.994 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22642 dockerd root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:50.995 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22642 dockerd root mem REG 8,1 178528 12765 /usr/lib/x86_64-linux-gnu/libudev.so.1.6.17 2023-10-08T15:40:50.995 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22642 dockerd root mem REG 8,1 163200 8942 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-10-08T15:40:50.995 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22642 dockerd root mem REG 8,1 1168056 8360 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.2.5 2023-10-08T15:40:50.995 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22642 dockerd root mem REG 8,1 129248 13039 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.2 2023-10-08T15:40:50.995 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22642 dockerd root mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:50.995 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22642 dockerd root mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:50.995 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22642 dockerd root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:50.995 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22642 dockerd root mem REG 8,1 431472 10641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-10-08T15:40:50.995 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22642 dockerd root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:50.995 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22642 dockerd root mem REG 8,1 709496 10741 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.28.0 2023-10-08T15:40:50.996 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22642 dockerd root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:50.996 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22642 dockerd root mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:50.996 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22642 dockerd root mem-W REG 8,1 32768 5514 /var/lib/docker/volumes/metadata.db 2023-10-08T15:40:50.996 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22642 dockerd root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:50.996 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22642 dockerd root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:50.996 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22642 dockerd root 1u unix 0xffff8f390dc24400 0t0 148115 type=STREAM 2023-10-08T15:40:50.996 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22642 dockerd root 2u unix 0xffff8f390dc24400 0t0 148115 type=STREAM 2023-10-08T15:40:50.996 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22642 dockerd root 3u unix 0xffff8f38c5591980 0t0 151776 /var/run/docker/metrics.sock type=STREAM 2023-10-08T15:40:50.996 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22642 dockerd root 4u unix 0xffff8f38c72c6a40 0t0 143260 /run/docker.sock type=STREAM 2023-10-08T15:40:50.996 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22642 dockerd root 5u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:50.997 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22642 dockerd root 6r FIFO 0,13 0t0 148118 pipe 2023-10-08T15:40:50.997 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22642 dockerd root 7w FIFO 0,13 0t0 148118 pipe 2023-10-08T15:40:50.997 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22642 dockerd root 8u unix 0xffff8f38c5530880 0t0 152765 type=STREAM 2023-10-08T15:40:50.997 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22642 dockerd root 9u unix 0xffff8f38df8cb740 0t0 148119 type=STREAM 2023-10-08T15:40:50.997 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22642 dockerd root 10uW REG 8,1 32768 5514 /var/lib/docker/volumes/metadata.db 2023-10-08T15:40:50.997 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22642 dockerd root 11r REG 0,4 0 4026532000 net 2023-10-08T15:40:50.997 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22642 dockerd root 12u netlink 0t0 146374 ROUTE 2023-10-08T15:40:50.997 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22642 dockerd root 13u netlink 0t0 146375 XFRM 2023-10-08T15:40:50.997 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22642 dockerd root 14u netlink 0t0 146376 NETFILTER 2023-10-08T15:40:50.998 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22642 dockerd root 15u unix 0xffff8f3911d9bb80 0t0 146421 /var/run/docker/libnetwork/016ab9653432.sock type=STREAM 2023-10-08T15:40:50.998 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22642 dockerd root 16uW REG 8,1 16384 5535 /var/lib/docker/buildkit/containerdmeta.db 2023-10-08T15:40:50.998 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22642 dockerd root 17uW REG 8,1 16384 5536 /var/lib/docker/buildkit/snapshots.db 2023-10-08T15:40:50.998 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22642 dockerd root 18uW REG 8,1 16384 5537 /var/lib/docker/buildkit/metadata_v2.db 2023-10-08T15:40:50.998 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22642 dockerd root 19uW REG 8,1 32768 5539 /var/lib/docker/buildkit/cache.db 2023-10-08T15:40:50.998 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22642 dockerd root 20uW REG 8,1 16384 3416 /var/lib/docker/buildkit/history.db 2023-10-08T15:40:50.998 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22643 dockerd root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:50.998 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22643 dockerd root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:50.998 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22643 dockerd root txt REG 8,1 83568776 25295 /usr/bin/dockerd 2023-10-08T15:40:50.998 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22643 dockerd root mem-W REG 8,1 16384 3416 /var/lib/docker/buildkit/history.db 2023-10-08T15:40:50.999 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22643 dockerd root mem-W REG 8,1 32768 5539 /var/lib/docker/buildkit/cache.db 2023-10-08T15:40:50.999 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22643 dockerd root mem-W REG 8,1 16384 5537 /var/lib/docker/buildkit/metadata_v2.db 2023-10-08T15:40:50.999 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22643 dockerd root mem REG 8,1 239896 8375 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-10-08T15:40:50.999 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22643 dockerd root mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:50.999 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22643 dockerd root mem-W REG 8,1 16384 5536 /var/lib/docker/buildkit/snapshots.db 2023-10-08T15:40:50.999 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22643 dockerd root mem-W REG 8,1 16384 5535 /var/lib/docker/buildkit/containerdmeta.db 2023-10-08T15:40:50.999 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22643 dockerd root mem REG 8,1 584392 8917 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.9.0 2023-10-08T15:40:50.999 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22643 dockerd root mem REG 8,1 137584 8109 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.28.0 2023-10-08T15:40:51.000 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22643 dockerd root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:51.000 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22643 dockerd root mem REG 8,1 178528 12765 /usr/lib/x86_64-linux-gnu/libudev.so.1.6.17 2023-10-08T15:40:51.000 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22643 dockerd root mem REG 8,1 163200 8942 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-10-08T15:40:51.000 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22643 dockerd root mem REG 8,1 1168056 8360 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.2.5 2023-10-08T15:40:51.000 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22643 dockerd root mem REG 8,1 129248 13039 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.2 2023-10-08T15:40:51.000 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22643 dockerd root mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:51.000 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22643 dockerd root mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:51.000 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22643 dockerd root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:51.000 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22643 dockerd root mem REG 8,1 431472 10641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-10-08T15:40:51.000 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22643 dockerd root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:51.001 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22643 dockerd root mem REG 8,1 709496 10741 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.28.0 2023-10-08T15:40:51.001 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22643 dockerd root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:51.001 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22643 dockerd root mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:51.001 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22643 dockerd root mem-W REG 8,1 32768 5514 /var/lib/docker/volumes/metadata.db 2023-10-08T15:40:51.001 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22643 dockerd root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:51.001 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22643 dockerd root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:51.001 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22643 dockerd root 1u unix 0xffff8f390dc24400 0t0 148115 type=STREAM 2023-10-08T15:40:51.001 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22643 dockerd root 2u unix 0xffff8f390dc24400 0t0 148115 type=STREAM 2023-10-08T15:40:51.001 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22643 dockerd root 3u unix 0xffff8f38c5591980 0t0 151776 /var/run/docker/metrics.sock type=STREAM 2023-10-08T15:40:51.002 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22643 dockerd root 4u unix 0xffff8f38c72c6a40 0t0 143260 /run/docker.sock type=STREAM 2023-10-08T15:40:51.002 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22643 dockerd root 5u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.002 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22643 dockerd root 6r FIFO 0,13 0t0 148118 pipe 2023-10-08T15:40:51.002 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22643 dockerd root 7w FIFO 0,13 0t0 148118 pipe 2023-10-08T15:40:51.002 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22643 dockerd root 8u unix 0xffff8f38c5530880 0t0 152765 type=STREAM 2023-10-08T15:40:51.002 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22643 dockerd root 9u unix 0xffff8f38df8cb740 0t0 148119 type=STREAM 2023-10-08T15:40:51.002 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22643 dockerd root 10uW REG 8,1 32768 5514 /var/lib/docker/volumes/metadata.db 2023-10-08T15:40:51.002 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22643 dockerd root 11r REG 0,4 0 4026532000 net 2023-10-08T15:40:51.002 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22643 dockerd root 12u netlink 0t0 146374 ROUTE 2023-10-08T15:40:51.003 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22643 dockerd root 13u netlink 0t0 146375 XFRM 2023-10-08T15:40:51.003 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22643 dockerd root 14u netlink 0t0 146376 NETFILTER 2023-10-08T15:40:51.003 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22643 dockerd root 15u unix 0xffff8f3911d9bb80 0t0 146421 /var/run/docker/libnetwork/016ab9653432.sock type=STREAM 2023-10-08T15:40:51.003 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22643 dockerd root 16uW REG 8,1 16384 5535 /var/lib/docker/buildkit/containerdmeta.db 2023-10-08T15:40:51.003 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22643 dockerd root 17uW REG 8,1 16384 5536 /var/lib/docker/buildkit/snapshots.db 2023-10-08T15:40:51.003 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22643 dockerd root 18uW REG 8,1 16384 5537 /var/lib/docker/buildkit/metadata_v2.db 2023-10-08T15:40:51.003 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22643 dockerd root 19uW REG 8,1 32768 5539 /var/lib/docker/buildkit/cache.db 2023-10-08T15:40:51.003 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22643 dockerd root 20uW REG 8,1 16384 3416 /var/lib/docker/buildkit/history.db 2023-10-08T15:40:51.003 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22644 dockerd root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:51.003 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22644 dockerd root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:51.004 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22644 dockerd root txt REG 8,1 83568776 25295 /usr/bin/dockerd 2023-10-08T15:40:51.004 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22644 dockerd root mem-W REG 8,1 16384 3416 /var/lib/docker/buildkit/history.db 2023-10-08T15:40:51.004 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22644 dockerd root mem-W REG 8,1 32768 5539 /var/lib/docker/buildkit/cache.db 2023-10-08T15:40:51.004 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22644 dockerd root mem-W REG 8,1 16384 5537 /var/lib/docker/buildkit/metadata_v2.db 2023-10-08T15:40:51.004 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22644 dockerd root mem REG 8,1 239896 8375 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-10-08T15:40:51.004 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22644 dockerd root mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:51.004 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22644 dockerd root mem-W REG 8,1 16384 5536 /var/lib/docker/buildkit/snapshots.db 2023-10-08T15:40:51.004 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22644 dockerd root mem-W REG 8,1 16384 5535 /var/lib/docker/buildkit/containerdmeta.db 2023-10-08T15:40:51.004 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22644 dockerd root mem REG 8,1 584392 8917 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.9.0 2023-10-08T15:40:51.004 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22644 dockerd root mem REG 8,1 137584 8109 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.28.0 2023-10-08T15:40:51.004 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22644 dockerd root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:51.005 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22644 dockerd root mem REG 8,1 178528 12765 /usr/lib/x86_64-linux-gnu/libudev.so.1.6.17 2023-10-08T15:40:51.005 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22644 dockerd root mem REG 8,1 163200 8942 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-10-08T15:40:51.005 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22644 dockerd root mem REG 8,1 1168056 8360 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.2.5 2023-10-08T15:40:51.005 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22644 dockerd root mem REG 8,1 129248 13039 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.2 2023-10-08T15:40:51.005 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22644 dockerd root mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:51.005 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22644 dockerd root mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:51.005 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22644 dockerd root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:51.005 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22644 dockerd root mem REG 8,1 431472 10641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-10-08T15:40:51.005 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22644 dockerd root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:51.005 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22644 dockerd root mem REG 8,1 709496 10741 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.28.0 2023-10-08T15:40:51.005 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22644 dockerd root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:51.005 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22644 dockerd root mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:51.006 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22644 dockerd root mem-W REG 8,1 32768 5514 /var/lib/docker/volumes/metadata.db 2023-10-08T15:40:51.006 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22644 dockerd root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:51.006 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22644 dockerd root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:51.006 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22644 dockerd root 1u unix 0xffff8f390dc24400 0t0 148115 type=STREAM 2023-10-08T15:40:51.006 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22644 dockerd root 2u unix 0xffff8f390dc24400 0t0 148115 type=STREAM 2023-10-08T15:40:51.006 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22644 dockerd root 3u unix 0xffff8f38c5591980 0t0 151776 /var/run/docker/metrics.sock type=STREAM 2023-10-08T15:40:51.006 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22644 dockerd root 4u unix 0xffff8f38c72c6a40 0t0 143260 /run/docker.sock type=STREAM 2023-10-08T15:40:51.006 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22644 dockerd root 5u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.006 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22644 dockerd root 6r FIFO 0,13 0t0 148118 pipe 2023-10-08T15:40:51.006 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22644 dockerd root 7w FIFO 0,13 0t0 148118 pipe 2023-10-08T15:40:51.006 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22644 dockerd root 8u unix 0xffff8f38c5530880 0t0 152765 type=STREAM 2023-10-08T15:40:51.007 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22644 dockerd root 9u unix 0xffff8f38df8cb740 0t0 148119 type=STREAM 2023-10-08T15:40:51.007 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22644 dockerd root 10uW REG 8,1 32768 5514 /var/lib/docker/volumes/metadata.db 2023-10-08T15:40:51.007 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22644 dockerd root 11r REG 0,4 0 4026532000 net 2023-10-08T15:40:51.007 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22644 dockerd root 12u netlink 0t0 146374 ROUTE 2023-10-08T15:40:51.007 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22644 dockerd root 13u netlink 0t0 146375 XFRM 2023-10-08T15:40:51.007 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22644 dockerd root 14u netlink 0t0 146376 NETFILTER 2023-10-08T15:40:51.007 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22644 dockerd root 15u unix 0xffff8f3911d9bb80 0t0 146421 /var/run/docker/libnetwork/016ab9653432.sock type=STREAM 2023-10-08T15:40:51.007 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22644 dockerd root 16uW REG 8,1 16384 5535 /var/lib/docker/buildkit/containerdmeta.db 2023-10-08T15:40:51.007 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22644 dockerd root 17uW REG 8,1 16384 5536 /var/lib/docker/buildkit/snapshots.db 2023-10-08T15:40:51.007 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22644 dockerd root 18uW REG 8,1 16384 5537 /var/lib/docker/buildkit/metadata_v2.db 2023-10-08T15:40:51.007 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22644 dockerd root 19uW REG 8,1 32768 5539 /var/lib/docker/buildkit/cache.db 2023-10-08T15:40:51.007 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22644 dockerd root 20uW REG 8,1 16384 3416 /var/lib/docker/buildkit/history.db 2023-10-08T15:40:51.008 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22645 dockerd root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:51.008 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22645 dockerd root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:51.008 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22645 dockerd root txt REG 8,1 83568776 25295 /usr/bin/dockerd 2023-10-08T15:40:51.008 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22645 dockerd root mem-W REG 8,1 16384 3416 /var/lib/docker/buildkit/history.db 2023-10-08T15:40:51.008 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22645 dockerd root mem-W REG 8,1 32768 5539 /var/lib/docker/buildkit/cache.db 2023-10-08T15:40:51.008 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22645 dockerd root mem-W REG 8,1 16384 5537 /var/lib/docker/buildkit/metadata_v2.db 2023-10-08T15:40:51.008 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22645 dockerd root mem REG 8,1 239896 8375 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-10-08T15:40:51.008 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22645 dockerd root mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:51.008 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22645 dockerd root mem-W REG 8,1 16384 5536 /var/lib/docker/buildkit/snapshots.db 2023-10-08T15:40:51.008 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22645 dockerd root mem-W REG 8,1 16384 5535 /var/lib/docker/buildkit/containerdmeta.db 2023-10-08T15:40:51.008 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22645 dockerd root mem REG 8,1 584392 8917 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.9.0 2023-10-08T15:40:51.008 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22645 dockerd root mem REG 8,1 137584 8109 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.28.0 2023-10-08T15:40:51.009 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22645 dockerd root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:51.009 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22645 dockerd root mem REG 8,1 178528 12765 /usr/lib/x86_64-linux-gnu/libudev.so.1.6.17 2023-10-08T15:40:51.009 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22645 dockerd root mem REG 8,1 163200 8942 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-10-08T15:40:51.009 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22645 dockerd root mem REG 8,1 1168056 8360 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.2.5 2023-10-08T15:40:51.009 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22645 dockerd root mem REG 8,1 129248 13039 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.2 2023-10-08T15:40:51.009 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22645 dockerd root mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:51.009 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22645 dockerd root mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:51.009 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22645 dockerd root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:51.009 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22645 dockerd root mem REG 8,1 431472 10641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-10-08T15:40:51.009 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22645 dockerd root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:51.009 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22645 dockerd root mem REG 8,1 709496 10741 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.28.0 2023-10-08T15:40:51.010 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22645 dockerd root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:51.010 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22645 dockerd root mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:51.010 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22645 dockerd root mem-W REG 8,1 32768 5514 /var/lib/docker/volumes/metadata.db 2023-10-08T15:40:51.010 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22645 dockerd root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:51.010 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22645 dockerd root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:51.010 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22645 dockerd root 1u unix 0xffff8f390dc24400 0t0 148115 type=STREAM 2023-10-08T15:40:51.010 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22645 dockerd root 2u unix 0xffff8f390dc24400 0t0 148115 type=STREAM 2023-10-08T15:40:51.010 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22645 dockerd root 3u unix 0xffff8f38c5591980 0t0 151776 /var/run/docker/metrics.sock type=STREAM 2023-10-08T15:40:51.010 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22645 dockerd root 4u unix 0xffff8f38c72c6a40 0t0 143260 /run/docker.sock type=STREAM 2023-10-08T15:40:51.010 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22645 dockerd root 5u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.010 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22645 dockerd root 6r FIFO 0,13 0t0 148118 pipe 2023-10-08T15:40:51.010 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22645 dockerd root 7w FIFO 0,13 0t0 148118 pipe 2023-10-08T15:40:51.011 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22645 dockerd root 8u unix 0xffff8f38c5530880 0t0 152765 type=STREAM 2023-10-08T15:40:51.011 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22645 dockerd root 9u unix 0xffff8f38df8cb740 0t0 148119 type=STREAM 2023-10-08T15:40:51.011 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22645 dockerd root 10uW REG 8,1 32768 5514 /var/lib/docker/volumes/metadata.db 2023-10-08T15:40:51.011 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22645 dockerd root 11r REG 0,4 0 4026532000 net 2023-10-08T15:40:51.011 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22645 dockerd root 12u netlink 0t0 146374 ROUTE 2023-10-08T15:40:51.011 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22645 dockerd root 13u netlink 0t0 146375 XFRM 2023-10-08T15:40:51.011 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22645 dockerd root 14u netlink 0t0 146376 NETFILTER 2023-10-08T15:40:51.011 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22645 dockerd root 15u unix 0xffff8f3911d9bb80 0t0 146421 /var/run/docker/libnetwork/016ab9653432.sock type=STREAM 2023-10-08T15:40:51.011 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22645 dockerd root 16uW REG 8,1 16384 5535 /var/lib/docker/buildkit/containerdmeta.db 2023-10-08T15:40:51.011 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22645 dockerd root 17uW REG 8,1 16384 5536 /var/lib/docker/buildkit/snapshots.db 2023-10-08T15:40:51.011 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22645 dockerd root 18uW REG 8,1 16384 5537 /var/lib/docker/buildkit/metadata_v2.db 2023-10-08T15:40:51.012 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22645 dockerd root 19uW REG 8,1 32768 5539 /var/lib/docker/buildkit/cache.db 2023-10-08T15:40:51.012 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22645 dockerd root 20uW REG 8,1 16384 3416 /var/lib/docker/buildkit/history.db 2023-10-08T15:40:51.012 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22646 dockerd root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:51.012 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22646 dockerd root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:51.012 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22646 dockerd root txt REG 8,1 83568776 25295 /usr/bin/dockerd 2023-10-08T15:40:51.012 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22646 dockerd root mem-W REG 8,1 16384 3416 /var/lib/docker/buildkit/history.db 2023-10-08T15:40:51.012 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22646 dockerd root mem-W REG 8,1 32768 5539 /var/lib/docker/buildkit/cache.db 2023-10-08T15:40:51.012 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22646 dockerd root mem-W REG 8,1 16384 5537 /var/lib/docker/buildkit/metadata_v2.db 2023-10-08T15:40:51.012 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22646 dockerd root mem REG 8,1 239896 8375 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-10-08T15:40:51.012 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22646 dockerd root mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:51.013 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22646 dockerd root mem-W REG 8,1 16384 5536 /var/lib/docker/buildkit/snapshots.db 2023-10-08T15:40:51.013 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22646 dockerd root mem-W REG 8,1 16384 5535 /var/lib/docker/buildkit/containerdmeta.db 2023-10-08T15:40:51.013 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22646 dockerd root mem REG 8,1 584392 8917 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.9.0 2023-10-08T15:40:51.013 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22646 dockerd root mem REG 8,1 137584 8109 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.28.0 2023-10-08T15:40:51.013 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22646 dockerd root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:51.013 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22646 dockerd root mem REG 8,1 178528 12765 /usr/lib/x86_64-linux-gnu/libudev.so.1.6.17 2023-10-08T15:40:51.013 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22646 dockerd root mem REG 8,1 163200 8942 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-10-08T15:40:51.013 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22646 dockerd root mem REG 8,1 1168056 8360 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.2.5 2023-10-08T15:40:51.013 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22646 dockerd root mem REG 8,1 129248 13039 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.2 2023-10-08T15:40:51.013 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22646 dockerd root mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:51.014 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22646 dockerd root mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:51.014 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22646 dockerd root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:51.014 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22646 dockerd root mem REG 8,1 431472 10641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-10-08T15:40:51.014 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22646 dockerd root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:51.014 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22646 dockerd root mem REG 8,1 709496 10741 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.28.0 2023-10-08T15:40:51.014 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22646 dockerd root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:51.014 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22646 dockerd root mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:51.014 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22646 dockerd root mem-W REG 8,1 32768 5514 /var/lib/docker/volumes/metadata.db 2023-10-08T15:40:51.014 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22646 dockerd root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:51.015 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22646 dockerd root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:51.015 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22646 dockerd root 1u unix 0xffff8f390dc24400 0t0 148115 type=STREAM 2023-10-08T15:40:51.015 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22646 dockerd root 2u unix 0xffff8f390dc24400 0t0 148115 type=STREAM 2023-10-08T15:40:51.015 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22646 dockerd root 3u unix 0xffff8f38c5591980 0t0 151776 /var/run/docker/metrics.sock type=STREAM 2023-10-08T15:40:51.015 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22646 dockerd root 4u unix 0xffff8f38c72c6a40 0t0 143260 /run/docker.sock type=STREAM 2023-10-08T15:40:51.015 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22646 dockerd root 5u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.015 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22646 dockerd root 6r FIFO 0,13 0t0 148118 pipe 2023-10-08T15:40:51.015 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22646 dockerd root 7w FIFO 0,13 0t0 148118 pipe 2023-10-08T15:40:51.015 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22646 dockerd root 8u unix 0xffff8f38c5530880 0t0 152765 type=STREAM 2023-10-08T15:40:51.016 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22646 dockerd root 9u unix 0xffff8f38df8cb740 0t0 148119 type=STREAM 2023-10-08T15:40:51.016 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22646 dockerd root 10uW REG 8,1 32768 5514 /var/lib/docker/volumes/metadata.db 2023-10-08T15:40:51.016 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22646 dockerd root 11r REG 0,4 0 4026532000 net 2023-10-08T15:40:51.016 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22646 dockerd root 12u netlink 0t0 146374 ROUTE 2023-10-08T15:40:51.016 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22646 dockerd root 13u netlink 0t0 146375 XFRM 2023-10-08T15:40:51.016 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22646 dockerd root 14u netlink 0t0 146376 NETFILTER 2023-10-08T15:40:51.016 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22646 dockerd root 15u unix 0xffff8f3911d9bb80 0t0 146421 /var/run/docker/libnetwork/016ab9653432.sock type=STREAM 2023-10-08T15:40:51.016 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22646 dockerd root 16uW REG 8,1 16384 5535 /var/lib/docker/buildkit/containerdmeta.db 2023-10-08T15:40:51.016 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22646 dockerd root 17uW REG 8,1 16384 5536 /var/lib/docker/buildkit/snapshots.db 2023-10-08T15:40:51.017 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22646 dockerd root 18uW REG 8,1 16384 5537 /var/lib/docker/buildkit/metadata_v2.db 2023-10-08T15:40:51.017 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22646 dockerd root 19uW REG 8,1 32768 5539 /var/lib/docker/buildkit/cache.db 2023-10-08T15:40:51.017 INFO:teuthology.orchestra.run.smithi089.stdout:dockerd 22626 22646 dockerd root 20uW REG 8,1 16384 3416 /var/lib/docker/buildkit/history.db 2023-10-08T15:40:51.017 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22890 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:51.017 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22890 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:51.017 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22890 root txt REG 8,1 876328 15978 /usr/sbin/sshd 2023-10-08T15:40:51.017 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22890 root mem REG 8,1 239896 8375 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-10-08T15:40:51.017 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22890 root mem REG 8,1 18720 8661 /usr/lib/x86_64-linux-gnu/security/pam_env.so 2023-10-08T15:40:51.017 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22890 root mem REG 8,1 27136 8672 /usr/lib/x86_64-linux-gnu/security/pam_limits.so 2023-10-08T15:40:51.018 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22890 root mem REG 8,1 14728 8386 /usr/lib/x86_64-linux-gnu/libpam_misc.so.0.82.1 2023-10-08T15:40:51.018 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22890 root mem REG 8,1 14560 8676 /usr/lib/x86_64-linux-gnu/security/pam_mail.so 2023-10-08T15:40:51.018 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22890 root mem REG 8,1 14656 8678 /usr/lib/x86_64-linux-gnu/security/pam_motd.so 2023-10-08T15:40:51.018 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22890 root mem REG 8,1 475944 8779 /usr/lib/x86_64-linux-gnu/security/pam_systemd.so 2023-10-08T15:40:51.018 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22890 root mem REG 8,1 14624 8696 /usr/lib/x86_64-linux-gnu/security/pam_umask.so 2023-10-08T15:40:51.018 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22890 root mem REG 8,1 14528 8670 /usr/lib/x86_64-linux-gnu/security/pam_keyinit.so 2023-10-08T15:40:51.018 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22890 root mem REG 8,1 14584 8675 /usr/lib/x86_64-linux-gnu/security/pam_loginuid.so 2023-10-08T15:40:51.018 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22890 root mem REG 8,1 31120 10630 /usr/lib/x86_64-linux-gnu/libcap.so.2.32 2023-10-08T15:40:51.018 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22890 root mem REG 8,1 27088 8686 /usr/lib/x86_64-linux-gnu/security/pam_selinux.so 2023-10-08T15:40:51.019 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22890 root mem REG 8,1 14512 8680 /usr/lib/x86_64-linux-gnu/security/pam_nologin.so 2023-10-08T15:40:51.019 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22890 root mem REG 8,1 18424 12487 /usr/lib/x86_64-linux-gnu/security/pam_cap.so 2023-10-08T15:40:51.019 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22890 root mem REG 8,1 64504 8697 /usr/lib/x86_64-linux-gnu/security/pam_unix.so 2023-10-08T15:40:51.019 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22890 root mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:51.019 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22890 root mem REG 8,1 137584 8109 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.28.0 2023-10-08T15:40:51.019 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22890 root mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:51.019 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22890 root mem REG 8,1 22600 15019 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.8 2023-10-08T15:40:51.019 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22890 root mem REG 8,1 56096 15015 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-10-08T15:40:51.019 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22890 root mem REG 8,1 191040 15017 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-10-08T15:40:51.020 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22890 root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:51.020 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22890 root mem REG 8,1 1168056 8360 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.2.5 2023-10-08T15:40:51.020 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22890 root mem REG 8,1 129248 13039 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.2 2023-10-08T15:40:51.020 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22890 root mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:51.020 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22890 root mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:51.020 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22890 root mem REG 8,1 584392 8917 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.9.0 2023-10-08T15:40:51.020 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22890 root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:51.020 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22890 root mem REG 8,1 27064 8001 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-10-08T15:40:51.020 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22890 root mem REG 8,1 105560 13403 /usr/lib/x86_64-linux-gnu/libnsl-2.31.so 2023-10-08T15:40:51.021 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22890 root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:51.021 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22890 root mem REG 8,1 22600 9279 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-10-08T15:40:51.021 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22890 root mem REG 8,1 902016 15021 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-10-08T15:40:51.021 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22890 root mem REG 8,1 309712 15024 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-10-08T15:40:51.021 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22890 root mem REG 8,1 202760 8017 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-10-08T15:40:51.021 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22890 root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:51.021 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22890 root mem REG 8,1 14880 13415 /usr/lib/x86_64-linux-gnu/libutil-2.31.so 2023-10-08T15:40:51.021 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22890 root DEL REG 8,1 8794 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:51.021 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22890 root mem REG 8,1 709496 10741 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.28.0 2023-10-08T15:40:51.022 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22890 root mem REG 8,1 163200 8942 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-10-08T15:40:51.022 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22890 root mem REG 8,1 68320 8384 /usr/lib/x86_64-linux-gnu/libpam.so.0.84.2 2023-10-08T15:40:51.022 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22890 root mem REG 8,1 133200 8347 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-10-08T15:40:51.022 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22890 root mem REG 8,1 44848 15918 /usr/lib/x86_64-linux-gnu/libwrap.so.0.7.6 2023-10-08T15:40:51.022 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22890 root mem REG 8,1 14448 8681 /usr/lib/x86_64-linux-gnu/security/pam_permit.so 2023-10-08T15:40:51.022 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22890 root mem REG 8,1 14048 8659 /usr/lib/x86_64-linux-gnu/security/pam_deny.so 2023-10-08T15:40:51.022 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22890 root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:51.022 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22890 root 0u CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:51.022 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22890 root 1u CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:51.023 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22890 root 2u CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:51.023 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22890 root 3u unix 0xffff8f39131361c0 0t0 151200 type=DGRAM 2023-10-08T15:40:51.023 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22890 root 4u IPv4 145236 0t0 TCP smithi089.front.sepia.ceph.com:ssh->teuthology.front.sepia.ceph.com:58130 (ESTABLISHED) 2023-10-08T15:40:51.023 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22890 root 6u unix 0xffff8f3913130440 0t0 151184 type=STREAM 2023-10-08T15:40:51.023 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22890 root 7u unix 0xffff8f3910444840 0t0 153875 type=STREAM 2023-10-08T15:40:51.023 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22890 root 8w FIFO 0,25 0t0 842 /run/systemd/sessions/4.ref 2023-10-08T15:40:51.023 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu cwd DIR 8,1 4096 2 / 2023-10-08T15:40:51.023 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu rtd DIR 8,1 4096 2 / 2023-10-08T15:40:51.023 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu txt REG 8,1 876328 15978 /usr/sbin/sshd 2023-10-08T15:40:51.023 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu mem REG 8,1 239896 8375 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-10-08T15:40:51.024 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu mem REG 8,1 18720 8661 /usr/lib/x86_64-linux-gnu/security/pam_env.so 2023-10-08T15:40:51.024 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu mem REG 8,1 27136 8672 /usr/lib/x86_64-linux-gnu/security/pam_limits.so 2023-10-08T15:40:51.024 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu mem REG 8,1 14728 8386 /usr/lib/x86_64-linux-gnu/libpam_misc.so.0.82.1 2023-10-08T15:40:51.024 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu mem REG 8,1 14560 8676 /usr/lib/x86_64-linux-gnu/security/pam_mail.so 2023-10-08T15:40:51.024 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu mem REG 8,1 14656 8678 /usr/lib/x86_64-linux-gnu/security/pam_motd.so 2023-10-08T15:40:51.024 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu mem REG 8,1 475944 8779 /usr/lib/x86_64-linux-gnu/security/pam_systemd.so 2023-10-08T15:40:51.024 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu mem REG 8,1 14624 8696 /usr/lib/x86_64-linux-gnu/security/pam_umask.so 2023-10-08T15:40:51.024 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu mem REG 8,1 14528 8670 /usr/lib/x86_64-linux-gnu/security/pam_keyinit.so 2023-10-08T15:40:51.024 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu mem REG 8,1 14584 8675 /usr/lib/x86_64-linux-gnu/security/pam_loginuid.so 2023-10-08T15:40:51.025 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu mem REG 8,1 31120 10630 /usr/lib/x86_64-linux-gnu/libcap.so.2.32 2023-10-08T15:40:51.025 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu mem REG 8,1 27088 8686 /usr/lib/x86_64-linux-gnu/security/pam_selinux.so 2023-10-08T15:40:51.025 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu mem REG 8,1 14512 8680 /usr/lib/x86_64-linux-gnu/security/pam_nologin.so 2023-10-08T15:40:51.025 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu mem REG 8,1 18424 12487 /usr/lib/x86_64-linux-gnu/security/pam_cap.so 2023-10-08T15:40:51.025 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu mem REG 8,1 64504 8697 /usr/lib/x86_64-linux-gnu/security/pam_unix.so 2023-10-08T15:40:51.025 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:51.025 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu mem REG 8,1 137584 8109 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.28.0 2023-10-08T15:40:51.025 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:51.025 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu mem REG 8,1 22600 15019 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.8 2023-10-08T15:40:51.025 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu mem REG 8,1 56096 15015 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-10-08T15:40:51.025 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu mem REG 8,1 191040 15017 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-10-08T15:40:51.026 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:51.026 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu mem REG 8,1 1168056 8360 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.2.5 2023-10-08T15:40:51.026 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu mem REG 8,1 129248 13039 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.2 2023-10-08T15:40:51.026 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:51.026 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:51.026 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu mem REG 8,1 584392 8917 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.9.0 2023-10-08T15:40:51.026 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:51.026 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu mem REG 8,1 27064 8001 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-10-08T15:40:51.026 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu mem REG 8,1 105560 13403 /usr/lib/x86_64-linux-gnu/libnsl-2.31.so 2023-10-08T15:40:51.027 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:51.027 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu mem REG 8,1 22600 9279 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-10-08T15:40:51.027 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu mem REG 8,1 902016 15021 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-10-08T15:40:51.027 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu mem REG 8,1 309712 15024 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-10-08T15:40:51.027 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu mem REG 8,1 202760 8017 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-10-08T15:40:51.027 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:51.027 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu mem REG 8,1 14880 13415 /usr/lib/x86_64-linux-gnu/libutil-2.31.so 2023-10-08T15:40:51.027 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu DEL REG 8,1 8794 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:51.027 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu mem REG 8,1 709496 10741 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.28.0 2023-10-08T15:40:51.027 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu mem REG 8,1 163200 8942 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-10-08T15:40:51.028 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu mem REG 8,1 68320 8384 /usr/lib/x86_64-linux-gnu/libpam.so.0.84.2 2023-10-08T15:40:51.028 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu mem REG 8,1 133200 8347 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-10-08T15:40:51.028 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu mem REG 8,1 44848 15918 /usr/lib/x86_64-linux-gnu/libwrap.so.0.7.6 2023-10-08T15:40:51.028 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu mem REG 8,1 14448 8681 /usr/lib/x86_64-linux-gnu/security/pam_permit.so 2023-10-08T15:40:51.028 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu mem REG 8,1 14048 8659 /usr/lib/x86_64-linux-gnu/security/pam_deny.so 2023-10-08T15:40:51.028 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:51.028 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu 0u CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:51.028 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu 1u CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:51.028 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu 2u CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:51.029 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu 3u unix 0xffff8f39131361c0 0t0 151200 type=DGRAM 2023-10-08T15:40:51.029 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu 4u IPv4 145236 0t0 TCP smithi089.front.sepia.ceph.com:ssh->teuthology.front.sepia.ceph.com:58130 (ESTABLISHED) 2023-10-08T15:40:51.029 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu 5u unix 0xffff8f3910447700 0t0 153874 type=STREAM 2023-10-08T15:40:51.029 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu 6u unix 0xffff8f3913130440 0t0 151184 type=STREAM 2023-10-08T15:40:51.029 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu 7r FIFO 0,13 0t0 151210 pipe 2023-10-08T15:40:51.029 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu 8w FIFO 0,25 0t0 842 /run/systemd/sessions/4.ref 2023-10-08T15:40:51.029 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu 9w FIFO 0,13 0t0 151210 pipe 2023-10-08T15:40:51.029 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu 11w FIFO 0,13 0t0 167763 pipe 2023-10-08T15:40:51.029 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu 12r FIFO 0,13 0t0 167764 pipe 2023-10-08T15:40:51.030 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu 14r FIFO 0,13 0t0 167765 pipe 2023-10-08T15:40:51.030 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu 15r FIFO 0,13 0t0 172601 pipe 2023-10-08T15:40:51.030 INFO:teuthology.orchestra.run.smithi089.stdout:sshd 22912 ubuntu 17r FIFO 0,13 0t0 172602 pipe 2023-10-08T15:40:51.030 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 ntp cwd DIR 8,1 4096 2 / 2023-10-08T15:40:51.030 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 ntp rtd DIR 8,1 4096 2 / 2023-10-08T15:40:51.030 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 ntp txt REG 8,1 838744 15658 /usr/sbin/ntpd 2023-10-08T15:40:51.030 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 ntp mem REG 8,1 239896 8375 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-10-08T15:40:51.030 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 ntp mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:51.030 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 ntp mem REG 8,1 27112 13405 /usr/lib/x86_64-linux-gnu/libnss_dns-2.31.so 2023-10-08T15:40:51.030 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 ntp mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:51.031 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 ntp mem REG 8,1 104984 8251 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-10-08T15:40:51.031 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 ntp mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:51.031 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 ntp mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:51.031 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 ntp mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:51.031 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 ntp DEL REG 8,1 8794 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:51.031 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 ntp mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:51.031 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 ntp mem REG 8,1 140800 15651 /usr/lib/x86_64-linux-gnu/libopts.so.25.17.1 2023-10-08T15:40:51.031 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 ntp mem REG 8,1 31120 10630 /usr/lib/x86_64-linux-gnu/libcap.so.2.32 2023-10-08T15:40:51.031 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 ntp mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:51.031 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 ntp 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:51.031 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 ntp 1r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:51.031 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 ntp 2r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:51.032 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 ntp 3u unix 0xffff8f39170caec0 0t0 148198 type=DGRAM 2023-10-08T15:40:51.032 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 ntp 4w REG 8,1 23752 1171 /var/log/ntpstats/rawstats.20231008 2023-10-08T15:40:51.032 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 ntp 5w REG 8,1 2977 1634 /var/log/ntpstats/peerstats.20231008 2023-10-08T15:40:51.032 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 ntp 6w REG 8,1 237 71914 /var/log/ntpstats/loopstats.20231008 2023-10-08T15:40:51.032 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 ntp 16u IPv6 148206 0t0 UDP *:ntp 2023-10-08T15:40:51.032 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 ntp 17u IPv4 148209 0t0 UDP *:ntp 2023-10-08T15:40:51.032 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 ntp 18u IPv4 148213 0t0 UDP localhost:ntp 2023-10-08T15:40:51.032 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 ntp 19u IPv4 148215 0t0 UDP smithi089.front.sepia.ceph.com:ntp 2023-10-08T15:40:51.032 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 ntp 20u IPv6 148217 0t0 UDP localhost:ntp 2023-10-08T15:40:51.032 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 ntp 21u IPv6 148219 0t0 UDP smithi089:ntp 2023-10-08T15:40:51.032 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 ntp 22u netlink 0t0 148220 ROUTE 2023-10-08T15:40:51.033 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 ntp 23u unix 0xffff8f39170cf2c0 0t0 148221 type=STREAM 2023-10-08T15:40:51.033 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 ntp 24u unix 0xffff8f39170cbfc0 0t0 148222 type=STREAM 2023-10-08T15:40:51.033 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 22943 ntpd ntp cwd DIR 8,1 4096 2 / 2023-10-08T15:40:51.033 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 22943 ntpd ntp rtd DIR 8,1 4096 2 / 2023-10-08T15:40:51.033 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 22943 ntpd ntp txt REG 8,1 838744 15658 /usr/sbin/ntpd 2023-10-08T15:40:51.033 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 22943 ntpd ntp mem REG 8,1 239896 8375 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-10-08T15:40:51.033 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 22943 ntpd ntp mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:51.033 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 22943 ntpd ntp mem REG 8,1 27112 13405 /usr/lib/x86_64-linux-gnu/libnss_dns-2.31.so 2023-10-08T15:40:51.033 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 22943 ntpd ntp mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:51.033 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 22943 ntpd ntp mem REG 8,1 104984 8251 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-10-08T15:40:51.033 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 22943 ntpd ntp mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:51.033 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 22943 ntpd ntp mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:51.034 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 22943 ntpd ntp mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:51.034 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 22943 ntpd ntp DEL REG 8,1 8794 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:51.034 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 22943 ntpd ntp mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:51.034 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 22943 ntpd ntp mem REG 8,1 140800 15651 /usr/lib/x86_64-linux-gnu/libopts.so.25.17.1 2023-10-08T15:40:51.034 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 22943 ntpd ntp mem REG 8,1 31120 10630 /usr/lib/x86_64-linux-gnu/libcap.so.2.32 2023-10-08T15:40:51.034 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 22943 ntpd ntp mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:51.034 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 22943 ntpd ntp 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:51.034 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 22943 ntpd ntp 1r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:51.035 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 22943 ntpd ntp 2r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:51.035 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 22943 ntpd ntp 3u unix 0xffff8f39170caec0 0t0 148198 type=DGRAM 2023-10-08T15:40:51.035 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 22943 ntpd ntp 4w REG 8,1 23752 1171 /var/log/ntpstats/rawstats.20231008 2023-10-08T15:40:51.035 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 22943 ntpd ntp 5w REG 8,1 2977 1634 /var/log/ntpstats/peerstats.20231008 2023-10-08T15:40:51.035 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 22943 ntpd ntp 6w REG 8,1 237 71914 /var/log/ntpstats/loopstats.20231008 2023-10-08T15:40:51.035 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 22943 ntpd ntp 16u IPv6 148206 0t0 UDP *:ntp 2023-10-08T15:40:51.035 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 22943 ntpd ntp 17u IPv4 148209 0t0 UDP *:ntp 2023-10-08T15:40:51.035 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 22943 ntpd ntp 18u IPv4 148213 0t0 UDP localhost:ntp 2023-10-08T15:40:51.035 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 22943 ntpd ntp 19u IPv4 148215 0t0 UDP smithi089.front.sepia.ceph.com:ntp 2023-10-08T15:40:51.035 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 22943 ntpd ntp 20u IPv6 148217 0t0 UDP localhost:ntp 2023-10-08T15:40:51.035 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 22943 ntpd ntp 21u IPv6 148219 0t0 UDP smithi089:ntp 2023-10-08T15:40:51.035 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 22943 ntpd ntp 22u netlink 0t0 148220 ROUTE 2023-10-08T15:40:51.036 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 22943 ntpd ntp 23u unix 0xffff8f39170cf2c0 0t0 148221 type=STREAM 2023-10-08T15:40:51.036 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd 22942 22943 ntpd ntp 24u unix 0xffff8f39170cbfc0 0t0 148222 type=STREAM 2023-10-08T15:40:51.036 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/7 23568 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:51.036 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/7 23568 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:51.036 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/7 23568 root txt unknown /proc/23568/exe 2023-10-08T15:40:51.036 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-cras 25541 ceph cwd DIR 8,1 4096 2 / 2023-10-08T15:40:51.036 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-cras 25541 ceph rtd DIR 8,1 4096 2 / 2023-10-08T15:40:51.036 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-cras 25541 ceph txt REG 8,1 5502744 11325 /usr/bin/python3.8 2023-10-08T15:40:51.036 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-cras 25541 ceph mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:51.036 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-cras 25541 ceph mem REG 8,1 74848 8355 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-10-08T15:40:51.036 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-cras 25541 ceph mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:51.036 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-cras 25541 ceph mem REG 8,1 45832 24533 /usr/lib/python3.8/lib-dynload/_lzma.cpython-38-x86_64-linux-gnu.so 2023-10-08T15:40:51.037 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-cras 25541 ceph mem REG 8,1 28520 24516 /usr/lib/python3.8/lib-dynload/_bz2.cpython-38-x86_64-linux-gnu.so 2023-10-08T15:40:51.037 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-cras 25541 ceph mem REG 8,1 6017584 10873 /usr/lib/locale/locale-archive 2023-10-08T15:40:51.037 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-cras 25541 ceph mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:51.037 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-cras 25541 ceph mem REG 8,1 182560 8776 /usr/lib/x86_64-linux-gnu/libexpat.so.1.6.11 2023-10-08T15:40:51.037 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-cras 25541 ceph mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:51.037 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-cras 25541 ceph mem REG 8,1 14880 13415 /usr/lib/x86_64-linux-gnu/libutil-2.31.so 2023-10-08T15:40:51.037 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-cras 25541 ceph mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:51.037 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-cras 25541 ceph mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:51.037 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-cras 25541 ceph mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:51.037 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-cras 25541 ceph mem REG 8,1 18696 13609 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-10-08T15:40:51.037 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-cras 25541 ceph mem REG 8,1 27002 13665 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-10-08T15:40:51.038 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-cras 25541 ceph mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:51.038 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-cras 25541 ceph 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:51.038 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-cras 25541 ceph 1u unix 0xffff8f390f518cc0 0t0 159226 type=STREAM 2023-10-08T15:40:51.038 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-cras 25541 ceph 2u unix 0xffff8f390f518cc0 0t0 159226 type=STREAM 2023-10-08T15:40:51.038 INFO:teuthology.orchestra.run.smithi089.stdout:wpa_suppl 27033 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:51.038 INFO:teuthology.orchestra.run.smithi089.stdout:wpa_suppl 27033 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:51.038 INFO:teuthology.orchestra.run.smithi089.stdout:wpa_suppl 27033 root txt REG 8,1 2893136 9654 /usr/sbin/wpa_supplicant 2023-10-08T15:40:51.038 INFO:teuthology.orchestra.run.smithi089.stdout:wpa_suppl 27033 root mem REG 8,1 137584 8109 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.28.0 2023-10-08T15:40:51.038 INFO:teuthology.orchestra.run.smithi089.stdout:wpa_suppl 27033 root mem REG 8,1 1168056 8360 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.2.5 2023-10-08T15:40:51.038 INFO:teuthology.orchestra.run.smithi089.stdout:wpa_suppl 27033 root mem REG 8,1 129248 13039 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.2 2023-10-08T15:40:51.039 INFO:teuthology.orchestra.run.smithi089.stdout:wpa_suppl 27033 root mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:51.039 INFO:teuthology.orchestra.run.smithi089.stdout:wpa_suppl 27033 root mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:51.039 INFO:teuthology.orchestra.run.smithi089.stdout:wpa_suppl 27033 root mem REG 8,1 709496 10741 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.28.0 2023-10-08T15:40:51.039 INFO:teuthology.orchestra.run.smithi089.stdout:wpa_suppl 27033 root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:51.039 INFO:teuthology.orchestra.run.smithi089.stdout:wpa_suppl 27033 root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:51.039 INFO:teuthology.orchestra.run.smithi089.stdout:wpa_suppl 27033 root mem REG 8,1 325944 8767 /usr/lib/x86_64-linux-gnu/libdbus-1.so.3.19.11 2023-10-08T15:40:51.039 INFO:teuthology.orchestra.run.smithi089.stdout:wpa_suppl 27033 root mem REG 8,1 2954080 9466 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:51.039 INFO:teuthology.orchestra.run.smithi089.stdout:wpa_suppl 27033 root mem REG 8,1 598104 9468 /usr/lib/x86_64-linux-gnu/libssl.so.1.1 2023-10-08T15:40:51.039 INFO:teuthology.orchestra.run.smithi089.stdout:wpa_suppl 27033 root mem REG 8,1 47168 16665 /usr/lib/x86_64-linux-gnu/libpcsclite.so.1.0.0 2023-10-08T15:40:51.040 INFO:teuthology.orchestra.run.smithi089.stdout:wpa_suppl 27033 root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:51.040 INFO:teuthology.orchestra.run.smithi089.stdout:wpa_suppl 27033 root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:51.040 INFO:teuthology.orchestra.run.smithi089.stdout:wpa_suppl 27033 root mem REG 8,1 477584 16364 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-10-08T15:40:51.040 INFO:teuthology.orchestra.run.smithi089.stdout:wpa_suppl 27033 root mem REG 8,1 27816 13081 /usr/lib/x86_64-linux-gnu/libnl-genl-3.so.200.26.0 2023-10-08T15:40:51.040 INFO:teuthology.orchestra.run.smithi089.stdout:wpa_suppl 27033 root mem REG 8,1 137912 13038 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-10-08T15:40:51.040 INFO:teuthology.orchestra.run.smithi089.stdout:wpa_suppl 27033 root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:51.040 INFO:teuthology.orchestra.run.smithi089.stdout:wpa_suppl 27033 root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:51.040 INFO:teuthology.orchestra.run.smithi089.stdout:wpa_suppl 27033 root 1u unix 0xffff8f3912252a80 0t0 161621 type=STREAM 2023-10-08T15:40:51.040 INFO:teuthology.orchestra.run.smithi089.stdout:wpa_suppl 27033 root 2u unix 0xffff8f3912252a80 0t0 161621 type=STREAM 2023-10-08T15:40:51.040 INFO:teuthology.orchestra.run.smithi089.stdout:wpa_suppl 27033 root 3u unix 0xffff8f38d09c50c0 0t0 166116 type=DGRAM 2023-10-08T15:40:51.041 INFO:teuthology.orchestra.run.smithi089.stdout:wpa_suppl 27033 root 4u unix 0xffff8f38d09c5500 0t0 166117 type=STREAM 2023-10-08T15:40:51.041 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:51.041 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:51.041 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root txt REG 8,1 3097016 9689 /usr/sbin/NetworkManager 2023-10-08T15:40:51.041 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 223512 1068711 /usr/lib/x86_64-linux-gnu/NetworkManager/1.22.10/libnm-device-plugin-wifi.so 2023-10-08T15:40:51.041 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 325944 8767 /usr/lib/x86_64-linux-gnu/libdbus-1.so.3.19.11 2023-10-08T15:40:51.041 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 55608 16258 /usr/lib/x86_64-linux-gnu/libjansson.so.4.11.1 2023-10-08T15:40:51.041 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 27136 9595 /usr/lib/x86_64-linux-gnu/libteamdctl.so.0.1.5 2023-10-08T15:40:51.041 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 44104 1068714 /usr/lib/x86_64-linux-gnu/NetworkManager/1.22.10/libnm-settings-plugin-ifupdown.so 2023-10-08T15:40:51.042 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 148912 9522 /usr/lib/x86_64-linux-gnu/libbluetooth.so.3.19.1 2023-10-08T15:40:51.042 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 98296 1068709 /usr/lib/x86_64-linux-gnu/NetworkManager/1.22.10/libnm-device-plugin-bluetooth.so 2023-10-08T15:40:51.042 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 1017928 9550 /usr/lib/x86_64-linux-gnu/libmm-glib.so.0.8.0 2023-10-08T15:40:51.042 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 44328 1068710 /usr/lib/x86_64-linux-gnu/NetworkManager/1.22.10/libnm-device-plugin-team.so 2023-10-08T15:40:51.042 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 102864 1068715 /usr/lib/x86_64-linux-gnu/NetworkManager/1.22.10/libnm-wwan.so 2023-10-08T15:40:51.042 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 35976 1068712 /usr/lib/x86_64-linux-gnu/NetworkManager/1.22.10/libnm-device-plugin-wwan.so 2023-10-08T15:40:51.042 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:51.042 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 40088 1068708 /usr/lib/x86_64-linux-gnu/NetworkManager/1.22.10/libnm-device-plugin-adsl.so 2023-10-08T15:40:51.042 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 104984 8251 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-10-08T15:40:51.043 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 1956992 8082 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28 2023-10-08T15:40:51.043 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 133640 18368 /usr/lib/x86_64-linux-gnu/libproxy.so.1.0.0 2023-10-08T15:40:51.043 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 67656 101921 /usr/lib/x86_64-linux-gnu/gio/modules/libdconfsettings.so 2023-10-08T15:40:51.043 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 6017584 10873 /usr/lib/locale/locale-archive 2023-10-08T15:40:51.043 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:51.043 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 202760 8017 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-10-08T15:40:51.043 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 1212216 11329 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-10-08T15:40:51.043 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 313336 15785 /usr/lib/x86_64-linux-gnu/libhx509.so.5.0.0 2023-10-08T15:40:51.043 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 68752 15776 /usr/lib/x86_64-linux-gnu/libheimbase.so.1.0.0 2023-10-08T15:40:51.043 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 166040 15782 /usr/lib/x86_64-linux-gnu/libwind.so.0.0.0 2023-10-08T15:40:51.044 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 97024 15770 /usr/lib/x86_64-linux-gnu/libroken.so.18.1.0 2023-10-08T15:40:51.044 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 221816 15779 /usr/lib/x86_64-linux-gnu/libhcrypto.so.4.1.0 2023-10-08T15:40:51.044 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 678240 15773 /usr/lib/x86_64-linux-gnu/libasn1.so.8.0.0 2023-10-08T15:40:51.044 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 594104 15788 /usr/lib/x86_64-linux-gnu/libkrb5.so.26.0.0 2023-10-08T15:40:51.044 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 43712 15791 /usr/lib/x86_64-linux-gnu/libheimntlm.so.0.1.0 2023-10-08T15:40:51.044 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 22600 15019 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.8 2023-10-08T15:40:51.044 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 351352 9401 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-10-08T15:40:51.044 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 137784 15763 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.7 2023-10-08T15:40:51.044 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 278160 15794 /usr/lib/x86_64-linux-gnu/libgssapi.so.3.0.0 2023-10-08T15:40:51.045 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 113552 15797 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-10-08T15:40:51.045 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 56096 15015 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-10-08T15:40:51.045 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 22600 9279 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-10-08T15:40:51.045 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 191040 15017 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-10-08T15:40:51.045 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 902016 15021 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-10-08T15:40:51.045 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 2954080 9466 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:51.045 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 137584 8109 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.28.0 2023-10-08T15:40:51.045 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 465008 11338 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-10-08T15:40:51.045 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 43416 10645 /usr/lib/x86_64-linux-gnu/libffi.so.7.1.0 2023-10-08T15:40:51.045 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:51.046 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 387768 8064 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-10-08T15:40:51.046 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:51.046 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 51512 15764 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.7 2023-10-08T15:40:51.046 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 63888 15800 /usr/lib/x86_64-linux-gnu/liblber-2.4.so.2.10.12 2023-10-08T15:40:51.046 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 339472 15801 /usr/lib/x86_64-linux-gnu/libldap_r-2.4.so.2.10.12 2023-10-08T15:40:51.046 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 309712 15024 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-10-08T15:40:51.046 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 445976 15809 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.4 2023-10-08T15:40:51.046 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 125960 15808 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-10-08T15:40:51.046 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 162160 15806 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.19.0 2023-10-08T15:40:51.047 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 27064 8001 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-10-08T15:40:51.047 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 584392 8917 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.9.0 2023-10-08T15:40:51.047 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 1168056 8360 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.2.5 2023-10-08T15:40:51.047 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 129248 13039 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.2 2023-10-08T15:40:51.047 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:51.047 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:51.047 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 534880 10650 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.0 2023-10-08T15:40:51.047 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 219976 8813 /usr/lib/x86_64-linux-gnu/libhogweed.so.5.0 2023-10-08T15:40:51.047 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 231592 8806 /usr/lib/x86_64-linux-gnu/libnettle.so.7.0 2023-10-08T15:40:51.048 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 84120 10728 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.0 2023-10-08T15:40:51.048 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 1575112 10736 /usr/lib/x86_64-linux-gnu/libunistring.so.2.1.0 2023-10-08T15:40:51.048 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 129096 10669 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.6 2023-10-08T15:40:51.048 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 1265624 8816 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-10-08T15:40:51.048 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:51.048 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:51.048 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:51.048 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 1207920 9384 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.6400.6 2023-10-08T15:40:51.048 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 18640 9386 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.6400.6 2023-10-08T15:40:51.049 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 387448 9388 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.6400.6 2023-10-08T15:40:51.049 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 1957200 9382 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.6400.6 2023-10-08T15:40:51.049 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 580216 18185 /usr/lib/x86_64-linux-gnu/libcurl-gnutls.so.4.6.0 2023-10-08T15:40:51.049 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 71672 15241 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-10-08T15:40:51.049 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 133200 8347 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-10-08T15:40:51.049 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 163200 8942 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-10-08T15:40:51.049 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 23160 9558 /usr/lib/x86_64-linux-gnu/libndp.so.0.1.1 2023-10-08T15:40:51.049 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 709496 10741 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.28.0 2023-10-08T15:40:51.049 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 178528 12765 /usr/lib/x86_64-linux-gnu/libudev.so.1.6.17 2023-10-08T15:40:51.049 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 1914336 8822 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.27.0 2023-10-08T15:40:51.049 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 30936 9424 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-10-08T15:40:51.050 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 18696 13609 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-10-08T15:40:51.050 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 27002 13665 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-10-08T15:40:51.050 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:51.050 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:51.050 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root 1u unix 0xffff8f390dc20000 0t0 162554 type=STREAM 2023-10-08T15:40:51.050 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root 2u unix 0xffff8f390dc20000 0t0 162554 type=STREAM 2023-10-08T15:40:51.050 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root 3u a_inode 0,14 0 13377 [eventfd] 2023-10-08T15:40:51.050 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root 4u a_inode 0,14 0 13377 [eventfd] 2023-10-08T15:40:51.050 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root 5u unix 0xffff8f38d66a4400 0t0 162556 type=DGRAM 2023-10-08T15:40:51.050 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root 6u unix 0xffff8f38c72dee80 0t0 160485 type=STREAM 2023-10-08T15:40:51.051 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root 7u a_inode 0,14 0 13377 [eventfd] 2023-10-08T15:40:51.051 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root 8r REG 0,4 0 4026532000 net 2023-10-08T15:40:51.051 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root 9r REG 0,4 0 4026532614 mnt 2023-10-08T15:40:51.051 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root 10u netlink 0t0 161697 KOBJECT_UEVENT 2023-10-08T15:40:51.051 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root 11u netlink 0t0 161698 GENERIC 2023-10-08T15:40:51.051 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root 12u netlink 0t0 161699 ROUTE 2023-10-08T15:40:51.051 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root 13r a_inode 0,14 0 13377 inotify 2023-10-08T15:40:51.051 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root 14r a_inode 0,14 0 13377 inotify 2023-10-08T15:40:51.051 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root 15u netlink 0t0 168018 KOBJECT_UEVENT 2023-10-08T15:40:51.051 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root 16u netlink 0t0 168020 KOBJECT_UEVENT 2023-10-08T15:40:51.051 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root 17u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.052 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 root 19w FIFO 0,25 0t0 881 /run/systemd/inhibit/9.ref 2023-10-08T15:40:51.052 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:51.052 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:51.052 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root txt REG 8,1 3097016 9689 /usr/sbin/NetworkManager 2023-10-08T15:40:51.052 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 223512 1068711 /usr/lib/x86_64-linux-gnu/NetworkManager/1.22.10/libnm-device-plugin-wifi.so 2023-10-08T15:40:51.052 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 325944 8767 /usr/lib/x86_64-linux-gnu/libdbus-1.so.3.19.11 2023-10-08T15:40:51.052 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 55608 16258 /usr/lib/x86_64-linux-gnu/libjansson.so.4.11.1 2023-10-08T15:40:51.052 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 27136 9595 /usr/lib/x86_64-linux-gnu/libteamdctl.so.0.1.5 2023-10-08T15:40:51.052 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 44104 1068714 /usr/lib/x86_64-linux-gnu/NetworkManager/1.22.10/libnm-settings-plugin-ifupdown.so 2023-10-08T15:40:51.053 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 148912 9522 /usr/lib/x86_64-linux-gnu/libbluetooth.so.3.19.1 2023-10-08T15:40:51.053 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 98296 1068709 /usr/lib/x86_64-linux-gnu/NetworkManager/1.22.10/libnm-device-plugin-bluetooth.so 2023-10-08T15:40:51.053 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 1017928 9550 /usr/lib/x86_64-linux-gnu/libmm-glib.so.0.8.0 2023-10-08T15:40:51.053 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 44328 1068710 /usr/lib/x86_64-linux-gnu/NetworkManager/1.22.10/libnm-device-plugin-team.so 2023-10-08T15:40:51.053 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 102864 1068715 /usr/lib/x86_64-linux-gnu/NetworkManager/1.22.10/libnm-wwan.so 2023-10-08T15:40:51.053 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 35976 1068712 /usr/lib/x86_64-linux-gnu/NetworkManager/1.22.10/libnm-device-plugin-wwan.so 2023-10-08T15:40:51.053 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:51.053 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 40088 1068708 /usr/lib/x86_64-linux-gnu/NetworkManager/1.22.10/libnm-device-plugin-adsl.so 2023-10-08T15:40:51.054 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 104984 8251 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-10-08T15:40:51.054 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 1956992 8082 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28 2023-10-08T15:40:51.054 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 133640 18368 /usr/lib/x86_64-linux-gnu/libproxy.so.1.0.0 2023-10-08T15:40:51.054 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 67656 101921 /usr/lib/x86_64-linux-gnu/gio/modules/libdconfsettings.so 2023-10-08T15:40:51.054 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 6017584 10873 /usr/lib/locale/locale-archive 2023-10-08T15:40:51.054 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:51.054 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 202760 8017 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-10-08T15:40:51.054 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 1212216 11329 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-10-08T15:40:51.054 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 313336 15785 /usr/lib/x86_64-linux-gnu/libhx509.so.5.0.0 2023-10-08T15:40:51.055 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 68752 15776 /usr/lib/x86_64-linux-gnu/libheimbase.so.1.0.0 2023-10-08T15:40:51.055 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 166040 15782 /usr/lib/x86_64-linux-gnu/libwind.so.0.0.0 2023-10-08T15:40:51.055 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 97024 15770 /usr/lib/x86_64-linux-gnu/libroken.so.18.1.0 2023-10-08T15:40:51.055 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 221816 15779 /usr/lib/x86_64-linux-gnu/libhcrypto.so.4.1.0 2023-10-08T15:40:51.055 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 678240 15773 /usr/lib/x86_64-linux-gnu/libasn1.so.8.0.0 2023-10-08T15:40:51.055 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 594104 15788 /usr/lib/x86_64-linux-gnu/libkrb5.so.26.0.0 2023-10-08T15:40:51.055 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 43712 15791 /usr/lib/x86_64-linux-gnu/libheimntlm.so.0.1.0 2023-10-08T15:40:51.055 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 22600 15019 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.8 2023-10-08T15:40:51.055 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 351352 9401 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-10-08T15:40:51.056 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 137784 15763 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.7 2023-10-08T15:40:51.056 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 278160 15794 /usr/lib/x86_64-linux-gnu/libgssapi.so.3.0.0 2023-10-08T15:40:51.056 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 113552 15797 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-10-08T15:40:51.056 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 56096 15015 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-10-08T15:40:51.056 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 22600 9279 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-10-08T15:40:51.056 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 191040 15017 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-10-08T15:40:51.056 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 902016 15021 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-10-08T15:40:51.056 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 2954080 9466 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:51.056 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 137584 8109 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.28.0 2023-10-08T15:40:51.056 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 465008 11338 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-10-08T15:40:51.057 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 43416 10645 /usr/lib/x86_64-linux-gnu/libffi.so.7.1.0 2023-10-08T15:40:51.057 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:51.057 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 387768 8064 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-10-08T15:40:51.057 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:51.057 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 51512 15764 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.7 2023-10-08T15:40:51.057 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 63888 15800 /usr/lib/x86_64-linux-gnu/liblber-2.4.so.2.10.12 2023-10-08T15:40:51.057 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 339472 15801 /usr/lib/x86_64-linux-gnu/libldap_r-2.4.so.2.10.12 2023-10-08T15:40:51.057 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 309712 15024 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-10-08T15:40:51.057 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 445976 15809 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.4 2023-10-08T15:40:51.058 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 125960 15808 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-10-08T15:40:51.058 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 162160 15806 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.19.0 2023-10-08T15:40:51.058 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 27064 8001 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-10-08T15:40:51.058 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 584392 8917 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.9.0 2023-10-08T15:40:51.058 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 1168056 8360 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.2.5 2023-10-08T15:40:51.058 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 129248 13039 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.2 2023-10-08T15:40:51.058 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:51.058 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:51.059 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 534880 10650 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.0 2023-10-08T15:40:51.059 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 219976 8813 /usr/lib/x86_64-linux-gnu/libhogweed.so.5.0 2023-10-08T15:40:51.059 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 231592 8806 /usr/lib/x86_64-linux-gnu/libnettle.so.7.0 2023-10-08T15:40:51.059 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 84120 10728 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.0 2023-10-08T15:40:51.059 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 1575112 10736 /usr/lib/x86_64-linux-gnu/libunistring.so.2.1.0 2023-10-08T15:40:51.059 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 129096 10669 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.6 2023-10-08T15:40:51.059 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 1265624 8816 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-10-08T15:40:51.059 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:51.059 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:51.059 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:51.060 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 1207920 9384 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.6400.6 2023-10-08T15:40:51.060 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 18640 9386 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.6400.6 2023-10-08T15:40:51.060 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 387448 9388 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.6400.6 2023-10-08T15:40:51.060 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 1957200 9382 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.6400.6 2023-10-08T15:40:51.060 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 580216 18185 /usr/lib/x86_64-linux-gnu/libcurl-gnutls.so.4.6.0 2023-10-08T15:40:51.060 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 71672 15241 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-10-08T15:40:51.060 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 133200 8347 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-10-08T15:40:51.060 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 163200 8942 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-10-08T15:40:51.060 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 23160 9558 /usr/lib/x86_64-linux-gnu/libndp.so.0.1.1 2023-10-08T15:40:51.060 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 709496 10741 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.28.0 2023-10-08T15:40:51.061 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 178528 12765 /usr/lib/x86_64-linux-gnu/libudev.so.1.6.17 2023-10-08T15:40:51.061 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 1914336 8822 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.27.0 2023-10-08T15:40:51.061 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 30936 9424 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-10-08T15:40:51.061 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 18696 13609 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-10-08T15:40:51.061 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 27002 13665 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-10-08T15:40:51.061 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:51.061 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:51.061 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root 1u unix 0xffff8f390dc20000 0t0 162554 type=STREAM 2023-10-08T15:40:51.061 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root 2u unix 0xffff8f390dc20000 0t0 162554 type=STREAM 2023-10-08T15:40:51.061 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root 3u a_inode 0,14 0 13377 [eventfd] 2023-10-08T15:40:51.062 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root 4u a_inode 0,14 0 13377 [eventfd] 2023-10-08T15:40:51.062 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root 5u unix 0xffff8f38d66a4400 0t0 162556 type=DGRAM 2023-10-08T15:40:51.062 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root 6u unix 0xffff8f38c72dee80 0t0 160485 type=STREAM 2023-10-08T15:40:51.062 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root 7u a_inode 0,14 0 13377 [eventfd] 2023-10-08T15:40:51.062 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root 8r REG 0,4 0 4026532000 net 2023-10-08T15:40:51.062 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root 9r REG 0,4 0 4026532614 mnt 2023-10-08T15:40:51.062 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root 10u netlink 0t0 161697 KOBJECT_UEVENT 2023-10-08T15:40:51.062 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root 11u netlink 0t0 161698 GENERIC 2023-10-08T15:40:51.062 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root 12u netlink 0t0 161699 ROUTE 2023-10-08T15:40:51.062 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root 13r a_inode 0,14 0 13377 inotify 2023-10-08T15:40:51.063 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root 14r a_inode 0,14 0 13377 inotify 2023-10-08T15:40:51.063 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root 15u netlink 0t0 168018 KOBJECT_UEVENT 2023-10-08T15:40:51.063 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root 16u netlink 0t0 168020 KOBJECT_UEVENT 2023-10-08T15:40:51.063 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root 17u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.063 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27313 gmain root 19w FIFO 0,25 0t0 881 /run/systemd/inhibit/9.ref 2023-10-08T15:40:51.063 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:51.063 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:51.063 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root txt REG 8,1 3097016 9689 /usr/sbin/NetworkManager 2023-10-08T15:40:51.063 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 223512 1068711 /usr/lib/x86_64-linux-gnu/NetworkManager/1.22.10/libnm-device-plugin-wifi.so 2023-10-08T15:40:51.063 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 325944 8767 /usr/lib/x86_64-linux-gnu/libdbus-1.so.3.19.11 2023-10-08T15:40:51.063 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 55608 16258 /usr/lib/x86_64-linux-gnu/libjansson.so.4.11.1 2023-10-08T15:40:51.064 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 27136 9595 /usr/lib/x86_64-linux-gnu/libteamdctl.so.0.1.5 2023-10-08T15:40:51.064 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 44104 1068714 /usr/lib/x86_64-linux-gnu/NetworkManager/1.22.10/libnm-settings-plugin-ifupdown.so 2023-10-08T15:40:51.064 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 148912 9522 /usr/lib/x86_64-linux-gnu/libbluetooth.so.3.19.1 2023-10-08T15:40:51.064 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 98296 1068709 /usr/lib/x86_64-linux-gnu/NetworkManager/1.22.10/libnm-device-plugin-bluetooth.so 2023-10-08T15:40:51.064 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 1017928 9550 /usr/lib/x86_64-linux-gnu/libmm-glib.so.0.8.0 2023-10-08T15:40:51.064 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 44328 1068710 /usr/lib/x86_64-linux-gnu/NetworkManager/1.22.10/libnm-device-plugin-team.so 2023-10-08T15:40:51.064 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 102864 1068715 /usr/lib/x86_64-linux-gnu/NetworkManager/1.22.10/libnm-wwan.so 2023-10-08T15:40:51.064 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 35976 1068712 /usr/lib/x86_64-linux-gnu/NetworkManager/1.22.10/libnm-device-plugin-wwan.so 2023-10-08T15:40:51.064 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:51.064 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 40088 1068708 /usr/lib/x86_64-linux-gnu/NetworkManager/1.22.10/libnm-device-plugin-adsl.so 2023-10-08T15:40:51.064 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 104984 8251 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-10-08T15:40:51.065 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 1956992 8082 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28 2023-10-08T15:40:51.065 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 133640 18368 /usr/lib/x86_64-linux-gnu/libproxy.so.1.0.0 2023-10-08T15:40:51.065 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 67656 101921 /usr/lib/x86_64-linux-gnu/gio/modules/libdconfsettings.so 2023-10-08T15:40:51.065 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 6017584 10873 /usr/lib/locale/locale-archive 2023-10-08T15:40:51.065 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:51.065 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 202760 8017 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-10-08T15:40:51.065 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 1212216 11329 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-10-08T15:40:51.065 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 313336 15785 /usr/lib/x86_64-linux-gnu/libhx509.so.5.0.0 2023-10-08T15:40:51.065 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 68752 15776 /usr/lib/x86_64-linux-gnu/libheimbase.so.1.0.0 2023-10-08T15:40:51.065 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 166040 15782 /usr/lib/x86_64-linux-gnu/libwind.so.0.0.0 2023-10-08T15:40:51.066 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 97024 15770 /usr/lib/x86_64-linux-gnu/libroken.so.18.1.0 2023-10-08T15:40:51.066 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 221816 15779 /usr/lib/x86_64-linux-gnu/libhcrypto.so.4.1.0 2023-10-08T15:40:51.066 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 678240 15773 /usr/lib/x86_64-linux-gnu/libasn1.so.8.0.0 2023-10-08T15:40:51.066 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 594104 15788 /usr/lib/x86_64-linux-gnu/libkrb5.so.26.0.0 2023-10-08T15:40:51.066 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 43712 15791 /usr/lib/x86_64-linux-gnu/libheimntlm.so.0.1.0 2023-10-08T15:40:51.066 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 22600 15019 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.8 2023-10-08T15:40:51.066 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 351352 9401 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-10-08T15:40:51.066 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 137784 15763 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.7 2023-10-08T15:40:51.066 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 278160 15794 /usr/lib/x86_64-linux-gnu/libgssapi.so.3.0.0 2023-10-08T15:40:51.066 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 113552 15797 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-10-08T15:40:51.067 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 56096 15015 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-10-08T15:40:51.067 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 22600 9279 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-10-08T15:40:51.067 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 191040 15017 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-10-08T15:40:51.067 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 902016 15021 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-10-08T15:40:51.067 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 2954080 9466 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:51.067 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 137584 8109 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.28.0 2023-10-08T15:40:51.067 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 465008 11338 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-10-08T15:40:51.067 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 43416 10645 /usr/lib/x86_64-linux-gnu/libffi.so.7.1.0 2023-10-08T15:40:51.067 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:51.067 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 387768 8064 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-10-08T15:40:51.067 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:51.067 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 51512 15764 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.7 2023-10-08T15:40:51.068 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 63888 15800 /usr/lib/x86_64-linux-gnu/liblber-2.4.so.2.10.12 2023-10-08T15:40:51.068 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 339472 15801 /usr/lib/x86_64-linux-gnu/libldap_r-2.4.so.2.10.12 2023-10-08T15:40:51.068 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 309712 15024 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-10-08T15:40:51.068 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 445976 15809 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.4 2023-10-08T15:40:51.068 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 125960 15808 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-10-08T15:40:51.068 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 162160 15806 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.19.0 2023-10-08T15:40:51.068 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 27064 8001 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-10-08T15:40:51.068 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 584392 8917 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.9.0 2023-10-08T15:40:51.068 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 1168056 8360 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.2.5 2023-10-08T15:40:51.068 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 129248 13039 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.2 2023-10-08T15:40:51.069 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:51.069 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:51.069 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 534880 10650 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.0 2023-10-08T15:40:51.069 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 219976 8813 /usr/lib/x86_64-linux-gnu/libhogweed.so.5.0 2023-10-08T15:40:51.069 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 231592 8806 /usr/lib/x86_64-linux-gnu/libnettle.so.7.0 2023-10-08T15:40:51.069 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 84120 10728 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.0 2023-10-08T15:40:51.069 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 1575112 10736 /usr/lib/x86_64-linux-gnu/libunistring.so.2.1.0 2023-10-08T15:40:51.069 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 129096 10669 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.6 2023-10-08T15:40:51.069 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 1265624 8816 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-10-08T15:40:51.069 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:51.070 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:51.070 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:51.070 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 1207920 9384 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.6400.6 2023-10-08T15:40:51.070 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 18640 9386 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.6400.6 2023-10-08T15:40:51.070 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 387448 9388 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.6400.6 2023-10-08T15:40:51.070 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 1957200 9382 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.6400.6 2023-10-08T15:40:51.070 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 580216 18185 /usr/lib/x86_64-linux-gnu/libcurl-gnutls.so.4.6.0 2023-10-08T15:40:51.070 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 71672 15241 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-10-08T15:40:51.071 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 133200 8347 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-10-08T15:40:51.071 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 163200 8942 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-10-08T15:40:51.071 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 23160 9558 /usr/lib/x86_64-linux-gnu/libndp.so.0.1.1 2023-10-08T15:40:51.071 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 709496 10741 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.28.0 2023-10-08T15:40:51.071 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 178528 12765 /usr/lib/x86_64-linux-gnu/libudev.so.1.6.17 2023-10-08T15:40:51.071 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 1914336 8822 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.27.0 2023-10-08T15:40:51.071 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 30936 9424 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-10-08T15:40:51.071 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 18696 13609 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-10-08T15:40:51.071 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 27002 13665 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-10-08T15:40:51.071 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:51.071 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:51.072 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root 1u unix 0xffff8f390dc20000 0t0 162554 type=STREAM 2023-10-08T15:40:51.072 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root 2u unix 0xffff8f390dc20000 0t0 162554 type=STREAM 2023-10-08T15:40:51.072 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root 3u a_inode 0,14 0 13377 [eventfd] 2023-10-08T15:40:51.072 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root 4u a_inode 0,14 0 13377 [eventfd] 2023-10-08T15:40:51.072 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root 5u unix 0xffff8f38d66a4400 0t0 162556 type=DGRAM 2023-10-08T15:40:51.072 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root 6u unix 0xffff8f38c72dee80 0t0 160485 type=STREAM 2023-10-08T15:40:51.072 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root 7u a_inode 0,14 0 13377 [eventfd] 2023-10-08T15:40:51.072 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root 8r REG 0,4 0 4026532000 net 2023-10-08T15:40:51.072 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root 9r REG 0,4 0 4026532614 mnt 2023-10-08T15:40:51.073 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root 10u netlink 0t0 161697 KOBJECT_UEVENT 2023-10-08T15:40:51.073 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root 11u netlink 0t0 161698 GENERIC 2023-10-08T15:40:51.073 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root 12u netlink 0t0 161699 ROUTE 2023-10-08T15:40:51.073 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root 13r a_inode 0,14 0 13377 inotify 2023-10-08T15:40:51.073 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root 14r a_inode 0,14 0 13377 inotify 2023-10-08T15:40:51.073 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root 15u netlink 0t0 168018 KOBJECT_UEVENT 2023-10-08T15:40:51.073 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root 16u netlink 0t0 168020 KOBJECT_UEVENT 2023-10-08T15:40:51.073 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root 17u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.073 INFO:teuthology.orchestra.run.smithi089.stdout:NetworkMa 27302 27318 gdbus root 19w FIFO 0,25 0t0 881 /run/systemd/inhibit/9.ref 2023-10-08T15:40:51.074 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:51.074 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:51.074 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root txt REG 8,1 1915728 9631 /usr/sbin/ModemManager 2023-10-08T15:40:51.074 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:51.074 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 104984 8251 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-10-08T15:40:51.074 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 1956992 8082 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28 2023-10-08T15:40:51.074 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 133640 18368 /usr/lib/x86_64-linux-gnu/libproxy.so.1.0.0 2023-10-08T15:40:51.074 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 67656 101921 /usr/lib/x86_64-linux-gnu/gio/modules/libdconfsettings.so 2023-10-08T15:40:51.074 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 14392 1068585 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-generic.so 2023-10-08T15:40:51.074 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 22816 1068580 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-dell.so 2023-10-08T15:40:51.075 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 18608 1068590 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-linktop.so 2023-10-08T15:40:51.075 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 22736 1068577 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-anydata.so 2023-10-08T15:40:51.075 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 14424 1068601 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-qcom-soc.so 2023-10-08T15:40:51.075 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 14360 1068603 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-samsung.so 2023-10-08T15:40:51.075 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 31008 1068614 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-zte.so 2023-10-08T15:40:51.075 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 26944 1068613 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-x22x.so 2023-10-08T15:40:51.075 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 47392 1068576 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-altair-lte.so 2023-10-08T15:40:51.075 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 43336 1068602 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-quectel.so 2023-10-08T15:40:51.075 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 14392 1068584 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-foxconn.so 2023-10-08T15:40:51.075 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 26944 1068589 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-iridium.so 2023-10-08T15:40:51.076 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 22784 1068611 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-via.so 2023-10-08T15:40:51.076 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 14416 1068586 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-gosuncn.so 2023-10-08T15:40:51.076 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 14384 1068578 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-broadmobi.so 2023-10-08T15:40:51.076 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 133440 1068579 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-cinterion.so 2023-10-08T15:40:51.076 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 63776 1068606 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-simtech.so 2023-10-08T15:40:51.076 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 14352 1068587 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-haier.so 2023-10-08T15:40:51.076 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 14384 1068581 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-dlink.so 2023-10-08T15:40:51.076 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 14384 1068609 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-tplink.so 2023-10-08T15:40:51.076 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 30992 1068593 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-mtk.so 2023-10-08T15:40:51.077 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 30912 1068612 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-wavecom.so 2023-10-08T15:40:51.077 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 14512 1068592 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-motorola.so 2023-10-08T15:40:51.077 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 14464 1068597 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-novatel.so 2023-10-08T15:40:51.077 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 14416 1068605 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-sierra.so 2023-10-08T15:40:51.077 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 14400 1068599 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-option.so 2023-10-08T15:40:51.077 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 22872 1068595 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-nokia.so 2023-10-08T15:40:51.077 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 14416 1068583 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-fibocom.so 2023-10-08T15:40:51.077 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 63808 1068582 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-ericsson-mbm.so 2023-10-08T15:40:51.077 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 22704 1068608 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-thuraya.so 2023-10-08T15:40:51.077 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 14440 1068594 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-nokia-icera.so 2023-10-08T15:40:51.078 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 39328 1068596 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-novatel-lte.so 2023-10-08T15:40:51.078 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 14496 1068607 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-telit.so 2023-10-08T15:40:51.078 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 129376 1068588 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-huawei.so 2023-10-08T15:40:51.078 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 100632 1068610 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-ublox.so 2023-10-08T15:40:51.078 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 22816 1068600 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-pantech.so 2023-10-08T15:40:51.078 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 47416 1068598 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-option-hso.so 2023-10-08T15:40:51.078 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 22800 1068591 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-longcheer.so 2023-10-08T15:40:51.078 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 43176 1068617 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-novatel.so 2023-10-08T15:40:51.078 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 67832 1068620 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-telit.so 2023-10-08T15:40:51.079 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 71928 1068616 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-icera.so 2023-10-08T15:40:51.079 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 63736 1068619 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-sierra.so 2023-10-08T15:40:51.079 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 59640 1068621 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-xmm.so 2023-10-08T15:40:51.079 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 30968 1068618 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-option.so 2023-10-08T15:40:51.079 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 22696 1068615 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-foxconn.so 2023-10-08T15:40:51.079 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 18696 13555 /usr/lib/x86_64-linux-gnu/gconv/IBM850.so 2023-10-08T15:40:51.079 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 18760 1068604 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-sierra-legacy.so 2023-10-08T15:40:51.079 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 137584 8109 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.28.0 2023-10-08T15:40:51.079 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 584392 8917 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.9.0 2023-10-08T15:40:51.079 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 351352 9401 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-10-08T15:40:51.080 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 1168056 8360 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.2.5 2023-10-08T15:40:51.080 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 129248 13039 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.2 2023-10-08T15:40:51.080 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:51.080 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:51.080 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 465008 11338 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-10-08T15:40:51.080 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 43416 10645 /usr/lib/x86_64-linux-gnu/libffi.so.7.1.0 2023-10-08T15:40:51.080 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:51.080 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 163200 8942 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-10-08T15:40:51.080 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 387768 8064 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-10-08T15:40:51.081 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:51.081 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 178528 12765 /usr/lib/x86_64-linux-gnu/libudev.so.1.6.17 2023-10-08T15:40:51.081 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:51.081 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:51.081 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:51.081 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 709496 10741 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.28.0 2023-10-08T15:40:51.081 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 1207920 9384 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.6400.6 2023-10-08T15:40:51.081 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 387448 9388 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.6400.6 2023-10-08T15:40:51.081 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 1957200 9382 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.6400.6 2023-10-08T15:40:51.082 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 126472 12515 /usr/lib/x86_64-linux-gnu/libpolkit-gobject-1.so.0.0.0 2023-10-08T15:40:51.082 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 448584 9538 /usr/lib/x86_64-linux-gnu/libmbim-glib.so.4.6.0 2023-10-08T15:40:51.082 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 3278920 9570 /usr/lib/x86_64-linux-gnu/libqmi-glib.so.5.8.0 2023-10-08T15:40:51.082 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 47176 18423 /usr/lib/x86_64-linux-gnu/libgudev-1.0.so.0.2.0 2023-10-08T15:40:51.082 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 18640 9386 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.6400.6 2023-10-08T15:40:51.082 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 1017928 9550 /usr/lib/x86_64-linux-gnu/libmm-glib.so.0.8.0 2023-10-08T15:40:51.082 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 18720 13660 /usr/lib/x86_64-linux-gnu/gconv/UTF-16.so 2023-10-08T15:40:51.082 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 27002 13665 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-10-08T15:40:51.082 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:51.082 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:51.083 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root 1u unix 0xffff8f3919b050c0 0t0 160604 type=STREAM 2023-10-08T15:40:51.083 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root 2w CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:51.083 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root 3u a_inode 0,14 0 13377 [eventfd] 2023-10-08T15:40:51.083 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root 4u a_inode 0,14 0 13377 [eventfd] 2023-10-08T15:40:51.083 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root 5u unix 0xffff8f38d78b5d80 0t0 165772 type=DGRAM 2023-10-08T15:40:51.083 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root 6u unix 0xffff8f3911b1aec0 0t0 160610 type=STREAM 2023-10-08T15:40:51.083 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root 7u a_inode 0,14 0 13377 [eventfd] 2023-10-08T15:40:51.083 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root 8u netlink 0t0 165773 KOBJECT_UEVENT 2023-10-08T15:40:51.083 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 root 10w FIFO 0,25 0t0 886 /run/systemd/inhibit/10.ref 2023-10-08T15:40:51.084 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:51.084 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:51.084 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root txt REG 8,1 1915728 9631 /usr/sbin/ModemManager 2023-10-08T15:40:51.084 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:51.084 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 104984 8251 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-10-08T15:40:51.084 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 1956992 8082 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28 2023-10-08T15:40:51.084 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 133640 18368 /usr/lib/x86_64-linux-gnu/libproxy.so.1.0.0 2023-10-08T15:40:51.084 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 67656 101921 /usr/lib/x86_64-linux-gnu/gio/modules/libdconfsettings.so 2023-10-08T15:40:51.084 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 14392 1068585 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-generic.so 2023-10-08T15:40:51.084 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 22816 1068580 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-dell.so 2023-10-08T15:40:51.085 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 18608 1068590 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-linktop.so 2023-10-08T15:40:51.085 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 22736 1068577 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-anydata.so 2023-10-08T15:40:51.085 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 14424 1068601 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-qcom-soc.so 2023-10-08T15:40:51.085 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 14360 1068603 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-samsung.so 2023-10-08T15:40:51.085 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 31008 1068614 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-zte.so 2023-10-08T15:40:51.085 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 26944 1068613 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-x22x.so 2023-10-08T15:40:51.085 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 47392 1068576 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-altair-lte.so 2023-10-08T15:40:51.085 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 43336 1068602 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-quectel.so 2023-10-08T15:40:51.085 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 14392 1068584 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-foxconn.so 2023-10-08T15:40:51.086 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 26944 1068589 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-iridium.so 2023-10-08T15:40:51.086 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 22784 1068611 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-via.so 2023-10-08T15:40:51.086 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 14416 1068586 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-gosuncn.so 2023-10-08T15:40:51.086 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 14384 1068578 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-broadmobi.so 2023-10-08T15:40:51.086 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 133440 1068579 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-cinterion.so 2023-10-08T15:40:51.086 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 63776 1068606 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-simtech.so 2023-10-08T15:40:51.086 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 14352 1068587 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-haier.so 2023-10-08T15:40:51.086 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 14384 1068581 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-dlink.so 2023-10-08T15:40:51.086 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 14384 1068609 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-tplink.so 2023-10-08T15:40:51.087 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 30992 1068593 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-mtk.so 2023-10-08T15:40:51.087 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 30912 1068612 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-wavecom.so 2023-10-08T15:40:51.087 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 14512 1068592 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-motorola.so 2023-10-08T15:40:51.087 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 14464 1068597 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-novatel.so 2023-10-08T15:40:51.087 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 14416 1068605 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-sierra.so 2023-10-08T15:40:51.087 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 14400 1068599 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-option.so 2023-10-08T15:40:51.087 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 22872 1068595 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-nokia.so 2023-10-08T15:40:51.087 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 14416 1068583 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-fibocom.so 2023-10-08T15:40:51.087 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 63808 1068582 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-ericsson-mbm.so 2023-10-08T15:40:51.088 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 22704 1068608 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-thuraya.so 2023-10-08T15:40:51.088 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 14440 1068594 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-nokia-icera.so 2023-10-08T15:40:51.088 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 39328 1068596 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-novatel-lte.so 2023-10-08T15:40:51.088 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 14496 1068607 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-telit.so 2023-10-08T15:40:51.088 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 129376 1068588 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-huawei.so 2023-10-08T15:40:51.088 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 100632 1068610 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-ublox.so 2023-10-08T15:40:51.088 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 22816 1068600 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-pantech.so 2023-10-08T15:40:51.088 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 47416 1068598 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-option-hso.so 2023-10-08T15:40:51.088 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 22800 1068591 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-longcheer.so 2023-10-08T15:40:51.089 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 43176 1068617 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-novatel.so 2023-10-08T15:40:51.089 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 67832 1068620 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-telit.so 2023-10-08T15:40:51.089 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 71928 1068616 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-icera.so 2023-10-08T15:40:51.089 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 63736 1068619 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-sierra.so 2023-10-08T15:40:51.089 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 59640 1068621 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-xmm.so 2023-10-08T15:40:51.089 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 30968 1068618 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-option.so 2023-10-08T15:40:51.089 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 22696 1068615 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-foxconn.so 2023-10-08T15:40:51.089 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 18696 13555 /usr/lib/x86_64-linux-gnu/gconv/IBM850.so 2023-10-08T15:40:51.089 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 18760 1068604 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-sierra-legacy.so 2023-10-08T15:40:51.089 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 137584 8109 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.28.0 2023-10-08T15:40:51.089 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 584392 8917 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.9.0 2023-10-08T15:40:51.090 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 351352 9401 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-10-08T15:40:51.090 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 1168056 8360 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.2.5 2023-10-08T15:40:51.090 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 129248 13039 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.2 2023-10-08T15:40:51.090 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:51.090 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:51.090 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 465008 11338 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-10-08T15:40:51.090 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 43416 10645 /usr/lib/x86_64-linux-gnu/libffi.so.7.1.0 2023-10-08T15:40:51.090 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:51.090 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 163200 8942 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-10-08T15:40:51.090 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 387768 8064 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-10-08T15:40:51.090 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:51.090 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 178528 12765 /usr/lib/x86_64-linux-gnu/libudev.so.1.6.17 2023-10-08T15:40:51.091 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:51.091 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:51.091 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:51.091 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 709496 10741 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.28.0 2023-10-08T15:40:51.091 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 1207920 9384 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.6400.6 2023-10-08T15:40:51.091 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 387448 9388 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.6400.6 2023-10-08T15:40:51.091 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 1957200 9382 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.6400.6 2023-10-08T15:40:51.091 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 126472 12515 /usr/lib/x86_64-linux-gnu/libpolkit-gobject-1.so.0.0.0 2023-10-08T15:40:51.091 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 448584 9538 /usr/lib/x86_64-linux-gnu/libmbim-glib.so.4.6.0 2023-10-08T15:40:51.091 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 3278920 9570 /usr/lib/x86_64-linux-gnu/libqmi-glib.so.5.8.0 2023-10-08T15:40:51.091 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 47176 18423 /usr/lib/x86_64-linux-gnu/libgudev-1.0.so.0.2.0 2023-10-08T15:40:51.092 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 18640 9386 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.6400.6 2023-10-08T15:40:51.092 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 1017928 9550 /usr/lib/x86_64-linux-gnu/libmm-glib.so.0.8.0 2023-10-08T15:40:51.092 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 18720 13660 /usr/lib/x86_64-linux-gnu/gconv/UTF-16.so 2023-10-08T15:40:51.092 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 27002 13665 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-10-08T15:40:51.092 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:51.092 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:51.092 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root 1u unix 0xffff8f3919b050c0 0t0 160604 type=STREAM 2023-10-08T15:40:51.092 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root 2w CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:51.092 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root 3u a_inode 0,14 0 13377 [eventfd] 2023-10-08T15:40:51.092 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root 4u a_inode 0,14 0 13377 [eventfd] 2023-10-08T15:40:51.092 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root 5u unix 0xffff8f38d78b5d80 0t0 165772 type=DGRAM 2023-10-08T15:40:51.093 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root 6u unix 0xffff8f3911b1aec0 0t0 160610 type=STREAM 2023-10-08T15:40:51.093 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root 7u a_inode 0,14 0 13377 [eventfd] 2023-10-08T15:40:51.093 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root 8u netlink 0t0 165773 KOBJECT_UEVENT 2023-10-08T15:40:51.093 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27400 gmain root 10w FIFO 0,25 0t0 886 /run/systemd/inhibit/10.ref 2023-10-08T15:40:51.093 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:51.093 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:51.093 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root txt REG 8,1 1915728 9631 /usr/sbin/ModemManager 2023-10-08T15:40:51.093 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:51.093 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 104984 8251 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-10-08T15:40:51.093 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 1956992 8082 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28 2023-10-08T15:40:51.093 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 133640 18368 /usr/lib/x86_64-linux-gnu/libproxy.so.1.0.0 2023-10-08T15:40:51.093 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 67656 101921 /usr/lib/x86_64-linux-gnu/gio/modules/libdconfsettings.so 2023-10-08T15:40:51.094 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 14392 1068585 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-generic.so 2023-10-08T15:40:51.094 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 22816 1068580 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-dell.so 2023-10-08T15:40:51.094 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 18608 1068590 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-linktop.so 2023-10-08T15:40:51.094 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 22736 1068577 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-anydata.so 2023-10-08T15:40:51.094 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 14424 1068601 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-qcom-soc.so 2023-10-08T15:40:51.094 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 14360 1068603 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-samsung.so 2023-10-08T15:40:51.094 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 31008 1068614 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-zte.so 2023-10-08T15:40:51.094 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 26944 1068613 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-x22x.so 2023-10-08T15:40:51.094 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 47392 1068576 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-altair-lte.so 2023-10-08T15:40:51.094 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 43336 1068602 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-quectel.so 2023-10-08T15:40:51.094 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 14392 1068584 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-foxconn.so 2023-10-08T15:40:51.095 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 26944 1068589 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-iridium.so 2023-10-08T15:40:51.095 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 22784 1068611 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-via.so 2023-10-08T15:40:51.095 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 14416 1068586 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-gosuncn.so 2023-10-08T15:40:51.095 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 14384 1068578 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-broadmobi.so 2023-10-08T15:40:51.095 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 133440 1068579 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-cinterion.so 2023-10-08T15:40:51.095 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 63776 1068606 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-simtech.so 2023-10-08T15:40:51.095 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 14352 1068587 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-haier.so 2023-10-08T15:40:51.095 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 14384 1068581 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-dlink.so 2023-10-08T15:40:51.095 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 14384 1068609 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-tplink.so 2023-10-08T15:40:51.095 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 30992 1068593 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-mtk.so 2023-10-08T15:40:51.097 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 30912 1068612 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-wavecom.so 2023-10-08T15:40:51.097 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 14512 1068592 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-motorola.so 2023-10-08T15:40:51.097 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 14464 1068597 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-novatel.so 2023-10-08T15:40:51.097 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 14416 1068605 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-sierra.so 2023-10-08T15:40:51.097 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 14400 1068599 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-option.so 2023-10-08T15:40:51.097 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 22872 1068595 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-nokia.so 2023-10-08T15:40:51.097 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 14416 1068583 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-fibocom.so 2023-10-08T15:40:51.097 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 63808 1068582 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-ericsson-mbm.so 2023-10-08T15:40:51.098 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 22704 1068608 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-thuraya.so 2023-10-08T15:40:51.098 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 14440 1068594 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-nokia-icera.so 2023-10-08T15:40:51.098 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 39328 1068596 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-novatel-lte.so 2023-10-08T15:40:51.098 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 14496 1068607 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-telit.so 2023-10-08T15:40:51.098 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 129376 1068588 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-huawei.so 2023-10-08T15:40:51.098 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 100632 1068610 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-ublox.so 2023-10-08T15:40:51.098 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 22816 1068600 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-pantech.so 2023-10-08T15:40:51.098 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 47416 1068598 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-option-hso.so 2023-10-08T15:40:51.098 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 22800 1068591 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-longcheer.so 2023-10-08T15:40:51.099 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 43176 1068617 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-novatel.so 2023-10-08T15:40:51.099 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 67832 1068620 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-telit.so 2023-10-08T15:40:51.099 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 71928 1068616 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-icera.so 2023-10-08T15:40:51.099 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 63736 1068619 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-sierra.so 2023-10-08T15:40:51.099 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 59640 1068621 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-xmm.so 2023-10-08T15:40:51.099 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 30968 1068618 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-option.so 2023-10-08T15:40:51.099 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 22696 1068615 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-foxconn.so 2023-10-08T15:40:51.099 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 18696 13555 /usr/lib/x86_64-linux-gnu/gconv/IBM850.so 2023-10-08T15:40:51.099 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 18760 1068604 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-sierra-legacy.so 2023-10-08T15:40:51.099 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 137584 8109 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.28.0 2023-10-08T15:40:51.100 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 584392 8917 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.9.0 2023-10-08T15:40:51.100 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 351352 9401 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-10-08T15:40:51.100 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 1168056 8360 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.2.5 2023-10-08T15:40:51.100 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 129248 13039 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.2 2023-10-08T15:40:51.100 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:51.100 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 35960 13413 /usr/lib/x86_64-linux-gnu/librt-2.31.so 2023-10-08T15:40:51.100 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 465008 11338 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-10-08T15:40:51.100 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 43416 10645 /usr/lib/x86_64-linux-gnu/libffi.so.7.1.0 2023-10-08T15:40:51.100 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:51.101 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 163200 8942 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-10-08T15:40:51.101 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 387768 8064 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-10-08T15:40:51.101 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:51.101 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 178528 12765 /usr/lib/x86_64-linux-gnu/libudev.so.1.6.17 2023-10-08T15:40:51.101 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:51.101 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:51.101 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:51.101 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 709496 10741 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.28.0 2023-10-08T15:40:51.101 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 1207920 9384 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.6400.6 2023-10-08T15:40:51.101 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 387448 9388 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.6400.6 2023-10-08T15:40:51.102 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 1957200 9382 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.6400.6 2023-10-08T15:40:51.102 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 126472 12515 /usr/lib/x86_64-linux-gnu/libpolkit-gobject-1.so.0.0.0 2023-10-08T15:40:51.102 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 448584 9538 /usr/lib/x86_64-linux-gnu/libmbim-glib.so.4.6.0 2023-10-08T15:40:51.102 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 3278920 9570 /usr/lib/x86_64-linux-gnu/libqmi-glib.so.5.8.0 2023-10-08T15:40:51.102 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 47176 18423 /usr/lib/x86_64-linux-gnu/libgudev-1.0.so.0.2.0 2023-10-08T15:40:51.102 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 18640 9386 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.6400.6 2023-10-08T15:40:51.102 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 1017928 9550 /usr/lib/x86_64-linux-gnu/libmm-glib.so.0.8.0 2023-10-08T15:40:51.102 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 18720 13660 /usr/lib/x86_64-linux-gnu/gconv/UTF-16.so 2023-10-08T15:40:51.102 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 27002 13665 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-10-08T15:40:51.103 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:51.103 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:51.103 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root 1u unix 0xffff8f3919b050c0 0t0 160604 type=STREAM 2023-10-08T15:40:51.103 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root 2w CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:51.103 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root 3u a_inode 0,14 0 13377 [eventfd] 2023-10-08T15:40:51.103 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root 4u a_inode 0,14 0 13377 [eventfd] 2023-10-08T15:40:51.103 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root 5u unix 0xffff8f38d78b5d80 0t0 165772 type=DGRAM 2023-10-08T15:40:51.103 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root 6u unix 0xffff8f3911b1aec0 0t0 160610 type=STREAM 2023-10-08T15:40:51.103 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root 7u a_inode 0,14 0 13377 [eventfd] 2023-10-08T15:40:51.104 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root 8u netlink 0t0 165773 KOBJECT_UEVENT 2023-10-08T15:40:51.104 INFO:teuthology.orchestra.run.smithi089.stdout:ModemMana 27386 27403 gdbus root 10w FIFO 0,25 0t0 886 /run/systemd/inhibit/10.ref 2023-10-08T15:40:51.104 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/2 28449 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:51.104 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/2 28449 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:51.104 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/2 28449 root txt unknown /proc/28449/exe 2023-10-08T15:40:51.104 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/2 28450 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:51.104 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/2 28450 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:51.104 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/2 28450 root txt unknown /proc/28450/exe 2023-10-08T15:40:51.104 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/4 28523 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:51.105 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/4 28523 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:51.105 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/4 28523 root txt unknown /proc/28523/exe 2023-10-08T15:40:51.105 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/4 28524 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:51.105 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/4 28524 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:51.105 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/4 28524 root txt unknown /proc/28524/exe 2023-10-08T15:40:51.105 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/4 28525 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:51.105 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/4 28525 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:51.105 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/4 28525 root txt unknown /proc/28525/exe 2023-10-08T15:40:51.105 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/1 28587 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:51.105 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/1 28587 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:51.106 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/1 28587 root txt unknown /proc/28587/exe 2023-10-08T15:40:51.106 INFO:teuthology.orchestra.run.smithi089.stdout:bash 28914 ubuntu cwd DIR 8,1 4096 6670 /home/ubuntu 2023-10-08T15:40:51.106 INFO:teuthology.orchestra.run.smithi089.stdout:bash 28914 ubuntu rtd DIR 8,1 4096 2 / 2023-10-08T15:40:51.106 INFO:teuthology.orchestra.run.smithi089.stdout:bash 28914 ubuntu txt REG 8,1 1183448 7751 /usr/bin/bash 2023-10-08T15:40:51.106 INFO:teuthology.orchestra.run.smithi089.stdout:bash 28914 ubuntu mem REG 8,1 6017584 10873 /usr/lib/locale/locale-archive 2023-10-08T15:40:51.106 INFO:teuthology.orchestra.run.smithi089.stdout:bash 28914 ubuntu mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:51.106 INFO:teuthology.orchestra.run.smithi089.stdout:bash 28914 ubuntu mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:51.106 INFO:teuthology.orchestra.run.smithi089.stdout:bash 28914 ubuntu mem REG 8,1 192032 8967 /usr/lib/x86_64-linux-gnu/libtinfo.so.6.2 2023-10-08T15:40:51.106 INFO:teuthology.orchestra.run.smithi089.stdout:bash 28914 ubuntu mem REG 8,1 18696 13609 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-10-08T15:40:51.107 INFO:teuthology.orchestra.run.smithi089.stdout:bash 28914 ubuntu mem REG 8,1 27002 13665 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-10-08T15:40:51.107 INFO:teuthology.orchestra.run.smithi089.stdout:bash 28914 ubuntu mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:51.107 INFO:teuthology.orchestra.run.smithi089.stdout:bash 28914 ubuntu 0r FIFO 0,13 0t0 167763 pipe 2023-10-08T15:40:51.107 INFO:teuthology.orchestra.run.smithi089.stdout:bash 28914 ubuntu 1w FIFO 0,13 0t0 167764 pipe 2023-10-08T15:40:51.107 INFO:teuthology.orchestra.run.smithi089.stdout:bash 28914 ubuntu 2w FIFO 0,13 0t0 167765 pipe 2023-10-08T15:40:51.107 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28916 root cwd DIR 8,1 4096 924112 /home/ubuntu/cephtest 2023-10-08T15:40:51.107 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28916 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:51.107 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28916 root txt REG 8,1 166056 10342 /usr/bin/sudo 2023-10-08T15:40:51.107 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28916 root mem REG 8,1 475944 8779 /usr/lib/x86_64-linux-gnu/security/pam_systemd.so 2023-10-08T15:40:51.108 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28916 root mem REG 8,1 105560 13403 /usr/lib/x86_64-linux-gnu/libnsl-2.31.so 2023-10-08T15:40:51.108 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28916 root mem REG 8,1 239896 8375 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-10-08T15:40:51.108 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28916 root mem REG 8,1 31120 10630 /usr/lib/x86_64-linux-gnu/libcap.so.2.32 2023-10-08T15:40:51.108 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28916 root mem REG 8,1 14728 8386 /usr/lib/x86_64-linux-gnu/libpam_misc.so.0.82.1 2023-10-08T15:40:51.108 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28916 root mem REG 8,1 14624 8696 /usr/lib/x86_64-linux-gnu/security/pam_umask.so 2023-10-08T15:40:51.108 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28916 root mem REG 8,1 202760 8017 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-10-08T15:40:51.108 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28916 root mem REG 8,1 18424 12487 /usr/lib/x86_64-linux-gnu/security/pam_cap.so 2023-10-08T15:40:51.108 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28916 root mem REG 8,1 14448 8681 /usr/lib/x86_64-linux-gnu/security/pam_permit.so 2023-10-08T15:40:51.108 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28916 root mem REG 8,1 64504 8697 /usr/lib/x86_64-linux-gnu/security/pam_unix.so 2023-10-08T15:40:51.108 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28916 root mem REG 8,1 68320 8384 /usr/lib/x86_64-linux-gnu/libpam.so.0.84.2 2023-10-08T15:40:51.109 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28916 root mem REG 8,1 392976 25058 /usr/lib/sudo/sudoers.so 2023-10-08T15:40:51.109 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28916 root mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:51.109 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28916 root mem REG 8,1 6017584 10873 /usr/lib/locale/locale-archive 2023-10-08T15:40:51.109 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28916 root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:51.109 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28916 root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:51.109 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28916 root mem REG 8,1 584392 8917 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.9.0 2023-10-08T15:40:51.109 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28916 root mem REG 8,1 27064 8001 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-10-08T15:40:51.109 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28916 root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:51.109 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28916 root mem REG 8,1 105312 25053 /usr/lib/sudo/libsudo_util.so.0.0.0 2023-10-08T15:40:51.110 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28916 root mem REG 8,1 14880 13415 /usr/lib/x86_64-linux-gnu/libutil-2.31.so 2023-10-08T15:40:51.110 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28916 root mem REG 8,1 163200 8942 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-10-08T15:40:51.110 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28916 root mem REG 8,1 133200 8347 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-10-08T15:40:51.110 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28916 root mem REG 8,1 14048 8659 /usr/lib/x86_64-linux-gnu/security/pam_deny.so 2023-10-08T15:40:51.110 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28916 root mem REG 8,1 18720 8661 /usr/lib/x86_64-linux-gnu/security/pam_env.so 2023-10-08T15:40:51.110 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28916 root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:51.110 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28916 root 0r FIFO 0,13 0t0 167763 pipe 2023-10-08T15:40:51.110 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28916 root 1w FIFO 0,13 0t0 167764 pipe 2023-10-08T15:40:51.110 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28916 root 2w FIFO 0,13 0t0 167765 pipe 2023-10-08T15:40:51.110 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28916 root 3u netlink 0t0 170577 AUDIT 2023-10-08T15:40:51.110 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28916 root 4u unix 0xffff8f3911b82200 0t0 170579 type=DGRAM 2023-10-08T15:40:51.111 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28916 root 6r FIFO 0,13 0t0 170582 pipe 2023-10-08T15:40:51.111 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28916 root 7w FIFO 0,13 0t0 170582 pipe 2023-10-08T15:40:51.111 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28918 root cwd DIR 8,1 4096 924112 /home/ubuntu/cephtest 2023-10-08T15:40:51.111 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28918 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:51.111 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28918 root txt REG 8,1 166056 10342 /usr/bin/sudo 2023-10-08T15:40:51.111 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28918 root mem REG 8,1 475944 8779 /usr/lib/x86_64-linux-gnu/security/pam_systemd.so 2023-10-08T15:40:51.111 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28918 root mem REG 8,1 105560 13403 /usr/lib/x86_64-linux-gnu/libnsl-2.31.so 2023-10-08T15:40:51.111 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28918 root mem REG 8,1 239896 8375 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-10-08T15:40:51.111 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28918 root mem REG 8,1 31120 10630 /usr/lib/x86_64-linux-gnu/libcap.so.2.32 2023-10-08T15:40:51.111 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28918 root mem REG 8,1 14728 8386 /usr/lib/x86_64-linux-gnu/libpam_misc.so.0.82.1 2023-10-08T15:40:51.111 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28918 root mem REG 8,1 14624 8696 /usr/lib/x86_64-linux-gnu/security/pam_umask.so 2023-10-08T15:40:51.112 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28918 root mem REG 8,1 202760 8017 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-10-08T15:40:51.112 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28918 root mem REG 8,1 18424 12487 /usr/lib/x86_64-linux-gnu/security/pam_cap.so 2023-10-08T15:40:51.112 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28918 root mem REG 8,1 14448 8681 /usr/lib/x86_64-linux-gnu/security/pam_permit.so 2023-10-08T15:40:51.112 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28918 root mem REG 8,1 64504 8697 /usr/lib/x86_64-linux-gnu/security/pam_unix.so 2023-10-08T15:40:51.112 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28918 root mem REG 8,1 68320 8384 /usr/lib/x86_64-linux-gnu/libpam.so.0.84.2 2023-10-08T15:40:51.112 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28918 root mem REG 8,1 392976 25058 /usr/lib/sudo/sudoers.so 2023-10-08T15:40:51.112 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28918 root mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:51.112 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28918 root mem REG 8,1 6017584 10873 /usr/lib/locale/locale-archive 2023-10-08T15:40:51.112 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28918 root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:51.113 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28918 root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:51.113 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28918 root mem REG 8,1 584392 8917 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.9.0 2023-10-08T15:40:51.113 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28918 root mem REG 8,1 27064 8001 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-10-08T15:40:51.113 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28918 root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:51.113 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28918 root mem REG 8,1 105312 25053 /usr/lib/sudo/libsudo_util.so.0.0.0 2023-10-08T15:40:51.113 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28918 root mem REG 8,1 14880 13415 /usr/lib/x86_64-linux-gnu/libutil-2.31.so 2023-10-08T15:40:51.113 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28918 root mem REG 8,1 163200 8942 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-10-08T15:40:51.113 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28918 root mem REG 8,1 133200 8347 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-10-08T15:40:51.113 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28918 root mem REG 8,1 14048 8659 /usr/lib/x86_64-linux-gnu/security/pam_deny.so 2023-10-08T15:40:51.114 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28918 root mem REG 8,1 18720 8661 /usr/lib/x86_64-linux-gnu/security/pam_env.so 2023-10-08T15:40:51.114 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28918 root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:51.114 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28918 root 0r FIFO 0,13 0t0 167763 pipe 2023-10-08T15:40:51.114 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28918 root 1w FIFO 0,13 0t0 167764 pipe 2023-10-08T15:40:51.114 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28918 root 2w FIFO 0,13 0t0 167765 pipe 2023-10-08T15:40:51.114 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28918 root 3u sock 0,9 0t0 172550 protocol: NETLINK 2023-10-08T15:40:51.114 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28918 root 4u sock 0,9 0t0 172552 protocol: UNIX 2023-10-08T15:40:51.114 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28918 root 6r FIFO 0,13 0t0 172555 pipe 2023-10-08T15:40:51.114 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28918 root 7w FIFO 0,13 0t0 172555 pipe 2023-10-08T15:40:51.114 INFO:teuthology.orchestra.run.smithi089.stdout:daemon-he 28919 root cwd DIR 8,1 4096 924112 /home/ubuntu/cephtest 2023-10-08T15:40:51.115 INFO:teuthology.orchestra.run.smithi089.stdout:daemon-he 28919 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:51.115 INFO:teuthology.orchestra.run.smithi089.stdout:daemon-he 28919 root txt REG 8,1 5502744 11325 /usr/bin/python3.8 2023-10-08T15:40:51.115 INFO:teuthology.orchestra.run.smithi089.stdout:daemon-he 28919 root mem REG 8,1 162264 8088 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.4 2023-10-08T15:40:51.115 INFO:teuthology.orchestra.run.smithi089.stdout:daemon-he 28919 root mem REG 8,1 74848 8355 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-10-08T15:40:51.115 INFO:teuthology.orchestra.run.smithi089.stdout:daemon-he 28919 root mem REG 8,1 45832 24533 /usr/lib/python3.8/lib-dynload/_lzma.cpython-38-x86_64-linux-gnu.so 2023-10-08T15:40:51.115 INFO:teuthology.orchestra.run.smithi089.stdout:daemon-he 28919 root mem REG 8,1 28520 24516 /usr/lib/python3.8/lib-dynload/_bz2.cpython-38-x86_64-linux-gnu.so 2023-10-08T15:40:51.115 INFO:teuthology.orchestra.run.smithi089.stdout:daemon-he 28919 root mem REG 8,1 6017584 10873 /usr/lib/locale/locale-archive 2023-10-08T15:40:51.115 INFO:teuthology.orchestra.run.smithi089.stdout:daemon-he 28919 root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:51.115 INFO:teuthology.orchestra.run.smithi089.stdout:daemon-he 28919 root mem REG 8,1 182560 8776 /usr/lib/x86_64-linux-gnu/libexpat.so.1.6.11 2023-10-08T15:40:51.116 INFO:teuthology.orchestra.run.smithi089.stdout:daemon-he 28919 root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:51.116 INFO:teuthology.orchestra.run.smithi089.stdout:daemon-he 28919 root mem REG 8,1 14880 13415 /usr/lib/x86_64-linux-gnu/libutil-2.31.so 2023-10-08T15:40:51.116 INFO:teuthology.orchestra.run.smithi089.stdout:daemon-he 28919 root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:51.116 INFO:teuthology.orchestra.run.smithi089.stdout:daemon-he 28919 root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:51.116 INFO:teuthology.orchestra.run.smithi089.stdout:daemon-he 28919 root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:51.116 INFO:teuthology.orchestra.run.smithi089.stdout:daemon-he 28919 root mem REG 8,1 18696 13609 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-10-08T15:40:51.116 INFO:teuthology.orchestra.run.smithi089.stdout:daemon-he 28919 root mem REG 8,1 27002 13665 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-10-08T15:40:51.116 INFO:teuthology.orchestra.run.smithi089.stdout:daemon-he 28919 root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:51.116 INFO:teuthology.orchestra.run.smithi089.stdout:daemon-he 28919 root 0r FIFO 0,13 0t0 167763 pipe 2023-10-08T15:40:51.116 INFO:teuthology.orchestra.run.smithi089.stdout:daemon-he 28919 root 1w FIFO 0,13 0t0 167764 pipe 2023-10-08T15:40:51.117 INFO:teuthology.orchestra.run.smithi089.stdout:daemon-he 28919 root 2w FIFO 0,13 0t0 167765 pipe 2023-10-08T15:40:51.117 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 root cwd DIR 8,1 4096 924112 /home/ubuntu/cephtest 2023-10-08T15:40:51.117 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:51.117 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 root txt REG 8,1 2980448 1055345 /usr/bin/ceph-fuse 2023-10-08T15:40:51.117 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 root mem REG 8,1 39368 21279 /usr/lib/x86_64-linux-gnu/liburcu-bp.so.6.1.0 2023-10-08T15:40:51.117 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 root mem REG 8,1 51280 111271 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.0.0.0 2023-10-08T15:40:51.117 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 root mem REG 8,1 137912 13038 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-10-08T15:40:51.117 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 root mem REG 8,1 477584 16364 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-10-08T15:40:51.117 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:51.117 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 root mem REG 8,1 117920 16368 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.2.28.0 2023-10-08T15:40:51.117 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 root mem REG 8,1 121552 16366 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.8.28.0 2023-10-08T15:40:51.118 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 root mem REG 8,1 178528 12765 /usr/lib/x86_64-linux-gnu/libudev.so.1.6.17 2023-10-08T15:40:51.118 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 root mem REG 8,1 2954080 9466 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:51.118 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 root mem REG 8,1 351352 9401 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-10-08T15:40:51.118 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 root mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:51.118 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:51.118 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 root mem REG 8,1 104984 8251 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-10-08T15:40:51.118 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:51.118 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 root mem REG 8,1 1956992 8082 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28 2023-10-08T15:40:51.118 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:51.118 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:51.118 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 root mem REG 8,1 12111760 1053837 /usr/lib/ceph/libceph-common.so.2 2023-10-08T15:40:51.119 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 root mem REG 8,1 252184 14163 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-10-08T15:40:51.119 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:51.119 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:51.119 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 root 1w FIFO 0,13 0t0 167764 pipe 2023-10-08T15:40:51.119 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 root 2w FIFO 0,13 0t0 167765 pipe 2023-10-08T15:40:51.119 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 root 3w REG 8,1 46647892 1068262 /var/log/ceph/ceph-client.0.28924.log 2023-10-08T15:40:51.119 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 root 4u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.119 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 root 5r FIFO 0,13 0t0 173760 pipe 2023-10-08T15:40:51.119 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 root 6w FIFO 0,13 0t0 173760 pipe 2023-10-08T15:40:51.119 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 root 7u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.119 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 root 8r FIFO 0,13 0t0 173761 pipe 2023-10-08T15:40:51.119 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 root 9w FIFO 0,13 0t0 173761 pipe 2023-10-08T15:40:51.120 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 root 10u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.120 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 root 11r FIFO 0,13 0t0 173762 pipe 2023-10-08T15:40:51.120 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 root 12w FIFO 0,13 0t0 173762 pipe 2023-10-08T15:40:51.120 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 root 13r FIFO 0,13 0t0 173763 pipe 2023-10-08T15:40:51.120 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 root 14w FIFO 0,13 0t0 173763 pipe 2023-10-08T15:40:51.120 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 root 15u sock 0,9 0t0 173764 protocol: UNIX 2023-10-08T15:40:51.120 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 root 16r FIFO 0,13 0t0 173765 pipe 2023-10-08T15:40:51.120 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 root 17w FIFO 0,13 0t0 173765 pipe 2023-10-08T15:40:51.120 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 root 18r FIFO 0,13 0t0 173766 pipe 2023-10-08T15:40:51.120 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 root 19w FIFO 0,13 0t0 173766 pipe 2023-10-08T15:40:51.120 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 root 20u sock 0,9 0t0 172558 protocol: TCP 2023-10-08T15:40:51.120 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 root 21u sock 0,9 0t0 167777 protocol: TCP 2023-10-08T15:40:51.121 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 root 22u CHR 10,229 0t0 87 /dev/fuse 2023-10-08T15:40:51.121 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 root 23r FIFO 0,13 0t0 172559 pipe 2023-10-08T15:40:51.121 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 root 24w FIFO 0,13 0t0 172559 pipe 2023-10-08T15:40:51.121 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 root 25r FIFO 0,13 0t0 169846 pipe 2023-10-08T15:40:51.121 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 root 26w FIFO 0,13 0t0 169846 pipe 2023-10-08T15:40:51.121 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 root 27u sock 0,9 0t0 175257 protocol: TCP 2023-10-08T15:40:51.121 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 root 28r FIFO 0,13 0t0 171742 pipe 2023-10-08T15:40:51.121 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 root 29w FIFO 0,13 0t0 171742 pipe 2023-10-08T15:40:51.121 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 root 30u sock 0,9 0t0 167802 protocol: TCP 2023-10-08T15:40:51.121 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 root 31u sock 0,9 0t0 167803 protocol: TCP 2023-10-08T15:40:51.121 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 root 32u sock 0,9 0t0 175258 protocol: TCP 2023-10-08T15:40:51.122 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 root 33u sock 0,9 0t0 167804 protocol: TCP 2023-10-08T15:40:51.122 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 root 34u sock 0,9 0t0 175259 protocol: TCP 2023-10-08T15:40:51.122 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 root 35u sock 0,9 0t0 175260 protocol: TCP 2023-10-08T15:40:51.122 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 root 36u sock 0,9 0t0 171743 protocol: TCP 2023-10-08T15:40:51.122 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28925 log root cwd DIR 8,1 4096 924112 /home/ubuntu/cephtest 2023-10-08T15:40:51.122 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28925 log root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:51.122 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28925 log root txt REG 8,1 2980448 1055345 /usr/bin/ceph-fuse 2023-10-08T15:40:51.122 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28925 log root mem REG 8,1 39368 21279 /usr/lib/x86_64-linux-gnu/liburcu-bp.so.6.1.0 2023-10-08T15:40:51.122 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28925 log root mem REG 8,1 51280 111271 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.0.0.0 2023-10-08T15:40:51.122 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28925 log root mem REG 8,1 137912 13038 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-10-08T15:40:51.122 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28925 log root mem REG 8,1 477584 16364 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-10-08T15:40:51.122 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28925 log root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:51.123 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28925 log root mem REG 8,1 117920 16368 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.2.28.0 2023-10-08T15:40:51.123 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28925 log root mem REG 8,1 121552 16366 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.8.28.0 2023-10-08T15:40:51.123 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28925 log root mem REG 8,1 178528 12765 /usr/lib/x86_64-linux-gnu/libudev.so.1.6.17 2023-10-08T15:40:51.123 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28925 log root mem REG 8,1 2954080 9466 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:51.123 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28925 log root mem REG 8,1 351352 9401 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-10-08T15:40:51.123 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28925 log root mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:51.123 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28925 log root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:51.123 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28925 log root mem REG 8,1 104984 8251 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-10-08T15:40:51.123 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28925 log root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:51.123 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28925 log root mem REG 8,1 1956992 8082 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28 2023-10-08T15:40:51.123 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28925 log root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:51.124 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28925 log root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:51.124 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28925 log root mem REG 8,1 12111760 1053837 /usr/lib/ceph/libceph-common.so.2 2023-10-08T15:40:51.124 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28925 log root mem REG 8,1 252184 14163 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-10-08T15:40:51.124 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28925 log root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:51.124 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28925 log root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:51.124 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28925 log root 1w FIFO 0,13 0t0 167764 pipe 2023-10-08T15:40:51.124 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28925 log root 2w FIFO 0,13 0t0 167765 pipe 2023-10-08T15:40:51.124 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28925 log root 3w REG 8,1 46647892 1068262 /var/log/ceph/ceph-client.0.28924.log 2023-10-08T15:40:51.124 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28925 log root 4u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.124 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28925 log root 5r FIFO 0,13 0t0 173760 pipe 2023-10-08T15:40:51.125 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28925 log root 6w FIFO 0,13 0t0 173760 pipe 2023-10-08T15:40:51.125 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28925 log root 7u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.125 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28925 log root 8r FIFO 0,13 0t0 173761 pipe 2023-10-08T15:40:51.125 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28925 log root 9w FIFO 0,13 0t0 173761 pipe 2023-10-08T15:40:51.125 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28925 log root 10u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.125 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28925 log root 11r FIFO 0,13 0t0 173762 pipe 2023-10-08T15:40:51.125 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28925 log root 12w FIFO 0,13 0t0 173762 pipe 2023-10-08T15:40:51.125 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28925 log root 13r FIFO 0,13 0t0 173763 pipe 2023-10-08T15:40:51.125 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28925 log root 14w FIFO 0,13 0t0 173763 pipe 2023-10-08T15:40:51.125 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28925 log root 15u sock 0,9 0t0 173764 protocol: UNIX 2023-10-08T15:40:51.125 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28925 log root 16r FIFO 0,13 0t0 173765 pipe 2023-10-08T15:40:51.126 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28925 log root 17w FIFO 0,13 0t0 173765 pipe 2023-10-08T15:40:51.126 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28925 log root 18r FIFO 0,13 0t0 173766 pipe 2023-10-08T15:40:51.126 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28925 log root 19w FIFO 0,13 0t0 173766 pipe 2023-10-08T15:40:51.126 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28925 log root 20u sock 0,9 0t0 172558 protocol: TCP 2023-10-08T15:40:51.126 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28925 log root 21u sock 0,9 0t0 167777 protocol: TCP 2023-10-08T15:40:51.126 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28925 log root 22u CHR 10,229 0t0 87 /dev/fuse 2023-10-08T15:40:51.126 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28925 log root 23r FIFO 0,13 0t0 172559 pipe 2023-10-08T15:40:51.126 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28925 log root 24w FIFO 0,13 0t0 172559 pipe 2023-10-08T15:40:51.126 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28925 log root 25r FIFO 0,13 0t0 169846 pipe 2023-10-08T15:40:51.126 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28925 log root 26w FIFO 0,13 0t0 169846 pipe 2023-10-08T15:40:51.126 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28925 log root 27u sock 0,9 0t0 175257 protocol: TCP 2023-10-08T15:40:51.127 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28925 log root 28r FIFO 0,13 0t0 171742 pipe 2023-10-08T15:40:51.127 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28925 log root 29w FIFO 0,13 0t0 171742 pipe 2023-10-08T15:40:51.127 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28925 log root 30u sock 0,9 0t0 167802 protocol: TCP 2023-10-08T15:40:51.127 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28925 log root 31u sock 0,9 0t0 167803 protocol: TCP 2023-10-08T15:40:51.127 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28925 log root 32u sock 0,9 0t0 175258 protocol: TCP 2023-10-08T15:40:51.127 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28925 log root 33u sock 0,9 0t0 167804 protocol: TCP 2023-10-08T15:40:51.127 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28925 log root 34u sock 0,9 0t0 175259 protocol: TCP 2023-10-08T15:40:51.127 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28925 log root 35u sock 0,9 0t0 175260 protocol: TCP 2023-10-08T15:40:51.127 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28925 log root 36u sock 0,9 0t0 171743 protocol: TCP 2023-10-08T15:40:51.127 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28927 msgr-work root cwd DIR 8,1 4096 924112 /home/ubuntu/cephtest 2023-10-08T15:40:51.127 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28927 msgr-work root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:51.127 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28927 msgr-work root txt REG 8,1 2980448 1055345 /usr/bin/ceph-fuse 2023-10-08T15:40:51.128 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28927 msgr-work root mem REG 8,1 39368 21279 /usr/lib/x86_64-linux-gnu/liburcu-bp.so.6.1.0 2023-10-08T15:40:51.128 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28927 msgr-work root mem REG 8,1 51280 111271 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.0.0.0 2023-10-08T15:40:51.128 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28927 msgr-work root mem REG 8,1 137912 13038 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-10-08T15:40:51.128 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28927 msgr-work root mem REG 8,1 477584 16364 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-10-08T15:40:51.128 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28927 msgr-work root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:51.128 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28927 msgr-work root mem REG 8,1 117920 16368 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.2.28.0 2023-10-08T15:40:51.128 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28927 msgr-work root mem REG 8,1 121552 16366 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.8.28.0 2023-10-08T15:40:51.128 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28927 msgr-work root mem REG 8,1 178528 12765 /usr/lib/x86_64-linux-gnu/libudev.so.1.6.17 2023-10-08T15:40:51.128 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28927 msgr-work root mem REG 8,1 2954080 9466 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:51.129 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28927 msgr-work root mem REG 8,1 351352 9401 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-10-08T15:40:51.129 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28927 msgr-work root mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:51.129 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28927 msgr-work root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:51.129 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28927 msgr-work root mem REG 8,1 104984 8251 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-10-08T15:40:51.129 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28927 msgr-work root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:51.129 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28927 msgr-work root mem REG 8,1 1956992 8082 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28 2023-10-08T15:40:51.129 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28927 msgr-work root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:51.129 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28927 msgr-work root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:51.129 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28927 msgr-work root mem REG 8,1 12111760 1053837 /usr/lib/ceph/libceph-common.so.2 2023-10-08T15:40:51.130 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28927 msgr-work root mem REG 8,1 252184 14163 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-10-08T15:40:51.130 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28927 msgr-work root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:51.130 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28927 msgr-work root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:51.130 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28927 msgr-work root 1w FIFO 0,13 0t0 167764 pipe 2023-10-08T15:40:51.130 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28927 msgr-work root 2w FIFO 0,13 0t0 167765 pipe 2023-10-08T15:40:51.130 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28927 msgr-work root 3w REG 8,1 46647892 1068262 /var/log/ceph/ceph-client.0.28924.log 2023-10-08T15:40:51.130 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28927 msgr-work root 4u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.130 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28927 msgr-work root 5r FIFO 0,13 0t0 173760 pipe 2023-10-08T15:40:51.130 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28927 msgr-work root 6w FIFO 0,13 0t0 173760 pipe 2023-10-08T15:40:51.130 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28927 msgr-work root 7u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.131 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28927 msgr-work root 8r FIFO 0,13 0t0 173761 pipe 2023-10-08T15:40:51.131 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28927 msgr-work root 9w FIFO 0,13 0t0 173761 pipe 2023-10-08T15:40:51.131 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28927 msgr-work root 10u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.131 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28927 msgr-work root 11r FIFO 0,13 0t0 173762 pipe 2023-10-08T15:40:51.131 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28927 msgr-work root 12w FIFO 0,13 0t0 173762 pipe 2023-10-08T15:40:51.131 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28927 msgr-work root 13r FIFO 0,13 0t0 173763 pipe 2023-10-08T15:40:51.131 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28927 msgr-work root 14w FIFO 0,13 0t0 173763 pipe 2023-10-08T15:40:51.131 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28927 msgr-work root 15u sock 0,9 0t0 173764 protocol: UNIX 2023-10-08T15:40:51.131 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28927 msgr-work root 16r FIFO 0,13 0t0 173765 pipe 2023-10-08T15:40:51.131 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28927 msgr-work root 17w FIFO 0,13 0t0 173765 pipe 2023-10-08T15:40:51.132 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28927 msgr-work root 18r FIFO 0,13 0t0 173766 pipe 2023-10-08T15:40:51.132 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28927 msgr-work root 19w FIFO 0,13 0t0 173766 pipe 2023-10-08T15:40:51.132 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28927 msgr-work root 20u sock 0,9 0t0 172558 protocol: TCP 2023-10-08T15:40:51.132 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28927 msgr-work root 21u sock 0,9 0t0 167777 protocol: TCP 2023-10-08T15:40:51.132 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28927 msgr-work root 22u CHR 10,229 0t0 87 /dev/fuse 2023-10-08T15:40:51.132 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28927 msgr-work root 23r FIFO 0,13 0t0 172559 pipe 2023-10-08T15:40:51.132 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28927 msgr-work root 24w FIFO 0,13 0t0 172559 pipe 2023-10-08T15:40:51.132 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28927 msgr-work root 25r FIFO 0,13 0t0 169846 pipe 2023-10-08T15:40:51.132 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28927 msgr-work root 26w FIFO 0,13 0t0 169846 pipe 2023-10-08T15:40:51.132 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28927 msgr-work root 27u sock 0,9 0t0 175257 protocol: TCP 2023-10-08T15:40:51.133 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28927 msgr-work root 28r FIFO 0,13 0t0 171742 pipe 2023-10-08T15:40:51.133 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28927 msgr-work root 29w FIFO 0,13 0t0 171742 pipe 2023-10-08T15:40:51.133 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28927 msgr-work root 30u sock 0,9 0t0 167802 protocol: TCP 2023-10-08T15:40:51.133 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28927 msgr-work root 31u sock 0,9 0t0 167803 protocol: TCP 2023-10-08T15:40:51.133 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28927 msgr-work root 32u sock 0,9 0t0 175258 protocol: TCP 2023-10-08T15:40:51.133 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28927 msgr-work root 33u sock 0,9 0t0 167804 protocol: TCP 2023-10-08T15:40:51.133 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28927 msgr-work root 34u sock 0,9 0t0 175259 protocol: TCP 2023-10-08T15:40:51.133 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28927 msgr-work root 35u sock 0,9 0t0 175260 protocol: TCP 2023-10-08T15:40:51.133 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28927 msgr-work root 36u sock 0,9 0t0 171743 protocol: TCP 2023-10-08T15:40:51.134 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28928 msgr-work root cwd DIR 8,1 4096 924112 /home/ubuntu/cephtest 2023-10-08T15:40:51.134 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28928 msgr-work root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:51.134 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28928 msgr-work root txt REG 8,1 2980448 1055345 /usr/bin/ceph-fuse 2023-10-08T15:40:51.134 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28928 msgr-work root mem REG 8,1 39368 21279 /usr/lib/x86_64-linux-gnu/liburcu-bp.so.6.1.0 2023-10-08T15:40:51.134 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28928 msgr-work root mem REG 8,1 51280 111271 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.0.0.0 2023-10-08T15:40:51.134 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28928 msgr-work root mem REG 8,1 137912 13038 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-10-08T15:40:51.134 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28928 msgr-work root mem REG 8,1 477584 16364 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-10-08T15:40:51.134 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28928 msgr-work root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:51.134 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28928 msgr-work root mem REG 8,1 117920 16368 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.2.28.0 2023-10-08T15:40:51.134 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28928 msgr-work root mem REG 8,1 121552 16366 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.8.28.0 2023-10-08T15:40:51.135 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28928 msgr-work root mem REG 8,1 178528 12765 /usr/lib/x86_64-linux-gnu/libudev.so.1.6.17 2023-10-08T15:40:51.135 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28928 msgr-work root mem REG 8,1 2954080 9466 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:51.135 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28928 msgr-work root mem REG 8,1 351352 9401 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-10-08T15:40:51.135 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28928 msgr-work root mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:51.135 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28928 msgr-work root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:51.135 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28928 msgr-work root mem REG 8,1 104984 8251 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-10-08T15:40:51.135 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28928 msgr-work root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:51.135 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28928 msgr-work root mem REG 8,1 1956992 8082 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28 2023-10-08T15:40:51.135 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28928 msgr-work root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:51.136 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28928 msgr-work root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:51.136 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28928 msgr-work root mem REG 8,1 12111760 1053837 /usr/lib/ceph/libceph-common.so.2 2023-10-08T15:40:51.136 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28928 msgr-work root mem REG 8,1 252184 14163 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-10-08T15:40:51.136 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28928 msgr-work root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:51.136 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28928 msgr-work root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:51.136 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28928 msgr-work root 1w FIFO 0,13 0t0 167764 pipe 2023-10-08T15:40:51.136 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28928 msgr-work root 2w FIFO 0,13 0t0 167765 pipe 2023-10-08T15:40:51.136 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28928 msgr-work root 3w REG 8,1 46647892 1068262 /var/log/ceph/ceph-client.0.28924.log 2023-10-08T15:40:51.136 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28928 msgr-work root 4u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.137 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28928 msgr-work root 5r FIFO 0,13 0t0 173760 pipe 2023-10-08T15:40:51.137 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28928 msgr-work root 6w FIFO 0,13 0t0 173760 pipe 2023-10-08T15:40:51.137 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28928 msgr-work root 7u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.137 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28928 msgr-work root 8r FIFO 0,13 0t0 173761 pipe 2023-10-08T15:40:51.137 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28928 msgr-work root 9w FIFO 0,13 0t0 173761 pipe 2023-10-08T15:40:51.137 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28928 msgr-work root 10u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.137 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28928 msgr-work root 11r FIFO 0,13 0t0 173762 pipe 2023-10-08T15:40:51.137 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28928 msgr-work root 12w FIFO 0,13 0t0 173762 pipe 2023-10-08T15:40:51.137 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28928 msgr-work root 13r FIFO 0,13 0t0 173763 pipe 2023-10-08T15:40:51.138 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28928 msgr-work root 14w FIFO 0,13 0t0 173763 pipe 2023-10-08T15:40:51.138 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28928 msgr-work root 15u sock 0,9 0t0 173764 protocol: UNIX 2023-10-08T15:40:51.138 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28928 msgr-work root 16r FIFO 0,13 0t0 173765 pipe 2023-10-08T15:40:51.138 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28928 msgr-work root 17w FIFO 0,13 0t0 173765 pipe 2023-10-08T15:40:51.138 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28928 msgr-work root 18r FIFO 0,13 0t0 173766 pipe 2023-10-08T15:40:51.138 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28928 msgr-work root 19w FIFO 0,13 0t0 173766 pipe 2023-10-08T15:40:51.138 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28928 msgr-work root 20u sock 0,9 0t0 172558 protocol: TCP 2023-10-08T15:40:51.138 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28928 msgr-work root 21u sock 0,9 0t0 167777 protocol: TCP 2023-10-08T15:40:51.138 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28928 msgr-work root 22u CHR 10,229 0t0 87 /dev/fuse 2023-10-08T15:40:51.139 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28928 msgr-work root 23r FIFO 0,13 0t0 172559 pipe 2023-10-08T15:40:51.139 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28928 msgr-work root 24w FIFO 0,13 0t0 172559 pipe 2023-10-08T15:40:51.139 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28928 msgr-work root 25r FIFO 0,13 0t0 169846 pipe 2023-10-08T15:40:51.139 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28928 msgr-work root 26w FIFO 0,13 0t0 169846 pipe 2023-10-08T15:40:51.139 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28928 msgr-work root 27u sock 0,9 0t0 175257 protocol: TCP 2023-10-08T15:40:51.139 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28928 msgr-work root 28r FIFO 0,13 0t0 171742 pipe 2023-10-08T15:40:51.139 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28928 msgr-work root 29w FIFO 0,13 0t0 171742 pipe 2023-10-08T15:40:51.139 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28928 msgr-work root 30u sock 0,9 0t0 167802 protocol: TCP 2023-10-08T15:40:51.139 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28928 msgr-work root 31u sock 0,9 0t0 167803 protocol: TCP 2023-10-08T15:40:51.140 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28928 msgr-work root 32u sock 0,9 0t0 175258 protocol: TCP 2023-10-08T15:40:51.140 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28928 msgr-work root 33u sock 0,9 0t0 167804 protocol: TCP 2023-10-08T15:40:51.140 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28928 msgr-work root 34u sock 0,9 0t0 175259 protocol: TCP 2023-10-08T15:40:51.140 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28928 msgr-work root 35u sock 0,9 0t0 175260 protocol: TCP 2023-10-08T15:40:51.140 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28928 msgr-work root 36u sock 0,9 0t0 171743 protocol: TCP 2023-10-08T15:40:51.140 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28929 msgr-work root cwd DIR 8,1 4096 924112 /home/ubuntu/cephtest 2023-10-08T15:40:51.140 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28929 msgr-work root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:51.140 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28929 msgr-work root txt REG 8,1 2980448 1055345 /usr/bin/ceph-fuse 2023-10-08T15:40:51.140 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28929 msgr-work root mem REG 8,1 39368 21279 /usr/lib/x86_64-linux-gnu/liburcu-bp.so.6.1.0 2023-10-08T15:40:51.140 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28929 msgr-work root mem REG 8,1 51280 111271 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.0.0.0 2023-10-08T15:40:51.141 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28929 msgr-work root mem REG 8,1 137912 13038 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-10-08T15:40:51.141 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28929 msgr-work root mem REG 8,1 477584 16364 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-10-08T15:40:51.141 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28929 msgr-work root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:51.141 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28929 msgr-work root mem REG 8,1 117920 16368 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.2.28.0 2023-10-08T15:40:51.141 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28929 msgr-work root mem REG 8,1 121552 16366 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.8.28.0 2023-10-08T15:40:51.141 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28929 msgr-work root mem REG 8,1 178528 12765 /usr/lib/x86_64-linux-gnu/libudev.so.1.6.17 2023-10-08T15:40:51.141 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28929 msgr-work root mem REG 8,1 2954080 9466 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:51.141 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28929 msgr-work root mem REG 8,1 351352 9401 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-10-08T15:40:51.141 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28929 msgr-work root mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:51.141 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28929 msgr-work root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:51.142 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28929 msgr-work root mem REG 8,1 104984 8251 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-10-08T15:40:51.142 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28929 msgr-work root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:51.142 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28929 msgr-work root mem REG 8,1 1956992 8082 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28 2023-10-08T15:40:51.142 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28929 msgr-work root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:51.142 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28929 msgr-work root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:51.142 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28929 msgr-work root mem REG 8,1 12111760 1053837 /usr/lib/ceph/libceph-common.so.2 2023-10-08T15:40:51.142 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28929 msgr-work root mem REG 8,1 252184 14163 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-10-08T15:40:51.142 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28929 msgr-work root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:51.143 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28929 msgr-work root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:51.143 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28929 msgr-work root 1w FIFO 0,13 0t0 167764 pipe 2023-10-08T15:40:51.143 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28929 msgr-work root 2w FIFO 0,13 0t0 167765 pipe 2023-10-08T15:40:51.143 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28929 msgr-work root 3w REG 8,1 46647892 1068262 /var/log/ceph/ceph-client.0.28924.log 2023-10-08T15:40:51.143 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28929 msgr-work root 4u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.143 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28929 msgr-work root 5r FIFO 0,13 0t0 173760 pipe 2023-10-08T15:40:51.143 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28929 msgr-work root 6w FIFO 0,13 0t0 173760 pipe 2023-10-08T15:40:51.143 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28929 msgr-work root 7u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.143 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28929 msgr-work root 8r FIFO 0,13 0t0 173761 pipe 2023-10-08T15:40:51.143 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28929 msgr-work root 9w FIFO 0,13 0t0 173761 pipe 2023-10-08T15:40:51.144 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28929 msgr-work root 10u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.144 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28929 msgr-work root 11r FIFO 0,13 0t0 173762 pipe 2023-10-08T15:40:51.144 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28929 msgr-work root 12w FIFO 0,13 0t0 173762 pipe 2023-10-08T15:40:51.144 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28929 msgr-work root 13r FIFO 0,13 0t0 173763 pipe 2023-10-08T15:40:51.144 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28929 msgr-work root 14w FIFO 0,13 0t0 173763 pipe 2023-10-08T15:40:51.144 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28929 msgr-work root 15u sock 0,9 0t0 173764 protocol: UNIX 2023-10-08T15:40:51.144 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28929 msgr-work root 16r FIFO 0,13 0t0 173765 pipe 2023-10-08T15:40:51.144 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28929 msgr-work root 17w FIFO 0,13 0t0 173765 pipe 2023-10-08T15:40:51.144 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28929 msgr-work root 18r FIFO 0,13 0t0 173766 pipe 2023-10-08T15:40:51.144 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28929 msgr-work root 19w FIFO 0,13 0t0 173766 pipe 2023-10-08T15:40:51.145 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28929 msgr-work root 20u sock 0,9 0t0 172558 protocol: TCP 2023-10-08T15:40:51.145 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28929 msgr-work root 21u sock 0,9 0t0 167777 protocol: TCP 2023-10-08T15:40:51.145 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28929 msgr-work root 22u CHR 10,229 0t0 87 /dev/fuse 2023-10-08T15:40:51.145 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28929 msgr-work root 23r FIFO 0,13 0t0 172559 pipe 2023-10-08T15:40:51.145 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28929 msgr-work root 24w FIFO 0,13 0t0 172559 pipe 2023-10-08T15:40:51.145 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28929 msgr-work root 25r FIFO 0,13 0t0 169846 pipe 2023-10-08T15:40:51.145 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28929 msgr-work root 26w FIFO 0,13 0t0 169846 pipe 2023-10-08T15:40:51.145 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28929 msgr-work root 27u sock 0,9 0t0 175257 protocol: TCP 2023-10-08T15:40:51.145 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28929 msgr-work root 28r FIFO 0,13 0t0 171742 pipe 2023-10-08T15:40:51.146 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28929 msgr-work root 29w FIFO 0,13 0t0 171742 pipe 2023-10-08T15:40:51.146 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28929 msgr-work root 30u sock 0,9 0t0 167802 protocol: TCP 2023-10-08T15:40:51.146 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28929 msgr-work root 31u sock 0,9 0t0 167803 protocol: TCP 2023-10-08T15:40:51.146 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28929 msgr-work root 32u sock 0,9 0t0 175258 protocol: TCP 2023-10-08T15:40:51.146 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28929 msgr-work root 33u sock 0,9 0t0 167804 protocol: TCP 2023-10-08T15:40:51.146 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28929 msgr-work root 34u sock 0,9 0t0 175259 protocol: TCP 2023-10-08T15:40:51.146 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28929 msgr-work root 35u sock 0,9 0t0 175260 protocol: TCP 2023-10-08T15:40:51.146 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28929 msgr-work root 36u sock 0,9 0t0 171743 protocol: TCP 2023-10-08T15:40:51.146 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28933 service root cwd DIR 8,1 4096 924112 /home/ubuntu/cephtest 2023-10-08T15:40:51.146 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28933 service root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:51.147 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28933 service root txt REG 8,1 2980448 1055345 /usr/bin/ceph-fuse 2023-10-08T15:40:51.147 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28933 service root mem REG 8,1 39368 21279 /usr/lib/x86_64-linux-gnu/liburcu-bp.so.6.1.0 2023-10-08T15:40:51.147 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28933 service root mem REG 8,1 51280 111271 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.0.0.0 2023-10-08T15:40:51.147 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28933 service root mem REG 8,1 137912 13038 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-10-08T15:40:51.147 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28933 service root mem REG 8,1 477584 16364 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-10-08T15:40:51.147 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28933 service root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:51.147 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28933 service root mem REG 8,1 117920 16368 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.2.28.0 2023-10-08T15:40:51.147 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28933 service root mem REG 8,1 121552 16366 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.8.28.0 2023-10-08T15:40:51.147 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28933 service root mem REG 8,1 178528 12765 /usr/lib/x86_64-linux-gnu/libudev.so.1.6.17 2023-10-08T15:40:51.147 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28933 service root mem REG 8,1 2954080 9466 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:51.147 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28933 service root mem REG 8,1 351352 9401 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-10-08T15:40:51.148 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28933 service root mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:51.148 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28933 service root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:51.148 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28933 service root mem REG 8,1 104984 8251 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-10-08T15:40:51.148 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28933 service root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:51.148 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28933 service root mem REG 8,1 1956992 8082 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28 2023-10-08T15:40:51.148 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28933 service root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:51.148 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28933 service root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:51.148 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28933 service root mem REG 8,1 12111760 1053837 /usr/lib/ceph/libceph-common.so.2 2023-10-08T15:40:51.148 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28933 service root mem REG 8,1 252184 14163 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-10-08T15:40:51.148 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28933 service root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:51.148 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28933 service root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:51.148 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28933 service root 1w FIFO 0,13 0t0 167764 pipe 2023-10-08T15:40:51.149 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28933 service root 2w FIFO 0,13 0t0 167765 pipe 2023-10-08T15:40:51.149 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28933 service root 3w REG 8,1 46647892 1068262 /var/log/ceph/ceph-client.0.28924.log 2023-10-08T15:40:51.149 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28933 service root 4u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.149 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28933 service root 5r FIFO 0,13 0t0 173760 pipe 2023-10-08T15:40:51.149 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28933 service root 6w FIFO 0,13 0t0 173760 pipe 2023-10-08T15:40:51.149 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28933 service root 7u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.149 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28933 service root 8r FIFO 0,13 0t0 173761 pipe 2023-10-08T15:40:51.149 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28933 service root 9w FIFO 0,13 0t0 173761 pipe 2023-10-08T15:40:51.149 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28933 service root 10u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.149 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28933 service root 11r FIFO 0,13 0t0 173762 pipe 2023-10-08T15:40:51.149 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28933 service root 12w FIFO 0,13 0t0 173762 pipe 2023-10-08T15:40:51.149 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28933 service root 13r FIFO 0,13 0t0 173763 pipe 2023-10-08T15:40:51.150 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28933 service root 14w FIFO 0,13 0t0 173763 pipe 2023-10-08T15:40:51.150 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28933 service root 15u sock 0,9 0t0 173764 protocol: UNIX 2023-10-08T15:40:51.150 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28933 service root 16r FIFO 0,13 0t0 173765 pipe 2023-10-08T15:40:51.150 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28933 service root 17w FIFO 0,13 0t0 173765 pipe 2023-10-08T15:40:51.150 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28933 service root 18r FIFO 0,13 0t0 173766 pipe 2023-10-08T15:40:51.150 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28933 service root 19w FIFO 0,13 0t0 173766 pipe 2023-10-08T15:40:51.150 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28933 service root 20u sock 0,9 0t0 172558 protocol: TCP 2023-10-08T15:40:51.150 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28933 service root 21u sock 0,9 0t0 167777 protocol: TCP 2023-10-08T15:40:51.150 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28933 service root 22u CHR 10,229 0t0 87 /dev/fuse 2023-10-08T15:40:51.150 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28933 service root 23r FIFO 0,13 0t0 172559 pipe 2023-10-08T15:40:51.150 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28933 service root 24w FIFO 0,13 0t0 172559 pipe 2023-10-08T15:40:51.151 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28933 service root 25r FIFO 0,13 0t0 169846 pipe 2023-10-08T15:40:51.151 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28933 service root 26w FIFO 0,13 0t0 169846 pipe 2023-10-08T15:40:51.151 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28933 service root 27u sock 0,9 0t0 175257 protocol: TCP 2023-10-08T15:40:51.151 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28933 service root 28r FIFO 0,13 0t0 171742 pipe 2023-10-08T15:40:51.151 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28933 service root 29w FIFO 0,13 0t0 171742 pipe 2023-10-08T15:40:51.151 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28933 service root 30u sock 0,9 0t0 167802 protocol: TCP 2023-10-08T15:40:51.151 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28933 service root 31u sock 0,9 0t0 167803 protocol: TCP 2023-10-08T15:40:51.151 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28933 service root 32u sock 0,9 0t0 175258 protocol: TCP 2023-10-08T15:40:51.151 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28933 service root 33u sock 0,9 0t0 167804 protocol: TCP 2023-10-08T15:40:51.151 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28933 service root 34u sock 0,9 0t0 175259 protocol: TCP 2023-10-08T15:40:51.151 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28933 service root 35u sock 0,9 0t0 175260 protocol: TCP 2023-10-08T15:40:51.152 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28933 service root 36u sock 0,9 0t0 171743 protocol: TCP 2023-10-08T15:40:51.152 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28934 admin_soc root cwd DIR 8,1 4096 924112 /home/ubuntu/cephtest 2023-10-08T15:40:51.152 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28934 admin_soc root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:51.152 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28934 admin_soc root txt REG 8,1 2980448 1055345 /usr/bin/ceph-fuse 2023-10-08T15:40:51.152 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28934 admin_soc root mem REG 8,1 39368 21279 /usr/lib/x86_64-linux-gnu/liburcu-bp.so.6.1.0 2023-10-08T15:40:51.152 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28934 admin_soc root mem REG 8,1 51280 111271 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.0.0.0 2023-10-08T15:40:51.152 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28934 admin_soc root mem REG 8,1 137912 13038 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-10-08T15:40:51.152 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28934 admin_soc root mem REG 8,1 477584 16364 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-10-08T15:40:51.152 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28934 admin_soc root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:51.152 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28934 admin_soc root mem REG 8,1 117920 16368 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.2.28.0 2023-10-08T15:40:51.152 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28934 admin_soc root mem REG 8,1 121552 16366 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.8.28.0 2023-10-08T15:40:51.153 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28934 admin_soc root mem REG 8,1 178528 12765 /usr/lib/x86_64-linux-gnu/libudev.so.1.6.17 2023-10-08T15:40:51.153 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28934 admin_soc root mem REG 8,1 2954080 9466 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:51.153 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28934 admin_soc root mem REG 8,1 351352 9401 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-10-08T15:40:51.153 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28934 admin_soc root mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:51.153 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28934 admin_soc root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:51.153 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28934 admin_soc root mem REG 8,1 104984 8251 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-10-08T15:40:51.153 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28934 admin_soc root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:51.153 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28934 admin_soc root mem REG 8,1 1956992 8082 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28 2023-10-08T15:40:51.153 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28934 admin_soc root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:51.153 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28934 admin_soc root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:51.153 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28934 admin_soc root mem REG 8,1 12111760 1053837 /usr/lib/ceph/libceph-common.so.2 2023-10-08T15:40:51.154 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28934 admin_soc root mem REG 8,1 252184 14163 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-10-08T15:40:51.154 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28934 admin_soc root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:51.154 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28934 admin_soc root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:51.154 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28934 admin_soc root 1w FIFO 0,13 0t0 167764 pipe 2023-10-08T15:40:51.154 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28934 admin_soc root 2w FIFO 0,13 0t0 167765 pipe 2023-10-08T15:40:51.154 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28934 admin_soc root 3w REG 8,1 46647892 1068262 /var/log/ceph/ceph-client.0.28924.log 2023-10-08T15:40:51.154 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28934 admin_soc root 4u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.154 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28934 admin_soc root 5r FIFO 0,13 0t0 173760 pipe 2023-10-08T15:40:51.154 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28934 admin_soc root 6w FIFO 0,13 0t0 173760 pipe 2023-10-08T15:40:51.154 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28934 admin_soc root 7u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.154 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28934 admin_soc root 8r FIFO 0,13 0t0 173761 pipe 2023-10-08T15:40:51.154 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28934 admin_soc root 9w FIFO 0,13 0t0 173761 pipe 2023-10-08T15:40:51.155 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28934 admin_soc root 10u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.155 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28934 admin_soc root 11r FIFO 0,13 0t0 173762 pipe 2023-10-08T15:40:51.155 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28934 admin_soc root 12w FIFO 0,13 0t0 173762 pipe 2023-10-08T15:40:51.155 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28934 admin_soc root 13r FIFO 0,13 0t0 173763 pipe 2023-10-08T15:40:51.155 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28934 admin_soc root 14w FIFO 0,13 0t0 173763 pipe 2023-10-08T15:40:51.155 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28934 admin_soc root 15u sock 0,9 0t0 173764 protocol: UNIX 2023-10-08T15:40:51.155 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28934 admin_soc root 16r FIFO 0,13 0t0 173765 pipe 2023-10-08T15:40:51.155 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28934 admin_soc root 17w FIFO 0,13 0t0 173765 pipe 2023-10-08T15:40:51.155 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28934 admin_soc root 18r FIFO 0,13 0t0 173766 pipe 2023-10-08T15:40:51.155 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28934 admin_soc root 19w FIFO 0,13 0t0 173766 pipe 2023-10-08T15:40:51.156 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28934 admin_soc root 20u sock 0,9 0t0 172558 protocol: TCP 2023-10-08T15:40:51.156 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28934 admin_soc root 21u sock 0,9 0t0 167777 protocol: TCP 2023-10-08T15:40:51.156 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28934 admin_soc root 22u CHR 10,229 0t0 87 /dev/fuse 2023-10-08T15:40:51.156 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28934 admin_soc root 23r FIFO 0,13 0t0 172559 pipe 2023-10-08T15:40:51.156 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28934 admin_soc root 24w FIFO 0,13 0t0 172559 pipe 2023-10-08T15:40:51.156 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28934 admin_soc root 25r FIFO 0,13 0t0 169846 pipe 2023-10-08T15:40:51.156 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28934 admin_soc root 26w FIFO 0,13 0t0 169846 pipe 2023-10-08T15:40:51.156 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28934 admin_soc root 27u sock 0,9 0t0 175257 protocol: TCP 2023-10-08T15:40:51.157 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28934 admin_soc root 28r FIFO 0,13 0t0 171742 pipe 2023-10-08T15:40:51.157 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28934 admin_soc root 29w FIFO 0,13 0t0 171742 pipe 2023-10-08T15:40:51.157 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28934 admin_soc root 30u sock 0,9 0t0 167802 protocol: TCP 2023-10-08T15:40:51.157 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28934 admin_soc root 31u sock 0,9 0t0 167803 protocol: TCP 2023-10-08T15:40:51.157 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28934 admin_soc root 32u sock 0,9 0t0 175258 protocol: TCP 2023-10-08T15:40:51.157 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28934 admin_soc root 33u sock 0,9 0t0 167804 protocol: TCP 2023-10-08T15:40:51.157 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28934 admin_soc root 34u sock 0,9 0t0 175259 protocol: TCP 2023-10-08T15:40:51.157 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28934 admin_soc root 35u sock 0,9 0t0 175260 protocol: TCP 2023-10-08T15:40:51.157 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28934 admin_soc root 36u sock 0,9 0t0 171743 protocol: TCP 2023-10-08T15:40:51.158 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28935 signal_ha root cwd DIR 8,1 4096 924112 /home/ubuntu/cephtest 2023-10-08T15:40:51.158 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28935 signal_ha root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:51.158 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28935 signal_ha root txt REG 8,1 2980448 1055345 /usr/bin/ceph-fuse 2023-10-08T15:40:51.158 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28935 signal_ha root mem REG 8,1 39368 21279 /usr/lib/x86_64-linux-gnu/liburcu-bp.so.6.1.0 2023-10-08T15:40:51.158 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28935 signal_ha root mem REG 8,1 51280 111271 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.0.0.0 2023-10-08T15:40:51.158 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28935 signal_ha root mem REG 8,1 137912 13038 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-10-08T15:40:51.158 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28935 signal_ha root mem REG 8,1 477584 16364 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-10-08T15:40:51.158 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28935 signal_ha root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:51.158 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28935 signal_ha root mem REG 8,1 117920 16368 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.2.28.0 2023-10-08T15:40:51.159 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28935 signal_ha root mem REG 8,1 121552 16366 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.8.28.0 2023-10-08T15:40:51.159 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28935 signal_ha root mem REG 8,1 178528 12765 /usr/lib/x86_64-linux-gnu/libudev.so.1.6.17 2023-10-08T15:40:51.159 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28935 signal_ha root mem REG 8,1 2954080 9466 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:51.159 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28935 signal_ha root mem REG 8,1 351352 9401 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-10-08T15:40:51.159 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28935 signal_ha root mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:51.159 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28935 signal_ha root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:51.159 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28935 signal_ha root mem REG 8,1 104984 8251 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-10-08T15:40:51.159 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28935 signal_ha root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:51.160 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28935 signal_ha root mem REG 8,1 1956992 8082 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28 2023-10-08T15:40:51.160 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28935 signal_ha root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:51.160 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28935 signal_ha root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:51.160 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28935 signal_ha root mem REG 8,1 12111760 1053837 /usr/lib/ceph/libceph-common.so.2 2023-10-08T15:40:51.160 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28935 signal_ha root mem REG 8,1 252184 14163 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-10-08T15:40:51.160 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28935 signal_ha root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:51.160 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28935 signal_ha root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:51.160 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28935 signal_ha root 1w FIFO 0,13 0t0 167764 pipe 2023-10-08T15:40:51.161 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28935 signal_ha root 2w FIFO 0,13 0t0 167765 pipe 2023-10-08T15:40:51.161 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28935 signal_ha root 3w REG 8,1 46647892 1068262 /var/log/ceph/ceph-client.0.28924.log 2023-10-08T15:40:51.161 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28935 signal_ha root 4u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.161 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28935 signal_ha root 5r FIFO 0,13 0t0 173760 pipe 2023-10-08T15:40:51.161 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28935 signal_ha root 6w FIFO 0,13 0t0 173760 pipe 2023-10-08T15:40:51.161 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28935 signal_ha root 7u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.161 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28935 signal_ha root 8r FIFO 0,13 0t0 173761 pipe 2023-10-08T15:40:51.161 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28935 signal_ha root 9w FIFO 0,13 0t0 173761 pipe 2023-10-08T15:40:51.161 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28935 signal_ha root 10u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.162 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28935 signal_ha root 11r FIFO 0,13 0t0 173762 pipe 2023-10-08T15:40:51.162 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28935 signal_ha root 12w FIFO 0,13 0t0 173762 pipe 2023-10-08T15:40:51.162 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28935 signal_ha root 13r FIFO 0,13 0t0 173763 pipe 2023-10-08T15:40:51.162 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28935 signal_ha root 14w FIFO 0,13 0t0 173763 pipe 2023-10-08T15:40:51.162 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28935 signal_ha root 15u sock 0,9 0t0 173764 protocol: UNIX 2023-10-08T15:40:51.162 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28935 signal_ha root 16r FIFO 0,13 0t0 173765 pipe 2023-10-08T15:40:51.162 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28935 signal_ha root 17w FIFO 0,13 0t0 173765 pipe 2023-10-08T15:40:51.162 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28935 signal_ha root 18r FIFO 0,13 0t0 173766 pipe 2023-10-08T15:40:51.163 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28935 signal_ha root 19w FIFO 0,13 0t0 173766 pipe 2023-10-08T15:40:51.163 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28935 signal_ha root 20u sock 0,9 0t0 172558 protocol: TCP 2023-10-08T15:40:51.163 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28935 signal_ha root 21u sock 0,9 0t0 167777 protocol: TCP 2023-10-08T15:40:51.163 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28935 signal_ha root 22u CHR 10,229 0t0 87 /dev/fuse 2023-10-08T15:40:51.163 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28935 signal_ha root 23r FIFO 0,13 0t0 172559 pipe 2023-10-08T15:40:51.163 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28935 signal_ha root 24w FIFO 0,13 0t0 172559 pipe 2023-10-08T15:40:51.163 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28935 signal_ha root 25r FIFO 0,13 0t0 169846 pipe 2023-10-08T15:40:51.163 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28935 signal_ha root 26w FIFO 0,13 0t0 169846 pipe 2023-10-08T15:40:51.163 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28935 signal_ha root 27u sock 0,9 0t0 175257 protocol: TCP 2023-10-08T15:40:51.163 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28935 signal_ha root 28r FIFO 0,13 0t0 171742 pipe 2023-10-08T15:40:51.164 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28935 signal_ha root 29w FIFO 0,13 0t0 171742 pipe 2023-10-08T15:40:51.164 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28935 signal_ha root 30u sock 0,9 0t0 167802 protocol: TCP 2023-10-08T15:40:51.164 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28935 signal_ha root 31u sock 0,9 0t0 167803 protocol: TCP 2023-10-08T15:40:51.164 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28935 signal_ha root 32u sock 0,9 0t0 175258 protocol: TCP 2023-10-08T15:40:51.164 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28935 signal_ha root 33u sock 0,9 0t0 167804 protocol: TCP 2023-10-08T15:40:51.164 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28935 signal_ha root 34u sock 0,9 0t0 175259 protocol: TCP 2023-10-08T15:40:51.164 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28935 signal_ha root 35u sock 0,9 0t0 175260 protocol: TCP 2023-10-08T15:40:51.164 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28935 signal_ha root 36u sock 0,9 0t0 171743 protocol: TCP 2023-10-08T15:40:51.165 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28936 io_contex root cwd DIR 8,1 4096 924112 /home/ubuntu/cephtest 2023-10-08T15:40:51.165 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28936 io_contex root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:51.165 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28936 io_contex root txt REG 8,1 2980448 1055345 /usr/bin/ceph-fuse 2023-10-08T15:40:51.165 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28936 io_contex root mem REG 8,1 39368 21279 /usr/lib/x86_64-linux-gnu/liburcu-bp.so.6.1.0 2023-10-08T15:40:51.165 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28936 io_contex root mem REG 8,1 51280 111271 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.0.0.0 2023-10-08T15:40:51.165 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28936 io_contex root mem REG 8,1 137912 13038 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-10-08T15:40:51.165 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28936 io_contex root mem REG 8,1 477584 16364 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-10-08T15:40:51.165 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28936 io_contex root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:51.165 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28936 io_contex root mem REG 8,1 117920 16368 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.2.28.0 2023-10-08T15:40:51.166 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28936 io_contex root mem REG 8,1 121552 16366 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.8.28.0 2023-10-08T15:40:51.166 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28936 io_contex root mem REG 8,1 178528 12765 /usr/lib/x86_64-linux-gnu/libudev.so.1.6.17 2023-10-08T15:40:51.166 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28936 io_contex root mem REG 8,1 2954080 9466 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:51.166 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28936 io_contex root mem REG 8,1 351352 9401 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-10-08T15:40:51.166 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28936 io_contex root mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:51.166 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28936 io_contex root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:51.166 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28936 io_contex root mem REG 8,1 104984 8251 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-10-08T15:40:51.166 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28936 io_contex root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:51.166 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28936 io_contex root mem REG 8,1 1956992 8082 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28 2023-10-08T15:40:51.167 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28936 io_contex root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:51.167 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28936 io_contex root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:51.167 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28936 io_contex root mem REG 8,1 12111760 1053837 /usr/lib/ceph/libceph-common.so.2 2023-10-08T15:40:51.167 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28936 io_contex root mem REG 8,1 252184 14163 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-10-08T15:40:51.167 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28936 io_contex root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:51.167 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28936 io_contex root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:51.167 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28936 io_contex root 1w FIFO 0,13 0t0 167764 pipe 2023-10-08T15:40:51.167 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28936 io_contex root 2w FIFO 0,13 0t0 167765 pipe 2023-10-08T15:40:51.167 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28936 io_contex root 3w REG 8,1 46647892 1068262 /var/log/ceph/ceph-client.0.28924.log 2023-10-08T15:40:51.168 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28936 io_contex root 4u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.168 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28936 io_contex root 5r FIFO 0,13 0t0 173760 pipe 2023-10-08T15:40:51.168 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28936 io_contex root 6w FIFO 0,13 0t0 173760 pipe 2023-10-08T15:40:51.168 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28936 io_contex root 7u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.168 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28936 io_contex root 8r FIFO 0,13 0t0 173761 pipe 2023-10-08T15:40:51.168 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28936 io_contex root 9w FIFO 0,13 0t0 173761 pipe 2023-10-08T15:40:51.168 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28936 io_contex root 10u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.168 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28936 io_contex root 11r FIFO 0,13 0t0 173762 pipe 2023-10-08T15:40:51.168 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28936 io_contex root 12w FIFO 0,13 0t0 173762 pipe 2023-10-08T15:40:51.168 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28936 io_contex root 13r FIFO 0,13 0t0 173763 pipe 2023-10-08T15:40:51.169 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28936 io_contex root 14w FIFO 0,13 0t0 173763 pipe 2023-10-08T15:40:51.169 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28936 io_contex root 15u sock 0,9 0t0 173764 protocol: UNIX 2023-10-08T15:40:51.169 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28936 io_contex root 16r FIFO 0,13 0t0 173765 pipe 2023-10-08T15:40:51.169 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28936 io_contex root 17w FIFO 0,13 0t0 173765 pipe 2023-10-08T15:40:51.169 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28936 io_contex root 18r FIFO 0,13 0t0 173766 pipe 2023-10-08T15:40:51.169 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28936 io_contex root 19w FIFO 0,13 0t0 173766 pipe 2023-10-08T15:40:51.169 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28936 io_contex root 20u sock 0,9 0t0 172558 protocol: TCP 2023-10-08T15:40:51.169 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28936 io_contex root 21u sock 0,9 0t0 167777 protocol: TCP 2023-10-08T15:40:51.169 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28936 io_contex root 22u CHR 10,229 0t0 87 /dev/fuse 2023-10-08T15:40:51.169 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28936 io_contex root 23r FIFO 0,13 0t0 172559 pipe 2023-10-08T15:40:51.169 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28936 io_contex root 24w FIFO 0,13 0t0 172559 pipe 2023-10-08T15:40:51.170 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28936 io_contex root 25r FIFO 0,13 0t0 169846 pipe 2023-10-08T15:40:51.170 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28936 io_contex root 26w FIFO 0,13 0t0 169846 pipe 2023-10-08T15:40:51.170 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28936 io_contex root 27u sock 0,9 0t0 175257 protocol: TCP 2023-10-08T15:40:51.170 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28936 io_contex root 28r FIFO 0,13 0t0 171742 pipe 2023-10-08T15:40:51.170 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28936 io_contex root 29w FIFO 0,13 0t0 171742 pipe 2023-10-08T15:40:51.170 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28936 io_contex root 30u sock 0,9 0t0 167802 protocol: TCP 2023-10-08T15:40:51.170 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28936 io_contex root 31u sock 0,9 0t0 167803 protocol: TCP 2023-10-08T15:40:51.170 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28936 io_contex root 32u sock 0,9 0t0 175258 protocol: TCP 2023-10-08T15:40:51.171 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28936 io_contex root 33u sock 0,9 0t0 167804 protocol: TCP 2023-10-08T15:40:51.171 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28936 io_contex root 34u sock 0,9 0t0 175259 protocol: TCP 2023-10-08T15:40:51.171 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28936 io_contex root 35u sock 0,9 0t0 175260 protocol: TCP 2023-10-08T15:40:51.171 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28936 io_contex root 36u sock 0,9 0t0 171743 protocol: TCP 2023-10-08T15:40:51.171 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28937 io_contex root cwd DIR 8,1 4096 924112 /home/ubuntu/cephtest 2023-10-08T15:40:51.171 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28937 io_contex root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:51.171 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28937 io_contex root txt REG 8,1 2980448 1055345 /usr/bin/ceph-fuse 2023-10-08T15:40:51.171 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28937 io_contex root mem REG 8,1 39368 21279 /usr/lib/x86_64-linux-gnu/liburcu-bp.so.6.1.0 2023-10-08T15:40:51.171 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28937 io_contex root mem REG 8,1 51280 111271 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.0.0.0 2023-10-08T15:40:51.171 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28937 io_contex root mem REG 8,1 137912 13038 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-10-08T15:40:51.172 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28937 io_contex root mem REG 8,1 477584 16364 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-10-08T15:40:51.172 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28937 io_contex root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:51.172 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28937 io_contex root mem REG 8,1 117920 16368 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.2.28.0 2023-10-08T15:40:51.172 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28937 io_contex root mem REG 8,1 121552 16366 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.8.28.0 2023-10-08T15:40:51.172 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28937 io_contex root mem REG 8,1 178528 12765 /usr/lib/x86_64-linux-gnu/libudev.so.1.6.17 2023-10-08T15:40:51.172 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28937 io_contex root mem REG 8,1 2954080 9466 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:51.172 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28937 io_contex root mem REG 8,1 351352 9401 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-10-08T15:40:51.172 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28937 io_contex root mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:51.172 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28937 io_contex root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:51.173 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28937 io_contex root mem REG 8,1 104984 8251 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-10-08T15:40:51.173 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28937 io_contex root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:51.173 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28937 io_contex root mem REG 8,1 1956992 8082 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28 2023-10-08T15:40:51.173 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28937 io_contex root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:51.173 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28937 io_contex root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:51.173 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28937 io_contex root mem REG 8,1 12111760 1053837 /usr/lib/ceph/libceph-common.so.2 2023-10-08T15:40:51.173 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28937 io_contex root mem REG 8,1 252184 14163 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-10-08T15:40:51.173 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28937 io_contex root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:51.173 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28937 io_contex root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:51.173 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28937 io_contex root 1w FIFO 0,13 0t0 167764 pipe 2023-10-08T15:40:51.173 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28937 io_contex root 2w FIFO 0,13 0t0 167765 pipe 2023-10-08T15:40:51.173 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28937 io_contex root 3w REG 8,1 46647892 1068262 /var/log/ceph/ceph-client.0.28924.log 2023-10-08T15:40:51.174 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28937 io_contex root 4u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.174 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28937 io_contex root 5r FIFO 0,13 0t0 173760 pipe 2023-10-08T15:40:51.174 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28937 io_contex root 6w FIFO 0,13 0t0 173760 pipe 2023-10-08T15:40:51.174 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28937 io_contex root 7u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.174 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28937 io_contex root 8r FIFO 0,13 0t0 173761 pipe 2023-10-08T15:40:51.174 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28937 io_contex root 9w FIFO 0,13 0t0 173761 pipe 2023-10-08T15:40:51.174 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28937 io_contex root 10u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.174 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28937 io_contex root 11r FIFO 0,13 0t0 173762 pipe 2023-10-08T15:40:51.174 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28937 io_contex root 12w FIFO 0,13 0t0 173762 pipe 2023-10-08T15:40:51.174 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28937 io_contex root 13r FIFO 0,13 0t0 173763 pipe 2023-10-08T15:40:51.174 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28937 io_contex root 14w FIFO 0,13 0t0 173763 pipe 2023-10-08T15:40:51.175 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28937 io_contex root 15u sock 0,9 0t0 173764 protocol: UNIX 2023-10-08T15:40:51.175 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28937 io_contex root 16r FIFO 0,13 0t0 173765 pipe 2023-10-08T15:40:51.175 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28937 io_contex root 17w FIFO 0,13 0t0 173765 pipe 2023-10-08T15:40:51.175 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28937 io_contex root 18r FIFO 0,13 0t0 173766 pipe 2023-10-08T15:40:51.175 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28937 io_contex root 19w FIFO 0,13 0t0 173766 pipe 2023-10-08T15:40:51.175 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28937 io_contex root 20u sock 0,9 0t0 172558 protocol: TCP 2023-10-08T15:40:51.175 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28937 io_contex root 21u sock 0,9 0t0 167777 protocol: TCP 2023-10-08T15:40:51.175 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28937 io_contex root 22u CHR 10,229 0t0 87 /dev/fuse 2023-10-08T15:40:51.175 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28937 io_contex root 23r FIFO 0,13 0t0 172559 pipe 2023-10-08T15:40:51.175 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28937 io_contex root 24w FIFO 0,13 0t0 172559 pipe 2023-10-08T15:40:51.175 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28937 io_contex root 25r FIFO 0,13 0t0 169846 pipe 2023-10-08T15:40:51.175 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28937 io_contex root 26w FIFO 0,13 0t0 169846 pipe 2023-10-08T15:40:51.176 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28937 io_contex root 27u sock 0,9 0t0 175257 protocol: TCP 2023-10-08T15:40:51.176 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28937 io_contex root 28r FIFO 0,13 0t0 171742 pipe 2023-10-08T15:40:51.176 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28937 io_contex root 29w FIFO 0,13 0t0 171742 pipe 2023-10-08T15:40:51.176 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28937 io_contex root 30u sock 0,9 0t0 167802 protocol: TCP 2023-10-08T15:40:51.176 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28937 io_contex root 31u sock 0,9 0t0 167803 protocol: TCP 2023-10-08T15:40:51.176 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28937 io_contex root 32u sock 0,9 0t0 175258 protocol: TCP 2023-10-08T15:40:51.176 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28937 io_contex root 33u sock 0,9 0t0 167804 protocol: TCP 2023-10-08T15:40:51.176 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28937 io_contex root 34u sock 0,9 0t0 175259 protocol: TCP 2023-10-08T15:40:51.176 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28937 io_contex root 35u sock 0,9 0t0 175260 protocol: TCP 2023-10-08T15:40:51.176 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28937 io_contex root 36u sock 0,9 0t0 171743 protocol: TCP 2023-10-08T15:40:51.176 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28938 ceph_time root cwd DIR 8,1 4096 924112 /home/ubuntu/cephtest 2023-10-08T15:40:51.177 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28938 ceph_time root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:51.177 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28938 ceph_time root txt REG 8,1 2980448 1055345 /usr/bin/ceph-fuse 2023-10-08T15:40:51.177 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28938 ceph_time root mem REG 8,1 39368 21279 /usr/lib/x86_64-linux-gnu/liburcu-bp.so.6.1.0 2023-10-08T15:40:51.177 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28938 ceph_time root mem REG 8,1 51280 111271 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.0.0.0 2023-10-08T15:40:51.177 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28938 ceph_time root mem REG 8,1 137912 13038 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-10-08T15:40:51.177 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28938 ceph_time root mem REG 8,1 477584 16364 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-10-08T15:40:51.177 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28938 ceph_time root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:51.177 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28938 ceph_time root mem REG 8,1 117920 16368 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.2.28.0 2023-10-08T15:40:51.177 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28938 ceph_time root mem REG 8,1 121552 16366 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.8.28.0 2023-10-08T15:40:51.177 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28938 ceph_time root mem REG 8,1 178528 12765 /usr/lib/x86_64-linux-gnu/libudev.so.1.6.17 2023-10-08T15:40:51.177 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28938 ceph_time root mem REG 8,1 2954080 9466 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:51.178 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28938 ceph_time root mem REG 8,1 351352 9401 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-10-08T15:40:51.178 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28938 ceph_time root mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:51.178 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28938 ceph_time root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:51.178 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28938 ceph_time root mem REG 8,1 104984 8251 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-10-08T15:40:51.178 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28938 ceph_time root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:51.178 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28938 ceph_time root mem REG 8,1 1956992 8082 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28 2023-10-08T15:40:51.178 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28938 ceph_time root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:51.178 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28938 ceph_time root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:51.178 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28938 ceph_time root mem REG 8,1 12111760 1053837 /usr/lib/ceph/libceph-common.so.2 2023-10-08T15:40:51.178 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28938 ceph_time root mem REG 8,1 252184 14163 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-10-08T15:40:51.178 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28938 ceph_time root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:51.178 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28938 ceph_time root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:51.179 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28938 ceph_time root 1w FIFO 0,13 0t0 167764 pipe 2023-10-08T15:40:51.179 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28938 ceph_time root 2w FIFO 0,13 0t0 167765 pipe 2023-10-08T15:40:51.179 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28938 ceph_time root 3w REG 8,1 46647892 1068262 /var/log/ceph/ceph-client.0.28924.log 2023-10-08T15:40:51.179 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28938 ceph_time root 4u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.179 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28938 ceph_time root 5r FIFO 0,13 0t0 173760 pipe 2023-10-08T15:40:51.179 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28938 ceph_time root 6w FIFO 0,13 0t0 173760 pipe 2023-10-08T15:40:51.179 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28938 ceph_time root 7u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.179 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28938 ceph_time root 8r FIFO 0,13 0t0 173761 pipe 2023-10-08T15:40:51.179 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28938 ceph_time root 9w FIFO 0,13 0t0 173761 pipe 2023-10-08T15:40:51.179 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28938 ceph_time root 10u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.179 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28938 ceph_time root 11r FIFO 0,13 0t0 173762 pipe 2023-10-08T15:40:51.179 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28938 ceph_time root 12w FIFO 0,13 0t0 173762 pipe 2023-10-08T15:40:51.180 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28938 ceph_time root 13r FIFO 0,13 0t0 173763 pipe 2023-10-08T15:40:51.180 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28938 ceph_time root 14w FIFO 0,13 0t0 173763 pipe 2023-10-08T15:40:51.180 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28938 ceph_time root 15u sock 0,9 0t0 173764 protocol: UNIX 2023-10-08T15:40:51.180 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28938 ceph_time root 16r FIFO 0,13 0t0 173765 pipe 2023-10-08T15:40:51.180 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28938 ceph_time root 17w FIFO 0,13 0t0 173765 pipe 2023-10-08T15:40:51.180 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28938 ceph_time root 18r FIFO 0,13 0t0 173766 pipe 2023-10-08T15:40:51.180 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28938 ceph_time root 19w FIFO 0,13 0t0 173766 pipe 2023-10-08T15:40:51.180 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28938 ceph_time root 20u sock 0,9 0t0 172558 protocol: TCP 2023-10-08T15:40:51.180 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28938 ceph_time root 21u sock 0,9 0t0 167777 protocol: TCP 2023-10-08T15:40:51.180 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28938 ceph_time root 22u CHR 10,229 0t0 87 /dev/fuse 2023-10-08T15:40:51.180 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28938 ceph_time root 23r FIFO 0,13 0t0 172559 pipe 2023-10-08T15:40:51.180 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28938 ceph_time root 24w FIFO 0,13 0t0 172559 pipe 2023-10-08T15:40:51.181 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28938 ceph_time root 25r FIFO 0,13 0t0 169846 pipe 2023-10-08T15:40:51.181 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28938 ceph_time root 26w FIFO 0,13 0t0 169846 pipe 2023-10-08T15:40:51.181 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28938 ceph_time root 27u sock 0,9 0t0 175257 protocol: TCP 2023-10-08T15:40:51.181 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28938 ceph_time root 28r FIFO 0,13 0t0 171742 pipe 2023-10-08T15:40:51.181 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28938 ceph_time root 29w FIFO 0,13 0t0 171742 pipe 2023-10-08T15:40:51.181 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28938 ceph_time root 30u sock 0,9 0t0 167802 protocol: TCP 2023-10-08T15:40:51.181 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28938 ceph_time root 31u sock 0,9 0t0 167803 protocol: TCP 2023-10-08T15:40:51.181 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28938 ceph_time root 32u sock 0,9 0t0 175258 protocol: TCP 2023-10-08T15:40:51.181 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28938 ceph_time root 33u sock 0,9 0t0 167804 protocol: TCP 2023-10-08T15:40:51.181 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28938 ceph_time root 34u sock 0,9 0t0 175259 protocol: TCP 2023-10-08T15:40:51.181 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28938 ceph_time root 35u sock 0,9 0t0 175260 protocol: TCP 2023-10-08T15:40:51.181 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28938 ceph_time root 36u sock 0,9 0t0 171743 protocol: TCP 2023-10-08T15:40:51.182 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28939 fn_anonym root cwd DIR 8,1 4096 924112 /home/ubuntu/cephtest 2023-10-08T15:40:51.182 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28939 fn_anonym root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:51.182 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28939 fn_anonym root txt REG 8,1 2980448 1055345 /usr/bin/ceph-fuse 2023-10-08T15:40:51.182 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28939 fn_anonym root mem REG 8,1 39368 21279 /usr/lib/x86_64-linux-gnu/liburcu-bp.so.6.1.0 2023-10-08T15:40:51.182 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28939 fn_anonym root mem REG 8,1 51280 111271 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.0.0.0 2023-10-08T15:40:51.182 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28939 fn_anonym root mem REG 8,1 137912 13038 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-10-08T15:40:51.182 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28939 fn_anonym root mem REG 8,1 477584 16364 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-10-08T15:40:51.182 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28939 fn_anonym root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:51.182 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28939 fn_anonym root mem REG 8,1 117920 16368 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.2.28.0 2023-10-08T15:40:51.182 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28939 fn_anonym root mem REG 8,1 121552 16366 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.8.28.0 2023-10-08T15:40:51.182 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28939 fn_anonym root mem REG 8,1 178528 12765 /usr/lib/x86_64-linux-gnu/libudev.so.1.6.17 2023-10-08T15:40:51.183 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28939 fn_anonym root mem REG 8,1 2954080 9466 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:51.183 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28939 fn_anonym root mem REG 8,1 351352 9401 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-10-08T15:40:51.183 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28939 fn_anonym root mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:51.183 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28939 fn_anonym root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:51.183 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28939 fn_anonym root mem REG 8,1 104984 8251 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-10-08T15:40:51.183 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28939 fn_anonym root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:51.183 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28939 fn_anonym root mem REG 8,1 1956992 8082 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28 2023-10-08T15:40:51.183 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28939 fn_anonym root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:51.183 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28939 fn_anonym root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:51.183 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28939 fn_anonym root mem REG 8,1 12111760 1053837 /usr/lib/ceph/libceph-common.so.2 2023-10-08T15:40:51.184 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28939 fn_anonym root mem REG 8,1 252184 14163 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-10-08T15:40:51.184 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28939 fn_anonym root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:51.184 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28939 fn_anonym root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:51.184 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28939 fn_anonym root 1w FIFO 0,13 0t0 167764 pipe 2023-10-08T15:40:51.184 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28939 fn_anonym root 2w FIFO 0,13 0t0 167765 pipe 2023-10-08T15:40:51.184 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28939 fn_anonym root 3w REG 8,1 46647892 1068262 /var/log/ceph/ceph-client.0.28924.log 2023-10-08T15:40:51.184 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28939 fn_anonym root 4u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.184 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28939 fn_anonym root 5r FIFO 0,13 0t0 173760 pipe 2023-10-08T15:40:51.184 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28939 fn_anonym root 6w FIFO 0,13 0t0 173760 pipe 2023-10-08T15:40:51.184 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28939 fn_anonym root 7u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.185 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28939 fn_anonym root 8r FIFO 0,13 0t0 173761 pipe 2023-10-08T15:40:51.185 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28939 fn_anonym root 9w FIFO 0,13 0t0 173761 pipe 2023-10-08T15:40:51.185 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28939 fn_anonym root 10u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.185 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28939 fn_anonym root 11r FIFO 0,13 0t0 173762 pipe 2023-10-08T15:40:51.185 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28939 fn_anonym root 12w FIFO 0,13 0t0 173762 pipe 2023-10-08T15:40:51.185 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28939 fn_anonym root 13r FIFO 0,13 0t0 173763 pipe 2023-10-08T15:40:51.185 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28939 fn_anonym root 14w FIFO 0,13 0t0 173763 pipe 2023-10-08T15:40:51.185 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28939 fn_anonym root 15u sock 0,9 0t0 173764 protocol: UNIX 2023-10-08T15:40:51.185 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28939 fn_anonym root 16r FIFO 0,13 0t0 173765 pipe 2023-10-08T15:40:51.185 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28939 fn_anonym root 17w FIFO 0,13 0t0 173765 pipe 2023-10-08T15:40:51.186 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28939 fn_anonym root 18r FIFO 0,13 0t0 173766 pipe 2023-10-08T15:40:51.186 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28939 fn_anonym root 19w FIFO 0,13 0t0 173766 pipe 2023-10-08T15:40:51.186 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28939 fn_anonym root 20u sock 0,9 0t0 172558 protocol: TCP 2023-10-08T15:40:51.186 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28939 fn_anonym root 21u sock 0,9 0t0 167777 protocol: TCP 2023-10-08T15:40:51.186 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28939 fn_anonym root 22u CHR 10,229 0t0 87 /dev/fuse 2023-10-08T15:40:51.186 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28939 fn_anonym root 23r FIFO 0,13 0t0 172559 pipe 2023-10-08T15:40:51.186 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28939 fn_anonym root 24w FIFO 0,13 0t0 172559 pipe 2023-10-08T15:40:51.186 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28939 fn_anonym root 25r FIFO 0,13 0t0 169846 pipe 2023-10-08T15:40:51.186 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28939 fn_anonym root 26w FIFO 0,13 0t0 169846 pipe 2023-10-08T15:40:51.186 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28939 fn_anonym root 27u sock 0,9 0t0 175257 protocol: TCP 2023-10-08T15:40:51.187 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28939 fn_anonym root 28r FIFO 0,13 0t0 171742 pipe 2023-10-08T15:40:51.187 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28939 fn_anonym root 29w FIFO 0,13 0t0 171742 pipe 2023-10-08T15:40:51.187 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28939 fn_anonym root 30u sock 0,9 0t0 167802 protocol: TCP 2023-10-08T15:40:51.187 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28939 fn_anonym root 31u sock 0,9 0t0 167803 protocol: TCP 2023-10-08T15:40:51.187 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28939 fn_anonym root 32u sock 0,9 0t0 175258 protocol: TCP 2023-10-08T15:40:51.187 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28939 fn_anonym root 33u sock 0,9 0t0 167804 protocol: TCP 2023-10-08T15:40:51.187 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28939 fn_anonym root 34u sock 0,9 0t0 175259 protocol: TCP 2023-10-08T15:40:51.187 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28939 fn_anonym root 35u sock 0,9 0t0 175260 protocol: TCP 2023-10-08T15:40:51.188 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28939 fn_anonym root 36u sock 0,9 0t0 171743 protocol: TCP 2023-10-08T15:40:51.188 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28940 fn_anonym root cwd DIR 8,1 4096 924112 /home/ubuntu/cephtest 2023-10-08T15:40:51.188 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28940 fn_anonym root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:51.188 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28940 fn_anonym root txt REG 8,1 2980448 1055345 /usr/bin/ceph-fuse 2023-10-08T15:40:51.188 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28940 fn_anonym root mem REG 8,1 39368 21279 /usr/lib/x86_64-linux-gnu/liburcu-bp.so.6.1.0 2023-10-08T15:40:51.188 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28940 fn_anonym root mem REG 8,1 51280 111271 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.0.0.0 2023-10-08T15:40:51.188 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28940 fn_anonym root mem REG 8,1 137912 13038 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-10-08T15:40:51.188 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28940 fn_anonym root mem REG 8,1 477584 16364 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-10-08T15:40:51.188 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28940 fn_anonym root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:51.188 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28940 fn_anonym root mem REG 8,1 117920 16368 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.2.28.0 2023-10-08T15:40:51.189 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28940 fn_anonym root mem REG 8,1 121552 16366 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.8.28.0 2023-10-08T15:40:51.189 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28940 fn_anonym root mem REG 8,1 178528 12765 /usr/lib/x86_64-linux-gnu/libudev.so.1.6.17 2023-10-08T15:40:51.189 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28940 fn_anonym root mem REG 8,1 2954080 9466 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:51.189 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28940 fn_anonym root mem REG 8,1 351352 9401 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-10-08T15:40:51.189 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28940 fn_anonym root mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:51.189 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28940 fn_anonym root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:51.189 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28940 fn_anonym root mem REG 8,1 104984 8251 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-10-08T15:40:51.189 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28940 fn_anonym root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:51.189 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28940 fn_anonym root mem REG 8,1 1956992 8082 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28 2023-10-08T15:40:51.189 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28940 fn_anonym root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:51.190 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28940 fn_anonym root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:51.190 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28940 fn_anonym root mem REG 8,1 12111760 1053837 /usr/lib/ceph/libceph-common.so.2 2023-10-08T15:40:51.190 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28940 fn_anonym root mem REG 8,1 252184 14163 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-10-08T15:40:51.190 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28940 fn_anonym root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:51.190 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28940 fn_anonym root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:51.190 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28940 fn_anonym root 1w FIFO 0,13 0t0 167764 pipe 2023-10-08T15:40:51.190 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28940 fn_anonym root 2w FIFO 0,13 0t0 167765 pipe 2023-10-08T15:40:51.190 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28940 fn_anonym root 3w REG 8,1 46647892 1068262 /var/log/ceph/ceph-client.0.28924.log 2023-10-08T15:40:51.191 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28940 fn_anonym root 4u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.191 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28940 fn_anonym root 5r FIFO 0,13 0t0 173760 pipe 2023-10-08T15:40:51.191 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28940 fn_anonym root 6w FIFO 0,13 0t0 173760 pipe 2023-10-08T15:40:51.191 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28940 fn_anonym root 7u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.191 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28940 fn_anonym root 8r FIFO 0,13 0t0 173761 pipe 2023-10-08T15:40:51.191 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28940 fn_anonym root 9w FIFO 0,13 0t0 173761 pipe 2023-10-08T15:40:51.191 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28940 fn_anonym root 10u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.191 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28940 fn_anonym root 11r FIFO 0,13 0t0 173762 pipe 2023-10-08T15:40:51.191 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28940 fn_anonym root 12w FIFO 0,13 0t0 173762 pipe 2023-10-08T15:40:51.191 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28940 fn_anonym root 13r FIFO 0,13 0t0 173763 pipe 2023-10-08T15:40:51.192 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28940 fn_anonym root 14w FIFO 0,13 0t0 173763 pipe 2023-10-08T15:40:51.192 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28940 fn_anonym root 15u sock 0,9 0t0 173764 protocol: UNIX 2023-10-08T15:40:51.192 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28940 fn_anonym root 16r FIFO 0,13 0t0 173765 pipe 2023-10-08T15:40:51.192 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28940 fn_anonym root 17w FIFO 0,13 0t0 173765 pipe 2023-10-08T15:40:51.192 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28940 fn_anonym root 18r FIFO 0,13 0t0 173766 pipe 2023-10-08T15:40:51.192 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28940 fn_anonym root 19w FIFO 0,13 0t0 173766 pipe 2023-10-08T15:40:51.192 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28940 fn_anonym root 20u sock 0,9 0t0 172558 protocol: TCP 2023-10-08T15:40:51.192 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28940 fn_anonym root 21u sock 0,9 0t0 167777 protocol: TCP 2023-10-08T15:40:51.192 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28940 fn_anonym root 22u CHR 10,229 0t0 87 /dev/fuse 2023-10-08T15:40:51.193 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28940 fn_anonym root 23r FIFO 0,13 0t0 172559 pipe 2023-10-08T15:40:51.193 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28940 fn_anonym root 24w FIFO 0,13 0t0 172559 pipe 2023-10-08T15:40:51.193 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28940 fn_anonym root 25r FIFO 0,13 0t0 169846 pipe 2023-10-08T15:40:51.193 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28940 fn_anonym root 26w FIFO 0,13 0t0 169846 pipe 2023-10-08T15:40:51.193 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28940 fn_anonym root 27u sock 0,9 0t0 175257 protocol: TCP 2023-10-08T15:40:51.193 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28940 fn_anonym root 28r FIFO 0,13 0t0 171742 pipe 2023-10-08T15:40:51.193 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28940 fn_anonym root 29w FIFO 0,13 0t0 171742 pipe 2023-10-08T15:40:51.193 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28940 fn_anonym root 30u sock 0,9 0t0 167802 protocol: TCP 2023-10-08T15:40:51.193 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28940 fn_anonym root 31u sock 0,9 0t0 167803 protocol: TCP 2023-10-08T15:40:51.193 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28940 fn_anonym root 32u sock 0,9 0t0 175258 protocol: TCP 2023-10-08T15:40:51.194 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28940 fn_anonym root 33u sock 0,9 0t0 167804 protocol: TCP 2023-10-08T15:40:51.194 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28940 fn_anonym root 34u sock 0,9 0t0 175259 protocol: TCP 2023-10-08T15:40:51.194 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28940 fn_anonym root 35u sock 0,9 0t0 175260 protocol: TCP 2023-10-08T15:40:51.194 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28940 fn_anonym root 36u sock 0,9 0t0 171743 protocol: TCP 2023-10-08T15:40:51.194 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28941 fn_anonym root cwd DIR 8,1 4096 924112 /home/ubuntu/cephtest 2023-10-08T15:40:51.194 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28941 fn_anonym root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:51.194 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28941 fn_anonym root txt REG 8,1 2980448 1055345 /usr/bin/ceph-fuse 2023-10-08T15:40:51.194 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28941 fn_anonym root mem REG 8,1 39368 21279 /usr/lib/x86_64-linux-gnu/liburcu-bp.so.6.1.0 2023-10-08T15:40:51.194 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28941 fn_anonym root mem REG 8,1 51280 111271 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.0.0.0 2023-10-08T15:40:51.195 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28941 fn_anonym root mem REG 8,1 137912 13038 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-10-08T15:40:51.195 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28941 fn_anonym root mem REG 8,1 477584 16364 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-10-08T15:40:51.195 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28941 fn_anonym root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:51.195 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28941 fn_anonym root mem REG 8,1 117920 16368 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.2.28.0 2023-10-08T15:40:51.195 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28941 fn_anonym root mem REG 8,1 121552 16366 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.8.28.0 2023-10-08T15:40:51.195 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28941 fn_anonym root mem REG 8,1 178528 12765 /usr/lib/x86_64-linux-gnu/libudev.so.1.6.17 2023-10-08T15:40:51.195 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28941 fn_anonym root mem REG 8,1 2954080 9466 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:51.195 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28941 fn_anonym root mem REG 8,1 351352 9401 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-10-08T15:40:51.195 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28941 fn_anonym root mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:51.196 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28941 fn_anonym root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:51.196 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28941 fn_anonym root mem REG 8,1 104984 8251 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-10-08T15:40:51.196 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28941 fn_anonym root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:51.196 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28941 fn_anonym root mem REG 8,1 1956992 8082 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28 2023-10-08T15:40:51.196 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28941 fn_anonym root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:51.196 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28941 fn_anonym root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:51.196 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28941 fn_anonym root mem REG 8,1 12111760 1053837 /usr/lib/ceph/libceph-common.so.2 2023-10-08T15:40:51.196 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28941 fn_anonym root mem REG 8,1 252184 14163 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-10-08T15:40:51.196 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28941 fn_anonym root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:51.197 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28941 fn_anonym root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:51.197 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28941 fn_anonym root 1w FIFO 0,13 0t0 167764 pipe 2023-10-08T15:40:51.197 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28941 fn_anonym root 2w FIFO 0,13 0t0 167765 pipe 2023-10-08T15:40:51.197 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28941 fn_anonym root 3w REG 8,1 46647892 1068262 /var/log/ceph/ceph-client.0.28924.log 2023-10-08T15:40:51.197 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28941 fn_anonym root 4u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.197 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28941 fn_anonym root 5r FIFO 0,13 0t0 173760 pipe 2023-10-08T15:40:51.197 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28941 fn_anonym root 6w FIFO 0,13 0t0 173760 pipe 2023-10-08T15:40:51.198 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28941 fn_anonym root 7u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.198 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28941 fn_anonym root 8r FIFO 0,13 0t0 173761 pipe 2023-10-08T15:40:51.198 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28941 fn_anonym root 9w FIFO 0,13 0t0 173761 pipe 2023-10-08T15:40:51.198 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28941 fn_anonym root 10u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.198 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28941 fn_anonym root 11r FIFO 0,13 0t0 173762 pipe 2023-10-08T15:40:51.198 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28941 fn_anonym root 12w FIFO 0,13 0t0 173762 pipe 2023-10-08T15:40:51.198 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28941 fn_anonym root 13r FIFO 0,13 0t0 173763 pipe 2023-10-08T15:40:51.198 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28941 fn_anonym root 14w FIFO 0,13 0t0 173763 pipe 2023-10-08T15:40:51.198 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28941 fn_anonym root 15u sock 0,9 0t0 173764 protocol: UNIX 2023-10-08T15:40:51.198 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28941 fn_anonym root 16r FIFO 0,13 0t0 173765 pipe 2023-10-08T15:40:51.199 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28941 fn_anonym root 17w FIFO 0,13 0t0 173765 pipe 2023-10-08T15:40:51.199 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28941 fn_anonym root 18r FIFO 0,13 0t0 173766 pipe 2023-10-08T15:40:51.199 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28941 fn_anonym root 19w FIFO 0,13 0t0 173766 pipe 2023-10-08T15:40:51.199 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28941 fn_anonym root 20u sock 0,9 0t0 172558 protocol: TCP 2023-10-08T15:40:51.199 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28941 fn_anonym root 21u sock 0,9 0t0 167777 protocol: TCP 2023-10-08T15:40:51.199 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28941 fn_anonym root 22u CHR 10,229 0t0 87 /dev/fuse 2023-10-08T15:40:51.199 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28941 fn_anonym root 23r FIFO 0,13 0t0 172559 pipe 2023-10-08T15:40:51.199 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28941 fn_anonym root 24w FIFO 0,13 0t0 172559 pipe 2023-10-08T15:40:51.199 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28941 fn_anonym root 25r FIFO 0,13 0t0 169846 pipe 2023-10-08T15:40:51.199 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28941 fn_anonym root 26w FIFO 0,13 0t0 169846 pipe 2023-10-08T15:40:51.200 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28941 fn_anonym root 27u sock 0,9 0t0 175257 protocol: TCP 2023-10-08T15:40:51.200 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28941 fn_anonym root 28r FIFO 0,13 0t0 171742 pipe 2023-10-08T15:40:51.200 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28941 fn_anonym root 29w FIFO 0,13 0t0 171742 pipe 2023-10-08T15:40:51.200 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28941 fn_anonym root 30u sock 0,9 0t0 167802 protocol: TCP 2023-10-08T15:40:51.200 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28941 fn_anonym root 31u sock 0,9 0t0 167803 protocol: TCP 2023-10-08T15:40:51.200 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28941 fn_anonym root 32u sock 0,9 0t0 175258 protocol: TCP 2023-10-08T15:40:51.200 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28941 fn_anonym root 33u sock 0,9 0t0 167804 protocol: TCP 2023-10-08T15:40:51.200 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28941 fn_anonym root 34u sock 0,9 0t0 175259 protocol: TCP 2023-10-08T15:40:51.200 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28941 fn_anonym root 35u sock 0,9 0t0 175260 protocol: TCP 2023-10-08T15:40:51.200 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28941 fn_anonym root 36u sock 0,9 0t0 171743 protocol: TCP 2023-10-08T15:40:51.201 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28942 fn_anonym root cwd DIR 8,1 4096 924112 /home/ubuntu/cephtest 2023-10-08T15:40:51.201 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28942 fn_anonym root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:51.201 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28942 fn_anonym root txt REG 8,1 2980448 1055345 /usr/bin/ceph-fuse 2023-10-08T15:40:51.201 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28942 fn_anonym root mem REG 8,1 39368 21279 /usr/lib/x86_64-linux-gnu/liburcu-bp.so.6.1.0 2023-10-08T15:40:51.201 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28942 fn_anonym root mem REG 8,1 51280 111271 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.0.0.0 2023-10-08T15:40:51.201 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28942 fn_anonym root mem REG 8,1 137912 13038 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-10-08T15:40:51.201 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28942 fn_anonym root mem REG 8,1 477584 16364 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-10-08T15:40:51.201 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28942 fn_anonym root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:51.201 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28942 fn_anonym root mem REG 8,1 117920 16368 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.2.28.0 2023-10-08T15:40:51.202 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28942 fn_anonym root mem REG 8,1 121552 16366 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.8.28.0 2023-10-08T15:40:51.202 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28942 fn_anonym root mem REG 8,1 178528 12765 /usr/lib/x86_64-linux-gnu/libudev.so.1.6.17 2023-10-08T15:40:51.202 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28942 fn_anonym root mem REG 8,1 2954080 9466 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:51.202 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28942 fn_anonym root mem REG 8,1 351352 9401 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-10-08T15:40:51.202 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28942 fn_anonym root mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:51.202 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28942 fn_anonym root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:51.202 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28942 fn_anonym root mem REG 8,1 104984 8251 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-10-08T15:40:51.202 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28942 fn_anonym root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:51.202 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28942 fn_anonym root mem REG 8,1 1956992 8082 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28 2023-10-08T15:40:51.202 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28942 fn_anonym root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:51.203 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28942 fn_anonym root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:51.203 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28942 fn_anonym root mem REG 8,1 12111760 1053837 /usr/lib/ceph/libceph-common.so.2 2023-10-08T15:40:51.203 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28942 fn_anonym root mem REG 8,1 252184 14163 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-10-08T15:40:51.203 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28942 fn_anonym root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:51.203 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28942 fn_anonym root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:51.203 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28942 fn_anonym root 1w FIFO 0,13 0t0 167764 pipe 2023-10-08T15:40:51.203 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28942 fn_anonym root 2w FIFO 0,13 0t0 167765 pipe 2023-10-08T15:40:51.203 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28942 fn_anonym root 3w REG 8,1 46647892 1068262 /var/log/ceph/ceph-client.0.28924.log 2023-10-08T15:40:51.203 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28942 fn_anonym root 4u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.203 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28942 fn_anonym root 5r FIFO 0,13 0t0 173760 pipe 2023-10-08T15:40:51.203 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28942 fn_anonym root 6w FIFO 0,13 0t0 173760 pipe 2023-10-08T15:40:51.204 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28942 fn_anonym root 7u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.204 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28942 fn_anonym root 8r FIFO 0,13 0t0 173761 pipe 2023-10-08T15:40:51.204 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28942 fn_anonym root 9w FIFO 0,13 0t0 173761 pipe 2023-10-08T15:40:51.204 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28942 fn_anonym root 10u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.204 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28942 fn_anonym root 11r FIFO 0,13 0t0 173762 pipe 2023-10-08T15:40:51.204 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28942 fn_anonym root 12w FIFO 0,13 0t0 173762 pipe 2023-10-08T15:40:51.204 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28942 fn_anonym root 13r FIFO 0,13 0t0 173763 pipe 2023-10-08T15:40:51.204 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28942 fn_anonym root 14w FIFO 0,13 0t0 173763 pipe 2023-10-08T15:40:51.204 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28942 fn_anonym root 15u sock 0,9 0t0 173764 protocol: UNIX 2023-10-08T15:40:51.204 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28942 fn_anonym root 16r FIFO 0,13 0t0 173765 pipe 2023-10-08T15:40:51.204 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28942 fn_anonym root 17w FIFO 0,13 0t0 173765 pipe 2023-10-08T15:40:51.205 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28942 fn_anonym root 18r FIFO 0,13 0t0 173766 pipe 2023-10-08T15:40:51.205 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28942 fn_anonym root 19w FIFO 0,13 0t0 173766 pipe 2023-10-08T15:40:51.205 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28942 fn_anonym root 20u sock 0,9 0t0 172558 protocol: TCP 2023-10-08T15:40:51.205 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28942 fn_anonym root 21u sock 0,9 0t0 167777 protocol: TCP 2023-10-08T15:40:51.205 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28942 fn_anonym root 22u CHR 10,229 0t0 87 /dev/fuse 2023-10-08T15:40:51.205 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28942 fn_anonym root 23r FIFO 0,13 0t0 172559 pipe 2023-10-08T15:40:51.205 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28942 fn_anonym root 24w FIFO 0,13 0t0 172559 pipe 2023-10-08T15:40:51.205 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28942 fn_anonym root 25r FIFO 0,13 0t0 169846 pipe 2023-10-08T15:40:51.205 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28942 fn_anonym root 26w FIFO 0,13 0t0 169846 pipe 2023-10-08T15:40:51.205 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28942 fn_anonym root 27u sock 0,9 0t0 175257 protocol: TCP 2023-10-08T15:40:51.205 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28942 fn_anonym root 28r FIFO 0,13 0t0 171742 pipe 2023-10-08T15:40:51.206 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28942 fn_anonym root 29w FIFO 0,13 0t0 171742 pipe 2023-10-08T15:40:51.206 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28942 fn_anonym root 30u sock 0,9 0t0 167802 protocol: TCP 2023-10-08T15:40:51.206 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28942 fn_anonym root 31u sock 0,9 0t0 167803 protocol: TCP 2023-10-08T15:40:51.206 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28942 fn_anonym root 32u sock 0,9 0t0 175258 protocol: TCP 2023-10-08T15:40:51.206 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28942 fn_anonym root 33u sock 0,9 0t0 167804 protocol: TCP 2023-10-08T15:40:51.206 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28942 fn_anonym root 34u sock 0,9 0t0 175259 protocol: TCP 2023-10-08T15:40:51.206 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28942 fn_anonym root 35u sock 0,9 0t0 175260 protocol: TCP 2023-10-08T15:40:51.206 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28942 fn_anonym root 36u sock 0,9 0t0 171743 protocol: TCP 2023-10-08T15:40:51.206 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28943 fn_anonym root cwd DIR 8,1 4096 924112 /home/ubuntu/cephtest 2023-10-08T15:40:51.206 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28943 fn_anonym root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:51.206 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28943 fn_anonym root txt REG 8,1 2980448 1055345 /usr/bin/ceph-fuse 2023-10-08T15:40:51.207 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28943 fn_anonym root mem REG 8,1 39368 21279 /usr/lib/x86_64-linux-gnu/liburcu-bp.so.6.1.0 2023-10-08T15:40:51.207 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28943 fn_anonym root mem REG 8,1 51280 111271 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.0.0.0 2023-10-08T15:40:51.207 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28943 fn_anonym root mem REG 8,1 137912 13038 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-10-08T15:40:51.207 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28943 fn_anonym root mem REG 8,1 477584 16364 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-10-08T15:40:51.207 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28943 fn_anonym root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:51.207 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28943 fn_anonym root mem REG 8,1 117920 16368 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.2.28.0 2023-10-08T15:40:51.207 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28943 fn_anonym root mem REG 8,1 121552 16366 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.8.28.0 2023-10-08T15:40:51.207 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28943 fn_anonym root mem REG 8,1 178528 12765 /usr/lib/x86_64-linux-gnu/libudev.so.1.6.17 2023-10-08T15:40:51.207 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28943 fn_anonym root mem REG 8,1 2954080 9466 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:51.207 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28943 fn_anonym root mem REG 8,1 351352 9401 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-10-08T15:40:51.207 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28943 fn_anonym root mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:51.208 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28943 fn_anonym root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:51.208 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28943 fn_anonym root mem REG 8,1 104984 8251 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-10-08T15:40:51.208 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28943 fn_anonym root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:51.208 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28943 fn_anonym root mem REG 8,1 1956992 8082 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28 2023-10-08T15:40:51.208 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28943 fn_anonym root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:51.208 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28943 fn_anonym root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:51.208 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28943 fn_anonym root mem REG 8,1 12111760 1053837 /usr/lib/ceph/libceph-common.so.2 2023-10-08T15:40:51.208 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28943 fn_anonym root mem REG 8,1 252184 14163 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-10-08T15:40:51.208 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28943 fn_anonym root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:51.208 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28943 fn_anonym root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:51.208 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28943 fn_anonym root 1w FIFO 0,13 0t0 167764 pipe 2023-10-08T15:40:51.209 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28943 fn_anonym root 2w FIFO 0,13 0t0 167765 pipe 2023-10-08T15:40:51.209 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28943 fn_anonym root 3w REG 8,1 46647892 1068262 /var/log/ceph/ceph-client.0.28924.log 2023-10-08T15:40:51.209 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28943 fn_anonym root 4u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.209 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28943 fn_anonym root 5r FIFO 0,13 0t0 173760 pipe 2023-10-08T15:40:51.209 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28943 fn_anonym root 6w FIFO 0,13 0t0 173760 pipe 2023-10-08T15:40:51.209 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28943 fn_anonym root 7u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.209 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28943 fn_anonym root 8r FIFO 0,13 0t0 173761 pipe 2023-10-08T15:40:51.209 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28943 fn_anonym root 9w FIFO 0,13 0t0 173761 pipe 2023-10-08T15:40:51.209 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28943 fn_anonym root 10u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.209 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28943 fn_anonym root 11r FIFO 0,13 0t0 173762 pipe 2023-10-08T15:40:51.210 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28943 fn_anonym root 12w FIFO 0,13 0t0 173762 pipe 2023-10-08T15:40:51.210 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28943 fn_anonym root 13r FIFO 0,13 0t0 173763 pipe 2023-10-08T15:40:51.210 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28943 fn_anonym root 14w FIFO 0,13 0t0 173763 pipe 2023-10-08T15:40:51.210 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28943 fn_anonym root 15u sock 0,9 0t0 173764 protocol: UNIX 2023-10-08T15:40:51.210 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28943 fn_anonym root 16r FIFO 0,13 0t0 173765 pipe 2023-10-08T15:40:51.210 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28943 fn_anonym root 17w FIFO 0,13 0t0 173765 pipe 2023-10-08T15:40:51.210 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28943 fn_anonym root 18r FIFO 0,13 0t0 173766 pipe 2023-10-08T15:40:51.210 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28943 fn_anonym root 19w FIFO 0,13 0t0 173766 pipe 2023-10-08T15:40:51.210 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28943 fn_anonym root 20u sock 0,9 0t0 172558 protocol: TCP 2023-10-08T15:40:51.211 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28943 fn_anonym root 21u sock 0,9 0t0 167777 protocol: TCP 2023-10-08T15:40:51.211 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28943 fn_anonym root 22u CHR 10,229 0t0 87 /dev/fuse 2023-10-08T15:40:51.211 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28943 fn_anonym root 23r FIFO 0,13 0t0 172559 pipe 2023-10-08T15:40:51.211 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28943 fn_anonym root 24w FIFO 0,13 0t0 172559 pipe 2023-10-08T15:40:51.211 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28943 fn_anonym root 25r FIFO 0,13 0t0 169846 pipe 2023-10-08T15:40:51.211 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28943 fn_anonym root 26w FIFO 0,13 0t0 169846 pipe 2023-10-08T15:40:51.211 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28943 fn_anonym root 27u sock 0,9 0t0 175257 protocol: TCP 2023-10-08T15:40:51.211 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28943 fn_anonym root 28r FIFO 0,13 0t0 171742 pipe 2023-10-08T15:40:51.211 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28943 fn_anonym root 29w FIFO 0,13 0t0 171742 pipe 2023-10-08T15:40:51.212 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28943 fn_anonym root 30u sock 0,9 0t0 167802 protocol: TCP 2023-10-08T15:40:51.212 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28943 fn_anonym root 31u sock 0,9 0t0 167803 protocol: TCP 2023-10-08T15:40:51.212 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28943 fn_anonym root 32u sock 0,9 0t0 175258 protocol: TCP 2023-10-08T15:40:51.212 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28943 fn_anonym root 33u sock 0,9 0t0 167804 protocol: TCP 2023-10-08T15:40:51.212 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28943 fn_anonym root 34u sock 0,9 0t0 175259 protocol: TCP 2023-10-08T15:40:51.212 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28943 fn_anonym root 35u sock 0,9 0t0 175260 protocol: TCP 2023-10-08T15:40:51.212 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28943 fn_anonym root 36u sock 0,9 0t0 171743 protocol: TCP 2023-10-08T15:40:51.212 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28944 safe_time root cwd DIR 8,1 4096 924112 /home/ubuntu/cephtest 2023-10-08T15:40:51.212 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28944 safe_time root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:51.212 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28944 safe_time root txt REG 8,1 2980448 1055345 /usr/bin/ceph-fuse 2023-10-08T15:40:51.213 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28944 safe_time root mem REG 8,1 39368 21279 /usr/lib/x86_64-linux-gnu/liburcu-bp.so.6.1.0 2023-10-08T15:40:51.213 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28944 safe_time root mem REG 8,1 51280 111271 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.0.0.0 2023-10-08T15:40:51.213 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28944 safe_time root mem REG 8,1 137912 13038 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-10-08T15:40:51.213 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28944 safe_time root mem REG 8,1 477584 16364 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-10-08T15:40:51.213 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28944 safe_time root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:51.213 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28944 safe_time root mem REG 8,1 117920 16368 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.2.28.0 2023-10-08T15:40:51.213 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28944 safe_time root mem REG 8,1 121552 16366 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.8.28.0 2023-10-08T15:40:51.213 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28944 safe_time root mem REG 8,1 178528 12765 /usr/lib/x86_64-linux-gnu/libudev.so.1.6.17 2023-10-08T15:40:51.213 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28944 safe_time root mem REG 8,1 2954080 9466 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:51.214 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28944 safe_time root mem REG 8,1 351352 9401 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-10-08T15:40:51.214 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28944 safe_time root mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:51.214 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28944 safe_time root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:51.214 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28944 safe_time root mem REG 8,1 104984 8251 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-10-08T15:40:51.214 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28944 safe_time root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:51.214 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28944 safe_time root mem REG 8,1 1956992 8082 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28 2023-10-08T15:40:51.214 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28944 safe_time root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:51.214 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28944 safe_time root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:51.214 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28944 safe_time root mem REG 8,1 12111760 1053837 /usr/lib/ceph/libceph-common.so.2 2023-10-08T15:40:51.215 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28944 safe_time root mem REG 8,1 252184 14163 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-10-08T15:40:51.215 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28944 safe_time root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:51.215 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28944 safe_time root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:51.215 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28944 safe_time root 1w FIFO 0,13 0t0 167764 pipe 2023-10-08T15:40:51.215 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28944 safe_time root 2w FIFO 0,13 0t0 167765 pipe 2023-10-08T15:40:51.215 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28944 safe_time root 3w REG 8,1 46647892 1068262 /var/log/ceph/ceph-client.0.28924.log 2023-10-08T15:40:51.215 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28944 safe_time root 4u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.215 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28944 safe_time root 5r FIFO 0,13 0t0 173760 pipe 2023-10-08T15:40:51.215 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28944 safe_time root 6w FIFO 0,13 0t0 173760 pipe 2023-10-08T15:40:51.216 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28944 safe_time root 7u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.216 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28944 safe_time root 8r FIFO 0,13 0t0 173761 pipe 2023-10-08T15:40:51.216 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28944 safe_time root 9w FIFO 0,13 0t0 173761 pipe 2023-10-08T15:40:51.216 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28944 safe_time root 10u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.216 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28944 safe_time root 11r FIFO 0,13 0t0 173762 pipe 2023-10-08T15:40:51.216 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28944 safe_time root 12w FIFO 0,13 0t0 173762 pipe 2023-10-08T15:40:51.216 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28944 safe_time root 13r FIFO 0,13 0t0 173763 pipe 2023-10-08T15:40:51.216 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28944 safe_time root 14w FIFO 0,13 0t0 173763 pipe 2023-10-08T15:40:51.217 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28944 safe_time root 15u sock 0,9 0t0 173764 protocol: UNIX 2023-10-08T15:40:51.217 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28944 safe_time root 16r FIFO 0,13 0t0 173765 pipe 2023-10-08T15:40:51.217 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28944 safe_time root 17w FIFO 0,13 0t0 173765 pipe 2023-10-08T15:40:51.217 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28944 safe_time root 18r FIFO 0,13 0t0 173766 pipe 2023-10-08T15:40:51.217 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28944 safe_time root 19w FIFO 0,13 0t0 173766 pipe 2023-10-08T15:40:51.217 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28944 safe_time root 20u sock 0,9 0t0 172558 protocol: TCP 2023-10-08T15:40:51.217 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28944 safe_time root 21u sock 0,9 0t0 167777 protocol: TCP 2023-10-08T15:40:51.217 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28944 safe_time root 22u CHR 10,229 0t0 87 /dev/fuse 2023-10-08T15:40:51.217 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28944 safe_time root 23r FIFO 0,13 0t0 172559 pipe 2023-10-08T15:40:51.217 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28944 safe_time root 24w FIFO 0,13 0t0 172559 pipe 2023-10-08T15:40:51.218 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28944 safe_time root 25r FIFO 0,13 0t0 169846 pipe 2023-10-08T15:40:51.218 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28944 safe_time root 26w FIFO 0,13 0t0 169846 pipe 2023-10-08T15:40:51.218 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28944 safe_time root 27u sock 0,9 0t0 175257 protocol: TCP 2023-10-08T15:40:51.218 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28944 safe_time root 28r FIFO 0,13 0t0 171742 pipe 2023-10-08T15:40:51.218 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28944 safe_time root 29w FIFO 0,13 0t0 171742 pipe 2023-10-08T15:40:51.218 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28944 safe_time root 30u sock 0,9 0t0 167802 protocol: TCP 2023-10-08T15:40:51.218 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28944 safe_time root 31u sock 0,9 0t0 167803 protocol: TCP 2023-10-08T15:40:51.218 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28944 safe_time root 32u sock 0,9 0t0 175258 protocol: TCP 2023-10-08T15:40:51.219 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28944 safe_time root 33u sock 0,9 0t0 167804 protocol: TCP 2023-10-08T15:40:51.219 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28944 safe_time root 34u sock 0,9 0t0 175259 protocol: TCP 2023-10-08T15:40:51.219 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28944 safe_time root 35u sock 0,9 0t0 175260 protocol: TCP 2023-10-08T15:40:51.219 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28944 safe_time root 36u sock 0,9 0t0 171743 protocol: TCP 2023-10-08T15:40:51.219 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28945 fn_anonym root cwd DIR 8,1 4096 924112 /home/ubuntu/cephtest 2023-10-08T15:40:51.219 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28945 fn_anonym root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:51.219 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28945 fn_anonym root txt REG 8,1 2980448 1055345 /usr/bin/ceph-fuse 2023-10-08T15:40:51.219 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28945 fn_anonym root mem REG 8,1 39368 21279 /usr/lib/x86_64-linux-gnu/liburcu-bp.so.6.1.0 2023-10-08T15:40:51.219 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28945 fn_anonym root mem REG 8,1 51280 111271 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.0.0.0 2023-10-08T15:40:51.219 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28945 fn_anonym root mem REG 8,1 137912 13038 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-10-08T15:40:51.220 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28945 fn_anonym root mem REG 8,1 477584 16364 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-10-08T15:40:51.220 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28945 fn_anonym root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:51.220 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28945 fn_anonym root mem REG 8,1 117920 16368 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.2.28.0 2023-10-08T15:40:51.220 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28945 fn_anonym root mem REG 8,1 121552 16366 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.8.28.0 2023-10-08T15:40:51.220 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28945 fn_anonym root mem REG 8,1 178528 12765 /usr/lib/x86_64-linux-gnu/libudev.so.1.6.17 2023-10-08T15:40:51.220 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28945 fn_anonym root mem REG 8,1 2954080 9466 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:51.220 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28945 fn_anonym root mem REG 8,1 351352 9401 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-10-08T15:40:51.220 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28945 fn_anonym root mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:51.220 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28945 fn_anonym root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:51.221 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28945 fn_anonym root mem REG 8,1 104984 8251 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-10-08T15:40:51.221 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28945 fn_anonym root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:51.221 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28945 fn_anonym root mem REG 8,1 1956992 8082 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28 2023-10-08T15:40:51.221 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28945 fn_anonym root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:51.221 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28945 fn_anonym root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:51.221 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28945 fn_anonym root mem REG 8,1 12111760 1053837 /usr/lib/ceph/libceph-common.so.2 2023-10-08T15:40:51.221 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28945 fn_anonym root mem REG 8,1 252184 14163 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-10-08T15:40:51.221 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28945 fn_anonym root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:51.221 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28945 fn_anonym root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:51.222 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28945 fn_anonym root 1w FIFO 0,13 0t0 167764 pipe 2023-10-08T15:40:51.222 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28945 fn_anonym root 2w FIFO 0,13 0t0 167765 pipe 2023-10-08T15:40:51.222 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28945 fn_anonym root 3w REG 8,1 46647892 1068262 /var/log/ceph/ceph-client.0.28924.log 2023-10-08T15:40:51.222 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28945 fn_anonym root 4u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.222 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28945 fn_anonym root 5r FIFO 0,13 0t0 173760 pipe 2023-10-08T15:40:51.222 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28945 fn_anonym root 6w FIFO 0,13 0t0 173760 pipe 2023-10-08T15:40:51.222 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28945 fn_anonym root 7u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.222 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28945 fn_anonym root 8r FIFO 0,13 0t0 173761 pipe 2023-10-08T15:40:51.222 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28945 fn_anonym root 9w FIFO 0,13 0t0 173761 pipe 2023-10-08T15:40:51.223 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28945 fn_anonym root 10u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.223 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28945 fn_anonym root 11r FIFO 0,13 0t0 173762 pipe 2023-10-08T15:40:51.223 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28945 fn_anonym root 12w FIFO 0,13 0t0 173762 pipe 2023-10-08T15:40:51.223 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28945 fn_anonym root 13r FIFO 0,13 0t0 173763 pipe 2023-10-08T15:40:51.223 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28945 fn_anonym root 14w FIFO 0,13 0t0 173763 pipe 2023-10-08T15:40:51.223 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28945 fn_anonym root 15u sock 0,9 0t0 173764 protocol: UNIX 2023-10-08T15:40:51.223 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28945 fn_anonym root 16r FIFO 0,13 0t0 173765 pipe 2023-10-08T15:40:51.223 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28945 fn_anonym root 17w FIFO 0,13 0t0 173765 pipe 2023-10-08T15:40:51.223 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28945 fn_anonym root 18r FIFO 0,13 0t0 173766 pipe 2023-10-08T15:40:51.223 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28945 fn_anonym root 19w FIFO 0,13 0t0 173766 pipe 2023-10-08T15:40:51.224 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28945 fn_anonym root 20u sock 0,9 0t0 172558 protocol: TCP 2023-10-08T15:40:51.224 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28945 fn_anonym root 21u sock 0,9 0t0 167777 protocol: TCP 2023-10-08T15:40:51.224 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28945 fn_anonym root 22u CHR 10,229 0t0 87 /dev/fuse 2023-10-08T15:40:51.224 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28945 fn_anonym root 23r FIFO 0,13 0t0 172559 pipe 2023-10-08T15:40:51.224 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28945 fn_anonym root 24w FIFO 0,13 0t0 172559 pipe 2023-10-08T15:40:51.224 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28945 fn_anonym root 25r FIFO 0,13 0t0 169846 pipe 2023-10-08T15:40:51.224 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28945 fn_anonym root 26w FIFO 0,13 0t0 169846 pipe 2023-10-08T15:40:51.224 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28945 fn_anonym root 27u sock 0,9 0t0 175257 protocol: TCP 2023-10-08T15:40:51.224 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28945 fn_anonym root 28r FIFO 0,13 0t0 171742 pipe 2023-10-08T15:40:51.224 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28945 fn_anonym root 29w FIFO 0,13 0t0 171742 pipe 2023-10-08T15:40:51.225 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28945 fn_anonym root 30u sock 0,9 0t0 167802 protocol: TCP 2023-10-08T15:40:51.225 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28945 fn_anonym root 31u sock 0,9 0t0 167803 protocol: TCP 2023-10-08T15:40:51.225 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28945 fn_anonym root 32u sock 0,9 0t0 175258 protocol: TCP 2023-10-08T15:40:51.225 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28945 fn_anonym root 33u sock 0,9 0t0 167804 protocol: TCP 2023-10-08T15:40:51.225 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28945 fn_anonym root 34u sock 0,9 0t0 175259 protocol: TCP 2023-10-08T15:40:51.225 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28945 fn_anonym root 35u sock 0,9 0t0 175260 protocol: TCP 2023-10-08T15:40:51.225 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28945 fn_anonym root 36u sock 0,9 0t0 171743 protocol: TCP 2023-10-08T15:40:51.225 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28946 flusher root cwd DIR 8,1 4096 924112 /home/ubuntu/cephtest 2023-10-08T15:40:51.225 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28946 flusher root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:51.226 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28946 flusher root txt REG 8,1 2980448 1055345 /usr/bin/ceph-fuse 2023-10-08T15:40:51.226 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28946 flusher root mem REG 8,1 39368 21279 /usr/lib/x86_64-linux-gnu/liburcu-bp.so.6.1.0 2023-10-08T15:40:51.226 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28946 flusher root mem REG 8,1 51280 111271 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.0.0.0 2023-10-08T15:40:51.226 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28946 flusher root mem REG 8,1 137912 13038 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-10-08T15:40:51.226 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28946 flusher root mem REG 8,1 477584 16364 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-10-08T15:40:51.226 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28946 flusher root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:51.226 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28946 flusher root mem REG 8,1 117920 16368 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.2.28.0 2023-10-08T15:40:51.226 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28946 flusher root mem REG 8,1 121552 16366 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.8.28.0 2023-10-08T15:40:51.226 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28946 flusher root mem REG 8,1 178528 12765 /usr/lib/x86_64-linux-gnu/libudev.so.1.6.17 2023-10-08T15:40:51.227 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28946 flusher root mem REG 8,1 2954080 9466 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:51.227 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28946 flusher root mem REG 8,1 351352 9401 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-10-08T15:40:51.227 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28946 flusher root mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:51.227 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28946 flusher root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:51.227 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28946 flusher root mem REG 8,1 104984 8251 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-10-08T15:40:51.227 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28946 flusher root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:51.227 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28946 flusher root mem REG 8,1 1956992 8082 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28 2023-10-08T15:40:51.227 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28946 flusher root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:51.227 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28946 flusher root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:51.227 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28946 flusher root mem REG 8,1 12111760 1053837 /usr/lib/ceph/libceph-common.so.2 2023-10-08T15:40:51.228 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28946 flusher root mem REG 8,1 252184 14163 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-10-08T15:40:51.228 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28946 flusher root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:51.228 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28946 flusher root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:51.228 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28946 flusher root 1w FIFO 0,13 0t0 167764 pipe 2023-10-08T15:40:51.228 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28946 flusher root 2w FIFO 0,13 0t0 167765 pipe 2023-10-08T15:40:51.228 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28946 flusher root 3w REG 8,1 46647892 1068262 /var/log/ceph/ceph-client.0.28924.log 2023-10-08T15:40:51.228 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28946 flusher root 4u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.228 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28946 flusher root 5r FIFO 0,13 0t0 173760 pipe 2023-10-08T15:40:51.228 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28946 flusher root 6w FIFO 0,13 0t0 173760 pipe 2023-10-08T15:40:51.228 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28946 flusher root 7u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.229 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28946 flusher root 8r FIFO 0,13 0t0 173761 pipe 2023-10-08T15:40:51.229 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28946 flusher root 9w FIFO 0,13 0t0 173761 pipe 2023-10-08T15:40:51.229 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28946 flusher root 10u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.229 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28946 flusher root 11r FIFO 0,13 0t0 173762 pipe 2023-10-08T15:40:51.229 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28946 flusher root 12w FIFO 0,13 0t0 173762 pipe 2023-10-08T15:40:51.229 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28946 flusher root 13r FIFO 0,13 0t0 173763 pipe 2023-10-08T15:40:51.229 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28946 flusher root 14w FIFO 0,13 0t0 173763 pipe 2023-10-08T15:40:51.229 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28946 flusher root 15u sock 0,9 0t0 173764 protocol: UNIX 2023-10-08T15:40:51.229 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28946 flusher root 16r FIFO 0,13 0t0 173765 pipe 2023-10-08T15:40:51.229 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28946 flusher root 17w FIFO 0,13 0t0 173765 pipe 2023-10-08T15:40:51.230 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28946 flusher root 18r FIFO 0,13 0t0 173766 pipe 2023-10-08T15:40:51.230 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28946 flusher root 19w FIFO 0,13 0t0 173766 pipe 2023-10-08T15:40:51.230 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28946 flusher root 20u sock 0,9 0t0 172558 protocol: TCP 2023-10-08T15:40:51.230 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28946 flusher root 21u sock 0,9 0t0 167777 protocol: TCP 2023-10-08T15:40:51.230 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28946 flusher root 22u CHR 10,229 0t0 87 /dev/fuse 2023-10-08T15:40:51.230 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28946 flusher root 23r FIFO 0,13 0t0 172559 pipe 2023-10-08T15:40:51.230 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28946 flusher root 24w FIFO 0,13 0t0 172559 pipe 2023-10-08T15:40:51.230 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28946 flusher root 25r FIFO 0,13 0t0 169846 pipe 2023-10-08T15:40:51.230 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28946 flusher root 26w FIFO 0,13 0t0 169846 pipe 2023-10-08T15:40:51.230 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28946 flusher root 27u sock 0,9 0t0 175257 protocol: TCP 2023-10-08T15:40:51.230 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28946 flusher root 28r FIFO 0,13 0t0 171742 pipe 2023-10-08T15:40:51.230 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28946 flusher root 29w FIFO 0,13 0t0 171742 pipe 2023-10-08T15:40:51.231 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28946 flusher root 30u sock 0,9 0t0 167802 protocol: TCP 2023-10-08T15:40:51.231 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28946 flusher root 31u sock 0,9 0t0 167803 protocol: TCP 2023-10-08T15:40:51.231 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28946 flusher root 32u sock 0,9 0t0 175258 protocol: TCP 2023-10-08T15:40:51.231 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28946 flusher root 33u sock 0,9 0t0 167804 protocol: TCP 2023-10-08T15:40:51.231 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28946 flusher root 34u sock 0,9 0t0 175259 protocol: TCP 2023-10-08T15:40:51.231 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28946 flusher root 35u sock 0,9 0t0 175260 protocol: TCP 2023-10-08T15:40:51.231 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28946 flusher root 36u sock 0,9 0t0 171743 protocol: TCP 2023-10-08T15:40:51.231 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28947 ms_dispat root cwd DIR 8,1 4096 924112 /home/ubuntu/cephtest 2023-10-08T15:40:51.231 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28947 ms_dispat root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:51.231 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28947 ms_dispat root txt REG 8,1 2980448 1055345 /usr/bin/ceph-fuse 2023-10-08T15:40:51.231 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28947 ms_dispat root mem REG 8,1 39368 21279 /usr/lib/x86_64-linux-gnu/liburcu-bp.so.6.1.0 2023-10-08T15:40:51.232 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28947 ms_dispat root mem REG 8,1 51280 111271 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.0.0.0 2023-10-08T15:40:51.232 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28947 ms_dispat root mem REG 8,1 137912 13038 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-10-08T15:40:51.232 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28947 ms_dispat root mem REG 8,1 477584 16364 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-10-08T15:40:51.232 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28947 ms_dispat root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:51.232 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28947 ms_dispat root mem REG 8,1 117920 16368 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.2.28.0 2023-10-08T15:40:51.232 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28947 ms_dispat root mem REG 8,1 121552 16366 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.8.28.0 2023-10-08T15:40:51.232 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28947 ms_dispat root mem REG 8,1 178528 12765 /usr/lib/x86_64-linux-gnu/libudev.so.1.6.17 2023-10-08T15:40:51.232 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28947 ms_dispat root mem REG 8,1 2954080 9466 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:51.232 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28947 ms_dispat root mem REG 8,1 351352 9401 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-10-08T15:40:51.232 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28947 ms_dispat root mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:51.232 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28947 ms_dispat root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:51.233 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28947 ms_dispat root mem REG 8,1 104984 8251 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-10-08T15:40:51.233 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28947 ms_dispat root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:51.233 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28947 ms_dispat root mem REG 8,1 1956992 8082 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28 2023-10-08T15:40:51.233 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28947 ms_dispat root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:51.233 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28947 ms_dispat root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:51.233 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28947 ms_dispat root mem REG 8,1 12111760 1053837 /usr/lib/ceph/libceph-common.so.2 2023-10-08T15:40:51.233 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28947 ms_dispat root mem REG 8,1 252184 14163 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-10-08T15:40:51.233 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28947 ms_dispat root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:51.233 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28947 ms_dispat root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:51.233 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28947 ms_dispat root 1w FIFO 0,13 0t0 167764 pipe 2023-10-08T15:40:51.233 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28947 ms_dispat root 2w FIFO 0,13 0t0 167765 pipe 2023-10-08T15:40:51.233 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28947 ms_dispat root 3w REG 8,1 46647892 1068262 /var/log/ceph/ceph-client.0.28924.log 2023-10-08T15:40:51.234 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28947 ms_dispat root 4u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.234 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28947 ms_dispat root 5r FIFO 0,13 0t0 173760 pipe 2023-10-08T15:40:51.234 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28947 ms_dispat root 6w FIFO 0,13 0t0 173760 pipe 2023-10-08T15:40:51.234 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28947 ms_dispat root 7u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.234 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28947 ms_dispat root 8r FIFO 0,13 0t0 173761 pipe 2023-10-08T15:40:51.234 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28947 ms_dispat root 9w FIFO 0,13 0t0 173761 pipe 2023-10-08T15:40:51.234 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28947 ms_dispat root 10u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.234 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28947 ms_dispat root 11r FIFO 0,13 0t0 173762 pipe 2023-10-08T15:40:51.234 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28947 ms_dispat root 12w FIFO 0,13 0t0 173762 pipe 2023-10-08T15:40:51.234 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28947 ms_dispat root 13r FIFO 0,13 0t0 173763 pipe 2023-10-08T15:40:51.234 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28947 ms_dispat root 14w FIFO 0,13 0t0 173763 pipe 2023-10-08T15:40:51.235 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28947 ms_dispat root 15u sock 0,9 0t0 173764 protocol: UNIX 2023-10-08T15:40:51.235 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28947 ms_dispat root 16r FIFO 0,13 0t0 173765 pipe 2023-10-08T15:40:51.235 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28947 ms_dispat root 17w FIFO 0,13 0t0 173765 pipe 2023-10-08T15:40:51.235 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28947 ms_dispat root 18r FIFO 0,13 0t0 173766 pipe 2023-10-08T15:40:51.235 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28947 ms_dispat root 19w FIFO 0,13 0t0 173766 pipe 2023-10-08T15:40:51.235 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28947 ms_dispat root 20u sock 0,9 0t0 172558 protocol: TCP 2023-10-08T15:40:51.235 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28947 ms_dispat root 21u sock 0,9 0t0 167777 protocol: TCP 2023-10-08T15:40:51.235 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28947 ms_dispat root 22u CHR 10,229 0t0 87 /dev/fuse 2023-10-08T15:40:51.235 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28947 ms_dispat root 23r FIFO 0,13 0t0 172559 pipe 2023-10-08T15:40:51.235 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28947 ms_dispat root 24w FIFO 0,13 0t0 172559 pipe 2023-10-08T15:40:51.235 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28947 ms_dispat root 25r FIFO 0,13 0t0 169846 pipe 2023-10-08T15:40:51.236 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28947 ms_dispat root 26w FIFO 0,13 0t0 169846 pipe 2023-10-08T15:40:51.236 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28947 ms_dispat root 27u sock 0,9 0t0 175257 protocol: TCP 2023-10-08T15:40:51.236 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28947 ms_dispat root 28r FIFO 0,13 0t0 171742 pipe 2023-10-08T15:40:51.236 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28947 ms_dispat root 29w FIFO 0,13 0t0 171742 pipe 2023-10-08T15:40:51.236 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28947 ms_dispat root 30u sock 0,9 0t0 167802 protocol: TCP 2023-10-08T15:40:51.236 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28947 ms_dispat root 31u sock 0,9 0t0 167803 protocol: TCP 2023-10-08T15:40:51.236 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28947 ms_dispat root 32u sock 0,9 0t0 175258 protocol: TCP 2023-10-08T15:40:51.236 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28947 ms_dispat root 33u sock 0,9 0t0 167804 protocol: TCP 2023-10-08T15:40:51.236 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28947 ms_dispat root 34u sock 0,9 0t0 175259 protocol: TCP 2023-10-08T15:40:51.236 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28947 ms_dispat root 35u sock 0,9 0t0 175260 protocol: TCP 2023-10-08T15:40:51.236 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28947 ms_dispat root 36u sock 0,9 0t0 171743 protocol: TCP 2023-10-08T15:40:51.236 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28948 ms_local root cwd DIR 8,1 4096 924112 /home/ubuntu/cephtest 2023-10-08T15:40:51.237 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28948 ms_local root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:51.237 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28948 ms_local root txt REG 8,1 2980448 1055345 /usr/bin/ceph-fuse 2023-10-08T15:40:51.237 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28948 ms_local root mem REG 8,1 39368 21279 /usr/lib/x86_64-linux-gnu/liburcu-bp.so.6.1.0 2023-10-08T15:40:51.237 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28948 ms_local root mem REG 8,1 51280 111271 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.0.0.0 2023-10-08T15:40:51.237 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28948 ms_local root mem REG 8,1 137912 13038 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-10-08T15:40:51.237 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28948 ms_local root mem REG 8,1 477584 16364 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-10-08T15:40:51.237 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28948 ms_local root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:51.237 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28948 ms_local root mem REG 8,1 117920 16368 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.2.28.0 2023-10-08T15:40:51.237 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28948 ms_local root mem REG 8,1 121552 16366 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.8.28.0 2023-10-08T15:40:51.237 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28948 ms_local root mem REG 8,1 178528 12765 /usr/lib/x86_64-linux-gnu/libudev.so.1.6.17 2023-10-08T15:40:51.237 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28948 ms_local root mem REG 8,1 2954080 9466 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:51.238 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28948 ms_local root mem REG 8,1 351352 9401 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-10-08T15:40:51.238 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28948 ms_local root mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:51.238 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28948 ms_local root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:51.238 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28948 ms_local root mem REG 8,1 104984 8251 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-10-08T15:40:51.238 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28948 ms_local root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:51.238 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28948 ms_local root mem REG 8,1 1956992 8082 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28 2023-10-08T15:40:51.238 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28948 ms_local root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:51.238 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28948 ms_local root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:51.238 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28948 ms_local root mem REG 8,1 12111760 1053837 /usr/lib/ceph/libceph-common.so.2 2023-10-08T15:40:51.239 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28948 ms_local root mem REG 8,1 252184 14163 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-10-08T15:40:51.239 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28948 ms_local root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:51.239 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28948 ms_local root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:51.239 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28948 ms_local root 1w FIFO 0,13 0t0 167764 pipe 2023-10-08T15:40:51.239 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28948 ms_local root 2w FIFO 0,13 0t0 167765 pipe 2023-10-08T15:40:51.239 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28948 ms_local root 3w REG 8,1 46647892 1068262 /var/log/ceph/ceph-client.0.28924.log 2023-10-08T15:40:51.239 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28948 ms_local root 4u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.239 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28948 ms_local root 5r FIFO 0,13 0t0 173760 pipe 2023-10-08T15:40:51.239 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28948 ms_local root 6w FIFO 0,13 0t0 173760 pipe 2023-10-08T15:40:51.239 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28948 ms_local root 7u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.240 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28948 ms_local root 8r FIFO 0,13 0t0 173761 pipe 2023-10-08T15:40:51.240 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28948 ms_local root 9w FIFO 0,13 0t0 173761 pipe 2023-10-08T15:40:51.240 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28948 ms_local root 10u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.240 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28948 ms_local root 11r FIFO 0,13 0t0 173762 pipe 2023-10-08T15:40:51.240 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28948 ms_local root 12w FIFO 0,13 0t0 173762 pipe 2023-10-08T15:40:51.240 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28948 ms_local root 13r FIFO 0,13 0t0 173763 pipe 2023-10-08T15:40:51.240 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28948 ms_local root 14w FIFO 0,13 0t0 173763 pipe 2023-10-08T15:40:51.240 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28948 ms_local root 15u sock 0,9 0t0 173764 protocol: UNIX 2023-10-08T15:40:51.240 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28948 ms_local root 16r FIFO 0,13 0t0 173765 pipe 2023-10-08T15:40:51.240 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28948 ms_local root 17w FIFO 0,13 0t0 173765 pipe 2023-10-08T15:40:51.240 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28948 ms_local root 18r FIFO 0,13 0t0 173766 pipe 2023-10-08T15:40:51.240 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28948 ms_local root 19w FIFO 0,13 0t0 173766 pipe 2023-10-08T15:40:51.241 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28948 ms_local root 20u sock 0,9 0t0 172558 protocol: TCP 2023-10-08T15:40:51.241 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28948 ms_local root 21u sock 0,9 0t0 167777 protocol: TCP 2023-10-08T15:40:51.241 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28948 ms_local root 22u CHR 10,229 0t0 87 /dev/fuse 2023-10-08T15:40:51.241 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28948 ms_local root 23r FIFO 0,13 0t0 172559 pipe 2023-10-08T15:40:51.241 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28948 ms_local root 24w FIFO 0,13 0t0 172559 pipe 2023-10-08T15:40:51.241 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28948 ms_local root 25r FIFO 0,13 0t0 169846 pipe 2023-10-08T15:40:51.241 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28948 ms_local root 26w FIFO 0,13 0t0 169846 pipe 2023-10-08T15:40:51.241 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28948 ms_local root 27u sock 0,9 0t0 175257 protocol: TCP 2023-10-08T15:40:51.241 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28948 ms_local root 28r FIFO 0,13 0t0 171742 pipe 2023-10-08T15:40:51.241 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28948 ms_local root 29w FIFO 0,13 0t0 171742 pipe 2023-10-08T15:40:51.241 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28948 ms_local root 30u sock 0,9 0t0 167802 protocol: TCP 2023-10-08T15:40:51.242 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28948 ms_local root 31u sock 0,9 0t0 167803 protocol: TCP 2023-10-08T15:40:51.242 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28948 ms_local root 32u sock 0,9 0t0 175258 protocol: TCP 2023-10-08T15:40:51.242 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28948 ms_local root 33u sock 0,9 0t0 167804 protocol: TCP 2023-10-08T15:40:51.242 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28948 ms_local root 34u sock 0,9 0t0 175259 protocol: TCP 2023-10-08T15:40:51.242 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28948 ms_local root 35u sock 0,9 0t0 175260 protocol: TCP 2023-10-08T15:40:51.242 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28948 ms_local root 36u sock 0,9 0t0 171743 protocol: TCP 2023-10-08T15:40:51.242 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28949 safe_time root cwd DIR 8,1 4096 924112 /home/ubuntu/cephtest 2023-10-08T15:40:51.242 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28949 safe_time root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:51.242 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28949 safe_time root txt REG 8,1 2980448 1055345 /usr/bin/ceph-fuse 2023-10-08T15:40:51.242 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28949 safe_time root mem REG 8,1 39368 21279 /usr/lib/x86_64-linux-gnu/liburcu-bp.so.6.1.0 2023-10-08T15:40:51.242 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28949 safe_time root mem REG 8,1 51280 111271 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.0.0.0 2023-10-08T15:40:51.243 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28949 safe_time root mem REG 8,1 137912 13038 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-10-08T15:40:51.243 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28949 safe_time root mem REG 8,1 477584 16364 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-10-08T15:40:51.243 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28949 safe_time root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:51.243 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28949 safe_time root mem REG 8,1 117920 16368 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.2.28.0 2023-10-08T15:40:51.243 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28949 safe_time root mem REG 8,1 121552 16366 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.8.28.0 2023-10-08T15:40:51.243 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28949 safe_time root mem REG 8,1 178528 12765 /usr/lib/x86_64-linux-gnu/libudev.so.1.6.17 2023-10-08T15:40:51.243 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28949 safe_time root mem REG 8,1 2954080 9466 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:51.243 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28949 safe_time root mem REG 8,1 351352 9401 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-10-08T15:40:51.243 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28949 safe_time root mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:51.244 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28949 safe_time root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:51.244 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28949 safe_time root mem REG 8,1 104984 8251 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-10-08T15:40:51.244 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28949 safe_time root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:51.244 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28949 safe_time root mem REG 8,1 1956992 8082 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28 2023-10-08T15:40:51.244 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28949 safe_time root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:51.244 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28949 safe_time root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:51.244 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28949 safe_time root mem REG 8,1 12111760 1053837 /usr/lib/ceph/libceph-common.so.2 2023-10-08T15:40:51.244 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28949 safe_time root mem REG 8,1 252184 14163 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-10-08T15:40:51.244 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28949 safe_time root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:51.245 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28949 safe_time root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:51.245 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28949 safe_time root 1w FIFO 0,13 0t0 167764 pipe 2023-10-08T15:40:51.245 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28949 safe_time root 2w FIFO 0,13 0t0 167765 pipe 2023-10-08T15:40:51.245 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28949 safe_time root 3w REG 8,1 46647892 1068262 /var/log/ceph/ceph-client.0.28924.log 2023-10-08T15:40:51.245 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28949 safe_time root 4u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.245 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28949 safe_time root 5r FIFO 0,13 0t0 173760 pipe 2023-10-08T15:40:51.245 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28949 safe_time root 6w FIFO 0,13 0t0 173760 pipe 2023-10-08T15:40:51.245 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28949 safe_time root 7u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.245 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28949 safe_time root 8r FIFO 0,13 0t0 173761 pipe 2023-10-08T15:40:51.245 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28949 safe_time root 9w FIFO 0,13 0t0 173761 pipe 2023-10-08T15:40:51.246 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28949 safe_time root 10u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.246 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28949 safe_time root 11r FIFO 0,13 0t0 173762 pipe 2023-10-08T15:40:51.246 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28949 safe_time root 12w FIFO 0,13 0t0 173762 pipe 2023-10-08T15:40:51.246 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28949 safe_time root 13r FIFO 0,13 0t0 173763 pipe 2023-10-08T15:40:51.246 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28949 safe_time root 14w FIFO 0,13 0t0 173763 pipe 2023-10-08T15:40:51.246 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28949 safe_time root 15u sock 0,9 0t0 173764 protocol: UNIX 2023-10-08T15:40:51.246 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28949 safe_time root 16r FIFO 0,13 0t0 173765 pipe 2023-10-08T15:40:51.246 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28949 safe_time root 17w FIFO 0,13 0t0 173765 pipe 2023-10-08T15:40:51.247 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28949 safe_time root 18r FIFO 0,13 0t0 173766 pipe 2023-10-08T15:40:51.247 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28949 safe_time root 19w FIFO 0,13 0t0 173766 pipe 2023-10-08T15:40:51.247 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28949 safe_time root 20u sock 0,9 0t0 172558 protocol: TCP 2023-10-08T15:40:51.247 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28949 safe_time root 21u sock 0,9 0t0 167777 protocol: TCP 2023-10-08T15:40:51.247 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28949 safe_time root 22u CHR 10,229 0t0 87 /dev/fuse 2023-10-08T15:40:51.247 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28949 safe_time root 23r FIFO 0,13 0t0 172559 pipe 2023-10-08T15:40:51.247 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28949 safe_time root 24w FIFO 0,13 0t0 172559 pipe 2023-10-08T15:40:51.247 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28949 safe_time root 25r FIFO 0,13 0t0 169846 pipe 2023-10-08T15:40:51.247 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28949 safe_time root 26w FIFO 0,13 0t0 169846 pipe 2023-10-08T15:40:51.247 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28949 safe_time root 27u sock 0,9 0t0 175257 protocol: TCP 2023-10-08T15:40:51.248 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28949 safe_time root 28r FIFO 0,13 0t0 171742 pipe 2023-10-08T15:40:51.248 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28949 safe_time root 29w FIFO 0,13 0t0 171742 pipe 2023-10-08T15:40:51.248 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28949 safe_time root 30u sock 0,9 0t0 167802 protocol: TCP 2023-10-08T15:40:51.248 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28949 safe_time root 31u sock 0,9 0t0 167803 protocol: TCP 2023-10-08T15:40:51.248 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28949 safe_time root 32u sock 0,9 0t0 175258 protocol: TCP 2023-10-08T15:40:51.248 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28949 safe_time root 33u sock 0,9 0t0 167804 protocol: TCP 2023-10-08T15:40:51.248 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28949 safe_time root 34u sock 0,9 0t0 175259 protocol: TCP 2023-10-08T15:40:51.248 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28949 safe_time root 35u sock 0,9 0t0 175260 protocol: TCP 2023-10-08T15:40:51.248 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28949 safe_time root 36u sock 0,9 0t0 171743 protocol: TCP 2023-10-08T15:40:51.248 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28950 ceph-fuse root cwd DIR 8,1 4096 924112 /home/ubuntu/cephtest 2023-10-08T15:40:51.249 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28950 ceph-fuse root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:51.249 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28950 ceph-fuse root txt REG 8,1 2980448 1055345 /usr/bin/ceph-fuse 2023-10-08T15:40:51.249 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28950 ceph-fuse root mem REG 8,1 39368 21279 /usr/lib/x86_64-linux-gnu/liburcu-bp.so.6.1.0 2023-10-08T15:40:51.249 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28950 ceph-fuse root mem REG 8,1 51280 111271 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.0.0.0 2023-10-08T15:40:51.249 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28950 ceph-fuse root mem REG 8,1 137912 13038 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-10-08T15:40:51.249 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28950 ceph-fuse root mem REG 8,1 477584 16364 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-10-08T15:40:51.249 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28950 ceph-fuse root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:51.249 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28950 ceph-fuse root mem REG 8,1 117920 16368 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.2.28.0 2023-10-08T15:40:51.249 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28950 ceph-fuse root mem REG 8,1 121552 16366 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.8.28.0 2023-10-08T15:40:51.250 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28950 ceph-fuse root mem REG 8,1 178528 12765 /usr/lib/x86_64-linux-gnu/libudev.so.1.6.17 2023-10-08T15:40:51.250 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28950 ceph-fuse root mem REG 8,1 2954080 9466 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:51.250 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28950 ceph-fuse root mem REG 8,1 351352 9401 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-10-08T15:40:51.250 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28950 ceph-fuse root mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:51.250 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28950 ceph-fuse root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:51.250 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28950 ceph-fuse root mem REG 8,1 104984 8251 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-10-08T15:40:51.250 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28950 ceph-fuse root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:51.250 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28950 ceph-fuse root mem REG 8,1 1956992 8082 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28 2023-10-08T15:40:51.250 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28950 ceph-fuse root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:51.251 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28950 ceph-fuse root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:51.251 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28950 ceph-fuse root mem REG 8,1 12111760 1053837 /usr/lib/ceph/libceph-common.so.2 2023-10-08T15:40:51.251 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28950 ceph-fuse root mem REG 8,1 252184 14163 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-10-08T15:40:51.251 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28950 ceph-fuse root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:51.251 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28950 ceph-fuse root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:51.251 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28950 ceph-fuse root 1w FIFO 0,13 0t0 167764 pipe 2023-10-08T15:40:51.251 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28950 ceph-fuse root 2w FIFO 0,13 0t0 167765 pipe 2023-10-08T15:40:51.251 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28950 ceph-fuse root 3w REG 8,1 46647892 1068262 /var/log/ceph/ceph-client.0.28924.log 2023-10-08T15:40:51.251 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28950 ceph-fuse root 4u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.251 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28950 ceph-fuse root 5r FIFO 0,13 0t0 173760 pipe 2023-10-08T15:40:51.252 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28950 ceph-fuse root 6w FIFO 0,13 0t0 173760 pipe 2023-10-08T15:40:51.252 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28950 ceph-fuse root 7u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.252 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28950 ceph-fuse root 8r FIFO 0,13 0t0 173761 pipe 2023-10-08T15:40:51.252 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28950 ceph-fuse root 9w FIFO 0,13 0t0 173761 pipe 2023-10-08T15:40:51.252 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28950 ceph-fuse root 10u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.252 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28950 ceph-fuse root 11r FIFO 0,13 0t0 173762 pipe 2023-10-08T15:40:51.252 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28950 ceph-fuse root 12w FIFO 0,13 0t0 173762 pipe 2023-10-08T15:40:51.252 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28950 ceph-fuse root 13r FIFO 0,13 0t0 173763 pipe 2023-10-08T15:40:51.252 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28950 ceph-fuse root 14w FIFO 0,13 0t0 173763 pipe 2023-10-08T15:40:51.253 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28950 ceph-fuse root 15u sock 0,9 0t0 173764 protocol: UNIX 2023-10-08T15:40:51.253 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28950 ceph-fuse root 16r FIFO 0,13 0t0 173765 pipe 2023-10-08T15:40:51.253 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28950 ceph-fuse root 17w FIFO 0,13 0t0 173765 pipe 2023-10-08T15:40:51.253 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28950 ceph-fuse root 18r FIFO 0,13 0t0 173766 pipe 2023-10-08T15:40:51.253 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28950 ceph-fuse root 19w FIFO 0,13 0t0 173766 pipe 2023-10-08T15:40:51.253 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28950 ceph-fuse root 20u sock 0,9 0t0 172558 protocol: TCP 2023-10-08T15:40:51.253 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28950 ceph-fuse root 21u sock 0,9 0t0 167777 protocol: TCP 2023-10-08T15:40:51.253 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28950 ceph-fuse root 22u CHR 10,229 0t0 87 /dev/fuse 2023-10-08T15:40:51.254 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28950 ceph-fuse root 23r FIFO 0,13 0t0 172559 pipe 2023-10-08T15:40:51.254 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28950 ceph-fuse root 24w FIFO 0,13 0t0 172559 pipe 2023-10-08T15:40:51.254 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28950 ceph-fuse root 25r FIFO 0,13 0t0 169846 pipe 2023-10-08T15:40:51.254 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28950 ceph-fuse root 26w FIFO 0,13 0t0 169846 pipe 2023-10-08T15:40:51.254 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28950 ceph-fuse root 27u sock 0,9 0t0 175257 protocol: TCP 2023-10-08T15:40:51.254 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28950 ceph-fuse root 28r FIFO 0,13 0t0 171742 pipe 2023-10-08T15:40:51.254 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28950 ceph-fuse root 29w FIFO 0,13 0t0 171742 pipe 2023-10-08T15:40:51.254 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28950 ceph-fuse root 30u sock 0,9 0t0 167802 protocol: TCP 2023-10-08T15:40:51.254 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28950 ceph-fuse root 31u sock 0,9 0t0 167803 protocol: TCP 2023-10-08T15:40:51.254 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28950 ceph-fuse root 32u sock 0,9 0t0 175258 protocol: TCP 2023-10-08T15:40:51.255 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28950 ceph-fuse root 33u sock 0,9 0t0 167804 protocol: TCP 2023-10-08T15:40:51.255 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28950 ceph-fuse root 34u sock 0,9 0t0 175259 protocol: TCP 2023-10-08T15:40:51.255 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28950 ceph-fuse root 35u sock 0,9 0t0 175260 protocol: TCP 2023-10-08T15:40:51.255 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28950 ceph-fuse root 36u sock 0,9 0t0 171743 protocol: TCP 2023-10-08T15:40:51.255 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28952 ceph-fuse root cwd DIR 8,1 4096 924112 /home/ubuntu/cephtest 2023-10-08T15:40:51.255 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28952 ceph-fuse root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:51.255 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28952 ceph-fuse root txt REG 8,1 2980448 1055345 /usr/bin/ceph-fuse 2023-10-08T15:40:51.255 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28952 ceph-fuse root mem REG 8,1 39368 21279 /usr/lib/x86_64-linux-gnu/liburcu-bp.so.6.1.0 2023-10-08T15:40:51.255 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28952 ceph-fuse root mem REG 8,1 51280 111271 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.0.0.0 2023-10-08T15:40:51.256 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28952 ceph-fuse root mem REG 8,1 137912 13038 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-10-08T15:40:51.256 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28952 ceph-fuse root mem REG 8,1 477584 16364 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-10-08T15:40:51.256 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28952 ceph-fuse root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:51.256 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28952 ceph-fuse root mem REG 8,1 117920 16368 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.2.28.0 2023-10-08T15:40:51.256 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28952 ceph-fuse root mem REG 8,1 121552 16366 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.8.28.0 2023-10-08T15:40:51.256 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28952 ceph-fuse root mem REG 8,1 178528 12765 /usr/lib/x86_64-linux-gnu/libudev.so.1.6.17 2023-10-08T15:40:51.256 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28952 ceph-fuse root mem REG 8,1 2954080 9466 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:51.256 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28952 ceph-fuse root mem REG 8,1 351352 9401 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-10-08T15:40:51.256 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28952 ceph-fuse root mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:51.257 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28952 ceph-fuse root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:51.257 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28952 ceph-fuse root mem REG 8,1 104984 8251 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-10-08T15:40:51.257 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28952 ceph-fuse root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:51.257 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28952 ceph-fuse root mem REG 8,1 1956992 8082 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28 2023-10-08T15:40:51.257 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28952 ceph-fuse root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:51.257 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28952 ceph-fuse root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:51.257 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28952 ceph-fuse root mem REG 8,1 12111760 1053837 /usr/lib/ceph/libceph-common.so.2 2023-10-08T15:40:51.257 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28952 ceph-fuse root mem REG 8,1 252184 14163 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-10-08T15:40:51.257 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28952 ceph-fuse root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:51.257 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28952 ceph-fuse root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:51.258 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28952 ceph-fuse root 1w FIFO 0,13 0t0 167764 pipe 2023-10-08T15:40:51.258 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28952 ceph-fuse root 2w FIFO 0,13 0t0 167765 pipe 2023-10-08T15:40:51.258 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28952 ceph-fuse root 3w REG 8,1 46647892 1068262 /var/log/ceph/ceph-client.0.28924.log 2023-10-08T15:40:51.258 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28952 ceph-fuse root 4u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.258 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28952 ceph-fuse root 5r FIFO 0,13 0t0 173760 pipe 2023-10-08T15:40:51.258 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28952 ceph-fuse root 6w FIFO 0,13 0t0 173760 pipe 2023-10-08T15:40:51.258 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28952 ceph-fuse root 7u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.258 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28952 ceph-fuse root 8r FIFO 0,13 0t0 173761 pipe 2023-10-08T15:40:51.258 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28952 ceph-fuse root 9w FIFO 0,13 0t0 173761 pipe 2023-10-08T15:40:51.259 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28952 ceph-fuse root 10u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.259 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28952 ceph-fuse root 11r FIFO 0,13 0t0 173762 pipe 2023-10-08T15:40:51.259 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28952 ceph-fuse root 12w FIFO 0,13 0t0 173762 pipe 2023-10-08T15:40:51.259 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28952 ceph-fuse root 13r FIFO 0,13 0t0 173763 pipe 2023-10-08T15:40:51.259 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28952 ceph-fuse root 14w FIFO 0,13 0t0 173763 pipe 2023-10-08T15:40:51.259 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28952 ceph-fuse root 15u sock 0,9 0t0 173764 protocol: UNIX 2023-10-08T15:40:51.259 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28952 ceph-fuse root 16r FIFO 0,13 0t0 173765 pipe 2023-10-08T15:40:51.259 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28952 ceph-fuse root 17w FIFO 0,13 0t0 173765 pipe 2023-10-08T15:40:51.259 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28952 ceph-fuse root 18r FIFO 0,13 0t0 173766 pipe 2023-10-08T15:40:51.259 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28952 ceph-fuse root 19w FIFO 0,13 0t0 173766 pipe 2023-10-08T15:40:51.259 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28952 ceph-fuse root 20u sock 0,9 0t0 172558 protocol: TCP 2023-10-08T15:40:51.260 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28952 ceph-fuse root 21u sock 0,9 0t0 167777 protocol: TCP 2023-10-08T15:40:51.260 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28952 ceph-fuse root 22u CHR 10,229 0t0 87 /dev/fuse 2023-10-08T15:40:51.260 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28952 ceph-fuse root 23r FIFO 0,13 0t0 172559 pipe 2023-10-08T15:40:51.260 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28952 ceph-fuse root 24w FIFO 0,13 0t0 172559 pipe 2023-10-08T15:40:51.260 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28952 ceph-fuse root 25r FIFO 0,13 0t0 169846 pipe 2023-10-08T15:40:51.260 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28952 ceph-fuse root 26w FIFO 0,13 0t0 169846 pipe 2023-10-08T15:40:51.260 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28952 ceph-fuse root 27u sock 0,9 0t0 175257 protocol: TCP 2023-10-08T15:40:51.260 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28952 ceph-fuse root 28r FIFO 0,13 0t0 171742 pipe 2023-10-08T15:40:51.260 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28952 ceph-fuse root 29w FIFO 0,13 0t0 171742 pipe 2023-10-08T15:40:51.260 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28952 ceph-fuse root 30u sock 0,9 0t0 167802 protocol: TCP 2023-10-08T15:40:51.260 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28952 ceph-fuse root 31u sock 0,9 0t0 167803 protocol: TCP 2023-10-08T15:40:51.261 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28952 ceph-fuse root 32u sock 0,9 0t0 175258 protocol: TCP 2023-10-08T15:40:51.261 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28952 ceph-fuse root 33u sock 0,9 0t0 167804 protocol: TCP 2023-10-08T15:40:51.261 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28952 ceph-fuse root 34u sock 0,9 0t0 175259 protocol: TCP 2023-10-08T15:40:51.261 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28952 ceph-fuse root 35u sock 0,9 0t0 175260 protocol: TCP 2023-10-08T15:40:51.261 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28952 ceph-fuse root 36u sock 0,9 0t0 171743 protocol: TCP 2023-10-08T15:40:51.261 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28953 ceph-fuse root cwd DIR 8,1 4096 924112 /home/ubuntu/cephtest 2023-10-08T15:40:51.261 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28953 ceph-fuse root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:51.261 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28953 ceph-fuse root txt REG 8,1 2980448 1055345 /usr/bin/ceph-fuse 2023-10-08T15:40:51.261 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28953 ceph-fuse root mem REG 8,1 39368 21279 /usr/lib/x86_64-linux-gnu/liburcu-bp.so.6.1.0 2023-10-08T15:40:51.261 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28953 ceph-fuse root mem REG 8,1 51280 111271 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.0.0.0 2023-10-08T15:40:51.261 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28953 ceph-fuse root mem REG 8,1 137912 13038 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-10-08T15:40:51.261 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28953 ceph-fuse root mem REG 8,1 477584 16364 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-10-08T15:40:51.261 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28953 ceph-fuse root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:51.262 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28953 ceph-fuse root mem REG 8,1 117920 16368 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.2.28.0 2023-10-08T15:40:51.262 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28953 ceph-fuse root mem REG 8,1 121552 16366 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.8.28.0 2023-10-08T15:40:51.262 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28953 ceph-fuse root mem REG 8,1 178528 12765 /usr/lib/x86_64-linux-gnu/libudev.so.1.6.17 2023-10-08T15:40:51.262 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28953 ceph-fuse root mem REG 8,1 2954080 9466 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:51.262 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28953 ceph-fuse root mem REG 8,1 351352 9401 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-10-08T15:40:51.262 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28953 ceph-fuse root mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:51.262 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28953 ceph-fuse root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:51.262 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28953 ceph-fuse root mem REG 8,1 104984 8251 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-10-08T15:40:51.262 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28953 ceph-fuse root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:51.262 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28953 ceph-fuse root mem REG 8,1 1956992 8082 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28 2023-10-08T15:40:51.263 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28953 ceph-fuse root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:51.263 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28953 ceph-fuse root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:51.263 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28953 ceph-fuse root mem REG 8,1 12111760 1053837 /usr/lib/ceph/libceph-common.so.2 2023-10-08T15:40:51.263 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28953 ceph-fuse root mem REG 8,1 252184 14163 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-10-08T15:40:51.263 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28953 ceph-fuse root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:51.263 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28953 ceph-fuse root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:51.263 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28953 ceph-fuse root 1w FIFO 0,13 0t0 167764 pipe 2023-10-08T15:40:51.263 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28953 ceph-fuse root 2w FIFO 0,13 0t0 167765 pipe 2023-10-08T15:40:51.263 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28953 ceph-fuse root 3w REG 8,1 46647892 1068262 /var/log/ceph/ceph-client.0.28924.log 2023-10-08T15:40:51.263 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28953 ceph-fuse root 4u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.263 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28953 ceph-fuse root 5r FIFO 0,13 0t0 173760 pipe 2023-10-08T15:40:51.264 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28953 ceph-fuse root 6w FIFO 0,13 0t0 173760 pipe 2023-10-08T15:40:51.264 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28953 ceph-fuse root 7u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.264 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28953 ceph-fuse root 8r FIFO 0,13 0t0 173761 pipe 2023-10-08T15:40:51.264 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28953 ceph-fuse root 9w FIFO 0,13 0t0 173761 pipe 2023-10-08T15:40:51.264 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28953 ceph-fuse root 10u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.264 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28953 ceph-fuse root 11r FIFO 0,13 0t0 173762 pipe 2023-10-08T15:40:51.264 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28953 ceph-fuse root 12w FIFO 0,13 0t0 173762 pipe 2023-10-08T15:40:51.264 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28953 ceph-fuse root 13r FIFO 0,13 0t0 173763 pipe 2023-10-08T15:40:51.264 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28953 ceph-fuse root 14w FIFO 0,13 0t0 173763 pipe 2023-10-08T15:40:51.264 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28953 ceph-fuse root 15u sock 0,9 0t0 173764 protocol: UNIX 2023-10-08T15:40:51.264 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28953 ceph-fuse root 16r FIFO 0,13 0t0 173765 pipe 2023-10-08T15:40:51.265 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28953 ceph-fuse root 17w FIFO 0,13 0t0 173765 pipe 2023-10-08T15:40:51.265 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28953 ceph-fuse root 18r FIFO 0,13 0t0 173766 pipe 2023-10-08T15:40:51.265 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28953 ceph-fuse root 19w FIFO 0,13 0t0 173766 pipe 2023-10-08T15:40:51.265 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28953 ceph-fuse root 20u sock 0,9 0t0 172558 protocol: TCP 2023-10-08T15:40:51.265 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28953 ceph-fuse root 21u sock 0,9 0t0 167777 protocol: TCP 2023-10-08T15:40:51.265 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28953 ceph-fuse root 22u CHR 10,229 0t0 87 /dev/fuse 2023-10-08T15:40:51.265 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28953 ceph-fuse root 23r FIFO 0,13 0t0 172559 pipe 2023-10-08T15:40:51.265 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28953 ceph-fuse root 24w FIFO 0,13 0t0 172559 pipe 2023-10-08T15:40:51.265 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28953 ceph-fuse root 25r FIFO 0,13 0t0 169846 pipe 2023-10-08T15:40:51.265 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28953 ceph-fuse root 26w FIFO 0,13 0t0 169846 pipe 2023-10-08T15:40:51.265 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28953 ceph-fuse root 27u sock 0,9 0t0 175257 protocol: TCP 2023-10-08T15:40:51.266 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28953 ceph-fuse root 28r FIFO 0,13 0t0 171742 pipe 2023-10-08T15:40:51.266 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28953 ceph-fuse root 29w FIFO 0,13 0t0 171742 pipe 2023-10-08T15:40:51.266 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28953 ceph-fuse root 30u sock 0,9 0t0 167802 protocol: TCP 2023-10-08T15:40:51.266 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28953 ceph-fuse root 31u sock 0,9 0t0 167803 protocol: TCP 2023-10-08T15:40:51.266 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28953 ceph-fuse root 32u sock 0,9 0t0 175258 protocol: TCP 2023-10-08T15:40:51.266 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28953 ceph-fuse root 33u sock 0,9 0t0 167804 protocol: TCP 2023-10-08T15:40:51.266 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28953 ceph-fuse root 34u sock 0,9 0t0 175259 protocol: TCP 2023-10-08T15:40:51.266 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28953 ceph-fuse root 35u sock 0,9 0t0 175260 protocol: TCP 2023-10-08T15:40:51.266 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28953 ceph-fuse root 36u sock 0,9 0t0 171743 protocol: TCP 2023-10-08T15:40:51.266 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28976 ceph-fuse root cwd DIR 8,1 4096 924112 /home/ubuntu/cephtest 2023-10-08T15:40:51.266 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28976 ceph-fuse root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:51.267 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28976 ceph-fuse root txt REG 8,1 2980448 1055345 /usr/bin/ceph-fuse 2023-10-08T15:40:51.267 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28976 ceph-fuse root mem REG 8,1 39368 21279 /usr/lib/x86_64-linux-gnu/liburcu-bp.so.6.1.0 2023-10-08T15:40:51.267 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28976 ceph-fuse root mem REG 8,1 51280 111271 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.0.0.0 2023-10-08T15:40:51.267 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28976 ceph-fuse root mem REG 8,1 137912 13038 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-10-08T15:40:51.267 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28976 ceph-fuse root mem REG 8,1 477584 16364 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-10-08T15:40:51.267 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28976 ceph-fuse root mem REG 8,1 108936 8964 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-10-08T15:40:51.267 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28976 ceph-fuse root mem REG 8,1 117920 16368 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.2.28.0 2023-10-08T15:40:51.267 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28976 ceph-fuse root mem REG 8,1 121552 16366 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.8.28.0 2023-10-08T15:40:51.267 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28976 ceph-fuse root mem REG 8,1 178528 12765 /usr/lib/x86_64-linux-gnu/libudev.so.1.6.17 2023-10-08T15:40:51.267 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28976 ceph-fuse root mem REG 8,1 2954080 9466 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 2023-10-08T15:40:51.268 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28976 ceph-fuse root mem REG 8,1 351352 9401 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-10-08T15:40:51.268 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28976 ceph-fuse root mem REG 8,1 101352 13412 /usr/lib/x86_64-linux-gnu/libresolv-2.31.so 2023-10-08T15:40:51.268 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28976 ceph-fuse root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:51.268 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28976 ceph-fuse root mem REG 8,1 104984 8251 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-10-08T15:40:51.268 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28976 ceph-fuse root mem REG 8,1 1369384 13400 /usr/lib/x86_64-linux-gnu/libm-2.31.so 2023-10-08T15:40:51.268 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28976 ceph-fuse root mem REG 8,1 1956992 8082 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28 2023-10-08T15:40:51.268 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28976 ceph-fuse root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:51.268 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28976 ceph-fuse root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:51.268 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28976 ceph-fuse root mem REG 8,1 12111760 1053837 /usr/lib/ceph/libceph-common.so.2 2023-10-08T15:40:51.268 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28976 ceph-fuse root mem REG 8,1 252184 14163 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-10-08T15:40:51.269 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28976 ceph-fuse root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:51.269 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28976 ceph-fuse root 0r CHR 1,3 0t0 6 /dev/null 2023-10-08T15:40:51.269 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28976 ceph-fuse root 1w FIFO 0,13 0t0 167764 pipe 2023-10-08T15:40:51.269 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28976 ceph-fuse root 2w FIFO 0,13 0t0 167765 pipe 2023-10-08T15:40:51.269 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28976 ceph-fuse root 3w REG 8,1 46647892 1068262 /var/log/ceph/ceph-client.0.28924.log 2023-10-08T15:40:51.269 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28976 ceph-fuse root 4u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.269 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28976 ceph-fuse root 5r FIFO 0,13 0t0 173760 pipe 2023-10-08T15:40:51.269 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28976 ceph-fuse root 6w FIFO 0,13 0t0 173760 pipe 2023-10-08T15:40:51.269 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28976 ceph-fuse root 7u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.269 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28976 ceph-fuse root 8r FIFO 0,13 0t0 173761 pipe 2023-10-08T15:40:51.270 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28976 ceph-fuse root 9w FIFO 0,13 0t0 173761 pipe 2023-10-08T15:40:51.270 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28976 ceph-fuse root 10u a_inode 0,14 0 13377 [eventpoll] 2023-10-08T15:40:51.270 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28976 ceph-fuse root 11r FIFO 0,13 0t0 173762 pipe 2023-10-08T15:40:51.270 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28976 ceph-fuse root 12w FIFO 0,13 0t0 173762 pipe 2023-10-08T15:40:51.270 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28976 ceph-fuse root 13r FIFO 0,13 0t0 173763 pipe 2023-10-08T15:40:51.270 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28976 ceph-fuse root 14w FIFO 0,13 0t0 173763 pipe 2023-10-08T15:40:51.270 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28976 ceph-fuse root 15u sock 0,9 0t0 173764 protocol: UNIX 2023-10-08T15:40:51.270 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28976 ceph-fuse root 16r FIFO 0,13 0t0 173765 pipe 2023-10-08T15:40:51.270 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28976 ceph-fuse root 17w FIFO 0,13 0t0 173765 pipe 2023-10-08T15:40:51.271 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28976 ceph-fuse root 18r FIFO 0,13 0t0 173766 pipe 2023-10-08T15:40:51.271 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28976 ceph-fuse root 19w FIFO 0,13 0t0 173766 pipe 2023-10-08T15:40:51.271 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28976 ceph-fuse root 20u sock 0,9 0t0 172558 protocol: TCP 2023-10-08T15:40:51.271 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28976 ceph-fuse root 21u sock 0,9 0t0 167777 protocol: TCP 2023-10-08T15:40:51.271 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28976 ceph-fuse root 22u CHR 10,229 0t0 87 /dev/fuse 2023-10-08T15:40:51.271 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28976 ceph-fuse root 23r FIFO 0,13 0t0 172559 pipe 2023-10-08T15:40:51.271 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28976 ceph-fuse root 24w FIFO 0,13 0t0 172559 pipe 2023-10-08T15:40:51.271 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28976 ceph-fuse root 25r FIFO 0,13 0t0 169846 pipe 2023-10-08T15:40:51.271 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28976 ceph-fuse root 26w FIFO 0,13 0t0 169846 pipe 2023-10-08T15:40:51.271 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28976 ceph-fuse root 27u sock 0,9 0t0 175257 protocol: TCP 2023-10-08T15:40:51.272 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28976 ceph-fuse root 28r FIFO 0,13 0t0 171742 pipe 2023-10-08T15:40:51.272 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28976 ceph-fuse root 29w FIFO 0,13 0t0 171742 pipe 2023-10-08T15:40:51.272 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28976 ceph-fuse root 30u sock 0,9 0t0 167802 protocol: TCP 2023-10-08T15:40:51.272 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28976 ceph-fuse root 31u sock 0,9 0t0 167803 protocol: TCP 2023-10-08T15:40:51.272 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28976 ceph-fuse root 32u sock 0,9 0t0 175258 protocol: TCP 2023-10-08T15:40:51.272 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28976 ceph-fuse root 33u sock 0,9 0t0 167804 protocol: TCP 2023-10-08T15:40:51.272 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28976 ceph-fuse root 34u sock 0,9 0t0 175259 protocol: TCP 2023-10-08T15:40:51.272 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28976 ceph-fuse root 35u sock 0,9 0t0 175260 protocol: TCP 2023-10-08T15:40:51.272 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-fuse 28924 28976 ceph-fuse root 36u sock 0,9 0t0 171743 protocol: TCP 2023-10-08T15:40:51.272 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/6 28981 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:51.273 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/6 28981 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:51.273 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/6 28981 root txt unknown /proc/28981/exe 2023-10-08T15:40:51.273 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/6 28982 root cwd DIR 8,1 4096 2 / 2023-10-08T15:40:51.273 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/6 28982 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:51.273 INFO:teuthology.orchestra.run.smithi089.stdout:kworker/6 28982 root txt unknown /proc/28982/exe 2023-10-08T15:40:51.273 INFO:teuthology.orchestra.run.smithi089.stdout:bash 28994 ubuntu cwd DIR 8,1 4096 6670 /home/ubuntu 2023-10-08T15:40:51.273 INFO:teuthology.orchestra.run.smithi089.stdout:bash 28994 ubuntu rtd DIR 8,1 4096 2 / 2023-10-08T15:40:51.273 INFO:teuthology.orchestra.run.smithi089.stdout:bash 28994 ubuntu txt REG 8,1 1183448 7751 /usr/bin/bash 2023-10-08T15:40:51.273 INFO:teuthology.orchestra.run.smithi089.stdout:bash 28994 ubuntu mem REG 8,1 6017584 10873 /usr/lib/locale/locale-archive 2023-10-08T15:40:51.274 INFO:teuthology.orchestra.run.smithi089.stdout:bash 28994 ubuntu mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:51.274 INFO:teuthology.orchestra.run.smithi089.stdout:bash 28994 ubuntu mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:51.274 INFO:teuthology.orchestra.run.smithi089.stdout:bash 28994 ubuntu mem REG 8,1 192032 8967 /usr/lib/x86_64-linux-gnu/libtinfo.so.6.2 2023-10-08T15:40:51.274 INFO:teuthology.orchestra.run.smithi089.stdout:bash 28994 ubuntu mem REG 8,1 18696 13609 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-10-08T15:40:51.274 INFO:teuthology.orchestra.run.smithi089.stdout:bash 28994 ubuntu mem REG 8,1 27002 13665 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-10-08T15:40:51.274 INFO:teuthology.orchestra.run.smithi089.stdout:bash 28994 ubuntu mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:51.274 INFO:teuthology.orchestra.run.smithi089.stdout:bash 28994 ubuntu 0r FIFO 0,13 0t0 172600 pipe 2023-10-08T15:40:51.274 INFO:teuthology.orchestra.run.smithi089.stdout:bash 28994 ubuntu 1w FIFO 0,13 0t0 172601 pipe 2023-10-08T15:40:51.274 INFO:teuthology.orchestra.run.smithi089.stdout:bash 28994 ubuntu 2w FIFO 0,13 0t0 172602 pipe 2023-10-08T15:40:51.274 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28995 root cwd DIR 8,1 4096 6670 /home/ubuntu 2023-10-08T15:40:51.275 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28995 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:51.275 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28995 root txt REG 8,1 166056 10342 /usr/bin/sudo 2023-10-08T15:40:51.275 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28995 root mem REG 8,1 475944 8779 /usr/lib/x86_64-linux-gnu/security/pam_systemd.so 2023-10-08T15:40:51.275 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28995 root mem REG 8,1 105560 13403 /usr/lib/x86_64-linux-gnu/libnsl-2.31.so 2023-10-08T15:40:51.275 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28995 root mem REG 8,1 239896 8375 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-10-08T15:40:51.275 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28995 root mem REG 8,1 31120 10630 /usr/lib/x86_64-linux-gnu/libcap.so.2.32 2023-10-08T15:40:51.275 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28995 root mem REG 8,1 14728 8386 /usr/lib/x86_64-linux-gnu/libpam_misc.so.0.82.1 2023-10-08T15:40:51.275 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28995 root mem REG 8,1 14624 8696 /usr/lib/x86_64-linux-gnu/security/pam_umask.so 2023-10-08T15:40:51.275 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28995 root mem REG 8,1 202760 8017 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-10-08T15:40:51.276 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28995 root mem REG 8,1 18424 12487 /usr/lib/x86_64-linux-gnu/security/pam_cap.so 2023-10-08T15:40:51.276 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28995 root mem REG 8,1 14448 8681 /usr/lib/x86_64-linux-gnu/security/pam_permit.so 2023-10-08T15:40:51.276 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28995 root mem REG 8,1 64504 8697 /usr/lib/x86_64-linux-gnu/security/pam_unix.so 2023-10-08T15:40:51.276 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28995 root mem REG 8,1 68320 8384 /usr/lib/x86_64-linux-gnu/libpam.so.0.84.2 2023-10-08T15:40:51.276 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28995 root mem REG 8,1 392976 25058 /usr/lib/sudo/sudoers.so 2023-10-08T15:40:51.276 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28995 root mem REG 8,1 51856 13406 /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so 2023-10-08T15:40:51.276 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28995 root mem REG 8,1 6017584 10873 /usr/lib/locale/locale-archive 2023-10-08T15:40:51.276 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28995 root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:51.276 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28995 root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:51.277 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28995 root mem REG 8,1 584392 8917 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.9.0 2023-10-08T15:40:51.277 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28995 root mem REG 8,1 27064 8001 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-10-08T15:40:51.277 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28995 root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:51.277 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28995 root mem REG 8,1 105312 25053 /usr/lib/sudo/libsudo_util.so.0.0.0 2023-10-08T15:40:51.277 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28995 root mem REG 8,1 14880 13415 /usr/lib/x86_64-linux-gnu/libutil-2.31.so 2023-10-08T15:40:51.277 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28995 root mem REG 8,1 163200 8942 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-10-08T15:40:51.277 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28995 root mem REG 8,1 133200 8347 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-10-08T15:40:51.277 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28995 root mem REG 8,1 14048 8659 /usr/lib/x86_64-linux-gnu/security/pam_deny.so 2023-10-08T15:40:51.277 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28995 root mem REG 8,1 18720 8661 /usr/lib/x86_64-linux-gnu/security/pam_env.so 2023-10-08T15:40:51.278 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28995 root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:51.278 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28995 root 0r FIFO 0,13 0t0 172600 pipe 2023-10-08T15:40:51.278 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28995 root 1w FIFO 0,13 0t0 172601 pipe 2023-10-08T15:40:51.278 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28995 root 2w FIFO 0,13 0t0 172602 pipe 2023-10-08T15:40:51.278 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28995 root 3u netlink 0t0 169965 AUDIT 2023-10-08T15:40:51.278 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28995 root 4u unix 0xffff8f39140c1540 0t0 169967 type=DGRAM 2023-10-08T15:40:51.278 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28995 root 6r FIFO 0,13 0t0 169970 pipe 2023-10-08T15:40:51.278 INFO:teuthology.orchestra.run.smithi089.stdout:sudo 28995 root 7w FIFO 0,13 0t0 169970 pipe 2023-10-08T15:40:51.278 INFO:teuthology.orchestra.run.smithi089.stdout:lsof 28996 root cwd DIR 8,1 4096 6670 /home/ubuntu 2023-10-08T15:40:51.279 INFO:teuthology.orchestra.run.smithi089.stdout:lsof 28996 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:51.279 INFO:teuthology.orchestra.run.smithi089.stdout:lsof 28996 root txt REG 8,1 175744 15260 /usr/bin/lsof 2023-10-08T15:40:51.279 INFO:teuthology.orchestra.run.smithi089.stdout:lsof 28996 root mem REG 8,1 6017584 10873 /usr/lib/locale/locale-archive 2023-10-08T15:40:51.279 INFO:teuthology.orchestra.run.smithi089.stdout:lsof 28996 root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:51.279 INFO:teuthology.orchestra.run.smithi089.stdout:lsof 28996 root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:51.279 INFO:teuthology.orchestra.run.smithi089.stdout:lsof 28996 root mem REG 8,1 584392 8917 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.9.0 2023-10-08T15:40:51.279 INFO:teuthology.orchestra.run.smithi089.stdout:lsof 28996 root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:51.279 INFO:teuthology.orchestra.run.smithi089.stdout:lsof 28996 root mem REG 8,1 163200 8942 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-10-08T15:40:51.279 INFO:teuthology.orchestra.run.smithi089.stdout:lsof 28996 root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:51.280 INFO:teuthology.orchestra.run.smithi089.stdout:lsof 28996 root 0r FIFO 0,13 0t0 172600 pipe 2023-10-08T15:40:51.280 INFO:teuthology.orchestra.run.smithi089.stdout:lsof 28996 root 1w FIFO 0,13 0t0 172601 pipe 2023-10-08T15:40:51.280 INFO:teuthology.orchestra.run.smithi089.stdout:lsof 28996 root 2w FIFO 0,13 0t0 172602 pipe 2023-10-08T15:40:51.280 INFO:teuthology.orchestra.run.smithi089.stdout:lsof 28996 root 3r DIR 0,5 0 1 /proc 2023-10-08T15:40:51.280 INFO:teuthology.orchestra.run.smithi089.stdout:lsof 28996 root 4r DIR 0,5 0 175303 /proc/28996/fd 2023-10-08T15:40:51.280 INFO:teuthology.orchestra.run.smithi089.stdout:lsof 28996 root 5w FIFO 0,13 0t0 175312 pipe 2023-10-08T15:40:51.280 INFO:teuthology.orchestra.run.smithi089.stdout:lsof 28996 root 6r FIFO 0,13 0t0 175313 pipe 2023-10-08T15:40:51.280 INFO:teuthology.orchestra.run.smithi089.stdout:lsof 28997 root cwd DIR 8,1 4096 6670 /home/ubuntu 2023-10-08T15:40:51.280 INFO:teuthology.orchestra.run.smithi089.stdout:lsof 28997 root rtd DIR 8,1 4096 2 / 2023-10-08T15:40:51.281 INFO:teuthology.orchestra.run.smithi089.stdout:lsof 28997 root txt REG 8,1 175744 15260 /usr/bin/lsof 2023-10-08T15:40:51.281 INFO:teuthology.orchestra.run.smithi089.stdout:lsof 28997 root mem REG 8,1 6017584 10873 /usr/lib/locale/locale-archive 2023-10-08T15:40:51.281 INFO:teuthology.orchestra.run.smithi089.stdout:lsof 28997 root mem REG 8,1 157224 13411 /usr/lib/x86_64-linux-gnu/libpthread-2.31.so 2023-10-08T15:40:51.281 INFO:teuthology.orchestra.run.smithi089.stdout:lsof 28997 root mem REG 8,1 18848 13399 /usr/lib/x86_64-linux-gnu/libdl-2.31.so 2023-10-08T15:40:51.281 INFO:teuthology.orchestra.run.smithi089.stdout:lsof 28997 root mem REG 8,1 584392 8917 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.9.0 2023-10-08T15:40:51.281 INFO:teuthology.orchestra.run.smithi089.stdout:lsof 28997 root mem REG 8,1 2029592 13398 /usr/lib/x86_64-linux-gnu/libc-2.31.so 2023-10-08T15:40:51.281 INFO:teuthology.orchestra.run.smithi089.stdout:lsof 28997 root mem REG 8,1 163200 8942 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-10-08T15:40:51.281 INFO:teuthology.orchestra.run.smithi089.stdout:lsof 28997 root mem REG 8,1 191504 8254 /usr/lib/x86_64-linux-gnu/ld-2.31.so 2023-10-08T15:40:51.281 INFO:teuthology.orchestra.run.smithi089.stdout:lsof 28997 root 4r FIFO 0,13 0t0 175312 pipe 2023-10-08T15:40:51.282 INFO:teuthology.orchestra.run.smithi089.stdout:lsof 28997 root 7w FIFO 0,13 0t0 175313 pipe 2023-10-08T15:40:51.284 INFO:teuthology.orchestra.run.smithi089.stdout:USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND 2023-10-08T15:40:51.284 INFO:teuthology.orchestra.run.smithi089.stdout:root 2 0.0 0.0 0 0 ? S 15:26 0:00 [kthreadd] 2023-10-08T15:40:51.284 INFO:teuthology.orchestra.run.smithi089.stdout:root 3 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [rcu_gp] 2023-10-08T15:40:51.284 INFO:teuthology.orchestra.run.smithi089.stdout:root 4 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [rcu_par_gp] 2023-10-08T15:40:51.284 INFO:teuthology.orchestra.run.smithi089.stdout:root 5 0.0 0.0 0 0 ? I 15:26 0:00 \_ [kworker/0:0-events] 2023-10-08T15:40:51.284 INFO:teuthology.orchestra.run.smithi089.stdout:root 6 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [kworker/0:0H-kblockd] 2023-10-08T15:40:51.284 INFO:teuthology.orchestra.run.smithi089.stdout:root 8 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [mm_percpu_wq] 2023-10-08T15:40:51.285 INFO:teuthology.orchestra.run.smithi089.stdout:root 9 0.0 0.0 0 0 ? S 15:26 0:00 \_ [ksoftirqd/0] 2023-10-08T15:40:51.285 INFO:teuthology.orchestra.run.smithi089.stdout:root 10 0.1 0.0 0 0 ? I 15:26 0:00 \_ [rcu_sched] 2023-10-08T15:40:51.285 INFO:teuthology.orchestra.run.smithi089.stdout:root 11 0.0 0.0 0 0 ? S 15:26 0:00 \_ [migration/0] 2023-10-08T15:40:51.285 INFO:teuthology.orchestra.run.smithi089.stdout:root 12 0.0 0.0 0 0 ? S 15:26 0:00 \_ [idle_inject/0] 2023-10-08T15:40:51.285 INFO:teuthology.orchestra.run.smithi089.stdout:root 14 0.0 0.0 0 0 ? S 15:26 0:00 \_ [cpuhp/0] 2023-10-08T15:40:51.285 INFO:teuthology.orchestra.run.smithi089.stdout:root 15 0.0 0.0 0 0 ? S 15:26 0:00 \_ [cpuhp/1] 2023-10-08T15:40:51.285 INFO:teuthology.orchestra.run.smithi089.stdout:root 16 0.0 0.0 0 0 ? S 15:26 0:00 \_ [idle_inject/1] 2023-10-08T15:40:51.285 INFO:teuthology.orchestra.run.smithi089.stdout:root 17 0.0 0.0 0 0 ? S 15:26 0:00 \_ [migration/1] 2023-10-08T15:40:51.285 INFO:teuthology.orchestra.run.smithi089.stdout:root 18 0.0 0.0 0 0 ? S 15:26 0:00 \_ [ksoftirqd/1] 2023-10-08T15:40:51.286 INFO:teuthology.orchestra.run.smithi089.stdout:root 20 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [kworker/1:0H-kblockd] 2023-10-08T15:40:51.286 INFO:teuthology.orchestra.run.smithi089.stdout:root 21 0.0 0.0 0 0 ? S 15:26 0:00 \_ [cpuhp/2] 2023-10-08T15:40:51.286 INFO:teuthology.orchestra.run.smithi089.stdout:root 22 0.0 0.0 0 0 ? S 15:26 0:00 \_ [idle_inject/2] 2023-10-08T15:40:51.286 INFO:teuthology.orchestra.run.smithi089.stdout:root 23 0.0 0.0 0 0 ? S 15:26 0:00 \_ [migration/2] 2023-10-08T15:40:51.286 INFO:teuthology.orchestra.run.smithi089.stdout:root 24 0.0 0.0 0 0 ? S 15:26 0:00 \_ [ksoftirqd/2] 2023-10-08T15:40:51.286 INFO:teuthology.orchestra.run.smithi089.stdout:root 26 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [kworker/2:0H-kblockd] 2023-10-08T15:40:51.286 INFO:teuthology.orchestra.run.smithi089.stdout:root 27 0.0 0.0 0 0 ? S 15:26 0:00 \_ [cpuhp/3] 2023-10-08T15:40:51.286 INFO:teuthology.orchestra.run.smithi089.stdout:root 28 0.0 0.0 0 0 ? S 15:26 0:00 \_ [idle_inject/3] 2023-10-08T15:40:51.286 INFO:teuthology.orchestra.run.smithi089.stdout:root 29 0.0 0.0 0 0 ? S 15:26 0:00 \_ [migration/3] 2023-10-08T15:40:51.286 INFO:teuthology.orchestra.run.smithi089.stdout:root 30 0.0 0.0 0 0 ? S 15:26 0:00 \_ [ksoftirqd/3] 2023-10-08T15:40:51.286 INFO:teuthology.orchestra.run.smithi089.stdout:root 32 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [kworker/3:0H-kblockd] 2023-10-08T15:40:51.287 INFO:teuthology.orchestra.run.smithi089.stdout:root 33 0.0 0.0 0 0 ? S 15:26 0:00 \_ [cpuhp/4] 2023-10-08T15:40:51.287 INFO:teuthology.orchestra.run.smithi089.stdout:root 34 0.0 0.0 0 0 ? S 15:26 0:00 \_ [idle_inject/4] 2023-10-08T15:40:51.287 INFO:teuthology.orchestra.run.smithi089.stdout:root 35 0.0 0.0 0 0 ? S 15:26 0:00 \_ [migration/4] 2023-10-08T15:40:51.287 INFO:teuthology.orchestra.run.smithi089.stdout:root 36 0.0 0.0 0 0 ? S 15:26 0:00 \_ [ksoftirqd/4] 2023-10-08T15:40:51.287 INFO:teuthology.orchestra.run.smithi089.stdout:root 38 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [kworker/4:0H-kblockd] 2023-10-08T15:40:51.287 INFO:teuthology.orchestra.run.smithi089.stdout:root 39 0.0 0.0 0 0 ? S 15:26 0:00 \_ [cpuhp/5] 2023-10-08T15:40:51.287 INFO:teuthology.orchestra.run.smithi089.stdout:root 40 0.0 0.0 0 0 ? S 15:26 0:00 \_ [idle_inject/5] 2023-10-08T15:40:51.287 INFO:teuthology.orchestra.run.smithi089.stdout:root 41 0.0 0.0 0 0 ? S 15:26 0:00 \_ [migration/5] 2023-10-08T15:40:51.287 INFO:teuthology.orchestra.run.smithi089.stdout:root 42 0.0 0.0 0 0 ? S 15:26 0:00 \_ [ksoftirqd/5] 2023-10-08T15:40:51.287 INFO:teuthology.orchestra.run.smithi089.stdout:root 44 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [kworker/5:0H-kblockd] 2023-10-08T15:40:51.287 INFO:teuthology.orchestra.run.smithi089.stdout:root 45 0.0 0.0 0 0 ? S 15:26 0:00 \_ [cpuhp/6] 2023-10-08T15:40:51.287 INFO:teuthology.orchestra.run.smithi089.stdout:root 46 0.0 0.0 0 0 ? S 15:26 0:00 \_ [idle_inject/6] 2023-10-08T15:40:51.288 INFO:teuthology.orchestra.run.smithi089.stdout:root 47 0.0 0.0 0 0 ? S 15:26 0:00 \_ [migration/6] 2023-10-08T15:40:51.288 INFO:teuthology.orchestra.run.smithi089.stdout:root 48 0.0 0.0 0 0 ? S 15:26 0:00 \_ [ksoftirqd/6] 2023-10-08T15:40:51.288 INFO:teuthology.orchestra.run.smithi089.stdout:root 50 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [kworker/6:0H-kblockd] 2023-10-08T15:40:51.288 INFO:teuthology.orchestra.run.smithi089.stdout:root 51 0.0 0.0 0 0 ? S 15:26 0:00 \_ [cpuhp/7] 2023-10-08T15:40:51.288 INFO:teuthology.orchestra.run.smithi089.stdout:root 52 0.0 0.0 0 0 ? S 15:26 0:00 \_ [idle_inject/7] 2023-10-08T15:40:51.288 INFO:teuthology.orchestra.run.smithi089.stdout:root 53 0.0 0.0 0 0 ? S 15:26 0:00 \_ [migration/7] 2023-10-08T15:40:51.288 INFO:teuthology.orchestra.run.smithi089.stdout:root 54 0.0 0.0 0 0 ? S 15:26 0:00 \_ [ksoftirqd/7] 2023-10-08T15:40:51.288 INFO:teuthology.orchestra.run.smithi089.stdout:root 56 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [kworker/7:0H-kblockd] 2023-10-08T15:40:51.288 INFO:teuthology.orchestra.run.smithi089.stdout:root 57 0.0 0.0 0 0 ? S 15:26 0:00 \_ [kdevtmpfs] 2023-10-08T15:40:51.288 INFO:teuthology.orchestra.run.smithi089.stdout:root 58 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [netns] 2023-10-08T15:40:51.288 INFO:teuthology.orchestra.run.smithi089.stdout:root 59 0.0 0.0 0 0 ? S 15:26 0:00 \_ [rcu_tasks_kthre] 2023-10-08T15:40:51.288 INFO:teuthology.orchestra.run.smithi089.stdout:root 60 0.0 0.0 0 0 ? S 15:26 0:00 \_ [kauditd] 2023-10-08T15:40:51.289 INFO:teuthology.orchestra.run.smithi089.stdout:root 63 0.0 0.0 0 0 ? S 15:26 0:00 \_ [khungtaskd] 2023-10-08T15:40:51.289 INFO:teuthology.orchestra.run.smithi089.stdout:root 64 0.0 0.0 0 0 ? S 15:26 0:00 \_ [oom_reaper] 2023-10-08T15:40:51.289 INFO:teuthology.orchestra.run.smithi089.stdout:root 65 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [writeback] 2023-10-08T15:40:51.289 INFO:teuthology.orchestra.run.smithi089.stdout:root 66 0.0 0.0 0 0 ? S 15:26 0:00 \_ [kcompactd0] 2023-10-08T15:40:51.289 INFO:teuthology.orchestra.run.smithi089.stdout:root 67 0.0 0.0 0 0 ? SN 15:26 0:00 \_ [ksmd] 2023-10-08T15:40:51.289 INFO:teuthology.orchestra.run.smithi089.stdout:root 68 0.0 0.0 0 0 ? SN 15:26 0:00 \_ [khugepaged] 2023-10-08T15:40:51.289 INFO:teuthology.orchestra.run.smithi089.stdout:root 114 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [kintegrityd] 2023-10-08T15:40:51.289 INFO:teuthology.orchestra.run.smithi089.stdout:root 115 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [kblockd] 2023-10-08T15:40:51.289 INFO:teuthology.orchestra.run.smithi089.stdout:root 116 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [blkcg_punt_bio] 2023-10-08T15:40:51.289 INFO:teuthology.orchestra.run.smithi089.stdout:root 117 0.0 0.0 0 0 ? I 15:26 0:00 \_ [kworker/0:2-events] 2023-10-08T15:40:51.289 INFO:teuthology.orchestra.run.smithi089.stdout:root 123 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [tpm_dev_wq] 2023-10-08T15:40:51.290 INFO:teuthology.orchestra.run.smithi089.stdout:root 124 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [ata_sff] 2023-10-08T15:40:51.290 INFO:teuthology.orchestra.run.smithi089.stdout:root 125 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [md] 2023-10-08T15:40:51.290 INFO:teuthology.orchestra.run.smithi089.stdout:root 126 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [edac-poller] 2023-10-08T15:40:51.290 INFO:teuthology.orchestra.run.smithi089.stdout:root 127 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [devfreq_wq] 2023-10-08T15:40:51.290 INFO:teuthology.orchestra.run.smithi089.stdout:root 128 0.0 0.0 0 0 ? S 15:26 0:00 \_ [watchdogd] 2023-10-08T15:40:51.290 INFO:teuthology.orchestra.run.smithi089.stdout:root 131 0.0 0.0 0 0 ? S 15:26 0:00 \_ [kswapd0] 2023-10-08T15:40:51.290 INFO:teuthology.orchestra.run.smithi089.stdout:root 132 0.0 0.0 0 0 ? S 15:26 0:00 \_ [ecryptfs-kthrea] 2023-10-08T15:40:51.290 INFO:teuthology.orchestra.run.smithi089.stdout:root 134 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [kthrotld] 2023-10-08T15:40:51.290 INFO:teuthology.orchestra.run.smithi089.stdout:root 135 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [acpi_thermal_pm] 2023-10-08T15:40:51.290 INFO:teuthology.orchestra.run.smithi089.stdout:root 136 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [vfio-irqfd-clea] 2023-10-08T15:40:51.290 INFO:teuthology.orchestra.run.smithi089.stdout:root 140 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [ipv6_addrconf] 2023-10-08T15:40:51.290 INFO:teuthology.orchestra.run.smithi089.stdout:root 149 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [kstrp] 2023-10-08T15:40:51.291 INFO:teuthology.orchestra.run.smithi089.stdout:root 152 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [kworker/u17:0-xprtiod] 2023-10-08T15:40:51.291 INFO:teuthology.orchestra.run.smithi089.stdout:root 165 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [charger_manager] 2023-10-08T15:40:51.291 INFO:teuthology.orchestra.run.smithi089.stdout:root 221 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [nvme-wq] 2023-10-08T15:40:51.291 INFO:teuthology.orchestra.run.smithi089.stdout:root 222 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [nvme-reset-wq] 2023-10-08T15:40:51.291 INFO:teuthology.orchestra.run.smithi089.stdout:root 223 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [nvme-delete-wq] 2023-10-08T15:40:51.291 INFO:teuthology.orchestra.run.smithi089.stdout:root 224 0.0 0.0 0 0 ? I 15:26 0:00 \_ [kworker/2:2-events] 2023-10-08T15:40:51.291 INFO:teuthology.orchestra.run.smithi089.stdout:root 228 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [ixgbe] 2023-10-08T15:40:51.291 INFO:teuthology.orchestra.run.smithi089.stdout:root 230 0.0 0.0 0 0 ? S 15:26 0:00 \_ [scsi_eh_0] 2023-10-08T15:40:51.291 INFO:teuthology.orchestra.run.smithi089.stdout:root 231 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [scsi_tmf_0] 2023-10-08T15:40:51.291 INFO:teuthology.orchestra.run.smithi089.stdout:root 232 0.0 0.0 0 0 ? S 15:26 0:00 \_ [scsi_eh_1] 2023-10-08T15:40:51.291 INFO:teuthology.orchestra.run.smithi089.stdout:root 233 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [scsi_tmf_1] 2023-10-08T15:40:51.292 INFO:teuthology.orchestra.run.smithi089.stdout:root 234 0.0 0.0 0 0 ? S 15:26 0:00 \_ [scsi_eh_2] 2023-10-08T15:40:51.292 INFO:teuthology.orchestra.run.smithi089.stdout:root 235 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [scsi_tmf_2] 2023-10-08T15:40:51.292 INFO:teuthology.orchestra.run.smithi089.stdout:root 236 0.0 0.0 0 0 ? S 15:26 0:00 \_ [scsi_eh_3] 2023-10-08T15:40:51.292 INFO:teuthology.orchestra.run.smithi089.stdout:root 237 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [scsi_tmf_3] 2023-10-08T15:40:51.292 INFO:teuthology.orchestra.run.smithi089.stdout:root 242 0.0 0.0 0 0 ? S 15:26 0:00 \_ [scsi_eh_4] 2023-10-08T15:40:51.292 INFO:teuthology.orchestra.run.smithi089.stdout:root 243 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [scsi_tmf_4] 2023-10-08T15:40:51.292 INFO:teuthology.orchestra.run.smithi089.stdout:root 244 0.0 0.0 0 0 ? S 15:26 0:00 \_ [scsi_eh_5] 2023-10-08T15:40:51.292 INFO:teuthology.orchestra.run.smithi089.stdout:root 245 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [scsi_tmf_5] 2023-10-08T15:40:51.292 INFO:teuthology.orchestra.run.smithi089.stdout:root 246 0.0 0.0 0 0 ? S 15:26 0:00 \_ [scsi_eh_6] 2023-10-08T15:40:51.292 INFO:teuthology.orchestra.run.smithi089.stdout:root 247 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [scsi_tmf_6] 2023-10-08T15:40:51.292 INFO:teuthology.orchestra.run.smithi089.stdout:root 248 0.0 0.0 0 0 ? S 15:26 0:00 \_ [scsi_eh_7] 2023-10-08T15:40:51.292 INFO:teuthology.orchestra.run.smithi089.stdout:root 249 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [scsi_tmf_7] 2023-10-08T15:40:51.292 INFO:teuthology.orchestra.run.smithi089.stdout:root 250 0.0 0.0 0 0 ? S 15:26 0:00 \_ [scsi_eh_8] 2023-10-08T15:40:51.293 INFO:teuthology.orchestra.run.smithi089.stdout:root 251 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [scsi_tmf_8] 2023-10-08T15:40:51.293 INFO:teuthology.orchestra.run.smithi089.stdout:root 252 0.0 0.0 0 0 ? S 15:26 0:00 \_ [scsi_eh_9] 2023-10-08T15:40:51.293 INFO:teuthology.orchestra.run.smithi089.stdout:root 253 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [scsi_tmf_9] 2023-10-08T15:40:51.293 INFO:teuthology.orchestra.run.smithi089.stdout:root 255 0.0 0.0 0 0 ? I 15:26 0:00 \_ [kworker/u16:8-events_power_efficient] 2023-10-08T15:40:51.293 INFO:teuthology.orchestra.run.smithi089.stdout:root 256 0.0 0.0 0 0 ? I 15:26 0:00 \_ [kworker/u16:9-events_power_efficient] 2023-10-08T15:40:51.293 INFO:teuthology.orchestra.run.smithi089.stdout:root 258 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [kworker/4:1H-kblockd] 2023-10-08T15:40:51.293 INFO:teuthology.orchestra.run.smithi089.stdout:root 305 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [kworker/5:1H-kblockd] 2023-10-08T15:40:51.293 INFO:teuthology.orchestra.run.smithi089.stdout:root 307 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [kworker/6:1H-kblockd] 2023-10-08T15:40:51.293 INFO:teuthology.orchestra.run.smithi089.stdout:root 308 0.1 0.0 0 0 ? S 15:26 0:01 \_ [jbd2/sda1-8] 2023-10-08T15:40:51.293 INFO:teuthology.orchestra.run.smithi089.stdout:root 309 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [ext4-rsv-conver] 2023-10-08T15:40:51.293 INFO:teuthology.orchestra.run.smithi089.stdout:root 310 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [kworker/1:1H-kblockd] 2023-10-08T15:40:51.293 INFO:teuthology.orchestra.run.smithi089.stdout:root 322 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [kworker/3:1H-kblockd] 2023-10-08T15:40:51.294 INFO:teuthology.orchestra.run.smithi089.stdout:root 327 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [kworker/7:1H-kblockd] 2023-10-08T15:40:51.294 INFO:teuthology.orchestra.run.smithi089.stdout:root 344 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [kworker/0:1H-kblockd] 2023-10-08T15:40:51.294 INFO:teuthology.orchestra.run.smithi089.stdout:root 358 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [kworker/2:1H-kblockd] 2023-10-08T15:40:51.294 INFO:teuthology.orchestra.run.smithi089.stdout:root 360 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [rpciod] 2023-10-08T15:40:51.294 INFO:teuthology.orchestra.run.smithi089.stdout:root 361 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [xprtiod] 2023-10-08T15:40:51.294 INFO:teuthology.orchestra.run.smithi089.stdout:root 377 0.0 0.0 0 0 ? S 15:26 0:00 \_ [ext4lazyinit] 2023-10-08T15:40:51.294 INFO:teuthology.orchestra.run.smithi089.stdout:root 382 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [iscsi_eh] 2023-10-08T15:40:51.294 INFO:teuthology.orchestra.run.smithi089.stdout:root 383 0.0 0.0 0 0 ? I 15:26 0:00 \_ [kworker/7:2-events] 2023-10-08T15:40:51.294 INFO:teuthology.orchestra.run.smithi089.stdout:root 402 0.0 0.0 0 0 ? I 15:26 0:00 \_ [kworker/2:3-events] 2023-10-08T15:40:51.294 INFO:teuthology.orchestra.run.smithi089.stdout:root 412 0.0 0.0 0 0 ? I 15:26 0:00 \_ [kworker/3:2-events] 2023-10-08T15:40:51.294 INFO:teuthology.orchestra.run.smithi089.stdout:root 414 0.0 0.0 0 0 ? I 15:26 0:00 \_ [kworker/3:3-cgroup_destroy] 2023-10-08T15:40:51.295 INFO:teuthology.orchestra.run.smithi089.stdout:root 467 0.0 0.0 0 0 ? I 15:26 0:00 \_ [kworker/1:2-events] 2023-10-08T15:40:51.295 INFO:teuthology.orchestra.run.smithi089.stdout:root 469 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [ipmi-msghandler] 2023-10-08T15:40:51.295 INFO:teuthology.orchestra.run.smithi089.stdout:root 492 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [cryptd] 2023-10-08T15:40:51.295 INFO:teuthology.orchestra.run.smithi089.stdout:root 511 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [ttm_swap] 2023-10-08T15:40:51.295 INFO:teuthology.orchestra.run.smithi089.stdout:root 523 0.0 0.0 0 0 ? SN 15:26 0:00 \_ [kipmi0] 2023-10-08T15:40:51.295 INFO:teuthology.orchestra.run.smithi089.stdout:root 600 0.0 0.0 0 0 ? I 15:26 0:00 \_ [kworker/4:3-cgroup_destroy] 2023-10-08T15:40:51.295 INFO:teuthology.orchestra.run.smithi089.stdout:root 680 0.0 0.0 0 0 ? I 15:26 0:00 \_ [kworker/1:3-events] 2023-10-08T15:40:51.297 INFO:teuthology.orchestra.run.smithi089.stdout:root 979 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [ib-comp-wq] 2023-10-08T15:40:51.297 INFO:teuthology.orchestra.run.smithi089.stdout:root 980 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [ib-comp-unb-wq] 2023-10-08T15:40:51.297 INFO:teuthology.orchestra.run.smithi089.stdout:root 981 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [ib_mcast] 2023-10-08T15:40:51.298 INFO:teuthology.orchestra.run.smithi089.stdout:root 982 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [ib_nl_sa_wq] 2023-10-08T15:40:51.298 INFO:teuthology.orchestra.run.smithi089.stdout:root 984 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [kworker/u17:1] 2023-10-08T15:40:51.298 INFO:teuthology.orchestra.run.smithi089.stdout:root 985 0.0 0.0 0 0 ? S 15:26 0:00 \_ [lockd] 2023-10-08T15:40:51.298 INFO:teuthology.orchestra.run.smithi089.stdout:root 999 0.0 0.0 0 0 ? I< 15:26 0:00 \_ [rdma_cm] 2023-10-08T15:40:51.298 INFO:teuthology.orchestra.run.smithi089.stdout:root 1086 0.0 0.0 0 0 ? S 15:26 0:00 \_ [nfsd] 2023-10-08T15:40:51.298 INFO:teuthology.orchestra.run.smithi089.stdout:root 1088 0.0 0.0 0 0 ? S 15:26 0:00 \_ [nfsd] 2023-10-08T15:40:51.298 INFO:teuthology.orchestra.run.smithi089.stdout:root 1089 0.0 0.0 0 0 ? S 15:26 0:00 \_ [nfsd] 2023-10-08T15:40:51.298 INFO:teuthology.orchestra.run.smithi089.stdout:root 1090 0.0 0.0 0 0 ? S 15:26 0:00 \_ [nfsd] 2023-10-08T15:40:51.298 INFO:teuthology.orchestra.run.smithi089.stdout:root 1091 0.0 0.0 0 0 ? S 15:26 0:00 \_ [nfsd] 2023-10-08T15:40:51.298 INFO:teuthology.orchestra.run.smithi089.stdout:root 1092 0.0 0.0 0 0 ? S 15:26 0:00 \_ [nfsd] 2023-10-08T15:40:51.298 INFO:teuthology.orchestra.run.smithi089.stdout:root 1093 0.0 0.0 0 0 ? S 15:26 0:00 \_ [nfsd] 2023-10-08T15:40:51.299 INFO:teuthology.orchestra.run.smithi089.stdout:root 1094 0.0 0.0 0 0 ? S 15:26 0:00 \_ [nfsd] 2023-10-08T15:40:51.299 INFO:teuthology.orchestra.run.smithi089.stdout:root 1095 0.0 0.0 0 0 ? I 15:26 0:00 \_ [kworker/5:5-events] 2023-10-08T15:40:51.299 INFO:teuthology.orchestra.run.smithi089.stdout:root 1184 0.0 0.0 2488 572 ? S 15:26 0:00 \_ bpfilter_umh 2023-10-08T15:40:51.299 INFO:teuthology.orchestra.run.smithi089.stdout:root 17501 0.0 0.0 0 0 ? I 15:31 0:00 \_ [kworker/u16:0-events_power_efficient] 2023-10-08T15:40:51.299 INFO:teuthology.orchestra.run.smithi089.stdout:root 17538 0.0 0.0 0 0 ? I 15:31 0:00 \_ [kworker/4:0-events] 2023-10-08T15:40:51.299 INFO:teuthology.orchestra.run.smithi089.stdout:root 17893 0.0 0.0 0 0 ? I< 15:31 0:00 \_ [kdmflush] 2023-10-08T15:40:51.299 INFO:teuthology.orchestra.run.smithi089.stdout:root 17924 0.0 0.0 0 0 ? I< 15:31 0:00 \_ [kdmflush] 2023-10-08T15:40:51.299 INFO:teuthology.orchestra.run.smithi089.stdout:root 17955 0.0 0.0 0 0 ? I< 15:31 0:00 \_ [kdmflush] 2023-10-08T15:40:51.299 INFO:teuthology.orchestra.run.smithi089.stdout:root 17986 0.0 0.0 0 0 ? I< 15:31 0:00 \_ [kdmflush] 2023-10-08T15:40:51.299 INFO:teuthology.orchestra.run.smithi089.stdout:root 18017 0.0 0.0 0 0 ? I< 15:31 0:00 \_ [kdmflush] 2023-10-08T15:40:51.300 INFO:teuthology.orchestra.run.smithi089.stdout:root 18207 0.0 0.0 0 0 ? I< 15:31 0:00 \_ [xfsalloc] 2023-10-08T15:40:51.300 INFO:teuthology.orchestra.run.smithi089.stdout:root 18208 0.0 0.0 0 0 ? I< 15:31 0:00 \_ [xfs_mru_cache] 2023-10-08T15:40:51.300 INFO:teuthology.orchestra.run.smithi089.stdout:root 18209 0.0 0.0 0 0 ? I< 15:31 0:00 \_ [xfs-buf/dm-4] 2023-10-08T15:40:51.300 INFO:teuthology.orchestra.run.smithi089.stdout:root 18210 0.0 0.0 0 0 ? I< 15:31 0:00 \_ [xfs-conv/dm-4] 2023-10-08T15:40:51.300 INFO:teuthology.orchestra.run.smithi089.stdout:root 18211 0.0 0.0 0 0 ? I< 15:31 0:00 \_ [xfs-cil/dm-4] 2023-10-08T15:40:51.300 INFO:teuthology.orchestra.run.smithi089.stdout:root 18212 0.0 0.0 0 0 ? I< 15:31 0:00 \_ [xfs-reclaim/dm-] 2023-10-08T15:40:51.300 INFO:teuthology.orchestra.run.smithi089.stdout:root 18213 0.0 0.0 0 0 ? I< 15:31 0:00 \_ [xfs-eofblocks/d] 2023-10-08T15:40:51.301 INFO:teuthology.orchestra.run.smithi089.stdout:root 18214 0.0 0.0 0 0 ? I< 15:31 0:00 \_ [xfs-log/dm-4] 2023-10-08T15:40:51.301 INFO:teuthology.orchestra.run.smithi089.stdout:root 18215 0.0 0.0 0 0 ? S 15:31 0:00 \_ [xfsaild/dm-4] 2023-10-08T15:40:51.301 INFO:teuthology.orchestra.run.smithi089.stdout:root 21022 0.0 0.0 0 0 ? I 15:32 0:00 \_ [kworker/5:0-events] 2023-10-08T15:40:51.301 INFO:teuthology.orchestra.run.smithi089.stdout:root 21339 0.0 0.0 0 0 ? I 15:33 0:00 \_ [kworker/6:0-events] 2023-10-08T15:40:51.301 INFO:teuthology.orchestra.run.smithi089.stdout:root 21341 0.0 0.0 0 0 ? I 15:33 0:00 \_ [kworker/6:3-events] 2023-10-08T15:40:51.301 INFO:teuthology.orchestra.run.smithi089.stdout:root 23568 0.0 0.0 0 0 ? I 15:34 0:00 \_ [kworker/7:0-events] 2023-10-08T15:40:51.301 INFO:teuthology.orchestra.run.smithi089.stdout:root 28449 0.0 0.0 0 0 ? I 15:36 0:00 \_ [kworker/2:0-events] 2023-10-08T15:40:51.301 INFO:teuthology.orchestra.run.smithi089.stdout:root 28450 0.0 0.0 0 0 ? I 15:36 0:00 \_ [kworker/2:1-events] 2023-10-08T15:40:51.301 INFO:teuthology.orchestra.run.smithi089.stdout:root 28523 0.0 0.0 0 0 ? I 15:36 0:00 \_ [kworker/4:1-events] 2023-10-08T15:40:51.301 INFO:teuthology.orchestra.run.smithi089.stdout:root 28524 0.0 0.0 0 0 ? I 15:36 0:00 \_ [kworker/4:2-events] 2023-10-08T15:40:51.302 INFO:teuthology.orchestra.run.smithi089.stdout:root 28525 0.0 0.0 0 0 ? I 15:36 0:00 \_ [kworker/4:4-memcg_kmem_cache] 2023-10-08T15:40:51.302 INFO:teuthology.orchestra.run.smithi089.stdout:root 28587 0.0 0.0 0 0 ? I 15:37 0:00 \_ [kworker/1:0] 2023-10-08T15:40:51.302 INFO:teuthology.orchestra.run.smithi089.stdout:root 28981 0.0 0.0 0 0 ? I 15:40 0:00 \_ [kworker/6:1-rcu_gp] 2023-10-08T15:40:51.302 INFO:teuthology.orchestra.run.smithi089.stdout:root 28982 0.0 0.0 0 0 ? I 15:40 0:00 \_ [kworker/6:2] 2023-10-08T15:40:51.302 INFO:teuthology.orchestra.run.smithi089.stdout:root 1 2.3 0.0 171132 12776 ? Ss 15:26 0:20 /sbin/init 2023-10-08T15:40:51.302 INFO:teuthology.orchestra.run.smithi089.stdout:root 363 0.2 0.0 62412 24772 ? S adjust-ulimits daemon-helper kill python3 -c ' 2023-10-08T15:40:51.307 DEBUG:teuthology.orchestra.run.smithi089:> import os 2023-10-08T15:40:51.308 DEBUG:teuthology.orchestra.run.smithi089:> path = "/sys/fs/fuse/connections/52/abort" 2023-10-08T15:40:51.308 DEBUG:teuthology.orchestra.run.smithi089:> if os.path.exists(path): 2023-10-08T15:40:51.308 DEBUG:teuthology.orchestra.run.smithi089:> open(path, "w").write("1") 2023-10-08T15:40:51.308 DEBUG:teuthology.orchestra.run.smithi089:> ' 2023-10-08T15:40:51.565 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:40:51.566 DEBUG:teuthology.orchestra.run.smithi089:> sudo umount -l -f /home/ubuntu/cephtest/mnt.0 2023-10-08T15:40:51.639 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi089.stderr:ceph-fuse[28924]: fuse finished with error 0 and tester_r 0 2023-10-08T15:40:51.641 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi089.front.sepia.ceph.com 2023-10-08T15:40:51.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:51.641 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-08T15:40:51.765 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi098.front.sepia.ceph.com 2023-10-08T15:40:51.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:51.766 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-08T15:40:51.772 INFO:teuthology.orchestra.run.smithi098.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-10-08T15:40:51.773 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T15:40:51.773 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2023-10-08T15:40:51.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:51.774 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-08T15:40:51.780 INFO:teuthology.orchestra.run.smithi153.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-08T15:40:51.781 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T15:40:51.781 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:40:51.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:51.911+0000 7febfbfff700 1 Processor -- start 2023-10-08T15:40:51.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:51.911+0000 7febfbfff700 1 -- start start 2023-10-08T15:40:51.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:51.911+0000 7febfbfff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7febfc0a15e0 0x7febfc14b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:51.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:51.911+0000 7febfbfff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7febfc147e00 0x7febfc148280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:51.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:51.911+0000 7febfbfff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febfc147970 con 0x7febfc146b70 2023-10-08T15:40:51.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:51.911+0000 7febfbfff700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febfc06de00 con 0x7febfc0a15e0 2023-10-08T15:40:51.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:51.911+0000 7febfbfff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febfc14bd90 con 0x7febfc147e00 2023-10-08T15:40:51.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:51.911+0000 7febfaffd700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7febfc0a15e0 0x7febfc14b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:51.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:51.911+0000 7febfaffd700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7febfc0a15e0 0x7febfc14b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34460/0 (socket says 172.21.15.3:34460) 2023-10-08T15:40:51.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:51.911+0000 7febfaffd700 1 -- 172.21.15.3:0/2137388158 learned_addr learned my addr 172.21.15.3:0/2137388158 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:51.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:51.911+0000 7febfb7fe700 1 --2- 172.21.15.3:0/2137388158 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7febfc147e00 0x7febfc148280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:51.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:51.915+0000 7febfaffd700 1 -- 172.21.15.3:0/2137388158 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7febfc147e00 msgr2=0x7febfc148280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:51.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:51.915+0000 7febfaffd700 1 --2- 172.21.15.3:0/2137388158 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7febfc147e00 0x7febfc148280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:51.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:51.915+0000 7febfaffd700 1 -- 172.21.15.3:0/2137388158 >> v1:172.21.15.50:6789/0 conn(0x7febfc146b70 legacy=0x7febfc146fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:51.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:51.915+0000 7febfaffd700 1 -- 172.21.15.3:0/2137388158 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febfc069770 con 0x7febfc0a15e0 2023-10-08T15:40:51.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:51.915+0000 7febfaffd700 1 --2- 172.21.15.3:0/2137388158 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7febfc0a15e0 0x7febfc14b850 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7febec00bc50 tx=0x7febec00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe8a8348753be3b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:51.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:51.915+0000 7febfa7fc700 1 -- 172.21.15.3:0/2137388158 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febec00be60 con 0x7febfc0a15e0 2023-10-08T15:40:51.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:51.915+0000 7febfa7fc700 1 -- 172.21.15.3:0/2137388158 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febec00de00 con 0x7febfc0a15e0 2023-10-08T15:40:51.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:51.915+0000 7febfa7fc700 1 -- 172.21.15.3:0/2137388158 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febec0196b0 con 0x7febfc0a15e0 2023-10-08T15:40:51.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:51.915+0000 7febfbfff700 1 -- 172.21.15.3:0/2137388158 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7febfc0a15e0 msgr2=0x7febfc14b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:51.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:51.915+0000 7febfbfff700 1 --2- 172.21.15.3:0/2137388158 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7febfc0a15e0 0x7febfc14b850 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7febec00bc50 tx=0x7febec00b4f0 comp rx=0 tx=0).stop 2023-10-08T15:40:51.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:51.915+0000 7febfbfff700 1 -- 172.21.15.3:0/2137388158 shutdown_connections 2023-10-08T15:40:51.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:51.915+0000 7febfbfff700 1 --2- 172.21.15.3:0/2137388158 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7febfc147e00 0x7febfc148280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:51.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:51.915+0000 7febfbfff700 1 --2- 172.21.15.3:0/2137388158 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7febfc0a15e0 0x7febfc14b850 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:51.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:51.915+0000 7febfbfff700 1 -- 172.21.15.3:0/2137388158 >> 172.21.15.3:0/2137388158 conn(0x7febfc0670e0 msgr2=0x7febfc0674e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:51.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:51.915+0000 7febfbfff700 1 -- 172.21.15.3:0/2137388158 shutdown_connections 2023-10-08T15:40:51.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:51.915+0000 7febfbfff700 1 -- 172.21.15.3:0/2137388158 wait complete. 2023-10-08T15:40:51.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:51.915+0000 7febfbfff700 1 Processor -- start 2023-10-08T15:40:51.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:51.915+0000 7febfbfff700 1 -- start start 2023-10-08T15:40:51.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:51.915+0000 7febfbfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7febfc0a15e0 0x7febfc0ba620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:51.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:51.915+0000 7febfbfff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7febfc146b70 0x7febfc0b6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:51.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:51.915+0000 7febfbfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febfc147e00 0x7febfc09ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:51.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:51.915+0000 7febfbfff700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febfc0ba190 con 0x7febfc0a15e0 2023-10-08T15:40:51.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:51.915+0000 7febfbfff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febfc0b9e20 con 0x7febfc147e00 2023-10-08T15:40:51.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:51.915+0000 7febfbfff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febfc15bb90 con 0x7febfc146b70 2023-10-08T15:40:51.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:51.915+0000 7febfaffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7febfc0a15e0 0x7febfc0ba620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:51.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:51.915+0000 7febfaffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7febfc0a15e0 0x7febfc0ba620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34466/0 (socket says 172.21.15.3:34466) 2023-10-08T15:40:51.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:51.915+0000 7febfaffd700 1 -- 172.21.15.3:0/1008844973 learned_addr learned my addr 172.21.15.3:0/1008844973 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:51.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:51.915+0000 7febfb7fe700 1 --2- 172.21.15.3:0/1008844973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febfc147e00 0x7febfc09ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:51.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:51.919+0000 7febf27fc700 1 --2- 172.21.15.3:0/1008844973 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7febfc146b70 0x7febfc0b6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:51.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:51.919+0000 7febfaffd700 1 -- 172.21.15.3:0/1008844973 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7febfc146b70 msgr2=0x7febfc0b6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:51.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:51.919+0000 7febfaffd700 1 --2- 172.21.15.3:0/1008844973 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7febfc146b70 0x7febfc0b6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:51.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:51.919+0000 7febfaffd700 1 -- 172.21.15.3:0/1008844973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febfc147e00 msgr2=0x7febfc09ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:51.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:51.919+0000 7febfaffd700 1 --2- 172.21.15.3:0/1008844973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febfc147e00 0x7febfc09ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:51.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:51.919+0000 7febfaffd700 1 -- 172.21.15.3:0/1008844973 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febec00b790 con 0x7febfc0a15e0 2023-10-08T15:40:51.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:51.919+0000 7febfaffd700 1 --2- 172.21.15.3:0/1008844973 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7febfc0a15e0 0x7febfc0ba620 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7febfc0bbda0 tx=0x7febec01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:51.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:51.919+0000 7febf37fe700 1 -- 172.21.15.3:0/1008844973 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febec010680 con 0x7febfc0a15e0 2023-10-08T15:40:51.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:51.919+0000 7febf37fe700 1 -- 172.21.15.3:0/1008844973 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febec010800 con 0x7febfc0a15e0 2023-10-08T15:40:51.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:51.919+0000 7febf37fe700 1 -- 172.21.15.3:0/1008844973 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febec010bc0 con 0x7febfc0a15e0 2023-10-08T15:40:51.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:51.919+0000 7febfbfff700 1 -- 172.21.15.3:0/1008844973 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febfc0bab60 con 0x7febfc0a15e0 2023-10-08T15:40:51.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:51.919+0000 7febfbfff700 1 -- 172.21.15.3:0/1008844973 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febfc0b6b00 con 0x7febfc0a15e0 2023-10-08T15:40:51.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:51.919+0000 7febfbfff700 1 -- 172.21.15.3:0/1008844973 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febfc05ecf0 con 0x7febfc0a15e0 2023-10-08T15:40:51.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:51.919+0000 7febf37fe700 1 -- 172.21.15.3:0/1008844973 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7febec0183e0 con 0x7febfc0a15e0 2023-10-08T15:40:51.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:51.919+0000 7febf37fe700 1 --2- 172.21.15.3:0/1008844973 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7febdc060580 0x7febdc062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:51.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:51.923+0000 7febf37fe700 1 -- 172.21.15.3:0/1008844973 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5705+0+0 (secure 0 0 0) 0x7febec014070 con 0x7febfc0a15e0 2023-10-08T15:40:51.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:51.923+0000 7febf27fc700 1 --2- 172.21.15.3:0/1008844973 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7febdc060580 0x7febdc062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:51.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:51.923+0000 7febf27fc700 1 --2- 172.21.15.3:0/1008844973 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7febdc060580 0x7febdc062a30 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7febfc0963a0 tx=0x7febe4007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:51.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:51.931+0000 7febf37fe700 1 -- 172.21.15.3:0/1008844973 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7febec04eab0 con 0x7febfc0a15e0 2023-10-08T15:40:52.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.131+0000 7febfbfff700 1 -- 172.21.15.3:0/1008844973 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7febfc068c60 con 0x7febfc0a15e0 2023-10-08T15:40:52.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.135+0000 7febf37fe700 1 -- 172.21.15.3:0/1008844973 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+3080 (secure 0 0 0) 0x7febec0520d0 con 0x7febfc0a15e0 2023-10-08T15:40:52.137 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:40:52.137 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5006,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3286528236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3286528236},{"type":"v1","addr":"172.21.15.50:6835","nonce":3286528236}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:40:13.764784+0000","modified":"2023-10-08T15:40:16.434138+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5337},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5337":{"gid":5337,"name":"a","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.3:6833/3441752211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":3441752211},{"type":"v1","addr":"172.21.15.3:6833","nonce":3441752211}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-08T15:40:52.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.135+0000 7febfbfff700 1 -- 172.21.15.3:0/1008844973 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7febdc060580 msgr2=0x7febdc062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:52.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.135+0000 7febfbfff700 1 --2- 172.21.15.3:0/1008844973 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7febdc060580 0x7febdc062a30 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7febfc0963a0 tx=0x7febe4007ec0 comp rx=0 tx=0).stop 2023-10-08T15:40:52.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.135+0000 7febfbfff700 1 -- 172.21.15.3:0/1008844973 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7febfc0a15e0 msgr2=0x7febfc0ba620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:52.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.135+0000 7febfbfff700 1 --2- 172.21.15.3:0/1008844973 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7febfc0a15e0 0x7febfc0ba620 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7febfc0bbda0 tx=0x7febec01b000 comp rx=0 tx=0).stop 2023-10-08T15:40:52.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.135+0000 7febfbfff700 1 -- 172.21.15.3:0/1008844973 shutdown_connections 2023-10-08T15:40:52.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.135+0000 7febfbfff700 1 --2- 172.21.15.3:0/1008844973 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7febdc060580 0x7febdc062a30 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:52.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.135+0000 7febfbfff700 1 --2- 172.21.15.3:0/1008844973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febfc147e00 0x7febfc09ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:52.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.135+0000 7febfbfff700 1 --2- 172.21.15.3:0/1008844973 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7febfc146b70 0x7febfc0b6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:52.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.135+0000 7febfbfff700 1 --2- 172.21.15.3:0/1008844973 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7febfc0a15e0 0x7febfc0ba620 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:52.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.135+0000 7febfbfff700 1 -- 172.21.15.3:0/1008844973 >> 172.21.15.3:0/1008844973 conn(0x7febfc0670e0 msgr2=0x7febfc0703a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:52.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.135+0000 7febfbfff700 1 -- 172.21.15.3:0/1008844973 shutdown_connections 2023-10-08T15:40:52.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.135+0000 7febfbfff700 1 -- 172.21.15.3:0/1008844973 wait complete. 2023-10-08T15:40:52.141 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 19 2023-10-08T15:40:52.151 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:40:52.260 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.255+0000 7f771bfff700 1 Processor -- start 2023-10-08T15:40:52.260 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.255+0000 7f771bfff700 1 -- start start 2023-10-08T15:40:52.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.259+0000 7f771bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f771c06cd70 0x7f771c06ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:52.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.259+0000 7f771bfff700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f771c06d570 con 0x7f771c0bbac0 2023-10-08T15:40:52.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.259+0000 7f771bfff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f771c06d850 con 0x7f771c14bda0 2023-10-08T15:40:52.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.259+0000 7f771bfff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f771c06c9a0 con 0x7f771c06cd70 2023-10-08T15:40:52.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.259+0000 7f771a7fc700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f771c0bbac0 0x7f771c14b690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:60108/0 (socket says 172.21.15.3:60108) 2023-10-08T15:40:52.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.259+0000 7f771a7fc700 1 -- 172.21.15.3:0/950621564 learned_addr learned my addr 172.21.15.3:0/950621564 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:40:52.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.259+0000 7f771affd700 1 --2- 172.21.15.3:0/950621564 >> v2:172.21.15.50:3300/0 conn(0x7f771c06cd70 0x7f771c06ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:52.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.259+0000 7f7719ffb700 1 -- 172.21.15.3:0/950621564 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1952174688 0 0) 0x7f771c06d570 con 0x7f771c0bbac0 2023-10-08T15:40:52.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.259+0000 7f7719ffb700 1 -- 172.21.15.3:0/950621564 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7704003570 con 0x7f771c0bbac0 2023-10-08T15:40:52.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.259+0000 7f771affd700 1 -- 172.21.15.3:0/950621564 >> v1:172.21.15.50:6789/0 conn(0x7f771c14bda0 legacy=0x7f771c1483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:52.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.259+0000 7f771affd700 1 -- 172.21.15.3:0/950621564 >> v1:172.21.15.3:6789/0 conn(0x7f771c0bbac0 legacy=0x7f771c14b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:52.265 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.259+0000 7f771affd700 1 -- 172.21.15.3:0/950621564 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f771c069110 con 0x7f771c06cd70 2023-10-08T15:40:52.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.259+0000 7f771affd700 1 --2- 172.21.15.3:0/950621564 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f771c06cd70 0x7f771c06ddf0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f770c0098e0 tx=0x7f770c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=128c8269c35a4552 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:52.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.259+0000 7f7719ffb700 1 -- 172.21.15.3:0/950621564 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770c00b640 con 0x7f771c06cd70 2023-10-08T15:40:52.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.259+0000 7f7719ffb700 1 -- 172.21.15.3:0/950621564 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f770c00b7a0 con 0x7f771c06cd70 2023-10-08T15:40:52.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.259+0000 7f7719ffb700 1 -- 172.21.15.3:0/950621564 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770c00bb40 con 0x7f771c06cd70 2023-10-08T15:40:52.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.259+0000 7f771bfff700 1 -- 172.21.15.3:0/950621564 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f771c06cd70 msgr2=0x7f771c06ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:52.267 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.259+0000 7f771bfff700 1 --2- 172.21.15.3:0/950621564 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f771c06cd70 0x7f771c06ddf0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f770c0098e0 tx=0x7f770c0091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:52.267 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.259+0000 7f771bfff700 1 -- 172.21.15.3:0/950621564 shutdown_connections 2023-10-08T15:40:52.267 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.259+0000 7f771bfff700 1 --2- 172.21.15.3:0/950621564 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f771c06cd70 0x7f771c06ddf0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:52.267 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.259+0000 7f771bfff700 1 -- 172.21.15.3:0/950621564 >> 172.21.15.3:0/950621564 conn(0x7f771c0670e0 msgr2=0x7f771c0674e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:52.267 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.259+0000 7f771bfff700 1 -- 172.21.15.3:0/950621564 shutdown_connections 2023-10-08T15:40:52.267 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.259+0000 7f771bfff700 1 -- 172.21.15.3:0/950621564 wait complete. 2023-10-08T15:40:52.269 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.263+0000 7f771bfff700 1 Processor -- start 2023-10-08T15:40:52.269 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.263+0000 7f771bfff700 1 -- start start 2023-10-08T15:40:52.269 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.263+0000 7f771bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f771c06cd70 0x7f771c095cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:52.269 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.263+0000 7f771bfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f771c0bbac0 0x7f771c144790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:52.269 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.263+0000 7f771bfff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f771c14bda0 0x7f771c144cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:52.270 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.263+0000 7f771bfff700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f771c096a90 con 0x7f771c0bbac0 2023-10-08T15:40:52.270 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.263+0000 7f771bfff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f771c145210 con 0x7f771c06cd70 2023-10-08T15:40:52.270 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.263+0000 7f771bfff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f771c0ba5e0 con 0x7f771c14bda0 2023-10-08T15:40:52.270 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.263+0000 7f771a7fc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f771c0bbac0 0x7f771c144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:52.270 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.263+0000 7f771a7fc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f771c0bbac0 0x7f771c144790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34474/0 (socket says 172.21.15.3:34474) 2023-10-08T15:40:52.270 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.263+0000 7f771affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f771c06cd70 0x7f771c095cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:52.270 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.263+0000 7f771a7fc700 1 -- 172.21.15.3:0/2467551584 learned_addr learned my addr 172.21.15.3:0/2467551584 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:52.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.263+0000 7f771b7fe700 1 --2- 172.21.15.3:0/2467551584 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f771c14bda0 0x7f771c144cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:52.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.263+0000 7f771a7fc700 1 -- 172.21.15.3:0/2467551584 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f771c14bda0 msgr2=0x7f771c144cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:52.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.263+0000 7f771a7fc700 1 --2- 172.21.15.3:0/2467551584 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f771c14bda0 0x7f771c144cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:52.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.263+0000 7f771a7fc700 1 -- 172.21.15.3:0/2467551584 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f771c06cd70 msgr2=0x7f771c095cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:52.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.263+0000 7f771a7fc700 1 --2- 172.21.15.3:0/2467551584 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f771c06cd70 0x7f771c095cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:52.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.263+0000 7f771a7fc700 1 -- 172.21.15.3:0/2467551584 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f770c009420 con 0x7f771c0bbac0 2023-10-08T15:40:52.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.267+0000 7f771a7fc700 1 --2- 172.21.15.3:0/2467551584 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f771c0bbac0 0x7f771c144790 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f771000c7f0 tx=0x7f7710007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:52.272 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.267+0000 7f7702ffd700 1 -- 172.21.15.3:0/2467551584 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7710005cd0 con 0x7f771c0bbac0 2023-10-08T15:40:52.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.267+0000 7f7702ffd700 1 -- 172.21.15.3:0/2467551584 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7710005e50 con 0x7f771c0bbac0 2023-10-08T15:40:52.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.267+0000 7f771bfff700 1 -- 172.21.15.3:0/2467551584 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f771c15b6d0 con 0x7f771c0bbac0 2023-10-08T15:40:52.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.267+0000 7f7702ffd700 1 -- 172.21.15.3:0/2467551584 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7710007320 con 0x7f771c0bbac0 2023-10-08T15:40:52.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.267+0000 7f771bfff700 1 -- 172.21.15.3:0/2467551584 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f771c096200 con 0x7f771c0bbac0 2023-10-08T15:40:52.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.267+0000 7f771bfff700 1 -- 172.21.15.3:0/2467551584 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f771c096c00 con 0x7f771c0bbac0 2023-10-08T15:40:52.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.267+0000 7f7702ffd700 1 -- 172.21.15.3:0/2467551584 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f771001b3b0 con 0x7f771c0bbac0 2023-10-08T15:40:52.274 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.271+0000 7f7702ffd700 1 --2- 172.21.15.3:0/2467551584 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7708060550 0x7f7708062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:52.274 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.271+0000 7f7702ffd700 1 -- 172.21.15.3:0/2467551584 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f771007bee0 con 0x7f771c0bbac0 2023-10-08T15:40:52.274 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.271+0000 7f771affd700 1 --2- 172.21.15.3:0/2467551584 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7708060550 0x7f7708062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:52.274 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.271+0000 7f771affd700 1 --2- 172.21.15.3:0/2467551584 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7708060550 0x7f7708062a00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f770c0093f0 tx=0x7f770c017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:52.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.275+0000 7f7702ffd700 1 -- 172.21.15.3:0/2467551584 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f771004c4d0 con 0x7f771c0bbac0 2023-10-08T15:40:52.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.439+0000 7f771bfff700 1 -- 172.21.15.3:0/2467551584 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f771c05ecf0 con 0x7f771c0bbac0 2023-10-08T15:40:52.443 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.439+0000 7f7702ffd700 1 -- 172.21.15.3:0/2467551584 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+15254 (secure 0 0 0) 0x7f7710017020 con 0x7f771c0bbac0 2023-10-08T15:40:52.444 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:40:52.444 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":39,"fsid":"7635972e-cd66-4a8f-a231-378db8b3847a","created":"2023-10-08T15:37:08.234594+0000","modified":"2023-10-08T15:40:15.399080+0000","last_up_change":"2023-10-08T15:37:17.537726+0000","last_in_change":"2023-10-08T15:37:10.269178+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:37:16.581590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:40:12.013806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-08T15:40:12.747398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"64fb1864-bfdd-4d75-9b41-03fb60085dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33363},{"type":"v1","addr":"172.21.15.3:6801","nonce":33363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33363},{"type":"v1","addr":"172.21.15.3:6803","nonce":33363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":33363},{"type":"v1","addr":"172.21.15.3:6807","nonce":33363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33363},{"type":"v1","addr":"172.21.15.3:6805","nonce":33363}]},"public_addr":"172.21.15.3:6801/33363","cluster_addr":"172.21.15.3:6803/33363","heartbeat_back_addr":"172.21.15.3:6807/33363","heartbeat_front_addr":"172.21.15.3:6805/33363","state":["exists","up"]},{"osd":1,"uuid":"3ca6bd3a-3e8a-4c65-af9c-46148b0c2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33364},{"type":"v1","addr":"172.21.15.3:6820","nonce":33364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33364},{"type":"v1","addr":"172.21.15.3:6824","nonce":33364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33364},{"type":"v1","addr":"172.21.15.3:6831","nonce":33364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33364},{"type":"v1","addr":"172.21.15.3:6828","nonce":33364}]},"public_addr":"172.21.15.3:6820/33364","cluster_addr":"172.21.15.3:6824/33364","heartbeat_back_addr":"172.21.15.3:6831/33364","heartbeat_front_addr":"172.21.15.3:6828/33364","state":["exists","up"]},{"osd":2,"uuid":"6eb9f757-58dd-442f-910d-32401454bce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33366},{"type":"v1","addr":"172.21.15.3:6817","nonce":33366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":33366},{"type":"v1","addr":"172.21.15.3:6821","nonce":33366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6827","nonce":33366},{"type":"v1","addr":"172.21.15.3:6829","nonce":33366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":33366},{"type":"v1","addr":"172.21.15.3:6825","nonce":33366}]},"public_addr":"172.21.15.3:6817/33366","cluster_addr":"172.21.15.3:6821/33366","heartbeat_back_addr":"172.21.15.3:6829/33366","heartbeat_front_addr":"172.21.15.3:6825/33366","state":["exists","up"]},{"osd":3,"uuid":"1c39866b-ac2e-4ea9-a69c-02b01ee4191d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33365},{"type":"v1","addr":"172.21.15.3:6809","nonce":33365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":33365},{"type":"v1","addr":"172.21.15.3:6811","nonce":33365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33365},{"type":"v1","addr":"172.21.15.3:6815","nonce":33365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":33365},{"type":"v1","addr":"172.21.15.3:6813","nonce":33365}]},"public_addr":"172.21.15.3:6809/33365","cluster_addr":"172.21.15.3:6811/33365","heartbeat_back_addr":"172.21.15.3:6815/33365","heartbeat_front_addr":"172.21.15.3:6813/33365","state":["exists","up"]},{"osd":4,"uuid":"15f86b61-b7f1-4780-ae00-9d80a68cb830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":33605},{"type":"v1","addr":"172.21.15.50:6809","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33605},{"type":"v1","addr":"172.21.15.50:6811","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33605},{"type":"v1","addr":"172.21.15.50:6815","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":33605},{"type":"v1","addr":"172.21.15.50:6813","nonce":33605}]},"public_addr":"172.21.15.50:6809/33605","cluster_addr":"172.21.15.50:6811/33605","heartbeat_back_addr":"172.21.15.50:6815/33605","heartbeat_front_addr":"172.21.15.50:6813/33605","state":["exists","up"]},{"osd":5,"uuid":"726c3003-34e6-4d5a-b6e2-f911e13c2118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33606},{"type":"v1","addr":"172.21.15.50:6801","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33606},{"type":"v1","addr":"172.21.15.50:6803","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33606},{"type":"v1","addr":"172.21.15.50:6807","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":33606},{"type":"v1","addr":"172.21.15.50:6805","nonce":33606}]},"public_addr":"172.21.15.50:6801/33606","cluster_addr":"172.21.15.50:6803/33606","heartbeat_back_addr":"172.21.15.50:6807/33606","heartbeat_front_addr":"172.21.15.50:6805/33606","state":["exists","up"]},{"osd":6,"uuid":"401122a4-9988-441f-a5a7-39164434ebcd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":33607},{"type":"v1","addr":"172.21.15.50:6819","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":33607},{"type":"v1","addr":"172.21.15.50:6823","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":33607},{"type":"v1","addr":"172.21.15.50:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":33607},{"type":"v1","addr":"172.21.15.50:6827","nonce":33607}]},"public_addr":"172.21.15.50:6819/33607","cluster_addr":"172.21.15.50:6823/33607","heartbeat_back_addr":"172.21.15.50:6831/33607","heartbeat_front_addr":"172.21.15.50:6827/33607","state":["exists","up"]},{"osd":7,"uuid":"6b3fa236-c9d0-4c4d-82ae-9af4daf6d699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33604},{"type":"v1","addr":"172.21.15.50:6818","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":33604},{"type":"v1","addr":"172.21.15.50:6822","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":33604},{"type":"v1","addr":"172.21.15.50:6830","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":33604},{"type":"v1","addr":"172.21.15.50:6826","nonce":33604}]},"public_addr":"172.21.15.50:6818/33604","cluster_addr":"172.21.15.50:6822/33604","heartbeat_back_addr":"172.21.15.50:6830/33604","heartbeat_front_addr":"172.21.15.50:6826/33604","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.497794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.529417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.873426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.325972+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.443971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.240795+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.739632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.643026+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:40:52.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.443+0000 7f771bfff700 1 -- 172.21.15.3:0/2467551584 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7708060550 msgr2=0x7f7708062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:52.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.443+0000 7f771bfff700 1 --2- 172.21.15.3:0/2467551584 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7708060550 0x7f7708062a00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f770c0093f0 tx=0x7f770c017000 comp rx=0 tx=0).stop 2023-10-08T15:40:52.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.443+0000 7f771bfff700 1 -- 172.21.15.3:0/2467551584 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f771c0bbac0 msgr2=0x7f771c144790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:52.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.443+0000 7f771bfff700 1 --2- 172.21.15.3:0/2467551584 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f771c0bbac0 0x7f771c144790 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f771000c7f0 tx=0x7f7710007e00 comp rx=0 tx=0).stop 2023-10-08T15:40:52.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.443+0000 7f771bfff700 1 -- 172.21.15.3:0/2467551584 shutdown_connections 2023-10-08T15:40:52.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.443+0000 7f771bfff700 1 --2- 172.21.15.3:0/2467551584 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7708060550 0x7f7708062a00 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:52.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.443+0000 7f771bfff700 1 --2- 172.21.15.3:0/2467551584 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f771c14bda0 0x7f771c144cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:52.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.443+0000 7f771bfff700 1 --2- 172.21.15.3:0/2467551584 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f771c0bbac0 0x7f771c144790 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:52.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.443+0000 7f771bfff700 1 --2- 172.21.15.3:0/2467551584 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f771c06cd70 0x7f771c095cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:52.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.443+0000 7f771bfff700 1 -- 172.21.15.3:0/2467551584 >> 172.21.15.3:0/2467551584 conn(0x7f771c0670e0 msgr2=0x7f771c0bea10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:52.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.443+0000 7f771bfff700 1 -- 172.21.15.3:0/2467551584 shutdown_connections 2023-10-08T15:40:52.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.443+0000 7f771bfff700 1 -- 172.21.15.3:0/2467551584 wait complete. 2023-10-08T15:40:52.459 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T15:37:16.581590+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T15:40:12.013806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T15:40:12.747398+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T15:40:52.459 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T15:40:52.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.567+0000 7f97cb59e700 1 Processor -- start 2023-10-08T15:40:52.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.567+0000 7f97cb59e700 1 -- start start 2023-10-08T15:40:52.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.567+0000 7f97cb59e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f97cc0a7bc0 0x7f97cc0be3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:52.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.567+0000 7f97cb59e700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97cc06ced0 con 0x7f97cc0a77f0 2023-10-08T15:40:52.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.567+0000 7f97cb59e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97cc069570 con 0x7f97cc06c5c0 2023-10-08T15:40:52.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.567+0000 7f97cb59e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97cc06e770 con 0x7f97cc0a7bc0 2023-10-08T15:40:52.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.567+0000 7f97ca59c700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f97cc0a77f0 0x7f97cc0a2200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:60118/0 (socket says 172.21.15.3:60118) 2023-10-08T15:40:52.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.567+0000 7f97ca59c700 1 -- 172.21.15.3:0/2894868240 learned_addr learned my addr 172.21.15.3:0/2894868240 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:40:52.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.571+0000 7f97cad9d700 1 --2- 172.21.15.3:0/2894868240 >> v2:172.21.15.50:3300/0 conn(0x7f97cc0a7bc0 0x7f97cc0be3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:52.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.571+0000 7f97c959a700 1 -- 172.21.15.3:0/2894868240 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3620314236 0 0) 0x7f97cc06ced0 con 0x7f97cc0a77f0 2023-10-08T15:40:52.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.571+0000 7f97c959a700 1 -- 172.21.15.3:0/2894868240 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97b4003570 con 0x7f97cc0a77f0 2023-10-08T15:40:52.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.571+0000 7f97cad9d700 1 -- 172.21.15.3:0/2894868240 >> v1:172.21.15.50:6789/0 conn(0x7f97cc06c5c0 legacy=0x7f97cc06d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:52.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.571+0000 7f97cad9d700 1 -- 172.21.15.3:0/2894868240 >> v1:172.21.15.3:6789/0 conn(0x7f97cc0a77f0 legacy=0x7f97cc0a2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:52.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.571+0000 7f97c959a700 1 -- 172.21.15.3:0/2894868240 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1483832474 0 0) 0x7f97b4003570 con 0x7f97cc0a77f0 2023-10-08T15:40:52.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.571+0000 7f97cad9d700 1 -- 172.21.15.3:0/2894868240 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97cc14c620 con 0x7f97cc0a7bc0 2023-10-08T15:40:52.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.571+0000 7f97cad9d700 1 --2- 172.21.15.3:0/2894868240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97cc0a7bc0 0x7f97cc0be3d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f97cc069700 tx=0x7f97c4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=415a9aa541546c54 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:52.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.571+0000 7f97c959a700 1 -- 172.21.15.3:0/2894868240 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c400e070 con 0x7f97cc0a7bc0 2023-10-08T15:40:52.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.571+0000 7f97c959a700 1 -- 172.21.15.3:0/2894868240 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97c400bb20 con 0x7f97cc0a7bc0 2023-10-08T15:40:52.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.571+0000 7f97c959a700 1 -- 172.21.15.3:0/2894868240 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c400bee0 con 0x7f97cc0a7bc0 2023-10-08T15:40:52.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.571+0000 7f97cb59e700 1 -- 172.21.15.3:0/2894868240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97cc0a7bc0 msgr2=0x7f97cc0be3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:52.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.571+0000 7f97cb59e700 1 --2- 172.21.15.3:0/2894868240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97cc0a7bc0 0x7f97cc0be3d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f97cc069700 tx=0x7f97c4009780 comp rx=0 tx=0).stop 2023-10-08T15:40:52.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.571+0000 7f97cb59e700 1 -- 172.21.15.3:0/2894868240 shutdown_connections 2023-10-08T15:40:52.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.571+0000 7f97cb59e700 1 --2- 172.21.15.3:0/2894868240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97cc0a7bc0 0x7f97cc0be3d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:52.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.571+0000 7f97cb59e700 1 -- 172.21.15.3:0/2894868240 >> 172.21.15.3:0/2894868240 conn(0x7f97cc0c29f0 msgr2=0x7f97cc0a1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:52.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.571+0000 7f97cb59e700 1 -- 172.21.15.3:0/2894868240 shutdown_connections 2023-10-08T15:40:52.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.571+0000 7f97cb59e700 1 -- 172.21.15.3:0/2894868240 wait complete. 2023-10-08T15:40:52.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.575+0000 7f97cb59e700 1 Processor -- start 2023-10-08T15:40:52.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.575+0000 7f97cb59e700 1 -- start start 2023-10-08T15:40:52.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.575+0000 7f97cb59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97cc06c5c0 0x7f97cc0a4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:52.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.575+0000 7f97cb59e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f97cc0a77f0 0x7f97cc14ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:52.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.575+0000 7f97cb59e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f97cc0a7bc0 0x7f97cc0a69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:52.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.575+0000 7f97cb59e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97cc0a4790 con 0x7f97cc0a77f0 2023-10-08T15:40:52.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.575+0000 7f97cb59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97cc14cf40 con 0x7f97cc06c5c0 2023-10-08T15:40:52.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.575+0000 7f97cb59e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97cc0a6f10 con 0x7f97cc0a7bc0 2023-10-08T15:40:52.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.575+0000 7f97c9d9b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f97cc0a77f0 0x7f97cc14ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:52.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.575+0000 7f97c9d9b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f97cc0a77f0 0x7f97cc14ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34490/0 (socket says 172.21.15.3:34490) 2023-10-08T15:40:52.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.575+0000 7f97c9d9b700 1 -- 172.21.15.3:0/3413620802 learned_addr learned my addr 172.21.15.3:0/3413620802 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:52.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.575+0000 7f97ca59c700 1 --2- 172.21.15.3:0/3413620802 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97cc06c5c0 0x7f97cc0a4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:52.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.575+0000 7f97cad9d700 1 --2- 172.21.15.3:0/3413620802 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f97cc0a7bc0 0x7f97cc0a69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:52.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.575+0000 7f97c9d9b700 1 -- 172.21.15.3:0/3413620802 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f97cc0a7bc0 msgr2=0x7f97cc0a69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:52.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.575+0000 7f97c9d9b700 1 --2- 172.21.15.3:0/3413620802 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f97cc0a7bc0 0x7f97cc0a69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:52.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.575+0000 7f97c9d9b700 1 -- 172.21.15.3:0/3413620802 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97cc06c5c0 msgr2=0x7f97cc0a4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:52.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.575+0000 7f97c9d9b700 1 --2- 172.21.15.3:0/3413620802 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97cc06c5c0 0x7f97cc0a4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:52.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.575+0000 7f97c9d9b700 1 -- 172.21.15.3:0/3413620802 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97c4009a20 con 0x7f97cc0a77f0 2023-10-08T15:40:52.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.575+0000 7f97c9d9b700 1 --2- 172.21.15.3:0/3413620802 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f97cc0a77f0 0x7f97cc14ca00 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f97c000c590 tx=0x7f97c000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:52.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.575+0000 7f97ba7fc700 1 -- 172.21.15.3:0/3413620802 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c0011590 con 0x7f97cc0a77f0 2023-10-08T15:40:52.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.575+0000 7f97ba7fc700 1 -- 172.21.15.3:0/3413620802 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97c00116f0 con 0x7f97cc0a77f0 2023-10-08T15:40:52.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.575+0000 7f97cb59e700 1 -- 172.21.15.3:0/3413620802 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97cc0a3300 con 0x7f97cc0a77f0 2023-10-08T15:40:52.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.575+0000 7f97ba7fc700 1 -- 172.21.15.3:0/3413620802 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c0011ab0 con 0x7f97cc0a77f0 2023-10-08T15:40:52.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.575+0000 7f97cb59e700 1 -- 172.21.15.3:0/3413620802 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97cc14e800 con 0x7f97cc0a77f0 2023-10-08T15:40:52.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.579+0000 7f97ba7fc700 1 -- 172.21.15.3:0/3413620802 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f97c001b3b0 con 0x7f97cc0a77f0 2023-10-08T15:40:52.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.579+0000 7f97cb59e700 1 -- 172.21.15.3:0/3413620802 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97cc0a3160 con 0x7f97cc0a77f0 2023-10-08T15:40:52.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.579+0000 7f97ba7fc700 1 --2- 172.21.15.3:0/3413620802 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f97ac060580 0x7f97ac062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:52.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.579+0000 7f97ba7fc700 1 -- 172.21.15.3:0/3413620802 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f97c007be30 con 0x7f97cc0a77f0 2023-10-08T15:40:52.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.579+0000 7f97ca59c700 1 --2- 172.21.15.3:0/3413620802 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f97ac060580 0x7f97ac062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:52.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.579+0000 7f97ca59c700 1 --2- 172.21.15.3:0/3413620802 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f97ac060580 0x7f97ac062a30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f97bc000fb0 tx=0x7f97bc005930 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:52.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.587+0000 7f97ba7fc700 1 -- 172.21.15.3:0/3413620802 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f97cc0a3160 con 0x7f97cc0a77f0 2023-10-08T15:40:52.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.747+0000 7f97cb59e700 1 -- 172.21.15.3:0/3413620802 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f97cc0a3160 con 0x7f97cc0a77f0 2023-10-08T15:40:52.752 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.747+0000 7f97ba7fc700 1 -- 172.21.15.3:0/3413620802 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7f97cc0a3160 con 0x7f97cc0a77f0 2023-10-08T15:40:52.752 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2023-10-08T15:40:52.755 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.751+0000 7f97cb59e700 1 -- 172.21.15.3:0/3413620802 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f97ac060580 msgr2=0x7f97ac062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:52.755 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.751+0000 7f97cb59e700 1 --2- 172.21.15.3:0/3413620802 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f97ac060580 0x7f97ac062a30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f97bc000fb0 tx=0x7f97bc005930 comp rx=0 tx=0).stop 2023-10-08T15:40:52.756 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.751+0000 7f97cb59e700 1 -- 172.21.15.3:0/3413620802 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f97cc0a77f0 msgr2=0x7f97cc14ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:52.756 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.751+0000 7f97cb59e700 1 --2- 172.21.15.3:0/3413620802 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f97cc0a77f0 0x7f97cc14ca00 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f97c000c590 tx=0x7f97c000c950 comp rx=0 tx=0).stop 2023-10-08T15:40:52.756 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.751+0000 7f97cb59e700 1 -- 172.21.15.3:0/3413620802 shutdown_connections 2023-10-08T15:40:52.756 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.751+0000 7f97cb59e700 1 --2- 172.21.15.3:0/3413620802 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f97ac060580 0x7f97ac062a30 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:52.756 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.751+0000 7f97cb59e700 1 --2- 172.21.15.3:0/3413620802 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f97cc0a7bc0 0x7f97cc0a69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:52.756 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.751+0000 7f97cb59e700 1 --2- 172.21.15.3:0/3413620802 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f97cc0a77f0 0x7f97cc14ca00 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:52.756 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.751+0000 7f97cb59e700 1 --2- 172.21.15.3:0/3413620802 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97cc06c5c0 0x7f97cc0a4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:52.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.751+0000 7f97cb59e700 1 -- 172.21.15.3:0/3413620802 >> 172.21.15.3:0/3413620802 conn(0x7f97cc0c29f0 msgr2=0x7f97cc14b3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:52.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.751+0000 7f97cb59e700 1 -- 172.21.15.3:0/3413620802 shutdown_connections 2023-10-08T15:40:52.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.751+0000 7f97cb59e700 1 -- 172.21.15.3:0/3413620802 wait complete. 2023-10-08T15:40:52.767 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T15:40:52.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.875+0000 7fb408c13700 1 Processor -- start 2023-10-08T15:40:52.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.875+0000 7fb408c13700 1 -- start start 2023-10-08T15:40:52.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.875+0000 7fb408c13700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb4040a77f0 0x7fb4040be3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:52.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.875+0000 7fb408c13700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb4040a7bc0 0x7fb40414bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:52.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.875+0000 7fb408c13700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb40406ced0 con 0x7fb40406c5c0 2023-10-08T15:40:52.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.875+0000 7fb408c13700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb40406e770 con 0x7fb4040a7bc0 2023-10-08T15:40:52.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.875+0000 7fb408c13700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb404069570 con 0x7fb4040a77f0 2023-10-08T15:40:52.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.875+0000 7fb403fff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb4040a7bc0 0x7fb40414bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:52.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.875+0000 7fb403fff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb4040a7bc0 0x7fb40414bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34498/0 (socket says 172.21.15.3:34498) 2023-10-08T15:40:52.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.875+0000 7fb403fff700 1 -- 172.21.15.3:0/173761836 learned_addr learned my addr 172.21.15.3:0/173761836 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:52.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.875+0000 7fb4037fe700 1 --2- 172.21.15.3:0/173761836 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb4040a77f0 0x7fb4040be3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:52.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.879+0000 7fb403fff700 1 -- 172.21.15.3:0/173761836 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb4040a77f0 msgr2=0x7fb4040be3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:52.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.879+0000 7fb403fff700 1 --2- 172.21.15.3:0/173761836 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb4040a77f0 0x7fb4040be3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:52.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.879+0000 7fb403fff700 1 -- 172.21.15.3:0/173761836 >> v1:172.21.15.50:6789/0 conn(0x7fb40406c5c0 legacy=0x7fb4040a2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:52.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.879+0000 7fb403fff700 1 -- 172.21.15.3:0/173761836 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb40414c620 con 0x7fb4040a7bc0 2023-10-08T15:40:52.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.879+0000 7fb4027fc700 1 -- 172.21.15.3:0/173761836 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2276928991 0 0) 0x7fb40406ced0 con 0x7fb40406c5c0 2023-10-08T15:40:52.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.879+0000 7fb403fff700 1 --2- 172.21.15.3:0/173761836 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb4040a7bc0 0x7fb40414bfb0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc009f20 tx=0x7fb3fc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16e8b1bdb237f413 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:52.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.879+0000 7fb4027fc700 1 -- 172.21.15.3:0/173761836 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc00e070 con 0x7fb4040a7bc0 2023-10-08T15:40:52.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.879+0000 7fb4027fc700 1 -- 172.21.15.3:0/173761836 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3fc00b9d0 con 0x7fb4040a7bc0 2023-10-08T15:40:52.885 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.879+0000 7fb4027fc700 1 -- 172.21.15.3:0/173761836 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc0092e0 con 0x7fb4040a7bc0 2023-10-08T15:40:52.885 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.879+0000 7fb408c13700 1 -- 172.21.15.3:0/173761836 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb4040a7bc0 msgr2=0x7fb40414bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:52.885 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.879+0000 7fb408c13700 1 --2- 172.21.15.3:0/173761836 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb4040a7bc0 0x7fb40414bfb0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc009f20 tx=0x7fb3fc009840 comp rx=0 tx=0).stop 2023-10-08T15:40:52.885 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.879+0000 7fb408c13700 1 -- 172.21.15.3:0/173761836 shutdown_connections 2023-10-08T15:40:52.885 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.879+0000 7fb408c13700 1 --2- 172.21.15.3:0/173761836 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb4040a7bc0 0x7fb40414bfb0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:52.885 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.879+0000 7fb408c13700 1 --2- 172.21.15.3:0/173761836 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb4040a77f0 0x7fb4040be3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:52.885 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.879+0000 7fb408c13700 1 -- 172.21.15.3:0/173761836 >> 172.21.15.3:0/173761836 conn(0x7fb4040c29f0 msgr2=0x7fb4040a1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:52.885 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.879+0000 7fb408c13700 1 -- 172.21.15.3:0/173761836 shutdown_connections 2023-10-08T15:40:52.885 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.879+0000 7fb408c13700 1 -- 172.21.15.3:0/173761836 wait complete. 2023-10-08T15:40:52.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.883+0000 7fb408c13700 1 Processor -- start 2023-10-08T15:40:52.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.883+0000 7fb408c13700 1 -- start start 2023-10-08T15:40:52.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.883+0000 7fb408c13700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb40406c5c0 0x7fb40415e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:52.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.883+0000 7fb408c13700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb4040a77f0 0x7fb40415e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:52.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.883+0000 7fb408c13700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb4040a7bc0 0x7fb404149d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:52.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.883+0000 7fb408c13700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4040b8db0 con 0x7fb4040a77f0 2023-10-08T15:40:52.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.883+0000 7fb408c13700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4040a6e40 con 0x7fb40406c5c0 2023-10-08T15:40:52.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.883+0000 7fb408c13700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4040b9d10 con 0x7fb4040a7bc0 2023-10-08T15:40:52.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.883+0000 7fb402ffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb4040a77f0 0x7fb40415e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:52.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.883+0000 7fb402ffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb4040a77f0 0x7fb40415e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34508/0 (socket says 172.21.15.3:34508) 2023-10-08T15:40:52.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.883+0000 7fb402ffd700 1 -- 172.21.15.3:0/1068386030 learned_addr learned my addr 172.21.15.3:0/1068386030 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:52.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.883+0000 7fb403fff700 1 --2- 172.21.15.3:0/1068386030 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb4040a7bc0 0x7fb404149d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:52.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.883+0000 7fb4037fe700 1 --2- 172.21.15.3:0/1068386030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb40406c5c0 0x7fb40415e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:52.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.883+0000 7fb402ffd700 1 -- 172.21.15.3:0/1068386030 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb4040a7bc0 msgr2=0x7fb404149d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:52.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.883+0000 7fb402ffd700 1 --2- 172.21.15.3:0/1068386030 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb4040a7bc0 0x7fb404149d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:52.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.883+0000 7fb402ffd700 1 -- 172.21.15.3:0/1068386030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb40406c5c0 msgr2=0x7fb40415e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:52.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.883+0000 7fb402ffd700 1 --2- 172.21.15.3:0/1068386030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb40406c5c0 0x7fb40415e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:52.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.883+0000 7fb402ffd700 1 -- 172.21.15.3:0/1068386030 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3fc009ae0 con 0x7fb4040a77f0 2023-10-08T15:40:52.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.883+0000 7fb402ffd700 1 --2- 172.21.15.3:0/1068386030 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb4040a77f0 0x7fb40415e690 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fb3f400c810 tx=0x7fb3f4007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:52.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.883+0000 7fb3eb7fe700 1 -- 172.21.15.3:0/1068386030 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f4011590 con 0x7fb4040a77f0 2023-10-08T15:40:52.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.883+0000 7fb3eb7fe700 1 -- 172.21.15.3:0/1068386030 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3f4011710 con 0x7fb4040a77f0 2023-10-08T15:40:52.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.883+0000 7fb408c13700 1 -- 172.21.15.3:0/1068386030 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb40415ef70 con 0x7fb4040a77f0 2023-10-08T15:40:52.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.883+0000 7fb3eb7fe700 1 -- 172.21.15.3:0/1068386030 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f4011ad0 con 0x7fb4040a77f0 2023-10-08T15:40:52.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.883+0000 7fb408c13700 1 -- 172.21.15.3:0/1068386030 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4040a6b80 con 0x7fb4040a77f0 2023-10-08T15:40:52.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.887+0000 7fb408c13700 1 -- 172.21.15.3:0/1068386030 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb40405ecf0 con 0x7fb4040a77f0 2023-10-08T15:40:52.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.887+0000 7fb3eb7fe700 1 -- 172.21.15.3:0/1068386030 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb3f401c460 con 0x7fb4040a77f0 2023-10-08T15:40:52.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.887+0000 7fb3eb7fe700 1 --2- 172.21.15.3:0/1068386030 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb3f0060550 0x7fb3f0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:52.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.887+0000 7fb4037fe700 1 --2- 172.21.15.3:0/1068386030 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb3f0060550 0x7fb3f0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:52.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.887+0000 7fb3eb7fe700 1 -- 172.21.15.3:0/1068386030 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb3f407c530 con 0x7fb4040a77f0 2023-10-08T15:40:52.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.891+0000 7fb4037fe700 1 --2- 172.21.15.3:0/1068386030 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb3f0060550 0x7fb3f0062a00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8009db0 tx=0x7fb3f80091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:52.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:52.895+0000 7fb3eb7fe700 1 -- 172.21.15.3:0/1068386030 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb3f404cb20 con 0x7fb4040a77f0 2023-10-08T15:40:53.059 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.055+0000 7fb408c13700 1 -- 172.21.15.3:0/1068386030 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb4040c16d0 con 0x7fb4040a77f0 2023-10-08T15:40:53.061 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.055+0000 7fb3eb7fe700 1 -- 172.21.15.3:0/1068386030 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v39) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb3f4050140 con 0x7fb4040a77f0 2023-10-08T15:40:53.061 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 32 2023-10-08T15:40:53.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.059+0000 7fb408c13700 1 -- 172.21.15.3:0/1068386030 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb3f0060550 msgr2=0x7fb3f0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:53.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.059+0000 7fb408c13700 1 --2- 172.21.15.3:0/1068386030 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb3f0060550 0x7fb3f0062a00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8009db0 tx=0x7fb3f80091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:53.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.059+0000 7fb408c13700 1 -- 172.21.15.3:0/1068386030 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb4040a77f0 msgr2=0x7fb40415e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:53.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.059+0000 7fb408c13700 1 --2- 172.21.15.3:0/1068386030 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb4040a77f0 0x7fb40415e690 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fb3f400c810 tx=0x7fb3f4007df0 comp rx=0 tx=0).stop 2023-10-08T15:40:53.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.059+0000 7fb408c13700 1 -- 172.21.15.3:0/1068386030 shutdown_connections 2023-10-08T15:40:53.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.059+0000 7fb408c13700 1 --2- 172.21.15.3:0/1068386030 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb3f0060550 0x7fb3f0062a00 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:53.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.059+0000 7fb408c13700 1 --2- 172.21.15.3:0/1068386030 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb4040a7bc0 0x7fb404149d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:53.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.059+0000 7fb408c13700 1 --2- 172.21.15.3:0/1068386030 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb4040a77f0 0x7fb40415e690 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:53.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.059+0000 7fb408c13700 1 --2- 172.21.15.3:0/1068386030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb40406c5c0 0x7fb40415e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:53.065 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.059+0000 7fb408c13700 1 -- 172.21.15.3:0/1068386030 >> 172.21.15.3:0/1068386030 conn(0x7fb4040c29f0 msgr2=0x7fb40414b320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:53.065 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.059+0000 7fb408c13700 1 -- 172.21.15.3:0/1068386030 shutdown_connections 2023-10-08T15:40:53.065 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.059+0000 7fb408c13700 1 -- 172.21.15.3:0/1068386030 wait complete. 2023-10-08T15:40:53.075 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T15:40:53.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.179+0000 7f593918d700 1 Processor -- start 2023-10-08T15:40:53.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.179+0000 7f593918d700 1 -- start start 2023-10-08T15:40:53.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.179+0000 7f593918d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f59340bf1f0 0x7f59340bf5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:53.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.179+0000 7f593918d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f59340a2d50 0x7f593406f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:53.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.179+0000 7f593918d700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f593406f5c0 con 0x7f59340b1e70 2023-10-08T15:40:53.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.179+0000 7f593918d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59340b3b60 con 0x7f59340a2d50 2023-10-08T15:40:53.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.179+0000 7f593918d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59340b3860 con 0x7f59340bf1f0 2023-10-08T15:40:53.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.179+0000 7f593898c700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f59340b1e70 0x7f593414ea40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:60134/0 (socket says 172.21.15.3:60134) 2023-10-08T15:40:53.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.179+0000 7f593898c700 1 -- 172.21.15.3:0/476937641 learned_addr learned my addr 172.21.15.3:0/476937641 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:40:53.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.179+0000 7f59337fe700 1 --2- 172.21.15.3:0/476937641 >> v2:172.21.15.50:3300/0 conn(0x7f59340a2d50 0x7f593406f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:53.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.179+0000 7f5933fff700 1 --2- 172.21.15.3:0/476937641 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f59340bf1f0 0x7f59340bf5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:53.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.179+0000 7f5932ffd700 1 -- 172.21.15.3:0/476937641 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4021546334 0 0) 0x7f593406f5c0 con 0x7f59340b1e70 2023-10-08T15:40:53.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.179+0000 7f5932ffd700 1 -- 172.21.15.3:0/476937641 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f591c003570 con 0x7f59340b1e70 2023-10-08T15:40:53.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.179+0000 7f59337fe700 1 -- 172.21.15.3:0/476937641 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f59340bf1f0 msgr2=0x7f59340bf5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:53.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.179+0000 7f59337fe700 1 --2- 172.21.15.3:0/476937641 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f59340bf1f0 0x7f59340bf5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:53.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.179+0000 7f59337fe700 1 -- 172.21.15.3:0/476937641 >> v1:172.21.15.3:6789/0 conn(0x7f59340b1e70 legacy=0x7f593414ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:53.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.183+0000 7f59337fe700 1 -- 172.21.15.3:0/476937641 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f593406daf0 con 0x7f59340a2d50 2023-10-08T15:40:53.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.183+0000 7f59337fe700 1 --2- 172.21.15.3:0/476937641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59340a2d50 0x7f593406f080 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f59280098e0 tx=0x7f59280091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4300f60d5c311215 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:53.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.183+0000 7f5932ffd700 1 -- 172.21.15.3:0/476937641 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5928011630 con 0x7f59340a2d50 2023-10-08T15:40:53.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.183+0000 7f5932ffd700 1 -- 172.21.15.3:0/476937641 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5928011790 con 0x7f59340a2d50 2023-10-08T15:40:53.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.183+0000 7f5932ffd700 1 -- 172.21.15.3:0/476937641 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5928011b30 con 0x7f59340a2d50 2023-10-08T15:40:53.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.183+0000 7f593918d700 1 -- 172.21.15.3:0/476937641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59340a2d50 msgr2=0x7f593406f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:53.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.183+0000 7f593918d700 1 --2- 172.21.15.3:0/476937641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59340a2d50 0x7f593406f080 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f59280098e0 tx=0x7f59280091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:53.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.183+0000 7f593918d700 1 -- 172.21.15.3:0/476937641 shutdown_connections 2023-10-08T15:40:53.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.183+0000 7f593918d700 1 --2- 172.21.15.3:0/476937641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59340a2d50 0x7f593406f080 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:53.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.183+0000 7f593918d700 1 --2- 172.21.15.3:0/476937641 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f59340bf1f0 0x7f59340bf5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:53.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.183+0000 7f593918d700 1 -- 172.21.15.3:0/476937641 >> 172.21.15.3:0/476937641 conn(0x7f5934068c80 msgr2=0x7f59340beae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:53.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.183+0000 7f593918d700 1 -- 172.21.15.3:0/476937641 shutdown_connections 2023-10-08T15:40:53.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.183+0000 7f593918d700 1 -- 172.21.15.3:0/476937641 wait complete. 2023-10-08T15:40:53.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.183+0000 7f593918d700 1 Processor -- start 2023-10-08T15:40:53.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.183+0000 7f593918d700 1 -- start start 2023-10-08T15:40:53.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.187+0000 7f593918d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f59340a2d50 0x7f5934098960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:53.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.187+0000 7f593918d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59340b1e70 0x7f5934095d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:53.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.187+0000 7f593918d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f59340bf1f0 0x7f5934149410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:53.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.187+0000 7f593918d700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593415bd00 con 0x7f59340a2d50 2023-10-08T15:40:53.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.187+0000 7f593918d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593415b680 con 0x7f59340b1e70 2023-10-08T15:40:53.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.187+0000 7f593918d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f593415b920 con 0x7f59340bf1f0 2023-10-08T15:40:53.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.187+0000 7f5933fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f59340a2d50 0x7f5934098960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:53.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.187+0000 7f5933fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f59340a2d50 0x7f5934098960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34522/0 (socket says 172.21.15.3:34522) 2023-10-08T15:40:53.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.187+0000 7f5933fff700 1 -- 172.21.15.3:0/4197698346 learned_addr learned my addr 172.21.15.3:0/4197698346 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:53.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.187+0000 7f59337fe700 1 --2- 172.21.15.3:0/4197698346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59340b1e70 0x7f5934095d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:53.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.187+0000 7f593898c700 1 --2- 172.21.15.3:0/4197698346 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f59340bf1f0 0x7f5934149410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:53.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.187+0000 7f5933fff700 1 -- 172.21.15.3:0/4197698346 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f59340bf1f0 msgr2=0x7f5934149410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:53.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.187+0000 7f5933fff700 1 --2- 172.21.15.3:0/4197698346 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f59340bf1f0 0x7f5934149410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:53.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.187+0000 7f5933fff700 1 -- 172.21.15.3:0/4197698346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59340b1e70 msgr2=0x7f5934095d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:53.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.187+0000 7f5933fff700 1 --2- 172.21.15.3:0/4197698346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59340b1e70 0x7f5934095d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:53.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.187+0000 7f5933fff700 1 -- 172.21.15.3:0/4197698346 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5928009420 con 0x7f59340a2d50 2023-10-08T15:40:53.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.187+0000 7f5933fff700 1 --2- 172.21.15.3:0/4197698346 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f59340a2d50 0x7f5934098960 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f592400ec80 tx=0x7f59240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:53.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.187+0000 7f591bfff700 1 -- 172.21.15.3:0/4197698346 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592400c850 con 0x7f59340a2d50 2023-10-08T15:40:53.194 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.187+0000 7f593918d700 1 -- 172.21.15.3:0/4197698346 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5934098ea0 con 0x7f59340a2d50 2023-10-08T15:40:53.194 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.187+0000 7f591bfff700 1 -- 172.21.15.3:0/4197698346 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f592400c9b0 con 0x7f59340a2d50 2023-10-08T15:40:53.194 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.187+0000 7f591bfff700 1 -- 172.21.15.3:0/4197698346 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592400cd50 con 0x7f59340a2d50 2023-10-08T15:40:53.194 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.187+0000 7f593918d700 1 -- 172.21.15.3:0/4197698346 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59340963f0 con 0x7f59340a2d50 2023-10-08T15:40:53.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.187+0000 7f593918d700 1 -- 172.21.15.3:0/4197698346 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f593405ecf0 con 0x7f59340a2d50 2023-10-08T15:40:53.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.191+0000 7f591bfff700 1 -- 172.21.15.3:0/4197698346 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5924013680 con 0x7f59340a2d50 2023-10-08T15:40:53.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.191+0000 7f591bfff700 1 --2- 172.21.15.3:0/4197698346 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5920060550 0x7f5920062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:53.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.191+0000 7f591bfff700 1 -- 172.21.15.3:0/4197698346 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f592407ca70 con 0x7f59340a2d50 2023-10-08T15:40:53.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.191+0000 7f59337fe700 1 --2- 172.21.15.3:0/4197698346 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5920060550 0x7f5920062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:53.196 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.191+0000 7f59337fe700 1 --2- 172.21.15.3:0/4197698346 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5920060550 0x7f5920062a00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f59280091e0 tx=0x7f5928017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:53.201 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.199+0000 7f591bfff700 1 -- 172.21.15.3:0/4197698346 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f592404cfc0 con 0x7f59340a2d50 2023-10-08T15:40:53.363 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.359+0000 7f593918d700 1 -- 172.21.15.3:0/4197698346 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f59340b22c0 con 0x7f59340a2d50 2023-10-08T15:40:53.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.359+0000 7f591bfff700 1 -- 172.21.15.3:0/4197698346 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v39) v1 ==== 100+0+11 (secure 0 0 0) 0x7f59240505e0 con 0x7f59340a2d50 2023-10-08T15:40:53.364 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 64 2023-10-08T15:40:53.367 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.363+0000 7f593918d700 1 -- 172.21.15.3:0/4197698346 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5920060550 msgr2=0x7f5920062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:53.367 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.363+0000 7f593918d700 1 --2- 172.21.15.3:0/4197698346 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5920060550 0x7f5920062a00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f59280091e0 tx=0x7f5928017000 comp rx=0 tx=0).stop 2023-10-08T15:40:53.367 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.363+0000 7f593918d700 1 -- 172.21.15.3:0/4197698346 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f59340a2d50 msgr2=0x7f5934098960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:53.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.363+0000 7f593918d700 1 --2- 172.21.15.3:0/4197698346 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f59340a2d50 0x7f5934098960 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f592400ec80 tx=0x7f59240091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:53.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.363+0000 7f593918d700 1 -- 172.21.15.3:0/4197698346 shutdown_connections 2023-10-08T15:40:53.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.363+0000 7f593918d700 1 --2- 172.21.15.3:0/4197698346 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5920060550 0x7f5920062a00 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:53.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.363+0000 7f593918d700 1 --2- 172.21.15.3:0/4197698346 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f59340bf1f0 0x7f5934149410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:53.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.363+0000 7f593918d700 1 --2- 172.21.15.3:0/4197698346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59340b1e70 0x7f5934095d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:53.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.363+0000 7f593918d700 1 --2- 172.21.15.3:0/4197698346 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f59340a2d50 0x7f5934098960 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:53.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.363+0000 7f593918d700 1 -- 172.21.15.3:0/4197698346 >> 172.21.15.3:0/4197698346 conn(0x7f5934068c80 msgr2=0x7f593414e950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:53.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.363+0000 7f593918d700 1 -- 172.21.15.3:0/4197698346 shutdown_connections 2023-10-08T15:40:53.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.363+0000 7f593918d700 1 -- 172.21.15.3:0/4197698346 wait complete. 2023-10-08T15:40:53.379 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:40:53.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.483+0000 7f9159914700 1 Processor -- start 2023-10-08T15:40:53.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.483+0000 7f9159914700 1 -- start start 2023-10-08T15:40:53.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.483+0000 7f9159914700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f91540a1080 0x7f91540a2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:53.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.483+0000 7f9159914700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f91540c16c0 0x7f915414f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:53.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.483+0000 7f9159914700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f915406bc70 con 0x7f91540a2590 2023-10-08T15:40:53.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.483+0000 7f9159914700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f915406de10 con 0x7f91540a1080 2023-10-08T15:40:53.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.483+0000 7f9159914700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f915414c1d0 con 0x7f91540c16c0 2023-10-08T15:40:53.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.487+0000 7f9159113700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f91540c16c0 0x7f915414f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:53.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.487+0000 7f9158912700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f91540a1080 0x7f91540a2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:53.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.487+0000 7f9159113700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f91540c16c0 0x7f915414f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.3:33484/0 (socket says 172.21.15.3:33484) 2023-10-08T15:40:53.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.487+0000 7f9159113700 1 -- 172.21.15.3:0/2856231556 learned_addr learned my addr 172.21.15.3:0/2856231556 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:53.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.487+0000 7f9153fff700 1 --1- 172.21.15.3:0/2856231556 >> v1:172.21.15.50:6789/0 conn(0x7f91540a2590 0x7f915414eaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.3:40906/0 (socket says 172.21.15.3:40906) 2023-10-08T15:40:53.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.487+0000 7f9159113700 1 -- 172.21.15.3:0/2856231556 >> v2:172.21.15.50:3300/0 conn(0x7f91540a1080 msgr2=0x7f91540a2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:53.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.487+0000 7f9159113700 1 --2- 172.21.15.3:0/2856231556 >> v2:172.21.15.50:3300/0 conn(0x7f91540a1080 0x7f91540a2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:53.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.487+0000 7f9159113700 1 -- 172.21.15.3:0/2856231556 >> v1:172.21.15.50:6789/0 conn(0x7f91540a2590 legacy=0x7f915414eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:53.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.487+0000 7f9159113700 1 -- 172.21.15.3:0/2856231556 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91540be230 con 0x7f91540c16c0 2023-10-08T15:40:53.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.487+0000 7f9159113700 1 --2- 172.21.15.3:0/2856231556 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f91540c16c0 0x7f915414f1b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f91440099b0 tx=0x7f9144009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6a8b38fc0a9b23e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:53.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.487+0000 7f91537fe700 1 -- 172.21.15.3:0/2856231556 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9144009ea0 con 0x7f91540c16c0 2023-10-08T15:40:53.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.487+0000 7f91537fe700 1 -- 172.21.15.3:0/2856231556 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f914400b860 con 0x7f91540c16c0 2023-10-08T15:40:53.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.487+0000 7f91537fe700 1 -- 172.21.15.3:0/2856231556 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f914400bc00 con 0x7f91540c16c0 2023-10-08T15:40:53.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.487+0000 7f9159914700 1 -- 172.21.15.3:0/2856231556 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f91540c16c0 msgr2=0x7f915414f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:53.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.487+0000 7f9159914700 1 --2- 172.21.15.3:0/2856231556 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f91540c16c0 0x7f915414f1b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f91440099b0 tx=0x7f9144009250 comp rx=0 tx=0).stop 2023-10-08T15:40:53.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.487+0000 7f9159914700 1 -- 172.21.15.3:0/2856231556 shutdown_connections 2023-10-08T15:40:53.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.487+0000 7f9159914700 1 --2- 172.21.15.3:0/2856231556 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f91540c16c0 0x7f915414f1b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:53.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.487+0000 7f9159914700 1 --2- 172.21.15.3:0/2856231556 >> v2:172.21.15.50:3300/0 conn(0x7f91540a1080 0x7f91540a2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:53.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.487+0000 7f9159914700 1 -- 172.21.15.3:0/2856231556 >> 172.21.15.3:0/2856231556 conn(0x7f91540c2840 msgr2=0x7f91540a1940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:53.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.487+0000 7f9159914700 1 -- 172.21.15.3:0/2856231556 shutdown_connections 2023-10-08T15:40:53.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.487+0000 7f9159914700 1 -- 172.21.15.3:0/2856231556 wait complete. 2023-10-08T15:40:53.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.487+0000 7f9159914700 1 Processor -- start 2023-10-08T15:40:53.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.487+0000 7f9159914700 1 -- start start 2023-10-08T15:40:53.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.491+0000 7f9159914700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91540a1080 0x7f9154149400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:53.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.491+0000 7f9159914700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f91540a2590 0x7f91540a5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:53.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.491+0000 7f9159914700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f91540c16c0 0x7f91540a62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:53.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.491+0000 7f9159914700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91540a58f0 con 0x7f91540c16c0 2023-10-08T15:40:53.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.491+0000 7f9159914700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91540a5580 con 0x7f91540a1080 2023-10-08T15:40:53.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.491+0000 7f9159914700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9154149940 con 0x7f91540a2590 2023-10-08T15:40:53.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.491+0000 7f9159113700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f91540c16c0 0x7f91540a62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:53.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.491+0000 7f9158912700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91540a1080 0x7f9154149400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:53.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.491+0000 7f9153fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f91540a2590 0x7f91540a5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:53.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.491+0000 7f9159113700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f91540c16c0 0x7f91540a62c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34536/0 (socket says 172.21.15.3:34536) 2023-10-08T15:40:53.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.491+0000 7f9158912700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91540a1080 0x7f9154149400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.3:50024/0 (socket says 172.21.15.3:50024) 2023-10-08T15:40:53.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.491+0000 7f9159113700 1 -- 172.21.15.3:0/1864413364 learned_addr learned my addr 172.21.15.3:0/1864413364 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:53.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.491+0000 7f9159113700 1 -- 172.21.15.3:0/1864413364 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f91540a2590 msgr2=0x7f91540a5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:53.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.491+0000 7f9159113700 1 --2- 172.21.15.3:0/1864413364 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f91540a2590 0x7f91540a5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:53.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.491+0000 7f9159113700 1 -- 172.21.15.3:0/1864413364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91540a1080 msgr2=0x7f9154149400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:53.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.491+0000 7f9159113700 1 --2- 172.21.15.3:0/1864413364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91540a1080 0x7f9154149400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:53.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.491+0000 7f9159113700 1 -- 172.21.15.3:0/1864413364 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91440094f0 con 0x7f91540c16c0 2023-10-08T15:40:53.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.491+0000 7f9159113700 1 --2- 172.21.15.3:0/1864413364 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f91540c16c0 0x7f91540a62c0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f915414c310 tx=0x7f9144017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:53.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.491+0000 7f9150ff9700 1 -- 172.21.15.3:0/1864413364 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f914400baa0 con 0x7f91540c16c0 2023-10-08T15:40:53.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.491+0000 7f9150ff9700 1 -- 172.21.15.3:0/1864413364 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9144025420 con 0x7f91540c16c0 2023-10-08T15:40:53.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.491+0000 7f9159914700 1 -- 172.21.15.3:0/1864413364 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91540a32c0 con 0x7f91540c16c0 2023-10-08T15:40:53.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.491+0000 7f9150ff9700 1 -- 172.21.15.3:0/1864413364 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f914400bc00 con 0x7f91540c16c0 2023-10-08T15:40:53.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.491+0000 7f9159914700 1 -- 172.21.15.3:0/1864413364 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91540a6800 con 0x7f91540c16c0 2023-10-08T15:40:53.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.495+0000 7f9159914700 1 -- 172.21.15.3:0/1864413364 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91540a3600 con 0x7f91540c16c0 2023-10-08T15:40:53.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.495+0000 7f9150ff9700 1 -- 172.21.15.3:0/1864413364 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f9144023070 con 0x7f91540c16c0 2023-10-08T15:40:53.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.495+0000 7f9150ff9700 1 --2- 172.21.15.3:0/1864413364 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f9138060550 0x7f9138062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:53.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.495+0000 7f9150ff9700 1 -- 172.21.15.3:0/1864413364 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f914407dd50 con 0x7f91540c16c0 2023-10-08T15:40:53.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.495+0000 7f9158912700 1 --2- 172.21.15.3:0/1864413364 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f9138060550 0x7f9138062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:53.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.495+0000 7f9158912700 1 --2- 172.21.15.3:0/1864413364 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f9138060550 0x7f9138062a00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f914c00f570 tx=0x7f914c00b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:53.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.503+0000 7f9150ff9700 1 -- 172.21.15.3:0/1864413364 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f91540a3600 con 0x7f91540c16c0 2023-10-08T15:40:53.701 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.699+0000 7f9159914700 1 -- 172.21.15.3:0/1864413364 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f91540a53e0 con 0x7f91540c16c0 2023-10-08T15:40:53.702 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.699+0000 7f9150ff9700 1 -- 172.21.15.3:0/1864413364 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+3080 (secure 0 0 0) 0x7f9144015c20 con 0x7f91540c16c0 2023-10-08T15:40:53.703 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:40:53.703 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5006,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3286528236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3286528236},{"type":"v1","addr":"172.21.15.50:6835","nonce":3286528236}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:40:13.764784+0000","modified":"2023-10-08T15:40:16.434138+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5337},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5337":{"gid":5337,"name":"a","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.3:6833/3441752211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":3441752211},{"type":"v1","addr":"172.21.15.3:6833","nonce":3441752211}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-08T15:40:53.705 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.699+0000 7f9159914700 1 -- 172.21.15.3:0/1864413364 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f9138060550 msgr2=0x7f9138062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:53.705 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.699+0000 7f9159914700 1 --2- 172.21.15.3:0/1864413364 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f9138060550 0x7f9138062a00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f914c00f570 tx=0x7f914c00b040 comp rx=0 tx=0).stop 2023-10-08T15:40:53.705 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.699+0000 7f9159914700 1 -- 172.21.15.3:0/1864413364 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f91540c16c0 msgr2=0x7f91540a62c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:53.705 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.699+0000 7f9159914700 1 --2- 172.21.15.3:0/1864413364 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f91540c16c0 0x7f91540a62c0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f915414c310 tx=0x7f9144017000 comp rx=0 tx=0).stop 2023-10-08T15:40:53.706 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.699+0000 7f9159914700 1 -- 172.21.15.3:0/1864413364 shutdown_connections 2023-10-08T15:40:53.706 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.699+0000 7f9159914700 1 --2- 172.21.15.3:0/1864413364 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f9138060550 0x7f9138062a00 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:53.706 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.699+0000 7f9159914700 1 --2- 172.21.15.3:0/1864413364 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f91540c16c0 0x7f91540a62c0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:53.706 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.699+0000 7f9159914700 1 --2- 172.21.15.3:0/1864413364 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f91540a2590 0x7f91540a5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:53.706 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.699+0000 7f9159914700 1 --2- 172.21.15.3:0/1864413364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91540a1080 0x7f9154149400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:53.706 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.699+0000 7f9159914700 1 -- 172.21.15.3:0/1864413364 >> 172.21.15.3:0/1864413364 conn(0x7f91540c2840 msgr2=0x7f9154068970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:53.706 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.699+0000 7f9159914700 1 -- 172.21.15.3:0/1864413364 shutdown_connections 2023-10-08T15:40:53.706 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.699+0000 7f9159914700 1 -- 172.21.15.3:0/1864413364 wait complete. 2023-10-08T15:40:53.707 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 19 2023-10-08T15:40:53.717 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:40:53.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.819+0000 7ff420bbb700 1 Processor -- start 2023-10-08T15:40:53.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.819+0000 7ff420bbb700 1 -- start start 2023-10-08T15:40:53.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.819+0000 7ff420bbb700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7ff41c06d080 0x7ff41c068ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:53.824 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.819+0000 7ff420bbb700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff41c09e490 con 0x7ff41c153ad0 2023-10-08T15:40:53.824 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.819+0000 7ff420bbb700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff41c06ce30 con 0x7ff41c0bafe0 2023-10-08T15:40:53.824 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.819+0000 7ff420bbb700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff41c09e6e0 con 0x7ff41c06d080 2023-10-08T15:40:53.824 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.819+0000 7ff419d9b700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7ff41c06d080 0x7ff41c068ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:53.824 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.819+0000 7ff41ad9d700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7ff41c153ad0 0x7ff41c14ef20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:60138/0 (socket says 172.21.15.3:60138) 2023-10-08T15:40:53.824 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.819+0000 7ff41ad9d700 1 -- 172.21.15.3:0/3149146542 learned_addr learned my addr 172.21.15.3:0/3149146542 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:40:53.824 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.819+0000 7ff419d9b700 1 -- 172.21.15.3:0/3149146542 >> v1:172.21.15.50:6789/0 conn(0x7ff41c0bafe0 legacy=0x7ff41c1533c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:53.824 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.819+0000 7ff419d9b700 1 -- 172.21.15.3:0/3149146542 >> v1:172.21.15.3:6789/0 conn(0x7ff41c153ad0 legacy=0x7ff41c14ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:53.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.819+0000 7ff419d9b700 1 -- 172.21.15.3:0/3149146542 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff41c153f50 con 0x7ff41c06d080 2023-10-08T15:40:53.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.819+0000 7ff419d9b700 1 --2- 172.21.15.3:0/3149146542 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff41c06d080 0x7ff41c068ab0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7ff414009e60 tx=0x7ff414009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f11e264c2059221 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:53.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.819+0000 7ff41959a700 1 -- 172.21.15.3:0/3149146542 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41400e070 con 0x7ff41c06d080 2023-10-08T15:40:53.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.819+0000 7ff41959a700 1 -- 172.21.15.3:0/3149146542 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff41400bc30 con 0x7ff41c06d080 2023-10-08T15:40:53.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.819+0000 7ff41959a700 1 -- 172.21.15.3:0/3149146542 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff414012430 con 0x7ff41c06d080 2023-10-08T15:40:53.826 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.819+0000 7ff420bbb700 1 -- 172.21.15.3:0/3149146542 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff41c06d080 msgr2=0x7ff41c068ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:53.826 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.819+0000 7ff420bbb700 1 --2- 172.21.15.3:0/3149146542 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff41c06d080 0x7ff41c068ab0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7ff414009e60 tx=0x7ff414009780 comp rx=0 tx=0).stop 2023-10-08T15:40:53.826 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.819+0000 7ff420bbb700 1 -- 172.21.15.3:0/3149146542 shutdown_connections 2023-10-08T15:40:53.826 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.819+0000 7ff420bbb700 1 --2- 172.21.15.3:0/3149146542 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff41c06d080 0x7ff41c068ab0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:53.826 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.819+0000 7ff420bbb700 1 -- 172.21.15.3:0/3149146542 >> 172.21.15.3:0/3149146542 conn(0x7ff41c0be640 msgr2=0x7ff41c0ba6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:53.826 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.819+0000 7ff420bbb700 1 -- 172.21.15.3:0/3149146542 shutdown_connections 2023-10-08T15:40:53.826 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.819+0000 7ff420bbb700 1 -- 172.21.15.3:0/3149146542 wait complete. 2023-10-08T15:40:53.827 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.823+0000 7ff420bbb700 1 Processor -- start 2023-10-08T15:40:53.827 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.823+0000 7ff420bbb700 1 -- start start 2023-10-08T15:40:53.828 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.823+0000 7ff420bbb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff41c06d080 0x7ff41c15f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:53.828 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.823+0000 7ff420bbb700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff41c0bafe0 0x7ff41c148dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:53.828 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.823+0000 7ff420bbb700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff41c153ad0 0x7ff41c0bccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:53.828 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.823+0000 7ff420bbb700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c0a2460 con 0x7ff41c153ad0 2023-10-08T15:40:53.829 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.823+0000 7ff420bbb700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c148940 con 0x7ff41c06d080 2023-10-08T15:40:53.829 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.823+0000 7ff420bbb700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c149310 con 0x7ff41c0bafe0 2023-10-08T15:40:53.829 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.823+0000 7ff41ad9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff41c153ad0 0x7ff41c0bccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:53.829 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.823+0000 7ff419d9b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff41c0bafe0 0x7ff41c148dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:53.829 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.823+0000 7ff41a59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff41c06d080 0x7ff41c15f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:53.829 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.823+0000 7ff41ad9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff41c153ad0 0x7ff41c0bccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34546/0 (socket says 172.21.15.3:34546) 2023-10-08T15:40:53.829 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.823+0000 7ff41ad9d700 1 -- 172.21.15.3:0/516402766 learned_addr learned my addr 172.21.15.3:0/516402766 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:53.830 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.823+0000 7ff41ad9d700 1 -- 172.21.15.3:0/516402766 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff41c0bafe0 msgr2=0x7ff41c148dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:53.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.823+0000 7ff41ad9d700 1 --2- 172.21.15.3:0/516402766 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff41c0bafe0 0x7ff41c148dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:53.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.823+0000 7ff41ad9d700 1 -- 172.21.15.3:0/516402766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff41c06d080 msgr2=0x7ff41c15f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:53.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.823+0000 7ff41ad9d700 1 --2- 172.21.15.3:0/516402766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff41c06d080 0x7ff41c15f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:53.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.823+0000 7ff41ad9d700 1 -- 172.21.15.3:0/516402766 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff414009a20 con 0x7ff41c153ad0 2023-10-08T15:40:53.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.827+0000 7ff41ad9d700 1 --2- 172.21.15.3:0/516402766 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff41c153ad0 0x7ff41c0bccb0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff40c00c7c0 tx=0x7ff40c007eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:53.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.827+0000 7ff4127fc700 1 -- 172.21.15.3:0/516402766 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40c005b30 con 0x7ff41c153ad0 2023-10-08T15:40:53.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.827+0000 7ff4127fc700 1 -- 172.21.15.3:0/516402766 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff40c005cb0 con 0x7ff41c153ad0 2023-10-08T15:40:53.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.827+0000 7ff420bbb700 1 -- 172.21.15.3:0/516402766 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff41c0bd1f0 con 0x7ff41c153ad0 2023-10-08T15:40:53.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.827+0000 7ff4127fc700 1 -- 172.21.15.3:0/516402766 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40c007320 con 0x7ff41c153ad0 2023-10-08T15:40:53.832 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.827+0000 7ff420bbb700 1 -- 172.21.15.3:0/516402766 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff41c160810 con 0x7ff41c153ad0 2023-10-08T15:40:53.833 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.827+0000 7ff4127fc700 1 -- 172.21.15.3:0/516402766 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff40c007690 con 0x7ff41c153ad0 2023-10-08T15:40:53.833 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.827+0000 7ff420bbb700 1 -- 172.21.15.3:0/516402766 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff41c148af0 con 0x7ff41c153ad0 2023-10-08T15:40:53.833 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.831+0000 7ff4127fc700 1 --2- 172.21.15.3:0/516402766 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff3fc060580 0x7ff3fc062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:53.834 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.831+0000 7ff4127fc700 1 -- 172.21.15.3:0/516402766 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff40c07bc60 con 0x7ff41c153ad0 2023-10-08T15:40:53.834 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.831+0000 7ff41a59c700 1 --2- 172.21.15.3:0/516402766 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff3fc060580 0x7ff3fc062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:53.834 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.831+0000 7ff41a59c700 1 --2- 172.21.15.3:0/516402766 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff3fc060580 0x7ff3fc062a30 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff4040039d0 tx=0x7ff404007f10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:53.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:53.839+0000 7ff4127fc700 1 -- 172.21.15.3:0/516402766 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff41c148af0 con 0x7ff41c153ad0 2023-10-08T15:40:54.006 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.003+0000 7ff420bbb700 1 -- 172.21.15.3:0/516402766 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff41c148af0 con 0x7ff41c153ad0 2023-10-08T15:40:54.007 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.003+0000 7ff4127fc700 1 -- 172.21.15.3:0/516402766 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+15254 (secure 0 0 0) 0x7ff41c148af0 con 0x7ff41c153ad0 2023-10-08T15:40:54.007 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:40:54.007 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":39,"fsid":"7635972e-cd66-4a8f-a231-378db8b3847a","created":"2023-10-08T15:37:08.234594+0000","modified":"2023-10-08T15:40:15.399080+0000","last_up_change":"2023-10-08T15:37:17.537726+0000","last_in_change":"2023-10-08T15:37:10.269178+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:37:16.581590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:40:12.013806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-08T15:40:12.747398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"64fb1864-bfdd-4d75-9b41-03fb60085dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33363},{"type":"v1","addr":"172.21.15.3:6801","nonce":33363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33363},{"type":"v1","addr":"172.21.15.3:6803","nonce":33363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":33363},{"type":"v1","addr":"172.21.15.3:6807","nonce":33363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33363},{"type":"v1","addr":"172.21.15.3:6805","nonce":33363}]},"public_addr":"172.21.15.3:6801/33363","cluster_addr":"172.21.15.3:6803/33363","heartbeat_back_addr":"172.21.15.3:6807/33363","heartbeat_front_addr":"172.21.15.3:6805/33363","state":["exists","up"]},{"osd":1,"uuid":"3ca6bd3a-3e8a-4c65-af9c-46148b0c2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33364},{"type":"v1","addr":"172.21.15.3:6820","nonce":33364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33364},{"type":"v1","addr":"172.21.15.3:6824","nonce":33364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33364},{"type":"v1","addr":"172.21.15.3:6831","nonce":33364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33364},{"type":"v1","addr":"172.21.15.3:6828","nonce":33364}]},"public_addr":"172.21.15.3:6820/33364","cluster_addr":"172.21.15.3:6824/33364","heartbeat_back_addr":"172.21.15.3:6831/33364","heartbeat_front_addr":"172.21.15.3:6828/33364","state":["exists","up"]},{"osd":2,"uuid":"6eb9f757-58dd-442f-910d-32401454bce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33366},{"type":"v1","addr":"172.21.15.3:6817","nonce":33366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":33366},{"type":"v1","addr":"172.21.15.3:6821","nonce":33366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6827","nonce":33366},{"type":"v1","addr":"172.21.15.3:6829","nonce":33366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":33366},{"type":"v1","addr":"172.21.15.3:6825","nonce":33366}]},"public_addr":"172.21.15.3:6817/33366","cluster_addr":"172.21.15.3:6821/33366","heartbeat_back_addr":"172.21.15.3:6829/33366","heartbeat_front_addr":"172.21.15.3:6825/33366","state":["exists","up"]},{"osd":3,"uuid":"1c39866b-ac2e-4ea9-a69c-02b01ee4191d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33365},{"type":"v1","addr":"172.21.15.3:6809","nonce":33365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":33365},{"type":"v1","addr":"172.21.15.3:6811","nonce":33365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33365},{"type":"v1","addr":"172.21.15.3:6815","nonce":33365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":33365},{"type":"v1","addr":"172.21.15.3:6813","nonce":33365}]},"public_addr":"172.21.15.3:6809/33365","cluster_addr":"172.21.15.3:6811/33365","heartbeat_back_addr":"172.21.15.3:6815/33365","heartbeat_front_addr":"172.21.15.3:6813/33365","state":["exists","up"]},{"osd":4,"uuid":"15f86b61-b7f1-4780-ae00-9d80a68cb830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":33605},{"type":"v1","addr":"172.21.15.50:6809","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33605},{"type":"v1","addr":"172.21.15.50:6811","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33605},{"type":"v1","addr":"172.21.15.50:6815","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":33605},{"type":"v1","addr":"172.21.15.50:6813","nonce":33605}]},"public_addr":"172.21.15.50:6809/33605","cluster_addr":"172.21.15.50:6811/33605","heartbeat_back_addr":"172.21.15.50:6815/33605","heartbeat_front_addr":"172.21.15.50:6813/33605","state":["exists","up"]},{"osd":5,"uuid":"726c3003-34e6-4d5a-b6e2-f911e13c2118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33606},{"type":"v1","addr":"172.21.15.50:6801","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33606},{"type":"v1","addr":"172.21.15.50:6803","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33606},{"type":"v1","addr":"172.21.15.50:6807","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":33606},{"type":"v1","addr":"172.21.15.50:6805","nonce":33606}]},"public_addr":"172.21.15.50:6801/33606","cluster_addr":"172.21.15.50:6803/33606","heartbeat_back_addr":"172.21.15.50:6807/33606","heartbeat_front_addr":"172.21.15.50:6805/33606","state":["exists","up"]},{"osd":6,"uuid":"401122a4-9988-441f-a5a7-39164434ebcd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":33607},{"type":"v1","addr":"172.21.15.50:6819","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":33607},{"type":"v1","addr":"172.21.15.50:6823","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":33607},{"type":"v1","addr":"172.21.15.50:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":33607},{"type":"v1","addr":"172.21.15.50:6827","nonce":33607}]},"public_addr":"172.21.15.50:6819/33607","cluster_addr":"172.21.15.50:6823/33607","heartbeat_back_addr":"172.21.15.50:6831/33607","heartbeat_front_addr":"172.21.15.50:6827/33607","state":["exists","up"]},{"osd":7,"uuid":"6b3fa236-c9d0-4c4d-82ae-9af4daf6d699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33604},{"type":"v1","addr":"172.21.15.50:6818","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":33604},{"type":"v1","addr":"172.21.15.50:6822","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":33604},{"type":"v1","addr":"172.21.15.50:6830","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":33604},{"type":"v1","addr":"172.21.15.50:6826","nonce":33604}]},"public_addr":"172.21.15.50:6818/33604","cluster_addr":"172.21.15.50:6822/33604","heartbeat_back_addr":"172.21.15.50:6830/33604","heartbeat_front_addr":"172.21.15.50:6826/33604","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.497794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.529417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.873426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.325972+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.443971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.240795+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.739632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.643026+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:40:54.010 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.007+0000 7ff420bbb700 1 -- 172.21.15.3:0/516402766 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff3fc060580 msgr2=0x7ff3fc062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:54.010 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.007+0000 7ff420bbb700 1 --2- 172.21.15.3:0/516402766 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff3fc060580 0x7ff3fc062a30 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff4040039d0 tx=0x7ff404007f10 comp rx=0 tx=0).stop 2023-10-08T15:40:54.010 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.007+0000 7ff420bbb700 1 -- 172.21.15.3:0/516402766 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff41c153ad0 msgr2=0x7ff41c0bccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:54.010 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.007+0000 7ff420bbb700 1 --2- 172.21.15.3:0/516402766 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff41c153ad0 0x7ff41c0bccb0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff40c00c7c0 tx=0x7ff40c007eb0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.010 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.007+0000 7ff420bbb700 1 -- 172.21.15.3:0/516402766 shutdown_connections 2023-10-08T15:40:54.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.007+0000 7ff420bbb700 1 --2- 172.21.15.3:0/516402766 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff3fc060580 0x7ff3fc062a30 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.007+0000 7ff420bbb700 1 --2- 172.21.15.3:0/516402766 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff41c153ad0 0x7ff41c0bccb0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.007+0000 7ff420bbb700 1 --2- 172.21.15.3:0/516402766 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff41c0bafe0 0x7ff41c148dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.007+0000 7ff420bbb700 1 --2- 172.21.15.3:0/516402766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff41c06d080 0x7ff41c15f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.007+0000 7ff420bbb700 1 -- 172.21.15.3:0/516402766 >> 172.21.15.3:0/516402766 conn(0x7ff41c0be640 msgr2=0x7ff41c0688d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:54.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.007+0000 7ff420bbb700 1 -- 172.21.15.3:0/516402766 shutdown_connections 2023-10-08T15:40:54.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.007+0000 7ff420bbb700 1 -- 172.21.15.3:0/516402766 wait complete. 2023-10-08T15:40:54.022 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T15:40:54.023 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:40:54.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.127+0000 7f01d8b62700 1 Processor -- start 2023-10-08T15:40:54.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.127+0000 7f01d8b62700 1 -- start start 2023-10-08T15:40:54.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.127+0000 7f01d8b62700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f01d414a080 0x7f01d40baf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:54.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.127+0000 7f01d8b62700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f01d406df30 0x7f01d414c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:54.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.127+0000 7f01d8b62700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01d40b4050 con 0x7f01d40bab50 2023-10-08T15:40:54.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.127+0000 7f01d8b62700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01d4146da0 con 0x7f01d406df30 2023-10-08T15:40:54.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.127+0000 7f01d8b62700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01d40b4710 con 0x7f01d414a080 2023-10-08T15:40:54.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.127+0000 7f01d37fe700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f01d40bab50 0x7f01d4149970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:60146/0 (socket says 172.21.15.3:60146) 2023-10-08T15:40:54.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.127+0000 7f01d37fe700 1 -- 172.21.15.3:0/4277252184 learned_addr learned my addr 172.21.15.3:0/4277252184 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:40:54.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.127+0000 7f01d3fff700 1 --2- 172.21.15.3:0/4277252184 >> v2:172.21.15.3:3300/0 conn(0x7f01d406df30 0x7f01d414c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:54.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.127+0000 7f01cbfff700 1 --2- 172.21.15.3:0/4277252184 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f01d414a080 0x7f01d40baf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:54.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.131+0000 7f01d2ffd700 1 -- 172.21.15.3:0/4277252184 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2724747379 0 0) 0x7f01d40b4050 con 0x7f01d40bab50 2023-10-08T15:40:54.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.131+0000 7f01d2ffd700 1 -- 172.21.15.3:0/4277252184 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01c0003570 con 0x7f01d40bab50 2023-10-08T15:40:54.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.131+0000 7f01d3fff700 1 -- 172.21.15.3:0/4277252184 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f01d414a080 msgr2=0x7f01d40baf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:54.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.131+0000 7f01d3fff700 1 --2- 172.21.15.3:0/4277252184 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f01d414a080 0x7f01d40baf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.131+0000 7f01d3fff700 1 -- 172.21.15.3:0/4277252184 >> v1:172.21.15.3:6789/0 conn(0x7f01d40bab50 legacy=0x7f01d4149970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:54.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.131+0000 7f01d3fff700 1 -- 172.21.15.3:0/4277252184 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d40b4330 con 0x7f01d406df30 2023-10-08T15:40:54.135 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.131+0000 7f01cbfff700 1 --2- 172.21.15.3:0/4277252184 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f01d414a080 0x7f01d40baf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:40:54.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.131+0000 7f01d3fff700 1 --2- 172.21.15.3:0/4277252184 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f01d406df30 0x7f01d414c9c0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f01cc009e60 tx=0x7f01cc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21e48a42bed0a4c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:54.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.131+0000 7f01d2ffd700 1 -- 172.21.15.3:0/4277252184 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01cc00e070 con 0x7f01d406df30 2023-10-08T15:40:54.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.131+0000 7f01d2ffd700 1 -- 172.21.15.3:0/4277252184 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01cc00bab0 con 0x7f01d406df30 2023-10-08T15:40:54.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.131+0000 7f01d2ffd700 1 -- 172.21.15.3:0/4277252184 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01cc00be30 con 0x7f01d406df30 2023-10-08T15:40:54.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.131+0000 7f01d8b62700 1 -- 172.21.15.3:0/4277252184 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f01d406df30 msgr2=0x7f01d414c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:54.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.131+0000 7f01d8b62700 1 --2- 172.21.15.3:0/4277252184 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f01d406df30 0x7f01d414c9c0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f01cc009e60 tx=0x7f01cc009780 comp rx=0 tx=0).stop 2023-10-08T15:40:54.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.131+0000 7f01d8b62700 1 -- 172.21.15.3:0/4277252184 shutdown_connections 2023-10-08T15:40:54.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.131+0000 7f01d8b62700 1 --2- 172.21.15.3:0/4277252184 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f01d406df30 0x7f01d414c9c0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.131+0000 7f01d8b62700 1 --2- 172.21.15.3:0/4277252184 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f01d414a080 0x7f01d40baf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.131+0000 7f01d8b62700 1 -- 172.21.15.3:0/4277252184 >> 172.21.15.3:0/4277252184 conn(0x7f01d40be4a0 msgr2=0x7f01d40ba440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:54.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.131+0000 7f01d8b62700 1 -- 172.21.15.3:0/4277252184 shutdown_connections 2023-10-08T15:40:54.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.131+0000 7f01d8b62700 1 -- 172.21.15.3:0/4277252184 wait complete. 2023-10-08T15:40:54.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.135+0000 7f01d8b62700 1 Processor -- start 2023-10-08T15:40:54.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.135+0000 7f01d8b62700 1 -- start start 2023-10-08T15:40:54.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.135+0000 7f01d8b62700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01d406df30 0x7f01d4145820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:54.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.135+0000 7f01d8b62700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f01d40bab50 0x7f01d414b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:54.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.135+0000 7f01d8b62700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f01d414a080 0x7f01d4147eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:54.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.135+0000 7f01d8b62700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d40b3950 con 0x7f01d40bab50 2023-10-08T15:40:54.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.135+0000 7f01d8b62700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d415eb60 con 0x7f01d406df30 2023-10-08T15:40:54.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.135+0000 7f01d8b62700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01d40a2f60 con 0x7f01d414a080 2023-10-08T15:40:54.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.135+0000 7f01cbfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f01d40bab50 0x7f01d414b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:54.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.135+0000 7f01cbfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f01d40bab50 0x7f01d414b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34568/0 (socket says 172.21.15.3:34568) 2023-10-08T15:40:54.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.135+0000 7f01cbfff700 1 -- 172.21.15.3:0/1193758187 learned_addr learned my addr 172.21.15.3:0/1193758187 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:54.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.135+0000 7f01d37fe700 1 --2- 172.21.15.3:0/1193758187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01d406df30 0x7f01d4145820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:54.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.135+0000 7f01d3fff700 1 --2- 172.21.15.3:0/1193758187 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f01d414a080 0x7f01d4147eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:54.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.135+0000 7f01cbfff700 1 -- 172.21.15.3:0/1193758187 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f01d414a080 msgr2=0x7f01d4147eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:54.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.135+0000 7f01cbfff700 1 --2- 172.21.15.3:0/1193758187 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f01d414a080 0x7f01d4147eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.135+0000 7f01cbfff700 1 -- 172.21.15.3:0/1193758187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01d406df30 msgr2=0x7f01d4145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:54.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.135+0000 7f01cbfff700 1 --2- 172.21.15.3:0/1193758187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01d406df30 0x7f01d4145820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.135+0000 7f01cbfff700 1 -- 172.21.15.3:0/1193758187 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01bc009420 con 0x7f01d40bab50 2023-10-08T15:40:54.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.135+0000 7f01cbfff700 1 --2- 172.21.15.3:0/1193758187 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f01d40bab50 0x7f01d414b7e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f01bc00ec80 tx=0x7f01bc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:54.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.135+0000 7f01cb7fe700 1 -- 172.21.15.3:0/1193758187 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01bc00c8f0 con 0x7f01d40bab50 2023-10-08T15:40:54.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.135+0000 7f01cb7fe700 1 -- 172.21.15.3:0/1193758187 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01bc00ca50 con 0x7f01d40bab50 2023-10-08T15:40:54.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.135+0000 7f01d8b62700 1 -- 172.21.15.3:0/1193758187 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01cc009a20 con 0x7f01d40bab50 2023-10-08T15:40:54.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.135+0000 7f01cb7fe700 1 -- 172.21.15.3:0/1193758187 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01bc00cdd0 con 0x7f01d40bab50 2023-10-08T15:40:54.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.135+0000 7f01d8b62700 1 -- 172.21.15.3:0/1193758187 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01d4145d60 con 0x7f01d40bab50 2023-10-08T15:40:54.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.139+0000 7f01d8b62700 1 -- 172.21.15.3:0/1193758187 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01d40b3720 con 0x7f01d40bab50 2023-10-08T15:40:54.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.139+0000 7f01cb7fe700 1 -- 172.21.15.3:0/1193758187 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f01bc013680 con 0x7f01d40bab50 2023-10-08T15:40:54.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.139+0000 7f01cb7fe700 1 --2- 172.21.15.3:0/1193758187 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f01b4060550 0x7f01b4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:54.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.139+0000 7f01cb7fe700 1 -- 172.21.15.3:0/1193758187 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f01bc07cbd0 con 0x7f01d40bab50 2023-10-08T15:40:54.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.139+0000 7f01d37fe700 1 --2- 172.21.15.3:0/1193758187 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f01b4060550 0x7f01b4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:54.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.139+0000 7f01d37fe700 1 --2- 172.21.15.3:0/1193758187 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f01b4060550 0x7f01b4062a00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f01c4007fd0 tx=0x7f01c4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:54.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.147+0000 7f01cb7fe700 1 -- 172.21.15.3:0/1193758187 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f01bc04d120 con 0x7f01d40bab50 2023-10-08T15:40:54.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.343+0000 7f01d8b62700 1 -- 172.21.15.3:0/1193758187 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f01d405ecf0 con 0x7f01d40bab50 2023-10-08T15:40:54.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.347+0000 7f01cb7fe700 1 -- 172.21.15.3:0/1193758187 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+3080 (secure 0 0 0) 0x7f01bc017c20 con 0x7f01d40bab50 2023-10-08T15:40:54.350 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:40:54.350 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5006,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3286528236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3286528236},{"type":"v1","addr":"172.21.15.50:6835","nonce":3286528236}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:40:13.764784+0000","modified":"2023-10-08T15:40:16.434138+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5337},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5337":{"gid":5337,"name":"a","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.3:6833/3441752211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":3441752211},{"type":"v1","addr":"172.21.15.3:6833","nonce":3441752211}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-08T15:40:54.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.347+0000 7f01d8b62700 1 -- 172.21.15.3:0/1193758187 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f01b4060550 msgr2=0x7f01b4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:54.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.347+0000 7f01d8b62700 1 --2- 172.21.15.3:0/1193758187 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f01b4060550 0x7f01b4062a00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f01c4007fd0 tx=0x7f01c4009040 comp rx=0 tx=0).stop 2023-10-08T15:40:54.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.347+0000 7f01d8b62700 1 -- 172.21.15.3:0/1193758187 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f01d40bab50 msgr2=0x7f01d414b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:54.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.347+0000 7f01d8b62700 1 --2- 172.21.15.3:0/1193758187 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f01d40bab50 0x7f01d414b7e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f01bc00ec80 tx=0x7f01bc0091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.347+0000 7f01d8b62700 1 -- 172.21.15.3:0/1193758187 shutdown_connections 2023-10-08T15:40:54.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.347+0000 7f01d8b62700 1 --2- 172.21.15.3:0/1193758187 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f01b4060550 0x7f01b4062a00 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.347+0000 7f01d8b62700 1 --2- 172.21.15.3:0/1193758187 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f01d414a080 0x7f01d4147eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.347+0000 7f01d8b62700 1 --2- 172.21.15.3:0/1193758187 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f01d40bab50 0x7f01d414b7e0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.347+0000 7f01d8b62700 1 --2- 172.21.15.3:0/1193758187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01d406df30 0x7f01d4145820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.347+0000 7f01d8b62700 1 -- 172.21.15.3:0/1193758187 >> 172.21.15.3:0/1193758187 conn(0x7f01d40be4a0 msgr2=0x7f01d414fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:54.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.347+0000 7f01d8b62700 1 -- 172.21.15.3:0/1193758187 shutdown_connections 2023-10-08T15:40:54.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.347+0000 7f01d8b62700 1 -- 172.21.15.3:0/1193758187 wait complete. 2023-10-08T15:40:54.354 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 19 2023-10-08T15:40:54.365 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:40:54.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.459+0000 7f88b0932700 1 Processor -- start 2023-10-08T15:40:54.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.459+0000 7f88b0932700 1 -- start start 2023-10-08T15:40:54.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.463+0000 7f88b0932700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f88ac06cd70 0x7f88ac06ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:54.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.463+0000 7f88b0932700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f88ac0bbac0 0x7f88ac14b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:54.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.463+0000 7f88b0932700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88ac06d570 con 0x7f88ac14bbd0 2023-10-08T15:40:54.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.463+0000 7f88b0932700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88ac06c9a0 con 0x7f88ac0bbac0 2023-10-08T15:40:54.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.463+0000 7f88b0932700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88ac06d850 con 0x7f88ac06cd70 2023-10-08T15:40:54.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.463+0000 7f88a259c700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f88ac0bbac0 0x7f88ac14b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:54.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.463+0000 7f88ab59e700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f88ac14bbd0 0x7f88ac147390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:60150/0 (socket says 172.21.15.3:60150) 2023-10-08T15:40:54.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.463+0000 7f88ab59e700 1 -- 172.21.15.3:0/3855181747 learned_addr learned my addr 172.21.15.3:0/3855181747 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:40:54.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.463+0000 7f88aad9d700 1 --2- 172.21.15.3:0/3855181747 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f88ac06cd70 0x7f88ac06ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:54.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.463+0000 7f88a259c700 1 -- 172.21.15.3:0/3855181747 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f88ac06cd70 msgr2=0x7f88ac06ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:54.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.463+0000 7f88a259c700 1 --2- 172.21.15.3:0/3855181747 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f88ac06cd70 0x7f88ac06ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.463+0000 7f88a259c700 1 -- 172.21.15.3:0/3855181747 >> v1:172.21.15.3:6789/0 conn(0x7f88ac14bbd0 legacy=0x7f88ac147390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:54.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.463+0000 7f88a259c700 1 -- 172.21.15.3:0/3855181747 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88ac069110 con 0x7f88ac0bbac0 2023-10-08T15:40:54.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.463+0000 7f88a259c700 1 --2- 172.21.15.3:0/3855181747 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f88ac0bbac0 0x7f88ac14b690 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f88940098e0 tx=0x7f88940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf237974076adc7e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:54.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.463+0000 7f88aa59c700 1 -- 172.21.15.3:0/3855181747 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889400f6b0 con 0x7f88ac0bbac0 2023-10-08T15:40:54.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.463+0000 7f88aa59c700 1 -- 172.21.15.3:0/3855181747 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f889400f810 con 0x7f88ac0bbac0 2023-10-08T15:40:54.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.463+0000 7f88aa59c700 1 -- 172.21.15.3:0/3855181747 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889400fbb0 con 0x7f88ac0bbac0 2023-10-08T15:40:54.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.463+0000 7f88b0932700 1 -- 172.21.15.3:0/3855181747 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f88ac0bbac0 msgr2=0x7f88ac14b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:54.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.463+0000 7f88b0932700 1 --2- 172.21.15.3:0/3855181747 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f88ac0bbac0 0x7f88ac14b690 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f88940098e0 tx=0x7f88940091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.463+0000 7f88b0932700 1 -- 172.21.15.3:0/3855181747 shutdown_connections 2023-10-08T15:40:54.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.463+0000 7f88b0932700 1 --2- 172.21.15.3:0/3855181747 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f88ac0bbac0 0x7f88ac14b690 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.463+0000 7f88b0932700 1 --2- 172.21.15.3:0/3855181747 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f88ac06cd70 0x7f88ac06ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.463+0000 7f88b0932700 1 -- 172.21.15.3:0/3855181747 >> 172.21.15.3:0/3855181747 conn(0x7f88ac0670e0 msgr2=0x7f88ac0674e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:54.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.463+0000 7f88b0932700 1 -- 172.21.15.3:0/3855181747 shutdown_connections 2023-10-08T15:40:54.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.463+0000 7f88b0932700 1 -- 172.21.15.3:0/3855181747 wait complete. 2023-10-08T15:40:54.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.467+0000 7f88b0932700 1 Processor -- start 2023-10-08T15:40:54.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.467+0000 7f88b0932700 1 -- start start 2023-10-08T15:40:54.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.467+0000 7f88b0932700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f88ac06cd70 0x7f88ac0b5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:54.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.467+0000 7f88b0932700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f88ac0bbac0 0x7f88ac159e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:54.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.467+0000 7f88b0932700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88ac14bbd0 0x7f88ac144e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:54.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.467+0000 7f88b0932700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88ac0b49f0 con 0x7f88ac06cd70 2023-10-08T15:40:54.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.467+0000 7f88b0932700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88ac0b56a0 con 0x7f88ac14bbd0 2023-10-08T15:40:54.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.467+0000 7f88b0932700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88ac15a730 con 0x7f88ac0bbac0 2023-10-08T15:40:54.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.467+0000 7f88aad9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f88ac06cd70 0x7f88ac0b5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:54.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.467+0000 7f88aad9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f88ac06cd70 0x7f88ac0b5160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34588/0 (socket says 172.21.15.3:34588) 2023-10-08T15:40:54.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.467+0000 7f88aad9d700 1 -- 172.21.15.3:0/3855871554 learned_addr learned my addr 172.21.15.3:0/3855871554 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:54.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.467+0000 7f88ab59e700 1 --2- 172.21.15.3:0/3855871554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88ac14bbd0 0x7f88ac144e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:54.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.467+0000 7f88a259c700 1 --2- 172.21.15.3:0/3855871554 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f88ac0bbac0 0x7f88ac159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:54.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.471+0000 7f88aad9d700 1 -- 172.21.15.3:0/3855871554 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f88ac0bbac0 msgr2=0x7f88ac159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:54.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.471+0000 7f88aad9d700 1 --2- 172.21.15.3:0/3855871554 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f88ac0bbac0 0x7f88ac159e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.471+0000 7f88aad9d700 1 -- 172.21.15.3:0/3855871554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88ac14bbd0 msgr2=0x7f88ac144e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:54.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.471+0000 7f88aad9d700 1 --2- 172.21.15.3:0/3855871554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88ac14bbd0 0x7f88ac144e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.471+0000 7f88aad9d700 1 -- 172.21.15.3:0/3855871554 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8894009420 con 0x7f88ac06cd70 2023-10-08T15:40:54.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.471+0000 7f88ab59e700 1 --2- 172.21.15.3:0/3855871554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88ac14bbd0 0x7f88ac144e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:40:54.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.471+0000 7f88aad9d700 1 --2- 172.21.15.3:0/3855871554 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f88ac06cd70 0x7f88ac0b5160 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f889c00ec80 tx=0x7f889c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:54.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.471+0000 7f88a37fe700 1 -- 172.21.15.3:0/3855871554 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889c00c850 con 0x7f88ac06cd70 2023-10-08T15:40:54.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.471+0000 7f88a37fe700 1 -- 172.21.15.3:0/3855871554 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f889c00c9b0 con 0x7f88ac06cd70 2023-10-08T15:40:54.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.471+0000 7f88b0932700 1 -- 172.21.15.3:0/3855871554 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88ac0b4c40 con 0x7f88ac06cd70 2023-10-08T15:40:54.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.471+0000 7f88a37fe700 1 -- 172.21.15.3:0/3855871554 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889c00cd50 con 0x7f88ac06cd70 2023-10-08T15:40:54.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.471+0000 7f88b0932700 1 -- 172.21.15.3:0/3855871554 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88ac15a370 con 0x7f88ac06cd70 2023-10-08T15:40:54.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.471+0000 7f88b0932700 1 -- 172.21.15.3:0/3855871554 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88ac05ecf0 con 0x7f88ac06cd70 2023-10-08T15:40:54.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.471+0000 7f88a37fe700 1 -- 172.21.15.3:0/3855871554 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f889c013680 con 0x7f88ac06cd70 2023-10-08T15:40:54.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.475+0000 7f88a37fe700 1 --2- 172.21.15.3:0/3855871554 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f888c060550 0x7f888c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:54.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.475+0000 7f88a37fe700 1 -- 172.21.15.3:0/3855871554 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f889c07ca70 con 0x7f88ac06cd70 2023-10-08T15:40:54.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.475+0000 7f88a259c700 1 --2- 172.21.15.3:0/3855871554 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f888c060550 0x7f888c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:54.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.475+0000 7f88a259c700 1 --2- 172.21.15.3:0/3855871554 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f888c060550 0x7f888c062a00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f88940093f0 tx=0x7f8894019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:54.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.479+0000 7f88a37fe700 1 -- 172.21.15.3:0/3855871554 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f889c04cfc0 con 0x7f88ac06cd70 2023-10-08T15:40:54.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.679+0000 7f88b0932700 1 -- 172.21.15.3:0/3855871554 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f88ac06fc70 con 0x7f88ac06cd70 2023-10-08T15:40:54.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.679+0000 7f88a37fe700 1 -- 172.21.15.3:0/3855871554 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+3080 (secure 0 0 0) 0x7f889c017c20 con 0x7f88ac06cd70 2023-10-08T15:40:54.683 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:40:54.683 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5006,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3286528236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3286528236},{"type":"v1","addr":"172.21.15.50:6835","nonce":3286528236}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:40:13.764784+0000","modified":"2023-10-08T15:40:16.434138+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5337},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5337":{"gid":5337,"name":"a","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.3:6833/3441752211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":3441752211},{"type":"v1","addr":"172.21.15.3:6833","nonce":3441752211}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-08T15:40:54.686 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.683+0000 7f88b0932700 1 -- 172.21.15.3:0/3855871554 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f888c060550 msgr2=0x7f888c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:54.686 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.683+0000 7f88b0932700 1 --2- 172.21.15.3:0/3855871554 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f888c060550 0x7f888c062a00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f88940093f0 tx=0x7f8894019000 comp rx=0 tx=0).stop 2023-10-08T15:40:54.686 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.683+0000 7f88b0932700 1 -- 172.21.15.3:0/3855871554 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f88ac06cd70 msgr2=0x7f88ac0b5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:54.686 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.683+0000 7f88b0932700 1 --2- 172.21.15.3:0/3855871554 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f88ac06cd70 0x7f88ac0b5160 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f889c00ec80 tx=0x7f889c0091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.686 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.683+0000 7f88b0932700 1 -- 172.21.15.3:0/3855871554 shutdown_connections 2023-10-08T15:40:54.687 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.683+0000 7f88b0932700 1 --2- 172.21.15.3:0/3855871554 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f888c060550 0x7f888c062a00 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.687 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.683+0000 7f88b0932700 1 --2- 172.21.15.3:0/3855871554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88ac14bbd0 0x7f88ac144e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.687 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.683+0000 7f88b0932700 1 --2- 172.21.15.3:0/3855871554 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f88ac0bbac0 0x7f88ac159e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.687 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.683+0000 7f88b0932700 1 --2- 172.21.15.3:0/3855871554 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f88ac06cd70 0x7f88ac0b5160 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.687 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.683+0000 7f88b0932700 1 -- 172.21.15.3:0/3855871554 >> 172.21.15.3:0/3855871554 conn(0x7f88ac0670e0 msgr2=0x7f88ac0674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:54.687 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.683+0000 7f88b0932700 1 -- 172.21.15.3:0/3855871554 shutdown_connections 2023-10-08T15:40:54.687 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.683+0000 7f88b0932700 1 -- 172.21.15.3:0/3855871554 wait complete. 2023-10-08T15:40:54.687 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 19 2023-10-08T15:40:54.698 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:40:54.804 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.799+0000 7fb09af17700 1 Processor -- start 2023-10-08T15:40:54.804 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.799+0000 7fb09af17700 1 -- start start 2023-10-08T15:40:54.805 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.799+0000 7fb09af17700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb09414ac50 0x7fb09414b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:54.805 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.799+0000 7fb09af17700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb09406be60 0x7fb09406c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:54.805 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.799+0000 7fb09af17700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb09414c6b0 con 0x7fb09406ca70 2023-10-08T15:40:54.805 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.799+0000 7fb09af17700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb09414dc50 con 0x7fb09414ac50 2023-10-08T15:40:54.805 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.799+0000 7fb09af17700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb09414c060 con 0x7fb09406be60 2023-10-08T15:40:54.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.799+0000 7fb09a716700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fb09406ca70 0x7fb09414eb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:60164/0 (socket says 172.21.15.3:60164) 2023-10-08T15:40:54.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.799+0000 7fb09a716700 1 -- 172.21.15.3:0/1586695546 learned_addr learned my addr 172.21.15.3:0/1586695546 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:40:54.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.803+0000 7fb099f15700 1 --2- 172.21.15.3:0/1586695546 >> v2:172.21.15.50:3300/0 conn(0x7fb09414ac50 0x7fb09414b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:54.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.803+0000 7fb099714700 1 --2- 172.21.15.3:0/1586695546 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb09406be60 0x7fb09406c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:54.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.803+0000 7fb098f13700 1 -- 172.21.15.3:0/1586695546 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3160245153 0 0) 0x7fb09414c6b0 con 0x7fb09406ca70 2023-10-08T15:40:54.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.803+0000 7fb098f13700 1 -- 172.21.15.3:0/1586695546 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb080003570 con 0x7fb09406ca70 2023-10-08T15:40:54.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.803+0000 7fb099f15700 1 -- 172.21.15.3:0/1586695546 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb09406be60 msgr2=0x7fb09406c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:54.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.803+0000 7fb099f15700 1 --2- 172.21.15.3:0/1586695546 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb09406be60 0x7fb09406c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.803+0000 7fb099f15700 1 -- 172.21.15.3:0/1586695546 >> v1:172.21.15.3:6789/0 conn(0x7fb09406ca70 legacy=0x7fb09414eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:54.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.803+0000 7fb099f15700 1 -- 172.21.15.3:0/1586695546 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb09414c340 con 0x7fb09414ac50 2023-10-08T15:40:54.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.803+0000 7fb099f15700 1 --2- 172.21.15.3:0/1586695546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb09414ac50 0x7fb09414b020 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb0840098e0 tx=0x7fb0840091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f99669a81db1700 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:54.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.803+0000 7fb098f13700 1 -- 172.21.15.3:0/1586695546 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb084011630 con 0x7fb09414ac50 2023-10-08T15:40:54.808 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.803+0000 7fb098f13700 1 -- 172.21.15.3:0/1586695546 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb084011790 con 0x7fb09414ac50 2023-10-08T15:40:54.808 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.803+0000 7fb098f13700 1 -- 172.21.15.3:0/1586695546 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb084011b30 con 0x7fb09414ac50 2023-10-08T15:40:54.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.803+0000 7fb09af17700 1 -- 172.21.15.3:0/1586695546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb09414ac50 msgr2=0x7fb09414b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:54.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.803+0000 7fb09af17700 1 --2- 172.21.15.3:0/1586695546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb09414ac50 0x7fb09414b020 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb0840098e0 tx=0x7fb0840091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.803+0000 7fb09af17700 1 -- 172.21.15.3:0/1586695546 shutdown_connections 2023-10-08T15:40:54.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.803+0000 7fb09af17700 1 --2- 172.21.15.3:0/1586695546 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb09406be60 0x7fb09406c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.803+0000 7fb09af17700 1 --2- 172.21.15.3:0/1586695546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb09414ac50 0x7fb09414b020 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.803+0000 7fb09af17700 1 -- 172.21.15.3:0/1586695546 >> 172.21.15.3:0/1586695546 conn(0x7fb0940c1df0 msgr2=0x7fb0940c21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:54.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.803+0000 7fb09af17700 1 -- 172.21.15.3:0/1586695546 shutdown_connections 2023-10-08T15:40:54.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.803+0000 7fb09af17700 1 -- 172.21.15.3:0/1586695546 wait complete. 2023-10-08T15:40:54.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.807+0000 7fb09af17700 1 Processor -- start 2023-10-08T15:40:54.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.807+0000 7fb09af17700 1 -- start start 2023-10-08T15:40:54.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.807+0000 7fb09af17700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb09406be60 0x7fb09409d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:54.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.807+0000 7fb09af17700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb09406ca70 0x7fb09415e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:54.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.807+0000 7fb09af17700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb09414ac50 0x7fb09415aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:54.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.807+0000 7fb09af17700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb094158530 con 0x7fb09414ac50 2023-10-08T15:40:54.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.807+0000 7fb09af17700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb09415e0f0 con 0x7fb09406ca70 2023-10-08T15:40:54.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.807+0000 7fb09af17700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb09415e390 con 0x7fb09406be60 2023-10-08T15:40:54.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.807+0000 7fb09a716700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb09414ac50 0x7fb09415aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:54.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.807+0000 7fb09a716700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb09414ac50 0x7fb09415aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34590/0 (socket says 172.21.15.3:34590) 2023-10-08T15:40:54.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.807+0000 7fb09a716700 1 -- 172.21.15.3:0/3716519788 learned_addr learned my addr 172.21.15.3:0/3716519788 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:54.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.807+0000 7fb099714700 1 --2- 172.21.15.3:0/3716519788 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb09406ca70 0x7fb09415e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:54.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.807+0000 7fb099f15700 1 --2- 172.21.15.3:0/3716519788 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb09406be60 0x7fb09409d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:54.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.807+0000 7fb09a716700 1 -- 172.21.15.3:0/3716519788 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb09406be60 msgr2=0x7fb09409d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:54.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.807+0000 7fb09a716700 1 --2- 172.21.15.3:0/3716519788 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb09406be60 0x7fb09409d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.807+0000 7fb09a716700 1 -- 172.21.15.3:0/3716519788 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb09406ca70 msgr2=0x7fb09415e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:54.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.807+0000 7fb09a716700 1 --2- 172.21.15.3:0/3716519788 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb09406ca70 0x7fb09415e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.807+0000 7fb09a716700 1 -- 172.21.15.3:0/3716519788 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb084009420 con 0x7fb09414ac50 2023-10-08T15:40:54.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.807+0000 7fb09a716700 1 --2- 172.21.15.3:0/3716519788 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb09414ac50 0x7fb09415aa50 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fb08c001460 tx=0x7fb08c001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:54.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.807+0000 7fb089ffb700 1 -- 172.21.15.3:0/3716519788 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08c00a890 con 0x7fb09414ac50 2023-10-08T15:40:54.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.807+0000 7fb089ffb700 1 -- 172.21.15.3:0/3716519788 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb08c00a9f0 con 0x7fb09414ac50 2023-10-08T15:40:54.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.807+0000 7fb09af17700 1 -- 172.21.15.3:0/3716519788 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb09414a330 con 0x7fb09414ac50 2023-10-08T15:40:54.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.807+0000 7fb089ffb700 1 -- 172.21.15.3:0/3716519788 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08c00ad70 con 0x7fb09414ac50 2023-10-08T15:40:54.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.807+0000 7fb09af17700 1 -- 172.21.15.3:0/3716519788 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb09415edf0 con 0x7fb09414ac50 2023-10-08T15:40:54.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.811+0000 7fb09af17700 1 -- 172.21.15.3:0/3716519788 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb09409dd50 con 0x7fb09414ac50 2023-10-08T15:40:54.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.811+0000 7fb089ffb700 1 -- 172.21.15.3:0/3716519788 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb08c007300 con 0x7fb09414ac50 2023-10-08T15:40:54.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.811+0000 7fb089ffb700 1 --2- 172.21.15.3:0/3716519788 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb078060550 0x7fb078062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:54.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.811+0000 7fb089ffb700 1 -- 172.21.15.3:0/3716519788 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb08c07cca0 con 0x7fb09414ac50 2023-10-08T15:40:54.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.811+0000 7fb099f15700 1 --2- 172.21.15.3:0/3716519788 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb078060550 0x7fb078062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:54.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.811+0000 7fb099f15700 1 --2- 172.21.15.3:0/3716519788 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb078060550 0x7fb078062a00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb0840091e0 tx=0x7fb084017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:54.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.819+0000 7fb089ffb700 1 -- 172.21.15.3:0/3716519788 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb08c04d1f0 con 0x7fb09414ac50 2023-10-08T15:40:54.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.979+0000 7fb09af17700 1 -- 172.21.15.3:0/3716519788 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb09405ecf0 con 0x7fb09414ac50 2023-10-08T15:40:54.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.979+0000 7fb089ffb700 1 -- 172.21.15.3:0/3716519788 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+15254 (secure 0 0 0) 0x7fb08c050810 con 0x7fb09414ac50 2023-10-08T15:40:54.984 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:40:54.984 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":39,"fsid":"7635972e-cd66-4a8f-a231-378db8b3847a","created":"2023-10-08T15:37:08.234594+0000","modified":"2023-10-08T15:40:15.399080+0000","last_up_change":"2023-10-08T15:37:17.537726+0000","last_in_change":"2023-10-08T15:37:10.269178+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:37:16.581590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:40:12.013806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-08T15:40:12.747398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"64fb1864-bfdd-4d75-9b41-03fb60085dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33363},{"type":"v1","addr":"172.21.15.3:6801","nonce":33363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33363},{"type":"v1","addr":"172.21.15.3:6803","nonce":33363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":33363},{"type":"v1","addr":"172.21.15.3:6807","nonce":33363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33363},{"type":"v1","addr":"172.21.15.3:6805","nonce":33363}]},"public_addr":"172.21.15.3:6801/33363","cluster_addr":"172.21.15.3:6803/33363","heartbeat_back_addr":"172.21.15.3:6807/33363","heartbeat_front_addr":"172.21.15.3:6805/33363","state":["exists","up"]},{"osd":1,"uuid":"3ca6bd3a-3e8a-4c65-af9c-46148b0c2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33364},{"type":"v1","addr":"172.21.15.3:6820","nonce":33364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33364},{"type":"v1","addr":"172.21.15.3:6824","nonce":33364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33364},{"type":"v1","addr":"172.21.15.3:6831","nonce":33364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33364},{"type":"v1","addr":"172.21.15.3:6828","nonce":33364}]},"public_addr":"172.21.15.3:6820/33364","cluster_addr":"172.21.15.3:6824/33364","heartbeat_back_addr":"172.21.15.3:6831/33364","heartbeat_front_addr":"172.21.15.3:6828/33364","state":["exists","up"]},{"osd":2,"uuid":"6eb9f757-58dd-442f-910d-32401454bce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33366},{"type":"v1","addr":"172.21.15.3:6817","nonce":33366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":33366},{"type":"v1","addr":"172.21.15.3:6821","nonce":33366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6827","nonce":33366},{"type":"v1","addr":"172.21.15.3:6829","nonce":33366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":33366},{"type":"v1","addr":"172.21.15.3:6825","nonce":33366}]},"public_addr":"172.21.15.3:6817/33366","cluster_addr":"172.21.15.3:6821/33366","heartbeat_back_addr":"172.21.15.3:6829/33366","heartbeat_front_addr":"172.21.15.3:6825/33366","state":["exists","up"]},{"osd":3,"uuid":"1c39866b-ac2e-4ea9-a69c-02b01ee4191d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33365},{"type":"v1","addr":"172.21.15.3:6809","nonce":33365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":33365},{"type":"v1","addr":"172.21.15.3:6811","nonce":33365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33365},{"type":"v1","addr":"172.21.15.3:6815","nonce":33365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":33365},{"type":"v1","addr":"172.21.15.3:6813","nonce":33365}]},"public_addr":"172.21.15.3:6809/33365","cluster_addr":"172.21.15.3:6811/33365","heartbeat_back_addr":"172.21.15.3:6815/33365","heartbeat_front_addr":"172.21.15.3:6813/33365","state":["exists","up"]},{"osd":4,"uuid":"15f86b61-b7f1-4780-ae00-9d80a68cb830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":33605},{"type":"v1","addr":"172.21.15.50:6809","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33605},{"type":"v1","addr":"172.21.15.50:6811","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33605},{"type":"v1","addr":"172.21.15.50:6815","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":33605},{"type":"v1","addr":"172.21.15.50:6813","nonce":33605}]},"public_addr":"172.21.15.50:6809/33605","cluster_addr":"172.21.15.50:6811/33605","heartbeat_back_addr":"172.21.15.50:6815/33605","heartbeat_front_addr":"172.21.15.50:6813/33605","state":["exists","up"]},{"osd":5,"uuid":"726c3003-34e6-4d5a-b6e2-f911e13c2118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33606},{"type":"v1","addr":"172.21.15.50:6801","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33606},{"type":"v1","addr":"172.21.15.50:6803","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33606},{"type":"v1","addr":"172.21.15.50:6807","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":33606},{"type":"v1","addr":"172.21.15.50:6805","nonce":33606}]},"public_addr":"172.21.15.50:6801/33606","cluster_addr":"172.21.15.50:6803/33606","heartbeat_back_addr":"172.21.15.50:6807/33606","heartbeat_front_addr":"172.21.15.50:6805/33606","state":["exists","up"]},{"osd":6,"uuid":"401122a4-9988-441f-a5a7-39164434ebcd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":33607},{"type":"v1","addr":"172.21.15.50:6819","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":33607},{"type":"v1","addr":"172.21.15.50:6823","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":33607},{"type":"v1","addr":"172.21.15.50:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":33607},{"type":"v1","addr":"172.21.15.50:6827","nonce":33607}]},"public_addr":"172.21.15.50:6819/33607","cluster_addr":"172.21.15.50:6823/33607","heartbeat_back_addr":"172.21.15.50:6831/33607","heartbeat_front_addr":"172.21.15.50:6827/33607","state":["exists","up"]},{"osd":7,"uuid":"6b3fa236-c9d0-4c4d-82ae-9af4daf6d699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33604},{"type":"v1","addr":"172.21.15.50:6818","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":33604},{"type":"v1","addr":"172.21.15.50:6822","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":33604},{"type":"v1","addr":"172.21.15.50:6830","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":33604},{"type":"v1","addr":"172.21.15.50:6826","nonce":33604}]},"public_addr":"172.21.15.50:6818/33604","cluster_addr":"172.21.15.50:6822/33604","heartbeat_back_addr":"172.21.15.50:6830/33604","heartbeat_front_addr":"172.21.15.50:6826/33604","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.497794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.529417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.873426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.325972+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.443971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.240795+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.739632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.643026+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:40:54.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.983+0000 7fb09af17700 1 -- 172.21.15.3:0/3716519788 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb078060550 msgr2=0x7fb078062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:54.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.983+0000 7fb09af17700 1 --2- 172.21.15.3:0/3716519788 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb078060550 0x7fb078062a00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb0840091e0 tx=0x7fb084017000 comp rx=0 tx=0).stop 2023-10-08T15:40:54.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.983+0000 7fb09af17700 1 -- 172.21.15.3:0/3716519788 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb09414ac50 msgr2=0x7fb09415aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:54.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.983+0000 7fb09af17700 1 --2- 172.21.15.3:0/3716519788 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb09414ac50 0x7fb09415aa50 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fb08c001460 tx=0x7fb08c001ae0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.983+0000 7fb09af17700 1 -- 172.21.15.3:0/3716519788 shutdown_connections 2023-10-08T15:40:54.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.983+0000 7fb09af17700 1 --2- 172.21.15.3:0/3716519788 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb078060550 0x7fb078062a00 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.983+0000 7fb09af17700 1 --2- 172.21.15.3:0/3716519788 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb09414ac50 0x7fb09415aa50 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.983+0000 7fb09af17700 1 --2- 172.21.15.3:0/3716519788 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb09406ca70 0x7fb09415e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.983+0000 7fb09af17700 1 --2- 172.21.15.3:0/3716519788 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb09406be60 0x7fb09409d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.983+0000 7fb09af17700 1 -- 172.21.15.3:0/3716519788 >> 172.21.15.3:0/3716519788 conn(0x7fb0940c1df0 msgr2=0x7fb0941486d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:54.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.983+0000 7fb09af17700 1 -- 172.21.15.3:0/3716519788 shutdown_connections 2023-10-08T15:40:54.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:54.983+0000 7fb09af17700 1 -- 172.21.15.3:0/3716519788 wait complete. 2023-10-08T15:40:54.998 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-08T15:40:55.106 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.103+0000 7f5733fff700 1 Processor -- start 2023-10-08T15:40:55.106 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.103+0000 7f5733fff700 1 -- start start 2023-10-08T15:40:55.107 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.103+0000 7f5733fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f57341490c0 0x7f57340674b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:55.107 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.103+0000 7f5733fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f57340bd4f0 0x7f5734149af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:55.107 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.103+0000 7f5733fff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5734149660 con 0x7f57340670e0 2023-10-08T15:40:55.107 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.103+0000 7f5733fff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57340a4ed0 con 0x7f57340bd4f0 2023-10-08T15:40:55.107 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.103+0000 7f5733fff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f573414d5f0 con 0x7f57341490c0 2023-10-08T15:40:55.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.103+0000 7f57327fc700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f57341490c0 0x7f57340674b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:55.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.103+0000 7f57327fc700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f57341490c0 0x7f57340674b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.3:33572/0 (socket says 172.21.15.3:33572) 2023-10-08T15:40:55.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.103+0000 7f57327fc700 1 -- 172.21.15.3:0/1875083236 learned_addr learned my addr 172.21.15.3:0/1875083236 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:55.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.103+0000 7f57337fe700 1 --2- 172.21.15.3:0/1875083236 >> v2:172.21.15.50:3300/0 conn(0x7f57340bd4f0 0x7f5734149af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:55.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.103+0000 7f57327fc700 1 -- 172.21.15.3:0/1875083236 >> v2:172.21.15.50:3300/0 conn(0x7f57340bd4f0 msgr2=0x7f5734149af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:55.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.103+0000 7f57327fc700 1 --2- 172.21.15.3:0/1875083236 >> v2:172.21.15.50:3300/0 conn(0x7f57340bd4f0 0x7f5734149af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:55.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.103+0000 7f57327fc700 1 -- 172.21.15.3:0/1875083236 >> v1:172.21.15.50:6789/0 conn(0x7f57340670e0 legacy=0x7f57340bbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:55.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.103+0000 7f57327fc700 1 -- 172.21.15.3:0/1875083236 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57340bc610 con 0x7f57341490c0 2023-10-08T15:40:55.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.103+0000 7f5731ffb700 1 -- 172.21.15.3:0/1875083236 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3858058181 0 0) 0x7f5734149660 con 0x7f57340670e0 2023-10-08T15:40:55.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.103+0000 7f57327fc700 1 --2- 172.21.15.3:0/1875083236 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f57341490c0 0x7f57340674b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f572c009f20 tx=0x7f572c009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14963fdc561ca202 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:55.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.103+0000 7f5731ffb700 1 -- 172.21.15.3:0/1875083236 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572c00e070 con 0x7f57341490c0 2023-10-08T15:40:55.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.103+0000 7f5731ffb700 1 -- 172.21.15.3:0/1875083236 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f572c00b9d0 con 0x7f57341490c0 2023-10-08T15:40:55.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.103+0000 7f5731ffb700 1 -- 172.21.15.3:0/1875083236 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572c0092e0 con 0x7f57341490c0 2023-10-08T15:40:55.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.103+0000 7f5733fff700 1 -- 172.21.15.3:0/1875083236 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f57341490c0 msgr2=0x7f57340674b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:55.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.103+0000 7f5733fff700 1 --2- 172.21.15.3:0/1875083236 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f57341490c0 0x7f57340674b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f572c009f20 tx=0x7f572c009840 comp rx=0 tx=0).stop 2023-10-08T15:40:55.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.103+0000 7f5733fff700 1 -- 172.21.15.3:0/1875083236 shutdown_connections 2023-10-08T15:40:55.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.103+0000 7f5733fff700 1 --2- 172.21.15.3:0/1875083236 >> v2:172.21.15.50:3300/0 conn(0x7f57340bd4f0 0x7f5734149af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:55.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.103+0000 7f5733fff700 1 --2- 172.21.15.3:0/1875083236 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f57341490c0 0x7f57340674b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:55.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.107+0000 7f5733fff700 1 -- 172.21.15.3:0/1875083236 >> 172.21.15.3:0/1875083236 conn(0x7f573406a760 msgr2=0x7f573406dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:55.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.107+0000 7f5733fff700 1 -- 172.21.15.3:0/1875083236 shutdown_connections 2023-10-08T15:40:55.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.107+0000 7f5733fff700 1 -- 172.21.15.3:0/1875083236 wait complete. 2023-10-08T15:40:55.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.107+0000 7f5733fff700 1 Processor -- start 2023-10-08T15:40:55.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.107+0000 7f5733fff700 1 -- start start 2023-10-08T15:40:55.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.107+0000 7f5733fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f57340670e0 0x7f57340b6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:55.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.107+0000 7f5733fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57340bd4f0 0x7f5734158830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:55.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.107+0000 7f5733fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57341490c0 0x7f573414b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:55.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.107+0000 7f5733fff700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57340b64a0 con 0x7f57340bd4f0 2023-10-08T15:40:55.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.107+0000 7f5733fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f573414cfc0 con 0x7f57341490c0 2023-10-08T15:40:55.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.107+0000 7f5733fff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57341591e0 con 0x7f57340670e0 2023-10-08T15:40:55.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.107+0000 7f57327fc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57340bd4f0 0x7f5734158830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:55.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.107+0000 7f57327fc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57340bd4f0 0x7f5734158830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34596/0 (socket says 172.21.15.3:34596) 2023-10-08T15:40:55.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.107+0000 7f57327fc700 1 -- 172.21.15.3:0/2366121142 learned_addr learned my addr 172.21.15.3:0/2366121142 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:55.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.107+0000 7f5732ffd700 1 --2- 172.21.15.3:0/2366121142 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f57340670e0 0x7f57340b6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:55.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.107+0000 7f57337fe700 1 --2- 172.21.15.3:0/2366121142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57341490c0 0x7f573414b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:55.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.107+0000 7f57327fc700 1 -- 172.21.15.3:0/2366121142 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f57340670e0 msgr2=0x7f57340b6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:55.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.107+0000 7f57327fc700 1 --2- 172.21.15.3:0/2366121142 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f57340670e0 0x7f57340b6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:55.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.107+0000 7f57327fc700 1 -- 172.21.15.3:0/2366121142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57341490c0 msgr2=0x7f573414b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:55.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.107+0000 7f57327fc700 1 --2- 172.21.15.3:0/2366121142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57341490c0 0x7f573414b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:55.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.107+0000 7f57327fc700 1 -- 172.21.15.3:0/2366121142 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f572c009ae0 con 0x7f57340bd4f0 2023-10-08T15:40:55.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.107+0000 7f57327fc700 1 --2- 172.21.15.3:0/2366121142 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57340bd4f0 0x7f5734158830 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5734067e10 tx=0x7f572c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:55.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.107+0000 7f571affd700 1 -- 172.21.15.3:0/2366121142 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572c007860 con 0x7f57340bd4f0 2023-10-08T15:40:55.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.107+0000 7f571affd700 1 -- 172.21.15.3:0/2366121142 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f572c0079c0 con 0x7f57340bd4f0 2023-10-08T15:40:55.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.111+0000 7f5733fff700 1 -- 172.21.15.3:0/2366121142 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57340b6130 con 0x7f57340bd4f0 2023-10-08T15:40:55.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.111+0000 7f571affd700 1 -- 172.21.15.3:0/2366121142 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572c007d80 con 0x7f57340bd4f0 2023-10-08T15:40:55.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.111+0000 7f5733fff700 1 -- 172.21.15.3:0/2366121142 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5734158d70 con 0x7f57340bd4f0 2023-10-08T15:40:55.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.111+0000 7f5733fff700 1 -- 172.21.15.3:0/2366121142 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f573414c3a0 con 0x7f57340bd4f0 2023-10-08T15:40:55.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.111+0000 7f571affd700 1 -- 172.21.15.3:0/2366121142 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f572c003040 con 0x7f57340bd4f0 2023-10-08T15:40:55.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.111+0000 7f571affd700 1 --2- 172.21.15.3:0/2366121142 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5720060580 0x7f5720062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:55.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.111+0000 7f571affd700 1 -- 172.21.15.3:0/2366121142 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f572c07e280 con 0x7f57340bd4f0 2023-10-08T15:40:55.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.111+0000 7f5732ffd700 1 --2- 172.21.15.3:0/2366121142 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5720060580 0x7f5720062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:55.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.111+0000 7f5732ffd700 1 --2- 172.21.15.3:0/2366121142 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5720060580 0x7f5720062a30 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5728007fd0 tx=0x7f5728007d30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:55.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.115+0000 7f571affd700 1 -- 172.21.15.3:0/2366121142 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f572c04e920 con 0x7f57340bd4f0 2023-10-08T15:40:55.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.311+0000 7f5733fff700 1 -- 172.21.15.3:0/2366121142 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f573405ecf0 con 0x7f57340bd4f0 2023-10-08T15:40:55.315 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-10-08T15:40:55.311+0000 7fd2c0727700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T15:40:55.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.323+0000 7f571affd700 1 -- 172.21.15.3:0/2366121142 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v20) v1 ==== 161+0+0 (secure 0 0 0) 0x7f572c051f40 con 0x7f57340bd4f0 2023-10-08T15:40:55.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.327+0000 7f5733fff700 1 -- 172.21.15.3:0/2366121142 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5720060580 msgr2=0x7f5720062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:55.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.327+0000 7f5733fff700 1 --2- 172.21.15.3:0/2366121142 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5720060580 0x7f5720062a30 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5728007fd0 tx=0x7f5728007d30 comp rx=0 tx=0).stop 2023-10-08T15:40:55.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.327+0000 7f5733fff700 1 -- 172.21.15.3:0/2366121142 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57340bd4f0 msgr2=0x7f5734158830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:55.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.327+0000 7f5733fff700 1 --2- 172.21.15.3:0/2366121142 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57340bd4f0 0x7f5734158830 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5734067e10 tx=0x7f572c018000 comp rx=0 tx=0).stop 2023-10-08T15:40:55.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.327+0000 7f5733fff700 1 -- 172.21.15.3:0/2366121142 shutdown_connections 2023-10-08T15:40:55.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.327+0000 7f5733fff700 1 --2- 172.21.15.3:0/2366121142 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5720060580 0x7f5720062a30 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:55.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.327+0000 7f5733fff700 1 --2- 172.21.15.3:0/2366121142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57341490c0 0x7f573414b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:55.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.327+0000 7f5733fff700 1 --2- 172.21.15.3:0/2366121142 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57340bd4f0 0x7f5734158830 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:55.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.327+0000 7f5733fff700 1 --2- 172.21.15.3:0/2366121142 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f57340670e0 0x7f57340b6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:55.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.327+0000 7f5733fff700 1 -- 172.21.15.3:0/2366121142 >> 172.21.15.3:0/2366121142 conn(0x7f573406a760 msgr2=0x7f57340a41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:55.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.327+0000 7f5733fff700 1 -- 172.21.15.3:0/2366121142 shutdown_connections 2023-10-08T15:40:55.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.327+0000 7f5733fff700 1 -- 172.21.15.3:0/2366121142 wait complete. 2023-10-08T15:40:55.331 INFO:teuthology.orchestra.run.smithi003.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-08T15:40:55.343 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-08T15:40:55.362 INFO:tasks.ceph.mds.a.smithi003.stdout:starting mds.a at 2023-10-08T15:40:55.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.455+0000 7f61eaf47700 1 Processor -- start 2023-10-08T15:40:55.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.455+0000 7f61eaf47700 1 -- start start 2023-10-08T15:40:55.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.455+0000 7f61eaf47700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f61e4147270 0x7f61e40be690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:55.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.455+0000 7f61eaf47700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61e414b390 con 0x7f61e40bebd0 2023-10-08T15:40:55.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.455+0000 7f61eaf47700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61e40b1c30 con 0x7f61e406de20 2023-10-08T15:40:55.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.455+0000 7f61eaf47700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61e406f750 con 0x7f61e4147270 2023-10-08T15:40:55.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.455+0000 7f61e8ce3700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f61e4147270 0x7f61e40be690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:55.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.455+0000 7f61e3fff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f61e40bebd0 0x7f61e414b820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:60180/0 (socket says 172.21.15.3:60180) 2023-10-08T15:40:55.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.455+0000 7f61e3fff700 1 -- 172.21.15.3:0/3907444064 learned_addr learned my addr 172.21.15.3:0/3907444064 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:40:55.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.459+0000 7f61e8ce3700 1 -- 172.21.15.3:0/3907444064 >> v1:172.21.15.50:6789/0 conn(0x7f61e406de20 legacy=0x7f61e4147640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:55.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.459+0000 7f61e8ce3700 1 -- 172.21.15.3:0/3907444064 >> v1:172.21.15.3:6789/0 conn(0x7f61e40bebd0 legacy=0x7f61e414b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:55.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.459+0000 7f61e8ce3700 1 -- 172.21.15.3:0/3907444064 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e406e510 con 0x7f61e4147270 2023-10-08T15:40:55.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.459+0000 7f61e8ce3700 1 --2- 172.21.15.3:0/3907444064 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f61e4147270 0x7f61e40be690 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f61d40098e0 tx=0x7f61d40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=925dcf3ed02d86e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:55.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.459+0000 7f61e37fe700 1 -- 172.21.15.3:0/3907444064 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d4009e80 con 0x7f61e4147270 2023-10-08T15:40:55.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.459+0000 7f61e37fe700 1 -- 172.21.15.3:0/3907444064 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d400b860 con 0x7f61e4147270 2023-10-08T15:40:55.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.459+0000 7f61e37fe700 1 -- 172.21.15.3:0/3907444064 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d400bbe0 con 0x7f61e4147270 2023-10-08T15:40:55.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.459+0000 7f61eaf47700 1 -- 172.21.15.3:0/3907444064 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f61e4147270 msgr2=0x7f61e40be690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:55.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.459+0000 7f61eaf47700 1 --2- 172.21.15.3:0/3907444064 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f61e4147270 0x7f61e40be690 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f61d40098e0 tx=0x7f61d40091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:55.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.459+0000 7f61eaf47700 1 -- 172.21.15.3:0/3907444064 shutdown_connections 2023-10-08T15:40:55.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.459+0000 7f61eaf47700 1 --2- 172.21.15.3:0/3907444064 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f61e4147270 0x7f61e40be690 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:55.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.459+0000 7f61eaf47700 1 -- 172.21.15.3:0/3907444064 >> 172.21.15.3:0/3907444064 conn(0x7f61e40694f0 msgr2=0x7f61e40698f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:55.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.459+0000 7f61eaf47700 1 -- 172.21.15.3:0/3907444064 shutdown_connections 2023-10-08T15:40:55.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.459+0000 7f61eaf47700 1 -- 172.21.15.3:0/3907444064 wait complete. 2023-10-08T15:40:55.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.463+0000 7f61eaf47700 1 Processor -- start 2023-10-08T15:40:55.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.463+0000 7f61eaf47700 1 -- start start 2023-10-08T15:40:55.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.463+0000 7f61eaf47700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f61e406de20 0x7f61e41468d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:55.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.463+0000 7f61eaf47700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61e40bebd0 0x7f61e415eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:55.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.463+0000 7f61eaf47700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f61e4147270 0x7f61e415f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:55.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.463+0000 7f61eaf47700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e4149d40 con 0x7f61e4147270 2023-10-08T15:40:55.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.463+0000 7f61eaf47700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e4146e10 con 0x7f61e40bebd0 2023-10-08T15:40:55.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.463+0000 7f61eaf47700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61e41496f0 con 0x7f61e406de20 2023-10-08T15:40:55.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.463+0000 7f61e94e4700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f61e4147270 0x7f61e415f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:55.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.463+0000 7f61e94e4700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f61e4147270 0x7f61e415f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34634/0 (socket says 172.21.15.3:34634) 2023-10-08T15:40:55.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.463+0000 7f61e3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61e40bebd0 0x7f61e415eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:55.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.463+0000 7f61e94e4700 1 -- 172.21.15.3:0/2271439504 learned_addr learned my addr 172.21.15.3:0/2271439504 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:55.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.463+0000 7f61e8ce3700 1 --2- 172.21.15.3:0/2271439504 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f61e406de20 0x7f61e41468d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:55.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.463+0000 7f61e94e4700 1 -- 172.21.15.3:0/2271439504 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f61e406de20 msgr2=0x7f61e41468d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:55.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.463+0000 7f61e94e4700 1 --2- 172.21.15.3:0/2271439504 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f61e406de20 0x7f61e41468d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:55.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.463+0000 7f61e94e4700 1 -- 172.21.15.3:0/2271439504 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61e40bebd0 msgr2=0x7f61e415eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:55.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.463+0000 7f61e94e4700 1 --2- 172.21.15.3:0/2271439504 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61e40bebd0 0x7f61e415eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:55.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.463+0000 7f61e94e4700 1 -- 172.21.15.3:0/2271439504 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d4009420 con 0x7f61e4147270 2023-10-08T15:40:55.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.463+0000 7f61e3fff700 1 --2- 172.21.15.3:0/2271439504 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61e40bebd0 0x7f61e415eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:40:55.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.463+0000 7f61e94e4700 1 --2- 172.21.15.3:0/2271439504 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f61e4147270 0x7f61e415f2e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f61dc00c8e0 tx=0x7f61dc001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:55.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.463+0000 7f61e0ff9700 1 -- 172.21.15.3:0/2271439504 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61dc012630 con 0x7f61e4147270 2023-10-08T15:40:55.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.463+0000 7f61e0ff9700 1 -- 172.21.15.3:0/2271439504 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61dc012790 con 0x7f61e4147270 2023-10-08T15:40:55.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.463+0000 7f61eaf47700 1 -- 172.21.15.3:0/2271439504 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61e41499d0 con 0x7f61e4147270 2023-10-08T15:40:55.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.463+0000 7f61e0ff9700 1 -- 172.21.15.3:0/2271439504 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61dc012b50 con 0x7f61e4147270 2023-10-08T15:40:55.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.463+0000 7f61eaf47700 1 -- 172.21.15.3:0/2271439504 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61e414a020 con 0x7f61e4147270 2023-10-08T15:40:55.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.467+0000 7f61eaf47700 1 -- 172.21.15.3:0/2271439504 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61e4064530 con 0x7f61e4147270 2023-10-08T15:40:55.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.467+0000 7f61e0ff9700 1 -- 172.21.15.3:0/2271439504 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f61dc01a3a0 con 0x7f61e4147270 2023-10-08T15:40:55.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.467+0000 7f61e0ff9700 1 --2- 172.21.15.3:0/2271439504 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f61d0060550 0x7f61d0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:55.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.467+0000 7f61e0ff9700 1 -- 172.21.15.3:0/2271439504 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f61dc07cab0 con 0x7f61e4147270 2023-10-08T15:40:55.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.467+0000 7f61e8ce3700 1 --2- 172.21.15.3:0/2271439504 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f61d0060550 0x7f61d0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:55.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.467+0000 7f61e8ce3700 1 --2- 172.21.15.3:0/2271439504 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f61d0060550 0x7f61d0062a00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f61d40093f0 tx=0x7f61d4018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:55.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.471+0000 7f61e0ff9700 1 -- 172.21.15.3:0/2271439504 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f61dc04cfb0 con 0x7f61e4147270 2023-10-08T15:40:55.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:55.667+0000 7f61eaf47700 1 -- 172.21.15.3:0/2271439504 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f61e404b600 con 0x7f61e4147270 2023-10-08T15:40:56.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.323+0000 7f61e0ff9700 1 -- 172.21.15.3:0/2271439504 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7f61dc0505d0 con 0x7f61e4147270 2023-10-08T15:40:56.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.327+0000 7f61eaf47700 1 -- 172.21.15.3:0/2271439504 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f61d0060550 msgr2=0x7f61d0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:56.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.327+0000 7f61eaf47700 1 --2- 172.21.15.3:0/2271439504 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f61d0060550 0x7f61d0062a00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f61d40093f0 tx=0x7f61d4018000 comp rx=0 tx=0).stop 2023-10-08T15:40:56.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.327+0000 7f61eaf47700 1 -- 172.21.15.3:0/2271439504 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f61e4147270 msgr2=0x7f61e415f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:56.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.327+0000 7f61eaf47700 1 --2- 172.21.15.3:0/2271439504 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f61e4147270 0x7f61e415f2e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f61dc00c8e0 tx=0x7f61dc001710 comp rx=0 tx=0).stop 2023-10-08T15:40:56.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.327+0000 7f61eaf47700 1 -- 172.21.15.3:0/2271439504 shutdown_connections 2023-10-08T15:40:56.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.327+0000 7f61eaf47700 1 --2- 172.21.15.3:0/2271439504 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f61d0060550 0x7f61d0062a00 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:56.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.327+0000 7f61eaf47700 1 --2- 172.21.15.3:0/2271439504 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f61e4147270 0x7f61e415f2e0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:56.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.327+0000 7f61eaf47700 1 --2- 172.21.15.3:0/2271439504 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61e40bebd0 0x7f61e415eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:56.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.327+0000 7f61eaf47700 1 --2- 172.21.15.3:0/2271439504 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f61e406de20 0x7f61e41468d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:56.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.327+0000 7f61eaf47700 1 -- 172.21.15.3:0/2271439504 >> 172.21.15.3:0/2271439504 conn(0x7f61e40694f0 msgr2=0x7f61e41517c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:56.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.327+0000 7f61eaf47700 1 -- 172.21.15.3:0/2271439504 shutdown_connections 2023-10-08T15:40:56.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.327+0000 7f61eaf47700 1 -- 172.21.15.3:0/2271439504 wait complete. 2023-10-08T15:40:56.344 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-08T15:40:56.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.507+0000 7fc1d6439700 1 Processor -- start 2023-10-08T15:40:56.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.507+0000 7fc1d6439700 1 -- start start 2023-10-08T15:40:56.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.511+0000 7fc1d6439700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fc1d009f6a0 0x7fc1d009fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:56.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.511+0000 7fc1d6439700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc1d0068e60 0x7fc1d00a0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:56.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.511+0000 7fc1d6439700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1d0149a70 con 0x7fc1d00a2410 2023-10-08T15:40:56.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.511+0000 7fc1d6439700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1d00692e0 con 0x7fc1d009f6a0 2023-10-08T15:40:56.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.511+0000 7fc1d6439700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d0149420 con 0x7fc1d0068e60 2023-10-08T15:40:56.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.511+0000 7fc1d5437700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fc1d009f6a0 0x7fc1d009fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:56.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.511+0000 7fc1d5437700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fc1d009f6a0 0x7fc1d009fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34644/0 (socket says 172.21.15.3:34644) 2023-10-08T15:40:56.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.511+0000 7fc1d5437700 1 -- 172.21.15.3:0/2519930321 learned_addr learned my addr 172.21.15.3:0/2519930321 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:56.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.511+0000 7fc1d5c38700 1 --2- 172.21.15.3:0/2519930321 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc1d0068e60 0x7fc1d00a0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:56.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.511+0000 7fc1d5437700 1 -- 172.21.15.3:0/2519930321 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc1d0068e60 msgr2=0x7fc1d00a0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:56.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.511+0000 7fc1d5437700 1 --2- 172.21.15.3:0/2519930321 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc1d0068e60 0x7fc1d00a0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:56.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.511+0000 7fc1d5437700 1 -- 172.21.15.3:0/2519930321 >> v1:172.21.15.50:6789/0 conn(0x7fc1d00a2410 legacy=0x7fc1d0149f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:56.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.511+0000 7fc1c3fff700 1 -- 172.21.15.3:0/2519930321 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1585011825 0 0) 0x7fc1d0149a70 con 0x7fc1d00a2410 2023-10-08T15:40:56.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.511+0000 7fc1d5437700 1 -- 172.21.15.3:0/2519930321 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d0149700 con 0x7fc1d009f6a0 2023-10-08T15:40:56.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.511+0000 7fc1d5437700 1 --2- 172.21.15.3:0/2519930321 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc1d009f6a0 0x7fc1d009fa70 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fc1c40099b0 tx=0x7fc1c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6809f95d2db4fe0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:56.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.511+0000 7fc1c3fff700 1 -- 172.21.15.3:0/2519930321 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c4009ea0 con 0x7fc1d009f6a0 2023-10-08T15:40:56.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.511+0000 7fc1c3fff700 1 -- 172.21.15.3:0/2519930321 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1c400b860 con 0x7fc1d009f6a0 2023-10-08T15:40:56.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.511+0000 7fc1c3fff700 1 -- 172.21.15.3:0/2519930321 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c400bc00 con 0x7fc1d009f6a0 2023-10-08T15:40:56.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.511+0000 7fc1d6439700 1 -- 172.21.15.3:0/2519930321 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc1d009f6a0 msgr2=0x7fc1d009fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:56.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.511+0000 7fc1d6439700 1 --2- 172.21.15.3:0/2519930321 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc1d009f6a0 0x7fc1d009fa70 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fc1c40099b0 tx=0x7fc1c4009250 comp rx=0 tx=0).stop 2023-10-08T15:40:56.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.511+0000 7fc1d6439700 1 -- 172.21.15.3:0/2519930321 shutdown_connections 2023-10-08T15:40:56.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.511+0000 7fc1d6439700 1 --2- 172.21.15.3:0/2519930321 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc1d0068e60 0x7fc1d00a0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:56.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.511+0000 7fc1d6439700 1 --2- 172.21.15.3:0/2519930321 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc1d009f6a0 0x7fc1d009fa70 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:56.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.511+0000 7fc1d6439700 1 -- 172.21.15.3:0/2519930321 >> 172.21.15.3:0/2519930321 conn(0x7fc1d00bd9d0 msgr2=0x7fc1d00bddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:56.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.511+0000 7fc1d6439700 1 -- 172.21.15.3:0/2519930321 shutdown_connections 2023-10-08T15:40:56.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.511+0000 7fc1d6439700 1 -- 172.21.15.3:0/2519930321 wait complete. 2023-10-08T15:40:56.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.515+0000 7fc1d6439700 1 Processor -- start 2023-10-08T15:40:56.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.515+0000 7fc1d6439700 1 -- start start 2023-10-08T15:40:56.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.515+0000 7fc1d6439700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1d0068e60 0x7fc1d015b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:56.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.515+0000 7fc1d6439700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc1d009f6a0 0x7fc1d014b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:56.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.515+0000 7fc1d6439700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc1d00a2410 0x7fc1d0147a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:56.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.515+0000 7fc1d6439700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d0099e80 con 0x7fc1d009f6a0 2023-10-08T15:40:56.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.515+0000 7fc1d6439700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d009f060 con 0x7fc1d0068e60 2023-10-08T15:40:56.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.515+0000 7fc1d6439700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d015b920 con 0x7fc1d00a2410 2023-10-08T15:40:56.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.515+0000 7fc1d4c36700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc1d009f6a0 0x7fc1d014b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:56.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.515+0000 7fc1d4c36700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc1d009f6a0 0x7fc1d014b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34646/0 (socket says 172.21.15.3:34646) 2023-10-08T15:40:56.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.515+0000 7fc1d4c36700 1 -- 172.21.15.3:0/3714913027 learned_addr learned my addr 172.21.15.3:0/3714913027 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:56.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.515+0000 7fc1d5c38700 1 --2- 172.21.15.3:0/3714913027 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc1d00a2410 0x7fc1d0147a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:56.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.515+0000 7fc1d5437700 1 --2- 172.21.15.3:0/3714913027 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1d0068e60 0x7fc1d015b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:56.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.515+0000 7fc1d4c36700 1 -- 172.21.15.3:0/3714913027 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc1d00a2410 msgr2=0x7fc1d0147a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:56.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.515+0000 7fc1d4c36700 1 --2- 172.21.15.3:0/3714913027 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc1d00a2410 0x7fc1d0147a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:56.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.515+0000 7fc1d4c36700 1 -- 172.21.15.3:0/3714913027 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1d0068e60 msgr2=0x7fc1d015b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:56.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.515+0000 7fc1d4c36700 1 --2- 172.21.15.3:0/3714913027 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1d0068e60 0x7fc1d015b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:56.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.515+0000 7fc1d4c36700 1 -- 172.21.15.3:0/3714913027 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c40094f0 con 0x7fc1d009f6a0 2023-10-08T15:40:56.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.515+0000 7fc1d4c36700 1 --2- 172.21.15.3:0/3714913027 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc1d009f6a0 0x7fc1d014b960 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc00c910 tx=0x7fc1cc001700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:56.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.515+0000 7fc1c17fa700 1 -- 172.21.15.3:0/3714913027 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc00a7e0 con 0x7fc1d009f6a0 2023-10-08T15:40:56.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.515+0000 7fc1c17fa700 1 -- 172.21.15.3:0/3714913027 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1cc00a960 con 0x7fc1d009f6a0 2023-10-08T15:40:56.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.515+0000 7fc1d6439700 1 -- 172.21.15.3:0/3714913027 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1d009ed80 con 0x7fc1d009f6a0 2023-10-08T15:40:56.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.515+0000 7fc1c17fa700 1 -- 172.21.15.3:0/3714913027 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc00ad20 con 0x7fc1d009f6a0 2023-10-08T15:40:56.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.515+0000 7fc1d6439700 1 -- 172.21.15.3:0/3714913027 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1d014bea0 con 0x7fc1d009f6a0 2023-10-08T15:40:56.523 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.515+0000 7fc1d6439700 1 -- 172.21.15.3:0/3714913027 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1d005ecf0 con 0x7fc1d009f6a0 2023-10-08T15:40:56.524 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.519+0000 7fc1c17fa700 1 -- 172.21.15.3:0/3714913027 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc1cc003030 con 0x7fc1d009f6a0 2023-10-08T15:40:56.524 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.519+0000 7fc1c17fa700 1 --2- 172.21.15.3:0/3714913027 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc1b4060550 0x7fc1b4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:56.525 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.519+0000 7fc1c17fa700 1 -- 172.21.15.3:0/3714913027 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fc1cc07d1e0 con 0x7fc1d009f6a0 2023-10-08T15:40:56.525 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.519+0000 7fc1d5437700 1 --2- 172.21.15.3:0/3714913027 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc1b4060550 0x7fc1b4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:56.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.523+0000 7fc1d5437700 1 --2- 172.21.15.3:0/3714913027 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc1b4060550 0x7fc1b4062a00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc1c40099b0 tx=0x7fc1c4017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:56.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.527+0000 7fc1c17fa700 1 -- 172.21.15.3:0/3714913027 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc1cc04d6e0 con 0x7fc1d009f6a0 2023-10-08T15:40:56.695 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:56.691+0000 7fc1d6439700 1 -- 172.21.15.3:0/3714913027 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc1d00ba110 con 0x7fc1d009f6a0 2023-10-08T15:40:57.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.339+0000 7fc1c17fa700 1 -- 172.21.15.3:0/3714913027 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v41) v1 ==== 181+0+0 (secure 0 0 0) 0x7fc1cc050d00 con 0x7fc1d009f6a0 2023-10-08T15:40:57.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.343+0000 7fc1d6439700 1 -- 172.21.15.3:0/3714913027 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc1b4060550 msgr2=0x7fc1b4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:57.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.343+0000 7fc1d6439700 1 --2- 172.21.15.3:0/3714913027 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc1b4060550 0x7fc1b4062a00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc1c40099b0 tx=0x7fc1c4017000 comp rx=0 tx=0).stop 2023-10-08T15:40:57.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.343+0000 7fc1d6439700 1 -- 172.21.15.3:0/3714913027 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc1d009f6a0 msgr2=0x7fc1d014b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:57.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.343+0000 7fc1d6439700 1 --2- 172.21.15.3:0/3714913027 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc1d009f6a0 0x7fc1d014b960 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc00c910 tx=0x7fc1cc001700 comp rx=0 tx=0).stop 2023-10-08T15:40:57.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.343+0000 7fc1d6439700 1 -- 172.21.15.3:0/3714913027 shutdown_connections 2023-10-08T15:40:57.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.343+0000 7fc1d6439700 1 --2- 172.21.15.3:0/3714913027 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc1b4060550 0x7fc1b4062a00 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:57.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.343+0000 7fc1d6439700 1 --2- 172.21.15.3:0/3714913027 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc1d00a2410 0x7fc1d0147a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:57.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.343+0000 7fc1d6439700 1 --2- 172.21.15.3:0/3714913027 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc1d009f6a0 0x7fc1d014b960 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:57.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.343+0000 7fc1d6439700 1 --2- 172.21.15.3:0/3714913027 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1d0068e60 0x7fc1d015b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:57.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.343+0000 7fc1d6439700 1 -- 172.21.15.3:0/3714913027 >> 172.21.15.3:0/3714913027 conn(0x7fc1d00bd9d0 msgr2=0x7fc1d00683a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:57.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.343+0000 7fc1d6439700 1 -- 172.21.15.3:0/3714913027 shutdown_connections 2023-10-08T15:40:57.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.343+0000 7fc1d6439700 1 -- 172.21.15.3:0/3714913027 wait complete. 2023-10-08T15:40:57.350 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'cephfs_metadata' removed 2023-10-08T15:40:57.362 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-08T15:40:57.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.467+0000 7f2bb9533700 1 Processor -- start 2023-10-08T15:40:57.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.467+0000 7f2bb9533700 1 -- start start 2023-10-08T15:40:57.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.471+0000 7f2bb9533700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f2bb41470c0 0x7f2bb4147490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:57.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.471+0000 7f2bb9533700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bb414be20 con 0x7f2bb40a12a0 2023-10-08T15:40:57.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.471+0000 7f2bb9533700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bb40a2250 con 0x7f2bb406eed0 2023-10-08T15:40:57.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.471+0000 7f2bb9533700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bb414bab0 con 0x7f2bb41470c0 2023-10-08T15:40:57.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.471+0000 7f2bb3fff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f2bb41470c0 0x7f2bb4147490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:57.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.471+0000 7f2bb8d32700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f2bb40a12a0 0x7f2bb40bac60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:56206/0 (socket says 172.21.15.3:56206) 2023-10-08T15:40:57.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.471+0000 7f2bb8d32700 1 -- 172.21.15.3:0/3788984017 learned_addr learned my addr 172.21.15.3:0/3788984017 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:40:57.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.471+0000 7f2bb2ffd700 1 -- 172.21.15.3:0/3788984017 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2431625683 0 0) 0x7f2bb414be20 con 0x7f2bb40a12a0 2023-10-08T15:40:57.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.471+0000 7f2bb2ffd700 1 -- 172.21.15.3:0/3788984017 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b9c003570 con 0x7f2bb40a12a0 2023-10-08T15:40:57.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.471+0000 7f2bb2ffd700 1 -- 172.21.15.3:0/3788984017 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2235206929 0 0) 0x7f2bb40a2250 con 0x7f2bb406eed0 2023-10-08T15:40:57.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.471+0000 7f2bb3fff700 1 -- 172.21.15.3:0/3788984017 >> v1:172.21.15.50:6789/0 conn(0x7f2bb406eed0 legacy=0x7f2bb4069150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:57.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.471+0000 7f2bb3fff700 1 -- 172.21.15.3:0/3788984017 >> v1:172.21.15.3:6789/0 conn(0x7f2bb40a12a0 legacy=0x7f2bb40bac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:57.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.471+0000 7f2bb3fff700 1 -- 172.21.15.3:0/3788984017 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb4069860 con 0x7f2bb41470c0 2023-10-08T15:40:57.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.471+0000 7f2bb3fff700 1 --2- 172.21.15.3:0/3788984017 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2bb41470c0 0x7f2bb4147490 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4009910 tx=0x7f2ba40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d8ae4b29d3021e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:57.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.471+0000 7f2bb2ffd700 1 -- 172.21.15.3:0/3788984017 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba400b640 con 0x7f2bb41470c0 2023-10-08T15:40:57.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.471+0000 7f2bb2ffd700 1 -- 172.21.15.3:0/3788984017 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ba400b7a0 con 0x7f2bb41470c0 2023-10-08T15:40:57.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.471+0000 7f2bb2ffd700 1 -- 172.21.15.3:0/3788984017 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba400bb60 con 0x7f2bb41470c0 2023-10-08T15:40:57.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.475+0000 7f2bb9533700 1 -- 172.21.15.3:0/3788984017 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2bb41470c0 msgr2=0x7f2bb4147490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:57.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.475+0000 7f2bb9533700 1 --2- 172.21.15.3:0/3788984017 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2bb41470c0 0x7f2bb4147490 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4009910 tx=0x7f2ba40091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:57.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.475+0000 7f2bb9533700 1 -- 172.21.15.3:0/3788984017 shutdown_connections 2023-10-08T15:40:57.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.475+0000 7f2bb9533700 1 --2- 172.21.15.3:0/3788984017 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2bb41470c0 0x7f2bb4147490 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:57.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.475+0000 7f2bb9533700 1 -- 172.21.15.3:0/3788984017 >> 172.21.15.3:0/3788984017 conn(0x7f2bb40670e0 msgr2=0x7f2bb40674e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:57.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.475+0000 7f2bb9533700 1 -- 172.21.15.3:0/3788984017 shutdown_connections 2023-10-08T15:40:57.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.475+0000 7f2bb9533700 1 -- 172.21.15.3:0/3788984017 wait complete. 2023-10-08T15:40:57.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.475+0000 7f2bb9533700 1 Processor -- start 2023-10-08T15:40:57.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.475+0000 7f2bb9533700 1 -- start start 2023-10-08T15:40:57.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.475+0000 7f2bb9533700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2bb406eed0 0x7f2bb40b2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:57.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.475+0000 7f2bb9533700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2bb40a12a0 0x7f2bb413e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:57.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.475+0000 7f2bb9533700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2bb41470c0 0x7f2bb413e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:57.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.475+0000 7f2bb9533700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb413df10 con 0x7f2bb41470c0 2023-10-08T15:40:57.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.475+0000 7f2bb9533700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb413d8c0 con 0x7f2bb40a12a0 2023-10-08T15:40:57.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.475+0000 7f2bb9533700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb413dba0 con 0x7f2bb406eed0 2023-10-08T15:40:57.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.479+0000 7f2bb8d32700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2bb41470c0 0x7f2bb413e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:57.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.479+0000 7f2bb8d32700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2bb41470c0 0x7f2bb413e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36790/0 (socket says 172.21.15.3:36790) 2023-10-08T15:40:57.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.479+0000 7f2bb8d32700 1 -- 172.21.15.3:0/1910943454 learned_addr learned my addr 172.21.15.3:0/1910943454 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:57.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.479+0000 7f2bb37fe700 1 --2- 172.21.15.3:0/1910943454 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2bb40a12a0 0x7f2bb413e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:57.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.479+0000 7f2bb3fff700 1 --2- 172.21.15.3:0/1910943454 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2bb406eed0 0x7f2bb40b2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:57.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.479+0000 7f2bb8d32700 1 -- 172.21.15.3:0/1910943454 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2bb406eed0 msgr2=0x7f2bb40b2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:57.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.479+0000 7f2bb8d32700 1 --2- 172.21.15.3:0/1910943454 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2bb406eed0 0x7f2bb40b2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:57.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.479+0000 7f2bb8d32700 1 -- 172.21.15.3:0/1910943454 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2bb40a12a0 msgr2=0x7f2bb413e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:57.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.479+0000 7f2bb8d32700 1 --2- 172.21.15.3:0/1910943454 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2bb40a12a0 0x7f2bb413e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:57.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.479+0000 7f2bb8d32700 1 -- 172.21.15.3:0/1910943454 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba4009420 con 0x7f2bb41470c0 2023-10-08T15:40:57.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.479+0000 7f2bb8d32700 1 --2- 172.21.15.3:0/1910943454 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2bb41470c0 0x7f2bb413e8e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f2bac001460 tx=0x7f2bac001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:57.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.479+0000 7f2b9bfff700 1 -- 172.21.15.3:0/1910943454 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bac00a890 con 0x7f2bb41470c0 2023-10-08T15:40:57.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.479+0000 7f2b9bfff700 1 -- 172.21.15.3:0/1910943454 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bac00a9f0 con 0x7f2bb41470c0 2023-10-08T15:40:57.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.479+0000 7f2bb9533700 1 -- 172.21.15.3:0/1910943454 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bb413f5f0 con 0x7f2bb41470c0 2023-10-08T15:40:57.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.479+0000 7f2b9bfff700 1 -- 172.21.15.3:0/1910943454 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bac00ad70 con 0x7f2bb41470c0 2023-10-08T15:40:57.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.479+0000 7f2bb9533700 1 -- 172.21.15.3:0/1910943454 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bb413ee20 con 0x7f2bb41470c0 2023-10-08T15:40:57.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.479+0000 7f2bb9533700 1 -- 172.21.15.3:0/1910943454 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bb413e080 con 0x7f2bb41470c0 2023-10-08T15:40:57.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.483+0000 7f2b9bfff700 1 -- 172.21.15.3:0/1910943454 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f2bac007300 con 0x7f2bb41470c0 2023-10-08T15:40:57.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.483+0000 7f2b9bfff700 1 --2- 172.21.15.3:0/1910943454 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f2ba0060550 0x7f2ba0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:57.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.483+0000 7f2b9bfff700 1 -- 172.21.15.3:0/1910943454 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5353+0+0 (secure 0 0 0) 0x7f2bac07ca40 con 0x7f2bb41470c0 2023-10-08T15:40:57.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.483+0000 7f2bb3fff700 1 --2- 172.21.15.3:0/1910943454 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f2ba0060550 0x7f2ba0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:57.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.483+0000 7f2bb3fff700 1 --2- 172.21.15.3:0/1910943454 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f2ba0060550 0x7f2ba0062a00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2ba40093f0 tx=0x7f2ba4017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:57.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.487+0000 7f2b9bfff700 1 -- 172.21.15.3:0/1910943454 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2bac07ee60 con 0x7f2bb41470c0 2023-10-08T15:40:57.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:57.647+0000 7f2bb9533700 1 -- 172.21.15.3:0/1910943454 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2bb405ecf0 con 0x7f2bb41470c0 2023-10-08T15:40:58.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.335+0000 7f2b9bfff700 1 -- 172.21.15.3:0/1910943454 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v42) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2bac04d180 con 0x7f2bb41470c0 2023-10-08T15:40:58.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.343+0000 7f2bb9533700 1 -- 172.21.15.3:0/1910943454 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f2ba0060550 msgr2=0x7f2ba0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:58.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.343+0000 7f2bb9533700 1 --2- 172.21.15.3:0/1910943454 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f2ba0060550 0x7f2ba0062a00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2ba40093f0 tx=0x7f2ba4017000 comp rx=0 tx=0).stop 2023-10-08T15:40:58.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.343+0000 7f2bb9533700 1 -- 172.21.15.3:0/1910943454 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2bb41470c0 msgr2=0x7f2bb413e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:58.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.343+0000 7f2bb9533700 1 --2- 172.21.15.3:0/1910943454 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2bb41470c0 0x7f2bb413e8e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f2bac001460 tx=0x7f2bac001ae0 comp rx=0 tx=0).stop 2023-10-08T15:40:58.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.343+0000 7f2bb9533700 1 -- 172.21.15.3:0/1910943454 shutdown_connections 2023-10-08T15:40:58.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.343+0000 7f2bb9533700 1 --2- 172.21.15.3:0/1910943454 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f2ba0060550 0x7f2ba0062a00 secure :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2ba40093f0 tx=0x7f2ba4017000 comp rx=0 tx=0).stop 2023-10-08T15:40:58.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.343+0000 7f2bb9533700 1 --2- 172.21.15.3:0/1910943454 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2bb41470c0 0x7f2bb413e8e0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:58.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.343+0000 7f2bb9533700 1 --2- 172.21.15.3:0/1910943454 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2bb40a12a0 0x7f2bb413e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:58.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.343+0000 7f2bb9533700 1 --2- 172.21.15.3:0/1910943454 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2bb406eed0 0x7f2bb40b2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:58.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.343+0000 7f2bb9533700 1 -- 172.21.15.3:0/1910943454 >> 172.21.15.3:0/1910943454 conn(0x7f2bb40670e0 msgr2=0x7f2bb4070550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:58.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.343+0000 7f2bb9533700 1 -- 172.21.15.3:0/1910943454 shutdown_connections 2023-10-08T15:40:58.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.343+0000 7f2bb9533700 1 -- 172.21.15.3:0/1910943454 wait complete. 2023-10-08T15:40:58.358 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'cephfs_data' removed 2023-10-08T15:40:58.371 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-08T15:40:58.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.471+0000 7ff3bbfff700 1 Processor -- start 2023-10-08T15:40:58.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.471+0000 7ff3bbfff700 1 -- start start 2023-10-08T15:40:58.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.471+0000 7ff3bbfff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff3bc06dde0 0x7ff3bc06ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:58.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.475+0000 7ff3bbfff700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3bc14d150 con 0x7ff3bc067650 2023-10-08T15:40:58.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.475+0000 7ff3bbfff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3bc14d430 con 0x7ff3bc067280 2023-10-08T15:40:58.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.475+0000 7ff3bbfff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3bc06e260 con 0x7ff3bc06dde0 2023-10-08T15:40:58.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.475+0000 7ff3b3fff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7ff3bc067650 0x7ff3bc06e700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:56218/0 (socket says 172.21.15.3:56218) 2023-10-08T15:40:58.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.475+0000 7ff3b3fff700 1 -- 172.21.15.3:0/3902528276 learned_addr learned my addr 172.21.15.3:0/3902528276 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:40:58.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.475+0000 7ff3bb7fe700 1 --2- 172.21.15.3:0/3902528276 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff3bc06dde0 0x7ff3bc06ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:58.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.475+0000 7ff3ba7fc700 1 -- 172.21.15.3:0/3902528276 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1898585685 0 0) 0x7ff3bc14d150 con 0x7ff3bc067650 2023-10-08T15:40:58.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.475+0000 7ff3ba7fc700 1 -- 172.21.15.3:0/3902528276 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3a8003570 con 0x7ff3bc067650 2023-10-08T15:40:58.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.475+0000 7ff3ba7fc700 1 -- 172.21.15.3:0/3902528276 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 158411740 0 0) 0x7ff3bc14d430 con 0x7ff3bc067280 2023-10-08T15:40:58.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.475+0000 7ff3ba7fc700 1 -- 172.21.15.3:0/3902528276 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3bc14d150 con 0x7ff3bc067280 2023-10-08T15:40:58.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.475+0000 7ff3bb7fe700 1 -- 172.21.15.3:0/3902528276 >> v1:172.21.15.50:6789/0 conn(0x7ff3bc067280 legacy=0x7ff3bc14c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:58.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.475+0000 7ff3bb7fe700 1 -- 172.21.15.3:0/3902528276 >> v1:172.21.15.3:6789/0 conn(0x7ff3bc067650 legacy=0x7ff3bc06e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:58.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.475+0000 7ff3bb7fe700 1 -- 172.21.15.3:0/3902528276 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3bc14d7a0 con 0x7ff3bc06dde0 2023-10-08T15:40:58.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.475+0000 7ff3bb7fe700 1 --2- 172.21.15.3:0/3902528276 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff3bc06dde0 0x7ff3bc06ee10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4009e90 tx=0x7ff3b4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6b470c205de9644 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:58.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.475+0000 7ff3ba7fc700 1 -- 172.21.15.3:0/3902528276 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b400e070 con 0x7ff3bc06dde0 2023-10-08T15:40:58.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.475+0000 7ff3ba7fc700 1 -- 172.21.15.3:0/3902528276 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b400bb80 con 0x7ff3bc06dde0 2023-10-08T15:40:58.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.475+0000 7ff3ba7fc700 1 -- 172.21.15.3:0/3902528276 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b4012430 con 0x7ff3bc06dde0 2023-10-08T15:40:58.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.475+0000 7ff3bbfff700 1 -- 172.21.15.3:0/3902528276 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff3bc06dde0 msgr2=0x7ff3bc06ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:58.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.475+0000 7ff3bbfff700 1 --2- 172.21.15.3:0/3902528276 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff3bc06dde0 0x7ff3bc06ee10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4009e90 tx=0x7ff3b4009780 comp rx=0 tx=0).stop 2023-10-08T15:40:58.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.475+0000 7ff3bbfff700 1 -- 172.21.15.3:0/3902528276 shutdown_connections 2023-10-08T15:40:58.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.475+0000 7ff3bbfff700 1 --2- 172.21.15.3:0/3902528276 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff3bc06dde0 0x7ff3bc06ee10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:58.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.475+0000 7ff3bbfff700 1 -- 172.21.15.3:0/3902528276 >> 172.21.15.3:0/3902528276 conn(0x7ff3bc0beb10 msgr2=0x7ff3bc0beee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:58.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.475+0000 7ff3bbfff700 1 -- 172.21.15.3:0/3902528276 shutdown_connections 2023-10-08T15:40:58.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.475+0000 7ff3bbfff700 1 -- 172.21.15.3:0/3902528276 wait complete. 2023-10-08T15:40:58.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.479+0000 7ff3bbfff700 1 Processor -- start 2023-10-08T15:40:58.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.479+0000 7ff3bbfff700 1 -- start start 2023-10-08T15:40:58.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.479+0000 7ff3bbfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3bc067280 0x7ff3bc14abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:58.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.479+0000 7ff3bbfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff3bc067650 0x7ff3bc159090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:58.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.479+0000 7ff3bbfff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff3bc06dde0 0x7ff3bc1595d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:58.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.479+0000 7ff3bbfff700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3bc0b6eb0 con 0x7ff3bc067650 2023-10-08T15:40:58.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.479+0000 7ff3bbfff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3bc14b120 con 0x7ff3bc067280 2023-10-08T15:40:58.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.479+0000 7ff3bbfff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3bc0b6880 con 0x7ff3bc06dde0 2023-10-08T15:40:58.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.479+0000 7ff3b3fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff3bc067650 0x7ff3bc159090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:58.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.483+0000 7ff3b3fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff3bc067650 0x7ff3bc159090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36800/0 (socket says 172.21.15.3:36800) 2023-10-08T15:40:58.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.483+0000 7ff3b3fff700 1 -- 172.21.15.3:0/204851884 learned_addr learned my addr 172.21.15.3:0/204851884 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:58.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.483+0000 7ff3baffd700 1 --2- 172.21.15.3:0/204851884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3bc067280 0x7ff3bc14abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:58.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.483+0000 7ff3bb7fe700 1 --2- 172.21.15.3:0/204851884 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff3bc06dde0 0x7ff3bc1595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:58.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.483+0000 7ff3b3fff700 1 -- 172.21.15.3:0/204851884 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff3bc06dde0 msgr2=0x7ff3bc1595d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:58.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.483+0000 7ff3b3fff700 1 --2- 172.21.15.3:0/204851884 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff3bc06dde0 0x7ff3bc1595d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:58.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.483+0000 7ff3b3fff700 1 -- 172.21.15.3:0/204851884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3bc067280 msgr2=0x7ff3bc14abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:58.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.483+0000 7ff3b3fff700 1 --2- 172.21.15.3:0/204851884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3bc067280 0x7ff3bc14abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:58.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.483+0000 7ff3b3fff700 1 -- 172.21.15.3:0/204851884 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b4009a20 con 0x7ff3bc067650 2023-10-08T15:40:58.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.483+0000 7ff3bb7fe700 1 --2- 172.21.15.3:0/204851884 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff3bc06dde0 0x7ff3bc1595d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:40:58.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.483+0000 7ff3b3fff700 1 --2- 172.21.15.3:0/204851884 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff3bc067650 0x7ff3bc159090 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7ff3a400c7c0 tx=0x7ff3a4007e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:58.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.483+0000 7ff3b2ffd700 1 -- 172.21.15.3:0/204851884 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a4005b30 con 0x7ff3bc067650 2023-10-08T15:40:58.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.483+0000 7ff3b2ffd700 1 -- 172.21.15.3:0/204851884 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3a4005c90 con 0x7ff3bc067650 2023-10-08T15:40:58.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.483+0000 7ff3bbfff700 1 -- 172.21.15.3:0/204851884 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3bc158b90 con 0x7ff3bc067650 2023-10-08T15:40:58.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.483+0000 7ff3b2ffd700 1 -- 172.21.15.3:0/204851884 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a4007320 con 0x7ff3bc067650 2023-10-08T15:40:58.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.483+0000 7ff3bbfff700 1 -- 172.21.15.3:0/204851884 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3bc14db30 con 0x7ff3bc067650 2023-10-08T15:40:58.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.483+0000 7ff3bbfff700 1 -- 172.21.15.3:0/204851884 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3bc05ecf0 con 0x7ff3bc067650 2023-10-08T15:40:58.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.483+0000 7ff3b2ffd700 1 -- 172.21.15.3:0/204851884 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff3a401b3b0 con 0x7ff3bc067650 2023-10-08T15:40:58.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.483+0000 7ff3b2ffd700 1 --2- 172.21.15.3:0/204851884 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff39c060580 0x7ff39c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:58.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.483+0000 7ff3b2ffd700 1 -- 172.21.15.3:0/204851884 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4939+0+0 (secure 0 0 0) 0x7ff3a407ba20 con 0x7ff3bc067650 2023-10-08T15:40:58.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.487+0000 7ff3baffd700 1 --2- 172.21.15.3:0/204851884 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff39c060580 0x7ff39c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:58.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.487+0000 7ff3baffd700 1 --2- 172.21.15.3:0/204851884 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff39c060580 0x7ff39c062a30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac007fd0 tx=0x7ff3ac007d50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:58.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.491+0000 7ff3b2ffd700 1 -- 172.21.15.3:0/204851884 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff3a404c310 con 0x7ff3bc067650 2023-10-08T15:40:58.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.679+0000 7ff3bbfff700 1 -- 172.21.15.3:0/204851884 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7ff3bc06f350 con 0x7ff3bc067650 2023-10-08T15:40:58.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.683+0000 7ff3b2ffd700 1 -- 172.21.15.3:0/204851884 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff3a404f930 con 0x7ff3bc067650 2023-10-08T15:40:58.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.687+0000 7ff3bbfff700 1 -- 172.21.15.3:0/204851884 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff39c060580 msgr2=0x7ff39c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:58.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.687+0000 7ff3bbfff700 1 --2- 172.21.15.3:0/204851884 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff39c060580 0x7ff39c062a30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac007fd0 tx=0x7ff3ac007d50 comp rx=0 tx=0).stop 2023-10-08T15:40:58.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.687+0000 7ff3bbfff700 1 -- 172.21.15.3:0/204851884 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff3bc067650 msgr2=0x7ff3bc159090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:58.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.687+0000 7ff3bbfff700 1 --2- 172.21.15.3:0/204851884 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff3bc067650 0x7ff3bc159090 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7ff3a400c7c0 tx=0x7ff3a4007e20 comp rx=0 tx=0).stop 2023-10-08T15:40:58.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.687+0000 7ff3bbfff700 1 -- 172.21.15.3:0/204851884 shutdown_connections 2023-10-08T15:40:58.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.687+0000 7ff3bbfff700 1 --2- 172.21.15.3:0/204851884 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff39c060580 0x7ff39c062a30 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:58.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.687+0000 7ff3bbfff700 1 --2- 172.21.15.3:0/204851884 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff3bc06dde0 0x7ff3bc1595d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:58.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.687+0000 7ff3bbfff700 1 --2- 172.21.15.3:0/204851884 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff3bc067650 0x7ff3bc159090 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:58.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.687+0000 7ff3bbfff700 1 --2- 172.21.15.3:0/204851884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3bc067280 0x7ff3bc14abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:58.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.687+0000 7ff3bbfff700 1 -- 172.21.15.3:0/204851884 >> 172.21.15.3:0/204851884 conn(0x7ff3bc0beb10 msgr2=0x7ff3bc0681d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:58.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.687+0000 7ff3bbfff700 1 -- 172.21.15.3:0/204851884 shutdown_connections 2023-10-08T15:40:58.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.687+0000 7ff3bbfff700 1 -- 172.21.15.3:0/204851884 wait complete. 2023-10-08T15:40:58.703 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead' 2023-10-08T15:40:58.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.807+0000 7f0dfb444700 1 Processor -- start 2023-10-08T15:40:58.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.807+0000 7f0dfb444700 1 -- start start 2023-10-08T15:40:58.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.807+0000 7f0dfb444700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f0df40b3530 0x7f0df414abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:58.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.807+0000 7f0dfb444700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0df406e020 0x7f0df414b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:58.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.807+0000 7f0dfb444700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0df40b8a00 con 0x7f0df40b2830 2023-10-08T15:40:58.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.807+0000 7f0dfb444700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0df40b2f80 con 0x7f0df40b3530 2023-10-08T15:40:58.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.807+0000 7f0dfb444700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0df40b83d0 con 0x7f0df406e020 2023-10-08T15:40:58.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.807+0000 7f0df91e0700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f0df40b3530 0x7f0df414abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:58.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.807+0000 7f0df91e0700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f0df40b3530 0x7f0df414abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36812/0 (socket says 172.21.15.3:36812) 2023-10-08T15:40:58.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.807+0000 7f0df91e0700 1 -- 172.21.15.3:0/2145839822 learned_addr learned my addr 172.21.15.3:0/2145839822 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:58.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.807+0000 7f0df91e0700 1 -- 172.21.15.3:0/2145839822 >> v2:172.21.15.50:3300/0 conn(0x7f0df406e020 msgr2=0x7f0df414b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:58.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.807+0000 7f0df99e1700 1 --2- 172.21.15.3:0/2145839822 >> v2:172.21.15.50:3300/0 conn(0x7f0df406e020 0x7f0df414b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:58.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.807+0000 7f0df91e0700 1 --2- 172.21.15.3:0/2145839822 >> v2:172.21.15.50:3300/0 conn(0x7f0df406e020 0x7f0df414b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:58.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.807+0000 7f0df91e0700 1 -- 172.21.15.3:0/2145839822 >> v1:172.21.15.50:6789/0 conn(0x7f0df40b2830 legacy=0x7f0df414ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:58.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.807+0000 7f0df91e0700 1 -- 172.21.15.3:0/2145839822 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df40b8690 con 0x7f0df40b3530 2023-10-08T15:40:58.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.811+0000 7f0df99e1700 1 --2- 172.21.15.3:0/2145839822 >> v2:172.21.15.50:3300/0 conn(0x7f0df406e020 0x7f0df414b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:40:58.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.811+0000 7f0df91e0700 1 --2- 172.21.15.3:0/2145839822 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0df40b3530 0x7f0df414abe0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f0df40ba630 tx=0x7f0de4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=380d591708734271 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:58.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.811+0000 7f0debfff700 1 -- 172.21.15.3:0/2145839822 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de400b820 con 0x7f0df40b3530 2023-10-08T15:40:58.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.811+0000 7f0debfff700 1 -- 172.21.15.3:0/2145839822 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0de400b980 con 0x7f0df40b3530 2023-10-08T15:40:58.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.811+0000 7f0debfff700 1 -- 172.21.15.3:0/2145839822 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de400bd20 con 0x7f0df40b3530 2023-10-08T15:40:58.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.811+0000 7f0dfb444700 1 -- 172.21.15.3:0/2145839822 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0df40b3530 msgr2=0x7f0df414abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:58.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.811+0000 7f0dfb444700 1 --2- 172.21.15.3:0/2145839822 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0df40b3530 0x7f0df414abe0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f0df40ba630 tx=0x7f0de4009250 comp rx=0 tx=0).stop 2023-10-08T15:40:58.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.811+0000 7f0dfb444700 1 -- 172.21.15.3:0/2145839822 shutdown_connections 2023-10-08T15:40:58.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.811+0000 7f0dfb444700 1 --2- 172.21.15.3:0/2145839822 >> v2:172.21.15.50:3300/0 conn(0x7f0df406e020 0x7f0df414b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:58.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.811+0000 7f0dfb444700 1 --2- 172.21.15.3:0/2145839822 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0df40b3530 0x7f0df414abe0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:58.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.811+0000 7f0dfb444700 1 -- 172.21.15.3:0/2145839822 >> 172.21.15.3:0/2145839822 conn(0x7f0df40be630 msgr2=0x7f0df40ba6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:58.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.811+0000 7f0dfb444700 1 -- 172.21.15.3:0/2145839822 shutdown_connections 2023-10-08T15:40:58.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.811+0000 7f0dfb444700 1 -- 172.21.15.3:0/2145839822 wait complete. 2023-10-08T15:40:58.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.815+0000 7f0dfb444700 1 Processor -- start 2023-10-08T15:40:58.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.815+0000 7f0dfb444700 1 -- start start 2023-10-08T15:40:58.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.815+0000 7f0dfb444700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0df406e020 0x7f0df414e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:58.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.815+0000 7f0dfb444700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0df40b2830 0x7f0df414d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:58.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.815+0000 7f0dfb444700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0df40b3530 0x7f0df4149520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:58.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.815+0000 7f0dfb444700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df4095ca0 con 0x7f0df40b3530 2023-10-08T15:40:58.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.815+0000 7f0dfb444700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df40962a0 con 0x7f0df406e020 2023-10-08T15:40:58.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.815+0000 7f0dfb444700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0df414a3b0 con 0x7f0df40b2830 2023-10-08T15:40:58.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.815+0000 7f0df99e1700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0df40b3530 0x7f0df4149520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:58.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.815+0000 7f0df99e1700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0df40b3530 0x7f0df4149520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36824/0 (socket says 172.21.15.3:36824) 2023-10-08T15:40:58.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.815+0000 7f0df99e1700 1 -- 172.21.15.3:0/2786701975 learned_addr learned my addr 172.21.15.3:0/2786701975 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:58.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.815+0000 7f0df91e0700 1 --2- 172.21.15.3:0/2786701975 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0df406e020 0x7f0df414e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:58.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.815+0000 7f0df99e1700 1 -- 172.21.15.3:0/2786701975 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0df40b2830 msgr2=0x7f0df414d370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T15:40:58.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.815+0000 7f0df99e1700 1 --2- 172.21.15.3:0/2786701975 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0df40b2830 0x7f0df414d370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:58.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.815+0000 7f0df99e1700 1 -- 172.21.15.3:0/2786701975 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0df406e020 msgr2=0x7f0df414e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:58.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.815+0000 7f0df99e1700 1 --2- 172.21.15.3:0/2786701975 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0df406e020 0x7f0df414e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:58.821 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.815+0000 7f0df99e1700 1 -- 172.21.15.3:0/2786701975 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de40094f0 con 0x7f0df40b3530 2023-10-08T15:40:58.821 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.815+0000 7f0df99e1700 1 --2- 172.21.15.3:0/2786701975 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0df40b3530 0x7f0df4149520 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f0df000c880 tx=0x7f0df0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:58.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.815+0000 7f0de97fa700 1 -- 172.21.15.3:0/2786701975 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df0011600 con 0x7f0df40b3530 2023-10-08T15:40:58.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.815+0000 7f0de97fa700 1 -- 172.21.15.3:0/2786701975 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0df0011760 con 0x7f0df40b3530 2023-10-08T15:40:58.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.815+0000 7f0dfb444700 1 -- 172.21.15.3:0/2786701975 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0df414dd40 con 0x7f0df40b3530 2023-10-08T15:40:58.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.815+0000 7f0de97fa700 1 -- 172.21.15.3:0/2786701975 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df0011b20 con 0x7f0df40b3530 2023-10-08T15:40:58.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.815+0000 7f0dfb444700 1 -- 172.21.15.3:0/2786701975 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0df414da50 con 0x7f0df40b3530 2023-10-08T15:40:58.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.819+0000 7f0dfb444700 1 -- 172.21.15.3:0/2786701975 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0df4095a70 con 0x7f0df40b3530 2023-10-08T15:40:58.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.819+0000 7f0de97fa700 1 -- 172.21.15.3:0/2786701975 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f0df00193f0 con 0x7f0df40b3530 2023-10-08T15:40:58.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.819+0000 7f0de97fa700 1 --2- 172.21.15.3:0/2786701975 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f0dd8060620 0x7f0dd8062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:58.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.819+0000 7f0de97fa700 1 -- 172.21.15.3:0/2786701975 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f0df007caf0 con 0x7f0df40b3530 2023-10-08T15:40:58.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.819+0000 7f0df91e0700 1 --2- 172.21.15.3:0/2786701975 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f0dd8060620 0x7f0dd8062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:58.824 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.819+0000 7f0df91e0700 1 --2- 172.21.15.3:0/2786701975 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f0dd8060620 0x7f0dd8062ad0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0df40ba630 tx=0x7f0de4016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:58.828 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:58.823+0000 7f0de97fa700 1 -- 172.21.15.3:0/2786701975 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0df004d440 con 0x7f0df40b3530 2023-10-08T15:40:59.047 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.043+0000 7f0dfb444700 1 -- 172.21.15.3:0/2786701975 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead"]} v 0) v1 -- 0x7f0df4095e50 con 0x7f0df40b3530 2023-10-08T15:40:59.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.346+0000 7f0de97fa700 1 -- 172.21.15.3:0/2786701975 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead"]}]=0 v163) v1 ==== 144+0+0 (secure 0 0 0) 0x7f0df4095e50 con 0x7f0df40b3530 2023-10-08T15:40:59.355 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.350+0000 7f0dfb444700 1 -- 172.21.15.3:0/2786701975 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f0dd8060620 msgr2=0x7f0dd8062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:59.355 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.350+0000 7f0dfb444700 1 --2- 172.21.15.3:0/2786701975 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f0dd8060620 0x7f0dd8062ad0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0df40ba630 tx=0x7f0de4016000 comp rx=0 tx=0).stop 2023-10-08T15:40:59.355 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.350+0000 7f0dfb444700 1 -- 172.21.15.3:0/2786701975 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0df40b3530 msgr2=0x7f0df4149520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:59.355 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.350+0000 7f0dfb444700 1 --2- 172.21.15.3:0/2786701975 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0df40b3530 0x7f0df4149520 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f0df000c880 tx=0x7f0df0008040 comp rx=0 tx=0).stop 2023-10-08T15:40:59.355 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.350+0000 7f0dfb444700 1 -- 172.21.15.3:0/2786701975 shutdown_connections 2023-10-08T15:40:59.355 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.350+0000 7f0dfb444700 1 --2- 172.21.15.3:0/2786701975 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f0dd8060620 0x7f0dd8062ad0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:59.355 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.350+0000 7f0dfb444700 1 --2- 172.21.15.3:0/2786701975 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0df40b3530 0x7f0df4149520 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:59.355 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.350+0000 7f0dfb444700 1 --2- 172.21.15.3:0/2786701975 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0df40b2830 0x7f0df414d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:59.356 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.350+0000 7f0dfb444700 1 --2- 172.21.15.3:0/2786701975 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0df406e020 0x7f0df414e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:59.356 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.350+0000 7f0dfb444700 1 -- 172.21.15.3:0/2786701975 >> 172.21.15.3:0/2786701975 conn(0x7f0df40be630 msgr2=0x7f0df414f320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:59.356 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.350+0000 7f0dfb444700 1 -- 172.21.15.3:0/2786701975 shutdown_connections 2023-10-08T15:40:59.356 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.350+0000 7f0dfb444700 1 -- 172.21.15.3:0/2786701975 wait complete. 2023-10-08T15:40:59.371 INFO:tasks.cephfs_test_runner:Check drop cache command with non-responding client using tell ... ok 2023-10-08T15:40:59.372 INFO:tasks.cephfs_test_runner:Starting test: test_drop_cache_command_dead_timeout (tasks.cephfs.test_misc.TestCacheDrop) Check drop cache command with non-responding client using tell 2023-10-08T15:40:59.372 INFO:tasks.cephfs_test_runner:test_drop_cache_command_dead_timeout (tasks.cephfs.test_misc.TestCacheDrop) 2023-10-08T15:40:59.372 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout' 2023-10-08T15:40:59.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.486+0000 7f79e4c11700 1 Processor -- start 2023-10-08T15:40:59.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.486+0000 7f79e4c11700 1 -- start start 2023-10-08T15:40:59.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.486+0000 7f79e4c11700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f79e00bbf00 0x7f79e014ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:59.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.486+0000 7f79e4c11700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f79e00be600 0x7f79e014abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:59.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.486+0000 7f79e4c11700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79e014fbd0 con 0x7f79e00bcdd0 2023-10-08T15:40:59.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.486+0000 7f79e4c11700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79e00b29d0 con 0x7f79e00be600 2023-10-08T15:40:59.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.486+0000 7f79e4c11700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79e00be9d0 con 0x7f79e00bbf00 2023-10-08T15:40:59.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.486+0000 7f79dffff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f79e00be600 0x7f79e014abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:59.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.486+0000 7f79deffd700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f79e00bcdd0 0x7f79e014f4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:56228/0 (socket says 172.21.15.3:56228) 2023-10-08T15:40:59.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.486+0000 7f79deffd700 1 -- 172.21.15.3:0/1503153823 learned_addr learned my addr 172.21.15.3:0/1503153823 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:40:59.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.486+0000 7f79dffff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f79e00be600 0x7f79e014abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36840/0 (socket says 172.21.15.3:36840) 2023-10-08T15:40:59.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.486+0000 7f79df7fe700 1 --2- 172.21.15.3:0/1503153823 >> v2:172.21.15.50:3300/0 conn(0x7f79e00bbf00 0x7f79e014ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:59.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.486+0000 7f79dffff700 1 -- 172.21.15.3:0/1503153823 >> v2:172.21.15.50:3300/0 conn(0x7f79e00bbf00 msgr2=0x7f79e014ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:59.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.486+0000 7f79dffff700 1 --2- 172.21.15.3:0/1503153823 >> v2:172.21.15.50:3300/0 conn(0x7f79e00bbf00 0x7f79e014ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:59.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.486+0000 7f79dffff700 1 -- 172.21.15.3:0/1503153823 >> v1:172.21.15.3:6789/0 conn(0x7f79e00bcdd0 legacy=0x7f79e014f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:59.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.486+0000 7f79de7fc700 1 -- 172.21.15.3:0/1503153823 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1120250326 0 0) 0x7f79e014fbd0 con 0x7f79e00bcdd0 2023-10-08T15:40:59.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.486+0000 7f79dffff700 1 -- 172.21.15.3:0/1503153823 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e00b1ee0 con 0x7f79e00be600 2023-10-08T15:40:59.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.486+0000 7f79dffff700 1 --2- 172.21.15.3:0/1503153823 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f79e00be600 0x7f79e014abd0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f79e006efc0 tx=0x7f79d8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6c23b8e38a1eb59 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:59.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.486+0000 7f79de7fc700 1 -- 172.21.15.3:0/1503153823 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d800e070 con 0x7f79e00be600 2023-10-08T15:40:59.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.486+0000 7f79de7fc700 1 -- 172.21.15.3:0/1503153823 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d800bc30 con 0x7f79e00be600 2023-10-08T15:40:59.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.486+0000 7f79de7fc700 1 -- 172.21.15.3:0/1503153823 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d8012430 con 0x7f79e00be600 2023-10-08T15:40:59.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.490+0000 7f79e4c11700 1 -- 172.21.15.3:0/1503153823 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f79e00be600 msgr2=0x7f79e014abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:59.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.490+0000 7f79e4c11700 1 --2- 172.21.15.3:0/1503153823 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f79e00be600 0x7f79e014abd0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f79e006efc0 tx=0x7f79d8009780 comp rx=0 tx=0).stop 2023-10-08T15:40:59.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.490+0000 7f79e4c11700 1 -- 172.21.15.3:0/1503153823 shutdown_connections 2023-10-08T15:40:59.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.490+0000 7f79e4c11700 1 --2- 172.21.15.3:0/1503153823 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f79e00be600 0x7f79e014abd0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:59.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.490+0000 7f79e4c11700 1 --2- 172.21.15.3:0/1503153823 >> v2:172.21.15.50:3300/0 conn(0x7f79e00bbf00 0x7f79e014ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:59.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.490+0000 7f79e4c11700 1 -- 172.21.15.3:0/1503153823 >> 172.21.15.3:0/1503153823 conn(0x7f79e00bf5e0 msgr2=0x7f79e00bb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:59.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.490+0000 7f79e4c11700 1 -- 172.21.15.3:0/1503153823 shutdown_connections 2023-10-08T15:40:59.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.490+0000 7f79e4c11700 1 -- 172.21.15.3:0/1503153823 wait complete. 2023-10-08T15:40:59.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.490+0000 7f79e4c11700 1 Processor -- start 2023-10-08T15:40:59.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.490+0000 7f79e4c11700 1 -- start start 2023-10-08T15:40:59.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.494+0000 7f79e4c11700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f79e00bbf00 0x7f79e0096a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:59.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.494+0000 7f79e4c11700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79e00bcdd0 0x7f79e009aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:59.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.494+0000 7f79e4c11700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f79e00be600 0x7f79e015afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:59.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.494+0000 7f79e4c11700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e009a600 con 0x7f79e00bbf00 2023-10-08T15:40:59.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.494+0000 7f79e4c11700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e015bcc0 con 0x7f79e00bcdd0 2023-10-08T15:40:59.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.494+0000 7f79e4c11700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e0098fa0 con 0x7f79e00be600 2023-10-08T15:40:59.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.494+0000 7f79df7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f79e00bbf00 0x7f79e0096a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:59.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.494+0000 7f79df7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f79e00bbf00 0x7f79e0096a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36854/0 (socket says 172.21.15.3:36854) 2023-10-08T15:40:59.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.494+0000 7f79df7fe700 1 -- 172.21.15.3:0/484043477 learned_addr learned my addr 172.21.15.3:0/484043477 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:40:59.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.494+0000 7f79deffd700 1 --2- 172.21.15.3:0/484043477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79e00bcdd0 0x7f79e009aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:59.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.494+0000 7f79dffff700 1 --2- 172.21.15.3:0/484043477 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f79e00be600 0x7f79e015afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:59.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.494+0000 7f79df7fe700 1 -- 172.21.15.3:0/484043477 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f79e00be600 msgr2=0x7f79e015afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:59.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.494+0000 7f79df7fe700 1 --2- 172.21.15.3:0/484043477 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f79e00be600 0x7f79e015afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:59.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.494+0000 7f79df7fe700 1 -- 172.21.15.3:0/484043477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79e00bcdd0 msgr2=0x7f79e009aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:59.501 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.494+0000 7f79df7fe700 1 --2- 172.21.15.3:0/484043477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79e00bcdd0 0x7f79e009aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:59.501 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.494+0000 7f79df7fe700 1 -- 172.21.15.3:0/484043477 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d8009a20 con 0x7f79e00bbf00 2023-10-08T15:40:59.501 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.494+0000 7f79df7fe700 1 --2- 172.21.15.3:0/484043477 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f79e00bbf00 0x7f79e0096a40 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f79d000d8c0 tx=0x7f79d0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:59.501 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.494+0000 7f79d77fe700 1 -- 172.21.15.3:0/484043477 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d0018070 con 0x7f79e00bbf00 2023-10-08T15:40:59.501 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.494+0000 7f79d77fe700 1 -- 172.21.15.3:0/484043477 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d0005a00 con 0x7f79e00bbf00 2023-10-08T15:40:59.501 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.494+0000 7f79e4c11700 1 -- 172.21.15.3:0/484043477 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79e0099280 con 0x7f79e00bbf00 2023-10-08T15:40:59.501 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.494+0000 7f79d77fe700 1 -- 172.21.15.3:0/484043477 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d0005dc0 con 0x7f79e00bbf00 2023-10-08T15:40:59.501 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.494+0000 7f79e4c11700 1 -- 172.21.15.3:0/484043477 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79e0097000 con 0x7f79e00bbf00 2023-10-08T15:40:59.502 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.494+0000 7f79e4c11700 1 -- 172.21.15.3:0/484043477 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79e005ecf0 con 0x7f79e00bbf00 2023-10-08T15:40:59.502 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.498+0000 7f79d77fe700 1 -- 172.21.15.3:0/484043477 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f79d0012800 con 0x7f79e00bbf00 2023-10-08T15:40:59.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.498+0000 7f79d77fe700 1 --2- 172.21.15.3:0/484043477 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f79c0060550 0x7f79c0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:59.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.498+0000 7f79d77fe700 1 -- 172.21.15.3:0/484043477 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f79d007c5d0 con 0x7f79e00bbf00 2023-10-08T15:40:59.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.498+0000 7f79deffd700 1 --2- 172.21.15.3:0/484043477 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f79c0060550 0x7f79c0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:59.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.498+0000 7f79deffd700 1 --2- 172.21.15.3:0/484043477 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f79c0060550 0x7f79c0062a00 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f79e0069cf0 tx=0x7f79c8007d30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:59.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.506+0000 7f79d77fe700 1 -- 172.21.15.3:0/484043477 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f79d0050950 con 0x7f79e00bbf00 2023-10-08T15:40:59.729 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:40:59.722+0000 7f79e4c11700 1 -- 172.21.15.3:0/484043477 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout"]} v 0) v1 -- 0x7f79e00639f0 con 0x7f79e00bbf00 2023-10-08T15:41:00.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.350+0000 7f79d77fe700 1 -- 172.21.15.3:0/484043477 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout"]}]=0 v164) v1 ==== 155+0+0 (secure 0 0 0) 0x7f79d00504e0 con 0x7f79e00bbf00 2023-10-08T15:41:00.358 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.354+0000 7f79e4c11700 1 -- 172.21.15.3:0/484043477 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f79c0060550 msgr2=0x7f79c0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:00.358 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.354+0000 7f79e4c11700 1 --2- 172.21.15.3:0/484043477 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f79c0060550 0x7f79c0062a00 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f79e0069cf0 tx=0x7f79c8007d30 comp rx=0 tx=0).stop 2023-10-08T15:41:00.358 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.354+0000 7f79e4c11700 1 -- 172.21.15.3:0/484043477 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f79e00bbf00 msgr2=0x7f79e0096a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:00.358 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.354+0000 7f79e4c11700 1 --2- 172.21.15.3:0/484043477 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f79e00bbf00 0x7f79e0096a40 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f79d000d8c0 tx=0x7f79d0008040 comp rx=0 tx=0).stop 2023-10-08T15:41:00.358 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.354+0000 7f79e4c11700 1 -- 172.21.15.3:0/484043477 shutdown_connections 2023-10-08T15:41:00.359 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.354+0000 7f79e4c11700 1 --2- 172.21.15.3:0/484043477 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f79c0060550 0x7f79c0062a00 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:00.359 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.354+0000 7f79e4c11700 1 --2- 172.21.15.3:0/484043477 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f79e00be600 0x7f79e015afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:00.359 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.354+0000 7f79e4c11700 1 --2- 172.21.15.3:0/484043477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79e00bcdd0 0x7f79e009aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:00.359 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.354+0000 7f79e4c11700 1 --2- 172.21.15.3:0/484043477 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f79e00bbf00 0x7f79e0096a40 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:00.359 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.354+0000 7f79e4c11700 1 -- 172.21.15.3:0/484043477 >> 172.21.15.3:0/484043477 conn(0x7f79e00bf5e0 msgr2=0x7f79e014de10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:00.359 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.354+0000 7f79e4c11700 1 -- 172.21.15.3:0/484043477 shutdown_connections 2023-10-08T15:41:00.359 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.354+0000 7f79e4c11700 1 -- 172.21.15.3:0/484043477 wait complete. 2023-10-08T15:41:00.375 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-08T15:41:00.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.494+0000 7f35ada40700 1 Processor -- start 2023-10-08T15:41:00.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.494+0000 7f35ada40700 1 -- start start 2023-10-08T15:41:00.501 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.494+0000 7f35ada40700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f35a806e4d0 0x7f35a80b4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:00.501 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.494+0000 7f35ada40700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35a80b4070 con 0x7f35a80bc1d0 2023-10-08T15:41:00.501 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.494+0000 7f35ada40700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35a806e030 con 0x7f35a80a2d50 2023-10-08T15:41:00.502 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.494+0000 7f35ada40700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35a806e310 con 0x7f35a806e4d0 2023-10-08T15:41:00.502 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.498+0000 7f35a6ffd700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f35a80bc1d0 0x7f35a814cbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:56244/0 (socket says 172.21.15.3:56244) 2023-10-08T15:41:00.502 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.498+0000 7f35a6ffd700 1 -- 172.21.15.3:0/2841137776 learned_addr learned my addr 172.21.15.3:0/2841137776 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:41:00.502 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.498+0000 7f35a67fc700 1 --2- 172.21.15.3:0/2841137776 >> v2:172.21.15.50:3300/0 conn(0x7f35a806e4d0 0x7f35a80b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:00.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.498+0000 7f35a5ffb700 1 -- 172.21.15.3:0/2841137776 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2205843469 0 0) 0x7f35a80b4070 con 0x7f35a80bc1d0 2023-10-08T15:41:00.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.498+0000 7f35a5ffb700 1 -- 172.21.15.3:0/2841137776 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3590003570 con 0x7f35a80bc1d0 2023-10-08T15:41:00.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.498+0000 7f35a5ffb700 1 -- 172.21.15.3:0/2841137776 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2784501123 0 0) 0x7f35a806e030 con 0x7f35a80a2d50 2023-10-08T15:41:00.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.498+0000 7f35a5ffb700 1 -- 172.21.15.3:0/2841137776 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35a80b4070 con 0x7f35a80a2d50 2023-10-08T15:41:00.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.498+0000 7f35a67fc700 1 -- 172.21.15.3:0/2841137776 >> v1:172.21.15.50:6789/0 conn(0x7f35a80a2d50 legacy=0x7f35a8148a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:00.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.498+0000 7f35a67fc700 1 -- 172.21.15.3:0/2841137776 >> v1:172.21.15.3:6789/0 conn(0x7f35a80bc1d0 legacy=0x7f35a814cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:00.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.498+0000 7f35a67fc700 1 -- 172.21.15.3:0/2841137776 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a80bc5a0 con 0x7f35a806e4d0 2023-10-08T15:41:00.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.498+0000 7f35a67fc700 1 --2- 172.21.15.3:0/2841137776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35a806e4d0 0x7f35a80b4500 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f359c0098e0 tx=0x7f359c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c92db0ce08b1e465 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:00.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.498+0000 7f35a5ffb700 1 -- 172.21.15.3:0/2841137776 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359c011630 con 0x7f35a806e4d0 2023-10-08T15:41:00.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.498+0000 7f35a5ffb700 1 -- 172.21.15.3:0/2841137776 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f359c011790 con 0x7f35a806e4d0 2023-10-08T15:41:00.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.498+0000 7f35a5ffb700 1 -- 172.21.15.3:0/2841137776 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359c011b10 con 0x7f35a806e4d0 2023-10-08T15:41:00.505 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.498+0000 7f35ada40700 1 -- 172.21.15.3:0/2841137776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35a806e4d0 msgr2=0x7f35a80b4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:00.505 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.498+0000 7f35ada40700 1 --2- 172.21.15.3:0/2841137776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35a806e4d0 0x7f35a80b4500 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f359c0098e0 tx=0x7f359c0091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:00.505 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.498+0000 7f35ada40700 1 -- 172.21.15.3:0/2841137776 shutdown_connections 2023-10-08T15:41:00.505 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.498+0000 7f35ada40700 1 --2- 172.21.15.3:0/2841137776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35a806e4d0 0x7f35a80b4500 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:00.505 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.498+0000 7f35ada40700 1 -- 172.21.15.3:0/2841137776 >> 172.21.15.3:0/2841137776 conn(0x7f35a80bf870 msgr2=0x7f35a80bb890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:00.505 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.498+0000 7f35ada40700 1 -- 172.21.15.3:0/2841137776 shutdown_connections 2023-10-08T15:41:00.505 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.498+0000 7f35ada40700 1 -- 172.21.15.3:0/2841137776 wait complete. 2023-10-08T15:41:00.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.502+0000 7f35ada40700 1 Processor -- start 2023-10-08T15:41:00.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.502+0000 7f35ada40700 1 -- start start 2023-10-08T15:41:00.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.502+0000 7f35ada40700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35a806e4d0 0x7f35a8140ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:00.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.502+0000 7f35ada40700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f35a80a2d50 0x7f35a8159e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:00.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.502+0000 7f35ada40700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f35a80bc1d0 0x7f35a813d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:00.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.502+0000 7f35ada40700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a8141bd0 con 0x7f35a80bc1d0 2023-10-08T15:41:00.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.502+0000 7f35ada40700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a8142050 con 0x7f35a806e4d0 2023-10-08T15:41:00.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.502+0000 7f35ada40700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a8141530 con 0x7f35a80a2d50 2023-10-08T15:41:00.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.502+0000 7f35a77fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f35a80bc1d0 0x7f35a813d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:00.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.502+0000 7f35a77fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f35a80bc1d0 0x7f35a813d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36862/0 (socket says 172.21.15.3:36862) 2023-10-08T15:41:00.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.502+0000 7f35a77fe700 1 -- 172.21.15.3:0/694284908 learned_addr learned my addr 172.21.15.3:0/694284908 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:00.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.502+0000 7f35a6ffd700 1 --2- 172.21.15.3:0/694284908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35a806e4d0 0x7f35a8140ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:00.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.502+0000 7f35a67fc700 1 --2- 172.21.15.3:0/694284908 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f35a80a2d50 0x7f35a8159e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:00.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.502+0000 7f35a77fe700 1 -- 172.21.15.3:0/694284908 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f35a80a2d50 msgr2=0x7f35a8159e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:00.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.502+0000 7f35a77fe700 1 --2- 172.21.15.3:0/694284908 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f35a80a2d50 0x7f35a8159e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:00.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.502+0000 7f35a77fe700 1 -- 172.21.15.3:0/694284908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35a806e4d0 msgr2=0x7f35a8140ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:00.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.502+0000 7f35a77fe700 1 --2- 172.21.15.3:0/694284908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35a806e4d0 0x7f35a8140ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:00.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.502+0000 7f35a77fe700 1 -- 172.21.15.3:0/694284908 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f359c009420 con 0x7f35a80bc1d0 2023-10-08T15:41:00.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.506+0000 7f35a77fe700 1 --2- 172.21.15.3:0/694284908 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f35a80bc1d0 0x7f35a813d300 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f35a000c910 tx=0x7f35a0007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:00.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.506+0000 7f358effd700 1 -- 172.21.15.3:0/694284908 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a0012630 con 0x7f35a80bc1d0 2023-10-08T15:41:00.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.506+0000 7f358effd700 1 -- 172.21.15.3:0/694284908 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a00127b0 con 0x7f35a80bc1d0 2023-10-08T15:41:00.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.506+0000 7f35ada40700 1 -- 172.21.15.3:0/694284908 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35a813f200 con 0x7f35a80bc1d0 2023-10-08T15:41:00.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.506+0000 7f358effd700 1 -- 172.21.15.3:0/694284908 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a0012b70 con 0x7f35a80bc1d0 2023-10-08T15:41:00.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.506+0000 7f35ada40700 1 -- 172.21.15.3:0/694284908 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35a81417f0 con 0x7f35a80bc1d0 2023-10-08T15:41:00.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.506+0000 7f35ada40700 1 -- 172.21.15.3:0/694284908 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35a80b4a70 con 0x7f35a80bc1d0 2023-10-08T15:41:00.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.506+0000 7f358effd700 1 -- 172.21.15.3:0/694284908 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f35a001b400 con 0x7f35a80bc1d0 2023-10-08T15:41:00.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.506+0000 7f358effd700 1 --2- 172.21.15.3:0/694284908 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3594060580 0x7f3594062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:00.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.506+0000 7f358effd700 1 -- 172.21.15.3:0/694284908 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f35a007c830 con 0x7f35a80bc1d0 2023-10-08T15:41:00.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.506+0000 7f35a6ffd700 1 --2- 172.21.15.3:0/694284908 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3594060580 0x7f3594062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:00.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.510+0000 7f35a6ffd700 1 --2- 172.21.15.3:0/694284908 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3594060580 0x7f3594062a30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3598007fd0 tx=0x7f3598009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:00.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.514+0000 7f358effd700 1 -- 172.21.15.3:0/694284908 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f35a80b4a70 con 0x7f35a80bc1d0 2023-10-08T15:41:00.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.678+0000 7f35ada40700 1 -- 172.21.15.3:0/694284908 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f35a80b4a70 con 0x7f35a80bc1d0 2023-10-08T15:41:00.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.682+0000 7f358effd700 1 -- 172.21.15.3:0/694284908 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f35a80b4a70 con 0x7f35a80bc1d0 2023-10-08T15:41:00.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.686+0000 7f35ada40700 1 -- 172.21.15.3:0/694284908 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3594060580 msgr2=0x7f3594062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:00.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.686+0000 7f35ada40700 1 --2- 172.21.15.3:0/694284908 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3594060580 0x7f3594062a30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3598007fd0 tx=0x7f3598009040 comp rx=0 tx=0).stop 2023-10-08T15:41:00.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.686+0000 7f35ada40700 1 -- 172.21.15.3:0/694284908 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f35a80bc1d0 msgr2=0x7f35a813d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:00.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.686+0000 7f35ada40700 1 --2- 172.21.15.3:0/694284908 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f35a80bc1d0 0x7f35a813d300 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f35a000c910 tx=0x7f35a0007f90 comp rx=0 tx=0).stop 2023-10-08T15:41:00.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.686+0000 7f35ada40700 1 -- 172.21.15.3:0/694284908 shutdown_connections 2023-10-08T15:41:00.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.686+0000 7f35ada40700 1 --2- 172.21.15.3:0/694284908 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3594060580 0x7f3594062a30 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:00.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.686+0000 7f35ada40700 1 --2- 172.21.15.3:0/694284908 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f35a80bc1d0 0x7f35a813d300 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:00.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.686+0000 7f35ada40700 1 --2- 172.21.15.3:0/694284908 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f35a80a2d50 0x7f35a8159e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:00.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.686+0000 7f35ada40700 1 --2- 172.21.15.3:0/694284908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35a806e4d0 0x7f35a8140ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:00.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.686+0000 7f35ada40700 1 -- 172.21.15.3:0/694284908 >> 172.21.15.3:0/694284908 conn(0x7f35a80bf870 msgr2=0x7f35a80bb890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:00.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.686+0000 7f35ada40700 1 -- 172.21.15.3:0/694284908 shutdown_connections 2023-10-08T15:41:00.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.686+0000 7f35ada40700 1 -- 172.21.15.3:0/694284908 wait complete. 2023-10-08T15:41:00.707 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T15:41:00.707 DEBUG:teuthology.orchestra.run.smithi003:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T15:41:00.725 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T15:41:00.746 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T15:41:00.767 DEBUG:teuthology.orchestra.run.smithi098:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T15:41:00.788 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T15:41:00.808 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T15:41:00.808 INFO:tasks.cephfs.cephfs_test_case:[, , ] 2023-10-08T15:41:00.809 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:41:00.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.918+0000 7f45b63b7700 1 Processor -- start 2023-10-08T15:41:00.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.918+0000 7f45b63b7700 1 -- start start 2023-10-08T15:41:00.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.918+0000 7f45b63b7700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f45b00b2b50 0x7f45b0147f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:00.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.918+0000 7f45b63b7700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f45b00b1c30 0x7f45b0148480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:00.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.918+0000 7f45b63b7700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45b014bba0 con 0x7f45b0068320 2023-10-08T15:41:00.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.918+0000 7f45b63b7700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45b0147af0 con 0x7f45b00b2b50 2023-10-08T15:41:00.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.918+0000 7f45b63b7700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45b014be40 con 0x7f45b00b1c30 2023-10-08T15:41:00.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.918+0000 7f45af7fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f45b00b2b50 0x7f45b0147f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:00.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.918+0000 7f45af7fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f45b00b2b50 0x7f45b0147f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36870/0 (socket says 172.21.15.3:36870) 2023-10-08T15:41:00.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.918+0000 7f45af7fe700 1 -- 172.21.15.3:0/3522589973 learned_addr learned my addr 172.21.15.3:0/3522589973 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:00.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.918+0000 7f45b4954700 1 --2- 172.21.15.3:0/3522589973 >> v2:172.21.15.50:3300/0 conn(0x7f45b00b1c30 0x7f45b0148480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:00.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.918+0000 7f45af7fe700 1 -- 172.21.15.3:0/3522589973 >> v2:172.21.15.50:3300/0 conn(0x7f45b00b1c30 msgr2=0x7f45b0148480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:00.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.918+0000 7f45af7fe700 1 --2- 172.21.15.3:0/3522589973 >> v2:172.21.15.50:3300/0 conn(0x7f45b00b1c30 0x7f45b0148480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:00.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.918+0000 7f45af7fe700 1 -- 172.21.15.3:0/3522589973 >> v1:172.21.15.50:6789/0 conn(0x7f45b0068320 legacy=0x7f45b00b2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:00.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.918+0000 7f45af7fe700 1 -- 172.21.15.3:0/3522589973 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b01489c0 con 0x7f45b00b2b50 2023-10-08T15:41:00.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.918+0000 7f45b4954700 1 --2- 172.21.15.3:0/3522589973 >> v2:172.21.15.50:3300/0 conn(0x7f45b00b1c30 0x7f45b0148480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:41:00.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.918+0000 7f45af7fe700 1 --2- 172.21.15.3:0/3522589973 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f45b00b2b50 0x7f45b0147f40 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f45b00a3130 tx=0x7f45a000ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbe1cd17db3c6571 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:00.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.918+0000 7f45aeffd700 1 -- 172.21.15.3:0/3522589973 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a0010070 con 0x7f45b00b2b50 2023-10-08T15:41:00.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.918+0000 7f45aeffd700 1 -- 172.21.15.3:0/3522589973 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45a000dc40 con 0x7f45b00b2b50 2023-10-08T15:41:00.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.918+0000 7f45aeffd700 1 -- 172.21.15.3:0/3522589973 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a0016440 con 0x7f45b00b2b50 2023-10-08T15:41:00.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.922+0000 7f45b63b7700 1 -- 172.21.15.3:0/3522589973 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f45b00b2b50 msgr2=0x7f45b0147f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:00.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.922+0000 7f45b63b7700 1 --2- 172.21.15.3:0/3522589973 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f45b00b2b50 0x7f45b0147f40 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f45b00a3130 tx=0x7f45a000ba50 comp rx=0 tx=0).stop 2023-10-08T15:41:00.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.922+0000 7f45b63b7700 1 -- 172.21.15.3:0/3522589973 shutdown_connections 2023-10-08T15:41:00.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.922+0000 7f45b63b7700 1 --2- 172.21.15.3:0/3522589973 >> v2:172.21.15.50:3300/0 conn(0x7f45b00b1c30 0x7f45b0148480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:00.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.922+0000 7f45b63b7700 1 --2- 172.21.15.3:0/3522589973 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f45b00b2b50 0x7f45b0147f40 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:00.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.922+0000 7f45b63b7700 1 -- 172.21.15.3:0/3522589973 >> 172.21.15.3:0/3522589973 conn(0x7f45b00be640 msgr2=0x7f45b00ba6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:00.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.922+0000 7f45b63b7700 1 -- 172.21.15.3:0/3522589973 shutdown_connections 2023-10-08T15:41:00.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.922+0000 7f45b63b7700 1 -- 172.21.15.3:0/3522589973 wait complete. 2023-10-08T15:41:00.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.922+0000 7f45b63b7700 1 Processor -- start 2023-10-08T15:41:00.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.922+0000 7f45b63b7700 1 -- start start 2023-10-08T15:41:00.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.926+0000 7f45b63b7700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f45b0068320 0x7f45b013f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:00.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.926+0000 7f45b63b7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45b00b1c30 0x7f45b013ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:00.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.926+0000 7f45b63b7700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f45b00b2b50 0x7f45b01445b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:00.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.926+0000 7f45b63b7700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b0157600 con 0x7f45b00b2b50 2023-10-08T15:41:00.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.926+0000 7f45b63b7700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b013f360 con 0x7f45b00b1c30 2023-10-08T15:41:00.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.926+0000 7f45b63b7700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45b0141a30 con 0x7f45b0068320 2023-10-08T15:41:00.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.926+0000 7f45b4954700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f45b00b2b50 0x7f45b01445b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:00.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.926+0000 7f45b4954700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f45b00b2b50 0x7f45b01445b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36880/0 (socket says 172.21.15.3:36880) 2023-10-08T15:41:00.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.926+0000 7f45b4954700 1 -- 172.21.15.3:0/425201451 learned_addr learned my addr 172.21.15.3:0/425201451 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:00.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.926+0000 7f45af7fe700 1 --2- 172.21.15.3:0/425201451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45b00b1c30 0x7f45b013ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:00.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.926+0000 7f45affff700 1 --2- 172.21.15.3:0/425201451 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f45b0068320 0x7f45b013f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:00.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.926+0000 7f45b4954700 1 -- 172.21.15.3:0/425201451 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f45b0068320 msgr2=0x7f45b013f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:00.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.926+0000 7f45b4954700 1 --2- 172.21.15.3:0/425201451 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f45b0068320 0x7f45b013f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:00.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.926+0000 7f45b4954700 1 -- 172.21.15.3:0/425201451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45b00b1c30 msgr2=0x7f45b013ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:00.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.926+0000 7f45b4954700 1 --2- 172.21.15.3:0/425201451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45b00b1c30 0x7f45b013ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:00.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.926+0000 7f45b4954700 1 -- 172.21.15.3:0/425201451 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a000bcf0 con 0x7f45b00b2b50 2023-10-08T15:41:00.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.926+0000 7f45af7fe700 1 --2- 172.21.15.3:0/425201451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45b00b1c30 0x7f45b013ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:00.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.926+0000 7f45b4954700 1 --2- 172.21.15.3:0/425201451 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f45b00b2b50 0x7f45b01445b0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f45a800c850 tx=0x7f45a8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:00.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.926+0000 7f4597fff700 1 -- 172.21.15.3:0/425201451 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a8011600 con 0x7f45b00b2b50 2023-10-08T15:41:00.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.926+0000 7f4597fff700 1 -- 172.21.15.3:0/425201451 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45a8011780 con 0x7f45b00b2b50 2023-10-08T15:41:00.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.926+0000 7f45b63b7700 1 -- 172.21.15.3:0/425201451 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45b0141d10 con 0x7f45b00b2b50 2023-10-08T15:41:00.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.926+0000 7f4597fff700 1 -- 172.21.15.3:0/425201451 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a8011b40 con 0x7f45b00b2b50 2023-10-08T15:41:00.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.926+0000 7f45b63b7700 1 -- 172.21.15.3:0/425201451 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45b0144d10 con 0x7f45b00b2b50 2023-10-08T15:41:00.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.926+0000 7f45b63b7700 1 -- 172.21.15.3:0/425201451 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45b0141870 con 0x7f45b00b2b50 2023-10-08T15:41:00.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.930+0000 7f4597fff700 1 -- 172.21.15.3:0/425201451 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f45a8018350 con 0x7f45b00b2b50 2023-10-08T15:41:00.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.930+0000 7f4597fff700 1 --2- 172.21.15.3:0/425201451 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f459c060550 0x7f459c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:00.935 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.930+0000 7f45affff700 1 --2- 172.21.15.3:0/425201451 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f459c060550 0x7f459c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:00.935 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.930+0000 7f4597fff700 1 -- 172.21.15.3:0/425201451 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f45a807c400 con 0x7f45b00b2b50 2023-10-08T15:41:00.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.930+0000 7f45affff700 1 --2- 172.21.15.3:0/425201451 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f459c060550 0x7f459c062a00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f45a40038a0 tx=0x7f45a4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:00.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:00.938+0000 7f4597fff700 1 -- 172.21.15.3:0/425201451 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f45a804ccf0 con 0x7f45b00b2b50 2023-10-08T15:41:01.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.130+0000 7f45b63b7700 1 -- 172.21.15.3:0/425201451 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f45b01577a0 con 0x7f45b00b2b50 2023-10-08T15:41:01.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.130+0000 7f4597fff700 1 -- 172.21.15.3:0/425201451 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+2012 (secure 0 0 0) 0x7f45a801e7f0 con 0x7f45b00b2b50 2023-10-08T15:41:01.137 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:41:01.137 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":21,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5006,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3286528236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3286528236},{"type":"v1","addr":"172.21.15.50:6835","nonce":3286528236}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6833/2251143130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":2251143130},{"type":"v1","addr":"172.21.15.3:6833","nonce":2251143130}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[]} 2023-10-08T15:41:01.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.134+0000 7f45b63b7700 1 -- 172.21.15.3:0/425201451 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f459c060550 msgr2=0x7f459c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:01.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.134+0000 7f45b63b7700 1 --2- 172.21.15.3:0/425201451 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f459c060550 0x7f459c062a00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f45a40038a0 tx=0x7f45a4009040 comp rx=0 tx=0).stop 2023-10-08T15:41:01.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.134+0000 7f45b63b7700 1 -- 172.21.15.3:0/425201451 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f45b00b2b50 msgr2=0x7f45b01445b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:01.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.134+0000 7f45b63b7700 1 --2- 172.21.15.3:0/425201451 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f45b00b2b50 0x7f45b01445b0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f45a800c850 tx=0x7f45a8008040 comp rx=0 tx=0).stop 2023-10-08T15:41:01.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.134+0000 7f45b63b7700 1 -- 172.21.15.3:0/425201451 shutdown_connections 2023-10-08T15:41:01.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.134+0000 7f45b63b7700 1 --2- 172.21.15.3:0/425201451 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f459c060550 0x7f459c062a00 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:01.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.134+0000 7f45b63b7700 1 --2- 172.21.15.3:0/425201451 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f45b00b2b50 0x7f45b01445b0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:01.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.134+0000 7f45b63b7700 1 --2- 172.21.15.3:0/425201451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45b00b1c30 0x7f45b013ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:01.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.134+0000 7f45b63b7700 1 --2- 172.21.15.3:0/425201451 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f45b0068320 0x7f45b013f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:01.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.134+0000 7f45b63b7700 1 -- 172.21.15.3:0/425201451 >> 172.21.15.3:0/425201451 conn(0x7f45b00be640 msgr2=0x7f45b00686f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:01.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.134+0000 7f45b63b7700 1 -- 172.21.15.3:0/425201451 shutdown_connections 2023-10-08T15:41:01.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.134+0000 7f45b63b7700 1 -- 172.21.15.3:0/425201451 wait complete. 2023-10-08T15:41:01.141 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 21 2023-10-08T15:41:01.151 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-08T15:41:01.151 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-08T15:41:01.152 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-08T15:41:01.152 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T15:41:01.152 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-08T15:41:01.152 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-08T15:41:01.152 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-08T15:41:01.152 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T15:41:01.165 INFO:tasks.ceph.mds.a:Stopped 2023-10-08T15:41:01.166 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-08T15:41:01.167 INFO:tasks.ceph.mds.b:Stopped 2023-10-08T15:41:01.167 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-08T15:41:01.168 INFO:tasks.ceph.mds.a:Started 2023-10-08T15:41:01.169 DEBUG:teuthology.parallel:result is None 2023-10-08T15:41:01.212 INFO:tasks.ceph.mds.b:Started 2023-10-08T15:41:01.212 DEBUG:teuthology.parallel:result is None 2023-10-08T15:41:01.212 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-08T15:41:01.248 INFO:tasks.ceph.mds.a.smithi003.stdout:starting mds.a at 2023-10-08T15:41:01.292 INFO:tasks.ceph.mds.b.smithi050.stdout:starting mds.b at 2023-10-08T15:41:01.323 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.318+0000 7f39b78ae700 1 Processor -- start 2023-10-08T15:41:01.323 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.318+0000 7f39b78ae700 1 -- start start 2023-10-08T15:41:01.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.318+0000 7f39b78ae700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f39b0147c10 0x7f39b006d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:01.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.318+0000 7f39b78ae700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f39b006c820 0x7f39b014c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:01.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.318+0000 7f39b78ae700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39b014bcc0 con 0x7f39b00badb0 2023-10-08T15:41:01.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.318+0000 7f39b78ae700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39b006cc80 con 0x7f39b006c820 2023-10-08T15:41:01.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.318+0000 7f39b78ae700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39b006dd00 con 0x7f39b0147c10 2023-10-08T15:41:01.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.318+0000 7f39b5e4b700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f39b00badb0 0x7f39b0147fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:56262/0 (socket says 172.21.15.3:56262) 2023-10-08T15:41:01.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.318+0000 7f39b5e4b700 1 -- 172.21.15.3:0/1601575317 learned_addr learned my addr 172.21.15.3:0/1601575317 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:41:01.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.318+0000 7f39b4e49700 1 --2- 172.21.15.3:0/1601575317 >> v2:172.21.15.3:3300/0 conn(0x7f39b006c820 0x7f39b014c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:01.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.318+0000 7f39b564a700 1 --2- 172.21.15.3:0/1601575317 >> v2:172.21.15.50:3300/0 conn(0x7f39b0147c10 0x7f39b006d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:01.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.318+0000 7f39affff700 1 -- 172.21.15.3:0/1601575317 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3708726676 0 0) 0x7f39b014bcc0 con 0x7f39b00badb0 2023-10-08T15:41:01.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.322+0000 7f39affff700 1 -- 172.21.15.3:0/1601575317 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3998003570 con 0x7f39b00badb0 2023-10-08T15:41:01.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.322+0000 7f39b4e49700 1 -- 172.21.15.3:0/1601575317 >> v2:172.21.15.50:3300/0 conn(0x7f39b0147c10 msgr2=0x7f39b006d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:01.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.322+0000 7f39b4e49700 1 --2- 172.21.15.3:0/1601575317 >> v2:172.21.15.50:3300/0 conn(0x7f39b0147c10 0x7f39b006d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:01.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.322+0000 7f39b4e49700 1 -- 172.21.15.3:0/1601575317 >> v1:172.21.15.3:6789/0 conn(0x7f39b00badb0 legacy=0x7f39b0147fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:01.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.322+0000 7f39affff700 1 -- 172.21.15.3:0/1601575317 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 757181606 0 0) 0x7f3998003570 con 0x7f39b00badb0 2023-10-08T15:41:01.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.322+0000 7f39b4e49700 1 -- 172.21.15.3:0/1601575317 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b014b950 con 0x7f39b006c820 2023-10-08T15:41:01.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.322+0000 7f39b4e49700 1 --2- 172.21.15.3:0/1601575317 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f39b006c820 0x7f39b014c150 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f39a40098e0 tx=0x7f39a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a4c0f6fa5e3336a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:01.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.322+0000 7f39affff700 1 -- 172.21.15.3:0/1601575317 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a4011630 con 0x7f39b006c820 2023-10-08T15:41:01.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.322+0000 7f39affff700 1 -- 172.21.15.3:0/1601575317 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39a4011790 con 0x7f39b006c820 2023-10-08T15:41:01.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.322+0000 7f39affff700 1 -- 172.21.15.3:0/1601575317 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a4011b30 con 0x7f39b006c820 2023-10-08T15:41:01.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.322+0000 7f39b78ae700 1 -- 172.21.15.3:0/1601575317 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f39b006c820 msgr2=0x7f39b014c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:01.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.322+0000 7f39b78ae700 1 --2- 172.21.15.3:0/1601575317 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f39b006c820 0x7f39b014c150 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f39a40098e0 tx=0x7f39a40091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:01.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.322+0000 7f39b78ae700 1 -- 172.21.15.3:0/1601575317 shutdown_connections 2023-10-08T15:41:01.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.322+0000 7f39b78ae700 1 --2- 172.21.15.3:0/1601575317 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f39b006c820 0x7f39b014c150 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:01.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.322+0000 7f39b78ae700 1 --2- 172.21.15.3:0/1601575317 >> v2:172.21.15.50:3300/0 conn(0x7f39b0147c10 0x7f39b006d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:01.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.322+0000 7f39b78ae700 1 -- 172.21.15.3:0/1601575317 >> 172.21.15.3:0/1601575317 conn(0x7f39b00be640 msgr2=0x7f39b00ba6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:01.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.322+0000 7f39b78ae700 1 -- 172.21.15.3:0/1601575317 shutdown_connections 2023-10-08T15:41:01.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.322+0000 7f39b78ae700 1 -- 172.21.15.3:0/1601575317 wait complete. 2023-10-08T15:41:01.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.322+0000 7f39b78ae700 1 Processor -- start 2023-10-08T15:41:01.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.326+0000 7f39b78ae700 1 -- start start 2023-10-08T15:41:01.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.326+0000 7f39b78ae700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f39b006c820 0x7f39b013dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:01.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.326+0000 7f39b78ae700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39b00badb0 0x7f39b00684f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:01.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.326+0000 7f39b78ae700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f39b0147c10 0x7f39b00b9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:01.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.326+0000 7f39b78ae700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b013e2c0 con 0x7f39b0147c10 2023-10-08T15:41:01.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.326+0000 7f39b78ae700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b01401b0 con 0x7f39b00badb0 2023-10-08T15:41:01.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.326+0000 7f39b78ae700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39b013e010 con 0x7f39b006c820 2023-10-08T15:41:01.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.326+0000 7f39b5e4b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f39b0147c10 0x7f39b00b9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:01.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.326+0000 7f39b5e4b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f39b0147c10 0x7f39b00b9070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36926/0 (socket says 172.21.15.3:36926) 2023-10-08T15:41:01.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.326+0000 7f39b5e4b700 1 -- 172.21.15.3:0/4005796294 learned_addr learned my addr 172.21.15.3:0/4005796294 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:01.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.326+0000 7f39b564a700 1 --2- 172.21.15.3:0/4005796294 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f39b006c820 0x7f39b013dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:01.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.326+0000 7f39b4e49700 1 --2- 172.21.15.3:0/4005796294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39b00badb0 0x7f39b00684f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:01.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.326+0000 7f39b5e4b700 1 -- 172.21.15.3:0/4005796294 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f39b006c820 msgr2=0x7f39b013dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:01.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.326+0000 7f39b5e4b700 1 --2- 172.21.15.3:0/4005796294 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f39b006c820 0x7f39b013dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:01.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.326+0000 7f39b5e4b700 1 -- 172.21.15.3:0/4005796294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39b00badb0 msgr2=0x7f39b00684f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:01.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.326+0000 7f39b5e4b700 1 --2- 172.21.15.3:0/4005796294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39b00badb0 0x7f39b00684f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:01.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.326+0000 7f39b5e4b700 1 -- 172.21.15.3:0/4005796294 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a4009420 con 0x7f39b0147c10 2023-10-08T15:41:01.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.326+0000 7f39b5e4b700 1 --2- 172.21.15.3:0/4005796294 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f39b0147c10 0x7f39b00b9070 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f39a000c810 tx=0x7f39a0007b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:01.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.326+0000 7f39ad7fa700 1 -- 172.21.15.3:0/4005796294 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a0007360 con 0x7f39b0147c10 2023-10-08T15:41:01.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.326+0000 7f39ad7fa700 1 -- 172.21.15.3:0/4005796294 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39a00074c0 con 0x7f39b0147c10 2023-10-08T15:41:01.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.326+0000 7f39b78ae700 1 -- 172.21.15.3:0/4005796294 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39b013fe40 con 0x7f39b0147c10 2023-10-08T15:41:01.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.326+0000 7f39ad7fa700 1 -- 172.21.15.3:0/4005796294 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a0004830 con 0x7f39b0147c10 2023-10-08T15:41:01.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.326+0000 7f39b78ae700 1 -- 172.21.15.3:0/4005796294 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39b013ed70 con 0x7f39b0147c10 2023-10-08T15:41:01.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.330+0000 7f39b78ae700 1 -- 172.21.15.3:0/4005796294 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39b013fca0 con 0x7f39b0147c10 2023-10-08T15:41:01.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.330+0000 7f39ad7fa700 1 -- 172.21.15.3:0/4005796294 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f39a0004be0 con 0x7f39b0147c10 2023-10-08T15:41:01.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.330+0000 7f39ad7fa700 1 --2- 172.21.15.3:0/4005796294 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f399c060580 0x7f399c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:01.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.330+0000 7f39ad7fa700 1 -- 172.21.15.3:0/4005796294 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f39a007c1f0 con 0x7f39b0147c10 2023-10-08T15:41:01.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.330+0000 7f39b564a700 1 --2- 172.21.15.3:0/4005796294 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f399c060580 0x7f399c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:01.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.330+0000 7f39b564a700 1 --2- 172.21.15.3:0/4005796294 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f399c060580 0x7f399c062a30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f39a800f510 tx=0x7f39a800b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:01.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.334+0000 7f39ad7fa700 1 -- 172.21.15.3:0/4005796294 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f39b013fca0 con 0x7f39b0147c10 2023-10-08T15:41:01.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:01.510+0000 7f39b78ae700 1 -- 172.21.15.3:0/4005796294 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f39b013fca0 con 0x7f39b0147c10 2023-10-08T15:41:02.367 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.362+0000 7f39ad7fa700 1 -- 172.21.15.3:0/4005796294 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v45) v1 ==== 97+0+0 (secure 0 0 0) 0x7f39b013fca0 con 0x7f39b0147c10 2023-10-08T15:41:02.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.366+0000 7f39b78ae700 1 -- 172.21.15.3:0/4005796294 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f399c060580 msgr2=0x7f399c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:02.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.366+0000 7f39b78ae700 1 --2- 172.21.15.3:0/4005796294 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f399c060580 0x7f399c062a30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f39a800f510 tx=0x7f39a800b040 comp rx=0 tx=0).stop 2023-10-08T15:41:02.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.366+0000 7f39b78ae700 1 -- 172.21.15.3:0/4005796294 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f39b0147c10 msgr2=0x7f39b00b9070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:02.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.366+0000 7f39b78ae700 1 --2- 172.21.15.3:0/4005796294 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f39b0147c10 0x7f39b00b9070 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f39a000c810 tx=0x7f39a0007b30 comp rx=0 tx=0).stop 2023-10-08T15:41:02.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.366+0000 7f39b78ae700 1 -- 172.21.15.3:0/4005796294 shutdown_connections 2023-10-08T15:41:02.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.366+0000 7f39b78ae700 1 --2- 172.21.15.3:0/4005796294 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f399c060580 0x7f399c062a30 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:02.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.366+0000 7f39b78ae700 1 --2- 172.21.15.3:0/4005796294 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f39b0147c10 0x7f39b00b9070 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:02.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.366+0000 7f39b78ae700 1 --2- 172.21.15.3:0/4005796294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39b00badb0 0x7f39b00684f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:02.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.366+0000 7f39b78ae700 1 --2- 172.21.15.3:0/4005796294 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f39b006c820 0x7f39b013dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:02.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.366+0000 7f39b78ae700 1 -- 172.21.15.3:0/4005796294 >> 172.21.15.3:0/4005796294 conn(0x7f39b00be640 msgr2=0x7f39b00bc950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:02.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.366+0000 7f39b78ae700 1 -- 172.21.15.3:0/4005796294 shutdown_connections 2023-10-08T15:41:02.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.366+0000 7f39b78ae700 1 -- 172.21.15.3:0/4005796294 wait complete. 2023-10-08T15:41:02.373 INFO:teuthology.orchestra.run.smithi003.stderr: removed all blocklist entries 2023-10-08T15:41:02.387 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-08T15:41:02.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.494+0000 7ff2ecf8f700 1 Processor -- start 2023-10-08T15:41:02.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.494+0000 7ff2ecf8f700 1 -- start start 2023-10-08T15:41:02.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.494+0000 7ff2ecf8f700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff2e814ac50 0x7ff2e814b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:02.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.494+0000 7ff2ecf8f700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff2e806be60 0x7ff2e806c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:02.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.494+0000 7ff2ecf8f700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2e814c6b0 con 0x7ff2e806ca70 2023-10-08T15:41:02.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.494+0000 7ff2ecf8f700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2e814dc50 con 0x7ff2e814ac50 2023-10-08T15:41:02.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.494+0000 7ff2ecf8f700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e814c060 con 0x7ff2e806be60 2023-10-08T15:41:02.501 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.494+0000 7ff2e6ffd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff2e806be60 0x7ff2e806c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:02.501 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.494+0000 7ff2e77fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff2e814ac50 0x7ff2e814b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:02.501 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.494+0000 7ff2e6ffd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff2e806be60 0x7ff2e806c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.3:35060/0 (socket says 172.21.15.3:35060) 2023-10-08T15:41:02.501 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.494+0000 7ff2e6ffd700 1 -- 172.21.15.3:0/4070423143 learned_addr learned my addr 172.21.15.3:0/4070423143 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:02.502 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.494+0000 7ff2e6ffd700 1 -- 172.21.15.3:0/4070423143 >> v2:172.21.15.50:3300/0 conn(0x7ff2e814ac50 msgr2=0x7ff2e814b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:02.502 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.494+0000 7ff2e6ffd700 1 --2- 172.21.15.3:0/4070423143 >> v2:172.21.15.50:3300/0 conn(0x7ff2e814ac50 0x7ff2e814b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:02.502 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.494+0000 7ff2e6ffd700 1 -- 172.21.15.3:0/4070423143 >> v1:172.21.15.50:6789/0 conn(0x7ff2e806ca70 legacy=0x7ff2e814eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:02.502 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.494+0000 7ff2e6ffd700 1 -- 172.21.15.3:0/4070423143 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e814c340 con 0x7ff2e806be60 2023-10-08T15:41:02.502 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.498+0000 7ff2e6ffd700 1 --2- 172.21.15.3:0/4070423143 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff2e806be60 0x7ff2e806c530 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff2d8009f20 tx=0x7ff2d8009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e61b569f813e66c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:02.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.498+0000 7ff2e67fc700 1 -- 172.21.15.3:0/4070423143 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d800e070 con 0x7ff2e806be60 2023-10-08T15:41:02.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.498+0000 7ff2e67fc700 1 -- 172.21.15.3:0/4070423143 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d800b9d0 con 0x7ff2e806be60 2023-10-08T15:41:02.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.498+0000 7ff2e67fc700 1 -- 172.21.15.3:0/4070423143 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d80092e0 con 0x7ff2e806be60 2023-10-08T15:41:02.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.498+0000 7ff2ecf8f700 1 -- 172.21.15.3:0/4070423143 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff2e806be60 msgr2=0x7ff2e806c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:02.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.498+0000 7ff2ecf8f700 1 --2- 172.21.15.3:0/4070423143 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff2e806be60 0x7ff2e806c530 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff2d8009f20 tx=0x7ff2d8009840 comp rx=0 tx=0).stop 2023-10-08T15:41:02.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.498+0000 7ff2ecf8f700 1 -- 172.21.15.3:0/4070423143 shutdown_connections 2023-10-08T15:41:02.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.498+0000 7ff2ecf8f700 1 --2- 172.21.15.3:0/4070423143 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff2e806be60 0x7ff2e806c530 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:02.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.498+0000 7ff2ecf8f700 1 --2- 172.21.15.3:0/4070423143 >> v2:172.21.15.50:3300/0 conn(0x7ff2e814ac50 0x7ff2e814b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:02.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.498+0000 7ff2ecf8f700 1 -- 172.21.15.3:0/4070423143 >> 172.21.15.3:0/4070423143 conn(0x7ff2e80c1df0 msgr2=0x7ff2e80c21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:02.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.498+0000 7ff2ecf8f700 1 -- 172.21.15.3:0/4070423143 shutdown_connections 2023-10-08T15:41:02.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.498+0000 7ff2ecf8f700 1 -- 172.21.15.3:0/4070423143 wait complete. 2023-10-08T15:41:02.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.502+0000 7ff2ecf8f700 1 Processor -- start 2023-10-08T15:41:02.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.502+0000 7ff2ecf8f700 1 -- start start 2023-10-08T15:41:02.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.502+0000 7ff2ecf8f700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff2e806be60 0x7ff2e8148420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:02.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.502+0000 7ff2ecf8f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2e806ca70 0x7ff2e8143e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:02.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.502+0000 7ff2ecf8f700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff2e814ac50 0x7ff2e8144350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:02.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.502+0000 7ff2ecf8f700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e80bfed0 con 0x7ff2e806be60 2023-10-08T15:41:02.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.502+0000 7ff2ecf8f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e8146500 con 0x7ff2e806ca70 2023-10-08T15:41:02.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.502+0000 7ff2ecf8f700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e8144890 con 0x7ff2e814ac50 2023-10-08T15:41:02.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.502+0000 7ff2e77fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff2e806be60 0x7ff2e8148420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:02.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.502+0000 7ff2e77fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff2e806be60 0x7ff2e8148420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36942/0 (socket says 172.21.15.3:36942) 2023-10-08T15:41:02.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.502+0000 7ff2e77fe700 1 -- 172.21.15.3:0/3037000408 learned_addr learned my addr 172.21.15.3:0/3037000408 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:02.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.502+0000 7ff2e6ffd700 1 --2- 172.21.15.3:0/3037000408 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2e806ca70 0x7ff2e8143e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:02.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.502+0000 7ff2e7fff700 1 --2- 172.21.15.3:0/3037000408 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff2e814ac50 0x7ff2e8144350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:02.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.502+0000 7ff2e77fe700 1 -- 172.21.15.3:0/3037000408 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff2e814ac50 msgr2=0x7ff2e8144350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:02.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.502+0000 7ff2e77fe700 1 --2- 172.21.15.3:0/3037000408 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff2e814ac50 0x7ff2e8144350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:02.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.502+0000 7ff2e77fe700 1 -- 172.21.15.3:0/3037000408 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2e806ca70 msgr2=0x7ff2e8143e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:02.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.502+0000 7ff2e77fe700 1 --2- 172.21.15.3:0/3037000408 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2e806ca70 0x7ff2e8143e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:02.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.502+0000 7ff2e77fe700 1 -- 172.21.15.3:0/3037000408 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d8009ae0 con 0x7ff2e806be60 2023-10-08T15:41:02.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.502+0000 7ff2e77fe700 1 --2- 172.21.15.3:0/3037000408 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff2e806be60 0x7ff2e8148420 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc00e960 tx=0x7ff2dc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:02.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.506+0000 7ff2cf7fe700 1 -- 172.21.15.3:0/3037000408 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc013680 con 0x7ff2e806be60 2023-10-08T15:41:02.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.506+0000 7ff2cf7fe700 1 -- 172.21.15.3:0/3037000408 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2dc0137e0 con 0x7ff2e806be60 2023-10-08T15:41:02.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.506+0000 7ff2ecf8f700 1 -- 172.21.15.3:0/3037000408 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2e80bfbf0 con 0x7ff2e806be60 2023-10-08T15:41:02.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.506+0000 7ff2cf7fe700 1 -- 172.21.15.3:0/3037000408 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc013b80 con 0x7ff2e806be60 2023-10-08T15:41:02.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.506+0000 7ff2ecf8f700 1 -- 172.21.15.3:0/3037000408 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2e8152c30 con 0x7ff2e806be60 2023-10-08T15:41:02.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.506+0000 7ff2ecf8f700 1 -- 172.21.15.3:0/3037000408 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2e805ecf0 con 0x7ff2e806be60 2023-10-08T15:41:02.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.506+0000 7ff2cf7fe700 1 -- 172.21.15.3:0/3037000408 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff2dc0123d0 con 0x7ff2e806be60 2023-10-08T15:41:02.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.506+0000 7ff2cf7fe700 1 --2- 172.21.15.3:0/3037000408 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff2d4060550 0x7ff2d4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:02.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.506+0000 7ff2cf7fe700 1 -- 172.21.15.3:0/3037000408 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ff2dc07c960 con 0x7ff2e806be60 2023-10-08T15:41:02.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.506+0000 7ff2e6ffd700 1 --2- 172.21.15.3:0/3037000408 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff2d4060550 0x7ff2d4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:02.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.510+0000 7ff2e6ffd700 1 --2- 172.21.15.3:0/3037000408 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff2d4060550 0x7ff2d4062a00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff2d8009880 tx=0x7ff2d8018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:02.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.514+0000 7ff2cf7fe700 1 -- 172.21.15.3:0/3037000408 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff2dc04d200 con 0x7ff2e806be60 2023-10-08T15:41:02.746 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.742+0000 7ff2ecf8f700 1 -- 172.21.15.3:0/3037000408 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7ff2e814e860 con 0x7ff2e806be60 2023-10-08T15:41:02.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.742+0000 7ff2cf7fe700 1 -- 172.21.15.3:0/3037000408 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) v1 ==== 80+0+4446 (secure 0 0 0) 0x7ff2dc050820 con 0x7ff2e806be60 2023-10-08T15:41:02.747 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:41:02.747 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2023-10-08T15:41:02.747 INFO:teuthology.orchestra.run.smithi003.stdout: "auth_dump": [ 2023-10-08T15:41:02.747 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:41:02.748 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "mds.a", 2023-10-08T15:41:02.748 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCGzCJlniy3BRAAQseQmhA2EOYYPCLL1hMj/g==", 2023-10-08T15:41:02.748 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:41:02.748 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow", 2023-10-08T15:41:02.748 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow *", 2023-10-08T15:41:02.748 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow *", 2023-10-08T15:41:02.748 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:41:02.748 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:41:02.748 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:41:02.749 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:41:02.749 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "mds.b", 2023-10-08T15:41:02.749 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCGzCJl1lNhCRAA/A3Dz/i7z2OM/Mwr00ZSFg==", 2023-10-08T15:41:02.749 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:41:02.749 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow", 2023-10-08T15:41:02.749 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow *", 2023-10-08T15:41:02.750 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow *", 2023-10-08T15:41:02.750 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:41:02.750 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:41:02.750 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:41:02.750 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:41:02.751 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.0", 2023-10-08T15:41:02.751 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCIzCJl5cInMhAAIWzN1t0FivwbJgXlK5WXCg==", 2023-10-08T15:41:02.751 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:41:02.751 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-10-08T15:41:02.751 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-10-08T15:41:02.751 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:41:02.751 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:41:02.751 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:41:02.751 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:41:02.751 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.1", 2023-10-08T15:41:02.751 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCMzCJlZQwWCBAAzzoTedkZwE7oFh4KXjrWZg==", 2023-10-08T15:41:02.752 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:41:02.752 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-10-08T15:41:02.752 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-10-08T15:41:02.752 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:41:02.752 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:41:02.752 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:41:02.752 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:41:02.752 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.2", 2023-10-08T15:41:02.752 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCPzCJlNZM0DRAAgBBNMGbDp8a6VU+mZCpMvQ==", 2023-10-08T15:41:02.752 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:41:02.752 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-10-08T15:41:02.752 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-10-08T15:41:02.753 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:41:02.753 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:41:02.753 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:41:02.753 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:41:02.753 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.3", 2023-10-08T15:41:02.753 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCSzCJltf1tERAAzUJYRvgmxgEtp/IkRsxqmg==", 2023-10-08T15:41:02.753 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:41:02.753 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-10-08T15:41:02.753 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-10-08T15:41:02.753 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:41:02.753 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:41:02.753 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:41:02.754 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:41:02.754 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.4", 2023-10-08T15:41:02.754 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCVzCJlJb2bOBAAZ4hEdc2vznsMuAZpBZlj6Q==", 2023-10-08T15:41:02.754 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:41:02.754 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-10-08T15:41:02.754 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-10-08T15:41:02.754 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:41:02.754 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:41:02.754 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:41:02.754 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:41:02.754 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.5", 2023-10-08T15:41:02.755 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCZzCJlRu4PAhAAgAt508VAQXQwI2L8QyJsag==", 2023-10-08T15:41:02.755 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:41:02.755 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-10-08T15:41:02.755 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-10-08T15:41:02.755 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:41:02.755 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:41:02.755 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:41:02.755 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:41:02.755 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.6", 2023-10-08T15:41:02.755 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCczCJl+1qsBBAArN1IsbopNLd43wJCb73a/A==", 2023-10-08T15:41:02.755 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:41:02.755 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-10-08T15:41:02.756 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-10-08T15:41:02.756 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:41:02.756 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:41:02.756 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:41:02.756 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:41:02.756 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.7", 2023-10-08T15:41:02.756 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCfzCJlMwQhCRAAv/YJwsTJz1eOHFJA/34fDQ==", 2023-10-08T15:41:02.756 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:41:02.756 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-10-08T15:41:02.756 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-10-08T15:41:02.756 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:41:02.756 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:41:02.757 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:41:02.757 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:41:02.757 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "client.0", 2023-10-08T15:41:02.757 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCGzCJlsNS9DBAAAGWd2+fzzFMSRkr2JgMssw==", 2023-10-08T15:41:02.757 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:41:02.757 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow", 2023-10-08T15:41:02.757 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow r", 2023-10-08T15:41:02.757 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-08T15:41:02.757 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:41:02.757 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:41:02.757 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:41:02.758 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "client.1", 2023-10-08T15:41:02.758 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCGzCJlDRibDxAAgu6Q6umK/yUGAg4R/9Yj+w==", 2023-10-08T15:41:02.758 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:41:02.758 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow", 2023-10-08T15:41:02.758 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow r", 2023-10-08T15:41:02.758 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow rw", 2023-10-08T15:41:02.758 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow rwx" 2023-10-08T15:41:02.758 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:41:02.758 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:41:02.758 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:41:02.758 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "client.2", 2023-10-08T15:41:02.758 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCGzCJlqKuGEhAAUqGYxYztxx87maQJT2LL/g==", 2023-10-08T15:41:02.759 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:41:02.759 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow", 2023-10-08T15:41:02.759 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow r", 2023-10-08T15:41:02.759 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow rw", 2023-10-08T15:41:02.759 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow rwx" 2023-10-08T15:41:02.759 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:41:02.759 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:41:02.759 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:41:02.759 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "client.admin", 2023-10-08T15:41:02.759 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCFzCJltIgDJxAAwtl0Hr7oKzNBMOvXUUnshQ==", 2023-10-08T15:41:02.759 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:41:02.759 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow *", 2023-10-08T15:41:02.760 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow *", 2023-10-08T15:41:02.760 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow *", 2023-10-08T15:41:02.760 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:41:02.760 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:41:02.760 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:41:02.760 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:41:02.760 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "mgr.x", 2023-10-08T15:41:02.760 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCGzCJlrnryAhAAe5CNtQTuBHbbPrdMxY2lqA==", 2023-10-08T15:41:02.760 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:41:02.760 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow *", 2023-10-08T15:41:02.760 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile mgr", 2023-10-08T15:41:02.761 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:41:02.761 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:41:02.761 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:41:02.761 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:41:02.761 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "mgr.y", 2023-10-08T15:41:02.761 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCGzCJl8moPABAAjH5iVWRLyeITsMX/nAZoTQ==", 2023-10-08T15:41:02.761 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:41:02.761 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow *", 2023-10-08T15:41:02.761 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile mgr", 2023-10-08T15:41:02.761 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:41:02.761 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:41:02.761 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:41:02.762 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2023-10-08T15:41:02.762 INFO:teuthology.orchestra.run.smithi003.stdout:} 2023-10-08T15:41:02.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.746+0000 7ff2ecf8f700 1 -- 172.21.15.3:0/3037000408 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff2d4060550 msgr2=0x7ff2d4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:02.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.746+0000 7ff2ecf8f700 1 --2- 172.21.15.3:0/3037000408 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff2d4060550 0x7ff2d4062a00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff2d8009880 tx=0x7ff2d8018000 comp rx=0 tx=0).stop 2023-10-08T15:41:02.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.746+0000 7ff2ecf8f700 1 -- 172.21.15.3:0/3037000408 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff2e806be60 msgr2=0x7ff2e8148420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:02.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.746+0000 7ff2ecf8f700 1 --2- 172.21.15.3:0/3037000408 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff2e806be60 0x7ff2e8148420 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc00e960 tx=0x7ff2dc0091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:02.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.746+0000 7ff2ecf8f700 1 -- 172.21.15.3:0/3037000408 shutdown_connections 2023-10-08T15:41:02.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.746+0000 7ff2ecf8f700 1 --2- 172.21.15.3:0/3037000408 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff2d4060550 0x7ff2d4062a00 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:02.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.746+0000 7ff2ecf8f700 1 --2- 172.21.15.3:0/3037000408 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff2e814ac50 0x7ff2e8144350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:02.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.746+0000 7ff2ecf8f700 1 --2- 172.21.15.3:0/3037000408 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2e806ca70 0x7ff2e8143e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:02.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.746+0000 7ff2ecf8f700 1 --2- 172.21.15.3:0/3037000408 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff2e806be60 0x7ff2e8148420 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:02.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.746+0000 7ff2ecf8f700 1 -- 172.21.15.3:0/3037000408 >> 172.21.15.3:0/3037000408 conn(0x7ff2e80c1df0 msgr2=0x7ff2e80685d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:02.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.746+0000 7ff2ecf8f700 1 -- 172.21.15.3:0/3037000408 shutdown_connections 2023-10-08T15:41:02.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.746+0000 7ff2ecf8f700 1 -- 172.21.15.3:0/3037000408 wait complete. 2023-10-08T15:41:02.765 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:41:02.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.870+0000 7f1e7f59e700 1 Processor -- start 2023-10-08T15:41:02.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.870+0000 7f1e7f59e700 1 -- start start 2023-10-08T15:41:02.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.870+0000 7f1e7f59e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1e8014ac50 0x7f1e8014b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:02.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.870+0000 7f1e7f59e700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f1e8006be60 0x7f1e8006c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:02.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.870+0000 7f1e7f59e700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e8014c6b0 con 0x7f1e8006ca70 2023-10-08T15:41:02.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.870+0000 7f1e7f59e700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e8014dc50 con 0x7f1e8006be60 2023-10-08T15:41:02.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.870+0000 7f1e7f59e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e8014c060 con 0x7f1e8014ac50 2023-10-08T15:41:02.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.870+0000 7f1e7ed9d700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f1e8006ca70 0x7f1e8014eb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:56266/0 (socket says 172.21.15.3:56266) 2023-10-08T15:41:02.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.870+0000 7f1e7ed9d700 1 -- 172.21.15.3:0/803019501 learned_addr learned my addr 172.21.15.3:0/803019501 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:41:02.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.870+0000 7f1e7dd9b700 1 --2- 172.21.15.3:0/803019501 >> v2:172.21.15.3:3300/0 conn(0x7f1e8006be60 0x7f1e8006c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:02.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.870+0000 7f1e7e59c700 1 --2- 172.21.15.3:0/803019501 >> v2:172.21.15.50:3300/0 conn(0x7f1e8014ac50 0x7f1e8014b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:02.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.870+0000 7f1e7d59a700 1 -- 172.21.15.3:0/803019501 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3650260398 0 0) 0x7f1e8014c6b0 con 0x7f1e8006ca70 2023-10-08T15:41:02.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.870+0000 7f1e7d59a700 1 -- 172.21.15.3:0/803019501 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e60003570 con 0x7f1e8006ca70 2023-10-08T15:41:02.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.870+0000 7f1e7e59c700 1 -- 172.21.15.3:0/803019501 >> v2:172.21.15.3:3300/0 conn(0x7f1e8006be60 msgr2=0x7f1e8006c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:02.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.870+0000 7f1e7e59c700 1 --2- 172.21.15.3:0/803019501 >> v2:172.21.15.3:3300/0 conn(0x7f1e8006be60 0x7f1e8006c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:02.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.870+0000 7f1e7e59c700 1 -- 172.21.15.3:0/803019501 >> v1:172.21.15.3:6789/0 conn(0x7f1e8006ca70 legacy=0x7f1e8014eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:02.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.870+0000 7f1e7e59c700 1 -- 172.21.15.3:0/803019501 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e8014c340 con 0x7f1e8014ac50 2023-10-08T15:41:02.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.870+0000 7f1e7e59c700 1 --2- 172.21.15.3:0/803019501 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e8014ac50 0x7f1e8014b020 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1e80069ed0 tx=0x7f1e700091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22bb66d26fc9d5a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:02.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.870+0000 7f1e7d59a700 1 -- 172.21.15.3:0/803019501 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e70011630 con 0x7f1e8014ac50 2023-10-08T15:41:02.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.870+0000 7f1e7d59a700 1 -- 172.21.15.3:0/803019501 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e70011790 con 0x7f1e8014ac50 2023-10-08T15:41:02.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.870+0000 7f1e7d59a700 1 -- 172.21.15.3:0/803019501 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e70011b30 con 0x7f1e8014ac50 2023-10-08T15:41:02.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.874+0000 7f1e7f59e700 1 -- 172.21.15.3:0/803019501 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e8014ac50 msgr2=0x7f1e8014b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:02.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.874+0000 7f1e7f59e700 1 --2- 172.21.15.3:0/803019501 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e8014ac50 0x7f1e8014b020 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1e80069ed0 tx=0x7f1e700091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:02.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.874+0000 7f1e7f59e700 1 -- 172.21.15.3:0/803019501 shutdown_connections 2023-10-08T15:41:02.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.874+0000 7f1e7f59e700 1 --2- 172.21.15.3:0/803019501 >> v2:172.21.15.3:3300/0 conn(0x7f1e8006be60 0x7f1e8006c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:02.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.874+0000 7f1e7f59e700 1 --2- 172.21.15.3:0/803019501 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e8014ac50 0x7f1e8014b020 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:02.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.874+0000 7f1e7f59e700 1 -- 172.21.15.3:0/803019501 >> 172.21.15.3:0/803019501 conn(0x7f1e800c1df0 msgr2=0x7f1e800c21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:02.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.874+0000 7f1e7f59e700 1 -- 172.21.15.3:0/803019501 shutdown_connections 2023-10-08T15:41:02.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.874+0000 7f1e7f59e700 1 -- 172.21.15.3:0/803019501 wait complete. 2023-10-08T15:41:02.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.874+0000 7f1e7f59e700 1 Processor -- start 2023-10-08T15:41:02.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.874+0000 7f1e7f59e700 1 -- start start 2023-10-08T15:41:02.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.874+0000 7f1e7f59e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1e8006be60 0x7f1e80147330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:02.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.874+0000 7f1e7f59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e8006ca70 0x7f1e8009c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:02.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.874+0000 7f1e7f59e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1e8014ac50 0x7f1e8009c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:02.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.874+0000 7f1e7f59e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8009e1b0 con 0x7f1e8014ac50 2023-10-08T15:41:02.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.874+0000 7f1e7f59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e80151f70 con 0x7f1e8006ca70 2023-10-08T15:41:02.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.874+0000 7f1e7f59e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e80147de0 con 0x7f1e8006be60 2023-10-08T15:41:02.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.874+0000 7f1e7ed9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1e8014ac50 0x7f1e8009c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:02.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.874+0000 7f1e7ed9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1e8014ac50 0x7f1e8009c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36964/0 (socket says 172.21.15.3:36964) 2023-10-08T15:41:02.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.874+0000 7f1e7ed9d700 1 -- 172.21.15.3:0/450745168 learned_addr learned my addr 172.21.15.3:0/450745168 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:02.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.874+0000 7f1e7e59c700 1 --2- 172.21.15.3:0/450745168 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1e8006be60 0x7f1e80147330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:02.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.874+0000 7f1e7dd9b700 1 --2- 172.21.15.3:0/450745168 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e8006ca70 0x7f1e8009c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:02.883 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.878+0000 7f1e7ed9d700 1 -- 172.21.15.3:0/450745168 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1e8006be60 msgr2=0x7f1e80147330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:02.883 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.878+0000 7f1e7ed9d700 1 --2- 172.21.15.3:0/450745168 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1e8006be60 0x7f1e80147330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:02.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.878+0000 7f1e7ed9d700 1 -- 172.21.15.3:0/450745168 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e8006ca70 msgr2=0x7f1e8009c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:02.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.878+0000 7f1e7ed9d700 1 --2- 172.21.15.3:0/450745168 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e8006ca70 0x7f1e8009c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:02.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.878+0000 7f1e7ed9d700 1 -- 172.21.15.3:0/450745168 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e70009420 con 0x7f1e8014ac50 2023-10-08T15:41:02.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.878+0000 7f1e7dd9b700 1 --2- 172.21.15.3:0/450745168 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e8006ca70 0x7f1e8009c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:02.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.878+0000 7f1e7ed9d700 1 --2- 172.21.15.3:0/450745168 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1e8014ac50 0x7f1e8009c9f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f1e7800c580 tx=0x7f1e78007d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:02.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.878+0000 7f1e767fc700 1 -- 172.21.15.3:0/450745168 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e78005c00 con 0x7f1e8014ac50 2023-10-08T15:41:02.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.878+0000 7f1e767fc700 1 -- 172.21.15.3:0/450745168 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e78005d60 con 0x7f1e8014ac50 2023-10-08T15:41:02.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.878+0000 7f1e7f59e700 1 -- 172.21.15.3:0/450745168 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e80147870 con 0x7f1e8014ac50 2023-10-08T15:41:02.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.878+0000 7f1e767fc700 1 -- 172.21.15.3:0/450745168 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e78007320 con 0x7f1e8014ac50 2023-10-08T15:41:02.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.878+0000 7f1e7f59e700 1 -- 172.21.15.3:0/450745168 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e80151c80 con 0x7f1e8014ac50 2023-10-08T15:41:02.885 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.878+0000 7f1e7f59e700 1 -- 172.21.15.3:0/450745168 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e80152520 con 0x7f1e8014ac50 2023-10-08T15:41:02.885 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.878+0000 7f1e767fc700 1 -- 172.21.15.3:0/450745168 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f1e78007690 con 0x7f1e8014ac50 2023-10-08T15:41:02.885 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.878+0000 7f1e767fc700 1 --2- 172.21.15.3:0/450745168 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1e64060550 0x7f1e64062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:02.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.882+0000 7f1e767fc700 1 -- 172.21.15.3:0/450745168 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f1e7807b980 con 0x7f1e8014ac50 2023-10-08T15:41:02.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.882+0000 7f1e7e59c700 1 --2- 172.21.15.3:0/450745168 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1e64060550 0x7f1e64062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:02.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.882+0000 7f1e7e59c700 1 --2- 172.21.15.3:0/450745168 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1e64060550 0x7f1e64062a00 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1e80069ed0 tx=0x7f1e70017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:02.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:02.886+0000 7f1e767fc700 1 -- 172.21.15.3:0/450745168 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1e7804c2c0 con 0x7f1e8014ac50 2023-10-08T15:41:03.050 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.046+0000 7f1e7f59e700 1 -- 172.21.15.3:0/450745168 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1e8005ecf0 con 0x7f1e8014ac50 2023-10-08T15:41:03.052 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.046+0000 7f1e767fc700 1 -- 172.21.15.3:0/450745168 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+12038 (secure 0 0 0) 0x7f1e78017090 con 0x7f1e8014ac50 2023-10-08T15:41:03.053 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:41:03.053 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":45,"fsid":"7635972e-cd66-4a8f-a231-378db8b3847a","created":"2023-10-08T15:37:08.234594+0000","modified":"2023-10-08T15:41:02.358082+0000","last_up_change":"2023-10-08T15:37:17.537726+0000","last_in_change":"2023-10-08T15:37:10.269178+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:37:16.581590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"64fb1864-bfdd-4d75-9b41-03fb60085dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33363},{"type":"v1","addr":"172.21.15.3:6801","nonce":33363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33363},{"type":"v1","addr":"172.21.15.3:6803","nonce":33363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":33363},{"type":"v1","addr":"172.21.15.3:6807","nonce":33363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33363},{"type":"v1","addr":"172.21.15.3:6805","nonce":33363}]},"public_addr":"172.21.15.3:6801/33363","cluster_addr":"172.21.15.3:6803/33363","heartbeat_back_addr":"172.21.15.3:6807/33363","heartbeat_front_addr":"172.21.15.3:6805/33363","state":["exists","up"]},{"osd":1,"uuid":"3ca6bd3a-3e8a-4c65-af9c-46148b0c2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33364},{"type":"v1","addr":"172.21.15.3:6820","nonce":33364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33364},{"type":"v1","addr":"172.21.15.3:6824","nonce":33364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33364},{"type":"v1","addr":"172.21.15.3:6831","nonce":33364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33364},{"type":"v1","addr":"172.21.15.3:6828","nonce":33364}]},"public_addr":"172.21.15.3:6820/33364","cluster_addr":"172.21.15.3:6824/33364","heartbeat_back_addr":"172.21.15.3:6831/33364","heartbeat_front_addr":"172.21.15.3:6828/33364","state":["exists","up"]},{"osd":2,"uuid":"6eb9f757-58dd-442f-910d-32401454bce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33366},{"type":"v1","addr":"172.21.15.3:6817","nonce":33366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":33366},{"type":"v1","addr":"172.21.15.3:6821","nonce":33366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6827","nonce":33366},{"type":"v1","addr":"172.21.15.3:6829","nonce":33366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":33366},{"type":"v1","addr":"172.21.15.3:6825","nonce":33366}]},"public_addr":"172.21.15.3:6817/33366","cluster_addr":"172.21.15.3:6821/33366","heartbeat_back_addr":"172.21.15.3:6829/33366","heartbeat_front_addr":"172.21.15.3:6825/33366","state":["exists","up"]},{"osd":3,"uuid":"1c39866b-ac2e-4ea9-a69c-02b01ee4191d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33365},{"type":"v1","addr":"172.21.15.3:6809","nonce":33365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":33365},{"type":"v1","addr":"172.21.15.3:6811","nonce":33365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33365},{"type":"v1","addr":"172.21.15.3:6815","nonce":33365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":33365},{"type":"v1","addr":"172.21.15.3:6813","nonce":33365}]},"public_addr":"172.21.15.3:6809/33365","cluster_addr":"172.21.15.3:6811/33365","heartbeat_back_addr":"172.21.15.3:6815/33365","heartbeat_front_addr":"172.21.15.3:6813/33365","state":["exists","up"]},{"osd":4,"uuid":"15f86b61-b7f1-4780-ae00-9d80a68cb830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":33605},{"type":"v1","addr":"172.21.15.50:6809","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33605},{"type":"v1","addr":"172.21.15.50:6811","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33605},{"type":"v1","addr":"172.21.15.50:6815","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":33605},{"type":"v1","addr":"172.21.15.50:6813","nonce":33605}]},"public_addr":"172.21.15.50:6809/33605","cluster_addr":"172.21.15.50:6811/33605","heartbeat_back_addr":"172.21.15.50:6815/33605","heartbeat_front_addr":"172.21.15.50:6813/33605","state":["exists","up"]},{"osd":5,"uuid":"726c3003-34e6-4d5a-b6e2-f911e13c2118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33606},{"type":"v1","addr":"172.21.15.50:6801","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33606},{"type":"v1","addr":"172.21.15.50:6803","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33606},{"type":"v1","addr":"172.21.15.50:6807","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":33606},{"type":"v1","addr":"172.21.15.50:6805","nonce":33606}]},"public_addr":"172.21.15.50:6801/33606","cluster_addr":"172.21.15.50:6803/33606","heartbeat_back_addr":"172.21.15.50:6807/33606","heartbeat_front_addr":"172.21.15.50:6805/33606","state":["exists","up"]},{"osd":6,"uuid":"401122a4-9988-441f-a5a7-39164434ebcd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":33607},{"type":"v1","addr":"172.21.15.50:6819","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":33607},{"type":"v1","addr":"172.21.15.50:6823","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":33607},{"type":"v1","addr":"172.21.15.50:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":33607},{"type":"v1","addr":"172.21.15.50:6827","nonce":33607}]},"public_addr":"172.21.15.50:6819/33607","cluster_addr":"172.21.15.50:6823/33607","heartbeat_back_addr":"172.21.15.50:6831/33607","heartbeat_front_addr":"172.21.15.50:6827/33607","state":["exists","up"]},{"osd":7,"uuid":"6b3fa236-c9d0-4c4d-82ae-9af4daf6d699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33604},{"type":"v1","addr":"172.21.15.50:6818","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":33604},{"type":"v1","addr":"172.21.15.50:6822","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":33604},{"type":"v1","addr":"172.21.15.50:6830","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":33604},{"type":"v1","addr":"172.21.15.50:6826","nonce":33604}]},"public_addr":"172.21.15.50:6818/33604","cluster_addr":"172.21.15.50:6822/33604","heartbeat_back_addr":"172.21.15.50:6830/33604","heartbeat_front_addr":"172.21.15.50:6826/33604","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.497794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.529417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.873426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.325972+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.443971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.240795+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.739632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.643026+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:41:03.055 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.050+0000 7f1e7f59e700 1 -- 172.21.15.3:0/450745168 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1e64060550 msgr2=0x7f1e64062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:03.055 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.050+0000 7f1e7f59e700 1 --2- 172.21.15.3:0/450745168 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1e64060550 0x7f1e64062a00 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1e80069ed0 tx=0x7f1e70017000 comp rx=0 tx=0).stop 2023-10-08T15:41:03.055 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.050+0000 7f1e7f59e700 1 -- 172.21.15.3:0/450745168 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1e8014ac50 msgr2=0x7f1e8009c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:03.055 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.050+0000 7f1e7f59e700 1 --2- 172.21.15.3:0/450745168 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1e8014ac50 0x7f1e8009c9f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f1e7800c580 tx=0x7f1e78007d50 comp rx=0 tx=0).stop 2023-10-08T15:41:03.055 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.050+0000 7f1e7f59e700 1 -- 172.21.15.3:0/450745168 shutdown_connections 2023-10-08T15:41:03.056 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.050+0000 7f1e7f59e700 1 --2- 172.21.15.3:0/450745168 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1e64060550 0x7f1e64062a00 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:03.056 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.050+0000 7f1e7f59e700 1 --2- 172.21.15.3:0/450745168 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1e8014ac50 0x7f1e8009c9f0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:03.056 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.050+0000 7f1e7f59e700 1 --2- 172.21.15.3:0/450745168 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e8006ca70 0x7f1e8009c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:03.056 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.050+0000 7f1e7f59e700 1 --2- 172.21.15.3:0/450745168 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1e8006be60 0x7f1e80147330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:03.056 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.050+0000 7f1e7f59e700 1 -- 172.21.15.3:0/450745168 >> 172.21.15.3:0/450745168 conn(0x7f1e800c1df0 msgr2=0x7f1e8014b590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:03.056 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.050+0000 7f1e7f59e700 1 -- 172.21.15.3:0/450745168 shutdown_connections 2023-10-08T15:41:03.056 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.050+0000 7f1e7f59e700 1 -- 172.21.15.3:0/450745168 wait complete. 2023-10-08T15:41:03.067 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T15:37:16.581590+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-08T15:41:03.068 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T15:41:03.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.174+0000 7fc50c0ed700 1 Processor -- start 2023-10-08T15:41:03.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.174+0000 7fc50c0ed700 1 -- start start 2023-10-08T15:41:03.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.174+0000 7fc50c0ed700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fc5040bf3a0 0x7fc50406cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:03.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.174+0000 7fc50c0ed700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc50406c830 0x7fc50406d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:03.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.174+0000 7fc50c0ed700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc50406d9d0 0x7fc50414ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:03.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.174+0000 7fc50c0ed700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc50414c0e0 con 0x7fc5040bf3a0 2023-10-08T15:41:03.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.174+0000 7fc50c0ed700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc50414c570 con 0x7fc50406d9d0 2023-10-08T15:41:03.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.174+0000 7fc50c0ed700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc50414ba90 con 0x7fc50406c830 2023-10-08T15:41:03.182 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.174+0000 7fc509e89700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fc5040bf3a0 0x7fc50406cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:03.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.174+0000 7fc509e89700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fc5040bf3a0 0x7fc50406cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36976/0 (socket says 172.21.15.3:36976) 2023-10-08T15:41:03.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.174+0000 7fc509e89700 1 -- 172.21.15.3:0/2156343067 learned_addr learned my addr 172.21.15.3:0/2156343067 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:03.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.174+0000 7fc509688700 1 --2- 172.21.15.3:0/2156343067 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc50406c830 0x7fc50406d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:03.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.174+0000 7fc50a68a700 1 --2- 172.21.15.3:0/2156343067 >> v2:172.21.15.50:3300/0 conn(0x7fc50406d9d0 0x7fc50414ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:03.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.174+0000 7fc509e89700 1 -- 172.21.15.3:0/2156343067 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc50406c830 msgr2=0x7fc50406d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:03.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.174+0000 7fc509e89700 1 --2- 172.21.15.3:0/2156343067 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc50406c830 0x7fc50406d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:03.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.174+0000 7fc509e89700 1 -- 172.21.15.3:0/2156343067 >> v2:172.21.15.50:3300/0 conn(0x7fc50406d9d0 msgr2=0x7fc50414ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:03.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.174+0000 7fc509e89700 1 --2- 172.21.15.3:0/2156343067 >> v2:172.21.15.50:3300/0 conn(0x7fc50406d9d0 0x7fc50414ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:03.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.178+0000 7fc509e89700 1 -- 172.21.15.3:0/2156343067 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc50414bd70 con 0x7fc5040bf3a0 2023-10-08T15:41:03.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.178+0000 7fc509e89700 1 --2- 172.21.15.3:0/2156343067 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc5040bf3a0 0x7fc50406cf50 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fc504069d50 tx=0x7fc4f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bacf2c580396a63f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:03.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.178+0000 7fc508e87700 1 -- 172.21.15.3:0/2156343067 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f400b640 con 0x7fc5040bf3a0 2023-10-08T15:41:03.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.178+0000 7fc508e87700 1 -- 172.21.15.3:0/2156343067 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4f400b7a0 con 0x7fc5040bf3a0 2023-10-08T15:41:03.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.178+0000 7fc508e87700 1 -- 172.21.15.3:0/2156343067 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f400bb60 con 0x7fc5040bf3a0 2023-10-08T15:41:03.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.178+0000 7fc50c0ed700 1 -- 172.21.15.3:0/2156343067 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc5040bf3a0 msgr2=0x7fc50406cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:03.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.178+0000 7fc50c0ed700 1 --2- 172.21.15.3:0/2156343067 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc5040bf3a0 0x7fc50406cf50 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fc504069d50 tx=0x7fc4f4009250 comp rx=0 tx=0).stop 2023-10-08T15:41:03.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.178+0000 7fc50c0ed700 1 -- 172.21.15.3:0/2156343067 shutdown_connections 2023-10-08T15:41:03.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.178+0000 7fc50c0ed700 1 --2- 172.21.15.3:0/2156343067 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc50406c830 0x7fc50406d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:03.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.178+0000 7fc50c0ed700 1 --2- 172.21.15.3:0/2156343067 >> v2:172.21.15.50:3300/0 conn(0x7fc50406d9d0 0x7fc50414ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:03.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.178+0000 7fc50c0ed700 1 --2- 172.21.15.3:0/2156343067 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc5040bf3a0 0x7fc50406cf50 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:03.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.178+0000 7fc50c0ed700 1 -- 172.21.15.3:0/2156343067 >> 172.21.15.3:0/2156343067 conn(0x7fc5040c2a40 msgr2=0x7fc5040bea60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:03.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.178+0000 7fc50c0ed700 1 -- 172.21.15.3:0/2156343067 shutdown_connections 2023-10-08T15:41:03.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.178+0000 7fc50c0ed700 1 -- 172.21.15.3:0/2156343067 wait complete. 2023-10-08T15:41:03.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.178+0000 7fc50c0ed700 1 Processor -- start 2023-10-08T15:41:03.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.178+0000 7fc50c0ed700 1 -- start start 2023-10-08T15:41:03.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.182+0000 7fc50c0ed700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc50406c830 0x7fc504148a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:03.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.182+0000 7fc50c0ed700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc50406d9d0 0x7fc504144a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:03.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.182+0000 7fc50c0ed700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc5040bf3a0 0x7fc504149530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:03.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.182+0000 7fc50c0ed700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc504150cf0 con 0x7fc5040bf3a0 2023-10-08T15:41:03.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.182+0000 7fc50c0ed700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc50414a3a0 con 0x7fc50406d9d0 2023-10-08T15:41:03.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.182+0000 7fc50c0ed700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc50415b350 con 0x7fc50406c830 2023-10-08T15:41:03.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.182+0000 7fc50a68a700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc5040bf3a0 0x7fc504149530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:03.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.182+0000 7fc50a68a700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc5040bf3a0 0x7fc504149530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36984/0 (socket says 172.21.15.3:36984) 2023-10-08T15:41:03.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.182+0000 7fc50a68a700 1 -- 172.21.15.3:0/1367399814 learned_addr learned my addr 172.21.15.3:0/1367399814 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:03.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.182+0000 7fc509688700 1 --2- 172.21.15.3:0/1367399814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc50406d9d0 0x7fc504144a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:03.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.182+0000 7fc509e89700 1 --2- 172.21.15.3:0/1367399814 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc50406c830 0x7fc504148a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:03.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.182+0000 7fc50a68a700 1 -- 172.21.15.3:0/1367399814 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc50406c830 msgr2=0x7fc504148a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:03.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.182+0000 7fc50a68a700 1 --2- 172.21.15.3:0/1367399814 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc50406c830 0x7fc504148a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:03.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.182+0000 7fc50a68a700 1 -- 172.21.15.3:0/1367399814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc50406d9d0 msgr2=0x7fc504144a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:03.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.182+0000 7fc50a68a700 1 --2- 172.21.15.3:0/1367399814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc50406d9d0 0x7fc504144a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:03.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.182+0000 7fc50a68a700 1 -- 172.21.15.3:0/1367399814 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4f40094f0 con 0x7fc5040bf3a0 2023-10-08T15:41:03.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.182+0000 7fc509e89700 1 --2- 172.21.15.3:0/1367399814 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc50406c830 0x7fc504148a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:41:03.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.182+0000 7fc509688700 1 --2- 172.21.15.3:0/1367399814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc50406d9d0 0x7fc504144a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:41:03.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.182+0000 7fc50a68a700 1 --2- 172.21.15.3:0/1367399814 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc5040bf3a0 0x7fc504149530 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc009ec0 tx=0x7fc4fc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:03.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.182+0000 7fc4f9ffb700 1 -- 172.21.15.3:0/1367399814 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc00cc20 con 0x7fc5040bf3a0 2023-10-08T15:41:03.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.182+0000 7fc4f9ffb700 1 -- 172.21.15.3:0/1367399814 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4fc00f040 con 0x7fc5040bf3a0 2023-10-08T15:41:03.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.182+0000 7fc50c0ed700 1 -- 172.21.15.3:0/1367399814 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc504141350 con 0x7fc5040bf3a0 2023-10-08T15:41:03.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.182+0000 7fc4f9ffb700 1 -- 172.21.15.3:0/1367399814 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc014480 con 0x7fc5040bf3a0 2023-10-08T15:41:03.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.182+0000 7fc50c0ed700 1 -- 172.21.15.3:0/1367399814 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc504151660 con 0x7fc5040bf3a0 2023-10-08T15:41:03.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.182+0000 7fc50c0ed700 1 -- 172.21.15.3:0/1367399814 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc50415b7a0 con 0x7fc5040bf3a0 2023-10-08T15:41:03.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.186+0000 7fc4f9ffb700 1 -- 172.21.15.3:0/1367399814 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc4fc014830 con 0x7fc5040bf3a0 2023-10-08T15:41:03.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.186+0000 7fc4f9ffb700 1 --2- 172.21.15.3:0/1367399814 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc4e8060550 0x7fc4e8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:03.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.186+0000 7fc4f9ffb700 1 -- 172.21.15.3:0/1367399814 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fc4fc07d4d0 con 0x7fc5040bf3a0 2023-10-08T15:41:03.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.186+0000 7fc509e89700 1 --2- 172.21.15.3:0/1367399814 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc4e8060550 0x7fc4e8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:03.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.186+0000 7fc509e89700 1 --2- 172.21.15.3:0/1367399814 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc4e8060550 0x7fc4e8062a00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc504069d50 tx=0x7fc4f4017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:03.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.190+0000 7fc4f9ffb700 1 -- 172.21.15.3:0/1367399814 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc4fc051880 con 0x7fc5040bf3a0 2023-10-08T15:41:03.356 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.350+0000 7fc50c0ed700 1 -- 172.21.15.3:0/1367399814 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc50415b7a0 con 0x7fc5040bf3a0 2023-10-08T15:41:03.357 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.354+0000 7fc4f9ffb700 1 -- 172.21.15.3:0/1367399814 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v45) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc50415b7a0 con 0x7fc5040bf3a0 2023-10-08T15:41:03.357 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2023-10-08T15:41:03.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.354+0000 7fc50c0ed700 1 -- 172.21.15.3:0/1367399814 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc4e8060550 msgr2=0x7fc4e8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:03.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.354+0000 7fc50c0ed700 1 --2- 172.21.15.3:0/1367399814 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc4e8060550 0x7fc4e8062a00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc504069d50 tx=0x7fc4f4017000 comp rx=0 tx=0).stop 2023-10-08T15:41:03.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.354+0000 7fc50c0ed700 1 -- 172.21.15.3:0/1367399814 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc5040bf3a0 msgr2=0x7fc504149530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:03.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.354+0000 7fc50c0ed700 1 --2- 172.21.15.3:0/1367399814 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc5040bf3a0 0x7fc504149530 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc009ec0 tx=0x7fc4fc00b040 comp rx=0 tx=0).stop 2023-10-08T15:41:03.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.354+0000 7fc50c0ed700 1 -- 172.21.15.3:0/1367399814 shutdown_connections 2023-10-08T15:41:03.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.354+0000 7fc50c0ed700 1 --2- 172.21.15.3:0/1367399814 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc4e8060550 0x7fc4e8062a00 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:03.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.354+0000 7fc50c0ed700 1 --2- 172.21.15.3:0/1367399814 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc5040bf3a0 0x7fc504149530 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:03.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.354+0000 7fc50c0ed700 1 --2- 172.21.15.3:0/1367399814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc50406d9d0 0x7fc504144a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:03.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.354+0000 7fc50c0ed700 1 --2- 172.21.15.3:0/1367399814 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc50406c830 0x7fc504148a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:03.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.354+0000 7fc50c0ed700 1 -- 172.21.15.3:0/1367399814 >> 172.21.15.3:0/1367399814 conn(0x7fc5040c2a40 msgr2=0x7fc50414af00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:03.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.358+0000 7fc50c0ed700 1 -- 172.21.15.3:0/1367399814 shutdown_connections 2023-10-08T15:41:03.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.358+0000 7fc50c0ed700 1 -- 172.21.15.3:0/1367399814 wait complete. 2023-10-08T15:41:03.378 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T15:41:03.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.474+0000 7f94a359e700 1 Processor -- start 2023-10-08T15:41:03.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.474+0000 7f94a359e700 1 -- start start 2023-10-08T15:41:03.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.474+0000 7f94a359e700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f94a4067310 0x7f94a40bfe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:03.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.474+0000 7f94a359e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f94a40ba440 0x7f94a414eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:03.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.474+0000 7f94a359e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94a4153a70 con 0x7f94a409ef40 2023-10-08T15:41:03.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.474+0000 7f94a359e700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94a409f460 con 0x7f94a4067310 2023-10-08T15:41:03.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.474+0000 7f94a359e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94a4153de0 con 0x7f94a40ba440 2023-10-08T15:41:03.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.474+0000 7f94a259c700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f94a4067310 0x7f94a40bfe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:03.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.478+0000 7f94a259c700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f94a4067310 0x7f94a40bfe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36986/0 (socket says 172.21.15.3:36986) 2023-10-08T15:41:03.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.478+0000 7f94a259c700 1 -- 172.21.15.3:0/973574730 learned_addr learned my addr 172.21.15.3:0/973574730 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:03.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.478+0000 7f94a2d9d700 1 --2- 172.21.15.3:0/973574730 >> v2:172.21.15.50:3300/0 conn(0x7f94a40ba440 0x7f94a414eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:03.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.478+0000 7f94a259c700 1 -- 172.21.15.3:0/973574730 >> v2:172.21.15.50:3300/0 conn(0x7f94a40ba440 msgr2=0x7f94a414eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:03.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.478+0000 7f94a259c700 1 --2- 172.21.15.3:0/973574730 >> v2:172.21.15.50:3300/0 conn(0x7f94a40ba440 0x7f94a414eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:03.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.478+0000 7f94a259c700 1 -- 172.21.15.3:0/973574730 >> v1:172.21.15.50:6789/0 conn(0x7f94a409ef40 legacy=0x7f94a40c03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:03.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.478+0000 7f94a259c700 1 -- 172.21.15.3:0/973574730 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a40bc410 con 0x7f94a4067310 2023-10-08T15:41:03.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.478+0000 7f94a259c700 1 --2- 172.21.15.3:0/973574730 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f94a4067310 0x7f94a40bfe80 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f94a4068840 tx=0x7f9498009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ed1b5327859026d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:03.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.478+0000 7f94a159a700 1 -- 172.21.15.3:0/973574730 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9498009e70 con 0x7f94a4067310 2023-10-08T15:41:03.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.478+0000 7f94a159a700 1 -- 172.21.15.3:0/973574730 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f949800b860 con 0x7f94a4067310 2023-10-08T15:41:03.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.478+0000 7f94a159a700 1 -- 172.21.15.3:0/973574730 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949800bc00 con 0x7f94a4067310 2023-10-08T15:41:03.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.478+0000 7f94a359e700 1 -- 172.21.15.3:0/973574730 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f94a4067310 msgr2=0x7f94a40bfe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:03.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.478+0000 7f94a359e700 1 --2- 172.21.15.3:0/973574730 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f94a4067310 0x7f94a40bfe80 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f94a4068840 tx=0x7f9498009250 comp rx=0 tx=0).stop 2023-10-08T15:41:03.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.478+0000 7f94a359e700 1 -- 172.21.15.3:0/973574730 shutdown_connections 2023-10-08T15:41:03.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.478+0000 7f94a359e700 1 --2- 172.21.15.3:0/973574730 >> v2:172.21.15.50:3300/0 conn(0x7f94a40ba440 0x7f94a414eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:03.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.478+0000 7f94a359e700 1 --2- 172.21.15.3:0/973574730 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f94a4067310 0x7f94a40bfe80 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:03.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.478+0000 7f94a359e700 1 -- 172.21.15.3:0/973574730 >> 172.21.15.3:0/973574730 conn(0x7f94a406dfb0 msgr2=0x7f94a406e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:03.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.478+0000 7f94a359e700 1 -- 172.21.15.3:0/973574730 shutdown_connections 2023-10-08T15:41:03.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.478+0000 7f94a359e700 1 -- 172.21.15.3:0/973574730 wait complete. 2023-10-08T15:41:03.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.482+0000 7f94a359e700 1 Processor -- start 2023-10-08T15:41:03.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.482+0000 7f94a359e700 1 -- start start 2023-10-08T15:41:03.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.482+0000 7f94a359e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f94a4067310 0x7f94a4152690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:03.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.482+0000 7f94a359e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f94a409ef40 0x7f94a415fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:03.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.482+0000 7f94a359e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94a40ba440 0x7f94a4160310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:03.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.482+0000 7f94a359e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a4096e80 con 0x7f94a4067310 2023-10-08T15:41:03.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.482+0000 7f94a359e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a40a2310 con 0x7f94a40ba440 2023-10-08T15:41:03.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.482+0000 7f94a359e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94a415f980 con 0x7f94a409ef40 2023-10-08T15:41:03.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.482+0000 7f94a259c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f94a4067310 0x7f94a4152690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:03.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.482+0000 7f94a259c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f94a4067310 0x7f94a4152690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36998/0 (socket says 172.21.15.3:36998) 2023-10-08T15:41:03.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.482+0000 7f94a259c700 1 -- 172.21.15.3:0/2214875644 learned_addr learned my addr 172.21.15.3:0/2214875644 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:03.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.482+0000 7f94a1d9b700 1 --2- 172.21.15.3:0/2214875644 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f94a409ef40 0x7f94a415fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:03.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.482+0000 7f94a2d9d700 1 --2- 172.21.15.3:0/2214875644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94a40ba440 0x7f94a4160310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:03.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.482+0000 7f94a259c700 1 -- 172.21.15.3:0/2214875644 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f94a409ef40 msgr2=0x7f94a415fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:03.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.482+0000 7f94a259c700 1 --2- 172.21.15.3:0/2214875644 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f94a409ef40 0x7f94a415fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:03.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.482+0000 7f94a259c700 1 -- 172.21.15.3:0/2214875644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94a40ba440 msgr2=0x7f94a4160310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:03.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.482+0000 7f94a259c700 1 --2- 172.21.15.3:0/2214875644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94a40ba440 0x7f94a4160310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:03.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.482+0000 7f94a259c700 1 -- 172.21.15.3:0/2214875644 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94980094f0 con 0x7f94a4067310 2023-10-08T15:41:03.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.482+0000 7f94a259c700 1 --2- 172.21.15.3:0/2214875644 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f94a4067310 0x7f94a4152690 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f94a406ef90 tx=0x7f9498017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:03.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.482+0000 7f94927fc700 1 -- 172.21.15.3:0/2214875644 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949800bbe0 con 0x7f94a4067310 2023-10-08T15:41:03.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.486+0000 7f94927fc700 1 -- 172.21.15.3:0/2214875644 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9498000c90 con 0x7f94a4067310 2023-10-08T15:41:03.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.486+0000 7f94a359e700 1 -- 172.21.15.3:0/2214875644 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94a4095a70 con 0x7f94a4067310 2023-10-08T15:41:03.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.486+0000 7f94927fc700 1 -- 172.21.15.3:0/2214875644 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9498011650 con 0x7f94a4067310 2023-10-08T15:41:03.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.486+0000 7f94a359e700 1 -- 172.21.15.3:0/2214875644 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94a40963c0 con 0x7f94a4067310 2023-10-08T15:41:03.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.486+0000 7f94927fc700 1 -- 172.21.15.3:0/2214875644 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f9498011a40 con 0x7f94a4067310 2023-10-08T15:41:03.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.486+0000 7f94a359e700 1 -- 172.21.15.3:0/2214875644 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94a405ecf0 con 0x7f94a4067310 2023-10-08T15:41:03.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.486+0000 7f94927fc700 1 --2- 172.21.15.3:0/2214875644 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f9484060550 0x7f9484062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:03.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.486+0000 7f94927fc700 1 -- 172.21.15.3:0/2214875644 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f949807d8d0 con 0x7f94a4067310 2023-10-08T15:41:03.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.486+0000 7f94a1d9b700 1 --2- 172.21.15.3:0/2214875644 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f9484060550 0x7f9484062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:03.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.486+0000 7f94a1d9b700 1 --2- 172.21.15.3:0/2214875644 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f9484060550 0x7f9484062a00 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f94a4097a00 tx=0x7f9494007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:03.501 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.498+0000 7f94927fc700 1 -- 172.21.15.3:0/2214875644 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f949804e210 con 0x7f94a4067310 2023-10-08T15:41:03.656 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.650+0000 7f94a359e700 1 -- 172.21.15.3:0/2214875644 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f94a40a2690 con 0x7f94a4067310 2023-10-08T15:41:03.657 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.650+0000 7f94927fc700 1 -- 172.21.15.3:0/2214875644 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v45) v1 ==== 84+0+65 (secure 0 0 0) 0x7f9498051830 con 0x7f94a4067310 2023-10-08T15:41:03.657 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:41:03.657 INFO:teuthology.orchestra.run.smithi003.stdout:[ 2023-10-08T15:41:03.657 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:41:03.657 INFO:teuthology.orchestra.run.smithi003.stdout: "poolnum": 1, 2023-10-08T15:41:03.657 INFO:teuthology.orchestra.run.smithi003.stdout: "poolname": ".mgr" 2023-10-08T15:41:03.658 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:41:03.658 INFO:teuthology.orchestra.run.smithi003.stdout:] 2023-10-08T15:41:03.659 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.654+0000 7f94a359e700 1 -- 172.21.15.3:0/2214875644 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f9484060550 msgr2=0x7f9484062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:03.659 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.654+0000 7f94a359e700 1 --2- 172.21.15.3:0/2214875644 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f9484060550 0x7f9484062a00 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f94a4097a00 tx=0x7f9494007ec0 comp rx=0 tx=0).stop 2023-10-08T15:41:03.660 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.654+0000 7f94a359e700 1 -- 172.21.15.3:0/2214875644 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f94a4067310 msgr2=0x7f94a4152690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:03.660 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.654+0000 7f94a359e700 1 --2- 172.21.15.3:0/2214875644 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f94a4067310 0x7f94a4152690 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f94a406ef90 tx=0x7f9498017000 comp rx=0 tx=0).stop 2023-10-08T15:41:03.660 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.654+0000 7f94a359e700 1 -- 172.21.15.3:0/2214875644 shutdown_connections 2023-10-08T15:41:03.660 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.654+0000 7f94a359e700 1 --2- 172.21.15.3:0/2214875644 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f9484060550 0x7f9484062a00 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:03.660 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.654+0000 7f94a359e700 1 --2- 172.21.15.3:0/2214875644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94a40ba440 0x7f94a4160310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:03.660 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.654+0000 7f94a359e700 1 --2- 172.21.15.3:0/2214875644 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f94a409ef40 0x7f94a415fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:03.660 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.654+0000 7f94a359e700 1 --2- 172.21.15.3:0/2214875644 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f94a4067310 0x7f94a4152690 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:03.660 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.654+0000 7f94a359e700 1 -- 172.21.15.3:0/2214875644 >> 172.21.15.3:0/2214875644 conn(0x7f94a406dfb0 msgr2=0x7f94a40beb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:03.660 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.654+0000 7f94a359e700 1 -- 172.21.15.3:0/2214875644 shutdown_connections 2023-10-08T15:41:03.660 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.654+0000 7f94a359e700 1 -- 172.21.15.3:0/2214875644 wait complete. 2023-10-08T15:41:03.671 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T15:41:03.671 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T15:41:03.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.778+0000 7f34a5a0d700 1 Processor -- start 2023-10-08T15:41:03.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.778+0000 7f34a5a0d700 1 -- start start 2023-10-08T15:41:03.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.778+0000 7f34a5a0d700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f34a00685b0 0x7f34a009e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:03.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.778+0000 7f34a5a0d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f34a00a10c0 0x7f34a014bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:03.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.778+0000 7f34a5a0d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34a009df40 con 0x7f34a014b980 2023-10-08T15:41:03.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.778+0000 7f34a5a0d700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34a014c730 con 0x7f34a00685b0 2023-10-08T15:41:03.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.778+0000 7f34a5a0d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a0149050 con 0x7f34a00a10c0 2023-10-08T15:41:03.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.778+0000 7f349ffff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f34a00685b0 0x7f34a009e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:03.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.778+0000 7f349ffff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f34a00685b0 0x7f34a009e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:37008/0 (socket says 172.21.15.3:37008) 2023-10-08T15:41:03.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.778+0000 7f349ffff700 1 -- 172.21.15.3:0/1484234096 learned_addr learned my addr 172.21.15.3:0/1484234096 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:03.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.778+0000 7f34a520c700 1 --2- 172.21.15.3:0/1484234096 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f34a00a10c0 0x7f34a014bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:03.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.778+0000 7f349ffff700 1 -- 172.21.15.3:0/1484234096 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f34a00a10c0 msgr2=0x7f34a014bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:03.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.778+0000 7f349ffff700 1 --2- 172.21.15.3:0/1484234096 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f34a00a10c0 0x7f34a014bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:03.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.778+0000 7f349ffff700 1 -- 172.21.15.3:0/1484234096 >> v1:172.21.15.50:6789/0 conn(0x7f34a014b980 legacy=0x7f34a00a09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:03.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.778+0000 7f349ffff700 1 -- 172.21.15.3:0/1484234096 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a014c450 con 0x7f34a00685b0 2023-10-08T15:41:03.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.778+0000 7f349ffff700 1 --2- 172.21.15.3:0/1484234096 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f34a00685b0 0x7f34a009e420 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f349000d1a0 tx=0x7f349000ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10aa4f0ff7b05d5f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:03.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.778+0000 7f349f7fe700 1 -- 172.21.15.3:0/1484234096 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3490010070 con 0x7f34a00685b0 2023-10-08T15:41:03.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.778+0000 7f349f7fe700 1 -- 172.21.15.3:0/1484234096 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349000de80 con 0x7f34a00685b0 2023-10-08T15:41:03.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.778+0000 7f349f7fe700 1 -- 172.21.15.3:0/1484234096 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349000b320 con 0x7f34a00685b0 2023-10-08T15:41:03.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.778+0000 7f34a5a0d700 1 -- 172.21.15.3:0/1484234096 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f34a00685b0 msgr2=0x7f34a009e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:03.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.778+0000 7f34a5a0d700 1 --2- 172.21.15.3:0/1484234096 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f34a00685b0 0x7f34a009e420 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f349000d1a0 tx=0x7f349000ba50 comp rx=0 tx=0).stop 2023-10-08T15:41:03.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.778+0000 7f34a5a0d700 1 -- 172.21.15.3:0/1484234096 shutdown_connections 2023-10-08T15:41:03.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.778+0000 7f34a5a0d700 1 --2- 172.21.15.3:0/1484234096 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f34a00a10c0 0x7f34a014bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:03.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.778+0000 7f34a5a0d700 1 --2- 172.21.15.3:0/1484234096 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f34a00685b0 0x7f34a009e420 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:03.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.778+0000 7f34a5a0d700 1 -- 172.21.15.3:0/1484234096 >> 172.21.15.3:0/1484234096 conn(0x7f34a00bd9d0 msgr2=0x7f34a00bddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:03.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.778+0000 7f34a5a0d700 1 -- 172.21.15.3:0/1484234096 shutdown_connections 2023-10-08T15:41:03.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.778+0000 7f34a5a0d700 1 -- 172.21.15.3:0/1484234096 wait complete. 2023-10-08T15:41:03.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.782+0000 7f34a5a0d700 1 Processor -- start 2023-10-08T15:41:03.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.782+0000 7f34a5a0d700 1 -- start start 2023-10-08T15:41:03.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.786+0000 7f34a5a0d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f34a00685b0 0x7f34a00bca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:03.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.786+0000 7f34a5a0d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34a00a10c0 0x7f34a0146980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:03.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.786+0000 7f34a5a0d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f34a014b980 0x7f34a006ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:03.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.786+0000 7f34a5a0d700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a00bd7b0 con 0x7f34a00685b0 2023-10-08T15:41:03.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.786+0000 7f34a5a0d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a0140ed0 con 0x7f34a00a10c0 2023-10-08T15:41:03.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.786+0000 7f34a5a0d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a015b520 con 0x7f34a014b980 2023-10-08T15:41:03.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.786+0000 7f34a4a0b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f34a00685b0 0x7f34a00bca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:03.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.786+0000 7f34a4a0b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f34a00685b0 0x7f34a00bca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:37018/0 (socket says 172.21.15.3:37018) 2023-10-08T15:41:03.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.786+0000 7f34a4a0b700 1 -- 172.21.15.3:0/1000944551 learned_addr learned my addr 172.21.15.3:0/1000944551 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:03.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.786+0000 7f34a520c700 1 --2- 172.21.15.3:0/1000944551 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f34a014b980 0x7f34a006ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:03.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.786+0000 7f349ffff700 1 --2- 172.21.15.3:0/1000944551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34a00a10c0 0x7f34a0146980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:03.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.786+0000 7f34a4a0b700 1 -- 172.21.15.3:0/1000944551 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f34a014b980 msgr2=0x7f34a006ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:03.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.786+0000 7f34a4a0b700 1 --2- 172.21.15.3:0/1000944551 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f34a014b980 0x7f34a006ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:03.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.786+0000 7f34a4a0b700 1 -- 172.21.15.3:0/1000944551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34a00a10c0 msgr2=0x7f34a0146980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:03.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.786+0000 7f34a4a0b700 1 --2- 172.21.15.3:0/1000944551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34a00a10c0 0x7f34a0146980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:03.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.786+0000 7f34a4a0b700 1 -- 172.21.15.3:0/1000944551 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f349000bcf0 con 0x7f34a00685b0 2023-10-08T15:41:03.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.786+0000 7f34a4a0b700 1 --2- 172.21.15.3:0/1000944551 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f34a00685b0 0x7f34a00bca40 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f349400b5e0 tx=0x7f3494009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:03.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.786+0000 7f349cff9700 1 -- 172.21.15.3:0/1000944551 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349400f510 con 0x7f34a00685b0 2023-10-08T15:41:03.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.786+0000 7f349cff9700 1 -- 172.21.15.3:0/1000944551 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349400f670 con 0x7f34a00685b0 2023-10-08T15:41:03.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.786+0000 7f349cff9700 1 -- 172.21.15.3:0/1000944551 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349400fa30 con 0x7f34a00685b0 2023-10-08T15:41:03.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.786+0000 7f34a5a0d700 1 -- 172.21.15.3:0/1000944551 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34a0140bf0 con 0x7f34a00685b0 2023-10-08T15:41:03.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.786+0000 7f34a5a0d700 1 -- 172.21.15.3:0/1000944551 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34a00bcf80 con 0x7f34a00685b0 2023-10-08T15:41:03.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.786+0000 7f34a5a0d700 1 -- 172.21.15.3:0/1000944551 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34a01570a0 con 0x7f34a00685b0 2023-10-08T15:41:03.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.790+0000 7f349cff9700 1 -- 172.21.15.3:0/1000944551 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f349401a400 con 0x7f34a00685b0 2023-10-08T15:41:03.794 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.790+0000 7f349cff9700 1 --2- 172.21.15.3:0/1000944551 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f348c060580 0x7f348c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:03.794 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.790+0000 7f349cff9700 1 -- 172.21.15.3:0/1000944551 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f349407bfa0 con 0x7f34a00685b0 2023-10-08T15:41:03.795 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.790+0000 7f349ffff700 1 --2- 172.21.15.3:0/1000944551 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f348c060580 0x7f348c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:03.795 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.790+0000 7f349ffff700 1 --2- 172.21.15.3:0/1000944551 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f348c060580 0x7f348c062a30 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f349000ba90 tx=0x7f3490019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:03.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.794+0000 7f349cff9700 1 -- 172.21.15.3:0/1000944551 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f349404c840 con 0x7f34a00685b0 2023-10-08T15:41:03.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:03.958+0000 7f34a5a0d700 1 -- 172.21.15.3:0/1000944551 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f34a015b350 con 0x7f34a00685b0 2023-10-08T15:41:04.397 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.390+0000 7f349cff9700 1 -- 172.21.15.3:0/1000944551 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v46) v1 ==== 138+0+0 (secure 0 0 0) 0x7f349404fe60 con 0x7f34a00685b0 2023-10-08T15:41:04.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.398+0000 7f34a5a0d700 1 -- 172.21.15.3:0/1000944551 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f348c060580 msgr2=0x7f348c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:04.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.398+0000 7f34a5a0d700 1 --2- 172.21.15.3:0/1000944551 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f348c060580 0x7f348c062a30 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f349000ba90 tx=0x7f3490019000 comp rx=0 tx=0).stop 2023-10-08T15:41:04.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.398+0000 7f34a5a0d700 1 -- 172.21.15.3:0/1000944551 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f34a00685b0 msgr2=0x7f34a00bca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:04.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.398+0000 7f34a5a0d700 1 --2- 172.21.15.3:0/1000944551 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f34a00685b0 0x7f34a00bca40 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f349400b5e0 tx=0x7f3494009120 comp rx=0 tx=0).stop 2023-10-08T15:41:04.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.402+0000 7f34a5a0d700 1 -- 172.21.15.3:0/1000944551 shutdown_connections 2023-10-08T15:41:04.407 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.402+0000 7f34a5a0d700 1 --2- 172.21.15.3:0/1000944551 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f348c060580 0x7f348c062a30 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:04.407 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.402+0000 7f34a5a0d700 1 --2- 172.21.15.3:0/1000944551 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f34a014b980 0x7f34a006ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:04.407 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.402+0000 7f34a5a0d700 1 --2- 172.21.15.3:0/1000944551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34a00a10c0 0x7f34a0146980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:04.407 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.402+0000 7f34a5a0d700 1 --2- 172.21.15.3:0/1000944551 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f34a00685b0 0x7f34a00bca40 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:04.407 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.402+0000 7f34a5a0d700 1 -- 172.21.15.3:0/1000944551 >> 172.21.15.3:0/1000944551 conn(0x7f34a00bd9d0 msgr2=0x7f34a0143870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:04.407 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.402+0000 7f34a5a0d700 1 -- 172.21.15.3:0/1000944551 shutdown_connections 2023-10-08T15:41:04.407 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.402+0000 7f34a5a0d700 1 -- 172.21.15.3:0/1000944551 wait complete. 2023-10-08T15:41:04.409 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'cephfs_metadata' created 2023-10-08T15:41:04.422 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T15:41:04.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.530+0000 7fc284994700 1 Processor -- start 2023-10-08T15:41:04.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.530+0000 7fc284994700 1 -- start start 2023-10-08T15:41:04.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.530+0000 7fc284994700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc280147840 0x7fc28014c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:04.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.530+0000 7fc284994700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fc280147c10 0x7fc280148050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:04.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.530+0000 7fc284994700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc28009d8d0 con 0x7fc28009ecd0 2023-10-08T15:41:04.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.530+0000 7fc284994700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc280148590 con 0x7fc280147c10 2023-10-08T15:41:04.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.530+0000 7fc284994700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2800a1fd0 con 0x7fc280147840 2023-10-08T15:41:04.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.530+0000 7fc27f59e700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fc280147c10 0x7fc280148050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:04.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.530+0000 7fc27e59c700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fc28009ecd0 0x7fc2800be0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:56272/0 (socket says 172.21.15.3:56272) 2023-10-08T15:41:04.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.530+0000 7fc27e59c700 1 -- 172.21.15.3:0/4258330215 learned_addr learned my addr 172.21.15.3:0/4258330215 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:41:04.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.530+0000 7fc27ed9d700 1 --2- 172.21.15.3:0/4258330215 >> v2:172.21.15.50:3300/0 conn(0x7fc280147840 0x7fc28014c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:04.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.530+0000 7fc27f59e700 1 -- 172.21.15.3:0/4258330215 >> v2:172.21.15.50:3300/0 conn(0x7fc280147840 msgr2=0x7fc28014c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:04.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.530+0000 7fc27dd9b700 1 -- 172.21.15.3:0/4258330215 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 234152197 0 0) 0x7fc28009d8d0 con 0x7fc28009ecd0 2023-10-08T15:41:04.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.530+0000 7fc27f59e700 1 --2- 172.21.15.3:0/4258330215 >> v2:172.21.15.50:3300/0 conn(0x7fc280147840 0x7fc28014c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:04.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.534+0000 7fc27f59e700 1 -- 172.21.15.3:0/4258330215 >> v1:172.21.15.3:6789/0 conn(0x7fc28009ecd0 legacy=0x7fc2800be0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:04.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.534+0000 7fc27f59e700 1 -- 172.21.15.3:0/4258330215 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2800a2270 con 0x7fc280147c10 2023-10-08T15:41:04.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.534+0000 7fc27f59e700 1 --2- 172.21.15.3:0/4258330215 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc280147c10 0x7fc280148050 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fc280069db0 tx=0x7fc278009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bec52e090b90fc1f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:04.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.534+0000 7fc27dd9b700 1 -- 172.21.15.3:0/4258330215 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27800e070 con 0x7fc280147c10 2023-10-08T15:41:04.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.534+0000 7fc27dd9b700 1 -- 172.21.15.3:0/4258330215 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc27800bb60 con 0x7fc280147c10 2023-10-08T15:41:04.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.534+0000 7fc27dd9b700 1 -- 172.21.15.3:0/4258330215 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc278012430 con 0x7fc280147c10 2023-10-08T15:41:04.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.534+0000 7fc284994700 1 -- 172.21.15.3:0/4258330215 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc280147c10 msgr2=0x7fc280148050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:04.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.534+0000 7fc284994700 1 --2- 172.21.15.3:0/4258330215 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc280147c10 0x7fc280148050 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fc280069db0 tx=0x7fc278009780 comp rx=0 tx=0).stop 2023-10-08T15:41:04.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.534+0000 7fc284994700 1 -- 172.21.15.3:0/4258330215 shutdown_connections 2023-10-08T15:41:04.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.534+0000 7fc284994700 1 --2- 172.21.15.3:0/4258330215 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc280147c10 0x7fc280148050 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:04.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.534+0000 7fc284994700 1 --2- 172.21.15.3:0/4258330215 >> v2:172.21.15.50:3300/0 conn(0x7fc280147840 0x7fc28014c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:04.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.534+0000 7fc284994700 1 -- 172.21.15.3:0/4258330215 >> 172.21.15.3:0/4258330215 conn(0x7fc280067bb0 msgr2=0x7fc2800bd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:04.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.534+0000 7fc284994700 1 -- 172.21.15.3:0/4258330215 shutdown_connections 2023-10-08T15:41:04.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.534+0000 7fc284994700 1 -- 172.21.15.3:0/4258330215 wait complete. 2023-10-08T15:41:04.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.534+0000 7fc284994700 1 Processor -- start 2023-10-08T15:41:04.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.534+0000 7fc284994700 1 -- start start 2023-10-08T15:41:04.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.538+0000 7fc284994700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc28009ecd0 0x7fc28009c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:04.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.538+0000 7fc284994700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc280147840 0x7fc28015ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:04.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.538+0000 7fc284994700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc280147c10 0x7fc28015e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:04.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.538+0000 7fc284994700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28014b380 con 0x7fc28009ecd0 2023-10-08T15:41:04.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.538+0000 7fc284994700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28006d850 con 0x7fc280147c10 2023-10-08T15:41:04.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.538+0000 7fc284994700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc280099f10 con 0x7fc280147840 2023-10-08T15:41:04.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.538+0000 7fc27ed9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc28009ecd0 0x7fc28009c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:04.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.538+0000 7fc27ed9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc28009ecd0 0x7fc28009c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:37038/0 (socket says 172.21.15.3:37038) 2023-10-08T15:41:04.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.538+0000 7fc27ed9d700 1 -- 172.21.15.3:0/3786853585 learned_addr learned my addr 172.21.15.3:0/3786853585 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:04.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.538+0000 7fc27e59c700 1 --2- 172.21.15.3:0/3786853585 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc280147840 0x7fc28015ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:04.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.538+0000 7fc27f59e700 1 --2- 172.21.15.3:0/3786853585 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc280147c10 0x7fc28015e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:04.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.538+0000 7fc27ed9d700 1 -- 172.21.15.3:0/3786853585 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc280147840 msgr2=0x7fc28015ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:04.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.538+0000 7fc27ed9d700 1 --2- 172.21.15.3:0/3786853585 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc280147840 0x7fc28015ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:04.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.538+0000 7fc27ed9d700 1 -- 172.21.15.3:0/3786853585 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc280147c10 msgr2=0x7fc28015e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:04.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.538+0000 7fc27ed9d700 1 --2- 172.21.15.3:0/3786853585 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc280147c10 0x7fc28015e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:04.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.538+0000 7fc27ed9d700 1 -- 172.21.15.3:0/3786853585 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc278009a20 con 0x7fc28009ecd0 2023-10-08T15:41:04.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.538+0000 7fc27f59e700 1 --2- 172.21.15.3:0/3786853585 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc280147c10 0x7fc28015e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:04.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.538+0000 7fc27e59c700 1 --2- 172.21.15.3:0/3786853585 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc280147840 0x7fc28015ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:04.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.538+0000 7fc27ed9d700 1 --2- 172.21.15.3:0/3786853585 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc28009ecd0 0x7fc28009c990 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fc27000ecb0 tx=0x7fc2700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:04.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.538+0000 7fc266ffd700 1 -- 172.21.15.3:0/3786853585 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27000c9d0 con 0x7fc28009ecd0 2023-10-08T15:41:04.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.538+0000 7fc266ffd700 1 -- 172.21.15.3:0/3786853585 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc27000cb30 con 0x7fc28009ecd0 2023-10-08T15:41:04.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.538+0000 7fc284994700 1 -- 172.21.15.3:0/3786853585 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc28009ced0 con 0x7fc28009ecd0 2023-10-08T15:41:04.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.538+0000 7fc266ffd700 1 -- 172.21.15.3:0/3786853585 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27000ced0 con 0x7fc28009ecd0 2023-10-08T15:41:04.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.538+0000 7fc284994700 1 -- 172.21.15.3:0/3786853585 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc280149700 con 0x7fc28009ecd0 2023-10-08T15:41:04.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.538+0000 7fc284994700 1 -- 172.21.15.3:0/3786853585 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc28005ecf0 con 0x7fc28009ecd0 2023-10-08T15:41:04.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.542+0000 7fc266ffd700 1 -- 172.21.15.3:0/3786853585 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc270013680 con 0x7fc28009ecd0 2023-10-08T15:41:04.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.542+0000 7fc266ffd700 1 --2- 172.21.15.3:0/3786853585 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc26c060580 0x7fc26c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:04.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.542+0000 7fc266ffd700 1 -- 172.21.15.3:0/3786853585 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5223+0+0 (secure 0 0 0) 0x7fc27007c980 con 0x7fc28009ecd0 2023-10-08T15:41:04.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.542+0000 7fc27e59c700 1 --2- 172.21.15.3:0/3786853585 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc26c060580 0x7fc26c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:04.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.542+0000 7fc27e59c700 1 --2- 172.21.15.3:0/3786853585 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc26c060580 0x7fc26c062a30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc280148230 tx=0x7fc274009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:04.555 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.550+0000 7fc266ffd700 1 -- 172.21.15.3:0/3786853585 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc27004d0b0 con 0x7fc28009ecd0 2023-10-08T15:41:04.717 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:04.710+0000 7fc284994700 1 -- 172.21.15.3:0/3786853585 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fc28015a910 con 0x7fc28009ecd0 2023-10-08T15:41:05.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.398+0000 7fc266ffd700 1 -- 172.21.15.3:0/3786853585 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v47) v1 ==== 170+0+0 (secure 0 0 0) 0x7fc2700506d0 con 0x7fc28009ecd0 2023-10-08T15:41:05.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.402+0000 7fc284994700 1 -- 172.21.15.3:0/3786853585 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc26c060580 msgr2=0x7fc26c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:05.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.402+0000 7fc284994700 1 --2- 172.21.15.3:0/3786853585 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc26c060580 0x7fc26c062a30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc280148230 tx=0x7fc274009040 comp rx=0 tx=0).stop 2023-10-08T15:41:05.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.402+0000 7fc284994700 1 -- 172.21.15.3:0/3786853585 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc28009ecd0 msgr2=0x7fc28009c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:05.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.402+0000 7fc284994700 1 --2- 172.21.15.3:0/3786853585 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc28009ecd0 0x7fc28009c990 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fc27000ecb0 tx=0x7fc2700091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:05.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.406+0000 7fc284994700 1 -- 172.21.15.3:0/3786853585 shutdown_connections 2023-10-08T15:41:05.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.406+0000 7fc284994700 1 --2- 172.21.15.3:0/3786853585 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc26c060580 0x7fc26c062a30 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:05.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.406+0000 7fc284994700 1 --2- 172.21.15.3:0/3786853585 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc280147c10 0x7fc28015e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:05.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.406+0000 7fc284994700 1 --2- 172.21.15.3:0/3786853585 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc280147840 0x7fc28015ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:05.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.406+0000 7fc284994700 1 --2- 172.21.15.3:0/3786853585 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc28009ecd0 0x7fc28009c990 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:05.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.406+0000 7fc284994700 1 -- 172.21.15.3:0/3786853585 >> 172.21.15.3:0/3786853585 conn(0x7fc280067bb0 msgr2=0x7fc280146e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:05.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.406+0000 7fc284994700 1 -- 172.21.15.3:0/3786853585 shutdown_connections 2023-10-08T15:41:05.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.410+0000 7fc284994700 1 -- 172.21.15.3:0/3786853585 wait complete. 2023-10-08T15:41:05.786 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'cephfs_data' created 2023-10-08T15:41:05.787 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T15:41:05.912 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.906+0000 7fb55d32c700 1 Processor -- start 2023-10-08T15:41:05.912 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.906+0000 7fb55d32c700 1 -- start start 2023-10-08T15:41:05.913 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.906+0000 7fb55d32c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb55806c5c0 0x7fb5580be3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:05.913 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.906+0000 7fb55d32c700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb5580a7bc0 0x7fb55814bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:05.913 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.906+0000 7fb55d32c700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb55806ced0 con 0x7fb5580a77f0 2023-10-08T15:41:05.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.906+0000 7fb55d32c700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb55806e770 con 0x7fb5580a7bc0 2023-10-08T15:41:05.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.906+0000 7fb55d32c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb558069570 con 0x7fb55806c5c0 2023-10-08T15:41:05.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.906+0000 7fb55cb2b700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb5580a7bc0 0x7fb55814bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:05.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.906+0000 7fb557fff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fb5580a77f0 0x7fb5580a2200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:56282/0 (socket says 172.21.15.3:56282) 2023-10-08T15:41:05.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.906+0000 7fb55cb2b700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb5580a7bc0 0x7fb55814bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:37052/0 (socket says 172.21.15.3:37052) 2023-10-08T15:41:05.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.906+0000 7fb557fff700 1 -- 172.21.15.3:0/4154028529 learned_addr learned my addr 172.21.15.3:0/4154028529 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:41:05.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.910+0000 7fb5577fe700 1 --2- 172.21.15.3:0/4154028529 >> v2:172.21.15.50:3300/0 conn(0x7fb55806c5c0 0x7fb5580be3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:05.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.910+0000 7fb55cb2b700 1 -- 172.21.15.3:0/4154028529 >> v2:172.21.15.50:3300/0 conn(0x7fb55806c5c0 msgr2=0x7fb5580be3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:05.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.910+0000 7fb55cb2b700 1 --2- 172.21.15.3:0/4154028529 >> v2:172.21.15.50:3300/0 conn(0x7fb55806c5c0 0x7fb5580be3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:05.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.910+0000 7fb55cb2b700 1 -- 172.21.15.3:0/4154028529 >> v1:172.21.15.3:6789/0 conn(0x7fb5580a77f0 legacy=0x7fb5580a2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:05.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.910+0000 7fb55cb2b700 1 -- 172.21.15.3:0/4154028529 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb55814c620 con 0x7fb5580a7bc0 2023-10-08T15:41:05.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.910+0000 7fb55cb2b700 1 --2- 172.21.15.3:0/4154028529 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb5580a7bc0 0x7fb55814bfb0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fb558068b60 tx=0x7fb550009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c72e5667499f0b92 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:05.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.910+0000 7fb556ffd700 1 -- 172.21.15.3:0/4154028529 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55000e070 con 0x7fb5580a7bc0 2023-10-08T15:41:05.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.910+0000 7fb556ffd700 1 -- 172.21.15.3:0/4154028529 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb55000bc30 con 0x7fb5580a7bc0 2023-10-08T15:41:05.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.910+0000 7fb556ffd700 1 -- 172.21.15.3:0/4154028529 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb550012430 con 0x7fb5580a7bc0 2023-10-08T15:41:05.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.910+0000 7fb55d32c700 1 -- 172.21.15.3:0/4154028529 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb5580a7bc0 msgr2=0x7fb55814bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:05.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.910+0000 7fb55d32c700 1 --2- 172.21.15.3:0/4154028529 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb5580a7bc0 0x7fb55814bfb0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fb558068b60 tx=0x7fb550009780 comp rx=0 tx=0).stop 2023-10-08T15:41:05.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.910+0000 7fb55d32c700 1 -- 172.21.15.3:0/4154028529 shutdown_connections 2023-10-08T15:41:05.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.910+0000 7fb55d32c700 1 --2- 172.21.15.3:0/4154028529 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb5580a7bc0 0x7fb55814bfb0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:05.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.910+0000 7fb55d32c700 1 --2- 172.21.15.3:0/4154028529 >> v2:172.21.15.50:3300/0 conn(0x7fb55806c5c0 0x7fb5580be3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:05.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.910+0000 7fb55d32c700 1 -- 172.21.15.3:0/4154028529 >> 172.21.15.3:0/4154028529 conn(0x7fb5580c29f0 msgr2=0x7fb5580a1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:05.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.910+0000 7fb55d32c700 1 -- 172.21.15.3:0/4154028529 shutdown_connections 2023-10-08T15:41:05.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.910+0000 7fb55d32c700 1 -- 172.21.15.3:0/4154028529 wait complete. 2023-10-08T15:41:05.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.914+0000 7fb55d32c700 1 Processor -- start 2023-10-08T15:41:05.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.914+0000 7fb55d32c700 1 -- start start 2023-10-08T15:41:05.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.914+0000 7fb55d32c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb55806c5c0 0x7fb55815e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:05.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.914+0000 7fb55d32c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5580a77f0 0x7fb558145f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:05.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.914+0000 7fb55d32c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb5580a7bc0 0x7fb5580a4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:05.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.914+0000 7fb55d32c700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55814eba0 con 0x7fb5580a7bc0 2023-10-08T15:41:05.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.914+0000 7fb55d32c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55814ffd0 con 0x7fb5580a77f0 2023-10-08T15:41:05.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.914+0000 7fb55d32c700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb55814e150 con 0x7fb55806c5c0 2023-10-08T15:41:05.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.914+0000 7fb55cb2b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb5580a7bc0 0x7fb5580a4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:05.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.914+0000 7fb55cb2b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb5580a7bc0 0x7fb5580a4ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:37058/0 (socket says 172.21.15.3:37058) 2023-10-08T15:41:05.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.914+0000 7fb55cb2b700 1 -- 172.21.15.3:0/85864212 learned_addr learned my addr 172.21.15.3:0/85864212 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:05.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.914+0000 7fb5577fe700 1 --2- 172.21.15.3:0/85864212 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5580a77f0 0x7fb558145f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:05.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.914+0000 7fb557fff700 1 --2- 172.21.15.3:0/85864212 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb55806c5c0 0x7fb55815e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:05.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.914+0000 7fb55cb2b700 1 -- 172.21.15.3:0/85864212 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb55806c5c0 msgr2=0x7fb55815e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:05.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.914+0000 7fb55cb2b700 1 --2- 172.21.15.3:0/85864212 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb55806c5c0 0x7fb55815e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:05.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.914+0000 7fb55cb2b700 1 -- 172.21.15.3:0/85864212 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5580a77f0 msgr2=0x7fb558145f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:05.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.914+0000 7fb55cb2b700 1 --2- 172.21.15.3:0/85864212 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5580a77f0 0x7fb558145f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:05.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.914+0000 7fb55cb2b700 1 -- 172.21.15.3:0/85864212 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb550009a20 con 0x7fb5580a7bc0 2023-10-08T15:41:05.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.914+0000 7fb5577fe700 1 --2- 172.21.15.3:0/85864212 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5580a77f0 0x7fb558145f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:05.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.914+0000 7fb55cb2b700 1 --2- 172.21.15.3:0/85864212 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb5580a7bc0 0x7fb5580a4ae0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fb55806bb30 tx=0x7fb550019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:05.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.914+0000 7fb53ffff700 1 -- 172.21.15.3:0/85864212 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb550007000 con 0x7fb5580a7bc0 2023-10-08T15:41:05.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.914+0000 7fb53ffff700 1 -- 172.21.15.3:0/85864212 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb55001b600 con 0x7fb5580a7bc0 2023-10-08T15:41:05.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.914+0000 7fb55d32c700 1 -- 172.21.15.3:0/85864212 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb55815ee00 con 0x7fb5580a7bc0 2023-10-08T15:41:05.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.914+0000 7fb53ffff700 1 -- 172.21.15.3:0/85864212 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55001b9c0 con 0x7fb5580a7bc0 2023-10-08T15:41:05.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.918+0000 7fb55d32c700 1 -- 172.21.15.3:0/85864212 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5580a6f80 con 0x7fb5580a7bc0 2023-10-08T15:41:05.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.918+0000 7fb55d32c700 1 -- 172.21.15.3:0/85864212 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5580a7170 con 0x7fb5580a7bc0 2023-10-08T15:41:05.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.918+0000 7fb53ffff700 1 -- 172.21.15.3:0/85864212 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb550003050 con 0x7fb5580a7bc0 2023-10-08T15:41:05.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.918+0000 7fb53ffff700 1 --2- 172.21.15.3:0/85864212 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb544060550 0x7fb544062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:05.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.918+0000 7fb53ffff700 1 -- 172.21.15.3:0/85864212 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5605+0+0 (secure 0 0 0) 0x7fb55007e570 con 0x7fb5580a7bc0 2023-10-08T15:41:05.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.918+0000 7fb557fff700 1 --2- 172.21.15.3:0/85864212 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb544060550 0x7fb544062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:05.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.922+0000 7fb557fff700 1 --2- 172.21.15.3:0/85864212 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb544060550 0x7fb544062a00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb54c001820 tx=0x7fb54c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:05.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:05.926+0000 7fb53ffff700 1 -- 172.21.15.3:0/85864212 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb55004ebc0 con 0x7fb5580a7bc0 2023-10-08T15:41:06.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.126+0000 7fb55d32c700 1 -- 172.21.15.3:0/85864212 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb55805ecf0 con 0x7fb5580a7bc0 2023-10-08T15:41:06.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.442+0000 7fb53ffff700 1 -- 172.21.15.3:0/85864212 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v23) v1 ==== 172+0+0 (secure 0 0 0) 0x7fb5500521e0 con 0x7fb5580a7bc0 2023-10-08T15:41:06.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.458+0000 7fb53dffb700 1 -- 172.21.15.3:0/85864212 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb544060550 msgr2=0x7fb544062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:06.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.458+0000 7fb53dffb700 1 --2- 172.21.15.3:0/85864212 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb544060550 0x7fb544062a00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb54c001820 tx=0x7fb54c009040 comp rx=0 tx=0).stop 2023-10-08T15:41:06.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.458+0000 7fb53dffb700 1 -- 172.21.15.3:0/85864212 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb5580a7bc0 msgr2=0x7fb5580a4ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:06.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.458+0000 7fb53dffb700 1 --2- 172.21.15.3:0/85864212 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb5580a7bc0 0x7fb5580a4ae0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fb55806bb30 tx=0x7fb550019000 comp rx=0 tx=0).stop 2023-10-08T15:41:06.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.458+0000 7fb53dffb700 1 -- 172.21.15.3:0/85864212 shutdown_connections 2023-10-08T15:41:06.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.458+0000 7fb53dffb700 1 --2- 172.21.15.3:0/85864212 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb544060550 0x7fb544062a00 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:06.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.458+0000 7fb53dffb700 1 --2- 172.21.15.3:0/85864212 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb5580a7bc0 0x7fb5580a4ae0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:06.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.458+0000 7fb53dffb700 1 --2- 172.21.15.3:0/85864212 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5580a77f0 0x7fb558145f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:06.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.458+0000 7fb53dffb700 1 --2- 172.21.15.3:0/85864212 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb55806c5c0 0x7fb55815e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:06.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.458+0000 7fb53dffb700 1 -- 172.21.15.3:0/85864212 >> 172.21.15.3:0/85864212 conn(0x7fb5580c29f0 msgr2=0x7fb5580be460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:06.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.458+0000 7fb53dffb700 1 -- 172.21.15.3:0/85864212 shutdown_connections 2023-10-08T15:41:06.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.458+0000 7fb53dffb700 1 -- 172.21.15.3:0/85864212 wait complete. 2023-10-08T15:41:06.466 INFO:teuthology.orchestra.run.smithi003.stderr:new fs with metadata pool 8 and data pool 9 2023-10-08T15:41:06.477 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:41:06.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.574+0000 7fa8dffff700 1 Processor -- start 2023-10-08T15:41:06.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.574+0000 7fa8dffff700 1 -- start start 2023-10-08T15:41:06.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.578+0000 7fa8dffff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa8e00bac80 0x7fa8e00bb990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:06.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.578+0000 7fa8dffff700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8e014c0e0 con 0x7fa8e00bb050 2023-10-08T15:41:06.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.578+0000 7fa8dffff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8e014c3c0 con 0x7fa8e006df20 2023-10-08T15:41:06.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.578+0000 7fa8dffff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e014c6a0 con 0x7fa8e00bac80 2023-10-08T15:41:06.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.578+0000 7fa8df7fe700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fa8e00bb050 0x7fa8e006d2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:56284/0 (socket says 172.21.15.3:56284) 2023-10-08T15:41:06.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.578+0000 7fa8df7fe700 1 -- 172.21.15.3:0/2936505745 learned_addr learned my addr 172.21.15.3:0/2936505745 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:41:06.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.578+0000 7fa8deffd700 1 --2- 172.21.15.3:0/2936505745 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa8e00bac80 0x7fa8e00bb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:06.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.578+0000 7fa8ddffb700 1 -- 172.21.15.3:0/2936505745 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 12058417 0 0) 0x7fa8e014c0e0 con 0x7fa8e00bb050 2023-10-08T15:41:06.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.578+0000 7fa8ddffb700 1 -- 172.21.15.3:0/2936505745 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8c8003570 con 0x7fa8e00bb050 2023-10-08T15:41:06.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.578+0000 7fa8ddffb700 1 -- 172.21.15.3:0/2936505745 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1688028215 0 0) 0x7fa8c8003570 con 0x7fa8e00bb050 2023-10-08T15:41:06.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.578+0000 7fa8ddffb700 1 -- 172.21.15.3:0/2936505745 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa8e00bac80 msgr2=0x7fa8e00bb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:06.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.578+0000 7fa8ddffb700 1 --2- 172.21.15.3:0/2936505745 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa8e00bac80 0x7fa8e00bb990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:06.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.578+0000 7fa8ddffb700 1 -- 172.21.15.3:0/2936505745 >> v1:172.21.15.50:6789/0 conn(0x7fa8e006df20 legacy=0x7fa8e006c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:06.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.578+0000 7fa8ddffb700 1 -- 172.21.15.3:0/2936505745 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e01482e0 con 0x7fa8e00bb050 2023-10-08T15:41:06.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.578+0000 7fa8deffd700 1 --2- 172.21.15.3:0/2936505745 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa8e00bac80 0x7fa8e00bb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:41:06.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.578+0000 7fa8ddffb700 1 -- 172.21.15.3:0/2936505745 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2285686191 0 0) 0x7fa8d80017f0 con 0x7fa8e00bb050 2023-10-08T15:41:06.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.578+0000 7fa8ddffb700 1 -- 172.21.15.3:0/2936505745 >> v1:172.21.15.3:6789/0 conn(0x7fa8e00bb050 legacy=0x7fa8e006d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:06.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.578+0000 7fa8ddffb700 1 --2- 172.21.15.3:0/2936505745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8c8003a90 0x7fa8c8003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:06.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.578+0000 7fa8ddffb700 1 --2- 172.21.15.3:0/2936505745 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa8e00bac80 0x7fa8c8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:06.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.578+0000 7fa8ddffb700 1 --2- 172.21.15.3:0/2936505745 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa8c8004d50 0x7fa8c80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:06.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.578+0000 7fa8ddffb700 1 -- 172.21.15.3:0/2936505745 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e014c6a0 con 0x7fa8c8004d50 2023-10-08T15:41:06.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.578+0000 7fa8ddffb700 1 -- 172.21.15.3:0/2936505745 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c800dd50 con 0x7fa8c8003a90 2023-10-08T15:41:06.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.578+0000 7fa8ddffb700 1 -- 172.21.15.3:0/2936505745 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c800df10 con 0x7fa8e00bac80 2023-10-08T15:41:06.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.578+0000 7fa8df7fe700 1 --2- 172.21.15.3:0/2936505745 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa8c8004d50 0x7fa8c80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:06.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.578+0000 7fa8deffd700 1 --2- 172.21.15.3:0/2936505745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8c8003a90 0x7fa8c8003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:06.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.578+0000 7fa8de7fc700 1 --2- 172.21.15.3:0/2936505745 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa8e00bac80 0x7fa8c8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:06.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.578+0000 7fa8df7fe700 1 -- 172.21.15.3:0/2936505745 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa8e00bac80 msgr2=0x7fa8c8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:06.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.578+0000 7fa8df7fe700 1 --2- 172.21.15.3:0/2936505745 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa8e00bac80 0x7fa8c8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:06.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.578+0000 7fa8df7fe700 1 -- 172.21.15.3:0/2936505745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8c8003a90 msgr2=0x7fa8c8003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:06.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.578+0000 7fa8df7fe700 1 --2- 172.21.15.3:0/2936505745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8c8003a90 0x7fa8c8003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:06.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.578+0000 7fa8df7fe700 1 -- 172.21.15.3:0/2936505745 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d0009420 con 0x7fa8c8004d50 2023-10-08T15:41:06.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.578+0000 7fa8deffd700 1 --2- 172.21.15.3:0/2936505745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8c8003a90 0x7fa8c8003ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:41:06.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.578+0000 7fa8df7fe700 1 --2- 172.21.15.3:0/2936505745 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa8c8004d50 0x7fa8c80051c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fa8d800a900 tx=0x7fa8e0149350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbed5e9d8a0b641b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:06.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.582+0000 7fa8ddffb700 1 -- 172.21.15.3:0/2936505745 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d80070d0 con 0x7fa8c8004d50 2023-10-08T15:41:06.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.582+0000 7fa8ddffb700 1 -- 172.21.15.3:0/2936505745 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8d8007230 con 0x7fa8c8004d50 2023-10-08T15:41:06.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.582+0000 7fa8ddffb700 1 -- 172.21.15.3:0/2936505745 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d80075f0 con 0x7fa8c8004d50 2023-10-08T15:41:06.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.582+0000 7fa8dffff700 1 -- 172.21.15.3:0/2936505745 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa8c8004d50 msgr2=0x7fa8c80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:06.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.582+0000 7fa8dffff700 1 --2- 172.21.15.3:0/2936505745 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa8c8004d50 0x7fa8c80051c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fa8d800a900 tx=0x7fa8e0149350 comp rx=0 tx=0).stop 2023-10-08T15:41:06.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.582+0000 7fa8df7fe700 1 -- 172.21.15.3:0/2936505745 reap_dead start 2023-10-08T15:41:06.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.582+0000 7fa8dffff700 1 -- 172.21.15.3:0/2936505745 shutdown_connections 2023-10-08T15:41:06.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.582+0000 7fa8dffff700 1 -- 172.21.15.3:0/2936505745 >> 172.21.15.3:0/2936505745 conn(0x7fa8e00670e0 msgr2=0x7fa8e00674e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:06.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.582+0000 7fa8dffff700 1 -- 172.21.15.3:0/2936505745 shutdown_connections 2023-10-08T15:41:06.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.582+0000 7fa8dffff700 1 -- 172.21.15.3:0/2936505745 wait complete. 2023-10-08T15:41:06.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.582+0000 7fa8dffff700 1 Processor -- start 2023-10-08T15:41:06.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.582+0000 7fa8dffff700 1 -- start start 2023-10-08T15:41:06.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.582+0000 7fa8dffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8c8004d50 0x7fa8e014a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:06.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.582+0000 7fa8dffff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa8e0144d00 0x7fa8e0145150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:06.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.582+0000 7fa8dffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa8e013e590 0x7fa8e013ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:06.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.582+0000 7fa8dffff700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e00b7610 con 0x7fa8e013e590 2023-10-08T15:41:06.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.582+0000 7fa8dffff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e014aae0 con 0x7fa8c8004d50 2023-10-08T15:41:06.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.582+0000 7fa8dffff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e0143de0 con 0x7fa8e0144d00 2023-10-08T15:41:06.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.586+0000 7fa8df7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa8e013e590 0x7fa8e013ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:06.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.586+0000 7fa8df7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa8e013e590 0x7fa8e013ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:37078/0 (socket says 172.21.15.3:37078) 2023-10-08T15:41:06.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.586+0000 7fa8df7fe700 1 -- 172.21.15.3:0/2768222015 learned_addr learned my addr 172.21.15.3:0/2768222015 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:06.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.586+0000 7fa8deffd700 1 --2- 172.21.15.3:0/2768222015 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8c8004d50 0x7fa8e014a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:06.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.586+0000 7fa8de7fc700 1 --2- 172.21.15.3:0/2768222015 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa8e0144d00 0x7fa8e0145150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:06.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.586+0000 7fa8df7fe700 1 -- 172.21.15.3:0/2768222015 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa8e0144d00 msgr2=0x7fa8e0145150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:06.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.586+0000 7fa8df7fe700 1 --2- 172.21.15.3:0/2768222015 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa8e0144d00 0x7fa8e0145150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:06.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.586+0000 7fa8df7fe700 1 -- 172.21.15.3:0/2768222015 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8c8004d50 msgr2=0x7fa8e014a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:06.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.586+0000 7fa8df7fe700 1 --2- 172.21.15.3:0/2768222015 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8c8004d50 0x7fa8e014a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:06.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.586+0000 7fa8df7fe700 1 -- 172.21.15.3:0/2768222015 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e0143790 con 0x7fa8e013e590 2023-10-08T15:41:06.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.586+0000 7fa8df7fe700 1 --2- 172.21.15.3:0/2768222015 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa8e013e590 0x7fa8e013ea00 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fa8d8012000 tx=0x7fa8d8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:06.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.586+0000 7fa8c6ffd700 1 -- 172.21.15.3:0/2768222015 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d80070d0 con 0x7fa8e013e590 2023-10-08T15:41:06.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.586+0000 7fa8c6ffd700 1 -- 172.21.15.3:0/2768222015 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8d80017b0 con 0x7fa8e013e590 2023-10-08T15:41:06.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.586+0000 7fa8dffff700 1 -- 172.21.15.3:0/2768222015 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8e0143a70 con 0x7fa8e013e590 2023-10-08T15:41:06.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.586+0000 7fa8c6ffd700 1 -- 172.21.15.3:0/2768222015 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d8007960 con 0x7fa8e013e590 2023-10-08T15:41:06.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.586+0000 7fa8dffff700 1 -- 172.21.15.3:0/2768222015 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8e013ef40 con 0x7fa8e013e590 2023-10-08T15:41:06.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.586+0000 7fa8dffff700 1 -- 172.21.15.3:0/2768222015 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8e0143c00 con 0x7fa8e013e590 2023-10-08T15:41:06.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.590+0000 7fa8c6ffd700 1 -- 172.21.15.3:0/2768222015 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa8d8029460 con 0x7fa8e013e590 2023-10-08T15:41:06.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.590+0000 7fa8c6ffd700 1 --2- 172.21.15.3:0/2768222015 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fa8cc060550 0x7fa8cc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:06.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.590+0000 7fa8c6ffd700 1 -- 172.21.15.3:0/2768222015 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa8d807ebd0 con 0x7fa8e013e590 2023-10-08T15:41:06.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.590+0000 7fa8deffd700 1 --2- 172.21.15.3:0/2768222015 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fa8cc060550 0x7fa8cc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:06.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.590+0000 7fa8deffd700 1 --2- 172.21.15.3:0/2768222015 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fa8cc060550 0x7fa8cc062a00 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0009910 tx=0x7fa8d00091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:06.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.598+0000 7fa8c6ffd700 1 -- 172.21.15.3:0/2768222015 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa8d804f1c0 con 0x7fa8e013e590 2023-10-08T15:41:06.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.762+0000 7fa8dffff700 1 -- 172.21.15.3:0/2768222015 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8e005ecf0 con 0x7fa8e013e590 2023-10-08T15:41:06.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.766+0000 7fa8c6ffd700 1 -- 172.21.15.3:0/2768222015 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+15267 (secure 0 0 0) 0x7fa8d8016090 con 0x7fa8e013e590 2023-10-08T15:41:06.771 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:41:06.771 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":48,"fsid":"7635972e-cd66-4a8f-a231-378db8b3847a","created":"2023-10-08T15:37:08.234594+0000","modified":"2023-10-08T15:41:06.131713+0000","last_up_change":"2023-10-08T15:37:17.537726+0000","last_in_change":"2023-10-08T15:37:10.269178+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:37:16.581590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:41:04.003380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-08T15:41:04.755627+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"64fb1864-bfdd-4d75-9b41-03fb60085dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33363},{"type":"v1","addr":"172.21.15.3:6801","nonce":33363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33363},{"type":"v1","addr":"172.21.15.3:6803","nonce":33363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":33363},{"type":"v1","addr":"172.21.15.3:6807","nonce":33363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33363},{"type":"v1","addr":"172.21.15.3:6805","nonce":33363}]},"public_addr":"172.21.15.3:6801/33363","cluster_addr":"172.21.15.3:6803/33363","heartbeat_back_addr":"172.21.15.3:6807/33363","heartbeat_front_addr":"172.21.15.3:6805/33363","state":["exists","up"]},{"osd":1,"uuid":"3ca6bd3a-3e8a-4c65-af9c-46148b0c2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33364},{"type":"v1","addr":"172.21.15.3:6820","nonce":33364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33364},{"type":"v1","addr":"172.21.15.3:6824","nonce":33364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33364},{"type":"v1","addr":"172.21.15.3:6831","nonce":33364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33364},{"type":"v1","addr":"172.21.15.3:6828","nonce":33364}]},"public_addr":"172.21.15.3:6820/33364","cluster_addr":"172.21.15.3:6824/33364","heartbeat_back_addr":"172.21.15.3:6831/33364","heartbeat_front_addr":"172.21.15.3:6828/33364","state":["exists","up"]},{"osd":2,"uuid":"6eb9f757-58dd-442f-910d-32401454bce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33366},{"type":"v1","addr":"172.21.15.3:6817","nonce":33366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":33366},{"type":"v1","addr":"172.21.15.3:6821","nonce":33366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6827","nonce":33366},{"type":"v1","addr":"172.21.15.3:6829","nonce":33366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":33366},{"type":"v1","addr":"172.21.15.3:6825","nonce":33366}]},"public_addr":"172.21.15.3:6817/33366","cluster_addr":"172.21.15.3:6821/33366","heartbeat_back_addr":"172.21.15.3:6829/33366","heartbeat_front_addr":"172.21.15.3:6825/33366","state":["exists","up"]},{"osd":3,"uuid":"1c39866b-ac2e-4ea9-a69c-02b01ee4191d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33365},{"type":"v1","addr":"172.21.15.3:6809","nonce":33365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":33365},{"type":"v1","addr":"172.21.15.3:6811","nonce":33365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33365},{"type":"v1","addr":"172.21.15.3:6815","nonce":33365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":33365},{"type":"v1","addr":"172.21.15.3:6813","nonce":33365}]},"public_addr":"172.21.15.3:6809/33365","cluster_addr":"172.21.15.3:6811/33365","heartbeat_back_addr":"172.21.15.3:6815/33365","heartbeat_front_addr":"172.21.15.3:6813/33365","state":["exists","up"]},{"osd":4,"uuid":"15f86b61-b7f1-4780-ae00-9d80a68cb830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":33605},{"type":"v1","addr":"172.21.15.50:6809","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33605},{"type":"v1","addr":"172.21.15.50:6811","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33605},{"type":"v1","addr":"172.21.15.50:6815","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":33605},{"type":"v1","addr":"172.21.15.50:6813","nonce":33605}]},"public_addr":"172.21.15.50:6809/33605","cluster_addr":"172.21.15.50:6811/33605","heartbeat_back_addr":"172.21.15.50:6815/33605","heartbeat_front_addr":"172.21.15.50:6813/33605","state":["exists","up"]},{"osd":5,"uuid":"726c3003-34e6-4d5a-b6e2-f911e13c2118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33606},{"type":"v1","addr":"172.21.15.50:6801","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33606},{"type":"v1","addr":"172.21.15.50:6803","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33606},{"type":"v1","addr":"172.21.15.50:6807","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":33606},{"type":"v1","addr":"172.21.15.50:6805","nonce":33606}]},"public_addr":"172.21.15.50:6801/33606","cluster_addr":"172.21.15.50:6803/33606","heartbeat_back_addr":"172.21.15.50:6807/33606","heartbeat_front_addr":"172.21.15.50:6805/33606","state":["exists","up"]},{"osd":6,"uuid":"401122a4-9988-441f-a5a7-39164434ebcd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":33607},{"type":"v1","addr":"172.21.15.50:6819","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":33607},{"type":"v1","addr":"172.21.15.50:6823","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":33607},{"type":"v1","addr":"172.21.15.50:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":33607},{"type":"v1","addr":"172.21.15.50:6827","nonce":33607}]},"public_addr":"172.21.15.50:6819/33607","cluster_addr":"172.21.15.50:6823/33607","heartbeat_back_addr":"172.21.15.50:6831/33607","heartbeat_front_addr":"172.21.15.50:6827/33607","state":["exists","up"]},{"osd":7,"uuid":"6b3fa236-c9d0-4c4d-82ae-9af4daf6d699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33604},{"type":"v1","addr":"172.21.15.50:6818","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":33604},{"type":"v1","addr":"172.21.15.50:6822","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":33604},{"type":"v1","addr":"172.21.15.50:6830","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":33604},{"type":"v1","addr":"172.21.15.50:6826","nonce":33604}]},"public_addr":"172.21.15.50:6818/33604","cluster_addr":"172.21.15.50:6822/33604","heartbeat_back_addr":"172.21.15.50:6830/33604","heartbeat_front_addr":"172.21.15.50:6826/33604","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.497794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.529417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.873426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.325972+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.443971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.240795+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.739632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.643026+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:41:06.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.766+0000 7fa8dffff700 1 -- 172.21.15.3:0/2768222015 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fa8cc060550 msgr2=0x7fa8cc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:06.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.766+0000 7fa8dffff700 1 --2- 172.21.15.3:0/2768222015 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fa8cc060550 0x7fa8cc062a00 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0009910 tx=0x7fa8d00091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:06.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.766+0000 7fa8dffff700 1 -- 172.21.15.3:0/2768222015 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa8e013e590 msgr2=0x7fa8e013ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:06.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.766+0000 7fa8dffff700 1 --2- 172.21.15.3:0/2768222015 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa8e013e590 0x7fa8e013ea00 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fa8d8012000 tx=0x7fa8d8015000 comp rx=0 tx=0).stop 2023-10-08T15:41:06.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.766+0000 7fa8dffff700 1 -- 172.21.15.3:0/2768222015 shutdown_connections 2023-10-08T15:41:06.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.766+0000 7fa8dffff700 1 --2- 172.21.15.3:0/2768222015 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fa8cc060550 0x7fa8cc062a00 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:06.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.766+0000 7fa8dffff700 1 --2- 172.21.15.3:0/2768222015 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa8e013e590 0x7fa8e013ea00 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:06.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.766+0000 7fa8dffff700 1 --2- 172.21.15.3:0/2768222015 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa8e0144d00 0x7fa8e0145150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:06.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.766+0000 7fa8dffff700 1 --2- 172.21.15.3:0/2768222015 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8c8004d50 0x7fa8e014a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:06.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.766+0000 7fa8dffff700 1 -- 172.21.15.3:0/2768222015 >> 172.21.15.3:0/2768222015 conn(0x7fa8e00670e0 msgr2=0x7fa8e0148700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:06.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.766+0000 7fa8dffff700 1 -- 172.21.15.3:0/2768222015 shutdown_connections 2023-10-08T15:41:06.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.766+0000 7fa8dffff700 1 -- 172.21.15.3:0/2768222015 wait complete. 2023-10-08T15:41:06.784 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:41:06.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.886+0000 7fdeb269d700 1 Processor -- start 2023-10-08T15:41:07.061 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.886+0000 7fdeb269d700 1 -- start start 2023-10-08T15:41:07.065 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.886+0000 7fdeb269d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdeac0a15e0 0x7fdeac14eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:07.066 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.886+0000 7fdeb269d700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fdeac068630 0x7fdeac14b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:07.066 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.886+0000 7fdeb269d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeac069900 con 0x7fdeac06cf60 2023-10-08T15:41:07.066 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.886+0000 7fdeb269d700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeac069620 con 0x7fdeac068630 2023-10-08T15:41:07.066 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.886+0000 7fdeb269d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac068d10 con 0x7fdeac0a15e0 2023-10-08T15:41:07.066 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.886+0000 7fdeb1e9c700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fdeac068630 0x7fdeac14b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:07.066 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.886+0000 7fdeb1e9c700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fdeac068630 0x7fdeac14b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35034/0 (socket says 172.21.15.3:35034) 2023-10-08T15:41:07.066 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.886+0000 7fdeb1e9c700 1 -- 172.21.15.3:0/1330155710 learned_addr learned my addr 172.21.15.3:0/1330155710 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:07.066 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.886+0000 7fdeb169b700 1 --2- 172.21.15.3:0/1330155710 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdeac0a15e0 0x7fdeac14eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:07.066 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.886+0000 7fdeb1e9c700 1 -- 172.21.15.3:0/1330155710 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdeac0a15e0 msgr2=0x7fdeac14eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:07.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.886+0000 7fdeb1e9c700 1 --2- 172.21.15.3:0/1330155710 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdeac0a15e0 0x7fdeac14eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:07.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.886+0000 7fdeb1e9c700 1 -- 172.21.15.3:0/1330155710 >> v1:172.21.15.50:6789/0 conn(0x7fdeac06cf60 legacy=0x7fdeac14f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:07.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.890+0000 7fdeb1e9c700 1 -- 172.21.15.3:0/1330155710 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeac06e8e0 con 0x7fdeac068630 2023-10-08T15:41:07.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.890+0000 7fdeb1e9c700 1 --2- 172.21.15.3:0/1330155710 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdeac068630 0x7fdeac14b750 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fdea4009f20 tx=0x7fdea4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15048c80e736f780 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:07.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.890+0000 7fdea3fff700 1 -- 172.21.15.3:0/1330155710 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea400e070 con 0x7fdeac068630 2023-10-08T15:41:07.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.890+0000 7fdea3fff700 1 -- 172.21.15.3:0/1330155710 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdea400b9d0 con 0x7fdeac068630 2023-10-08T15:41:07.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.890+0000 7fdea3fff700 1 -- 172.21.15.3:0/1330155710 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea40092e0 con 0x7fdeac068630 2023-10-08T15:41:07.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.890+0000 7fdeb269d700 1 -- 172.21.15.3:0/1330155710 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdeac068630 msgr2=0x7fdeac14b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:07.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.890+0000 7fdeb269d700 1 --2- 172.21.15.3:0/1330155710 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdeac068630 0x7fdeac14b750 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fdea4009f20 tx=0x7fdea4009840 comp rx=0 tx=0).stop 2023-10-08T15:41:07.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.890+0000 7fdeb269d700 1 -- 172.21.15.3:0/1330155710 shutdown_connections 2023-10-08T15:41:07.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.890+0000 7fdeb269d700 1 --2- 172.21.15.3:0/1330155710 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdeac068630 0x7fdeac14b750 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:07.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.890+0000 7fdeb269d700 1 --2- 172.21.15.3:0/1330155710 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdeac0a15e0 0x7fdeac14eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:07.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.890+0000 7fdeb269d700 1 -- 172.21.15.3:0/1330155710 >> 172.21.15.3:0/1330155710 conn(0x7fdeac0670e0 msgr2=0x7fdeac0674e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:07.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.890+0000 7fdeb269d700 1 -- 172.21.15.3:0/1330155710 shutdown_connections 2023-10-08T15:41:07.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.890+0000 7fdeb269d700 1 -- 172.21.15.3:0/1330155710 wait complete. 2023-10-08T15:41:07.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.890+0000 7fdeb269d700 1 Processor -- start 2023-10-08T15:41:07.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.890+0000 7fdeb269d700 1 -- start start 2023-10-08T15:41:07.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.890+0000 7fdeb269d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdeac068630 0x7fdeac140810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:07.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.890+0000 7fdeb269d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdeac0a15e0 0x7fdeac15e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:07.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.890+0000 7fdeb269d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdeac13f8d0 0x7fdeac150f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:07.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.890+0000 7fdeb269d700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac13f6f0 con 0x7fdeac068630 2023-10-08T15:41:07.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.890+0000 7fdeb269d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac15f070 con 0x7fdeac0a15e0 2023-10-08T15:41:07.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.890+0000 7fdeb269d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac13f410 con 0x7fdeac13f8d0 2023-10-08T15:41:07.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.890+0000 7fdeb169b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdeac068630 0x7fdeac140810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:07.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.894+0000 7fdeb169b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdeac068630 0x7fdeac140810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35040/0 (socket says 172.21.15.3:35040) 2023-10-08T15:41:07.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.894+0000 7fdeb1e9c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdeac13f8d0 0x7fdeac150f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:07.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.894+0000 7fdeb169b700 1 -- 172.21.15.3:0/3247971605 learned_addr learned my addr 172.21.15.3:0/3247971605 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:07.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.894+0000 7fdeb0e9a700 1 --2- 172.21.15.3:0/3247971605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdeac0a15e0 0x7fdeac15e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:07.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.894+0000 7fdeb169b700 1 -- 172.21.15.3:0/3247971605 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdeac13f8d0 msgr2=0x7fdeac150f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:07.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.894+0000 7fdeb169b700 1 --2- 172.21.15.3:0/3247971605 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdeac13f8d0 0x7fdeac150f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:07.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.894+0000 7fdeb169b700 1 -- 172.21.15.3:0/3247971605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdeac0a15e0 msgr2=0x7fdeac15e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:07.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.894+0000 7fdeb169b700 1 --2- 172.21.15.3:0/3247971605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdeac0a15e0 0x7fdeac15e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:07.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.894+0000 7fdeb169b700 1 -- 172.21.15.3:0/3247971605 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea4009ae0 con 0x7fdeac068630 2023-10-08T15:41:07.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.894+0000 7fdeb1e9c700 1 --2- 172.21.15.3:0/3247971605 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdeac13f8d0 0x7fdeac150f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:41:07.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.894+0000 7fdeb169b700 1 --2- 172.21.15.3:0/3247971605 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdeac068630 0x7fdeac140810 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fdea800e930 tx=0x7fdea80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:07.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.894+0000 7fdea17fa700 1 -- 172.21.15.3:0/3247971605 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea8013680 con 0x7fdeac068630 2023-10-08T15:41:07.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.894+0000 7fdea17fa700 1 -- 172.21.15.3:0/3247971605 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdea80137e0 con 0x7fdeac068630 2023-10-08T15:41:07.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.894+0000 7fdea17fa700 1 -- 172.21.15.3:0/3247971605 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea8013b80 con 0x7fdeac068630 2023-10-08T15:41:07.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.894+0000 7fdeb269d700 1 -- 172.21.15.3:0/3247971605 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdeac15ec90 con 0x7fdeac068630 2023-10-08T15:41:07.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.894+0000 7fdeb269d700 1 -- 172.21.15.3:0/3247971605 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeac142800 con 0x7fdeac068630 2023-10-08T15:41:07.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.898+0000 7fdeb269d700 1 -- 172.21.15.3:0/3247971605 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdeac05ecf0 con 0x7fdeac068630 2023-10-08T15:41:07.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.898+0000 7fdea17fa700 1 -- 172.21.15.3:0/3247971605 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fdea800c3e0 con 0x7fdeac068630 2023-10-08T15:41:07.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.898+0000 7fdea17fa700 1 --2- 172.21.15.3:0/3247971605 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fde90060580 0x7fde90062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:07.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.898+0000 7fdea17fa700 1 -- 172.21.15.3:0/3247971605 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdea807c8c0 con 0x7fdeac068630 2023-10-08T15:41:07.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.898+0000 7fdeb0e9a700 1 --2- 172.21.15.3:0/3247971605 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fde90060580 0x7fde90062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:07.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.898+0000 7fdeb0e9a700 1 --2- 172.21.15.3:0/3247971605 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fde90060580 0x7fde90062a30 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fdeac1436a0 tx=0x7fde9c000bc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:07.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:06.906+0000 7fdea17fa700 1 -- 172.21.15.3:0/3247971605 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fdea804ceb0 con 0x7fdeac068630 2023-10-08T15:41:07.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.066+0000 7fdeb269d700 1 -- 172.21.15.3:0/3247971605 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdeac0a19b0 con 0x7fdeac068630 2023-10-08T15:41:07.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.070+0000 7fdea17fa700 1 -- 172.21.15.3:0/3247971605 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+15267 (secure 0 0 0) 0x7fdea8021090 con 0x7fdeac068630 2023-10-08T15:41:07.075 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:41:07.076 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":48,"fsid":"7635972e-cd66-4a8f-a231-378db8b3847a","created":"2023-10-08T15:37:08.234594+0000","modified":"2023-10-08T15:41:06.131713+0000","last_up_change":"2023-10-08T15:37:17.537726+0000","last_in_change":"2023-10-08T15:37:10.269178+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:37:16.581590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:41:04.003380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-08T15:41:04.755627+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"64fb1864-bfdd-4d75-9b41-03fb60085dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33363},{"type":"v1","addr":"172.21.15.3:6801","nonce":33363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33363},{"type":"v1","addr":"172.21.15.3:6803","nonce":33363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":33363},{"type":"v1","addr":"172.21.15.3:6807","nonce":33363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33363},{"type":"v1","addr":"172.21.15.3:6805","nonce":33363}]},"public_addr":"172.21.15.3:6801/33363","cluster_addr":"172.21.15.3:6803/33363","heartbeat_back_addr":"172.21.15.3:6807/33363","heartbeat_front_addr":"172.21.15.3:6805/33363","state":["exists","up"]},{"osd":1,"uuid":"3ca6bd3a-3e8a-4c65-af9c-46148b0c2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33364},{"type":"v1","addr":"172.21.15.3:6820","nonce":33364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33364},{"type":"v1","addr":"172.21.15.3:6824","nonce":33364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33364},{"type":"v1","addr":"172.21.15.3:6831","nonce":33364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33364},{"type":"v1","addr":"172.21.15.3:6828","nonce":33364}]},"public_addr":"172.21.15.3:6820/33364","cluster_addr":"172.21.15.3:6824/33364","heartbeat_back_addr":"172.21.15.3:6831/33364","heartbeat_front_addr":"172.21.15.3:6828/33364","state":["exists","up"]},{"osd":2,"uuid":"6eb9f757-58dd-442f-910d-32401454bce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33366},{"type":"v1","addr":"172.21.15.3:6817","nonce":33366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":33366},{"type":"v1","addr":"172.21.15.3:6821","nonce":33366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6827","nonce":33366},{"type":"v1","addr":"172.21.15.3:6829","nonce":33366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":33366},{"type":"v1","addr":"172.21.15.3:6825","nonce":33366}]},"public_addr":"172.21.15.3:6817/33366","cluster_addr":"172.21.15.3:6821/33366","heartbeat_back_addr":"172.21.15.3:6829/33366","heartbeat_front_addr":"172.21.15.3:6825/33366","state":["exists","up"]},{"osd":3,"uuid":"1c39866b-ac2e-4ea9-a69c-02b01ee4191d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33365},{"type":"v1","addr":"172.21.15.3:6809","nonce":33365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":33365},{"type":"v1","addr":"172.21.15.3:6811","nonce":33365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33365},{"type":"v1","addr":"172.21.15.3:6815","nonce":33365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":33365},{"type":"v1","addr":"172.21.15.3:6813","nonce":33365}]},"public_addr":"172.21.15.3:6809/33365","cluster_addr":"172.21.15.3:6811/33365","heartbeat_back_addr":"172.21.15.3:6815/33365","heartbeat_front_addr":"172.21.15.3:6813/33365","state":["exists","up"]},{"osd":4,"uuid":"15f86b61-b7f1-4780-ae00-9d80a68cb830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":33605},{"type":"v1","addr":"172.21.15.50:6809","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33605},{"type":"v1","addr":"172.21.15.50:6811","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33605},{"type":"v1","addr":"172.21.15.50:6815","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":33605},{"type":"v1","addr":"172.21.15.50:6813","nonce":33605}]},"public_addr":"172.21.15.50:6809/33605","cluster_addr":"172.21.15.50:6811/33605","heartbeat_back_addr":"172.21.15.50:6815/33605","heartbeat_front_addr":"172.21.15.50:6813/33605","state":["exists","up"]},{"osd":5,"uuid":"726c3003-34e6-4d5a-b6e2-f911e13c2118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33606},{"type":"v1","addr":"172.21.15.50:6801","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33606},{"type":"v1","addr":"172.21.15.50:6803","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33606},{"type":"v1","addr":"172.21.15.50:6807","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":33606},{"type":"v1","addr":"172.21.15.50:6805","nonce":33606}]},"public_addr":"172.21.15.50:6801/33606","cluster_addr":"172.21.15.50:6803/33606","heartbeat_back_addr":"172.21.15.50:6807/33606","heartbeat_front_addr":"172.21.15.50:6805/33606","state":["exists","up"]},{"osd":6,"uuid":"401122a4-9988-441f-a5a7-39164434ebcd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":33607},{"type":"v1","addr":"172.21.15.50:6819","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":33607},{"type":"v1","addr":"172.21.15.50:6823","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":33607},{"type":"v1","addr":"172.21.15.50:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":33607},{"type":"v1","addr":"172.21.15.50:6827","nonce":33607}]},"public_addr":"172.21.15.50:6819/33607","cluster_addr":"172.21.15.50:6823/33607","heartbeat_back_addr":"172.21.15.50:6831/33607","heartbeat_front_addr":"172.21.15.50:6827/33607","state":["exists","up"]},{"osd":7,"uuid":"6b3fa236-c9d0-4c4d-82ae-9af4daf6d699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33604},{"type":"v1","addr":"172.21.15.50:6818","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":33604},{"type":"v1","addr":"172.21.15.50:6822","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":33604},{"type":"v1","addr":"172.21.15.50:6830","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":33604},{"type":"v1","addr":"172.21.15.50:6826","nonce":33604}]},"public_addr":"172.21.15.50:6818/33604","cluster_addr":"172.21.15.50:6822/33604","heartbeat_back_addr":"172.21.15.50:6830/33604","heartbeat_front_addr":"172.21.15.50:6826/33604","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.497794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.529417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.873426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.325972+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.443971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.240795+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.739632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.643026+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:41:07.079 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.074+0000 7fdeb269d700 1 -- 172.21.15.3:0/3247971605 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fde90060580 msgr2=0x7fde90062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:07.079 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.074+0000 7fdeb269d700 1 --2- 172.21.15.3:0/3247971605 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fde90060580 0x7fde90062a30 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fdeac1436a0 tx=0x7fde9c000bc0 comp rx=0 tx=0).stop 2023-10-08T15:41:07.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.074+0000 7fdeb269d700 1 -- 172.21.15.3:0/3247971605 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdeac068630 msgr2=0x7fdeac140810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:07.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.074+0000 7fdeb269d700 1 --2- 172.21.15.3:0/3247971605 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdeac068630 0x7fdeac140810 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fdea800e930 tx=0x7fdea80091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:07.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.074+0000 7fdeb269d700 1 -- 172.21.15.3:0/3247971605 shutdown_connections 2023-10-08T15:41:07.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.074+0000 7fdeb269d700 1 --2- 172.21.15.3:0/3247971605 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fde90060580 0x7fde90062a30 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:07.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.074+0000 7fdeb269d700 1 --2- 172.21.15.3:0/3247971605 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdeac13f8d0 0x7fdeac150f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:07.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.074+0000 7fdeb269d700 1 --2- 172.21.15.3:0/3247971605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdeac0a15e0 0x7fdeac15e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:07.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.074+0000 7fdeb269d700 1 --2- 172.21.15.3:0/3247971605 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdeac068630 0x7fdeac140810 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:07.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.074+0000 7fdeb269d700 1 -- 172.21.15.3:0/3247971605 >> 172.21.15.3:0/3247971605 conn(0x7fdeac0670e0 msgr2=0x7fdeac1462c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:07.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.074+0000 7fdeb269d700 1 -- 172.21.15.3:0/3247971605 shutdown_connections 2023-10-08T15:41:07.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.074+0000 7fdeb269d700 1 -- 172.21.15.3:0/3247971605 wait complete. 2023-10-08T15:41:07.094 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T15:41:07.262 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:41:07.265 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:41:07.267 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:41:07.269 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:41:07.271 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:41:07.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.274+0000 7fdb0ca6f700 1 Processor -- start 2023-10-08T15:41:07.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.274+0000 7fdb0ca6f700 1 -- start start 2023-10-08T15:41:07.283 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.278+0000 7fdb0ca6f700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fdb080beb80 0x7fdb0814c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:07.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.278+0000 7fdb0ca6f700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdb08068d00 0x7fdb081482c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:07.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.278+0000 7fdb0ca6f700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb080b22b0 con 0x7fdb080a0d30 2023-10-08T15:41:07.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.278+0000 7fdb0ca6f700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb080b28e0 con 0x7fdb080beb80 2023-10-08T15:41:07.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.278+0000 7fdb0ca6f700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb0806ac40 con 0x7fdb08068d00 2023-10-08T15:41:07.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.278+0000 7fdb077fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fdb080beb80 0x7fdb0814c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:07.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.278+0000 7fdb077fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fdb080beb80 0x7fdb0814c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35052/0 (socket says 172.21.15.3:35052) 2023-10-08T15:41:07.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.278+0000 7fdb077fe700 1 -- 172.21.15.3:0/3081663553 learned_addr learned my addr 172.21.15.3:0/3081663553 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:07.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.278+0000 7fdb07fff700 1 --2- 172.21.15.3:0/3081663553 >> v2:172.21.15.50:3300/0 conn(0x7fdb08068d00 0x7fdb081482c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:07.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.278+0000 7fdb077fe700 1 -- 172.21.15.3:0/3081663553 >> v2:172.21.15.50:3300/0 conn(0x7fdb08068d00 msgr2=0x7fdb081482c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:07.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.278+0000 7fdb077fe700 1 --2- 172.21.15.3:0/3081663553 >> v2:172.21.15.50:3300/0 conn(0x7fdb08068d00 0x7fdb081482c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:07.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.278+0000 7fdb077fe700 1 -- 172.21.15.3:0/3081663553 >> v1:172.21.15.3:6789/0 conn(0x7fdb080a0d30 legacy=0x7fdb0814cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:07.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.278+0000 7fdb067fc700 1 -- 172.21.15.3:0/3081663553 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 538835881 0 0) 0x7fdb080b22b0 con 0x7fdb080a0d30 2023-10-08T15:41:07.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.278+0000 7fdb077fe700 1 -- 172.21.15.3:0/3081663553 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb08069de0 con 0x7fdb080beb80 2023-10-08T15:41:07.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.278+0000 7fdb077fe700 1 --2- 172.21.15.3:0/3081663553 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb080beb80 0x7fdb0814c9c0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fdb0806b3d0 tx=0x7fdaf8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d46feb1e2dadbb11 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:07.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.278+0000 7fdb067fc700 1 -- 172.21.15.3:0/3081663553 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf8009e70 con 0x7fdb080beb80 2023-10-08T15:41:07.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.278+0000 7fdb067fc700 1 -- 172.21.15.3:0/3081663553 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaf800b860 con 0x7fdb080beb80 2023-10-08T15:41:07.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.278+0000 7fdb067fc700 1 -- 172.21.15.3:0/3081663553 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf800bc20 con 0x7fdb080beb80 2023-10-08T15:41:07.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.278+0000 7fdb0ca6f700 1 -- 172.21.15.3:0/3081663553 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb080beb80 msgr2=0x7fdb0814c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:07.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.278+0000 7fdb0ca6f700 1 --2- 172.21.15.3:0/3081663553 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb080beb80 0x7fdb0814c9c0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fdb0806b3d0 tx=0x7fdaf8009250 comp rx=0 tx=0).stop 2023-10-08T15:41:07.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.278+0000 7fdb0ca6f700 1 -- 172.21.15.3:0/3081663553 shutdown_connections 2023-10-08T15:41:07.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.278+0000 7fdb0ca6f700 1 --2- 172.21.15.3:0/3081663553 >> v2:172.21.15.50:3300/0 conn(0x7fdb08068d00 0x7fdb081482c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:07.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.278+0000 7fdb0ca6f700 1 --2- 172.21.15.3:0/3081663553 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb080beb80 0x7fdb0814c9c0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:07.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.278+0000 7fdb0ca6f700 1 -- 172.21.15.3:0/3081663553 >> 172.21.15.3:0/3081663553 conn(0x7fdb08067b60 msgr2=0x7fdb080be240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:07.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.278+0000 7fdb0ca6f700 1 -- 172.21.15.3:0/3081663553 shutdown_connections 2023-10-08T15:41:07.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.278+0000 7fdb0ca6f700 1 -- 172.21.15.3:0/3081663553 wait complete. 2023-10-08T15:41:07.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.282+0000 7fdb0ca6f700 1 Processor -- start 2023-10-08T15:41:07.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.282+0000 7fdb0ca6f700 1 -- start start 2023-10-08T15:41:07.289 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.282+0000 7fdb0ca6f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb08068d00 0x7fdb0814b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:07.289 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.282+0000 7fdb0ca6f700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb080a0d30 0x7fdb08146110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:07.289 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.282+0000 7fdb0ca6f700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdb080beb80 0x7fdb08146650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:07.289 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.282+0000 7fdb0ca6f700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb081489a0 con 0x7fdb080a0d30 2023-10-08T15:41:07.289 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.282+0000 7fdb0ca6f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0806cd50 con 0x7fdb08068d00 2023-10-08T15:41:07.289 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.282+0000 7fdb0ca6f700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0814b660 con 0x7fdb080beb80 2023-10-08T15:41:07.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.282+0000 7fdb06ffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb080a0d30 0x7fdb08146110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:07.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.282+0000 7fdb06ffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb080a0d30 0x7fdb08146110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35058/0 (socket says 172.21.15.3:35058) 2023-10-08T15:41:07.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.282+0000 7fdb06ffd700 1 -- 172.21.15.3:0/2802901314 learned_addr learned my addr 172.21.15.3:0/2802901314 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:07.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.282+0000 7fdb077fe700 1 --2- 172.21.15.3:0/2802901314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb08068d00 0x7fdb0814b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:07.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.282+0000 7fdb07fff700 1 --2- 172.21.15.3:0/2802901314 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdb080beb80 0x7fdb08146650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:07.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.282+0000 7fdb077fe700 1 -- 172.21.15.3:0/2802901314 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdb080beb80 msgr2=0x7fdb08146650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:07.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.282+0000 7fdb077fe700 1 --2- 172.21.15.3:0/2802901314 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdb080beb80 0x7fdb08146650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:07.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.282+0000 7fdb077fe700 1 -- 172.21.15.3:0/2802901314 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb080a0d30 msgr2=0x7fdb08146110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:07.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.282+0000 7fdb077fe700 1 --2- 172.21.15.3:0/2802901314 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb080a0d30 0x7fdb08146110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:07.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.282+0000 7fdb077fe700 1 -- 172.21.15.3:0/2802901314 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf80094f0 con 0x7fdb08068d00 2023-10-08T15:41:07.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.282+0000 7fdb077fe700 1 --2- 172.21.15.3:0/2802901314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb08068d00 0x7fdb0814b120 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fdb0806f470 tx=0x7fdaf8017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:07.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.282+0000 7fdaff7fe700 1 -- 172.21.15.3:0/2802901314 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf801f070 con 0x7fdb08068d00 2023-10-08T15:41:07.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.282+0000 7fdb0ca6f700 1 -- 172.21.15.3:0/2802901314 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb0806cff0 con 0x7fdb08068d00 2023-10-08T15:41:07.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.282+0000 7fdaff7fe700 1 -- 172.21.15.3:0/2802901314 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaf8006b30 con 0x7fdb08068d00 2023-10-08T15:41:07.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.282+0000 7fdaff7fe700 1 -- 172.21.15.3:0/2802901314 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf800bc00 con 0x7fdb08068d00 2023-10-08T15:41:07.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.282+0000 7fdb0ca6f700 1 -- 172.21.15.3:0/2802901314 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb0814ba30 con 0x7fdb08068d00 2023-10-08T15:41:07.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.282+0000 7fdb0ca6f700 1 -- 172.21.15.3:0/2802901314 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb0805ecf0 con 0x7fdb08068d00 2023-10-08T15:41:07.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.286+0000 7fdaff7fe700 1 -- 172.21.15.3:0/2802901314 <== mon.1 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fdaf8043a20 con 0x7fdb08068d00 2023-10-08T15:41:07.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.286+0000 7fdaff7fe700 1 --2- 172.21.15.3:0/2802901314 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fdae8060550 0x7fdae8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:07.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.286+0000 7fdaff7fe700 1 -- 172.21.15.3:0/2802901314 <== mon.1 v2:172.21.15.50:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdaf807d6c0 con 0x7fdb08068d00 2023-10-08T15:41:07.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.286+0000 7fdb06ffd700 1 --2- 172.21.15.3:0/2802901314 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fdae8060550 0x7fdae8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:07.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.286+0000 7fdb06ffd700 1 --2- 172.21.15.3:0/2802901314 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fdae8060550 0x7fdae8062a00 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fdb081471a0 tx=0x7fdaf0007df0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:07.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.294+0000 7fdaff7fe700 1 -- 172.21.15.3:0/2802901314 <== mon.1 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fdaf804dd30 con 0x7fdb08068d00 2023-10-08T15:41:07.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:07.494+0000 7fdb0ca6f700 1 -- 172.21.15.3:0/2802901314 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fdb0806d4f0 con 0x7fdb08068d00 2023-10-08T15:41:08.455 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.450+0000 7fdaff7fe700 1 -- 172.21.15.3:0/2802901314 <== mon.1 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v26) v1 ==== 118+0+0 (secure 0 0 0) 0x7fdaf8051350 con 0x7fdb08068d00 2023-10-08T15:41:08.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.454+0000 7fdb0ca6f700 1 -- 172.21.15.3:0/2802901314 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fdae8060550 msgr2=0x7fdae8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:08.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.454+0000 7fdb0ca6f700 1 --2- 172.21.15.3:0/2802901314 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fdae8060550 0x7fdae8062a00 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fdb081471a0 tx=0x7fdaf0007df0 comp rx=0 tx=0).stop 2023-10-08T15:41:08.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.454+0000 7fdb0ca6f700 1 -- 172.21.15.3:0/2802901314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb08068d00 msgr2=0x7fdb0814b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:08.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.454+0000 7fdb0ca6f700 1 --2- 172.21.15.3:0/2802901314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb08068d00 0x7fdb0814b120 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fdb0806f470 tx=0x7fdaf8017000 comp rx=0 tx=0).stop 2023-10-08T15:41:08.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.454+0000 7fdb0ca6f700 1 -- 172.21.15.3:0/2802901314 shutdown_connections 2023-10-08T15:41:08.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.454+0000 7fdb0ca6f700 1 --2- 172.21.15.3:0/2802901314 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fdae8060550 0x7fdae8062a00 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:08.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.454+0000 7fdb0ca6f700 1 --2- 172.21.15.3:0/2802901314 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdb080beb80 0x7fdb08146650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:08.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.454+0000 7fdb0ca6f700 1 --2- 172.21.15.3:0/2802901314 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb080a0d30 0x7fdb08146110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:08.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.454+0000 7fdb0ca6f700 1 --2- 172.21.15.3:0/2802901314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb08068d00 0x7fdb0814b120 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:08.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.454+0000 7fdb0ca6f700 1 -- 172.21.15.3:0/2802901314 >> 172.21.15.3:0/2802901314 conn(0x7fdb08067b60 msgr2=0x7fdb08142480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:08.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.454+0000 7fdb0ca6f700 1 -- 172.21.15.3:0/2802901314 shutdown_connections 2023-10-08T15:41:08.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.454+0000 7fdb0ca6f700 1 -- 172.21.15.3:0/2802901314 wait complete. 2023-10-08T15:41:08.474 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-08T15:41:08.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.590+0000 7f5bf1d99700 1 Processor -- start 2023-10-08T15:41:08.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.590+0000 7f5bf1d99700 1 -- start start 2023-10-08T15:41:08.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.590+0000 7f5bf1d99700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f5bec069a20 0x7f5bec14aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:08.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.590+0000 7f5bf1d99700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5bec067950 0x7f5bec14ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:08.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.590+0000 7f5bf1d99700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bec0b35b0 con 0x7f5bec06e620 2023-10-08T15:41:08.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.590+0000 7f5bf1d99700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bec0b2f60 con 0x7f5bec069a20 2023-10-08T15:41:08.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.590+0000 7f5bf1d99700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bec0b3240 con 0x7f5bec067950 2023-10-08T15:41:08.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.590+0000 7f5beb7fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f5bec069a20 0x7f5bec14aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:08.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.594+0000 7f5beb7fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f5bec069a20 0x7f5bec14aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35066/0 (socket says 172.21.15.3:35066) 2023-10-08T15:41:08.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.594+0000 7f5beb7fe700 1 -- 172.21.15.3:0/3987352997 learned_addr learned my addr 172.21.15.3:0/3987352997 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:08.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.594+0000 7f5bebfff700 1 --2- 172.21.15.3:0/3987352997 >> v2:172.21.15.50:3300/0 conn(0x7f5bec067950 0x7f5bec14ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:08.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.594+0000 7f5beb7fe700 1 -- 172.21.15.3:0/3987352997 >> v2:172.21.15.50:3300/0 conn(0x7f5bec067950 msgr2=0x7f5bec14ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:08.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.594+0000 7f5beb7fe700 1 --2- 172.21.15.3:0/3987352997 >> v2:172.21.15.50:3300/0 conn(0x7f5bec067950 0x7f5bec14ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:08.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.594+0000 7f5beb7fe700 1 -- 172.21.15.3:0/3987352997 >> v1:172.21.15.50:6789/0 conn(0x7f5bec06e620 legacy=0x7f5bec14b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:08.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.594+0000 7f5beb7fe700 1 -- 172.21.15.3:0/3987352997 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bec067fb0 con 0x7f5bec069a20 2023-10-08T15:41:08.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.594+0000 7f5beb7fe700 1 --2- 172.21.15.3:0/3987352997 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5bec069a20 0x7f5bec14aad0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f5bec06a210 tx=0x7f5bd4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1e99354d3eb8732 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:08.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.594+0000 7f5bea7fc700 1 -- 172.21.15.3:0/3987352997 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd4009e70 con 0x7f5bec069a20 2023-10-08T15:41:08.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.594+0000 7f5bea7fc700 1 -- 172.21.15.3:0/3987352997 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd400b860 con 0x7f5bec069a20 2023-10-08T15:41:08.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.594+0000 7f5bea7fc700 1 -- 172.21.15.3:0/3987352997 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd400bc20 con 0x7f5bec069a20 2023-10-08T15:41:08.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.594+0000 7f5bf1d99700 1 -- 172.21.15.3:0/3987352997 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5bec069a20 msgr2=0x7f5bec14aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:08.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.594+0000 7f5bf1d99700 1 --2- 172.21.15.3:0/3987352997 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5bec069a20 0x7f5bec14aad0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f5bec06a210 tx=0x7f5bd4009250 comp rx=0 tx=0).stop 2023-10-08T15:41:08.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.594+0000 7f5bf1d99700 1 -- 172.21.15.3:0/3987352997 shutdown_connections 2023-10-08T15:41:08.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.594+0000 7f5bf1d99700 1 --2- 172.21.15.3:0/3987352997 >> v2:172.21.15.50:3300/0 conn(0x7f5bec067950 0x7f5bec14ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:08.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.594+0000 7f5bf1d99700 1 --2- 172.21.15.3:0/3987352997 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5bec069a20 0x7f5bec14aad0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:08.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.594+0000 7f5bf1d99700 1 -- 172.21.15.3:0/3987352997 >> 172.21.15.3:0/3987352997 conn(0x7f5bec0bb080 msgr2=0x7f5bec0670e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:08.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.594+0000 7f5bf1d99700 1 -- 172.21.15.3:0/3987352997 shutdown_connections 2023-10-08T15:41:08.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.594+0000 7f5bf1d99700 1 -- 172.21.15.3:0/3987352997 wait complete. 2023-10-08T15:41:08.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.598+0000 7f5bf1d99700 1 Processor -- start 2023-10-08T15:41:08.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.598+0000 7f5bf1d99700 1 -- start start 2023-10-08T15:41:08.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.598+0000 7f5bf1d99700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5bec067950 0x7f5bec14f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:08.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.598+0000 7f5bf1d99700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5bec069a20 0x7f5bec15c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:08.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.598+0000 7f5bf1d99700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5bec06e620 0x7f5bec149d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:08.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.598+0000 7f5bf1d99700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec15c620 con 0x7f5bec069a20 2023-10-08T15:41:08.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.598+0000 7f5bf1d99700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec15b3a0 con 0x7f5bec06e620 2023-10-08T15:41:08.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.598+0000 7f5bf1d99700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec15b600 con 0x7f5bec067950 2023-10-08T15:41:08.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.598+0000 7f5beaffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5bec069a20 0x7f5bec15c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:08.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.598+0000 7f5beaffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5bec069a20 0x7f5bec15c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35076/0 (socket says 172.21.15.3:35076) 2023-10-08T15:41:08.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.598+0000 7f5beaffd700 1 -- 172.21.15.3:0/3060254068 learned_addr learned my addr 172.21.15.3:0/3060254068 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:08.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.598+0000 7f5beb7fe700 1 --2- 172.21.15.3:0/3060254068 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5bec067950 0x7f5bec14f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:08.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.598+0000 7f5bebfff700 1 --2- 172.21.15.3:0/3060254068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5bec06e620 0x7f5bec149d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:08.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.598+0000 7f5beaffd700 1 -- 172.21.15.3:0/3060254068 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5bec067950 msgr2=0x7f5bec14f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:08.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.598+0000 7f5beaffd700 1 --2- 172.21.15.3:0/3060254068 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5bec067950 0x7f5bec14f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:08.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.598+0000 7f5beaffd700 1 -- 172.21.15.3:0/3060254068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5bec06e620 msgr2=0x7f5bec149d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:08.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.598+0000 7f5beaffd700 1 --2- 172.21.15.3:0/3060254068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5bec06e620 0x7f5bec149d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:08.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.598+0000 7f5beaffd700 1 -- 172.21.15.3:0/3060254068 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd40094f0 con 0x7f5bec069a20 2023-10-08T15:41:08.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.598+0000 7f5beaffd700 1 --2- 172.21.15.3:0/3060254068 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5bec069a20 0x7f5bec15c0e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc00c4e0 tx=0x7f5bdc00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:08.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.598+0000 7f5be37fe700 1 -- 172.21.15.3:0/3060254068 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc011590 con 0x7f5bec069a20 2023-10-08T15:41:08.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.598+0000 7f5be37fe700 1 -- 172.21.15.3:0/3060254068 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bdc011710 con 0x7f5bec069a20 2023-10-08T15:41:08.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.598+0000 7f5bf1d99700 1 -- 172.21.15.3:0/3060254068 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bec15b8e0 con 0x7f5bec069a20 2023-10-08T15:41:08.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.598+0000 7f5be37fe700 1 -- 172.21.15.3:0/3060254068 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc011ad0 con 0x7f5bec069a20 2023-10-08T15:41:08.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.602+0000 7f5bf1d99700 1 -- 172.21.15.3:0/3060254068 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bec143f20 con 0x7f5bec069a20 2023-10-08T15:41:08.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.602+0000 7f5bf1d99700 1 -- 172.21.15.3:0/3060254068 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bec064530 con 0x7f5bec069a20 2023-10-08T15:41:08.608 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.602+0000 7f5be37fe700 1 -- 172.21.15.3:0/3060254068 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5bdc01b3b0 con 0x7f5bec069a20 2023-10-08T15:41:08.608 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.602+0000 7f5be37fe700 1 --2- 172.21.15.3:0/3060254068 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5bcc060580 0x7f5bcc062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:08.608 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.602+0000 7f5be37fe700 1 -- 172.21.15.3:0/3060254068 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5bdc07bb30 con 0x7f5bec069a20 2023-10-08T15:41:08.608 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.602+0000 7f5beb7fe700 1 --2- 172.21.15.3:0/3060254068 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5bcc060580 0x7f5bcc062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:08.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.606+0000 7f5beb7fe700 1 --2- 172.21.15.3:0/3060254068 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5bcc060580 0x7f5bcc062a30 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5bec06a210 tx=0x7f5bd4017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:08.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.614+0000 7f5be37fe700 1 -- 172.21.15.3:0/3060254068 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5bdc04c120 con 0x7f5bec069a20 2023-10-08T15:41:08.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:08.810+0000 7f5bf1d99700 1 -- 172.21.15.3:0/3060254068 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f5bec069df0 con 0x7f5bec069a20 2023-10-08T15:41:09.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.462+0000 7f5be37fe700 1 -- 172.21.15.3:0/3060254068 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v27) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5bdc04f740 con 0x7f5bec069a20 2023-10-08T15:41:09.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.462+0000 7f5bf1d99700 1 -- 172.21.15.3:0/3060254068 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5bcc060580 msgr2=0x7f5bcc062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:09.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.462+0000 7f5bf1d99700 1 --2- 172.21.15.3:0/3060254068 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5bcc060580 0x7f5bcc062a30 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5bec06a210 tx=0x7f5bd4017000 comp rx=0 tx=0).stop 2023-10-08T15:41:09.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.462+0000 7f5bf1d99700 1 -- 172.21.15.3:0/3060254068 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5bec069a20 msgr2=0x7f5bec15c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:09.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.462+0000 7f5bf1d99700 1 --2- 172.21.15.3:0/3060254068 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5bec069a20 0x7f5bec15c0e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc00c4e0 tx=0x7f5bdc00c7f0 comp rx=0 tx=0).stop 2023-10-08T15:41:09.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.466+0000 7f5bf1d99700 1 -- 172.21.15.3:0/3060254068 shutdown_connections 2023-10-08T15:41:09.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.466+0000 7f5bf1d99700 1 --2- 172.21.15.3:0/3060254068 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5bcc060580 0x7f5bcc062a30 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:09.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.466+0000 7f5bf1d99700 1 --2- 172.21.15.3:0/3060254068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5bec06e620 0x7f5bec149d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:09.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.466+0000 7f5bf1d99700 1 --2- 172.21.15.3:0/3060254068 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5bec069a20 0x7f5bec15c0e0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:09.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.466+0000 7f5bf1d99700 1 --2- 172.21.15.3:0/3060254068 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5bec067950 0x7f5bec14f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:09.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.466+0000 7f5bf1d99700 1 -- 172.21.15.3:0/3060254068 >> 172.21.15.3:0/3060254068 conn(0x7f5bec0bb080 msgr2=0x7f5bec0bc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:09.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.466+0000 7f5bf1d99700 1 -- 172.21.15.3:0/3060254068 shutdown_connections 2023-10-08T15:41:09.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.466+0000 7f5bf1d99700 1 -- 172.21.15.3:0/3060254068 wait complete. 2023-10-08T15:41:09.485 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:41:09.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.590+0000 7ff67ab81700 1 Processor -- start 2023-10-08T15:41:09.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.590+0000 7ff67ab81700 1 -- start start 2023-10-08T15:41:09.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.590+0000 7ff67ab81700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7ff6740bafe0 0x7ff674068ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:09.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.590+0000 7ff67ab81700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff67406d080 0x7ff6741533c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:09.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.590+0000 7ff67ab81700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff674153900 0x7ff67414ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:09.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.590+0000 7ff67ab81700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff67409e490 con 0x7ff6740bafe0 2023-10-08T15:41:09.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.590+0000 7ff67ab81700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff67406ce30 con 0x7ff67406d080 2023-10-08T15:41:09.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.590+0000 7ff67ab81700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff67409e6e0 con 0x7ff674153900 2023-10-08T15:41:09.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.590+0000 7ff67891d700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7ff6740bafe0 0x7ff674068ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:09.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.590+0000 7ff67891d700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7ff6740bafe0 0x7ff674068ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35080/0 (socket says 172.21.15.3:35080) 2023-10-08T15:41:09.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.590+0000 7ff67891d700 1 -- 172.21.15.3:0/2428205526 learned_addr learned my addr 172.21.15.3:0/2428205526 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:09.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.590+0000 7ff673fff700 1 --2- 172.21.15.3:0/2428205526 >> v2:172.21.15.50:3300/0 conn(0x7ff67406d080 0x7ff6741533c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:09.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.590+0000 7ff67911e700 1 --2- 172.21.15.3:0/2428205526 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff674153900 0x7ff67414ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:09.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.590+0000 7ff67891d700 1 -- 172.21.15.3:0/2428205526 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff674153900 msgr2=0x7ff67414ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:09.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.590+0000 7ff67891d700 1 --2- 172.21.15.3:0/2428205526 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff674153900 0x7ff67414ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:09.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.590+0000 7ff67891d700 1 -- 172.21.15.3:0/2428205526 >> v2:172.21.15.50:3300/0 conn(0x7ff67406d080 msgr2=0x7ff6741533c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:09.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.590+0000 7ff67891d700 1 --2- 172.21.15.3:0/2428205526 >> v2:172.21.15.50:3300/0 conn(0x7ff67406d080 0x7ff6741533c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:09.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.590+0000 7ff67891d700 1 -- 172.21.15.3:0/2428205526 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff67409ea50 con 0x7ff6740bafe0 2023-10-08T15:41:09.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.590+0000 7ff67891d700 1 --2- 172.21.15.3:0/2428205526 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff6740bafe0 0x7ff674068ab0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7ff67409f7e0 tx=0x7ff65c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=171001055b267566 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:09.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.590+0000 7ff6737fe700 1 -- 172.21.15.3:0/2428205526 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65c00b640 con 0x7ff6740bafe0 2023-10-08T15:41:09.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.590+0000 7ff6737fe700 1 -- 172.21.15.3:0/2428205526 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff65c00b7a0 con 0x7ff6740bafe0 2023-10-08T15:41:09.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.590+0000 7ff6737fe700 1 -- 172.21.15.3:0/2428205526 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65c00bb60 con 0x7ff6740bafe0 2023-10-08T15:41:09.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.590+0000 7ff67ab81700 1 -- 172.21.15.3:0/2428205526 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff6740bafe0 msgr2=0x7ff674068ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:09.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.590+0000 7ff67ab81700 1 --2- 172.21.15.3:0/2428205526 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff6740bafe0 0x7ff674068ab0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7ff67409f7e0 tx=0x7ff65c009250 comp rx=0 tx=0).stop 2023-10-08T15:41:09.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.594+0000 7ff67ab81700 1 -- 172.21.15.3:0/2428205526 shutdown_connections 2023-10-08T15:41:09.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.594+0000 7ff67ab81700 1 --2- 172.21.15.3:0/2428205526 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff674153900 0x7ff67414ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:09.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.594+0000 7ff67ab81700 1 --2- 172.21.15.3:0/2428205526 >> v2:172.21.15.50:3300/0 conn(0x7ff67406d080 0x7ff6741533c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:09.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.594+0000 7ff67ab81700 1 --2- 172.21.15.3:0/2428205526 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff6740bafe0 0x7ff674068ab0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:09.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.594+0000 7ff67ab81700 1 -- 172.21.15.3:0/2428205526 >> 172.21.15.3:0/2428205526 conn(0x7ff6740be640 msgr2=0x7ff6740ba6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:09.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.594+0000 7ff67ab81700 1 -- 172.21.15.3:0/2428205526 shutdown_connections 2023-10-08T15:41:09.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.594+0000 7ff67ab81700 1 -- 172.21.15.3:0/2428205526 wait complete. 2023-10-08T15:41:09.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.594+0000 7ff67ab81700 1 Processor -- start 2023-10-08T15:41:09.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.594+0000 7ff67ab81700 1 -- start start 2023-10-08T15:41:09.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.594+0000 7ff67ab81700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff67406d080 0x7ff674152150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:09.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.594+0000 7ff67ab81700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff6740bafe0 0x7ff6740a0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:09.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.594+0000 7ff67ab81700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff674153900 0x7ff6740a0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:09.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.594+0000 7ff67ab81700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff674149210 con 0x7ff674153900 2023-10-08T15:41:09.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.594+0000 7ff67ab81700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6740a2ef0 con 0x7ff67406d080 2023-10-08T15:41:09.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.594+0000 7ff67ab81700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6741495e0 con 0x7ff6740bafe0 2023-10-08T15:41:09.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.594+0000 7ff67911e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff674153900 0x7ff6740a0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:09.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.594+0000 7ff67911e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff674153900 0x7ff6740a0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35086/0 (socket says 172.21.15.3:35086) 2023-10-08T15:41:09.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.594+0000 7ff67911e700 1 -- 172.21.15.3:0/586127553 learned_addr learned my addr 172.21.15.3:0/586127553 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:09.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.594+0000 7ff673fff700 1 --2- 172.21.15.3:0/586127553 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff6740bafe0 0x7ff6740a0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:09.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.594+0000 7ff67891d700 1 --2- 172.21.15.3:0/586127553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff67406d080 0x7ff674152150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:09.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.594+0000 7ff67911e700 1 -- 172.21.15.3:0/586127553 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff6740bafe0 msgr2=0x7ff6740a0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:09.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.594+0000 7ff67911e700 1 --2- 172.21.15.3:0/586127553 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff6740bafe0 0x7ff6740a0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:09.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.594+0000 7ff67911e700 1 -- 172.21.15.3:0/586127553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff67406d080 msgr2=0x7ff674152150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:09.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.594+0000 7ff67911e700 1 --2- 172.21.15.3:0/586127553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff67406d080 0x7ff674152150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:09.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.594+0000 7ff67911e700 1 -- 172.21.15.3:0/586127553 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff65c009490 con 0x7ff674153900 2023-10-08T15:41:09.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.594+0000 7ff673fff700 1 --2- 172.21.15.3:0/586127553 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff6740bafe0 0x7ff6740a0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:09.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.594+0000 7ff67911e700 1 --2- 172.21.15.3:0/586127553 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff674153900 0x7ff6740a0580 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7ff66400ea50 tx=0x7ff6640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:09.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.594+0000 7ff670ff9700 1 -- 172.21.15.3:0/586127553 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff66400c850 con 0x7ff674153900 2023-10-08T15:41:09.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.594+0000 7ff670ff9700 1 -- 172.21.15.3:0/586127553 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff66400c9b0 con 0x7ff674153900 2023-10-08T15:41:09.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.594+0000 7ff67ab81700 1 -- 172.21.15.3:0/586127553 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6740a2c10 con 0x7ff674153900 2023-10-08T15:41:09.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.594+0000 7ff670ff9700 1 -- 172.21.15.3:0/586127553 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff66400cd70 con 0x7ff674153900 2023-10-08T15:41:09.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.598+0000 7ff67ab81700 1 -- 172.21.15.3:0/586127553 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6740a2210 con 0x7ff674153900 2023-10-08T15:41:09.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.598+0000 7ff67ab81700 1 -- 172.21.15.3:0/586127553 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff674064530 con 0x7ff674153900 2023-10-08T15:41:09.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.598+0000 7ff670ff9700 1 -- 172.21.15.3:0/586127553 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff664013680 con 0x7ff674153900 2023-10-08T15:41:09.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.598+0000 7ff670ff9700 1 --2- 172.21.15.3:0/586127553 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff658060550 0x7ff658062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:09.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.598+0000 7ff670ff9700 1 -- 172.21.15.3:0/586127553 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff66407cb00 con 0x7ff674153900 2023-10-08T15:41:09.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.598+0000 7ff67891d700 1 --2- 172.21.15.3:0/586127553 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff658060550 0x7ff658062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:09.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.602+0000 7ff67891d700 1 --2- 172.21.15.3:0/586127553 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff658060550 0x7ff658062a00 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff67409f7e0 tx=0x7ff65c017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:09.608 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.602+0000 7ff670ff9700 1 -- 172.21.15.3:0/586127553 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff66404d0f0 con 0x7ff674153900 2023-10-08T15:41:09.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.802+0000 7ff67ab81700 1 -- 172.21.15.3:0/586127553 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff674148f70 con 0x7ff674153900 2023-10-08T15:41:09.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.802+0000 7ff670ff9700 1 -- 172.21.15.3:0/586127553 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+3077 (secure 0 0 0) 0x7ff664017c20 con 0x7ff674153900 2023-10-08T15:41:09.808 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:41:09.808 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":27,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5674,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/688778262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":688778262},{"type":"v1","addr":"172.21.15.50:6835","nonce":688778262}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:41:06.132475+0000","modified":"2023-10-08T15:41:09.450447+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5685},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5685":{"gid":5685,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.3:6833/3789195831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":3789195831},{"type":"v1","addr":"172.21.15.3:6833","nonce":3789195831}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-08T15:41:09.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.806+0000 7ff67ab81700 1 -- 172.21.15.3:0/586127553 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff658060550 msgr2=0x7ff658062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:09.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.806+0000 7ff67ab81700 1 --2- 172.21.15.3:0/586127553 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff658060550 0x7ff658062a00 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff67409f7e0 tx=0x7ff65c017000 comp rx=0 tx=0).stop 2023-10-08T15:41:09.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.806+0000 7ff67ab81700 1 -- 172.21.15.3:0/586127553 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff674153900 msgr2=0x7ff6740a0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:09.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.806+0000 7ff67ab81700 1 --2- 172.21.15.3:0/586127553 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff674153900 0x7ff6740a0580 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7ff66400ea50 tx=0x7ff6640091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:09.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.806+0000 7ff67ab81700 1 -- 172.21.15.3:0/586127553 shutdown_connections 2023-10-08T15:41:09.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.806+0000 7ff67ab81700 1 --2- 172.21.15.3:0/586127553 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff658060550 0x7ff658062a00 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:09.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.806+0000 7ff67ab81700 1 --2- 172.21.15.3:0/586127553 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff674153900 0x7ff6740a0580 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:09.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.806+0000 7ff67ab81700 1 --2- 172.21.15.3:0/586127553 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff6740bafe0 0x7ff6740a0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:09.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.806+0000 7ff67ab81700 1 --2- 172.21.15.3:0/586127553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff67406d080 0x7ff674152150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:09.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.806+0000 7ff67ab81700 1 -- 172.21.15.3:0/586127553 >> 172.21.15.3:0/586127553 conn(0x7ff6740be640 msgr2=0x7ff67414cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:09.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.806+0000 7ff67ab81700 1 -- 172.21.15.3:0/586127553 shutdown_connections 2023-10-08T15:41:09.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.806+0000 7ff67ab81700 1 -- 172.21.15.3:0/586127553 wait complete. 2023-10-08T15:41:09.814 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 27 2023-10-08T15:41:09.829 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:41:09.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.934+0000 7f8819b02700 1 Processor -- start 2023-10-08T15:41:09.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.934+0000 7f8819b02700 1 -- start start 2023-10-08T15:41:09.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.934+0000 7f8819b02700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f88140badb0 0x7f88140bb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:09.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.934+0000 7f8819b02700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f881414a030 0x7f88140b2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:09.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.934+0000 7f8819b02700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8814149ba0 con 0x7f88140b43a0 2023-10-08T15:41:09.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.934+0000 7f8819b02700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8814149550 con 0x7f88140badb0 2023-10-08T15:41:09.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.934+0000 7f8819b02700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8814149830 con 0x7f881414a030 2023-10-08T15:41:09.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.934+0000 7f88137fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f88140badb0 0x7f88140bb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:09.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.934+0000 7f88137fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f88140badb0 0x7f88140bb180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35094/0 (socket says 172.21.15.3:35094) 2023-10-08T15:41:09.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.934+0000 7f88137fe700 1 -- 172.21.15.3:0/2706406840 learned_addr learned my addr 172.21.15.3:0/2706406840 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:09.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.934+0000 7f880bfff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f88140b43a0 0x7f881414d450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:50708/0 (socket says 172.21.15.3:50708) 2023-10-08T15:41:09.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.934+0000 7f8813fff700 1 --2- 172.21.15.3:0/2706406840 >> v2:172.21.15.50:3300/0 conn(0x7f881414a030 0x7f88140b2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:09.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.934+0000 7f88137fe700 1 -- 172.21.15.3:0/2706406840 >> v2:172.21.15.50:3300/0 conn(0x7f881414a030 msgr2=0x7f88140b2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:09.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.934+0000 7f88137fe700 1 --2- 172.21.15.3:0/2706406840 >> v2:172.21.15.50:3300/0 conn(0x7f881414a030 0x7f88140b2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:09.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.934+0000 7f88137fe700 1 -- 172.21.15.3:0/2706406840 >> v1:172.21.15.3:6789/0 conn(0x7f88140b43a0 legacy=0x7f881414d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:09.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.934+0000 7f88137fe700 1 -- 172.21.15.3:0/2706406840 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f881414a4b0 con 0x7f88140badb0 2023-10-08T15:41:09.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.934+0000 7f88137fe700 1 --2- 172.21.15.3:0/2706406840 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f88140badb0 0x7f88140bb180 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f88140691c0 tx=0x7f8804009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c2740af3973e65b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:09.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.934+0000 7f8812ffd700 1 -- 172.21.15.3:0/2706406840 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8804005c10 con 0x7f88140badb0 2023-10-08T15:41:09.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.934+0000 7f8812ffd700 1 -- 172.21.15.3:0/2706406840 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8804005d70 con 0x7f88140badb0 2023-10-08T15:41:09.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.934+0000 7f8812ffd700 1 -- 172.21.15.3:0/2706406840 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880400b8a0 con 0x7f88140badb0 2023-10-08T15:41:09.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.934+0000 7f8819b02700 1 -- 172.21.15.3:0/2706406840 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f88140badb0 msgr2=0x7f88140bb180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:09.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.934+0000 7f8819b02700 1 --2- 172.21.15.3:0/2706406840 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f88140badb0 0x7f88140bb180 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f88140691c0 tx=0x7f8804009220 comp rx=0 tx=0).stop 2023-10-08T15:41:09.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.934+0000 7f8819b02700 1 -- 172.21.15.3:0/2706406840 shutdown_connections 2023-10-08T15:41:09.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.934+0000 7f8819b02700 1 --2- 172.21.15.3:0/2706406840 >> v2:172.21.15.50:3300/0 conn(0x7f881414a030 0x7f88140b2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:09.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.934+0000 7f8819b02700 1 --2- 172.21.15.3:0/2706406840 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f88140badb0 0x7f88140bb180 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:09.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.934+0000 7f8819b02700 1 -- 172.21.15.3:0/2706406840 >> 172.21.15.3:0/2706406840 conn(0x7f88140be640 msgr2=0x7f88140ba6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:09.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.934+0000 7f8819b02700 1 -- 172.21.15.3:0/2706406840 shutdown_connections 2023-10-08T15:41:09.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.934+0000 7f8819b02700 1 -- 172.21.15.3:0/2706406840 wait complete. 2023-10-08T15:41:09.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.938+0000 7f8819b02700 1 Processor -- start 2023-10-08T15:41:09.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.938+0000 7f8819b02700 1 -- start start 2023-10-08T15:41:09.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.938+0000 7f8819b02700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88140b43a0 0x7f88141461c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:09.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.938+0000 7f8819b02700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f88140badb0 0x7f881415c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:09.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.938+0000 7f8819b02700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f881414a030 0x7f881415ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:09.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.938+0000 7f8819b02700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f881414c270 con 0x7f881414a030 2023-10-08T15:41:09.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.938+0000 7f8819b02700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f881414bf40 con 0x7f88140b43a0 2023-10-08T15:41:09.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.938+0000 7f8819b02700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8814146700 con 0x7f88140badb0 2023-10-08T15:41:09.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.938+0000 7f8813fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f881414a030 0x7f881415ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:09.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.938+0000 7f8813fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f881414a030 0x7f881415ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35102/0 (socket says 172.21.15.3:35102) 2023-10-08T15:41:09.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.938+0000 7f8813fff700 1 -- 172.21.15.3:0/85479494 learned_addr learned my addr 172.21.15.3:0/85479494 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:09.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.938+0000 7f88137fe700 1 --2- 172.21.15.3:0/85479494 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88140b43a0 0x7f88141461c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:09.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.938+0000 7f880bfff700 1 --2- 172.21.15.3:0/85479494 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f88140badb0 0x7f881415c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:09.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.938+0000 7f8813fff700 1 -- 172.21.15.3:0/85479494 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f88140badb0 msgr2=0x7f881415c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:09.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.938+0000 7f8813fff700 1 --2- 172.21.15.3:0/85479494 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f88140badb0 0x7f881415c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:09.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.938+0000 7f8813fff700 1 -- 172.21.15.3:0/85479494 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88140b43a0 msgr2=0x7f88141461c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:09.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.938+0000 7f8813fff700 1 --2- 172.21.15.3:0/85479494 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88140b43a0 0x7f88141461c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:09.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.938+0000 7f8813fff700 1 -- 172.21.15.3:0/85479494 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8804009480 con 0x7f881414a030 2023-10-08T15:41:09.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.938+0000 7f8813fff700 1 --2- 172.21.15.3:0/85479494 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f881414a030 0x7f881415ccf0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f880c007f20 tx=0x7f880c009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:09.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.938+0000 7f880b7fe700 1 -- 172.21.15.3:0/85479494 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c00ebf0 con 0x7f881414a030 2023-10-08T15:41:09.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.938+0000 7f880b7fe700 1 -- 172.21.15.3:0/85479494 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f880c00ed70 con 0x7f881414a030 2023-10-08T15:41:09.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.938+0000 7f8819b02700 1 -- 172.21.15.3:0/85479494 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88140b7060 con 0x7f881414a030 2023-10-08T15:41:09.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.938+0000 7f880b7fe700 1 -- 172.21.15.3:0/85479494 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c014670 con 0x7f881414a030 2023-10-08T15:41:09.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.938+0000 7f8819b02700 1 -- 172.21.15.3:0/85479494 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88140b6c10 con 0x7f881414a030 2023-10-08T15:41:09.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.942+0000 7f8819b02700 1 -- 172.21.15.3:0/85479494 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f881414c3e0 con 0x7f881414a030 2023-10-08T15:41:09.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.942+0000 7f880b7fe700 1 -- 172.21.15.3:0/85479494 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f880c0149e0 con 0x7f881414a030 2023-10-08T15:41:09.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.942+0000 7f880b7fe700 1 --2- 172.21.15.3:0/85479494 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f87f4060550 0x7f87f4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:09.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.942+0000 7f880b7fe700 1 -- 172.21.15.3:0/85479494 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f880c07cee0 con 0x7f881414a030 2023-10-08T15:41:09.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.942+0000 7f88137fe700 1 --2- 172.21.15.3:0/85479494 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f87f4060550 0x7f87f4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:09.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.946+0000 7f88137fe700 1 --2- 172.21.15.3:0/85479494 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f87f4060550 0x7f87f4062a00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8804007fd0 tx=0x7f8804016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:09.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:09.950+0000 7f880b7fe700 1 -- 172.21.15.3:0/85479494 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f880c04d430 con 0x7f881414a030 2023-10-08T15:41:10.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.114+0000 7f8819b02700 1 -- 172.21.15.3:0/85479494 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8814064530 con 0x7f881414a030 2023-10-08T15:41:10.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.114+0000 7f880b7fe700 1 -- 172.21.15.3:0/85479494 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+15254 (secure 0 0 0) 0x7f880c050a50 con 0x7f881414a030 2023-10-08T15:41:10.121 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:41:10.121 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":49,"fsid":"7635972e-cd66-4a8f-a231-378db8b3847a","created":"2023-10-08T15:37:08.234594+0000","modified":"2023-10-08T15:41:07.416834+0000","last_up_change":"2023-10-08T15:37:17.537726+0000","last_in_change":"2023-10-08T15:37:10.269178+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:37:16.581590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:41:04.003380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-08T15:41:04.755627+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"64fb1864-bfdd-4d75-9b41-03fb60085dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33363},{"type":"v1","addr":"172.21.15.3:6801","nonce":33363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33363},{"type":"v1","addr":"172.21.15.3:6803","nonce":33363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":33363},{"type":"v1","addr":"172.21.15.3:6807","nonce":33363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33363},{"type":"v1","addr":"172.21.15.3:6805","nonce":33363}]},"public_addr":"172.21.15.3:6801/33363","cluster_addr":"172.21.15.3:6803/33363","heartbeat_back_addr":"172.21.15.3:6807/33363","heartbeat_front_addr":"172.21.15.3:6805/33363","state":["exists","up"]},{"osd":1,"uuid":"3ca6bd3a-3e8a-4c65-af9c-46148b0c2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33364},{"type":"v1","addr":"172.21.15.3:6820","nonce":33364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33364},{"type":"v1","addr":"172.21.15.3:6824","nonce":33364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33364},{"type":"v1","addr":"172.21.15.3:6831","nonce":33364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33364},{"type":"v1","addr":"172.21.15.3:6828","nonce":33364}]},"public_addr":"172.21.15.3:6820/33364","cluster_addr":"172.21.15.3:6824/33364","heartbeat_back_addr":"172.21.15.3:6831/33364","heartbeat_front_addr":"172.21.15.3:6828/33364","state":["exists","up"]},{"osd":2,"uuid":"6eb9f757-58dd-442f-910d-32401454bce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33366},{"type":"v1","addr":"172.21.15.3:6817","nonce":33366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":33366},{"type":"v1","addr":"172.21.15.3:6821","nonce":33366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6827","nonce":33366},{"type":"v1","addr":"172.21.15.3:6829","nonce":33366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":33366},{"type":"v1","addr":"172.21.15.3:6825","nonce":33366}]},"public_addr":"172.21.15.3:6817/33366","cluster_addr":"172.21.15.3:6821/33366","heartbeat_back_addr":"172.21.15.3:6829/33366","heartbeat_front_addr":"172.21.15.3:6825/33366","state":["exists","up"]},{"osd":3,"uuid":"1c39866b-ac2e-4ea9-a69c-02b01ee4191d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33365},{"type":"v1","addr":"172.21.15.3:6809","nonce":33365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":33365},{"type":"v1","addr":"172.21.15.3:6811","nonce":33365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33365},{"type":"v1","addr":"172.21.15.3:6815","nonce":33365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":33365},{"type":"v1","addr":"172.21.15.3:6813","nonce":33365}]},"public_addr":"172.21.15.3:6809/33365","cluster_addr":"172.21.15.3:6811/33365","heartbeat_back_addr":"172.21.15.3:6815/33365","heartbeat_front_addr":"172.21.15.3:6813/33365","state":["exists","up"]},{"osd":4,"uuid":"15f86b61-b7f1-4780-ae00-9d80a68cb830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":33605},{"type":"v1","addr":"172.21.15.50:6809","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33605},{"type":"v1","addr":"172.21.15.50:6811","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33605},{"type":"v1","addr":"172.21.15.50:6815","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":33605},{"type":"v1","addr":"172.21.15.50:6813","nonce":33605}]},"public_addr":"172.21.15.50:6809/33605","cluster_addr":"172.21.15.50:6811/33605","heartbeat_back_addr":"172.21.15.50:6815/33605","heartbeat_front_addr":"172.21.15.50:6813/33605","state":["exists","up"]},{"osd":5,"uuid":"726c3003-34e6-4d5a-b6e2-f911e13c2118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33606},{"type":"v1","addr":"172.21.15.50:6801","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33606},{"type":"v1","addr":"172.21.15.50:6803","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33606},{"type":"v1","addr":"172.21.15.50:6807","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":33606},{"type":"v1","addr":"172.21.15.50:6805","nonce":33606}]},"public_addr":"172.21.15.50:6801/33606","cluster_addr":"172.21.15.50:6803/33606","heartbeat_back_addr":"172.21.15.50:6807/33606","heartbeat_front_addr":"172.21.15.50:6805/33606","state":["exists","up"]},{"osd":6,"uuid":"401122a4-9988-441f-a5a7-39164434ebcd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":33607},{"type":"v1","addr":"172.21.15.50:6819","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":33607},{"type":"v1","addr":"172.21.15.50:6823","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":33607},{"type":"v1","addr":"172.21.15.50:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":33607},{"type":"v1","addr":"172.21.15.50:6827","nonce":33607}]},"public_addr":"172.21.15.50:6819/33607","cluster_addr":"172.21.15.50:6823/33607","heartbeat_back_addr":"172.21.15.50:6831/33607","heartbeat_front_addr":"172.21.15.50:6827/33607","state":["exists","up"]},{"osd":7,"uuid":"6b3fa236-c9d0-4c4d-82ae-9af4daf6d699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33604},{"type":"v1","addr":"172.21.15.50:6818","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":33604},{"type":"v1","addr":"172.21.15.50:6822","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":33604},{"type":"v1","addr":"172.21.15.50:6830","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":33604},{"type":"v1","addr":"172.21.15.50:6826","nonce":33604}]},"public_addr":"172.21.15.50:6818/33604","cluster_addr":"172.21.15.50:6822/33604","heartbeat_back_addr":"172.21.15.50:6830/33604","heartbeat_front_addr":"172.21.15.50:6826/33604","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.497794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.529417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.873426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.325972+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.443971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.240795+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.739632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.643026+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:41:10.123 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.118+0000 7f8819b02700 1 -- 172.21.15.3:0/85479494 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f87f4060550 msgr2=0x7f87f4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:10.124 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.118+0000 7f8819b02700 1 --2- 172.21.15.3:0/85479494 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f87f4060550 0x7f87f4062a00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8804007fd0 tx=0x7f8804016000 comp rx=0 tx=0).stop 2023-10-08T15:41:10.124 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.118+0000 7f8819b02700 1 -- 172.21.15.3:0/85479494 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f881414a030 msgr2=0x7f881415ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:10.124 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.118+0000 7f8819b02700 1 --2- 172.21.15.3:0/85479494 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f881414a030 0x7f881415ccf0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f880c007f20 tx=0x7f880c009860 comp rx=0 tx=0).stop 2023-10-08T15:41:10.124 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.118+0000 7f8819b02700 1 -- 172.21.15.3:0/85479494 shutdown_connections 2023-10-08T15:41:10.124 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.118+0000 7f8819b02700 1 --2- 172.21.15.3:0/85479494 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f87f4060550 0x7f87f4062a00 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:10.124 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.118+0000 7f8819b02700 1 --2- 172.21.15.3:0/85479494 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f881414a030 0x7f881415ccf0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:10.124 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.118+0000 7f8819b02700 1 --2- 172.21.15.3:0/85479494 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f88140badb0 0x7f881415c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:10.124 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.118+0000 7f8819b02700 1 --2- 172.21.15.3:0/85479494 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88140b43a0 0x7f88141461c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:10.124 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.118+0000 7f8819b02700 1 -- 172.21.15.3:0/85479494 >> 172.21.15.3:0/85479494 conn(0x7f88140be640 msgr2=0x7f881414a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:10.124 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.118+0000 7f8819b02700 1 -- 172.21.15.3:0/85479494 shutdown_connections 2023-10-08T15:41:10.125 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.118+0000 7f8819b02700 1 -- 172.21.15.3:0/85479494 wait complete. 2023-10-08T15:41:10.136 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T15:41:10.136 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T15:41:10.243 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.238+0000 7f1fa0343700 1 Processor -- start 2023-10-08T15:41:10.243 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.238+0000 7f1fa0343700 1 -- start start 2023-10-08T15:41:10.245 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.238+0000 7f1fa0343700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1f9806d080 0x7f1f98068ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:10.245 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.238+0000 7f1fa0343700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1f98153ad0 0x7f1f9814ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:10.245 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.238+0000 7f1fa0343700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f9809e490 con 0x7f1f980bafe0 2023-10-08T15:41:10.245 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.238+0000 7f1fa0343700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f9806ce30 con 0x7f1f98153ad0 2023-10-08T15:41:10.245 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.238+0000 7f1fa0343700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9809e6e0 con 0x7f1f9806d080 2023-10-08T15:41:10.246 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.238+0000 7f1f9e0df700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f1f980bafe0 0x7f1f981533c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:50718/0 (socket says 172.21.15.3:50718) 2023-10-08T15:41:10.246 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.238+0000 7f1f9e0df700 1 -- 172.21.15.3:0/289237217 learned_addr learned my addr 172.21.15.3:0/289237217 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:41:10.246 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.238+0000 7f1f9d8de700 1 --2- 172.21.15.3:0/289237217 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1f9806d080 0x7f1f98068ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:10.246 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.238+0000 7f1f9e8e0700 1 --2- 172.21.15.3:0/289237217 >> v2:172.21.15.50:3300/0 conn(0x7f1f98153ad0 0x7f1f9814ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:10.246 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.238+0000 7f1f9d0dd700 1 -- 172.21.15.3:0/289237217 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 516115644 0 0) 0x7f1f9809e490 con 0x7f1f980bafe0 2023-10-08T15:41:10.246 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.238+0000 7f1f9d0dd700 1 -- 172.21.15.3:0/289237217 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f84003570 con 0x7f1f980bafe0 2023-10-08T15:41:10.246 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.238+0000 7f1f9d8de700 1 -- 172.21.15.3:0/289237217 >> v2:172.21.15.50:3300/0 conn(0x7f1f98153ad0 msgr2=0x7f1f9814ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:10.246 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.238+0000 7f1f9d8de700 1 --2- 172.21.15.3:0/289237217 >> v2:172.21.15.50:3300/0 conn(0x7f1f98153ad0 0x7f1f9814ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:10.246 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.238+0000 7f1f9d8de700 1 -- 172.21.15.3:0/289237217 >> v1:172.21.15.3:6789/0 conn(0x7f1f980bafe0 legacy=0x7f1f981533c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:10.246 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.238+0000 7f1f9d8de700 1 -- 172.21.15.3:0/289237217 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f98153f70 con 0x7f1f9806d080 2023-10-08T15:41:10.247 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.238+0000 7f1f9e8e0700 1 --2- 172.21.15.3:0/289237217 >> v2:172.21.15.50:3300/0 conn(0x7f1f98153ad0 0x7f1f9814ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:10.247 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.242+0000 7f1f9d8de700 1 --2- 172.21.15.3:0/289237217 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1f9806d080 0x7f1f98068ab0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1f880098e0 tx=0x7f1f880091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=503d49b88e7211bc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:10.248 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.242+0000 7f1f9d0dd700 1 -- 172.21.15.3:0/289237217 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8800b640 con 0x7f1f9806d080 2023-10-08T15:41:10.248 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.242+0000 7f1f9d0dd700 1 -- 172.21.15.3:0/289237217 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f8800b7a0 con 0x7f1f9806d080 2023-10-08T15:41:10.248 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.242+0000 7f1f9d0dd700 1 -- 172.21.15.3:0/289237217 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8800bb20 con 0x7f1f9806d080 2023-10-08T15:41:10.248 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.242+0000 7f1fa0343700 1 -- 172.21.15.3:0/289237217 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1f9806d080 msgr2=0x7f1f98068ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:10.248 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.242+0000 7f1fa0343700 1 --2- 172.21.15.3:0/289237217 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1f9806d080 0x7f1f98068ab0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1f880098e0 tx=0x7f1f880091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:10.248 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.242+0000 7f1fa0343700 1 -- 172.21.15.3:0/289237217 shutdown_connections 2023-10-08T15:41:10.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.242+0000 7f1fa0343700 1 --2- 172.21.15.3:0/289237217 >> v2:172.21.15.50:3300/0 conn(0x7f1f98153ad0 0x7f1f9814ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:10.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.242+0000 7f1fa0343700 1 --2- 172.21.15.3:0/289237217 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1f9806d080 0x7f1f98068ab0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:10.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.242+0000 7f1fa0343700 1 -- 172.21.15.3:0/289237217 >> 172.21.15.3:0/289237217 conn(0x7f1f980be640 msgr2=0x7f1f980ba6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:10.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.242+0000 7f1fa0343700 1 -- 172.21.15.3:0/289237217 shutdown_connections 2023-10-08T15:41:10.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.242+0000 7f1fa0343700 1 -- 172.21.15.3:0/289237217 wait complete. 2023-10-08T15:41:10.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.242+0000 7f1fa0343700 1 Processor -- start 2023-10-08T15:41:10.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.242+0000 7f1fa0343700 1 -- start start 2023-10-08T15:41:10.251 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.242+0000 7f1fa0343700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f9806d080 0x7f1f980680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:10.251 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.242+0000 7f1fa0343700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1f980bafe0 0x7f1f9815fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:10.251 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.242+0000 7f1fa0343700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1f98153ad0 0x7f1f9815e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:10.251 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.242+0000 7f1fa0343700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f98162c40 con 0x7f1f98153ad0 2023-10-08T15:41:10.251 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.242+0000 7f1fa0343700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9814a090 con 0x7f1f9806d080 2023-10-08T15:41:10.251 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.242+0000 7f1fa0343700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f981637b0 con 0x7f1f980bafe0 2023-10-08T15:41:10.251 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.242+0000 7f1f9e0df700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f9806d080 0x7f1f980680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:10.251 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.242+0000 7f1f9d8de700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1f980bafe0 0x7f1f9815fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:10.251 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.242+0000 7f1f9e0df700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f9806d080 0x7f1f980680b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.3:40868/0 (socket says 172.21.15.3:40868) 2023-10-08T15:41:10.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.242+0000 7f1f9e0df700 1 -- 172.21.15.3:0/3788275254 learned_addr learned my addr 172.21.15.3:0/3788275254 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:10.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.242+0000 7f1f9e8e0700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1f98153ad0 0x7f1f9815e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:10.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.246+0000 7f1f9d8de700 1 -- 172.21.15.3:0/3788275254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f9806d080 msgr2=0x7f1f980680b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:10.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.246+0000 7f1f9d8de700 1 --2- 172.21.15.3:0/3788275254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f9806d080 0x7f1f980680b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:10.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.246+0000 7f1f9d8de700 1 -- 172.21.15.3:0/3788275254 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1f98153ad0 msgr2=0x7f1f9815e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:10.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.246+0000 7f1f9d8de700 1 --2- 172.21.15.3:0/3788275254 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1f98153ad0 0x7f1f9815e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:10.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.246+0000 7f1f9d8de700 1 -- 172.21.15.3:0/3788275254 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f88009420 con 0x7f1f980bafe0 2023-10-08T15:41:10.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.246+0000 7f1f9d8de700 1 --2- 172.21.15.3:0/3788275254 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1f980bafe0 0x7f1f9815fce0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1f88016000 tx=0x7f1f88017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:10.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.246+0000 7f1f8e7fc700 1 -- 172.21.15.3:0/3788275254 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8800bb20 con 0x7f1f980bafe0 2023-10-08T15:41:10.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.246+0000 7f1f8e7fc700 1 -- 172.21.15.3:0/3788275254 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f8801be00 con 0x7f1f980bafe0 2023-10-08T15:41:10.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.246+0000 7f1fa0343700 1 -- 172.21.15.3:0/3788275254 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f9815f4e0 con 0x7f1f980bafe0 2023-10-08T15:41:10.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.246+0000 7f1f8e7fc700 1 -- 172.21.15.3:0/3788275254 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f88011690 con 0x7f1f980bafe0 2023-10-08T15:41:10.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.246+0000 7f1fa0343700 1 -- 172.21.15.3:0/3788275254 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f981628d0 con 0x7f1f980bafe0 2023-10-08T15:41:10.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.246+0000 7f1fa0343700 1 -- 172.21.15.3:0/3788275254 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f98064530 con 0x7f1f980bafe0 2023-10-08T15:41:10.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.246+0000 7f1f8e7fc700 1 -- 172.21.15.3:0/3788275254 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f1f88011a80 con 0x7f1f980bafe0 2023-10-08T15:41:10.254 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.250+0000 7f1f8e7fc700 1 --2- 172.21.15.3:0/3788275254 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1f7c060550 0x7f1f7c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:10.254 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.250+0000 7f1f8e7fc700 1 -- 172.21.15.3:0/3788275254 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1f8807dfe0 con 0x7f1f980bafe0 2023-10-08T15:41:10.254 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.250+0000 7f1f9e0df700 1 --2- 172.21.15.3:0/3788275254 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1f7c060550 0x7f1f7c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:10.255 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.250+0000 7f1f9e0df700 1 --2- 172.21.15.3:0/3788275254 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1f7c060550 0x7f1f7c062a00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1f90000f80 tx=0x7f1f90009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:10.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.258+0000 7f1f8e7fc700 1 -- 172.21.15.3:0/3788275254 <== mon.2 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1f8804e570 con 0x7f1f980bafe0 2023-10-08T15:41:10.421 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.414+0000 7f1fa0343700 1 -- 172.21.15.3:0/3788275254 --> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1f9809ea50 con 0x7f1f7c060550 2023-10-08T15:41:10.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.434+0000 7f1f8e7fc700 1 -- 172.21.15.3:0/3788275254 <== mgr.4102 v2:172.21.15.50:6832/33268 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287213 (secure 0 0 0) 0x7f1f9809ea50 con 0x7f1f7c060550 2023-10-08T15:41:10.443 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:41:10.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.438+0000 7f1fa0343700 1 -- 172.21.15.3:0/3788275254 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1f7c060550 msgr2=0x7f1f7c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:10.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.438+0000 7f1fa0343700 1 --2- 172.21.15.3:0/3788275254 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1f7c060550 0x7f1f7c062a00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1f90000f80 tx=0x7f1f90009040 comp rx=0 tx=0).stop 2023-10-08T15:41:10.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.438+0000 7f1fa0343700 1 -- 172.21.15.3:0/3788275254 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1f980bafe0 msgr2=0x7f1f9815fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:10.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.438+0000 7f1fa0343700 1 --2- 172.21.15.3:0/3788275254 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1f980bafe0 0x7f1f9815fce0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1f88016000 tx=0x7f1f88017000 comp rx=0 tx=0).stop 2023-10-08T15:41:10.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.438+0000 7f1fa0343700 1 -- 172.21.15.3:0/3788275254 shutdown_connections 2023-10-08T15:41:10.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.438+0000 7f1fa0343700 1 --2- 172.21.15.3:0/3788275254 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1f7c060550 0x7f1f7c062a00 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:10.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.438+0000 7f1fa0343700 1 --2- 172.21.15.3:0/3788275254 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1f98153ad0 0x7f1f9815e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:10.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.438+0000 7f1fa0343700 1 --2- 172.21.15.3:0/3788275254 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1f980bafe0 0x7f1f9815fce0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:10.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.438+0000 7f1fa0343700 1 --2- 172.21.15.3:0/3788275254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f9806d080 0x7f1f980680b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:10.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.438+0000 7f1fa0343700 1 -- 172.21.15.3:0/3788275254 >> 172.21.15.3:0/3788275254 conn(0x7f1f980be640 msgr2=0x7f1f9814ecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:10.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.438+0000 7f1fa0343700 1 -- 172.21.15.3:0/3788275254 shutdown_connections 2023-10-08T15:41:10.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.438+0000 7f1fa0343700 1 -- 172.21.15.3:0/3788275254 wait complete. 2023-10-08T15:41:10.447 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2023-10-08T15:41:10.460 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":158,"stamp":"2023-10-08T15:41:08.594229+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":126,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2448540,"kb_used_data":4700,"kb_used_omap":0,"kb_used_meta":2443776,"kb_avail":752526180,"statfs":{"total":773094113280,"available":770586808320,"internally_reserved":0,"allocated":4812800,"data_stored":3076788,"data_compressed":66282,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":2502426624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.199693"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.455593+0000","last_change":"2023-10-08T15:41:06.452152+0000","last_active":"2023-10-08T15:41:06.455593+0000","last_peered":"2023-10-08T15:41:06.455593+0000","last_clean":"2023-10-08T15:41:06.455593+0000","last_became_active":"2023-10-08T15:41:06.451785+0000","last_became_peered":"2023-10-08T15:41:06.451785+0000","last_unstale":"2023-10-08T15:41:06.455593+0000","last_undegraded":"2023-10-08T15:41:06.455593+0000","last_fullsized":"2023-10-08T15:41:06.455593+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:04:06.979756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.464399+0000","last_change":"2023-10-08T15:41:06.457280+0000","last_active":"2023-10-08T15:41:06.464399+0000","last_peered":"2023-10-08T15:41:06.464399+0000","last_clean":"2023-10-08T15:41:06.464399+0000","last_became_active":"2023-10-08T15:41:06.455044+0000","last_became_peered":"2023-10-08T15:41:06.455044+0000","last_unstale":"2023-10-08T15:41:06.464399+0000","last_undegraded":"2023-10-08T15:41:06.464399+0000","last_fullsized":"2023-10-08T15:41:06.464399+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:38:53.950317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.450532+0000","last_change":"2023-10-08T15:41:06.443520+0000","last_active":"2023-10-08T15:41:06.450532+0000","last_peered":"2023-10-08T15:41:06.450532+0000","last_clean":"2023-10-08T15:41:06.450532+0000","last_became_active":"2023-10-08T15:41:06.442389+0000","last_became_peered":"2023-10-08T15:41:06.442389+0000","last_unstale":"2023-10-08T15:41:06.450532+0000","last_undegraded":"2023-10-08T15:41:06.450532+0000","last_fullsized":"2023-10-08T15:41:06.450532+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:10:44.771641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.448762+0000","last_change":"2023-10-08T15:41:06.448762+0000","last_active":"2023-10-08T15:41:06.448762+0000","last_peered":"2023-10-08T15:41:06.448762+0000","last_clean":"2023-10-08T15:41:06.448762+0000","last_became_active":"2023-10-08T15:41:06.448487+0000","last_became_peered":"2023-10-08T15:41:06.448487+0000","last_unstale":"2023-10-08T15:41:06.448762+0000","last_undegraded":"2023-10-08T15:41:06.448762+0000","last_fullsized":"2023-10-08T15:41:06.448762+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:37:41.814988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.447910+0000","last_change":"2023-10-08T15:41:06.442684+0000","last_active":"2023-10-08T15:41:06.447910+0000","last_peered":"2023-10-08T15:41:06.447910+0000","last_clean":"2023-10-08T15:41:06.447910+0000","last_became_active":"2023-10-08T15:41:06.442381+0000","last_became_peered":"2023-10-08T15:41:06.442381+0000","last_unstale":"2023-10-08T15:41:06.447910+0000","last_undegraded":"2023-10-08T15:41:06.447910+0000","last_fullsized":"2023-10-08T15:41:06.447910+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:03:31.710089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.459637+0000","last_change":"2023-10-08T15:41:06.446651+0000","last_active":"2023-10-08T15:41:06.459637+0000","last_peered":"2023-10-08T15:41:06.459637+0000","last_clean":"2023-10-08T15:41:06.459637+0000","last_became_active":"2023-10-08T15:41:06.446321+0000","last_became_peered":"2023-10-08T15:41:06.446321+0000","last_unstale":"2023-10-08T15:41:06.459637+0000","last_undegraded":"2023-10-08T15:41:06.459637+0000","last_fullsized":"2023-10-08T15:41:06.459637+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:58:39.797277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.445309+0000","last_change":"2023-10-08T15:41:06.445309+0000","last_active":"2023-10-08T15:41:06.445309+0000","last_peered":"2023-10-08T15:41:06.445309+0000","last_clean":"2023-10-08T15:41:06.445309+0000","last_became_active":"2023-10-08T15:41:06.444964+0000","last_became_peered":"2023-10-08T15:41:06.444964+0000","last_unstale":"2023-10-08T15:41:06.445309+0000","last_undegraded":"2023-10-08T15:41:06.445309+0000","last_fullsized":"2023-10-08T15:41:06.445309+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:32:43.679059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.464222+0000","last_change":"2023-10-08T15:41:06.454647+0000","last_active":"2023-10-08T15:41:06.464222+0000","last_peered":"2023-10-08T15:41:06.464222+0000","last_clean":"2023-10-08T15:41:06.464222+0000","last_became_active":"2023-10-08T15:41:06.454209+0000","last_became_peered":"2023-10-08T15:41:06.454209+0000","last_unstale":"2023-10-08T15:41:06.464222+0000","last_undegraded":"2023-10-08T15:41:06.464222+0000","last_fullsized":"2023-10-08T15:41:06.464222+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:16:39.321609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.444409+0000","last_change":"2023-10-08T15:41:06.444409+0000","last_active":"2023-10-08T15:41:06.444409+0000","last_peered":"2023-10-08T15:41:06.444409+0000","last_clean":"2023-10-08T15:41:06.444409+0000","last_became_active":"2023-10-08T15:41:06.444117+0000","last_became_peered":"2023-10-08T15:41:06.444117+0000","last_unstale":"2023-10-08T15:41:06.444409+0000","last_undegraded":"2023-10-08T15:41:06.444409+0000","last_fullsized":"2023-10-08T15:41:06.444409+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:18:23.055593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.453199+0000","last_change":"2023-10-08T15:41:06.435988+0000","last_active":"2023-10-08T15:41:06.453199+0000","last_peered":"2023-10-08T15:41:06.453199+0000","last_clean":"2023-10-08T15:41:06.453199+0000","last_became_active":"2023-10-08T15:41:06.435695+0000","last_became_peered":"2023-10-08T15:41:06.435695+0000","last_unstale":"2023-10-08T15:41:06.453199+0000","last_undegraded":"2023-10-08T15:41:06.453199+0000","last_fullsized":"2023-10-08T15:41:06.453199+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:37:38.169465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.462549+0000","last_change":"2023-10-08T15:41:06.455447+0000","last_active":"2023-10-08T15:41:06.462549+0000","last_peered":"2023-10-08T15:41:06.462549+0000","last_clean":"2023-10-08T15:41:06.462549+0000","last_became_active":"2023-10-08T15:41:06.455168+0000","last_became_peered":"2023-10-08T15:41:06.455168+0000","last_unstale":"2023-10-08T15:41:06.462549+0000","last_undegraded":"2023-10-08T15:41:06.462549+0000","last_fullsized":"2023-10-08T15:41:06.462549+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:43:12.044091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.447678+0000","last_change":"2023-10-08T15:41:06.447678+0000","last_active":"2023-10-08T15:41:06.447678+0000","last_peered":"2023-10-08T15:41:06.447678+0000","last_clean":"2023-10-08T15:41:06.447678+0000","last_became_active":"2023-10-08T15:41:06.447357+0000","last_became_peered":"2023-10-08T15:41:06.447357+0000","last_unstale":"2023-10-08T15:41:06.447678+0000","last_undegraded":"2023-10-08T15:41:06.447678+0000","last_fullsized":"2023-10-08T15:41:06.447678+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:55:57.583824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.449413+0000","last_change":"2023-10-08T15:41:06.443783+0000","last_active":"2023-10-08T15:41:06.449413+0000","last_peered":"2023-10-08T15:41:06.449413+0000","last_clean":"2023-10-08T15:41:06.449413+0000","last_became_active":"2023-10-08T15:41:06.443454+0000","last_became_peered":"2023-10-08T15:41:06.443454+0000","last_unstale":"2023-10-08T15:41:06.449413+0000","last_undegraded":"2023-10-08T15:41:06.449413+0000","last_fullsized":"2023-10-08T15:41:06.449413+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:51:44.543938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.433492+0000","last_change":"2023-10-08T15:41:06.433492+0000","last_active":"2023-10-08T15:41:06.433492+0000","last_peered":"2023-10-08T15:41:06.433492+0000","last_clean":"2023-10-08T15:41:06.433492+0000","last_became_active":"2023-10-08T15:41:06.433102+0000","last_became_peered":"2023-10-08T15:41:06.433102+0000","last_unstale":"2023-10-08T15:41:06.433492+0000","last_undegraded":"2023-10-08T15:41:06.433492+0000","last_fullsized":"2023-10-08T15:41:06.433492+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:06:52.575822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.434516+0000","last_change":"2023-10-08T15:41:06.434516+0000","last_active":"2023-10-08T15:41:06.434516+0000","last_peered":"2023-10-08T15:41:06.434516+0000","last_clean":"2023-10-08T15:41:06.434516+0000","last_became_active":"2023-10-08T15:41:06.432695+0000","last_became_peered":"2023-10-08T15:41:06.432695+0000","last_unstale":"2023-10-08T15:41:06.434516+0000","last_undegraded":"2023-10-08T15:41:06.434516+0000","last_fullsized":"2023-10-08T15:41:06.434516+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:18:50.762021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.462088+0000","last_change":"2023-10-08T15:41:06.458828+0000","last_active":"2023-10-08T15:41:06.462088+0000","last_peered":"2023-10-08T15:41:06.462088+0000","last_clean":"2023-10-08T15:41:06.462088+0000","last_became_active":"2023-10-08T15:41:06.458472+0000","last_became_peered":"2023-10-08T15:41:06.458472+0000","last_unstale":"2023-10-08T15:41:06.462088+0000","last_undegraded":"2023-10-08T15:41:06.462088+0000","last_fullsized":"2023-10-08T15:41:06.462088+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:10:13.012202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.459445+0000","last_change":"2023-10-08T15:41:06.451302+0000","last_active":"2023-10-08T15:41:06.459445+0000","last_peered":"2023-10-08T15:41:06.459445+0000","last_clean":"2023-10-08T15:41:06.459445+0000","last_became_active":"2023-10-08T15:41:06.450346+0000","last_became_peered":"2023-10-08T15:41:06.450346+0000","last_unstale":"2023-10-08T15:41:06.459445+0000","last_undegraded":"2023-10-08T15:41:06.459445+0000","last_fullsized":"2023-10-08T15:41:06.459445+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:46:14.988801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.450716+0000","last_change":"2023-10-08T15:41:06.444104+0000","last_active":"2023-10-08T15:41:06.450716+0000","last_peered":"2023-10-08T15:41:06.450716+0000","last_clean":"2023-10-08T15:41:06.450716+0000","last_became_active":"2023-10-08T15:41:06.443784+0000","last_became_peered":"2023-10-08T15:41:06.443784+0000","last_unstale":"2023-10-08T15:41:06.450716+0000","last_undegraded":"2023-10-08T15:41:06.450716+0000","last_fullsized":"2023-10-08T15:41:06.450716+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:05:50.711417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.462138+0000","last_change":"2023-10-08T15:41:06.459029+0000","last_active":"2023-10-08T15:41:06.462138+0000","last_peered":"2023-10-08T15:41:06.462138+0000","last_clean":"2023-10-08T15:41:06.462138+0000","last_became_active":"2023-10-08T15:41:06.458725+0000","last_became_peered":"2023-10-08T15:41:06.458725+0000","last_unstale":"2023-10-08T15:41:06.462138+0000","last_undegraded":"2023-10-08T15:41:06.462138+0000","last_fullsized":"2023-10-08T15:41:06.462138+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:14:52.209223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.459529+0000","last_change":"2023-10-08T15:41:06.450372+0000","last_active":"2023-10-08T15:41:06.459529+0000","last_peered":"2023-10-08T15:41:06.459529+0000","last_clean":"2023-10-08T15:41:06.459529+0000","last_became_active":"2023-10-08T15:41:06.450063+0000","last_became_peered":"2023-10-08T15:41:06.450063+0000","last_unstale":"2023-10-08T15:41:06.459529+0000","last_undegraded":"2023-10-08T15:41:06.459529+0000","last_fullsized":"2023-10-08T15:41:06.459529+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:34:29.694180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.452028+0000","last_change":"2023-10-08T15:41:06.446624+0000","last_active":"2023-10-08T15:41:06.452028+0000","last_peered":"2023-10-08T15:41:06.452028+0000","last_clean":"2023-10-08T15:41:06.452028+0000","last_became_active":"2023-10-08T15:41:06.446298+0000","last_became_peered":"2023-10-08T15:41:06.446298+0000","last_unstale":"2023-10-08T15:41:06.452028+0000","last_undegraded":"2023-10-08T15:41:06.452028+0000","last_fullsized":"2023-10-08T15:41:06.452028+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:44:38.503380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.460491+0000","last_change":"2023-10-08T15:41:06.451294+0000","last_active":"2023-10-08T15:41:06.460491+0000","last_peered":"2023-10-08T15:41:06.460491+0000","last_clean":"2023-10-08T15:41:06.460491+0000","last_became_active":"2023-10-08T15:41:06.448302+0000","last_became_peered":"2023-10-08T15:41:06.448302+0000","last_unstale":"2023-10-08T15:41:06.460491+0000","last_undegraded":"2023-10-08T15:41:06.460491+0000","last_fullsized":"2023-10-08T15:41:06.460491+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:37:53.277090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.460226+0000","last_change":"2023-10-08T15:41:06.454128+0000","last_active":"2023-10-08T15:41:06.460226+0000","last_peered":"2023-10-08T15:41:06.460226+0000","last_clean":"2023-10-08T15:41:06.460226+0000","last_became_active":"2023-10-08T15:41:06.453249+0000","last_became_peered":"2023-10-08T15:41:06.453249+0000","last_unstale":"2023-10-08T15:41:06.460226+0000","last_undegraded":"2023-10-08T15:41:06.460226+0000","last_fullsized":"2023-10-08T15:41:06.460226+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:54:45.803734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.450069+0000","last_change":"2023-10-08T15:41:06.447102+0000","last_active":"2023-10-08T15:41:06.450069+0000","last_peered":"2023-10-08T15:41:06.450069+0000","last_clean":"2023-10-08T15:41:06.450069+0000","last_became_active":"2023-10-08T15:41:06.446781+0000","last_became_peered":"2023-10-08T15:41:06.446781+0000","last_unstale":"2023-10-08T15:41:06.450069+0000","last_undegraded":"2023-10-08T15:41:06.450069+0000","last_fullsized":"2023-10-08T15:41:06.450069+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:30:43.795702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.455674+0000","last_change":"2023-10-08T15:41:06.453817+0000","last_active":"2023-10-08T15:41:06.455674+0000","last_peered":"2023-10-08T15:41:06.455674+0000","last_clean":"2023-10-08T15:41:06.455674+0000","last_became_active":"2023-10-08T15:41:06.453527+0000","last_became_peered":"2023-10-08T15:41:06.453527+0000","last_unstale":"2023-10-08T15:41:06.455674+0000","last_undegraded":"2023-10-08T15:41:06.455674+0000","last_fullsized":"2023-10-08T15:41:06.455674+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:44:11.863677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.455775+0000","last_change":"2023-10-08T15:41:06.455775+0000","last_active":"2023-10-08T15:41:06.455775+0000","last_peered":"2023-10-08T15:41:06.455775+0000","last_clean":"2023-10-08T15:41:06.455775+0000","last_became_active":"2023-10-08T15:41:06.455475+0000","last_became_peered":"2023-10-08T15:41:06.455475+0000","last_unstale":"2023-10-08T15:41:06.455775+0000","last_undegraded":"2023-10-08T15:41:06.455775+0000","last_fullsized":"2023-10-08T15:41:06.455775+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:18:23.055593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.447252+0000","last_change":"2023-10-08T15:41:06.442056+0000","last_active":"2023-10-08T15:41:06.447252+0000","last_peered":"2023-10-08T15:41:06.447252+0000","last_clean":"2023-10-08T15:41:06.447252+0000","last_became_active":"2023-10-08T15:41:06.441700+0000","last_became_peered":"2023-10-08T15:41:06.441700+0000","last_unstale":"2023-10-08T15:41:06.447252+0000","last_undegraded":"2023-10-08T15:41:06.447252+0000","last_fullsized":"2023-10-08T15:41:06.447252+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:14:36.594450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.447823+0000","last_change":"2023-10-08T15:41:06.442640+0000","last_active":"2023-10-08T15:41:06.447823+0000","last_peered":"2023-10-08T15:41:06.447823+0000","last_clean":"2023-10-08T15:41:06.447823+0000","last_became_active":"2023-10-08T15:41:06.442333+0000","last_became_peered":"2023-10-08T15:41:06.442333+0000","last_unstale":"2023-10-08T15:41:06.447823+0000","last_undegraded":"2023-10-08T15:41:06.447823+0000","last_fullsized":"2023-10-08T15:41:06.447823+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:58:34.489879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.459670+0000","last_change":"2023-10-08T15:41:06.449953+0000","last_active":"2023-10-08T15:41:06.459670+0000","last_peered":"2023-10-08T15:41:06.459670+0000","last_clean":"2023-10-08T15:41:06.459670+0000","last_became_active":"2023-10-08T15:41:06.448212+0000","last_became_peered":"2023-10-08T15:41:06.448212+0000","last_unstale":"2023-10-08T15:41:06.459670+0000","last_undegraded":"2023-10-08T15:41:06.459670+0000","last_fullsized":"2023-10-08T15:41:06.459670+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:40:53.711246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.445718+0000","last_change":"2023-10-08T15:41:06.436453+0000","last_active":"2023-10-08T15:41:06.445718+0000","last_peered":"2023-10-08T15:41:06.445718+0000","last_clean":"2023-10-08T15:41:06.445718+0000","last_became_active":"2023-10-08T15:41:06.436146+0000","last_became_peered":"2023-10-08T15:41:06.436146+0000","last_unstale":"2023-10-08T15:41:06.445718+0000","last_undegraded":"2023-10-08T15:41:06.445718+0000","last_fullsized":"2023-10-08T15:41:06.445718+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:13:18.443325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.439341+0000","last_change":"2023-10-08T15:41:06.436659+0000","last_active":"2023-10-08T15:41:06.439341+0000","last_peered":"2023-10-08T15:41:06.439341+0000","last_clean":"2023-10-08T15:41:06.439341+0000","last_became_active":"2023-10-08T15:41:06.436302+0000","last_became_peered":"2023-10-08T15:41:06.436302+0000","last_unstale":"2023-10-08T15:41:06.439341+0000","last_undegraded":"2023-10-08T15:41:06.439341+0000","last_fullsized":"2023-10-08T15:41:06.439341+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:34:33.661006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.462907+0000","last_change":"2023-10-08T15:41:06.461979+0000","last_active":"2023-10-08T15:41:06.462907+0000","last_peered":"2023-10-08T15:41:06.462907+0000","last_clean":"2023-10-08T15:41:06.462907+0000","last_became_active":"2023-10-08T15:41:06.461671+0000","last_became_peered":"2023-10-08T15:41:06.461671+0000","last_unstale":"2023-10-08T15:41:06.462907+0000","last_undegraded":"2023-10-08T15:41:06.462907+0000","last_fullsized":"2023-10-08T15:41:06.462907+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:59:43.421345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.461837+0000","last_change":"2023-10-08T15:41:06.450847+0000","last_active":"2023-10-08T15:41:06.461837+0000","last_peered":"2023-10-08T15:41:06.461837+0000","last_clean":"2023-10-08T15:41:06.461837+0000","last_became_active":"2023-10-08T15:41:06.450555+0000","last_became_peered":"2023-10-08T15:41:06.450555+0000","last_unstale":"2023-10-08T15:41:06.461837+0000","last_undegraded":"2023-10-08T15:41:06.461837+0000","last_fullsized":"2023-10-08T15:41:06.461837+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:40:15.011431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"48'4","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.463317+0000","last_change":"2023-10-08T15:41:05.428296+0000","last_active":"2023-10-08T15:41:06.463317+0000","last_peered":"2023-10-08T15:41:06.463317+0000","last_clean":"2023-10-08T15:41:06.463317+0000","last_became_active":"2023-10-08T15:41:05.426678+0000","last_became_peered":"2023-10-08T15:41:05.426678+0000","last_unstale":"2023-10-08T15:41:06.463317+0000","last_undegraded":"2023-10-08T15:41:06.463317+0000","last_fullsized":"2023-10-08T15:41:06.463317+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:46:31.857032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.453113+0000","last_change":"2023-10-08T15:41:06.435148+0000","last_active":"2023-10-08T15:41:06.453113+0000","last_peered":"2023-10-08T15:41:06.453113+0000","last_clean":"2023-10-08T15:41:06.453113+0000","last_became_active":"2023-10-08T15:41:06.434876+0000","last_became_peered":"2023-10-08T15:41:06.434876+0000","last_unstale":"2023-10-08T15:41:06.453113+0000","last_undegraded":"2023-10-08T15:41:06.453113+0000","last_fullsized":"2023-10-08T15:41:06.453113+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:45:38.568668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"48'1","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.465344+0000","last_change":"2023-10-08T15:41:05.416181+0000","last_active":"2023-10-08T15:41:06.465344+0000","last_peered":"2023-10-08T15:41:06.465344+0000","last_clean":"2023-10-08T15:41:06.465344+0000","last_became_active":"2023-10-08T15:41:05.415904+0000","last_became_peered":"2023-10-08T15:41:05.415904+0000","last_unstale":"2023-10-08T15:41:06.465344+0000","last_undegraded":"2023-10-08T15:41:06.465344+0000","last_fullsized":"2023-10-08T15:41:06.465344+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:55:56.572447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.462173+0000","last_change":"2023-10-08T15:41:06.461407+0000","last_active":"2023-10-08T15:41:06.462173+0000","last_peered":"2023-10-08T15:41:06.462173+0000","last_clean":"2023-10-08T15:41:06.462173+0000","last_became_active":"2023-10-08T15:41:06.461035+0000","last_became_peered":"2023-10-08T15:41:06.461035+0000","last_unstale":"2023-10-08T15:41:06.462173+0000","last_undegraded":"2023-10-08T15:41:06.462173+0000","last_fullsized":"2023-10-08T15:41:06.462173+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:20:28.396241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"48'2","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.460833+0000","last_change":"2023-10-08T15:41:05.425911+0000","last_active":"2023-10-08T15:41:06.460833+0000","last_peered":"2023-10-08T15:41:06.460833+0000","last_clean":"2023-10-08T15:41:06.460833+0000","last_became_active":"2023-10-08T15:41:05.425627+0000","last_became_peered":"2023-10-08T15:41:05.425627+0000","last_unstale":"2023-10-08T15:41:06.460833+0000","last_undegraded":"2023-10-08T15:41:06.460833+0000","last_fullsized":"2023-10-08T15:41:06.460833+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:15:45.526358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.447265+0000","last_change":"2023-10-08T15:41:06.442625+0000","last_active":"2023-10-08T15:41:06.447265+0000","last_peered":"2023-10-08T15:41:06.447265+0000","last_clean":"2023-10-08T15:41:06.447265+0000","last_became_active":"2023-10-08T15:41:06.442334+0000","last_became_peered":"2023-10-08T15:41:06.442334+0000","last_unstale":"2023-10-08T15:41:06.447265+0000","last_undegraded":"2023-10-08T15:41:06.447265+0000","last_fullsized":"2023-10-08T15:41:06.447265+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:59:37.982152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"48'2","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.463119+0000","last_change":"2023-10-08T15:41:05.424562+0000","last_active":"2023-10-08T15:41:06.463119+0000","last_peered":"2023-10-08T15:41:06.463119+0000","last_clean":"2023-10-08T15:41:06.463119+0000","last_became_active":"2023-10-08T15:41:05.424008+0000","last_became_peered":"2023-10-08T15:41:05.424008+0000","last_unstale":"2023-10-08T15:41:06.463119+0000","last_undegraded":"2023-10-08T15:41:06.463119+0000","last_fullsized":"2023-10-08T15:41:06.463119+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:01:52.196763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.459946+0000","last_change":"2023-10-08T15:41:06.450822+0000","last_active":"2023-10-08T15:41:06.459946+0000","last_peered":"2023-10-08T15:41:06.459946+0000","last_clean":"2023-10-08T15:41:06.459946+0000","last_became_active":"2023-10-08T15:41:06.448321+0000","last_became_peered":"2023-10-08T15:41:06.448321+0000","last_unstale":"2023-10-08T15:41:06.459946+0000","last_undegraded":"2023-10-08T15:41:06.459946+0000","last_fullsized":"2023-10-08T15:41:06.459946+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:43:18.728915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"48'1","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.426166+0000","last_change":"2023-10-08T15:41:05.422081+0000","last_active":"2023-10-08T15:41:06.426166+0000","last_peered":"2023-10-08T15:41:06.426166+0000","last_clean":"2023-10-08T15:41:06.426166+0000","last_became_active":"2023-10-08T15:41:05.421531+0000","last_became_peered":"2023-10-08T15:41:05.421531+0000","last_unstale":"2023-10-08T15:41:06.426166+0000","last_undegraded":"2023-10-08T15:41:06.426166+0000","last_fullsized":"2023-10-08T15:41:06.426166+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:30:08.152470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.458278+0000","last_change":"2023-10-08T15:41:06.449188+0000","last_active":"2023-10-08T15:41:06.458278+0000","last_peered":"2023-10-08T15:41:06.458278+0000","last_clean":"2023-10-08T15:41:06.458278+0000","last_became_active":"2023-10-08T15:41:06.448844+0000","last_became_peered":"2023-10-08T15:41:06.448844+0000","last_unstale":"2023-10-08T15:41:06.458278+0000","last_undegraded":"2023-10-08T15:41:06.458278+0000","last_fullsized":"2023-10-08T15:41:06.458278+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:09:05.913988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"48'1","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.460760+0000","last_change":"2023-10-08T15:41:05.422608+0000","last_active":"2023-10-08T15:41:06.460760+0000","last_peered":"2023-10-08T15:41:06.460760+0000","last_clean":"2023-10-08T15:41:06.460760+0000","last_became_active":"2023-10-08T15:41:05.422267+0000","last_became_peered":"2023-10-08T15:41:05.422267+0000","last_unstale":"2023-10-08T15:41:06.460760+0000","last_undegraded":"2023-10-08T15:41:06.460760+0000","last_fullsized":"2023-10-08T15:41:06.460760+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:39:04.618463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.450087+0000","last_change":"2023-10-08T15:41:06.447420+0000","last_active":"2023-10-08T15:41:06.450087+0000","last_peered":"2023-10-08T15:41:06.450087+0000","last_clean":"2023-10-08T15:41:06.450087+0000","last_became_active":"2023-10-08T15:41:06.447042+0000","last_became_peered":"2023-10-08T15:41:06.447042+0000","last_unstale":"2023-10-08T15:41:06.450087+0000","last_undegraded":"2023-10-08T15:41:06.450087+0000","last_fullsized":"2023-10-08T15:41:06.450087+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:43:23.999134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-08T15:41:05.429193+0000","last_change":"2023-10-08T15:41:05.427475+0000","last_active":"2023-10-08T15:41:05.429193+0000","last_peered":"2023-10-08T15:41:05.429193+0000","last_clean":"2023-10-08T15:41:05.429193+0000","last_became_active":"2023-10-08T15:41:05.427144+0000","last_became_peered":"2023-10-08T15:41:05.427144+0000","last_unstale":"2023-10-08T15:41:05.429193+0000","last_undegraded":"2023-10-08T15:41:05.429193+0000","last_fullsized":"2023-10-08T15:41:05.429193+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:25:04.072117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.460019+0000","last_change":"2023-10-08T15:41:06.450640+0000","last_active":"2023-10-08T15:41:06.460019+0000","last_peered":"2023-10-08T15:41:06.460019+0000","last_clean":"2023-10-08T15:41:06.460019+0000","last_became_active":"2023-10-08T15:41:06.450244+0000","last_became_peered":"2023-10-08T15:41:06.450244+0000","last_unstale":"2023-10-08T15:41:06.460019+0000","last_undegraded":"2023-10-08T15:41:06.460019+0000","last_fullsized":"2023-10-08T15:41:06.460019+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:48:41.755229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-08T15:41:05.420928+0000","last_change":"2023-10-08T15:41:05.418924+0000","last_active":"2023-10-08T15:41:05.420928+0000","last_peered":"2023-10-08T15:41:05.420928+0000","last_clean":"2023-10-08T15:41:05.420928+0000","last_became_active":"2023-10-08T15:41:05.418560+0000","last_became_peered":"2023-10-08T15:41:05.418560+0000","last_unstale":"2023-10-08T15:41:05.420928+0000","last_undegraded":"2023-10-08T15:41:05.420928+0000","last_fullsized":"2023-10-08T15:41:05.420928+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:01:52.196763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.433108+0000","last_change":"2023-10-08T15:41:06.433108+0000","last_active":"2023-10-08T15:41:06.433108+0000","last_peered":"2023-10-08T15:41:06.433108+0000","last_clean":"2023-10-08T15:41:06.433108+0000","last_became_active":"2023-10-08T15:41:06.432691+0000","last_became_peered":"2023-10-08T15:41:06.432691+0000","last_unstale":"2023-10-08T15:41:06.433108+0000","last_undegraded":"2023-10-08T15:41:06.433108+0000","last_fullsized":"2023-10-08T15:41:06.433108+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:19:51.870053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.433533+0000","last_change":"2023-10-08T15:41:05.432438+0000","last_active":"2023-10-08T15:41:06.433533+0000","last_peered":"2023-10-08T15:41:06.433533+0000","last_clean":"2023-10-08T15:41:06.433533+0000","last_became_active":"2023-10-08T15:41:05.432093+0000","last_became_peered":"2023-10-08T15:41:05.432093+0000","last_unstale":"2023-10-08T15:41:06.433533+0000","last_undegraded":"2023-10-08T15:41:06.433533+0000","last_fullsized":"2023-10-08T15:41:06.433533+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:08:39.146318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.450448+0000","last_change":"2023-10-08T15:41:06.442416+0000","last_active":"2023-10-08T15:41:06.450448+0000","last_peered":"2023-10-08T15:41:06.450448+0000","last_clean":"2023-10-08T15:41:06.450448+0000","last_became_active":"2023-10-08T15:41:06.442010+0000","last_became_peered":"2023-10-08T15:41:06.442010+0000","last_unstale":"2023-10-08T15:41:06.450448+0000","last_undegraded":"2023-10-08T15:41:06.450448+0000","last_fullsized":"2023-10-08T15:41:06.450448+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:08:36.921466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.437836+0000","last_change":"2023-10-08T15:41:05.424925+0000","last_active":"2023-10-08T15:41:06.437836+0000","last_peered":"2023-10-08T15:41:06.437836+0000","last_clean":"2023-10-08T15:41:06.437836+0000","last_became_active":"2023-10-08T15:41:05.424603+0000","last_became_peered":"2023-10-08T15:41:05.424603+0000","last_unstale":"2023-10-08T15:41:06.437836+0000","last_undegraded":"2023-10-08T15:41:06.437836+0000","last_fullsized":"2023-10-08T15:41:06.437836+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:20:27.384865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.440106+0000","last_change":"2023-10-08T15:41:06.433500+0000","last_active":"2023-10-08T15:41:06.440106+0000","last_peered":"2023-10-08T15:41:06.440106+0000","last_clean":"2023-10-08T15:41:06.440106+0000","last_became_active":"2023-10-08T15:41:06.433082+0000","last_became_peered":"2023-10-08T15:41:06.433082+0000","last_unstale":"2023-10-08T15:41:06.440106+0000","last_undegraded":"2023-10-08T15:41:06.440106+0000","last_fullsized":"2023-10-08T15:41:06.440106+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:24.987918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"48'3","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.464247+0000","last_change":"2023-10-08T15:41:05.425052+0000","last_active":"2023-10-08T15:41:06.464247+0000","last_peered":"2023-10-08T15:41:06.464247+0000","last_clean":"2023-10-08T15:41:06.464247+0000","last_became_active":"2023-10-08T15:41:05.424615+0000","last_became_peered":"2023-10-08T15:41:05.424615+0000","last_unstale":"2023-10-08T15:41:06.464247+0000","last_undegraded":"2023-10-08T15:41:06.464247+0000","last_fullsized":"2023-10-08T15:41:06.464247+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:23.976541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.450570+0000","last_change":"2023-10-08T15:41:06.444134+0000","last_active":"2023-10-08T15:41:06.450570+0000","last_peered":"2023-10-08T15:41:06.450570+0000","last_clean":"2023-10-08T15:41:06.450570+0000","last_became_active":"2023-10-08T15:41:06.442788+0000","last_became_peered":"2023-10-08T15:41:06.442788+0000","last_unstale":"2023-10-08T15:41:06.450570+0000","last_undegraded":"2023-10-08T15:41:06.450570+0000","last_fullsized":"2023-10-08T15:41:06.450570+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:10:59.834960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"48'6","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.463676+0000","last_change":"2023-10-08T15:41:05.427226+0000","last_active":"2023-10-08T15:41:06.463676+0000","last_peered":"2023-10-08T15:41:06.463676+0000","last_clean":"2023-10-08T15:41:06.463676+0000","last_became_active":"2023-10-08T15:41:05.426875+0000","last_became_peered":"2023-10-08T15:41:05.426875+0000","last_unstale":"2023-10-08T15:41:06.463676+0000","last_undegraded":"2023-10-08T15:41:06.463676+0000","last_fullsized":"2023-10-08T15:41:06.463676+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:34:57.157992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.459755+0000","last_change":"2023-10-08T15:41:06.459755+0000","last_active":"2023-10-08T15:41:06.459755+0000","last_peered":"2023-10-08T15:41:06.459755+0000","last_clean":"2023-10-08T15:41:06.459755+0000","last_became_active":"2023-10-08T15:41:06.459452+0000","last_became_peered":"2023-10-08T15:41:06.459452+0000","last_unstale":"2023-10-08T15:41:06.459755+0000","last_undegraded":"2023-10-08T15:41:06.459755+0000","last_fullsized":"2023-10-08T15:41:06.459755+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:20:28.396241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"48'2","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.465332+0000","last_change":"2023-10-08T15:41:05.420869+0000","last_active":"2023-10-08T15:41:06.465332+0000","last_peered":"2023-10-08T15:41:06.465332+0000","last_clean":"2023-10-08T15:41:06.465332+0000","last_became_active":"2023-10-08T15:41:05.420568+0000","last_became_peered":"2023-10-08T15:41:05.420568+0000","last_unstale":"2023-10-08T15:41:06.465332+0000","last_undegraded":"2023-10-08T15:41:06.465332+0000","last_fullsized":"2023-10-08T15:41:06.465332+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:58:38.785900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.450597+0000","last_change":"2023-10-08T15:41:06.442522+0000","last_active":"2023-10-08T15:41:06.450597+0000","last_peered":"2023-10-08T15:41:06.450597+0000","last_clean":"2023-10-08T15:41:06.450597+0000","last_became_active":"2023-10-08T15:41:06.441904+0000","last_became_peered":"2023-10-08T15:41:06.441904+0000","last_unstale":"2023-10-08T15:41:06.450597+0000","last_undegraded":"2023-10-08T15:41:06.450597+0000","last_fullsized":"2023-10-08T15:41:06.450597+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:23:00.462449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.434894+0000","last_change":"2023-10-08T15:41:05.421625+0000","last_active":"2023-10-08T15:41:06.434894+0000","last_peered":"2023-10-08T15:41:06.434894+0000","last_clean":"2023-10-08T15:41:06.434894+0000","last_became_active":"2023-10-08T15:41:05.421073+0000","last_became_peered":"2023-10-08T15:41:05.421073+0000","last_unstale":"2023-10-08T15:41:06.434894+0000","last_undegraded":"2023-10-08T15:41:06.434894+0000","last_fullsized":"2023-10-08T15:41:06.434894+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:02:18.624782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.436866+0000","last_change":"2023-10-08T15:41:06.436866+0000","last_active":"2023-10-08T15:41:06.436866+0000","last_peered":"2023-10-08T15:41:06.436866+0000","last_clean":"2023-10-08T15:41:06.436866+0000","last_became_active":"2023-10-08T15:41:06.436472+0000","last_became_peered":"2023-10-08T15:41:06.436472+0000","last_unstale":"2023-10-08T15:41:06.436866+0000","last_undegraded":"2023-10-08T15:41:06.436866+0000","last_fullsized":"2023-10-08T15:41:06.436866+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:51:11.469061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-08T15:41:05.429177+0000","last_change":"2023-10-08T15:41:05.425516+0000","last_active":"2023-10-08T15:41:05.429177+0000","last_peered":"2023-10-08T15:41:05.429177+0000","last_clean":"2023-10-08T15:41:05.429177+0000","last_became_active":"2023-10-08T15:41:05.425222+0000","last_became_peered":"2023-10-08T15:41:05.425222+0000","last_unstale":"2023-10-08T15:41:05.429177+0000","last_undegraded":"2023-10-08T15:41:05.429177+0000","last_fullsized":"2023-10-08T15:41:05.429177+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:34:57.157992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.460205+0000","last_change":"2023-10-08T15:41:06.453927+0000","last_active":"2023-10-08T15:41:06.460205+0000","last_peered":"2023-10-08T15:41:06.460205+0000","last_clean":"2023-10-08T15:41:06.460205+0000","last_became_active":"2023-10-08T15:41:06.453515+0000","last_became_peered":"2023-10-08T15:41:06.453515+0000","last_unstale":"2023-10-08T15:41:06.460205+0000","last_undegraded":"2023-10-08T15:41:06.460205+0000","last_fullsized":"2023-10-08T15:41:06.460205+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:40:27.438245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"48'8","reported_seq":18,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.464195+0000","last_change":"2023-10-08T15:41:05.428308+0000","last_active":"2023-10-08T15:41:06.464195+0000","last_peered":"2023-10-08T15:41:06.464195+0000","last_clean":"2023-10-08T15:41:06.464195+0000","last_became_active":"2023-10-08T15:41:05.428001+0000","last_became_peered":"2023-10-08T15:41:05.428001+0000","last_unstale":"2023-10-08T15:41:06.464195+0000","last_undegraded":"2023-10-08T15:41:06.464195+0000","last_fullsized":"2023-10-08T15:41:06.464195+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:43:11.032714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.451863+0000","last_change":"2023-10-08T15:41:06.448757+0000","last_active":"2023-10-08T15:41:06.451863+0000","last_peered":"2023-10-08T15:41:06.451863+0000","last_clean":"2023-10-08T15:41:06.451863+0000","last_became_active":"2023-10-08T15:41:06.448291+0000","last_became_peered":"2023-10-08T15:41:06.448291+0000","last_unstale":"2023-10-08T15:41:06.451863+0000","last_undegraded":"2023-10-08T15:41:06.451863+0000","last_fullsized":"2023-10-08T15:41:06.451863+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:30:47.336020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"48'1","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.459248+0000","last_change":"2023-10-08T15:41:05.420407+0000","last_active":"2023-10-08T15:41:06.459248+0000","last_peered":"2023-10-08T15:41:06.459248+0000","last_clean":"2023-10-08T15:41:06.459248+0000","last_became_active":"2023-10-08T15:41:05.420122+0000","last_became_peered":"2023-10-08T15:41:05.420122+0000","last_unstale":"2023-10-08T15:41:06.459248+0000","last_undegraded":"2023-10-08T15:41:06.459248+0000","last_fullsized":"2023-10-08T15:41:06.459248+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:23:48.987488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.455866+0000","last_change":"2023-10-08T15:41:06.455866+0000","last_active":"2023-10-08T15:41:06.455866+0000","last_peered":"2023-10-08T15:41:06.455866+0000","last_clean":"2023-10-08T15:41:06.455866+0000","last_became_active":"2023-10-08T15:41:06.455570+0000","last_became_peered":"2023-10-08T15:41:06.455570+0000","last_unstale":"2023-10-08T15:41:06.455866+0000","last_undegraded":"2023-10-08T15:41:06.455866+0000","last_fullsized":"2023-10-08T15:41:06.455866+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:23:49.998865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"48'2","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.461783+0000","last_change":"2023-10-08T15:41:05.425585+0000","last_active":"2023-10-08T15:41:06.461783+0000","last_peered":"2023-10-08T15:41:06.461783+0000","last_clean":"2023-10-08T15:41:06.461783+0000","last_became_active":"2023-10-08T15:41:05.425267+0000","last_became_peered":"2023-10-08T15:41:05.425267+0000","last_unstale":"2023-10-08T15:41:06.461783+0000","last_undegraded":"2023-10-08T15:41:06.461783+0000","last_fullsized":"2023-10-08T15:41:06.461783+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:46:33.678799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.459549+0000","last_change":"2023-10-08T15:41:06.451364+0000","last_active":"2023-10-08T15:41:06.459549+0000","last_peered":"2023-10-08T15:41:06.459549+0000","last_clean":"2023-10-08T15:41:06.459549+0000","last_became_active":"2023-10-08T15:41:06.450939+0000","last_became_peered":"2023-10-08T15:41:06.450939+0000","last_unstale":"2023-10-08T15:41:06.459549+0000","last_undegraded":"2023-10-08T15:41:06.459549+0000","last_fullsized":"2023-10-08T15:41:06.459549+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:46.585533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"48'1","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.441451+0000","last_change":"2023-10-08T15:41:05.423819+0000","last_active":"2023-10-08T15:41:06.441451+0000","last_peered":"2023-10-08T15:41:06.441451+0000","last_clean":"2023-10-08T15:41:06.441451+0000","last_became_active":"2023-10-08T15:41:05.419732+0000","last_became_peered":"2023-10-08T15:41:05.419732+0000","last_unstale":"2023-10-08T15:41:06.441451+0000","last_undegraded":"2023-10-08T15:41:06.441451+0000","last_fullsized":"2023-10-08T15:41:06.441451+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:40:58.940180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.450552+0000","last_change":"2023-10-08T15:41:06.443735+0000","last_active":"2023-10-08T15:41:06.450552+0000","last_peered":"2023-10-08T15:41:06.450552+0000","last_clean":"2023-10-08T15:41:06.450552+0000","last_became_active":"2023-10-08T15:41:06.443131+0000","last_became_peered":"2023-10-08T15:41:06.443131+0000","last_unstale":"2023-10-08T15:41:06.450552+0000","last_undegraded":"2023-10-08T15:41:06.450552+0000","last_fullsized":"2023-10-08T15:41:06.450552+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:46:10.449586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.439788+0000","last_change":"2023-10-08T15:41:05.429701+0000","last_active":"2023-10-08T15:41:06.439788+0000","last_peered":"2023-10-08T15:41:06.439788+0000","last_clean":"2023-10-08T15:41:06.439788+0000","last_became_active":"2023-10-08T15:41:05.429418+0000","last_became_peered":"2023-10-08T15:41:05.429418+0000","last_unstale":"2023-10-08T15:41:06.439788+0000","last_undegraded":"2023-10-08T15:41:06.439788+0000","last_fullsized":"2023-10-08T15:41:06.439788+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:45:12.183728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.459868+0000","last_change":"2023-10-08T15:41:06.459868+0000","last_active":"2023-10-08T15:41:06.459868+0000","last_peered":"2023-10-08T15:41:06.459868+0000","last_clean":"2023-10-08T15:41:06.459868+0000","last_became_active":"2023-10-08T15:41:06.459533+0000","last_became_peered":"2023-10-08T15:41:06.459533+0000","last_unstale":"2023-10-08T15:41:06.459868+0000","last_undegraded":"2023-10-08T15:41:06.459868+0000","last_fullsized":"2023-10-08T15:41:06.459868+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:37:41.807860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"48'2","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.465368+0000","last_change":"2023-10-08T15:41:05.417041+0000","last_active":"2023-10-08T15:41:06.465368+0000","last_peered":"2023-10-08T15:41:06.465368+0000","last_clean":"2023-10-08T15:41:06.465368+0000","last_became_active":"2023-10-08T15:41:05.416757+0000","last_became_peered":"2023-10-08T15:41:05.416757+0000","last_unstale":"2023-10-08T15:41:06.465368+0000","last_undegraded":"2023-10-08T15:41:06.465368+0000","last_fullsized":"2023-10-08T15:41:06.465368+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:18:22.044216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.447328+0000","last_change":"2023-10-08T15:41:06.443162+0000","last_active":"2023-10-08T15:41:06.447328+0000","last_peered":"2023-10-08T15:41:06.447328+0000","last_clean":"2023-10-08T15:41:06.447328+0000","last_became_active":"2023-10-08T15:41:06.441805+0000","last_became_peered":"2023-10-08T15:41:06.441805+0000","last_unstale":"2023-10-08T15:41:06.447328+0000","last_undegraded":"2023-10-08T15:41:06.447328+0000","last_fullsized":"2023-10-08T15:41:06.447328+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:37:41.814988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.422525+0000","last_change":"2023-10-08T15:41:05.420900+0000","last_active":"2023-10-08T15:41:06.422525+0000","last_peered":"2023-10-08T15:41:06.422525+0000","last_clean":"2023-10-08T15:41:06.422525+0000","last_became_active":"2023-10-08T15:41:05.420573+0000","last_became_peered":"2023-10-08T15:41:05.420573+0000","last_unstale":"2023-10-08T15:41:06.422525+0000","last_undegraded":"2023-10-08T15:41:06.422525+0000","last_fullsized":"2023-10-08T15:41:06.422525+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:30:42.784325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.458297+0000","last_change":"2023-10-08T15:41:06.445383+0000","last_active":"2023-10-08T15:41:06.458297+0000","last_peered":"2023-10-08T15:41:06.458297+0000","last_clean":"2023-10-08T15:41:06.458297+0000","last_became_active":"2023-10-08T15:41:06.445037+0000","last_became_peered":"2023-10-08T15:41:06.445037+0000","last_unstale":"2023-10-08T15:41:06.458297+0000","last_undegraded":"2023-10-08T15:41:06.458297+0000","last_fullsized":"2023-10-08T15:41:06.458297+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:46.585533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-08T15:41:05.428018+0000","last_change":"2023-10-08T15:41:05.423733+0000","last_active":"2023-10-08T15:41:05.428018+0000","last_peered":"2023-10-08T15:41:05.428018+0000","last_clean":"2023-10-08T15:41:05.428018+0000","last_became_active":"2023-10-08T15:41:05.423416+0000","last_became_peered":"2023-10-08T15:41:05.423416+0000","last_unstale":"2023-10-08T15:41:05.428018+0000","last_undegraded":"2023-10-08T15:41:05.428018+0000","last_fullsized":"2023-10-08T15:41:05.428018+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:53:50.387647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.448896+0000","last_change":"2023-10-08T15:41:06.448896+0000","last_active":"2023-10-08T15:41:06.448896+0000","last_peered":"2023-10-08T15:41:06.448896+0000","last_clean":"2023-10-08T15:41:06.448896+0000","last_became_active":"2023-10-08T15:41:06.448611+0000","last_became_peered":"2023-10-08T15:41:06.448611+0000","last_unstale":"2023-10-08T15:41:06.448896+0000","last_undegraded":"2023-10-08T15:41:06.448896+0000","last_fullsized":"2023-10-08T15:41:06.448896+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:10.730958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"48'2","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.464971+0000","last_change":"2023-10-08T15:41:05.419823+0000","last_active":"2023-10-08T15:41:06.464971+0000","last_peered":"2023-10-08T15:41:06.464971+0000","last_clean":"2023-10-08T15:41:06.464971+0000","last_became_active":"2023-10-08T15:41:05.419518+0000","last_became_peered":"2023-10-08T15:41:05.419518+0000","last_unstale":"2023-10-08T15:41:06.464971+0000","last_undegraded":"2023-10-08T15:41:06.464971+0000","last_fullsized":"2023-10-08T15:41:06.464971+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:43:22.987757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.449113+0000","last_change":"2023-10-08T15:41:06.449113+0000","last_active":"2023-10-08T15:41:06.449113+0000","last_peered":"2023-10-08T15:41:06.449113+0000","last_clean":"2023-10-08T15:41:06.449113+0000","last_became_active":"2023-10-08T15:41:06.448029+0000","last_became_peered":"2023-10-08T15:41:06.448029+0000","last_unstale":"2023-10-08T15:41:06.449113+0000","last_undegraded":"2023-10-08T15:41:06.449113+0000","last_fullsized":"2023-10-08T15:41:06.449113+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:58:39.797277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.439574+0000","last_change":"2023-10-08T15:41:05.430736+0000","last_active":"2023-10-08T15:41:06.439574+0000","last_peered":"2023-10-08T15:41:06.439574+0000","last_clean":"2023-10-08T15:41:06.439574+0000","last_became_active":"2023-10-08T15:41:05.430331+0000","last_became_peered":"2023-10-08T15:41:05.430331+0000","last_unstale":"2023-10-08T15:41:06.439574+0000","last_undegraded":"2023-10-08T15:41:06.439574+0000","last_fullsized":"2023-10-08T15:41:06.439574+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:53:50.387647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.454275+0000","last_change":"2023-10-08T15:41:06.435766+0000","last_active":"2023-10-08T15:41:06.454275+0000","last_peered":"2023-10-08T15:41:06.454275+0000","last_clean":"2023-10-08T15:41:06.454275+0000","last_became_active":"2023-10-08T15:41:06.435473+0000","last_became_peered":"2023-10-08T15:41:06.435473+0000","last_unstale":"2023-10-08T15:41:06.454275+0000","last_undegraded":"2023-10-08T15:41:06.454275+0000","last_fullsized":"2023-10-08T15:41:06.454275+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:52:10.298432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.434877+0000","last_change":"2023-10-08T15:41:05.417963+0000","last_active":"2023-10-08T15:41:06.434877+0000","last_peered":"2023-10-08T15:41:06.434877+0000","last_clean":"2023-10-08T15:41:06.434877+0000","last_became_active":"2023-10-08T15:41:05.417670+0000","last_became_peered":"2023-10-08T15:41:05.417670+0000","last_unstale":"2023-10-08T15:41:06.434877+0000","last_undegraded":"2023-10-08T15:41:06.434877+0000","last_fullsized":"2023-10-08T15:41:06.434877+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:39:25.403059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.447273+0000","last_change":"2023-10-08T15:41:06.444273+0000","last_active":"2023-10-08T15:41:06.447273+0000","last_peered":"2023-10-08T15:41:06.447273+0000","last_clean":"2023-10-08T15:41:06.447273+0000","last_became_active":"2023-10-08T15:41:06.444002+0000","last_became_peered":"2023-10-08T15:41:06.444002+0000","last_unstale":"2023-10-08T15:41:06.447273+0000","last_undegraded":"2023-10-08T15:41:06.447273+0000","last_fullsized":"2023-10-08T15:41:06.447273+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:17:04.496253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-08T15:41:05.428085+0000","last_change":"2023-10-08T15:41:05.423187+0000","last_active":"2023-10-08T15:41:05.428085+0000","last_peered":"2023-10-08T15:41:05.428085+0000","last_clean":"2023-10-08T15:41:05.428085+0000","last_became_active":"2023-10-08T15:41:05.419599+0000","last_became_peered":"2023-10-08T15:41:05.419599+0000","last_unstale":"2023-10-08T15:41:05.428085+0000","last_undegraded":"2023-10-08T15:41:05.428085+0000","last_fullsized":"2023-10-08T15:41:05.428085+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:30:08.152470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.465309+0000","last_change":"2023-10-08T15:41:06.458231+0000","last_active":"2023-10-08T15:41:06.465309+0000","last_peered":"2023-10-08T15:41:06.465309+0000","last_clean":"2023-10-08T15:41:06.465309+0000","last_became_active":"2023-10-08T15:41:06.457747+0000","last_became_peered":"2023-10-08T15:41:06.457747+0000","last_unstale":"2023-10-08T15:41:06.465309+0000","last_undegraded":"2023-10-08T15:41:06.465309+0000","last_fullsized":"2023-10-08T15:41:06.465309+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:00:24.445256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.422509+0000","last_change":"2023-10-08T15:41:05.426493+0000","last_active":"2023-10-08T15:41:06.422509+0000","last_peered":"2023-10-08T15:41:06.422509+0000","last_clean":"2023-10-08T15:41:06.422509+0000","last_became_active":"2023-10-08T15:41:05.426089+0000","last_became_peered":"2023-10-08T15:41:05.426089+0000","last_unstale":"2023-10-08T15:41:06.422509+0000","last_undegraded":"2023-10-08T15:41:06.422509+0000","last_fullsized":"2023-10-08T15:41:06.422509+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:47:58.708925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.452397+0000","last_change":"2023-10-08T15:41:06.451904+0000","last_active":"2023-10-08T15:41:06.452397+0000","last_peered":"2023-10-08T15:41:06.452397+0000","last_clean":"2023-10-08T15:41:06.452397+0000","last_became_active":"2023-10-08T15:41:06.451029+0000","last_became_peered":"2023-10-08T15:41:06.451029+0000","last_unstale":"2023-10-08T15:41:06.452397+0000","last_undegraded":"2023-10-08T15:41:06.452397+0000","last_fullsized":"2023-10-08T15:41:06.452397+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:03:07.422056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-08T15:41:05.423736+0000","last_change":"2023-10-08T15:41:05.422862+0000","last_active":"2023-10-08T15:41:05.423736+0000","last_peered":"2023-10-08T15:41:05.423736+0000","last_clean":"2023-10-08T15:41:05.423736+0000","last_became_active":"2023-10-08T15:41:05.422495+0000","last_became_peered":"2023-10-08T15:41:05.422495+0000","last_unstale":"2023-10-08T15:41:05.423736+0000","last_undegraded":"2023-10-08T15:41:05.423736+0000","last_fullsized":"2023-10-08T15:41:05.423736+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:26:54.388269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.453160+0000","last_change":"2023-10-08T15:41:06.437140+0000","last_active":"2023-10-08T15:41:06.453160+0000","last_peered":"2023-10-08T15:41:06.453160+0000","last_clean":"2023-10-08T15:41:06.453160+0000","last_became_active":"2023-10-08T15:41:06.436854+0000","last_became_peered":"2023-10-08T15:41:06.436854+0000","last_unstale":"2023-10-08T15:41:06.453160+0000","last_undegraded":"2023-10-08T15:41:06.453160+0000","last_fullsized":"2023-10-08T15:41:06.453160+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:25:42.944981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.422496+0000","last_change":"2023-10-08T15:41:05.422963+0000","last_active":"2023-10-08T15:41:06.422496+0000","last_peered":"2023-10-08T15:41:06.422496+0000","last_clean":"2023-10-08T15:41:06.422496+0000","last_became_active":"2023-10-08T15:41:05.422669+0000","last_became_peered":"2023-10-08T15:41:05.422669+0000","last_unstale":"2023-10-08T15:41:06.422496+0000","last_undegraded":"2023-10-08T15:41:06.422496+0000","last_fullsized":"2023-10-08T15:41:06.422496+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:54:59.548259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.459998+0000","last_change":"2023-10-08T15:41:06.450556+0000","last_active":"2023-10-08T15:41:06.459998+0000","last_peered":"2023-10-08T15:41:06.459998+0000","last_clean":"2023-10-08T15:41:06.459998+0000","last_became_active":"2023-10-08T15:41:06.449855+0000","last_became_peered":"2023-10-08T15:41:06.449855+0000","last_unstale":"2023-10-08T15:41:06.459998+0000","last_undegraded":"2023-10-08T15:41:06.459998+0000","last_fullsized":"2023-10-08T15:41:06.459998+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:04:32.249612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.437155+0000","last_change":"2023-10-08T15:41:05.426634+0000","last_active":"2023-10-08T15:41:06.437155+0000","last_peered":"2023-10-08T15:41:06.437155+0000","last_clean":"2023-10-08T15:41:06.437155+0000","last_became_active":"2023-10-08T15:41:05.426314+0000","last_became_peered":"2023-10-08T15:41:05.426314+0000","last_unstale":"2023-10-08T15:41:06.437155+0000","last_undegraded":"2023-10-08T15:41:06.437155+0000","last_fullsized":"2023-10-08T15:41:06.437155+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:37:40.796483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.454855+0000","last_change":"2023-10-08T15:41:06.448899+0000","last_active":"2023-10-08T15:41:06.454855+0000","last_peered":"2023-10-08T15:41:06.454855+0000","last_clean":"2023-10-08T15:41:06.454855+0000","last_became_active":"2023-10-08T15:41:06.448490+0000","last_became_peered":"2023-10-08T15:41:06.448490+0000","last_unstale":"2023-10-08T15:41:06.454855+0000","last_undegraded":"2023-10-08T15:41:06.454855+0000","last_fullsized":"2023-10-08T15:41:06.454855+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:53:56.986432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.435245+0000","last_change":"2023-10-08T15:41:05.428493+0000","last_active":"2023-10-08T15:41:06.435245+0000","last_peered":"2023-10-08T15:41:06.435245+0000","last_clean":"2023-10-08T15:41:06.435245+0000","last_became_active":"2023-10-08T15:41:05.428178+0000","last_became_peered":"2023-10-08T15:41:05.428178+0000","last_unstale":"2023-10-08T15:41:06.435245+0000","last_undegraded":"2023-10-08T15:41:06.435245+0000","last_fullsized":"2023-10-08T15:41:06.435245+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:06:17.731641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":192,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.428502+0000","last_change":"2023-10-08T15:37:19.380955+0000","last_active":"2023-10-08T15:41:06.428502+0000","last_peered":"2023-10-08T15:41:06.428502+0000","last_clean":"2023-10-08T15:41:06.428502+0000","last_became_active":"2023-10-08T15:37:19.378277+0000","last_became_peered":"2023-10-08T15:37:19.378277+0000","last_unstale":"2023-10-08T15:41:06.428502+0000","last_undegraded":"2023-10-08T15:41:06.428502+0000","last_fullsized":"2023-10-08T15:41:06.428502+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:17.537726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:17.537726+0000","last_clean_scrub_stamp":"2023-10-08T15:37:17.537726+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:06:26.612046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66282,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542192,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306120,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065720,"statfs":{"total":96636764160,"available":96323297280,"internally_reserved":0,"allocated":655360,"data_stored":829316,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.92300000000000004,"15min":0.95299999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.1930000000000001,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.92900000000000005,"15min":0.93100000000000005},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.2629999999999999,"5min":1.758,"15min":1.758},"last":1.022}]},{"osd":1,"last update":"Sun Oct 8 15:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.90700000000000003,"15min":0.89400000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.2809999999999999,"5min":1.474,"15min":1.474},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.95199999999999996,"15min":0.95799999999999996},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.2609999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.96499999999999997}]},{"osd":2,"last update":"Sun Oct 8 15:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.995,"15min":1.024},"min":{"1min":0.56100000000000005,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.3089999999999999,"5min":1.623,"15min":1.623},"last":1.0920000000000001},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.998,"15min":1.0049999999999999},"min":{"1min":0.65200000000000002,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.73599999999999999}]},{"osd":3,"last update":"Sun Oct 8 15:40:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":0.99299999999999999,"15min":0.97599999999999998},"min":{"1min":0.72499999999999998,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.3540000000000001,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1970000000000001,"15min":1.2050000000000001},"min":{"1min":0.69499999999999995,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.48,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":1.26}]},{"osd":4,"last update":"Sun Oct 8 15:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.052,"15min":1.0820000000000001},"min":{"1min":0.71699999999999997,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.5109999999999999,"5min":1.512,"15min":1.512},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.071,"5min":1.089,"15min":1.0980000000000001},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.054}]},{"osd":5,"last update":"Sun Oct 8 15:40:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.206,"15min":1.2569999999999999},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":1.181},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.222,"15min":1.244},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":1.133}]},{"osd":6,"last update":"Sun Oct 8 15:40:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2789999999999999,"15min":1.3109999999999999},"min":{"1min":0.96199999999999997,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.839,"5min":1.839,"15min":1.839},"last":1.23},{"interface":"front","average":{"1min":1.109,"5min":1.21,"15min":1.246},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.417,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.1579999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542193,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306036,"kb_used_data":556,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065804,"statfs":{"total":96636764160,"available":96323383296,"internally_reserved":0,"allocated":569344,"data_stored":232500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.871,"15min":0.83299999999999996},"min":{"1min":0.64600000000000002,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":1.0289999999999999,"5min":0.98899999999999999,"15min":0.999},"min":{"1min":0.627,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.673,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":0.86199999999999999}]},{"osd":1,"last update":"Sun Oct 8 15:40:22 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":0.96199999999999997,"15min":0.96099999999999997},"min":{"1min":0.61699999999999999,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.82799999999999996},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0009999999999999,"15min":0.995},"min":{"1min":0.69699999999999995,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.5309999999999999,"5min":1.853,"15min":1.853},"last":0.72699999999999998}]},{"osd":2,"last update":"Sun Oct 8 15:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.88200000000000001,"15min":0.85399999999999998},"min":{"1min":0.69899999999999995,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.121},{"interface":"front","average":{"1min":1.103,"5min":1.0700000000000001,"15min":1.0780000000000001},"min":{"1min":0.74299999999999999,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5049999999999999,"5min":1.518,"15min":1.518},"last":0.63900000000000001}]},{"osd":3,"last update":"Sun Oct 8 15:40:22 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.038,"15min":1.0269999999999999},"min":{"1min":0.82499999999999996,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.097,"5min":1.073,"15min":1.0820000000000001},"min":{"1min":0.82899999999999996,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.7270000000000001,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":0.78900000000000003}]},{"osd":4,"last update":"Sun Oct 8 15:40:22 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.1020000000000001,"15min":1.1180000000000001},"min":{"1min":0.90300000000000002,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.171,"15min":1.1879999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":1.149}]},{"osd":5,"last update":"Sun Oct 8 15:40:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.1040000000000001,"15min":1.121},"min":{"1min":0.77300000000000002,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.3939999999999999,"5min":1.581,"15min":1.581},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.296,"5min":1.2889999999999999,"15min":1.3100000000000001},"min":{"1min":1.0880000000000001,"5min":0.96099999999999997,"15min":0.96099999999999997},"max":{"1min":1.8,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.99099999999999999}]},{"osd":7,"last update":"Sun Oct 8 15:40:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.272,"15min":1.2849999999999999},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":1.095},{"interface":"front","average":{"1min":1.256,"5min":1.2849999999999999,"15min":1.3069999999999999},"min":{"1min":0.999,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":1.5580000000000001,"5min":2.5630000000000002,"15min":2.5630000000000002},"last":1.0569999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542194,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306056,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065784,"statfs":{"total":96636764160,"available":96323362816,"internally_reserved":0,"allocated":589824,"data_stored":238844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.70199999999999996,"15min":0.71699999999999997},"min":{"1min":0.52400000000000002,"5min":0.501,"15min":0.501},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.77600000000000002,"15min":0.76500000000000001},"min":{"1min":0.60299999999999998,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0649999999999999,"5min":1.179,"15min":1.179},"last":0.62}]},{"osd":1,"last update":"Sun Oct 8 15:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.71899999999999997,"15min":0.71299999999999997},"min":{"1min":0.52300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.002,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.84599999999999997,"15min":0.81999999999999995},"min":{"1min":0.63300000000000001,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.92100000000000004}]},{"osd":2,"last update":"Sun Oct 8 15:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.85899999999999999,"15min":0.85399999999999998},"min":{"1min":0.57399999999999995,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.92400000000000004,"15min":0.92700000000000005},"min":{"1min":0.51900000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.2030000000000001,"5min":1.423,"15min":1.423},"last":1.208}]},{"osd":4,"last update":"Sun Oct 8 15:40:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.077,"15min":1.0669999999999999},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":0.875},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.129,"15min":1.1499999999999999},"min":{"1min":0.79500000000000004,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.3959999999999999,"5min":2.762,"15min":2.762},"last":0.96299999999999997}]},{"osd":5,"last update":"Sun Oct 8 15:40:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.157,"15min":1.1579999999999999},"min":{"1min":0.78000000000000003,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.631,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.069},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.2210000000000001,"15min":1.2310000000000001},"min":{"1min":0.91800000000000004,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.415,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":1.1499999999999999}]},{"osd":6,"last update":"Sun Oct 8 15:40:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2769999999999999,"15min":1.3},"min":{"1min":0.83499999999999996,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.633,"5min":2.6890000000000001,"15min":2.6890000000000001},"last":1.105},{"interface":"front","average":{"1min":1.222,"5min":1.2250000000000001,"15min":1.2230000000000001},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":1.742,"5min":1.742,"15min":1.742},"last":1.3100000000000001}]},{"osd":7,"last update":"Sun Oct 8 15:40:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.266,"15min":1.2589999999999999},"min":{"1min":1.02,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":1.679,"5min":1.738,"15min":1.738},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.304,"5min":1.339,"15min":1.357},"min":{"1min":1.052,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.5620000000000001,"5min":2.5840000000000001,"15min":2.5840000000000001},"last":1.2829999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542193,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306056,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065784,"statfs":{"total":96636764160,"available":96323362816,"internally_reserved":0,"allocated":589824,"data_stored":238844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:40:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.63300000000000001,"15min":0.623},"min":{"1min":0.48299999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.70499999999999996,"15min":0.66000000000000003},"min":{"1min":0.56699999999999995,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.147,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.79700000000000004}]},{"osd":1,"last update":"Sun Oct 8 15:40:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.70899999999999996,"15min":0.68300000000000005},"min":{"1min":0.57499999999999996,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.141,"5min":1.236,"15min":1.236},"last":0.621},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.75800000000000001,"15min":0.70599999999999996},"min":{"1min":0.64500000000000002,"5min":0.307,"15min":0.307},"max":{"1min":1.2529999999999999,"5min":1.399,"15min":1.399},"last":0.66200000000000003}]},{"osd":3,"last update":"Sun Oct 8 15:40:28 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.69599999999999995,"15min":0.65200000000000002},"min":{"1min":0.57599999999999996,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.86899999999999999,"15min":0.84799999999999998},"min":{"1min":0.65100000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.1799999999999999,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.83799999999999997}]},{"osd":4,"last update":"Sun Oct 8 15:40:28 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.012,"15min":1.002},"min":{"1min":0.79700000000000004,"5min":0.748,"15min":0.748},"max":{"1min":1.2230000000000001,"5min":1.371,"15min":1.371},"last":0.93600000000000005},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.72699999999999998,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.4239999999999999,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.544}]},{"osd":5,"last update":"Sun Oct 8 15:40:28 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.0660000000000001,"15min":1.0589999999999999},"min":{"1min":0.85199999999999998,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.381,"5min":1.462,"15min":1.462},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.125,"5min":1.0780000000000001,"15min":1.0640000000000001},"min":{"1min":0.79500000000000004,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.383,"5min":1.452,"15min":1.452},"last":1.03}]},{"osd":6,"last update":"Sun Oct 8 15:40:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.111,"15min":1.097},"min":{"1min":0.85799999999999998,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":1.6479999999999999},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.133,"15min":1.111},"min":{"1min":0.879,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.492,"5min":1.526,"15min":1.526},"last":1.488}]},{"osd":7,"last update":"Sun Oct 8 15:40:28 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.1910000000000001,"15min":1.161},"min":{"1min":1.0880000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.6319999999999999,"5min":1.72,"15min":1.72},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.1910000000000001,"15min":1.167},"min":{"1min":1.0349999999999999,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.508,"5min":1.804,"15min":1.804},"last":1.401}]}]},{"osd":1,"up_from":14,"seq":60129542194,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306052,"kb_used_data":572,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065788,"statfs":{"total":96636764160,"available":96323366912,"internally_reserved":0,"allocated":585728,"data_stored":238878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.751,"15min":0.77100000000000002},"min":{"1min":0.39600000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.0840000000000001,"5min":1.734,"15min":1.734},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.91600000000000004,"15min":0.98399999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.1970000000000001,"5min":5.7960000000000003,"15min":5.7960000000000003},"last":0.54000000000000004}]},{"osd":2,"last update":"Sun Oct 8 15:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.80300000000000005,"15min":0.83699999999999997},"min":{"1min":0.53800000000000003,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.86099999999999999,"5min":4.0119999999999996,"15min":4.0119999999999996},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.89500000000000002,"15min":0.90700000000000003},"min":{"1min":0.57899999999999996,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3660000000000001,"5min":1.853,"15min":1.853},"last":0.82499999999999996}]},{"osd":3,"last update":"Sun Oct 8 15:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":1.1259999999999999,"15min":1.0169999999999999},"min":{"1min":0.57299999999999995,"5min":0.435,"15min":0.435},"max":{"1min":2.109,"5min":13.388,"15min":13.388},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.91100000000000003,"5min":1.208,"15min":1.167},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":2.274,"5min":13.353,"15min":13.353},"last":0.91200000000000003}]},{"osd":4,"last update":"Sun Oct 8 15:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.153,"15min":1.228},"min":{"1min":0.81000000000000005,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.2290000000000001,"5min":5.859,"15min":5.859},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.024,"5min":1.117,"15min":1.159},"min":{"1min":0.80100000000000005,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.3029999999999999,"5min":4.2679999999999998,"15min":4.2679999999999998},"last":0.94999999999999996}]},{"osd":5,"last update":"Sun Oct 8 15:40:20 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.115,"15min":1.141},"min":{"1min":0.76000000000000001,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.2490000000000001,"5min":4.3380000000000001,"15min":4.3380000000000001},"last":1.048},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.177,"15min":1.181},"min":{"1min":0.73699999999999999,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.907,"5min":2.085,"15min":2.085},"last":1.119}]},{"osd":6,"last update":"Sun Oct 8 15:40:20 2023","interfaces":[{"interface":"back","average":{"1min":1.1200000000000001,"5min":1.302,"15min":1.373},"min":{"1min":0.80200000000000005,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.524,"5min":5.8979999999999997,"15min":5.8979999999999997},"last":1.181},{"interface":"front","average":{"1min":1.151,"5min":1.246,"15min":1.274},"min":{"1min":0.86399999999999999,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.631,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":1.2350000000000001}]},{"osd":7,"last update":"Sun Oct 8 15:40:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.2470000000000001,"15min":1.2490000000000001},"min":{"1min":0.96699999999999997,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.8320000000000001,"5min":2.3940000000000001,"15min":2.3940000000000001},"last":1.212},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.3979999999999999,"15min":1.4790000000000001},"min":{"1min":0.87,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.6279999999999999,"5min":5.9299999999999997,"15min":5.9299999999999997},"last":1.28}]}]},{"osd":0,"up_from":14,"seq":60129542194,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302032,"kb_used_data":648,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069808,"statfs":{"total":96636764160,"available":96327483392,"internally_reserved":0,"allocated":663552,"data_stored":831246,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 15:40:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.78200000000000003,"15min":0.82999999999999996},"min":{"1min":0.504,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.99299999999999999,"5min":1.514,"15min":1.514},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.80000000000000004,"15min":0.80100000000000005},"min":{"1min":0.46700000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1399999999999999,"5min":1.518,"15min":1.518},"last":0.90100000000000002}]},{"osd":2,"last update":"Sun Oct 8 15:40:21 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.82699999999999996,"15min":0.85799999999999998},"min":{"1min":0.57099999999999995,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.96799999999999997,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.78000000000000003,"15min":0.78400000000000003},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.0209999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.71599999999999997}]},{"osd":3,"last update":"Sun Oct 8 15:40:21 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.747,"15min":0.75700000000000001},"min":{"1min":0.51100000000000001,"5min":0.499,"15min":0.499},"max":{"1min":1.02,"5min":1.103,"15min":1.103},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.875,"5min":0.95999999999999996,"15min":0.98699999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.0489999999999999,"5min":2.3290000000000002,"15min":2.3290000000000002},"last":0.94599999999999995}]},{"osd":4,"last update":"Sun Oct 8 15:40:21 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":1.0629999999999999,"15min":1.087},"min":{"1min":0.83899999999999997,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.3,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.173},{"interface":"front","average":{"1min":0.96299999999999997,"5min":1.0649999999999999,"15min":1.089},"min":{"1min":0.71599999999999997,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.2330000000000001,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.97099999999999997}]},{"osd":5,"last update":"Sun Oct 8 15:40:21 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":1.054,"15min":1.089},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.3280000000000001,"5min":2.214,"15min":2.214},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.276,"15min":1.3360000000000001},"min":{"1min":0.94599999999999995,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.3640000000000001,"5min":3.4569999999999999,"15min":3.4569999999999999},"last":0.80000000000000004}]},{"osd":6,"last update":"Sun Oct 8 15:40:21 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.25,"15min":1.294},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.319,"5min":2.532,"15min":2.532},"last":1.121},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.222,"15min":1.242},"min":{"1min":0.92600000000000005,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.359,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":1.012}]},{"osd":7,"last update":"Sun Oct 8 15:40:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.2709999999999999,"15min":1.2929999999999999},"min":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"max":{"1min":1.4199999999999999,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.238},{"interface":"front","average":{"1min":1.149,"5min":1.2130000000000001,"15min":1.2290000000000001},"min":{"1min":0.90600000000000003,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.3999999999999999,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":1.1459999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574897,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306044,"kb_used_data":564,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065796,"statfs":{"total":96636764160,"available":96323375104,"internally_reserved":0,"allocated":577536,"data_stored":233124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.879,"15min":0.85599999999999998},"min":{"1min":0.61499999999999999,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1990000000000001,"5min":1.528,"15min":1.528},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.876,"5min":0.90000000000000002,"15min":0.90800000000000003},"min":{"1min":0.65300000000000002,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1930000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.52000000000000002}]},{"osd":1,"last update":"Sun Oct 8 15:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.91700000000000004,"15min":0.91000000000000003},"min":{"1min":0.67800000000000005,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.169,"5min":1.448,"15min":1.448},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.95199999999999996,"15min":0.98399999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1319999999999999,"5min":1.754,"15min":1.754},"last":0.58899999999999997}]},{"osd":2,"last update":"Sun Oct 8 15:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.94099999999999995,"15min":0.95099999999999996},"min":{"1min":0.67900000000000005,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1819999999999999,"5min":1.869,"15min":1.869},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.98799999999999999,"15min":1.0089999999999999},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.266,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.78500000000000003}]},{"osd":3,"last update":"Sun Oct 8 15:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.98899999999999999,"15min":0.999},"min":{"1min":0.70399999999999996,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.1379999999999999,"5min":1.929,"15min":1.929},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.0680000000000001,"15min":1.103},"min":{"1min":0.77400000000000002,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.2949999999999999,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.65500000000000003}]},{"osd":4,"last update":"Sun Oct 8 15:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":1.002,"15min":1.0109999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.266,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.86699999999999999,"5min":1.0409999999999999,"15min":1.071},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.073,"5min":1.823,"15min":1.823},"last":0.95199999999999996}]},{"osd":6,"last update":"Sun Oct 8 15:40:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.1779999999999999,"15min":1.1990000000000001},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.3480000000000001,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":0.55100000000000005},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.1879999999999999,"15min":1.226},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.3029999999999999,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.016}]},{"osd":7,"last update":"Sun Oct 8 15:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":1.109,"15min":1.151},"min":{"1min":0.74099999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.1799999999999999,"5min":2.177,"15min":2.177},"last":0.63600000000000001},{"interface":"front","average":{"1min":1.133,"5min":1.2010000000000001,"15min":1.2150000000000001},"min":{"1min":0.93000000000000005,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.3720000000000001,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":0.80800000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574897,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310144,"kb_used_data":568,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061696,"statfs":{"total":96636764160,"available":96319176704,"internally_reserved":0,"allocated":581632,"data_stored":234036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.83699999999999997,"15min":0.81499999999999995},"min":{"1min":0.66200000000000003,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.125,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.80900000000000005,"15min":0.79300000000000004},"min":{"1min":0.52600000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.83699999999999997}]},{"osd":1,"last update":"Sun Oct 8 15:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.86399999999999999,"15min":0.83799999999999997},"min":{"1min":0.68100000000000005,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":1.147},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.85299999999999998,"15min":0.83699999999999997},"min":{"1min":0.67600000000000005,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.76700000000000002}]},{"osd":2,"last update":"Sun Oct 8 15:40:20 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0449999999999999,"15min":1.0329999999999999},"min":{"1min":0.72299999999999998,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.3080000000000001,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.071,"5min":1.022,"15min":1.022},"min":{"1min":0.86399999999999999,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.234,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.90500000000000003}]},{"osd":3,"last update":"Sun Oct 8 15:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":1.004,"15min":1.016},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.2529999999999999,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":1.012},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.042,"15min":1.0349999999999999},"min":{"1min":0.68999999999999995,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":1.2969999999999999}]},{"osd":5,"last update":"Sun Oct 8 15:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.98199999999999998,"15min":0.96999999999999997},"min":{"1min":0.70599999999999996,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.343,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":1.325},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0660000000000001,"15min":1.0620000000000001},"min":{"1min":0.65300000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.3500000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":1.097}]},{"osd":6,"last update":"Sun Oct 8 15:40:20 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.1240000000000001,"15min":1.1419999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.3540000000000001,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.194},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.1859999999999999,"15min":1.1819999999999999},"min":{"1min":0.98599999999999999,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":1.2330000000000001}]},{"osd":7,"last update":"Sun Oct 8 15:40:20 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.0820000000000001,"15min":1.0700000000000001},"min":{"1min":0.78100000000000003,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.387,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":1.3740000000000001},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.196,"15min":1.1910000000000001},"min":{"1min":0.97399999999999998,"5min":0.625,"15min":0.625},"max":{"1min":1.4550000000000001,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.274}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T15:41:10.468 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T15:41:10.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.570+0000 7f484580b700 1 Processor -- start 2023-10-08T15:41:10.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.570+0000 7f484580b700 1 -- start start 2023-10-08T15:41:10.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.570+0000 7f484580b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4840069d50 0x7f484014f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:10.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.570+0000 7f484580b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f48400674b0 0x7f4840068400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:10.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.570+0000 7f484580b700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f484014bc60 con 0x7f48400670e0 2023-10-08T15:41:10.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.570+0000 7f484580b700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4840067910 con 0x7f48400674b0 2023-10-08T15:41:10.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.570+0000 7f484580b700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f484014c800 con 0x7f4840069d50 2023-10-08T15:41:10.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.570+0000 7f4844809700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f48400670e0 0x7f484014c0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:50724/0 (socket says 172.21.15.3:50724) 2023-10-08T15:41:10.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.570+0000 7f4844809700 1 -- 172.21.15.3:0/2995295811 learned_addr learned my addr 172.21.15.3:0/2995295811 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:41:10.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.570+0000 7f483ffff700 1 --2- 172.21.15.3:0/2995295811 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4840069d50 0x7f484014f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:10.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.574+0000 7f484500a700 1 --2- 172.21.15.3:0/2995295811 >> v2:172.21.15.50:3300/0 conn(0x7f48400674b0 0x7f4840068400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:10.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.574+0000 7f483f7fe700 1 -- 172.21.15.3:0/2995295811 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 48181055 0 0) 0x7f484014bc60 con 0x7f48400670e0 2023-10-08T15:41:10.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.574+0000 7f483f7fe700 1 -- 172.21.15.3:0/2995295811 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f482c003570 con 0x7f48400670e0 2023-10-08T15:41:10.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.574+0000 7f483ffff700 1 -- 172.21.15.3:0/2995295811 >> v2:172.21.15.50:3300/0 conn(0x7f48400674b0 msgr2=0x7f4840068400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:10.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.574+0000 7f483ffff700 1 --2- 172.21.15.3:0/2995295811 >> v2:172.21.15.50:3300/0 conn(0x7f48400674b0 0x7f4840068400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:10.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.574+0000 7f483ffff700 1 -- 172.21.15.3:0/2995295811 >> v1:172.21.15.3:6789/0 conn(0x7f48400670e0 legacy=0x7f484014c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:10.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.574+0000 7f483ffff700 1 -- 172.21.15.3:0/2995295811 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f484014b8f0 con 0x7f4840069d50 2023-10-08T15:41:10.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.574+0000 7f483ffff700 1 --2- 172.21.15.3:0/2995295811 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4840069d50 0x7f484014f560 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4838009e60 tx=0x7f4838009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec64e6b7f73e9dce server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:10.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.574+0000 7f483f7fe700 1 -- 172.21.15.3:0/2995295811 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483800e070 con 0x7f4840069d50 2023-10-08T15:41:10.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.574+0000 7f483f7fe700 1 -- 172.21.15.3:0/2995295811 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f483800bab0 con 0x7f4840069d50 2023-10-08T15:41:10.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.574+0000 7f483f7fe700 1 -- 172.21.15.3:0/2995295811 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483800be30 con 0x7f4840069d50 2023-10-08T15:41:10.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.574+0000 7f484580b700 1 -- 172.21.15.3:0/2995295811 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4840069d50 msgr2=0x7f484014f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:10.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.574+0000 7f484580b700 1 --2- 172.21.15.3:0/2995295811 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4840069d50 0x7f484014f560 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4838009e60 tx=0x7f4838009780 comp rx=0 tx=0).stop 2023-10-08T15:41:10.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.574+0000 7f484580b700 1 -- 172.21.15.3:0/2995295811 shutdown_connections 2023-10-08T15:41:10.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.574+0000 7f484580b700 1 --2- 172.21.15.3:0/2995295811 >> v2:172.21.15.50:3300/0 conn(0x7f48400674b0 0x7f4840068400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:10.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.574+0000 7f484580b700 1 --2- 172.21.15.3:0/2995295811 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4840069d50 0x7f484014f560 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:10.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.574+0000 7f484580b700 1 -- 172.21.15.3:0/2995295811 >> 172.21.15.3:0/2995295811 conn(0x7f484006dfb0 msgr2=0x7f484006e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:10.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.574+0000 7f484580b700 1 -- 172.21.15.3:0/2995295811 shutdown_connections 2023-10-08T15:41:10.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.574+0000 7f484580b700 1 -- 172.21.15.3:0/2995295811 wait complete. 2023-10-08T15:41:10.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.578+0000 7f484580b700 1 Processor -- start 2023-10-08T15:41:10.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.578+0000 7f484580b700 1 -- start start 2023-10-08T15:41:10.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.578+0000 7f484580b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f48400670e0 0x7f48400bf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:10.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.578+0000 7f484580b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f48400674b0 0x7f484009eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:10.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.578+0000 7f484580b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4840069d50 0x7f484015e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:10.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.578+0000 7f484580b700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f484015f430 con 0x7f48400674b0 2023-10-08T15:41:10.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.578+0000 7f484580b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f484009b2a0 con 0x7f4840069d50 2023-10-08T15:41:10.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.578+0000 7f484580b700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f484009af30 con 0x7f48400670e0 2023-10-08T15:41:10.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.578+0000 7f483ffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f48400674b0 0x7f484009eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:10.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.578+0000 7f483ffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f48400674b0 0x7f484009eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35122/0 (socket says 172.21.15.3:35122) 2023-10-08T15:41:10.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.578+0000 7f483ffff700 1 -- 172.21.15.3:0/3831186280 learned_addr learned my addr 172.21.15.3:0/3831186280 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:10.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.578+0000 7f484500a700 1 --2- 172.21.15.3:0/3831186280 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4840069d50 0x7f484015e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:10.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.578+0000 7f4844809700 1 --2- 172.21.15.3:0/3831186280 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f48400670e0 0x7f48400bf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:10.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.578+0000 7f483ffff700 1 -- 172.21.15.3:0/3831186280 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f48400670e0 msgr2=0x7f48400bf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:10.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.578+0000 7f483ffff700 1 --2- 172.21.15.3:0/3831186280 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f48400670e0 0x7f48400bf9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:10.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.578+0000 7f483ffff700 1 -- 172.21.15.3:0/3831186280 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4840069d50 msgr2=0x7f484015e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:10.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.578+0000 7f483ffff700 1 --2- 172.21.15.3:0/3831186280 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4840069d50 0x7f484015e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:10.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.578+0000 7f483ffff700 1 -- 172.21.15.3:0/3831186280 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4838009a20 con 0x7f48400674b0 2023-10-08T15:41:10.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.578+0000 7f4844809700 1 --2- 172.21.15.3:0/3831186280 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f48400670e0 0x7f48400bf9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:10.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.578+0000 7f483ffff700 1 --2- 172.21.15.3:0/3831186280 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f48400674b0 0x7f484009eb60 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f4838013000 tx=0x7f4838019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:10.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.578+0000 7f483cff9700 1 -- 172.21.15.3:0/3831186280 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4838012e30 con 0x7f48400674b0 2023-10-08T15:41:10.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.578+0000 7f483cff9700 1 -- 172.21.15.3:0/3831186280 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4838001010 con 0x7f48400674b0 2023-10-08T15:41:10.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.578+0000 7f484580b700 1 -- 172.21.15.3:0/3831186280 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f484009d310 con 0x7f48400674b0 2023-10-08T15:41:10.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.578+0000 7f483cff9700 1 -- 172.21.15.3:0/3831186280 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48380276c0 con 0x7f48400674b0 2023-10-08T15:41:10.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.578+0000 7f484580b700 1 -- 172.21.15.3:0/3831186280 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f484009a1a0 con 0x7f48400674b0 2023-10-08T15:41:10.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.582+0000 7f484580b700 1 -- 172.21.15.3:0/3831186280 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f484009b450 con 0x7f48400674b0 2023-10-08T15:41:10.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.582+0000 7f483cff9700 1 -- 172.21.15.3:0/3831186280 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4838024070 con 0x7f48400674b0 2023-10-08T15:41:10.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.582+0000 7f483cff9700 1 --2- 172.21.15.3:0/3831186280 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4820060550 0x7f4820062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:10.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.582+0000 7f483cff9700 1 -- 172.21.15.3:0/3831186280 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f483807ecd0 con 0x7f48400674b0 2023-10-08T15:41:10.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.582+0000 7f4844809700 1 --2- 172.21.15.3:0/3831186280 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4820060550 0x7f4820062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:10.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.582+0000 7f4844809700 1 --2- 172.21.15.3:0/3831186280 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4820060550 0x7f4820062a00 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f48280058d0 tx=0x7f4828009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:10.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.586+0000 7f483cff9700 1 -- 172.21.15.3:0/3831186280 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f484009b450 con 0x7f48400674b0 2023-10-08T15:41:10.750 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.746+0000 7f484580b700 1 -- 172.21.15.3:0/3831186280 --> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f484009b450 con 0x7f4820060550 2023-10-08T15:41:10.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.766+0000 7f483cff9700 1 -- 172.21.15.3:0/3831186280 <== mgr.4102 v2:172.21.15.50:6832/33268 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287213 (secure 0 0 0) 0x7f484009b450 con 0x7f4820060550 2023-10-08T15:41:10.773 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:41:10.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.770+0000 7f484580b700 1 -- 172.21.15.3:0/3831186280 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4820060550 msgr2=0x7f4820062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:10.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.770+0000 7f484580b700 1 --2- 172.21.15.3:0/3831186280 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4820060550 0x7f4820062a00 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f48280058d0 tx=0x7f4828009040 comp rx=0 tx=0).stop 2023-10-08T15:41:10.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.770+0000 7f484580b700 1 -- 172.21.15.3:0/3831186280 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f48400674b0 msgr2=0x7f484009eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:10.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.770+0000 7f484580b700 1 --2- 172.21.15.3:0/3831186280 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f48400674b0 0x7f484009eb60 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f4838013000 tx=0x7f4838019000 comp rx=0 tx=0).stop 2023-10-08T15:41:10.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.770+0000 7f484580b700 1 -- 172.21.15.3:0/3831186280 shutdown_connections 2023-10-08T15:41:10.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.770+0000 7f484580b700 1 --2- 172.21.15.3:0/3831186280 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4820060550 0x7f4820062a00 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:10.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.770+0000 7f484580b700 1 --2- 172.21.15.3:0/3831186280 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4840069d50 0x7f484015e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:10.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.770+0000 7f484580b700 1 --2- 172.21.15.3:0/3831186280 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f48400674b0 0x7f484009eb60 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:10.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.770+0000 7f484580b700 1 --2- 172.21.15.3:0/3831186280 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f48400670e0 0x7f48400bf9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:10.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.770+0000 7f484580b700 1 -- 172.21.15.3:0/3831186280 >> 172.21.15.3:0/3831186280 conn(0x7f484006dfb0 msgr2=0x7f484014f250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:10.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.770+0000 7f484580b700 1 -- 172.21.15.3:0/3831186280 shutdown_connections 2023-10-08T15:41:10.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.770+0000 7f484580b700 1 -- 172.21.15.3:0/3831186280 wait complete. 2023-10-08T15:41:10.777 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2023-10-08T15:41:10.791 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2023-10-08T15:41:10.594973+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":126,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2448540,"kb_used_data":4700,"kb_used_omap":0,"kb_used_meta":2443776,"kb_avail":752526180,"statfs":{"total":773094113280,"available":770586808320,"internally_reserved":0,"allocated":4812800,"data_stored":3076788,"data_compressed":66282,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":2502426624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001888"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.455593+0000","last_change":"2023-10-08T15:41:06.452152+0000","last_active":"2023-10-08T15:41:06.455593+0000","last_peered":"2023-10-08T15:41:06.455593+0000","last_clean":"2023-10-08T15:41:06.455593+0000","last_became_active":"2023-10-08T15:41:06.451785+0000","last_became_peered":"2023-10-08T15:41:06.451785+0000","last_unstale":"2023-10-08T15:41:06.455593+0000","last_undegraded":"2023-10-08T15:41:06.455593+0000","last_fullsized":"2023-10-08T15:41:06.455593+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:04:06.979756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.464399+0000","last_change":"2023-10-08T15:41:06.457280+0000","last_active":"2023-10-08T15:41:06.464399+0000","last_peered":"2023-10-08T15:41:06.464399+0000","last_clean":"2023-10-08T15:41:06.464399+0000","last_became_active":"2023-10-08T15:41:06.455044+0000","last_became_peered":"2023-10-08T15:41:06.455044+0000","last_unstale":"2023-10-08T15:41:06.464399+0000","last_undegraded":"2023-10-08T15:41:06.464399+0000","last_fullsized":"2023-10-08T15:41:06.464399+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:38:53.950317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.450532+0000","last_change":"2023-10-08T15:41:06.443520+0000","last_active":"2023-10-08T15:41:06.450532+0000","last_peered":"2023-10-08T15:41:06.450532+0000","last_clean":"2023-10-08T15:41:06.450532+0000","last_became_active":"2023-10-08T15:41:06.442389+0000","last_became_peered":"2023-10-08T15:41:06.442389+0000","last_unstale":"2023-10-08T15:41:06.450532+0000","last_undegraded":"2023-10-08T15:41:06.450532+0000","last_fullsized":"2023-10-08T15:41:06.450532+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:10:44.771641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.448762+0000","last_change":"2023-10-08T15:41:06.448762+0000","last_active":"2023-10-08T15:41:06.448762+0000","last_peered":"2023-10-08T15:41:06.448762+0000","last_clean":"2023-10-08T15:41:06.448762+0000","last_became_active":"2023-10-08T15:41:06.448487+0000","last_became_peered":"2023-10-08T15:41:06.448487+0000","last_unstale":"2023-10-08T15:41:06.448762+0000","last_undegraded":"2023-10-08T15:41:06.448762+0000","last_fullsized":"2023-10-08T15:41:06.448762+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:37:41.814988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.447910+0000","last_change":"2023-10-08T15:41:06.442684+0000","last_active":"2023-10-08T15:41:06.447910+0000","last_peered":"2023-10-08T15:41:06.447910+0000","last_clean":"2023-10-08T15:41:06.447910+0000","last_became_active":"2023-10-08T15:41:06.442381+0000","last_became_peered":"2023-10-08T15:41:06.442381+0000","last_unstale":"2023-10-08T15:41:06.447910+0000","last_undegraded":"2023-10-08T15:41:06.447910+0000","last_fullsized":"2023-10-08T15:41:06.447910+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:03:31.710089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.459637+0000","last_change":"2023-10-08T15:41:06.446651+0000","last_active":"2023-10-08T15:41:06.459637+0000","last_peered":"2023-10-08T15:41:06.459637+0000","last_clean":"2023-10-08T15:41:06.459637+0000","last_became_active":"2023-10-08T15:41:06.446321+0000","last_became_peered":"2023-10-08T15:41:06.446321+0000","last_unstale":"2023-10-08T15:41:06.459637+0000","last_undegraded":"2023-10-08T15:41:06.459637+0000","last_fullsized":"2023-10-08T15:41:06.459637+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:58:39.797277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.445309+0000","last_change":"2023-10-08T15:41:06.445309+0000","last_active":"2023-10-08T15:41:06.445309+0000","last_peered":"2023-10-08T15:41:06.445309+0000","last_clean":"2023-10-08T15:41:06.445309+0000","last_became_active":"2023-10-08T15:41:06.444964+0000","last_became_peered":"2023-10-08T15:41:06.444964+0000","last_unstale":"2023-10-08T15:41:06.445309+0000","last_undegraded":"2023-10-08T15:41:06.445309+0000","last_fullsized":"2023-10-08T15:41:06.445309+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:32:43.679059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.464222+0000","last_change":"2023-10-08T15:41:06.454647+0000","last_active":"2023-10-08T15:41:06.464222+0000","last_peered":"2023-10-08T15:41:06.464222+0000","last_clean":"2023-10-08T15:41:06.464222+0000","last_became_active":"2023-10-08T15:41:06.454209+0000","last_became_peered":"2023-10-08T15:41:06.454209+0000","last_unstale":"2023-10-08T15:41:06.464222+0000","last_undegraded":"2023-10-08T15:41:06.464222+0000","last_fullsized":"2023-10-08T15:41:06.464222+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:16:39.321609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.444409+0000","last_change":"2023-10-08T15:41:06.444409+0000","last_active":"2023-10-08T15:41:06.444409+0000","last_peered":"2023-10-08T15:41:06.444409+0000","last_clean":"2023-10-08T15:41:06.444409+0000","last_became_active":"2023-10-08T15:41:06.444117+0000","last_became_peered":"2023-10-08T15:41:06.444117+0000","last_unstale":"2023-10-08T15:41:06.444409+0000","last_undegraded":"2023-10-08T15:41:06.444409+0000","last_fullsized":"2023-10-08T15:41:06.444409+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:18:23.055593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.453199+0000","last_change":"2023-10-08T15:41:06.435988+0000","last_active":"2023-10-08T15:41:06.453199+0000","last_peered":"2023-10-08T15:41:06.453199+0000","last_clean":"2023-10-08T15:41:06.453199+0000","last_became_active":"2023-10-08T15:41:06.435695+0000","last_became_peered":"2023-10-08T15:41:06.435695+0000","last_unstale":"2023-10-08T15:41:06.453199+0000","last_undegraded":"2023-10-08T15:41:06.453199+0000","last_fullsized":"2023-10-08T15:41:06.453199+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:37:38.169465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.462549+0000","last_change":"2023-10-08T15:41:06.455447+0000","last_active":"2023-10-08T15:41:06.462549+0000","last_peered":"2023-10-08T15:41:06.462549+0000","last_clean":"2023-10-08T15:41:06.462549+0000","last_became_active":"2023-10-08T15:41:06.455168+0000","last_became_peered":"2023-10-08T15:41:06.455168+0000","last_unstale":"2023-10-08T15:41:06.462549+0000","last_undegraded":"2023-10-08T15:41:06.462549+0000","last_fullsized":"2023-10-08T15:41:06.462549+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:43:12.044091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.447678+0000","last_change":"2023-10-08T15:41:06.447678+0000","last_active":"2023-10-08T15:41:06.447678+0000","last_peered":"2023-10-08T15:41:06.447678+0000","last_clean":"2023-10-08T15:41:06.447678+0000","last_became_active":"2023-10-08T15:41:06.447357+0000","last_became_peered":"2023-10-08T15:41:06.447357+0000","last_unstale":"2023-10-08T15:41:06.447678+0000","last_undegraded":"2023-10-08T15:41:06.447678+0000","last_fullsized":"2023-10-08T15:41:06.447678+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:55:57.583824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.449413+0000","last_change":"2023-10-08T15:41:06.443783+0000","last_active":"2023-10-08T15:41:06.449413+0000","last_peered":"2023-10-08T15:41:06.449413+0000","last_clean":"2023-10-08T15:41:06.449413+0000","last_became_active":"2023-10-08T15:41:06.443454+0000","last_became_peered":"2023-10-08T15:41:06.443454+0000","last_unstale":"2023-10-08T15:41:06.449413+0000","last_undegraded":"2023-10-08T15:41:06.449413+0000","last_fullsized":"2023-10-08T15:41:06.449413+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:51:44.543938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.433492+0000","last_change":"2023-10-08T15:41:06.433492+0000","last_active":"2023-10-08T15:41:06.433492+0000","last_peered":"2023-10-08T15:41:06.433492+0000","last_clean":"2023-10-08T15:41:06.433492+0000","last_became_active":"2023-10-08T15:41:06.433102+0000","last_became_peered":"2023-10-08T15:41:06.433102+0000","last_unstale":"2023-10-08T15:41:06.433492+0000","last_undegraded":"2023-10-08T15:41:06.433492+0000","last_fullsized":"2023-10-08T15:41:06.433492+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:06:52.575822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.434516+0000","last_change":"2023-10-08T15:41:06.434516+0000","last_active":"2023-10-08T15:41:06.434516+0000","last_peered":"2023-10-08T15:41:06.434516+0000","last_clean":"2023-10-08T15:41:06.434516+0000","last_became_active":"2023-10-08T15:41:06.432695+0000","last_became_peered":"2023-10-08T15:41:06.432695+0000","last_unstale":"2023-10-08T15:41:06.434516+0000","last_undegraded":"2023-10-08T15:41:06.434516+0000","last_fullsized":"2023-10-08T15:41:06.434516+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:18:50.762021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.462088+0000","last_change":"2023-10-08T15:41:06.458828+0000","last_active":"2023-10-08T15:41:06.462088+0000","last_peered":"2023-10-08T15:41:06.462088+0000","last_clean":"2023-10-08T15:41:06.462088+0000","last_became_active":"2023-10-08T15:41:06.458472+0000","last_became_peered":"2023-10-08T15:41:06.458472+0000","last_unstale":"2023-10-08T15:41:06.462088+0000","last_undegraded":"2023-10-08T15:41:06.462088+0000","last_fullsized":"2023-10-08T15:41:06.462088+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:10:13.012202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.459445+0000","last_change":"2023-10-08T15:41:06.451302+0000","last_active":"2023-10-08T15:41:06.459445+0000","last_peered":"2023-10-08T15:41:06.459445+0000","last_clean":"2023-10-08T15:41:06.459445+0000","last_became_active":"2023-10-08T15:41:06.450346+0000","last_became_peered":"2023-10-08T15:41:06.450346+0000","last_unstale":"2023-10-08T15:41:06.459445+0000","last_undegraded":"2023-10-08T15:41:06.459445+0000","last_fullsized":"2023-10-08T15:41:06.459445+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:46:14.988801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.450716+0000","last_change":"2023-10-08T15:41:06.444104+0000","last_active":"2023-10-08T15:41:06.450716+0000","last_peered":"2023-10-08T15:41:06.450716+0000","last_clean":"2023-10-08T15:41:06.450716+0000","last_became_active":"2023-10-08T15:41:06.443784+0000","last_became_peered":"2023-10-08T15:41:06.443784+0000","last_unstale":"2023-10-08T15:41:06.450716+0000","last_undegraded":"2023-10-08T15:41:06.450716+0000","last_fullsized":"2023-10-08T15:41:06.450716+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:05:50.711417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.462138+0000","last_change":"2023-10-08T15:41:06.459029+0000","last_active":"2023-10-08T15:41:06.462138+0000","last_peered":"2023-10-08T15:41:06.462138+0000","last_clean":"2023-10-08T15:41:06.462138+0000","last_became_active":"2023-10-08T15:41:06.458725+0000","last_became_peered":"2023-10-08T15:41:06.458725+0000","last_unstale":"2023-10-08T15:41:06.462138+0000","last_undegraded":"2023-10-08T15:41:06.462138+0000","last_fullsized":"2023-10-08T15:41:06.462138+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:14:52.209223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.459529+0000","last_change":"2023-10-08T15:41:06.450372+0000","last_active":"2023-10-08T15:41:06.459529+0000","last_peered":"2023-10-08T15:41:06.459529+0000","last_clean":"2023-10-08T15:41:06.459529+0000","last_became_active":"2023-10-08T15:41:06.450063+0000","last_became_peered":"2023-10-08T15:41:06.450063+0000","last_unstale":"2023-10-08T15:41:06.459529+0000","last_undegraded":"2023-10-08T15:41:06.459529+0000","last_fullsized":"2023-10-08T15:41:06.459529+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:34:29.694180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.452028+0000","last_change":"2023-10-08T15:41:06.446624+0000","last_active":"2023-10-08T15:41:06.452028+0000","last_peered":"2023-10-08T15:41:06.452028+0000","last_clean":"2023-10-08T15:41:06.452028+0000","last_became_active":"2023-10-08T15:41:06.446298+0000","last_became_peered":"2023-10-08T15:41:06.446298+0000","last_unstale":"2023-10-08T15:41:06.452028+0000","last_undegraded":"2023-10-08T15:41:06.452028+0000","last_fullsized":"2023-10-08T15:41:06.452028+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:44:38.503380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.460491+0000","last_change":"2023-10-08T15:41:06.451294+0000","last_active":"2023-10-08T15:41:06.460491+0000","last_peered":"2023-10-08T15:41:06.460491+0000","last_clean":"2023-10-08T15:41:06.460491+0000","last_became_active":"2023-10-08T15:41:06.448302+0000","last_became_peered":"2023-10-08T15:41:06.448302+0000","last_unstale":"2023-10-08T15:41:06.460491+0000","last_undegraded":"2023-10-08T15:41:06.460491+0000","last_fullsized":"2023-10-08T15:41:06.460491+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:37:53.277090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.460226+0000","last_change":"2023-10-08T15:41:06.454128+0000","last_active":"2023-10-08T15:41:06.460226+0000","last_peered":"2023-10-08T15:41:06.460226+0000","last_clean":"2023-10-08T15:41:06.460226+0000","last_became_active":"2023-10-08T15:41:06.453249+0000","last_became_peered":"2023-10-08T15:41:06.453249+0000","last_unstale":"2023-10-08T15:41:06.460226+0000","last_undegraded":"2023-10-08T15:41:06.460226+0000","last_fullsized":"2023-10-08T15:41:06.460226+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:54:45.803734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.450069+0000","last_change":"2023-10-08T15:41:06.447102+0000","last_active":"2023-10-08T15:41:06.450069+0000","last_peered":"2023-10-08T15:41:06.450069+0000","last_clean":"2023-10-08T15:41:06.450069+0000","last_became_active":"2023-10-08T15:41:06.446781+0000","last_became_peered":"2023-10-08T15:41:06.446781+0000","last_unstale":"2023-10-08T15:41:06.450069+0000","last_undegraded":"2023-10-08T15:41:06.450069+0000","last_fullsized":"2023-10-08T15:41:06.450069+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:30:43.795702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.455674+0000","last_change":"2023-10-08T15:41:06.453817+0000","last_active":"2023-10-08T15:41:06.455674+0000","last_peered":"2023-10-08T15:41:06.455674+0000","last_clean":"2023-10-08T15:41:06.455674+0000","last_became_active":"2023-10-08T15:41:06.453527+0000","last_became_peered":"2023-10-08T15:41:06.453527+0000","last_unstale":"2023-10-08T15:41:06.455674+0000","last_undegraded":"2023-10-08T15:41:06.455674+0000","last_fullsized":"2023-10-08T15:41:06.455674+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:44:11.863677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.455775+0000","last_change":"2023-10-08T15:41:06.455775+0000","last_active":"2023-10-08T15:41:06.455775+0000","last_peered":"2023-10-08T15:41:06.455775+0000","last_clean":"2023-10-08T15:41:06.455775+0000","last_became_active":"2023-10-08T15:41:06.455475+0000","last_became_peered":"2023-10-08T15:41:06.455475+0000","last_unstale":"2023-10-08T15:41:06.455775+0000","last_undegraded":"2023-10-08T15:41:06.455775+0000","last_fullsized":"2023-10-08T15:41:06.455775+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:18:23.055593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.447252+0000","last_change":"2023-10-08T15:41:06.442056+0000","last_active":"2023-10-08T15:41:06.447252+0000","last_peered":"2023-10-08T15:41:06.447252+0000","last_clean":"2023-10-08T15:41:06.447252+0000","last_became_active":"2023-10-08T15:41:06.441700+0000","last_became_peered":"2023-10-08T15:41:06.441700+0000","last_unstale":"2023-10-08T15:41:06.447252+0000","last_undegraded":"2023-10-08T15:41:06.447252+0000","last_fullsized":"2023-10-08T15:41:06.447252+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:14:36.594450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.447823+0000","last_change":"2023-10-08T15:41:06.442640+0000","last_active":"2023-10-08T15:41:06.447823+0000","last_peered":"2023-10-08T15:41:06.447823+0000","last_clean":"2023-10-08T15:41:06.447823+0000","last_became_active":"2023-10-08T15:41:06.442333+0000","last_became_peered":"2023-10-08T15:41:06.442333+0000","last_unstale":"2023-10-08T15:41:06.447823+0000","last_undegraded":"2023-10-08T15:41:06.447823+0000","last_fullsized":"2023-10-08T15:41:06.447823+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:58:34.489879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.459670+0000","last_change":"2023-10-08T15:41:06.449953+0000","last_active":"2023-10-08T15:41:06.459670+0000","last_peered":"2023-10-08T15:41:06.459670+0000","last_clean":"2023-10-08T15:41:06.459670+0000","last_became_active":"2023-10-08T15:41:06.448212+0000","last_became_peered":"2023-10-08T15:41:06.448212+0000","last_unstale":"2023-10-08T15:41:06.459670+0000","last_undegraded":"2023-10-08T15:41:06.459670+0000","last_fullsized":"2023-10-08T15:41:06.459670+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:40:53.711246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.445718+0000","last_change":"2023-10-08T15:41:06.436453+0000","last_active":"2023-10-08T15:41:06.445718+0000","last_peered":"2023-10-08T15:41:06.445718+0000","last_clean":"2023-10-08T15:41:06.445718+0000","last_became_active":"2023-10-08T15:41:06.436146+0000","last_became_peered":"2023-10-08T15:41:06.436146+0000","last_unstale":"2023-10-08T15:41:06.445718+0000","last_undegraded":"2023-10-08T15:41:06.445718+0000","last_fullsized":"2023-10-08T15:41:06.445718+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:13:18.443325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.439341+0000","last_change":"2023-10-08T15:41:06.436659+0000","last_active":"2023-10-08T15:41:06.439341+0000","last_peered":"2023-10-08T15:41:06.439341+0000","last_clean":"2023-10-08T15:41:06.439341+0000","last_became_active":"2023-10-08T15:41:06.436302+0000","last_became_peered":"2023-10-08T15:41:06.436302+0000","last_unstale":"2023-10-08T15:41:06.439341+0000","last_undegraded":"2023-10-08T15:41:06.439341+0000","last_fullsized":"2023-10-08T15:41:06.439341+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:34:33.661006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.462907+0000","last_change":"2023-10-08T15:41:06.461979+0000","last_active":"2023-10-08T15:41:06.462907+0000","last_peered":"2023-10-08T15:41:06.462907+0000","last_clean":"2023-10-08T15:41:06.462907+0000","last_became_active":"2023-10-08T15:41:06.461671+0000","last_became_peered":"2023-10-08T15:41:06.461671+0000","last_unstale":"2023-10-08T15:41:06.462907+0000","last_undegraded":"2023-10-08T15:41:06.462907+0000","last_fullsized":"2023-10-08T15:41:06.462907+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:59:43.421345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.461837+0000","last_change":"2023-10-08T15:41:06.450847+0000","last_active":"2023-10-08T15:41:06.461837+0000","last_peered":"2023-10-08T15:41:06.461837+0000","last_clean":"2023-10-08T15:41:06.461837+0000","last_became_active":"2023-10-08T15:41:06.450555+0000","last_became_peered":"2023-10-08T15:41:06.450555+0000","last_unstale":"2023-10-08T15:41:06.461837+0000","last_undegraded":"2023-10-08T15:41:06.461837+0000","last_fullsized":"2023-10-08T15:41:06.461837+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:40:15.011431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"48'4","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.463317+0000","last_change":"2023-10-08T15:41:05.428296+0000","last_active":"2023-10-08T15:41:06.463317+0000","last_peered":"2023-10-08T15:41:06.463317+0000","last_clean":"2023-10-08T15:41:06.463317+0000","last_became_active":"2023-10-08T15:41:05.426678+0000","last_became_peered":"2023-10-08T15:41:05.426678+0000","last_unstale":"2023-10-08T15:41:06.463317+0000","last_undegraded":"2023-10-08T15:41:06.463317+0000","last_fullsized":"2023-10-08T15:41:06.463317+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:46:31.857032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.453113+0000","last_change":"2023-10-08T15:41:06.435148+0000","last_active":"2023-10-08T15:41:06.453113+0000","last_peered":"2023-10-08T15:41:06.453113+0000","last_clean":"2023-10-08T15:41:06.453113+0000","last_became_active":"2023-10-08T15:41:06.434876+0000","last_became_peered":"2023-10-08T15:41:06.434876+0000","last_unstale":"2023-10-08T15:41:06.453113+0000","last_undegraded":"2023-10-08T15:41:06.453113+0000","last_fullsized":"2023-10-08T15:41:06.453113+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:45:38.568668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"48'1","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.465344+0000","last_change":"2023-10-08T15:41:05.416181+0000","last_active":"2023-10-08T15:41:06.465344+0000","last_peered":"2023-10-08T15:41:06.465344+0000","last_clean":"2023-10-08T15:41:06.465344+0000","last_became_active":"2023-10-08T15:41:05.415904+0000","last_became_peered":"2023-10-08T15:41:05.415904+0000","last_unstale":"2023-10-08T15:41:06.465344+0000","last_undegraded":"2023-10-08T15:41:06.465344+0000","last_fullsized":"2023-10-08T15:41:06.465344+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:55:56.572447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.462173+0000","last_change":"2023-10-08T15:41:06.461407+0000","last_active":"2023-10-08T15:41:06.462173+0000","last_peered":"2023-10-08T15:41:06.462173+0000","last_clean":"2023-10-08T15:41:06.462173+0000","last_became_active":"2023-10-08T15:41:06.461035+0000","last_became_peered":"2023-10-08T15:41:06.461035+0000","last_unstale":"2023-10-08T15:41:06.462173+0000","last_undegraded":"2023-10-08T15:41:06.462173+0000","last_fullsized":"2023-10-08T15:41:06.462173+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:20:28.396241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"48'2","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.460833+0000","last_change":"2023-10-08T15:41:05.425911+0000","last_active":"2023-10-08T15:41:06.460833+0000","last_peered":"2023-10-08T15:41:06.460833+0000","last_clean":"2023-10-08T15:41:06.460833+0000","last_became_active":"2023-10-08T15:41:05.425627+0000","last_became_peered":"2023-10-08T15:41:05.425627+0000","last_unstale":"2023-10-08T15:41:06.460833+0000","last_undegraded":"2023-10-08T15:41:06.460833+0000","last_fullsized":"2023-10-08T15:41:06.460833+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:15:45.526358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.447265+0000","last_change":"2023-10-08T15:41:06.442625+0000","last_active":"2023-10-08T15:41:06.447265+0000","last_peered":"2023-10-08T15:41:06.447265+0000","last_clean":"2023-10-08T15:41:06.447265+0000","last_became_active":"2023-10-08T15:41:06.442334+0000","last_became_peered":"2023-10-08T15:41:06.442334+0000","last_unstale":"2023-10-08T15:41:06.447265+0000","last_undegraded":"2023-10-08T15:41:06.447265+0000","last_fullsized":"2023-10-08T15:41:06.447265+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:59:37.982152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"48'2","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.463119+0000","last_change":"2023-10-08T15:41:05.424562+0000","last_active":"2023-10-08T15:41:06.463119+0000","last_peered":"2023-10-08T15:41:06.463119+0000","last_clean":"2023-10-08T15:41:06.463119+0000","last_became_active":"2023-10-08T15:41:05.424008+0000","last_became_peered":"2023-10-08T15:41:05.424008+0000","last_unstale":"2023-10-08T15:41:06.463119+0000","last_undegraded":"2023-10-08T15:41:06.463119+0000","last_fullsized":"2023-10-08T15:41:06.463119+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:01:52.196763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.459946+0000","last_change":"2023-10-08T15:41:06.450822+0000","last_active":"2023-10-08T15:41:06.459946+0000","last_peered":"2023-10-08T15:41:06.459946+0000","last_clean":"2023-10-08T15:41:06.459946+0000","last_became_active":"2023-10-08T15:41:06.448321+0000","last_became_peered":"2023-10-08T15:41:06.448321+0000","last_unstale":"2023-10-08T15:41:06.459946+0000","last_undegraded":"2023-10-08T15:41:06.459946+0000","last_fullsized":"2023-10-08T15:41:06.459946+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:43:18.728915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"48'1","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.426166+0000","last_change":"2023-10-08T15:41:05.422081+0000","last_active":"2023-10-08T15:41:06.426166+0000","last_peered":"2023-10-08T15:41:06.426166+0000","last_clean":"2023-10-08T15:41:06.426166+0000","last_became_active":"2023-10-08T15:41:05.421531+0000","last_became_peered":"2023-10-08T15:41:05.421531+0000","last_unstale":"2023-10-08T15:41:06.426166+0000","last_undegraded":"2023-10-08T15:41:06.426166+0000","last_fullsized":"2023-10-08T15:41:06.426166+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:30:08.152470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.458278+0000","last_change":"2023-10-08T15:41:06.449188+0000","last_active":"2023-10-08T15:41:06.458278+0000","last_peered":"2023-10-08T15:41:06.458278+0000","last_clean":"2023-10-08T15:41:06.458278+0000","last_became_active":"2023-10-08T15:41:06.448844+0000","last_became_peered":"2023-10-08T15:41:06.448844+0000","last_unstale":"2023-10-08T15:41:06.458278+0000","last_undegraded":"2023-10-08T15:41:06.458278+0000","last_fullsized":"2023-10-08T15:41:06.458278+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:09:05.913988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"48'1","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.460760+0000","last_change":"2023-10-08T15:41:05.422608+0000","last_active":"2023-10-08T15:41:06.460760+0000","last_peered":"2023-10-08T15:41:06.460760+0000","last_clean":"2023-10-08T15:41:06.460760+0000","last_became_active":"2023-10-08T15:41:05.422267+0000","last_became_peered":"2023-10-08T15:41:05.422267+0000","last_unstale":"2023-10-08T15:41:06.460760+0000","last_undegraded":"2023-10-08T15:41:06.460760+0000","last_fullsized":"2023-10-08T15:41:06.460760+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:39:04.618463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.450087+0000","last_change":"2023-10-08T15:41:06.447420+0000","last_active":"2023-10-08T15:41:06.450087+0000","last_peered":"2023-10-08T15:41:06.450087+0000","last_clean":"2023-10-08T15:41:06.450087+0000","last_became_active":"2023-10-08T15:41:06.447042+0000","last_became_peered":"2023-10-08T15:41:06.447042+0000","last_unstale":"2023-10-08T15:41:06.450087+0000","last_undegraded":"2023-10-08T15:41:06.450087+0000","last_fullsized":"2023-10-08T15:41:06.450087+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:43:23.999134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-08T15:41:05.429193+0000","last_change":"2023-10-08T15:41:05.427475+0000","last_active":"2023-10-08T15:41:05.429193+0000","last_peered":"2023-10-08T15:41:05.429193+0000","last_clean":"2023-10-08T15:41:05.429193+0000","last_became_active":"2023-10-08T15:41:05.427144+0000","last_became_peered":"2023-10-08T15:41:05.427144+0000","last_unstale":"2023-10-08T15:41:05.429193+0000","last_undegraded":"2023-10-08T15:41:05.429193+0000","last_fullsized":"2023-10-08T15:41:05.429193+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:25:04.072117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.460019+0000","last_change":"2023-10-08T15:41:06.450640+0000","last_active":"2023-10-08T15:41:06.460019+0000","last_peered":"2023-10-08T15:41:06.460019+0000","last_clean":"2023-10-08T15:41:06.460019+0000","last_became_active":"2023-10-08T15:41:06.450244+0000","last_became_peered":"2023-10-08T15:41:06.450244+0000","last_unstale":"2023-10-08T15:41:06.460019+0000","last_undegraded":"2023-10-08T15:41:06.460019+0000","last_fullsized":"2023-10-08T15:41:06.460019+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:48:41.755229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-08T15:41:05.420928+0000","last_change":"2023-10-08T15:41:05.418924+0000","last_active":"2023-10-08T15:41:05.420928+0000","last_peered":"2023-10-08T15:41:05.420928+0000","last_clean":"2023-10-08T15:41:05.420928+0000","last_became_active":"2023-10-08T15:41:05.418560+0000","last_became_peered":"2023-10-08T15:41:05.418560+0000","last_unstale":"2023-10-08T15:41:05.420928+0000","last_undegraded":"2023-10-08T15:41:05.420928+0000","last_fullsized":"2023-10-08T15:41:05.420928+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:01:52.196763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.433108+0000","last_change":"2023-10-08T15:41:06.433108+0000","last_active":"2023-10-08T15:41:06.433108+0000","last_peered":"2023-10-08T15:41:06.433108+0000","last_clean":"2023-10-08T15:41:06.433108+0000","last_became_active":"2023-10-08T15:41:06.432691+0000","last_became_peered":"2023-10-08T15:41:06.432691+0000","last_unstale":"2023-10-08T15:41:06.433108+0000","last_undegraded":"2023-10-08T15:41:06.433108+0000","last_fullsized":"2023-10-08T15:41:06.433108+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:19:51.870053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.433533+0000","last_change":"2023-10-08T15:41:05.432438+0000","last_active":"2023-10-08T15:41:06.433533+0000","last_peered":"2023-10-08T15:41:06.433533+0000","last_clean":"2023-10-08T15:41:06.433533+0000","last_became_active":"2023-10-08T15:41:05.432093+0000","last_became_peered":"2023-10-08T15:41:05.432093+0000","last_unstale":"2023-10-08T15:41:06.433533+0000","last_undegraded":"2023-10-08T15:41:06.433533+0000","last_fullsized":"2023-10-08T15:41:06.433533+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:08:39.146318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.450448+0000","last_change":"2023-10-08T15:41:06.442416+0000","last_active":"2023-10-08T15:41:06.450448+0000","last_peered":"2023-10-08T15:41:06.450448+0000","last_clean":"2023-10-08T15:41:06.450448+0000","last_became_active":"2023-10-08T15:41:06.442010+0000","last_became_peered":"2023-10-08T15:41:06.442010+0000","last_unstale":"2023-10-08T15:41:06.450448+0000","last_undegraded":"2023-10-08T15:41:06.450448+0000","last_fullsized":"2023-10-08T15:41:06.450448+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:08:36.921466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.437836+0000","last_change":"2023-10-08T15:41:05.424925+0000","last_active":"2023-10-08T15:41:06.437836+0000","last_peered":"2023-10-08T15:41:06.437836+0000","last_clean":"2023-10-08T15:41:06.437836+0000","last_became_active":"2023-10-08T15:41:05.424603+0000","last_became_peered":"2023-10-08T15:41:05.424603+0000","last_unstale":"2023-10-08T15:41:06.437836+0000","last_undegraded":"2023-10-08T15:41:06.437836+0000","last_fullsized":"2023-10-08T15:41:06.437836+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:20:27.384865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.440106+0000","last_change":"2023-10-08T15:41:06.433500+0000","last_active":"2023-10-08T15:41:06.440106+0000","last_peered":"2023-10-08T15:41:06.440106+0000","last_clean":"2023-10-08T15:41:06.440106+0000","last_became_active":"2023-10-08T15:41:06.433082+0000","last_became_peered":"2023-10-08T15:41:06.433082+0000","last_unstale":"2023-10-08T15:41:06.440106+0000","last_undegraded":"2023-10-08T15:41:06.440106+0000","last_fullsized":"2023-10-08T15:41:06.440106+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:24.987918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"48'3","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.464247+0000","last_change":"2023-10-08T15:41:05.425052+0000","last_active":"2023-10-08T15:41:06.464247+0000","last_peered":"2023-10-08T15:41:06.464247+0000","last_clean":"2023-10-08T15:41:06.464247+0000","last_became_active":"2023-10-08T15:41:05.424615+0000","last_became_peered":"2023-10-08T15:41:05.424615+0000","last_unstale":"2023-10-08T15:41:06.464247+0000","last_undegraded":"2023-10-08T15:41:06.464247+0000","last_fullsized":"2023-10-08T15:41:06.464247+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:23.976541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.450570+0000","last_change":"2023-10-08T15:41:06.444134+0000","last_active":"2023-10-08T15:41:06.450570+0000","last_peered":"2023-10-08T15:41:06.450570+0000","last_clean":"2023-10-08T15:41:06.450570+0000","last_became_active":"2023-10-08T15:41:06.442788+0000","last_became_peered":"2023-10-08T15:41:06.442788+0000","last_unstale":"2023-10-08T15:41:06.450570+0000","last_undegraded":"2023-10-08T15:41:06.450570+0000","last_fullsized":"2023-10-08T15:41:06.450570+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:10:59.834960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"48'6","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.463676+0000","last_change":"2023-10-08T15:41:05.427226+0000","last_active":"2023-10-08T15:41:06.463676+0000","last_peered":"2023-10-08T15:41:06.463676+0000","last_clean":"2023-10-08T15:41:06.463676+0000","last_became_active":"2023-10-08T15:41:05.426875+0000","last_became_peered":"2023-10-08T15:41:05.426875+0000","last_unstale":"2023-10-08T15:41:06.463676+0000","last_undegraded":"2023-10-08T15:41:06.463676+0000","last_fullsized":"2023-10-08T15:41:06.463676+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:34:57.157992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.459755+0000","last_change":"2023-10-08T15:41:06.459755+0000","last_active":"2023-10-08T15:41:06.459755+0000","last_peered":"2023-10-08T15:41:06.459755+0000","last_clean":"2023-10-08T15:41:06.459755+0000","last_became_active":"2023-10-08T15:41:06.459452+0000","last_became_peered":"2023-10-08T15:41:06.459452+0000","last_unstale":"2023-10-08T15:41:06.459755+0000","last_undegraded":"2023-10-08T15:41:06.459755+0000","last_fullsized":"2023-10-08T15:41:06.459755+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:20:28.396241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"48'2","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.465332+0000","last_change":"2023-10-08T15:41:05.420869+0000","last_active":"2023-10-08T15:41:06.465332+0000","last_peered":"2023-10-08T15:41:06.465332+0000","last_clean":"2023-10-08T15:41:06.465332+0000","last_became_active":"2023-10-08T15:41:05.420568+0000","last_became_peered":"2023-10-08T15:41:05.420568+0000","last_unstale":"2023-10-08T15:41:06.465332+0000","last_undegraded":"2023-10-08T15:41:06.465332+0000","last_fullsized":"2023-10-08T15:41:06.465332+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:58:38.785900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.450597+0000","last_change":"2023-10-08T15:41:06.442522+0000","last_active":"2023-10-08T15:41:06.450597+0000","last_peered":"2023-10-08T15:41:06.450597+0000","last_clean":"2023-10-08T15:41:06.450597+0000","last_became_active":"2023-10-08T15:41:06.441904+0000","last_became_peered":"2023-10-08T15:41:06.441904+0000","last_unstale":"2023-10-08T15:41:06.450597+0000","last_undegraded":"2023-10-08T15:41:06.450597+0000","last_fullsized":"2023-10-08T15:41:06.450597+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:23:00.462449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.434894+0000","last_change":"2023-10-08T15:41:05.421625+0000","last_active":"2023-10-08T15:41:06.434894+0000","last_peered":"2023-10-08T15:41:06.434894+0000","last_clean":"2023-10-08T15:41:06.434894+0000","last_became_active":"2023-10-08T15:41:05.421073+0000","last_became_peered":"2023-10-08T15:41:05.421073+0000","last_unstale":"2023-10-08T15:41:06.434894+0000","last_undegraded":"2023-10-08T15:41:06.434894+0000","last_fullsized":"2023-10-08T15:41:06.434894+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:02:18.624782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.436866+0000","last_change":"2023-10-08T15:41:06.436866+0000","last_active":"2023-10-08T15:41:06.436866+0000","last_peered":"2023-10-08T15:41:06.436866+0000","last_clean":"2023-10-08T15:41:06.436866+0000","last_became_active":"2023-10-08T15:41:06.436472+0000","last_became_peered":"2023-10-08T15:41:06.436472+0000","last_unstale":"2023-10-08T15:41:06.436866+0000","last_undegraded":"2023-10-08T15:41:06.436866+0000","last_fullsized":"2023-10-08T15:41:06.436866+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:51:11.469061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-08T15:41:05.429177+0000","last_change":"2023-10-08T15:41:05.425516+0000","last_active":"2023-10-08T15:41:05.429177+0000","last_peered":"2023-10-08T15:41:05.429177+0000","last_clean":"2023-10-08T15:41:05.429177+0000","last_became_active":"2023-10-08T15:41:05.425222+0000","last_became_peered":"2023-10-08T15:41:05.425222+0000","last_unstale":"2023-10-08T15:41:05.429177+0000","last_undegraded":"2023-10-08T15:41:05.429177+0000","last_fullsized":"2023-10-08T15:41:05.429177+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:34:57.157992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.460205+0000","last_change":"2023-10-08T15:41:06.453927+0000","last_active":"2023-10-08T15:41:06.460205+0000","last_peered":"2023-10-08T15:41:06.460205+0000","last_clean":"2023-10-08T15:41:06.460205+0000","last_became_active":"2023-10-08T15:41:06.453515+0000","last_became_peered":"2023-10-08T15:41:06.453515+0000","last_unstale":"2023-10-08T15:41:06.460205+0000","last_undegraded":"2023-10-08T15:41:06.460205+0000","last_fullsized":"2023-10-08T15:41:06.460205+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:40:27.438245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"48'8","reported_seq":18,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.464195+0000","last_change":"2023-10-08T15:41:05.428308+0000","last_active":"2023-10-08T15:41:06.464195+0000","last_peered":"2023-10-08T15:41:06.464195+0000","last_clean":"2023-10-08T15:41:06.464195+0000","last_became_active":"2023-10-08T15:41:05.428001+0000","last_became_peered":"2023-10-08T15:41:05.428001+0000","last_unstale":"2023-10-08T15:41:06.464195+0000","last_undegraded":"2023-10-08T15:41:06.464195+0000","last_fullsized":"2023-10-08T15:41:06.464195+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:43:11.032714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.451863+0000","last_change":"2023-10-08T15:41:06.448757+0000","last_active":"2023-10-08T15:41:06.451863+0000","last_peered":"2023-10-08T15:41:06.451863+0000","last_clean":"2023-10-08T15:41:06.451863+0000","last_became_active":"2023-10-08T15:41:06.448291+0000","last_became_peered":"2023-10-08T15:41:06.448291+0000","last_unstale":"2023-10-08T15:41:06.451863+0000","last_undegraded":"2023-10-08T15:41:06.451863+0000","last_fullsized":"2023-10-08T15:41:06.451863+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:30:47.336020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"48'1","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.459248+0000","last_change":"2023-10-08T15:41:05.420407+0000","last_active":"2023-10-08T15:41:06.459248+0000","last_peered":"2023-10-08T15:41:06.459248+0000","last_clean":"2023-10-08T15:41:06.459248+0000","last_became_active":"2023-10-08T15:41:05.420122+0000","last_became_peered":"2023-10-08T15:41:05.420122+0000","last_unstale":"2023-10-08T15:41:06.459248+0000","last_undegraded":"2023-10-08T15:41:06.459248+0000","last_fullsized":"2023-10-08T15:41:06.459248+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:23:48.987488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.455866+0000","last_change":"2023-10-08T15:41:06.455866+0000","last_active":"2023-10-08T15:41:06.455866+0000","last_peered":"2023-10-08T15:41:06.455866+0000","last_clean":"2023-10-08T15:41:06.455866+0000","last_became_active":"2023-10-08T15:41:06.455570+0000","last_became_peered":"2023-10-08T15:41:06.455570+0000","last_unstale":"2023-10-08T15:41:06.455866+0000","last_undegraded":"2023-10-08T15:41:06.455866+0000","last_fullsized":"2023-10-08T15:41:06.455866+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:23:49.998865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"48'2","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.461783+0000","last_change":"2023-10-08T15:41:05.425585+0000","last_active":"2023-10-08T15:41:06.461783+0000","last_peered":"2023-10-08T15:41:06.461783+0000","last_clean":"2023-10-08T15:41:06.461783+0000","last_became_active":"2023-10-08T15:41:05.425267+0000","last_became_peered":"2023-10-08T15:41:05.425267+0000","last_unstale":"2023-10-08T15:41:06.461783+0000","last_undegraded":"2023-10-08T15:41:06.461783+0000","last_fullsized":"2023-10-08T15:41:06.461783+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:46:33.678799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.459549+0000","last_change":"2023-10-08T15:41:06.451364+0000","last_active":"2023-10-08T15:41:06.459549+0000","last_peered":"2023-10-08T15:41:06.459549+0000","last_clean":"2023-10-08T15:41:06.459549+0000","last_became_active":"2023-10-08T15:41:06.450939+0000","last_became_peered":"2023-10-08T15:41:06.450939+0000","last_unstale":"2023-10-08T15:41:06.459549+0000","last_undegraded":"2023-10-08T15:41:06.459549+0000","last_fullsized":"2023-10-08T15:41:06.459549+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:46.585533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"48'1","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.441451+0000","last_change":"2023-10-08T15:41:05.423819+0000","last_active":"2023-10-08T15:41:06.441451+0000","last_peered":"2023-10-08T15:41:06.441451+0000","last_clean":"2023-10-08T15:41:06.441451+0000","last_became_active":"2023-10-08T15:41:05.419732+0000","last_became_peered":"2023-10-08T15:41:05.419732+0000","last_unstale":"2023-10-08T15:41:06.441451+0000","last_undegraded":"2023-10-08T15:41:06.441451+0000","last_fullsized":"2023-10-08T15:41:06.441451+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:40:58.940180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.450552+0000","last_change":"2023-10-08T15:41:06.443735+0000","last_active":"2023-10-08T15:41:06.450552+0000","last_peered":"2023-10-08T15:41:06.450552+0000","last_clean":"2023-10-08T15:41:06.450552+0000","last_became_active":"2023-10-08T15:41:06.443131+0000","last_became_peered":"2023-10-08T15:41:06.443131+0000","last_unstale":"2023-10-08T15:41:06.450552+0000","last_undegraded":"2023-10-08T15:41:06.450552+0000","last_fullsized":"2023-10-08T15:41:06.450552+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:46:10.449586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.439788+0000","last_change":"2023-10-08T15:41:05.429701+0000","last_active":"2023-10-08T15:41:06.439788+0000","last_peered":"2023-10-08T15:41:06.439788+0000","last_clean":"2023-10-08T15:41:06.439788+0000","last_became_active":"2023-10-08T15:41:05.429418+0000","last_became_peered":"2023-10-08T15:41:05.429418+0000","last_unstale":"2023-10-08T15:41:06.439788+0000","last_undegraded":"2023-10-08T15:41:06.439788+0000","last_fullsized":"2023-10-08T15:41:06.439788+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:45:12.183728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.459868+0000","last_change":"2023-10-08T15:41:06.459868+0000","last_active":"2023-10-08T15:41:06.459868+0000","last_peered":"2023-10-08T15:41:06.459868+0000","last_clean":"2023-10-08T15:41:06.459868+0000","last_became_active":"2023-10-08T15:41:06.459533+0000","last_became_peered":"2023-10-08T15:41:06.459533+0000","last_unstale":"2023-10-08T15:41:06.459868+0000","last_undegraded":"2023-10-08T15:41:06.459868+0000","last_fullsized":"2023-10-08T15:41:06.459868+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:37:41.807860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"48'2","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.465368+0000","last_change":"2023-10-08T15:41:05.417041+0000","last_active":"2023-10-08T15:41:06.465368+0000","last_peered":"2023-10-08T15:41:06.465368+0000","last_clean":"2023-10-08T15:41:06.465368+0000","last_became_active":"2023-10-08T15:41:05.416757+0000","last_became_peered":"2023-10-08T15:41:05.416757+0000","last_unstale":"2023-10-08T15:41:06.465368+0000","last_undegraded":"2023-10-08T15:41:06.465368+0000","last_fullsized":"2023-10-08T15:41:06.465368+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:18:22.044216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.447328+0000","last_change":"2023-10-08T15:41:06.443162+0000","last_active":"2023-10-08T15:41:06.447328+0000","last_peered":"2023-10-08T15:41:06.447328+0000","last_clean":"2023-10-08T15:41:06.447328+0000","last_became_active":"2023-10-08T15:41:06.441805+0000","last_became_peered":"2023-10-08T15:41:06.441805+0000","last_unstale":"2023-10-08T15:41:06.447328+0000","last_undegraded":"2023-10-08T15:41:06.447328+0000","last_fullsized":"2023-10-08T15:41:06.447328+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:37:41.814988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.422525+0000","last_change":"2023-10-08T15:41:05.420900+0000","last_active":"2023-10-08T15:41:06.422525+0000","last_peered":"2023-10-08T15:41:06.422525+0000","last_clean":"2023-10-08T15:41:06.422525+0000","last_became_active":"2023-10-08T15:41:05.420573+0000","last_became_peered":"2023-10-08T15:41:05.420573+0000","last_unstale":"2023-10-08T15:41:06.422525+0000","last_undegraded":"2023-10-08T15:41:06.422525+0000","last_fullsized":"2023-10-08T15:41:06.422525+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:30:42.784325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.458297+0000","last_change":"2023-10-08T15:41:06.445383+0000","last_active":"2023-10-08T15:41:06.458297+0000","last_peered":"2023-10-08T15:41:06.458297+0000","last_clean":"2023-10-08T15:41:06.458297+0000","last_became_active":"2023-10-08T15:41:06.445037+0000","last_became_peered":"2023-10-08T15:41:06.445037+0000","last_unstale":"2023-10-08T15:41:06.458297+0000","last_undegraded":"2023-10-08T15:41:06.458297+0000","last_fullsized":"2023-10-08T15:41:06.458297+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:46.585533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-08T15:41:05.428018+0000","last_change":"2023-10-08T15:41:05.423733+0000","last_active":"2023-10-08T15:41:05.428018+0000","last_peered":"2023-10-08T15:41:05.428018+0000","last_clean":"2023-10-08T15:41:05.428018+0000","last_became_active":"2023-10-08T15:41:05.423416+0000","last_became_peered":"2023-10-08T15:41:05.423416+0000","last_unstale":"2023-10-08T15:41:05.428018+0000","last_undegraded":"2023-10-08T15:41:05.428018+0000","last_fullsized":"2023-10-08T15:41:05.428018+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:53:50.387647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.448896+0000","last_change":"2023-10-08T15:41:06.448896+0000","last_active":"2023-10-08T15:41:06.448896+0000","last_peered":"2023-10-08T15:41:06.448896+0000","last_clean":"2023-10-08T15:41:06.448896+0000","last_became_active":"2023-10-08T15:41:06.448611+0000","last_became_peered":"2023-10-08T15:41:06.448611+0000","last_unstale":"2023-10-08T15:41:06.448896+0000","last_undegraded":"2023-10-08T15:41:06.448896+0000","last_fullsized":"2023-10-08T15:41:06.448896+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:10.730958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"48'2","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.464971+0000","last_change":"2023-10-08T15:41:05.419823+0000","last_active":"2023-10-08T15:41:06.464971+0000","last_peered":"2023-10-08T15:41:06.464971+0000","last_clean":"2023-10-08T15:41:06.464971+0000","last_became_active":"2023-10-08T15:41:05.419518+0000","last_became_peered":"2023-10-08T15:41:05.419518+0000","last_unstale":"2023-10-08T15:41:06.464971+0000","last_undegraded":"2023-10-08T15:41:06.464971+0000","last_fullsized":"2023-10-08T15:41:06.464971+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:43:22.987757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.449113+0000","last_change":"2023-10-08T15:41:06.449113+0000","last_active":"2023-10-08T15:41:06.449113+0000","last_peered":"2023-10-08T15:41:06.449113+0000","last_clean":"2023-10-08T15:41:06.449113+0000","last_became_active":"2023-10-08T15:41:06.448029+0000","last_became_peered":"2023-10-08T15:41:06.448029+0000","last_unstale":"2023-10-08T15:41:06.449113+0000","last_undegraded":"2023-10-08T15:41:06.449113+0000","last_fullsized":"2023-10-08T15:41:06.449113+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:58:39.797277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.439574+0000","last_change":"2023-10-08T15:41:05.430736+0000","last_active":"2023-10-08T15:41:06.439574+0000","last_peered":"2023-10-08T15:41:06.439574+0000","last_clean":"2023-10-08T15:41:06.439574+0000","last_became_active":"2023-10-08T15:41:05.430331+0000","last_became_peered":"2023-10-08T15:41:05.430331+0000","last_unstale":"2023-10-08T15:41:06.439574+0000","last_undegraded":"2023-10-08T15:41:06.439574+0000","last_fullsized":"2023-10-08T15:41:06.439574+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:53:50.387647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.454275+0000","last_change":"2023-10-08T15:41:06.435766+0000","last_active":"2023-10-08T15:41:06.454275+0000","last_peered":"2023-10-08T15:41:06.454275+0000","last_clean":"2023-10-08T15:41:06.454275+0000","last_became_active":"2023-10-08T15:41:06.435473+0000","last_became_peered":"2023-10-08T15:41:06.435473+0000","last_unstale":"2023-10-08T15:41:06.454275+0000","last_undegraded":"2023-10-08T15:41:06.454275+0000","last_fullsized":"2023-10-08T15:41:06.454275+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:52:10.298432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.434877+0000","last_change":"2023-10-08T15:41:05.417963+0000","last_active":"2023-10-08T15:41:06.434877+0000","last_peered":"2023-10-08T15:41:06.434877+0000","last_clean":"2023-10-08T15:41:06.434877+0000","last_became_active":"2023-10-08T15:41:05.417670+0000","last_became_peered":"2023-10-08T15:41:05.417670+0000","last_unstale":"2023-10-08T15:41:06.434877+0000","last_undegraded":"2023-10-08T15:41:06.434877+0000","last_fullsized":"2023-10-08T15:41:06.434877+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:39:25.403059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.447273+0000","last_change":"2023-10-08T15:41:06.444273+0000","last_active":"2023-10-08T15:41:06.447273+0000","last_peered":"2023-10-08T15:41:06.447273+0000","last_clean":"2023-10-08T15:41:06.447273+0000","last_became_active":"2023-10-08T15:41:06.444002+0000","last_became_peered":"2023-10-08T15:41:06.444002+0000","last_unstale":"2023-10-08T15:41:06.447273+0000","last_undegraded":"2023-10-08T15:41:06.447273+0000","last_fullsized":"2023-10-08T15:41:06.447273+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:17:04.496253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-08T15:41:05.428085+0000","last_change":"2023-10-08T15:41:05.423187+0000","last_active":"2023-10-08T15:41:05.428085+0000","last_peered":"2023-10-08T15:41:05.428085+0000","last_clean":"2023-10-08T15:41:05.428085+0000","last_became_active":"2023-10-08T15:41:05.419599+0000","last_became_peered":"2023-10-08T15:41:05.419599+0000","last_unstale":"2023-10-08T15:41:05.428085+0000","last_undegraded":"2023-10-08T15:41:05.428085+0000","last_fullsized":"2023-10-08T15:41:05.428085+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:30:08.152470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.465309+0000","last_change":"2023-10-08T15:41:06.458231+0000","last_active":"2023-10-08T15:41:06.465309+0000","last_peered":"2023-10-08T15:41:06.465309+0000","last_clean":"2023-10-08T15:41:06.465309+0000","last_became_active":"2023-10-08T15:41:06.457747+0000","last_became_peered":"2023-10-08T15:41:06.457747+0000","last_unstale":"2023-10-08T15:41:06.465309+0000","last_undegraded":"2023-10-08T15:41:06.465309+0000","last_fullsized":"2023-10-08T15:41:06.465309+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:00:24.445256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.422509+0000","last_change":"2023-10-08T15:41:05.426493+0000","last_active":"2023-10-08T15:41:06.422509+0000","last_peered":"2023-10-08T15:41:06.422509+0000","last_clean":"2023-10-08T15:41:06.422509+0000","last_became_active":"2023-10-08T15:41:05.426089+0000","last_became_peered":"2023-10-08T15:41:05.426089+0000","last_unstale":"2023-10-08T15:41:06.422509+0000","last_undegraded":"2023-10-08T15:41:06.422509+0000","last_fullsized":"2023-10-08T15:41:06.422509+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:47:58.708925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.452397+0000","last_change":"2023-10-08T15:41:06.451904+0000","last_active":"2023-10-08T15:41:06.452397+0000","last_peered":"2023-10-08T15:41:06.452397+0000","last_clean":"2023-10-08T15:41:06.452397+0000","last_became_active":"2023-10-08T15:41:06.451029+0000","last_became_peered":"2023-10-08T15:41:06.451029+0000","last_unstale":"2023-10-08T15:41:06.452397+0000","last_undegraded":"2023-10-08T15:41:06.452397+0000","last_fullsized":"2023-10-08T15:41:06.452397+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:03:07.422056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-08T15:41:05.423736+0000","last_change":"2023-10-08T15:41:05.422862+0000","last_active":"2023-10-08T15:41:05.423736+0000","last_peered":"2023-10-08T15:41:05.423736+0000","last_clean":"2023-10-08T15:41:05.423736+0000","last_became_active":"2023-10-08T15:41:05.422495+0000","last_became_peered":"2023-10-08T15:41:05.422495+0000","last_unstale":"2023-10-08T15:41:05.423736+0000","last_undegraded":"2023-10-08T15:41:05.423736+0000","last_fullsized":"2023-10-08T15:41:05.423736+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:26:54.388269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.453160+0000","last_change":"2023-10-08T15:41:06.437140+0000","last_active":"2023-10-08T15:41:06.453160+0000","last_peered":"2023-10-08T15:41:06.453160+0000","last_clean":"2023-10-08T15:41:06.453160+0000","last_became_active":"2023-10-08T15:41:06.436854+0000","last_became_peered":"2023-10-08T15:41:06.436854+0000","last_unstale":"2023-10-08T15:41:06.453160+0000","last_undegraded":"2023-10-08T15:41:06.453160+0000","last_fullsized":"2023-10-08T15:41:06.453160+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:25:42.944981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.422496+0000","last_change":"2023-10-08T15:41:05.422963+0000","last_active":"2023-10-08T15:41:06.422496+0000","last_peered":"2023-10-08T15:41:06.422496+0000","last_clean":"2023-10-08T15:41:06.422496+0000","last_became_active":"2023-10-08T15:41:05.422669+0000","last_became_peered":"2023-10-08T15:41:05.422669+0000","last_unstale":"2023-10-08T15:41:06.422496+0000","last_undegraded":"2023-10-08T15:41:06.422496+0000","last_fullsized":"2023-10-08T15:41:06.422496+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:54:59.548259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.459998+0000","last_change":"2023-10-08T15:41:06.450556+0000","last_active":"2023-10-08T15:41:06.459998+0000","last_peered":"2023-10-08T15:41:06.459998+0000","last_clean":"2023-10-08T15:41:06.459998+0000","last_became_active":"2023-10-08T15:41:06.449855+0000","last_became_peered":"2023-10-08T15:41:06.449855+0000","last_unstale":"2023-10-08T15:41:06.459998+0000","last_undegraded":"2023-10-08T15:41:06.459998+0000","last_fullsized":"2023-10-08T15:41:06.459998+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:04:32.249612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.437155+0000","last_change":"2023-10-08T15:41:05.426634+0000","last_active":"2023-10-08T15:41:06.437155+0000","last_peered":"2023-10-08T15:41:06.437155+0000","last_clean":"2023-10-08T15:41:06.437155+0000","last_became_active":"2023-10-08T15:41:05.426314+0000","last_became_peered":"2023-10-08T15:41:05.426314+0000","last_unstale":"2023-10-08T15:41:06.437155+0000","last_undegraded":"2023-10-08T15:41:06.437155+0000","last_fullsized":"2023-10-08T15:41:06.437155+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:37:40.796483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.454855+0000","last_change":"2023-10-08T15:41:06.448899+0000","last_active":"2023-10-08T15:41:06.454855+0000","last_peered":"2023-10-08T15:41:06.454855+0000","last_clean":"2023-10-08T15:41:06.454855+0000","last_became_active":"2023-10-08T15:41:06.448490+0000","last_became_peered":"2023-10-08T15:41:06.448490+0000","last_unstale":"2023-10-08T15:41:06.454855+0000","last_undegraded":"2023-10-08T15:41:06.454855+0000","last_fullsized":"2023-10-08T15:41:06.454855+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:05.390750+0000","last_clean_scrub_stamp":"2023-10-08T15:41:05.390750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:53:56.986432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.435245+0000","last_change":"2023-10-08T15:41:05.428493+0000","last_active":"2023-10-08T15:41:06.435245+0000","last_peered":"2023-10-08T15:41:06.435245+0000","last_clean":"2023-10-08T15:41:06.435245+0000","last_became_active":"2023-10-08T15:41:05.428178+0000","last_became_peered":"2023-10-08T15:41:05.428178+0000","last_unstale":"2023-10-08T15:41:06.435245+0000","last_undegraded":"2023-10-08T15:41:06.435245+0000","last_fullsized":"2023-10-08T15:41:06.435245+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:04.379373+0000","last_clean_scrub_stamp":"2023-10-08T15:41:04.379373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:06:17.731641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":192,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-08T15:41:06.428502+0000","last_change":"2023-10-08T15:37:19.380955+0000","last_active":"2023-10-08T15:41:06.428502+0000","last_peered":"2023-10-08T15:41:06.428502+0000","last_clean":"2023-10-08T15:41:06.428502+0000","last_became_active":"2023-10-08T15:37:19.378277+0000","last_became_peered":"2023-10-08T15:37:19.378277+0000","last_unstale":"2023-10-08T15:41:06.428502+0000","last_undegraded":"2023-10-08T15:41:06.428502+0000","last_fullsized":"2023-10-08T15:41:06.428502+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:17.537726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:17.537726+0000","last_clean_scrub_stamp":"2023-10-08T15:37:17.537726+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:06:26.612046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66282,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542192,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306120,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065720,"statfs":{"total":96636764160,"available":96323297280,"internally_reserved":0,"allocated":655360,"data_stored":829316,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.92300000000000004,"15min":0.95299999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.1930000000000001,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.92900000000000005,"15min":0.93100000000000005},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.2629999999999999,"5min":1.758,"15min":1.758},"last":1.022}]},{"osd":1,"last update":"Sun Oct 8 15:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.90700000000000003,"15min":0.89400000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.2809999999999999,"5min":1.474,"15min":1.474},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.95199999999999996,"15min":0.95799999999999996},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.2609999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.96499999999999997}]},{"osd":2,"last update":"Sun Oct 8 15:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.995,"15min":1.024},"min":{"1min":0.56100000000000005,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.3089999999999999,"5min":1.623,"15min":1.623},"last":1.0920000000000001},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.998,"15min":1.0049999999999999},"min":{"1min":0.65200000000000002,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.73599999999999999}]},{"osd":3,"last update":"Sun Oct 8 15:40:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":0.99299999999999999,"15min":0.97599999999999998},"min":{"1min":0.72499999999999998,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.3540000000000001,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1970000000000001,"15min":1.2050000000000001},"min":{"1min":0.69499999999999995,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.48,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":1.26}]},{"osd":4,"last update":"Sun Oct 8 15:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.052,"15min":1.0820000000000001},"min":{"1min":0.71699999999999997,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.5109999999999999,"5min":1.512,"15min":1.512},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.071,"5min":1.089,"15min":1.0980000000000001},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.054}]},{"osd":5,"last update":"Sun Oct 8 15:40:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.206,"15min":1.2569999999999999},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":1.181},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.222,"15min":1.244},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":1.133}]},{"osd":6,"last update":"Sun Oct 8 15:40:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2789999999999999,"15min":1.3109999999999999},"min":{"1min":0.96199999999999997,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.839,"5min":1.839,"15min":1.839},"last":1.23},{"interface":"front","average":{"1min":1.109,"5min":1.21,"15min":1.246},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.417,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.1579999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542193,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306036,"kb_used_data":556,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065804,"statfs":{"total":96636764160,"available":96323383296,"internally_reserved":0,"allocated":569344,"data_stored":232500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.871,"15min":0.83299999999999996},"min":{"1min":0.64600000000000002,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":1.0289999999999999,"5min":0.98899999999999999,"15min":0.999},"min":{"1min":0.627,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.673,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":0.86199999999999999}]},{"osd":1,"last update":"Sun Oct 8 15:40:22 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":0.96199999999999997,"15min":0.96099999999999997},"min":{"1min":0.61699999999999999,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.82799999999999996},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0009999999999999,"15min":0.995},"min":{"1min":0.69699999999999995,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.5309999999999999,"5min":1.853,"15min":1.853},"last":0.72699999999999998}]},{"osd":2,"last update":"Sun Oct 8 15:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.88200000000000001,"15min":0.85399999999999998},"min":{"1min":0.69899999999999995,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.121},{"interface":"front","average":{"1min":1.103,"5min":1.0700000000000001,"15min":1.0780000000000001},"min":{"1min":0.74299999999999999,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5049999999999999,"5min":1.518,"15min":1.518},"last":0.63900000000000001}]},{"osd":3,"last update":"Sun Oct 8 15:40:22 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.038,"15min":1.0269999999999999},"min":{"1min":0.82499999999999996,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.097,"5min":1.073,"15min":1.0820000000000001},"min":{"1min":0.82899999999999996,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.7270000000000001,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":0.78900000000000003}]},{"osd":4,"last update":"Sun Oct 8 15:40:22 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.1020000000000001,"15min":1.1180000000000001},"min":{"1min":0.90300000000000002,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.171,"15min":1.1879999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":1.149}]},{"osd":5,"last update":"Sun Oct 8 15:40:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.1040000000000001,"15min":1.121},"min":{"1min":0.77300000000000002,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.3939999999999999,"5min":1.581,"15min":1.581},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.296,"5min":1.2889999999999999,"15min":1.3100000000000001},"min":{"1min":1.0880000000000001,"5min":0.96099999999999997,"15min":0.96099999999999997},"max":{"1min":1.8,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.99099999999999999}]},{"osd":7,"last update":"Sun Oct 8 15:40:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.272,"15min":1.2849999999999999},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":1.095},{"interface":"front","average":{"1min":1.256,"5min":1.2849999999999999,"15min":1.3069999999999999},"min":{"1min":0.999,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":1.5580000000000001,"5min":2.5630000000000002,"15min":2.5630000000000002},"last":1.0569999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542194,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306056,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065784,"statfs":{"total":96636764160,"available":96323362816,"internally_reserved":0,"allocated":589824,"data_stored":238844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.70199999999999996,"15min":0.71699999999999997},"min":{"1min":0.52400000000000002,"5min":0.501,"15min":0.501},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.77600000000000002,"15min":0.76500000000000001},"min":{"1min":0.60299999999999998,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0649999999999999,"5min":1.179,"15min":1.179},"last":0.62}]},{"osd":1,"last update":"Sun Oct 8 15:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.71899999999999997,"15min":0.71299999999999997},"min":{"1min":0.52300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.002,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.84599999999999997,"15min":0.81999999999999995},"min":{"1min":0.63300000000000001,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.92100000000000004}]},{"osd":2,"last update":"Sun Oct 8 15:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.85899999999999999,"15min":0.85399999999999998},"min":{"1min":0.57399999999999995,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.92400000000000004,"15min":0.92700000000000005},"min":{"1min":0.51900000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.2030000000000001,"5min":1.423,"15min":1.423},"last":1.208}]},{"osd":4,"last update":"Sun Oct 8 15:40:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.077,"15min":1.0669999999999999},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":0.875},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.129,"15min":1.1499999999999999},"min":{"1min":0.79500000000000004,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.3959999999999999,"5min":2.762,"15min":2.762},"last":0.96299999999999997}]},{"osd":5,"last update":"Sun Oct 8 15:40:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.157,"15min":1.1579999999999999},"min":{"1min":0.78000000000000003,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.631,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.069},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.2210000000000001,"15min":1.2310000000000001},"min":{"1min":0.91800000000000004,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.415,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":1.1499999999999999}]},{"osd":6,"last update":"Sun Oct 8 15:40:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2769999999999999,"15min":1.3},"min":{"1min":0.83499999999999996,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.633,"5min":2.6890000000000001,"15min":2.6890000000000001},"last":1.105},{"interface":"front","average":{"1min":1.222,"5min":1.2250000000000001,"15min":1.2230000000000001},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":1.742,"5min":1.742,"15min":1.742},"last":1.3100000000000001}]},{"osd":7,"last update":"Sun Oct 8 15:40:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.266,"15min":1.2589999999999999},"min":{"1min":1.02,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":1.679,"5min":1.738,"15min":1.738},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.304,"5min":1.339,"15min":1.357},"min":{"1min":1.052,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.5620000000000001,"5min":2.5840000000000001,"15min":2.5840000000000001},"last":1.2829999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542193,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306056,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065784,"statfs":{"total":96636764160,"available":96323362816,"internally_reserved":0,"allocated":589824,"data_stored":238844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:40:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.63300000000000001,"15min":0.623},"min":{"1min":0.48299999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.70499999999999996,"15min":0.66000000000000003},"min":{"1min":0.56699999999999995,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.147,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.79700000000000004}]},{"osd":1,"last update":"Sun Oct 8 15:40:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.70899999999999996,"15min":0.68300000000000005},"min":{"1min":0.57499999999999996,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.141,"5min":1.236,"15min":1.236},"last":0.621},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.75800000000000001,"15min":0.70599999999999996},"min":{"1min":0.64500000000000002,"5min":0.307,"15min":0.307},"max":{"1min":1.2529999999999999,"5min":1.399,"15min":1.399},"last":0.66200000000000003}]},{"osd":3,"last update":"Sun Oct 8 15:40:28 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.69599999999999995,"15min":0.65200000000000002},"min":{"1min":0.57599999999999996,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.86899999999999999,"15min":0.84799999999999998},"min":{"1min":0.65100000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.1799999999999999,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.83799999999999997}]},{"osd":4,"last update":"Sun Oct 8 15:40:28 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.012,"15min":1.002},"min":{"1min":0.79700000000000004,"5min":0.748,"15min":0.748},"max":{"1min":1.2230000000000001,"5min":1.371,"15min":1.371},"last":0.93600000000000005},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.72699999999999998,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.4239999999999999,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.544}]},{"osd":5,"last update":"Sun Oct 8 15:40:28 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.0660000000000001,"15min":1.0589999999999999},"min":{"1min":0.85199999999999998,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.381,"5min":1.462,"15min":1.462},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.125,"5min":1.0780000000000001,"15min":1.0640000000000001},"min":{"1min":0.79500000000000004,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.383,"5min":1.452,"15min":1.452},"last":1.03}]},{"osd":6,"last update":"Sun Oct 8 15:40:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.111,"15min":1.097},"min":{"1min":0.85799999999999998,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":1.6479999999999999},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.133,"15min":1.111},"min":{"1min":0.879,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.492,"5min":1.526,"15min":1.526},"last":1.488}]},{"osd":7,"last update":"Sun Oct 8 15:40:28 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.1910000000000001,"15min":1.161},"min":{"1min":1.0880000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.6319999999999999,"5min":1.72,"15min":1.72},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.1910000000000001,"15min":1.167},"min":{"1min":1.0349999999999999,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.508,"5min":1.804,"15min":1.804},"last":1.401}]}]},{"osd":1,"up_from":14,"seq":60129542194,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306052,"kb_used_data":572,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065788,"statfs":{"total":96636764160,"available":96323366912,"internally_reserved":0,"allocated":585728,"data_stored":238878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.751,"15min":0.77100000000000002},"min":{"1min":0.39600000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.0840000000000001,"5min":1.734,"15min":1.734},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.91600000000000004,"15min":0.98399999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.1970000000000001,"5min":5.7960000000000003,"15min":5.7960000000000003},"last":0.54000000000000004}]},{"osd":2,"last update":"Sun Oct 8 15:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.80300000000000005,"15min":0.83699999999999997},"min":{"1min":0.53800000000000003,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.86099999999999999,"5min":4.0119999999999996,"15min":4.0119999999999996},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.89500000000000002,"15min":0.90700000000000003},"min":{"1min":0.57899999999999996,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3660000000000001,"5min":1.853,"15min":1.853},"last":0.82499999999999996}]},{"osd":3,"last update":"Sun Oct 8 15:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":1.1259999999999999,"15min":1.0169999999999999},"min":{"1min":0.57299999999999995,"5min":0.435,"15min":0.435},"max":{"1min":2.109,"5min":13.388,"15min":13.388},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.91100000000000003,"5min":1.208,"15min":1.167},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":2.274,"5min":13.353,"15min":13.353},"last":0.91200000000000003}]},{"osd":4,"last update":"Sun Oct 8 15:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.153,"15min":1.228},"min":{"1min":0.81000000000000005,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.2290000000000001,"5min":5.859,"15min":5.859},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.024,"5min":1.117,"15min":1.159},"min":{"1min":0.80100000000000005,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.3029999999999999,"5min":4.2679999999999998,"15min":4.2679999999999998},"last":0.94999999999999996}]},{"osd":5,"last update":"Sun Oct 8 15:40:20 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.115,"15min":1.141},"min":{"1min":0.76000000000000001,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.2490000000000001,"5min":4.3380000000000001,"15min":4.3380000000000001},"last":1.048},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.177,"15min":1.181},"min":{"1min":0.73699999999999999,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.907,"5min":2.085,"15min":2.085},"last":1.119}]},{"osd":6,"last update":"Sun Oct 8 15:40:20 2023","interfaces":[{"interface":"back","average":{"1min":1.1200000000000001,"5min":1.302,"15min":1.373},"min":{"1min":0.80200000000000005,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.524,"5min":5.8979999999999997,"15min":5.8979999999999997},"last":1.181},{"interface":"front","average":{"1min":1.151,"5min":1.246,"15min":1.274},"min":{"1min":0.86399999999999999,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.631,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":1.2350000000000001}]},{"osd":7,"last update":"Sun Oct 8 15:40:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.2470000000000001,"15min":1.2490000000000001},"min":{"1min":0.96699999999999997,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.8320000000000001,"5min":2.3940000000000001,"15min":2.3940000000000001},"last":1.212},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.3979999999999999,"15min":1.4790000000000001},"min":{"1min":0.87,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.6279999999999999,"5min":5.9299999999999997,"15min":5.9299999999999997},"last":1.28}]}]},{"osd":0,"up_from":14,"seq":60129542194,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302032,"kb_used_data":648,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069808,"statfs":{"total":96636764160,"available":96327483392,"internally_reserved":0,"allocated":663552,"data_stored":831246,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 15:40:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.78200000000000003,"15min":0.82999999999999996},"min":{"1min":0.504,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.99299999999999999,"5min":1.514,"15min":1.514},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.80000000000000004,"15min":0.80100000000000005},"min":{"1min":0.46700000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1399999999999999,"5min":1.518,"15min":1.518},"last":0.90100000000000002}]},{"osd":2,"last update":"Sun Oct 8 15:40:21 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.82699999999999996,"15min":0.85799999999999998},"min":{"1min":0.57099999999999995,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.96799999999999997,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.78000000000000003,"15min":0.78400000000000003},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.0209999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.71599999999999997}]},{"osd":3,"last update":"Sun Oct 8 15:40:21 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.747,"15min":0.75700000000000001},"min":{"1min":0.51100000000000001,"5min":0.499,"15min":0.499},"max":{"1min":1.02,"5min":1.103,"15min":1.103},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.875,"5min":0.95999999999999996,"15min":0.98699999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.0489999999999999,"5min":2.3290000000000002,"15min":2.3290000000000002},"last":0.94599999999999995}]},{"osd":4,"last update":"Sun Oct 8 15:40:21 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":1.0629999999999999,"15min":1.087},"min":{"1min":0.83899999999999997,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.3,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.173},{"interface":"front","average":{"1min":0.96299999999999997,"5min":1.0649999999999999,"15min":1.089},"min":{"1min":0.71599999999999997,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.2330000000000001,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.97099999999999997}]},{"osd":5,"last update":"Sun Oct 8 15:40:21 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":1.054,"15min":1.089},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.3280000000000001,"5min":2.214,"15min":2.214},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.276,"15min":1.3360000000000001},"min":{"1min":0.94599999999999995,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.3640000000000001,"5min":3.4569999999999999,"15min":3.4569999999999999},"last":0.80000000000000004}]},{"osd":6,"last update":"Sun Oct 8 15:40:21 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.25,"15min":1.294},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.319,"5min":2.532,"15min":2.532},"last":1.121},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.222,"15min":1.242},"min":{"1min":0.92600000000000005,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.359,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":1.012}]},{"osd":7,"last update":"Sun Oct 8 15:40:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.2709999999999999,"15min":1.2929999999999999},"min":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"max":{"1min":1.4199999999999999,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.238},{"interface":"front","average":{"1min":1.149,"5min":1.2130000000000001,"15min":1.2290000000000001},"min":{"1min":0.90600000000000003,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.3999999999999999,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":1.1459999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574897,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306044,"kb_used_data":564,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065796,"statfs":{"total":96636764160,"available":96323375104,"internally_reserved":0,"allocated":577536,"data_stored":233124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.879,"15min":0.85599999999999998},"min":{"1min":0.61499999999999999,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1990000000000001,"5min":1.528,"15min":1.528},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.876,"5min":0.90000000000000002,"15min":0.90800000000000003},"min":{"1min":0.65300000000000002,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1930000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.52000000000000002}]},{"osd":1,"last update":"Sun Oct 8 15:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.91700000000000004,"15min":0.91000000000000003},"min":{"1min":0.67800000000000005,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.169,"5min":1.448,"15min":1.448},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.95199999999999996,"15min":0.98399999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1319999999999999,"5min":1.754,"15min":1.754},"last":0.58899999999999997}]},{"osd":2,"last update":"Sun Oct 8 15:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.94099999999999995,"15min":0.95099999999999996},"min":{"1min":0.67900000000000005,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1819999999999999,"5min":1.869,"15min":1.869},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.98799999999999999,"15min":1.0089999999999999},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.266,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.78500000000000003}]},{"osd":3,"last update":"Sun Oct 8 15:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.98899999999999999,"15min":0.999},"min":{"1min":0.70399999999999996,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.1379999999999999,"5min":1.929,"15min":1.929},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.0680000000000001,"15min":1.103},"min":{"1min":0.77400000000000002,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.2949999999999999,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.65500000000000003}]},{"osd":4,"last update":"Sun Oct 8 15:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":1.002,"15min":1.0109999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.266,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.86699999999999999,"5min":1.0409999999999999,"15min":1.071},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.073,"5min":1.823,"15min":1.823},"last":0.95199999999999996}]},{"osd":6,"last update":"Sun Oct 8 15:40:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.1779999999999999,"15min":1.1990000000000001},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.3480000000000001,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":0.55100000000000005},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.1879999999999999,"15min":1.226},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.3029999999999999,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.016}]},{"osd":7,"last update":"Sun Oct 8 15:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":1.109,"15min":1.151},"min":{"1min":0.74099999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.1799999999999999,"5min":2.177,"15min":2.177},"last":0.63600000000000001},{"interface":"front","average":{"1min":1.133,"5min":1.2010000000000001,"15min":1.2150000000000001},"min":{"1min":0.93000000000000005,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.3720000000000001,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":0.80800000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574897,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310144,"kb_used_data":568,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061696,"statfs":{"total":96636764160,"available":96319176704,"internally_reserved":0,"allocated":581632,"data_stored":234036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.83699999999999997,"15min":0.81499999999999995},"min":{"1min":0.66200000000000003,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.125,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.80900000000000005,"15min":0.79300000000000004},"min":{"1min":0.52600000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.83699999999999997}]},{"osd":1,"last update":"Sun Oct 8 15:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.86399999999999999,"15min":0.83799999999999997},"min":{"1min":0.68100000000000005,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":1.147},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.85299999999999998,"15min":0.83699999999999997},"min":{"1min":0.67600000000000005,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.76700000000000002}]},{"osd":2,"last update":"Sun Oct 8 15:40:20 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0449999999999999,"15min":1.0329999999999999},"min":{"1min":0.72299999999999998,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.3080000000000001,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.071,"5min":1.022,"15min":1.022},"min":{"1min":0.86399999999999999,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.234,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.90500000000000003}]},{"osd":3,"last update":"Sun Oct 8 15:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":1.004,"15min":1.016},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.2529999999999999,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":1.012},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.042,"15min":1.0349999999999999},"min":{"1min":0.68999999999999995,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":1.2969999999999999}]},{"osd":5,"last update":"Sun Oct 8 15:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.98199999999999998,"15min":0.96999999999999997},"min":{"1min":0.70599999999999996,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.343,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":1.325},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0660000000000001,"15min":1.0620000000000001},"min":{"1min":0.65300000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.3500000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":1.097}]},{"osd":6,"last update":"Sun Oct 8 15:40:20 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.1240000000000001,"15min":1.1419999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.3540000000000001,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.194},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.1859999999999999,"15min":1.1819999999999999},"min":{"1min":0.98599999999999999,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":1.2330000000000001}]},{"osd":7,"last update":"Sun Oct 8 15:40:20 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.0820000000000001,"15min":1.0700000000000001},"min":{"1min":0.78100000000000003,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.387,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":1.3740000000000001},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.196,"15min":1.1910000000000001},"min":{"1min":0.97399999999999998,"5min":0.625,"15min":0.625},"max":{"1min":1.4550000000000001,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.274}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T15:41:10.799 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-08T15:41:10.800 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-08T15:41:10.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.914+0000 7faa464d9700 1 Processor -- start 2023-10-08T15:41:10.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.914+0000 7faa464d9700 1 -- start start 2023-10-08T15:41:10.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.914+0000 7faa464d9700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7faa40148de0 0x7faa401491b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:10.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.918+0000 7faa464d9700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faa4014d6c0 0x7faa400b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:10.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.918+0000 7faa464d9700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa400bc210 con 0x7faa400b4e70 2023-10-08T15:41:10.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.918+0000 7faa464d9700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa400a28e0 con 0x7faa40148de0 2023-10-08T15:41:10.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.918+0000 7faa464d9700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa400b6e40 con 0x7faa4014d6c0 2023-10-08T15:41:10.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.918+0000 7faa3ffff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7faa40148de0 0x7faa401491b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:10.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.918+0000 7faa3f7fe700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7faa400b4e70 0x7faa400bc980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:50740/0 (socket says 172.21.15.3:50740) 2023-10-08T15:41:10.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.918+0000 7faa3f7fe700 1 -- 172.21.15.3:0/236115916 learned_addr learned my addr 172.21.15.3:0/236115916 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:41:10.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.918+0000 7faa44a76700 1 --2- 172.21.15.3:0/236115916 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faa4014d6c0 0x7faa400b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:10.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.918+0000 7faa3effd700 1 -- 172.21.15.3:0/236115916 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 387781818 0 0) 0x7faa400bc210 con 0x7faa400b4e70 2023-10-08T15:41:10.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.918+0000 7faa3effd700 1 -- 172.21.15.3:0/236115916 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa2c003570 con 0x7faa400b4e70 2023-10-08T15:41:10.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.918+0000 7faa3ffff700 1 -- 172.21.15.3:0/236115916 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faa4014d6c0 msgr2=0x7faa400b57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:10.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.918+0000 7faa3ffff700 1 --2- 172.21.15.3:0/236115916 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faa4014d6c0 0x7faa400b57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:10.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.918+0000 7faa3ffff700 1 -- 172.21.15.3:0/236115916 >> v1:172.21.15.3:6789/0 conn(0x7faa400b4e70 legacy=0x7faa400bc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:10.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.918+0000 7faa3ffff700 1 -- 172.21.15.3:0/236115916 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa4014db20 con 0x7faa40148de0 2023-10-08T15:41:10.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.918+0000 7faa3ffff700 1 --2- 172.21.15.3:0/236115916 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faa40148de0 0x7faa401491b0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7faa30009e60 tx=0x7faa30009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acfaed8be81a0d18 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:10.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.918+0000 7faa3effd700 1 -- 172.21.15.3:0/236115916 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3000e070 con 0x7faa40148de0 2023-10-08T15:41:10.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.918+0000 7faa3effd700 1 -- 172.21.15.3:0/236115916 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa3000bab0 con 0x7faa40148de0 2023-10-08T15:41:10.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.918+0000 7faa3effd700 1 -- 172.21.15.3:0/236115916 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3000be30 con 0x7faa40148de0 2023-10-08T15:41:10.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.918+0000 7faa464d9700 1 -- 172.21.15.3:0/236115916 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faa40148de0 msgr2=0x7faa401491b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:10.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.918+0000 7faa464d9700 1 --2- 172.21.15.3:0/236115916 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faa40148de0 0x7faa401491b0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7faa30009e60 tx=0x7faa30009780 comp rx=0 tx=0).stop 2023-10-08T15:41:10.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.918+0000 7faa464d9700 1 -- 172.21.15.3:0/236115916 shutdown_connections 2023-10-08T15:41:10.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.918+0000 7faa464d9700 1 --2- 172.21.15.3:0/236115916 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faa4014d6c0 0x7faa400b57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:10.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.918+0000 7faa464d9700 1 --2- 172.21.15.3:0/236115916 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faa40148de0 0x7faa401491b0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:10.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.918+0000 7faa464d9700 1 -- 172.21.15.3:0/236115916 >> 172.21.15.3:0/236115916 conn(0x7faa400670e0 msgr2=0x7faa400674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:10.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.918+0000 7faa464d9700 1 -- 172.21.15.3:0/236115916 shutdown_connections 2023-10-08T15:41:10.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.918+0000 7faa464d9700 1 -- 172.21.15.3:0/236115916 wait complete. 2023-10-08T15:41:10.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.922+0000 7faa464d9700 1 Processor -- start 2023-10-08T15:41:10.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.922+0000 7faa464d9700 1 -- start start 2023-10-08T15:41:10.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.922+0000 7faa464d9700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faa400b4e70 0x7faa4014c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:10.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.922+0000 7faa464d9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa40148de0 0x7faa40145300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:10.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.922+0000 7faa464d9700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faa4014d6c0 0x7faa40145840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:10.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.922+0000 7faa464d9700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa400bfe70 con 0x7faa4014d6c0 2023-10-08T15:41:10.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.922+0000 7faa464d9700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4014c730 con 0x7faa40148de0 2023-10-08T15:41:10.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.922+0000 7faa464d9700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa400c0450 con 0x7faa400b4e70 2023-10-08T15:41:10.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.922+0000 7faa44a76700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faa4014d6c0 0x7faa40145840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:10.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.922+0000 7faa44a76700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faa4014d6c0 0x7faa40145840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35140/0 (socket says 172.21.15.3:35140) 2023-10-08T15:41:10.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.922+0000 7faa44a76700 1 -- 172.21.15.3:0/2590038999 learned_addr learned my addr 172.21.15.3:0/2590038999 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:10.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.922+0000 7faa3ffff700 1 --2- 172.21.15.3:0/2590038999 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faa400b4e70 0x7faa4014c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:10.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.922+0000 7faa3f7fe700 1 --2- 172.21.15.3:0/2590038999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa40148de0 0x7faa40145300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:10.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.922+0000 7faa44a76700 1 -- 172.21.15.3:0/2590038999 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faa400b4e70 msgr2=0x7faa4014c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:10.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.922+0000 7faa44a76700 1 --2- 172.21.15.3:0/2590038999 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faa400b4e70 0x7faa4014c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:10.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.922+0000 7faa44a76700 1 -- 172.21.15.3:0/2590038999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa40148de0 msgr2=0x7faa40145300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:10.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.922+0000 7faa44a76700 1 --2- 172.21.15.3:0/2590038999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa40148de0 0x7faa40145300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:10.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.922+0000 7faa44a76700 1 -- 172.21.15.3:0/2590038999 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa30009a20 con 0x7faa4014d6c0 2023-10-08T15:41:10.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.922+0000 7faa44a76700 1 --2- 172.21.15.3:0/2590038999 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faa4014d6c0 0x7faa40145840 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7faa3800e8d0 tx=0x7faa380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:10.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.922+0000 7faa37fff700 1 -- 172.21.15.3:0/2590038999 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa38013680 con 0x7faa4014d6c0 2023-10-08T15:41:10.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.922+0000 7faa37fff700 1 -- 172.21.15.3:0/2590038999 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa380137e0 con 0x7faa4014d6c0 2023-10-08T15:41:10.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.922+0000 7faa464d9700 1 -- 172.21.15.3:0/2590038999 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa40145d80 con 0x7faa4014d6c0 2023-10-08T15:41:10.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.922+0000 7faa37fff700 1 -- 172.21.15.3:0/2590038999 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa38013ba0 con 0x7faa4014d6c0 2023-10-08T15:41:10.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.922+0000 7faa464d9700 1 -- 172.21.15.3:0/2590038999 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa400c0bf0 con 0x7faa4014d6c0 2023-10-08T15:41:10.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.926+0000 7faa464d9700 1 -- 172.21.15.3:0/2590038999 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa400c0610 con 0x7faa4014d6c0 2023-10-08T15:41:10.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.926+0000 7faa37fff700 1 -- 172.21.15.3:0/2590038999 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7faa380123d0 con 0x7faa4014d6c0 2023-10-08T15:41:10.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.926+0000 7faa37fff700 1 --2- 172.21.15.3:0/2590038999 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7faa20060550 0x7faa20062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:10.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.926+0000 7faa37fff700 1 -- 172.21.15.3:0/2590038999 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faa3807c950 con 0x7faa4014d6c0 2023-10-08T15:41:10.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.926+0000 7faa3ffff700 1 --2- 172.21.15.3:0/2590038999 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7faa20060550 0x7faa20062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:10.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.926+0000 7faa3ffff700 1 --2- 172.21.15.3:0/2590038999 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7faa20060550 0x7faa20062a00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7faa300097c0 tx=0x7faa30019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:10.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:10.930+0000 7faa37fff700 1 -- 172.21.15.3:0/2590038999 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7faa3804cf40 con 0x7faa4014d6c0 2023-10-08T15:41:11.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.150+0000 7faa464d9700 1 -- 172.21.15.3:0/2590038999 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7faa400c08f0 con 0x7faa4014d6c0 2023-10-08T15:41:11.163 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.158+0000 7faa37fff700 1 -- 172.21.15.3:0/2590038999 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7faa38050560 con 0x7faa4014d6c0 2023-10-08T15:41:11.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.162+0000 7faa464d9700 1 -- 172.21.15.3:0/2590038999 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7faa20060550 msgr2=0x7faa20062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:11.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.162+0000 7faa464d9700 1 --2- 172.21.15.3:0/2590038999 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7faa20060550 0x7faa20062a00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7faa300097c0 tx=0x7faa30019000 comp rx=0 tx=0).stop 2023-10-08T15:41:11.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.162+0000 7faa464d9700 1 -- 172.21.15.3:0/2590038999 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faa4014d6c0 msgr2=0x7faa40145840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:11.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.162+0000 7faa464d9700 1 --2- 172.21.15.3:0/2590038999 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faa4014d6c0 0x7faa40145840 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7faa3800e8d0 tx=0x7faa380091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:11.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.162+0000 7faa464d9700 1 -- 172.21.15.3:0/2590038999 shutdown_connections 2023-10-08T15:41:11.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.162+0000 7faa464d9700 1 --2- 172.21.15.3:0/2590038999 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7faa20060550 0x7faa20062a00 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:11.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.162+0000 7faa464d9700 1 --2- 172.21.15.3:0/2590038999 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faa4014d6c0 0x7faa40145840 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:11.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.162+0000 7faa464d9700 1 --2- 172.21.15.3:0/2590038999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa40148de0 0x7faa40145300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:11.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.162+0000 7faa464d9700 1 --2- 172.21.15.3:0/2590038999 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faa400b4e70 0x7faa4014c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:11.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.162+0000 7faa464d9700 1 -- 172.21.15.3:0/2590038999 >> 172.21.15.3:0/2590038999 conn(0x7faa400670e0 msgr2=0x7faa4014f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:11.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.162+0000 7faa464d9700 1 -- 172.21.15.3:0/2590038999 shutdown_connections 2023-10-08T15:41:11.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.162+0000 7faa464d9700 1 -- 172.21.15.3:0/2590038999 wait complete. 2023-10-08T15:41:11.167 INFO:teuthology.orchestra.run.smithi003.stderr:updated caps for client.0 2023-10-08T15:41:11.180 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:41:11.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.282+0000 7f04f6a2b700 1 Processor -- start 2023-10-08T15:41:11.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.282+0000 7f04f6a2b700 1 -- start start 2023-10-08T15:41:11.289 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.286+0000 7f04f6a2b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f04f006be60 0x7f04f014b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:11.289 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.286+0000 7f04f6a2b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f04f006cc40 0x7f04f014cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:11.289 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.286+0000 7f04f6a2b700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04f014c6b0 con 0x7f04f014ac50 2023-10-08T15:41:11.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.286+0000 7f04f6a2b700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04f014c060 con 0x7f04f006cc40 2023-10-08T15:41:11.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.286+0000 7f04f6a2b700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f014c340 con 0x7f04f006be60 2023-10-08T15:41:11.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.286+0000 7f04f5228700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f04f006be60 0x7f04f014b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:11.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.286+0000 7f04f622a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f04f006cc40 0x7f04f014cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:11.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.286+0000 7f04f5228700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f04f006be60 0x7f04f014b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.3:42692/0 (socket says 172.21.15.3:42692) 2023-10-08T15:41:11.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.286+0000 7f04f5228700 1 -- 172.21.15.3:0/3816149725 learned_addr learned my addr 172.21.15.3:0/3816149725 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:11.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.286+0000 7f04f5228700 1 -- 172.21.15.3:0/3816149725 >> v2:172.21.15.50:3300/0 conn(0x7f04f006cc40 msgr2=0x7f04f014cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:11.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.286+0000 7f04f5228700 1 --2- 172.21.15.3:0/3816149725 >> v2:172.21.15.50:3300/0 conn(0x7f04f006cc40 0x7f04f014cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:11.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.286+0000 7f04f5228700 1 -- 172.21.15.3:0/3816149725 >> v1:172.21.15.50:6789/0 conn(0x7f04f014ac50 legacy=0x7f04f006c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:11.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.286+0000 7f04f5228700 1 -- 172.21.15.3:0/3816149725 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f014e860 con 0x7f04f006be60 2023-10-08T15:41:11.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.286+0000 7f04f5228700 1 --2- 172.21.15.3:0/3816149725 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f04f006be60 0x7f04f014b020 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f04ec0099b0 tx=0x7f04ec009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bb0c37e35240530 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:11.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.286+0000 7f04f4a27700 1 -- 172.21.15.3:0/3816149725 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ec009ea0 con 0x7f04f006be60 2023-10-08T15:41:11.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.286+0000 7f04f4a27700 1 -- 172.21.15.3:0/3816149725 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04ec00b860 con 0x7f04f006be60 2023-10-08T15:41:11.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.286+0000 7f04f4a27700 1 -- 172.21.15.3:0/3816149725 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ec00bc00 con 0x7f04f006be60 2023-10-08T15:41:11.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.286+0000 7f04f6a2b700 1 -- 172.21.15.3:0/3816149725 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f04f006be60 msgr2=0x7f04f014b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:11.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.286+0000 7f04f6a2b700 1 --2- 172.21.15.3:0/3816149725 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f04f006be60 0x7f04f014b020 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f04ec0099b0 tx=0x7f04ec009250 comp rx=0 tx=0).stop 2023-10-08T15:41:11.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.286+0000 7f04f6a2b700 1 -- 172.21.15.3:0/3816149725 shutdown_connections 2023-10-08T15:41:11.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.286+0000 7f04f6a2b700 1 --2- 172.21.15.3:0/3816149725 >> v2:172.21.15.50:3300/0 conn(0x7f04f006cc40 0x7f04f014cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:11.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.286+0000 7f04f6a2b700 1 --2- 172.21.15.3:0/3816149725 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f04f006be60 0x7f04f014b020 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:11.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.286+0000 7f04f6a2b700 1 -- 172.21.15.3:0/3816149725 >> 172.21.15.3:0/3816149725 conn(0x7f04f00c1df0 msgr2=0x7f04f00c21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:11.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.286+0000 7f04f6a2b700 1 -- 172.21.15.3:0/3816149725 shutdown_connections 2023-10-08T15:41:11.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.286+0000 7f04f6a2b700 1 -- 172.21.15.3:0/3816149725 wait complete. 2023-10-08T15:41:11.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.290+0000 7f04f6a2b700 1 Processor -- start 2023-10-08T15:41:11.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.290+0000 7f04f6a2b700 1 -- start start 2023-10-08T15:41:11.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.290+0000 7f04f6a2b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f04f006be60 0x7f04f0148ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:11.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.290+0000 7f04f6a2b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04f006cc40 0x7f04f015b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:11.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.290+0000 7f04f6a2b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f04f014ac50 0x7f04f015baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:11.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.290+0000 7f04f6a2b700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f009f190 con 0x7f04f014ac50 2023-10-08T15:41:11.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.290+0000 7f04f6a2b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f015f3e0 con 0x7f04f006cc40 2023-10-08T15:41:11.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.290+0000 7f04f6a2b700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f015f070 con 0x7f04f006be60 2023-10-08T15:41:11.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.290+0000 7f04f5a29700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f04f006be60 0x7f04f0148ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:11.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.290+0000 7f04f622a700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f04f014ac50 0x7f04f015baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:11.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.290+0000 7f04f5a29700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f04f006be60 0x7f04f0148ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.3:42706/0 (socket says 172.21.15.3:42706) 2023-10-08T15:41:11.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.290+0000 7f04f5a29700 1 -- 172.21.15.3:0/3035312005 learned_addr learned my addr 172.21.15.3:0/3035312005 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:11.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.290+0000 7f04f5228700 1 --2- 172.21.15.3:0/3035312005 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04f006cc40 0x7f04f015b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:11.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.290+0000 7f04f622a700 1 -- 172.21.15.3:0/3035312005 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f04f006be60 msgr2=0x7f04f0148ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:11.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.290+0000 7f04f622a700 1 --2- 172.21.15.3:0/3035312005 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f04f006be60 0x7f04f0148ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:11.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.290+0000 7f04f622a700 1 -- 172.21.15.3:0/3035312005 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04f006cc40 msgr2=0x7f04f015b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:11.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.290+0000 7f04f622a700 1 --2- 172.21.15.3:0/3035312005 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04f006cc40 0x7f04f015b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:11.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.290+0000 7f04f622a700 1 -- 172.21.15.3:0/3035312005 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04ec0094f0 con 0x7f04f014ac50 2023-10-08T15:41:11.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.290+0000 7f04f5228700 1 --2- 172.21.15.3:0/3035312005 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04f006cc40 0x7f04f015b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:41:11.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.290+0000 7f04f5a29700 1 --2- 172.21.15.3:0/3035312005 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f04f006be60 0x7f04f0148ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:41:11.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.290+0000 7f04f622a700 1 --2- 172.21.15.3:0/3035312005 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f04f014ac50 0x7f04f015baf0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f04e8009e50 tx=0x7f04e800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:11.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.290+0000 7f04e5ffb700 1 -- 172.21.15.3:0/3035312005 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e800caa0 con 0x7f04f014ac50 2023-10-08T15:41:11.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.290+0000 7f04e5ffb700 1 -- 172.21.15.3:0/3035312005 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e800f040 con 0x7f04f014ac50 2023-10-08T15:41:11.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.290+0000 7f04f6a2b700 1 -- 172.21.15.3:0/3035312005 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04f0149000 con 0x7f04f014ac50 2023-10-08T15:41:11.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.290+0000 7f04e5ffb700 1 -- 172.21.15.3:0/3035312005 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e800ce70 con 0x7f04f014ac50 2023-10-08T15:41:11.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.290+0000 7f04f6a2b700 1 -- 172.21.15.3:0/3035312005 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04f009e820 con 0x7f04f014ac50 2023-10-08T15:41:11.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.294+0000 7f04f6a2b700 1 -- 172.21.15.3:0/3035312005 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04f009d450 con 0x7f04f014ac50 2023-10-08T15:41:11.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.294+0000 7f04e5ffb700 1 -- 172.21.15.3:0/3035312005 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f04e8014690 con 0x7f04f014ac50 2023-10-08T15:41:11.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.294+0000 7f04e5ffb700 1 --2- 172.21.15.3:0/3035312005 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f04d4060550 0x7f04d4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:11.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.298+0000 7f04e5ffb700 1 -- 172.21.15.3:0/3035312005 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f04e807d2b0 con 0x7f04f014ac50 2023-10-08T15:41:11.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.298+0000 7f04f5a29700 1 --2- 172.21.15.3:0/3035312005 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f04d4060550 0x7f04d4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:11.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.298+0000 7f04f5a29700 1 --2- 172.21.15.3:0/3035312005 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f04d4060550 0x7f04d4062a00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f04e0001d60 tx=0x7f04e0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:11.306 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.302+0000 7f04e5ffb700 1 -- 172.21.15.3:0/3035312005 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f04f009d450 con 0x7f04f014ac50 2023-10-08T15:41:11.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.498+0000 7f04f6a2b700 1 -- 172.21.15.3:0/3035312005 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f04f009d450 con 0x7f04f014ac50 2023-10-08T15:41:11.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.498+0000 7f04e5ffb700 1 -- 172.21.15.3:0/3035312005 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+3077 (secure 0 0 0) 0x7f04e8018c20 con 0x7f04f014ac50 2023-10-08T15:41:11.504 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:41:11.504 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":27,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5674,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/688778262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":688778262},{"type":"v1","addr":"172.21.15.50:6835","nonce":688778262}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:41:06.132475+0000","modified":"2023-10-08T15:41:09.450447+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5685},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5685":{"gid":5685,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.3:6833/3789195831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":3789195831},{"type":"v1","addr":"172.21.15.3:6833","nonce":3789195831}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-08T15:41:11.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.502+0000 7f04f6a2b700 1 -- 172.21.15.3:0/3035312005 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f04d4060550 msgr2=0x7f04d4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:11.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.502+0000 7f04f6a2b700 1 --2- 172.21.15.3:0/3035312005 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f04d4060550 0x7f04d4062a00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f04e0001d60 tx=0x7f04e0009040 comp rx=0 tx=0).stop 2023-10-08T15:41:11.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.502+0000 7f04f6a2b700 1 -- 172.21.15.3:0/3035312005 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f04f014ac50 msgr2=0x7f04f015baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:11.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.502+0000 7f04f6a2b700 1 --2- 172.21.15.3:0/3035312005 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f04f014ac50 0x7f04f015baf0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f04e8009e50 tx=0x7f04e800b040 comp rx=0 tx=0).stop 2023-10-08T15:41:11.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.502+0000 7f04f6a2b700 1 -- 172.21.15.3:0/3035312005 shutdown_connections 2023-10-08T15:41:11.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.502+0000 7f04f6a2b700 1 --2- 172.21.15.3:0/3035312005 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f04d4060550 0x7f04d4062a00 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:11.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.502+0000 7f04f6a2b700 1 --2- 172.21.15.3:0/3035312005 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f04f014ac50 0x7f04f015baf0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:11.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.502+0000 7f04f6a2b700 1 --2- 172.21.15.3:0/3035312005 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04f006cc40 0x7f04f015b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:11.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.502+0000 7f04f6a2b700 1 --2- 172.21.15.3:0/3035312005 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f04f006be60 0x7f04f0148ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:11.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.502+0000 7f04f6a2b700 1 -- 172.21.15.3:0/3035312005 >> 172.21.15.3:0/3035312005 conn(0x7f04f00c1df0 msgr2=0x7f04f01497f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:11.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.502+0000 7f04f6a2b700 1 -- 172.21.15.3:0/3035312005 shutdown_connections 2023-10-08T15:41:11.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.502+0000 7f04f6a2b700 1 -- 172.21.15.3:0/3035312005 wait complete. 2023-10-08T15:41:11.507 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 27 2023-10-08T15:41:11.701 INFO:tasks.ceph.mds.a.smithi003.stderr:2023-10-08T15:41:11.694+0000 7f155682d700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T15:41:11.719 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-08T15:41:06.132475+0000', 'modified': '2023-10-08T15:41:09.450447+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5685}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5685': {'gid': 5685, 'name': 'a', 'rank': 0, 'incarnation': 23, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.3:6833/3789195831', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.3:6832', 'nonce': 3789195831}, {'type': 'v1', 'addr': '172.21.15.3:6833', 'nonce': 3789195831}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-08T15:41:11.719 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-08T15:41:11.720 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-08T15:41:11.837 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.830+0000 7fb4ac23c700 1 Processor -- start 2023-10-08T15:41:11.837 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.830+0000 7fb4ac23c700 1 -- start start 2023-10-08T15:41:11.838 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.834+0000 7fb4ac23c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb4a40670e0 0x7fb4a40674b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:11.838 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.834+0000 7fb4ac23c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb4a40bde90 0x7fb4a40be330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:11.838 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.834+0000 7fb4ac23c700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4a40a2690 con 0x7fb4a40bcca0 2023-10-08T15:41:11.838 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.834+0000 7fb4ac23c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4a414fde0 con 0x7fb4a40670e0 2023-10-08T15:41:11.838 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.834+0000 7fb4ac23c700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a40bda00 con 0x7fb4a40bde90 2023-10-08T15:41:11.838 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.834+0000 7fb4a97d7700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fb4a40bcca0 0x7fb4a414cbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:50746/0 (socket says 172.21.15.3:50746) 2023-10-08T15:41:11.838 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.834+0000 7fb4a97d7700 1 -- 172.21.15.3:0/3132233849 learned_addr learned my addr 172.21.15.3:0/3132233849 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:41:11.839 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.834+0000 7fb4aa7d9700 1 --2- 172.21.15.3:0/3132233849 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb4a40bde90 0x7fb4a40be330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:11.839 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.834+0000 7fb4a9fd8700 1 --2- 172.21.15.3:0/3132233849 >> v2:172.21.15.50:3300/0 conn(0x7fb4a40670e0 0x7fb4a40674b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:11.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.834+0000 7fb4a8fd6700 1 -- 172.21.15.3:0/3132233849 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1313572798 0 0) 0x7fb4a40a2690 con 0x7fb4a40bcca0 2023-10-08T15:41:11.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.834+0000 7fb4a8fd6700 1 -- 172.21.15.3:0/3132233849 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb490003570 con 0x7fb4a40bcca0 2023-10-08T15:41:11.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.834+0000 7fb4aa7d9700 1 -- 172.21.15.3:0/3132233849 >> v2:172.21.15.50:3300/0 conn(0x7fb4a40670e0 msgr2=0x7fb4a40674b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:11.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.834+0000 7fb4aa7d9700 1 --2- 172.21.15.3:0/3132233849 >> v2:172.21.15.50:3300/0 conn(0x7fb4a40670e0 0x7fb4a40674b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:11.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.834+0000 7fb4aa7d9700 1 -- 172.21.15.3:0/3132233849 >> v1:172.21.15.3:6789/0 conn(0x7fb4a40bcca0 legacy=0x7fb4a414cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:11.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.834+0000 7fb4aa7d9700 1 -- 172.21.15.3:0/3132233849 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a409f3a0 con 0x7fb4a40bde90 2023-10-08T15:41:11.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.834+0000 7fb4aa7d9700 1 --2- 172.21.15.3:0/3132233849 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb4a40bde90 0x7fb4a40be330 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb49c0098e0 tx=0x7fb49c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a788c4d56a6a0e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:11.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.834+0000 7fb4a8fd6700 1 -- 172.21.15.3:0/3132233849 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49c011630 con 0x7fb4a40bde90 2023-10-08T15:41:11.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.834+0000 7fb4a8fd6700 1 -- 172.21.15.3:0/3132233849 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb49c011790 con 0x7fb4a40bde90 2023-10-08T15:41:11.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.834+0000 7fb4a8fd6700 1 -- 172.21.15.3:0/3132233849 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49c011b30 con 0x7fb4a40bde90 2023-10-08T15:41:11.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.834+0000 7fb4ac23c700 1 -- 172.21.15.3:0/3132233849 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb4a40bde90 msgr2=0x7fb4a40be330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:11.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.834+0000 7fb4ac23c700 1 --2- 172.21.15.3:0/3132233849 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb4a40bde90 0x7fb4a40be330 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb49c0098e0 tx=0x7fb49c0091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:11.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.834+0000 7fb4ac23c700 1 -- 172.21.15.3:0/3132233849 shutdown_connections 2023-10-08T15:41:11.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.834+0000 7fb4ac23c700 1 --2- 172.21.15.3:0/3132233849 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb4a40bde90 0x7fb4a40be330 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:11.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.834+0000 7fb4ac23c700 1 --2- 172.21.15.3:0/3132233849 >> v2:172.21.15.50:3300/0 conn(0x7fb4a40670e0 0x7fb4a40674b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:11.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.834+0000 7fb4ac23c700 1 -- 172.21.15.3:0/3132233849 >> 172.21.15.3:0/3132233849 conn(0x7fb4a406b9b0 msgr2=0x7fb4a40681f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:11.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.834+0000 7fb4ac23c700 1 -- 172.21.15.3:0/3132233849 shutdown_connections 2023-10-08T15:41:11.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.834+0000 7fb4ac23c700 1 -- 172.21.15.3:0/3132233849 wait complete. 2023-10-08T15:41:11.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.838+0000 7fb4ac23c700 1 Processor -- start 2023-10-08T15:41:11.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.838+0000 7fb4ac23c700 1 -- start start 2023-10-08T15:41:11.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.838+0000 7fb4ac23c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb4a40670e0 0x7fb4a4163350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:11.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.838+0000 7fb4ac23c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4a40bcca0 0x7fb4a414bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:11.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.838+0000 7fb4ac23c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb4a40bde90 0x7fb4a4150f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:11.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.838+0000 7fb4ac23c700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a4148ff0 con 0x7fb4a40bde90 2023-10-08T15:41:11.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.838+0000 7fb4ac23c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a4163890 con 0x7fb4a40bcca0 2023-10-08T15:41:11.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.838+0000 7fb4ac23c700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a40a14c0 con 0x7fb4a40670e0 2023-10-08T15:41:11.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.838+0000 7fb4aa7d9700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb4a40bde90 0x7fb4a4150f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:11.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.838+0000 7fb4aa7d9700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb4a40bde90 0x7fb4a4150f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35160/0 (socket says 172.21.15.3:35160) 2023-10-08T15:41:11.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.838+0000 7fb4aa7d9700 1 -- 172.21.15.3:0/327756277 learned_addr learned my addr 172.21.15.3:0/327756277 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:11.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.838+0000 7fb4a97d7700 1 --2- 172.21.15.3:0/327756277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4a40bcca0 0x7fb4a414bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:11.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.838+0000 7fb4a9fd8700 1 --2- 172.21.15.3:0/327756277 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb4a40670e0 0x7fb4a4163350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:11.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.838+0000 7fb4aa7d9700 1 -- 172.21.15.3:0/327756277 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb4a40670e0 msgr2=0x7fb4a4163350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:11.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.838+0000 7fb4aa7d9700 1 --2- 172.21.15.3:0/327756277 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb4a40670e0 0x7fb4a4163350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:11.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.838+0000 7fb4aa7d9700 1 -- 172.21.15.3:0/327756277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4a40bcca0 msgr2=0x7fb4a414bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:11.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.838+0000 7fb4aa7d9700 1 --2- 172.21.15.3:0/327756277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4a40bcca0 0x7fb4a414bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:11.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.838+0000 7fb4aa7d9700 1 -- 172.21.15.3:0/327756277 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb49c009420 con 0x7fb4a40bde90 2023-10-08T15:41:11.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.838+0000 7fb4a9fd8700 1 --2- 172.21.15.3:0/327756277 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb4a40670e0 0x7fb4a4163350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:11.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.838+0000 7fb4aa7d9700 1 --2- 172.21.15.3:0/327756277 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb4a40bde90 0x7fb4a4150f90 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fb4a40bdb40 tx=0x7fb49c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:11.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.838+0000 7fb4a1ffb700 1 -- 172.21.15.3:0/327756277 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49c0253f0 con 0x7fb4a40bde90 2023-10-08T15:41:11.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.838+0000 7fb4a1ffb700 1 -- 172.21.15.3:0/327756277 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb49c025570 con 0x7fb4a40bde90 2023-10-08T15:41:11.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.838+0000 7fb4ac23c700 1 -- 172.21.15.3:0/327756277 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4a414c010 con 0x7fb4a40bde90 2023-10-08T15:41:11.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.838+0000 7fb4a1ffb700 1 -- 172.21.15.3:0/327756277 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49c025930 con 0x7fb4a40bde90 2023-10-08T15:41:11.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.838+0000 7fb4ac23c700 1 -- 172.21.15.3:0/327756277 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4a4149280 con 0x7fb4a40bde90 2023-10-08T15:41:11.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.842+0000 7fb4a1ffb700 1 -- 172.21.15.3:0/327756277 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb49c025d20 con 0x7fb4a40bde90 2023-10-08T15:41:11.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.842+0000 7fb4a1ffb700 1 --2- 172.21.15.3:0/327756277 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb484060580 0x7fb484062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:11.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.842+0000 7fb4a1ffb700 1 -- 172.21.15.3:0/327756277 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb49c07e1b0 con 0x7fb4a40bde90 2023-10-08T15:41:11.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.842+0000 7fb4a9fd8700 1 --2- 172.21.15.3:0/327756277 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb484060580 0x7fb484062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:11.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.842+0000 7fb4a9fd8700 1 --2- 172.21.15.3:0/327756277 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb484060580 0x7fb484062a30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb494009d80 tx=0x7fb494008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:11.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.846+0000 7fb4ae4e5740 1 Processor -- start 2023-10-08T15:41:11.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.846+0000 7fb4ae4e5740 1 -- start start 2023-10-08T15:41:11.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.846+0000 7fb4ae4e5740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0xd40ae0 0xf78460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:11.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.846+0000 7fb4ae4e5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd40710 0xf789a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:11.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.846+0000 7fb4ae4e5740 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0xd8b790 0xf78ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:11.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.846+0000 7fb4ae4e5740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0xeebf30 con 0xd40ae0 2023-10-08T15:41:11.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.846+0000 7fb4ae4e5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0xee7ed0 con 0xd40710 2023-10-08T15:41:11.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.846+0000 7fb4ae4e5740 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0xeae0b0 con 0xd8b790 2023-10-08T15:41:11.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.846+0000 7fb4a9fd8700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0xd40ae0 0xf78460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:11.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.846+0000 7fb4a9fd8700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0xd40ae0 0xf78460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35172/0 (socket says 172.21.15.3:35172) 2023-10-08T15:41:11.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.846+0000 7fb4a9fd8700 1 -- 172.21.15.3:0/2406333955 learned_addr learned my addr 172.21.15.3:0/2406333955 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:11.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.846+0000 7fb4aa7d9700 1 --2- 172.21.15.3:0/2406333955 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0xd8b790 0xf78ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:11.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.846+0000 7fb4a97d7700 1 --2- 172.21.15.3:0/2406333955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd40710 0xf789a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:11.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.846+0000 7fb4a9fd8700 1 -- 172.21.15.3:0/2406333955 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0xd8b790 msgr2=0xf78ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:11.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.846+0000 7fb4a9fd8700 1 --2- 172.21.15.3:0/2406333955 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0xd8b790 0xf78ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:11.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.846+0000 7fb4a9fd8700 1 -- 172.21.15.3:0/2406333955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd40710 msgr2=0xf789a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:11.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.846+0000 7fb4a9fd8700 1 --2- 172.21.15.3:0/2406333955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd40710 0xf789a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:11.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.846+0000 7fb4a9fd8700 1 -- 172.21.15.3:0/2406333955 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xd8c9e0 con 0xd40ae0 2023-10-08T15:41:11.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.846+0000 7fb4a97d7700 1 --2- 172.21.15.3:0/2406333955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd40710 0xf789a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:41:11.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.846+0000 7fb4a9fd8700 1 --2- 172.21.15.3:0/2406333955 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0xd40ae0 0xf78460 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fb494011ea0 tx=0x7fb494018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41e6e8bb35d84140 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:11.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.846+0000 7fb49affd700 1 -- 172.21.15.3:0/2406333955 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb494015c60 con 0xd40ae0 2023-10-08T15:41:11.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.846+0000 7fb49affd700 1 -- 172.21.15.3:0/2406333955 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb494015dc0 con 0xd40ae0 2023-10-08T15:41:11.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.846+0000 7fb49affd700 1 -- 172.21.15.3:0/2406333955 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb494021440 con 0xd40ae0 2023-10-08T15:41:11.858 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.850+0000 7fb4ae4e5740 1 -- 172.21.15.3:0/2406333955 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0xd40ae0 msgr2=0xf78460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:11.858 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.850+0000 7fb4ae4e5740 1 --2- 172.21.15.3:0/2406333955 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0xd40ae0 0xf78460 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fb494011ea0 tx=0x7fb494018000 comp rx=0 tx=0).stop 2023-10-08T15:41:11.858 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.850+0000 7fb4ae4e5740 1 -- 172.21.15.3:0/2406333955 shutdown_connections 2023-10-08T15:41:11.858 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.850+0000 7fb4ae4e5740 1 --2- 172.21.15.3:0/2406333955 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0xd8b790 0xf78ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:11.858 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.850+0000 7fb4ae4e5740 1 --2- 172.21.15.3:0/2406333955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd40710 0xf789a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:11.858 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.850+0000 7fb4ae4e5740 1 --2- 172.21.15.3:0/2406333955 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0xd40ae0 0xf78460 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:11.858 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.850+0000 7fb4ae4e5740 1 -- 172.21.15.3:0/2406333955 >> 172.21.15.3:0/2406333955 conn(0xd40eb0 msgr2=0xf73810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:11.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.850+0000 7fb4ae4e5740 1 -- 172.21.15.3:0/2406333955 shutdown_connections 2023-10-08T15:41:11.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.850+0000 7fb4ae4e5740 1 -- 172.21.15.3:0/2406333955 wait complete. 2023-10-08T15:41:11.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.850+0000 7fb4ae4e5740 1 -- start start 2023-10-08T15:41:11.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.850+0000 7fb4ae4e5740 1 Processor -- start 2023-10-08T15:41:11.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.850+0000 7fb4ae4e5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd40710 0xfae570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:11.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.850+0000 7fb4ae4e5740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0xd40ae0 0xfaeab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:11.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.850+0000 7fb4ae4e5740 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0xd8b790 0xfaf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:11.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.850+0000 7fb4ae4e5740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0xeadd50 con 0xd40ae0 2023-10-08T15:41:11.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.850+0000 7fb4ae4e5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0xe86970 con 0xd40710 2023-10-08T15:41:11.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.850+0000 7fb4ae4e5740 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0xee76e0 con 0xd8b790 2023-10-08T15:41:11.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.850+0000 7fb4ae4e5740 10 client.0 _ll_register_callbacks cb 0xf316a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T15:41:11.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.850+0000 7fb4a97d7700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0xd40ae0 0xfaeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:11.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.850+0000 7fb4a97d7700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0xd40ae0 0xfaeab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35178/0 (socket says 172.21.15.3:35178) 2023-10-08T15:41:11.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.850+0000 7fb4a97d7700 1 -- 172.21.15.3:0/1365820045 learned_addr learned my addr 172.21.15.3:0/1365820045 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:11.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.850+0000 7fb4a9fd8700 1 --2- 172.21.15.3:0/1365820045 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd40710 0xfae570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:11.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.850+0000 7fb4aa7d9700 1 --2- 172.21.15.3:0/1365820045 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0xd8b790 0xfaf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:11.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.850+0000 7fb4a97d7700 1 -- 172.21.15.3:0/1365820045 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0xd8b790 msgr2=0xfaf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:11.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.850+0000 7fb4a97d7700 1 --2- 172.21.15.3:0/1365820045 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0xd8b790 0xfaf5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:11.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.850+0000 7fb4a97d7700 1 -- 172.21.15.3:0/1365820045 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd40710 msgr2=0xfae570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:11.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.850+0000 7fb4a97d7700 1 --2- 172.21.15.3:0/1365820045 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd40710 0xfae570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:11.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.850+0000 7fb4a97d7700 1 -- 172.21.15.3:0/1365820045 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb494011ad0 con 0xd40ae0 2023-10-08T15:41:11.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.850+0000 7fb4a97d7700 1 --2- 172.21.15.3:0/1365820045 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0xd40ae0 0xfaeab0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fb48c0078f0 tx=0x7fb48c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c02c567abd150485 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:11.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.850+0000 7fb483fff700 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2023-10-08T15:41:11.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.850+0000 7fb483fff700 1 -- 172.21.15.3:0/1365820045 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48c001f10 con 0xd40ae0 2023-10-08T15:41:11.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.850+0000 7fb483fff700 1 -- 172.21.15.3:0/1365820045 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(49..49 src has 1..49) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb48c0108e0 con 0xd40ae0 2023-10-08T15:41:11.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.850+0000 7fb4ae4e5740 1 -- 172.21.15.3:0/1365820045 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xe86cc0 con 0xd40ae0 2023-10-08T15:41:11.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.854+0000 7fb483fff700 1 -- 172.21.15.3:0/1365820045 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb48c010cb0 con 0xd40ae0 2023-10-08T15:41:11.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.854+0000 7fb4ae4e5740 10 client.5829 fetch_fsmap learned FSMap version 27 2023-10-08T15:41:11.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.854+0000 7fb4ae4e5740 1 -- 172.21.15.3:0/1365820045 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) v3 -- 0xeb6370 con 0xd40ae0 2023-10-08T15:41:11.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.854+0000 7fb483fff700 1 -- 172.21.15.3:0/1365820045 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xe86cc0 con 0xd40ae0 2023-10-08T15:41:11.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.854+0000 7fb483fff700 1 -- 172.21.15.3:0/1365820045 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 27) v1 ==== 2010+0+0 (secure 0 0 0) 0x7fb48c014c50 con 0xd40ae0 2023-10-08T15:41:11.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.854+0000 7fb4ae4e5740 10 client.5829 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T15:41:11.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.854+0000 7fb4ae4e5740 10 client.5829 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-08T15:41:11.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.854+0000 7fb4ae4e5740 20 client.5829 populate_metadata read hostname 'smithi003' 2023-10-08T15:41:11.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.854+0000 7fb4ae4e5740 1 --2- 172.21.15.3:0/1365820045 >> [v2:172.21.15.3:6832/3789195831,v1:172.21.15.3:6833/3789195831] conn(0xfbeb90 0xfc0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:11.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.854+0000 7fb4ae4e5740 4 client.5829 mds_command: new command op to 5685 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-08T15:41:11.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.854+0000 7fb4ae4e5740 1 -- 172.21.15.3:0/1365820045 --> [v2:172.21.15.3:6832/3789195831,v1:172.21.15.3:6833/3789195831] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xe8a3e0 con 0xfbeb90 2023-10-08T15:41:11.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.854+0000 7fb4a9fd8700 1 --2- 172.21.15.3:0/1365820045 >> [v2:172.21.15.3:6832/3789195831,v1:172.21.15.3:6833/3789195831] conn(0xfbeb90 0xfc0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:11.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.854+0000 7fb483fff700 10 client.5829 ms_handle_connect on v2:172.21.15.3:6832/3789195831 2023-10-08T15:41:11.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.854+0000 7fb4a9fd8700 1 --2- 172.21.15.3:0/1365820045 >> [v2:172.21.15.3:6832/3789195831,v1:172.21.15.3:6833/3789195831] conn(0xfbeb90 0xfc0f70 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd72d00223a489ce server_cookie=3af8df82e65164a8 in_seq=0 out_seq=0 2023-10-08T15:41:11.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.854+0000 7fb483fff700 1 -- 172.21.15.3:0/1365820045 <== mds.0 v2:172.21.15.3:6832/3789195831 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0xe8a3e0 con 0xfbeb90 2023-10-08T15:41:11.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.854+0000 7fb483fff700 10 client.5829 handle_command_reply: tid=0 2023-10-08T15:41:11.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.854+0000 7fb4ae4e5740 1 client.5829 shutdown 2023-10-08T15:41:11.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.854+0000 7fb4ae4e5740 1 -- 172.21.15.3:0/1365820045 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0xd40ae0 msgr2=0xfaeab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:11.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.854+0000 7fb4ae4e5740 1 --2- 172.21.15.3:0/1365820045 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0xd40ae0 0xfaeab0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fb48c0078f0 tx=0x7fb48c009040 comp rx=0 tx=0).stop 2023-10-08T15:41:11.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.854+0000 7fb4ae4e5740 1 -- 172.21.15.3:0/1365820045 shutdown_connections 2023-10-08T15:41:11.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.854+0000 7fb4ae4e5740 1 --2- 172.21.15.3:0/1365820045 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0xd8b790 0xfaf5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:11.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.854+0000 7fb4ae4e5740 1 --2- 172.21.15.3:0/1365820045 >> [v2:172.21.15.3:6832/3789195831,v1:172.21.15.3:6833/3789195831] conn(0xfbeb90 0xfc0f70 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:11.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.854+0000 7fb4ae4e5740 1 --2- 172.21.15.3:0/1365820045 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0xd40ae0 0xfaeab0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:11.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.854+0000 7fb483fff700 0 client.5829 ms_handle_reset on v2:172.21.15.3:6832/3789195831 2023-10-08T15:41:11.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.854+0000 7fb4ae4e5740 1 --2- 172.21.15.3:0/1365820045 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd40710 0xfae570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:11.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.854+0000 7fb4ae4e5740 1 -- 172.21.15.3:0/1365820045 >> 172.21.15.3:0/1365820045 conn(0xd40eb0 msgr2=0xf72f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:11.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.854+0000 7fb4ae4e5740 1 -- 172.21.15.3:0/1365820045 shutdown_connections 2023-10-08T15:41:11.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.854+0000 7fb4ae4e5740 1 -- 172.21.15.3:0/1365820045 wait complete. 2023-10-08T15:41:11.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.854+0000 7fb4ae4e5740 20 client.5829 trim_cache size 0 max 16384 2023-10-08T15:41:11.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.874+0000 7fb4ae4e5740 1 Processor -- start 2023-10-08T15:41:11.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.874+0000 7fb4ae4e5740 1 -- start start 2023-10-08T15:41:11.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.874+0000 7fb4ae4e5740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0xd40eb0 0xfb5f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:11.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.874+0000 7fb4ae4e5740 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0xd40710 0xf76050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:11.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.874+0000 7fb4ae4e5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd40ae0 0xf76590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:11.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.874+0000 7fb4ae4e5740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0xe88b80 con 0xd40eb0 2023-10-08T15:41:11.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.874+0000 7fb4ae4e5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0xebbf40 con 0xd40ae0 2023-10-08T15:41:11.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.874+0000 7fb4ae4e5740 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0xe96c90 con 0xd40710 2023-10-08T15:41:11.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.874+0000 7fb4a9fd8700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0xd40eb0 0xfb5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:11.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.874+0000 7fb4a9fd8700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0xd40eb0 0xfb5f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35192/0 (socket says 172.21.15.3:35192) 2023-10-08T15:41:11.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.874+0000 7fb4a9fd8700 1 -- 172.21.15.3:0/3402011976 learned_addr learned my addr 172.21.15.3:0/3402011976 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:11.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.874+0000 7fb4a97d7700 1 --2- 172.21.15.3:0/3402011976 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0xd40710 0xf76050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:11.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.874+0000 7fb4aa7d9700 1 --2- 172.21.15.3:0/3402011976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd40ae0 0xf76590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:11.883 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.878+0000 7fb4a9fd8700 1 -- 172.21.15.3:0/3402011976 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0xd40710 msgr2=0xf76050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:11.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.878+0000 7fb4a9fd8700 1 --2- 172.21.15.3:0/3402011976 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0xd40710 0xf76050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:11.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.878+0000 7fb4a9fd8700 1 -- 172.21.15.3:0/3402011976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd40ae0 msgr2=0xf76590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:11.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.878+0000 7fb4a9fd8700 1 --2- 172.21.15.3:0/3402011976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd40ae0 0xf76590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:11.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.878+0000 7fb4a9fd8700 1 -- 172.21.15.3:0/3402011976 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xe9cd80 con 0xd40eb0 2023-10-08T15:41:11.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.878+0000 7fb4a97d7700 1 --2- 172.21.15.3:0/3402011976 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0xd40710 0xf76050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:11.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.878+0000 7fb4a9fd8700 1 --2- 172.21.15.3:0/3402011976 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0xd40eb0 0xfb5f60 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fb494008010 tx=0x7fb49402d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17fe9983382704c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:11.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.878+0000 7fb49b7fe700 1 -- 172.21.15.3:0/3402011976 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb494030040 con 0xd40eb0 2023-10-08T15:41:11.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.878+0000 7fb49b7fe700 1 -- 172.21.15.3:0/3402011976 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb494032040 con 0xd40eb0 2023-10-08T15:41:11.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.878+0000 7fb49b7fe700 1 -- 172.21.15.3:0/3402011976 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb494009aa0 con 0xd40eb0 2023-10-08T15:41:11.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.878+0000 7fb4ae4e5740 1 -- 172.21.15.3:0/3402011976 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0xd40eb0 msgr2=0xfb5f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:11.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.878+0000 7fb4ae4e5740 1 --2- 172.21.15.3:0/3402011976 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0xd40eb0 0xfb5f60 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fb494008010 tx=0x7fb49402d040 comp rx=0 tx=0).stop 2023-10-08T15:41:11.885 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.878+0000 7fb4ae4e5740 1 -- 172.21.15.3:0/3402011976 shutdown_connections 2023-10-08T15:41:11.885 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.878+0000 7fb4ae4e5740 1 --2- 172.21.15.3:0/3402011976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd40ae0 0xf76590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:11.885 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.878+0000 7fb4ae4e5740 1 --2- 172.21.15.3:0/3402011976 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0xd40710 0xf76050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:11.885 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.878+0000 7fb4ae4e5740 1 --2- 172.21.15.3:0/3402011976 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0xd40eb0 0xfb5f60 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:11.885 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.878+0000 7fb4ae4e5740 1 -- 172.21.15.3:0/3402011976 >> 172.21.15.3:0/3402011976 conn(0xf75880 msgr2=0xfb5640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:11.885 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.878+0000 7fb4ae4e5740 1 -- 172.21.15.3:0/3402011976 shutdown_connections 2023-10-08T15:41:11.885 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.878+0000 7fb4ae4e5740 1 -- 172.21.15.3:0/3402011976 wait complete. 2023-10-08T15:41:11.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.878+0000 7fb4ae4e5740 1 -- start start 2023-10-08T15:41:11.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.878+0000 7fb4ae4e5740 1 Processor -- start 2023-10-08T15:41:11.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.882+0000 7fb4ae4e5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd40710 0xf797c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:11.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.882+0000 7fb4ae4e5740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0xd40ae0 0xfcf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:11.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.882+0000 7fb4ae4e5740 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0xd40eb0 0xfcfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:11.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.882+0000 7fb4ae4e5740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0xee5890 con 0xd40ae0 2023-10-08T15:41:11.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.882+0000 7fb4ae4e5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0xee6d60 con 0xd40710 2023-10-08T15:41:11.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.882+0000 7fb4ae4e5740 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0xeec490 con 0xd40eb0 2023-10-08T15:41:11.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.882+0000 7fb4ae4e5740 10 client.0 _ll_register_callbacks cb 0xe0fd00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T15:41:11.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.882+0000 7fb4a97d7700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0xd40ae0 0xfcf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:11.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.882+0000 7fb4a97d7700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0xd40ae0 0xfcf9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35206/0 (socket says 172.21.15.3:35206) 2023-10-08T15:41:11.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.882+0000 7fb4a97d7700 1 -- 172.21.15.3:0/3561316312 learned_addr learned my addr 172.21.15.3:0/3561316312 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:11.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.882+0000 7fb4aa7d9700 1 --2- 172.21.15.3:0/3561316312 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0xd40eb0 0xfcfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:11.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.882+0000 7fb4a9fd8700 1 --2- 172.21.15.3:0/3561316312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd40710 0xf797c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:11.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.882+0000 7fb4a97d7700 1 -- 172.21.15.3:0/3561316312 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0xd40eb0 msgr2=0xfcfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:11.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.882+0000 7fb4a97d7700 1 --2- 172.21.15.3:0/3561316312 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0xd40eb0 0xfcfee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:11.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.882+0000 7fb4a97d7700 1 -- 172.21.15.3:0/3561316312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd40710 msgr2=0xf797c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:11.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.882+0000 7fb4a97d7700 1 --2- 172.21.15.3:0/3561316312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd40710 0xf797c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:11.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.882+0000 7fb4a97d7700 1 -- 172.21.15.3:0/3561316312 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0xd8c9e0 con 0xd40ae0 2023-10-08T15:41:11.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.882+0000 7fb4a9fd8700 1 --2- 172.21.15.3:0/3561316312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd40710 0xf797c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:11.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.882+0000 7fb4a97d7700 1 --2- 172.21.15.3:0/3561316312 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0xd40ae0 0xfcf9a0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fb48c0078f0 tx=0x7fb48c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=875d240fca62b15f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:11.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.882+0000 7fb483fff700 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2023-10-08T15:41:11.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.882+0000 7fb483fff700 1 -- 172.21.15.3:0/3561316312 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48c02b070 con 0xd40ae0 2023-10-08T15:41:11.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.882+0000 7fb483fff700 1 -- 172.21.15.3:0/3561316312 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(49..49 src has 1..49) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb48c0108e0 con 0xd40ae0 2023-10-08T15:41:11.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.882+0000 7fb4ae4e5740 1 -- 172.21.15.3:0/3561316312 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb494015dc0 con 0xd40ae0 2023-10-08T15:41:11.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.882+0000 7fb483fff700 1 -- 172.21.15.3:0/3561316312 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb48c01d3f0 con 0xd40ae0 2023-10-08T15:41:11.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.882+0000 7fb4ae4e5740 10 client.5835 fetch_fsmap learned FSMap version 27 2023-10-08T15:41:11.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.882+0000 7fb4ae4e5740 1 -- 172.21.15.3:0/3561316312 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) v3 -- 0xe91130 con 0xd40ae0 2023-10-08T15:41:11.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.882+0000 7fb483fff700 1 -- 172.21.15.3:0/3561316312 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb494015dc0 con 0xd40ae0 2023-10-08T15:41:11.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.882+0000 7fb483fff700 1 -- 172.21.15.3:0/3561316312 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 27) v1 ==== 2010+0+0 (secure 0 0 0) 0x7fb48c014c50 con 0xd40ae0 2023-10-08T15:41:11.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.882+0000 7fb4ae4e5740 10 client.5835 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T15:41:11.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.882+0000 7fb4ae4e5740 10 client.5835 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-08T15:41:11.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.882+0000 7fb4ae4e5740 20 client.5835 populate_metadata read hostname 'smithi003' 2023-10-08T15:41:11.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.882+0000 7fb4ae4e5740 1 --2- 172.21.15.3:0/3561316312 >> [v2:172.21.15.3:6832/3789195831,v1:172.21.15.3:6833/3789195831] conn(0xd8b790 0xfd0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:11.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.882+0000 7fb4ae4e5740 4 client.5835 mds_command: new command op to 5685 tid=0[{"prefix": "status"}] 2023-10-08T15:41:11.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.882+0000 7fb4ae4e5740 1 -- 172.21.15.3:0/3561316312 --> [v2:172.21.15.3:6832/3789195831,v1:172.21.15.3:6833/3789195831] -- command(tid 0: {"prefix": "status"}) v1 -- 0xebc410 con 0xd8b790 2023-10-08T15:41:11.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.886+0000 7fb4a9fd8700 1 --2- 172.21.15.3:0/3561316312 >> [v2:172.21.15.3:6832/3789195831,v1:172.21.15.3:6833/3789195831] conn(0xd8b790 0xfd0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:11.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.886+0000 7fb483fff700 10 client.5835 ms_handle_connect on v2:172.21.15.3:6832/3789195831 2023-10-08T15:41:11.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.886+0000 7fb4a9fd8700 1 --2- 172.21.15.3:0/3561316312 >> [v2:172.21.15.3:6832/3789195831,v1:172.21.15.3:6833/3789195831] conn(0xd8b790 0xfd0420 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5723267e2d0915f server_cookie=270d6df829285d0b in_seq=0 out_seq=0 2023-10-08T15:41:11.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.886+0000 7fb483fff700 1 -- 172.21.15.3:0/3561316312 <== mds.0 v2:172.21.15.3:6832/3789195831 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0xebc410 con 0xd8b790 2023-10-08T15:41:11.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.886+0000 7fb483fff700 10 client.5835 handle_command_reply: tid=0 2023-10-08T15:41:11.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.886+0000 7fb4ae4e5740 1 client.5835 shutdown 2023-10-08T15:41:11.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.886+0000 7fb4ae4e5740 1 -- 172.21.15.3:0/3561316312 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0xd40ae0 msgr2=0xfcf9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:11.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.886+0000 7fb4ae4e5740 1 --2- 172.21.15.3:0/3561316312 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0xd40ae0 0xfcf9a0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fb48c0078f0 tx=0x7fb48c01a000 comp rx=0 tx=0).stop 2023-10-08T15:41:11.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.886+0000 7fb4ae4e5740 1 -- 172.21.15.3:0/3561316312 shutdown_connections 2023-10-08T15:41:11.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.886+0000 7fb4ae4e5740 1 --2- 172.21.15.3:0/3561316312 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0xd40eb0 0xfcfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:11.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.886+0000 7fb4ae4e5740 1 --2- 172.21.15.3:0/3561316312 >> [v2:172.21.15.3:6832/3789195831,v1:172.21.15.3:6833/3789195831] conn(0xd8b790 0xfd0420 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:11.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.886+0000 7fb4ae4e5740 1 --2- 172.21.15.3:0/3561316312 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0xd40ae0 0xfcf9a0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:11.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.886+0000 7fb483fff700 0 client.5835 ms_handle_reset on v2:172.21.15.3:6832/3789195831 2023-10-08T15:41:11.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.886+0000 7fb4ae4e5740 1 --2- 172.21.15.3:0/3561316312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd40710 0xf797c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:11.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.886+0000 7fb4ae4e5740 1 -- 172.21.15.3:0/3561316312 >> 172.21.15.3:0/3561316312 conn(0xf75880 msgr2=0x1002ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:11.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.886+0000 7fb4ae4e5740 1 -- 172.21.15.3:0/3561316312 shutdown_connections 2023-10-08T15:41:11.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.886+0000 7fb4ae4e5740 1 -- 172.21.15.3:0/3561316312 wait complete. 2023-10-08T15:41:11.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.886+0000 7fb4ae4e5740 20 client.5835 trim_cache size 0 max 16384 2023-10-08T15:41:11.895 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2023-10-08T15:41:11.895 INFO:teuthology.orchestra.run.smithi003.stdout: "cluster_fsid": "7635972e-cd66-4a8f-a231-378db8b3847a", 2023-10-08T15:41:11.895 INFO:teuthology.orchestra.run.smithi003.stdout: "whoami": 0, 2023-10-08T15:41:11.895 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 5685, 2023-10-08T15:41:11.895 INFO:teuthology.orchestra.run.smithi003.stdout: "want_state": "up:active", 2023-10-08T15:41:11.895 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "up:active", 2023-10-08T15:41:11.895 INFO:teuthology.orchestra.run.smithi003.stdout: "fs_name": "cephfs", 2023-10-08T15:41:11.896 INFO:teuthology.orchestra.run.smithi003.stdout: "rank_uptime": 5.4487562980000002, 2023-10-08T15:41:11.896 INFO:teuthology.orchestra.run.smithi003.stdout: "mdsmap_epoch": 27, 2023-10-08T15:41:11.896 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch": 49, 2023-10-08T15:41:11.896 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch_barrier": 49, 2023-10-08T15:41:11.896 INFO:teuthology.orchestra.run.smithi003.stdout: "uptime": 10.639950976 2023-10-08T15:41:11.896 INFO:teuthology.orchestra.run.smithi003.stdout:} 2023-10-08T15:41:11.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.886+0000 7fb4ac23c700 1 -- 172.21.15.3:0/327756277 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb484060580 msgr2=0x7fb484062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:11.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.886+0000 7fb4ac23c700 1 --2- 172.21.15.3:0/327756277 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb484060580 0x7fb484062a30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb494009d80 tx=0x7fb494008040 comp rx=0 tx=0).stop 2023-10-08T15:41:11.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.886+0000 7fb4ac23c700 1 -- 172.21.15.3:0/327756277 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb4a40bde90 msgr2=0x7fb4a4150f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:11.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.886+0000 7fb4ac23c700 1 --2- 172.21.15.3:0/327756277 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb4a40bde90 0x7fb4a4150f90 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fb4a40bdb40 tx=0x7fb49c017000 comp rx=0 tx=0).stop 2023-10-08T15:41:11.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.886+0000 7fb4ac23c700 1 -- 172.21.15.3:0/327756277 shutdown_connections 2023-10-08T15:41:11.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.886+0000 7fb4ac23c700 1 --2- 172.21.15.3:0/327756277 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb484060580 0x7fb484062a30 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:11.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.886+0000 7fb4ac23c700 1 --2- 172.21.15.3:0/327756277 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb4a40bde90 0x7fb4a4150f90 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:11.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.886+0000 7fb4ac23c700 1 --2- 172.21.15.3:0/327756277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4a40bcca0 0x7fb4a414bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:11.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.886+0000 7fb4ac23c700 1 --2- 172.21.15.3:0/327756277 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb4a40670e0 0x7fb4a4163350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:11.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.886+0000 7fb4ac23c700 1 -- 172.21.15.3:0/327756277 >> 172.21.15.3:0/327756277 conn(0x7fb4a406b9b0 msgr2=0x7fb4a4150010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:11.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.886+0000 7fb4ac23c700 1 -- 172.21.15.3:0/327756277 shutdown_connections 2023-10-08T15:41:11.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:11.886+0000 7fb4ac23c700 1 -- 172.21.15.3:0/327756277 wait complete. 2023-10-08T15:41:11.909 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T15:41:12.022 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.018+0000 7f688a04f700 1 Processor -- start 2023-10-08T15:41:12.022 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.018+0000 7f688a04f700 1 -- start start 2023-10-08T15:41:12.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.018+0000 7f688a04f700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f688414ac20 0x7f688414aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:12.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.018+0000 7f688a04f700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f68840681f0 0x7f68840670e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:12.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.018+0000 7f688a04f700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6884069f70 con 0x7f6884067620 2023-10-08T15:41:12.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.018+0000 7f688a04f700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68840c0b10 con 0x7f68840681f0 2023-10-08T15:41:12.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.018+0000 7f688a04f700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68840c0c50 con 0x7f688414ac20 2023-10-08T15:41:12.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.018+0000 7f6883fff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f6884067620 0x7f6884068910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:50750/0 (socket says 172.21.15.3:50750) 2023-10-08T15:41:12.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.018+0000 7f6883fff700 1 -- 172.21.15.3:0/2882133582 learned_addr learned my addr 172.21.15.3:0/2882133582 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:41:12.025 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.018+0000 7f68837fe700 1 --2- 172.21.15.3:0/2882133582 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f688414ac20 0x7f688414aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:12.025 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.018+0000 7f6882ffd700 1 --2- 172.21.15.3:0/2882133582 >> v2:172.21.15.50:3300/0 conn(0x7f68840681f0 0x7f68840670e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:12.026 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.018+0000 7f68827fc700 1 -- 172.21.15.3:0/2882133582 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4046120011 0 0) 0x7f6884069f70 con 0x7f6884067620 2023-10-08T15:41:12.026 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.018+0000 7f68827fc700 1 -- 172.21.15.3:0/2882133582 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6870003570 con 0x7f6884067620 2023-10-08T15:41:12.026 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.018+0000 7f68837fe700 1 -- 172.21.15.3:0/2882133582 >> v2:172.21.15.50:3300/0 conn(0x7f68840681f0 msgr2=0x7f68840670e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:12.026 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.018+0000 7f68837fe700 1 --2- 172.21.15.3:0/2882133582 >> v2:172.21.15.50:3300/0 conn(0x7f68840681f0 0x7f68840670e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:12.026 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.018+0000 7f68837fe700 1 -- 172.21.15.3:0/2882133582 >> v1:172.21.15.3:6789/0 conn(0x7f6884067620 legacy=0x7f6884068910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:12.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.018+0000 7f68837fe700 1 -- 172.21.15.3:0/2882133582 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f688409ee30 con 0x7f688414ac20 2023-10-08T15:41:12.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.018+0000 7f6882ffd700 1 --2- 172.21.15.3:0/2882133582 >> v2:172.21.15.50:3300/0 conn(0x7f68840681f0 0x7f68840670e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:41:12.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.022+0000 7f68837fe700 1 --2- 172.21.15.3:0/2882133582 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f688414ac20 0x7f688414aff0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f686c009e60 tx=0x7f686c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1223c5628c58ca3b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:12.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.022+0000 7f68827fc700 1 -- 172.21.15.3:0/2882133582 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686c00e070 con 0x7f688414ac20 2023-10-08T15:41:12.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.022+0000 7f68827fc700 1 -- 172.21.15.3:0/2882133582 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f686c00bab0 con 0x7f688414ac20 2023-10-08T15:41:12.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.022+0000 7f68827fc700 1 -- 172.21.15.3:0/2882133582 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686c00be70 con 0x7f688414ac20 2023-10-08T15:41:12.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.022+0000 7f688a04f700 1 -- 172.21.15.3:0/2882133582 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f688414ac20 msgr2=0x7f688414aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:12.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.022+0000 7f688a04f700 1 --2- 172.21.15.3:0/2882133582 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f688414ac20 0x7f688414aff0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f686c009e60 tx=0x7f686c009780 comp rx=0 tx=0).stop 2023-10-08T15:41:12.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.022+0000 7f688a04f700 1 -- 172.21.15.3:0/2882133582 shutdown_connections 2023-10-08T15:41:12.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.022+0000 7f688a04f700 1 --2- 172.21.15.3:0/2882133582 >> v2:172.21.15.50:3300/0 conn(0x7f68840681f0 0x7f68840670e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:12.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.022+0000 7f688a04f700 1 --2- 172.21.15.3:0/2882133582 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f688414ac20 0x7f688414aff0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:12.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.022+0000 7f688a04f700 1 -- 172.21.15.3:0/2882133582 >> 172.21.15.3:0/2882133582 conn(0x7f688406e0d0 msgr2=0x7f688406e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:12.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.022+0000 7f688a04f700 1 -- 172.21.15.3:0/2882133582 shutdown_connections 2023-10-08T15:41:12.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.022+0000 7f688a04f700 1 -- 172.21.15.3:0/2882133582 wait complete. 2023-10-08T15:41:12.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.022+0000 7f688a04f700 1 Processor -- start 2023-10-08T15:41:12.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.022+0000 7f688a04f700 1 -- start start 2023-10-08T15:41:12.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.026+0000 7f688a04f700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6884067620 0x7f68840b97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:12.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.026+0000 7f688a04f700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f68840681f0 0x7f6884147e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:12.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.026+0000 7f688a04f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f688414ac20 0x7f6884148360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:12.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.026+0000 7f688a04f700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68840bc0f0 con 0x7f68840681f0 2023-10-08T15:41:12.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.026+0000 7f688a04f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688414fca0 con 0x7f688414ac20 2023-10-08T15:41:12.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.026+0000 7f688a04f700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6884150260 con 0x7f6884067620 2023-10-08T15:41:12.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.026+0000 7f6882ffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f68840681f0 0x7f6884147e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:12.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.026+0000 7f6882ffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f68840681f0 0x7f6884147e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35208/0 (socket says 172.21.15.3:35208) 2023-10-08T15:41:12.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.026+0000 7f6882ffd700 1 -- 172.21.15.3:0/2726112839 learned_addr learned my addr 172.21.15.3:0/2726112839 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:12.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.026+0000 7f68837fe700 1 --2- 172.21.15.3:0/2726112839 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6884067620 0x7f68840b97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:12.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.026+0000 7f6883fff700 1 --2- 172.21.15.3:0/2726112839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f688414ac20 0x7f6884148360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:12.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.026+0000 7f6882ffd700 1 -- 172.21.15.3:0/2726112839 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6884067620 msgr2=0x7f68840b97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:12.033 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.026+0000 7f6882ffd700 1 --2- 172.21.15.3:0/2726112839 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6884067620 0x7f68840b97b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:12.033 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.026+0000 7f6882ffd700 1 -- 172.21.15.3:0/2726112839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f688414ac20 msgr2=0x7f6884148360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:12.033 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.026+0000 7f6882ffd700 1 --2- 172.21.15.3:0/2726112839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f688414ac20 0x7f6884148360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:12.033 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.026+0000 7f6882ffd700 1 -- 172.21.15.3:0/2726112839 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6874009420 con 0x7f68840681f0 2023-10-08T15:41:12.033 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.026+0000 7f6882ffd700 1 --2- 172.21.15.3:0/2726112839 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f68840681f0 0x7f6884147e20 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f687400ec80 tx=0x7f68740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:12.033 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.026+0000 7f687b7fe700 1 -- 172.21.15.3:0/2726112839 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687400c920 con 0x7f68840681f0 2023-10-08T15:41:12.033 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.026+0000 7f687b7fe700 1 -- 172.21.15.3:0/2726112839 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f687400ca80 con 0x7f68840681f0 2023-10-08T15:41:12.033 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.026+0000 7f688a04f700 1 -- 172.21.15.3:0/2726112839 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f686c009a20 con 0x7f68840681f0 2023-10-08T15:41:12.033 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.026+0000 7f687b7fe700 1 -- 172.21.15.3:0/2726112839 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687400ce00 con 0x7f68840681f0 2023-10-08T15:41:12.033 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.026+0000 7f688a04f700 1 -- 172.21.15.3:0/2726112839 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68840a2700 con 0x7f68840681f0 2023-10-08T15:41:12.034 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.026+0000 7f688a04f700 1 -- 172.21.15.3:0/2726112839 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6884150410 con 0x7f68840681f0 2023-10-08T15:41:12.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.030+0000 7f687b7fe700 1 -- 172.21.15.3:0/2726112839 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6874013680 con 0x7f68840681f0 2023-10-08T15:41:12.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.030+0000 7f687b7fe700 1 --2- 172.21.15.3:0/2726112839 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f6864060550 0x7f6864062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:12.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.030+0000 7f687b7fe700 1 -- 172.21.15.3:0/2726112839 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f687407cb00 con 0x7f68840681f0 2023-10-08T15:41:12.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.030+0000 7f68837fe700 1 --2- 172.21.15.3:0/2726112839 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f6864060550 0x7f6864062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:12.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.030+0000 7f68837fe700 1 --2- 172.21.15.3:0/2726112839 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f6864060550 0x7f6864062a00 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f686c0097c0 tx=0x7f686c019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:12.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.034+0000 7f687b7fe700 1 -- 172.21.15.3:0/2726112839 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6884150410 con 0x7f68840681f0 2023-10-08T15:41:12.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.230+0000 7f688a04f700 1 -- 172.21.15.3:0/2726112839 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f68841503d0 con 0x7f68840681f0 2023-10-08T15:41:12.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.230+0000 7f687b7fe700 1 -- 172.21.15.3:0/2726112839 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) v1 ==== 53+0+73 (secure 0 0 0) 0x7f687404d0f0 con 0x7f68840681f0 2023-10-08T15:41:12.235 INFO:teuthology.orchestra.run.smithi003.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T15:41:12.239 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.234+0000 7f688a04f700 1 -- 172.21.15.3:0/2726112839 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f6864060550 msgr2=0x7f6864062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:12.239 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.234+0000 7f688a04f700 1 --2- 172.21.15.3:0/2726112839 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f6864060550 0x7f6864062a00 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f686c0097c0 tx=0x7f686c019000 comp rx=0 tx=0).stop 2023-10-08T15:41:12.239 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.234+0000 7f688a04f700 1 -- 172.21.15.3:0/2726112839 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f68840681f0 msgr2=0x7f6884147e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:12.239 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.234+0000 7f688a04f700 1 --2- 172.21.15.3:0/2726112839 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f68840681f0 0x7f6884147e20 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f687400ec80 tx=0x7f68740091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:12.239 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.234+0000 7f688a04f700 1 -- 172.21.15.3:0/2726112839 shutdown_connections 2023-10-08T15:41:12.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.234+0000 7f688a04f700 1 --2- 172.21.15.3:0/2726112839 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f6864060550 0x7f6864062a00 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:12.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.234+0000 7f688a04f700 1 --2- 172.21.15.3:0/2726112839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f688414ac20 0x7f6884148360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:12.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.234+0000 7f688a04f700 1 --2- 172.21.15.3:0/2726112839 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f68840681f0 0x7f6884147e20 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:12.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.234+0000 7f688a04f700 1 --2- 172.21.15.3:0/2726112839 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6884067620 0x7f68840b97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:12.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.234+0000 7f688a04f700 1 -- 172.21.15.3:0/2726112839 >> 172.21.15.3:0/2726112839 conn(0x7f688406e0d0 msgr2=0x7f688414a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:12.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.234+0000 7f688a04f700 1 -- 172.21.15.3:0/2726112839 shutdown_connections 2023-10-08T15:41:12.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:12.234+0000 7f688a04f700 1 -- 172.21.15.3:0/2726112839 wait complete. 2023-10-08T15:41:12.250 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-08T15:41:12.250 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T15:41:12.250 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi089.front.sepia.ceph.com 2023-10-08T15:41:12.250 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-08T15:41:12.250 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T15:41:12.250 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-08T15:41:12.250 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-08T15:41:12.250 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T15:41:12.250 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T15:41:12.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:41:12.251 DEBUG:teuthology.orchestra.run.smithi089:> ip addr 2023-10-08T15:41:12.259 INFO:teuthology.orchestra.run.smithi089.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T15:41:12.259 INFO:teuthology.orchestra.run.smithi089.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T15:41:12.259 INFO:teuthology.orchestra.run.smithi089.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T15:41:12.259 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:41:12.259 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 ::1/128 scope host 2023-10-08T15:41:12.259 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:41:12.259 INFO:teuthology.orchestra.run.smithi089.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T15:41:12.259 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c6 brd ff:ff:ff:ff:ff:ff 2023-10-08T15:41:12.260 INFO:teuthology.orchestra.run.smithi089.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T15:41:12.260 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c7 brd ff:ff:ff:ff:ff:ff 2023-10-08T15:41:12.260 INFO:teuthology.orchestra.run.smithi089.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T15:41:12.260 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:00 brd ff:ff:ff:ff:ff:ff 2023-10-08T15:41:12.260 INFO:teuthology.orchestra.run.smithi089.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T15:41:12.260 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:01 brd ff:ff:ff:ff:ff:ff 2023-10-08T15:41:12.260 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.21.15.89/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-08T15:41:12.260 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft 42325sec preferred_lft 42325sec 2023-10-08T15:41:12.260 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::ec4:7aff:fe8f:d501/64 scope link 2023-10-08T15:41:12.260 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:41:12.261 INFO:teuthology.orchestra.run.smithi089.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-08T15:41:12.261 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 02:42:0d:de:29:b2 brd ff:ff:ff:ff:ff:ff 2023-10-08T15:41:12.261 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-08T15:41:12.261 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:41:12.261 INFO:teuthology.orchestra.run.smithi089.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T15:41:12.261 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 96:c9:6f:4e:3d:df brd ff:ff:ff:ff:ff:ff 2023-10-08T15:41:12.261 INFO:teuthology.orchestra.run.smithi089.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T15:41:12.261 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:41:12.261 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::6c37:4fff:fe02:5a19/64 scope link 2023-10-08T15:41:12.262 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:41:12.262 INFO:teuthology.orchestra.run.smithi089.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T15:41:12.262 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 96:c9:6f:4e:3d:df brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T15:41:12.262 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::94c9:6fff:fe4e:3ddf/64 scope link 2023-10-08T15:41:12.262 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:41:12.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:41:12.262 DEBUG:teuthology.orchestra.run.smithi089:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T15:41:12.277 INFO:teuthology.orchestra.run.smithi089.stdout:1 2023-10-08T15:41:12.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:41:12.279 DEBUG:teuthology.orchestra.run.smithi089:> route 2023-10-08T15:41:12.330 INFO:teuthology.orchestra.run.smithi089.stdout:Kernel IP routing table 2023-10-08T15:41:12.330 INFO:teuthology.orchestra.run.smithi089.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T15:41:12.330 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-08T15:41:12.330 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-08T15:41:12.331 INFO:teuthology.orchestra.run.smithi089.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-08T15:41:12.331 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-10-08T15:41:12.331 INFO:teuthology.orchestra.run.smithi089.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-08T15:41:12.331 INFO:teuthology.orchestra.run.smithi089.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T15:41:12.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:41:12.332 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-10-08T15:41:12.332 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-10-08T15:41:12.332 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-08T15:41:12.332 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-08T15:41:12.332 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-08T15:41:12.332 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-10-08T15:41:12.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:41:12.370 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2023-10-08T15:41:12.378 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T15:41:12.378 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T15:41:12.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:41:12.378 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set brx.0 up 2023-10-08T15:41:12.437 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-08T15:41:12.437 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T15:41:12.437 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-08T15:41:12.442 INFO:teuthology.orchestra.run.smithi089.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-08T15:41:12.442 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T15:41:12.442 DEBUG:teuthology.orchestra.run.smithi089:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-08T15:41:12.447 DEBUG:teuthology.orchestra.run.smithi089:> sudo modprobe fuse 2023-10-08T15:41:12.506 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-08T15:41:12.506 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-08T15:41:12.516 INFO:teuthology.orchestra.run.smithi089.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-08T15:41:12.517 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-08T15:41:12.517 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:41:12.517 DEBUG:teuthology.orchestra.run.smithi089:> ls /sys/fs/fuse/connections 2023-10-08T15:41:12.522 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-08T15:41:12.522 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-08T15:41:12.566 DEBUG:teuthology.orchestra.run.smithi089:> sudo modprobe fuse 2023-10-08T15:41:12.583 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-08T15:41:12.583 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-08T15:41:12.591 INFO:teuthology.orchestra.run.smithi089.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-08T15:41:12.592 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-08T15:41:12.593 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:41:12.593 DEBUG:teuthology.orchestra.run.smithi089:> ls /sys/fs/fuse/connections 2023-10-08T15:41:12.651 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi089.stderr:2023-10-08T15:41:12.646+0000 7fce5d0ea380 -1 init, newargv = 0x55bf4c218830 newargc=15 2023-10-08T15:41:12.651 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi089.stderr:ceph-fuse[29068]: starting ceph client 2023-10-08T15:41:12.661 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi089.stderr:ceph-fuse[29068]: starting fuse 2023-10-08T15:41:13.698 DEBUG:teuthology.orchestra.run.smithi089:> sudo modprobe fuse 2023-10-08T15:41:13.716 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-08T15:41:13.716 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-08T15:41:13.727 INFO:teuthology.orchestra.run.smithi089.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-08T15:41:13.728 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-08T15:41:13.729 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:41:13.729 DEBUG:teuthology.orchestra.run.smithi089:> ls /sys/fs/fuse/connections 2023-10-08T15:41:13.783 INFO:teuthology.orchestra.run.smithi089.stdout:52 2023-10-08T15:41:13.783 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-10-08T15:41:13.784 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-08T15:41:13.784 DEBUG:teuthology.orchestra.run.smithi089:> import glob 2023-10-08T15:41:13.784 DEBUG:teuthology.orchestra.run.smithi089:> import re 2023-10-08T15:41:13.784 DEBUG:teuthology.orchestra.run.smithi089:> import os 2023-10-08T15:41:13.784 DEBUG:teuthology.orchestra.run.smithi089:> import subprocess 2023-10-08T15:41:13.784 DEBUG:teuthology.orchestra.run.smithi089:> 2023-10-08T15:41:13.784 DEBUG:teuthology.orchestra.run.smithi089:> def _find_admin_socket(client_name): 2023-10-08T15:41:13.784 DEBUG:teuthology.orchestra.run.smithi089:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-08T15:41:13.784 DEBUG:teuthology.orchestra.run.smithi089:> files = glob.glob(asok_path) 2023-10-08T15:41:13.784 DEBUG:teuthology.orchestra.run.smithi089:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-08T15:41:13.784 DEBUG:teuthology.orchestra.run.smithi089:> 2023-10-08T15:41:13.784 DEBUG:teuthology.orchestra.run.smithi089:> # Given a non-glob path, it better be there 2023-10-08T15:41:13.785 DEBUG:teuthology.orchestra.run.smithi089:> if "*" not in asok_path: 2023-10-08T15:41:13.785 DEBUG:teuthology.orchestra.run.smithi089:> assert(len(files) == 1) 2023-10-08T15:41:13.785 DEBUG:teuthology.orchestra.run.smithi089:> return files[0] 2023-10-08T15:41:13.785 DEBUG:teuthology.orchestra.run.smithi089:> 2023-10-08T15:41:13.785 DEBUG:teuthology.orchestra.run.smithi089:> for f in files: 2023-10-08T15:41:13.785 DEBUG:teuthology.orchestra.run.smithi089:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-08T15:41:13.785 DEBUG:teuthology.orchestra.run.smithi089:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-08T15:41:13.785 DEBUG:teuthology.orchestra.run.smithi089:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-08T15:41:13.785 DEBUG:teuthology.orchestra.run.smithi089:> contents = proc_f.read() 2023-10-08T15:41:13.785 DEBUG:teuthology.orchestra.run.smithi089:> if mountpoint in contents: 2023-10-08T15:41:13.785 DEBUG:teuthology.orchestra.run.smithi089:> return f 2023-10-08T15:41:13.785 DEBUG:teuthology.orchestra.run.smithi089:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-08T15:41:13.785 DEBUG:teuthology.orchestra.run.smithi089:> 2023-10-08T15:41:13.786 DEBUG:teuthology.orchestra.run.smithi089:> print(_find_admin_socket("client.0")) 2023-10-08T15:41:13.786 DEBUG:teuthology.orchestra.run.smithi089:> ' 2023-10-08T15:41:13.867 INFO:teuthology.orchestra.run.smithi089.stdout:/var/run/ceph/ceph-client.0.29068.asok 2023-10-08T15:41:14.052 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.29068.asok 2023-10-08T15:41:14.052 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:41:14.052 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.29068.asok status 2023-10-08T15:41:14.146 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2023-10-08T15:41:14.147 INFO:teuthology.orchestra.run.smithi089.stdout: "metadata": { 2023-10-08T15:41:14.147 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph_sha1": "08cac0187919fc3a247efdf445f652e2fb30a647", 2023-10-08T15:41:14.147 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph_version": "ceph version 17.2.6-1320-g08cac018 (08cac0187919fc3a247efdf445f652e2fb30a647) quincy (stable)", 2023-10-08T15:41:14.147 INFO:teuthology.orchestra.run.smithi089.stdout: "entity_id": "0", 2023-10-08T15:41:14.147 INFO:teuthology.orchestra.run.smithi089.stdout: "hostname": "smithi089", 2023-10-08T15:41:14.147 INFO:teuthology.orchestra.run.smithi089.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-08T15:41:14.147 INFO:teuthology.orchestra.run.smithi089.stdout: "pid": "29068", 2023-10-08T15:41:14.147 INFO:teuthology.orchestra.run.smithi089.stdout: "root": "/" 2023-10-08T15:41:14.147 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-10-08T15:41:14.148 INFO:teuthology.orchestra.run.smithi089.stdout: "dentry_count": 0, 2023-10-08T15:41:14.148 INFO:teuthology.orchestra.run.smithi089.stdout: "dentry_pinned_count": 0, 2023-10-08T15:41:14.148 INFO:teuthology.orchestra.run.smithi089.stdout: "id": 5815, 2023-10-08T15:41:14.148 INFO:teuthology.orchestra.run.smithi089.stdout: "inst": { 2023-10-08T15:41:14.148 INFO:teuthology.orchestra.run.smithi089.stdout: "name": { 2023-10-08T15:41:14.148 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "client", 2023-10-08T15:41:14.148 INFO:teuthology.orchestra.run.smithi089.stdout: "num": 5815 2023-10-08T15:41:14.148 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-10-08T15:41:14.148 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": { 2023-10-08T15:41:14.148 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2023-10-08T15:41:14.149 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:0", 2023-10-08T15:41:14.149 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 21619605 2023-10-08T15:41:14.149 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-10-08T15:41:14.149 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-10-08T15:41:14.149 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": { 2023-10-08T15:41:14.149 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2023-10-08T15:41:14.149 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:0", 2023-10-08T15:41:14.149 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 21619605 2023-10-08T15:41:14.149 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-10-08T15:41:14.149 INFO:teuthology.orchestra.run.smithi089.stdout: "inst_str": "client.5815 172.21.15.89:0/21619605", 2023-10-08T15:41:14.150 INFO:teuthology.orchestra.run.smithi089.stdout: "addr_str": "172.21.15.89:0/21619605", 2023-10-08T15:41:14.150 INFO:teuthology.orchestra.run.smithi089.stdout: "inode_count": 1, 2023-10-08T15:41:14.150 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_epoch": 27, 2023-10-08T15:41:14.150 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_epoch": 49, 2023-10-08T15:41:14.150 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_epoch_barrier": 0, 2023-10-08T15:41:14.150 INFO:teuthology.orchestra.run.smithi089.stdout: "blocklisted": false, 2023-10-08T15:41:14.150 INFO:teuthology.orchestra.run.smithi089.stdout: "fs_name": "cephfs" 2023-10-08T15:41:14.150 INFO:teuthology.orchestra.run.smithi089.stdout:} 2023-10-08T15:41:14.156 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:41:14.156 DEBUG:teuthology.orchestra.run.smithi089:> stat --file-system '--printf=%T 2023-10-08T15:41:14.156 DEBUG:teuthology.orchestra.run.smithi089:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-08T15:41:14.161 INFO:teuthology.orchestra.run.smithi089.stdout:fuseblk 2023-10-08T15:41:14.162 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-08T15:41:14.162 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:41:14.162 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-08T15:41:14.178 DEBUG:teuthology.orchestra.run.smithi089:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-08T15:41:14.178 DEBUG:teuthology.orchestra.run.smithi089:> import os 2023-10-08T15:41:14.178 DEBUG:teuthology.orchestra.run.smithi089:> import uuid 2023-10-08T15:41:14.179 DEBUG:teuthology.orchestra.run.smithi089:> 2023-10-08T15:41:14.179 DEBUG:teuthology.orchestra.run.smithi089:> n = 1000 2023-10-08T15:41:14.179 DEBUG:teuthology.orchestra.run.smithi089:> create_hard_links = False 2023-10-08T15:41:14.179 DEBUG:teuthology.orchestra.run.smithi089:> if 0 > 0: 2023-10-08T15:41:14.179 DEBUG:teuthology.orchestra.run.smithi089:> create_hard_links = True 2023-10-08T15:41:14.179 DEBUG:teuthology.orchestra.run.smithi089:> path = "/home/ubuntu/cephtest/mnt.0/dc-dir/dc-file" 2023-10-08T15:41:14.179 DEBUG:teuthology.orchestra.run.smithi089:> 2023-10-08T15:41:14.179 DEBUG:teuthology.orchestra.run.smithi089:> dpath = os.path.dirname(path) 2023-10-08T15:41:14.179 DEBUG:teuthology.orchestra.run.smithi089:> fnameprefix = os.path.basename(path) 2023-10-08T15:41:14.179 DEBUG:teuthology.orchestra.run.smithi089:> os.makedirs(dpath, exist_ok=True) 2023-10-08T15:41:14.179 DEBUG:teuthology.orchestra.run.smithi089:> 2023-10-08T15:41:14.179 DEBUG:teuthology.orchestra.run.smithi089:> try: 2023-10-08T15:41:14.180 DEBUG:teuthology.orchestra.run.smithi089:> dirfd = os.open(dpath, os.O_DIRECTORY) 2023-10-08T15:41:14.180 DEBUG:teuthology.orchestra.run.smithi089:> 2023-10-08T15:41:14.180 DEBUG:teuthology.orchestra.run.smithi089:> for i in range(n): 2023-10-08T15:41:14.180 DEBUG:teuthology.orchestra.run.smithi089:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2023-10-08T15:41:14.180 DEBUG:teuthology.orchestra.run.smithi089:> with open(fpath, '"'"'w'"'"') as f: 2023-10-08T15:41:14.180 DEBUG:teuthology.orchestra.run.smithi089:> f.write(f"{i}") 2023-10-08T15:41:14.180 DEBUG:teuthology.orchestra.run.smithi089:> if True: 2023-10-08T15:41:14.180 DEBUG:teuthology.orchestra.run.smithi089:> f.flush() 2023-10-08T15:41:14.180 DEBUG:teuthology.orchestra.run.smithi089:> os.fsync(f.fileno()) 2023-10-08T15:41:14.180 DEBUG:teuthology.orchestra.run.smithi089:> if False: 2023-10-08T15:41:14.180 DEBUG:teuthology.orchestra.run.smithi089:> os.unlink(fpath) 2023-10-08T15:41:14.180 DEBUG:teuthology.orchestra.run.smithi089:> if False: 2023-10-08T15:41:14.180 DEBUG:teuthology.orchestra.run.smithi089:> os.fsync(dirfd) 2023-10-08T15:41:14.181 DEBUG:teuthology.orchestra.run.smithi089:> if create_hard_links: 2023-10-08T15:41:14.181 DEBUG:teuthology.orchestra.run.smithi089:> for j in range(0): 2023-10-08T15:41:14.181 DEBUG:teuthology.orchestra.run.smithi089:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2023-10-08T15:41:14.181 DEBUG:teuthology.orchestra.run.smithi089:> if False: 2023-10-08T15:41:14.181 DEBUG:teuthology.orchestra.run.smithi089:> os.fsync(dirfd) 2023-10-08T15:41:14.181 DEBUG:teuthology.orchestra.run.smithi089:> finally: 2023-10-08T15:41:14.181 DEBUG:teuthology.orchestra.run.smithi089:> os.close(dirfd) 2023-10-08T15:41:14.181 DEBUG:teuthology.orchestra.run.smithi089:> ' 2023-10-08T15:41:25.253 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:41:25.369 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.362+0000 7fb041f36700 1 Processor -- start 2023-10-08T15:41:25.369 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.362+0000 7fb041f36700 1 -- start start 2023-10-08T15:41:25.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.366+0000 7fb041f36700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb03c0bce50 0x7fb03c147d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:25.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.366+0000 7fb041f36700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb03c06cf60 0x7fb03c148250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:25.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.366+0000 7fb041f36700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb03c14bde0 con 0x7fb03c0bca80 2023-10-08T15:41:25.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.366+0000 7fb041f36700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb03c14b920 con 0x7fb03c0bce50 2023-10-08T15:41:25.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.366+0000 7fb041f36700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb03c06d6f0 con 0x7fb03c06cf60 2023-10-08T15:41:25.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.366+0000 7fb03bfff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb03c0bce50 0x7fb03c147d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:25.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.366+0000 7fb03bfff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb03c0bce50 0x7fb03c147d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33660/0 (socket says 172.21.15.3:33660) 2023-10-08T15:41:25.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.366+0000 7fb03bfff700 1 -- 172.21.15.3:0/1518954185 learned_addr learned my addr 172.21.15.3:0/1518954185 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:25.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.366+0000 7fb041735700 1 --2- 172.21.15.3:0/1518954185 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb03c06cf60 0x7fb03c148250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:25.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.366+0000 7fb03bfff700 1 -- 172.21.15.3:0/1518954185 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb03c06cf60 msgr2=0x7fb03c148250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:25.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.366+0000 7fb03bfff700 1 --2- 172.21.15.3:0/1518954185 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb03c06cf60 0x7fb03c148250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:25.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.366+0000 7fb03bfff700 1 -- 172.21.15.3:0/1518954185 >> v1:172.21.15.3:6789/0 conn(0x7fb03c0bca80 legacy=0x7fb03c0b2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:25.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.366+0000 7fb03bfff700 1 -- 172.21.15.3:0/1518954185 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb03c14bb00 con 0x7fb03c0bce50 2023-10-08T15:41:25.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.366+0000 7fb041735700 1 --2- 172.21.15.3:0/1518954185 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb03c06cf60 0x7fb03c148250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:41:25.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.366+0000 7fb03bfff700 1 --2- 172.21.15.3:0/1518954185 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb03c0bce50 0x7fb03c147d10 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb02c009f20 tx=0x7fb02c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f5965de0efa18b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:25.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.366+0000 7fb03b7fe700 1 -- 172.21.15.3:0/1518954185 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02c00e070 con 0x7fb03c0bce50 2023-10-08T15:41:25.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.366+0000 7fb03b7fe700 1 -- 172.21.15.3:0/1518954185 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb02c00ba80 con 0x7fb03c0bce50 2023-10-08T15:41:25.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.366+0000 7fb03b7fe700 1 -- 172.21.15.3:0/1518954185 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02c0092e0 con 0x7fb03c0bce50 2023-10-08T15:41:25.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.366+0000 7fb041f36700 1 -- 172.21.15.3:0/1518954185 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb03c0bce50 msgr2=0x7fb03c147d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:25.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.366+0000 7fb041f36700 1 --2- 172.21.15.3:0/1518954185 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb03c0bce50 0x7fb03c147d10 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb02c009f20 tx=0x7fb02c009840 comp rx=0 tx=0).stop 2023-10-08T15:41:25.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.366+0000 7fb041f36700 1 -- 172.21.15.3:0/1518954185 shutdown_connections 2023-10-08T15:41:25.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.366+0000 7fb041f36700 1 --2- 172.21.15.3:0/1518954185 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb03c06cf60 0x7fb03c148250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:25.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.366+0000 7fb041f36700 1 --2- 172.21.15.3:0/1518954185 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb03c0bce50 0x7fb03c147d10 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:25.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.366+0000 7fb041f36700 1 -- 172.21.15.3:0/1518954185 >> 172.21.15.3:0/1518954185 conn(0x7fb03c0be4a0 msgr2=0x7fb03c0ba440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:25.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.366+0000 7fb041f36700 1 -- 172.21.15.3:0/1518954185 shutdown_connections 2023-10-08T15:41:25.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.366+0000 7fb041f36700 1 -- 172.21.15.3:0/1518954185 wait complete. 2023-10-08T15:41:25.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.370+0000 7fb041f36700 1 Processor -- start 2023-10-08T15:41:25.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.370+0000 7fb041f36700 1 -- start start 2023-10-08T15:41:25.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.370+0000 7fb041f36700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb03c06cf60 0x7fb03c15e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:25.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.370+0000 7fb041f36700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb03c0bca80 0x7fb03c1364c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:25.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.370+0000 7fb041f36700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb03c0bce50 0x7fb03c146370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:25.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.370+0000 7fb041f36700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb03c139bc0 con 0x7fb03c06cf60 2023-10-08T15:41:25.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.370+0000 7fb041f36700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb03c15f230 con 0x7fb03c0bca80 2023-10-08T15:41:25.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.370+0000 7fb041f36700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb03c15e930 con 0x7fb03c0bce50 2023-10-08T15:41:25.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.370+0000 7fb040f34700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb03c06cf60 0x7fb03c15e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:25.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.370+0000 7fb040f34700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb03c06cf60 0x7fb03c15e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33664/0 (socket says 172.21.15.3:33664) 2023-10-08T15:41:25.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.370+0000 7fb040f34700 1 -- 172.21.15.3:0/2339904928 learned_addr learned my addr 172.21.15.3:0/2339904928 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:25.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.370+0000 7fb041735700 1 --2- 172.21.15.3:0/2339904928 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb03c0bce50 0x7fb03c146370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:25.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.370+0000 7fb03bfff700 1 --2- 172.21.15.3:0/2339904928 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb03c0bca80 0x7fb03c1364c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:25.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.370+0000 7fb040f34700 1 -- 172.21.15.3:0/2339904928 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb03c0bce50 msgr2=0x7fb03c146370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:25.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.370+0000 7fb040f34700 1 --2- 172.21.15.3:0/2339904928 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb03c0bce50 0x7fb03c146370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:25.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.370+0000 7fb040f34700 1 -- 172.21.15.3:0/2339904928 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb03c0bca80 msgr2=0x7fb03c1364c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:25.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.370+0000 7fb040f34700 1 --2- 172.21.15.3:0/2339904928 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb03c0bca80 0x7fb03c1364c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:25.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.370+0000 7fb040f34700 1 -- 172.21.15.3:0/2339904928 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb02c009ae0 con 0x7fb03c06cf60 2023-10-08T15:41:25.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.370+0000 7fb040f34700 1 --2- 172.21.15.3:0/2339904928 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb03c06cf60 0x7fb03c15e3f0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fb03000c590 tx=0x7fb03000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:25.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.370+0000 7fb038ff9700 1 -- 172.21.15.3:0/2339904928 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb030011590 con 0x7fb03c06cf60 2023-10-08T15:41:25.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.370+0000 7fb038ff9700 1 -- 172.21.15.3:0/2339904928 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb030011710 con 0x7fb03c06cf60 2023-10-08T15:41:25.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.370+0000 7fb041f36700 1 -- 172.21.15.3:0/2339904928 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb03c136a60 con 0x7fb03c06cf60 2023-10-08T15:41:25.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.370+0000 7fb038ff9700 1 -- 172.21.15.3:0/2339904928 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb030011ad0 con 0x7fb03c06cf60 2023-10-08T15:41:25.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.370+0000 7fb041f36700 1 -- 172.21.15.3:0/2339904928 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb03c138070 con 0x7fb03c06cf60 2023-10-08T15:41:25.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.374+0000 7fb041f36700 1 -- 172.21.15.3:0/2339904928 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb03c05ecf0 con 0x7fb03c06cf60 2023-10-08T15:41:25.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.374+0000 7fb038ff9700 1 -- 172.21.15.3:0/2339904928 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb03001b3b0 con 0x7fb03c06cf60 2023-10-08T15:41:25.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.374+0000 7fb038ff9700 1 --2- 172.21.15.3:0/2339904928 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb028060550 0x7fb028062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:25.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.374+0000 7fb038ff9700 1 -- 172.21.15.3:0/2339904928 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb03007bca0 con 0x7fb03c06cf60 2023-10-08T15:41:25.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.374+0000 7fb03bfff700 1 --2- 172.21.15.3:0/2339904928 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb028060550 0x7fb028062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:25.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.378+0000 7fb03bfff700 1 --2- 172.21.15.3:0/2339904928 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb028060550 0x7fb028062a00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb02c009f20 tx=0x7fb02c018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:25.387 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.382+0000 7fb038ff9700 1 -- 172.21.15.3:0/2339904928 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb03004c1f0 con 0x7fb03c06cf60 2023-10-08T15:41:25.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.578+0000 7fb041f36700 1 -- 172.21.15.3:0/2339904928 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb03c06d8d0 con 0x7fb03c06cf60 2023-10-08T15:41:25.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.578+0000 7fb038ff9700 1 -- 172.21.15.3:0/2339904928 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+3077 (secure 0 0 0) 0x7fb030017c20 con 0x7fb03c06cf60 2023-10-08T15:41:25.584 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:41:25.584 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":27,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5674,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/688778262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":688778262},{"type":"v1","addr":"172.21.15.50:6835","nonce":688778262}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:41:06.132475+0000","modified":"2023-10-08T15:41:09.450447+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5685},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5685":{"gid":5685,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.3:6833/3789195831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":3789195831},{"type":"v1","addr":"172.21.15.3:6833","nonce":3789195831}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-08T15:41:25.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.582+0000 7fb041f36700 1 -- 172.21.15.3:0/2339904928 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb028060550 msgr2=0x7fb028062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:25.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.582+0000 7fb041f36700 1 --2- 172.21.15.3:0/2339904928 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb028060550 0x7fb028062a00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb02c009f20 tx=0x7fb02c018000 comp rx=0 tx=0).stop 2023-10-08T15:41:25.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.582+0000 7fb041f36700 1 -- 172.21.15.3:0/2339904928 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb03c06cf60 msgr2=0x7fb03c15e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:25.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.582+0000 7fb041f36700 1 --2- 172.21.15.3:0/2339904928 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb03c06cf60 0x7fb03c15e3f0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fb03000c590 tx=0x7fb03000c8a0 comp rx=0 tx=0).stop 2023-10-08T15:41:25.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.582+0000 7fb041f36700 1 -- 172.21.15.3:0/2339904928 shutdown_connections 2023-10-08T15:41:25.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.582+0000 7fb041f36700 1 --2- 172.21.15.3:0/2339904928 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb028060550 0x7fb028062a00 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:25.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.582+0000 7fb041f36700 1 --2- 172.21.15.3:0/2339904928 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb03c0bce50 0x7fb03c146370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:25.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.582+0000 7fb041f36700 1 --2- 172.21.15.3:0/2339904928 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb03c0bca80 0x7fb03c1364c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:25.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.582+0000 7fb041f36700 1 --2- 172.21.15.3:0/2339904928 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb03c06cf60 0x7fb03c15e3f0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:25.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.582+0000 7fb041f36700 1 -- 172.21.15.3:0/2339904928 >> 172.21.15.3:0/2339904928 conn(0x7fb03c0be4a0 msgr2=0x7fb03c0b1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:25.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.582+0000 7fb041f36700 1 -- 172.21.15.3:0/2339904928 shutdown_connections 2023-10-08T15:41:25.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.582+0000 7fb041f36700 1 -- 172.21.15.3:0/2339904928 wait complete. 2023-10-08T15:41:25.588 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 27 2023-10-08T15:41:25.599 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_caps 20 2023-10-08T15:41:25.709 INFO:teuthology.orchestra.run.smithi003.stdout:{"success":"mds_recall_max_caps = '20' (not observed, change may require restart) "} 2023-10-08T15:41:25.709 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_caps = '20' (not observed, change may require restart) " } 2023-10-08T15:41:25.710 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:41:25.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.814+0000 7fa0908a0700 1 Processor -- start 2023-10-08T15:41:25.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.814+0000 7fa0908a0700 1 -- start start 2023-10-08T15:41:25.821 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.814+0000 7fa0908a0700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa08c1421b0 0x7fa08c067ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:25.821 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.814+0000 7fa0908a0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa08c149780 0x7fa08c148870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:25.821 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.814+0000 7fa0908a0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa08c149be0 con 0x7fa08c06dce0 2023-10-08T15:41:25.821 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.814+0000 7fa0908a0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa08c06d2e0 con 0x7fa08c149780 2023-10-08T15:41:25.821 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.814+0000 7fa0908a0700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa08c148420 con 0x7fa08c1421b0 2023-10-08T15:41:25.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.814+0000 7fa08a59c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa08c1421b0 0x7fa08c067ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:25.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.814+0000 7fa089d9b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa08c06dce0 0x7fa08c0670e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.3:38546/0 (socket says 172.21.15.3:38546) 2023-10-08T15:41:25.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.814+0000 7fa089d9b700 1 -- 172.21.15.3:0/2895618274 learned_addr learned my addr 172.21.15.3:0/2895618274 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:41:25.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.814+0000 7fa08ad9d700 1 --2- 172.21.15.3:0/2895618274 >> v2:172.21.15.50:3300/0 conn(0x7fa08c149780 0x7fa08c148870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:25.824 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.818+0000 7fa08959a700 1 -- 172.21.15.3:0/2895618274 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2754185255 0 0) 0x7fa08c149be0 con 0x7fa08c06dce0 2023-10-08T15:41:25.824 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.818+0000 7fa08959a700 1 -- 172.21.15.3:0/2895618274 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa074003570 con 0x7fa08c06dce0 2023-10-08T15:41:25.824 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.818+0000 7fa08ad9d700 1 -- 172.21.15.3:0/2895618274 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa08c1421b0 msgr2=0x7fa08c067ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:25.824 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.818+0000 7fa08ad9d700 1 --2- 172.21.15.3:0/2895618274 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa08c1421b0 0x7fa08c067ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:25.824 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.818+0000 7fa08ad9d700 1 -- 172.21.15.3:0/2895618274 >> v1:172.21.15.50:6789/0 conn(0x7fa08c06dce0 legacy=0x7fa08c0670e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:25.824 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.818+0000 7fa08ad9d700 1 -- 172.21.15.3:0/2895618274 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa08c06d4d0 con 0x7fa08c149780 2023-10-08T15:41:25.824 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.818+0000 7fa08ad9d700 1 --2- 172.21.15.3:0/2895618274 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa08c149780 0x7fa08c148870 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa084009e60 tx=0x7fa084009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59062dc6653730cb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:25.824 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.818+0000 7fa08959a700 1 -- 172.21.15.3:0/2895618274 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08400e070 con 0x7fa08c149780 2023-10-08T15:41:25.824 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.818+0000 7fa08959a700 1 -- 172.21.15.3:0/2895618274 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa08400bab0 con 0x7fa08c149780 2023-10-08T15:41:25.824 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.818+0000 7fa08959a700 1 -- 172.21.15.3:0/2895618274 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08400be50 con 0x7fa08c149780 2023-10-08T15:41:25.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.818+0000 7fa0908a0700 1 -- 172.21.15.3:0/2895618274 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa08c149780 msgr2=0x7fa08c148870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:25.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.818+0000 7fa0908a0700 1 --2- 172.21.15.3:0/2895618274 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa08c149780 0x7fa08c148870 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa084009e60 tx=0x7fa084009780 comp rx=0 tx=0).stop 2023-10-08T15:41:25.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.818+0000 7fa0908a0700 1 -- 172.21.15.3:0/2895618274 shutdown_connections 2023-10-08T15:41:25.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.818+0000 7fa0908a0700 1 --2- 172.21.15.3:0/2895618274 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa08c149780 0x7fa08c148870 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:25.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.818+0000 7fa0908a0700 1 --2- 172.21.15.3:0/2895618274 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa08c1421b0 0x7fa08c067ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:25.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.818+0000 7fa0908a0700 1 -- 172.21.15.3:0/2895618274 >> 172.21.15.3:0/2895618274 conn(0x7fa08c068720 msgr2=0x7fa08c068b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:25.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.818+0000 7fa0908a0700 1 -- 172.21.15.3:0/2895618274 shutdown_connections 2023-10-08T15:41:25.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.818+0000 7fa0908a0700 1 -- 172.21.15.3:0/2895618274 wait complete. 2023-10-08T15:41:25.826 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.822+0000 7fa0908a0700 1 Processor -- start 2023-10-08T15:41:25.826 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.822+0000 7fa0908a0700 1 -- start start 2023-10-08T15:41:25.828 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.822+0000 7fa0908a0700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa08c06dce0 0x7fa08c0b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:25.828 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.822+0000 7fa0908a0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa08c1421b0 0x7fa08c145560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:25.828 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.822+0000 7fa0908a0700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa08c149780 0x7fa08c15a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:25.828 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.822+0000 7fa0908a0700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa08c0b2ed0 con 0x7fa08c06dce0 2023-10-08T15:41:25.829 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.822+0000 7fa0908a0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa08c15ad50 con 0x7fa08c1421b0 2023-10-08T15:41:25.829 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.822+0000 7fa0908a0700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa08c0b2af0 con 0x7fa08c149780 2023-10-08T15:41:25.829 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.822+0000 7fa08a59c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa08c06dce0 0x7fa08c0b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:25.829 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.822+0000 7fa08a59c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa08c06dce0 0x7fa08c0b40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33668/0 (socket says 172.21.15.3:33668) 2023-10-08T15:41:25.829 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.822+0000 7fa08a59c700 1 -- 172.21.15.3:0/1171487064 learned_addr learned my addr 172.21.15.3:0/1171487064 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:25.829 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.822+0000 7fa08ad9d700 1 --2- 172.21.15.3:0/1171487064 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa08c149780 0x7fa08c15a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:25.829 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.822+0000 7fa089d9b700 1 --2- 172.21.15.3:0/1171487064 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa08c1421b0 0x7fa08c145560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:25.829 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.822+0000 7fa08a59c700 1 -- 172.21.15.3:0/1171487064 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa08c149780 msgr2=0x7fa08c15a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:25.829 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.822+0000 7fa08a59c700 1 --2- 172.21.15.3:0/1171487064 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa08c149780 0x7fa08c15a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:25.829 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.822+0000 7fa08a59c700 1 -- 172.21.15.3:0/1171487064 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa08c1421b0 msgr2=0x7fa08c145560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:25.829 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.822+0000 7fa08a59c700 1 --2- 172.21.15.3:0/1171487064 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa08c1421b0 0x7fa08c145560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:25.830 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.822+0000 7fa08a59c700 1 -- 172.21.15.3:0/1171487064 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa084009a20 con 0x7fa08c06dce0 2023-10-08T15:41:25.830 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.822+0000 7fa08a59c700 1 --2- 172.21.15.3:0/1171487064 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa08c06dce0 0x7fa08c0b40f0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fa07c00ec80 tx=0x7fa07c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:25.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.822+0000 7fa07a7fc700 1 -- 172.21.15.3:0/1171487064 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07c00c850 con 0x7fa08c06dce0 2023-10-08T15:41:25.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.822+0000 7fa07a7fc700 1 -- 172.21.15.3:0/1171487064 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa07c00c9b0 con 0x7fa08c06dce0 2023-10-08T15:41:25.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.822+0000 7fa0908a0700 1 -- 172.21.15.3:0/1171487064 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa08c0b4630 con 0x7fa08c06dce0 2023-10-08T15:41:25.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.822+0000 7fa07a7fc700 1 -- 172.21.15.3:0/1171487064 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07c00cd50 con 0x7fa08c06dce0 2023-10-08T15:41:25.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.822+0000 7fa0908a0700 1 -- 172.21.15.3:0/1171487064 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa08c147480 con 0x7fa08c06dce0 2023-10-08T15:41:25.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.826+0000 7fa0908a0700 1 -- 172.21.15.3:0/1171487064 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa08c064530 con 0x7fa08c06dce0 2023-10-08T15:41:25.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.826+0000 7fa07a7fc700 1 -- 172.21.15.3:0/1171487064 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa07c013680 con 0x7fa08c06dce0 2023-10-08T15:41:25.832 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.826+0000 7fa07a7fc700 1 --2- 172.21.15.3:0/1171487064 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fa06c060580 0x7fa06c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:25.832 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.826+0000 7fa07a7fc700 1 -- 172.21.15.3:0/1171487064 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa07c07c9a0 con 0x7fa08c06dce0 2023-10-08T15:41:25.832 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.826+0000 7fa089d9b700 1 --2- 172.21.15.3:0/1171487064 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fa06c060580 0x7fa06c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:25.833 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.826+0000 7fa089d9b700 1 --2- 172.21.15.3:0/1171487064 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fa06c060580 0x7fa06c062a30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa08c0b5dc0 tx=0x7fa080009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:25.839 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:25.834+0000 7fa07a7fc700 1 -- 172.21.15.3:0/1171487064 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa07c04cf90 con 0x7fa08c06dce0 2023-10-08T15:41:26.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.030+0000 7fa0908a0700 1 -- 172.21.15.3:0/1171487064 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa08c04b600 con 0x7fa08c06dce0 2023-10-08T15:41:26.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.030+0000 7fa07a7fc700 1 -- 172.21.15.3:0/1171487064 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+3077 (secure 0 0 0) 0x7fa07c017c20 con 0x7fa08c06dce0 2023-10-08T15:41:26.037 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:41:26.037 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":27,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5674,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/688778262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":688778262},{"type":"v1","addr":"172.21.15.50:6835","nonce":688778262}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:41:06.132475+0000","modified":"2023-10-08T15:41:09.450447+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5685},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5685":{"gid":5685,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.3:6833/3789195831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":3789195831},{"type":"v1","addr":"172.21.15.3:6833","nonce":3789195831}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-08T15:41:26.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.034+0000 7fa0908a0700 1 -- 172.21.15.3:0/1171487064 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fa06c060580 msgr2=0x7fa06c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:26.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.034+0000 7fa0908a0700 1 --2- 172.21.15.3:0/1171487064 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fa06c060580 0x7fa06c062a30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa08c0b5dc0 tx=0x7fa080009040 comp rx=0 tx=0).stop 2023-10-08T15:41:26.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.034+0000 7fa0908a0700 1 -- 172.21.15.3:0/1171487064 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa08c06dce0 msgr2=0x7fa08c0b40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:26.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.034+0000 7fa0908a0700 1 --2- 172.21.15.3:0/1171487064 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa08c06dce0 0x7fa08c0b40f0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fa07c00ec80 tx=0x7fa07c0091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:26.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.034+0000 7fa0908a0700 1 -- 172.21.15.3:0/1171487064 shutdown_connections 2023-10-08T15:41:26.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.034+0000 7fa0908a0700 1 --2- 172.21.15.3:0/1171487064 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fa06c060580 0x7fa06c062a30 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:26.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.034+0000 7fa0908a0700 1 --2- 172.21.15.3:0/1171487064 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa08c149780 0x7fa08c15a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:26.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.034+0000 7fa0908a0700 1 --2- 172.21.15.3:0/1171487064 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa08c1421b0 0x7fa08c145560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:26.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.034+0000 7fa0908a0700 1 --2- 172.21.15.3:0/1171487064 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa08c06dce0 0x7fa08c0b40f0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:26.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.034+0000 7fa0908a0700 1 -- 172.21.15.3:0/1171487064 >> 172.21.15.3:0/1171487064 conn(0x7fa08c068720 msgr2=0x7fa08c068ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:26.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.034+0000 7fa0908a0700 1 -- 172.21.15.3:0/1171487064 shutdown_connections 2023-10-08T15:41:26.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.034+0000 7fa0908a0700 1 -- 172.21.15.3:0/1171487064 wait complete. 2023-10-08T15:41:26.041 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 27 2023-10-08T15:41:26.051 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_decay_threshold 400 2023-10-08T15:41:26.157 INFO:teuthology.orchestra.run.smithi003.stdout:{"success":"mds_recall_max_decay_threshold = '400' (not observed, change may require restart) "} 2023-10-08T15:41:26.158 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_decay_threshold = '400' (not observed, change may require restart) " } 2023-10-08T15:41:26.158 INFO:tasks.cephfs.mount:Suspending the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T15:41:26.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:41:26.158 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set brx.0 down 2023-10-08T15:41:26.177 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 cache drop 5 2023-10-08T15:41:26.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.282+0000 7f1f1b59e700 1 Processor -- start 2023-10-08T15:41:26.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.282+0000 7f1f1b59e700 1 -- start start 2023-10-08T15:41:26.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.282+0000 7f1f1b59e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1f1c14e3c0 0x7f1f1c0be950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:26.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.282+0000 7f1f1b59e700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f1f1c06ef30 0x7f1f1c14b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:26.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.282+0000 7f1f1b59e700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f1c068e00 con 0x7f1f1c06d730 2023-10-08T15:41:26.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.282+0000 7f1f1b59e700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f1c14b4b0 con 0x7f1f1c06ef30 2023-10-08T15:41:26.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.282+0000 7f1f1b59e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1c06e7a0 con 0x7f1f1c14e3c0 2023-10-08T15:41:26.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.282+0000 7f1f19d9b700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f1f1c06ef30 0x7f1f1c14b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:26.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.282+0000 7f1f1ad9d700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f1f1c06d730 0x7f1f1c14bee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:45452/0 (socket says 172.21.15.3:45452) 2023-10-08T15:41:26.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.282+0000 7f1f1ad9d700 1 -- 172.21.15.3:0/2351386457 learned_addr learned my addr 172.21.15.3:0/2351386457 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:41:26.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.282+0000 7f1f1a59c700 1 --2- 172.21.15.3:0/2351386457 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1f1c14e3c0 0x7f1f1c0be950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:26.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.282+0000 7f1f1959a700 1 -- 172.21.15.3:0/2351386457 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1822901935 0 0) 0x7f1f1c068e00 con 0x7f1f1c06d730 2023-10-08T15:41:26.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.282+0000 7f1f1959a700 1 -- 172.21.15.3:0/2351386457 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f04003570 con 0x7f1f1c06d730 2023-10-08T15:41:26.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.282+0000 7f1f19d9b700 1 -- 172.21.15.3:0/2351386457 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1f1c14e3c0 msgr2=0x7f1f1c0be950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:26.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.282+0000 7f1f19d9b700 1 --2- 172.21.15.3:0/2351386457 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1f1c14e3c0 0x7f1f1c0be950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:26.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.282+0000 7f1f19d9b700 1 -- 172.21.15.3:0/2351386457 >> v1:172.21.15.3:6789/0 conn(0x7f1f1c06d730 legacy=0x7f1f1c14bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:26.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.282+0000 7f1f19d9b700 1 -- 172.21.15.3:0/2351386457 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f1c069050 con 0x7f1f1c06ef30 2023-10-08T15:41:26.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.282+0000 7f1f19d9b700 1 --2- 172.21.15.3:0/2351386457 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1f1c06ef30 0x7f1f1c14b9a0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f1f100098e0 tx=0x7f1f100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d6a3cc5bdcff798 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:26.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.282+0000 7f1f1959a700 1 -- 172.21.15.3:0/2351386457 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f10011630 con 0x7f1f1c06ef30 2023-10-08T15:41:26.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.282+0000 7f1f1959a700 1 -- 172.21.15.3:0/2351386457 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f10011790 con 0x7f1f1c06ef30 2023-10-08T15:41:26.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.282+0000 7f1f1959a700 1 -- 172.21.15.3:0/2351386457 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f10011b30 con 0x7f1f1c06ef30 2023-10-08T15:41:26.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.282+0000 7f1f1b59e700 1 -- 172.21.15.3:0/2351386457 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1f1c06ef30 msgr2=0x7f1f1c14b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:26.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.282+0000 7f1f1b59e700 1 --2- 172.21.15.3:0/2351386457 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1f1c06ef30 0x7f1f1c14b9a0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f1f100098e0 tx=0x7f1f100091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:26.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.282+0000 7f1f1b59e700 1 -- 172.21.15.3:0/2351386457 shutdown_connections 2023-10-08T15:41:26.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.282+0000 7f1f1b59e700 1 --2- 172.21.15.3:0/2351386457 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1f1c06ef30 0x7f1f1c14b9a0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:26.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.282+0000 7f1f1b59e700 1 --2- 172.21.15.3:0/2351386457 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1f1c14e3c0 0x7f1f1c0be950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:26.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.282+0000 7f1f1b59e700 1 -- 172.21.15.3:0/2351386457 >> 172.21.15.3:0/2351386457 conn(0x7f1f1c067b60 msgr2=0x7f1f1c0be240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:26.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.282+0000 7f1f1b59e700 1 -- 172.21.15.3:0/2351386457 shutdown_connections 2023-10-08T15:41:26.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.282+0000 7f1f1b59e700 1 -- 172.21.15.3:0/2351386457 wait complete. 2023-10-08T15:41:26.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.286+0000 7f1f1b59e700 1 Processor -- start 2023-10-08T15:41:26.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.286+0000 7f1f1b59e700 1 -- start start 2023-10-08T15:41:26.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.286+0000 7f1f1b59e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1f1c06d730 0x7f1f1c148710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:26.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.286+0000 7f1f1b59e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1f1c14e3c0 0x7f1f1c15e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:26.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.286+0000 7f1f1b59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f1c15ef40 0x7f1f1c147590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:26.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.286+0000 7f1f1b59e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1c0bb110 con 0x7f1f1c14e3c0 2023-10-08T15:41:26.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.286+0000 7f1f1b59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1c0bb3f0 con 0x7f1f1c15ef40 2023-10-08T15:41:26.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.286+0000 7f1f1b59e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1c15eb70 con 0x7f1f1c06d730 2023-10-08T15:41:26.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.286+0000 7f1f19d9b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1f1c14e3c0 0x7f1f1c15e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:26.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.286+0000 7f1f19d9b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1f1c14e3c0 0x7f1f1c15e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33694/0 (socket says 172.21.15.3:33694) 2023-10-08T15:41:26.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.286+0000 7f1f19d9b700 1 -- 172.21.15.3:0/1960417877 learned_addr learned my addr 172.21.15.3:0/1960417877 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:26.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.286+0000 7f1f1a59c700 1 --2- 172.21.15.3:0/1960417877 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1f1c06d730 0x7f1f1c148710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:26.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.286+0000 7f1f1ad9d700 1 --2- 172.21.15.3:0/1960417877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f1c15ef40 0x7f1f1c147590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:26.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.286+0000 7f1f19d9b700 1 -- 172.21.15.3:0/1960417877 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1f1c06d730 msgr2=0x7f1f1c148710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:26.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.286+0000 7f1f19d9b700 1 --2- 172.21.15.3:0/1960417877 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1f1c06d730 0x7f1f1c148710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:26.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.286+0000 7f1f19d9b700 1 -- 172.21.15.3:0/1960417877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f1c15ef40 msgr2=0x7f1f1c147590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:26.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.286+0000 7f1f19d9b700 1 --2- 172.21.15.3:0/1960417877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f1c15ef40 0x7f1f1c147590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:26.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.286+0000 7f1f19d9b700 1 -- 172.21.15.3:0/1960417877 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f10009420 con 0x7f1f1c14e3c0 2023-10-08T15:41:26.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.286+0000 7f1f1a59c700 1 --2- 172.21.15.3:0/1960417877 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1f1c06d730 0x7f1f1c148710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:41:26.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.286+0000 7f1f19d9b700 1 --2- 172.21.15.3:0/1960417877 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1f1c14e3c0 0x7f1f1c15e630 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c071260 tx=0x7f1f10017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:26.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.286+0000 7f1f0a7fc700 1 -- 172.21.15.3:0/1960417877 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f10011b10 con 0x7f1f1c14e3c0 2023-10-08T15:41:26.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.286+0000 7f1f0a7fc700 1 -- 172.21.15.3:0/1960417877 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f100233f0 con 0x7f1f1c14e3c0 2023-10-08T15:41:26.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.286+0000 7f1f1b59e700 1 -- 172.21.15.3:0/1960417877 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f1c148370 con 0x7f1f1c14e3c0 2023-10-08T15:41:26.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.286+0000 7f1f0a7fc700 1 -- 172.21.15.3:0/1960417877 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f10023770 con 0x7f1f1c14e3c0 2023-10-08T15:41:26.297 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.286+0000 7f1f1b59e700 1 -- 172.21.15.3:0/1960417877 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f1c148c90 con 0x7f1f1c14e3c0 2023-10-08T15:41:26.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.290+0000 7f1f0a7fc700 1 -- 172.21.15.3:0/1960417877 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f1f1002c3b0 con 0x7f1f1c14e3c0 2023-10-08T15:41:26.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.290+0000 7f1f0a7fc700 1 --2- 172.21.15.3:0/1960417877 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1efc060550 0x7f1efc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:26.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.290+0000 7f1f0a7fc700 1 -- 172.21.15.3:0/1960417877 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1f1007dcd0 con 0x7f1f1c14e3c0 2023-10-08T15:41:26.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.290+0000 7f1f1a59c700 1 --2- 172.21.15.3:0/1960417877 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1efc060550 0x7f1efc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:26.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.290+0000 7f1f1a59c700 1 --2- 172.21.15.3:0/1960417877 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1efc060550 0x7f1efc062a00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c006f00 tx=0x7f1f0c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:26.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.290+0000 7f1f22f49740 1 Processor -- start 2023-10-08T15:41:26.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.290+0000 7f1f22f49740 1 -- start start 2023-10-08T15:41:26.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.294+0000 7f1f22f49740 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1288c20 0x14c0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:26.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.294+0000 7f1f22f49740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1288850 0x14bdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:26.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.294+0000 7f1f22f49740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x12d38d0 0x14be0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:26.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.294+0000 7f1f22f49740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x14341b0 con 0x1288850 2023-10-08T15:41:26.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.294+0000 7f1f22f49740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x1430150 con 0x12d38d0 2023-10-08T15:41:26.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.294+0000 7f1f22f49740 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x13f6090 con 0x1288c20 2023-10-08T15:41:26.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.294+0000 7f1f19d9b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1288850 0x14bdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:26.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.294+0000 7f1f19d9b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1288850 0x14bdb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33698/0 (socket says 172.21.15.3:33698) 2023-10-08T15:41:26.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.294+0000 7f1f19d9b700 1 -- 172.21.15.3:0/3901191146 learned_addr learned my addr 172.21.15.3:0/3901191146 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:26.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.294+0000 7f1f1a59c700 1 --2- 172.21.15.3:0/3901191146 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1288c20 0x14c0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:26.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.294+0000 7f1f1ad9d700 1 --2- 172.21.15.3:0/3901191146 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x12d38d0 0x14be0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:26.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.294+0000 7f1f19d9b700 1 -- 172.21.15.3:0/3901191146 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1288c20 msgr2=0x14c0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:26.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.294+0000 7f1f19d9b700 1 --2- 172.21.15.3:0/3901191146 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1288c20 0x14c0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:26.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.294+0000 7f1f19d9b700 1 -- 172.21.15.3:0/3901191146 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x12d38d0 msgr2=0x14be0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:26.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.294+0000 7f1f19d9b700 1 --2- 172.21.15.3:0/3901191146 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x12d38d0 0x14be0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:26.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.294+0000 7f1f19d9b700 1 -- 172.21.15.3:0/3901191146 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x12d4b20 con 0x1288850 2023-10-08T15:41:26.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.294+0000 7f1f1ad9d700 1 --2- 172.21.15.3:0/3901191146 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x12d38d0 0x14be0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:41:26.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.294+0000 7f1f19d9b700 1 --2- 172.21.15.3:0/3901191146 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1288850 0x14bdb70 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f1f1007c150 tx=0x7f1f1007c0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeeb7dcc9174c33a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:26.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.294+0000 7f1efb7fe700 1 -- 172.21.15.3:0/3901191146 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f100526a0 con 0x1288850 2023-10-08T15:41:26.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.294+0000 7f1efb7fe700 1 -- 172.21.15.3:0/3901191146 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f100551f0 con 0x1288850 2023-10-08T15:41:26.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.294+0000 7f1efb7fe700 1 -- 172.21.15.3:0/3901191146 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f10058f40 con 0x1288850 2023-10-08T15:41:26.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.294+0000 7f1f22f49740 1 -- 172.21.15.3:0/3901191146 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1288850 msgr2=0x14bdb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:26.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.294+0000 7f1f22f49740 1 --2- 172.21.15.3:0/3901191146 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1288850 0x14bdb70 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f1f1007c150 tx=0x7f1f1007c0b0 comp rx=0 tx=0).stop 2023-10-08T15:41:26.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.294+0000 7f1f22f49740 1 -- 172.21.15.3:0/3901191146 shutdown_connections 2023-10-08T15:41:26.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.294+0000 7f1f22f49740 1 --2- 172.21.15.3:0/3901191146 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x12d38d0 0x14be0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:26.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.294+0000 7f1f22f49740 1 --2- 172.21.15.3:0/3901191146 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1288850 0x14bdb70 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:26.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.294+0000 7f1f22f49740 1 --2- 172.21.15.3:0/3901191146 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1288c20 0x14c0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:26.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.294+0000 7f1f22f49740 1 -- 172.21.15.3:0/3901191146 >> 172.21.15.3:0/3901191146 conn(0x1288ff0 msgr2=0x14bc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:26.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.294+0000 7f1f22f49740 1 -- 172.21.15.3:0/3901191146 shutdown_connections 2023-10-08T15:41:26.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.294+0000 7f1f22f49740 1 -- 172.21.15.3:0/3901191146 wait complete. 2023-10-08T15:41:26.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.294+0000 7f1f22f49740 1 -- start start 2023-10-08T15:41:26.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.294+0000 7f1f22f49740 1 Processor -- start 2023-10-08T15:41:26.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.294+0000 7f1f22f49740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1288850 0x14fb160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:26.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.298+0000 7f1f22f49740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1288c20 0x14fb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:26.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.298+0000 7f1f22f49740 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x12d38d0 0x14fbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:26.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.298+0000 7f1f22f49740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x13f5d30 con 0x1288850 2023-10-08T15:41:26.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.298+0000 7f1f22f49740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x13cebc0 con 0x1288c20 2023-10-08T15:41:26.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.298+0000 7f1f22f49740 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x1433380 con 0x12d38d0 2023-10-08T15:41:26.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.298+0000 7f1f22f49740 10 client.0 _ll_register_callbacks cb 0x13d2ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T15:41:26.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.298+0000 7f1f1a59c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1288850 0x14fb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:26.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.298+0000 7f1f1a59c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1288850 0x14fb160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33700/0 (socket says 172.21.15.3:33700) 2023-10-08T15:41:26.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.298+0000 7f1f1a59c700 1 -- 172.21.15.3:0/589765779 learned_addr learned my addr 172.21.15.3:0/589765779 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:26.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.298+0000 7f1f1ad9d700 1 --2- 172.21.15.3:0/589765779 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x12d38d0 0x14fbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:26.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.298+0000 7f1f19d9b700 1 --2- 172.21.15.3:0/589765779 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1288c20 0x14fb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:26.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.298+0000 7f1f1a59c700 1 -- 172.21.15.3:0/589765779 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x12d38d0 msgr2=0x14fbbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:26.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.298+0000 7f1f1a59c700 1 --2- 172.21.15.3:0/589765779 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x12d38d0 0x14fbbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:26.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.298+0000 7f1f1a59c700 1 -- 172.21.15.3:0/589765779 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1288c20 msgr2=0x14fb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:26.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.298+0000 7f1f1a59c700 1 --2- 172.21.15.3:0/589765779 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1288c20 0x14fb6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:26.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.298+0000 7f1f1a59c700 1 -- 172.21.15.3:0/589765779 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f1c148c90 con 0x1288850 2023-10-08T15:41:26.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.298+0000 7f1f19d9b700 1 --2- 172.21.15.3:0/589765779 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1288c20 0x14fb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:41:26.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.298+0000 7f1f1a59c700 1 --2- 172.21.15.3:0/589765779 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1288850 0x14fb160 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c015b70 tx=0x7f1f0c019040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e204f19bdd292aa server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:26.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.298+0000 7f1ef8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2023-10-08T15:41:26.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.298+0000 7f1ef8ff9700 1 -- 172.21.15.3:0/589765779 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c016ac0 con 0x1288850 2023-10-08T15:41:26.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.298+0000 7f1ef8ff9700 1 -- 172.21.15.3:0/589765779 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(49..49 src has 1..49) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1f0c016c20 con 0x1288850 2023-10-08T15:41:26.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.298+0000 7f1f22f49740 1 -- 172.21.15.3:0/589765779 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x13f2e20 con 0x1288850 2023-10-08T15:41:26.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.298+0000 7f1ef8ff9700 1 -- 172.21.15.3:0/589765779 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1f0c022420 con 0x1288850 2023-10-08T15:41:26.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.298+0000 7f1f22f49740 10 client.5874 fetch_fsmap learned FSMap version 27 2023-10-08T15:41:26.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.298+0000 7f1f22f49740 1 -- 172.21.15.3:0/589765779 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) v3 -- 0x13fe450 con 0x1288850 2023-10-08T15:41:26.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.298+0000 7f1ef8ff9700 1 -- 172.21.15.3:0/589765779 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x13f2e20 con 0x1288850 2023-10-08T15:41:26.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.298+0000 7f1ef8ff9700 1 -- 172.21.15.3:0/589765779 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 27) v1 ==== 2010+0+0 (secure 0 0 0) 0x7f1f0c0143d0 con 0x1288850 2023-10-08T15:41:26.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.298+0000 7f1f22f49740 10 client.5874 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T15:41:26.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.298+0000 7f1f22f49740 10 client.5874 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2023-10-08T15:41:26.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.298+0000 7f1f22f49740 20 client.5874 populate_metadata read hostname 'smithi003' 2023-10-08T15:41:26.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.298+0000 7f1f22f49740 1 --2- 172.21.15.3:0/589765779 >> [v2:172.21.15.3:6832/3789195831,v1:172.21.15.3:6833/3789195831] conn(0x14c43d0 0x1506cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:26.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.298+0000 7f1f22f49740 4 client.5874 mds_command: new command op to 5685 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-08T15:41:26.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.298+0000 7f1f22f49740 1 -- 172.21.15.3:0/589765779 --> [v2:172.21.15.3:6832/3789195831,v1:172.21.15.3:6833/3789195831] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x13d2700 con 0x14c43d0 2023-10-08T15:41:26.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.298+0000 7f1f19d9b700 1 --2- 172.21.15.3:0/589765779 >> [v2:172.21.15.3:6832/3789195831,v1:172.21.15.3:6833/3789195831] conn(0x14c43d0 0x1506cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:26.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.298+0000 7f1f19d9b700 1 --2- 172.21.15.3:0/589765779 >> [v2:172.21.15.3:6832/3789195831,v1:172.21.15.3:6833/3789195831] conn(0x14c43d0 0x1506cf0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=625cdaf9f2e6a5c2 server_cookie=a2766ef89107f12b in_seq=0 out_seq=0 2023-10-08T15:41:26.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.298+0000 7f1ef8ff9700 10 client.5874 ms_handle_connect on v2:172.21.15.3:6832/3789195831 2023-10-08T15:41:26.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.298+0000 7f1ef8ff9700 1 -- 172.21.15.3:0/589765779 <== mds.0 v2:172.21.15.3:6832/3789195831 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x13d2700 con 0x14c43d0 2023-10-08T15:41:26.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.298+0000 7f1ef8ff9700 10 client.5874 handle_command_reply: tid=0 2023-10-08T15:41:26.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.298+0000 7f1f22f49740 1 client.5874 shutdown 2023-10-08T15:41:26.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.298+0000 7f1f22f49740 1 -- 172.21.15.3:0/589765779 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1288850 msgr2=0x14fb160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:26.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.298+0000 7f1f22f49740 1 --2- 172.21.15.3:0/589765779 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1288850 0x14fb160 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c015b70 tx=0x7f1f0c019040 comp rx=0 tx=0).stop 2023-10-08T15:41:26.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.298+0000 7f1f22f49740 1 -- 172.21.15.3:0/589765779 shutdown_connections 2023-10-08T15:41:26.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.298+0000 7f1f22f49740 1 --2- 172.21.15.3:0/589765779 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x12d38d0 0x14fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:26.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.298+0000 7f1f22f49740 1 --2- 172.21.15.3:0/589765779 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1288c20 0x14fb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:26.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.298+0000 7f1f22f49740 1 --2- 172.21.15.3:0/589765779 >> [v2:172.21.15.3:6832/3789195831,v1:172.21.15.3:6833/3789195831] conn(0x14c43d0 0x1506cf0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:26.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.298+0000 7f1f22f49740 1 --2- 172.21.15.3:0/589765779 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1288850 0x14fb160 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:26.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.298+0000 7f1ef8ff9700 0 client.5874 ms_handle_reset on v2:172.21.15.3:6832/3789195831 2023-10-08T15:41:26.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.298+0000 7f1f22f49740 1 -- 172.21.15.3:0/589765779 >> 172.21.15.3:0/589765779 conn(0x1288ff0 msgr2=0x14bc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:26.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.298+0000 7f1f22f49740 1 -- 172.21.15.3:0/589765779 shutdown_connections 2023-10-08T15:41:26.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.298+0000 7f1f22f49740 1 -- 172.21.15.3:0/589765779 wait complete. 2023-10-08T15:41:26.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.298+0000 7f1f22f49740 20 client.5874 trim_cache size 0 max 16384 2023-10-08T15:41:26.317 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.314+0000 7f1f22f49740 1 Processor -- start 2023-10-08T15:41:26.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.314+0000 7f1f22f49740 1 -- start start 2023-10-08T15:41:26.320 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.314+0000 7f1f22f49740 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1288850 0x14fb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:26.320 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.314+0000 7f1f22f49740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1288c20 0x14ff5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:26.320 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.314+0000 7f1f22f49740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x12d38d0 0x14ffaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:26.320 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.314+0000 7f1f22f49740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x142db10 con 0x12d38d0 2023-10-08T15:41:26.320 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.314+0000 7f1f22f49740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x142efe0 con 0x1288c20 2023-10-08T15:41:26.320 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.314+0000 7f1f22f49740 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x1434a90 con 0x1288850 2023-10-08T15:41:26.320 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.314+0000 7f1f1ad9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x12d38d0 0x14ffaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:26.320 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.314+0000 7f1f1ad9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x12d38d0 0x14ffaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33716/0 (socket says 172.21.15.3:33716) 2023-10-08T15:41:26.320 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.314+0000 7f1f1ad9d700 1 -- 172.21.15.3:0/3662091923 learned_addr learned my addr 172.21.15.3:0/3662091923 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:26.320 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.314+0000 7f1f19d9b700 1 --2- 172.21.15.3:0/3662091923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1288c20 0x14ff5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:26.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.314+0000 7f1f1a59c700 1 --2- 172.21.15.3:0/3662091923 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1288850 0x14fb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:26.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.314+0000 7f1f1ad9d700 1 -- 172.21.15.3:0/3662091923 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1288850 msgr2=0x14fb8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:26.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.314+0000 7f1f1ad9d700 1 --2- 172.21.15.3:0/3662091923 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1288850 0x14fb8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:26.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.314+0000 7f1f1ad9d700 1 -- 172.21.15.3:0/3662091923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1288c20 msgr2=0x14ff5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:26.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.314+0000 7f1f1ad9d700 1 --2- 172.21.15.3:0/3662091923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1288c20 0x14ff5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:26.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.314+0000 7f1f1ad9d700 1 -- 172.21.15.3:0/3662091923 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x13e4e60 con 0x12d38d0 2023-10-08T15:41:26.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.314+0000 7f1f19d9b700 1 --2- 172.21.15.3:0/3662091923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1288c20 0x14ff5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:26.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.314+0000 7f1f1a59c700 1 --2- 172.21.15.3:0/3662091923 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1288850 0x14fb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:26.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.314+0000 7f1f1ad9d700 1 --2- 172.21.15.3:0/3662091923 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x12d38d0 0x14ffaf0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f1f14001c90 tx=0x7f1f14009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7274cb27d9b9ef36 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:26.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.314+0000 7f1efbfff700 1 -- 172.21.15.3:0/3662091923 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f14007670 con 0x12d38d0 2023-10-08T15:41:26.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.314+0000 7f1efbfff700 1 -- 172.21.15.3:0/3662091923 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f1400d040 con 0x12d38d0 2023-10-08T15:41:26.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.314+0000 7f1efbfff700 1 -- 172.21.15.3:0/3662091923 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f14007a40 con 0x12d38d0 2023-10-08T15:41:26.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.314+0000 7f1f22f49740 1 -- 172.21.15.3:0/3662091923 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x12d38d0 msgr2=0x14ffaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:26.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.314+0000 7f1f22f49740 1 --2- 172.21.15.3:0/3662091923 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x12d38d0 0x14ffaf0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f1f14001c90 tx=0x7f1f14009040 comp rx=0 tx=0).stop 2023-10-08T15:41:26.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.314+0000 7f1f22f49740 1 -- 172.21.15.3:0/3662091923 shutdown_connections 2023-10-08T15:41:26.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.314+0000 7f1f22f49740 1 --2- 172.21.15.3:0/3662091923 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x12d38d0 0x14ffaf0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:26.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.314+0000 7f1f22f49740 1 --2- 172.21.15.3:0/3662091923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1288c20 0x14ff5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:26.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.314+0000 7f1f22f49740 1 --2- 172.21.15.3:0/3662091923 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1288850 0x14fb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:26.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.314+0000 7f1f22f49740 1 -- 172.21.15.3:0/3662091923 >> 172.21.15.3:0/3662091923 conn(0x1288ff0 msgr2=0x14fb1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:26.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.314+0000 7f1f22f49740 1 -- 172.21.15.3:0/3662091923 shutdown_connections 2023-10-08T15:41:26.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.314+0000 7f1f22f49740 1 -- 172.21.15.3:0/3662091923 wait complete. 2023-10-08T15:41:26.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.318+0000 7f1f22f49740 1 -- start start 2023-10-08T15:41:26.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.318+0000 7f1f22f49740 1 Processor -- start 2023-10-08T15:41:26.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.318+0000 7f1f22f49740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1288850 0x15480d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:26.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.318+0000 7f1f22f49740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1288c20 0x1548610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:26.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.318+0000 7f1f22f49740 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x12d38d0 0x15498c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:26.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.318+0000 7f1f22f49740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x13f4200 con 0x1288c20 2023-10-08T15:41:26.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.318+0000 7f1f22f49740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x1286570 con 0x1288850 2023-10-08T15:41:26.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.318+0000 7f1f22f49740 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x1402550 con 0x12d38d0 2023-10-08T15:41:26.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.318+0000 7f1f22f49740 10 client.0 _ll_register_callbacks cb 0x13f9390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T15:41:26.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.318+0000 7f1f19d9b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1288c20 0x1548610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:26.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.318+0000 7f1f19d9b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1288c20 0x1548610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33718/0 (socket says 172.21.15.3:33718) 2023-10-08T15:41:26.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.318+0000 7f1f19d9b700 1 -- 172.21.15.3:0/4026603073 learned_addr learned my addr 172.21.15.3:0/4026603073 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:26.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.318+0000 7f1f1a59c700 1 --2- 172.21.15.3:0/4026603073 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1288850 0x15480d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:26.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.318+0000 7f1f1ad9d700 1 --2- 172.21.15.3:0/4026603073 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x12d38d0 0x15498c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:26.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.318+0000 7f1f19d9b700 1 -- 172.21.15.3:0/4026603073 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x12d38d0 msgr2=0x15498c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:26.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.318+0000 7f1f19d9b700 1 --2- 172.21.15.3:0/4026603073 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x12d38d0 0x15498c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:26.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.318+0000 7f1f19d9b700 1 -- 172.21.15.3:0/4026603073 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1288850 msgr2=0x15480d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:26.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.318+0000 7f1f19d9b700 1 --2- 172.21.15.3:0/4026603073 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1288850 0x15480d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:26.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.318+0000 7f1f19d9b700 1 -- 172.21.15.3:0/4026603073 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f04003570 con 0x1288c20 2023-10-08T15:41:26.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.318+0000 7f1f19d9b700 1 --2- 172.21.15.3:0/4026603073 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1288c20 0x1548610 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f1f10013000 tx=0x7f1f1001e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52ba2ba72e286eba server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:26.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.318+0000 7f1ef8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2023-10-08T15:41:26.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.318+0000 7f1ef8ff9700 1 -- 172.21.15.3:0/4026603073 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f10058f40 con 0x1288c20 2023-10-08T15:41:26.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.318+0000 7f1f22f49740 1 -- 172.21.15.3:0/4026603073 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1f100551f0 con 0x1288c20 2023-10-08T15:41:26.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.318+0000 7f1ef8ff9700 1 -- 172.21.15.3:0/4026603073 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(49..49 src has 1..49) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1f1005a070 con 0x1288c20 2023-10-08T15:41:26.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.318+0000 7f1ef8ff9700 1 -- 172.21.15.3:0/4026603073 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1f10050300 con 0x1288c20 2023-10-08T15:41:26.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.318+0000 7f1f22f49740 10 client.5880 fetch_fsmap learned FSMap version 27 2023-10-08T15:41:26.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.318+0000 7f1f22f49740 1 -- 172.21.15.3:0/4026603073 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) v3 -- 0x13d9210 con 0x1288c20 2023-10-08T15:41:26.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.322+0000 7f1ef8ff9700 1 -- 172.21.15.3:0/4026603073 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f100551f0 con 0x1288c20 2023-10-08T15:41:26.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.322+0000 7f1ef8ff9700 1 -- 172.21.15.3:0/4026603073 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 27) v1 ==== 2010+0+0 (secure 0 0 0) 0x7f1f100671d0 con 0x1288c20 2023-10-08T15:41:26.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.322+0000 7f1f22f49740 10 client.5880 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T15:41:26.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.322+0000 7f1f22f49740 10 client.5880 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2023-10-08T15:41:26.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.322+0000 7f1f22f49740 20 client.5880 populate_metadata read hostname 'smithi003' 2023-10-08T15:41:26.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.322+0000 7f1f22f49740 1 --2- 172.21.15.3:0/4026603073 >> [v2:172.21.15.3:6832/3789195831,v1:172.21.15.3:6833/3789195831] conn(0x1549e00 0x154a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:26.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.322+0000 7f1f22f49740 4 client.5880 mds_command: new command op to 5685 tid=0[{"prefix": "cache drop", "timeout": 5}] 2023-10-08T15:41:26.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.322+0000 7f1f22f49740 1 -- 172.21.15.3:0/4026603073 --> [v2:172.21.15.3:6832/3789195831,v1:172.21.15.3:6833/3789195831] -- command(tid 0: {"prefix": "cache drop", "timeout": 5}) v1 -- 0x13d2420 con 0x1549e00 2023-10-08T15:41:26.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.322+0000 7f1f1a59c700 1 --2- 172.21.15.3:0/4026603073 >> [v2:172.21.15.3:6832/3789195831,v1:172.21.15.3:6833/3789195831] conn(0x1549e00 0x154a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:26.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.322+0000 7f1ef8ff9700 10 client.5880 ms_handle_connect on v2:172.21.15.3:6832/3789195831 2023-10-08T15:41:26.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:26.322+0000 7f1f1a59c700 1 --2- 172.21.15.3:0/4026603073 >> [v2:172.21.15.3:6832/3789195831,v1:172.21.15.3:6833/3789195831] conn(0x1549e00 0x154a200 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cbdfc18d6ebcbd04 server_cookie=ca372df5b07b4960 in_seq=0 out_seq=0 2023-10-08T15:41:31.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.510+0000 7f1ef8ff9700 1 -- 172.21.15.3:0/4026603073 <== mds.0 v2:172.21.15.3:6832/3789195831 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+397 (crc 0 0 0) 0x13d2420 con 0x1549e00 2023-10-08T15:41:31.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.510+0000 7f1ef8ff9700 10 client.5880 handle_command_reply: tid=0 2023-10-08T15:41:31.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.510+0000 7f1f22f49740 1 client.5880 shutdown 2023-10-08T15:41:31.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.510+0000 7f1f22f49740 1 -- 172.21.15.3:0/4026603073 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1288c20 msgr2=0x1548610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:31.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.510+0000 7f1f22f49740 1 --2- 172.21.15.3:0/4026603073 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1288c20 0x1548610 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f1f10013000 tx=0x7f1f1001e040 comp rx=0 tx=0).stop 2023-10-08T15:41:31.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.510+0000 7f1f22f49740 1 -- 172.21.15.3:0/4026603073 shutdown_connections 2023-10-08T15:41:31.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.510+0000 7f1f22f49740 1 --2- 172.21.15.3:0/4026603073 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x12d38d0 0x15498c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:31.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.510+0000 7f1f22f49740 1 --2- 172.21.15.3:0/4026603073 >> [v2:172.21.15.3:6832/3789195831,v1:172.21.15.3:6833/3789195831] conn(0x1549e00 0x154a200 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:31.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.510+0000 7f1f22f49740 1 --2- 172.21.15.3:0/4026603073 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1288c20 0x1548610 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:31.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.510+0000 7f1ef8ff9700 0 client.5880 ms_handle_reset on v2:172.21.15.3:6832/3789195831 2023-10-08T15:41:31.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.510+0000 7f1f22f49740 1 --2- 172.21.15.3:0/4026603073 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1288850 0x15480d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:31.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.510+0000 7f1f22f49740 1 -- 172.21.15.3:0/4026603073 >> 172.21.15.3:0/4026603073 conn(0x1288ff0 msgr2=0x14fb8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:31.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.510+0000 7f1f22f49740 1 -- 172.21.15.3:0/4026603073 shutdown_connections 2023-10-08T15:41:31.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.510+0000 7f1f22f49740 1 -- 172.21.15.3:0/4026603073 wait complete. 2023-10-08T15:41:31.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.514+0000 7f1f22f49740 20 client.5880 trim_cache size 0 max 16384 2023-10-08T15:41:31.519 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2023-10-08T15:41:31.519 INFO:teuthology.orchestra.run.smithi003.stdout: "client_recall": { 2023-10-08T15:41:31.519 INFO:teuthology.orchestra.run.smithi003.stdout: "return_code": -110, 2023-10-08T15:41:31.519 INFO:teuthology.orchestra.run.smithi003.stdout: "message": "(110) Connection timed out", 2023-10-08T15:41:31.519 INFO:teuthology.orchestra.run.smithi003.stdout: "recalled": 120 2023-10-08T15:41:31.519 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:41:31.519 INFO:teuthology.orchestra.run.smithi003.stdout: "flush_journal": { 2023-10-08T15:41:31.520 INFO:teuthology.orchestra.run.smithi003.stdout: "return_code": 0, 2023-10-08T15:41:31.520 INFO:teuthology.orchestra.run.smithi003.stdout: "message": "" 2023-10-08T15:41:31.520 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:41:31.520 INFO:teuthology.orchestra.run.smithi003.stdout: "trim_cache": { 2023-10-08T15:41:31.520 INFO:teuthology.orchestra.run.smithi003.stdout: "trimmed": 0 2023-10-08T15:41:31.520 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:41:31.520 INFO:teuthology.orchestra.run.smithi003.stdout: "cache": { 2023-10-08T15:41:31.520 INFO:teuthology.orchestra.run.smithi003.stdout: "pool": { 2023-10-08T15:41:31.520 INFO:teuthology.orchestra.run.smithi003.stdout: "items": 20625, 2023-10-08T15:41:31.520 INFO:teuthology.orchestra.run.smithi003.stdout: "bytes": 3168080 2023-10-08T15:41:31.520 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:41:31.520 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:41:31.521 INFO:teuthology.orchestra.run.smithi003.stdout: "duration": 5.189960234 2023-10-08T15:41:31.521 INFO:teuthology.orchestra.run.smithi003.stdout:} 2023-10-08T15:41:31.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.514+0000 7f1f1b59e700 1 -- 172.21.15.3:0/1960417877 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1efc060550 msgr2=0x7f1efc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:31.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.514+0000 7f1f1b59e700 1 --2- 172.21.15.3:0/1960417877 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1efc060550 0x7f1efc062a00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c006f00 tx=0x7f1f0c008040 comp rx=0 tx=0).stop 2023-10-08T15:41:31.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.514+0000 7f1f1b59e700 1 -- 172.21.15.3:0/1960417877 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1f1c14e3c0 msgr2=0x7f1f1c15e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:31.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.514+0000 7f1f1b59e700 1 --2- 172.21.15.3:0/1960417877 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1f1c14e3c0 0x7f1f1c15e630 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c071260 tx=0x7f1f10017000 comp rx=0 tx=0).stop 2023-10-08T15:41:31.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.514+0000 7f1f1b59e700 1 -- 172.21.15.3:0/1960417877 shutdown_connections 2023-10-08T15:41:31.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.514+0000 7f1f1b59e700 1 --2- 172.21.15.3:0/1960417877 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1efc060550 0x7f1efc062a00 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:31.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.514+0000 7f1f1b59e700 1 --2- 172.21.15.3:0/1960417877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f1c15ef40 0x7f1f1c147590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:31.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.514+0000 7f1f1b59e700 1 --2- 172.21.15.3:0/1960417877 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1f1c14e3c0 0x7f1f1c15e630 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:31.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.514+0000 7f1f1b59e700 1 --2- 172.21.15.3:0/1960417877 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1f1c06d730 0x7f1f1c148710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:31.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.514+0000 7f1f1b59e700 1 -- 172.21.15.3:0/1960417877 >> 172.21.15.3:0/1960417877 conn(0x7f1f1c067b60 msgr2=0x7f1f1c14e790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:31.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.514+0000 7f1f1b59e700 1 -- 172.21.15.3:0/1960417877 shutdown_connections 2023-10-08T15:41:31.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.514+0000 7f1f1b59e700 1 -- 172.21.15.3:0/1960417877 wait complete. 2023-10-08T15:41:31.531 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T15:41:31.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:41:31.531 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set brx.0 up 2023-10-08T15:41:31.549 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T15:41:31.549 DEBUG:teuthology.orchestra.run.smithi003:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T15:41:31.569 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T15:41:31.590 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T15:41:31.611 DEBUG:teuthology.orchestra.run.smithi098:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T15:41:31.632 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T15:41:31.655 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T15:41:31.655 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi089.front.sepia.ceph.com... 2023-10-08T15:41:31.655 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T15:41:31.655 DEBUG:teuthology.orchestra.run.smithi089:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-08T15:41:31.670 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi089.stderr:ceph-fuse[29068]: fuse finished with error 0 and tester_r 0 2023-10-08T15:41:31.674 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi089.front.sepia.ceph.com 2023-10-08T15:41:31.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:41:31.674 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-08T15:41:31.850 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi098.front.sepia.ceph.com 2023-10-08T15:41:31.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:41:31.851 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-08T15:41:31.858 INFO:teuthology.orchestra.run.smithi098.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-10-08T15:41:31.858 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T15:41:31.859 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2023-10-08T15:41:31.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:41:31.859 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-08T15:41:31.867 INFO:teuthology.orchestra.run.smithi153.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-08T15:41:31.868 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T15:41:31.869 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:41:31.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.982+0000 7f586e688700 1 Processor -- start 2023-10-08T15:41:31.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.982+0000 7f586e688700 1 -- start start 2023-10-08T15:41:31.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.982+0000 7f586e688700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f58680bb0c0 0x7f586806dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:31.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.982+0000 7f586e688700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f586806d9f0 con 0x7f58680bacf0 2023-10-08T15:41:31.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.982+0000 7f586e688700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f586814c410 con 0x7f58680b1c30 2023-10-08T15:41:31.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.982+0000 7f586e688700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5868148170 con 0x7f58680bb0c0 2023-10-08T15:41:31.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.982+0000 7f586d686700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f58680bacf0 0x7f58680b22b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:55266/0 (socket says 172.21.15.3:55266) 2023-10-08T15:41:31.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.982+0000 7f586d686700 1 -- 172.21.15.3:0/3986988802 learned_addr learned my addr 172.21.15.3:0/3986988802 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:41:31.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.982+0000 7f586ce85700 1 --2- 172.21.15.3:0/3986988802 >> v2:172.21.15.50:3300/0 conn(0x7f58680bb0c0 0x7f586806dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:31.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.982+0000 7f585ffff700 1 -- 172.21.15.3:0/3986988802 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1525733766 0 0) 0x7f586806d9f0 con 0x7f58680bacf0 2023-10-08T15:41:31.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.982+0000 7f585ffff700 1 -- 172.21.15.3:0/3986988802 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5854003570 con 0x7f58680bacf0 2023-10-08T15:41:31.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.986+0000 7f586ce85700 1 -- 172.21.15.3:0/3986988802 >> v1:172.21.15.50:6789/0 conn(0x7f58680b1c30 legacy=0x7f5868148590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:31.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.986+0000 7f586ce85700 1 -- 172.21.15.3:0/3986988802 >> v1:172.21.15.3:6789/0 conn(0x7f58680bacf0 legacy=0x7f58680b22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:31.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.986+0000 7f585ffff700 1 -- 172.21.15.3:0/3986988802 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3323690541 0 0) 0x7f5854003570 con 0x7f58680bacf0 2023-10-08T15:41:31.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.986+0000 7f586ce85700 1 -- 172.21.15.3:0/3986988802 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f586814c0e0 con 0x7f58680bb0c0 2023-10-08T15:41:31.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.986+0000 7f586ce85700 1 --2- 172.21.15.3:0/3986988802 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58680bb0c0 0x7f586806dc60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f58580098e0 tx=0x7f58580091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=498f1a597ddd0b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:31.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.986+0000 7f585ffff700 1 -- 172.21.15.3:0/3986988802 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5864001470 con 0x7f58680bb0c0 2023-10-08T15:41:31.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.986+0000 7f585ffff700 1 -- 172.21.15.3:0/3986988802 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5858011420 con 0x7f58680bb0c0 2023-10-08T15:41:31.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.986+0000 7f585ffff700 1 -- 172.21.15.3:0/3986988802 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58580117a0 con 0x7f58680bb0c0 2023-10-08T15:41:31.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.986+0000 7f586e688700 1 -- 172.21.15.3:0/3986988802 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58680bb0c0 msgr2=0x7f586806dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:31.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.986+0000 7f586e688700 1 --2- 172.21.15.3:0/3986988802 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58680bb0c0 0x7f586806dc60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f58580098e0 tx=0x7f58580091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:31.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.986+0000 7f586e688700 1 -- 172.21.15.3:0/3986988802 shutdown_connections 2023-10-08T15:41:31.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.986+0000 7f586e688700 1 --2- 172.21.15.3:0/3986988802 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58680bb0c0 0x7f586806dc60 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:31.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.986+0000 7f586e688700 1 -- 172.21.15.3:0/3986988802 >> 172.21.15.3:0/3986988802 conn(0x7f58680be4a0 msgr2=0x7f58680ba440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:31.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.986+0000 7f586e688700 1 -- 172.21.15.3:0/3986988802 shutdown_connections 2023-10-08T15:41:31.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.986+0000 7f586e688700 1 -- 172.21.15.3:0/3986988802 wait complete. 2023-10-08T15:41:31.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.990+0000 7f586e688700 1 Processor -- start 2023-10-08T15:41:31.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.990+0000 7f586e688700 1 -- start start 2023-10-08T15:41:31.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.990+0000 7f586e688700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f58680b1c30 0x7f58681479b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:31.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.990+0000 7f586e688700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58680bacf0 0x7f586815e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:31.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.990+0000 7f586e688700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f58680bb0c0 0x7f58681496b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:31.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.990+0000 7f586e688700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f586814b380 con 0x7f58680b1c30 2023-10-08T15:41:31.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.990+0000 7f586e688700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5868147ef0 con 0x7f58680bacf0 2023-10-08T15:41:31.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.990+0000 7f586e688700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5868147520 con 0x7f58680bb0c0 2023-10-08T15:41:31.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.990+0000 7f586d686700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f58680b1c30 0x7f58681479b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:31.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.990+0000 7f586d686700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f58680b1c30 0x7f58681479b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45132/0 (socket says 172.21.15.3:45132) 2023-10-08T15:41:32.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.990+0000 7f586d686700 1 -- 172.21.15.3:0/2697101328 learned_addr learned my addr 172.21.15.3:0/2697101328 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:32.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.990+0000 7f586ce85700 1 --2- 172.21.15.3:0/2697101328 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58680bacf0 0x7f586815e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:32.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.990+0000 7f586de87700 1 --2- 172.21.15.3:0/2697101328 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f58680bb0c0 0x7f58681496b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:32.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.994+0000 7f586d686700 1 -- 172.21.15.3:0/2697101328 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f58680bb0c0 msgr2=0x7f58681496b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:32.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.994+0000 7f586d686700 1 --2- 172.21.15.3:0/2697101328 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f58680bb0c0 0x7f58681496b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:32.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.994+0000 7f586d686700 1 -- 172.21.15.3:0/2697101328 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58680bacf0 msgr2=0x7f586815e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:32.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.994+0000 7f586d686700 1 --2- 172.21.15.3:0/2697101328 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58680bacf0 0x7f586815e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:32.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.994+0000 7f586d686700 1 -- 172.21.15.3:0/2697101328 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5858009420 con 0x7f58680b1c30 2023-10-08T15:41:32.001 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.994+0000 7f586de87700 1 --2- 172.21.15.3:0/2697101328 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f58680bb0c0 0x7f58681496b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:32.001 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.994+0000 7f586d686700 1 --2- 172.21.15.3:0/2697101328 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f58680b1c30 0x7f58681479b0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f586400cbc0 tx=0x7f5864001aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:32.001 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.994+0000 7f585d7fa700 1 -- 172.21.15.3:0/2697101328 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5864001d10 con 0x7f58680b1c30 2023-10-08T15:41:32.001 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.994+0000 7f585d7fa700 1 -- 172.21.15.3:0/2697101328 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5864007360 con 0x7f58680b1c30 2023-10-08T15:41:32.001 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.994+0000 7f586e688700 1 -- 172.21.15.3:0/2697101328 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f586815c1d0 con 0x7f58680b1c30 2023-10-08T15:41:32.001 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.994+0000 7f585d7fa700 1 -- 172.21.15.3:0/2697101328 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5864004830 con 0x7f58680b1c30 2023-10-08T15:41:32.001 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.994+0000 7f586e688700 1 -- 172.21.15.3:0/2697101328 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58680b9200 con 0x7f58680b1c30 2023-10-08T15:41:32.003 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.994+0000 7f586e688700 1 -- 172.21.15.3:0/2697101328 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f586805ecf0 con 0x7f58680b1c30 2023-10-08T15:41:32.003 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.994+0000 7f585d7fa700 1 -- 172.21.15.3:0/2697101328 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5864004ba0 con 0x7f58680b1c30 2023-10-08T15:41:32.003 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.994+0000 7f585d7fa700 1 --2- 172.21.15.3:0/2697101328 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f584c060550 0x7f584c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:32.003 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.994+0000 7f585d7fa700 1 -- 172.21.15.3:0/2697101328 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f586407be30 con 0x7f58680b1c30 2023-10-08T15:41:32.003 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.994+0000 7f586ce85700 1 --2- 172.21.15.3:0/2697101328 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f584c060550 0x7f584c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:32.003 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:31.998+0000 7f586ce85700 1 --2- 172.21.15.3:0/2697101328 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f584c060550 0x7f584c062a00 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5858009fd0 tx=0x7f5858016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:32.007 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.002+0000 7f585d7fa700 1 -- 172.21.15.3:0/2697101328 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f586404c4a0 con 0x7f58680b1c30 2023-10-08T15:41:32.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.202+0000 7f586e688700 1 -- 172.21.15.3:0/2697101328 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f58680bc940 con 0x7f58680b1c30 2023-10-08T15:41:32.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.206+0000 7f585d7fa700 1 -- 172.21.15.3:0/2697101328 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+3077 (secure 0 0 0) 0x7f5864018020 con 0x7f58680b1c30 2023-10-08T15:41:32.210 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:41:32.210 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":27,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5674,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/688778262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":688778262},{"type":"v1","addr":"172.21.15.50:6835","nonce":688778262}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:41:06.132475+0000","modified":"2023-10-08T15:41:09.450447+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5685},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5685":{"gid":5685,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.3:6833/3789195831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":3789195831},{"type":"v1","addr":"172.21.15.3:6833","nonce":3789195831}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-08T15:41:32.212 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.206+0000 7f586e688700 1 -- 172.21.15.3:0/2697101328 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f584c060550 msgr2=0x7f584c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:32.212 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.206+0000 7f586e688700 1 --2- 172.21.15.3:0/2697101328 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f584c060550 0x7f584c062a00 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5858009fd0 tx=0x7f5858016000 comp rx=0 tx=0).stop 2023-10-08T15:41:32.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.206+0000 7f586e688700 1 -- 172.21.15.3:0/2697101328 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f58680b1c30 msgr2=0x7f58681479b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:32.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.206+0000 7f586e688700 1 --2- 172.21.15.3:0/2697101328 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f58680b1c30 0x7f58681479b0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f586400cbc0 tx=0x7f5864001aa0 comp rx=0 tx=0).stop 2023-10-08T15:41:32.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.206+0000 7f586e688700 1 -- 172.21.15.3:0/2697101328 shutdown_connections 2023-10-08T15:41:32.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.206+0000 7f586e688700 1 --2- 172.21.15.3:0/2697101328 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f584c060550 0x7f584c062a00 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:32.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.206+0000 7f586e688700 1 --2- 172.21.15.3:0/2697101328 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f58680bb0c0 0x7f58681496b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:32.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.206+0000 7f586e688700 1 --2- 172.21.15.3:0/2697101328 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58680bacf0 0x7f586815e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:32.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.206+0000 7f586e688700 1 --2- 172.21.15.3:0/2697101328 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f58680b1c30 0x7f58681479b0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:32.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.206+0000 7f586e688700 1 -- 172.21.15.3:0/2697101328 >> 172.21.15.3:0/2697101328 conn(0x7f58680be4a0 msgr2=0x7f5868145dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:32.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.206+0000 7f586e688700 1 -- 172.21.15.3:0/2697101328 shutdown_connections 2023-10-08T15:41:32.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.206+0000 7f586e688700 1 -- 172.21.15.3:0/2697101328 wait complete. 2023-10-08T15:41:32.214 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 27 2023-10-08T15:41:32.223 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:41:32.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.326+0000 7f859258b700 1 Processor -- start 2023-10-08T15:41:32.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.326+0000 7f859258b700 1 -- start start 2023-10-08T15:41:32.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.326+0000 7f859258b700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f858c06be60 0x7f858c14b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:32.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.326+0000 7f859258b700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f858c14c6b0 con 0x7f858c14ac50 2023-10-08T15:41:32.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.326+0000 7f859258b700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f858c14c060 con 0x7f858c06cc40 2023-10-08T15:41:32.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.326+0000 7f859258b700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f858c14c340 con 0x7f858c06be60 2023-10-08T15:41:32.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.330+0000 7f8591589700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f858c14ac50 0x7f858c06c530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:55280/0 (socket says 172.21.15.3:55280) 2023-10-08T15:41:32.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.330+0000 7f8591589700 1 -- 172.21.15.3:0/2852932372 learned_addr learned my addr 172.21.15.3:0/2852932372 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:41:32.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.330+0000 7f8590d88700 1 --2- 172.21.15.3:0/2852932372 >> v2:172.21.15.3:3300/0 conn(0x7f858c06be60 0x7f858c14b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:32.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.330+0000 7f857ffff700 1 -- 172.21.15.3:0/2852932372 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2041167442 0 0) 0x7f858c14c6b0 con 0x7f858c14ac50 2023-10-08T15:41:32.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.330+0000 7f857ffff700 1 -- 172.21.15.3:0/2852932372 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8578003570 con 0x7f858c14ac50 2023-10-08T15:41:32.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.330+0000 7f857ffff700 1 -- 172.21.15.3:0/2852932372 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1598227912 0 0) 0x7f858c14c060 con 0x7f858c06cc40 2023-10-08T15:41:32.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.330+0000 7f857ffff700 1 -- 172.21.15.3:0/2852932372 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f858c14c6b0 con 0x7f858c06cc40 2023-10-08T15:41:32.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.330+0000 7f8590d88700 1 -- 172.21.15.3:0/2852932372 >> v1:172.21.15.50:6789/0 conn(0x7f858c06cc40 legacy=0x7f858c14cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:32.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.330+0000 7f8590d88700 1 -- 172.21.15.3:0/2852932372 >> v1:172.21.15.3:6789/0 conn(0x7f858c14ac50 legacy=0x7f858c06c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:32.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.330+0000 7f8590d88700 1 -- 172.21.15.3:0/2852932372 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f858c14e860 con 0x7f858c06be60 2023-10-08T15:41:32.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.330+0000 7f8590d88700 1 --2- 172.21.15.3:0/2852932372 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f858c06be60 0x7f858c14b020 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f85800098e0 tx=0x7f85800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffc237a5d0a1e077 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:32.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.330+0000 7f857ffff700 1 -- 172.21.15.3:0/2852932372 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8580011630 con 0x7f858c06be60 2023-10-08T15:41:32.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.330+0000 7f857ffff700 1 -- 172.21.15.3:0/2852932372 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8580011790 con 0x7f858c06be60 2023-10-08T15:41:32.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.330+0000 7f857ffff700 1 -- 172.21.15.3:0/2852932372 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8580011b30 con 0x7f858c06be60 2023-10-08T15:41:32.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.330+0000 7f859258b700 1 -- 172.21.15.3:0/2852932372 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f858c06be60 msgr2=0x7f858c14b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:32.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.330+0000 7f859258b700 1 --2- 172.21.15.3:0/2852932372 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f858c06be60 0x7f858c14b020 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f85800098e0 tx=0x7f85800091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:32.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.330+0000 7f859258b700 1 -- 172.21.15.3:0/2852932372 shutdown_connections 2023-10-08T15:41:32.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.330+0000 7f859258b700 1 --2- 172.21.15.3:0/2852932372 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f858c06be60 0x7f858c14b020 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:32.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.330+0000 7f859258b700 1 -- 172.21.15.3:0/2852932372 >> 172.21.15.3:0/2852932372 conn(0x7f858c0c1df0 msgr2=0x7f858c0c21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:32.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.330+0000 7f859258b700 1 -- 172.21.15.3:0/2852932372 shutdown_connections 2023-10-08T15:41:32.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.330+0000 7f859258b700 1 -- 172.21.15.3:0/2852932372 wait complete. 2023-10-08T15:41:32.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.334+0000 7f859258b700 1 Processor -- start 2023-10-08T15:41:32.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.334+0000 7f859258b700 1 -- start start 2023-10-08T15:41:32.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.334+0000 7f859258b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f858c06be60 0x7f858c09ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:32.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.334+0000 7f859258b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f858c06cc40 0x7f858c14ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:32.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.334+0000 7f859258b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f858c14ac50 0x7f858c15e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:32.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.334+0000 7f859258b700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f858c15e0c0 con 0x7f858c06be60 2023-10-08T15:41:32.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.334+0000 7f859258b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f858c09d330 con 0x7f858c14ac50 2023-10-08T15:41:32.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.334+0000 7f859258b700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f858c09e2a0 con 0x7f858c06cc40 2023-10-08T15:41:32.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.334+0000 7f8591589700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f858c06be60 0x7f858c09ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:32.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.334+0000 7f8591589700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f858c06be60 0x7f858c09ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45162/0 (socket says 172.21.15.3:45162) 2023-10-08T15:41:32.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.334+0000 7f8591589700 1 -- 172.21.15.3:0/2315924817 learned_addr learned my addr 172.21.15.3:0/2315924817 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:32.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.334+0000 7f8590d88700 1 --2- 172.21.15.3:0/2315924817 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f858c06cc40 0x7f858c14ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:32.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.334+0000 7f8591d8a700 1 --2- 172.21.15.3:0/2315924817 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f858c14ac50 0x7f858c15e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:32.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.338+0000 7f8591589700 1 -- 172.21.15.3:0/2315924817 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f858c06cc40 msgr2=0x7f858c14ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:32.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.338+0000 7f8591589700 1 --2- 172.21.15.3:0/2315924817 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f858c06cc40 0x7f858c14ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:32.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.338+0000 7f8591589700 1 -- 172.21.15.3:0/2315924817 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f858c14ac50 msgr2=0x7f858c15e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:32.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.338+0000 7f8591589700 1 --2- 172.21.15.3:0/2315924817 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f858c14ac50 0x7f858c15e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:32.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.338+0000 7f8591589700 1 -- 172.21.15.3:0/2315924817 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8580009420 con 0x7f858c06be60 2023-10-08T15:41:32.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.338+0000 7f8591589700 1 --2- 172.21.15.3:0/2315924817 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f858c06be60 0x7f858c09ecc0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f858800c790 tx=0x7f8588007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:32.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.338+0000 7f857d7fa700 1 -- 172.21.15.3:0/2315924817 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8588005b30 con 0x7f858c06be60 2023-10-08T15:41:32.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.338+0000 7f857d7fa700 1 -- 172.21.15.3:0/2315924817 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8588005c90 con 0x7f858c06be60 2023-10-08T15:41:32.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.338+0000 7f859258b700 1 -- 172.21.15.3:0/2315924817 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f858c09e580 con 0x7f858c06be60 2023-10-08T15:41:32.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.338+0000 7f857d7fa700 1 -- 172.21.15.3:0/2315924817 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8588007300 con 0x7f858c06be60 2023-10-08T15:41:32.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.338+0000 7f859258b700 1 -- 172.21.15.3:0/2315924817 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f858c14f3d0 con 0x7f858c06be60 2023-10-08T15:41:32.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.338+0000 7f859258b700 1 -- 172.21.15.3:0/2315924817 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f858c05ecf0 con 0x7f858c06be60 2023-10-08T15:41:32.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.342+0000 7f857d7fa700 1 -- 172.21.15.3:0/2315924817 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f858801b3b0 con 0x7f858c06be60 2023-10-08T15:41:32.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.342+0000 7f857d7fa700 1 --2- 172.21.15.3:0/2315924817 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8570060550 0x7f8570062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:32.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.342+0000 7f857d7fa700 1 -- 172.21.15.3:0/2315924817 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f858807bc50 con 0x7f858c06be60 2023-10-08T15:41:32.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.342+0000 7f8590d88700 1 --2- 172.21.15.3:0/2315924817 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8570060550 0x7f8570062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:32.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.342+0000 7f8590d88700 1 --2- 172.21.15.3:0/2315924817 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8570060550 0x7f8570062a00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f85800093f0 tx=0x7f8580017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:32.355 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.350+0000 7f857d7fa700 1 -- 172.21.15.3:0/2315924817 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8588081020 con 0x7f858c06be60 2023-10-08T15:41:32.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.514+0000 7f859258b700 1 -- 172.21.15.3:0/2315924817 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f858c06d0e0 con 0x7f858c06be60 2023-10-08T15:41:32.523 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.518+0000 7f857d7fa700 1 -- 172.21.15.3:0/2315924817 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+15254 (secure 0 0 0) 0x7f8588017090 con 0x7f858c06be60 2023-10-08T15:41:32.523 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:41:32.523 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":49,"fsid":"7635972e-cd66-4a8f-a231-378db8b3847a","created":"2023-10-08T15:37:08.234594+0000","modified":"2023-10-08T15:41:07.416834+0000","last_up_change":"2023-10-08T15:37:17.537726+0000","last_in_change":"2023-10-08T15:37:10.269178+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:37:16.581590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:41:04.003380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-08T15:41:04.755627+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"64fb1864-bfdd-4d75-9b41-03fb60085dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33363},{"type":"v1","addr":"172.21.15.3:6801","nonce":33363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33363},{"type":"v1","addr":"172.21.15.3:6803","nonce":33363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":33363},{"type":"v1","addr":"172.21.15.3:6807","nonce":33363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33363},{"type":"v1","addr":"172.21.15.3:6805","nonce":33363}]},"public_addr":"172.21.15.3:6801/33363","cluster_addr":"172.21.15.3:6803/33363","heartbeat_back_addr":"172.21.15.3:6807/33363","heartbeat_front_addr":"172.21.15.3:6805/33363","state":["exists","up"]},{"osd":1,"uuid":"3ca6bd3a-3e8a-4c65-af9c-46148b0c2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33364},{"type":"v1","addr":"172.21.15.3:6820","nonce":33364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33364},{"type":"v1","addr":"172.21.15.3:6824","nonce":33364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33364},{"type":"v1","addr":"172.21.15.3:6831","nonce":33364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33364},{"type":"v1","addr":"172.21.15.3:6828","nonce":33364}]},"public_addr":"172.21.15.3:6820/33364","cluster_addr":"172.21.15.3:6824/33364","heartbeat_back_addr":"172.21.15.3:6831/33364","heartbeat_front_addr":"172.21.15.3:6828/33364","state":["exists","up"]},{"osd":2,"uuid":"6eb9f757-58dd-442f-910d-32401454bce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33366},{"type":"v1","addr":"172.21.15.3:6817","nonce":33366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":33366},{"type":"v1","addr":"172.21.15.3:6821","nonce":33366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6827","nonce":33366},{"type":"v1","addr":"172.21.15.3:6829","nonce":33366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":33366},{"type":"v1","addr":"172.21.15.3:6825","nonce":33366}]},"public_addr":"172.21.15.3:6817/33366","cluster_addr":"172.21.15.3:6821/33366","heartbeat_back_addr":"172.21.15.3:6829/33366","heartbeat_front_addr":"172.21.15.3:6825/33366","state":["exists","up"]},{"osd":3,"uuid":"1c39866b-ac2e-4ea9-a69c-02b01ee4191d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33365},{"type":"v1","addr":"172.21.15.3:6809","nonce":33365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":33365},{"type":"v1","addr":"172.21.15.3:6811","nonce":33365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33365},{"type":"v1","addr":"172.21.15.3:6815","nonce":33365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":33365},{"type":"v1","addr":"172.21.15.3:6813","nonce":33365}]},"public_addr":"172.21.15.3:6809/33365","cluster_addr":"172.21.15.3:6811/33365","heartbeat_back_addr":"172.21.15.3:6815/33365","heartbeat_front_addr":"172.21.15.3:6813/33365","state":["exists","up"]},{"osd":4,"uuid":"15f86b61-b7f1-4780-ae00-9d80a68cb830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":33605},{"type":"v1","addr":"172.21.15.50:6809","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33605},{"type":"v1","addr":"172.21.15.50:6811","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33605},{"type":"v1","addr":"172.21.15.50:6815","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":33605},{"type":"v1","addr":"172.21.15.50:6813","nonce":33605}]},"public_addr":"172.21.15.50:6809/33605","cluster_addr":"172.21.15.50:6811/33605","heartbeat_back_addr":"172.21.15.50:6815/33605","heartbeat_front_addr":"172.21.15.50:6813/33605","state":["exists","up"]},{"osd":5,"uuid":"726c3003-34e6-4d5a-b6e2-f911e13c2118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33606},{"type":"v1","addr":"172.21.15.50:6801","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33606},{"type":"v1","addr":"172.21.15.50:6803","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33606},{"type":"v1","addr":"172.21.15.50:6807","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":33606},{"type":"v1","addr":"172.21.15.50:6805","nonce":33606}]},"public_addr":"172.21.15.50:6801/33606","cluster_addr":"172.21.15.50:6803/33606","heartbeat_back_addr":"172.21.15.50:6807/33606","heartbeat_front_addr":"172.21.15.50:6805/33606","state":["exists","up"]},{"osd":6,"uuid":"401122a4-9988-441f-a5a7-39164434ebcd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":33607},{"type":"v1","addr":"172.21.15.50:6819","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":33607},{"type":"v1","addr":"172.21.15.50:6823","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":33607},{"type":"v1","addr":"172.21.15.50:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":33607},{"type":"v1","addr":"172.21.15.50:6827","nonce":33607}]},"public_addr":"172.21.15.50:6819/33607","cluster_addr":"172.21.15.50:6823/33607","heartbeat_back_addr":"172.21.15.50:6831/33607","heartbeat_front_addr":"172.21.15.50:6827/33607","state":["exists","up"]},{"osd":7,"uuid":"6b3fa236-c9d0-4c4d-82ae-9af4daf6d699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33604},{"type":"v1","addr":"172.21.15.50:6818","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":33604},{"type":"v1","addr":"172.21.15.50:6822","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":33604},{"type":"v1","addr":"172.21.15.50:6830","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":33604},{"type":"v1","addr":"172.21.15.50:6826","nonce":33604}]},"public_addr":"172.21.15.50:6818/33604","cluster_addr":"172.21.15.50:6822/33604","heartbeat_back_addr":"172.21.15.50:6830/33604","heartbeat_front_addr":"172.21.15.50:6826/33604","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.497794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.529417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.873426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.325972+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.443971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.240795+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.739632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.643026+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:41:32.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.522+0000 7f859258b700 1 -- 172.21.15.3:0/2315924817 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8570060550 msgr2=0x7f8570062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:32.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.522+0000 7f859258b700 1 --2- 172.21.15.3:0/2315924817 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8570060550 0x7f8570062a00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f85800093f0 tx=0x7f8580017000 comp rx=0 tx=0).stop 2023-10-08T15:41:32.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.522+0000 7f859258b700 1 -- 172.21.15.3:0/2315924817 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f858c06be60 msgr2=0x7f858c09ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:32.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.522+0000 7f859258b700 1 --2- 172.21.15.3:0/2315924817 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f858c06be60 0x7f858c09ecc0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f858800c790 tx=0x7f8588007ea0 comp rx=0 tx=0).stop 2023-10-08T15:41:32.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.522+0000 7f859258b700 1 -- 172.21.15.3:0/2315924817 shutdown_connections 2023-10-08T15:41:32.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.522+0000 7f859258b700 1 --2- 172.21.15.3:0/2315924817 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8570060550 0x7f8570062a00 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:32.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.522+0000 7f859258b700 1 --2- 172.21.15.3:0/2315924817 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f858c14ac50 0x7f858c15e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:32.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.522+0000 7f859258b700 1 --2- 172.21.15.3:0/2315924817 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f858c06cc40 0x7f858c14ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:32.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.522+0000 7f859258b700 1 --2- 172.21.15.3:0/2315924817 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f858c06be60 0x7f858c09ecc0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:32.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.522+0000 7f859258b700 1 -- 172.21.15.3:0/2315924817 >> 172.21.15.3:0/2315924817 conn(0x7f858c0c1df0 msgr2=0x7f858c149e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:32.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.522+0000 7f859258b700 1 -- 172.21.15.3:0/2315924817 shutdown_connections 2023-10-08T15:41:32.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.522+0000 7f859258b700 1 -- 172.21.15.3:0/2315924817 wait complete. 2023-10-08T15:41:32.538 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T15:37:16.581590+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T15:41:04.003380+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T15:41:04.755627+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T15:41:32.538 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T15:41:32.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.646+0000 7fb93e872700 1 Processor -- start 2023-10-08T15:41:32.652 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.646+0000 7fb93e872700 1 -- start start 2023-10-08T15:41:32.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.646+0000 7fb93e872700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb9381479f0 0x7fb938067bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:32.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.646+0000 7fb93e872700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb938069ed0 0x7fb938147dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:32.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.646+0000 7fb93e872700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb938068130 0x7fb93814bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:32.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.646+0000 7fb93e872700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9381494f0 con 0x7fb938069ed0 2023-10-08T15:41:32.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.646+0000 7fb93e872700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb93806e3f0 con 0x7fb9381479f0 2023-10-08T15:41:32.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.646+0000 7fb93e872700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb93806e6d0 con 0x7fb938068130 2023-10-08T15:41:32.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.646+0000 7fb9377fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb938069ed0 0x7fb938147dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:32.655 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.646+0000 7fb9377fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb938069ed0 0x7fb938147dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45176/0 (socket says 172.21.15.3:45176) 2023-10-08T15:41:32.655 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.646+0000 7fb9377fe700 1 -- 172.21.15.3:0/3678224453 learned_addr learned my addr 172.21.15.3:0/3678224453 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:32.655 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.650+0000 7fb93ce0f700 1 --2- 172.21.15.3:0/3678224453 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb938068130 0x7fb93814bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:32.655 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.650+0000 7fb937fff700 1 --2- 172.21.15.3:0/3678224453 >> v2:172.21.15.50:3300/0 conn(0x7fb9381479f0 0x7fb938067bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:32.655 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.650+0000 7fb9377fe700 1 -- 172.21.15.3:0/3678224453 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb938068130 msgr2=0x7fb93814bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:32.655 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.650+0000 7fb9377fe700 1 --2- 172.21.15.3:0/3678224453 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb938068130 0x7fb93814bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:32.655 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.650+0000 7fb9377fe700 1 -- 172.21.15.3:0/3678224453 >> v2:172.21.15.50:3300/0 conn(0x7fb9381479f0 msgr2=0x7fb938067bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:32.655 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.650+0000 7fb9377fe700 1 --2- 172.21.15.3:0/3678224453 >> v2:172.21.15.50:3300/0 conn(0x7fb9381479f0 0x7fb938067bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:32.655 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.650+0000 7fb9377fe700 1 -- 172.21.15.3:0/3678224453 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9380b3490 con 0x7fb938069ed0 2023-10-08T15:41:32.655 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.650+0000 7fb937fff700 1 --2- 172.21.15.3:0/3678224453 >> v2:172.21.15.50:3300/0 conn(0x7fb9381479f0 0x7fb938067bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:41:32.655 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.650+0000 7fb9377fe700 1 --2- 172.21.15.3:0/3678224453 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb938069ed0 0x7fb938147dc0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fb938068580 tx=0x7fb928009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9a40dbe3c77923e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:32.656 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.650+0000 7fb936ffd700 1 -- 172.21.15.3:0/3678224453 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92800b860 con 0x7fb938069ed0 2023-10-08T15:41:32.656 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.650+0000 7fb936ffd700 1 -- 172.21.15.3:0/3678224453 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb92800b9c0 con 0x7fb938069ed0 2023-10-08T15:41:32.656 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.650+0000 7fb936ffd700 1 -- 172.21.15.3:0/3678224453 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92800bd60 con 0x7fb938069ed0 2023-10-08T15:41:32.657 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.650+0000 7fb93e872700 1 -- 172.21.15.3:0/3678224453 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb938069ed0 msgr2=0x7fb938147dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:32.657 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.650+0000 7fb93e872700 1 --2- 172.21.15.3:0/3678224453 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb938069ed0 0x7fb938147dc0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fb938068580 tx=0x7fb928009250 comp rx=0 tx=0).stop 2023-10-08T15:41:32.657 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.650+0000 7fb93e872700 1 -- 172.21.15.3:0/3678224453 shutdown_connections 2023-10-08T15:41:32.657 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.650+0000 7fb93e872700 1 --2- 172.21.15.3:0/3678224453 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb938068130 0x7fb93814bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:32.657 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.650+0000 7fb93e872700 1 --2- 172.21.15.3:0/3678224453 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb938069ed0 0x7fb938147dc0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:32.657 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.650+0000 7fb93e872700 1 --2- 172.21.15.3:0/3678224453 >> v2:172.21.15.50:3300/0 conn(0x7fb9381479f0 0x7fb938067bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:32.657 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.650+0000 7fb93e872700 1 -- 172.21.15.3:0/3678224453 >> 172.21.15.3:0/3678224453 conn(0x7fb9380670e0 msgr2=0x7fb9380674e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:32.657 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.650+0000 7fb93e872700 1 -- 172.21.15.3:0/3678224453 shutdown_connections 2023-10-08T15:41:32.658 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.650+0000 7fb93e872700 1 -- 172.21.15.3:0/3678224453 wait complete. 2023-10-08T15:41:32.658 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.654+0000 7fb93e872700 1 Processor -- start 2023-10-08T15:41:32.658 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.654+0000 7fb93e872700 1 -- start start 2023-10-08T15:41:32.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.654+0000 7fb93e872700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb938068130 0x7fb93806c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:32.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.654+0000 7fb93e872700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb938069ed0 0x7fb9381439b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:32.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.654+0000 7fb93e872700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb9381479f0 0x7fb938143ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:32.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.654+0000 7fb93e872700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9380b9790 con 0x7fb938069ed0 2023-10-08T15:41:32.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.654+0000 7fb93e872700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb93815d0e0 con 0x7fb938068130 2023-10-08T15:41:32.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.654+0000 7fb93e872700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb93815cb20 con 0x7fb9381479f0 2023-10-08T15:41:32.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.654+0000 7fb9377fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb938069ed0 0x7fb9381439b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:32.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.654+0000 7fb9377fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb938069ed0 0x7fb9381439b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45190/0 (socket says 172.21.15.3:45190) 2023-10-08T15:41:32.664 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.654+0000 7fb9377fe700 1 -- 172.21.15.3:0/1295053568 learned_addr learned my addr 172.21.15.3:0/1295053568 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:32.664 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.654+0000 7fb937fff700 1 --2- 172.21.15.3:0/1295053568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb938068130 0x7fb93806c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:32.664 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.654+0000 7fb93ce0f700 1 --2- 172.21.15.3:0/1295053568 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb9381479f0 0x7fb938143ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:32.664 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.654+0000 7fb9377fe700 1 -- 172.21.15.3:0/1295053568 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb9381479f0 msgr2=0x7fb938143ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:32.664 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.654+0000 7fb9377fe700 1 --2- 172.21.15.3:0/1295053568 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb9381479f0 0x7fb938143ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:32.664 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.654+0000 7fb9377fe700 1 -- 172.21.15.3:0/1295053568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb938068130 msgr2=0x7fb93806c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:32.664 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.654+0000 7fb9377fe700 1 --2- 172.21.15.3:0/1295053568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb938068130 0x7fb93806c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:32.664 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.654+0000 7fb9377fe700 1 -- 172.21.15.3:0/1295053568 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9280094f0 con 0x7fb938069ed0 2023-10-08T15:41:32.664 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.654+0000 7fb9377fe700 1 --2- 172.21.15.3:0/1295053568 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb938069ed0 0x7fb9381439b0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fb938063740 tx=0x7fb928017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:32.664 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.654+0000 7fb91ffff700 1 -- 172.21.15.3:0/1295053568 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb928024440 con 0x7fb938069ed0 2023-10-08T15:41:32.664 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.654+0000 7fb91ffff700 1 -- 172.21.15.3:0/1295053568 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9280245a0 con 0x7fb938069ed0 2023-10-08T15:41:32.664 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.654+0000 7fb93e872700 1 -- 172.21.15.3:0/1295053568 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb938144430 con 0x7fb938069ed0 2023-10-08T15:41:32.665 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.654+0000 7fb91ffff700 1 -- 172.21.15.3:0/1295053568 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb928024940 con 0x7fb938069ed0 2023-10-08T15:41:32.665 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.654+0000 7fb93e872700 1 -- 172.21.15.3:0/1295053568 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9380b9270 con 0x7fb938069ed0 2023-10-08T15:41:32.665 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.658+0000 7fb93e872700 1 -- 172.21.15.3:0/1295053568 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb938064530 con 0x7fb938069ed0 2023-10-08T15:41:32.666 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.658+0000 7fb91ffff700 1 -- 172.21.15.3:0/1295053568 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb92801a420 con 0x7fb938069ed0 2023-10-08T15:41:32.666 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.658+0000 7fb91ffff700 1 --2- 172.21.15.3:0/1295053568 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb924060550 0x7fb924062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:32.666 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.658+0000 7fb91ffff700 1 -- 172.21.15.3:0/1295053568 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb92807e640 con 0x7fb938069ed0 2023-10-08T15:41:32.666 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.658+0000 7fb937fff700 1 --2- 172.21.15.3:0/1295053568 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb924060550 0x7fb924062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:32.666 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.662+0000 7fb937fff700 1 --2- 172.21.15.3:0/1295053568 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb924060550 0x7fb924062a00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb92c006fd0 tx=0x7fb92c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:32.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.666+0000 7fb91ffff700 1 -- 172.21.15.3:0/1295053568 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb92804ed60 con 0x7fb938069ed0 2023-10-08T15:41:32.835 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.830+0000 7fb93e872700 1 -- 172.21.15.3:0/1295053568 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb93815cce0 con 0x7fb938069ed0 2023-10-08T15:41:32.836 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.830+0000 7fb91ffff700 1 -- 172.21.15.3:0/1295053568 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v49) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb928052380 con 0x7fb938069ed0 2023-10-08T15:41:32.836 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2023-10-08T15:41:32.838 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.834+0000 7fb93e872700 1 -- 172.21.15.3:0/1295053568 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb924060550 msgr2=0x7fb924062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:32.838 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.834+0000 7fb93e872700 1 --2- 172.21.15.3:0/1295053568 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb924060550 0x7fb924062a00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb92c006fd0 tx=0x7fb92c008040 comp rx=0 tx=0).stop 2023-10-08T15:41:32.838 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.834+0000 7fb93e872700 1 -- 172.21.15.3:0/1295053568 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb938069ed0 msgr2=0x7fb9381439b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:32.838 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.834+0000 7fb93e872700 1 --2- 172.21.15.3:0/1295053568 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb938069ed0 0x7fb9381439b0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fb938063740 tx=0x7fb928017000 comp rx=0 tx=0).stop 2023-10-08T15:41:32.838 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.834+0000 7fb93e872700 1 -- 172.21.15.3:0/1295053568 shutdown_connections 2023-10-08T15:41:32.839 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.834+0000 7fb93e872700 1 --2- 172.21.15.3:0/1295053568 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb924060550 0x7fb924062a00 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:32.839 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.834+0000 7fb93e872700 1 --2- 172.21.15.3:0/1295053568 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb9381479f0 0x7fb938143ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:32.839 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.834+0000 7fb93e872700 1 --2- 172.21.15.3:0/1295053568 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb938069ed0 0x7fb9381439b0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:32.839 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.834+0000 7fb93e872700 1 --2- 172.21.15.3:0/1295053568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb938068130 0x7fb93806c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:32.839 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.834+0000 7fb93e872700 1 -- 172.21.15.3:0/1295053568 >> 172.21.15.3:0/1295053568 conn(0x7fb9380670e0 msgr2=0x7fb938146ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:32.839 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.834+0000 7fb93e872700 1 -- 172.21.15.3:0/1295053568 shutdown_connections 2023-10-08T15:41:32.839 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.834+0000 7fb93e872700 1 -- 172.21.15.3:0/1295053568 wait complete. 2023-10-08T15:41:32.850 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T15:41:32.959 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.954+0000 7f884d15f700 1 Processor -- start 2023-10-08T15:41:32.959 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.954+0000 7f884d15f700 1 -- start start 2023-10-08T15:41:32.961 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.954+0000 7f884d15f700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8848148cf0 0x7f88480b3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:32.961 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.954+0000 7f884d15f700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f88481490c0 0x7f8848147f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:32.961 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.954+0000 7f884d15f700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f884806e0b0 con 0x7f884806ec00 2023-10-08T15:41:32.961 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.954+0000 7f884d15f700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88480b3b30 con 0x7f88481490c0 2023-10-08T15:41:32.961 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.954+0000 7f884d15f700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f884806e390 con 0x7f8848148cf0 2023-10-08T15:41:32.961 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.954+0000 7f88477fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f88481490c0 0x7f8848147f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:32.961 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.954+0000 7f88477fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f88481490c0 0x7f8848147f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45198/0 (socket says 172.21.15.3:45198) 2023-10-08T15:41:32.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.954+0000 7f88477fe700 1 -- 172.21.15.3:0/255079135 learned_addr learned my addr 172.21.15.3:0/255079135 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:32.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.954+0000 7f8847fff700 1 --2- 172.21.15.3:0/255079135 >> v2:172.21.15.50:3300/0 conn(0x7f8848148cf0 0x7f88480b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:32.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.954+0000 7f88477fe700 1 -- 172.21.15.3:0/255079135 >> v2:172.21.15.50:3300/0 conn(0x7f8848148cf0 msgr2=0x7f88480b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:32.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.954+0000 7f88477fe700 1 --2- 172.21.15.3:0/255079135 >> v2:172.21.15.50:3300/0 conn(0x7f8848148cf0 0x7f88480b3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:32.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.954+0000 7f88477fe700 1 -- 172.21.15.3:0/255079135 >> v1:172.21.15.50:6789/0 conn(0x7f884806ec00 legacy=0x7f88480bf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:32.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.954+0000 7f88477fe700 1 -- 172.21.15.3:0/255079135 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88480a2e80 con 0x7f88481490c0 2023-10-08T15:41:32.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.958+0000 7f88477fe700 1 --2- 172.21.15.3:0/255079135 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f88481490c0 0x7f8848147f40 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f884806d400 tx=0x7f8838009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f69b4ff842d5166d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:32.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.958+0000 7f8846ffd700 1 -- 172.21.15.3:0/255079135 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883800b820 con 0x7f88481490c0 2023-10-08T15:41:32.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.958+0000 7f8846ffd700 1 -- 172.21.15.3:0/255079135 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f883800b980 con 0x7f88481490c0 2023-10-08T15:41:32.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.958+0000 7f8846ffd700 1 -- 172.21.15.3:0/255079135 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883800bd20 con 0x7f88481490c0 2023-10-08T15:41:32.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.958+0000 7f884d15f700 1 -- 172.21.15.3:0/255079135 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f88481490c0 msgr2=0x7f8848147f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:32.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.958+0000 7f884d15f700 1 --2- 172.21.15.3:0/255079135 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f88481490c0 0x7f8848147f40 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f884806d400 tx=0x7f8838009250 comp rx=0 tx=0).stop 2023-10-08T15:41:32.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.958+0000 7f884d15f700 1 -- 172.21.15.3:0/255079135 shutdown_connections 2023-10-08T15:41:32.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.958+0000 7f884d15f700 1 --2- 172.21.15.3:0/255079135 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f88481490c0 0x7f8848147f40 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:32.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.958+0000 7f884d15f700 1 --2- 172.21.15.3:0/255079135 >> v2:172.21.15.50:3300/0 conn(0x7f8848148cf0 0x7f88480b3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:32.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.958+0000 7f884d15f700 1 -- 172.21.15.3:0/255079135 >> 172.21.15.3:0/255079135 conn(0x7f8848068c80 msgr2=0x7f88480beae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:32.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.958+0000 7f884d15f700 1 -- 172.21.15.3:0/255079135 shutdown_connections 2023-10-08T15:41:32.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.958+0000 7f884d15f700 1 -- 172.21.15.3:0/255079135 wait complete. 2023-10-08T15:41:32.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.958+0000 7f884d15f700 1 Processor -- start 2023-10-08T15:41:32.965 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.958+0000 7f884d15f700 1 -- start start 2023-10-08T15:41:32.966 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.958+0000 7f884d15f700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f884806ec00 0x7f8848143210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:32.966 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.958+0000 7f884d15f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8848148cf0 0x7f88481408d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:32.967 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.958+0000 7f884d15f700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f88481490c0 0x7f884815e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:32.967 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.958+0000 7f884d15f700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8848141290 con 0x7f884806ec00 2023-10-08T15:41:32.967 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.958+0000 7f884d15f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884815c580 con 0x7f8848148cf0 2023-10-08T15:41:32.967 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.958+0000 7f884d15f700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88481414e0 con 0x7f88481490c0 2023-10-08T15:41:32.967 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.958+0000 7f8847fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f884806ec00 0x7f8848143210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:32.967 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.958+0000 7f8847fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f884806ec00 0x7f8848143210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45204/0 (socket says 172.21.15.3:45204) 2023-10-08T15:41:32.967 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.958+0000 7f8847fff700 1 -- 172.21.15.3:0/496713099 learned_addr learned my addr 172.21.15.3:0/496713099 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:32.967 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.958+0000 7f88477fe700 1 --2- 172.21.15.3:0/496713099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8848148cf0 0x7f88481408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:32.967 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.958+0000 7f884c95e700 1 --2- 172.21.15.3:0/496713099 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f88481490c0 0x7f884815e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:32.967 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.958+0000 7f8847fff700 1 -- 172.21.15.3:0/496713099 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f88481490c0 msgr2=0x7f884815e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:32.967 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.958+0000 7f8847fff700 1 --2- 172.21.15.3:0/496713099 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f88481490c0 0x7f884815e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:32.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.958+0000 7f8847fff700 1 -- 172.21.15.3:0/496713099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8848148cf0 msgr2=0x7f88481408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:32.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.958+0000 7f8847fff700 1 --2- 172.21.15.3:0/496713099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8848148cf0 0x7f88481408d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:32.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.958+0000 7f8847fff700 1 -- 172.21.15.3:0/496713099 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88380094f0 con 0x7f884806ec00 2023-10-08T15:41:32.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.962+0000 7f8847fff700 1 --2- 172.21.15.3:0/496713099 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f884806ec00 0x7f8848143210 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f883c00d890 tx=0x7f883c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:32.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.962+0000 7f882ffff700 1 -- 172.21.15.3:0/496713099 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883c0125f0 con 0x7f884806ec00 2023-10-08T15:41:32.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.962+0000 7f882ffff700 1 -- 172.21.15.3:0/496713099 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f883c012770 con 0x7f884806ec00 2023-10-08T15:41:32.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.962+0000 7f882ffff700 1 -- 172.21.15.3:0/496713099 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883c012b30 con 0x7f884806ec00 2023-10-08T15:41:32.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.962+0000 7f884d15f700 1 -- 172.21.15.3:0/496713099 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8848141c10 con 0x7f884806ec00 2023-10-08T15:41:32.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.962+0000 7f884d15f700 1 -- 172.21.15.3:0/496713099 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8848143750 con 0x7f884806ec00 2023-10-08T15:41:32.969 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.962+0000 7f884d15f700 1 -- 172.21.15.3:0/496713099 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f884805ecf0 con 0x7f884806ec00 2023-10-08T15:41:32.969 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.962+0000 7f882ffff700 1 -- 172.21.15.3:0/496713099 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f883c01e460 con 0x7f884806ec00 2023-10-08T15:41:32.969 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.962+0000 7f882ffff700 1 --2- 172.21.15.3:0/496713099 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8834060550 0x7f8834062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:32.969 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.962+0000 7f882ffff700 1 -- 172.21.15.3:0/496713099 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f883c07cdd0 con 0x7f884806ec00 2023-10-08T15:41:32.969 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.962+0000 7f88477fe700 1 --2- 172.21.15.3:0/496713099 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8834060550 0x7f8834062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:32.970 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.966+0000 7f88477fe700 1 --2- 172.21.15.3:0/496713099 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8834060550 0x7f8834062a00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f884806d400 tx=0x7f8838016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:32.978 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:32.974+0000 7f882ffff700 1 -- 172.21.15.3:0/496713099 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f883c04d3c0 con 0x7f884806ec00 2023-10-08T15:41:33.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.138+0000 7f884d15f700 1 -- 172.21.15.3:0/496713099 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8848141650 con 0x7f884806ec00 2023-10-08T15:41:33.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.138+0000 7f882ffff700 1 -- 172.21.15.3:0/496713099 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v49) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8848141650 con 0x7f884806ec00 2023-10-08T15:41:33.142 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 32 2023-10-08T15:41:33.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.138+0000 7f884d15f700 1 -- 172.21.15.3:0/496713099 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8834060550 msgr2=0x7f8834062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:33.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.138+0000 7f884d15f700 1 --2- 172.21.15.3:0/496713099 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8834060550 0x7f8834062a00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f884806d400 tx=0x7f8838016000 comp rx=0 tx=0).stop 2023-10-08T15:41:33.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.138+0000 7f884d15f700 1 -- 172.21.15.3:0/496713099 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f884806ec00 msgr2=0x7f8848143210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:33.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.138+0000 7f884d15f700 1 --2- 172.21.15.3:0/496713099 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f884806ec00 0x7f8848143210 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f883c00d890 tx=0x7f883c008040 comp rx=0 tx=0).stop 2023-10-08T15:41:33.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.138+0000 7f884d15f700 1 -- 172.21.15.3:0/496713099 shutdown_connections 2023-10-08T15:41:33.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.138+0000 7f884d15f700 1 --2- 172.21.15.3:0/496713099 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8834060550 0x7f8834062a00 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:33.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.138+0000 7f884d15f700 1 --2- 172.21.15.3:0/496713099 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f88481490c0 0x7f884815e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:33.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.138+0000 7f884d15f700 1 --2- 172.21.15.3:0/496713099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8848148cf0 0x7f88481408d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:33.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.138+0000 7f884d15f700 1 --2- 172.21.15.3:0/496713099 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f884806ec00 0x7f8848143210 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:33.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.138+0000 7f884d15f700 1 -- 172.21.15.3:0/496713099 >> 172.21.15.3:0/496713099 conn(0x7f8848068c80 msgr2=0x7f88480b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:33.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.138+0000 7f884d15f700 1 -- 172.21.15.3:0/496713099 shutdown_connections 2023-10-08T15:41:33.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.138+0000 7f884d15f700 1 -- 172.21.15.3:0/496713099 wait complete. 2023-10-08T15:41:33.162 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T15:41:33.272 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.266+0000 7fb2dda11700 1 Processor -- start 2023-10-08T15:41:33.272 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.266+0000 7fb2dda11700 1 -- start start 2023-10-08T15:41:33.274 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.270+0000 7fb2dda11700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb2d8148cf0 0x7fb2d80b3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:33.275 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.270+0000 7fb2dda11700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb2d806ec00 0x7fb2d8147f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:33.275 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.270+0000 7fb2dda11700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2d806e0b0 con 0x7fb2d81490c0 2023-10-08T15:41:33.275 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.270+0000 7fb2dda11700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2d80b3b30 con 0x7fb2d8148cf0 2023-10-08T15:41:33.275 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.270+0000 7fb2dda11700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2d806e390 con 0x7fb2d806ec00 2023-10-08T15:41:33.275 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.270+0000 7fb2dca0f700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb2d8148cf0 0x7fb2d80b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:33.275 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.270+0000 7fb2dca0f700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb2d8148cf0 0x7fb2d80b3050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45210/0 (socket says 172.21.15.3:45210) 2023-10-08T15:41:33.275 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.270+0000 7fb2dca0f700 1 -- 172.21.15.3:0/2242586349 learned_addr learned my addr 172.21.15.3:0/2242586349 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:33.275 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.270+0000 7fb2dd210700 1 --2- 172.21.15.3:0/2242586349 >> v2:172.21.15.50:3300/0 conn(0x7fb2d806ec00 0x7fb2d8147f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:33.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.270+0000 7fb2dca0f700 1 -- 172.21.15.3:0/2242586349 >> v2:172.21.15.50:3300/0 conn(0x7fb2d806ec00 msgr2=0x7fb2d8147f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:33.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.270+0000 7fb2dca0f700 1 --2- 172.21.15.3:0/2242586349 >> v2:172.21.15.50:3300/0 conn(0x7fb2d806ec00 0x7fb2d8147f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:33.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.270+0000 7fb2dca0f700 1 -- 172.21.15.3:0/2242586349 >> v1:172.21.15.50:6789/0 conn(0x7fb2d81490c0 legacy=0x7fb2d80bf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:33.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.270+0000 7fb2dca0f700 1 -- 172.21.15.3:0/2242586349 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d80a2e80 con 0x7fb2d8148cf0 2023-10-08T15:41:33.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.270+0000 7fb2dca0f700 1 --2- 172.21.15.3:0/2242586349 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb2d8148cf0 0x7fb2d80b3050 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fb2d80a2bf0 tx=0x7fb2cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7487c8112add013 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:33.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.270+0000 7fb2d77fe700 1 -- 172.21.15.3:0/2242586349 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc009e70 con 0x7fb2d8148cf0 2023-10-08T15:41:33.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.270+0000 7fb2d77fe700 1 -- 172.21.15.3:0/2242586349 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2cc00b860 con 0x7fb2d8148cf0 2023-10-08T15:41:33.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.270+0000 7fb2d77fe700 1 -- 172.21.15.3:0/2242586349 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc00bc00 con 0x7fb2d8148cf0 2023-10-08T15:41:33.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.270+0000 7fb2dda11700 1 -- 172.21.15.3:0/2242586349 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb2d8148cf0 msgr2=0x7fb2d80b3050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:33.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.270+0000 7fb2dda11700 1 --2- 172.21.15.3:0/2242586349 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb2d8148cf0 0x7fb2d80b3050 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fb2d80a2bf0 tx=0x7fb2cc009250 comp rx=0 tx=0).stop 2023-10-08T15:41:33.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.270+0000 7fb2dda11700 1 -- 172.21.15.3:0/2242586349 shutdown_connections 2023-10-08T15:41:33.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.270+0000 7fb2dda11700 1 --2- 172.21.15.3:0/2242586349 >> v2:172.21.15.50:3300/0 conn(0x7fb2d806ec00 0x7fb2d8147f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:33.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.270+0000 7fb2dda11700 1 --2- 172.21.15.3:0/2242586349 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb2d8148cf0 0x7fb2d80b3050 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:33.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.270+0000 7fb2dda11700 1 -- 172.21.15.3:0/2242586349 >> 172.21.15.3:0/2242586349 conn(0x7fb2d8068c80 msgr2=0x7fb2d80beae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:33.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.270+0000 7fb2dda11700 1 -- 172.21.15.3:0/2242586349 shutdown_connections 2023-10-08T15:41:33.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.270+0000 7fb2dda11700 1 -- 172.21.15.3:0/2242586349 wait complete. 2023-10-08T15:41:33.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.274+0000 7fb2dda11700 1 Processor -- start 2023-10-08T15:41:33.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.274+0000 7fb2dda11700 1 -- start start 2023-10-08T15:41:33.282 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.274+0000 7fb2dda11700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb2d806ec00 0x7fb2d80b7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:33.282 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.274+0000 7fb2dda11700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb2d8148cf0 0x7fb2d814aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:33.282 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.274+0000 7fb2dda11700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2d81490c0 0x7fb2d8159a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:33.282 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.274+0000 7fb2dda11700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d80a27b0 con 0x7fb2d806ec00 2023-10-08T15:41:33.282 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.274+0000 7fb2dda11700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d81595e0 con 0x7fb2d81490c0 2023-10-08T15:41:33.282 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.274+0000 7fb2dda11700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d80b8230 con 0x7fb2d8148cf0 2023-10-08T15:41:33.282 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.274+0000 7fb2dca0f700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb2d806ec00 0x7fb2d80b7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:33.282 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.274+0000 7fb2dca0f700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb2d806ec00 0x7fb2d80b7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45216/0 (socket says 172.21.15.3:45216) 2023-10-08T15:41:33.283 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.274+0000 7fb2dca0f700 1 -- 172.21.15.3:0/3166829051 learned_addr learned my addr 172.21.15.3:0/3166829051 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:33.283 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.274+0000 7fb2d7fff700 1 --2- 172.21.15.3:0/3166829051 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb2d8148cf0 0x7fb2d814aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:33.283 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.274+0000 7fb2dd210700 1 --2- 172.21.15.3:0/3166829051 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2d81490c0 0x7fb2d8159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:33.283 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.274+0000 7fb2dca0f700 1 -- 172.21.15.3:0/3166829051 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb2d8148cf0 msgr2=0x7fb2d814aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:33.283 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.274+0000 7fb2dca0f700 1 --2- 172.21.15.3:0/3166829051 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb2d8148cf0 0x7fb2d814aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:33.283 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.274+0000 7fb2dca0f700 1 -- 172.21.15.3:0/3166829051 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2d81490c0 msgr2=0x7fb2d8159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:33.283 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.274+0000 7fb2dca0f700 1 --2- 172.21.15.3:0/3166829051 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2d81490c0 0x7fb2d8159a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:33.283 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.274+0000 7fb2dca0f700 1 -- 172.21.15.3:0/3166829051 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2cc0094f0 con 0x7fb2d806ec00 2023-10-08T15:41:33.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.274+0000 7fb2dd210700 1 --2- 172.21.15.3:0/3166829051 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2d81490c0 0x7fb2d8159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:33.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.274+0000 7fb2dca0f700 1 --2- 172.21.15.3:0/3166829051 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb2d806ec00 0x7fb2d80b7cf0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc006fd0 tx=0x7fb2cc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:33.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.278+0000 7fb2d4ff9700 1 -- 172.21.15.3:0/3166829051 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc00bbe0 con 0x7fb2d806ec00 2023-10-08T15:41:33.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.278+0000 7fb2d4ff9700 1 -- 172.21.15.3:0/3166829051 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2cc011420 con 0x7fb2d806ec00 2023-10-08T15:41:33.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.278+0000 7fb2dda11700 1 -- 172.21.15.3:0/3166829051 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2d814af40 con 0x7fb2d806ec00 2023-10-08T15:41:33.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.278+0000 7fb2d4ff9700 1 -- 172.21.15.3:0/3166829051 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc0117a0 con 0x7fb2d806ec00 2023-10-08T15:41:33.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.278+0000 7fb2dda11700 1 -- 172.21.15.3:0/3166829051 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2d815d600 con 0x7fb2d806ec00 2023-10-08T15:41:33.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.278+0000 7fb2d4ff9700 1 -- 172.21.15.3:0/3166829051 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb2cc011bd0 con 0x7fb2d806ec00 2023-10-08T15:41:33.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.278+0000 7fb2dda11700 1 -- 172.21.15.3:0/3166829051 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2d805ecf0 con 0x7fb2d806ec00 2023-10-08T15:41:33.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.278+0000 7fb2d4ff9700 1 --2- 172.21.15.3:0/3166829051 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb2bc060550 0x7fb2bc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:33.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.278+0000 7fb2d4ff9700 1 -- 172.21.15.3:0/3166829051 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb2cc07dff0 con 0x7fb2d806ec00 2023-10-08T15:41:33.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.278+0000 7fb2d7fff700 1 --2- 172.21.15.3:0/3166829051 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb2bc060550 0x7fb2bc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:33.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.282+0000 7fb2d7fff700 1 --2- 172.21.15.3:0/3166829051 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb2bc060550 0x7fb2bc062a00 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb2d81475c0 tx=0x7fb2c4007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:33.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.286+0000 7fb2d4ff9700 1 -- 172.21.15.3:0/3166829051 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb2cc04e5e0 con 0x7fb2d806ec00 2023-10-08T15:41:33.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.450+0000 7fb2dda11700 1 -- 172.21.15.3:0/3166829051 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb2d80bf900 con 0x7fb2d806ec00 2023-10-08T15:41:33.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.450+0000 7fb2d4ff9700 1 -- 172.21.15.3:0/3166829051 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v49) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb2cc051c00 con 0x7fb2d806ec00 2023-10-08T15:41:33.454 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 64 2023-10-08T15:41:33.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.450+0000 7fb2dda11700 1 -- 172.21.15.3:0/3166829051 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb2bc060550 msgr2=0x7fb2bc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:33.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.450+0000 7fb2dda11700 1 --2- 172.21.15.3:0/3166829051 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb2bc060550 0x7fb2bc062a00 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb2d81475c0 tx=0x7fb2c4007ec0 comp rx=0 tx=0).stop 2023-10-08T15:41:33.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.450+0000 7fb2dda11700 1 -- 172.21.15.3:0/3166829051 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb2d806ec00 msgr2=0x7fb2d80b7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:33.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.450+0000 7fb2dda11700 1 --2- 172.21.15.3:0/3166829051 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb2d806ec00 0x7fb2d80b7cf0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc006fd0 tx=0x7fb2cc017000 comp rx=0 tx=0).stop 2023-10-08T15:41:33.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.450+0000 7fb2dda11700 1 -- 172.21.15.3:0/3166829051 shutdown_connections 2023-10-08T15:41:33.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.450+0000 7fb2dda11700 1 --2- 172.21.15.3:0/3166829051 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb2bc060550 0x7fb2bc062a00 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:33.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.450+0000 7fb2dda11700 1 --2- 172.21.15.3:0/3166829051 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2d81490c0 0x7fb2d8159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:33.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.450+0000 7fb2dda11700 1 --2- 172.21.15.3:0/3166829051 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb2d8148cf0 0x7fb2d814aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:33.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.450+0000 7fb2dda11700 1 --2- 172.21.15.3:0/3166829051 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb2d806ec00 0x7fb2d80b7cf0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:33.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.450+0000 7fb2dda11700 1 -- 172.21.15.3:0/3166829051 >> 172.21.15.3:0/3166829051 conn(0x7fb2d8068c80 msgr2=0x7fb2d80bdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:33.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.450+0000 7fb2dda11700 1 -- 172.21.15.3:0/3166829051 shutdown_connections 2023-10-08T15:41:33.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.450+0000 7fb2dda11700 1 -- 172.21.15.3:0/3166829051 wait complete. 2023-10-08T15:41:33.468 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:41:33.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.574+0000 7fbeecb8b700 1 Processor -- start 2023-10-08T15:41:33.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.574+0000 7fbeecb8b700 1 -- start start 2023-10-08T15:41:33.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.574+0000 7fbeecb8b700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fbee80703a0 0x7fbee8146b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:33.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.574+0000 7fbeecb8b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbee8070800 0x7fbee81470b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:33.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.574+0000 7fbeecb8b700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbee8147970 con 0x7fbee814b850 2023-10-08T15:41:33.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.574+0000 7fbeecb8b700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbee806de00 con 0x7fbee80703a0 2023-10-08T15:41:33.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.574+0000 7fbeecb8b700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbee8069770 con 0x7fbee8070800 2023-10-08T15:41:33.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.574+0000 7fbee6ffd700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fbee80703a0 0x7fbee8146b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:33.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.574+0000 7fbee6ffd700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fbee80703a0 0x7fbee8146b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45226/0 (socket says 172.21.15.3:45226) 2023-10-08T15:41:33.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.574+0000 7fbee6ffd700 1 -- 172.21.15.3:0/9526819 learned_addr learned my addr 172.21.15.3:0/9526819 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:33.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.574+0000 7fbee7fff700 1 --2- 172.21.15.3:0/9526819 >> v2:172.21.15.50:3300/0 conn(0x7fbee8070800 0x7fbee81470b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:33.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.574+0000 7fbee6ffd700 1 -- 172.21.15.3:0/9526819 >> v2:172.21.15.50:3300/0 conn(0x7fbee8070800 msgr2=0x7fbee81470b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:33.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.574+0000 7fbee6ffd700 1 --2- 172.21.15.3:0/9526819 >> v2:172.21.15.50:3300/0 conn(0x7fbee8070800 0x7fbee81470b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:33.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.574+0000 7fbee6ffd700 1 -- 172.21.15.3:0/9526819 >> v1:172.21.15.3:6789/0 conn(0x7fbee814b850 legacy=0x7fbee80a15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:33.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.574+0000 7fbee6ffd700 1 -- 172.21.15.3:0/9526819 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee8068c60 con 0x7fbee80703a0 2023-10-08T15:41:33.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.574+0000 7fbee6ffd700 1 --2- 172.21.15.3:0/9526819 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbee80703a0 0x7fbee8146b70 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fbee80b1ce0 tx=0x7fbee0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba3b881fcbe08578 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:33.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.574+0000 7fbee67fc700 1 -- 172.21.15.3:0/9526819 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee000e070 con 0x7fbee80703a0 2023-10-08T15:41:33.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.574+0000 7fbee67fc700 1 -- 172.21.15.3:0/9526819 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbee000b950 con 0x7fbee80703a0 2023-10-08T15:41:33.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.574+0000 7fbee67fc700 1 -- 172.21.15.3:0/9526819 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee00092e0 con 0x7fbee80703a0 2023-10-08T15:41:33.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.574+0000 7fbeecb8b700 1 -- 172.21.15.3:0/9526819 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbee80703a0 msgr2=0x7fbee8146b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:33.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.574+0000 7fbeecb8b700 1 --2- 172.21.15.3:0/9526819 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbee80703a0 0x7fbee8146b70 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fbee80b1ce0 tx=0x7fbee0009840 comp rx=0 tx=0).stop 2023-10-08T15:41:33.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.574+0000 7fbeecb8b700 1 -- 172.21.15.3:0/9526819 shutdown_connections 2023-10-08T15:41:33.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.574+0000 7fbeecb8b700 1 --2- 172.21.15.3:0/9526819 >> v2:172.21.15.50:3300/0 conn(0x7fbee8070800 0x7fbee81470b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:33.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.574+0000 7fbeecb8b700 1 --2- 172.21.15.3:0/9526819 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbee80703a0 0x7fbee8146b70 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:33.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.574+0000 7fbeecb8b700 1 -- 172.21.15.3:0/9526819 >> 172.21.15.3:0/9526819 conn(0x7fbee80670e0 msgr2=0x7fbee80674e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:33.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.574+0000 7fbeecb8b700 1 -- 172.21.15.3:0/9526819 shutdown_connections 2023-10-08T15:41:33.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.574+0000 7fbeecb8b700 1 -- 172.21.15.3:0/9526819 wait complete. 2023-10-08T15:41:33.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.578+0000 7fbeecb8b700 1 Processor -- start 2023-10-08T15:41:33.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.578+0000 7fbeecb8b700 1 -- start start 2023-10-08T15:41:33.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.578+0000 7fbeecb8b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbee80703a0 0x7fbee80b2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:33.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.578+0000 7fbeecb8b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbee8070800 0x7fbee815bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:33.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.578+0000 7fbeecb8b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbee814b850 0x7fbee8142070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:33.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.578+0000 7fbeecb8b700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee81505f0 con 0x7fbee814b850 2023-10-08T15:41:33.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.578+0000 7fbeecb8b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee8150310 con 0x7fbee8070800 2023-10-08T15:41:33.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.578+0000 7fbeecb8b700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbee815c980 con 0x7fbee80703a0 2023-10-08T15:41:33.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.578+0000 7fbee7fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbee814b850 0x7fbee8142070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:33.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.578+0000 7fbee7fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbee814b850 0x7fbee8142070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45234/0 (socket says 172.21.15.3:45234) 2023-10-08T15:41:33.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.578+0000 7fbee7fff700 1 -- 172.21.15.3:0/3353326326 learned_addr learned my addr 172.21.15.3:0/3353326326 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:33.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.578+0000 7fbee6ffd700 1 --2- 172.21.15.3:0/3353326326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbee8070800 0x7fbee815bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:33.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.578+0000 7fbee77fe700 1 --2- 172.21.15.3:0/3353326326 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbee80703a0 0x7fbee80b2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:33.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.578+0000 7fbee7fff700 1 -- 172.21.15.3:0/3353326326 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbee80703a0 msgr2=0x7fbee80b2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:33.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.578+0000 7fbee7fff700 1 --2- 172.21.15.3:0/3353326326 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbee80703a0 0x7fbee80b2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:33.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.578+0000 7fbee7fff700 1 -- 172.21.15.3:0/3353326326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbee8070800 msgr2=0x7fbee815bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:33.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.578+0000 7fbee7fff700 1 --2- 172.21.15.3:0/3353326326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbee8070800 0x7fbee815bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:33.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.578+0000 7fbee7fff700 1 -- 172.21.15.3:0/3353326326 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee0009ae0 con 0x7fbee814b850 2023-10-08T15:41:33.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.578+0000 7fbee6ffd700 1 --2- 172.21.15.3:0/3353326326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbee8070800 0x7fbee815bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:33.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.578+0000 7fbee7fff700 1 --2- 172.21.15.3:0/3353326326 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbee814b850 0x7fbee8142070 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fbed800d860 tx=0x7fbed8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:33.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.582+0000 7fbedf7fe700 1 -- 172.21.15.3:0/3353326326 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed80125f0 con 0x7fbee814b850 2023-10-08T15:41:33.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.582+0000 7fbedf7fe700 1 -- 172.21.15.3:0/3353326326 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbed8012770 con 0x7fbee814b850 2023-10-08T15:41:33.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.582+0000 7fbeecb8b700 1 -- 172.21.15.3:0/3353326326 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbee80b37e0 con 0x7fbee814b850 2023-10-08T15:41:33.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.582+0000 7fbedf7fe700 1 -- 172.21.15.3:0/3353326326 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed8012b30 con 0x7fbee814b850 2023-10-08T15:41:33.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.582+0000 7fbeecb8b700 1 -- 172.21.15.3:0/3353326326 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbee8150890 con 0x7fbee814b850 2023-10-08T15:41:33.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.582+0000 7fbeecb8b700 1 -- 172.21.15.3:0/3353326326 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbee8150ab0 con 0x7fbee814b850 2023-10-08T15:41:33.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.582+0000 7fbedf7fe700 1 -- 172.21.15.3:0/3353326326 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fbed801e460 con 0x7fbee814b850 2023-10-08T15:41:33.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.582+0000 7fbedf7fe700 1 --2- 172.21.15.3:0/3353326326 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbec8060550 0x7fbec8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:33.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.582+0000 7fbedf7fe700 1 -- 172.21.15.3:0/3353326326 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbed807cda0 con 0x7fbee814b850 2023-10-08T15:41:33.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.582+0000 7fbee77fe700 1 --2- 172.21.15.3:0/3353326326 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbec8060550 0x7fbec8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:33.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.586+0000 7fbee77fe700 1 --2- 172.21.15.3:0/3353326326 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbec8060550 0x7fbec8062a00 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fbed0000f60 tx=0x7fbed0007ea0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:33.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.590+0000 7fbedf7fe700 1 -- 172.21.15.3:0/3353326326 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbed804d390 con 0x7fbee814b850 2023-10-08T15:41:33.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.786+0000 7fbeecb8b700 1 -- 172.21.15.3:0/3353326326 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbee805ecf0 con 0x7fbee814b850 2023-10-08T15:41:33.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.786+0000 7fbedf7fe700 1 -- 172.21.15.3:0/3353326326 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+3077 (secure 0 0 0) 0x7fbed80509b0 con 0x7fbee814b850 2023-10-08T15:41:33.792 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:41:33.792 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":27,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5674,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/688778262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":688778262},{"type":"v1","addr":"172.21.15.50:6835","nonce":688778262}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:41:06.132475+0000","modified":"2023-10-08T15:41:09.450447+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5685},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5685":{"gid":5685,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.3:6833/3789195831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":3789195831},{"type":"v1","addr":"172.21.15.3:6833","nonce":3789195831}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-08T15:41:33.794 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.790+0000 7fbeecb8b700 1 -- 172.21.15.3:0/3353326326 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbec8060550 msgr2=0x7fbec8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:33.795 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.790+0000 7fbeecb8b700 1 --2- 172.21.15.3:0/3353326326 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbec8060550 0x7fbec8062a00 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fbed0000f60 tx=0x7fbed0007ea0 comp rx=0 tx=0).stop 2023-10-08T15:41:33.795 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.790+0000 7fbeecb8b700 1 -- 172.21.15.3:0/3353326326 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbee814b850 msgr2=0x7fbee8142070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:33.795 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.790+0000 7fbeecb8b700 1 --2- 172.21.15.3:0/3353326326 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbee814b850 0x7fbee8142070 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fbed800d860 tx=0x7fbed8008040 comp rx=0 tx=0).stop 2023-10-08T15:41:33.795 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.790+0000 7fbeecb8b700 1 -- 172.21.15.3:0/3353326326 shutdown_connections 2023-10-08T15:41:33.795 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.790+0000 7fbeecb8b700 1 --2- 172.21.15.3:0/3353326326 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbec8060550 0x7fbec8062a00 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:33.795 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.790+0000 7fbeecb8b700 1 --2- 172.21.15.3:0/3353326326 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbee814b850 0x7fbee8142070 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:33.795 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.790+0000 7fbeecb8b700 1 --2- 172.21.15.3:0/3353326326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbee8070800 0x7fbee815bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:33.795 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.790+0000 7fbeecb8b700 1 --2- 172.21.15.3:0/3353326326 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbee80703a0 0x7fbee80b2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:33.795 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.790+0000 7fbeecb8b700 1 -- 172.21.15.3:0/3353326326 >> 172.21.15.3:0/3353326326 conn(0x7fbee80670e0 msgr2=0x7fbee814af80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:33.795 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.790+0000 7fbeecb8b700 1 -- 172.21.15.3:0/3353326326 shutdown_connections 2023-10-08T15:41:33.795 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.790+0000 7fbeecb8b700 1 -- 172.21.15.3:0/3353326326 wait complete. 2023-10-08T15:41:33.796 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 27 2023-10-08T15:41:33.806 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:41:33.912 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.906+0000 7f84effff700 1 Processor -- start 2023-10-08T15:41:33.912 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.906+0000 7f84effff700 1 -- start start 2023-10-08T15:41:33.913 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.910+0000 7f84effff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f84f00a15e0 0x7f84f014eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:33.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.910+0000 7f84effff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f84f0068630 0x7f84f014f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:33.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.910+0000 7f84effff700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84f0069850 con 0x7f84f006cf10 2023-10-08T15:41:33.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.910+0000 7f84effff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84f014c7d0 con 0x7f84f00a15e0 2023-10-08T15:41:33.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.910+0000 7f84effff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84f0068e30 con 0x7f84f0068630 2023-10-08T15:41:33.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.910+0000 7f84ef7fe700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f84f006cf10 0x7f84f014a5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:55302/0 (socket says 172.21.15.3:55302) 2023-10-08T15:41:33.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.910+0000 7f84ef7fe700 1 -- 172.21.15.3:0/3068656326 learned_addr learned my addr 172.21.15.3:0/3068656326 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:41:33.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.910+0000 7f84ee7fc700 1 --2- 172.21.15.3:0/3068656326 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f84f0068630 0x7f84f014f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:33.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.910+0000 7f84eeffd700 1 --2- 172.21.15.3:0/3068656326 >> v2:172.21.15.50:3300/0 conn(0x7f84f00a15e0 0x7f84f014eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:33.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.910+0000 7f84edffb700 1 -- 172.21.15.3:0/3068656326 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1021355310 0 0) 0x7f84f0069850 con 0x7f84f006cf10 2023-10-08T15:41:33.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.910+0000 7f84edffb700 1 -- 172.21.15.3:0/3068656326 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84d8003570 con 0x7f84f006cf10 2023-10-08T15:41:33.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.910+0000 7f84ee7fc700 1 -- 172.21.15.3:0/3068656326 >> v2:172.21.15.50:3300/0 conn(0x7f84f00a15e0 msgr2=0x7f84f014eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:33.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.910+0000 7f84ee7fc700 1 --2- 172.21.15.3:0/3068656326 >> v2:172.21.15.50:3300/0 conn(0x7f84f00a15e0 0x7f84f014eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:33.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.910+0000 7f84edffb700 1 -- 172.21.15.3:0/3068656326 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4161873227 0 0) 0x7f84d8003570 con 0x7f84f006cf10 2023-10-08T15:41:33.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.910+0000 7f84ee7fc700 1 -- 172.21.15.3:0/3068656326 >> v1:172.21.15.3:6789/0 conn(0x7f84f006cf10 legacy=0x7f84f014a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:33.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.910+0000 7f84ee7fc700 1 -- 172.21.15.3:0/3068656326 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f006e830 con 0x7f84f0068630 2023-10-08T15:41:33.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.910+0000 7f84ee7fc700 1 --2- 172.21.15.3:0/3068656326 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f84f0068630 0x7f84f014f0a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f84e00098e0 tx=0x7f84e00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9756d1d72cb1293 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:33.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.910+0000 7f84edffb700 1 -- 172.21.15.3:0/3068656326 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e80017f0 con 0x7f84f0068630 2023-10-08T15:41:33.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.910+0000 7f84edffb700 1 -- 172.21.15.3:0/3068656326 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e0011420 con 0x7f84f0068630 2023-10-08T15:41:33.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.910+0000 7f84edffb700 1 -- 172.21.15.3:0/3068656326 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e00117a0 con 0x7f84f0068630 2023-10-08T15:41:33.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.910+0000 7f84effff700 1 -- 172.21.15.3:0/3068656326 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f84f0068630 msgr2=0x7f84f014f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:33.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.910+0000 7f84effff700 1 --2- 172.21.15.3:0/3068656326 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f84f0068630 0x7f84f014f0a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f84e00098e0 tx=0x7f84e00091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:33.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.910+0000 7f84effff700 1 -- 172.21.15.3:0/3068656326 shutdown_connections 2023-10-08T15:41:33.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.910+0000 7f84effff700 1 --2- 172.21.15.3:0/3068656326 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f84f0068630 0x7f84f014f0a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:33.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.910+0000 7f84effff700 1 --2- 172.21.15.3:0/3068656326 >> v2:172.21.15.50:3300/0 conn(0x7f84f00a15e0 0x7f84f014eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:33.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.910+0000 7f84effff700 1 -- 172.21.15.3:0/3068656326 >> 172.21.15.3:0/3068656326 conn(0x7f84f00670e0 msgr2=0x7f84f00674e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:33.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.910+0000 7f84effff700 1 -- 172.21.15.3:0/3068656326 shutdown_connections 2023-10-08T15:41:33.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.910+0000 7f84effff700 1 -- 172.21.15.3:0/3068656326 wait complete. 2023-10-08T15:41:33.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.914+0000 7f84effff700 1 Processor -- start 2023-10-08T15:41:33.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.914+0000 7f84effff700 1 -- start start 2023-10-08T15:41:33.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.914+0000 7f84effff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84f0068630 0x7f84f00b8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:33.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.914+0000 7f84effff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f84f006cf10 0x7f84f00b7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:33.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.914+0000 7f84effff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f84f00a15e0 0x7f84f01473a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:33.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.914+0000 7f84effff700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f015b9a0 con 0x7f84f006cf10 2023-10-08T15:41:33.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.914+0000 7f84effff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f00b6510 con 0x7f84f0068630 2023-10-08T15:41:33.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.914+0000 7f84effff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84f00b8b50 con 0x7f84f00a15e0 2023-10-08T15:41:33.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.914+0000 7f84ee7fc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f84f006cf10 0x7f84f00b7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:33.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.914+0000 7f84ee7fc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f84f006cf10 0x7f84f00b7060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45240/0 (socket says 172.21.15.3:45240) 2023-10-08T15:41:33.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.914+0000 7f84ee7fc700 1 -- 172.21.15.3:0/2962292605 learned_addr learned my addr 172.21.15.3:0/2962292605 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:33.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.914+0000 7f84ef7fe700 1 --2- 172.21.15.3:0/2962292605 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f84f00a15e0 0x7f84f01473a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:33.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.914+0000 7f84eeffd700 1 --2- 172.21.15.3:0/2962292605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84f0068630 0x7f84f00b8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:33.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.914+0000 7f84ee7fc700 1 -- 172.21.15.3:0/2962292605 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f84f00a15e0 msgr2=0x7f84f01473a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:33.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.914+0000 7f84ee7fc700 1 --2- 172.21.15.3:0/2962292605 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f84f00a15e0 0x7f84f01473a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:33.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.914+0000 7f84ee7fc700 1 -- 172.21.15.3:0/2962292605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84f0068630 msgr2=0x7f84f00b8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:33.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.914+0000 7f84ee7fc700 1 --2- 172.21.15.3:0/2962292605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84f0068630 0x7f84f00b8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:33.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.914+0000 7f84ee7fc700 1 -- 172.21.15.3:0/2962292605 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e0009420 con 0x7f84f006cf10 2023-10-08T15:41:33.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.914+0000 7f84ee7fc700 1 --2- 172.21.15.3:0/2962292605 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f84f006cf10 0x7f84f00b7060 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f84f0068f70 tx=0x7f84e0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:33.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.914+0000 7f84d6ffd700 1 -- 172.21.15.3:0/2962292605 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e001caf0 con 0x7f84f006cf10 2023-10-08T15:41:33.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.914+0000 7f84d6ffd700 1 -- 172.21.15.3:0/2962292605 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e001cc70 con 0x7f84f006cf10 2023-10-08T15:41:33.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.914+0000 7f84effff700 1 -- 172.21.15.3:0/2962292605 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84f00b8e30 con 0x7f84f006cf10 2023-10-08T15:41:33.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.914+0000 7f84d6ffd700 1 -- 172.21.15.3:0/2962292605 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e001a450 con 0x7f84f006cf10 2023-10-08T15:41:33.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.914+0000 7f84effff700 1 -- 172.21.15.3:0/2962292605 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84f015bea0 con 0x7f84f006cf10 2023-10-08T15:41:33.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.918+0000 7f84effff700 1 -- 172.21.15.3:0/2962292605 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84f00b89b0 con 0x7f84f006cf10 2023-10-08T15:41:33.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.918+0000 7f84d6ffd700 1 -- 172.21.15.3:0/2962292605 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f84e001a820 con 0x7f84f006cf10 2023-10-08T15:41:33.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.918+0000 7f84d6ffd700 1 --2- 172.21.15.3:0/2962292605 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f84dc060550 0x7f84dc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:33.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.918+0000 7f84d6ffd700 1 -- 172.21.15.3:0/2962292605 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f84e007e3b0 con 0x7f84f006cf10 2023-10-08T15:41:33.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.918+0000 7f84eeffd700 1 --2- 172.21.15.3:0/2962292605 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f84dc060550 0x7f84dc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:33.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.922+0000 7f84eeffd700 1 --2- 172.21.15.3:0/2962292605 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f84dc060550 0x7f84dc062a00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f84e4009d10 tx=0x7f84e40091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:33.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:33.930+0000 7f84d6ffd700 1 -- 172.21.15.3:0/2962292605 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f84f00b89b0 con 0x7f84f006cf10 2023-10-08T15:41:34.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.090+0000 7f84effff700 1 -- 172.21.15.3:0/2962292605 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f84f015bbc0 con 0x7f84f006cf10 2023-10-08T15:41:34.098 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.094+0000 7f84d6ffd700 1 -- 172.21.15.3:0/2962292605 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+15254 (secure 0 0 0) 0x7f84f015bbc0 con 0x7f84f006cf10 2023-10-08T15:41:34.099 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:41:34.099 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":49,"fsid":"7635972e-cd66-4a8f-a231-378db8b3847a","created":"2023-10-08T15:37:08.234594+0000","modified":"2023-10-08T15:41:07.416834+0000","last_up_change":"2023-10-08T15:37:17.537726+0000","last_in_change":"2023-10-08T15:37:10.269178+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:37:16.581590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:41:04.003380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-08T15:41:04.755627+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"64fb1864-bfdd-4d75-9b41-03fb60085dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33363},{"type":"v1","addr":"172.21.15.3:6801","nonce":33363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33363},{"type":"v1","addr":"172.21.15.3:6803","nonce":33363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":33363},{"type":"v1","addr":"172.21.15.3:6807","nonce":33363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33363},{"type":"v1","addr":"172.21.15.3:6805","nonce":33363}]},"public_addr":"172.21.15.3:6801/33363","cluster_addr":"172.21.15.3:6803/33363","heartbeat_back_addr":"172.21.15.3:6807/33363","heartbeat_front_addr":"172.21.15.3:6805/33363","state":["exists","up"]},{"osd":1,"uuid":"3ca6bd3a-3e8a-4c65-af9c-46148b0c2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33364},{"type":"v1","addr":"172.21.15.3:6820","nonce":33364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33364},{"type":"v1","addr":"172.21.15.3:6824","nonce":33364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33364},{"type":"v1","addr":"172.21.15.3:6831","nonce":33364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33364},{"type":"v1","addr":"172.21.15.3:6828","nonce":33364}]},"public_addr":"172.21.15.3:6820/33364","cluster_addr":"172.21.15.3:6824/33364","heartbeat_back_addr":"172.21.15.3:6831/33364","heartbeat_front_addr":"172.21.15.3:6828/33364","state":["exists","up"]},{"osd":2,"uuid":"6eb9f757-58dd-442f-910d-32401454bce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33366},{"type":"v1","addr":"172.21.15.3:6817","nonce":33366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":33366},{"type":"v1","addr":"172.21.15.3:6821","nonce":33366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6827","nonce":33366},{"type":"v1","addr":"172.21.15.3:6829","nonce":33366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":33366},{"type":"v1","addr":"172.21.15.3:6825","nonce":33366}]},"public_addr":"172.21.15.3:6817/33366","cluster_addr":"172.21.15.3:6821/33366","heartbeat_back_addr":"172.21.15.3:6829/33366","heartbeat_front_addr":"172.21.15.3:6825/33366","state":["exists","up"]},{"osd":3,"uuid":"1c39866b-ac2e-4ea9-a69c-02b01ee4191d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33365},{"type":"v1","addr":"172.21.15.3:6809","nonce":33365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":33365},{"type":"v1","addr":"172.21.15.3:6811","nonce":33365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33365},{"type":"v1","addr":"172.21.15.3:6815","nonce":33365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":33365},{"type":"v1","addr":"172.21.15.3:6813","nonce":33365}]},"public_addr":"172.21.15.3:6809/33365","cluster_addr":"172.21.15.3:6811/33365","heartbeat_back_addr":"172.21.15.3:6815/33365","heartbeat_front_addr":"172.21.15.3:6813/33365","state":["exists","up"]},{"osd":4,"uuid":"15f86b61-b7f1-4780-ae00-9d80a68cb830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":33605},{"type":"v1","addr":"172.21.15.50:6809","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33605},{"type":"v1","addr":"172.21.15.50:6811","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33605},{"type":"v1","addr":"172.21.15.50:6815","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":33605},{"type":"v1","addr":"172.21.15.50:6813","nonce":33605}]},"public_addr":"172.21.15.50:6809/33605","cluster_addr":"172.21.15.50:6811/33605","heartbeat_back_addr":"172.21.15.50:6815/33605","heartbeat_front_addr":"172.21.15.50:6813/33605","state":["exists","up"]},{"osd":5,"uuid":"726c3003-34e6-4d5a-b6e2-f911e13c2118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33606},{"type":"v1","addr":"172.21.15.50:6801","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33606},{"type":"v1","addr":"172.21.15.50:6803","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33606},{"type":"v1","addr":"172.21.15.50:6807","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":33606},{"type":"v1","addr":"172.21.15.50:6805","nonce":33606}]},"public_addr":"172.21.15.50:6801/33606","cluster_addr":"172.21.15.50:6803/33606","heartbeat_back_addr":"172.21.15.50:6807/33606","heartbeat_front_addr":"172.21.15.50:6805/33606","state":["exists","up"]},{"osd":6,"uuid":"401122a4-9988-441f-a5a7-39164434ebcd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":33607},{"type":"v1","addr":"172.21.15.50:6819","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":33607},{"type":"v1","addr":"172.21.15.50:6823","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":33607},{"type":"v1","addr":"172.21.15.50:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":33607},{"type":"v1","addr":"172.21.15.50:6827","nonce":33607}]},"public_addr":"172.21.15.50:6819/33607","cluster_addr":"172.21.15.50:6823/33607","heartbeat_back_addr":"172.21.15.50:6831/33607","heartbeat_front_addr":"172.21.15.50:6827/33607","state":["exists","up"]},{"osd":7,"uuid":"6b3fa236-c9d0-4c4d-82ae-9af4daf6d699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33604},{"type":"v1","addr":"172.21.15.50:6818","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":33604},{"type":"v1","addr":"172.21.15.50:6822","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":33604},{"type":"v1","addr":"172.21.15.50:6830","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":33604},{"type":"v1","addr":"172.21.15.50:6826","nonce":33604}]},"public_addr":"172.21.15.50:6818/33604","cluster_addr":"172.21.15.50:6822/33604","heartbeat_back_addr":"172.21.15.50:6830/33604","heartbeat_front_addr":"172.21.15.50:6826/33604","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.497794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.529417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.873426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.325972+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.443971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.240795+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.739632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.643026+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:41:34.101 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.094+0000 7f84effff700 1 -- 172.21.15.3:0/2962292605 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f84dc060550 msgr2=0x7f84dc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:34.101 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.094+0000 7f84effff700 1 --2- 172.21.15.3:0/2962292605 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f84dc060550 0x7f84dc062a00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f84e4009d10 tx=0x7f84e40091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:34.101 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.094+0000 7f84effff700 1 -- 172.21.15.3:0/2962292605 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f84f006cf10 msgr2=0x7f84f00b7060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:34.102 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.094+0000 7f84effff700 1 --2- 172.21.15.3:0/2962292605 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f84f006cf10 0x7f84f00b7060 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f84f0068f70 tx=0x7f84e0016000 comp rx=0 tx=0).stop 2023-10-08T15:41:34.102 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.094+0000 7f84effff700 1 -- 172.21.15.3:0/2962292605 shutdown_connections 2023-10-08T15:41:34.102 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.094+0000 7f84effff700 1 --2- 172.21.15.3:0/2962292605 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f84dc060550 0x7f84dc062a00 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:34.102 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.094+0000 7f84effff700 1 --2- 172.21.15.3:0/2962292605 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f84f00a15e0 0x7f84f01473a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:34.102 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.094+0000 7f84effff700 1 --2- 172.21.15.3:0/2962292605 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f84f006cf10 0x7f84f00b7060 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:34.102 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.098+0000 7f84effff700 1 --2- 172.21.15.3:0/2962292605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84f0068630 0x7f84f00b8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:34.102 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.098+0000 7f84effff700 1 -- 172.21.15.3:0/2962292605 >> 172.21.15.3:0/2962292605 conn(0x7f84f00670e0 msgr2=0x7f84f006c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:34.102 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.098+0000 7f84effff700 1 -- 172.21.15.3:0/2962292605 shutdown_connections 2023-10-08T15:41:34.102 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.098+0000 7f84effff700 1 -- 172.21.15.3:0/2962292605 wait complete. 2023-10-08T15:41:34.114 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T15:41:34.114 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:41:34.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.218+0000 7fb6659e7700 1 Processor -- start 2023-10-08T15:41:34.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.218+0000 7fb6659e7700 1 -- start start 2023-10-08T15:41:34.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.222+0000 7fb6659e7700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb6600bce50 0x7fb660147d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:34.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.222+0000 7fb6659e7700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb66006cf60 0x7fb660148250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:34.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.222+0000 7fb6659e7700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb66014bde0 con 0x7fb6600bca80 2023-10-08T15:41:34.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.222+0000 7fb6659e7700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb66014b920 con 0x7fb66006cf60 2023-10-08T15:41:34.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.222+0000 7fb6659e7700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb66006d6f0 con 0x7fb6600bce50 2023-10-08T15:41:34.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.222+0000 7fb6649e5700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fb6600bca80 0x7fb6600b2340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:55314/0 (socket says 172.21.15.3:55314) 2023-10-08T15:41:34.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.222+0000 7fb6649e5700 1 -- 172.21.15.3:0/230124358 learned_addr learned my addr 172.21.15.3:0/230124358 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:41:34.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.222+0000 7fb65ffff700 1 --2- 172.21.15.3:0/230124358 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb6600bce50 0x7fb660147d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:34.226 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.222+0000 7fb6651e6700 1 --2- 172.21.15.3:0/230124358 >> v2:172.21.15.50:3300/0 conn(0x7fb66006cf60 0x7fb660148250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:34.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.222+0000 7fb65f7fe700 1 -- 172.21.15.3:0/230124358 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2123640964 0 0) 0x7fb66014bde0 con 0x7fb6600bca80 2023-10-08T15:41:34.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.222+0000 7fb65f7fe700 1 -- 172.21.15.3:0/230124358 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb648003570 con 0x7fb6600bca80 2023-10-08T15:41:34.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.222+0000 7fb65ffff700 1 -- 172.21.15.3:0/230124358 >> v2:172.21.15.50:3300/0 conn(0x7fb66006cf60 msgr2=0x7fb660148250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:34.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.222+0000 7fb65ffff700 1 --2- 172.21.15.3:0/230124358 >> v2:172.21.15.50:3300/0 conn(0x7fb66006cf60 0x7fb660148250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:34.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.222+0000 7fb65ffff700 1 -- 172.21.15.3:0/230124358 >> v1:172.21.15.3:6789/0 conn(0x7fb6600bca80 legacy=0x7fb6600b2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:34.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.222+0000 7fb65f7fe700 1 -- 172.21.15.3:0/230124358 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 766148796 0 0) 0x7fb648003570 con 0x7fb6600bca80 2023-10-08T15:41:34.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.222+0000 7fb65ffff700 1 -- 172.21.15.3:0/230124358 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb66014bb00 con 0x7fb6600bce50 2023-10-08T15:41:34.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.222+0000 7fb65ffff700 1 --2- 172.21.15.3:0/230124358 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb6600bce50 0x7fb660147d10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb650009e60 tx=0x7fb650009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b54dd6b4bd61767c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:34.228 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.222+0000 7fb65f7fe700 1 -- 172.21.15.3:0/230124358 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65000e070 con 0x7fb6600bce50 2023-10-08T15:41:34.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.222+0000 7fb65f7fe700 1 -- 172.21.15.3:0/230124358 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb65000b7a0 con 0x7fb6600bce50 2023-10-08T15:41:34.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.222+0000 7fb65f7fe700 1 -- 172.21.15.3:0/230124358 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb654001470 con 0x7fb6600bce50 2023-10-08T15:41:34.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.222+0000 7fb6659e7700 1 -- 172.21.15.3:0/230124358 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb6600bce50 msgr2=0x7fb660147d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:34.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.222+0000 7fb6659e7700 1 --2- 172.21.15.3:0/230124358 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb6600bce50 0x7fb660147d10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb650009e60 tx=0x7fb650009780 comp rx=0 tx=0).stop 2023-10-08T15:41:34.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.222+0000 7fb6659e7700 1 -- 172.21.15.3:0/230124358 shutdown_connections 2023-10-08T15:41:34.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.222+0000 7fb6659e7700 1 --2- 172.21.15.3:0/230124358 >> v2:172.21.15.50:3300/0 conn(0x7fb66006cf60 0x7fb660148250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:34.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.222+0000 7fb6659e7700 1 --2- 172.21.15.3:0/230124358 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb6600bce50 0x7fb660147d10 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:34.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.222+0000 7fb6659e7700 1 -- 172.21.15.3:0/230124358 >> 172.21.15.3:0/230124358 conn(0x7fb6600be4a0 msgr2=0x7fb6600ba440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:34.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.222+0000 7fb6659e7700 1 -- 172.21.15.3:0/230124358 shutdown_connections 2023-10-08T15:41:34.229 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.222+0000 7fb6659e7700 1 -- 172.21.15.3:0/230124358 wait complete. 2023-10-08T15:41:34.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.226+0000 7fb6659e7700 1 Processor -- start 2023-10-08T15:41:34.230 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.226+0000 7fb6659e7700 1 -- start start 2023-10-08T15:41:34.231 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.226+0000 7fb6659e7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb66006cf60 0x7fb66015e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:34.231 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.226+0000 7fb6659e7700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb6600bca80 0x7fb660150ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:34.231 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.226+0000 7fb6659e7700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb6600bce50 0x7fb6601425b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:34.231 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.226+0000 7fb6659e7700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb660142120 con 0x7fb6600bca80 2023-10-08T15:41:34.231 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.226+0000 7fb6659e7700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb66013d790 con 0x7fb66006cf60 2023-10-08T15:41:34.231 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.226+0000 7fb6659e7700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6600b8d30 con 0x7fb6600bce50 2023-10-08T15:41:34.231 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.226+0000 7fb65ffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb6600bca80 0x7fb660150ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:34.232 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.226+0000 7fb65ffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb6600bca80 0x7fb660150ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45256/0 (socket says 172.21.15.3:45256) 2023-10-08T15:41:34.232 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.226+0000 7fb65ffff700 1 -- 172.21.15.3:0/1918752080 learned_addr learned my addr 172.21.15.3:0/1918752080 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:34.232 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.226+0000 7fb6651e6700 1 --2- 172.21.15.3:0/1918752080 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb6600bce50 0x7fb6601425b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:34.232 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.226+0000 7fb6649e5700 1 --2- 172.21.15.3:0/1918752080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb66006cf60 0x7fb66015e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:34.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.226+0000 7fb65ffff700 1 -- 172.21.15.3:0/1918752080 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb6600bce50 msgr2=0x7fb6601425b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:34.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.226+0000 7fb65ffff700 1 --2- 172.21.15.3:0/1918752080 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb6600bce50 0x7fb6601425b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:34.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.226+0000 7fb65ffff700 1 -- 172.21.15.3:0/1918752080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb66006cf60 msgr2=0x7fb66015e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:34.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.226+0000 7fb65ffff700 1 --2- 172.21.15.3:0/1918752080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb66006cf60 0x7fb66015e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:34.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.226+0000 7fb65ffff700 1 -- 172.21.15.3:0/1918752080 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb650009a20 con 0x7fb6600bca80 2023-10-08T15:41:34.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.226+0000 7fb65ffff700 1 --2- 172.21.15.3:0/1918752080 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb6600bca80 0x7fb660150ff0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fb650003000 tx=0x7fb650018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:34.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.226+0000 7fb65cff9700 1 -- 172.21.15.3:0/1918752080 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65000be80 con 0x7fb6600bca80 2023-10-08T15:41:34.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.226+0000 7fb65cff9700 1 -- 172.21.15.3:0/1918752080 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb650021070 con 0x7fb6600bca80 2023-10-08T15:41:34.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.226+0000 7fb6659e7700 1 -- 172.21.15.3:0/1918752080 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6600b8a50 con 0x7fb6600bca80 2023-10-08T15:41:34.234 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.226+0000 7fb65cff9700 1 -- 172.21.15.3:0/1918752080 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb650012b30 con 0x7fb6600bca80 2023-10-08T15:41:34.234 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.226+0000 7fb6659e7700 1 -- 172.21.15.3:0/1918752080 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb660151530 con 0x7fb6600bca80 2023-10-08T15:41:34.234 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.226+0000 7fb6659e7700 1 -- 172.21.15.3:0/1918752080 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb66005ecf0 con 0x7fb6600bca80 2023-10-08T15:41:34.234 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.230+0000 7fb65cff9700 1 -- 172.21.15.3:0/1918752080 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb650023030 con 0x7fb6600bca80 2023-10-08T15:41:34.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.230+0000 7fb65cff9700 1 --2- 172.21.15.3:0/1918752080 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb64c060550 0x7fb64c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:34.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.230+0000 7fb65cff9700 1 -- 172.21.15.3:0/1918752080 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb65007e9a0 con 0x7fb6600bca80 2023-10-08T15:41:34.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.230+0000 7fb6649e5700 1 --2- 172.21.15.3:0/1918752080 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb64c060550 0x7fb64c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:34.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.230+0000 7fb6649e5700 1 --2- 172.21.15.3:0/1918752080 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb64c060550 0x7fb64c062a00 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb654004e60 tx=0x7fb654001a10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:34.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.234+0000 7fb65cff9700 1 -- 172.21.15.3:0/1918752080 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb65004f010 con 0x7fb6600bca80 2023-10-08T15:41:34.435 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.430+0000 7fb6659e7700 1 -- 172.21.15.3:0/1918752080 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb66006d8d0 con 0x7fb6600bca80 2023-10-08T15:41:34.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.430+0000 7fb65cff9700 1 -- 172.21.15.3:0/1918752080 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+3077 (secure 0 0 0) 0x7fb650052630 con 0x7fb6600bca80 2023-10-08T15:41:34.436 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:41:34.437 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":27,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5674,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/688778262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":688778262},{"type":"v1","addr":"172.21.15.50:6835","nonce":688778262}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:41:06.132475+0000","modified":"2023-10-08T15:41:09.450447+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5685},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5685":{"gid":5685,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.3:6833/3789195831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":3789195831},{"type":"v1","addr":"172.21.15.3:6833","nonce":3789195831}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-08T15:41:34.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.434+0000 7fb6659e7700 1 -- 172.21.15.3:0/1918752080 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb64c060550 msgr2=0x7fb64c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:34.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.434+0000 7fb6659e7700 1 --2- 172.21.15.3:0/1918752080 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb64c060550 0x7fb64c062a00 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb654004e60 tx=0x7fb654001a10 comp rx=0 tx=0).stop 2023-10-08T15:41:34.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.434+0000 7fb6659e7700 1 -- 172.21.15.3:0/1918752080 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb6600bca80 msgr2=0x7fb660150ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:34.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.434+0000 7fb6659e7700 1 --2- 172.21.15.3:0/1918752080 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb6600bca80 0x7fb660150ff0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fb650003000 tx=0x7fb650018000 comp rx=0 tx=0).stop 2023-10-08T15:41:34.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.434+0000 7fb6659e7700 1 -- 172.21.15.3:0/1918752080 shutdown_connections 2023-10-08T15:41:34.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.434+0000 7fb6659e7700 1 --2- 172.21.15.3:0/1918752080 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb64c060550 0x7fb64c062a00 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:34.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.434+0000 7fb6659e7700 1 --2- 172.21.15.3:0/1918752080 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb6600bce50 0x7fb6601425b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:34.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.434+0000 7fb6659e7700 1 --2- 172.21.15.3:0/1918752080 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb6600bca80 0x7fb660150ff0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:34.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.434+0000 7fb6659e7700 1 --2- 172.21.15.3:0/1918752080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb66006cf60 0x7fb66015e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:34.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.434+0000 7fb6659e7700 1 -- 172.21.15.3:0/1918752080 >> 172.21.15.3:0/1918752080 conn(0x7fb6600be4a0 msgr2=0x7fb6600b1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:34.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.434+0000 7fb6659e7700 1 -- 172.21.15.3:0/1918752080 shutdown_connections 2023-10-08T15:41:34.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.434+0000 7fb6659e7700 1 -- 172.21.15.3:0/1918752080 wait complete. 2023-10-08T15:41:34.440 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 27 2023-10-08T15:41:34.451 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:41:34.555 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.550+0000 7fa7810a1700 1 Processor -- start 2023-10-08T15:41:34.555 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.550+0000 7fa7810a1700 1 -- start start 2023-10-08T15:41:34.555 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.550+0000 7fa7810a1700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa77c06be60 0x7fa77c14b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:34.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.550+0000 7fa7810a1700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fa77c06cc40 0x7fa77c14cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:34.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.550+0000 7fa7810a1700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa77c14c6b0 con 0x7fa77c14ac50 2023-10-08T15:41:34.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.550+0000 7fa7810a1700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa77c14c060 con 0x7fa77c06cc40 2023-10-08T15:41:34.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.550+0000 7fa7810a1700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa77c14c340 con 0x7fa77c06be60 2023-10-08T15:41:34.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.550+0000 7fa7808a0700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fa77c06cc40 0x7fa77c14cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:34.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.550+0000 7fa7808a0700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fa77c06cc40 0x7fa77c14cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45266/0 (socket says 172.21.15.3:45266) 2023-10-08T15:41:34.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.550+0000 7fa7808a0700 1 -- 172.21.15.3:0/3288635248 learned_addr learned my addr 172.21.15.3:0/3288635248 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:34.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.550+0000 7fa77b7fe700 1 --2- 172.21.15.3:0/3288635248 >> v2:172.21.15.50:3300/0 conn(0x7fa77c06be60 0x7fa77c14b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:34.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.550+0000 7fa7808a0700 1 -- 172.21.15.3:0/3288635248 >> v2:172.21.15.50:3300/0 conn(0x7fa77c06be60 msgr2=0x7fa77c14b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:34.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.550+0000 7fa7808a0700 1 --2- 172.21.15.3:0/3288635248 >> v2:172.21.15.50:3300/0 conn(0x7fa77c06be60 0x7fa77c14b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:34.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.550+0000 7fa77affd700 1 -- 172.21.15.3:0/3288635248 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3917290957 0 0) 0x7fa77c14c6b0 con 0x7fa77c14ac50 2023-10-08T15:41:34.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.550+0000 7fa7808a0700 1 -- 172.21.15.3:0/3288635248 >> v1:172.21.15.50:6789/0 conn(0x7fa77c14ac50 legacy=0x7fa77c06c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:34.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.550+0000 7fa7808a0700 1 -- 172.21.15.3:0/3288635248 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa77c14e860 con 0x7fa77c06cc40 2023-10-08T15:41:34.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.550+0000 7fa7808a0700 1 --2- 172.21.15.3:0/3288635248 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa77c06cc40 0x7fa77c14cc40 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fa77c064280 tx=0x7fa764009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94734e506a6a3896 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:34.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.550+0000 7fa77affd700 1 -- 172.21.15.3:0/3288635248 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa764009e70 con 0x7fa77c06cc40 2023-10-08T15:41:34.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.550+0000 7fa77affd700 1 -- 172.21.15.3:0/3288635248 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa76400b860 con 0x7fa77c06cc40 2023-10-08T15:41:34.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.550+0000 7fa77affd700 1 -- 172.21.15.3:0/3288635248 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76400bc00 con 0x7fa77c06cc40 2023-10-08T15:41:34.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.554+0000 7fa7810a1700 1 -- 172.21.15.3:0/3288635248 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa77c06cc40 msgr2=0x7fa77c14cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:34.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.554+0000 7fa7810a1700 1 --2- 172.21.15.3:0/3288635248 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa77c06cc40 0x7fa77c14cc40 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fa77c064280 tx=0x7fa764009250 comp rx=0 tx=0).stop 2023-10-08T15:41:34.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.554+0000 7fa7810a1700 1 -- 172.21.15.3:0/3288635248 shutdown_connections 2023-10-08T15:41:34.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.554+0000 7fa7810a1700 1 --2- 172.21.15.3:0/3288635248 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa77c06cc40 0x7fa77c14cc40 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:34.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.554+0000 7fa7810a1700 1 --2- 172.21.15.3:0/3288635248 >> v2:172.21.15.50:3300/0 conn(0x7fa77c06be60 0x7fa77c14b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:34.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.554+0000 7fa7810a1700 1 -- 172.21.15.3:0/3288635248 >> 172.21.15.3:0/3288635248 conn(0x7fa77c0c1df0 msgr2=0x7fa77c0c21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:34.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.554+0000 7fa7810a1700 1 -- 172.21.15.3:0/3288635248 shutdown_connections 2023-10-08T15:41:34.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.554+0000 7fa7810a1700 1 -- 172.21.15.3:0/3288635248 wait complete. 2023-10-08T15:41:34.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.554+0000 7fa7810a1700 1 Processor -- start 2023-10-08T15:41:34.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.554+0000 7fa7810a1700 1 -- start start 2023-10-08T15:41:34.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.558+0000 7fa7810a1700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa77c06be60 0x7fa77c148180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:34.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.558+0000 7fa7810a1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa77c06cc40 0x7fa77c14cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:34.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.558+0000 7fa7810a1700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa77c14ac50 0x7fa77c14d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:34.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.558+0000 7fa7810a1700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa77c09c700 con 0x7fa77c06be60 2023-10-08T15:41:34.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.558+0000 7fa7810a1700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa77c1486c0 con 0x7fa77c06cc40 2023-10-08T15:41:34.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.558+0000 7fa7810a1700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa77c09c390 con 0x7fa77c14ac50 2023-10-08T15:41:34.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.558+0000 7fa77bfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa77c06be60 0x7fa77c148180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:34.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.558+0000 7fa77bfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa77c06be60 0x7fa77c148180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45282/0 (socket says 172.21.15.3:45282) 2023-10-08T15:41:34.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.558+0000 7fa77bfff700 1 -- 172.21.15.3:0/4037627977 learned_addr learned my addr 172.21.15.3:0/4037627977 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:34.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.558+0000 7fa77b7fe700 1 --2- 172.21.15.3:0/4037627977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa77c06cc40 0x7fa77c14cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:34.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.558+0000 7fa7808a0700 1 --2- 172.21.15.3:0/4037627977 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa77c14ac50 0x7fa77c14d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:34.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.558+0000 7fa77bfff700 1 -- 172.21.15.3:0/4037627977 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa77c14ac50 msgr2=0x7fa77c14d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:34.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.558+0000 7fa77bfff700 1 --2- 172.21.15.3:0/4037627977 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa77c14ac50 0x7fa77c14d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:34.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.558+0000 7fa77bfff700 1 -- 172.21.15.3:0/4037627977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa77c06cc40 msgr2=0x7fa77c14cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:34.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.558+0000 7fa77bfff700 1 --2- 172.21.15.3:0/4037627977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa77c06cc40 0x7fa77c14cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:34.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.558+0000 7fa77bfff700 1 -- 172.21.15.3:0/4037627977 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7640094f0 con 0x7fa77c06be60 2023-10-08T15:41:34.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.558+0000 7fa77b7fe700 1 --2- 172.21.15.3:0/4037627977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa77c06cc40 0x7fa77c14cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:34.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.558+0000 7fa77bfff700 1 --2- 172.21.15.3:0/4037627977 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa77c06be60 0x7fa77c148180 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fa77400c910 tx=0x7fa774001700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:34.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.558+0000 7fa773fff700 1 -- 172.21.15.3:0/4037627977 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77400a690 con 0x7fa77c06be60 2023-10-08T15:41:34.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.558+0000 7fa773fff700 1 -- 172.21.15.3:0/4037627977 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa77400a7f0 con 0x7fa77c06be60 2023-10-08T15:41:34.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.558+0000 7fa7810a1700 1 -- 172.21.15.3:0/4037627977 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa77c14de90 con 0x7fa77c06be60 2023-10-08T15:41:34.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.558+0000 7fa773fff700 1 -- 172.21.15.3:0/4037627977 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77400abb0 con 0x7fa77c06be60 2023-10-08T15:41:34.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.558+0000 7fa7810a1700 1 -- 172.21.15.3:0/4037627977 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa77c15eca0 con 0x7fa77c06be60 2023-10-08T15:41:34.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.562+0000 7fa7810a1700 1 -- 172.21.15.3:0/4037627977 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa77c04bbc0 con 0x7fa77c06be60 2023-10-08T15:41:34.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.562+0000 7fa773fff700 1 -- 172.21.15.3:0/4037627977 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa774003030 con 0x7fa77c06be60 2023-10-08T15:41:34.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.562+0000 7fa773fff700 1 --2- 172.21.15.3:0/4037627977 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fa760060550 0x7fa760062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:34.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.562+0000 7fa773fff700 1 -- 172.21.15.3:0/4037627977 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa77407c8d0 con 0x7fa77c06be60 2023-10-08T15:41:34.568 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.562+0000 7fa77b7fe700 1 --2- 172.21.15.3:0/4037627977 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fa760060550 0x7fa760062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:34.568 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.562+0000 7fa77b7fe700 1 --2- 172.21.15.3:0/4037627977 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fa760060550 0x7fa760062a00 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa77c09e8e0 tx=0x7fa76c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:34.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.570+0000 7fa773fff700 1 -- 172.21.15.3:0/4037627977 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa77c04bbc0 con 0x7fa77c06be60 2023-10-08T15:41:34.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.766+0000 7fa7810a1700 1 -- 172.21.15.3:0/4037627977 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa77c04bbc0 con 0x7fa77c06be60 2023-10-08T15:41:34.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.766+0000 7fa773fff700 1 -- 172.21.15.3:0/4037627977 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+3077 (secure 0 0 0) 0x7fa77c04bbc0 con 0x7fa77c06be60 2023-10-08T15:41:34.772 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:41:34.772 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":27,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5674,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/688778262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":688778262},{"type":"v1","addr":"172.21.15.50:6835","nonce":688778262}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:41:06.132475+0000","modified":"2023-10-08T15:41:09.450447+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5685},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5685":{"gid":5685,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.3:6833/3789195831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":3789195831},{"type":"v1","addr":"172.21.15.3:6833","nonce":3789195831}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-08T15:41:34.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.770+0000 7fa7810a1700 1 -- 172.21.15.3:0/4037627977 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fa760060550 msgr2=0x7fa760062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:34.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.770+0000 7fa7810a1700 1 --2- 172.21.15.3:0/4037627977 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fa760060550 0x7fa760062a00 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa77c09e8e0 tx=0x7fa76c008040 comp rx=0 tx=0).stop 2023-10-08T15:41:34.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.770+0000 7fa7810a1700 1 -- 172.21.15.3:0/4037627977 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa77c06be60 msgr2=0x7fa77c148180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:34.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.770+0000 7fa7810a1700 1 --2- 172.21.15.3:0/4037627977 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa77c06be60 0x7fa77c148180 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fa77400c910 tx=0x7fa774001700 comp rx=0 tx=0).stop 2023-10-08T15:41:34.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.770+0000 7fa7810a1700 1 -- 172.21.15.3:0/4037627977 shutdown_connections 2023-10-08T15:41:34.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.770+0000 7fa7810a1700 1 --2- 172.21.15.3:0/4037627977 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fa760060550 0x7fa760062a00 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:34.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.770+0000 7fa7810a1700 1 --2- 172.21.15.3:0/4037627977 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa77c14ac50 0x7fa77c14d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:34.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.770+0000 7fa7810a1700 1 --2- 172.21.15.3:0/4037627977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa77c06cc40 0x7fa77c14cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:34.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.770+0000 7fa7810a1700 1 --2- 172.21.15.3:0/4037627977 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa77c06be60 0x7fa77c148180 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:34.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.770+0000 7fa7810a1700 1 -- 172.21.15.3:0/4037627977 >> 172.21.15.3:0/4037627977 conn(0x7fa77c0c1df0 msgr2=0x7fa77c0670e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:34.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.770+0000 7fa7810a1700 1 -- 172.21.15.3:0/4037627977 shutdown_connections 2023-10-08T15:41:34.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.770+0000 7fa7810a1700 1 -- 172.21.15.3:0/4037627977 wait complete. 2023-10-08T15:41:34.776 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 27 2023-10-08T15:41:34.786 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:41:34.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.886+0000 7fb8cc98d700 1 Processor -- start 2023-10-08T15:41:34.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.886+0000 7fb8cc98d700 1 -- start start 2023-10-08T15:41:34.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.890+0000 7fb8cc98d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb8c806cf60 0x7fb8c814f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:34.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.890+0000 7fb8cc98d700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb8c8068630 0x7fb8c814b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:34.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.890+0000 7fb8cc98d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8c8069900 con 0x7fb8c80a15e0 2023-10-08T15:41:34.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.890+0000 7fb8cc98d700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8c8069620 con 0x7fb8c8068630 2023-10-08T15:41:34.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.890+0000 7fb8cc98d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c8068d10 con 0x7fb8c806cf60 2023-10-08T15:41:34.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.890+0000 7fb8c759e700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb8c8068630 0x7fb8c814b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:34.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.890+0000 7fb8c759e700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb8c8068630 0x7fb8c814b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45288/0 (socket says 172.21.15.3:45288) 2023-10-08T15:41:34.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.890+0000 7fb8c759e700 1 -- 172.21.15.3:0/778703989 learned_addr learned my addr 172.21.15.3:0/778703989 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:34.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.890+0000 7fb8c659c700 1 --2- 172.21.15.3:0/778703989 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb8c806cf60 0x7fb8c814f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:34.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.890+0000 7fb8c759e700 1 -- 172.21.15.3:0/778703989 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb8c806cf60 msgr2=0x7fb8c814f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:34.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.890+0000 7fb8c759e700 1 --2- 172.21.15.3:0/778703989 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb8c806cf60 0x7fb8c814f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:34.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.890+0000 7fb8c759e700 1 -- 172.21.15.3:0/778703989 >> v1:172.21.15.50:6789/0 conn(0x7fb8c80a15e0 legacy=0x7fb8c814eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:34.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.890+0000 7fb8c759e700 1 -- 172.21.15.3:0/778703989 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c806e8e0 con 0x7fb8c8068630 2023-10-08T15:41:34.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.890+0000 7fb8c759e700 1 --2- 172.21.15.3:0/778703989 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb8c8068630 0x7fb8c814b750 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0009f20 tx=0x7fb8c0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e48e4256dd152d14 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:34.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.890+0000 7fb8c5d9b700 1 -- 172.21.15.3:0/778703989 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c000e070 con 0x7fb8c8068630 2023-10-08T15:41:34.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.890+0000 7fb8c5d9b700 1 -- 172.21.15.3:0/778703989 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8c000b9d0 con 0x7fb8c8068630 2023-10-08T15:41:34.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.890+0000 7fb8c5d9b700 1 -- 172.21.15.3:0/778703989 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c00092e0 con 0x7fb8c8068630 2023-10-08T15:41:34.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.890+0000 7fb8cc98d700 1 -- 172.21.15.3:0/778703989 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb8c8068630 msgr2=0x7fb8c814b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:34.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.890+0000 7fb8cc98d700 1 --2- 172.21.15.3:0/778703989 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb8c8068630 0x7fb8c814b750 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0009f20 tx=0x7fb8c0009840 comp rx=0 tx=0).stop 2023-10-08T15:41:34.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.890+0000 7fb8cc98d700 1 -- 172.21.15.3:0/778703989 shutdown_connections 2023-10-08T15:41:34.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.890+0000 7fb8cc98d700 1 --2- 172.21.15.3:0/778703989 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb8c8068630 0x7fb8c814b750 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:34.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.890+0000 7fb8cc98d700 1 --2- 172.21.15.3:0/778703989 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb8c806cf60 0x7fb8c814f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:34.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.890+0000 7fb8cc98d700 1 -- 172.21.15.3:0/778703989 >> 172.21.15.3:0/778703989 conn(0x7fb8c80670e0 msgr2=0x7fb8c80674e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:34.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.890+0000 7fb8cc98d700 1 -- 172.21.15.3:0/778703989 shutdown_connections 2023-10-08T15:41:34.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.890+0000 7fb8cc98d700 1 -- 172.21.15.3:0/778703989 wait complete. 2023-10-08T15:41:34.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.894+0000 7fb8cc98d700 1 Processor -- start 2023-10-08T15:41:34.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.894+0000 7fb8cc98d700 1 -- start start 2023-10-08T15:41:34.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.894+0000 7fb8cc98d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb8c8068630 0x7fb8c8143120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:34.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.894+0000 7fb8cc98d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8c80a15e0 0x7fb8c815ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:34.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.894+0000 7fb8cc98d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb8c814c9e0 0x7fb8c8151040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:34.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.894+0000 7fb8cc98d700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c814e720 con 0x7fb8c8068630 2023-10-08T15:41:34.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.894+0000 7fb8cc98d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c813f390 con 0x7fb8c80a15e0 2023-10-08T15:41:34.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.894+0000 7fb8cc98d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c81421e0 con 0x7fb8c814c9e0 2023-10-08T15:41:34.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.894+0000 7fb8c6d9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb8c8068630 0x7fb8c8143120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:34.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.894+0000 7fb8c6d9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb8c8068630 0x7fb8c8143120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45296/0 (socket says 172.21.15.3:45296) 2023-10-08T15:41:34.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.894+0000 7fb8c6d9d700 1 -- 172.21.15.3:0/506992219 learned_addr learned my addr 172.21.15.3:0/506992219 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:34.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.894+0000 7fb8c659c700 1 --2- 172.21.15.3:0/506992219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8c80a15e0 0x7fb8c815ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:34.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.894+0000 7fb8c759e700 1 --2- 172.21.15.3:0/506992219 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb8c814c9e0 0x7fb8c8151040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:34.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.894+0000 7fb8c6d9d700 1 -- 172.21.15.3:0/506992219 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb8c814c9e0 msgr2=0x7fb8c8151040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:34.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.894+0000 7fb8c6d9d700 1 --2- 172.21.15.3:0/506992219 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb8c814c9e0 0x7fb8c8151040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:34.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.894+0000 7fb8c6d9d700 1 -- 172.21.15.3:0/506992219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8c80a15e0 msgr2=0x7fb8c815ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:34.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.894+0000 7fb8c6d9d700 1 --2- 172.21.15.3:0/506992219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8c80a15e0 0x7fb8c815ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:34.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.894+0000 7fb8c6d9d700 1 -- 172.21.15.3:0/506992219 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c0009ae0 con 0x7fb8c8068630 2023-10-08T15:41:34.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.894+0000 7fb8c6d9d700 1 --2- 172.21.15.3:0/506992219 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb8c8068630 0x7fb8c8143120 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fb8b000c4e0 tx=0x7fb8b000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:34.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.894+0000 7fb8beffd700 1 -- 172.21.15.3:0/506992219 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b0011590 con 0x7fb8c8068630 2023-10-08T15:41:34.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.894+0000 7fb8beffd700 1 -- 172.21.15.3:0/506992219 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b0011710 con 0x7fb8c8068630 2023-10-08T15:41:34.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.894+0000 7fb8beffd700 1 -- 172.21.15.3:0/506992219 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b0011ad0 con 0x7fb8c8068630 2023-10-08T15:41:34.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.894+0000 7fb8cc98d700 1 -- 172.21.15.3:0/506992219 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8c813f7a0 con 0x7fb8c8068630 2023-10-08T15:41:34.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.894+0000 7fb8cc98d700 1 -- 172.21.15.3:0/506992219 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8c813fb20 con 0x7fb8c8068630 2023-10-08T15:41:34.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.898+0000 7fb8beffd700 1 -- 172.21.15.3:0/506992219 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb8b0001020 con 0x7fb8c8068630 2023-10-08T15:41:34.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.898+0000 7fb8beffd700 1 --2- 172.21.15.3:0/506992219 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb8a8060550 0x7fb8a8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:34.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.898+0000 7fb8cc98d700 1 -- 172.21.15.3:0/506992219 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8c814e4f0 con 0x7fb8c8068630 2023-10-08T15:41:34.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.898+0000 7fb8beffd700 1 -- 172.21.15.3:0/506992219 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb8b007bc40 con 0x7fb8c8068630 2023-10-08T15:41:34.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.898+0000 7fb8c659c700 1 --2- 172.21.15.3:0/506992219 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb8a8060550 0x7fb8a8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:34.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.898+0000 7fb8c659c700 1 --2- 172.21.15.3:0/506992219 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb8a8060550 0x7fb8a8062a00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb8c814e1b0 tx=0x7fb8b8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:34.910 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:34.906+0000 7fb8beffd700 1 -- 172.21.15.3:0/506992219 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb8b004c230 con 0x7fb8c8068630 2023-10-08T15:41:35.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.074+0000 7fb8cc98d700 1 -- 172.21.15.3:0/506992219 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb8c805ecf0 con 0x7fb8c8068630 2023-10-08T15:41:35.082 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.078+0000 7fb8beffd700 1 -- 172.21.15.3:0/506992219 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+15254 (secure 0 0 0) 0x7fb8b0017070 con 0x7fb8c8068630 2023-10-08T15:41:35.083 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:41:35.083 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":49,"fsid":"7635972e-cd66-4a8f-a231-378db8b3847a","created":"2023-10-08T15:37:08.234594+0000","modified":"2023-10-08T15:41:07.416834+0000","last_up_change":"2023-10-08T15:37:17.537726+0000","last_in_change":"2023-10-08T15:37:10.269178+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:37:16.581590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:41:04.003380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-08T15:41:04.755627+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"64fb1864-bfdd-4d75-9b41-03fb60085dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33363},{"type":"v1","addr":"172.21.15.3:6801","nonce":33363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33363},{"type":"v1","addr":"172.21.15.3:6803","nonce":33363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":33363},{"type":"v1","addr":"172.21.15.3:6807","nonce":33363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33363},{"type":"v1","addr":"172.21.15.3:6805","nonce":33363}]},"public_addr":"172.21.15.3:6801/33363","cluster_addr":"172.21.15.3:6803/33363","heartbeat_back_addr":"172.21.15.3:6807/33363","heartbeat_front_addr":"172.21.15.3:6805/33363","state":["exists","up"]},{"osd":1,"uuid":"3ca6bd3a-3e8a-4c65-af9c-46148b0c2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33364},{"type":"v1","addr":"172.21.15.3:6820","nonce":33364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33364},{"type":"v1","addr":"172.21.15.3:6824","nonce":33364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33364},{"type":"v1","addr":"172.21.15.3:6831","nonce":33364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33364},{"type":"v1","addr":"172.21.15.3:6828","nonce":33364}]},"public_addr":"172.21.15.3:6820/33364","cluster_addr":"172.21.15.3:6824/33364","heartbeat_back_addr":"172.21.15.3:6831/33364","heartbeat_front_addr":"172.21.15.3:6828/33364","state":["exists","up"]},{"osd":2,"uuid":"6eb9f757-58dd-442f-910d-32401454bce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33366},{"type":"v1","addr":"172.21.15.3:6817","nonce":33366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":33366},{"type":"v1","addr":"172.21.15.3:6821","nonce":33366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6827","nonce":33366},{"type":"v1","addr":"172.21.15.3:6829","nonce":33366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":33366},{"type":"v1","addr":"172.21.15.3:6825","nonce":33366}]},"public_addr":"172.21.15.3:6817/33366","cluster_addr":"172.21.15.3:6821/33366","heartbeat_back_addr":"172.21.15.3:6829/33366","heartbeat_front_addr":"172.21.15.3:6825/33366","state":["exists","up"]},{"osd":3,"uuid":"1c39866b-ac2e-4ea9-a69c-02b01ee4191d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33365},{"type":"v1","addr":"172.21.15.3:6809","nonce":33365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":33365},{"type":"v1","addr":"172.21.15.3:6811","nonce":33365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33365},{"type":"v1","addr":"172.21.15.3:6815","nonce":33365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":33365},{"type":"v1","addr":"172.21.15.3:6813","nonce":33365}]},"public_addr":"172.21.15.3:6809/33365","cluster_addr":"172.21.15.3:6811/33365","heartbeat_back_addr":"172.21.15.3:6815/33365","heartbeat_front_addr":"172.21.15.3:6813/33365","state":["exists","up"]},{"osd":4,"uuid":"15f86b61-b7f1-4780-ae00-9d80a68cb830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":33605},{"type":"v1","addr":"172.21.15.50:6809","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33605},{"type":"v1","addr":"172.21.15.50:6811","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33605},{"type":"v1","addr":"172.21.15.50:6815","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":33605},{"type":"v1","addr":"172.21.15.50:6813","nonce":33605}]},"public_addr":"172.21.15.50:6809/33605","cluster_addr":"172.21.15.50:6811/33605","heartbeat_back_addr":"172.21.15.50:6815/33605","heartbeat_front_addr":"172.21.15.50:6813/33605","state":["exists","up"]},{"osd":5,"uuid":"726c3003-34e6-4d5a-b6e2-f911e13c2118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33606},{"type":"v1","addr":"172.21.15.50:6801","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33606},{"type":"v1","addr":"172.21.15.50:6803","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33606},{"type":"v1","addr":"172.21.15.50:6807","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":33606},{"type":"v1","addr":"172.21.15.50:6805","nonce":33606}]},"public_addr":"172.21.15.50:6801/33606","cluster_addr":"172.21.15.50:6803/33606","heartbeat_back_addr":"172.21.15.50:6807/33606","heartbeat_front_addr":"172.21.15.50:6805/33606","state":["exists","up"]},{"osd":6,"uuid":"401122a4-9988-441f-a5a7-39164434ebcd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":33607},{"type":"v1","addr":"172.21.15.50:6819","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":33607},{"type":"v1","addr":"172.21.15.50:6823","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":33607},{"type":"v1","addr":"172.21.15.50:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":33607},{"type":"v1","addr":"172.21.15.50:6827","nonce":33607}]},"public_addr":"172.21.15.50:6819/33607","cluster_addr":"172.21.15.50:6823/33607","heartbeat_back_addr":"172.21.15.50:6831/33607","heartbeat_front_addr":"172.21.15.50:6827/33607","state":["exists","up"]},{"osd":7,"uuid":"6b3fa236-c9d0-4c4d-82ae-9af4daf6d699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33604},{"type":"v1","addr":"172.21.15.50:6818","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":33604},{"type":"v1","addr":"172.21.15.50:6822","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":33604},{"type":"v1","addr":"172.21.15.50:6830","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":33604},{"type":"v1","addr":"172.21.15.50:6826","nonce":33604}]},"public_addr":"172.21.15.50:6818/33604","cluster_addr":"172.21.15.50:6822/33604","heartbeat_back_addr":"172.21.15.50:6830/33604","heartbeat_front_addr":"172.21.15.50:6826/33604","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.497794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.529417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.873426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.325972+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.443971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.240795+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.739632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.643026+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:41:35.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.078+0000 7fb8cc98d700 1 -- 172.21.15.3:0/506992219 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb8a8060550 msgr2=0x7fb8a8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:35.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.078+0000 7fb8cc98d700 1 --2- 172.21.15.3:0/506992219 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb8a8060550 0x7fb8a8062a00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb8c814e1b0 tx=0x7fb8b8008040 comp rx=0 tx=0).stop 2023-10-08T15:41:35.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.078+0000 7fb8cc98d700 1 -- 172.21.15.3:0/506992219 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb8c8068630 msgr2=0x7fb8c8143120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:35.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.078+0000 7fb8cc98d700 1 --2- 172.21.15.3:0/506992219 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb8c8068630 0x7fb8c8143120 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fb8b000c4e0 tx=0x7fb8b000c8a0 comp rx=0 tx=0).stop 2023-10-08T15:41:35.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.078+0000 7fb8cc98d700 1 -- 172.21.15.3:0/506992219 shutdown_connections 2023-10-08T15:41:35.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.078+0000 7fb8cc98d700 1 --2- 172.21.15.3:0/506992219 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb8a8060550 0x7fb8a8062a00 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:35.086 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.078+0000 7fb8cc98d700 1 --2- 172.21.15.3:0/506992219 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb8c814c9e0 0x7fb8c8151040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:35.086 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.078+0000 7fb8cc98d700 1 --2- 172.21.15.3:0/506992219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8c80a15e0 0x7fb8c815ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:35.086 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.078+0000 7fb8cc98d700 1 --2- 172.21.15.3:0/506992219 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb8c8068630 0x7fb8c8143120 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:35.086 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.078+0000 7fb8cc98d700 1 -- 172.21.15.3:0/506992219 >> 172.21.15.3:0/506992219 conn(0x7fb8c80670e0 msgr2=0x7fb8c80bce90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:35.086 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.078+0000 7fb8cc98d700 1 -- 172.21.15.3:0/506992219 shutdown_connections 2023-10-08T15:41:35.086 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.078+0000 7fb8cc98d700 1 -- 172.21.15.3:0/506992219 wait complete. 2023-10-08T15:41:35.097 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-08T15:41:35.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.198+0000 7f3a21932700 1 Processor -- start 2023-10-08T15:41:35.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.198+0000 7f3a21932700 1 -- start start 2023-10-08T15:41:35.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.198+0000 7f3a21932700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f3a1c0a1fd0 0x7f3a1c148330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:35.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.198+0000 7f3a21932700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3a1c14c6c0 0x7f3a1c148870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:35.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.198+0000 7f3a21932700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3a1c148db0 0x7f3a1c0b1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:35.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.198+0000 7f3a21932700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a1c14b9d0 con 0x7f3a1c0a1fd0 2023-10-08T15:41:35.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.198+0000 7f3a21932700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a1c0b3b10 con 0x7f3a1c148db0 2023-10-08T15:41:35.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.198+0000 7f3a21932700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c14bbe0 con 0x7f3a1c14c6c0 2023-10-08T15:41:35.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.198+0000 7f3a1affd700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f3a1c0a1fd0 0x7f3a1c148330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:35.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.198+0000 7f3a1affd700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f3a1c0a1fd0 0x7f3a1c148330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45304/0 (socket says 172.21.15.3:45304) 2023-10-08T15:41:35.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.198+0000 7f3a1affd700 1 -- 172.21.15.3:0/560544825 learned_addr learned my addr 172.21.15.3:0/560544825 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:35.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.202+0000 7f3a1a7fc700 1 --2- 172.21.15.3:0/560544825 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3a1c14c6c0 0x7f3a1c148870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:35.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.202+0000 7f3a1b7fe700 1 --2- 172.21.15.3:0/560544825 >> v2:172.21.15.50:3300/0 conn(0x7f3a1c148db0 0x7f3a1c0b1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:35.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.202+0000 7f3a1affd700 1 -- 172.21.15.3:0/560544825 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3a1c14c6c0 msgr2=0x7f3a1c148870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:35.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.202+0000 7f3a1affd700 1 --2- 172.21.15.3:0/560544825 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3a1c14c6c0 0x7f3a1c148870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:35.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.202+0000 7f3a1affd700 1 -- 172.21.15.3:0/560544825 >> v2:172.21.15.50:3300/0 conn(0x7f3a1c148db0 msgr2=0x7f3a1c0b1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:35.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.202+0000 7f3a1affd700 1 --2- 172.21.15.3:0/560544825 >> v2:172.21.15.50:3300/0 conn(0x7f3a1c148db0 0x7f3a1c0b1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:35.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.202+0000 7f3a1affd700 1 -- 172.21.15.3:0/560544825 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a1c14bec0 con 0x7f3a1c0a1fd0 2023-10-08T15:41:35.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.202+0000 7f3a1affd700 1 --2- 172.21.15.3:0/560544825 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3a1c0a1fd0 0x7f3a1c148330 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c0b2ef0 tx=0x7f3a0c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c752f47b112e840 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:35.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.202+0000 7f3a19ffb700 1 -- 172.21.15.3:0/560544825 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c00b640 con 0x7f3a1c0a1fd0 2023-10-08T15:41:35.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.202+0000 7f3a19ffb700 1 -- 172.21.15.3:0/560544825 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a0c00b7a0 con 0x7f3a1c0a1fd0 2023-10-08T15:41:35.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.202+0000 7f3a19ffb700 1 -- 172.21.15.3:0/560544825 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c00bb60 con 0x7f3a1c0a1fd0 2023-10-08T15:41:35.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.202+0000 7f3a21932700 1 -- 172.21.15.3:0/560544825 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3a1c0a1fd0 msgr2=0x7f3a1c148330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:35.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.202+0000 7f3a21932700 1 --2- 172.21.15.3:0/560544825 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3a1c0a1fd0 0x7f3a1c148330 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c0b2ef0 tx=0x7f3a0c009250 comp rx=0 tx=0).stop 2023-10-08T15:41:35.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.202+0000 7f3a21932700 1 -- 172.21.15.3:0/560544825 shutdown_connections 2023-10-08T15:41:35.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.202+0000 7f3a21932700 1 --2- 172.21.15.3:0/560544825 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3a1c14c6c0 0x7f3a1c148870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:35.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.202+0000 7f3a21932700 1 --2- 172.21.15.3:0/560544825 >> v2:172.21.15.50:3300/0 conn(0x7f3a1c148db0 0x7f3a1c0b1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:35.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.202+0000 7f3a21932700 1 --2- 172.21.15.3:0/560544825 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3a1c0a1fd0 0x7f3a1c148330 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:35.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.202+0000 7f3a21932700 1 -- 172.21.15.3:0/560544825 >> 172.21.15.3:0/560544825 conn(0x7f3a1c06b9b0 msgr2=0x7f3a1c0681f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:35.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.202+0000 7f3a21932700 1 -- 172.21.15.3:0/560544825 shutdown_connections 2023-10-08T15:41:35.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.202+0000 7f3a21932700 1 -- 172.21.15.3:0/560544825 wait complete. 2023-10-08T15:41:35.211 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.206+0000 7f3a21932700 1 Processor -- start 2023-10-08T15:41:35.211 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.206+0000 7f3a21932700 1 -- start start 2023-10-08T15:41:35.211 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.206+0000 7f3a21932700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a1c0a1fd0 0x7f3a1c158fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:35.211 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.206+0000 7f3a21932700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3a1c148db0 0x7f3a1c0b5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:35.212 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.206+0000 7f3a21932700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3a1c14c6c0 0x7f3a1c140d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:35.212 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.206+0000 7f3a21932700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c159510 con 0x7f3a1c14c6c0 2023-10-08T15:41:35.212 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.206+0000 7f3a21932700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c0b5640 con 0x7f3a1c0a1fd0 2023-10-08T15:41:35.212 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.206+0000 7f3a21932700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c06cf90 con 0x7f3a1c148db0 2023-10-08T15:41:35.212 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.206+0000 7f3a1b7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3a1c14c6c0 0x7f3a1c140d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:35.212 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.206+0000 7f3a1b7fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3a1c14c6c0 0x7f3a1c140d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45314/0 (socket says 172.21.15.3:45314) 2023-10-08T15:41:35.212 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.206+0000 7f3a1b7fe700 1 -- 172.21.15.3:0/2740219913 learned_addr learned my addr 172.21.15.3:0/2740219913 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:35.212 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.206+0000 7f3a1affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a1c0a1fd0 0x7f3a1c158fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:35.212 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.206+0000 7f3a1a7fc700 1 --2- 172.21.15.3:0/2740219913 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3a1c148db0 0x7f3a1c0b5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:35.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.206+0000 7f3a1b7fe700 1 -- 172.21.15.3:0/2740219913 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3a1c148db0 msgr2=0x7f3a1c0b5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:35.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.206+0000 7f3a1b7fe700 1 --2- 172.21.15.3:0/2740219913 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3a1c148db0 0x7f3a1c0b5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:35.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.206+0000 7f3a1b7fe700 1 -- 172.21.15.3:0/2740219913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a1c0a1fd0 msgr2=0x7f3a1c158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:35.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.206+0000 7f3a1b7fe700 1 --2- 172.21.15.3:0/2740219913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a1c0a1fd0 0x7f3a1c158fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:35.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.206+0000 7f3a1b7fe700 1 -- 172.21.15.3:0/2740219913 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a0c0094f0 con 0x7f3a1c14c6c0 2023-10-08T15:41:35.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.206+0000 7f3a1b7fe700 1 --2- 172.21.15.3:0/2740219913 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3a1c14c6c0 0x7f3a1c140d60 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f3a14009ec0 tx=0x7f3a1400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:35.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.206+0000 7f3a02ffd700 1 -- 172.21.15.3:0/2740219913 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1400cb70 con 0x7f3a1c14c6c0 2023-10-08T15:41:35.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.206+0000 7f3a02ffd700 1 -- 172.21.15.3:0/2740219913 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a1400f040 con 0x7f3a1c14c6c0 2023-10-08T15:41:35.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.206+0000 7f3a21932700 1 -- 172.21.15.3:0/2740219913 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a1c06d270 con 0x7f3a1c14c6c0 2023-10-08T15:41:35.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.206+0000 7f3a02ffd700 1 -- 172.21.15.3:0/2740219913 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a14014480 con 0x7f3a1c14c6c0 2023-10-08T15:41:35.215 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.206+0000 7f3a21932700 1 -- 172.21.15.3:0/2740219913 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a1c0b5cd0 con 0x7f3a1c14c6c0 2023-10-08T15:41:35.215 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.210+0000 7f3a21932700 1 -- 172.21.15.3:0/2740219913 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a1c144e30 con 0x7f3a1c14c6c0 2023-10-08T15:41:35.215 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.210+0000 7f3a02ffd700 1 -- 172.21.15.3:0/2740219913 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f3a14014830 con 0x7f3a1c14c6c0 2023-10-08T15:41:35.215 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.210+0000 7f3a02ffd700 1 --2- 172.21.15.3:0/2740219913 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3a08060580 0x7f3a08062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:35.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.210+0000 7f3a02ffd700 1 -- 172.21.15.3:0/2740219913 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3a1407d3e0 con 0x7f3a1c14c6c0 2023-10-08T15:41:35.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.210+0000 7f3a1affd700 1 --2- 172.21.15.3:0/2740219913 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3a08060580 0x7f3a08062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:35.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.210+0000 7f3a1affd700 1 --2- 172.21.15.3:0/2740219913 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3a08060580 0x7f3a08062a30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c0b2ef0 tx=0x7f3a0c017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:35.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.218+0000 7f3a02ffd700 1 -- 172.21.15.3:0/2740219913 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3a1c144e30 con 0x7f3a1c14c6c0 2023-10-08T15:41:35.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.414+0000 7f3a21932700 1 -- 172.21.15.3:0/2740219913 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f3a1c144e30 con 0x7f3a1c14c6c0 2023-10-08T15:41:35.420 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-10-08T15:41:35.414+0000 7fd2c0727700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T15:41:35.431 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.426+0000 7f3a02ffd700 1 -- 172.21.15.3:0/2740219913 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v28) v1 ==== 161+0+0 (secure 0 0 0) 0x7f3a1c144e30 con 0x7f3a1c14c6c0 2023-10-08T15:41:35.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.430+0000 7f3a21932700 1 -- 172.21.15.3:0/2740219913 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3a08060580 msgr2=0x7f3a08062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:35.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.430+0000 7f3a21932700 1 --2- 172.21.15.3:0/2740219913 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3a08060580 0x7f3a08062a30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c0b2ef0 tx=0x7f3a0c017000 comp rx=0 tx=0).stop 2023-10-08T15:41:35.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.430+0000 7f3a21932700 1 -- 172.21.15.3:0/2740219913 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3a1c14c6c0 msgr2=0x7f3a1c140d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:35.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.430+0000 7f3a21932700 1 --2- 172.21.15.3:0/2740219913 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3a1c14c6c0 0x7f3a1c140d60 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f3a14009ec0 tx=0x7f3a1400b040 comp rx=0 tx=0).stop 2023-10-08T15:41:35.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.430+0000 7f3a21932700 1 -- 172.21.15.3:0/2740219913 shutdown_connections 2023-10-08T15:41:35.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.430+0000 7f3a21932700 1 --2- 172.21.15.3:0/2740219913 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3a08060580 0x7f3a08062a30 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:35.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.430+0000 7f3a21932700 1 --2- 172.21.15.3:0/2740219913 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3a1c14c6c0 0x7f3a1c140d60 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:35.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.430+0000 7f3a21932700 1 --2- 172.21.15.3:0/2740219913 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3a1c148db0 0x7f3a1c0b5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:35.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.430+0000 7f3a21932700 1 --2- 172.21.15.3:0/2740219913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a1c0a1fd0 0x7f3a1c158fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:35.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.430+0000 7f3a21932700 1 -- 172.21.15.3:0/2740219913 >> 172.21.15.3:0/2740219913 conn(0x7f3a1c06b9b0 msgr2=0x7f3a1c147020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:35.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.430+0000 7f3a21932700 1 -- 172.21.15.3:0/2740219913 shutdown_connections 2023-10-08T15:41:35.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.430+0000 7f3a21932700 1 -- 172.21.15.3:0/2740219913 wait complete. 2023-10-08T15:41:35.438 INFO:teuthology.orchestra.run.smithi003.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-08T15:41:35.451 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-08T15:41:35.469 INFO:tasks.ceph.mds.a.smithi003.stdout:starting mds.a at 2023-10-08T15:41:35.563 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.558+0000 7f1805c5c700 1 Processor -- start 2023-10-08T15:41:35.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.558+0000 7f1805c5c700 1 -- start start 2023-10-08T15:41:35.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.558+0000 7f1805c5c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f180014b000 0x7f1800068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:35.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.558+0000 7f1805c5c700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f180006d200 0x7f180006d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:35.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.558+0000 7f1805c5c700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f180006c7b0 con 0x7f180014ac30 2023-10-08T15:41:35.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.558+0000 7f1805c5c700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18000a7e60 con 0x7f180006d200 2023-10-08T15:41:35.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.558+0000 7f1805c5c700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f180006ca00 con 0x7f180014b000 2023-10-08T15:41:35.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.558+0000 7f180545b700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f180006d200 0x7f180006d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:35.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.558+0000 7f17f7fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f180014b000 0x7f1800068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:35.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.558+0000 7f1804c5a700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f180014ac30 0x7f180014bf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.3:39620/0 (socket says 172.21.15.3:39620) 2023-10-08T15:41:35.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.558+0000 7f17f7fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f180014b000 0x7f1800068390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.3:58306/0 (socket says 172.21.15.3:58306) 2023-10-08T15:41:35.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.558+0000 7f1804c5a700 1 -- 172.21.15.3:0/587565281 learned_addr learned my addr 172.21.15.3:0/587565281 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:41:35.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.558+0000 7f17f77fe700 1 -- 172.21.15.3:0/587565281 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 713447988 0 0) 0x7f180006c7b0 con 0x7f180014ac30 2023-10-08T15:41:35.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.558+0000 7f17f77fe700 1 -- 172.21.15.3:0/587565281 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17e8003570 con 0x7f180014ac30 2023-10-08T15:41:35.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.558+0000 7f17f7fff700 1 -- 172.21.15.3:0/587565281 >> v2:172.21.15.3:3300/0 conn(0x7f180006d200 msgr2=0x7f180006d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:35.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.558+0000 7f17f7fff700 1 --2- 172.21.15.3:0/587565281 >> v2:172.21.15.3:3300/0 conn(0x7f180006d200 0x7f180006d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:35.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.558+0000 7f17f7fff700 1 -- 172.21.15.3:0/587565281 >> v1:172.21.15.50:6789/0 conn(0x7f180014ac30 legacy=0x7f180014bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:35.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.558+0000 7f17f7fff700 1 -- 172.21.15.3:0/587565281 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f180006cce0 con 0x7f180014b000 2023-10-08T15:41:35.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.558+0000 7f180545b700 1 --2- 172.21.15.3:0/587565281 >> v2:172.21.15.3:3300/0 conn(0x7f180006d200 0x7f180006d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:41:35.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.562+0000 7f17f7fff700 1 --2- 172.21.15.3:0/587565281 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f180014b000 0x7f1800068390 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f17f00098e0 tx=0x7f17f00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5559a75c8c901462 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:35.568 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.562+0000 7f17f77fe700 1 -- 172.21.15.3:0/587565281 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f0011630 con 0x7f180014b000 2023-10-08T15:41:35.568 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.562+0000 7f17f77fe700 1 -- 172.21.15.3:0/587565281 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f0011790 con 0x7f180014b000 2023-10-08T15:41:35.568 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.562+0000 7f17f77fe700 1 -- 172.21.15.3:0/587565281 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f0011b30 con 0x7f180014b000 2023-10-08T15:41:35.568 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.562+0000 7f1805c5c700 1 -- 172.21.15.3:0/587565281 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f180014b000 msgr2=0x7f1800068390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:35.568 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.562+0000 7f1805c5c700 1 --2- 172.21.15.3:0/587565281 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f180014b000 0x7f1800068390 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f17f00098e0 tx=0x7f17f00091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:35.568 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.562+0000 7f1805c5c700 1 -- 172.21.15.3:0/587565281 shutdown_connections 2023-10-08T15:41:35.568 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.562+0000 7f1805c5c700 1 --2- 172.21.15.3:0/587565281 >> v2:172.21.15.3:3300/0 conn(0x7f180006d200 0x7f180006d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:35.568 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.562+0000 7f1805c5c700 1 --2- 172.21.15.3:0/587565281 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f180014b000 0x7f1800068390 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:35.568 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.562+0000 7f1805c5c700 1 -- 172.21.15.3:0/587565281 >> 172.21.15.3:0/587565281 conn(0x7f18000c1df0 msgr2=0x7f18000c21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:35.568 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.562+0000 7f1805c5c700 1 -- 172.21.15.3:0/587565281 shutdown_connections 2023-10-08T15:41:35.569 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.562+0000 7f1805c5c700 1 -- 172.21.15.3:0/587565281 wait complete. 2023-10-08T15:41:35.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.562+0000 7f1805c5c700 1 Processor -- start 2023-10-08T15:41:35.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.562+0000 7f1805c5c700 1 -- start start 2023-10-08T15:41:35.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.566+0000 7f1805c5c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f180006d200 0x7f180014d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:35.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.566+0000 7f1805c5c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f180014ac30 0x7f18000a5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:35.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.566+0000 7f1805c5c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f180014b000 0x7f18000a6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:35.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.566+0000 7f1805c5c700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180014fa00 con 0x7f180014ac30 2023-10-08T15:41:35.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.566+0000 7f1805c5c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180015b730 con 0x7f180006d200 2023-10-08T15:41:35.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.566+0000 7f1805c5c700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f180015b3c0 con 0x7f180014b000 2023-10-08T15:41:35.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.566+0000 7f17f7fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f180014ac30 0x7f18000a5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:35.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.566+0000 7f17f7fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f180014ac30 0x7f18000a5bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45346/0 (socket says 172.21.15.3:45346) 2023-10-08T15:41:35.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.566+0000 7f17f7fff700 1 -- 172.21.15.3:0/3204347211 learned_addr learned my addr 172.21.15.3:0/3204347211 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:35.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.566+0000 7f180545b700 1 --2- 172.21.15.3:0/3204347211 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f180014b000 0x7f18000a6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:35.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.566+0000 7f1804c5a700 1 --2- 172.21.15.3:0/3204347211 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f180006d200 0x7f180014d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:35.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.566+0000 7f17f7fff700 1 -- 172.21.15.3:0/3204347211 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f180014b000 msgr2=0x7f18000a6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:35.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.566+0000 7f17f7fff700 1 --2- 172.21.15.3:0/3204347211 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f180014b000 0x7f18000a6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:35.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.566+0000 7f17f7fff700 1 -- 172.21.15.3:0/3204347211 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f180006d200 msgr2=0x7f180014d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:35.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.566+0000 7f17f7fff700 1 --2- 172.21.15.3:0/3204347211 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f180006d200 0x7f180014d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:35.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.566+0000 7f17f7fff700 1 -- 172.21.15.3:0/3204347211 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f8009a20 con 0x7f180014ac30 2023-10-08T15:41:35.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.566+0000 7f1804c5a700 1 --2- 172.21.15.3:0/3204347211 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f180006d200 0x7f180014d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:41:35.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.566+0000 7f17f7fff700 1 --2- 172.21.15.3:0/3204347211 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f180014ac30 0x7f18000a5bd0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f18000bf200 tx=0x7f17f0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:35.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.566+0000 7f17f4ff9700 1 -- 172.21.15.3:0/3204347211 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f0011900 con 0x7f180014ac30 2023-10-08T15:41:35.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.566+0000 7f1805c5c700 1 -- 172.21.15.3:0/3204347211 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17f0009420 con 0x7f180014ac30 2023-10-08T15:41:35.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.566+0000 7f17f4ff9700 1 -- 172.21.15.3:0/3204347211 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f0011a60 con 0x7f180014ac30 2023-10-08T15:41:35.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.566+0000 7f1805c5c700 1 -- 172.21.15.3:0/3204347211 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18000a2690 con 0x7f180014ac30 2023-10-08T15:41:35.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.566+0000 7f17f4ff9700 1 -- 172.21.15.3:0/3204347211 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f0025640 con 0x7f180014ac30 2023-10-08T15:41:35.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.570+0000 7f1805c5c700 1 -- 172.21.15.3:0/3204347211 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f180014ce60 con 0x7f180014ac30 2023-10-08T15:41:35.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.570+0000 7f17f4ff9700 1 -- 172.21.15.3:0/3204347211 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f17f0025a30 con 0x7f180014ac30 2023-10-08T15:41:35.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.570+0000 7f17f4ff9700 1 --2- 172.21.15.3:0/3204347211 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f17ec060550 0x7f17ec062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:35.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.570+0000 7f17f4ff9700 1 -- 172.21.15.3:0/3204347211 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f17f007df40 con 0x7f180014ac30 2023-10-08T15:41:35.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.570+0000 7f1804c5a700 1 --2- 172.21.15.3:0/3204347211 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f17ec060550 0x7f17ec062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:35.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.570+0000 7f1804c5a700 1 --2- 172.21.15.3:0/3204347211 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f17ec060550 0x7f17ec062a00 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f17fc007fd0 tx=0x7f17fc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:35.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.578+0000 7f17f4ff9700 1 -- 172.21.15.3:0/3204347211 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f180014ce60 con 0x7f180014ac30 2023-10-08T15:41:35.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:35.774+0000 7f1805c5c700 1 -- 172.21.15.3:0/3204347211 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f180014ce60 con 0x7f180014ac30 2023-10-08T15:41:36.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.426+0000 7f17f4ff9700 1 -- 172.21.15.3:0/3204347211 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v29) v1 ==== 104+0+0 (secure 0 0 0) 0x7f180014ce60 con 0x7f180014ac30 2023-10-08T15:41:36.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.434+0000 7f1805c5c700 1 -- 172.21.15.3:0/3204347211 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f17ec060550 msgr2=0x7f17ec062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:36.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.434+0000 7f1805c5c700 1 --2- 172.21.15.3:0/3204347211 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f17ec060550 0x7f17ec062a00 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f17fc007fd0 tx=0x7f17fc009040 comp rx=0 tx=0).stop 2023-10-08T15:41:36.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.434+0000 7f1805c5c700 1 -- 172.21.15.3:0/3204347211 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f180014ac30 msgr2=0x7f18000a5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:36.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.434+0000 7f1805c5c700 1 --2- 172.21.15.3:0/3204347211 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f180014ac30 0x7f18000a5bd0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f18000bf200 tx=0x7f17f0017000 comp rx=0 tx=0).stop 2023-10-08T15:41:36.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.434+0000 7f1805c5c700 1 -- 172.21.15.3:0/3204347211 shutdown_connections 2023-10-08T15:41:36.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.434+0000 7f1805c5c700 1 --2- 172.21.15.3:0/3204347211 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f17ec060550 0x7f17ec062a00 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:36.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.434+0000 7f1805c5c700 1 --2- 172.21.15.3:0/3204347211 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f180014b000 0x7f18000a6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:36.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.434+0000 7f1805c5c700 1 --2- 172.21.15.3:0/3204347211 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f180014ac30 0x7f18000a5bd0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:36.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.434+0000 7f1805c5c700 1 --2- 172.21.15.3:0/3204347211 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f180006d200 0x7f180014d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:36.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.434+0000 7f1805c5c700 1 -- 172.21.15.3:0/3204347211 >> 172.21.15.3:0/3204347211 conn(0x7f18000c1df0 msgr2=0x7f1800068b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:36.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.434+0000 7f1805c5c700 1 -- 172.21.15.3:0/3204347211 shutdown_connections 2023-10-08T15:41:36.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.434+0000 7f1805c5c700 1 -- 172.21.15.3:0/3204347211 wait complete. 2023-10-08T15:41:36.454 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-08T15:41:36.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.558+0000 7f8b273b6700 1 Processor -- start 2023-10-08T15:41:36.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.562+0000 7f8b273b6700 1 -- start start 2023-10-08T15:41:36.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.562+0000 7f8b273b6700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8b20069920 0x7f8b2006c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:36.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.562+0000 7f8b273b6700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b2014bed0 con 0x7f8b200a1200 2023-10-08T15:41:36.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.562+0000 7f8b273b6700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b2014c170 con 0x7f8b2014b6d0 2023-10-08T15:41:36.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.562+0000 7f8b273b6700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b200694d0 con 0x7f8b20069920 2023-10-08T15:41:36.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.562+0000 7f8b26bb5700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f8b200a1200 0x7f8b2006ced0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:55330/0 (socket says 172.21.15.3:55330) 2023-10-08T15:41:36.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.562+0000 7f8b26bb5700 1 -- 172.21.15.3:0/2442778810 learned_addr learned my addr 172.21.15.3:0/2442778810 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:41:36.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.562+0000 7f8b25bb3700 1 --2- 172.21.15.3:0/2442778810 >> v2:172.21.15.50:3300/0 conn(0x7f8b20069920 0x7f8b2006c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:36.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.562+0000 7f8b253b2700 1 -- 172.21.15.3:0/2442778810 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1571138476 0 0) 0x7f8b2014bed0 con 0x7f8b200a1200 2023-10-08T15:41:36.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.562+0000 7f8b253b2700 1 -- 172.21.15.3:0/2442778810 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b0c003570 con 0x7f8b200a1200 2023-10-08T15:41:36.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.562+0000 7f8b253b2700 1 -- 172.21.15.3:0/2442778810 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2143916551 0 0) 0x7f8b2014c170 con 0x7f8b2014b6d0 2023-10-08T15:41:36.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.562+0000 7f8b253b2700 1 -- 172.21.15.3:0/2442778810 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b2014bed0 con 0x7f8b2014b6d0 2023-10-08T15:41:36.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.562+0000 7f8b253b2700 1 -- 172.21.15.3:0/2442778810 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 495861499 0 0) 0x7f8b0c003570 con 0x7f8b200a1200 2023-10-08T15:41:36.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.562+0000 7f8b253b2700 1 -- 172.21.15.3:0/2442778810 >> v2:172.21.15.50:3300/0 conn(0x7f8b20069920 msgr2=0x7f8b2006c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:36.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.562+0000 7f8b253b2700 1 --2- 172.21.15.3:0/2442778810 >> v2:172.21.15.50:3300/0 conn(0x7f8b20069920 0x7f8b2006c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:36.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.562+0000 7f8b253b2700 1 -- 172.21.15.3:0/2442778810 >> v1:172.21.15.50:6789/0 conn(0x7f8b2014b6d0 legacy=0x7f8b20068d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:36.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.562+0000 7f8b253b2700 1 -- 172.21.15.3:0/2442778810 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b2014baa0 con 0x7f8b200a1200 2023-10-08T15:41:36.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.562+0000 7f8b253b2700 1 -- 172.21.15.3:0/2442778810 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2285686191 0 0) 0x7f8b1c001470 con 0x7f8b200a1200 2023-10-08T15:41:36.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.562+0000 7f8b253b2700 1 -- 172.21.15.3:0/2442778810 >> v1:172.21.15.3:6789/0 conn(0x7f8b200a1200 legacy=0x7f8b2006ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:36.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.562+0000 7f8b253b2700 1 --2- 172.21.15.3:0/2442778810 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8b0c003bf0 0x7f8b0c003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:36.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.562+0000 7f8b253b2700 1 --2- 172.21.15.3:0/2442778810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b0c004810 0x7f8b0c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:36.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.562+0000 7f8b253b2700 1 --2- 172.21.15.3:0/2442778810 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8b0c0051c0 0x7f8b0c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:36.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.562+0000 7f8b253b2700 1 -- 172.21.15.3:0/2442778810 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0c00c080 con 0x7f8b0c0051c0 2023-10-08T15:41:36.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.562+0000 7f8b253b2700 1 -- 172.21.15.3:0/2442778810 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0c00c1f0 con 0x7f8b0c004810 2023-10-08T15:41:36.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.562+0000 7f8b253b2700 1 -- 172.21.15.3:0/2442778810 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0c00c3b0 con 0x7f8b0c003bf0 2023-10-08T15:41:36.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.562+0000 7f8b26bb5700 1 --2- 172.21.15.3:0/2442778810 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8b0c0051c0 0x7f8b0c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:36.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.562+0000 7f8b25bb3700 1 --2- 172.21.15.3:0/2442778810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b0c004810 0x7f8b0c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:36.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.562+0000 7f8b263b4700 1 --2- 172.21.15.3:0/2442778810 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8b0c003bf0 0x7f8b0c003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:36.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.562+0000 7f8b26bb5700 1 -- 172.21.15.3:0/2442778810 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8b0c003bf0 msgr2=0x7f8b0c003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:36.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.562+0000 7f8b26bb5700 1 --2- 172.21.15.3:0/2442778810 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8b0c003bf0 0x7f8b0c003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:36.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.562+0000 7f8b26bb5700 1 -- 172.21.15.3:0/2442778810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b0c004810 msgr2=0x7f8b0c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:36.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.562+0000 7f8b26bb5700 1 --2- 172.21.15.3:0/2442778810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b0c004810 0x7f8b0c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:36.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.562+0000 7f8b26bb5700 1 -- 172.21.15.3:0/2442778810 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b0c003570 con 0x7f8b0c0051c0 2023-10-08T15:41:36.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.562+0000 7f8b26bb5700 1 -- 172.21.15.3:0/2442778810 reap_dead start 2023-10-08T15:41:36.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.562+0000 7f8b26bb5700 1 --2- 172.21.15.3:0/2442778810 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8b0c0051c0 0x7f8b0c00ba60 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c00c2a0 tx=0x7f8b1c001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd6454a396543976 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:36.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.562+0000 7f8b253b2700 1 -- 172.21.15.3:0/2442778810 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c00cb70 con 0x7f8b0c0051c0 2023-10-08T15:41:36.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.562+0000 7f8b253b2700 1 -- 172.21.15.3:0/2442778810 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b1c00ccd0 con 0x7f8b0c0051c0 2023-10-08T15:41:36.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.562+0000 7f8b253b2700 1 -- 172.21.15.3:0/2442778810 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c005b50 con 0x7f8b0c0051c0 2023-10-08T15:41:36.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.566+0000 7f8b273b6700 1 -- 172.21.15.3:0/2442778810 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8b0c0051c0 msgr2=0x7f8b0c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:36.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.566+0000 7f8b273b6700 1 --2- 172.21.15.3:0/2442778810 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8b0c0051c0 0x7f8b0c00ba60 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c00c2a0 tx=0x7f8b1c001e10 comp rx=0 tx=0).stop 2023-10-08T15:41:36.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.566+0000 7f8b273b6700 1 -- 172.21.15.3:0/2442778810 shutdown_connections 2023-10-08T15:41:36.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.566+0000 7f8b273b6700 1 --2- 172.21.15.3:0/2442778810 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8b0c0051c0 0x7f8b0c00ba60 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:36.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.566+0000 7f8b273b6700 1 -- 172.21.15.3:0/2442778810 >> 172.21.15.3:0/2442778810 conn(0x7f8b200a18a0 msgr2=0x7f8b200a1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:36.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.566+0000 7f8b273b6700 1 -- 172.21.15.3:0/2442778810 shutdown_connections 2023-10-08T15:41:36.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.566+0000 7f8b273b6700 1 -- 172.21.15.3:0/2442778810 wait complete. 2023-10-08T15:41:36.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.566+0000 7f8b273b6700 1 Processor -- start 2023-10-08T15:41:36.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.566+0000 7f8b273b6700 1 -- start start 2023-10-08T15:41:36.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.566+0000 7f8b273b6700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8b0c0051c0 0x7f8b2013e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:36.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.566+0000 7f8b273b6700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b2014c910 0x7f8b2015e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:36.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.566+0000 7f8b273b6700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8b2015e820 0x7f8b2015ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:36.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.566+0000 7f8b273b6700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2015f1b0 con 0x7f8b0c0051c0 2023-10-08T15:41:36.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.566+0000 7f8b273b6700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b20143b30 con 0x7f8b2014c910 2023-10-08T15:41:36.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.566+0000 7f8b273b6700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b20143790 con 0x7f8b2015e820 2023-10-08T15:41:36.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.566+0000 7f8b263b4700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8b0c0051c0 0x7f8b2013e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:36.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.566+0000 7f8b263b4700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8b0c0051c0 0x7f8b2013e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45352/0 (socket says 172.21.15.3:45352) 2023-10-08T15:41:36.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.566+0000 7f8b263b4700 1 -- 172.21.15.3:0/1056589021 learned_addr learned my addr 172.21.15.3:0/1056589021 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:36.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.570+0000 7f8b26bb5700 1 --2- 172.21.15.3:0/1056589021 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8b2015e820 0x7f8b2015ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:36.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.570+0000 7f8b25bb3700 1 --2- 172.21.15.3:0/1056589021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b2014c910 0x7f8b2015e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:36.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.570+0000 7f8b263b4700 1 -- 172.21.15.3:0/1056589021 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8b2015e820 msgr2=0x7f8b2015ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:36.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.570+0000 7f8b263b4700 1 --2- 172.21.15.3:0/1056589021 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8b2015e820 0x7f8b2015ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:36.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.570+0000 7f8b263b4700 1 -- 172.21.15.3:0/1056589021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b2014c910 msgr2=0x7f8b2015e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:36.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.570+0000 7f8b263b4700 1 --2- 172.21.15.3:0/1056589021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b2014c910 0x7f8b2015e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:36.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.570+0000 7f8b263b4700 1 -- 172.21.15.3:0/1056589021 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b201400f0 con 0x7f8b0c0051c0 2023-10-08T15:41:36.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.570+0000 7f8b263b4700 1 --2- 172.21.15.3:0/1056589021 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8b0c0051c0 0x7f8b2013e7f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f8b1800eb00 tx=0x7f8b18009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:36.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.570+0000 7f8b167fc700 1 -- 172.21.15.3:0/1056589021 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b180032e0 con 0x7f8b0c0051c0 2023-10-08T15:41:36.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.570+0000 7f8b167fc700 1 -- 172.21.15.3:0/1056589021 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b18010040 con 0x7f8b0c0051c0 2023-10-08T15:41:36.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.570+0000 7f8b273b6700 1 -- 172.21.15.3:0/1056589021 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b2013ed30 con 0x7f8b0c0051c0 2023-10-08T15:41:36.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.570+0000 7f8b167fc700 1 -- 172.21.15.3:0/1056589021 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b180016e0 con 0x7f8b0c0051c0 2023-10-08T15:41:36.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.570+0000 7f8b273b6700 1 -- 172.21.15.3:0/1056589021 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b200c2ab0 con 0x7f8b0c0051c0 2023-10-08T15:41:36.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.570+0000 7f8b273b6700 1 -- 172.21.15.3:0/1056589021 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b2005ecf0 con 0x7f8b0c0051c0 2023-10-08T15:41:36.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.570+0000 7f8b167fc700 1 -- 172.21.15.3:0/1056589021 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f8b18001ad0 con 0x7f8b0c0051c0 2023-10-08T15:41:36.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.570+0000 7f8b167fc700 1 --2- 172.21.15.3:0/1056589021 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8b04060550 0x7f8b04062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:36.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.570+0000 7f8b167fc700 1 -- 172.21.15.3:0/1056589021 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f8b1807c570 con 0x7f8b0c0051c0 2023-10-08T15:41:36.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.570+0000 7f8b25bb3700 1 --2- 172.21.15.3:0/1056589021 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8b04060550 0x7f8b04062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:36.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.574+0000 7f8b25bb3700 1 --2- 172.21.15.3:0/1056589021 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8b04060550 0x7f8b04062a00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8b10006c80 tx=0x7f8b10008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:36.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.582+0000 7f8b167fc700 1 -- 172.21.15.3:0/1056589021 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8b1804cb10 con 0x7f8b0c0051c0 2023-10-08T15:41:36.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:36.746+0000 7f8b273b6700 1 -- 172.21.15.3:0/1056589021 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8b2006d370 con 0x7f8b0c0051c0 2023-10-08T15:41:37.334 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:41:37.336 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:41:37.339 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:41:37.341 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:41:37.343 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:41:37.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.434+0000 7f8b167fc700 1 -- 172.21.15.3:0/1056589021 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v51) v1 ==== 181+0+0 (secure 0 0 0) 0x7f8b1807ae60 con 0x7f8b0c0051c0 2023-10-08T15:41:37.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.442+0000 7f8b273b6700 1 -- 172.21.15.3:0/1056589021 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8b04060550 msgr2=0x7f8b04062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:37.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.442+0000 7f8b273b6700 1 --2- 172.21.15.3:0/1056589021 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8b04060550 0x7f8b04062a00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8b10006c80 tx=0x7f8b10008040 comp rx=0 tx=0).stop 2023-10-08T15:41:37.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.442+0000 7f8b273b6700 1 -- 172.21.15.3:0/1056589021 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8b0c0051c0 msgr2=0x7f8b2013e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:37.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.442+0000 7f8b273b6700 1 --2- 172.21.15.3:0/1056589021 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8b0c0051c0 0x7f8b2013e7f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f8b1800eb00 tx=0x7f8b18009040 comp rx=0 tx=0).stop 2023-10-08T15:41:37.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.442+0000 7f8b273b6700 1 -- 172.21.15.3:0/1056589021 shutdown_connections 2023-10-08T15:41:37.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.442+0000 7f8b273b6700 1 --2- 172.21.15.3:0/1056589021 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8b04060550 0x7f8b04062a00 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:37.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.442+0000 7f8b273b6700 1 --2- 172.21.15.3:0/1056589021 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8b2015e820 0x7f8b2015ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:37.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.442+0000 7f8b273b6700 1 --2- 172.21.15.3:0/1056589021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b2014c910 0x7f8b2015e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:37.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.442+0000 7f8b273b6700 1 --2- 172.21.15.3:0/1056589021 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8b0c0051c0 0x7f8b2013e7f0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:37.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.442+0000 7f8b273b6700 1 -- 172.21.15.3:0/1056589021 >> 172.21.15.3:0/1056589021 conn(0x7f8b200a18a0 msgr2=0x7f8b200bfce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:37.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.442+0000 7f8b273b6700 1 -- 172.21.15.3:0/1056589021 shutdown_connections 2023-10-08T15:41:37.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.442+0000 7f8b273b6700 1 -- 172.21.15.3:0/1056589021 wait complete. 2023-10-08T15:41:37.449 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'cephfs_metadata' removed 2023-10-08T15:41:37.462 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-08T15:41:37.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.570+0000 7fa8fe98d700 1 Processor -- start 2023-10-08T15:41:37.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.570+0000 7fa8fe98d700 1 -- start start 2023-10-08T15:41:37.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.574+0000 7fa8fe98d700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fa8f814b6d0 0x7fa8f8068d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:37.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.574+0000 7fa8fe98d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa8f80a1200 0x7fa8f806d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:37.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.574+0000 7fa8fe98d700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8f80692a0 con 0x7fa8f8069920 2023-10-08T15:41:37.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.574+0000 7fa8fe98d700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8f80694d0 con 0x7fa8f814b6d0 2023-10-08T15:41:37.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.574+0000 7fa8fe98d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f814bed0 con 0x7fa8f80a1200 2023-10-08T15:41:37.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.574+0000 7fa8fd98b700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fa8f814b6d0 0x7fa8f8068d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:37.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.574+0000 7fa8fd18a700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fa8f8069920 0x7fa8f806c990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:47590/0 (socket says 172.21.15.3:47590) 2023-10-08T15:41:37.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.574+0000 7fa8fd18a700 1 -- 172.21.15.3:0/3749612146 learned_addr learned my addr 172.21.15.3:0/3749612146 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:41:37.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.574+0000 7fa8fe18c700 1 --2- 172.21.15.3:0/3749612146 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa8f80a1200 0x7fa8f806d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:37.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.574+0000 7fa8fc989700 1 -- 172.21.15.3:0/3749612146 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 87180640 0 0) 0x7fa8f80692a0 con 0x7fa8f8069920 2023-10-08T15:41:37.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.574+0000 7fa8fc989700 1 -- 172.21.15.3:0/3749612146 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8e4003570 con 0x7fa8f8069920 2023-10-08T15:41:37.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.574+0000 7fa8fd98b700 1 -- 172.21.15.3:0/3749612146 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa8f80a1200 msgr2=0x7fa8f806d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:37.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.574+0000 7fa8fd98b700 1 --2- 172.21.15.3:0/3749612146 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa8f80a1200 0x7fa8f806d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:37.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.574+0000 7fa8fd98b700 1 -- 172.21.15.3:0/3749612146 >> v1:172.21.15.3:6789/0 conn(0x7fa8f8069920 legacy=0x7fa8f806c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:37.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.574+0000 7fa8fd98b700 1 -- 172.21.15.3:0/3749612146 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f814c170 con 0x7fa8f814b6d0 2023-10-08T15:41:37.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.574+0000 7fa8fd98b700 1 --2- 172.21.15.3:0/3749612146 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa8f814b6d0 0x7fa8f8068d60 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fa8f40098e0 tx=0x7fa8f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4e7f9507fa6101e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:37.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.574+0000 7fa8fc989700 1 -- 172.21.15.3:0/3749612146 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f4011630 con 0x7fa8f814b6d0 2023-10-08T15:41:37.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.574+0000 7fa8fc989700 1 -- 172.21.15.3:0/3749612146 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f4011790 con 0x7fa8f814b6d0 2023-10-08T15:41:37.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.574+0000 7fa8fc989700 1 -- 172.21.15.3:0/3749612146 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f4011b30 con 0x7fa8f814b6d0 2023-10-08T15:41:37.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.574+0000 7fa8fe98d700 1 -- 172.21.15.3:0/3749612146 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa8f814b6d0 msgr2=0x7fa8f8068d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:37.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.574+0000 7fa8fe98d700 1 --2- 172.21.15.3:0/3749612146 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa8f814b6d0 0x7fa8f8068d60 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fa8f40098e0 tx=0x7fa8f40091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:37.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.574+0000 7fa8fe98d700 1 -- 172.21.15.3:0/3749612146 shutdown_connections 2023-10-08T15:41:37.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.574+0000 7fa8fe98d700 1 --2- 172.21.15.3:0/3749612146 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa8f80a1200 0x7fa8f806d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:37.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.574+0000 7fa8fe98d700 1 --2- 172.21.15.3:0/3749612146 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa8f814b6d0 0x7fa8f8068d60 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:37.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.574+0000 7fa8fe98d700 1 -- 172.21.15.3:0/3749612146 >> 172.21.15.3:0/3749612146 conn(0x7fa8f80a18a0 msgr2=0x7fa8f80a1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:37.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.574+0000 7fa8fe98d700 1 -- 172.21.15.3:0/3749612146 shutdown_connections 2023-10-08T15:41:37.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.574+0000 7fa8fe98d700 1 -- 172.21.15.3:0/3749612146 wait complete. 2023-10-08T15:41:37.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.578+0000 7fa8fe98d700 1 Processor -- start 2023-10-08T15:41:37.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.578+0000 7fa8fe98d700 1 -- start start 2023-10-08T15:41:37.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.578+0000 7fa8fe98d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa8f8069920 0x7fa8f814d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:37.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.578+0000 7fa8fe98d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8f80a1200 0x7fa8f814a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:37.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.578+0000 7fa8fe98d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa8f814b6d0 0x7fa8f815e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:37.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.578+0000 7fa8fe98d700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f8143c70 con 0x7fa8f814b6d0 2023-10-08T15:41:37.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.578+0000 7fa8fe98d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f814aa50 con 0x7fa8f80a1200 2023-10-08T15:41:37.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.578+0000 7fa8fe98d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f814e610 con 0x7fa8f8069920 2023-10-08T15:41:37.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.578+0000 7fa8fe18c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa8f814b6d0 0x7fa8f815e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:37.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.578+0000 7fa8fe18c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa8f814b6d0 0x7fa8f815e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57340/0 (socket says 172.21.15.3:57340) 2023-10-08T15:41:37.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.578+0000 7fa8fe18c700 1 -- 172.21.15.3:0/2471985694 learned_addr learned my addr 172.21.15.3:0/2471985694 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:37.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.578+0000 7fa8fd98b700 1 --2- 172.21.15.3:0/2471985694 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa8f8069920 0x7fa8f814d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:37.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.578+0000 7fa8fd18a700 1 --2- 172.21.15.3:0/2471985694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8f80a1200 0x7fa8f814a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:37.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.578+0000 7fa8fe18c700 1 -- 172.21.15.3:0/2471985694 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa8f8069920 msgr2=0x7fa8f814d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:37.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.578+0000 7fa8fe18c700 1 --2- 172.21.15.3:0/2471985694 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa8f8069920 0x7fa8f814d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:37.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.578+0000 7fa8fe18c700 1 -- 172.21.15.3:0/2471985694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8f80a1200 msgr2=0x7fa8f814a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:37.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.578+0000 7fa8fe18c700 1 --2- 172.21.15.3:0/2471985694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8f80a1200 0x7fa8f814a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:37.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.578+0000 7fa8fe18c700 1 -- 172.21.15.3:0/2471985694 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f4009420 con 0x7fa8f814b6d0 2023-10-08T15:41:37.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.578+0000 7fa8fd18a700 1 --2- 172.21.15.3:0/2471985694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8f80a1200 0x7fa8f814a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:41:37.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.578+0000 7fa8fd98b700 1 --2- 172.21.15.3:0/2471985694 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa8f8069920 0x7fa8f814d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:41:37.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.578+0000 7fa8fe18c700 1 --2- 172.21.15.3:0/2471985694 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa8f814b6d0 0x7fa8f815e5d0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fa8f0009ef0 tx=0x7fa8f000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:37.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.578+0000 7fa8e9ffb700 1 -- 172.21.15.3:0/2471985694 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f000cc50 con 0x7fa8f814b6d0 2023-10-08T15:41:37.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.578+0000 7fa8e9ffb700 1 -- 172.21.15.3:0/2471985694 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f000f040 con 0x7fa8f814b6d0 2023-10-08T15:41:37.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.578+0000 7fa8fe98d700 1 -- 172.21.15.3:0/2471985694 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8f814e2a0 con 0x7fa8f814b6d0 2023-10-08T15:41:37.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.578+0000 7fa8e9ffb700 1 -- 172.21.15.3:0/2471985694 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f0014480 con 0x7fa8f814b6d0 2023-10-08T15:41:37.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.578+0000 7fa8fe98d700 1 -- 172.21.15.3:0/2471985694 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8f81491a0 con 0x7fa8f814b6d0 2023-10-08T15:41:37.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.578+0000 7fa8fe98d700 1 -- 172.21.15.3:0/2471985694 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8f806ecb0 con 0x7fa8f814b6d0 2023-10-08T15:41:37.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.582+0000 7fa8e9ffb700 1 -- 172.21.15.3:0/2471985694 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa8f0014830 con 0x7fa8f814b6d0 2023-10-08T15:41:37.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.582+0000 7fa8e9ffb700 1 --2- 172.21.15.3:0/2471985694 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fa8dc060580 0x7fa8dc062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:37.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.582+0000 7fa8e9ffb700 1 -- 172.21.15.3:0/2471985694 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5353+0+0 (secure 0 0 0) 0x7fa8f007d710 con 0x7fa8f814b6d0 2023-10-08T15:41:37.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.582+0000 7fa8fd98b700 1 --2- 172.21.15.3:0/2471985694 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fa8dc060580 0x7fa8dc062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:37.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.582+0000 7fa8fd98b700 1 --2- 172.21.15.3:0/2471985694 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fa8dc060580 0x7fa8dc062a30 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa8f4003080 tx=0x7fa8f4017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:37.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.586+0000 7fa8e9ffb700 1 -- 172.21.15.3:0/2471985694 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa8f004dee0 con 0x7fa8f814b6d0 2023-10-08T15:41:37.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:37.750+0000 7fa8fe98d700 1 -- 172.21.15.3:0/2471985694 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa8f806ecb0 con 0x7fa8f814b6d0 2023-10-08T15:41:38.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.438+0000 7fa8e9ffb700 1 -- 172.21.15.3:0/2471985694 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v52) v1 ==== 169+0+0 (secure 0 0 0) 0x7fa8f806ecb0 con 0x7fa8f814b6d0 2023-10-08T15:41:38.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.446+0000 7fa8fe98d700 1 -- 172.21.15.3:0/2471985694 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fa8dc060580 msgr2=0x7fa8dc062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:38.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.446+0000 7fa8fe98d700 1 --2- 172.21.15.3:0/2471985694 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fa8dc060580 0x7fa8dc062a30 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa8f4003080 tx=0x7fa8f4017000 comp rx=0 tx=0).stop 2023-10-08T15:41:38.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.446+0000 7fa8fe98d700 1 -- 172.21.15.3:0/2471985694 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa8f814b6d0 msgr2=0x7fa8f815e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:38.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.446+0000 7fa8fe98d700 1 --2- 172.21.15.3:0/2471985694 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa8f814b6d0 0x7fa8f815e5d0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fa8f0009ef0 tx=0x7fa8f000b040 comp rx=0 tx=0).stop 2023-10-08T15:41:38.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.446+0000 7fa8fe98d700 1 -- 172.21.15.3:0/2471985694 shutdown_connections 2023-10-08T15:41:38.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.446+0000 7fa8fe98d700 1 --2- 172.21.15.3:0/2471985694 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fa8dc060580 0x7fa8dc062a30 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:38.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.446+0000 7fa8fe98d700 1 --2- 172.21.15.3:0/2471985694 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa8f814b6d0 0x7fa8f815e5d0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:38.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.446+0000 7fa8fe98d700 1 --2- 172.21.15.3:0/2471985694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8f80a1200 0x7fa8f814a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:38.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.446+0000 7fa8fe98d700 1 --2- 172.21.15.3:0/2471985694 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa8f8069920 0x7fa8f814d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:38.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.446+0000 7fa8fe98d700 1 -- 172.21.15.3:0/2471985694 >> 172.21.15.3:0/2471985694 conn(0x7fa8f80a18a0 msgr2=0x7fa8f8144330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:38.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.446+0000 7fa8fe98d700 1 -- 172.21.15.3:0/2471985694 shutdown_connections 2023-10-08T15:41:38.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.446+0000 7fa8fe98d700 1 -- 172.21.15.3:0/2471985694 wait complete. 2023-10-08T15:41:38.454 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'cephfs_data' removed 2023-10-08T15:41:38.469 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-08T15:41:38.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.566+0000 7fb03ac5e700 1 Processor -- start 2023-10-08T15:41:38.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.566+0000 7fb03ac5e700 1 -- start start 2023-10-08T15:41:38.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.570+0000 7fb03ac5e700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb03406e720 0x7fb034069680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:38.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.570+0000 7fb03ac5e700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb034147fe0 con 0x7fb03406eaf0 2023-10-08T15:41:38.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.570+0000 7fb03ac5e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb03406dda0 con 0x7fb03406cdc0 2023-10-08T15:41:38.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.570+0000 7fb03ac5e700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb034069bc0 con 0x7fb03406e720 2023-10-08T15:41:38.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.570+0000 7fb03945b700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fb03406eaf0 0x7fb034148470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:47592/0 (socket says 172.21.15.3:47592) 2023-10-08T15:41:38.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.570+0000 7fb039c5c700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb03406e720 0x7fb034069680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:38.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.570+0000 7fb03945b700 1 -- 172.21.15.3:0/712884500 learned_addr learned my addr 172.21.15.3:0/712884500 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:41:38.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.570+0000 7fb038c5a700 1 -- 172.21.15.3:0/712884500 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1552067225 0 0) 0x7fb034147fe0 con 0x7fb03406eaf0 2023-10-08T15:41:38.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.570+0000 7fb038c5a700 1 -- 172.21.15.3:0/712884500 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb020003570 con 0x7fb03406eaf0 2023-10-08T15:41:38.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.570+0000 7fb038c5a700 1 -- 172.21.15.3:0/712884500 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3877569141 0 0) 0x7fb03406dda0 con 0x7fb03406cdc0 2023-10-08T15:41:38.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.570+0000 7fb038c5a700 1 -- 172.21.15.3:0/712884500 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb034147fe0 con 0x7fb03406cdc0 2023-10-08T15:41:38.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.570+0000 7fb039c5c700 1 -- 172.21.15.3:0/712884500 >> v1:172.21.15.50:6789/0 conn(0x7fb03406cdc0 legacy=0x7fb03406d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:38.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.570+0000 7fb038c5a700 1 -- 172.21.15.3:0/712884500 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3136428819 0 0) 0x7fb020003570 con 0x7fb03406eaf0 2023-10-08T15:41:38.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.570+0000 7fb039c5c700 1 -- 172.21.15.3:0/712884500 >> v1:172.21.15.3:6789/0 conn(0x7fb03406eaf0 legacy=0x7fb034148470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:38.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.570+0000 7fb039c5c700 1 -- 172.21.15.3:0/712884500 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb034147990 con 0x7fb03406e720 2023-10-08T15:41:38.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.570+0000 7fb039c5c700 1 --2- 172.21.15.3:0/712884500 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb03406e720 0x7fb034069680 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fb0300098e0 tx=0x7fb0300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c11cc6970bf40339 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:38.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.570+0000 7fb038c5a700 1 -- 172.21.15.3:0/712884500 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb024001470 con 0x7fb03406e720 2023-10-08T15:41:38.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.570+0000 7fb038c5a700 1 -- 172.21.15.3:0/712884500 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb030011420 con 0x7fb03406e720 2023-10-08T15:41:38.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.570+0000 7fb038c5a700 1 -- 172.21.15.3:0/712884500 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0300117c0 con 0x7fb03406e720 2023-10-08T15:41:38.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.574+0000 7fb03ac5e700 1 -- 172.21.15.3:0/712884500 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb03406e720 msgr2=0x7fb034069680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:38.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.574+0000 7fb03ac5e700 1 --2- 172.21.15.3:0/712884500 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb03406e720 0x7fb034069680 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fb0300098e0 tx=0x7fb0300091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:38.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.574+0000 7fb03ac5e700 1 -- 172.21.15.3:0/712884500 shutdown_connections 2023-10-08T15:41:38.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.574+0000 7fb03ac5e700 1 --2- 172.21.15.3:0/712884500 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb03406e720 0x7fb034069680 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:38.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.574+0000 7fb03ac5e700 1 -- 172.21.15.3:0/712884500 >> 172.21.15.3:0/712884500 conn(0x7fb034067bb0 msgr2=0x7fb0340be200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:38.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.574+0000 7fb03ac5e700 1 -- 172.21.15.3:0/712884500 shutdown_connections 2023-10-08T15:41:38.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.574+0000 7fb03ac5e700 1 -- 172.21.15.3:0/712884500 wait complete. 2023-10-08T15:41:38.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.574+0000 7fb03ac5e700 1 Processor -- start 2023-10-08T15:41:38.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.574+0000 7fb03ac5e700 1 -- start start 2023-10-08T15:41:38.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.574+0000 7fb03ac5e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb03406cdc0 0x7fb034139ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:38.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.578+0000 7fb03ac5e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb03406e720 0x7fb0340b6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:38.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.578+0000 7fb03ac5e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb03406eaf0 0x7fb0340b6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:38.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.578+0000 7fb03ac5e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0340b4d30 con 0x7fb03406e720 2023-10-08T15:41:38.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.578+0000 7fb03ac5e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0340b4290 con 0x7fb03406eaf0 2023-10-08T15:41:38.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.578+0000 7fb03ac5e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0340b3d90 con 0x7fb03406cdc0 2023-10-08T15:41:38.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.578+0000 7fb03945b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb03406e720 0x7fb0340b6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:38.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.578+0000 7fb03945b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb03406e720 0x7fb0340b6140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57358/0 (socket says 172.21.15.3:57358) 2023-10-08T15:41:38.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.578+0000 7fb03945b700 1 -- 172.21.15.3:0/270987348 learned_addr learned my addr 172.21.15.3:0/270987348 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:38.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.578+0000 7fb039c5c700 1 --2- 172.21.15.3:0/270987348 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb03406cdc0 0x7fb034139ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:38.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.578+0000 7fb03a45d700 1 --2- 172.21.15.3:0/270987348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb03406eaf0 0x7fb0340b6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:38.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.578+0000 7fb03945b700 1 -- 172.21.15.3:0/270987348 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb03406cdc0 msgr2=0x7fb034139ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:38.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.578+0000 7fb03945b700 1 --2- 172.21.15.3:0/270987348 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb03406cdc0 0x7fb034139ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:38.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.578+0000 7fb03945b700 1 -- 172.21.15.3:0/270987348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb03406eaf0 msgr2=0x7fb0340b6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:38.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.578+0000 7fb03945b700 1 --2- 172.21.15.3:0/270987348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb03406eaf0 0x7fb0340b6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:38.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.578+0000 7fb03945b700 1 -- 172.21.15.3:0/270987348 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb030009420 con 0x7fb03406e720 2023-10-08T15:41:38.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.578+0000 7fb03945b700 1 --2- 172.21.15.3:0/270987348 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb03406e720 0x7fb0340b6140 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fb02400c960 tx=0x7fb0240019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:38.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.578+0000 7fb029ffb700 1 -- 172.21.15.3:0/270987348 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb024005b30 con 0x7fb03406e720 2023-10-08T15:41:38.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.578+0000 7fb029ffb700 1 -- 172.21.15.3:0/270987348 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb024005c90 con 0x7fb03406e720 2023-10-08T15:41:38.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.578+0000 7fb03ac5e700 1 -- 172.21.15.3:0/270987348 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb03413a430 con 0x7fb03406e720 2023-10-08T15:41:38.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.578+0000 7fb029ffb700 1 -- 172.21.15.3:0/270987348 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb024007340 con 0x7fb03406e720 2023-10-08T15:41:38.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.578+0000 7fb03ac5e700 1 -- 172.21.15.3:0/270987348 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb03413a8e0 con 0x7fb03406e720 2023-10-08T15:41:38.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.578+0000 7fb03ac5e700 1 -- 172.21.15.3:0/270987348 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb034147200 con 0x7fb03406e720 2023-10-08T15:41:38.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.582+0000 7fb029ffb700 1 -- 172.21.15.3:0/270987348 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb02401b400 con 0x7fb03406e720 2023-10-08T15:41:38.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.582+0000 7fb029ffb700 1 --2- 172.21.15.3:0/270987348 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb018060550 0x7fb018062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:38.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.582+0000 7fb029ffb700 1 -- 172.21.15.3:0/270987348 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fb02407c150 con 0x7fb03406e720 2023-10-08T15:41:38.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.582+0000 7fb039c5c700 1 --2- 172.21.15.3:0/270987348 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb018060550 0x7fb018062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:38.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.582+0000 7fb039c5c700 1 --2- 172.21.15.3:0/270987348 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb018060550 0x7fb018062a00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb0300093f0 tx=0x7fb030016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:38.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.590+0000 7fb029ffb700 1 -- 172.21.15.3:0/270987348 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb034147200 con 0x7fb03406e720 2023-10-08T15:41:38.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.778+0000 7fb03ac5e700 1 -- 172.21.15.3:0/270987348 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fb034147200 con 0x7fb03406e720 2023-10-08T15:41:38.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.786+0000 7fb029ffb700 1 -- 172.21.15.3:0/270987348 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb034147200 con 0x7fb03406e720 2023-10-08T15:41:38.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.786+0000 7fb03ac5e700 1 -- 172.21.15.3:0/270987348 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb018060550 msgr2=0x7fb018062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:38.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.786+0000 7fb03ac5e700 1 --2- 172.21.15.3:0/270987348 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb018060550 0x7fb018062a00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb0300093f0 tx=0x7fb030016000 comp rx=0 tx=0).stop 2023-10-08T15:41:38.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.786+0000 7fb03ac5e700 1 -- 172.21.15.3:0/270987348 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb03406e720 msgr2=0x7fb0340b6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:38.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.786+0000 7fb03ac5e700 1 --2- 172.21.15.3:0/270987348 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb03406e720 0x7fb0340b6140 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fb02400c960 tx=0x7fb0240019b0 comp rx=0 tx=0).stop 2023-10-08T15:41:38.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.786+0000 7fb03ac5e700 1 -- 172.21.15.3:0/270987348 shutdown_connections 2023-10-08T15:41:38.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.786+0000 7fb03ac5e700 1 --2- 172.21.15.3:0/270987348 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fb018060550 0x7fb018062a00 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:38.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.786+0000 7fb03ac5e700 1 --2- 172.21.15.3:0/270987348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb03406eaf0 0x7fb0340b6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:38.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.786+0000 7fb03ac5e700 1 --2- 172.21.15.3:0/270987348 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb03406e720 0x7fb0340b6140 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:38.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.786+0000 7fb03ac5e700 1 --2- 172.21.15.3:0/270987348 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb03406cdc0 0x7fb034139ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:38.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.786+0000 7fb03ac5e700 1 -- 172.21.15.3:0/270987348 >> 172.21.15.3:0/270987348 conn(0x7fb034067bb0 msgr2=0x7fb03413e650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:38.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.786+0000 7fb03ac5e700 1 -- 172.21.15.3:0/270987348 shutdown_connections 2023-10-08T15:41:38.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.786+0000 7fb03ac5e700 1 -- 172.21.15.3:0/270987348 wait complete. 2023-10-08T15:41:38.803 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout' 2023-10-08T15:41:38.906 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.902+0000 7f4269d39700 1 Processor -- start 2023-10-08T15:41:38.906 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.902+0000 7f4269d39700 1 -- start start 2023-10-08T15:41:38.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.902+0000 7f4269d39700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f426414b020 0x7f4264155ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:38.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.902+0000 7f4269d39700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f426414c6b0 con 0x7f426406be60 2023-10-08T15:41:38.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.902+0000 7f4269d39700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f426414dc50 con 0x7f426414ac50 2023-10-08T15:41:38.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.902+0000 7f4269d39700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f426406d350 con 0x7f426414b020 2023-10-08T15:41:38.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.902+0000 7f4263fff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f426406be60 0x7f426406cc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:47602/0 (socket says 172.21.15.3:47602) 2023-10-08T15:41:38.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.902+0000 7f4263fff700 1 -- 172.21.15.3:0/3810754887 learned_addr learned my addr 172.21.15.3:0/3810754887 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:41:38.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.902+0000 7f4269538700 1 --2- 172.21.15.3:0/3810754887 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f426414b020 0x7f4264155ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:38.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.902+0000 7f42637fe700 1 -- 172.21.15.3:0/3810754887 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3741392785 0 0) 0x7f426414c6b0 con 0x7f426406be60 2023-10-08T15:41:38.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.902+0000 7f42637fe700 1 -- 172.21.15.3:0/3810754887 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4244003570 con 0x7f426406be60 2023-10-08T15:41:38.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.902+0000 7f42637fe700 1 -- 172.21.15.3:0/3810754887 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1678210909 0 0) 0x7f426414dc50 con 0x7f426414ac50 2023-10-08T15:41:38.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.902+0000 7f42637fe700 1 -- 172.21.15.3:0/3810754887 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f426414c6b0 con 0x7f426414ac50 2023-10-08T15:41:38.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.902+0000 7f4269538700 1 -- 172.21.15.3:0/3810754887 >> v1:172.21.15.50:6789/0 conn(0x7f426414ac50 legacy=0x7f426406c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:38.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.902+0000 7f42637fe700 1 -- 172.21.15.3:0/3810754887 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1159783203 0 0) 0x7f4244003570 con 0x7f426406be60 2023-10-08T15:41:38.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.902+0000 7f4269538700 1 -- 172.21.15.3:0/3810754887 >> v1:172.21.15.3:6789/0 conn(0x7f426406be60 legacy=0x7f426406cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:38.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.902+0000 7f4269538700 1 -- 172.21.15.3:0/3810754887 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f426414c060 con 0x7f426414b020 2023-10-08T15:41:38.910 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.902+0000 7f4269538700 1 --2- 172.21.15.3:0/3810754887 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f426414b020 0x7f4264155ee0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4254009910 tx=0x7f42540091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6edfe4cc1ece40f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:38.910 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.902+0000 7f42637fe700 1 -- 172.21.15.3:0/3810754887 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424c001470 con 0x7f426414b020 2023-10-08T15:41:38.910 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.902+0000 7f42637fe700 1 -- 172.21.15.3:0/3810754887 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4254011420 con 0x7f426414b020 2023-10-08T15:41:38.910 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.902+0000 7f42637fe700 1 -- 172.21.15.3:0/3810754887 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42540117a0 con 0x7f426414b020 2023-10-08T15:41:38.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.906+0000 7f4269d39700 1 -- 172.21.15.3:0/3810754887 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f426414b020 msgr2=0x7f4264155ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:38.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.906+0000 7f4269d39700 1 --2- 172.21.15.3:0/3810754887 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f426414b020 0x7f4264155ee0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4254009910 tx=0x7f42540091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:38.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.906+0000 7f4269d39700 1 -- 172.21.15.3:0/3810754887 shutdown_connections 2023-10-08T15:41:38.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.906+0000 7f4269d39700 1 --2- 172.21.15.3:0/3810754887 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f426414b020 0x7f4264155ee0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:38.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.906+0000 7f4269d39700 1 -- 172.21.15.3:0/3810754887 >> 172.21.15.3:0/3810754887 conn(0x7f42640c1df0 msgr2=0x7f42640c21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:38.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.906+0000 7f4269d39700 1 -- 172.21.15.3:0/3810754887 shutdown_connections 2023-10-08T15:41:38.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.906+0000 7f4269d39700 1 -- 172.21.15.3:0/3810754887 wait complete. 2023-10-08T15:41:38.912 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.906+0000 7f4269d39700 1 Processor -- start 2023-10-08T15:41:38.912 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.906+0000 7f4269d39700 1 -- start start 2023-10-08T15:41:38.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.910+0000 7f4269d39700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f426406be60 0x7f4264147fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:38.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.910+0000 7f4269d39700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f426414ac50 0x7f4264145c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:38.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.910+0000 7f4269d39700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f426414b020 0x7f4264146140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:38.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.910+0000 7f4269d39700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f426409c7b0 con 0x7f426414b020 2023-10-08T15:41:38.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.910+0000 7f4269d39700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f426409bc00 con 0x7f426414ac50 2023-10-08T15:41:38.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.910+0000 7f4269d39700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f426409c4d0 con 0x7f426406be60 2023-10-08T15:41:38.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.910+0000 7f4269538700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f426414b020 0x7f4264146140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:38.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.910+0000 7f4268d37700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f426406be60 0x7f4264147fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:38.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.910+0000 7f4263fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f426414ac50 0x7f4264145c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:38.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.910+0000 7f4268d37700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f426406be60 0x7f4264147fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.3:54808/0 (socket says 172.21.15.3:54808) 2023-10-08T15:41:38.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.910+0000 7f4269538700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f426414b020 0x7f4264146140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57372/0 (socket says 172.21.15.3:57372) 2023-10-08T15:41:38.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.910+0000 7f4268d37700 1 -- 172.21.15.3:0/1330275770 learned_addr learned my addr 172.21.15.3:0/1330275770 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:38.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.910+0000 7f4263fff700 1 -- 172.21.15.3:0/1330275770 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f426406be60 msgr2=0x7f4264147fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:38.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.910+0000 7f4263fff700 1 --2- 172.21.15.3:0/1330275770 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f426406be60 0x7f4264147fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:38.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.910+0000 7f4263fff700 1 -- 172.21.15.3:0/1330275770 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f426414b020 msgr2=0x7f4264146140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:38.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.910+0000 7f4263fff700 1 --2- 172.21.15.3:0/1330275770 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f426414b020 0x7f4264146140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:38.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.910+0000 7f4263fff700 1 -- 172.21.15.3:0/1330275770 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4254009420 con 0x7f426414ac50 2023-10-08T15:41:38.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.910+0000 7f4269538700 1 --2- 172.21.15.3:0/1330275770 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f426414b020 0x7f4264146140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:41:38.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.910+0000 7f4268d37700 1 --2- 172.21.15.3:0/1330275770 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f426406be60 0x7f4264147fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:41:38.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.910+0000 7f4263fff700 1 --2- 172.21.15.3:0/1330275770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f426414ac50 0x7f4264145c00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f424c0011e0 tx=0x7f424c001a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:38.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.910+0000 7f4260ff9700 1 -- 172.21.15.3:0/1330275770 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424c007360 con 0x7f426414ac50 2023-10-08T15:41:38.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.910+0000 7f4260ff9700 1 -- 172.21.15.3:0/1330275770 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f424c0074e0 con 0x7f426414ac50 2023-10-08T15:41:38.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.910+0000 7f4269d39700 1 -- 172.21.15.3:0/1330275770 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4264146680 con 0x7f426414ac50 2023-10-08T15:41:38.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.910+0000 7f4260ff9700 1 -- 172.21.15.3:0/1330275770 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424c004830 con 0x7f426414ac50 2023-10-08T15:41:38.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.910+0000 7f4269d39700 1 -- 172.21.15.3:0/1330275770 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f426409bf70 con 0x7f426414ac50 2023-10-08T15:41:38.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.910+0000 7f4269d39700 1 -- 172.21.15.3:0/1330275770 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f426405ecf0 con 0x7f426414ac50 2023-10-08T15:41:38.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.914+0000 7f4260ff9700 1 -- 172.21.15.3:0/1330275770 <== mon.1 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f424c004c00 con 0x7f426414ac50 2023-10-08T15:41:38.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.914+0000 7f4260ff9700 1 --2- 172.21.15.3:0/1330275770 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4248060550 0x7f4248062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:38.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.914+0000 7f4260ff9700 1 -- 172.21.15.3:0/1330275770 <== mon.1 v2:172.21.15.50:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f424c07b830 con 0x7f426414ac50 2023-10-08T15:41:38.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.914+0000 7f4268d37700 1 --2- 172.21.15.3:0/1330275770 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4248060550 0x7f4248062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:38.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.914+0000 7f4268d37700 1 --2- 172.21.15.3:0/1330275770 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4248060550 0x7f4248062a00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f425c007fd0 tx=0x7f425c002820 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:38.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:38.926+0000 7f4260ff9700 1 -- 172.21.15.3:0/1330275770 <== mon.1 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f424c04c120 con 0x7f426414ac50 2023-10-08T15:41:39.150 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.146+0000 7f4269d39700 1 -- 172.21.15.3:0/1330275770 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout"]} v 0) v1 -- 0x7f426414c340 con 0x7f426414ac50 2023-10-08T15:41:39.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.450+0000 7f4260ff9700 1 -- 172.21.15.3:0/1330275770 <== mon.1 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout"]}]=0 v193) v1 ==== 152+0+0 (secure 0 0 0) 0x7f424c04f740 con 0x7f426414ac50 2023-10-08T15:41:39.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.454+0000 7f4269d39700 1 -- 172.21.15.3:0/1330275770 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4248060550 msgr2=0x7f4248062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:39.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.454+0000 7f4269d39700 1 --2- 172.21.15.3:0/1330275770 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4248060550 0x7f4248062a00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f425c007fd0 tx=0x7f425c002820 comp rx=0 tx=0).stop 2023-10-08T15:41:39.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.454+0000 7f4269d39700 1 -- 172.21.15.3:0/1330275770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f426414ac50 msgr2=0x7f4264145c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:39.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.454+0000 7f4269d39700 1 --2- 172.21.15.3:0/1330275770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f426414ac50 0x7f4264145c00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f424c0011e0 tx=0x7f424c001a20 comp rx=0 tx=0).stop 2023-10-08T15:41:39.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.454+0000 7f4269d39700 1 -- 172.21.15.3:0/1330275770 shutdown_connections 2023-10-08T15:41:39.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.454+0000 7f4269d39700 1 --2- 172.21.15.3:0/1330275770 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4248060550 0x7f4248062a00 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:39.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.454+0000 7f4269d39700 1 --2- 172.21.15.3:0/1330275770 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f426414b020 0x7f4264146140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:39.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.454+0000 7f4269d39700 1 --2- 172.21.15.3:0/1330275770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f426414ac50 0x7f4264145c00 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:39.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.454+0000 7f4269d39700 1 --2- 172.21.15.3:0/1330275770 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f426406be60 0x7f4264147fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:39.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.454+0000 7f4269d39700 1 -- 172.21.15.3:0/1330275770 >> 172.21.15.3:0/1330275770 conn(0x7f42640c1df0 msgr2=0x7f426406c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:39.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.454+0000 7f4269d39700 1 -- 172.21.15.3:0/1330275770 shutdown_connections 2023-10-08T15:41:39.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.454+0000 7f4269d39700 1 -- 172.21.15.3:0/1330275770 wait complete. 2023-10-08T15:41:39.477 INFO:tasks.cephfs_test_runner:Check drop cache command with non-responding client using tell ... ok 2023-10-08T15:41:39.477 INFO:tasks.cephfs_test_runner:Starting test: test_drop_cache_command_timeout (tasks.cephfs.test_misc.TestCacheDrop) Basic test for checking drop cache command. 2023-10-08T15:41:39.478 INFO:tasks.cephfs_test_runner:test_drop_cache_command_timeout (tasks.cephfs.test_misc.TestCacheDrop) 2023-10-08T15:41:39.478 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout' 2023-10-08T15:41:39.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.582+0000 7f850533d700 1 Processor -- start 2023-10-08T15:41:39.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.582+0000 7f850533d700 1 -- start start 2023-10-08T15:41:39.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.586+0000 7f850533d700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f85000bacf0 0x7f8500153860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:39.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.586+0000 7f850533d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f850009e520 0x7f850006c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:39.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.586+0000 7f850533d700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f850014fe30 con 0x7f85000bb0c0 2023-10-08T15:41:39.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.586+0000 7f850533d700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f850009f0e0 con 0x7f85000bacf0 2023-10-08T15:41:39.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.586+0000 7f850533d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f850014f8b0 con 0x7f850009e520 2023-10-08T15:41:39.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.586+0000 7f84ff7fe700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f85000bb0c0 0x7f85001502c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:47606/0 (socket says 172.21.15.3:47606) 2023-10-08T15:41:39.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.586+0000 7f84ff7fe700 1 -- 172.21.15.3:0/3694165928 learned_addr learned my addr 172.21.15.3:0/3694165928 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:41:39.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.586+0000 7f84fffff700 1 --2- 172.21.15.3:0/3694165928 >> v2:172.21.15.3:3300/0 conn(0x7f85000bacf0 0x7f8500153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:39.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.586+0000 7f84feffd700 1 -- 172.21.15.3:0/3694165928 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2651766509 0 0) 0x7f850014fe30 con 0x7f85000bb0c0 2023-10-08T15:41:39.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.586+0000 7f8504b3c700 1 --2- 172.21.15.3:0/3694165928 >> v2:172.21.15.50:3300/0 conn(0x7f850009e520 0x7f850006c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:39.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.586+0000 7f84feffd700 1 -- 172.21.15.3:0/3694165928 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84e8003570 con 0x7f85000bb0c0 2023-10-08T15:41:39.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.586+0000 7f84feffd700 1 -- 172.21.15.3:0/3694165928 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1605553272 0 0) 0x7f84e8003570 con 0x7f85000bb0c0 2023-10-08T15:41:39.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.586+0000 7f84feffd700 1 -- 172.21.15.3:0/3694165928 >> v2:172.21.15.50:3300/0 conn(0x7f850009e520 msgr2=0x7f850006c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:39.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.586+0000 7f84feffd700 1 --2- 172.21.15.3:0/3694165928 >> v2:172.21.15.50:3300/0 conn(0x7f850009e520 0x7f850006c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:39.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.586+0000 7f84feffd700 1 -- 172.21.15.3:0/3694165928 >> v2:172.21.15.3:3300/0 conn(0x7f85000bacf0 msgr2=0x7f8500153860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:39.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.586+0000 7f84feffd700 1 --2- 172.21.15.3:0/3694165928 >> v2:172.21.15.3:3300/0 conn(0x7f85000bacf0 0x7f8500153860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:39.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.586+0000 7f84feffd700 1 -- 172.21.15.3:0/3694165928 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f850014fac0 con 0x7f85000bb0c0 2023-10-08T15:41:39.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.586+0000 7f84feffd700 1 -- 172.21.15.3:0/3694165928 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2285686191 0 0) 0x7f84f00017f0 con 0x7f85000bb0c0 2023-10-08T15:41:39.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.586+0000 7f84feffd700 1 -- 172.21.15.3:0/3694165928 >> v1:172.21.15.3:6789/0 conn(0x7f85000bb0c0 legacy=0x7f85001502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:39.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.586+0000 7f84feffd700 1 --2- 172.21.15.3:0/3694165928 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f84e8003a60 0x7f84e8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:39.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.586+0000 7f84feffd700 1 --2- 172.21.15.3:0/3694165928 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84e8004810 0x7f84e8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:39.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.586+0000 7f84feffd700 1 --2- 172.21.15.3:0/3694165928 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f84e80051c0 0x7f84e800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:39.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.586+0000 7f84feffd700 1 -- 172.21.15.3:0/3694165928 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f850014f8b0 con 0x7f84e8003a60 2023-10-08T15:41:39.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.586+0000 7f84feffd700 1 -- 172.21.15.3:0/3694165928 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e800bfd0 con 0x7f84e8004810 2023-10-08T15:41:39.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.586+0000 7f84feffd700 1 -- 172.21.15.3:0/3694165928 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84e800c190 con 0x7f84e80051c0 2023-10-08T15:41:39.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.586+0000 7f84fffff700 1 --2- 172.21.15.3:0/3694165928 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f84e8003a60 0x7f84e8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:39.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.586+0000 7f8504b3c700 1 --2- 172.21.15.3:0/3694165928 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f84e80051c0 0x7f84e800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:39.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.586+0000 7f84ff7fe700 1 --2- 172.21.15.3:0/3694165928 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84e8004810 0x7f84e8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:39.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.586+0000 7f84fffff700 1 -- 172.21.15.3:0/3694165928 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f84e80051c0 msgr2=0x7f84e800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:39.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.586+0000 7f84fffff700 1 --2- 172.21.15.3:0/3694165928 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f84e80051c0 0x7f84e800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:39.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.586+0000 7f84fffff700 1 -- 172.21.15.3:0/3694165928 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84e8004810 msgr2=0x7f84e8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:39.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.586+0000 7f84fffff700 1 --2- 172.21.15.3:0/3694165928 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84e8004810 0x7f84e8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:39.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.586+0000 7f8504b3c700 1 -- 172.21.15.3:0/3694165928 reap_dead start 2023-10-08T15:41:39.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.586+0000 7f84fffff700 1 -- 172.21.15.3:0/3694165928 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e8003570 con 0x7f84e8003a60 2023-10-08T15:41:39.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.586+0000 7f84fffff700 1 --2- 172.21.15.3:0/3694165928 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f84e8003a60 0x7f84e8003e70 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f84f4009c00 tx=0x7f84f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a17ff7b52ae75ce server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:39.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.586+0000 7f84feffd700 1 -- 172.21.15.3:0/3694165928 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f400e710 con 0x7f84e8003a60 2023-10-08T15:41:39.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.586+0000 7f84feffd700 1 -- 172.21.15.3:0/3694165928 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f400e870 con 0x7f84e8003a60 2023-10-08T15:41:39.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.586+0000 7f84feffd700 1 -- 172.21.15.3:0/3694165928 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f400ec30 con 0x7f84e8003a60 2023-10-08T15:41:39.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.586+0000 7f850533d700 1 -- 172.21.15.3:0/3694165928 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f84e8003a60 msgr2=0x7f84e8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:39.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.586+0000 7f850533d700 1 --2- 172.21.15.3:0/3694165928 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f84e8003a60 0x7f84e8003e70 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f84f4009c00 tx=0x7f84f40091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:39.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.586+0000 7f850533d700 1 -- 172.21.15.3:0/3694165928 shutdown_connections 2023-10-08T15:41:39.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.586+0000 7f850533d700 1 --2- 172.21.15.3:0/3694165928 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f84e8003a60 0x7f84e8003e70 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:39.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.586+0000 7f850533d700 1 -- 172.21.15.3:0/3694165928 >> 172.21.15.3:0/3694165928 conn(0x7f85000be4a0 msgr2=0x7f85000ba440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:39.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.590+0000 7f850533d700 1 -- 172.21.15.3:0/3694165928 shutdown_connections 2023-10-08T15:41:39.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.590+0000 7f850533d700 1 -- 172.21.15.3:0/3694165928 wait complete. 2023-10-08T15:41:39.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.590+0000 7f850533d700 1 Processor -- start 2023-10-08T15:41:39.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.590+0000 7f850533d700 1 -- start start 2023-10-08T15:41:39.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.590+0000 7f850533d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f84e8003a60 0x7f8500145f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:39.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.590+0000 7f850533d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8500145a80 0x7f850014c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:39.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.590+0000 7f850533d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f85000a2cf0 0x7f8500144d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:39.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.590+0000 7f850533d700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8500149210 con 0x7f85000a2cf0 2023-10-08T15:41:39.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.590+0000 7f850533d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85000a1fe0 con 0x7f8500145a80 2023-10-08T15:41:39.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.590+0000 7f850533d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f850014c690 con 0x7f84e8003a60 2023-10-08T15:41:39.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.590+0000 7f8504b3c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f85000a2cf0 0x7f8500144d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:39.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.590+0000 7f8504b3c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f85000a2cf0 0x7f8500144d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57396/0 (socket says 172.21.15.3:57396) 2023-10-08T15:41:39.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.590+0000 7f8504b3c700 1 -- 172.21.15.3:0/528136306 learned_addr learned my addr 172.21.15.3:0/528136306 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:39.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.590+0000 7f84fffff700 1 --2- 172.21.15.3:0/528136306 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f84e8003a60 0x7f8500145f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:39.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.590+0000 7f84ff7fe700 1 --2- 172.21.15.3:0/528136306 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8500145a80 0x7f850014c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:39.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.590+0000 7f8504b3c700 1 -- 172.21.15.3:0/528136306 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f84e8003a60 msgr2=0x7f8500145f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:39.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.590+0000 7f8504b3c700 1 --2- 172.21.15.3:0/528136306 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f84e8003a60 0x7f8500145f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:39.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.590+0000 7f8504b3c700 1 -- 172.21.15.3:0/528136306 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8500145a80 msgr2=0x7f850014c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:39.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.590+0000 7f8504b3c700 1 --2- 172.21.15.3:0/528136306 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8500145a80 0x7f850014c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:39.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.590+0000 7f8504b3c700 1 -- 172.21.15.3:0/528136306 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85000a21f0 con 0x7f85000a2cf0 2023-10-08T15:41:39.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.590+0000 7f84ff7fe700 1 --2- 172.21.15.3:0/528136306 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8500145a80 0x7f850014c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:39.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.590+0000 7f8504b3c700 1 --2- 172.21.15.3:0/528136306 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f85000a2cf0 0x7f8500144d70 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f85000a3170 tx=0x7f84f8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:39.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.594+0000 7f84e7fff700 1 -- 172.21.15.3:0/528136306 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f8015670 con 0x7f85000a2cf0 2023-10-08T15:41:39.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.594+0000 7f84e7fff700 1 -- 172.21.15.3:0/528136306 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f80157d0 con 0x7f85000a2cf0 2023-10-08T15:41:39.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.594+0000 7f850533d700 1 -- 172.21.15.3:0/528136306 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85000a1060 con 0x7f85000a2cf0 2023-10-08T15:41:39.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.594+0000 7f84e7fff700 1 -- 172.21.15.3:0/528136306 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f8015bd0 con 0x7f85000a2cf0 2023-10-08T15:41:39.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.594+0000 7f850533d700 1 -- 172.21.15.3:0/528136306 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85001454d0 con 0x7f85000a2cf0 2023-10-08T15:41:39.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.594+0000 7f850533d700 1 -- 172.21.15.3:0/528136306 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f850005ecf0 con 0x7f85000a2cf0 2023-10-08T15:41:39.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.594+0000 7f84e7fff700 1 -- 172.21.15.3:0/528136306 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f84f8020460 con 0x7f85000a2cf0 2023-10-08T15:41:39.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.594+0000 7f84e7fff700 1 --2- 172.21.15.3:0/528136306 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f84ec060550 0x7f84ec062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:39.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.594+0000 7f84e7fff700 1 -- 172.21.15.3:0/528136306 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f84f807c5f0 con 0x7f85000a2cf0 2023-10-08T15:41:39.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.594+0000 7f84fffff700 1 --2- 172.21.15.3:0/528136306 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f84ec060550 0x7f84ec062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:39.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.598+0000 7f84fffff700 1 --2- 172.21.15.3:0/528136306 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f84ec060550 0x7f84ec062a00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f84f40091e0 tx=0x7f84f401a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:39.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.602+0000 7f84e7fff700 1 -- 172.21.15.3:0/528136306 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f84f804ce40 con 0x7f85000a2cf0 2023-10-08T15:41:39.830 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:39.826+0000 7f850533d700 1 -- 172.21.15.3:0/528136306 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout"]} v 0) v1 -- 0x7f850009eb80 con 0x7f85000a2cf0 2023-10-08T15:41:40.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.454+0000 7f84e7fff700 1 -- 172.21.15.3:0/528136306 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout"]}]=0 v194) v1 ==== 150+0+0 (secure 0 0 0) 0x7f84f8050460 con 0x7f85000a2cf0 2023-10-08T15:41:40.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.458+0000 7f850533d700 1 -- 172.21.15.3:0/528136306 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f84ec060550 msgr2=0x7f84ec062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:40.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.458+0000 7f850533d700 1 --2- 172.21.15.3:0/528136306 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f84ec060550 0x7f84ec062a00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f84f40091e0 tx=0x7f84f401a000 comp rx=0 tx=0).stop 2023-10-08T15:41:40.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.458+0000 7f850533d700 1 -- 172.21.15.3:0/528136306 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f85000a2cf0 msgr2=0x7f8500144d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:40.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.458+0000 7f850533d700 1 --2- 172.21.15.3:0/528136306 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f85000a2cf0 0x7f8500144d70 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f85000a3170 tx=0x7f84f8008040 comp rx=0 tx=0).stop 2023-10-08T15:41:40.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.458+0000 7f850533d700 1 -- 172.21.15.3:0/528136306 shutdown_connections 2023-10-08T15:41:40.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.458+0000 7f850533d700 1 --2- 172.21.15.3:0/528136306 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f84ec060550 0x7f84ec062a00 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:40.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.458+0000 7f850533d700 1 --2- 172.21.15.3:0/528136306 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f85000a2cf0 0x7f8500144d70 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:40.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.458+0000 7f850533d700 1 --2- 172.21.15.3:0/528136306 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8500145a80 0x7f850014c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:40.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.458+0000 7f850533d700 1 --2- 172.21.15.3:0/528136306 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f84e8003a60 0x7f8500145f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:40.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.458+0000 7f850533d700 1 -- 172.21.15.3:0/528136306 >> 172.21.15.3:0/528136306 conn(0x7f85000be4a0 msgr2=0x7f850014cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:40.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.458+0000 7f850533d700 1 -- 172.21.15.3:0/528136306 shutdown_connections 2023-10-08T15:41:40.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.458+0000 7f850533d700 1 -- 172.21.15.3:0/528136306 wait complete. 2023-10-08T15:41:40.480 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-08T15:41:40.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.598+0000 7f7a3dd90700 1 Processor -- start 2023-10-08T15:41:40.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.598+0000 7f7a3dd90700 1 -- start start 2023-10-08T15:41:40.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.598+0000 7f7a3dd90700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f7a38069ed0 0x7f7a3814bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:40.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.598+0000 7f7a3dd90700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7a380699c0 0x7f7a3814c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:40.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.598+0000 7f7a3dd90700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a3814bb10 con 0x7f7a381479f0 2023-10-08T15:41:40.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.598+0000 7f7a3dd90700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a3806dcc0 con 0x7f7a38069ed0 2023-10-08T15:41:40.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.598+0000 7f7a3dd90700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a381494d0 con 0x7f7a380699c0 2023-10-08T15:41:40.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.598+0000 7f7a36ffd700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f7a38069ed0 0x7f7a3814bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:40.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.598+0000 7f7a377fe700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f7a381479f0 0x7f7a38067bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:47610/0 (socket says 172.21.15.3:47610) 2023-10-08T15:41:40.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.598+0000 7f7a377fe700 1 -- 172.21.15.3:0/3257367834 learned_addr learned my addr 172.21.15.3:0/3257367834 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:41:40.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.598+0000 7f7a37fff700 1 --2- 172.21.15.3:0/3257367834 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7a380699c0 0x7f7a3814c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:40.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.598+0000 7f7a367fc700 1 -- 172.21.15.3:0/3257367834 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2491646259 0 0) 0x7f7a3814bb10 con 0x7f7a381479f0 2023-10-08T15:41:40.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.598+0000 7f7a36ffd700 1 -- 172.21.15.3:0/3257367834 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7a380699c0 msgr2=0x7f7a3814c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:40.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.598+0000 7f7a36ffd700 1 --2- 172.21.15.3:0/3257367834 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7a380699c0 0x7f7a3814c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:40.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.598+0000 7f7a36ffd700 1 -- 172.21.15.3:0/3257367834 >> v1:172.21.15.3:6789/0 conn(0x7f7a381479f0 legacy=0x7f7a38067bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:40.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.598+0000 7f7a36ffd700 1 -- 172.21.15.3:0/3257367834 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a3806d9e0 con 0x7f7a38069ed0 2023-10-08T15:41:40.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.598+0000 7f7a36ffd700 1 --2- 172.21.15.3:0/3257367834 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7a38069ed0 0x7f7a3814bfa0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c0098e0 tx=0x7f7a2c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99bde4609cc41049 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:40.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.598+0000 7f7a367fc700 1 -- 172.21.15.3:0/3257367834 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c00b640 con 0x7f7a38069ed0 2023-10-08T15:41:40.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.598+0000 7f7a367fc700 1 -- 172.21.15.3:0/3257367834 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2c00b7a0 con 0x7f7a38069ed0 2023-10-08T15:41:40.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.598+0000 7f7a367fc700 1 -- 172.21.15.3:0/3257367834 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c00bb40 con 0x7f7a38069ed0 2023-10-08T15:41:40.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.602+0000 7f7a3dd90700 1 -- 172.21.15.3:0/3257367834 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7a38069ed0 msgr2=0x7f7a3814bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:40.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.602+0000 7f7a3dd90700 1 --2- 172.21.15.3:0/3257367834 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7a38069ed0 0x7f7a3814bfa0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c0098e0 tx=0x7f7a2c0091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:40.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.602+0000 7f7a3dd90700 1 -- 172.21.15.3:0/3257367834 shutdown_connections 2023-10-08T15:41:40.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.602+0000 7f7a3dd90700 1 --2- 172.21.15.3:0/3257367834 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7a380699c0 0x7f7a3814c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:40.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.602+0000 7f7a3dd90700 1 --2- 172.21.15.3:0/3257367834 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7a38069ed0 0x7f7a3814bfa0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:40.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.602+0000 7f7a3dd90700 1 -- 172.21.15.3:0/3257367834 >> 172.21.15.3:0/3257367834 conn(0x7f7a380670e0 msgr2=0x7f7a380674e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:40.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.602+0000 7f7a3dd90700 1 -- 172.21.15.3:0/3257367834 shutdown_connections 2023-10-08T15:41:40.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.602+0000 7f7a3dd90700 1 -- 172.21.15.3:0/3257367834 wait complete. 2023-10-08T15:41:40.608 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.602+0000 7f7a3dd90700 1 Processor -- start 2023-10-08T15:41:40.608 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.602+0000 7f7a3dd90700 1 -- start start 2023-10-08T15:41:40.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.602+0000 7f7a3dd90700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7a380699c0 0x7f7a38159de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:40.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.602+0000 7f7a3dd90700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7a38069ed0 0x7f7a3814c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:40.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.602+0000 7f7a3dd90700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a381479f0 0x7f7a3814d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:40.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.602+0000 7f7a3dd90700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a380b9070 con 0x7f7a38069ed0 2023-10-08T15:41:40.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.602+0000 7f7a3dd90700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3814bfa0 con 0x7f7a381479f0 2023-10-08T15:41:40.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.602+0000 7f7a3dd90700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3814c560 con 0x7f7a380699c0 2023-10-08T15:41:40.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.602+0000 7f7a36ffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7a38069ed0 0x7f7a3814c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:40.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.602+0000 7f7a36ffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7a38069ed0 0x7f7a3814c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57408/0 (socket says 172.21.15.3:57408) 2023-10-08T15:41:40.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.602+0000 7f7a36ffd700 1 -- 172.21.15.3:0/3495292400 learned_addr learned my addr 172.21.15.3:0/3495292400 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:40.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.602+0000 7f7a377fe700 1 --2- 172.21.15.3:0/3495292400 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7a380699c0 0x7f7a38159de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:40.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.602+0000 7f7a37fff700 1 --2- 172.21.15.3:0/3495292400 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a381479f0 0x7f7a3814d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:40.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.602+0000 7f7a36ffd700 1 -- 172.21.15.3:0/3495292400 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7a380699c0 msgr2=0x7f7a38159de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:40.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.602+0000 7f7a36ffd700 1 --2- 172.21.15.3:0/3495292400 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7a380699c0 0x7f7a38159de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:40.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.602+0000 7f7a36ffd700 1 -- 172.21.15.3:0/3495292400 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a381479f0 msgr2=0x7f7a3814d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:40.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.602+0000 7f7a36ffd700 1 --2- 172.21.15.3:0/3495292400 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a381479f0 0x7f7a3814d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:40.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.602+0000 7f7a36ffd700 1 -- 172.21.15.3:0/3495292400 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a2c009420 con 0x7f7a38069ed0 2023-10-08T15:41:40.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.606+0000 7f7a36ffd700 1 --2- 172.21.15.3:0/3495292400 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7a38069ed0 0x7f7a3814c9f0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c013000 tx=0x7f7a2c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:40.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.606+0000 7f7a1f7fe700 1 -- 172.21.15.3:0/3495292400 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c01f070 con 0x7f7a38069ed0 2023-10-08T15:41:40.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.606+0000 7f7a3dd90700 1 -- 172.21.15.3:0/3495292400 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a3814c1f0 con 0x7f7a38069ed0 2023-10-08T15:41:40.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.606+0000 7f7a1f7fe700 1 -- 172.21.15.3:0/3495292400 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2c002f30 con 0x7f7a38069ed0 2023-10-08T15:41:40.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.606+0000 7f7a3dd90700 1 -- 172.21.15.3:0/3495292400 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a3814d0d0 con 0x7f7a38069ed0 2023-10-08T15:41:40.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.606+0000 7f7a1f7fe700 1 -- 172.21.15.3:0/3495292400 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c006af0 con 0x7f7a38069ed0 2023-10-08T15:41:40.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.606+0000 7f7a3dd90700 1 -- 172.21.15.3:0/3495292400 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a3814c6f0 con 0x7f7a38069ed0 2023-10-08T15:41:40.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.606+0000 7f7a1f7fe700 1 -- 172.21.15.3:0/3495292400 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f7a2c023070 con 0x7f7a38069ed0 2023-10-08T15:41:40.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.606+0000 7f7a1f7fe700 1 --2- 172.21.15.3:0/3495292400 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7a24060550 0x7f7a24062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:40.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.606+0000 7f7a1f7fe700 1 -- 172.21.15.3:0/3495292400 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f7a2c07dad0 con 0x7f7a38069ed0 2023-10-08T15:41:40.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.606+0000 7f7a377fe700 1 --2- 172.21.15.3:0/3495292400 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7a24060550 0x7f7a24062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:40.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.610+0000 7f7a377fe700 1 --2- 172.21.15.3:0/3495292400 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7a24060550 0x7f7a24062a00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7a3815d9f0 tx=0x7f7a28007f50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:40.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.614+0000 7f7a1f7fe700 1 -- 172.21.15.3:0/3495292400 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7a2c04e3c0 con 0x7f7a38069ed0 2023-10-08T15:41:40.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.778+0000 7f7a3dd90700 1 -- 172.21.15.3:0/3495292400 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f7a3815a320 con 0x7f7a38069ed0 2023-10-08T15:41:40.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.786+0000 7f7a1f7fe700 1 -- 172.21.15.3:0/3495292400 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7a2c02a020 con 0x7f7a38069ed0 2023-10-08T15:41:40.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.786+0000 7f7a3dd90700 1 -- 172.21.15.3:0/3495292400 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7a24060550 msgr2=0x7f7a24062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:40.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.786+0000 7f7a3dd90700 1 --2- 172.21.15.3:0/3495292400 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7a24060550 0x7f7a24062a00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7a3815d9f0 tx=0x7f7a28007f50 comp rx=0 tx=0).stop 2023-10-08T15:41:40.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.786+0000 7f7a3dd90700 1 -- 172.21.15.3:0/3495292400 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7a38069ed0 msgr2=0x7f7a3814c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:40.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.786+0000 7f7a3dd90700 1 --2- 172.21.15.3:0/3495292400 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7a38069ed0 0x7f7a3814c9f0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c013000 tx=0x7f7a2c017000 comp rx=0 tx=0).stop 2023-10-08T15:41:40.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.786+0000 7f7a3dd90700 1 -- 172.21.15.3:0/3495292400 shutdown_connections 2023-10-08T15:41:40.794 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.786+0000 7f7a3dd90700 1 --2- 172.21.15.3:0/3495292400 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7a24060550 0x7f7a24062a00 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:40.794 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.786+0000 7f7a3dd90700 1 --2- 172.21.15.3:0/3495292400 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a381479f0 0x7f7a3814d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:40.794 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.786+0000 7f7a3dd90700 1 --2- 172.21.15.3:0/3495292400 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7a38069ed0 0x7f7a3814c9f0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:40.794 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.786+0000 7f7a3dd90700 1 --2- 172.21.15.3:0/3495292400 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7a380699c0 0x7f7a38159de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:40.794 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.786+0000 7f7a3dd90700 1 -- 172.21.15.3:0/3495292400 >> 172.21.15.3:0/3495292400 conn(0x7f7a380670e0 msgr2=0x7f7a38067b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:40.794 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.786+0000 7f7a3dd90700 1 -- 172.21.15.3:0/3495292400 shutdown_connections 2023-10-08T15:41:40.794 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:40.786+0000 7f7a3dd90700 1 -- 172.21.15.3:0/3495292400 wait complete. 2023-10-08T15:41:40.810 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T15:41:40.810 DEBUG:teuthology.orchestra.run.smithi003:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T15:41:40.826 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T15:41:40.847 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T15:41:40.868 DEBUG:teuthology.orchestra.run.smithi098:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T15:41:40.888 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T15:41:40.910 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T15:41:40.910 INFO:tasks.cephfs.cephfs_test_case:[, , ] 2023-10-08T15:41:40.910 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:41:41.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.022+0000 7fd2af0c7700 1 Processor -- start 2023-10-08T15:41:41.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.022+0000 7fd2af0c7700 1 -- start start 2023-10-08T15:41:41.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.022+0000 7fd2af0c7700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fd2a80a1fd0 0x7fd2a8148330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:41.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.022+0000 7fd2af0c7700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd2a80bc4f0 0x7fd2a8147280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:41.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.022+0000 7fd2af0c7700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2a80b3b10 con 0x7fd2a814c6c0 2023-10-08T15:41:41.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.022+0000 7fd2af0c7700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2a814b9d0 con 0x7fd2a80a1fd0 2023-10-08T15:41:41.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.022+0000 7fd2af0c7700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a814bbe0 con 0x7fd2a80bc4f0 2023-10-08T15:41:41.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.022+0000 7fd2ace63700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fd2a80a1fd0 0x7fd2a8148330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:41.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.022+0000 7fd2a7fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd2a814c6c0 0x7fd2a8148870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.3:42564/0 (socket says 172.21.15.3:42564) 2023-10-08T15:41:41.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.022+0000 7fd2a7fff700 1 -- 172.21.15.3:0/3275884433 learned_addr learned my addr 172.21.15.3:0/3275884433 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:41:41.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.022+0000 7fd2ad664700 1 --2- 172.21.15.3:0/3275884433 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd2a80bc4f0 0x7fd2a8147280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:41.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.022+0000 7fd2a77fe700 1 -- 172.21.15.3:0/3275884433 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 857430773 0 0) 0x7fd2a80b3b10 con 0x7fd2a814c6c0 2023-10-08T15:41:41.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.022+0000 7fd2ace63700 1 -- 172.21.15.3:0/3275884433 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd2a80bc4f0 msgr2=0x7fd2a8147280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:41.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.022+0000 7fd2ace63700 1 --2- 172.21.15.3:0/3275884433 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd2a80bc4f0 0x7fd2a8147280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:41.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.022+0000 7fd2ace63700 1 -- 172.21.15.3:0/3275884433 >> v1:172.21.15.50:6789/0 conn(0x7fd2a814c6c0 legacy=0x7fd2a8148870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:41.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.026+0000 7fd2ace63700 1 -- 172.21.15.3:0/3275884433 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a814bec0 con 0x7fd2a80a1fd0 2023-10-08T15:41:41.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.026+0000 7fd2ace63700 1 --2- 172.21.15.3:0/3275884433 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd2a80a1fd0 0x7fd2a8148330 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fd2a814bb10 tx=0x7fd2900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e3db35ad09fd72a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:41.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.026+0000 7fd2a77fe700 1 -- 172.21.15.3:0/3275884433 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd290011630 con 0x7fd2a80a1fd0 2023-10-08T15:41:41.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.026+0000 7fd2a77fe700 1 -- 172.21.15.3:0/3275884433 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd290011790 con 0x7fd2a80a1fd0 2023-10-08T15:41:41.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.026+0000 7fd2a77fe700 1 -- 172.21.15.3:0/3275884433 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd290011b50 con 0x7fd2a80a1fd0 2023-10-08T15:41:41.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.026+0000 7fd2af0c7700 1 -- 172.21.15.3:0/3275884433 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd2a80a1fd0 msgr2=0x7fd2a8148330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:41.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.026+0000 7fd2af0c7700 1 --2- 172.21.15.3:0/3275884433 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd2a80a1fd0 0x7fd2a8148330 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fd2a814bb10 tx=0x7fd2900091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:41.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.026+0000 7fd2af0c7700 1 -- 172.21.15.3:0/3275884433 shutdown_connections 2023-10-08T15:41:41.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.026+0000 7fd2af0c7700 1 --2- 172.21.15.3:0/3275884433 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd2a80bc4f0 0x7fd2a8147280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:41.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.026+0000 7fd2af0c7700 1 --2- 172.21.15.3:0/3275884433 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd2a80a1fd0 0x7fd2a8148330 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:41.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.026+0000 7fd2af0c7700 1 -- 172.21.15.3:0/3275884433 >> 172.21.15.3:0/3275884433 conn(0x7fd2a806b9b0 msgr2=0x7fd2a80681f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:41.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.026+0000 7fd2af0c7700 1 -- 172.21.15.3:0/3275884433 shutdown_connections 2023-10-08T15:41:41.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.026+0000 7fd2af0c7700 1 -- 172.21.15.3:0/3275884433 wait complete. 2023-10-08T15:41:41.033 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.030+0000 7fd2af0c7700 1 Processor -- start 2023-10-08T15:41:41.033 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.030+0000 7fd2af0c7700 1 -- start start 2023-10-08T15:41:41.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.030+0000 7fd2af0c7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2a80a1fd0 0x7fd2a815f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:41.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.030+0000 7fd2af0c7700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd2a80bc4f0 0x7fd2a806e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:41.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.030+0000 7fd2af0c7700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd2a814c6c0 0x7fd2a8142d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:41.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.030+0000 7fd2af0c7700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a815fa90 con 0x7fd2a814c6c0 2023-10-08T15:41:41.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.030+0000 7fd2af0c7700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a814b800 con 0x7fd2a80a1fd0 2023-10-08T15:41:41.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.030+0000 7fd2af0c7700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a80b8c80 con 0x7fd2a80bc4f0 2023-10-08T15:41:41.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.030+0000 7fd2ad664700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd2a814c6c0 0x7fd2a8142d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:41.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.030+0000 7fd2ad664700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd2a814c6c0 0x7fd2a8142d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57434/0 (socket says 172.21.15.3:57434) 2023-10-08T15:41:41.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.030+0000 7fd2ad664700 1 -- 172.21.15.3:0/437749026 learned_addr learned my addr 172.21.15.3:0/437749026 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:41.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.030+0000 7fd2a7fff700 1 --2- 172.21.15.3:0/437749026 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd2a80bc4f0 0x7fd2a806e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:41.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.030+0000 7fd2ace63700 1 --2- 172.21.15.3:0/437749026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2a80a1fd0 0x7fd2a815f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:41.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.030+0000 7fd2ad664700 1 -- 172.21.15.3:0/437749026 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd2a80bc4f0 msgr2=0x7fd2a806e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:41.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.030+0000 7fd2ad664700 1 --2- 172.21.15.3:0/437749026 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd2a80bc4f0 0x7fd2a806e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:41.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.030+0000 7fd2ad664700 1 -- 172.21.15.3:0/437749026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2a80a1fd0 msgr2=0x7fd2a815f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:41.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.030+0000 7fd2ad664700 1 --2- 172.21.15.3:0/437749026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2a80a1fd0 0x7fd2a815f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:41.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.030+0000 7fd2ad664700 1 -- 172.21.15.3:0/437749026 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd290009420 con 0x7fd2a814c6c0 2023-10-08T15:41:41.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.030+0000 7fd2a7fff700 1 --2- 172.21.15.3:0/437749026 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd2a80bc4f0 0x7fd2a806e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:41:41.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.030+0000 7fd2ad664700 1 --2- 172.21.15.3:0/437749026 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd2a814c6c0 0x7fd2a8142d80 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fd2a000ea50 tx=0x7fd2a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:41.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.030+0000 7fd2a4ff9700 1 -- 172.21.15.3:0/437749026 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a000ee90 con 0x7fd2a814c6c0 2023-10-08T15:41:41.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.030+0000 7fd2a4ff9700 1 -- 172.21.15.3:0/437749026 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2a000c850 con 0x7fd2a814c6c0 2023-10-08T15:41:41.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.030+0000 7fd2a4ff9700 1 -- 172.21.15.3:0/437749026 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a000cc10 con 0x7fd2a814c6c0 2023-10-08T15:41:41.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.030+0000 7fd2af0c7700 1 -- 172.21.15.3:0/437749026 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2a806e800 con 0x7fd2a814c6c0 2023-10-08T15:41:41.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.030+0000 7fd2af0c7700 1 -- 172.21.15.3:0/437749026 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2a80b9f70 con 0x7fd2a814c6c0 2023-10-08T15:41:41.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.034+0000 7fd2af0c7700 1 -- 172.21.15.3:0/437749026 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2a8064530 con 0x7fd2a814c6c0 2023-10-08T15:41:41.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.034+0000 7fd2a4ff9700 1 -- 172.21.15.3:0/437749026 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fd2a0013470 con 0x7fd2a814c6c0 2023-10-08T15:41:41.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.034+0000 7fd2a4ff9700 1 --2- 172.21.15.3:0/437749026 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd288060580 0x7fd288062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:41.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.034+0000 7fd2a4ff9700 1 -- 172.21.15.3:0/437749026 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fd2a007c660 con 0x7fd2a814c6c0 2023-10-08T15:41:41.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.034+0000 7fd2ace63700 1 --2- 172.21.15.3:0/437749026 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd288060580 0x7fd288062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:41.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.038+0000 7fd2ace63700 1 --2- 172.21.15.3:0/437749026 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd288060580 0x7fd288062a30 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd2900091e0 tx=0x7fd290016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:41.047 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.042+0000 7fd2a4ff9700 1 -- 172.21.15.3:0/437749026 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd2a004cf30 con 0x7fd2a814c6c0 2023-10-08T15:41:41.245 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.242+0000 7fd2af0c7700 1 -- 172.21.15.3:0/437749026 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd2a80b8dc0 con 0x7fd2a814c6c0 2023-10-08T15:41:41.246 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.242+0000 7fd2a4ff9700 1 -- 172.21.15.3:0/437749026 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+2009 (secure 0 0 0) 0x7fd2a80b8dc0 con 0x7fd2a814c6c0 2023-10-08T15:41:41.246 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:41:41.247 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":29,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5674,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/688778262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":688778262},{"type":"v1","addr":"172.21.15.50:6835","nonce":688778262}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":5958,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6833/3472716847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":3472716847},{"type":"v1","addr":"172.21.15.3:6833","nonce":3472716847}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[]} 2023-10-08T15:41:41.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.242+0000 7fd2af0c7700 1 -- 172.21.15.3:0/437749026 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd288060580 msgr2=0x7fd288062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:41.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.242+0000 7fd2af0c7700 1 --2- 172.21.15.3:0/437749026 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd288060580 0x7fd288062a30 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd2900091e0 tx=0x7fd290016000 comp rx=0 tx=0).stop 2023-10-08T15:41:41.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.242+0000 7fd2af0c7700 1 -- 172.21.15.3:0/437749026 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd2a814c6c0 msgr2=0x7fd2a8142d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:41.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.242+0000 7fd2af0c7700 1 --2- 172.21.15.3:0/437749026 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd2a814c6c0 0x7fd2a8142d80 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fd2a000ea50 tx=0x7fd2a00091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:41.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.242+0000 7fd2af0c7700 1 -- 172.21.15.3:0/437749026 shutdown_connections 2023-10-08T15:41:41.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.242+0000 7fd2af0c7700 1 --2- 172.21.15.3:0/437749026 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd288060580 0x7fd288062a30 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:41.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.242+0000 7fd2af0c7700 1 --2- 172.21.15.3:0/437749026 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd2a814c6c0 0x7fd2a8142d80 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:41.250 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.242+0000 7fd2af0c7700 1 --2- 172.21.15.3:0/437749026 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd2a80bc4f0 0x7fd2a806e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:41.250 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.242+0000 7fd2af0c7700 1 --2- 172.21.15.3:0/437749026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2a80a1fd0 0x7fd2a815f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:41.250 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.242+0000 7fd2af0c7700 1 -- 172.21.15.3:0/437749026 >> 172.21.15.3:0/437749026 conn(0x7fd2a806b9b0 msgr2=0x7fd2a80680c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:41.250 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.242+0000 7fd2af0c7700 1 -- 172.21.15.3:0/437749026 shutdown_connections 2023-10-08T15:41:41.250 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.242+0000 7fd2af0c7700 1 -- 172.21.15.3:0/437749026 wait complete. 2023-10-08T15:41:41.250 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 29 2023-10-08T15:41:41.260 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-08T15:41:41.260 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-08T15:41:41.261 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-08T15:41:41.261 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T15:41:41.261 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-08T15:41:41.261 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-08T15:41:41.261 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-08T15:41:41.261 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T15:41:41.271 INFO:tasks.ceph.mds.a:Stopped 2023-10-08T15:41:41.271 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-08T15:41:41.277 INFO:tasks.ceph.mds.b:Stopped 2023-10-08T15:41:41.277 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-08T15:41:41.314 INFO:tasks.ceph.mds.a:Started 2023-10-08T15:41:41.315 DEBUG:teuthology.parallel:result is None 2023-10-08T15:41:41.320 INFO:tasks.ceph.mds.b:Started 2023-10-08T15:41:41.320 DEBUG:teuthology.parallel:result is None 2023-10-08T15:41:41.320 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-08T15:41:41.398 INFO:tasks.ceph.mds.b.smithi050.stdout:starting mds.b at 2023-10-08T15:41:41.403 INFO:tasks.ceph.mds.a.smithi003.stdout:starting mds.a at 2023-10-08T15:41:41.431 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.426+0000 7f435763a700 1 Processor -- start 2023-10-08T15:41:41.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.426+0000 7f435763a700 1 -- start start 2023-10-08T15:41:41.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.426+0000 7f435763a700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f4350067310 0x7f4350149ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:41.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.426+0000 7f435763a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f43500bcca0 0x7f43501463b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:41.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.426+0000 7f435763a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f43501468f0 0x7f435014ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:41.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.426+0000 7f435763a700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43500a26a0 con 0x7f4350067310 2023-10-08T15:41:41.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.426+0000 7f435763a700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f435014a4b0 con 0x7f43501468f0 2023-10-08T15:41:41.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.426+0000 7f435763a700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43500a2210 con 0x7f43500bcca0 2023-10-08T15:41:41.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.426+0000 7f43553d6700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f4350067310 0x7f4350149ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:41.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.426+0000 7f43553d6700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f4350067310 0x7f4350149ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57476/0 (socket says 172.21.15.3:57476) 2023-10-08T15:41:41.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.426+0000 7f43553d6700 1 -- 172.21.15.3:0/1676625548 learned_addr learned my addr 172.21.15.3:0/1676625548 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:41.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.426+0000 7f4355bd7700 1 --2- 172.21.15.3:0/1676625548 >> v2:172.21.15.50:3300/0 conn(0x7f43501468f0 0x7f435014ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:41.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.426+0000 7f4354bd5700 1 --2- 172.21.15.3:0/1676625548 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f43500bcca0 0x7f43501463b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:41.435 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.430+0000 7f43553d6700 1 -- 172.21.15.3:0/1676625548 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f43500bcca0 msgr2=0x7f43501463b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:41.435 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.430+0000 7f43553d6700 1 --2- 172.21.15.3:0/1676625548 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f43500bcca0 0x7f43501463b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:41.435 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.430+0000 7f43553d6700 1 -- 172.21.15.3:0/1676625548 >> v2:172.21.15.50:3300/0 conn(0x7f43501468f0 msgr2=0x7f435014ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:41.435 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.430+0000 7f43553d6700 1 --2- 172.21.15.3:0/1676625548 >> v2:172.21.15.50:3300/0 conn(0x7f43501468f0 0x7f435014ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:41.435 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.430+0000 7f43553d6700 1 -- 172.21.15.3:0/1676625548 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43500a1ee0 con 0x7f4350067310 2023-10-08T15:41:41.435 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.430+0000 7f43553d6700 1 --2- 172.21.15.3:0/1676625548 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4350067310 0x7f4350149ea0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f4350149480 tx=0x7f4340009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fd7a284ac7f7c2c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:41.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.430+0000 7f4347fff700 1 -- 172.21.15.3:0/1676625548 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434000b640 con 0x7f4350067310 2023-10-08T15:41:41.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.430+0000 7f4347fff700 1 -- 172.21.15.3:0/1676625548 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f434000b7a0 con 0x7f4350067310 2023-10-08T15:41:41.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.430+0000 7f4347fff700 1 -- 172.21.15.3:0/1676625548 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434000bb40 con 0x7f4350067310 2023-10-08T15:41:41.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.430+0000 7f435763a700 1 -- 172.21.15.3:0/1676625548 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4350067310 msgr2=0x7f4350149ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:41.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.430+0000 7f435763a700 1 --2- 172.21.15.3:0/1676625548 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4350067310 0x7f4350149ea0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f4350149480 tx=0x7f4340009250 comp rx=0 tx=0).stop 2023-10-08T15:41:41.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.430+0000 7f435763a700 1 -- 172.21.15.3:0/1676625548 shutdown_connections 2023-10-08T15:41:41.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.430+0000 7f435763a700 1 --2- 172.21.15.3:0/1676625548 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f43500bcca0 0x7f43501463b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:41.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.430+0000 7f435763a700 1 --2- 172.21.15.3:0/1676625548 >> v2:172.21.15.50:3300/0 conn(0x7f43501468f0 0x7f435014ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:41.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.430+0000 7f435763a700 1 --2- 172.21.15.3:0/1676625548 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4350067310 0x7f4350149ea0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:41.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.430+0000 7f435763a700 1 -- 172.21.15.3:0/1676625548 >> 172.21.15.3:0/1676625548 conn(0x7f435006b9b0 msgr2=0x7f43500681f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:41.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.430+0000 7f435763a700 1 -- 172.21.15.3:0/1676625548 shutdown_connections 2023-10-08T15:41:41.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.430+0000 7f435763a700 1 -- 172.21.15.3:0/1676625548 wait complete. 2023-10-08T15:41:41.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.430+0000 7f435763a700 1 Processor -- start 2023-10-08T15:41:41.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.434+0000 7f435763a700 1 -- start start 2023-10-08T15:41:41.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.434+0000 7f435763a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4350067310 0x7f435006e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:41.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.434+0000 7f435763a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f43500bcca0 0x7f435013f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:41.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.434+0000 7f435763a700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f43501468f0 0x7f435013fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:41.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.434+0000 7f435763a700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4350148670 con 0x7f43501468f0 2023-10-08T15:41:41.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.434+0000 7f435763a700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4350147620 con 0x7f4350067310 2023-10-08T15:41:41.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.434+0000 7f435763a700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43501481e0 con 0x7f43500bcca0 2023-10-08T15:41:41.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.434+0000 7f4355bd7700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f43501468f0 0x7f435013fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:41.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.434+0000 7f4355bd7700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f43501468f0 0x7f435013fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57478/0 (socket says 172.21.15.3:57478) 2023-10-08T15:41:41.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.434+0000 7f4355bd7700 1 -- 172.21.15.3:0/1805842475 learned_addr learned my addr 172.21.15.3:0/1805842475 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:41.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.434+0000 7f4354bd5700 1 --2- 172.21.15.3:0/1805842475 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f43500bcca0 0x7f435013f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:41.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.434+0000 7f43553d6700 1 --2- 172.21.15.3:0/1805842475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4350067310 0x7f435006e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:41.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.434+0000 7f4355bd7700 1 -- 172.21.15.3:0/1805842475 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f43500bcca0 msgr2=0x7f435013f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:41.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.434+0000 7f4355bd7700 1 --2- 172.21.15.3:0/1805842475 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f43500bcca0 0x7f435013f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:41.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.434+0000 7f4355bd7700 1 -- 172.21.15.3:0/1805842475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4350067310 msgr2=0x7f435006e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:41.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.434+0000 7f4355bd7700 1 --2- 172.21.15.3:0/1805842475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4350067310 0x7f435006e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:41.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.434+0000 7f4355bd7700 1 -- 172.21.15.3:0/1805842475 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43400094f0 con 0x7f43501468f0 2023-10-08T15:41:41.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.434+0000 7f4355bd7700 1 --2- 172.21.15.3:0/1805842475 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f43501468f0 0x7f435013fde0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f434800e900 tx=0x7f43480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:41.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.434+0000 7f43457fa700 1 -- 172.21.15.3:0/1805842475 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4348013680 con 0x7f43501468f0 2023-10-08T15:41:41.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.434+0000 7f43457fa700 1 -- 172.21.15.3:0/1805842475 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43480137e0 con 0x7f43501468f0 2023-10-08T15:41:41.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.434+0000 7f435763a700 1 -- 172.21.15.3:0/1805842475 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f435006e940 con 0x7f43501468f0 2023-10-08T15:41:41.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.434+0000 7f43457fa700 1 -- 172.21.15.3:0/1805842475 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4348013ba0 con 0x7f43501468f0 2023-10-08T15:41:41.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.434+0000 7f435763a700 1 -- 172.21.15.3:0/1805842475 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4350147e70 con 0x7f43501468f0 2023-10-08T15:41:41.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.438+0000 7f435763a700 1 -- 172.21.15.3:0/1805842475 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4350148350 con 0x7f43501468f0 2023-10-08T15:41:41.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.438+0000 7f43457fa700 1 -- 172.21.15.3:0/1805842475 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f43480123d0 con 0x7f43501468f0 2023-10-08T15:41:41.443 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.438+0000 7f43457fa700 1 --2- 172.21.15.3:0/1805842475 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4334060550 0x7f4334062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:41.443 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.438+0000 7f43457fa700 1 -- 172.21.15.3:0/1805842475 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f434807c520 con 0x7f43501468f0 2023-10-08T15:41:41.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.438+0000 7f43553d6700 1 --2- 172.21.15.3:0/1805842475 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4334060550 0x7f4334062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:41.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.438+0000 7f43553d6700 1 --2- 172.21.15.3:0/1805842475 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4334060550 0x7f4334062a00 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4350149480 tx=0x7f4340017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:41.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.446+0000 7f43457fa700 1 -- 172.21.15.3:0/1805842475 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f434804ce10 con 0x7f43501468f0 2023-10-08T15:41:41.629 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:41.622+0000 7f435763a700 1 -- 172.21.15.3:0/1805842475 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f4350064530 con 0x7f43501468f0 2023-10-08T15:41:42.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.474+0000 7f43457fa700 1 -- 172.21.15.3:0/1805842475 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v55) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4348050430 con 0x7f43501468f0 2023-10-08T15:41:42.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.478+0000 7f435763a700 1 -- 172.21.15.3:0/1805842475 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4334060550 msgr2=0x7f4334062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:42.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.478+0000 7f435763a700 1 --2- 172.21.15.3:0/1805842475 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4334060550 0x7f4334062a00 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4350149480 tx=0x7f4340017000 comp rx=0 tx=0).stop 2023-10-08T15:41:42.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.478+0000 7f435763a700 1 -- 172.21.15.3:0/1805842475 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f43501468f0 msgr2=0x7f435013fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:42.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.478+0000 7f435763a700 1 --2- 172.21.15.3:0/1805842475 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f43501468f0 0x7f435013fde0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f434800e900 tx=0x7f43480091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:42.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.478+0000 7f435763a700 1 -- 172.21.15.3:0/1805842475 shutdown_connections 2023-10-08T15:41:42.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.478+0000 7f435763a700 1 --2- 172.21.15.3:0/1805842475 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4334060550 0x7f4334062a00 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:42.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.478+0000 7f435763a700 1 --2- 172.21.15.3:0/1805842475 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f43501468f0 0x7f435013fde0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:42.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.478+0000 7f435763a700 1 --2- 172.21.15.3:0/1805842475 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f43500bcca0 0x7f435013f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:42.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.478+0000 7f435763a700 1 --2- 172.21.15.3:0/1805842475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4350067310 0x7f435006e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:42.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.478+0000 7f435763a700 1 -- 172.21.15.3:0/1805842475 >> 172.21.15.3:0/1805842475 conn(0x7f435006b9b0 msgr2=0x7f4350143f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:42.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.478+0000 7f435763a700 1 -- 172.21.15.3:0/1805842475 shutdown_connections 2023-10-08T15:41:42.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.478+0000 7f435763a700 1 -- 172.21.15.3:0/1805842475 wait complete. 2023-10-08T15:41:42.485 INFO:teuthology.orchestra.run.smithi003.stderr: removed all blocklist entries 2023-10-08T15:41:42.502 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-08T15:41:42.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.606+0000 7f52f5cc9700 1 Processor -- start 2023-10-08T15:41:42.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.606+0000 7f52f5cc9700 1 -- start start 2023-10-08T15:41:42.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.606+0000 7f52f5cc9700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f52f00badb0 0x7f52f00bb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:42.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.606+0000 7f52f5cc9700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f52f00b43a0 0x7f52f014d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:42.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.606+0000 7f52f5cc9700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f52f014a030 0x7f52f00b2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:42.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.606+0000 7f52f5cc9700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52f0149ba0 con 0x7f52f00b43a0 2023-10-08T15:41:42.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.606+0000 7f52f5cc9700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52f014d990 con 0x7f52f014a030 2023-10-08T15:41:42.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.606+0000 7f52f5cc9700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52f0149550 con 0x7f52f00badb0 2023-10-08T15:41:42.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.606+0000 7f52eeffd700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f52f00b43a0 0x7f52f014d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:42.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.606+0000 7f52eeffd700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f52f00b43a0 0x7f52f014d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57494/0 (socket says 172.21.15.3:57494) 2023-10-08T15:41:42.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.606+0000 7f52eeffd700 1 -- 172.21.15.3:0/3787165486 learned_addr learned my addr 172.21.15.3:0/3787165486 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:42.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.606+0000 7f52effff700 1 --2- 172.21.15.3:0/3787165486 >> v2:172.21.15.50:3300/0 conn(0x7f52f014a030 0x7f52f00b2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:42.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.606+0000 7f52ef7fe700 1 --2- 172.21.15.3:0/3787165486 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f52f00badb0 0x7f52f00bb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:42.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.606+0000 7f52eeffd700 1 -- 172.21.15.3:0/3787165486 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f52f00badb0 msgr2=0x7f52f00bb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:42.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.606+0000 7f52eeffd700 1 --2- 172.21.15.3:0/3787165486 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f52f00badb0 0x7f52f00bb180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:42.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.606+0000 7f52eeffd700 1 -- 172.21.15.3:0/3787165486 >> v2:172.21.15.50:3300/0 conn(0x7f52f014a030 msgr2=0x7f52f00b2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:42.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.606+0000 7f52eeffd700 1 --2- 172.21.15.3:0/3787165486 >> v2:172.21.15.50:3300/0 conn(0x7f52f014a030 0x7f52f00b2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:42.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.606+0000 7f52eeffd700 1 -- 172.21.15.3:0/3787165486 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f0149830 con 0x7f52f00b43a0 2023-10-08T15:41:42.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.606+0000 7f52ef7fe700 1 --2- 172.21.15.3:0/3787165486 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f52f00badb0 0x7f52f00bb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:42.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.606+0000 7f52eeffd700 1 --2- 172.21.15.3:0/3787165486 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f52f00b43a0 0x7f52f014d450 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f52f00b59e0 tx=0x7f52e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=621cb7b58e50a7d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:42.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.610+0000 7f52ee7fc700 1 -- 172.21.15.3:0/3787165486 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e4009e70 con 0x7f52f00b43a0 2023-10-08T15:41:42.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.610+0000 7f52ee7fc700 1 -- 172.21.15.3:0/3787165486 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52e400b860 con 0x7f52f00b43a0 2023-10-08T15:41:42.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.610+0000 7f52ee7fc700 1 -- 172.21.15.3:0/3787165486 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e400bc20 con 0x7f52f00b43a0 2023-10-08T15:41:42.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.610+0000 7f52f5cc9700 1 -- 172.21.15.3:0/3787165486 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f52f00b43a0 msgr2=0x7f52f014d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:42.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.610+0000 7f52f5cc9700 1 --2- 172.21.15.3:0/3787165486 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f52f00b43a0 0x7f52f014d450 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f52f00b59e0 tx=0x7f52e4009250 comp rx=0 tx=0).stop 2023-10-08T15:41:42.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.610+0000 7f52f5cc9700 1 -- 172.21.15.3:0/3787165486 shutdown_connections 2023-10-08T15:41:42.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.610+0000 7f52f5cc9700 1 --2- 172.21.15.3:0/3787165486 >> v2:172.21.15.50:3300/0 conn(0x7f52f014a030 0x7f52f00b2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:42.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.610+0000 7f52f5cc9700 1 --2- 172.21.15.3:0/3787165486 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f52f00b43a0 0x7f52f014d450 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:42.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.610+0000 7f52f5cc9700 1 --2- 172.21.15.3:0/3787165486 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f52f00badb0 0x7f52f00bb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:42.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.610+0000 7f52f5cc9700 1 -- 172.21.15.3:0/3787165486 >> 172.21.15.3:0/3787165486 conn(0x7f52f00be640 msgr2=0x7f52f00ba6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:42.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.610+0000 7f52f5cc9700 1 -- 172.21.15.3:0/3787165486 shutdown_connections 2023-10-08T15:41:42.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.610+0000 7f52f5cc9700 1 -- 172.21.15.3:0/3787165486 wait complete. 2023-10-08T15:41:42.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.610+0000 7f52f5cc9700 1 Processor -- start 2023-10-08T15:41:42.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.610+0000 7f52f5cc9700 1 -- start start 2023-10-08T15:41:42.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.610+0000 7f52f5cc9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52f00b43a0 0x7f52f014ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:42.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.610+0000 7f52f5cc9700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f52f00badb0 0x7f52f015c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:42.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.610+0000 7f52f5cc9700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f52f014a030 0x7f52f00b5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:42.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.610+0000 7f52f5cc9700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f00b8510 con 0x7f52f00badb0 2023-10-08T15:41:42.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.614+0000 7f52f5cc9700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f0159ac0 con 0x7f52f00b43a0 2023-10-08T15:41:42.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.614+0000 7f52f5cc9700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52f0159d50 con 0x7f52f014a030 2023-10-08T15:41:42.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.614+0000 7f52eeffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f52f00badb0 0x7f52f015c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:42.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.614+0000 7f52eeffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f52f00badb0 0x7f52f015c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57502/0 (socket says 172.21.15.3:57502) 2023-10-08T15:41:42.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.614+0000 7f52eeffd700 1 -- 172.21.15.3:0/4269462996 learned_addr learned my addr 172.21.15.3:0/4269462996 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:42.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.614+0000 7f52ef7fe700 1 --2- 172.21.15.3:0/4269462996 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52f00b43a0 0x7f52f014ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:42.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.614+0000 7f52effff700 1 --2- 172.21.15.3:0/4269462996 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f52f014a030 0x7f52f00b5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:42.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.614+0000 7f52eeffd700 1 -- 172.21.15.3:0/4269462996 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f52f014a030 msgr2=0x7f52f00b5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:42.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.614+0000 7f52eeffd700 1 --2- 172.21.15.3:0/4269462996 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f52f014a030 0x7f52f00b5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:42.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.614+0000 7f52eeffd700 1 -- 172.21.15.3:0/4269462996 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52f00b43a0 msgr2=0x7f52f014ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:42.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.614+0000 7f52eeffd700 1 --2- 172.21.15.3:0/4269462996 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52f00b43a0 0x7f52f014ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:42.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.614+0000 7f52eeffd700 1 -- 172.21.15.3:0/4269462996 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e40094f0 con 0x7f52f00badb0 2023-10-08T15:41:42.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.614+0000 7f52effff700 1 --2- 172.21.15.3:0/4269462996 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f52f014a030 0x7f52f00b5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:42.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.614+0000 7f52eeffd700 1 --2- 172.21.15.3:0/4269462996 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f52f00badb0 0x7f52f015c680 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f52e40094c0 tx=0x7f52e4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:42.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.614+0000 7f52d77fe700 1 -- 172.21.15.3:0/4269462996 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e4006af0 con 0x7f52f00badb0 2023-10-08T15:41:42.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.614+0000 7f52d77fe700 1 -- 172.21.15.3:0/4269462996 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52e4000bc0 con 0x7f52f00badb0 2023-10-08T15:41:42.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.614+0000 7f52f5cc9700 1 -- 172.21.15.3:0/4269462996 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52f0068660 con 0x7f52f00badb0 2023-10-08T15:41:42.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.614+0000 7f52d77fe700 1 -- 172.21.15.3:0/4269462996 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e400bc00 con 0x7f52f00badb0 2023-10-08T15:41:42.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.614+0000 7f52f5cc9700 1 -- 172.21.15.3:0/4269462996 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52f015cbc0 con 0x7f52f00badb0 2023-10-08T15:41:42.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.614+0000 7f52f5cc9700 1 -- 172.21.15.3:0/4269462996 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52f0064530 con 0x7f52f00badb0 2023-10-08T15:41:42.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.614+0000 7f52d77fe700 1 -- 172.21.15.3:0/4269462996 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f52e4023070 con 0x7f52f00badb0 2023-10-08T15:41:42.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.618+0000 7f52d77fe700 1 --2- 172.21.15.3:0/4269462996 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f52dc060550 0x7f52dc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:42.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.618+0000 7f52d77fe700 1 -- 172.21.15.3:0/4269462996 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f52e407d6d0 con 0x7f52f00badb0 2023-10-08T15:41:42.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.618+0000 7f52ef7fe700 1 --2- 172.21.15.3:0/4269462996 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f52dc060550 0x7f52dc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:42.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.618+0000 7f52ef7fe700 1 --2- 172.21.15.3:0/4269462996 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f52dc060550 0x7f52dc062a00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f52f014d340 tx=0x7f52e0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:42.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.622+0000 7f52d77fe700 1 -- 172.21.15.3:0/4269462996 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f52e404dff0 con 0x7f52f00badb0 2023-10-08T15:41:42.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.842+0000 7f52f5cc9700 1 -- 172.21.15.3:0/4269462996 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f52f0159e90 con 0x7f52f00badb0 2023-10-08T15:41:42.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.846+0000 7f52d77fe700 1 -- 172.21.15.3:0/4269462996 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+4446 (secure 0 0 0) 0x7f52e4051610 con 0x7f52f00badb0 2023-10-08T15:41:42.849 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:41:42.850 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2023-10-08T15:41:42.850 INFO:teuthology.orchestra.run.smithi003.stdout: "auth_dump": [ 2023-10-08T15:41:42.850 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:41:42.850 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "mds.a", 2023-10-08T15:41:42.850 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCGzCJlniy3BRAAQseQmhA2EOYYPCLL1hMj/g==", 2023-10-08T15:41:42.850 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:41:42.850 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow", 2023-10-08T15:41:42.850 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow *", 2023-10-08T15:41:42.850 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow *", 2023-10-08T15:41:42.850 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:41:42.851 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:41:42.851 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:41:42.851 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:41:42.851 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "mds.b", 2023-10-08T15:41:42.851 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCGzCJl1lNhCRAA/A3Dz/i7z2OM/Mwr00ZSFg==", 2023-10-08T15:41:42.851 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:41:42.851 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow", 2023-10-08T15:41:42.851 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow *", 2023-10-08T15:41:42.851 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow *", 2023-10-08T15:41:42.851 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:41:42.851 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:41:42.851 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:41:42.852 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:41:42.852 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.0", 2023-10-08T15:41:42.852 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCIzCJl5cInMhAAIWzN1t0FivwbJgXlK5WXCg==", 2023-10-08T15:41:42.852 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:41:42.852 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-10-08T15:41:42.852 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-10-08T15:41:42.852 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:41:42.852 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:41:42.852 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:41:42.852 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:41:42.852 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.1", 2023-10-08T15:41:42.853 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCMzCJlZQwWCBAAzzoTedkZwE7oFh4KXjrWZg==", 2023-10-08T15:41:42.853 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:41:42.853 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-10-08T15:41:42.853 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-10-08T15:41:42.853 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:41:42.853 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:41:42.853 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:41:42.853 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:41:42.853 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.2", 2023-10-08T15:41:42.853 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCPzCJlNZM0DRAAgBBNMGbDp8a6VU+mZCpMvQ==", 2023-10-08T15:41:42.853 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:41:42.854 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-10-08T15:41:42.854 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-10-08T15:41:42.854 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:41:42.854 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:41:42.854 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:41:42.854 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:41:42.854 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.3", 2023-10-08T15:41:42.854 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCSzCJltf1tERAAzUJYRvgmxgEtp/IkRsxqmg==", 2023-10-08T15:41:42.854 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:41:42.854 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-10-08T15:41:42.854 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-10-08T15:41:42.855 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:41:42.855 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:41:42.855 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:41:42.855 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:41:42.855 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.4", 2023-10-08T15:41:42.855 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCVzCJlJb2bOBAAZ4hEdc2vznsMuAZpBZlj6Q==", 2023-10-08T15:41:42.855 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:41:42.855 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-10-08T15:41:42.855 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-10-08T15:41:42.855 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:41:42.855 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:41:42.856 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:41:42.856 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:41:42.856 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.5", 2023-10-08T15:41:42.856 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCZzCJlRu4PAhAAgAt508VAQXQwI2L8QyJsag==", 2023-10-08T15:41:42.856 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:41:42.856 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-10-08T15:41:42.856 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-10-08T15:41:42.856 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:41:42.856 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:41:42.856 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:41:42.856 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:41:42.857 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.6", 2023-10-08T15:41:42.857 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCczCJl+1qsBBAArN1IsbopNLd43wJCb73a/A==", 2023-10-08T15:41:42.857 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:41:42.857 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-10-08T15:41:42.857 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-10-08T15:41:42.857 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:41:42.857 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:41:42.857 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:41:42.857 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:41:42.857 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.7", 2023-10-08T15:41:42.857 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCfzCJlMwQhCRAAv/YJwsTJz1eOHFJA/34fDQ==", 2023-10-08T15:41:42.858 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:41:42.858 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-10-08T15:41:42.858 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-10-08T15:41:42.858 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:41:42.858 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:41:42.858 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:41:42.858 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:41:42.858 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "client.0", 2023-10-08T15:41:42.858 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCGzCJlsNS9DBAAAGWd2+fzzFMSRkr2JgMssw==", 2023-10-08T15:41:42.858 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:41:42.858 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow", 2023-10-08T15:41:42.859 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow r", 2023-10-08T15:41:42.859 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-08T15:41:42.859 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:41:42.859 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:41:42.859 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:41:42.859 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "client.1", 2023-10-08T15:41:42.859 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCGzCJlDRibDxAAgu6Q6umK/yUGAg4R/9Yj+w==", 2023-10-08T15:41:42.859 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:41:42.859 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow", 2023-10-08T15:41:42.859 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow r", 2023-10-08T15:41:42.859 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow rw", 2023-10-08T15:41:42.859 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow rwx" 2023-10-08T15:41:42.860 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:41:42.860 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:41:42.860 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:41:42.860 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "client.2", 2023-10-08T15:41:42.860 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCGzCJlqKuGEhAAUqGYxYztxx87maQJT2LL/g==", 2023-10-08T15:41:42.860 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:41:42.860 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow", 2023-10-08T15:41:42.860 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow r", 2023-10-08T15:41:42.860 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow rw", 2023-10-08T15:41:42.860 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow rwx" 2023-10-08T15:41:42.860 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:41:42.861 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:41:42.861 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:41:42.861 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "client.admin", 2023-10-08T15:41:42.861 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCFzCJltIgDJxAAwtl0Hr7oKzNBMOvXUUnshQ==", 2023-10-08T15:41:42.861 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:41:42.861 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow *", 2023-10-08T15:41:42.861 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow *", 2023-10-08T15:41:42.861 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow *", 2023-10-08T15:41:42.861 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:41:42.861 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:41:42.861 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:41:42.861 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:41:42.862 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "mgr.x", 2023-10-08T15:41:42.862 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCGzCJlrnryAhAAe5CNtQTuBHbbPrdMxY2lqA==", 2023-10-08T15:41:42.862 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:41:42.862 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow *", 2023-10-08T15:41:42.862 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile mgr", 2023-10-08T15:41:42.862 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:41:42.862 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:41:42.862 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:41:42.862 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:41:42.862 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "mgr.y", 2023-10-08T15:41:42.863 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCGzCJl8moPABAAjH5iVWRLyeITsMX/nAZoTQ==", 2023-10-08T15:41:42.863 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:41:42.863 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow *", 2023-10-08T15:41:42.863 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile mgr", 2023-10-08T15:41:42.863 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:41:42.863 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:41:42.863 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:41:42.863 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2023-10-08T15:41:42.863 INFO:teuthology.orchestra.run.smithi003.stdout:} 2023-10-08T15:41:42.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.846+0000 7f52f5cc9700 1 -- 172.21.15.3:0/4269462996 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f52dc060550 msgr2=0x7f52dc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:42.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.846+0000 7f52f5cc9700 1 --2- 172.21.15.3:0/4269462996 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f52dc060550 0x7f52dc062a00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f52f014d340 tx=0x7f52e0008040 comp rx=0 tx=0).stop 2023-10-08T15:41:42.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.846+0000 7f52f5cc9700 1 -- 172.21.15.3:0/4269462996 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f52f00badb0 msgr2=0x7f52f015c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:42.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.846+0000 7f52f5cc9700 1 --2- 172.21.15.3:0/4269462996 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f52f00badb0 0x7f52f015c680 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f52e40094c0 tx=0x7f52e4017000 comp rx=0 tx=0).stop 2023-10-08T15:41:42.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.846+0000 7f52f5cc9700 1 -- 172.21.15.3:0/4269462996 shutdown_connections 2023-10-08T15:41:42.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.846+0000 7f52f5cc9700 1 --2- 172.21.15.3:0/4269462996 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f52dc060550 0x7f52dc062a00 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:42.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.846+0000 7f52f5cc9700 1 --2- 172.21.15.3:0/4269462996 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f52f014a030 0x7f52f00b5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:42.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.846+0000 7f52f5cc9700 1 --2- 172.21.15.3:0/4269462996 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f52f00badb0 0x7f52f015c680 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:42.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.846+0000 7f52f5cc9700 1 --2- 172.21.15.3:0/4269462996 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52f00b43a0 0x7f52f014ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:42.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.846+0000 7f52f5cc9700 1 -- 172.21.15.3:0/4269462996 >> 172.21.15.3:0/4269462996 conn(0x7f52f00be640 msgr2=0x7f52f0148a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:42.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.846+0000 7f52f5cc9700 1 -- 172.21.15.3:0/4269462996 shutdown_connections 2023-10-08T15:41:42.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.846+0000 7f52f5cc9700 1 -- 172.21.15.3:0/4269462996 wait complete. 2023-10-08T15:41:42.866 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:41:42.974 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.970+0000 7fae22f29700 1 Processor -- start 2023-10-08T15:41:42.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.970+0000 7fae22f29700 1 -- start start 2023-10-08T15:41:42.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.970+0000 7fae22f29700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fae1c0bacf0 0x7fae1c14f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:42.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.970+0000 7fae22f29700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae1c14eb80 con 0x7fae1c0bb0c0 2023-10-08T15:41:42.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.970+0000 7fae22f29700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae1c0bd700 con 0x7fae1c0b8a40 2023-10-08T15:41:42.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.970+0000 7fae22f29700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae1c0b9e50 con 0x7fae1c0bacf0 2023-10-08T15:41:42.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.970+0000 7fae21726700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fae1c0bb0c0 0x7fae1c0bc8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:47626/0 (socket says 172.21.15.3:47626) 2023-10-08T15:41:42.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.970+0000 7fae21726700 1 -- 172.21.15.3:0/1356026047 learned_addr learned my addr 172.21.15.3:0/1356026047 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:41:42.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.970+0000 7fae21f27700 1 --2- 172.21.15.3:0/1356026047 >> v2:172.21.15.50:3300/0 conn(0x7fae1c0bacf0 0x7fae1c14f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:42.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.970+0000 7fae20f25700 1 -- 172.21.15.3:0/1356026047 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 410899845 0 0) 0x7fae1c14eb80 con 0x7fae1c0bb0c0 2023-10-08T15:41:42.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.970+0000 7fae20f25700 1 -- 172.21.15.3:0/1356026047 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae08003570 con 0x7fae1c0bb0c0 2023-10-08T15:41:42.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.970+0000 7fae20f25700 1 -- 172.21.15.3:0/1356026047 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2124657112 0 0) 0x7fae08003570 con 0x7fae1c0bb0c0 2023-10-08T15:41:42.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.970+0000 7fae20f25700 1 -- 172.21.15.3:0/1356026047 >> v2:172.21.15.50:3300/0 conn(0x7fae1c0bacf0 msgr2=0x7fae1c14f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:42.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.970+0000 7fae20f25700 1 --2- 172.21.15.3:0/1356026047 >> v2:172.21.15.50:3300/0 conn(0x7fae1c0bacf0 0x7fae1c14f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:42.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.970+0000 7fae20f25700 1 -- 172.21.15.3:0/1356026047 >> v1:172.21.15.50:6789/0 conn(0x7fae1c0b8a40 legacy=0x7fae1c0bcff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:42.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.970+0000 7fae20f25700 1 -- 172.21.15.3:0/1356026047 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae1c0ba130 con 0x7fae1c0bb0c0 2023-10-08T15:41:42.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.970+0000 7fae20f25700 1 -- 172.21.15.3:0/1356026047 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2285686191 0 0) 0x7fae180017f0 con 0x7fae1c0bb0c0 2023-10-08T15:41:42.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.970+0000 7fae20f25700 1 -- 172.21.15.3:0/1356026047 >> v1:172.21.15.3:6789/0 conn(0x7fae1c0bb0c0 legacy=0x7fae1c0bc8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:42.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.970+0000 7fae20f25700 1 --2- 172.21.15.3:0/1356026047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae08003a60 0x7fae08003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:42.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.970+0000 7fae20f25700 1 --2- 172.21.15.3:0/1356026047 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fae08004810 0x7fae08004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:42.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.970+0000 7fae20f25700 1 --2- 172.21.15.3:0/1356026047 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fae080051c0 0x7fae0800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:42.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.970+0000 7fae20f25700 1 -- 172.21.15.3:0/1356026047 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae1c0b9e50 con 0x7fae080051c0 2023-10-08T15:41:42.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.970+0000 7fae20f25700 1 -- 172.21.15.3:0/1356026047 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae0800c160 con 0x7fae08003a60 2023-10-08T15:41:42.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.970+0000 7fae20f25700 1 -- 172.21.15.3:0/1356026047 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae0800c320 con 0x7fae08004810 2023-10-08T15:41:42.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.970+0000 7fae22728700 1 --2- 172.21.15.3:0/1356026047 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fae080051c0 0x7fae0800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:42.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.970+0000 7fae21726700 1 --2- 172.21.15.3:0/1356026047 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fae08004810 0x7fae08004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:42.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.970+0000 7fae21f27700 1 --2- 172.21.15.3:0/1356026047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae08003a60 0x7fae08003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:42.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.974+0000 7fae22728700 1 -- 172.21.15.3:0/1356026047 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fae08004810 msgr2=0x7fae08004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:42.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.974+0000 7fae22728700 1 --2- 172.21.15.3:0/1356026047 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fae08004810 0x7fae08004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:42.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.974+0000 7fae22728700 1 -- 172.21.15.3:0/1356026047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae08003a60 msgr2=0x7fae08003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:42.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.974+0000 7fae22728700 1 --2- 172.21.15.3:0/1356026047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae08003a60 0x7fae08003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:42.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.974+0000 7fae22728700 1 -- 172.21.15.3:0/1356026047 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae08003570 con 0x7fae080051c0 2023-10-08T15:41:42.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.974+0000 7fae22728700 1 -- 172.21.15.3:0/1356026047 reap_dead start 2023-10-08T15:41:42.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.974+0000 7fae22728700 1 --2- 172.21.15.3:0/1356026047 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fae080051c0 0x7fae0800ba60 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fae14001880 tx=0x7fae14007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=154f9910e456496d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:42.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.974+0000 7fae20f25700 1 -- 172.21.15.3:0/1356026047 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae14012420 con 0x7fae080051c0 2023-10-08T15:41:42.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.974+0000 7fae20f25700 1 -- 172.21.15.3:0/1356026047 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae140125a0 con 0x7fae080051c0 2023-10-08T15:41:42.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.974+0000 7fae20f25700 1 -- 172.21.15.3:0/1356026047 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae14012960 con 0x7fae080051c0 2023-10-08T15:41:42.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.974+0000 7fae22f29700 1 -- 172.21.15.3:0/1356026047 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fae080051c0 msgr2=0x7fae0800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:42.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.974+0000 7fae22f29700 1 --2- 172.21.15.3:0/1356026047 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fae080051c0 0x7fae0800ba60 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fae14001880 tx=0x7fae14007d30 comp rx=0 tx=0).stop 2023-10-08T15:41:42.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.974+0000 7fae22f29700 1 -- 172.21.15.3:0/1356026047 shutdown_connections 2023-10-08T15:41:42.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.974+0000 7fae22f29700 1 --2- 172.21.15.3:0/1356026047 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fae080051c0 0x7fae0800ba60 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:42.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.974+0000 7fae22f29700 1 -- 172.21.15.3:0/1356026047 >> 172.21.15.3:0/1356026047 conn(0x7fae1c0be4a0 msgr2=0x7fae1c0ba440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:42.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.974+0000 7fae22f29700 1 -- 172.21.15.3:0/1356026047 shutdown_connections 2023-10-08T15:41:42.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.974+0000 7fae22f29700 1 -- 172.21.15.3:0/1356026047 wait complete. 2023-10-08T15:41:42.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.974+0000 7fae22f29700 1 Processor -- start 2023-10-08T15:41:42.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.974+0000 7fae22f29700 1 -- start start 2023-10-08T15:41:42.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.978+0000 7fae22f29700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fae080051c0 0x7fae1c149320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:42.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.978+0000 7fae22f29700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae1c096960 0x7fae1c15e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:42.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.978+0000 7fae22f29700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fae1c096dd0 0x7fae1c15e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:42.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.978+0000 7fae22f29700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae1c096160 con 0x7fae1c096dd0 2023-10-08T15:41:42.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.978+0000 7fae22f29700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae1c15ecd0 con 0x7fae1c096960 2023-10-08T15:41:42.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.978+0000 7fae22f29700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae1c095b10 con 0x7fae080051c0 2023-10-08T15:41:42.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.978+0000 7fae22728700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fae1c096dd0 0x7fae1c15e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:42.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.978+0000 7fae21726700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae1c096960 0x7fae1c15e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:42.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.978+0000 7fae22728700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fae1c096dd0 0x7fae1c15e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57524/0 (socket says 172.21.15.3:57524) 2023-10-08T15:41:42.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.978+0000 7fae22728700 1 -- 172.21.15.3:0/3699106972 learned_addr learned my addr 172.21.15.3:0/3699106972 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:42.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.978+0000 7fae21f27700 1 --2- 172.21.15.3:0/3699106972 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fae080051c0 0x7fae1c149320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:42.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.978+0000 7fae22728700 1 -- 172.21.15.3:0/3699106972 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fae080051c0 msgr2=0x7fae1c149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:42.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.978+0000 7fae22728700 1 --2- 172.21.15.3:0/3699106972 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fae080051c0 0x7fae1c149320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:42.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.978+0000 7fae22728700 1 -- 172.21.15.3:0/3699106972 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae1c096960 msgr2=0x7fae1c15e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:42.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.978+0000 7fae22728700 1 --2- 172.21.15.3:0/3699106972 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae1c096960 0x7fae1c15e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:42.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.978+0000 7fae22728700 1 -- 172.21.15.3:0/3699106972 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae1c095df0 con 0x7fae1c096dd0 2023-10-08T15:41:42.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.978+0000 7fae21f27700 1 --2- 172.21.15.3:0/3699106972 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fae080051c0 0x7fae1c149320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:41:42.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.978+0000 7fae21726700 1 --2- 172.21.15.3:0/3699106972 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae1c096960 0x7fae1c15e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:41:42.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.978+0000 7fae22728700 1 --2- 172.21.15.3:0/3699106972 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fae1c096dd0 0x7fae1c15e790 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fae1c06e330 tx=0x7fae14015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:42.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.978+0000 7fae11ffb700 1 -- 172.21.15.3:0/3699106972 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae14012420 con 0x7fae1c096dd0 2023-10-08T15:41:42.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.978+0000 7fae11ffb700 1 -- 172.21.15.3:0/3699106972 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae14001200 con 0x7fae1c096dd0 2023-10-08T15:41:42.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.978+0000 7fae22f29700 1 -- 172.21.15.3:0/3699106972 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae1c096400 con 0x7fae1c096dd0 2023-10-08T15:41:42.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.978+0000 7fae11ffb700 1 -- 172.21.15.3:0/3699106972 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae14012940 con 0x7fae1c096dd0 2023-10-08T15:41:42.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.978+0000 7fae22f29700 1 -- 172.21.15.3:0/3699106972 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae1c1521d0 con 0x7fae1c096dd0 2023-10-08T15:41:42.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.982+0000 7fae22f29700 1 -- 172.21.15.3:0/3699106972 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae1c149040 con 0x7fae1c096dd0 2023-10-08T15:41:42.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.982+0000 7fae11ffb700 1 -- 172.21.15.3:0/3699106972 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fae1401d5a0 con 0x7fae1c096dd0 2023-10-08T15:41:42.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.982+0000 7fae11ffb700 1 --2- 172.21.15.3:0/3699106972 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fae00060580 0x7fae00062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:42.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.982+0000 7fae11ffb700 1 -- 172.21.15.3:0/3699106972 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fae1407caf0 con 0x7fae1c096dd0 2023-10-08T15:41:42.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.982+0000 7fae21f27700 1 --2- 172.21.15.3:0/3699106972 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fae00060580 0x7fae00062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:42.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.982+0000 7fae21f27700 1 --2- 172.21.15.3:0/3699106972 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fae00060580 0x7fae00062a30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fae0c006f00 tx=0x7fae0c0091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:42.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:42.986+0000 7fae11ffb700 1 -- 172.21.15.3:0/3699106972 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fae1404d4b0 con 0x7fae1c096dd0 2023-10-08T15:41:43.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.154+0000 7fae22f29700 1 -- 172.21.15.3:0/3699106972 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fae1c149040 con 0x7fae1c096dd0 2023-10-08T15:41:43.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.154+0000 7fae11ffb700 1 -- 172.21.15.3:0/3699106972 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+12038 (secure 0 0 0) 0x7fae1c149040 con 0x7fae1c096dd0 2023-10-08T15:41:43.161 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:41:43.161 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":55,"fsid":"7635972e-cd66-4a8f-a231-378db8b3847a","created":"2023-10-08T15:37:08.234594+0000","modified":"2023-10-08T15:41:42.464704+0000","last_up_change":"2023-10-08T15:37:17.537726+0000","last_in_change":"2023-10-08T15:37:10.269178+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:37:16.581590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"64fb1864-bfdd-4d75-9b41-03fb60085dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33363},{"type":"v1","addr":"172.21.15.3:6801","nonce":33363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33363},{"type":"v1","addr":"172.21.15.3:6803","nonce":33363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":33363},{"type":"v1","addr":"172.21.15.3:6807","nonce":33363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33363},{"type":"v1","addr":"172.21.15.3:6805","nonce":33363}]},"public_addr":"172.21.15.3:6801/33363","cluster_addr":"172.21.15.3:6803/33363","heartbeat_back_addr":"172.21.15.3:6807/33363","heartbeat_front_addr":"172.21.15.3:6805/33363","state":["exists","up"]},{"osd":1,"uuid":"3ca6bd3a-3e8a-4c65-af9c-46148b0c2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33364},{"type":"v1","addr":"172.21.15.3:6820","nonce":33364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33364},{"type":"v1","addr":"172.21.15.3:6824","nonce":33364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33364},{"type":"v1","addr":"172.21.15.3:6831","nonce":33364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33364},{"type":"v1","addr":"172.21.15.3:6828","nonce":33364}]},"public_addr":"172.21.15.3:6820/33364","cluster_addr":"172.21.15.3:6824/33364","heartbeat_back_addr":"172.21.15.3:6831/33364","heartbeat_front_addr":"172.21.15.3:6828/33364","state":["exists","up"]},{"osd":2,"uuid":"6eb9f757-58dd-442f-910d-32401454bce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33366},{"type":"v1","addr":"172.21.15.3:6817","nonce":33366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":33366},{"type":"v1","addr":"172.21.15.3:6821","nonce":33366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6827","nonce":33366},{"type":"v1","addr":"172.21.15.3:6829","nonce":33366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":33366},{"type":"v1","addr":"172.21.15.3:6825","nonce":33366}]},"public_addr":"172.21.15.3:6817/33366","cluster_addr":"172.21.15.3:6821/33366","heartbeat_back_addr":"172.21.15.3:6829/33366","heartbeat_front_addr":"172.21.15.3:6825/33366","state":["exists","up"]},{"osd":3,"uuid":"1c39866b-ac2e-4ea9-a69c-02b01ee4191d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33365},{"type":"v1","addr":"172.21.15.3:6809","nonce":33365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":33365},{"type":"v1","addr":"172.21.15.3:6811","nonce":33365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33365},{"type":"v1","addr":"172.21.15.3:6815","nonce":33365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":33365},{"type":"v1","addr":"172.21.15.3:6813","nonce":33365}]},"public_addr":"172.21.15.3:6809/33365","cluster_addr":"172.21.15.3:6811/33365","heartbeat_back_addr":"172.21.15.3:6815/33365","heartbeat_front_addr":"172.21.15.3:6813/33365","state":["exists","up"]},{"osd":4,"uuid":"15f86b61-b7f1-4780-ae00-9d80a68cb830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":33605},{"type":"v1","addr":"172.21.15.50:6809","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33605},{"type":"v1","addr":"172.21.15.50:6811","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33605},{"type":"v1","addr":"172.21.15.50:6815","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":33605},{"type":"v1","addr":"172.21.15.50:6813","nonce":33605}]},"public_addr":"172.21.15.50:6809/33605","cluster_addr":"172.21.15.50:6811/33605","heartbeat_back_addr":"172.21.15.50:6815/33605","heartbeat_front_addr":"172.21.15.50:6813/33605","state":["exists","up"]},{"osd":5,"uuid":"726c3003-34e6-4d5a-b6e2-f911e13c2118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33606},{"type":"v1","addr":"172.21.15.50:6801","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33606},{"type":"v1","addr":"172.21.15.50:6803","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33606},{"type":"v1","addr":"172.21.15.50:6807","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":33606},{"type":"v1","addr":"172.21.15.50:6805","nonce":33606}]},"public_addr":"172.21.15.50:6801/33606","cluster_addr":"172.21.15.50:6803/33606","heartbeat_back_addr":"172.21.15.50:6807/33606","heartbeat_front_addr":"172.21.15.50:6805/33606","state":["exists","up"]},{"osd":6,"uuid":"401122a4-9988-441f-a5a7-39164434ebcd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":33607},{"type":"v1","addr":"172.21.15.50:6819","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":33607},{"type":"v1","addr":"172.21.15.50:6823","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":33607},{"type":"v1","addr":"172.21.15.50:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":33607},{"type":"v1","addr":"172.21.15.50:6827","nonce":33607}]},"public_addr":"172.21.15.50:6819/33607","cluster_addr":"172.21.15.50:6823/33607","heartbeat_back_addr":"172.21.15.50:6831/33607","heartbeat_front_addr":"172.21.15.50:6827/33607","state":["exists","up"]},{"osd":7,"uuid":"6b3fa236-c9d0-4c4d-82ae-9af4daf6d699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33604},{"type":"v1","addr":"172.21.15.50:6818","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":33604},{"type":"v1","addr":"172.21.15.50:6822","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":33604},{"type":"v1","addr":"172.21.15.50:6830","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":33604},{"type":"v1","addr":"172.21.15.50:6826","nonce":33604}]},"public_addr":"172.21.15.50:6818/33604","cluster_addr":"172.21.15.50:6822/33604","heartbeat_back_addr":"172.21.15.50:6830/33604","heartbeat_front_addr":"172.21.15.50:6826/33604","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.497794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.529417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.873426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.325972+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.443971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.240795+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.739632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.643026+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:41:43.163 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.158+0000 7fae22f29700 1 -- 172.21.15.3:0/3699106972 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fae00060580 msgr2=0x7fae00062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:43.163 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.158+0000 7fae22f29700 1 --2- 172.21.15.3:0/3699106972 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fae00060580 0x7fae00062a30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fae0c006f00 tx=0x7fae0c0091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:43.163 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.158+0000 7fae22f29700 1 -- 172.21.15.3:0/3699106972 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fae1c096dd0 msgr2=0x7fae1c15e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:43.163 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.158+0000 7fae22f29700 1 --2- 172.21.15.3:0/3699106972 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fae1c096dd0 0x7fae1c15e790 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fae1c06e330 tx=0x7fae14015000 comp rx=0 tx=0).stop 2023-10-08T15:41:43.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.158+0000 7fae22f29700 1 -- 172.21.15.3:0/3699106972 shutdown_connections 2023-10-08T15:41:43.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.158+0000 7fae22f29700 1 --2- 172.21.15.3:0/3699106972 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fae00060580 0x7fae00062a30 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:43.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.158+0000 7fae22f29700 1 --2- 172.21.15.3:0/3699106972 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fae1c096dd0 0x7fae1c15e790 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:43.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.158+0000 7fae22f29700 1 --2- 172.21.15.3:0/3699106972 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae1c096960 0x7fae1c15e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:43.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.158+0000 7fae22f29700 1 --2- 172.21.15.3:0/3699106972 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fae080051c0 0x7fae1c149320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:43.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.158+0000 7fae22f29700 1 -- 172.21.15.3:0/3699106972 >> 172.21.15.3:0/3699106972 conn(0x7fae1c0be4a0 msgr2=0x7fae1c0bc760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:43.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.158+0000 7fae22f29700 1 -- 172.21.15.3:0/3699106972 shutdown_connections 2023-10-08T15:41:43.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.158+0000 7fae22f29700 1 -- 172.21.15.3:0/3699106972 wait complete. 2023-10-08T15:41:43.179 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T15:37:16.581590+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-08T15:41:43.180 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T15:41:43.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.290+0000 7fe12e7ae700 1 Processor -- start 2023-10-08T15:41:43.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.290+0000 7fe12e7ae700 1 -- start start 2023-10-08T15:41:43.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.290+0000 7fe12e7ae700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe12806c5c0 0x7fe1280be3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:43.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.290+0000 7fe12e7ae700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe1280a7bc0 0x7fe12814bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:43.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.290+0000 7fe12e7ae700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe12806ced0 con 0x7fe1280a77f0 2023-10-08T15:41:43.297 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.290+0000 7fe12e7ae700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe12806e770 con 0x7fe1280a7bc0 2023-10-08T15:41:43.297 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.290+0000 7fe12e7ae700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe128069570 con 0x7fe12806c5c0 2023-10-08T15:41:43.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.290+0000 7fe12dfad700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe1280a7bc0 0x7fe12814bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:43.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.290+0000 7fe12cfab700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe12806c5c0 0x7fe1280be3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:43.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.290+0000 7fe12d7ac700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe1280a77f0 0x7fe1280a2200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.3:42584/0 (socket says 172.21.15.3:42584) 2023-10-08T15:41:43.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.290+0000 7fe12cfab700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe12806c5c0 0x7fe1280be3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.3:54926/0 (socket says 172.21.15.3:54926) 2023-10-08T15:41:43.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.290+0000 7fe12d7ac700 1 -- 172.21.15.3:0/2125236369 learned_addr learned my addr 172.21.15.3:0/2125236369 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:41:43.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.290+0000 7fe12dfad700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe1280a7bc0 0x7fe12814bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.3:35038/0 (socket says 172.21.15.3:35038) 2023-10-08T15:41:43.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.294+0000 7fe12cfab700 1 -- 172.21.15.3:0/2125236369 >> v2:172.21.15.50:3300/0 conn(0x7fe1280a7bc0 msgr2=0x7fe12814bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:43.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.294+0000 7fe12cfab700 1 --2- 172.21.15.3:0/2125236369 >> v2:172.21.15.50:3300/0 conn(0x7fe1280a7bc0 0x7fe12814bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:43.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.294+0000 7fe12cfab700 1 -- 172.21.15.3:0/2125236369 >> v1:172.21.15.50:6789/0 conn(0x7fe1280a77f0 legacy=0x7fe1280a2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:43.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.294+0000 7fe12cfab700 1 -- 172.21.15.3:0/2125236369 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe12814c620 con 0x7fe12806c5c0 2023-10-08T15:41:43.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.294+0000 7fe12cfab700 1 --2- 172.21.15.3:0/2125236369 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe12806c5c0 0x7fe1280be3d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe1240098e0 tx=0x7fe1240091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=acd6c851de9a9c2f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:43.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.294+0000 7fe11ffff700 1 -- 172.21.15.3:0/2125236369 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12400b640 con 0x7fe12806c5c0 2023-10-08T15:41:43.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.294+0000 7fe11ffff700 1 -- 172.21.15.3:0/2125236369 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe12400b7a0 con 0x7fe12806c5c0 2023-10-08T15:41:43.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.294+0000 7fe11ffff700 1 -- 172.21.15.3:0/2125236369 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12400bb40 con 0x7fe12806c5c0 2023-10-08T15:41:43.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.294+0000 7fe12e7ae700 1 -- 172.21.15.3:0/2125236369 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe12806c5c0 msgr2=0x7fe1280be3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:43.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.294+0000 7fe12e7ae700 1 --2- 172.21.15.3:0/2125236369 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe12806c5c0 0x7fe1280be3d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe1240098e0 tx=0x7fe1240091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:43.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.294+0000 7fe12e7ae700 1 -- 172.21.15.3:0/2125236369 shutdown_connections 2023-10-08T15:41:43.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.294+0000 7fe12e7ae700 1 --2- 172.21.15.3:0/2125236369 >> v2:172.21.15.50:3300/0 conn(0x7fe1280a7bc0 0x7fe12814bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:43.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.294+0000 7fe12e7ae700 1 --2- 172.21.15.3:0/2125236369 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe12806c5c0 0x7fe1280be3d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:43.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.294+0000 7fe12e7ae700 1 -- 172.21.15.3:0/2125236369 >> 172.21.15.3:0/2125236369 conn(0x7fe1280c29f0 msgr2=0x7fe1280a1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:43.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.294+0000 7fe12e7ae700 1 -- 172.21.15.3:0/2125236369 shutdown_connections 2023-10-08T15:41:43.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.294+0000 7fe12e7ae700 1 -- 172.21.15.3:0/2125236369 wait complete. 2023-10-08T15:41:43.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.298+0000 7fe12e7ae700 1 Processor -- start 2023-10-08T15:41:43.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.298+0000 7fe12e7ae700 1 -- start start 2023-10-08T15:41:43.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.298+0000 7fe12e7ae700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe12806c5c0 0x7fe1280b7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:43.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.298+0000 7fe12e7ae700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe1280a77f0 0x7fe128147470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:43.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.298+0000 7fe12e7ae700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1280a7bc0 0x7fe1281479b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:43.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.298+0000 7fe12e7ae700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1280a64e0 con 0x7fe12806c5c0 2023-10-08T15:41:43.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.298+0000 7fe12e7ae700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1280a6970 con 0x7fe1280a7bc0 2023-10-08T15:41:43.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.298+0000 7fe12e7ae700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1280b7680 con 0x7fe1280a77f0 2023-10-08T15:41:43.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.298+0000 7fe12d7ac700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe12806c5c0 0x7fe1280b7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:43.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.298+0000 7fe12d7ac700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe12806c5c0 0x7fe1280b7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57540/0 (socket says 172.21.15.3:57540) 2023-10-08T15:41:43.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.298+0000 7fe12d7ac700 1 -- 172.21.15.3:0/1632888620 learned_addr learned my addr 172.21.15.3:0/1632888620 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:43.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.298+0000 7fe12dfad700 1 --2- 172.21.15.3:0/1632888620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1280a7bc0 0x7fe1281479b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:43.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.298+0000 7fe12cfab700 1 --2- 172.21.15.3:0/1632888620 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe1280a77f0 0x7fe128147470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:43.305 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.298+0000 7fe12d7ac700 1 -- 172.21.15.3:0/1632888620 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe1280a77f0 msgr2=0x7fe128147470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:43.305 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.298+0000 7fe12d7ac700 1 --2- 172.21.15.3:0/1632888620 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe1280a77f0 0x7fe128147470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:43.305 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.298+0000 7fe12d7ac700 1 -- 172.21.15.3:0/1632888620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1280a7bc0 msgr2=0x7fe1281479b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:43.305 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.298+0000 7fe12d7ac700 1 --2- 172.21.15.3:0/1632888620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1280a7bc0 0x7fe1281479b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:43.306 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.298+0000 7fe12d7ac700 1 -- 172.21.15.3:0/1632888620 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe124009420 con 0x7fe12806c5c0 2023-10-08T15:41:43.306 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.298+0000 7fe12d7ac700 1 --2- 172.21.15.3:0/1632888620 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe12806c5c0 0x7fe1280b7140 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fe11800c7c0 tx=0x7fe118007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:43.306 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.298+0000 7fe11d7fa700 1 -- 172.21.15.3:0/1632888620 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe118005b30 con 0x7fe12806c5c0 2023-10-08T15:41:43.306 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.298+0000 7fe11d7fa700 1 -- 172.21.15.3:0/1632888620 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe118005c90 con 0x7fe12806c5c0 2023-10-08T15:41:43.306 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.298+0000 7fe12e7ae700 1 -- 172.21.15.3:0/1632888620 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1280a23c0 con 0x7fe12806c5c0 2023-10-08T15:41:43.306 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.298+0000 7fe11d7fa700 1 -- 172.21.15.3:0/1632888620 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe118004a80 con 0x7fe12806c5c0 2023-10-08T15:41:43.306 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.298+0000 7fe12e7ae700 1 -- 172.21.15.3:0/1632888620 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe128147ef0 con 0x7fe12806c5c0 2023-10-08T15:41:43.306 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.302+0000 7fe12e7ae700 1 -- 172.21.15.3:0/1632888620 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe12805ecf0 con 0x7fe12806c5c0 2023-10-08T15:41:43.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.302+0000 7fe11d7fa700 1 -- 172.21.15.3:0/1632888620 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe1180070d0 con 0x7fe12806c5c0 2023-10-08T15:41:43.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.302+0000 7fe11d7fa700 1 --2- 172.21.15.3:0/1632888620 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe10c060550 0x7fe10c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:43.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.302+0000 7fe11d7fa700 1 -- 172.21.15.3:0/1632888620 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fe11807b800 con 0x7fe12806c5c0 2023-10-08T15:41:43.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.302+0000 7fe12cfab700 1 --2- 172.21.15.3:0/1632888620 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe10c060550 0x7fe10c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:43.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.302+0000 7fe12cfab700 1 --2- 172.21.15.3:0/1632888620 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe10c060550 0x7fe10c062a00 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe1240093f0 tx=0x7fe124017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:43.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.310+0000 7fe11d7fa700 1 -- 172.21.15.3:0/1632888620 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe118049be0 con 0x7fe12806c5c0 2023-10-08T15:41:43.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.470+0000 7fe12e7ae700 1 -- 172.21.15.3:0/1632888620 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe12806cb60 con 0x7fe12806c5c0 2023-10-08T15:41:43.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.470+0000 7fe11d7fa700 1 -- 172.21.15.3:0/1632888620 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v55) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe11804c0a0 con 0x7fe12806c5c0 2023-10-08T15:41:43.476 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2023-10-08T15:41:43.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.474+0000 7fe12e7ae700 1 -- 172.21.15.3:0/1632888620 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe10c060550 msgr2=0x7fe10c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:43.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.474+0000 7fe12e7ae700 1 --2- 172.21.15.3:0/1632888620 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe10c060550 0x7fe10c062a00 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe1240093f0 tx=0x7fe124017000 comp rx=0 tx=0).stop 2023-10-08T15:41:43.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.474+0000 7fe12e7ae700 1 -- 172.21.15.3:0/1632888620 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe12806c5c0 msgr2=0x7fe1280b7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:43.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.474+0000 7fe12e7ae700 1 --2- 172.21.15.3:0/1632888620 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe12806c5c0 0x7fe1280b7140 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fe11800c7c0 tx=0x7fe118007f70 comp rx=0 tx=0).stop 2023-10-08T15:41:43.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.474+0000 7fe12e7ae700 1 -- 172.21.15.3:0/1632888620 shutdown_connections 2023-10-08T15:41:43.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.474+0000 7fe12e7ae700 1 --2- 172.21.15.3:0/1632888620 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe10c060550 0x7fe10c062a00 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:43.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.474+0000 7fe12e7ae700 1 --2- 172.21.15.3:0/1632888620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1280a7bc0 0x7fe1281479b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:43.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.474+0000 7fe12e7ae700 1 --2- 172.21.15.3:0/1632888620 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe1280a77f0 0x7fe128147470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:43.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.474+0000 7fe12e7ae700 1 --2- 172.21.15.3:0/1632888620 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe12806c5c0 0x7fe1280b7140 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:43.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.474+0000 7fe12e7ae700 1 -- 172.21.15.3:0/1632888620 >> 172.21.15.3:0/1632888620 conn(0x7fe1280c29f0 msgr2=0x7fe128149af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:43.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.478+0000 7fe12e7ae700 1 -- 172.21.15.3:0/1632888620 shutdown_connections 2023-10-08T15:41:43.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.478+0000 7fe12e7ae700 1 -- 172.21.15.3:0/1632888620 wait complete. 2023-10-08T15:41:43.495 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T15:41:43.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.594+0000 7fc223458700 1 Processor -- start 2023-10-08T15:41:43.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.594+0000 7fc223458700 1 -- start start 2023-10-08T15:41:43.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.594+0000 7fc223458700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fc21c0a15e0 0x7fc21c1460c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:43.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.594+0000 7fc223458700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc21c068320 0x7fc21c068af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:43.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.594+0000 7fc223458700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc21c14a180 con 0x7fc21c0a0d30 2023-10-08T15:41:43.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.594+0000 7fc223458700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc21c149cf0 con 0x7fc21c0a15e0 2023-10-08T15:41:43.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.594+0000 7fc223458700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc21c0b2080 con 0x7fc21c068320 2023-10-08T15:41:43.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.594+0000 7fc222456700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fc21c0a15e0 0x7fc21c1460c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:43.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.594+0000 7fc222456700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fc21c0a15e0 0x7fc21c1460c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57546/0 (socket says 172.21.15.3:57546) 2023-10-08T15:41:43.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.594+0000 7fc222456700 1 -- 172.21.15.3:0/2070054339 learned_addr learned my addr 172.21.15.3:0/2070054339 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:43.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.594+0000 7fc222c57700 1 --2- 172.21.15.3:0/2070054339 >> v2:172.21.15.50:3300/0 conn(0x7fc21c068320 0x7fc21c068af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:43.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.594+0000 7fc222456700 1 -- 172.21.15.3:0/2070054339 >> v2:172.21.15.50:3300/0 conn(0x7fc21c068320 msgr2=0x7fc21c068af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:43.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.594+0000 7fc222456700 1 --2- 172.21.15.3:0/2070054339 >> v2:172.21.15.50:3300/0 conn(0x7fc21c068320 0x7fc21c068af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:43.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.594+0000 7fc222456700 1 -- 172.21.15.3:0/2070054339 >> v1:172.21.15.50:6789/0 conn(0x7fc21c0a0d30 legacy=0x7fc21c146600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:43.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.594+0000 7fc222456700 1 -- 172.21.15.3:0/2070054339 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc21c0b2360 con 0x7fc21c0a15e0 2023-10-08T15:41:43.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.598+0000 7fc222456700 1 --2- 172.21.15.3:0/2070054339 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc21c0a15e0 0x7fc21c1460c0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fc21c149c60 tx=0x7fc218009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d36f7a5fa9dba779 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:43.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.598+0000 7fc221454700 1 -- 172.21.15.3:0/2070054339 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc218009e70 con 0x7fc21c0a15e0 2023-10-08T15:41:43.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.598+0000 7fc221454700 1 -- 172.21.15.3:0/2070054339 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc21800b860 con 0x7fc21c0a15e0 2023-10-08T15:41:43.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.598+0000 7fc221454700 1 -- 172.21.15.3:0/2070054339 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21800bc00 con 0x7fc21c0a15e0 2023-10-08T15:41:43.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.598+0000 7fc223458700 1 -- 172.21.15.3:0/2070054339 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc21c0a15e0 msgr2=0x7fc21c1460c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:43.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.598+0000 7fc223458700 1 --2- 172.21.15.3:0/2070054339 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc21c0a15e0 0x7fc21c1460c0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fc21c149c60 tx=0x7fc218009250 comp rx=0 tx=0).stop 2023-10-08T15:41:43.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.598+0000 7fc223458700 1 -- 172.21.15.3:0/2070054339 shutdown_connections 2023-10-08T15:41:43.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.598+0000 7fc223458700 1 --2- 172.21.15.3:0/2070054339 >> v2:172.21.15.50:3300/0 conn(0x7fc21c068320 0x7fc21c068af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:43.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.598+0000 7fc223458700 1 --2- 172.21.15.3:0/2070054339 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc21c0a15e0 0x7fc21c1460c0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:43.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.598+0000 7fc223458700 1 -- 172.21.15.3:0/2070054339 >> 172.21.15.3:0/2070054339 conn(0x7fc21c0670e0 msgr2=0x7fc21c0674e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:43.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.598+0000 7fc223458700 1 -- 172.21.15.3:0/2070054339 shutdown_connections 2023-10-08T15:41:43.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.598+0000 7fc223458700 1 -- 172.21.15.3:0/2070054339 wait complete. 2023-10-08T15:41:43.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.602+0000 7fc223458700 1 Processor -- start 2023-10-08T15:41:43.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.602+0000 7fc223458700 1 -- start start 2023-10-08T15:41:43.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.602+0000 7fc223458700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc21c068320 0x7fc21c15eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:43.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.602+0000 7fc223458700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc21c0a0d30 0x7fc21c0beb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:43.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.602+0000 7fc223458700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc21c0a15e0 0x7fc21c147bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:43.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.602+0000 7fc223458700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c06df90 con 0x7fc21c0a15e0 2023-10-08T15:41:43.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.602+0000 7fc223458700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c06dc60 con 0x7fc21c068320 2023-10-08T15:41:43.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.602+0000 7fc223458700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c0bf080 con 0x7fc21c0a0d30 2023-10-08T15:41:43.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.602+0000 7fc222c57700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc21c0a15e0 0x7fc21c147bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:43.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.602+0000 7fc222c57700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc21c0a15e0 0x7fc21c147bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57556/0 (socket says 172.21.15.3:57556) 2023-10-08T15:41:43.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.602+0000 7fc222c57700 1 -- 172.21.15.3:0/2679393029 learned_addr learned my addr 172.21.15.3:0/2679393029 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:43.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.602+0000 7fc222456700 1 --2- 172.21.15.3:0/2679393029 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc21c068320 0x7fc21c15eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:43.608 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.602+0000 7fc221c55700 1 --2- 172.21.15.3:0/2679393029 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc21c0a0d30 0x7fc21c0beb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:43.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.602+0000 7fc222c57700 1 -- 172.21.15.3:0/2679393029 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc21c0a0d30 msgr2=0x7fc21c0beb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:43.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.602+0000 7fc222c57700 1 --2- 172.21.15.3:0/2679393029 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc21c0a0d30 0x7fc21c0beb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:43.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.602+0000 7fc222c57700 1 -- 172.21.15.3:0/2679393029 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc21c068320 msgr2=0x7fc21c15eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:43.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.602+0000 7fc222c57700 1 --2- 172.21.15.3:0/2679393029 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc21c068320 0x7fc21c15eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:43.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.602+0000 7fc222c57700 1 -- 172.21.15.3:0/2679393029 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2180094f0 con 0x7fc21c0a15e0 2023-10-08T15:41:43.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.602+0000 7fc222c57700 1 --2- 172.21.15.3:0/2679393029 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc21c0a15e0 0x7fc21c147bf0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fc214009e90 tx=0x7fc21400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:43.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.602+0000 7fc2127fc700 1 -- 172.21.15.3:0/2679393029 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21400cb70 con 0x7fc21c0a15e0 2023-10-08T15:41:43.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.602+0000 7fc2127fc700 1 -- 172.21.15.3:0/2679393029 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc21400f040 con 0x7fc21c0a15e0 2023-10-08T15:41:43.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.602+0000 7fc2127fc700 1 -- 172.21.15.3:0/2679393029 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc214014480 con 0x7fc21c0a15e0 2023-10-08T15:41:43.610 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.602+0000 7fc223458700 1 -- 172.21.15.3:0/2679393029 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc21c148130 con 0x7fc21c0a15e0 2023-10-08T15:41:43.610 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.602+0000 7fc223458700 1 -- 172.21.15.3:0/2679393029 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc21c06d2d0 con 0x7fc21c0a15e0 2023-10-08T15:41:43.610 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.606+0000 7fc223458700 1 -- 172.21.15.3:0/2679393029 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc21c05ecf0 con 0x7fc21c0a15e0 2023-10-08T15:41:43.610 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.606+0000 7fc2127fc700 1 -- 172.21.15.3:0/2679393029 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc214014830 con 0x7fc21c0a15e0 2023-10-08T15:41:43.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.606+0000 7fc2127fc700 1 --2- 172.21.15.3:0/2679393029 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc200060550 0x7fc200062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:43.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.606+0000 7fc222456700 1 --2- 172.21.15.3:0/2679393029 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc200060550 0x7fc200062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:43.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.606+0000 7fc2127fc700 1 -- 172.21.15.3:0/2679393029 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fc21407cdd0 con 0x7fc21c0a15e0 2023-10-08T15:41:43.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.606+0000 7fc222456700 1 --2- 172.21.15.3:0/2679393029 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc200060550 0x7fc200062a00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc21c149c60 tx=0x7fc218017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:43.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.610+0000 7fc2127fc700 1 -- 172.21.15.3:0/2679393029 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc21404d710 con 0x7fc21c0a15e0 2023-10-08T15:41:43.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.774+0000 7fc223458700 1 -- 172.21.15.3:0/2679393029 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc21c06e0d0 con 0x7fc21c0a15e0 2023-10-08T15:41:43.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.778+0000 7fc2127fc700 1 -- 172.21.15.3:0/2679393029 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v55) v1 ==== 84+0+65 (secure 0 0 0) 0x7fc21407e060 con 0x7fc21c0a15e0 2023-10-08T15:41:43.781 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:41:43.781 INFO:teuthology.orchestra.run.smithi003.stdout:[ 2023-10-08T15:41:43.782 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:41:43.782 INFO:teuthology.orchestra.run.smithi003.stdout: "poolnum": 1, 2023-10-08T15:41:43.782 INFO:teuthology.orchestra.run.smithi003.stdout: "poolname": ".mgr" 2023-10-08T15:41:43.782 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:41:43.782 INFO:teuthology.orchestra.run.smithi003.stdout:] 2023-10-08T15:41:43.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.778+0000 7fc223458700 1 -- 172.21.15.3:0/2679393029 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc200060550 msgr2=0x7fc200062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:43.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.778+0000 7fc223458700 1 --2- 172.21.15.3:0/2679393029 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc200060550 0x7fc200062a00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc21c149c60 tx=0x7fc218017000 comp rx=0 tx=0).stop 2023-10-08T15:41:43.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.778+0000 7fc223458700 1 -- 172.21.15.3:0/2679393029 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc21c0a15e0 msgr2=0x7fc21c147bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:43.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.778+0000 7fc223458700 1 --2- 172.21.15.3:0/2679393029 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc21c0a15e0 0x7fc21c147bf0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fc214009e90 tx=0x7fc21400b040 comp rx=0 tx=0).stop 2023-10-08T15:41:43.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.778+0000 7fc223458700 1 -- 172.21.15.3:0/2679393029 shutdown_connections 2023-10-08T15:41:43.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.778+0000 7fc223458700 1 --2- 172.21.15.3:0/2679393029 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc200060550 0x7fc200062a00 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:43.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.778+0000 7fc223458700 1 --2- 172.21.15.3:0/2679393029 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc21c0a15e0 0x7fc21c147bf0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:43.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.778+0000 7fc223458700 1 --2- 172.21.15.3:0/2679393029 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc21c0a0d30 0x7fc21c0beb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:43.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.778+0000 7fc223458700 1 --2- 172.21.15.3:0/2679393029 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc21c068320 0x7fc21c15eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:43.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.778+0000 7fc223458700 1 -- 172.21.15.3:0/2679393029 >> 172.21.15.3:0/2679393029 conn(0x7fc21c0670e0 msgr2=0x7fc21c140ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:43.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.778+0000 7fc223458700 1 -- 172.21.15.3:0/2679393029 shutdown_connections 2023-10-08T15:41:43.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.778+0000 7fc223458700 1 -- 172.21.15.3:0/2679393029 wait complete. 2023-10-08T15:41:43.796 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T15:41:43.796 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T15:41:43.906 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.902+0000 7f69ed433700 1 Processor -- start 2023-10-08T15:41:43.906 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.902+0000 7f69ed433700 1 -- start start 2023-10-08T15:41:43.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.902+0000 7f69ed433700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f69e80a20b0 0x7f69e80683a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:43.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.902+0000 7f69ed433700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f69e814c180 0x7f69e8148430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:43.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.902+0000 7f69ed433700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69e80a2960 con 0x7f69e80a1340 2023-10-08T15:41:43.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.902+0000 7f69ed433700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69e809f8a0 con 0x7f69e80a20b0 2023-10-08T15:41:43.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.902+0000 7f69ed433700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e814b550 con 0x7f69e814c180 2023-10-08T15:41:43.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.902+0000 7f69e7fff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f69e80a20b0 0x7f69e80683a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:43.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.902+0000 7f69e7fff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f69e80a20b0 0x7f69e80683a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57558/0 (socket says 172.21.15.3:57558) 2023-10-08T15:41:43.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.902+0000 7f69e7fff700 1 -- 172.21.15.3:0/671926392 learned_addr learned my addr 172.21.15.3:0/671926392 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:43.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.902+0000 7f69ecc32700 1 --2- 172.21.15.3:0/671926392 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f69e814c180 0x7f69e8148430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:43.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.902+0000 7f69e7fff700 1 -- 172.21.15.3:0/671926392 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f69e814c180 msgr2=0x7f69e8148430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:43.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.902+0000 7f69e7fff700 1 --2- 172.21.15.3:0/671926392 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f69e814c180 0x7f69e8148430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:43.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.902+0000 7f69e7fff700 1 -- 172.21.15.3:0/671926392 >> v1:172.21.15.50:6789/0 conn(0x7f69e80a1340 legacy=0x7f69e814ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:43.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.902+0000 7f69e7fff700 1 -- 172.21.15.3:0/671926392 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e80ba150 con 0x7f69e80a20b0 2023-10-08T15:41:43.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.902+0000 7f69e7fff700 1 --2- 172.21.15.3:0/671926392 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f69e80a20b0 0x7f69e80683a0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f69d80099b0 tx=0x7f69d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db8f6d99dc8eee38 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:43.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.902+0000 7f69e6ffd700 1 -- 172.21.15.3:0/671926392 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d800b860 con 0x7f69e80a20b0 2023-10-08T15:41:43.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.902+0000 7f69e6ffd700 1 -- 172.21.15.3:0/671926392 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69d800b9c0 con 0x7f69e80a20b0 2023-10-08T15:41:43.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.902+0000 7f69e6ffd700 1 -- 172.21.15.3:0/671926392 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d800bd60 con 0x7f69e80a20b0 2023-10-08T15:41:43.910 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.902+0000 7f69ed433700 1 -- 172.21.15.3:0/671926392 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f69e80a20b0 msgr2=0x7f69e80683a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:43.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.902+0000 7f69ed433700 1 --2- 172.21.15.3:0/671926392 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f69e80a20b0 0x7f69e80683a0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f69d80099b0 tx=0x7f69d8009250 comp rx=0 tx=0).stop 2023-10-08T15:41:43.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.902+0000 7f69ed433700 1 -- 172.21.15.3:0/671926392 shutdown_connections 2023-10-08T15:41:43.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.902+0000 7f69ed433700 1 --2- 172.21.15.3:0/671926392 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f69e814c180 0x7f69e8148430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:43.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.902+0000 7f69ed433700 1 --2- 172.21.15.3:0/671926392 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f69e80a20b0 0x7f69e80683a0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:43.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.902+0000 7f69ed433700 1 -- 172.21.15.3:0/671926392 >> 172.21.15.3:0/671926392 conn(0x7f69e80bd9d0 msgr2=0x7f69e80bddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:43.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.902+0000 7f69ed433700 1 -- 172.21.15.3:0/671926392 shutdown_connections 2023-10-08T15:41:43.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.902+0000 7f69ed433700 1 -- 172.21.15.3:0/671926392 wait complete. 2023-10-08T15:41:43.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.906+0000 7f69ed433700 1 Processor -- start 2023-10-08T15:41:43.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.906+0000 7f69ed433700 1 -- start start 2023-10-08T15:41:43.913 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.906+0000 7f69ed433700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69e80a1340 0x7f69e8142ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:43.913 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.906+0000 7f69ed433700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f69e80a20b0 0x7f69e8143000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:43.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.906+0000 7f69ed433700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f69e814c180 0x7f69e814c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:43.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.906+0000 7f69ed433700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e8143540 con 0x7f69e814c180 2023-10-08T15:41:43.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.906+0000 7f69ed433700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e814f710 con 0x7f69e80a1340 2023-10-08T15:41:43.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.906+0000 7f69ed433700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e815ee40 con 0x7f69e80a20b0 2023-10-08T15:41:43.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.906+0000 7f69ecc32700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f69e814c180 0x7f69e814c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:43.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.906+0000 7f69e7fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69e80a1340 0x7f69e8142ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:43.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.906+0000 7f69ecc32700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f69e814c180 0x7f69e814c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57574/0 (socket says 172.21.15.3:57574) 2023-10-08T15:41:43.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.906+0000 7f69ecc32700 1 -- 172.21.15.3:0/3317071555 learned_addr learned my addr 172.21.15.3:0/3317071555 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:43.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.906+0000 7f69e77fe700 1 --2- 172.21.15.3:0/3317071555 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f69e80a20b0 0x7f69e8143000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:43.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.906+0000 7f69ecc32700 1 -- 172.21.15.3:0/3317071555 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f69e80a20b0 msgr2=0x7f69e8143000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:43.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.906+0000 7f69ecc32700 1 --2- 172.21.15.3:0/3317071555 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f69e80a20b0 0x7f69e8143000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:43.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.906+0000 7f69ecc32700 1 -- 172.21.15.3:0/3317071555 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69e80a1340 msgr2=0x7f69e8142ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:43.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.906+0000 7f69ecc32700 1 --2- 172.21.15.3:0/3317071555 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69e80a1340 0x7f69e8142ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:43.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.906+0000 7f69ecc32700 1 -- 172.21.15.3:0/3317071555 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d80094f0 con 0x7f69e814c180 2023-10-08T15:41:43.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.906+0000 7f69e7fff700 1 --2- 172.21.15.3:0/3317071555 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69e80a1340 0x7f69e8142ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:41:43.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.906+0000 7f69ecc32700 1 --2- 172.21.15.3:0/3317071555 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f69e814c180 0x7f69e814c940 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f69e0007ef0 tx=0x7f69e0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:43.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.910+0000 7f69dffff700 1 -- 172.21.15.3:0/3317071555 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e000eb30 con 0x7f69e814c180 2023-10-08T15:41:43.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.910+0000 7f69dffff700 1 -- 172.21.15.3:0/3317071555 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e000ec90 con 0x7f69e814c180 2023-10-08T15:41:43.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.910+0000 7f69ed433700 1 -- 172.21.15.3:0/3317071555 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69e814f410 con 0x7f69e814c180 2023-10-08T15:41:43.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.910+0000 7f69dffff700 1 -- 172.21.15.3:0/3317071555 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e0014670 con 0x7f69e814c180 2023-10-08T15:41:43.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.910+0000 7f69ed433700 1 -- 172.21.15.3:0/3317071555 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69e81418f0 con 0x7f69e814c180 2023-10-08T15:41:43.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.910+0000 7f69ed433700 1 -- 172.21.15.3:0/3317071555 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69e805ecf0 con 0x7f69e814c180 2023-10-08T15:41:43.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.910+0000 7f69dffff700 1 -- 172.21.15.3:0/3317071555 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f69e0014a20 con 0x7f69e814c180 2023-10-08T15:41:43.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.910+0000 7f69dffff700 1 --2- 172.21.15.3:0/3317071555 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f69c8060550 0x7f69c8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:43.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.910+0000 7f69dffff700 1 -- 172.21.15.3:0/3317071555 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f69e007c9e0 con 0x7f69e814c180 2023-10-08T15:41:43.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.910+0000 7f69e7fff700 1 --2- 172.21.15.3:0/3317071555 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f69c8060550 0x7f69c8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:43.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.914+0000 7f69e7fff700 1 --2- 172.21.15.3:0/3317071555 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f69c8060550 0x7f69c8062a00 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f69d80099b0 tx=0x7f69d8017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:43.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:43.922+0000 7f69dffff700 1 -- 172.21.15.3:0/3317071555 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f69e004d320 con 0x7f69e814c180 2023-10-08T15:41:44.086 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.082+0000 7f69ed433700 1 -- 172.21.15.3:0/3317071555 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f69e815f000 con 0x7f69e814c180 2023-10-08T15:41:44.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.502+0000 7f69dffff700 1 -- 172.21.15.3:0/3317071555 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v56) v1 ==== 138+0+0 (secure 0 0 0) 0x7f69e0009980 con 0x7f69e814c180 2023-10-08T15:41:44.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.510+0000 7f69ed433700 1 -- 172.21.15.3:0/3317071555 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f69c8060550 msgr2=0x7f69c8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:44.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.510+0000 7f69ed433700 1 --2- 172.21.15.3:0/3317071555 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f69c8060550 0x7f69c8062a00 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f69d80099b0 tx=0x7f69d8017000 comp rx=0 tx=0).stop 2023-10-08T15:41:44.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.510+0000 7f69ed433700 1 -- 172.21.15.3:0/3317071555 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f69e814c180 msgr2=0x7f69e814c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:44.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.510+0000 7f69ed433700 1 --2- 172.21.15.3:0/3317071555 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f69e814c180 0x7f69e814c940 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f69e0007ef0 tx=0x7f69e0009840 comp rx=0 tx=0).stop 2023-10-08T15:41:44.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.510+0000 7f69ed433700 1 -- 172.21.15.3:0/3317071555 shutdown_connections 2023-10-08T15:41:44.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.510+0000 7f69ed433700 1 --2- 172.21.15.3:0/3317071555 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f69c8060550 0x7f69c8062a00 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:44.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.510+0000 7f69ed433700 1 --2- 172.21.15.3:0/3317071555 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f69e814c180 0x7f69e814c940 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:44.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.510+0000 7f69ed433700 1 --2- 172.21.15.3:0/3317071555 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f69e80a20b0 0x7f69e8143000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:44.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.510+0000 7f69ed433700 1 --2- 172.21.15.3:0/3317071555 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69e80a1340 0x7f69e8142ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:44.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.510+0000 7f69ed433700 1 -- 172.21.15.3:0/3317071555 >> 172.21.15.3:0/3317071555 conn(0x7f69e80bd9d0 msgr2=0x7f69e8068a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:44.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.510+0000 7f69ed433700 1 -- 172.21.15.3:0/3317071555 shutdown_connections 2023-10-08T15:41:44.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.510+0000 7f69ed433700 1 -- 172.21.15.3:0/3317071555 wait complete. 2023-10-08T15:41:44.517 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'cephfs_metadata' created 2023-10-08T15:41:44.529 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T15:41:44.652 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.646+0000 7f608f8a4700 1 Processor -- start 2023-10-08T15:41:44.652 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.646+0000 7f608f8a4700 1 -- start start 2023-10-08T15:41:44.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.650+0000 7f608f8a4700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f608814c490 0x7f6088148b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:44.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.650+0000 7f608f8a4700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6088149040 0x7f60880bace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:44.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.650+0000 7f608f8a4700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6088148670 con 0x7f60880bc1d0 2023-10-08T15:41:44.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.650+0000 7f608f8a4700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f608806f000 con 0x7f6088149040 2023-10-08T15:41:44.655 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.650+0000 7f608f8a4700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f608806f2e0 con 0x7f608814c490 2023-10-08T15:41:44.655 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.650+0000 7f608ce3f700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f608814c490 0x7f6088148b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:44.655 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.650+0000 7f608de41700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6088149040 0x7f60880bace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:44.655 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.650+0000 7f608d640700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f60880bc1d0 0x7f60880b1e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.3:42608/0 (socket says 172.21.15.3:42608) 2023-10-08T15:41:44.655 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.650+0000 7f608de41700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6088149040 0x7f60880bace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.3:35074/0 (socket says 172.21.15.3:35074) 2023-10-08T15:41:44.655 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.650+0000 7f608d640700 1 -- 172.21.15.3:0/4134439284 learned_addr learned my addr 172.21.15.3:0/4134439284 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:41:44.655 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.650+0000 7f608ce3f700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f608814c490 0x7f6088148b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.3:54964/0 (socket says 172.21.15.3:54964) 2023-10-08T15:41:44.656 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.650+0000 7f608de41700 1 -- 172.21.15.3:0/4134439284 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f608814c490 msgr2=0x7f6088148b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:44.656 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.650+0000 7f608de41700 1 --2- 172.21.15.3:0/4134439284 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f608814c490 0x7f6088148b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:44.656 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.650+0000 7f608de41700 1 -- 172.21.15.3:0/4134439284 >> v1:172.21.15.50:6789/0 conn(0x7f60880bc1d0 legacy=0x7f60880b1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:44.657 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.650+0000 7f608de41700 1 -- 172.21.15.3:0/4134439284 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f608814c8c0 con 0x7f6088149040 2023-10-08T15:41:44.657 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.650+0000 7f608de41700 1 --2- 172.21.15.3:0/4134439284 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6088149040 0x7f60880bace0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6080009e60 tx=0x7f6080009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d0b81d108c341ec server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:44.657 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.650+0000 7f607ffff700 1 -- 172.21.15.3:0/4134439284 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608000e070 con 0x7f6088149040 2023-10-08T15:41:44.657 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.650+0000 7f607ffff700 1 -- 172.21.15.3:0/4134439284 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f608000bb60 con 0x7f6088149040 2023-10-08T15:41:44.657 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.650+0000 7f607ffff700 1 -- 172.21.15.3:0/4134439284 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6080012430 con 0x7f6088149040 2023-10-08T15:41:44.658 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.650+0000 7f608f8a4700 1 -- 172.21.15.3:0/4134439284 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6088149040 msgr2=0x7f60880bace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:44.658 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.650+0000 7f608f8a4700 1 --2- 172.21.15.3:0/4134439284 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6088149040 0x7f60880bace0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6080009e60 tx=0x7f6080009780 comp rx=0 tx=0).stop 2023-10-08T15:41:44.658 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.654+0000 7f608f8a4700 1 -- 172.21.15.3:0/4134439284 shutdown_connections 2023-10-08T15:41:44.658 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.654+0000 7f608f8a4700 1 --2- 172.21.15.3:0/4134439284 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6088149040 0x7f60880bace0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:44.658 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.654+0000 7f608f8a4700 1 --2- 172.21.15.3:0/4134439284 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f608814c490 0x7f6088148b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:44.659 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.654+0000 7f608f8a4700 1 -- 172.21.15.3:0/4134439284 >> 172.21.15.3:0/4134439284 conn(0x7f60880bf820 msgr2=0x7f60880bb890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:44.659 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.654+0000 7f608f8a4700 1 -- 172.21.15.3:0/4134439284 shutdown_connections 2023-10-08T15:41:44.659 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.654+0000 7f608f8a4700 1 -- 172.21.15.3:0/4134439284 wait complete. 2023-10-08T15:41:44.659 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.654+0000 7f608f8a4700 1 Processor -- start 2023-10-08T15:41:44.659 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.654+0000 7f608f8a4700 1 -- start start 2023-10-08T15:41:44.660 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.654+0000 7f608f8a4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60880bc1d0 0x7f6088067310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:44.660 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.654+0000 7f608f8a4700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6088149040 0x7f60880b85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:44.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.654+0000 7f608f8a4700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f608814c490 0x7f60880b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:44.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.654+0000 7f608f8a4700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60880ba830 con 0x7f608814c490 2023-10-08T15:41:44.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.654+0000 7f608f8a4700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60880b7260 con 0x7f60880bc1d0 2023-10-08T15:41:44.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.654+0000 7f608f8a4700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6088067850 con 0x7f6088149040 2023-10-08T15:41:44.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.654+0000 7f608de41700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f608814c490 0x7f60880b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:44.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.654+0000 7f608d640700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60880bc1d0 0x7f6088067310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:44.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.654+0000 7f608ce3f700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6088149040 0x7f60880b85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:44.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.654+0000 7f608d640700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60880bc1d0 0x7f6088067310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.3:35086/0 (socket says 172.21.15.3:35086) 2023-10-08T15:41:44.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.654+0000 7f608d640700 1 -- 172.21.15.3:0/2277945701 learned_addr learned my addr 172.21.15.3:0/2277945701 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:44.662 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.658+0000 7f608d640700 1 -- 172.21.15.3:0/2277945701 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6088149040 msgr2=0x7f60880b85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:44.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.658+0000 7f608d640700 1 --2- 172.21.15.3:0/2277945701 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6088149040 0x7f60880b85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:44.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.658+0000 7f608d640700 1 -- 172.21.15.3:0/2277945701 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f608814c490 msgr2=0x7f60880b8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:44.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.658+0000 7f608d640700 1 --2- 172.21.15.3:0/2277945701 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f608814c490 0x7f60880b8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:44.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.658+0000 7f608d640700 1 -- 172.21.15.3:0/2277945701 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6080009a20 con 0x7f60880bc1d0 2023-10-08T15:41:44.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.658+0000 7f608d640700 1 --2- 172.21.15.3:0/2277945701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60880bc1d0 0x7f6088067310 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f608400c7f0 tx=0x7f6084007f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:44.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.658+0000 7f607d7fa700 1 -- 172.21.15.3:0/2277945701 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6084005b30 con 0x7f60880bc1d0 2023-10-08T15:41:44.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.658+0000 7f607d7fa700 1 -- 172.21.15.3:0/2277945701 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6084005cb0 con 0x7f60880bc1d0 2023-10-08T15:41:44.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.658+0000 7f608f8a4700 1 -- 172.21.15.3:0/2277945701 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60880b74b0 con 0x7f60880bc1d0 2023-10-08T15:41:44.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.658+0000 7f607d7fa700 1 -- 172.21.15.3:0/2277945701 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6084004a80 con 0x7f60880bc1d0 2023-10-08T15:41:44.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.658+0000 7f608f8a4700 1 -- 172.21.15.3:0/2277945701 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60880b9060 con 0x7f60880bc1d0 2023-10-08T15:41:44.664 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.658+0000 7f608f8a4700 1 -- 172.21.15.3:0/2277945701 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60880b7930 con 0x7f60880bc1d0 2023-10-08T15:41:44.665 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.662+0000 7f607d7fa700 1 -- 172.21.15.3:0/2277945701 <== mon.1 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6084034a70 con 0x7f60880bc1d0 2023-10-08T15:41:44.666 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.662+0000 7f607d7fa700 1 --2- 172.21.15.3:0/2277945701 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f606c060550 0x7f606c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:44.666 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.662+0000 7f607d7fa700 1 -- 172.21.15.3:0/2277945701 <== mon.1 v2:172.21.15.50:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f608407bee0 con 0x7f60880bc1d0 2023-10-08T15:41:44.666 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.662+0000 7f608ce3f700 1 --2- 172.21.15.3:0/2277945701 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f606c060550 0x7f606c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:44.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.662+0000 7f608ce3f700 1 --2- 172.21.15.3:0/2277945701 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f606c060550 0x7f606c062a00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f60880b8150 tx=0x7f60780091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:44.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.670+0000 7f607d7fa700 1 -- 172.21.15.3:0/2277945701 <== mon.1 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f608404c730 con 0x7f60880bc1d0 2023-10-08T15:41:44.838 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:44.834+0000 7f608f8a4700 1 -- 172.21.15.3:0/2277945701 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f60880b8200 con 0x7f60880bc1d0 2023-10-08T15:41:45.525 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.518+0000 7f607d7fa700 1 -- 172.21.15.3:0/2277945701 <== mon.1 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v57) v1 ==== 170+0+0 (secure 0 0 0) 0x7f608404fd50 con 0x7f60880bc1d0 2023-10-08T15:41:45.549 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.542+0000 7f608f8a4700 1 -- 172.21.15.3:0/2277945701 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f606c060550 msgr2=0x7f606c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:45.549 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.542+0000 7f608f8a4700 1 --2- 172.21.15.3:0/2277945701 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f606c060550 0x7f606c062a00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f60880b8150 tx=0x7f60780091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:45.549 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.542+0000 7f608f8a4700 1 -- 172.21.15.3:0/2277945701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60880bc1d0 msgr2=0x7f6088067310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:45.549 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.542+0000 7f608f8a4700 1 --2- 172.21.15.3:0/2277945701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60880bc1d0 0x7f6088067310 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f608400c7f0 tx=0x7f6084007f70 comp rx=0 tx=0).stop 2023-10-08T15:41:45.549 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.542+0000 7f608f8a4700 1 -- 172.21.15.3:0/2277945701 shutdown_connections 2023-10-08T15:41:45.549 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.542+0000 7f608f8a4700 1 --2- 172.21.15.3:0/2277945701 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f606c060550 0x7f606c062a00 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:45.549 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.542+0000 7f608f8a4700 1 --2- 172.21.15.3:0/2277945701 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f608814c490 0x7f60880b8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:45.549 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.542+0000 7f608f8a4700 1 --2- 172.21.15.3:0/2277945701 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6088149040 0x7f60880b85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:45.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.542+0000 7f608f8a4700 1 --2- 172.21.15.3:0/2277945701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60880bc1d0 0x7f6088067310 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:45.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.542+0000 7f608f8a4700 1 -- 172.21.15.3:0/2277945701 >> 172.21.15.3:0/2277945701 conn(0x7f60880bf820 msgr2=0x7f60880681f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:45.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.542+0000 7f608f8a4700 1 -- 172.21.15.3:0/2277945701 shutdown_connections 2023-10-08T15:41:45.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.542+0000 7f608f8a4700 1 -- 172.21.15.3:0/2277945701 wait complete. 2023-10-08T15:41:45.550 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'cephfs_data' created 2023-10-08T15:41:45.561 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T15:41:45.670 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.666+0000 7f6c8f45e700 1 Processor -- start 2023-10-08T15:41:45.670 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.666+0000 7f6c8f45e700 1 -- start start 2023-10-08T15:41:45.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.666+0000 7f6c8f45e700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f6c88067e20 0x7f6c8809e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:45.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.666+0000 7f6c8f45e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6c8814f5d0 0x7f6c88150f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:45.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.666+0000 7f6c8f45e700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c880ba480 con 0x7f6c88069ab0 2023-10-08T15:41:45.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.666+0000 7f6c8f45e700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c8809eab0 con 0x7f6c88067e20 2023-10-08T15:41:45.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.666+0000 7f6c8f45e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c88150620 con 0x7f6c8814f5d0 2023-10-08T15:41:45.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.666+0000 7f6c8c9f9700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f6c88069ab0 0x7f6c8814eec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:47640/0 (socket says 172.21.15.3:47640) 2023-10-08T15:41:45.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.666+0000 7f6c8c9f9700 1 -- 172.21.15.3:0/2580678315 learned_addr learned my addr 172.21.15.3:0/2580678315 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:41:45.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.666+0000 7f6c8d1fa700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f6c88067e20 0x7f6c8809e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:45.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.666+0000 7f6c8d9fb700 1 --2- 172.21.15.3:0/2580678315 >> v2:172.21.15.50:3300/0 conn(0x7f6c8814f5d0 0x7f6c88150f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:45.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.666+0000 7f6c7ffff700 1 -- 172.21.15.3:0/2580678315 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1048707923 0 0) 0x7f6c880ba480 con 0x7f6c88069ab0 2023-10-08T15:41:45.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.666+0000 7f6c7ffff700 1 -- 172.21.15.3:0/2580678315 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c74003570 con 0x7f6c88069ab0 2023-10-08T15:41:45.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.666+0000 7f6c8d1fa700 1 -- 172.21.15.3:0/2580678315 >> v2:172.21.15.50:3300/0 conn(0x7f6c8814f5d0 msgr2=0x7f6c88150f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:45.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.666+0000 7f6c8d1fa700 1 --2- 172.21.15.3:0/2580678315 >> v2:172.21.15.50:3300/0 conn(0x7f6c8814f5d0 0x7f6c88150f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:45.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.666+0000 7f6c8d1fa700 1 -- 172.21.15.3:0/2580678315 >> v1:172.21.15.3:6789/0 conn(0x7f6c88069ab0 legacy=0x7f6c8814eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:45.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.666+0000 7f6c8d1fa700 1 -- 172.21.15.3:0/2580678315 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c88150900 con 0x7f6c88067e20 2023-10-08T15:41:45.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.666+0000 7f6c8d9fb700 1 --2- 172.21.15.3:0/2580678315 >> v2:172.21.15.50:3300/0 conn(0x7f6c8814f5d0 0x7f6c88150f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:45.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.666+0000 7f6c8d1fa700 1 --2- 172.21.15.3:0/2580678315 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6c88067e20 0x7f6c8809e490 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f6c88152f30 tx=0x7f6c780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddad941566f74297 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:45.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.666+0000 7f6c7ffff700 1 -- 172.21.15.3:0/2580678315 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c78011630 con 0x7f6c88067e20 2023-10-08T15:41:45.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.666+0000 7f6c7ffff700 1 -- 172.21.15.3:0/2580678315 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c78011790 con 0x7f6c88067e20 2023-10-08T15:41:45.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.666+0000 7f6c7ffff700 1 -- 172.21.15.3:0/2580678315 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c78011b30 con 0x7f6c88067e20 2023-10-08T15:41:45.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.666+0000 7f6c8f45e700 1 -- 172.21.15.3:0/2580678315 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6c88067e20 msgr2=0x7f6c8809e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:45.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.666+0000 7f6c8f45e700 1 --2- 172.21.15.3:0/2580678315 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6c88067e20 0x7f6c8809e490 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f6c88152f30 tx=0x7f6c780091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:45.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.666+0000 7f6c8f45e700 1 -- 172.21.15.3:0/2580678315 shutdown_connections 2023-10-08T15:41:45.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.666+0000 7f6c8f45e700 1 --2- 172.21.15.3:0/2580678315 >> v2:172.21.15.50:3300/0 conn(0x7f6c8814f5d0 0x7f6c88150f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:45.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.666+0000 7f6c8f45e700 1 --2- 172.21.15.3:0/2580678315 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6c88067e20 0x7f6c8809e490 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:45.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.666+0000 7f6c8f45e700 1 -- 172.21.15.3:0/2580678315 >> 172.21.15.3:0/2580678315 conn(0x7f6c880670e0 msgr2=0x7f6c880674e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:45.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.670+0000 7f6c8f45e700 1 -- 172.21.15.3:0/2580678315 shutdown_connections 2023-10-08T15:41:45.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.670+0000 7f6c8f45e700 1 -- 172.21.15.3:0/2580678315 wait complete. 2023-10-08T15:41:45.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.670+0000 7f6c8f45e700 1 Processor -- start 2023-10-08T15:41:45.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.670+0000 7f6c8f45e700 1 -- start start 2023-10-08T15:41:45.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.670+0000 7f6c8f45e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6c88067e20 0x7f6c88163690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:45.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.670+0000 7f6c8f45e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c88069ab0 0x7f6c88162d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:45.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.670+0000 7f6c8f45e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6c8814f5d0 0x7f6c880a0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:45.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.670+0000 7f6c8f45e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c880b3d90 con 0x7f6c88067e20 2023-10-08T15:41:45.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.670+0000 7f6c8f45e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c880a2c70 con 0x7f6c88069ab0 2023-10-08T15:41:45.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.670+0000 7f6c8f45e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c881632c0 con 0x7f6c8814f5d0 2023-10-08T15:41:45.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.670+0000 7f6c8d1fa700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6c88067e20 0x7f6c88163690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:45.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.670+0000 7f6c8d1fa700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6c88067e20 0x7f6c88163690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57604/0 (socket says 172.21.15.3:57604) 2023-10-08T15:41:45.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.670+0000 7f6c8c9f9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c88069ab0 0x7f6c88162d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:45.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.670+0000 7f6c8d1fa700 1 -- 172.21.15.3:0/3575322263 learned_addr learned my addr 172.21.15.3:0/3575322263 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:45.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.670+0000 7f6c8d9fb700 1 --2- 172.21.15.3:0/3575322263 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6c8814f5d0 0x7f6c880a0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:45.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.674+0000 7f6c8c9f9700 1 -- 172.21.15.3:0/3575322263 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6c8814f5d0 msgr2=0x7f6c880a0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:45.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.674+0000 7f6c8c9f9700 1 --2- 172.21.15.3:0/3575322263 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6c8814f5d0 0x7f6c880a0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:45.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.674+0000 7f6c8c9f9700 1 -- 172.21.15.3:0/3575322263 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6c88067e20 msgr2=0x7f6c88163690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:45.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.674+0000 7f6c8c9f9700 1 --2- 172.21.15.3:0/3575322263 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6c88067e20 0x7f6c88163690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:45.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.674+0000 7f6c8c9f9700 1 -- 172.21.15.3:0/3575322263 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c78009420 con 0x7f6c88069ab0 2023-10-08T15:41:45.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.674+0000 7f6c8d1fa700 1 --2- 172.21.15.3:0/3575322263 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6c88067e20 0x7f6c88163690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:41:45.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.674+0000 7f6c8c9f9700 1 --2- 172.21.15.3:0/3575322263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c88069ab0 0x7f6c88162d80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6c8400c580 tx=0x7f6c84007d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:45.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.674+0000 7f6c7d7fa700 1 -- 172.21.15.3:0/3575322263 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c84005b30 con 0x7f6c88069ab0 2023-10-08T15:41:45.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.674+0000 7f6c7d7fa700 1 -- 172.21.15.3:0/3575322263 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c84005cb0 con 0x7f6c88069ab0 2023-10-08T15:41:45.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.674+0000 7f6c8f45e700 1 -- 172.21.15.3:0/3575322263 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c8814bd30 con 0x7f6c88069ab0 2023-10-08T15:41:45.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.674+0000 7f6c7d7fa700 1 -- 172.21.15.3:0/3575322263 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c84007320 con 0x7f6c88069ab0 2023-10-08T15:41:45.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.674+0000 7f6c8f45e700 1 -- 172.21.15.3:0/3575322263 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c880a1d80 con 0x7f6c88069ab0 2023-10-08T15:41:45.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.674+0000 7f6c8f45e700 1 -- 172.21.15.3:0/3575322263 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c88152c90 con 0x7f6c88069ab0 2023-10-08T15:41:45.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.674+0000 7f6c7d7fa700 1 -- 172.21.15.3:0/3575322263 <== mon.1 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6c8401b3b0 con 0x7f6c88069ab0 2023-10-08T15:41:45.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.678+0000 7f6c7d7fa700 1 --2- 172.21.15.3:0/3575322263 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f6c6c060580 0x7f6c6c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:45.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.678+0000 7f6c7d7fa700 1 -- 172.21.15.3:0/3575322263 <== mon.1 v2:172.21.15.50:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f6c8407bed0 con 0x7f6c88069ab0 2023-10-08T15:41:45.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.678+0000 7f6c8d1fa700 1 --2- 172.21.15.3:0/3575322263 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f6c6c060580 0x7f6c6c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:45.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.678+0000 7f6c8d1fa700 1 --2- 172.21.15.3:0/3575322263 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f6c6c060580 0x7f6c6c062a30 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6c78011fd0 tx=0x7f6c78017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:45.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.686+0000 7f6c7d7fa700 1 -- 172.21.15.3:0/3575322263 <== mon.1 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6c8404c480 con 0x7f6c88069ab0 2023-10-08T15:41:45.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:45.882+0000 7f6c8f45e700 1 -- 172.21.15.3:0/3575322263 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f6c88152c90 con 0x7f6c88069ab0 2023-10-08T15:41:46.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.522+0000 7f6c7d7fa700 1 -- 172.21.15.3:0/3575322263 <== mon.1 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v31) v1 ==== 174+0+0 (secure 0 0 0) 0x7f6c88152c90 con 0x7f6c88069ab0 2023-10-08T15:41:46.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.538+0000 7f6c8f45e700 1 -- 172.21.15.3:0/3575322263 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f6c6c060580 msgr2=0x7f6c6c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:46.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.538+0000 7f6c8f45e700 1 --2- 172.21.15.3:0/3575322263 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f6c6c060580 0x7f6c6c062a30 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6c78011fd0 tx=0x7f6c78017000 comp rx=0 tx=0).stop 2023-10-08T15:41:46.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.538+0000 7f6c8f45e700 1 -- 172.21.15.3:0/3575322263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c88069ab0 msgr2=0x7f6c88162d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:46.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.538+0000 7f6c8f45e700 1 --2- 172.21.15.3:0/3575322263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c88069ab0 0x7f6c88162d80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6c8400c580 tx=0x7f6c84007d50 comp rx=0 tx=0).stop 2023-10-08T15:41:46.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.542+0000 7f6c8f45e700 1 -- 172.21.15.3:0/3575322263 shutdown_connections 2023-10-08T15:41:46.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.542+0000 7f6c8f45e700 1 --2- 172.21.15.3:0/3575322263 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f6c6c060580 0x7f6c6c062a30 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:46.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.542+0000 7f6c8f45e700 1 --2- 172.21.15.3:0/3575322263 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6c8814f5d0 0x7f6c880a0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:46.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.542+0000 7f6c8f45e700 1 --2- 172.21.15.3:0/3575322263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c88069ab0 0x7f6c88162d80 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:46.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.542+0000 7f6c8f45e700 1 --2- 172.21.15.3:0/3575322263 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6c88067e20 0x7f6c88163690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:46.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.542+0000 7f6c8f45e700 1 -- 172.21.15.3:0/3575322263 >> 172.21.15.3:0/3575322263 conn(0x7f6c880670e0 msgr2=0x7f6c880bccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:46.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.542+0000 7f6c8f45e700 1 -- 172.21.15.3:0/3575322263 shutdown_connections 2023-10-08T15:41:46.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.542+0000 7f6c8f45e700 1 -- 172.21.15.3:0/3575322263 wait complete. 2023-10-08T15:41:46.557 INFO:teuthology.orchestra.run.smithi003.stderr:new fs with metadata pool 10 and data pool 11 2023-10-08T15:41:46.571 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:41:46.669 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.662+0000 7f53a759e700 1 Processor -- start 2023-10-08T15:41:46.669 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.662+0000 7f53a759e700 1 -- start start 2023-10-08T15:41:46.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.666+0000 7f53a759e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53a80bacf0 0x7f53a806dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:46.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.666+0000 7f53a759e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f53a80bb0c0 0x7f53a80b22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:46.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.666+0000 7f53a759e700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53a806d9f0 con 0x7f53a80b1c30 2023-10-08T15:41:46.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.666+0000 7f53a759e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53a8148170 con 0x7f53a80bacf0 2023-10-08T15:41:46.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.666+0000 7f53a759e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53a814c410 con 0x7f53a80bb0c0 2023-10-08T15:41:46.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.666+0000 7f53a6d9d700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f53a80b1c30 0x7f53a8148590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:47648/0 (socket says 172.21.15.3:47648) 2023-10-08T15:41:46.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.666+0000 7f53a6d9d700 1 -- 172.21.15.3:0/2195443270 learned_addr learned my addr 172.21.15.3:0/2195443270 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:41:46.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.666+0000 7f53a5d9b700 1 --2- 172.21.15.3:0/2195443270 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f53a80bb0c0 0x7f53a80b22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:46.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.666+0000 7f53a659c700 1 --2- 172.21.15.3:0/2195443270 >> v2:172.21.15.50:3300/0 conn(0x7f53a80bacf0 0x7f53a806dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:46.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.666+0000 7f53a559a700 1 -- 172.21.15.3:0/2195443270 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1890094154 0 0) 0x7f53a806d9f0 con 0x7f53a80b1c30 2023-10-08T15:41:46.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.666+0000 7f53a559a700 1 -- 172.21.15.3:0/2195443270 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5390003570 con 0x7f53a80b1c30 2023-10-08T15:41:46.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.666+0000 7f53a559a700 1 -- 172.21.15.3:0/2195443270 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1015402962 0 0) 0x7f5390003570 con 0x7f53a80b1c30 2023-10-08T15:41:46.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.666+0000 7f53a5d9b700 1 -- 172.21.15.3:0/2195443270 >> v2:172.21.15.50:3300/0 conn(0x7f53a80bacf0 msgr2=0x7f53a806dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:46.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.666+0000 7f53a5d9b700 1 --2- 172.21.15.3:0/2195443270 >> v2:172.21.15.50:3300/0 conn(0x7f53a80bacf0 0x7f53a806dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:46.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.666+0000 7f53a5d9b700 1 -- 172.21.15.3:0/2195443270 >> v1:172.21.15.3:6789/0 conn(0x7f53a80b1c30 legacy=0x7f53a8148590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:46.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.666+0000 7f53a5d9b700 1 -- 172.21.15.3:0/2195443270 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a814c0e0 con 0x7f53a80bb0c0 2023-10-08T15:41:46.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.666+0000 7f53a5d9b700 1 --2- 172.21.15.3:0/2195443270 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f53a80bb0c0 0x7f53a80b22b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f53980098e0 tx=0x7f53980091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd545d2c661383c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:46.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.666+0000 7f53a559a700 1 -- 172.21.15.3:0/2195443270 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a00017f0 con 0x7f53a80bb0c0 2023-10-08T15:41:46.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.666+0000 7f53a559a700 1 -- 172.21.15.3:0/2195443270 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5398011420 con 0x7f53a80bb0c0 2023-10-08T15:41:46.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.666+0000 7f53a559a700 1 -- 172.21.15.3:0/2195443270 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53980117a0 con 0x7f53a80bb0c0 2023-10-08T15:41:46.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.666+0000 7f53a759e700 1 -- 172.21.15.3:0/2195443270 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f53a80bb0c0 msgr2=0x7f53a80b22b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:46.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.666+0000 7f53a759e700 1 --2- 172.21.15.3:0/2195443270 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f53a80bb0c0 0x7f53a80b22b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f53980098e0 tx=0x7f53980091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:46.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.666+0000 7f53a759e700 1 -- 172.21.15.3:0/2195443270 shutdown_connections 2023-10-08T15:41:46.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.666+0000 7f53a759e700 1 --2- 172.21.15.3:0/2195443270 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f53a80bb0c0 0x7f53a80b22b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:46.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.666+0000 7f53a759e700 1 --2- 172.21.15.3:0/2195443270 >> v2:172.21.15.50:3300/0 conn(0x7f53a80bacf0 0x7f53a806dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:46.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.666+0000 7f53a759e700 1 -- 172.21.15.3:0/2195443270 >> 172.21.15.3:0/2195443270 conn(0x7f53a80be4a0 msgr2=0x7f53a80ba440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:46.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.666+0000 7f53a759e700 1 -- 172.21.15.3:0/2195443270 shutdown_connections 2023-10-08T15:41:46.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.666+0000 7f53a759e700 1 -- 172.21.15.3:0/2195443270 wait complete. 2023-10-08T15:41:46.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.670+0000 7f53a759e700 1 Processor -- start 2023-10-08T15:41:46.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.670+0000 7f53a759e700 1 -- start start 2023-10-08T15:41:46.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.670+0000 7f53a759e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53a80b1c30 0x7f53a815ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:46.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.670+0000 7f53a759e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f53a80bacf0 0x7f53a815acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:46.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.670+0000 7f53a759e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f53a80bb0c0 0x7f53a8141ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:46.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.670+0000 7f53a759e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a80b5ec0 con 0x7f53a80bacf0 2023-10-08T15:41:46.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.670+0000 7f53a759e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a80b4f90 con 0x7f53a80b1c30 2023-10-08T15:41:46.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.670+0000 7f53a759e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53a8142530 con 0x7f53a80bb0c0 2023-10-08T15:41:46.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.670+0000 7f53a5d9b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f53a80bacf0 0x7f53a815acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:46.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.670+0000 7f53a5d9b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f53a80bacf0 0x7f53a815acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57608/0 (socket says 172.21.15.3:57608) 2023-10-08T15:41:46.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.670+0000 7f53a5d9b700 1 -- 172.21.15.3:0/1741164321 learned_addr learned my addr 172.21.15.3:0/1741164321 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:46.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.670+0000 7f53a659c700 1 --2- 172.21.15.3:0/1741164321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53a80b1c30 0x7f53a815ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:46.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.670+0000 7f53a6d9d700 1 --2- 172.21.15.3:0/1741164321 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f53a80bb0c0 0x7f53a8141ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:46.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.670+0000 7f53a5d9b700 1 -- 172.21.15.3:0/1741164321 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f53a80bb0c0 msgr2=0x7f53a8141ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:46.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.670+0000 7f53a5d9b700 1 --2- 172.21.15.3:0/1741164321 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f53a80bb0c0 0x7f53a8141ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:46.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.670+0000 7f53a5d9b700 1 -- 172.21.15.3:0/1741164321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53a80b1c30 msgr2=0x7f53a815ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:46.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.670+0000 7f53a5d9b700 1 --2- 172.21.15.3:0/1741164321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53a80b1c30 0x7f53a815ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:46.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.670+0000 7f53a5d9b700 1 -- 172.21.15.3:0/1741164321 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5398009420 con 0x7f53a80bacf0 2023-10-08T15:41:46.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.670+0000 7f53a659c700 1 --2- 172.21.15.3:0/1741164321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53a80b1c30 0x7f53a815ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:46.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.670+0000 7f53a5d9b700 1 --2- 172.21.15.3:0/1741164321 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f53a80bacf0 0x7f53a815acd0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f5398002000 tx=0x7f5398016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:46.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.670+0000 7f53967fc700 1 -- 172.21.15.3:0/1741164321 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539801cba0 con 0x7f53a80bacf0 2023-10-08T15:41:46.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.670+0000 7f53967fc700 1 -- 172.21.15.3:0/1741164321 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f539801cd20 con 0x7f53a80bacf0 2023-10-08T15:41:46.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.670+0000 7f53a759e700 1 -- 172.21.15.3:0/1741164321 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53a80b5230 con 0x7f53a80bacf0 2023-10-08T15:41:46.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.670+0000 7f53967fc700 1 -- 172.21.15.3:0/1741164321 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539801a6a0 con 0x7f53a80bacf0 2023-10-08T15:41:46.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.670+0000 7f53a759e700 1 -- 172.21.15.3:0/1741164321 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53a80b7290 con 0x7f53a80bacf0 2023-10-08T15:41:46.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.670+0000 7f53a759e700 1 -- 172.21.15.3:0/1741164321 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53a80b56b0 con 0x7f53a80bacf0 2023-10-08T15:41:46.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.674+0000 7f53967fc700 1 -- 172.21.15.3:0/1741164321 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f539801aa50 con 0x7f53a80bacf0 2023-10-08T15:41:46.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.674+0000 7f53967fc700 1 --2- 172.21.15.3:0/1741164321 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5388060550 0x7f5388062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:46.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.674+0000 7f53967fc700 1 -- 172.21.15.3:0/1741164321 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f539807e7f0 con 0x7f53a80bacf0 2023-10-08T15:41:46.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.674+0000 7f53a659c700 1 --2- 172.21.15.3:0/1741164321 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5388060550 0x7f5388062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:46.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.674+0000 7f53a659c700 1 --2- 172.21.15.3:0/1741164321 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5388060550 0x7f5388062a00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f539c009d80 tx=0x7f539c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:46.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.682+0000 7f53967fc700 1 -- 172.21.15.3:0/1741164321 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f539804ede0 con 0x7f53a80bacf0 2023-10-08T15:41:46.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.846+0000 7f53a759e700 1 -- 172.21.15.3:0/1741164321 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f53a805ecf0 con 0x7f53a80bacf0 2023-10-08T15:41:46.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.850+0000 7f53967fc700 1 -- 172.21.15.3:0/1741164321 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+15270 (secure 0 0 0) 0x7f5398019ed0 con 0x7f53a80bacf0 2023-10-08T15:41:46.854 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:41:46.854 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":58,"fsid":"7635972e-cd66-4a8f-a231-378db8b3847a","created":"2023-10-08T15:37:08.234594+0000","modified":"2023-10-08T15:41:45.889465+0000","last_up_change":"2023-10-08T15:37:17.537726+0000","last_in_change":"2023-10-08T15:37:10.269178+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:37:16.581590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:41:44.126771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-08T15:41:44.881738+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"64fb1864-bfdd-4d75-9b41-03fb60085dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33363},{"type":"v1","addr":"172.21.15.3:6801","nonce":33363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33363},{"type":"v1","addr":"172.21.15.3:6803","nonce":33363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":33363},{"type":"v1","addr":"172.21.15.3:6807","nonce":33363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33363},{"type":"v1","addr":"172.21.15.3:6805","nonce":33363}]},"public_addr":"172.21.15.3:6801/33363","cluster_addr":"172.21.15.3:6803/33363","heartbeat_back_addr":"172.21.15.3:6807/33363","heartbeat_front_addr":"172.21.15.3:6805/33363","state":["exists","up"]},{"osd":1,"uuid":"3ca6bd3a-3e8a-4c65-af9c-46148b0c2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33364},{"type":"v1","addr":"172.21.15.3:6820","nonce":33364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33364},{"type":"v1","addr":"172.21.15.3:6824","nonce":33364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33364},{"type":"v1","addr":"172.21.15.3:6831","nonce":33364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33364},{"type":"v1","addr":"172.21.15.3:6828","nonce":33364}]},"public_addr":"172.21.15.3:6820/33364","cluster_addr":"172.21.15.3:6824/33364","heartbeat_back_addr":"172.21.15.3:6831/33364","heartbeat_front_addr":"172.21.15.3:6828/33364","state":["exists","up"]},{"osd":2,"uuid":"6eb9f757-58dd-442f-910d-32401454bce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33366},{"type":"v1","addr":"172.21.15.3:6817","nonce":33366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":33366},{"type":"v1","addr":"172.21.15.3:6821","nonce":33366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6827","nonce":33366},{"type":"v1","addr":"172.21.15.3:6829","nonce":33366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":33366},{"type":"v1","addr":"172.21.15.3:6825","nonce":33366}]},"public_addr":"172.21.15.3:6817/33366","cluster_addr":"172.21.15.3:6821/33366","heartbeat_back_addr":"172.21.15.3:6829/33366","heartbeat_front_addr":"172.21.15.3:6825/33366","state":["exists","up"]},{"osd":3,"uuid":"1c39866b-ac2e-4ea9-a69c-02b01ee4191d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33365},{"type":"v1","addr":"172.21.15.3:6809","nonce":33365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":33365},{"type":"v1","addr":"172.21.15.3:6811","nonce":33365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33365},{"type":"v1","addr":"172.21.15.3:6815","nonce":33365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":33365},{"type":"v1","addr":"172.21.15.3:6813","nonce":33365}]},"public_addr":"172.21.15.3:6809/33365","cluster_addr":"172.21.15.3:6811/33365","heartbeat_back_addr":"172.21.15.3:6815/33365","heartbeat_front_addr":"172.21.15.3:6813/33365","state":["exists","up"]},{"osd":4,"uuid":"15f86b61-b7f1-4780-ae00-9d80a68cb830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":33605},{"type":"v1","addr":"172.21.15.50:6809","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33605},{"type":"v1","addr":"172.21.15.50:6811","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33605},{"type":"v1","addr":"172.21.15.50:6815","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":33605},{"type":"v1","addr":"172.21.15.50:6813","nonce":33605}]},"public_addr":"172.21.15.50:6809/33605","cluster_addr":"172.21.15.50:6811/33605","heartbeat_back_addr":"172.21.15.50:6815/33605","heartbeat_front_addr":"172.21.15.50:6813/33605","state":["exists","up"]},{"osd":5,"uuid":"726c3003-34e6-4d5a-b6e2-f911e13c2118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33606},{"type":"v1","addr":"172.21.15.50:6801","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33606},{"type":"v1","addr":"172.21.15.50:6803","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33606},{"type":"v1","addr":"172.21.15.50:6807","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":33606},{"type":"v1","addr":"172.21.15.50:6805","nonce":33606}]},"public_addr":"172.21.15.50:6801/33606","cluster_addr":"172.21.15.50:6803/33606","heartbeat_back_addr":"172.21.15.50:6807/33606","heartbeat_front_addr":"172.21.15.50:6805/33606","state":["exists","up"]},{"osd":6,"uuid":"401122a4-9988-441f-a5a7-39164434ebcd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":33607},{"type":"v1","addr":"172.21.15.50:6819","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":33607},{"type":"v1","addr":"172.21.15.50:6823","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":33607},{"type":"v1","addr":"172.21.15.50:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":33607},{"type":"v1","addr":"172.21.15.50:6827","nonce":33607}]},"public_addr":"172.21.15.50:6819/33607","cluster_addr":"172.21.15.50:6823/33607","heartbeat_back_addr":"172.21.15.50:6831/33607","heartbeat_front_addr":"172.21.15.50:6827/33607","state":["exists","up"]},{"osd":7,"uuid":"6b3fa236-c9d0-4c4d-82ae-9af4daf6d699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33604},{"type":"v1","addr":"172.21.15.50:6818","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":33604},{"type":"v1","addr":"172.21.15.50:6822","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":33604},{"type":"v1","addr":"172.21.15.50:6830","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":33604},{"type":"v1","addr":"172.21.15.50:6826","nonce":33604}]},"public_addr":"172.21.15.50:6818/33604","cluster_addr":"172.21.15.50:6822/33604","heartbeat_back_addr":"172.21.15.50:6830/33604","heartbeat_front_addr":"172.21.15.50:6826/33604","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.497794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.529417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.873426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.325972+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.443971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.240795+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.739632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.643026+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:41:46.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.850+0000 7f53a759e700 1 -- 172.21.15.3:0/1741164321 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5388060550 msgr2=0x7f5388062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:46.857 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.850+0000 7f53a759e700 1 --2- 172.21.15.3:0/1741164321 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5388060550 0x7f5388062a00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f539c009d80 tx=0x7f539c008040 comp rx=0 tx=0).stop 2023-10-08T15:41:46.857 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.850+0000 7f53a759e700 1 -- 172.21.15.3:0/1741164321 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f53a80bacf0 msgr2=0x7f53a815acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:46.857 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.850+0000 7f53a759e700 1 --2- 172.21.15.3:0/1741164321 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f53a80bacf0 0x7f53a815acd0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f5398002000 tx=0x7f5398016000 comp rx=0 tx=0).stop 2023-10-08T15:41:46.857 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.850+0000 7f53a759e700 1 -- 172.21.15.3:0/1741164321 shutdown_connections 2023-10-08T15:41:46.857 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.850+0000 7f53a759e700 1 --2- 172.21.15.3:0/1741164321 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5388060550 0x7f5388062a00 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:46.857 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.850+0000 7f53a759e700 1 --2- 172.21.15.3:0/1741164321 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f53a80bb0c0 0x7f53a8141ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:46.857 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.850+0000 7f53a759e700 1 --2- 172.21.15.3:0/1741164321 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f53a80bacf0 0x7f53a815acd0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:46.857 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.850+0000 7f53a759e700 1 --2- 172.21.15.3:0/1741164321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53a80b1c30 0x7f53a815ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:46.857 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.850+0000 7f53a759e700 1 -- 172.21.15.3:0/1741164321 >> 172.21.15.3:0/1741164321 conn(0x7f53a80be4a0 msgr2=0x7f53a80bb8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:46.857 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.850+0000 7f53a759e700 1 -- 172.21.15.3:0/1741164321 shutdown_connections 2023-10-08T15:41:46.858 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.850+0000 7f53a759e700 1 -- 172.21.15.3:0/1741164321 wait complete. 2023-10-08T15:41:46.869 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:41:46.974 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.970+0000 7f9ab3fff700 1 Processor -- start 2023-10-08T15:41:46.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.970+0000 7f9ab3fff700 1 -- start start 2023-10-08T15:41:46.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.970+0000 7f9ab3fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9ab40bacf0 0x7f9ab4153860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:46.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.970+0000 7f9ab3fff700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ab414fe30 con 0x7f9ab409e520 2023-10-08T15:41:46.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.970+0000 7f9ab3fff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ab414fac0 con 0x7f9ab40bb0c0 2023-10-08T15:41:46.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.970+0000 7f9ab3fff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab409f0e0 con 0x7f9ab40bacf0 2023-10-08T15:41:46.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.970+0000 7f9ab37fe700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f9ab409e520 0x7f9ab406c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:60726/0 (socket says 172.21.15.3:60726) 2023-10-08T15:41:46.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.970+0000 7f9ab37fe700 1 -- 172.21.15.3:0/1684615315 learned_addr learned my addr 172.21.15.3:0/1684615315 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:41:46.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.970+0000 7f9ab2ffd700 1 --2- 172.21.15.3:0/1684615315 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9ab40bacf0 0x7f9ab4153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:46.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.970+0000 7f9ab1ffb700 1 -- 172.21.15.3:0/1684615315 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2046836605 0 0) 0x7f9ab414fe30 con 0x7f9ab409e520 2023-10-08T15:41:46.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.970+0000 7f9ab1ffb700 1 -- 172.21.15.3:0/1684615315 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a9c003570 con 0x7f9ab409e520 2023-10-08T15:41:46.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.970+0000 7f9ab1ffb700 1 -- 172.21.15.3:0/1684615315 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2221534213 0 0) 0x7f9ab414fac0 con 0x7f9ab40bb0c0 2023-10-08T15:41:46.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.970+0000 7f9ab1ffb700 1 -- 172.21.15.3:0/1684615315 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ab414fe30 con 0x7f9ab40bb0c0 2023-10-08T15:41:46.978 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.970+0000 7f9ab2ffd700 1 -- 172.21.15.3:0/1684615315 >> v1:172.21.15.50:6789/0 conn(0x7f9ab40bb0c0 legacy=0x7f9ab41502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:46.978 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.970+0000 7f9ab2ffd700 1 -- 172.21.15.3:0/1684615315 >> v1:172.21.15.3:6789/0 conn(0x7f9ab409e520 legacy=0x7f9ab406c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:46.978 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.970+0000 7f9ab2ffd700 1 -- 172.21.15.3:0/1684615315 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab409eb80 con 0x7f9ab40bacf0 2023-10-08T15:41:46.978 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.974+0000 7f9ab2ffd700 1 --2- 172.21.15.3:0/1684615315 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9ab40bacf0 0x7f9ab4153860 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8009910 tx=0x7f9aa80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f70f10481fb35c5e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:46.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.974+0000 7f9ab1ffb700 1 -- 172.21.15.3:0/1684615315 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa8011630 con 0x7f9ab40bacf0 2023-10-08T15:41:46.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.974+0000 7f9ab1ffb700 1 -- 172.21.15.3:0/1684615315 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa8011790 con 0x7f9ab40bacf0 2023-10-08T15:41:46.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.974+0000 7f9ab1ffb700 1 -- 172.21.15.3:0/1684615315 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa8011b30 con 0x7f9ab40bacf0 2023-10-08T15:41:46.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.974+0000 7f9ab3fff700 1 -- 172.21.15.3:0/1684615315 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9ab40bacf0 msgr2=0x7f9ab4153860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:46.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.974+0000 7f9ab3fff700 1 --2- 172.21.15.3:0/1684615315 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9ab40bacf0 0x7f9ab4153860 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8009910 tx=0x7f9aa80091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:46.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.974+0000 7f9ab3fff700 1 -- 172.21.15.3:0/1684615315 shutdown_connections 2023-10-08T15:41:46.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.974+0000 7f9ab3fff700 1 --2- 172.21.15.3:0/1684615315 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9ab40bacf0 0x7f9ab4153860 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:46.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.974+0000 7f9ab3fff700 1 -- 172.21.15.3:0/1684615315 >> 172.21.15.3:0/1684615315 conn(0x7f9ab40be4a0 msgr2=0x7f9ab40ba440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:46.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.974+0000 7f9ab3fff700 1 -- 172.21.15.3:0/1684615315 shutdown_connections 2023-10-08T15:41:46.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.974+0000 7f9ab3fff700 1 -- 172.21.15.3:0/1684615315 wait complete. 2023-10-08T15:41:46.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.974+0000 7f9ab3fff700 1 Processor -- start 2023-10-08T15:41:46.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.974+0000 7f9ab3fff700 1 -- start start 2023-10-08T15:41:46.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.978+0000 7f9ab3fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ab409e520 0x7f9ab41515e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:46.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.978+0000 7f9ab3fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9ab40bacf0 0x7f9ab415f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:46.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.978+0000 7f9ab3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ab40bb0c0 0x7f9ab4149f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:46.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.978+0000 7f9ab3fff700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab414af90 con 0x7f9ab409e520 2023-10-08T15:41:46.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.978+0000 7f9ab3fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab414cf40 con 0x7f9ab40bb0c0 2023-10-08T15:41:46.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.978+0000 7f9ab3fff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab415fe10 con 0x7f9ab40bacf0 2023-10-08T15:41:46.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.978+0000 7f9ab2ffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ab409e520 0x7f9ab41515e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:46.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.978+0000 7f9ab2ffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ab409e520 0x7f9ab41515e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60422/0 (socket says 172.21.15.3:60422) 2023-10-08T15:41:46.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.978+0000 7f9ab2ffd700 1 -- 172.21.15.3:0/1285153920 learned_addr learned my addr 172.21.15.3:0/1285153920 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:46.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.978+0000 7f9ab37fe700 1 --2- 172.21.15.3:0/1285153920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ab40bb0c0 0x7f9ab4149f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:46.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.978+0000 7f9ab27fc700 1 --2- 172.21.15.3:0/1285153920 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9ab40bacf0 0x7f9ab415f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:46.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.978+0000 7f9ab2ffd700 1 -- 172.21.15.3:0/1285153920 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9ab40bacf0 msgr2=0x7f9ab415f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:46.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.978+0000 7f9ab2ffd700 1 --2- 172.21.15.3:0/1285153920 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9ab40bacf0 0x7f9ab415f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:46.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.978+0000 7f9ab2ffd700 1 -- 172.21.15.3:0/1285153920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ab40bb0c0 msgr2=0x7f9ab4149f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:46.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.978+0000 7f9ab2ffd700 1 --2- 172.21.15.3:0/1285153920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ab40bb0c0 0x7f9ab4149f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:46.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.978+0000 7f9ab2ffd700 1 -- 172.21.15.3:0/1285153920 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa8009420 con 0x7f9ab409e520 2023-10-08T15:41:46.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.978+0000 7f9ab2ffd700 1 --2- 172.21.15.3:0/1285153920 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ab409e520 0x7f9ab41515e0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8009fd0 tx=0x7f9aa8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:46.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.978+0000 7f9a9affd700 1 -- 172.21.15.3:0/1285153920 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa801f070 con 0x7f9ab409e520 2023-10-08T15:41:46.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.978+0000 7f9a9affd700 1 -- 172.21.15.3:0/1285153920 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa8002f70 con 0x7f9ab409e520 2023-10-08T15:41:46.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.978+0000 7f9ab3fff700 1 -- 172.21.15.3:0/1285153920 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ab414a450 con 0x7f9ab409e520 2023-10-08T15:41:46.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.978+0000 7f9a9affd700 1 -- 172.21.15.3:0/1285153920 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa8023410 con 0x7f9ab409e520 2023-10-08T15:41:46.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.978+0000 7f9ab3fff700 1 -- 172.21.15.3:0/1285153920 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ab41534e0 con 0x7f9ab409e520 2023-10-08T15:41:46.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.982+0000 7f9ab3fff700 1 -- 172.21.15.3:0/1285153920 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ab4064970 con 0x7f9ab409e520 2023-10-08T15:41:46.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.982+0000 7f9a9affd700 1 -- 172.21.15.3:0/1285153920 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f9aa8023840 con 0x7f9ab409e520 2023-10-08T15:41:46.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.982+0000 7f9a9affd700 1 --2- 172.21.15.3:0/1285153920 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f9aa0060550 0x7f9aa0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:46.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.982+0000 7f9a9affd700 1 -- 172.21.15.3:0/1285153920 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9aa807d860 con 0x7f9ab409e520 2023-10-08T15:41:46.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.982+0000 7f9ab27fc700 1 --2- 172.21.15.3:0/1285153920 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f9aa0060550 0x7f9aa0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:46.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.982+0000 7f9ab27fc700 1 --2- 172.21.15.3:0/1285153920 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f9aa0060550 0x7f9aa0062a00 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9ab41512a0 tx=0x7f9aa4007d50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:46.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:46.990+0000 7f9a9affd700 1 -- 172.21.15.3:0/1285153920 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9aa804ddb0 con 0x7f9ab409e520 2023-10-08T15:41:47.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.154+0000 7f9ab3fff700 1 -- 172.21.15.3:0/1285153920 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9ab405ecf0 con 0x7f9ab409e520 2023-10-08T15:41:47.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.158+0000 7f9a9affd700 1 -- 172.21.15.3:0/1285153920 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+15270 (secure 0 0 0) 0x7f9aa8015090 con 0x7f9ab409e520 2023-10-08T15:41:47.163 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:41:47.163 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":58,"fsid":"7635972e-cd66-4a8f-a231-378db8b3847a","created":"2023-10-08T15:37:08.234594+0000","modified":"2023-10-08T15:41:45.889465+0000","last_up_change":"2023-10-08T15:37:17.537726+0000","last_in_change":"2023-10-08T15:37:10.269178+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:37:16.581590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:41:44.126771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-08T15:41:44.881738+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"64fb1864-bfdd-4d75-9b41-03fb60085dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33363},{"type":"v1","addr":"172.21.15.3:6801","nonce":33363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33363},{"type":"v1","addr":"172.21.15.3:6803","nonce":33363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":33363},{"type":"v1","addr":"172.21.15.3:6807","nonce":33363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33363},{"type":"v1","addr":"172.21.15.3:6805","nonce":33363}]},"public_addr":"172.21.15.3:6801/33363","cluster_addr":"172.21.15.3:6803/33363","heartbeat_back_addr":"172.21.15.3:6807/33363","heartbeat_front_addr":"172.21.15.3:6805/33363","state":["exists","up"]},{"osd":1,"uuid":"3ca6bd3a-3e8a-4c65-af9c-46148b0c2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33364},{"type":"v1","addr":"172.21.15.3:6820","nonce":33364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33364},{"type":"v1","addr":"172.21.15.3:6824","nonce":33364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33364},{"type":"v1","addr":"172.21.15.3:6831","nonce":33364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33364},{"type":"v1","addr":"172.21.15.3:6828","nonce":33364}]},"public_addr":"172.21.15.3:6820/33364","cluster_addr":"172.21.15.3:6824/33364","heartbeat_back_addr":"172.21.15.3:6831/33364","heartbeat_front_addr":"172.21.15.3:6828/33364","state":["exists","up"]},{"osd":2,"uuid":"6eb9f757-58dd-442f-910d-32401454bce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33366},{"type":"v1","addr":"172.21.15.3:6817","nonce":33366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":33366},{"type":"v1","addr":"172.21.15.3:6821","nonce":33366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6827","nonce":33366},{"type":"v1","addr":"172.21.15.3:6829","nonce":33366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":33366},{"type":"v1","addr":"172.21.15.3:6825","nonce":33366}]},"public_addr":"172.21.15.3:6817/33366","cluster_addr":"172.21.15.3:6821/33366","heartbeat_back_addr":"172.21.15.3:6829/33366","heartbeat_front_addr":"172.21.15.3:6825/33366","state":["exists","up"]},{"osd":3,"uuid":"1c39866b-ac2e-4ea9-a69c-02b01ee4191d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33365},{"type":"v1","addr":"172.21.15.3:6809","nonce":33365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":33365},{"type":"v1","addr":"172.21.15.3:6811","nonce":33365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33365},{"type":"v1","addr":"172.21.15.3:6815","nonce":33365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":33365},{"type":"v1","addr":"172.21.15.3:6813","nonce":33365}]},"public_addr":"172.21.15.3:6809/33365","cluster_addr":"172.21.15.3:6811/33365","heartbeat_back_addr":"172.21.15.3:6815/33365","heartbeat_front_addr":"172.21.15.3:6813/33365","state":["exists","up"]},{"osd":4,"uuid":"15f86b61-b7f1-4780-ae00-9d80a68cb830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":33605},{"type":"v1","addr":"172.21.15.50:6809","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33605},{"type":"v1","addr":"172.21.15.50:6811","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33605},{"type":"v1","addr":"172.21.15.50:6815","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":33605},{"type":"v1","addr":"172.21.15.50:6813","nonce":33605}]},"public_addr":"172.21.15.50:6809/33605","cluster_addr":"172.21.15.50:6811/33605","heartbeat_back_addr":"172.21.15.50:6815/33605","heartbeat_front_addr":"172.21.15.50:6813/33605","state":["exists","up"]},{"osd":5,"uuid":"726c3003-34e6-4d5a-b6e2-f911e13c2118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33606},{"type":"v1","addr":"172.21.15.50:6801","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33606},{"type":"v1","addr":"172.21.15.50:6803","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33606},{"type":"v1","addr":"172.21.15.50:6807","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":33606},{"type":"v1","addr":"172.21.15.50:6805","nonce":33606}]},"public_addr":"172.21.15.50:6801/33606","cluster_addr":"172.21.15.50:6803/33606","heartbeat_back_addr":"172.21.15.50:6807/33606","heartbeat_front_addr":"172.21.15.50:6805/33606","state":["exists","up"]},{"osd":6,"uuid":"401122a4-9988-441f-a5a7-39164434ebcd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":33607},{"type":"v1","addr":"172.21.15.50:6819","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":33607},{"type":"v1","addr":"172.21.15.50:6823","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":33607},{"type":"v1","addr":"172.21.15.50:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":33607},{"type":"v1","addr":"172.21.15.50:6827","nonce":33607}]},"public_addr":"172.21.15.50:6819/33607","cluster_addr":"172.21.15.50:6823/33607","heartbeat_back_addr":"172.21.15.50:6831/33607","heartbeat_front_addr":"172.21.15.50:6827/33607","state":["exists","up"]},{"osd":7,"uuid":"6b3fa236-c9d0-4c4d-82ae-9af4daf6d699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33604},{"type":"v1","addr":"172.21.15.50:6818","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":33604},{"type":"v1","addr":"172.21.15.50:6822","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":33604},{"type":"v1","addr":"172.21.15.50:6830","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":33604},{"type":"v1","addr":"172.21.15.50:6826","nonce":33604}]},"public_addr":"172.21.15.50:6818/33604","cluster_addr":"172.21.15.50:6822/33604","heartbeat_back_addr":"172.21.15.50:6830/33604","heartbeat_front_addr":"172.21.15.50:6826/33604","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.497794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.529417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.873426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.325972+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.443971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.240795+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.739632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.643026+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:41:47.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.158+0000 7f9ab3fff700 1 -- 172.21.15.3:0/1285153920 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f9aa0060550 msgr2=0x7f9aa0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:47.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.158+0000 7f9ab3fff700 1 --2- 172.21.15.3:0/1285153920 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f9aa0060550 0x7f9aa0062a00 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9ab41512a0 tx=0x7f9aa4007d50 comp rx=0 tx=0).stop 2023-10-08T15:41:47.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.158+0000 7f9ab3fff700 1 -- 172.21.15.3:0/1285153920 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ab409e520 msgr2=0x7f9ab41515e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:47.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.158+0000 7f9ab3fff700 1 --2- 172.21.15.3:0/1285153920 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ab409e520 0x7f9ab41515e0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8009fd0 tx=0x7f9aa8017000 comp rx=0 tx=0).stop 2023-10-08T15:41:47.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.158+0000 7f9ab3fff700 1 -- 172.21.15.3:0/1285153920 shutdown_connections 2023-10-08T15:41:47.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.158+0000 7f9ab3fff700 1 --2- 172.21.15.3:0/1285153920 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f9aa0060550 0x7f9aa0062a00 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:47.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.158+0000 7f9ab3fff700 1 --2- 172.21.15.3:0/1285153920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ab40bb0c0 0x7f9ab4149f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:47.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.158+0000 7f9ab3fff700 1 --2- 172.21.15.3:0/1285153920 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9ab40bacf0 0x7f9ab415f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:47.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.158+0000 7f9ab3fff700 1 --2- 172.21.15.3:0/1285153920 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ab409e520 0x7f9ab41515e0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:47.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.158+0000 7f9ab3fff700 1 -- 172.21.15.3:0/1285153920 >> 172.21.15.3:0/1285153920 conn(0x7f9ab40be4a0 msgr2=0x7f9ab40670e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:47.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.158+0000 7f9ab3fff700 1 -- 172.21.15.3:0/1285153920 shutdown_connections 2023-10-08T15:41:47.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.158+0000 7f9ab3fff700 1 -- 172.21.15.3:0/1285153920 wait complete. 2023-10-08T15:41:47.177 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T15:41:47.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.282+0000 7f7a6ca9c700 1 Processor -- start 2023-10-08T15:41:47.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.282+0000 7f7a6ca9c700 1 -- start start 2023-10-08T15:41:47.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.286+0000 7f7a6ca9c700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f7a680a77f0 0x7f7a680be3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:47.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.286+0000 7f7a6ca9c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7a680a7bc0 0x7f7a6814bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:47.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.286+0000 7f7a6ca9c700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a6806ced0 con 0x7f7a6806c5c0 2023-10-08T15:41:47.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.286+0000 7f7a6ca9c700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a6806e770 con 0x7f7a680a77f0 2023-10-08T15:41:47.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.286+0000 7f7a6ca9c700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a68069570 con 0x7f7a680a7bc0 2023-10-08T15:41:47.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.286+0000 7f7a66ffd700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f7a6806c5c0 0x7f7a680a2200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:60740/0 (socket says 172.21.15.3:60740) 2023-10-08T15:41:47.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.286+0000 7f7a66ffd700 1 -- 172.21.15.3:0/380130545 learned_addr learned my addr 172.21.15.3:0/380130545 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:41:47.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.286+0000 7f7a677fe700 1 --2- 172.21.15.3:0/380130545 >> v2:172.21.15.3:3300/0 conn(0x7f7a680a77f0 0x7f7a680be3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:47.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.286+0000 7f7a67fff700 1 --2- 172.21.15.3:0/380130545 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7a680a7bc0 0x7f7a6814bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:47.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.286+0000 7f7a667fc700 1 -- 172.21.15.3:0/380130545 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2615332752 0 0) 0x7f7a6806ced0 con 0x7f7a6806c5c0 2023-10-08T15:41:47.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.286+0000 7f7a667fc700 1 -- 172.21.15.3:0/380130545 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a54003570 con 0x7f7a6806c5c0 2023-10-08T15:41:47.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.286+0000 7f7a67fff700 1 -- 172.21.15.3:0/380130545 >> v2:172.21.15.3:3300/0 conn(0x7f7a680a77f0 msgr2=0x7f7a680be3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:47.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.286+0000 7f7a67fff700 1 --2- 172.21.15.3:0/380130545 >> v2:172.21.15.3:3300/0 conn(0x7f7a680a77f0 0x7f7a680be3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:47.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.286+0000 7f7a67fff700 1 -- 172.21.15.3:0/380130545 >> v1:172.21.15.3:6789/0 conn(0x7f7a6806c5c0 legacy=0x7f7a680a2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:47.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.286+0000 7f7a667fc700 1 -- 172.21.15.3:0/380130545 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4189153682 0 0) 0x7f7a54003570 con 0x7f7a6806c5c0 2023-10-08T15:41:47.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.286+0000 7f7a67fff700 1 -- 172.21.15.3:0/380130545 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a6814c620 con 0x7f7a680a7bc0 2023-10-08T15:41:47.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.286+0000 7f7a677fe700 1 --2- 172.21.15.3:0/380130545 >> v2:172.21.15.3:3300/0 conn(0x7f7a680a77f0 0x7f7a680be3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:41:47.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.286+0000 7f7a67fff700 1 --2- 172.21.15.3:0/380130545 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7a680a7bc0 0x7f7a6814bfb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7a60009e60 tx=0x7f7a60009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6aa31e0d4b890c62 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:47.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.286+0000 7f7a667fc700 1 -- 172.21.15.3:0/380130545 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6000e070 con 0x7f7a680a7bc0 2023-10-08T15:41:47.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.286+0000 7f7a667fc700 1 -- 172.21.15.3:0/380130545 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a6000b7a0 con 0x7f7a680a7bc0 2023-10-08T15:41:47.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.286+0000 7f7a667fc700 1 -- 172.21.15.3:0/380130545 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a50001470 con 0x7f7a680a7bc0 2023-10-08T15:41:47.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.286+0000 7f7a6ca9c700 1 -- 172.21.15.3:0/380130545 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7a680a7bc0 msgr2=0x7f7a6814bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:47.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.286+0000 7f7a6ca9c700 1 --2- 172.21.15.3:0/380130545 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7a680a7bc0 0x7f7a6814bfb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7a60009e60 tx=0x7f7a60009780 comp rx=0 tx=0).stop 2023-10-08T15:41:47.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.286+0000 7f7a6ca9c700 1 -- 172.21.15.3:0/380130545 shutdown_connections 2023-10-08T15:41:47.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.286+0000 7f7a6ca9c700 1 --2- 172.21.15.3:0/380130545 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7a680a7bc0 0x7f7a6814bfb0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:47.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.286+0000 7f7a6ca9c700 1 --2- 172.21.15.3:0/380130545 >> v2:172.21.15.3:3300/0 conn(0x7f7a680a77f0 0x7f7a680be3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:47.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.286+0000 7f7a6ca9c700 1 -- 172.21.15.3:0/380130545 >> 172.21.15.3:0/380130545 conn(0x7f7a680c29f0 msgr2=0x7f7a680a1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:47.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.286+0000 7f7a6ca9c700 1 -- 172.21.15.3:0/380130545 shutdown_connections 2023-10-08T15:41:47.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.286+0000 7f7a6ca9c700 1 -- 172.21.15.3:0/380130545 wait complete. 2023-10-08T15:41:47.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.290+0000 7f7a6ca9c700 1 Processor -- start 2023-10-08T15:41:47.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.290+0000 7f7a6ca9c700 1 -- start start 2023-10-08T15:41:47.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.290+0000 7f7a6ca9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a6806c5c0 0x7f7a6806d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:47.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.290+0000 7f7a6ca9c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7a680a77f0 0x7f7a6815e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:47.297 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.290+0000 7f7a6ca9c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7a680a7bc0 0x7f7a6815ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:47.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.290+0000 7f7a6ca9c700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a68152980 con 0x7f7a680a7bc0 2023-10-08T15:41:47.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.290+0000 7f7a6ca9c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a68152330 con 0x7f7a6806c5c0 2023-10-08T15:41:47.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.290+0000 7f7a6ca9c700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a68152610 con 0x7f7a680a77f0 2023-10-08T15:41:47.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.290+0000 7f7a67fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7a680a7bc0 0x7f7a6815ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:47.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.290+0000 7f7a67fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7a680a7bc0 0x7f7a6815ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60436/0 (socket says 172.21.15.3:60436) 2023-10-08T15:41:47.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.290+0000 7f7a67fff700 1 -- 172.21.15.3:0/2904308574 learned_addr learned my addr 172.21.15.3:0/2904308574 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:47.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.290+0000 7f7a677fe700 1 --2- 172.21.15.3:0/2904308574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a6806c5c0 0x7f7a6806d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:47.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.290+0000 7f7a66ffd700 1 --2- 172.21.15.3:0/2904308574 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7a680a77f0 0x7f7a6815e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:47.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.290+0000 7f7a67fff700 1 -- 172.21.15.3:0/2904308574 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7a680a77f0 msgr2=0x7f7a6815e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:47.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.290+0000 7f7a67fff700 1 --2- 172.21.15.3:0/2904308574 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7a680a77f0 0x7f7a6815e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:47.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.290+0000 7f7a67fff700 1 -- 172.21.15.3:0/2904308574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a6806c5c0 msgr2=0x7f7a6806d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:47.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.290+0000 7f7a67fff700 1 --2- 172.21.15.3:0/2904308574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a6806c5c0 0x7f7a6806d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:47.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.290+0000 7f7a67fff700 1 -- 172.21.15.3:0/2904308574 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a58009420 con 0x7f7a680a7bc0 2023-10-08T15:41:47.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.290+0000 7f7a66ffd700 1 --2- 172.21.15.3:0/2904308574 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7a680a77f0 0x7f7a6815e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:47.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.290+0000 7f7a677fe700 1 --2- 172.21.15.3:0/2904308574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a6806c5c0 0x7f7a6806d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:47.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.290+0000 7f7a67fff700 1 --2- 172.21.15.3:0/2904308574 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7a680a7bc0 0x7f7a6815ea60 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f7a6000b610 tx=0x7f7a60018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:47.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.294+0000 7f7a5f7fe700 1 -- 172.21.15.3:0/2904308574 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6000bea0 con 0x7f7a680a7bc0 2023-10-08T15:41:47.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.294+0000 7f7a5f7fe700 1 -- 172.21.15.3:0/2904308574 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a60012cc0 con 0x7f7a680a7bc0 2023-10-08T15:41:47.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.294+0000 7f7a5f7fe700 1 -- 172.21.15.3:0/2904308574 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6001e680 con 0x7f7a680a7bc0 2023-10-08T15:41:47.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.294+0000 7f7a6ca9c700 1 -- 172.21.15.3:0/2904308574 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a60009a20 con 0x7f7a680a7bc0 2023-10-08T15:41:47.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.294+0000 7f7a6ca9c700 1 -- 172.21.15.3:0/2904308574 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a680a3840 con 0x7f7a680a7bc0 2023-10-08T15:41:47.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.294+0000 7f7a6ca9c700 1 -- 172.21.15.3:0/2904308574 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a6805ecf0 con 0x7f7a680a7bc0 2023-10-08T15:41:47.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.294+0000 7f7a5f7fe700 1 -- 172.21.15.3:0/2904308574 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f7a6001ea70 con 0x7f7a680a7bc0 2023-10-08T15:41:47.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.294+0000 7f7a5f7fe700 1 --2- 172.21.15.3:0/2904308574 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7a48060550 0x7f7a48062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:47.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.294+0000 7f7a5f7fe700 1 -- 172.21.15.3:0/2904308574 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7a6007ec10 con 0x7f7a680a7bc0 2023-10-08T15:41:47.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.294+0000 7f7a677fe700 1 --2- 172.21.15.3:0/2904308574 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7a48060550 0x7f7a48062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:47.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.298+0000 7f7a677fe700 1 --2- 172.21.15.3:0/2904308574 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7a48060550 0x7f7a48062a00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7a580093f0 tx=0x7f7a58008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:47.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.302+0000 7f7a5f7fe700 1 -- 172.21.15.3:0/2904308574 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7a6004f160 con 0x7f7a680a7bc0 2023-10-08T15:41:47.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.502+0000 7f7a6ca9c700 1 -- 172.21.15.3:0/2904308574 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7a6806cb60 con 0x7f7a680a7bc0 2023-10-08T15:41:47.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.542+0000 7f7a5f7fe700 1 -- 172.21.15.3:0/2904308574 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v32) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7a60052780 con 0x7f7a680a7bc0 2023-10-08T15:41:47.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.546+0000 7f7a6ca9c700 1 -- 172.21.15.3:0/2904308574 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7a48060550 msgr2=0x7f7a48062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:47.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.546+0000 7f7a6ca9c700 1 --2- 172.21.15.3:0/2904308574 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7a48060550 0x7f7a48062a00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7a580093f0 tx=0x7f7a58008040 comp rx=0 tx=0).stop 2023-10-08T15:41:47.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.546+0000 7f7a6ca9c700 1 -- 172.21.15.3:0/2904308574 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7a680a7bc0 msgr2=0x7f7a6815ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:47.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.546+0000 7f7a6ca9c700 1 --2- 172.21.15.3:0/2904308574 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7a680a7bc0 0x7f7a6815ea60 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f7a6000b610 tx=0x7f7a60018000 comp rx=0 tx=0).stop 2023-10-08T15:41:47.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.546+0000 7f7a6ca9c700 1 -- 172.21.15.3:0/2904308574 shutdown_connections 2023-10-08T15:41:47.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.546+0000 7f7a6ca9c700 1 --2- 172.21.15.3:0/2904308574 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7a48060550 0x7f7a48062a00 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:47.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.546+0000 7f7a6ca9c700 1 --2- 172.21.15.3:0/2904308574 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7a680a7bc0 0x7f7a6815ea60 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:47.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.546+0000 7f7a6ca9c700 1 --2- 172.21.15.3:0/2904308574 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7a680a77f0 0x7f7a6815e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:47.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.546+0000 7f7a6ca9c700 1 --2- 172.21.15.3:0/2904308574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a6806c5c0 0x7f7a6806d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:47.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.546+0000 7f7a6ca9c700 1 -- 172.21.15.3:0/2904308574 >> 172.21.15.3:0/2904308574 conn(0x7f7a680c29f0 msgr2=0x7f7a680bf470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:47.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.546+0000 7f7a6ca9c700 1 -- 172.21.15.3:0/2904308574 shutdown_connections 2023-10-08T15:41:47.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.546+0000 7f7a6ca9c700 1 -- 172.21.15.3:0/2904308574 wait complete. 2023-10-08T15:41:47.565 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-08T15:41:47.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.666+0000 7f87ed1dc700 1 Processor -- start 2023-10-08T15:41:47.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.666+0000 7f87ed1dc700 1 -- start start 2023-10-08T15:41:47.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.666+0000 7f87ed1dc700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f87e80beb80 0x7f87e8141310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:47.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.666+0000 7f87ed1dc700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f87e8141850 0x7f87e814b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:47.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.666+0000 7f87ed1dc700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87e806e140 con 0x7f87e8069e10 2023-10-08T15:41:47.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.666+0000 7f87ed1dc700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87e81481f0 con 0x7f87e8141850 2023-10-08T15:41:47.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.666+0000 7f87ed1dc700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e80a0f40 con 0x7f87e80beb80 2023-10-08T15:41:47.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.670+0000 7f87ec9db700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f87e8141850 0x7f87e814b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:47.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.670+0000 7f87e77fe700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f87e8069e10 0x7f87e814add0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:60756/0 (socket says 172.21.15.3:60756) 2023-10-08T15:41:47.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.670+0000 7f87e77fe700 1 -- 172.21.15.3:0/913369954 learned_addr learned my addr 172.21.15.3:0/913369954 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:41:47.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.670+0000 7f87e7fff700 1 --2- 172.21.15.3:0/913369954 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f87e80beb80 0x7f87e8141310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:47.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.670+0000 7f87ec9db700 1 -- 172.21.15.3:0/913369954 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f87e80beb80 msgr2=0x7f87e8141310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:47.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.670+0000 7f87ec9db700 1 --2- 172.21.15.3:0/913369954 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f87e80beb80 0x7f87e8141310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:47.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.670+0000 7f87ec9db700 1 -- 172.21.15.3:0/913369954 >> v1:172.21.15.3:6789/0 conn(0x7f87e8069e10 legacy=0x7f87e814add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:47.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.670+0000 7f87e6ffd700 1 -- 172.21.15.3:0/913369954 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1733987125 0 0) 0x7f87e806e140 con 0x7f87e8069e10 2023-10-08T15:41:47.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.670+0000 7f87ec9db700 1 -- 172.21.15.3:0/913369954 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e806eff0 con 0x7f87e8141850 2023-10-08T15:41:47.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.670+0000 7f87ec9db700 1 --2- 172.21.15.3:0/913369954 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f87e8141850 0x7f87e814b4e0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f87e000aef0 tx=0x7f87e000a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aecdf3786b21cad4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:47.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.670+0000 7f87e6ffd700 1 -- 172.21.15.3:0/913369954 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e000a2e0 con 0x7f87e8141850 2023-10-08T15:41:47.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.670+0000 7f87e6ffd700 1 -- 172.21.15.3:0/913369954 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e000dc20 con 0x7f87e8141850 2023-10-08T15:41:47.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.670+0000 7f87e6ffd700 1 -- 172.21.15.3:0/913369954 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e0008450 con 0x7f87e8141850 2023-10-08T15:41:47.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.670+0000 7f87ed1dc700 1 -- 172.21.15.3:0/913369954 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f87e8141850 msgr2=0x7f87e814b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:47.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.670+0000 7f87ed1dc700 1 --2- 172.21.15.3:0/913369954 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f87e8141850 0x7f87e814b4e0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f87e000aef0 tx=0x7f87e000a7d0 comp rx=0 tx=0).stop 2023-10-08T15:41:47.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.670+0000 7f87ed1dc700 1 -- 172.21.15.3:0/913369954 shutdown_connections 2023-10-08T15:41:47.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.670+0000 7f87ed1dc700 1 --2- 172.21.15.3:0/913369954 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f87e8141850 0x7f87e814b4e0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:47.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.670+0000 7f87ed1dc700 1 --2- 172.21.15.3:0/913369954 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f87e80beb80 0x7f87e8141310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:47.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.670+0000 7f87ed1dc700 1 -- 172.21.15.3:0/913369954 >> 172.21.15.3:0/913369954 conn(0x7f87e8067b60 msgr2=0x7f87e80be240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:47.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.670+0000 7f87ed1dc700 1 -- 172.21.15.3:0/913369954 shutdown_connections 2023-10-08T15:41:47.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.670+0000 7f87ed1dc700 1 -- 172.21.15.3:0/913369954 wait complete. 2023-10-08T15:41:47.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.670+0000 7f87ed1dc700 1 Processor -- start 2023-10-08T15:41:47.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.674+0000 7f87ed1dc700 1 -- start start 2023-10-08T15:41:47.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.674+0000 7f87ed1dc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f87e8069e10 0x7f87e814af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:47.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.674+0000 7f87ed1dc700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f87e80beb80 0x7f87e8159e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:47.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.674+0000 7f87ed1dc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87e8141850 0x7f87e815a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:47.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.674+0000 7f87ed1dc700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e814cd50 con 0x7f87e8069e10 2023-10-08T15:41:47.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.674+0000 7f87ed1dc700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e815ac90 con 0x7f87e8141850 2023-10-08T15:41:47.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.674+0000 7f87ed1dc700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e814c970 con 0x7f87e80beb80 2023-10-08T15:41:47.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.674+0000 7f87e7fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f87e8069e10 0x7f87e814af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:47.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.674+0000 7f87e7fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f87e8069e10 0x7f87e814af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60458/0 (socket says 172.21.15.3:60458) 2023-10-08T15:41:47.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.674+0000 7f87e7fff700 1 -- 172.21.15.3:0/1880279484 learned_addr learned my addr 172.21.15.3:0/1880279484 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:47.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.674+0000 7f87e77fe700 1 --2- 172.21.15.3:0/1880279484 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f87e80beb80 0x7f87e8159e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:47.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.674+0000 7f87ec9db700 1 --2- 172.21.15.3:0/1880279484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87e8141850 0x7f87e815a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:47.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.674+0000 7f87e7fff700 1 -- 172.21.15.3:0/1880279484 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f87e80beb80 msgr2=0x7f87e8159e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:47.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.674+0000 7f87e7fff700 1 --2- 172.21.15.3:0/1880279484 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f87e80beb80 0x7f87e8159e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:47.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.674+0000 7f87e7fff700 1 -- 172.21.15.3:0/1880279484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87e8141850 msgr2=0x7f87e815a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:47.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.674+0000 7f87e7fff700 1 --2- 172.21.15.3:0/1880279484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87e8141850 0x7f87e815a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:47.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.674+0000 7f87e7fff700 1 -- 172.21.15.3:0/1880279484 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e000aa30 con 0x7f87e8069e10 2023-10-08T15:41:47.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.674+0000 7f87ec9db700 1 --2- 172.21.15.3:0/1880279484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87e8141850 0x7f87e815a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:47.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.674+0000 7f87e77fe700 1 --2- 172.21.15.3:0/1880279484 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f87e80beb80 0x7f87e8159e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:47.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.674+0000 7f87e7fff700 1 --2- 172.21.15.3:0/1880279484 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f87e8069e10 0x7f87e814af00 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f87d800ec80 tx=0x7f87d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:47.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.674+0000 7f87cffff700 1 -- 172.21.15.3:0/1880279484 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d800c9d0 con 0x7f87e8069e10 2023-10-08T15:41:47.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.674+0000 7f87cffff700 1 -- 172.21.15.3:0/1880279484 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d800cb30 con 0x7f87e8069e10 2023-10-08T15:41:47.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.674+0000 7f87ed1dc700 1 -- 172.21.15.3:0/1880279484 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87e814c660 con 0x7f87e8069e10 2023-10-08T15:41:47.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.674+0000 7f87cffff700 1 -- 172.21.15.3:0/1880279484 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d8013470 con 0x7f87e8069e10 2023-10-08T15:41:47.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.674+0000 7f87ed1dc700 1 -- 172.21.15.3:0/1880279484 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87e815a8a0 con 0x7f87e8069e10 2023-10-08T15:41:47.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.678+0000 7f87ed1dc700 1 -- 172.21.15.3:0/1880279484 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87e805ecf0 con 0x7f87e8069e10 2023-10-08T15:41:47.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.678+0000 7f87cffff700 1 -- 172.21.15.3:0/1880279484 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f87d8013820 con 0x7f87e8069e10 2023-10-08T15:41:47.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.678+0000 7f87cffff700 1 --2- 172.21.15.3:0/1880279484 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f87d4060580 0x7f87d4062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:47.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.678+0000 7f87cffff700 1 -- 172.21.15.3:0/1880279484 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f87d807cb80 con 0x7f87e8069e10 2023-10-08T15:41:47.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.678+0000 7f87e77fe700 1 --2- 172.21.15.3:0/1880279484 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f87d4060580 0x7f87d4062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:47.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.678+0000 7f87e77fe700 1 --2- 172.21.15.3:0/1880279484 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f87d4060580 0x7f87d4062a30 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f87e80be040 tx=0x7f87dc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:47.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.686+0000 7f87cffff700 1 -- 172.21.15.3:0/1880279484 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f87d804d170 con 0x7f87e8069e10 2023-10-08T15:41:47.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:47.886+0000 7f87ed1dc700 1 -- 172.21.15.3:0/1880279484 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f87e806a910 con 0x7f87e8069e10 2023-10-08T15:41:48.555 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.550+0000 7f87cffff700 1 -- 172.21.15.3:0/1880279484 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v33) v1 ==== 122+0+0 (secure 0 0 0) 0x7f87d8050790 con 0x7f87e8069e10 2023-10-08T15:41:48.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.554+0000 7f87ed1dc700 1 -- 172.21.15.3:0/1880279484 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f87d4060580 msgr2=0x7f87d4062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:48.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.554+0000 7f87ed1dc700 1 --2- 172.21.15.3:0/1880279484 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f87d4060580 0x7f87d4062a30 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f87e80be040 tx=0x7f87dc009040 comp rx=0 tx=0).stop 2023-10-08T15:41:48.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.554+0000 7f87ed1dc700 1 -- 172.21.15.3:0/1880279484 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f87e8069e10 msgr2=0x7f87e814af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:48.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.554+0000 7f87ed1dc700 1 --2- 172.21.15.3:0/1880279484 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f87e8069e10 0x7f87e814af00 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f87d800ec80 tx=0x7f87d80091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:48.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.554+0000 7f87ed1dc700 1 -- 172.21.15.3:0/1880279484 shutdown_connections 2023-10-08T15:41:48.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.554+0000 7f87ed1dc700 1 --2- 172.21.15.3:0/1880279484 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f87d4060580 0x7f87d4062a30 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:48.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.554+0000 7f87ed1dc700 1 --2- 172.21.15.3:0/1880279484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87e8141850 0x7f87e815a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:48.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.554+0000 7f87ed1dc700 1 --2- 172.21.15.3:0/1880279484 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f87e80beb80 0x7f87e8159e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:48.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.554+0000 7f87ed1dc700 1 --2- 172.21.15.3:0/1880279484 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f87e8069e10 0x7f87e814af00 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:48.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.554+0000 7f87ed1dc700 1 -- 172.21.15.3:0/1880279484 >> 172.21.15.3:0/1880279484 conn(0x7f87e8067b60 msgr2=0x7f87e80bcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:48.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.554+0000 7f87ed1dc700 1 -- 172.21.15.3:0/1880279484 shutdown_connections 2023-10-08T15:41:48.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.554+0000 7f87ed1dc700 1 -- 172.21.15.3:0/1880279484 wait complete. 2023-10-08T15:41:48.580 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:41:48.693 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.686+0000 7fc71ffff700 1 Processor -- start 2023-10-08T15:41:48.693 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.686+0000 7fc71ffff700 1 -- start start 2023-10-08T15:41:48.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.690+0000 7fc71ffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc7200c0720 0x7fc7200674b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:48.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.690+0000 7fc71ffff700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7200687c0 con 0x7fc7200681f0 2023-10-08T15:41:48.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.690+0000 7fc71ffff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc720068aa0 con 0x7fc7200670e0 2023-10-08T15:41:48.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.690+0000 7fc71ffff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc72014c6f0 con 0x7fc7200c0720 2023-10-08T15:41:48.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.690+0000 7fc71f7fe700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fc7200681f0 0x7fc7200a18c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:60762/0 (socket says 172.21.15.3:60762) 2023-10-08T15:41:48.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.690+0000 7fc71f7fe700 1 -- 172.21.15.3:0/609279919 learned_addr learned my addr 172.21.15.3:0/609279919 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:41:48.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.690+0000 7fc71e7fc700 1 --2- 172.21.15.3:0/609279919 >> v2:172.21.15.50:3300/0 conn(0x7fc7200c0720 0x7fc7200674b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:48.697 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.690+0000 7fc71dffb700 1 -- 172.21.15.3:0/609279919 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2759671053 0 0) 0x7fc7200687c0 con 0x7fc7200681f0 2023-10-08T15:41:48.697 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.690+0000 7fc71dffb700 1 -- 172.21.15.3:0/609279919 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc70c003570 con 0x7fc7200681f0 2023-10-08T15:41:48.697 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.690+0000 7fc71dffb700 1 -- 172.21.15.3:0/609279919 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2764683688 0 0) 0x7fc720068aa0 con 0x7fc7200670e0 2023-10-08T15:41:48.697 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.690+0000 7fc71dffb700 1 -- 172.21.15.3:0/609279919 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7200687c0 con 0x7fc7200670e0 2023-10-08T15:41:48.698 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.690+0000 7fc71dffb700 1 -- 172.21.15.3:0/609279919 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1248522001 0 0) 0x7fc70c003570 con 0x7fc7200681f0 2023-10-08T15:41:48.698 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.690+0000 7fc71dffb700 1 -- 172.21.15.3:0/609279919 >> v2:172.21.15.50:3300/0 conn(0x7fc7200c0720 msgr2=0x7fc7200674b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:48.698 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.690+0000 7fc71dffb700 1 --2- 172.21.15.3:0/609279919 >> v2:172.21.15.50:3300/0 conn(0x7fc7200c0720 0x7fc7200674b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:48.698 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.690+0000 7fc71dffb700 1 -- 172.21.15.3:0/609279919 >> v1:172.21.15.50:6789/0 conn(0x7fc7200670e0 legacy=0x7fc720068f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:48.698 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.690+0000 7fc71dffb700 1 -- 172.21.15.3:0/609279919 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc72006a030 con 0x7fc7200681f0 2023-10-08T15:41:48.698 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.690+0000 7fc71e7fc700 1 --2- 172.21.15.3:0/609279919 >> v2:172.21.15.50:3300/0 conn(0x7fc7200c0720 0x7fc7200674b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:41:48.698 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.690+0000 7fc71dffb700 1 -- 172.21.15.3:0/609279919 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2285686191 0 0) 0x7fc7100014c0 con 0x7fc7200681f0 2023-10-08T15:41:48.698 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.690+0000 7fc71dffb700 1 -- 172.21.15.3:0/609279919 >> v1:172.21.15.3:6789/0 conn(0x7fc7200681f0 legacy=0x7fc7200a18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:48.698 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.690+0000 7fc71dffb700 1 --2- 172.21.15.3:0/609279919 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc70c003bf0 0x7fc70c003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:48.698 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.690+0000 7fc71dffb700 1 --2- 172.21.15.3:0/609279919 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc70c004810 0x7fc70c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:48.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.690+0000 7fc71dffb700 1 --2- 172.21.15.3:0/609279919 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc70c0051c0 0x7fc70c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:48.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.690+0000 7fc71dffb700 1 -- 172.21.15.3:0/609279919 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc72014c6f0 con 0x7fc70c003bf0 2023-10-08T15:41:48.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.690+0000 7fc71dffb700 1 -- 172.21.15.3:0/609279919 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc70c00c160 con 0x7fc70c0051c0 2023-10-08T15:41:48.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.690+0000 7fc71dffb700 1 -- 172.21.15.3:0/609279919 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc70c00c320 con 0x7fc70c004810 2023-10-08T15:41:48.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.690+0000 7fc71effd700 1 --2- 172.21.15.3:0/609279919 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc70c003bf0 0x7fc70c003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:48.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.690+0000 7fc71f7fe700 1 --2- 172.21.15.3:0/609279919 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc70c0051c0 0x7fc70c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:48.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.690+0000 7fc71e7fc700 1 --2- 172.21.15.3:0/609279919 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc70c004810 0x7fc70c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:48.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.690+0000 7fc71effd700 1 -- 172.21.15.3:0/609279919 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc70c004810 msgr2=0x7fc70c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:48.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.690+0000 7fc71effd700 1 --2- 172.21.15.3:0/609279919 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc70c004810 0x7fc70c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:48.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.690+0000 7fc71effd700 1 -- 172.21.15.3:0/609279919 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc70c0051c0 msgr2=0x7fc70c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:48.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.690+0000 7fc71effd700 1 --2- 172.21.15.3:0/609279919 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc70c0051c0 0x7fc70c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:48.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.690+0000 7fc71effd700 1 -- 172.21.15.3:0/609279919 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc70c003570 con 0x7fc70c003bf0 2023-10-08T15:41:48.700 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.690+0000 7fc71f7fe700 1 --2- 172.21.15.3:0/609279919 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc70c0051c0 0x7fc70c00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:48.700 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.690+0000 7fc71f7fe700 1 -- 172.21.15.3:0/609279919 reap_dead start 2023-10-08T15:41:48.700 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.690+0000 7fc71effd700 1 --2- 172.21.15.3:0/609279919 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc70c003bf0 0x7fc70c003fe0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fc7180020f0 tx=0x7fc7180017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ece2e6f215c85d13 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:48.700 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.690+0000 7fc71dffb700 1 -- 172.21.15.3:0/609279919 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc718001ab0 con 0x7fc70c003bf0 2023-10-08T15:41:48.700 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.690+0000 7fc71dffb700 1 -- 172.21.15.3:0/609279919 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc718006ba0 con 0x7fc70c003bf0 2023-10-08T15:41:48.700 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.690+0000 7fc71dffb700 1 -- 172.21.15.3:0/609279919 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71800c8b0 con 0x7fc70c003bf0 2023-10-08T15:41:48.700 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.694+0000 7fc71ffff700 1 -- 172.21.15.3:0/609279919 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc70c003bf0 msgr2=0x7fc70c003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:48.700 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.694+0000 7fc71ffff700 1 --2- 172.21.15.3:0/609279919 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc70c003bf0 0x7fc70c003fe0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fc7180020f0 tx=0x7fc7180017a0 comp rx=0 tx=0).stop 2023-10-08T15:41:48.702 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.694+0000 7fc71ffff700 1 -- 172.21.15.3:0/609279919 shutdown_connections 2023-10-08T15:41:48.702 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.694+0000 7fc71ffff700 1 --2- 172.21.15.3:0/609279919 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc70c003bf0 0x7fc70c003fe0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:48.703 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.694+0000 7fc71ffff700 1 -- 172.21.15.3:0/609279919 >> 172.21.15.3:0/609279919 conn(0x7fc72006dfb0 msgr2=0x7fc72006e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:48.703 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.694+0000 7fc71ffff700 1 -- 172.21.15.3:0/609279919 shutdown_connections 2023-10-08T15:41:48.703 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.694+0000 7fc71ffff700 1 -- 172.21.15.3:0/609279919 wait complete. 2023-10-08T15:41:48.703 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.694+0000 7fc71ffff700 1 Processor -- start 2023-10-08T15:41:48.703 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.694+0000 7fc71ffff700 1 -- start start 2023-10-08T15:41:48.703 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.694+0000 7fc71ffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc70c003bf0 0x7fc7201478e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:48.703 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.694+0000 7fc71ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc720099e80 0x7fc72014f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:48.703 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.694+0000 7fc71ffff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc7200bf330 0x7fc720146a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:48.703 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.694+0000 7fc71ffff700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc72015ee80 con 0x7fc70c003bf0 2023-10-08T15:41:48.703 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.694+0000 7fc71ffff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc72009a2f0 con 0x7fc720099e80 2023-10-08T15:41:48.703 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.694+0000 7fc71ffff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc72014f930 con 0x7fc7200bf330 2023-10-08T15:41:48.704 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.694+0000 7fc71effd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc70c003bf0 0x7fc7201478e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:48.704 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.694+0000 7fc71effd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc70c003bf0 0x7fc7201478e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60486/0 (socket says 172.21.15.3:60486) 2023-10-08T15:41:48.704 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.694+0000 7fc71effd700 1 -- 172.21.15.3:0/1553861185 learned_addr learned my addr 172.21.15.3:0/1553861185 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:48.704 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.694+0000 7fc71e7fc700 1 --2- 172.21.15.3:0/1553861185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc720099e80 0x7fc72014f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:48.704 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.694+0000 7fc71f7fe700 1 --2- 172.21.15.3:0/1553861185 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc7200bf330 0x7fc720146a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:48.704 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.694+0000 7fc71effd700 1 -- 172.21.15.3:0/1553861185 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc7200bf330 msgr2=0x7fc720146a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:48.704 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.694+0000 7fc71effd700 1 --2- 172.21.15.3:0/1553861185 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc7200bf330 0x7fc720146a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:48.704 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.694+0000 7fc71effd700 1 -- 172.21.15.3:0/1553861185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc720099e80 msgr2=0x7fc72014f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:48.704 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.694+0000 7fc71effd700 1 --2- 172.21.15.3:0/1553861185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc720099e80 0x7fc72014f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:48.704 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.694+0000 7fc71effd700 1 -- 172.21.15.3:0/1553861185 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc72015f0e0 con 0x7fc70c003bf0 2023-10-08T15:41:48.704 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.694+0000 7fc71f7fe700 1 --2- 172.21.15.3:0/1553861185 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc7200bf330 0x7fc720146a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:48.705 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.698+0000 7fc71effd700 1 --2- 172.21.15.3:0/1553861185 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc70c003bf0 0x7fc7201478e0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fc71800c6a0 tx=0x7fc718015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:48.705 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.698+0000 7fc716ffd700 1 -- 172.21.15.3:0/1553861185 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7180129a0 con 0x7fc70c003bf0 2023-10-08T15:41:48.705 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.698+0000 7fc716ffd700 1 -- 172.21.15.3:0/1553861185 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc718012b00 con 0x7fc70c003bf0 2023-10-08T15:41:48.705 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.698+0000 7fc716ffd700 1 -- 172.21.15.3:0/1553861185 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71801e450 con 0x7fc70c003bf0 2023-10-08T15:41:48.705 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.698+0000 7fc71ffff700 1 -- 172.21.15.3:0/1553861185 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc72015ee80 con 0x7fc70c003bf0 2023-10-08T15:41:48.705 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.698+0000 7fc71ffff700 1 -- 172.21.15.3:0/1553861185 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc72014efd0 con 0x7fc70c003bf0 2023-10-08T15:41:48.706 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.698+0000 7fc71ffff700 1 -- 172.21.15.3:0/1553861185 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc72005ecf0 con 0x7fc70c003bf0 2023-10-08T15:41:48.706 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.698+0000 7fc716ffd700 1 -- 172.21.15.3:0/1553861185 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc71801e880 con 0x7fc70c003bf0 2023-10-08T15:41:48.706 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.702+0000 7fc716ffd700 1 --2- 172.21.15.3:0/1553861185 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc700060550 0x7fc700062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:48.706 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.702+0000 7fc716ffd700 1 -- 172.21.15.3:0/1553861185 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc71807ea10 con 0x7fc70c003bf0 2023-10-08T15:41:48.706 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.702+0000 7fc71e7fc700 1 --2- 172.21.15.3:0/1553861185 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc700060550 0x7fc700062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:48.706 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.702+0000 7fc71e7fc700 1 --2- 172.21.15.3:0/1553861185 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc700060550 0x7fc700062a00 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc7200bf2d0 tx=0x7fc708008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:48.710 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.706+0000 7fc716ffd700 1 -- 172.21.15.3:0/1553861185 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc71804f140 con 0x7fc70c003bf0 2023-10-08T15:41:48.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.902+0000 7fc71ffff700 1 -- 172.21.15.3:0/1553861185 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc7200a18b0 con 0x7fc70c003bf0 2023-10-08T15:41:48.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.902+0000 7fc716ffd700 1 -- 172.21.15.3:0/1553861185 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+3082 (secure 0 0 0) 0x7fc718016c20 con 0x7fc70c003bf0 2023-10-08T15:41:48.909 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:41:48.909 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":33,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5480,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1007706158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1007706158},{"type":"v1","addr":"172.21.15.50:6835","nonce":1007706158}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:41:45.889781+0000","modified":"2023-10-08T15:41:48.541276+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6030},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6030":{"gid":6030,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.3:6833/1129612905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":1129612905},{"type":"v1","addr":"172.21.15.3:6833","nonce":1129612905}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-08T15:41:48.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.906+0000 7fc71ffff700 1 -- 172.21.15.3:0/1553861185 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc700060550 msgr2=0x7fc700062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:48.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.906+0000 7fc71ffff700 1 --2- 172.21.15.3:0/1553861185 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc700060550 0x7fc700062a00 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc7200bf2d0 tx=0x7fc708008040 comp rx=0 tx=0).stop 2023-10-08T15:41:48.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.906+0000 7fc71ffff700 1 -- 172.21.15.3:0/1553861185 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc70c003bf0 msgr2=0x7fc7201478e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:48.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.906+0000 7fc71ffff700 1 --2- 172.21.15.3:0/1553861185 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc70c003bf0 0x7fc7201478e0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fc71800c6a0 tx=0x7fc718015000 comp rx=0 tx=0).stop 2023-10-08T15:41:48.912 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.906+0000 7fc71ffff700 1 -- 172.21.15.3:0/1553861185 shutdown_connections 2023-10-08T15:41:48.912 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.906+0000 7fc71ffff700 1 --2- 172.21.15.3:0/1553861185 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc700060550 0x7fc700062a00 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:48.912 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.906+0000 7fc71ffff700 1 --2- 172.21.15.3:0/1553861185 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc7200bf330 0x7fc720146a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:48.912 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.906+0000 7fc71ffff700 1 --2- 172.21.15.3:0/1553861185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc720099e80 0x7fc72014f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:48.912 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.906+0000 7fc71ffff700 1 --2- 172.21.15.3:0/1553861185 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc70c003bf0 0x7fc7201478e0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:48.912 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.906+0000 7fc71ffff700 1 -- 172.21.15.3:0/1553861185 >> 172.21.15.3:0/1553861185 conn(0x7fc72006dfb0 msgr2=0x7fc720151d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:48.912 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.906+0000 7fc71ffff700 1 -- 172.21.15.3:0/1553861185 shutdown_connections 2023-10-08T15:41:48.912 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:48.906+0000 7fc71ffff700 1 -- 172.21.15.3:0/1553861185 wait complete. 2023-10-08T15:41:48.913 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 33 2023-10-08T15:41:48.923 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:41:49.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.026+0000 7f3f93fff700 1 Processor -- start 2023-10-08T15:41:49.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.026+0000 7f3f93fff700 1 -- start start 2023-10-08T15:41:49.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.026+0000 7f3f93fff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f3f940a15e0 0x7f3f9414b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:49.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.026+0000 7f3f93fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3f94147e00 0x7f3f94148240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:49.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.026+0000 7f3f93fff700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f94147970 con 0x7f3f94146b70 2023-10-08T15:41:49.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.026+0000 7f3f93fff700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f9406de00 con 0x7f3f940a15e0 2023-10-08T15:41:49.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.026+0000 7f3f93fff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f9414bd90 con 0x7f3f94147e00 2023-10-08T15:41:49.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.026+0000 7f3f92ffd700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f3f940a15e0 0x7f3f9414b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:49.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.026+0000 7f3f927fc700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f3f94146b70 0x7f3f94146fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:60776/0 (socket says 172.21.15.3:60776) 2023-10-08T15:41:49.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.026+0000 7f3f927fc700 1 -- 172.21.15.3:0/1125741416 learned_addr learned my addr 172.21.15.3:0/1125741416 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:41:49.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.026+0000 7f3f937fe700 1 --2- 172.21.15.3:0/1125741416 >> v2:172.21.15.50:3300/0 conn(0x7f3f94147e00 0x7f3f94148240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:49.033 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.026+0000 7f3f92ffd700 1 -- 172.21.15.3:0/1125741416 >> v2:172.21.15.50:3300/0 conn(0x7f3f94147e00 msgr2=0x7f3f94148240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:49.034 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.026+0000 7f3f92ffd700 1 --2- 172.21.15.3:0/1125741416 >> v2:172.21.15.50:3300/0 conn(0x7f3f94147e00 0x7f3f94148240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:49.034 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.026+0000 7f3f92ffd700 1 -- 172.21.15.3:0/1125741416 >> v1:172.21.15.3:6789/0 conn(0x7f3f94146b70 legacy=0x7f3f94146fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:49.034 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.026+0000 7f3f92ffd700 1 -- 172.21.15.3:0/1125741416 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f94069770 con 0x7f3f940a15e0 2023-10-08T15:41:49.034 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.026+0000 7f3f91ffb700 1 -- 172.21.15.3:0/1125741416 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 799833753 0 0) 0x7f3f94147970 con 0x7f3f94146b70 2023-10-08T15:41:49.034 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.026+0000 7f3f92ffd700 1 --2- 172.21.15.3:0/1125741416 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3f940a15e0 0x7f3f9414b850 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f3f940b1ce0 tx=0x7f3f84009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b79869f9104bd67d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:49.034 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.030+0000 7f3f91ffb700 1 -- 172.21.15.3:0/1125741416 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8400e070 con 0x7f3f940a15e0 2023-10-08T15:41:49.034 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.030+0000 7f3f91ffb700 1 -- 172.21.15.3:0/1125741416 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f8400bb60 con 0x7f3f940a15e0 2023-10-08T15:41:49.034 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.030+0000 7f3f91ffb700 1 -- 172.21.15.3:0/1125741416 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f84012430 con 0x7f3f940a15e0 2023-10-08T15:41:49.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.030+0000 7f3f93fff700 1 -- 172.21.15.3:0/1125741416 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3f940a15e0 msgr2=0x7f3f9414b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:49.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.030+0000 7f3f93fff700 1 --2- 172.21.15.3:0/1125741416 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3f940a15e0 0x7f3f9414b850 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f3f940b1ce0 tx=0x7f3f84009780 comp rx=0 tx=0).stop 2023-10-08T15:41:49.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.030+0000 7f3f93fff700 1 -- 172.21.15.3:0/1125741416 shutdown_connections 2023-10-08T15:41:49.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.030+0000 7f3f93fff700 1 --2- 172.21.15.3:0/1125741416 >> v2:172.21.15.50:3300/0 conn(0x7f3f94147e00 0x7f3f94148240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:49.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.030+0000 7f3f93fff700 1 --2- 172.21.15.3:0/1125741416 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3f940a15e0 0x7f3f9414b850 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:49.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.030+0000 7f3f93fff700 1 -- 172.21.15.3:0/1125741416 >> 172.21.15.3:0/1125741416 conn(0x7f3f940670e0 msgr2=0x7f3f940674e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:49.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.030+0000 7f3f93fff700 1 -- 172.21.15.3:0/1125741416 shutdown_connections 2023-10-08T15:41:49.036 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.030+0000 7f3f93fff700 1 -- 172.21.15.3:0/1125741416 wait complete. 2023-10-08T15:41:49.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.034+0000 7f3f93fff700 1 Processor -- start 2023-10-08T15:41:49.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.034+0000 7f3f93fff700 1 -- start start 2023-10-08T15:41:49.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.034+0000 7f3f93fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f940a15e0 0x7f3f94150500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:49.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.034+0000 7f3f93fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3f94146b70 0x7f3f9415e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:49.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.034+0000 7f3f93fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3f94147e00 0x7f3f9415ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:49.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.034+0000 7f3f93fff700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9415f370 con 0x7f3f94146b70 2023-10-08T15:41:49.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.034+0000 7f3f93fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f941528a0 con 0x7f3f940a15e0 2023-10-08T15:41:49.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.034+0000 7f3f93fff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9414fa00 con 0x7f3f94147e00 2023-10-08T15:41:49.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.034+0000 7f3f927fc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3f94146b70 0x7f3f9415e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:49.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.034+0000 7f3f927fc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3f94146b70 0x7f3f9415e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60504/0 (socket says 172.21.15.3:60504) 2023-10-08T15:41:49.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.034+0000 7f3f927fc700 1 -- 172.21.15.3:0/1646042837 learned_addr learned my addr 172.21.15.3:0/1646042837 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:49.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.034+0000 7f3f92ffd700 1 --2- 172.21.15.3:0/1646042837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f940a15e0 0x7f3f94150500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:49.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.034+0000 7f3f937fe700 1 --2- 172.21.15.3:0/1646042837 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3f94147e00 0x7f3f9415ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:49.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.034+0000 7f3f927fc700 1 -- 172.21.15.3:0/1646042837 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3f94147e00 msgr2=0x7f3f9415ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:49.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.034+0000 7f3f927fc700 1 --2- 172.21.15.3:0/1646042837 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3f94147e00 0x7f3f9415ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:49.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.034+0000 7f3f927fc700 1 -- 172.21.15.3:0/1646042837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f940a15e0 msgr2=0x7f3f94150500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:49.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.034+0000 7f3f927fc700 1 --2- 172.21.15.3:0/1646042837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f940a15e0 0x7f3f94150500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:49.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.034+0000 7f3f927fc700 1 -- 172.21.15.3:0/1646042837 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f84009a20 con 0x7f3f94146b70 2023-10-08T15:41:49.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.034+0000 7f3f927fc700 1 --2- 172.21.15.3:0/1646042837 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3f94146b70 0x7f3f9415e8f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c00c7e0 tx=0x7f3f7c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:49.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.034+0000 7f3f8affd700 1 -- 172.21.15.3:0/1646042837 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c005b30 con 0x7f3f94146b70 2023-10-08T15:41:49.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.034+0000 7f3f8affd700 1 -- 172.21.15.3:0/1646042837 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f7c005c90 con 0x7f3f94146b70 2023-10-08T15:41:49.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.034+0000 7f3f93fff700 1 -- 172.21.15.3:0/1646042837 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f9415c5c0 con 0x7f3f94146b70 2023-10-08T15:41:49.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.034+0000 7f3f8affd700 1 -- 172.21.15.3:0/1646042837 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c007300 con 0x7f3f94146b70 2023-10-08T15:41:49.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.034+0000 7f3f93fff700 1 -- 172.21.15.3:0/1646042837 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f9414e3d0 con 0x7f3f94146b70 2023-10-08T15:41:49.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.038+0000 7f3f93fff700 1 -- 172.21.15.3:0/1646042837 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f9405ecf0 con 0x7f3f94146b70 2023-10-08T15:41:49.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.038+0000 7f3f8affd700 1 -- 172.21.15.3:0/1646042837 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f3f7c0076b0 con 0x7f3f94146b70 2023-10-08T15:41:49.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.038+0000 7f3f8affd700 1 --2- 172.21.15.3:0/1646042837 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3f74060550 0x7f3f74062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:49.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.038+0000 7f3f8affd700 1 -- 172.21.15.3:0/1646042837 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3f7c07bc20 con 0x7f3f94146b70 2023-10-08T15:41:49.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.038+0000 7f3f92ffd700 1 --2- 172.21.15.3:0/1646042837 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3f74060550 0x7f3f74062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:49.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.042+0000 7f3f92ffd700 1 --2- 172.21.15.3:0/1646042837 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3f74060550 0x7f3f74062a00 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3f84009fd0 tx=0x7f3f84019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:49.054 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.050+0000 7f3f8affd700 1 -- 172.21.15.3:0/1646042837 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3f7c04c210 con 0x7f3f94146b70 2023-10-08T15:41:49.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.206+0000 7f3f93fff700 1 -- 172.21.15.3:0/1646042837 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3f94068c60 con 0x7f3f94146b70 2023-10-08T15:41:49.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.206+0000 7f3f8affd700 1 -- 172.21.15.3:0/1646042837 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+15257 (secure 0 0 0) 0x7f3f7c001d60 con 0x7f3f94146b70 2023-10-08T15:41:49.211 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:41:49.211 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":59,"fsid":"7635972e-cd66-4a8f-a231-378db8b3847a","created":"2023-10-08T15:37:08.234594+0000","modified":"2023-10-08T15:41:47.531083+0000","last_up_change":"2023-10-08T15:37:17.537726+0000","last_in_change":"2023-10-08T15:37:10.269178+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:37:16.581590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:41:44.126771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-08T15:41:44.881738+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"64fb1864-bfdd-4d75-9b41-03fb60085dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33363},{"type":"v1","addr":"172.21.15.3:6801","nonce":33363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33363},{"type":"v1","addr":"172.21.15.3:6803","nonce":33363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":33363},{"type":"v1","addr":"172.21.15.3:6807","nonce":33363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33363},{"type":"v1","addr":"172.21.15.3:6805","nonce":33363}]},"public_addr":"172.21.15.3:6801/33363","cluster_addr":"172.21.15.3:6803/33363","heartbeat_back_addr":"172.21.15.3:6807/33363","heartbeat_front_addr":"172.21.15.3:6805/33363","state":["exists","up"]},{"osd":1,"uuid":"3ca6bd3a-3e8a-4c65-af9c-46148b0c2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33364},{"type":"v1","addr":"172.21.15.3:6820","nonce":33364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33364},{"type":"v1","addr":"172.21.15.3:6824","nonce":33364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33364},{"type":"v1","addr":"172.21.15.3:6831","nonce":33364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33364},{"type":"v1","addr":"172.21.15.3:6828","nonce":33364}]},"public_addr":"172.21.15.3:6820/33364","cluster_addr":"172.21.15.3:6824/33364","heartbeat_back_addr":"172.21.15.3:6831/33364","heartbeat_front_addr":"172.21.15.3:6828/33364","state":["exists","up"]},{"osd":2,"uuid":"6eb9f757-58dd-442f-910d-32401454bce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33366},{"type":"v1","addr":"172.21.15.3:6817","nonce":33366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":33366},{"type":"v1","addr":"172.21.15.3:6821","nonce":33366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6827","nonce":33366},{"type":"v1","addr":"172.21.15.3:6829","nonce":33366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":33366},{"type":"v1","addr":"172.21.15.3:6825","nonce":33366}]},"public_addr":"172.21.15.3:6817/33366","cluster_addr":"172.21.15.3:6821/33366","heartbeat_back_addr":"172.21.15.3:6829/33366","heartbeat_front_addr":"172.21.15.3:6825/33366","state":["exists","up"]},{"osd":3,"uuid":"1c39866b-ac2e-4ea9-a69c-02b01ee4191d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33365},{"type":"v1","addr":"172.21.15.3:6809","nonce":33365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":33365},{"type":"v1","addr":"172.21.15.3:6811","nonce":33365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33365},{"type":"v1","addr":"172.21.15.3:6815","nonce":33365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":33365},{"type":"v1","addr":"172.21.15.3:6813","nonce":33365}]},"public_addr":"172.21.15.3:6809/33365","cluster_addr":"172.21.15.3:6811/33365","heartbeat_back_addr":"172.21.15.3:6815/33365","heartbeat_front_addr":"172.21.15.3:6813/33365","state":["exists","up"]},{"osd":4,"uuid":"15f86b61-b7f1-4780-ae00-9d80a68cb830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":33605},{"type":"v1","addr":"172.21.15.50:6809","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33605},{"type":"v1","addr":"172.21.15.50:6811","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33605},{"type":"v1","addr":"172.21.15.50:6815","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":33605},{"type":"v1","addr":"172.21.15.50:6813","nonce":33605}]},"public_addr":"172.21.15.50:6809/33605","cluster_addr":"172.21.15.50:6811/33605","heartbeat_back_addr":"172.21.15.50:6815/33605","heartbeat_front_addr":"172.21.15.50:6813/33605","state":["exists","up"]},{"osd":5,"uuid":"726c3003-34e6-4d5a-b6e2-f911e13c2118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33606},{"type":"v1","addr":"172.21.15.50:6801","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33606},{"type":"v1","addr":"172.21.15.50:6803","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33606},{"type":"v1","addr":"172.21.15.50:6807","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":33606},{"type":"v1","addr":"172.21.15.50:6805","nonce":33606}]},"public_addr":"172.21.15.50:6801/33606","cluster_addr":"172.21.15.50:6803/33606","heartbeat_back_addr":"172.21.15.50:6807/33606","heartbeat_front_addr":"172.21.15.50:6805/33606","state":["exists","up"]},{"osd":6,"uuid":"401122a4-9988-441f-a5a7-39164434ebcd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":33607},{"type":"v1","addr":"172.21.15.50:6819","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":33607},{"type":"v1","addr":"172.21.15.50:6823","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":33607},{"type":"v1","addr":"172.21.15.50:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":33607},{"type":"v1","addr":"172.21.15.50:6827","nonce":33607}]},"public_addr":"172.21.15.50:6819/33607","cluster_addr":"172.21.15.50:6823/33607","heartbeat_back_addr":"172.21.15.50:6831/33607","heartbeat_front_addr":"172.21.15.50:6827/33607","state":["exists","up"]},{"osd":7,"uuid":"6b3fa236-c9d0-4c4d-82ae-9af4daf6d699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33604},{"type":"v1","addr":"172.21.15.50:6818","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":33604},{"type":"v1","addr":"172.21.15.50:6822","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":33604},{"type":"v1","addr":"172.21.15.50:6830","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":33604},{"type":"v1","addr":"172.21.15.50:6826","nonce":33604}]},"public_addr":"172.21.15.50:6818/33604","cluster_addr":"172.21.15.50:6822/33604","heartbeat_back_addr":"172.21.15.50:6830/33604","heartbeat_front_addr":"172.21.15.50:6826/33604","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.497794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.529417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.873426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.325972+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.443971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.240795+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.739632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.643026+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:41:49.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.206+0000 7f3f93fff700 1 -- 172.21.15.3:0/1646042837 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3f74060550 msgr2=0x7f3f74062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:49.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.206+0000 7f3f93fff700 1 --2- 172.21.15.3:0/1646042837 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3f74060550 0x7f3f74062a00 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3f84009fd0 tx=0x7f3f84019000 comp rx=0 tx=0).stop 2023-10-08T15:41:49.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.206+0000 7f3f93fff700 1 -- 172.21.15.3:0/1646042837 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3f94146b70 msgr2=0x7f3f9415e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:49.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.206+0000 7f3f93fff700 1 --2- 172.21.15.3:0/1646042837 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3f94146b70 0x7f3f9415e8f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c00c7e0 tx=0x7f3f7c007df0 comp rx=0 tx=0).stop 2023-10-08T15:41:49.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.210+0000 7f3f93fff700 1 -- 172.21.15.3:0/1646042837 shutdown_connections 2023-10-08T15:41:49.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.210+0000 7f3f93fff700 1 --2- 172.21.15.3:0/1646042837 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3f74060550 0x7f3f74062a00 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:49.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.210+0000 7f3f93fff700 1 --2- 172.21.15.3:0/1646042837 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3f94147e00 0x7f3f9415ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:49.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.210+0000 7f3f93fff700 1 --2- 172.21.15.3:0/1646042837 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3f94146b70 0x7f3f9415e8f0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:49.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.210+0000 7f3f93fff700 1 --2- 172.21.15.3:0/1646042837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f940a15e0 0x7f3f94150500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:49.215 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.210+0000 7f3f93fff700 1 -- 172.21.15.3:0/1646042837 >> 172.21.15.3:0/1646042837 conn(0x7f3f940670e0 msgr2=0x7f3f94148240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:49.215 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.210+0000 7f3f93fff700 1 -- 172.21.15.3:0/1646042837 shutdown_connections 2023-10-08T15:41:49.215 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.210+0000 7f3f93fff700 1 -- 172.21.15.3:0/1646042837 wait complete. 2023-10-08T15:41:49.226 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T15:41:49.227 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T15:41:49.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.334+0000 7f1c6f04d700 1 Processor -- start 2023-10-08T15:41:49.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.334+0000 7f1c6f04d700 1 -- start start 2023-10-08T15:41:49.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.334+0000 7f1c6f04d700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f1c680bafe0 0x7f1c68068ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:49.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.334+0000 7f1c6f04d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1c6806d080 0x7f1c681533c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:49.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.334+0000 7f1c6f04d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1c68153900 0x7f1c6814ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:49.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.334+0000 7f1c6f04d700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c6809e490 con 0x7f1c680bafe0 2023-10-08T15:41:49.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.334+0000 7f1c6f04d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c6806ce30 con 0x7f1c68153900 2023-10-08T15:41:49.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.334+0000 7f1c6f04d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6809e6e0 con 0x7f1c6806d080 2023-10-08T15:41:49.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.334+0000 7f1c6cde9700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f1c680bafe0 0x7f1c68068ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:49.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.334+0000 7f1c6cde9700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f1c680bafe0 0x7f1c68068ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60520/0 (socket says 172.21.15.3:60520) 2023-10-08T15:41:49.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.334+0000 7f1c6cde9700 1 -- 172.21.15.3:0/2597123845 learned_addr learned my addr 172.21.15.3:0/2597123845 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:49.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.334+0000 7f1c67fff700 1 --2- 172.21.15.3:0/2597123845 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1c6806d080 0x7f1c681533c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:49.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.334+0000 7f1c6cde9700 1 -- 172.21.15.3:0/2597123845 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1c6806d080 msgr2=0x7f1c681533c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:49.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.334+0000 7f1c6cde9700 1 --2- 172.21.15.3:0/2597123845 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1c6806d080 0x7f1c681533c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:49.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.334+0000 7f1c6d5ea700 1 --2- 172.21.15.3:0/2597123845 >> v2:172.21.15.50:3300/0 conn(0x7f1c68153900 0x7f1c6814ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:49.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.334+0000 7f1c6cde9700 1 -- 172.21.15.3:0/2597123845 >> v2:172.21.15.50:3300/0 conn(0x7f1c68153900 msgr2=0x7f1c6814ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:49.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.334+0000 7f1c6cde9700 1 --2- 172.21.15.3:0/2597123845 >> v2:172.21.15.50:3300/0 conn(0x7f1c68153900 0x7f1c6814ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:49.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.334+0000 7f1c6cde9700 1 -- 172.21.15.3:0/2597123845 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c6809ea50 con 0x7f1c680bafe0 2023-10-08T15:41:49.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.334+0000 7f1c6d5ea700 1 --2- 172.21.15.3:0/2597123845 >> v2:172.21.15.50:3300/0 conn(0x7f1c68153900 0x7f1c6814ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:41:49.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.334+0000 7f1c6cde9700 1 --2- 172.21.15.3:0/2597123845 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1c680bafe0 0x7f1c68068ab0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f1c68150e90 tx=0x7f1c50009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed88424fe355e0e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:49.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.334+0000 7f1c677fe700 1 -- 172.21.15.3:0/2597123845 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5000b860 con 0x7f1c680bafe0 2023-10-08T15:41:49.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.334+0000 7f1c677fe700 1 -- 172.21.15.3:0/2597123845 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c5000b9c0 con 0x7f1c680bafe0 2023-10-08T15:41:49.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.334+0000 7f1c677fe700 1 -- 172.21.15.3:0/2597123845 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5000bd60 con 0x7f1c680bafe0 2023-10-08T15:41:49.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.334+0000 7f1c6f04d700 1 -- 172.21.15.3:0/2597123845 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1c680bafe0 msgr2=0x7f1c68068ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:49.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.334+0000 7f1c6f04d700 1 --2- 172.21.15.3:0/2597123845 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1c680bafe0 0x7f1c68068ab0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f1c68150e90 tx=0x7f1c50009220 comp rx=0 tx=0).stop 2023-10-08T15:41:49.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.334+0000 7f1c6f04d700 1 -- 172.21.15.3:0/2597123845 shutdown_connections 2023-10-08T15:41:49.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.334+0000 7f1c6f04d700 1 --2- 172.21.15.3:0/2597123845 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1c6806d080 0x7f1c681533c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:49.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.334+0000 7f1c6f04d700 1 --2- 172.21.15.3:0/2597123845 >> v2:172.21.15.50:3300/0 conn(0x7f1c68153900 0x7f1c6814ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:49.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.334+0000 7f1c6f04d700 1 --2- 172.21.15.3:0/2597123845 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1c680bafe0 0x7f1c68068ab0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:49.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.334+0000 7f1c6f04d700 1 -- 172.21.15.3:0/2597123845 >> 172.21.15.3:0/2597123845 conn(0x7f1c680be640 msgr2=0x7f1c680ba6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:49.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.334+0000 7f1c6f04d700 1 -- 172.21.15.3:0/2597123845 shutdown_connections 2023-10-08T15:41:49.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.334+0000 7f1c6f04d700 1 -- 172.21.15.3:0/2597123845 wait complete. 2023-10-08T15:41:49.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.338+0000 7f1c6f04d700 1 Processor -- start 2023-10-08T15:41:49.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.338+0000 7f1c6f04d700 1 -- start start 2023-10-08T15:41:49.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.338+0000 7f1c6f04d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c6806d080 0x7f1c681521e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:49.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.338+0000 7f1c6f04d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1c680bafe0 0x7f1c68145e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:49.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.338+0000 7f1c6f04d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1c68153900 0x7f1c68146360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:49.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.338+0000 7f1c6f04d700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c68152a90 con 0x7f1c680bafe0 2023-10-08T15:41:49.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.338+0000 7f1c6f04d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c68148a50 con 0x7f1c6806d080 2023-10-08T15:41:49.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.338+0000 7f1c6f04d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c68163a40 con 0x7f1c68153900 2023-10-08T15:41:49.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.342+0000 7f1c67fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1c680bafe0 0x7f1c68145e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:49.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.342+0000 7f1c67fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1c680bafe0 0x7f1c68145e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60534/0 (socket says 172.21.15.3:60534) 2023-10-08T15:41:49.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.342+0000 7f1c67fff700 1 -- 172.21.15.3:0/890803220 learned_addr learned my addr 172.21.15.3:0/890803220 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:49.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.342+0000 7f1c6cde9700 1 --2- 172.21.15.3:0/890803220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c6806d080 0x7f1c681521e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:49.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.342+0000 7f1c6d5ea700 1 --2- 172.21.15.3:0/890803220 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1c68153900 0x7f1c68146360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:49.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.342+0000 7f1c67fff700 1 -- 172.21.15.3:0/890803220 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1c68153900 msgr2=0x7f1c68146360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:49.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.342+0000 7f1c67fff700 1 --2- 172.21.15.3:0/890803220 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1c68153900 0x7f1c68146360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:49.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.342+0000 7f1c67fff700 1 -- 172.21.15.3:0/890803220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c6806d080 msgr2=0x7f1c681521e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:49.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.342+0000 7f1c67fff700 1 --2- 172.21.15.3:0/890803220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c6806d080 0x7f1c681521e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:49.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.342+0000 7f1c67fff700 1 -- 172.21.15.3:0/890803220 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c50009480 con 0x7f1c680bafe0 2023-10-08T15:41:49.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.342+0000 7f1c6d5ea700 1 --2- 172.21.15.3:0/890803220 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1c68153900 0x7f1c68146360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:49.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.342+0000 7f1c67fff700 1 --2- 172.21.15.3:0/890803220 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1c680bafe0 0x7f1c68145e20 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f1c60007f90 tx=0x7f1c60009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:49.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.342+0000 7f1c64ff9700 1 -- 172.21.15.3:0/890803220 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6000eca0 con 0x7f1c680bafe0 2023-10-08T15:41:49.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.342+0000 7f1c64ff9700 1 -- 172.21.15.3:0/890803220 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c6000ee20 con 0x7f1c680bafe0 2023-10-08T15:41:49.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.342+0000 7f1c6f04d700 1 -- 172.21.15.3:0/890803220 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c68152720 con 0x7f1c680bafe0 2023-10-08T15:41:49.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.342+0000 7f1c64ff9700 1 -- 172.21.15.3:0/890803220 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c60014670 con 0x7f1c680bafe0 2023-10-08T15:41:49.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.342+0000 7f1c6f04d700 1 -- 172.21.15.3:0/890803220 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c68146920 con 0x7f1c680bafe0 2023-10-08T15:41:49.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.342+0000 7f1c64ff9700 1 -- 172.21.15.3:0/890803220 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f1c600149e0 con 0x7f1c680bafe0 2023-10-08T15:41:49.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.342+0000 7f1c6f04d700 1 -- 172.21.15.3:0/890803220 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c68064530 con 0x7f1c680bafe0 2023-10-08T15:41:49.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.346+0000 7f1c64ff9700 1 --2- 172.21.15.3:0/890803220 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1c48060550 0x7f1c48062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:49.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.346+0000 7f1c64ff9700 1 -- 172.21.15.3:0/890803220 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1c6007ce50 con 0x7f1c680bafe0 2023-10-08T15:41:49.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.346+0000 7f1c6cde9700 1 --2- 172.21.15.3:0/890803220 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1c48060550 0x7f1c48062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:49.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.346+0000 7f1c6cde9700 1 --2- 172.21.15.3:0/890803220 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1c48060550 0x7f1c48062a00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1c50009260 tx=0x7f1c50017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:49.357 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.354+0000 7f1c64ff9700 1 -- 172.21.15.3:0/890803220 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1c6004d440 con 0x7f1c680bafe0 2023-10-08T15:41:49.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.510+0000 7f1c6f04d700 1 -- 172.21.15.3:0/890803220 --> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1c680bb3b0 con 0x7f1c48060550 2023-10-08T15:41:49.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.526+0000 7f1c64ff9700 1 -- 172.21.15.3:0/890803220 <== mgr.4102 v2:172.21.15.50:6832/33268 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287340 (secure 0 0 0) 0x7f1c680bb3b0 con 0x7f1c48060550 2023-10-08T15:41:49.536 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:41:49.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.530+0000 7f1c6f04d700 1 -- 172.21.15.3:0/890803220 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1c48060550 msgr2=0x7f1c48062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:49.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.530+0000 7f1c6f04d700 1 --2- 172.21.15.3:0/890803220 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1c48060550 0x7f1c48062a00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1c50009260 tx=0x7f1c50017000 comp rx=0 tx=0).stop 2023-10-08T15:41:49.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.530+0000 7f1c6f04d700 1 -- 172.21.15.3:0/890803220 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1c680bafe0 msgr2=0x7f1c68145e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:49.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.530+0000 7f1c6f04d700 1 --2- 172.21.15.3:0/890803220 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1c680bafe0 0x7f1c68145e20 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f1c60007f90 tx=0x7f1c60009860 comp rx=0 tx=0).stop 2023-10-08T15:41:49.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.530+0000 7f1c6f04d700 1 -- 172.21.15.3:0/890803220 shutdown_connections 2023-10-08T15:41:49.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.530+0000 7f1c6f04d700 1 --2- 172.21.15.3:0/890803220 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f1c48060550 0x7f1c48062a00 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:49.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.530+0000 7f1c6f04d700 1 --2- 172.21.15.3:0/890803220 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1c68153900 0x7f1c68146360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:49.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.530+0000 7f1c6f04d700 1 --2- 172.21.15.3:0/890803220 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1c680bafe0 0x7f1c68145e20 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:49.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.530+0000 7f1c6f04d700 1 --2- 172.21.15.3:0/890803220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c6806d080 0x7f1c681521e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:49.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.530+0000 7f1c6f04d700 1 -- 172.21.15.3:0/890803220 >> 172.21.15.3:0/890803220 conn(0x7f1c680be640 msgr2=0x7f1c68149e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:49.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.534+0000 7f1c6f04d700 1 -- 172.21.15.3:0/890803220 shutdown_connections 2023-10-08T15:41:49.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.534+0000 7f1c6f04d700 1 -- 172.21.15.3:0/890803220 wait complete. 2023-10-08T15:41:49.540 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2023-10-08T15:41:49.550 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":188,"stamp":"2023-10-08T15:41:48.608160+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":165,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2445464,"kb_used_data":5720,"kb_used_omap":0,"kb_used_meta":2439680,"kb_avail":752529256,"statfs":{"total":773094113280,"available":770589958144,"internally_reserved":0,"allocated":5857280,"data_stored":3541095,"data_compressed":66282,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":2498232320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.105070"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.540382+0000","last_change":"2023-10-08T15:41:46.538400+0000","last_active":"2023-10-08T15:41:46.540382+0000","last_peered":"2023-10-08T15:41:46.540382+0000","last_clean":"2023-10-08T15:41:46.540382+0000","last_became_active":"2023-10-08T15:41:46.538136+0000","last_became_peered":"2023-10-08T15:41:46.538136+0000","last_unstale":"2023-10-08T15:41:46.540382+0000","last_undegraded":"2023-10-08T15:41:46.540382+0000","last_fullsized":"2023-10-08T15:41:46.540382+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:47:08.832078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.564027+0000","last_change":"2023-10-08T15:41:46.554091+0000","last_active":"2023-10-08T15:41:46.564027+0000","last_peered":"2023-10-08T15:41:46.564027+0000","last_clean":"2023-10-08T15:41:46.564027+0000","last_became_active":"2023-10-08T15:41:46.553775+0000","last_became_peered":"2023-10-08T15:41:46.553775+0000","last_unstale":"2023-10-08T15:41:46.564027+0000","last_undegraded":"2023-10-08T15:41:46.564027+0000","last_fullsized":"2023-10-08T15:41:46.564027+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:35:17.568858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.552691+0000","last_change":"2023-10-08T15:41:46.545414+0000","last_active":"2023-10-08T15:41:46.552691+0000","last_peered":"2023-10-08T15:41:46.552691+0000","last_clean":"2023-10-08T15:41:46.552691+0000","last_became_active":"2023-10-08T15:41:46.545118+0000","last_became_peered":"2023-10-08T15:41:46.545118+0000","last_unstale":"2023-10-08T15:41:46.552691+0000","last_undegraded":"2023-10-08T15:41:46.552691+0000","last_fullsized":"2023-10-08T15:41:46.552691+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:21:19.421520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.562327+0000","last_change":"2023-10-08T15:41:46.559966+0000","last_active":"2023-10-08T15:41:46.562327+0000","last_peered":"2023-10-08T15:41:46.562327+0000","last_clean":"2023-10-08T15:41:46.562327+0000","last_became_active":"2023-10-08T15:41:46.559639+0000","last_became_peered":"2023-10-08T15:41:46.559639+0000","last_unstale":"2023-10-08T15:41:46.562327+0000","last_undegraded":"2023-10-08T15:41:46.562327+0000","last_fullsized":"2023-10-08T15:41:46.562327+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:14:06.171960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.555220+0000","last_change":"2023-10-08T15:41:46.537224+0000","last_active":"2023-10-08T15:41:46.555220+0000","last_peered":"2023-10-08T15:41:46.555220+0000","last_clean":"2023-10-08T15:41:46.555220+0000","last_became_active":"2023-10-08T15:41:46.536885+0000","last_became_peered":"2023-10-08T15:41:46.536885+0000","last_unstale":"2023-10-08T15:41:46.555220+0000","last_undegraded":"2023-10-08T15:41:46.555220+0000","last_fullsized":"2023-10-08T15:41:46.555220+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:54:56.222398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.563996+0000","last_change":"2023-10-08T15:41:46.554014+0000","last_active":"2023-10-08T15:41:46.563996+0000","last_peered":"2023-10-08T15:41:46.563996+0000","last_clean":"2023-10-08T15:41:46.563996+0000","last_became_active":"2023-10-08T15:41:46.553719+0000","last_became_peered":"2023-10-08T15:41:46.553719+0000","last_unstale":"2023-10-08T15:41:46.563996+0000","last_undegraded":"2023-10-08T15:41:46.563996+0000","last_fullsized":"2023-10-08T15:41:46.563996+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:18.165868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.545708+0000","last_change":"2023-10-08T15:41:46.545708+0000","last_active":"2023-10-08T15:41:46.545708+0000","last_peered":"2023-10-08T15:41:46.545708+0000","last_clean":"2023-10-08T15:41:46.545708+0000","last_became_active":"2023-10-08T15:41:46.544644+0000","last_became_peered":"2023-10-08T15:41:46.544644+0000","last_unstale":"2023-10-08T15:41:46.545708+0000","last_undegraded":"2023-10-08T15:41:46.545708+0000","last_fullsized":"2023-10-08T15:41:46.545708+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:20:18.458706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.554247+0000","last_change":"2023-10-08T15:41:46.537502+0000","last_active":"2023-10-08T15:41:46.554247+0000","last_peered":"2023-10-08T15:41:46.554247+0000","last_clean":"2023-10-08T15:41:46.554247+0000","last_became_active":"2023-10-08T15:41:46.536430+0000","last_became_peered":"2023-10-08T15:41:46.536430+0000","last_unstale":"2023-10-08T15:41:46.554247+0000","last_undegraded":"2023-10-08T15:41:46.554247+0000","last_fullsized":"2023-10-08T15:41:46.554247+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:26:35.732235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.560750+0000","last_change":"2023-10-08T15:41:46.553300+0000","last_active":"2023-10-08T15:41:46.560750+0000","last_peered":"2023-10-08T15:41:46.560750+0000","last_clean":"2023-10-08T15:41:46.560750+0000","last_became_active":"2023-10-08T15:41:46.549282+0000","last_became_peered":"2023-10-08T15:41:46.549282+0000","last_unstale":"2023-10-08T15:41:46.560750+0000","last_undegraded":"2023-10-08T15:41:46.560750+0000","last_fullsized":"2023-10-08T15:41:46.560750+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:55:18.668745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.564453+0000","last_change":"2023-10-08T15:41:46.563265+0000","last_active":"2023-10-08T15:41:46.564453+0000","last_peered":"2023-10-08T15:41:46.564453+0000","last_clean":"2023-10-08T15:41:46.564453+0000","last_became_active":"2023-10-08T15:41:46.562926+0000","last_became_peered":"2023-10-08T15:41:46.562926+0000","last_unstale":"2023-10-08T15:41:46.564453+0000","last_undegraded":"2023-10-08T15:41:46.564453+0000","last_fullsized":"2023-10-08T15:41:46.564453+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:04:01.710191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.559462+0000","last_change":"2023-10-08T15:41:46.552162+0000","last_active":"2023-10-08T15:41:46.559462+0000","last_peered":"2023-10-08T15:41:46.559462+0000","last_clean":"2023-10-08T15:41:46.559462+0000","last_became_active":"2023-10-08T15:41:46.551848+0000","last_became_peered":"2023-10-08T15:41:46.551848+0000","last_unstale":"2023-10-08T15:41:46.559462+0000","last_undegraded":"2023-10-08T15:41:46.559462+0000","last_fullsized":"2023-10-08T15:41:46.559462+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:24.319835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.558402+0000","last_change":"2023-10-08T15:41:46.556572+0000","last_active":"2023-10-08T15:41:46.558402+0000","last_peered":"2023-10-08T15:41:46.558402+0000","last_clean":"2023-10-08T15:41:46.558402+0000","last_became_active":"2023-10-08T15:41:46.556174+0000","last_became_peered":"2023-10-08T15:41:46.556174+0000","last_unstale":"2023-10-08T15:41:46.558402+0000","last_undegraded":"2023-10-08T15:41:46.558402+0000","last_fullsized":"2023-10-08T15:41:46.558402+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:28:10.770709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.557856+0000","last_change":"2023-10-08T15:41:46.554199+0000","last_active":"2023-10-08T15:41:46.557856+0000","last_peered":"2023-10-08T15:41:46.557856+0000","last_clean":"2023-10-08T15:41:46.557856+0000","last_became_active":"2023-10-08T15:41:46.553981+0000","last_became_peered":"2023-10-08T15:41:46.553981+0000","last_unstale":"2023-10-08T15:41:46.557856+0000","last_undegraded":"2023-10-08T15:41:46.557856+0000","last_fullsized":"2023-10-08T15:41:46.557856+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:02:26.963889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.560534+0000","last_change":"2023-10-08T15:41:46.549433+0000","last_active":"2023-10-08T15:41:46.560534+0000","last_peered":"2023-10-08T15:41:46.560534+0000","last_clean":"2023-10-08T15:41:46.560534+0000","last_became_active":"2023-10-08T15:41:46.548523+0000","last_became_peered":"2023-10-08T15:41:46.548523+0000","last_unstale":"2023-10-08T15:41:46.560534+0000","last_undegraded":"2023-10-08T15:41:46.560534+0000","last_fullsized":"2023-10-08T15:41:46.560534+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:34:57.376399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.558221+0000","last_change":"2023-10-08T15:41:46.556100+0000","last_active":"2023-10-08T15:41:46.558221+0000","last_peered":"2023-10-08T15:41:46.558221+0000","last_clean":"2023-10-08T15:41:46.558221+0000","last_became_active":"2023-10-08T15:41:46.555774+0000","last_became_peered":"2023-10-08T15:41:46.555774+0000","last_unstale":"2023-10-08T15:41:46.558221+0000","last_undegraded":"2023-10-08T15:41:46.558221+0000","last_fullsized":"2023-10-08T15:41:46.558221+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:44:52.733458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.564341+0000","last_change":"2023-10-08T15:41:46.561688+0000","last_active":"2023-10-08T15:41:46.564341+0000","last_peered":"2023-10-08T15:41:46.564341+0000","last_clean":"2023-10-08T15:41:46.564341+0000","last_became_active":"2023-10-08T15:41:46.561322+0000","last_became_peered":"2023-10-08T15:41:46.561322+0000","last_unstale":"2023-10-08T15:41:46.564341+0000","last_undegraded":"2023-10-08T15:41:46.564341+0000","last_fullsized":"2023-10-08T15:41:46.564341+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:05:03.836202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.560707+0000","last_change":"2023-10-08T15:41:46.549449+0000","last_active":"2023-10-08T15:41:46.560707+0000","last_peered":"2023-10-08T15:41:46.560707+0000","last_clean":"2023-10-08T15:41:46.560707+0000","last_became_active":"2023-10-08T15:41:46.548731+0000","last_became_peered":"2023-10-08T15:41:46.548731+0000","last_unstale":"2023-10-08T15:41:46.560707+0000","last_undegraded":"2023-10-08T15:41:46.560707+0000","last_fullsized":"2023-10-08T15:41:46.560707+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:36:21.980162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.553230+0000","last_change":"2023-10-08T15:41:46.552565+0000","last_active":"2023-10-08T15:41:46.553230+0000","last_peered":"2023-10-08T15:41:46.553230+0000","last_clean":"2023-10-08T15:41:46.553230+0000","last_became_active":"2023-10-08T15:41:46.552254+0000","last_became_peered":"2023-10-08T15:41:46.552254+0000","last_unstale":"2023-10-08T15:41:46.553230+0000","last_undegraded":"2023-10-08T15:41:46.553230+0000","last_fullsized":"2023-10-08T15:41:46.553230+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:40:44.627927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.560770+0000","last_change":"2023-10-08T15:41:46.544365+0000","last_active":"2023-10-08T15:41:46.560770+0000","last_peered":"2023-10-08T15:41:46.560770+0000","last_clean":"2023-10-08T15:41:46.560770+0000","last_became_active":"2023-10-08T15:41:46.544061+0000","last_became_peered":"2023-10-08T15:41:46.544061+0000","last_unstale":"2023-10-08T15:41:46.560770+0000","last_undegraded":"2023-10-08T15:41:46.560770+0000","last_fullsized":"2023-10-08T15:41:46.560770+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:48:50.737532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.545238+0000","last_change":"2023-10-08T15:41:46.540612+0000","last_active":"2023-10-08T15:41:46.545238+0000","last_peered":"2023-10-08T15:41:46.545238+0000","last_clean":"2023-10-08T15:41:46.545238+0000","last_became_active":"2023-10-08T15:41:46.540241+0000","last_became_peered":"2023-10-08T15:41:46.540241+0000","last_unstale":"2023-10-08T15:41:46.545238+0000","last_undegraded":"2023-10-08T15:41:46.545238+0000","last_fullsized":"2023-10-08T15:41:46.545238+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:59:01.320705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.557502+0000","last_change":"2023-10-08T15:41:46.553070+0000","last_active":"2023-10-08T15:41:46.557502+0000","last_peered":"2023-10-08T15:41:46.557502+0000","last_clean":"2023-10-08T15:41:46.557502+0000","last_became_active":"2023-10-08T15:41:46.552802+0000","last_became_peered":"2023-10-08T15:41:46.552802+0000","last_unstale":"2023-10-08T15:41:46.557502+0000","last_undegraded":"2023-10-08T15:41:46.557502+0000","last_fullsized":"2023-10-08T15:41:46.557502+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:37:34.388882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.564426+0000","last_change":"2023-10-08T15:41:46.563102+0000","last_active":"2023-10-08T15:41:46.564426+0000","last_peered":"2023-10-08T15:41:46.564426+0000","last_clean":"2023-10-08T15:41:46.564426+0000","last_became_active":"2023-10-08T15:41:46.562749+0000","last_became_peered":"2023-10-08T15:41:46.562749+0000","last_unstale":"2023-10-08T15:41:46.564426+0000","last_undegraded":"2023-10-08T15:41:46.564426+0000","last_fullsized":"2023-10-08T15:41:46.564426+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:20:18.458706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.556134+0000","last_change":"2023-10-08T15:41:46.540643+0000","last_active":"2023-10-08T15:41:46.556134+0000","last_peered":"2023-10-08T15:41:46.556134+0000","last_clean":"2023-10-08T15:41:46.556134+0000","last_became_active":"2023-10-08T15:41:46.540380+0000","last_became_peered":"2023-10-08T15:41:46.540380+0000","last_unstale":"2023-10-08T15:41:46.556134+0000","last_undegraded":"2023-10-08T15:41:46.556134+0000","last_fullsized":"2023-10-08T15:41:46.556134+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:21:06.414555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.536583+0000","last_change":"2023-10-08T15:41:46.534834+0000","last_active":"2023-10-08T15:41:46.536583+0000","last_peered":"2023-10-08T15:41:46.536583+0000","last_clean":"2023-10-08T15:41:46.536583+0000","last_became_active":"2023-10-08T15:41:46.534460+0000","last_became_peered":"2023-10-08T15:41:46.534460+0000","last_unstale":"2023-10-08T15:41:46.536583+0000","last_undegraded":"2023-10-08T15:41:46.536583+0000","last_fullsized":"2023-10-08T15:41:46.536583+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:29:41.636403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.561541+0000","last_change":"2023-10-08T15:41:46.559921+0000","last_active":"2023-10-08T15:41:46.561541+0000","last_peered":"2023-10-08T15:41:46.561541+0000","last_clean":"2023-10-08T15:41:46.561541+0000","last_became_active":"2023-10-08T15:41:46.559612+0000","last_became_peered":"2023-10-08T15:41:46.559612+0000","last_unstale":"2023-10-08T15:41:46.561541+0000","last_undegraded":"2023-10-08T15:41:46.561541+0000","last_fullsized":"2023-10-08T15:41:46.561541+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:39:08.813661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.561419+0000","last_change":"2023-10-08T15:41:46.561419+0000","last_active":"2023-10-08T15:41:46.561419+0000","last_peered":"2023-10-08T15:41:46.561419+0000","last_clean":"2023-10-08T15:41:46.561419+0000","last_became_active":"2023-10-08T15:41:46.561112+0000","last_became_peered":"2023-10-08T15:41:46.561112+0000","last_unstale":"2023-10-08T15:41:46.561419+0000","last_undegraded":"2023-10-08T15:41:46.561419+0000","last_fullsized":"2023-10-08T15:41:46.561419+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:05:03.836202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.558762+0000","last_change":"2023-10-08T15:41:46.555617+0000","last_active":"2023-10-08T15:41:46.558762+0000","last_peered":"2023-10-08T15:41:46.558762+0000","last_clean":"2023-10-08T15:41:46.558762+0000","last_became_active":"2023-10-08T15:41:46.555303+0000","last_became_peered":"2023-10-08T15:41:46.555303+0000","last_unstale":"2023-10-08T15:41:46.558762+0000","last_undegraded":"2023-10-08T15:41:46.558762+0000","last_fullsized":"2023-10-08T15:41:46.558762+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:41:43.333820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.564378+0000","last_change":"2023-10-08T15:41:46.562264+0000","last_active":"2023-10-08T15:41:46.564378+0000","last_peered":"2023-10-08T15:41:46.564378+0000","last_clean":"2023-10-08T15:41:46.564378+0000","last_became_active":"2023-10-08T15:41:46.561965+0000","last_became_peered":"2023-10-08T15:41:46.561965+0000","last_unstale":"2023-10-08T15:41:46.564378+0000","last_undegraded":"2023-10-08T15:41:46.564378+0000","last_fullsized":"2023-10-08T15:41:46.564378+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:10:09.285067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.544982+0000","last_change":"2023-10-08T15:41:46.539324+0000","last_active":"2023-10-08T15:41:46.544982+0000","last_peered":"2023-10-08T15:41:46.544982+0000","last_clean":"2023-10-08T15:41:46.544982+0000","last_became_active":"2023-10-08T15:41:46.539009+0000","last_became_peered":"2023-10-08T15:41:46.539009+0000","last_unstale":"2023-10-08T15:41:46.544982+0000","last_undegraded":"2023-10-08T15:41:46.544982+0000","last_fullsized":"2023-10-08T15:41:46.544982+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:27:11.503421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.553676+0000","last_change":"2023-10-08T15:41:46.553676+0000","last_active":"2023-10-08T15:41:46.553676+0000","last_peered":"2023-10-08T15:41:46.553676+0000","last_clean":"2023-10-08T15:41:46.553676+0000","last_became_active":"2023-10-08T15:41:46.553382+0000","last_became_peered":"2023-10-08T15:41:46.553382+0000","last_unstale":"2023-10-08T15:41:46.553676+0000","last_undegraded":"2023-10-08T15:41:46.553676+0000","last_fullsized":"2023-10-08T15:41:46.553676+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:04:01.710191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.557657+0000","last_change":"2023-10-08T15:41:46.557657+0000","last_active":"2023-10-08T15:41:46.557657+0000","last_peered":"2023-10-08T15:41:46.557657+0000","last_clean":"2023-10-08T15:41:46.557657+0000","last_became_active":"2023-10-08T15:41:46.557319+0000","last_became_peered":"2023-10-08T15:41:46.557319+0000","last_unstale":"2023-10-08T15:41:46.557657+0000","last_undegraded":"2023-10-08T15:41:46.557657+0000","last_fullsized":"2023-10-08T15:41:46.557657+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:42:43.045917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.560698+0000","last_change":"2023-10-08T15:41:46.541637+0000","last_active":"2023-10-08T15:41:46.560698+0000","last_peered":"2023-10-08T15:41:46.560698+0000","last_clean":"2023-10-08T15:41:46.560698+0000","last_became_active":"2023-10-08T15:41:46.541248+0000","last_became_peered":"2023-10-08T15:41:46.541248+0000","last_unstale":"2023-10-08T15:41:46.560698+0000","last_undegraded":"2023-10-08T15:41:46.560698+0000","last_fullsized":"2023-10-08T15:41:46.560698+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:21:22.647017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.559337+0000","last_change":"2023-10-08T15:41:46.553420+0000","last_active":"2023-10-08T15:41:46.559337+0000","last_peered":"2023-10-08T15:41:46.559337+0000","last_clean":"2023-10-08T15:41:46.559337+0000","last_became_active":"2023-10-08T15:41:46.553116+0000","last_became_peered":"2023-10-08T15:41:46.553116+0000","last_unstale":"2023-10-08T15:41:46.559337+0000","last_undegraded":"2023-10-08T15:41:46.559337+0000","last_fullsized":"2023-10-08T15:41:46.559337+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:31:56.388623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"58'4","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.556378+0000","last_change":"2023-10-08T15:41:45.539597+0000","last_active":"2023-10-08T15:41:46.556378+0000","last_peered":"2023-10-08T15:41:46.556378+0000","last_clean":"2023-10-08T15:41:46.556378+0000","last_became_active":"2023-10-08T15:41:45.539244+0000","last_became_peered":"2023-10-08T15:41:45.539244+0000","last_unstale":"2023-10-08T15:41:46.556378+0000","last_undegraded":"2023-10-08T15:41:46.556378+0000","last_fullsized":"2023-10-08T15:41:46.556378+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:37:16.854143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.560730+0000","last_change":"2023-10-08T15:41:46.553071+0000","last_active":"2023-10-08T15:41:46.560730+0000","last_peered":"2023-10-08T15:41:46.560730+0000","last_clean":"2023-10-08T15:41:46.560730+0000","last_became_active":"2023-10-08T15:41:46.548745+0000","last_became_peered":"2023-10-08T15:41:46.548745+0000","last_unstale":"2023-10-08T15:41:46.560730+0000","last_undegraded":"2023-10-08T15:41:46.560730+0000","last_fullsized":"2023-10-08T15:41:46.560730+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:44:41.018942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"58'1","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.559442+0000","last_change":"2023-10-08T15:41:45.544750+0000","last_active":"2023-10-08T15:41:46.559442+0000","last_peered":"2023-10-08T15:41:46.559442+0000","last_clean":"2023-10-08T15:41:46.559442+0000","last_became_active":"2023-10-08T15:41:45.544413+0000","last_became_peered":"2023-10-08T15:41:45.544413+0000","last_unstale":"2023-10-08T15:41:46.559442+0000","last_undegraded":"2023-10-08T15:41:46.559442+0000","last_fullsized":"2023-10-08T15:41:46.559442+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:09:34.814052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.553075+0000","last_change":"2023-10-08T15:41:46.534463+0000","last_active":"2023-10-08T15:41:46.553075+0000","last_peered":"2023-10-08T15:41:46.553075+0000","last_clean":"2023-10-08T15:41:46.553075+0000","last_became_active":"2023-10-08T15:41:46.534077+0000","last_became_peered":"2023-10-08T15:41:46.534077+0000","last_unstale":"2023-10-08T15:41:46.553075+0000","last_undegraded":"2023-10-08T15:41:46.553075+0000","last_fullsized":"2023-10-08T15:41:46.553075+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:40:44.627927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"58'2","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.561240+0000","last_change":"2023-10-08T15:41:45.542562+0000","last_active":"2023-10-08T15:41:46.561240+0000","last_peered":"2023-10-08T15:41:46.561240+0000","last_clean":"2023-10-08T15:41:46.561240+0000","last_became_active":"2023-10-08T15:41:45.542333+0000","last_became_peered":"2023-10-08T15:41:45.542333+0000","last_unstale":"2023-10-08T15:41:46.561240+0000","last_undegraded":"2023-10-08T15:41:46.561240+0000","last_fullsized":"2023-10-08T15:41:46.561240+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:21:11.582368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.551652+0000","last_change":"2023-10-08T15:41:46.539448+0000","last_active":"2023-10-08T15:41:46.551652+0000","last_peered":"2023-10-08T15:41:46.551652+0000","last_clean":"2023-10-08T15:41:46.551652+0000","last_became_active":"2023-10-08T15:41:46.539033+0000","last_became_peered":"2023-10-08T15:41:46.539033+0000","last_unstale":"2023-10-08T15:41:46.551652+0000","last_undegraded":"2023-10-08T15:41:46.551652+0000","last_fullsized":"2023-10-08T15:41:46.551652+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:31.685152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"58'2","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.555912+0000","last_change":"2023-10-08T15:41:45.545098+0000","last_active":"2023-10-08T15:41:46.555912+0000","last_peered":"2023-10-08T15:41:46.555912+0000","last_clean":"2023-10-08T15:41:46.555912+0000","last_became_active":"2023-10-08T15:41:45.544269+0000","last_became_peered":"2023-10-08T15:41:45.544269+0000","last_unstale":"2023-10-08T15:41:46.555912+0000","last_undegraded":"2023-10-08T15:41:46.555912+0000","last_fullsized":"2023-10-08T15:41:46.555912+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:58:15.964202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.548820+0000","last_change":"2023-10-08T15:41:46.548820+0000","last_active":"2023-10-08T15:41:46.548820+0000","last_peered":"2023-10-08T15:41:46.548820+0000","last_clean":"2023-10-08T15:41:46.548820+0000","last_became_active":"2023-10-08T15:41:46.548471+0000","last_became_peered":"2023-10-08T15:41:46.548471+0000","last_unstale":"2023-10-08T15:41:46.548820+0000","last_undegraded":"2023-10-08T15:41:46.548820+0000","last_fullsized":"2023-10-08T15:41:46.548820+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:37:34.388882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"58'1","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.546117+0000","last_change":"2023-10-08T15:41:45.536093+0000","last_active":"2023-10-08T15:41:46.546117+0000","last_peered":"2023-10-08T15:41:46.546117+0000","last_clean":"2023-10-08T15:41:46.546117+0000","last_became_active":"2023-10-08T15:41:45.535716+0000","last_became_peered":"2023-10-08T15:41:45.535716+0000","last_unstale":"2023-10-08T15:41:46.546117+0000","last_undegraded":"2023-10-08T15:41:46.546117+0000","last_fullsized":"2023-10-08T15:41:46.546117+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:02:25.950083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.558520+0000","last_change":"2023-10-08T15:41:46.557006+0000","last_active":"2023-10-08T15:41:46.558520+0000","last_peered":"2023-10-08T15:41:46.558520+0000","last_clean":"2023-10-08T15:41:46.558520+0000","last_became_active":"2023-10-08T15:41:46.556709+0000","last_became_peered":"2023-10-08T15:41:46.556709+0000","last_unstale":"2023-10-08T15:41:46.558520+0000","last_undegraded":"2023-10-08T15:41:46.558520+0000","last_fullsized":"2023-10-08T15:41:46.558520+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:09:35.827857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"58'1","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.560850+0000","last_change":"2023-10-08T15:41:45.544999+0000","last_active":"2023-10-08T15:41:46.560850+0000","last_peered":"2023-10-08T15:41:46.560850+0000","last_clean":"2023-10-08T15:41:46.560850+0000","last_became_active":"2023-10-08T15:41:45.544621+0000","last_became_peered":"2023-10-08T15:41:45.544621+0000","last_unstale":"2023-10-08T15:41:46.560850+0000","last_undegraded":"2023-10-08T15:41:46.560850+0000","last_fullsized":"2023-10-08T15:41:46.560850+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:40:11.035901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.560663+0000","last_change":"2023-10-08T15:41:46.553869+0000","last_active":"2023-10-08T15:41:46.560663+0000","last_peered":"2023-10-08T15:41:46.560663+0000","last_clean":"2023-10-08T15:41:46.560663+0000","last_became_active":"2023-10-08T15:41:46.553532+0000","last_became_peered":"2023-10-08T15:41:46.553532+0000","last_unstale":"2023-10-08T15:41:46.560663+0000","last_undegraded":"2023-10-08T15:41:46.560663+0000","last_fullsized":"2023-10-08T15:41:46.560663+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:31:13.382206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.529829+0000","last_change":"2023-10-08T15:41:45.534514+0000","last_active":"2023-10-08T15:41:46.529829+0000","last_peered":"2023-10-08T15:41:46.529829+0000","last_clean":"2023-10-08T15:41:46.529829+0000","last_became_active":"2023-10-08T15:41:45.534095+0000","last_became_peered":"2023-10-08T15:41:45.534095+0000","last_unstale":"2023-10-08T15:41:46.529829+0000","last_undegraded":"2023-10-08T15:41:46.529829+0000","last_fullsized":"2023-10-08T15:41:46.529829+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:38:42.846610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.545259+0000","last_change":"2023-10-08T15:41:46.540825+0000","last_active":"2023-10-08T15:41:46.545259+0000","last_peered":"2023-10-08T15:41:46.545259+0000","last_clean":"2023-10-08T15:41:46.545259+0000","last_became_active":"2023-10-08T15:41:46.540550+0000","last_became_peered":"2023-10-08T15:41:46.540550+0000","last_unstale":"2023-10-08T15:41:46.545259+0000","last_undegraded":"2023-10-08T15:41:46.545259+0000","last_fullsized":"2023-10-08T15:41:46.545259+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:04:01.710191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.521558+0000","last_change":"2023-10-08T15:41:45.544354+0000","last_active":"2023-10-08T15:41:46.521558+0000","last_peered":"2023-10-08T15:41:46.521558+0000","last_clean":"2023-10-08T15:41:46.521558+0000","last_became_active":"2023-10-08T15:41:45.544047+0000","last_became_peered":"2023-10-08T15:41:45.544047+0000","last_unstale":"2023-10-08T15:41:46.521558+0000","last_undegraded":"2023-10-08T15:41:46.521558+0000","last_fullsized":"2023-10-08T15:41:46.521558+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:45:17.598917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.540592+0000","last_change":"2023-10-08T15:41:46.540592+0000","last_active":"2023-10-08T15:41:46.540592+0000","last_peered":"2023-10-08T15:41:46.540592+0000","last_clean":"2023-10-08T15:41:46.540592+0000","last_became_active":"2023-10-08T15:41:46.540252+0000","last_became_peered":"2023-10-08T15:41:46.540252+0000","last_unstale":"2023-10-08T15:41:46.540592+0000","last_undegraded":"2023-10-08T15:41:46.540592+0000","last_fullsized":"2023-10-08T15:41:46.540592+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:55.453944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.547084+0000","last_change":"2023-10-08T15:41:45.532392+0000","last_active":"2023-10-08T15:41:46.547084+0000","last_peered":"2023-10-08T15:41:46.547084+0000","last_clean":"2023-10-08T15:41:46.547084+0000","last_became_active":"2023-10-08T15:41:45.532036+0000","last_became_peered":"2023-10-08T15:41:45.532036+0000","last_unstale":"2023-10-08T15:41:46.547084+0000","last_undegraded":"2023-10-08T15:41:46.547084+0000","last_fullsized":"2023-10-08T15:41:46.547084+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:50:49.335800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.559845+0000","last_change":"2023-10-08T15:41:46.553919+0000","last_active":"2023-10-08T15:41:46.559845+0000","last_peered":"2023-10-08T15:41:46.559845+0000","last_clean":"2023-10-08T15:41:46.559845+0000","last_became_active":"2023-10-08T15:41:46.552993+0000","last_became_peered":"2023-10-08T15:41:46.552993+0000","last_unstale":"2023-10-08T15:41:46.559845+0000","last_undegraded":"2023-10-08T15:41:46.559845+0000","last_fullsized":"2023-10-08T15:41:46.559845+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:38:02.448583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.527633+0000","last_change":"2023-10-08T15:41:45.544474+0000","last_active":"2023-10-08T15:41:46.527633+0000","last_peered":"2023-10-08T15:41:46.527633+0000","last_clean":"2023-10-08T15:41:46.527633+0000","last_became_active":"2023-10-08T15:41:45.541685+0000","last_became_peered":"2023-10-08T15:41:45.541685+0000","last_unstale":"2023-10-08T15:41:46.527633+0000","last_undegraded":"2023-10-08T15:41:46.527633+0000","last_fullsized":"2023-10-08T15:41:46.527633+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:49:59.317001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.564080+0000","last_change":"2023-10-08T15:41:46.554831+0000","last_active":"2023-10-08T15:41:46.564080+0000","last_peered":"2023-10-08T15:41:46.564080+0000","last_clean":"2023-10-08T15:41:46.564080+0000","last_became_active":"2023-10-08T15:41:46.554504+0000","last_became_peered":"2023-10-08T15:41:46.554504+0000","last_unstale":"2023-10-08T15:41:46.564080+0000","last_undegraded":"2023-10-08T15:41:46.564080+0000","last_fullsized":"2023-10-08T15:41:46.564080+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:38:48.207820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"58'3","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.550510+0000","last_change":"2023-10-08T15:41:45.540332+0000","last_active":"2023-10-08T15:41:46.550510+0000","last_peered":"2023-10-08T15:41:46.550510+0000","last_clean":"2023-10-08T15:41:46.550510+0000","last_became_active":"2023-10-08T15:41:45.540055+0000","last_became_peered":"2023-10-08T15:41:45.540055+0000","last_unstale":"2023-10-08T15:41:46.550510+0000","last_undegraded":"2023-10-08T15:41:46.550510+0000","last_fullsized":"2023-10-08T15:41:46.550510+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:59:00.306900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.555333+0000","last_change":"2023-10-08T15:41:46.546441+0000","last_active":"2023-10-08T15:41:46.555333+0000","last_peered":"2023-10-08T15:41:46.555333+0000","last_clean":"2023-10-08T15:41:46.555333+0000","last_became_active":"2023-10-08T15:41:46.546044+0000","last_became_peered":"2023-10-08T15:41:46.546044+0000","last_unstale":"2023-10-08T15:41:46.555333+0000","last_undegraded":"2023-10-08T15:41:46.555333+0000","last_fullsized":"2023-10-08T15:41:46.555333+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:06:27.535971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"58'6","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.566534+0000","last_change":"2023-10-08T15:41:45.536005+0000","last_active":"2023-10-08T15:41:46.566534+0000","last_peered":"2023-10-08T15:41:46.566534+0000","last_clean":"2023-10-08T15:41:46.566534+0000","last_became_active":"2023-10-08T15:41:45.534635+0000","last_became_peered":"2023-10-08T15:41:45.534635+0000","last_unstale":"2023-10-08T15:41:46.566534+0000","last_undegraded":"2023-10-08T15:41:46.566534+0000","last_fullsized":"2023-10-08T15:41:46.566534+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:26.333859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.560132+0000","last_change":"2023-10-08T15:41:46.556184+0000","last_active":"2023-10-08T15:41:46.560132+0000","last_peered":"2023-10-08T15:41:46.560132+0000","last_clean":"2023-10-08T15:41:46.560132+0000","last_became_active":"2023-10-08T15:41:46.555856+0000","last_became_peered":"2023-10-08T15:41:46.555856+0000","last_unstale":"2023-10-08T15:41:46.560132+0000","last_undegraded":"2023-10-08T15:41:46.560132+0000","last_fullsized":"2023-10-08T15:41:46.560132+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:40:59.740874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"58'2","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.554845+0000","last_change":"2023-10-08T15:41:45.528769+0000","last_active":"2023-10-08T15:41:46.554845+0000","last_peered":"2023-10-08T15:41:46.554845+0000","last_clean":"2023-10-08T15:41:46.554845+0000","last_became_active":"2023-10-08T15:41:45.528029+0000","last_became_peered":"2023-10-08T15:41:45.528029+0000","last_unstale":"2023-10-08T15:41:46.554845+0000","last_undegraded":"2023-10-08T15:41:46.554845+0000","last_fullsized":"2023-10-08T15:41:46.554845+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:18:38.886296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.554151+0000","last_change":"2023-10-08T15:41:46.554151+0000","last_active":"2023-10-08T15:41:46.554151+0000","last_peered":"2023-10-08T15:41:46.554151+0000","last_clean":"2023-10-08T15:41:46.554151+0000","last_became_active":"2023-10-08T15:41:46.553875+0000","last_became_peered":"2023-10-08T15:41:46.553875+0000","last_unstale":"2023-10-08T15:41:46.554151+0000","last_undegraded":"2023-10-08T15:41:46.554151+0000","last_fullsized":"2023-10-08T15:41:46.554151+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:24:58.644419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.526724+0000","last_change":"2023-10-08T15:41:45.547840+0000","last_active":"2023-10-08T15:41:46.526724+0000","last_peered":"2023-10-08T15:41:46.526724+0000","last_clean":"2023-10-08T15:41:46.526724+0000","last_became_active":"2023-10-08T15:41:45.547462+0000","last_became_peered":"2023-10-08T15:41:45.547462+0000","last_unstale":"2023-10-08T15:41:46.526724+0000","last_undegraded":"2023-10-08T15:41:46.526724+0000","last_fullsized":"2023-10-08T15:41:46.526724+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:19:17.815587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.562112+0000","last_change":"2023-10-08T15:41:46.560048+0000","last_active":"2023-10-08T15:41:46.562112+0000","last_peered":"2023-10-08T15:41:46.562112+0000","last_clean":"2023-10-08T15:41:46.562112+0000","last_became_active":"2023-10-08T15:41:46.559660+0000","last_became_peered":"2023-10-08T15:41:46.559660+0000","last_unstale":"2023-10-08T15:41:46.562112+0000","last_undegraded":"2023-10-08T15:41:46.562112+0000","last_fullsized":"2023-10-08T15:41:46.562112+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:49:48.086007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-08T15:41:45.543791+0000","last_change":"2023-10-08T15:41:45.542464+0000","last_active":"2023-10-08T15:41:45.543791+0000","last_peered":"2023-10-08T15:41:45.543791+0000","last_clean":"2023-10-08T15:41:45.543791+0000","last_became_active":"2023-10-08T15:41:45.542173+0000","last_became_peered":"2023-10-08T15:41:45.542173+0000","last_unstale":"2023-10-08T15:41:45.543791+0000","last_undegraded":"2023-10-08T15:41:45.543791+0000","last_fullsized":"2023-10-08T15:41:45.543791+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:50:49.335800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.560764+0000","last_change":"2023-10-08T15:41:46.549202+0000","last_active":"2023-10-08T15:41:46.560764+0000","last_peered":"2023-10-08T15:41:46.560764+0000","last_clean":"2023-10-08T15:41:46.560764+0000","last_became_active":"2023-10-08T15:41:46.548865+0000","last_became_peered":"2023-10-08T15:41:46.548865+0000","last_unstale":"2023-10-08T15:41:46.560764+0000","last_undegraded":"2023-10-08T15:41:46.560764+0000","last_fullsized":"2023-10-08T15:41:46.560764+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:36:18.441042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"58'8","reported_seq":18,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.560564+0000","last_change":"2023-10-08T15:41:45.532750+0000","last_active":"2023-10-08T15:41:46.560564+0000","last_peered":"2023-10-08T15:41:46.560564+0000","last_clean":"2023-10-08T15:41:46.560564+0000","last_became_active":"2023-10-08T15:41:45.532482+0000","last_became_peered":"2023-10-08T15:41:45.532482+0000","last_unstale":"2023-10-08T15:41:46.560564+0000","last_undegraded":"2023-10-08T15:41:46.560564+0000","last_fullsized":"2023-10-08T15:41:46.560564+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:55:13.132023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.555415+0000","last_change":"2023-10-08T15:41:46.549843+0000","last_active":"2023-10-08T15:41:46.555415+0000","last_peered":"2023-10-08T15:41:46.555415+0000","last_clean":"2023-10-08T15:41:46.555415+0000","last_became_active":"2023-10-08T15:41:46.549574+0000","last_became_peered":"2023-10-08T15:41:46.549574+0000","last_unstale":"2023-10-08T15:41:46.555415+0000","last_undegraded":"2023-10-08T15:41:46.555415+0000","last_fullsized":"2023-10-08T15:41:46.555415+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:42:43.045917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"58'1","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.553015+0000","last_change":"2023-10-08T15:41:45.541631+0000","last_active":"2023-10-08T15:41:46.553015+0000","last_peered":"2023-10-08T15:41:46.553015+0000","last_clean":"2023-10-08T15:41:46.553015+0000","last_became_active":"2023-10-08T15:41:45.541298+0000","last_became_peered":"2023-10-08T15:41:45.541298+0000","last_unstale":"2023-10-08T15:41:46.553015+0000","last_undegraded":"2023-10-08T15:41:46.553015+0000","last_fullsized":"2023-10-08T15:41:46.553015+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:38:42.846610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.537768+0000","last_change":"2023-10-08T15:41:46.535721+0000","last_active":"2023-10-08T15:41:46.537768+0000","last_peered":"2023-10-08T15:41:46.537768+0000","last_clean":"2023-10-08T15:41:46.537768+0000","last_became_active":"2023-10-08T15:41:46.535403+0000","last_became_peered":"2023-10-08T15:41:46.535403+0000","last_unstale":"2023-10-08T15:41:46.537768+0000","last_undegraded":"2023-10-08T15:41:46.537768+0000","last_fullsized":"2023-10-08T15:41:46.537768+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:39:25.192019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"58'2","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.561273+0000","last_change":"2023-10-08T15:41:45.541422+0000","last_active":"2023-10-08T15:41:46.561273+0000","last_peered":"2023-10-08T15:41:46.561273+0000","last_clean":"2023-10-08T15:41:46.561273+0000","last_became_active":"2023-10-08T15:41:45.541106+0000","last_became_peered":"2023-10-08T15:41:45.541106+0000","last_unstale":"2023-10-08T15:41:46.561273+0000","last_undegraded":"2023-10-08T15:41:46.561273+0000","last_fullsized":"2023-10-08T15:41:46.561273+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:16:55.171303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.558052+0000","last_change":"2023-10-08T15:41:46.556158+0000","last_active":"2023-10-08T15:41:46.558052+0000","last_peered":"2023-10-08T15:41:46.558052+0000","last_clean":"2023-10-08T15:41:46.558052+0000","last_became_active":"2023-10-08T15:41:46.555790+0000","last_became_peered":"2023-10-08T15:41:46.555790+0000","last_unstale":"2023-10-08T15:41:46.558052+0000","last_undegraded":"2023-10-08T15:41:46.558052+0000","last_fullsized":"2023-10-08T15:41:46.558052+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:51:16.745793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"58'1","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.553644+0000","last_change":"2023-10-08T15:41:45.541001+0000","last_active":"2023-10-08T15:41:46.553644+0000","last_peered":"2023-10-08T15:41:46.553644+0000","last_clean":"2023-10-08T15:41:46.553644+0000","last_became_active":"2023-10-08T15:41:45.540531+0000","last_became_peered":"2023-10-08T15:41:45.540531+0000","last_unstale":"2023-10-08T15:41:46.553644+0000","last_undegraded":"2023-10-08T15:41:46.553644+0000","last_fullsized":"2023-10-08T15:41:46.553644+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:46:59.067157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.560937+0000","last_change":"2023-10-08T15:41:46.553056+0000","last_active":"2023-10-08T15:41:46.560937+0000","last_peered":"2023-10-08T15:41:46.560937+0000","last_clean":"2023-10-08T15:41:46.560937+0000","last_became_active":"2023-10-08T15:41:46.549094+0000","last_became_peered":"2023-10-08T15:41:46.549094+0000","last_unstale":"2023-10-08T15:41:46.560937+0000","last_undegraded":"2023-10-08T15:41:46.560937+0000","last_fullsized":"2023-10-08T15:41:46.560937+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:32:08.063389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.526292+0000","last_change":"2023-10-08T15:41:45.533870+0000","last_active":"2023-10-08T15:41:46.526292+0000","last_peered":"2023-10-08T15:41:46.526292+0000","last_clean":"2023-10-08T15:41:46.526292+0000","last_became_active":"2023-10-08T15:41:45.533535+0000","last_became_peered":"2023-10-08T15:41:45.533535+0000","last_unstale":"2023-10-08T15:41:46.526292+0000","last_undegraded":"2023-10-08T15:41:46.526292+0000","last_fullsized":"2023-10-08T15:41:46.526292+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:16:44.684647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.550352+0000","last_change":"2023-10-08T15:41:46.542899+0000","last_active":"2023-10-08T15:41:46.550352+0000","last_peered":"2023-10-08T15:41:46.550352+0000","last_clean":"2023-10-08T15:41:46.550352+0000","last_became_active":"2023-10-08T15:41:46.542547+0000","last_became_peered":"2023-10-08T15:41:46.542547+0000","last_unstale":"2023-10-08T15:41:46.550352+0000","last_undegraded":"2023-10-08T15:41:46.550352+0000","last_fullsized":"2023-10-08T15:41:46.550352+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:44:20.020250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.526995+0000","last_change":"2023-10-08T15:41:45.545770+0000","last_active":"2023-10-08T15:41:46.526995+0000","last_peered":"2023-10-08T15:41:46.526995+0000","last_clean":"2023-10-08T15:41:46.526995+0000","last_became_active":"2023-10-08T15:41:45.545488+0000","last_became_peered":"2023-10-08T15:41:45.545488+0000","last_unstale":"2023-10-08T15:41:46.526995+0000","last_undegraded":"2023-10-08T15:41:46.526995+0000","last_fullsized":"2023-10-08T15:41:46.526995+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:25:13.996333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.561725+0000","last_change":"2023-10-08T15:41:46.560668+0000","last_active":"2023-10-08T15:41:46.561725+0000","last_peered":"2023-10-08T15:41:46.561725+0000","last_clean":"2023-10-08T15:41:46.561725+0000","last_became_active":"2023-10-08T15:41:46.560395+0000","last_became_peered":"2023-10-08T15:41:46.560395+0000","last_unstale":"2023-10-08T15:41:46.561725+0000","last_undegraded":"2023-10-08T15:41:46.561725+0000","last_fullsized":"2023-10-08T15:41:46.561725+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:25:37.509193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-08T15:41:45.538357+0000","last_change":"2023-10-08T15:41:45.535667+0000","last_active":"2023-10-08T15:41:45.538357+0000","last_peered":"2023-10-08T15:41:45.538357+0000","last_clean":"2023-10-08T15:41:45.538357+0000","last_became_active":"2023-10-08T15:41:45.534993+0000","last_became_peered":"2023-10-08T15:41:45.534993+0000","last_unstale":"2023-10-08T15:41:45.538357+0000","last_undegraded":"2023-10-08T15:41:45.538357+0000","last_fullsized":"2023-10-08T15:41:45.538357+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:28:35.111098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.561772+0000","last_change":"2023-10-08T15:41:46.560107+0000","last_active":"2023-10-08T15:41:46.561772+0000","last_peered":"2023-10-08T15:41:46.561772+0000","last_clean":"2023-10-08T15:41:46.561772+0000","last_became_active":"2023-10-08T15:41:46.559816+0000","last_became_peered":"2023-10-08T15:41:46.559816+0000","last_unstale":"2023-10-08T15:41:46.561772+0000","last_undegraded":"2023-10-08T15:41:46.561772+0000","last_fullsized":"2023-10-08T15:41:46.561772+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:36:45.614443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.535481+0000","last_change":"2023-10-08T15:41:45.544986+0000","last_active":"2023-10-08T15:41:46.535481+0000","last_peered":"2023-10-08T15:41:46.535481+0000","last_clean":"2023-10-08T15:41:46.535481+0000","last_became_active":"2023-10-08T15:41:45.544683+0000","last_became_peered":"2023-10-08T15:41:45.544683+0000","last_unstale":"2023-10-08T15:41:46.535481+0000","last_undegraded":"2023-10-08T15:41:46.535481+0000","last_fullsized":"2023-10-08T15:41:46.535481+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:39:07.799856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.563591+0000","last_change":"2023-10-08T15:41:46.560251+0000","last_active":"2023-10-08T15:41:46.563591+0000","last_peered":"2023-10-08T15:41:46.563591+0000","last_clean":"2023-10-08T15:41:46.563591+0000","last_became_active":"2023-10-08T15:41:46.559945+0000","last_became_peered":"2023-10-08T15:41:46.559945+0000","last_unstale":"2023-10-08T15:41:46.563591+0000","last_undegraded":"2023-10-08T15:41:46.563591+0000","last_fullsized":"2023-10-08T15:41:46.563591+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:37:23.844694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"58'2","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.560587+0000","last_change":"2023-10-08T15:41:45.541122+0000","last_active":"2023-10-08T15:41:46.560587+0000","last_peered":"2023-10-08T15:41:46.560587+0000","last_clean":"2023-10-08T15:41:46.560587+0000","last_became_active":"2023-10-08T15:41:45.540758+0000","last_became_peered":"2023-10-08T15:41:45.540758+0000","last_unstale":"2023-10-08T15:41:46.560587+0000","last_undegraded":"2023-10-08T15:41:46.560587+0000","last_fullsized":"2023-10-08T15:41:46.560587+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:18:38.886296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.546072+0000","last_change":"2023-10-08T15:41:46.546072+0000","last_active":"2023-10-08T15:41:46.546072+0000","last_peered":"2023-10-08T15:41:46.546072+0000","last_clean":"2023-10-08T15:41:46.546072+0000","last_became_active":"2023-10-08T15:41:46.544719+0000","last_became_peered":"2023-10-08T15:41:46.544719+0000","last_unstale":"2023-10-08T15:41:46.546072+0000","last_undegraded":"2023-10-08T15:41:46.546072+0000","last_fullsized":"2023-10-08T15:41:46.546072+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:10:09.285067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-08T15:41:45.543807+0000","last_change":"2023-10-08T15:41:45.542636+0000","last_active":"2023-10-08T15:41:45.543807+0000","last_peered":"2023-10-08T15:41:45.543807+0000","last_clean":"2023-10-08T15:41:45.543807+0000","last_became_active":"2023-10-08T15:41:45.542351+0000","last_became_peered":"2023-10-08T15:41:45.542351+0000","last_unstale":"2023-10-08T15:41:45.543807+0000","last_undegraded":"2023-10-08T15:41:45.543807+0000","last_fullsized":"2023-10-08T15:41:45.543807+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:16:55.171303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.559722+0000","last_change":"2023-10-08T15:41:46.554088+0000","last_active":"2023-10-08T15:41:46.559722+0000","last_peered":"2023-10-08T15:41:46.559722+0000","last_clean":"2023-10-08T15:41:46.559722+0000","last_became_active":"2023-10-08T15:41:46.553813+0000","last_became_peered":"2023-10-08T15:41:46.553813+0000","last_unstale":"2023-10-08T15:41:46.559722+0000","last_undegraded":"2023-10-08T15:41:46.559722+0000","last_fullsized":"2023-10-08T15:41:46.559722+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:29:41.497855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.523052+0000","last_change":"2023-10-08T15:41:45.537006+0000","last_active":"2023-10-08T15:41:46.523052+0000","last_peered":"2023-10-08T15:41:46.523052+0000","last_clean":"2023-10-08T15:41:46.523052+0000","last_became_active":"2023-10-08T15:41:45.536721+0000","last_became_peered":"2023-10-08T15:41:45.536721+0000","last_unstale":"2023-10-08T15:41:46.523052+0000","last_undegraded":"2023-10-08T15:41:46.523052+0000","last_fullsized":"2023-10-08T15:41:46.523052+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:06:29.806953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.556343+0000","last_change":"2023-10-08T15:41:46.541119+0000","last_active":"2023-10-08T15:41:46.556343+0000","last_peered":"2023-10-08T15:41:46.556343+0000","last_clean":"2023-10-08T15:41:46.556343+0000","last_became_active":"2023-10-08T15:41:46.540298+0000","last_became_peered":"2023-10-08T15:41:46.540298+0000","last_unstale":"2023-10-08T15:41:46.556343+0000","last_undegraded":"2023-10-08T15:41:46.556343+0000","last_fullsized":"2023-10-08T15:41:46.556343+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:08:39.068985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.535078+0000","last_change":"2023-10-08T15:41:45.540492+0000","last_active":"2023-10-08T15:41:46.535078+0000","last_peered":"2023-10-08T15:41:46.535078+0000","last_clean":"2023-10-08T15:41:46.535078+0000","last_became_active":"2023-10-08T15:41:45.539875+0000","last_became_peered":"2023-10-08T15:41:45.539875+0000","last_unstale":"2023-10-08T15:41:46.535078+0000","last_undegraded":"2023-10-08T15:41:46.535078+0000","last_fullsized":"2023-10-08T15:41:46.535078+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:42:13.770273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.560638+0000","last_change":"2023-10-08T15:41:46.553820+0000","last_active":"2023-10-08T15:41:46.560638+0000","last_peered":"2023-10-08T15:41:46.560638+0000","last_clean":"2023-10-08T15:41:46.560638+0000","last_became_active":"2023-10-08T15:41:46.548992+0000","last_became_peered":"2023-10-08T15:41:46.548992+0000","last_unstale":"2023-10-08T15:41:46.560638+0000","last_undegraded":"2023-10-08T15:41:46.560638+0000","last_fullsized":"2023-10-08T15:41:46.560638+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:37:03.757401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.522519+0000","last_change":"2023-10-08T15:41:45.538345+0000","last_active":"2023-10-08T15:41:46.522519+0000","last_peered":"2023-10-08T15:41:46.522519+0000","last_clean":"2023-10-08T15:41:46.522519+0000","last_became_active":"2023-10-08T15:41:45.538043+0000","last_became_peered":"2023-10-08T15:41:45.538043+0000","last_unstale":"2023-10-08T15:41:46.522519+0000","last_undegraded":"2023-10-08T15:41:46.522519+0000","last_fullsized":"2023-10-08T15:41:46.522519+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:23:39.557985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.555018+0000","last_change":"2023-10-08T15:41:46.537244+0000","last_active":"2023-10-08T15:41:46.555018+0000","last_peered":"2023-10-08T15:41:46.555018+0000","last_clean":"2023-10-08T15:41:46.555018+0000","last_became_active":"2023-10-08T15:41:46.535257+0000","last_became_peered":"2023-10-08T15:41:46.535257+0000","last_unstale":"2023-10-08T15:41:46.555018+0000","last_undegraded":"2023-10-08T15:41:46.555018+0000","last_fullsized":"2023-10-08T15:41:46.555018+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:14:06.171960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.529858+0000","last_change":"2023-10-08T15:41:45.534401+0000","last_active":"2023-10-08T15:41:46.529858+0000","last_peered":"2023-10-08T15:41:46.529858+0000","last_clean":"2023-10-08T15:41:46.529858+0000","last_became_active":"2023-10-08T15:41:45.534014+0000","last_became_peered":"2023-10-08T15:41:45.534014+0000","last_unstale":"2023-10-08T15:41:46.529858+0000","last_undegraded":"2023-10-08T15:41:46.529858+0000","last_fullsized":"2023-10-08T15:41:46.529858+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:19:17.815587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.550178+0000","last_change":"2023-10-08T15:41:46.546268+0000","last_active":"2023-10-08T15:41:46.550178+0000","last_peered":"2023-10-08T15:41:46.550178+0000","last_clean":"2023-10-08T15:41:46.550178+0000","last_became_active":"2023-10-08T15:41:46.546000+0000","last_became_peered":"2023-10-08T15:41:46.546000+0000","last_unstale":"2023-10-08T15:41:46.550178+0000","last_undegraded":"2023-10-08T15:41:46.550178+0000","last_fullsized":"2023-10-08T15:41:46.550178+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:00:55.449673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.545678+0000","last_change":"2023-10-08T15:41:45.532418+0000","last_active":"2023-10-08T15:41:46.545678+0000","last_peered":"2023-10-08T15:41:46.545678+0000","last_clean":"2023-10-08T15:41:46.545678+0000","last_became_active":"2023-10-08T15:41:45.532078+0000","last_became_peered":"2023-10-08T15:41:45.532078+0000","last_unstale":"2023-10-08T15:41:46.545678+0000","last_undegraded":"2023-10-08T15:41:46.545678+0000","last_fullsized":"2023-10-08T15:41:46.545678+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:23:30.867873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.560762+0000","last_change":"2023-10-08T15:41:46.541984+0000","last_active":"2023-10-08T15:41:46.560762+0000","last_peered":"2023-10-08T15:41:46.560762+0000","last_clean":"2023-10-08T15:41:46.560762+0000","last_became_active":"2023-10-08T15:41:46.541670+0000","last_became_peered":"2023-10-08T15:41:46.541670+0000","last_unstale":"2023-10-08T15:41:46.560762+0000","last_undegraded":"2023-10-08T15:41:46.560762+0000","last_fullsized":"2023-10-08T15:41:46.560762+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:24.687891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.527707+0000","last_change":"2023-10-08T15:41:45.544884+0000","last_active":"2023-10-08T15:41:46.527707+0000","last_peered":"2023-10-08T15:41:46.527707+0000","last_clean":"2023-10-08T15:41:46.527707+0000","last_became_active":"2023-10-08T15:41:45.544440+0000","last_became_peered":"2023-10-08T15:41:45.544440+0000","last_unstale":"2023-10-08T15:41:46.527707+0000","last_undegraded":"2023-10-08T15:41:46.527707+0000","last_fullsized":"2023-10-08T15:41:46.527707+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:44:02.052652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.561685+0000","last_change":"2023-10-08T15:41:46.560090+0000","last_active":"2023-10-08T15:41:46.561685+0000","last_peered":"2023-10-08T15:41:46.561685+0000","last_clean":"2023-10-08T15:41:46.561685+0000","last_became_active":"2023-10-08T15:41:46.559779+0000","last_became_peered":"2023-10-08T15:41:46.559779+0000","last_unstale":"2023-10-08T15:41:46.561685+0000","last_undegraded":"2023-10-08T15:41:46.561685+0000","last_fullsized":"2023-10-08T15:41:46.561685+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:32:57.690304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"58'2","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.560770+0000","last_change":"2023-10-08T15:41:45.544718+0000","last_active":"2023-10-08T15:41:46.560770+0000","last_peered":"2023-10-08T15:41:46.560770+0000","last_clean":"2023-10-08T15:41:46.560770+0000","last_became_active":"2023-10-08T15:41:45.544219+0000","last_became_peered":"2023-10-08T15:41:45.544219+0000","last_unstale":"2023-10-08T15:41:46.560770+0000","last_undegraded":"2023-10-08T15:41:46.560770+0000","last_fullsized":"2023-10-08T15:41:46.560770+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:50:32.179768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":202,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.526553+0000","last_change":"2023-10-08T15:37:19.380955+0000","last_active":"2023-10-08T15:41:46.526553+0000","last_peered":"2023-10-08T15:41:46.526553+0000","last_clean":"2023-10-08T15:41:46.526553+0000","last_became_active":"2023-10-08T15:37:19.378277+0000","last_became_peered":"2023-10-08T15:37:19.378277+0000","last_unstale":"2023-10-08T15:41:46.526553+0000","last_undegraded":"2023-10-08T15:41:46.526553+0000","last_fullsized":"2023-10-08T15:41:46.526553+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:17.537726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:17.537726+0000","last_clean_scrub_stamp":"2023-10-08T15:37:17.537726+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:06:26.612046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66282,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542200,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306248,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065592,"statfs":{"total":96636764160,"available":96323166208,"internally_reserved":0,"allocated":786432,"data_stored":887853,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:41:27 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.92000000000000004,"15min":0.95199999999999996},"min":{"1min":0.57099999999999995,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.92400000000000004,"15min":0.92900000000000005},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.3600000000000001,"5min":1.758,"15min":1.758},"last":1.1499999999999999}]},{"osd":1,"last update":"Sun Oct 8 15:41:27 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.88200000000000001,"15min":0.88600000000000001},"min":{"1min":0.46600000000000003,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.1930000000000001,"5min":1.474,"15min":1.474},"last":1.034},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.94299999999999995,"15min":0.95499999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.2849999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.2010000000000001}]},{"osd":2,"last update":"Sun Oct 8 15:41:27 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.97099999999999997,"15min":1.016},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.381,"5min":1.623,"15min":1.623},"last":1.099},{"interface":"front","average":{"1min":1.038,"5min":1.0029999999999999,"15min":1.0069999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.93000000000000005}]},{"osd":3,"last update":"Sun Oct 8 15:41:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.012,"15min":0.98199999999999998},"min":{"1min":0.91900000000000004,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.8260000000000001,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.226},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.998,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.8129999999999999,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":1.3069999999999999}]},{"osd":4,"last update":"Sun Oct 8 15:41:27 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.0389999999999999,"15min":1.077},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":1.331},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0760000000000001,"15min":1.0940000000000001},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.393,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.4179999999999999}]},{"osd":5,"last update":"Sun Oct 8 15:41:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1799999999999999,"15min":1.248},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.6359999999999999,"5min":1.792,"15min":1.792},"last":1.454},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.2130000000000001,"15min":1.2410000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":1.532}]},{"osd":6,"last update":"Sun Oct 8 15:41:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.272,"15min":1.3080000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.6879999999999999,"5min":1.839,"15min":1.839},"last":1.7010000000000001},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.1950000000000001,"15min":1.2410000000000001},"min":{"1min":0.79900000000000004,"5min":0.627,"15min":0.627},"max":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":1.609}]}]},{"osd":6,"up_from":14,"seq":60129542201,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306184,"kb_used_data":704,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065656,"statfs":{"total":96636764160,"available":96323231744,"internally_reserved":0,"allocated":720896,"data_stored":296989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88600000000000001,"15min":0.83799999999999997},"min":{"1min":0.60199999999999998,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.3200000000000001,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":1.024},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98599999999999999,"15min":0.998},"min":{"1min":0.63500000000000001,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.3400000000000001,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":0.90400000000000003}]},{"osd":1,"last update":"Sun Oct 8 15:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96299999999999997,"15min":0.96099999999999997},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.98599999999999999,"15min":0.98999999999999999},"min":{"1min":0.60299999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.4179999999999999,"5min":1.853,"15min":1.853},"last":0.99199999999999999}]},{"osd":2,"last update":"Sun Oct 8 15:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.88700000000000001,"15min":0.85599999999999998},"min":{"1min":0.70199999999999996,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.347,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.0640000000000001,"15min":1.0760000000000001},"min":{"1min":0.58499999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.3740000000000001,"5min":1.518,"15min":1.518},"last":0.77000000000000002}]},{"osd":3,"last update":"Sun Oct 8 15:41:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.048,"15min":1.03},"min":{"1min":0.81100000000000005,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.421,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.95299999999999996,"5min":1.046,"15min":1.073},"min":{"1min":0.78900000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.2010000000000001,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":0.81299999999999994}]},{"osd":4,"last update":"Sun Oct 8 15:41:26 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.103,"15min":1.1180000000000001},"min":{"1min":0.71299999999999997,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.3959999999999999,"5min":1.7,"15min":1.7},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.161,"15min":1.1850000000000001},"min":{"1min":0.89700000000000002,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.343,"5min":1.623,"15min":1.623},"last":1.103}]},{"osd":5,"last update":"Sun Oct 8 15:41:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0900000000000001,"15min":1.1160000000000001},"min":{"1min":0.86299999999999999,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.325,"5min":1.581,"15min":1.581},"last":1.139},{"interface":"front","average":{"1min":1.21,"5min":1.2669999999999999,"15min":1.3029999999999999},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.458,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":1.2}]},{"osd":7,"last update":"Sun Oct 8 15:41:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.2709999999999999,"15min":1.2849999999999999},"min":{"1min":1.0860000000000001,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":1.665,"5min":1.74,"15min":1.74},"last":1.232},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.26,"15min":1.2989999999999999},"min":{"1min":0.96899999999999997,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":1.522,"5min":2.5630000000000002,"15min":2.5630000000000002},"last":1.262}]}]},{"osd":3,"up_from":14,"seq":60129542202,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310280,"kb_used_data":704,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061560,"statfs":{"total":96636764160,"available":96319037440,"internally_reserved":0,"allocated":720896,"data_stored":297009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69599999999999995,"15min":0.71499999999999997},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0369999999999999,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.77000000000000002,"15min":0.76300000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.143,"5min":1.179,"15min":1.179},"last":0.73399999999999999}]},{"osd":1,"last update":"Sun Oct 8 15:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.73299999999999998,"15min":0.71699999999999997},"min":{"1min":0.42499999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":1.052},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.84099999999999997,"15min":0.81799999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.155,"5min":1.353,"15min":1.353},"last":0.89200000000000002}]},{"osd":2,"last update":"Sun Oct 8 15:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.85399999999999998,"15min":0.85199999999999998},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.1870000000000001,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.92200000000000004,"15min":0.92600000000000005},"min":{"1min":0.56599999999999995,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.325,"5min":1.423,"15min":1.423},"last":0.94299999999999995}]},{"osd":4,"last update":"Sun Oct 8 15:41:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.079,"15min":1.0669999999999999},"min":{"1min":0.77300000000000002,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.583,"5min":1.585,"15min":1.585},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.101,"15min":1.141},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.3959999999999999,"5min":2.762,"15min":2.762},"last":1.2629999999999999}]},{"osd":5,"last update":"Sun Oct 8 15:41:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.139,"15min":1.1519999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.5409999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":1.147,"5min":1.2030000000000001,"15min":1.2250000000000001},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.508,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":1.093}]},{"osd":6,"last update":"Sun Oct 8 15:41:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.2529999999999999,"15min":1.292},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.583,"5min":2.6890000000000001,"15min":2.6890000000000001},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.218,"15min":1.22},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":1.6539999999999999,"5min":1.742,"15min":1.742},"last":1.0149999999999999}]},{"osd":7,"last update":"Sun Oct 8 15:41:25 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.26,"15min":1.2569999999999999},"min":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"max":{"1min":1.51,"5min":1.738,"15min":1.738},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.236,"5min":1.3129999999999999,"15min":1.349},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.6000000000000001,"5min":2.5840000000000001,"15min":2.5840000000000001},"last":1.4530000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542201,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306188,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065652,"statfs":{"total":96636764160,"available":96323227648,"internally_reserved":0,"allocated":724992,"data_stored":298433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.64700000000000002,"15min":0.628},"min":{"1min":0.499,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.72499999999999998,"15min":0.66700000000000004},"min":{"1min":0.47099999999999997,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.105,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.78000000000000003}]},{"osd":1,"last update":"Sun Oct 8 15:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.72199999999999998,"15min":0.68700000000000006},"min":{"1min":0.56299999999999994,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0860000000000001,"5min":1.236,"15min":1.236},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.77900000000000003,"15min":0.71299999999999997},"min":{"1min":0.502,"5min":0.307,"15min":0.307},"max":{"1min":1.226,"5min":1.399,"15min":1.399},"last":0.88600000000000001}]},{"osd":3,"last update":"Sun Oct 8 15:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.72099999999999997,"15min":0.66100000000000003},"min":{"1min":0.53100000000000003,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.85099999999999998},"min":{"1min":0.621,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.60999999999999999}]},{"osd":4,"last update":"Sun Oct 8 15:41:32 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.014,"15min":1.0029999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.329,"5min":1.371,"15min":1.371},"last":0.70899999999999996},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0369999999999999,"15min":1.0349999999999999},"min":{"1min":0.71799999999999997,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.544,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.2210000000000001}]},{"osd":5,"last update":"Sun Oct 8 15:41:32 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.056,"15min":1.056},"min":{"1min":0.75700000000000001,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.351,"5min":1.462,"15min":1.462},"last":0.73399999999999999},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0780000000000001,"15min":1.0640000000000001},"min":{"1min":0.77000000000000002,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.3919999999999999,"5min":1.452,"15min":1.452},"last":1.022}]},{"osd":6,"last update":"Sun Oct 8 15:41:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.133,"15min":1.1040000000000001},"min":{"1min":0.83799999999999997,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.137,"5min":1.141,"15min":1.113},"min":{"1min":0.74199999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":0.81699999999999995}]},{"osd":7,"last update":"Sun Oct 8 15:41:32 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.2110000000000001,"15min":1.167},"min":{"1min":0.85299999999999998,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.6419999999999999,"5min":1.72,"15min":1.72},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.153,"5min":1.1910000000000001,"15min":1.167},"min":{"1min":0.77800000000000002,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.647,"5min":1.804,"15min":1.804},"last":0.86199999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542202,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306196,"kb_used_data":716,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065644,"statfs":{"total":96636764160,"available":96323219456,"internally_reserved":0,"allocated":733184,"data_stored":299021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:41:23 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.73799999999999999,"15min":0.76600000000000001},"min":{"1min":0.44700000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.1739999999999999,"5min":1.734,"15min":1.734},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.85499999999999998,"15min":0.96399999999999997},"min":{"1min":0.502,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.077,"5min":5.7960000000000003,"15min":5.7960000000000003},"last":0.63300000000000001}]},{"osd":2,"last update":"Sun Oct 8 15:41:23 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.77300000000000002,"15min":0.82699999999999996},"min":{"1min":0.46999999999999997,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.95099999999999996,"5min":4.0119999999999996,"15min":4.0119999999999996},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88800000000000001,"15min":0.90400000000000003},"min":{"1min":0.60399999999999998,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.2629999999999999,"5min":1.853,"15min":1.853},"last":0.69399999999999995}]},{"osd":3,"last update":"Sun Oct 8 15:41:23 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":1.1259999999999999,"15min":1.0169999999999999},"min":{"1min":0.65800000000000003,"5min":0.435,"15min":0.435},"max":{"1min":1.2070000000000001,"5min":13.388,"15min":13.388},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.97899999999999998,"5min":1.1739999999999999,"15min":1.1559999999999999},"min":{"1min":0.65600000000000003,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.323,"5min":13.353,"15min":13.353},"last":0.77300000000000002}]},{"osd":4,"last update":"Sun Oct 8 15:41:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.105,"15min":1.212},"min":{"1min":0.69499999999999995,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.5349999999999999,"5min":5.859,"15min":5.859},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.091,"15min":1.1499999999999999},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.5469999999999999,"5min":4.2679999999999998,"15min":4.2679999999999998},"last":1.214}]},{"osd":5,"last update":"Sun Oct 8 15:41:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.099,"15min":1.1359999999999999},"min":{"1min":0.78700000000000003,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.446,"5min":4.3380000000000001,"15min":4.3380000000000001},"last":1.173},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.1679999999999999,"15min":1.1779999999999999},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.7709999999999999,"5min":2.085,"15min":2.085},"last":1.2709999999999999}]},{"osd":6,"last update":"Sun Oct 8 15:41:23 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.246,"15min":1.3540000000000001},"min":{"1min":0.746,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.431,"5min":5.8979999999999997,"15min":5.8979999999999997},"last":0.85299999999999998},{"interface":"front","average":{"1min":1.153,"5min":1.2190000000000001,"15min":1.2649999999999999},"min":{"1min":0.81499999999999995,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.5069999999999999,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":1.119}]},{"osd":7,"last update":"Sun Oct 8 15:41:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.24,"15min":1.246},"min":{"1min":0.77700000000000002,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.7010000000000001,"5min":2.3940000000000001,"15min":2.3940000000000001},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.3380000000000001,"15min":1.4590000000000001},"min":{"1min":0.93799999999999994,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.5649999999999999,"5min":5.9299999999999997,"15min":5.9299999999999997},"last":1.429}]}]},{"osd":0,"up_from":14,"seq":60129542202,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306240,"kb_used_data":760,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065600,"statfs":{"total":96636764160,"available":96323174400,"internally_reserved":0,"allocated":778240,"data_stored":887265,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 15:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.73299999999999998,"15min":0.81299999999999994},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.89500000000000002,"5min":1.514,"15min":1.514},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.79300000000000004,"15min":0.79900000000000004},"min":{"1min":0.45700000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0980000000000001,"5min":1.518,"15min":1.518},"last":0.621}]},{"osd":2,"last update":"Sun Oct 8 15:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.81699999999999995,"15min":0.85499999999999998},"min":{"1min":0.57799999999999996,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.4059999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.78100000000000003,"15min":0.78400000000000003},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.216,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.80000000000000004}]},{"osd":3,"last update":"Sun Oct 8 15:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.75,"15min":0.75800000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.95099999999999996,"15min":0.98399999999999999},"min":{"1min":0.66900000000000004,"5min":0.499,"15min":0.499},"max":{"1min":1.556,"5min":2.3290000000000002,"15min":2.3290000000000002},"last":0.70599999999999996}]},{"osd":4,"last update":"Sun Oct 8 15:41:24 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.0469999999999999,"15min":1.0820000000000001},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.3959999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.97299999999999998,"5min":1.04,"15min":1.0800000000000001},"min":{"1min":0.67800000000000005,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.4850000000000001,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.82899999999999996}]},{"osd":5,"last update":"Sun Oct 8 15:41:24 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.0349999999999999,"15min":1.083},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.3140000000000001,"5min":2.214,"15min":2.214},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.2270000000000001,"15min":1.3200000000000001},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.6879999999999999,"5min":3.4569999999999999,"15min":3.4569999999999999},"last":1.0720000000000001}]},{"osd":6,"last update":"Sun Oct 8 15:41:24 2023","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.218,"15min":1.284},"min":{"1min":0.94099999999999995,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.641,"5min":2.532,"15min":2.532},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.2090000000000001,"15min":1.2370000000000001},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.649,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":1.226}]},{"osd":7,"last update":"Sun Oct 8 15:41:24 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.2649999999999999,"15min":1.2909999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.726,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.163},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.202,"15min":1.226},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":1.111}]}]},{"osd":5,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306152,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065688,"statfs":{"total":96636764160,"available":96323264512,"internally_reserved":0,"allocated":688128,"data_stored":283846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.879,"15min":0.85599999999999998},"min":{"1min":0.55600000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.2829999999999999,"5min":1.528,"15min":1.528},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.90700000000000003,"15min":0.91000000000000003},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.96899999999999997}]},{"osd":1,"last update":"Sun Oct 8 15:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.91200000000000003,"15min":0.90800000000000003},"min":{"1min":0.52700000000000002,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.2909999999999999,"5min":1.448,"15min":1.448},"last":1.4219999999999999},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.92900000000000005,"15min":0.97599999999999998},"min":{"1min":0.58899999999999997,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1739999999999999,"5min":1.754,"15min":1.754},"last":1.1519999999999999}]},{"osd":2,"last update":"Sun Oct 8 15:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.94499999999999995,"15min":0.95199999999999996},"min":{"1min":0.63200000000000001,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.4750000000000001,"5min":1.869,"15min":1.869},"last":0.752},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98099999999999998,"15min":1.0069999999999999},"min":{"1min":0.66200000000000003,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.2250000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":1.1160000000000001}]},{"osd":3,"last update":"Sun Oct 8 15:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98599999999999999,"15min":0.998},"min":{"1min":0.69499999999999995,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.2470000000000001,"5min":1.929,"15min":1.929},"last":0.65100000000000002},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.05,"15min":1.097},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.589,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":1.0680000000000001}]},{"osd":4,"last update":"Sun Oct 8 15:41:24 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.002,"15min":1.0109999999999999},"min":{"1min":0.72899999999999998,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.5069999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0329999999999999,"15min":1.0680000000000001},"min":{"1min":0.65000000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.399,"5min":1.823,"15min":1.823},"last":1.306}]},{"osd":6,"last update":"Sun Oct 8 15:41:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.1679999999999999,"15min":1.196},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.6659999999999999,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":1.28},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.177,"15min":1.2230000000000001},"min":{"1min":0.72799999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.5,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.0329999999999999}]},{"osd":7,"last update":"Sun Oct 8 15:41:24 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.099,"15min":1.1479999999999999},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.4379999999999999,"5min":2.177,"15min":2.177},"last":1.25},{"interface":"front","average":{"1min":1.2,"5min":1.196,"15min":1.2130000000000001},"min":{"1min":0.72399999999999998,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.74,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.2}]}]},{"osd":4,"up_from":13,"seq":55834574905,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297976,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073864,"statfs":{"total":96636764160,"available":96331636736,"internally_reserved":0,"allocated":704512,"data_stored":290679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.82699999999999996,"15min":0.81100000000000005},"min":{"1min":0.57199999999999995,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.83099999999999996,"15min":0.80100000000000005},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":0.89500000000000002}]},{"osd":1,"last update":"Sun Oct 8 15:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.88200000000000001,"15min":0.84399999999999997},"min":{"1min":0.69099999999999995,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86099999999999999,"15min":0.83999999999999997},"min":{"1min":0.51200000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1240000000000001,"5min":1.383,"15min":1.383},"last":0.85599999999999998}]},{"osd":2,"last update":"Sun Oct 8 15:41:22 2023","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.054,"15min":1.036},"min":{"1min":0.79500000000000004,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0209999999999999,"15min":1.022},"min":{"1min":0.67300000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":1.0289999999999999}]},{"osd":3,"last update":"Sun Oct 8 15:41:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.012,"15min":1.0189999999999999},"min":{"1min":0.83299999999999996,"5min":0.626,"15min":0.626},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.101,"5min":1.056,"15min":1.04},"min":{"1min":0.77000000000000002,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.68700000000000006}]},{"osd":5,"last update":"Sun Oct 8 15:41:22 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.0049999999999999,"15min":0.97699999999999998},"min":{"1min":0.629,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":1.304},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.0920000000000001,"15min":1.0700000000000001},"min":{"1min":0.82399999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":1.202}]},{"osd":6,"last update":"Sun Oct 8 15:41:22 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.115,"15min":1.139},"min":{"1min":0.72399999999999998,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.45,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.97799999999999998},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.2070000000000001,"15min":1.1890000000000001},"min":{"1min":0.91600000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.92500000000000004}]},{"osd":7,"last update":"Sun Oct 8 15:41:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.1080000000000001,"15min":1.079},"min":{"1min":0.92900000000000005,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.103},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.218,"15min":1.198},"min":{"1min":0.97399999999999998,"5min":0.625,"15min":0.625},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":1.1479999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T15:41:49.557 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T15:41:49.662 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.658+0000 7f373ebd3700 1 Processor -- start 2023-10-08T15:41:49.662 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.658+0000 7f373ebd3700 1 -- start start 2023-10-08T15:41:49.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.658+0000 7f373ebd3700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f37380bafe0 0x7f3738068ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:49.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.658+0000 7f373ebd3700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f373809e490 con 0x7f3738153ad0 2023-10-08T15:41:49.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.658+0000 7f373ebd3700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f373806ce30 con 0x7f373806d080 2023-10-08T15:41:49.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.658+0000 7f373ebd3700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f373809e6e0 con 0x7f37380bafe0 2023-10-08T15:41:49.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.658+0000 7f373d170700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f3738153ad0 0x7f373814ef20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:60782/0 (socket says 172.21.15.3:60782) 2023-10-08T15:41:49.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.658+0000 7f373d170700 1 -- 172.21.15.3:0/2748390479 learned_addr learned my addr 172.21.15.3:0/2748390479 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:41:49.664 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.658+0000 7f373c96f700 1 --2- 172.21.15.3:0/2748390479 >> v2:172.21.15.50:3300/0 conn(0x7f37380bafe0 0x7f3738068ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:49.664 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.658+0000 7f37377fe700 1 -- 172.21.15.3:0/2748390479 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3783810784 0 0) 0x7f373809e490 con 0x7f3738153ad0 2023-10-08T15:41:49.664 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.658+0000 7f37377fe700 1 -- 172.21.15.3:0/2748390479 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3724003570 con 0x7f3738153ad0 2023-10-08T15:41:49.666 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.658+0000 7f37377fe700 1 -- 172.21.15.3:0/2748390479 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1978804988 0 0) 0x7f3724003570 con 0x7f3738153ad0 2023-10-08T15:41:49.666 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.658+0000 7f37377fe700 1 -- 172.21.15.3:0/2748390479 >> v2:172.21.15.50:3300/0 conn(0x7f37380bafe0 msgr2=0x7f3738068ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:49.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.658+0000 7f37377fe700 1 --2- 172.21.15.3:0/2748390479 >> v2:172.21.15.50:3300/0 conn(0x7f37380bafe0 0x7f3738068ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:49.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.658+0000 7f37377fe700 1 -- 172.21.15.3:0/2748390479 >> v1:172.21.15.50:6789/0 conn(0x7f373806d080 legacy=0x7f37381533c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:49.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.658+0000 7f37377fe700 1 -- 172.21.15.3:0/2748390479 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3738153f10 con 0x7f3738153ad0 2023-10-08T15:41:49.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.658+0000 7f37377fe700 1 -- 172.21.15.3:0/2748390479 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2285686191 0 0) 0x7f3728001470 con 0x7f3738153ad0 2023-10-08T15:41:49.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.658+0000 7f37377fe700 1 -- 172.21.15.3:0/2748390479 >> v1:172.21.15.3:6789/0 conn(0x7f3738153ad0 legacy=0x7f373814ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:49.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.658+0000 7f37377fe700 1 --2- 172.21.15.3:0/2748390479 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3724003a60 0x7f3724003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:49.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.658+0000 7f37377fe700 1 --2- 172.21.15.3:0/2748390479 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3724004810 0x7f3724004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:49.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.658+0000 7f37377fe700 1 --2- 172.21.15.3:0/2748390479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37240051c0 0x7f372400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:49.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.658+0000 7f37377fe700 1 -- 172.21.15.3:0/2748390479 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f373809e6e0 con 0x7f3724004810 2023-10-08T15:41:49.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.658+0000 7f37377fe700 1 -- 172.21.15.3:0/2748390479 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f372400c160 con 0x7f37240051c0 2023-10-08T15:41:49.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.658+0000 7f37377fe700 1 -- 172.21.15.3:0/2748390479 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f372400c320 con 0x7f3724003a60 2023-10-08T15:41:49.668 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.658+0000 7f3737fff700 1 --2- 172.21.15.3:0/2748390479 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3724004810 0x7f3724004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:49.668 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.658+0000 7f373d170700 1 --2- 172.21.15.3:0/2748390479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37240051c0 0x7f372400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:49.668 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.658+0000 7f373c96f700 1 --2- 172.21.15.3:0/2748390479 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3724003a60 0x7f3724003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:49.668 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.658+0000 7f3737fff700 1 -- 172.21.15.3:0/2748390479 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3724003a60 msgr2=0x7f3724003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:49.668 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.658+0000 7f3737fff700 1 --2- 172.21.15.3:0/2748390479 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3724003a60 0x7f3724003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:49.668 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.658+0000 7f3737fff700 1 -- 172.21.15.3:0/2748390479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37240051c0 msgr2=0x7f372400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:49.668 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.658+0000 7f3737fff700 1 --2- 172.21.15.3:0/2748390479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37240051c0 0x7f372400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:49.668 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.658+0000 7f3737fff700 1 -- 172.21.15.3:0/2748390479 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3724003570 con 0x7f3724004810 2023-10-08T15:41:49.668 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.658+0000 7f373c96f700 1 --2- 172.21.15.3:0/2748390479 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3724003a60 0x7f3724003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:49.668 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.658+0000 7f373d170700 1 --2- 172.21.15.3:0/2748390479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37240051c0 0x7f372400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:49.668 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.658+0000 7f373d170700 1 -- 172.21.15.3:0/2748390479 reap_dead start 2023-10-08T15:41:49.669 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.658+0000 7f3737fff700 1 --2- 172.21.15.3:0/2748390479 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3724004810 0x7f3724004c80 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f3730001fc0 tx=0x7f3730001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12cc70fa0ce8eb33 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:49.669 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.662+0000 7f37377fe700 1 -- 172.21.15.3:0/2748390479 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3730001950 con 0x7f3724004810 2023-10-08T15:41:49.669 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.662+0000 7f37377fe700 1 -- 172.21.15.3:0/2748390479 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f373000c8b0 con 0x7f3724004810 2023-10-08T15:41:49.669 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.662+0000 7f37377fe700 1 -- 172.21.15.3:0/2748390479 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373000cc50 con 0x7f3724004810 2023-10-08T15:41:49.669 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.662+0000 7f373ebd3700 1 -- 172.21.15.3:0/2748390479 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3724004810 msgr2=0x7f3724004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:49.669 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.662+0000 7f373ebd3700 1 --2- 172.21.15.3:0/2748390479 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3724004810 0x7f3724004c80 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f3730001fc0 tx=0x7f3730001640 comp rx=0 tx=0).stop 2023-10-08T15:41:49.669 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.662+0000 7f373ebd3700 1 -- 172.21.15.3:0/2748390479 shutdown_connections 2023-10-08T15:41:49.669 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.662+0000 7f373ebd3700 1 --2- 172.21.15.3:0/2748390479 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3724004810 0x7f3724004c80 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:49.669 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.662+0000 7f373ebd3700 1 -- 172.21.15.3:0/2748390479 >> 172.21.15.3:0/2748390479 conn(0x7f37380be640 msgr2=0x7f37380ba6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:49.669 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.662+0000 7f373ebd3700 1 -- 172.21.15.3:0/2748390479 shutdown_connections 2023-10-08T15:41:49.669 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.662+0000 7f373ebd3700 1 -- 172.21.15.3:0/2748390479 wait complete. 2023-10-08T15:41:49.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.662+0000 7f373ebd3700 1 Processor -- start 2023-10-08T15:41:49.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.662+0000 7f373ebd3700 1 -- start start 2023-10-08T15:41:49.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.666+0000 7f373ebd3700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f373814ed80 0x7f3738145c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:49.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.666+0000 7f373ebd3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37380bc3c0 0x7f37381603c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:49.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.666+0000 7f373ebd3700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f37380bd160 0x7f37381465f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:49.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.666+0000 7f373ebd3700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3738144b70 con 0x7f373814ed80 2023-10-08T15:41:49.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.666+0000 7f373ebd3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f373815ff30 con 0x7f37380bc3c0 2023-10-08T15:41:49.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.666+0000 7f373ebd3700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37380bc8e0 con 0x7f37380bd160 2023-10-08T15:41:49.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.666+0000 7f373c96f700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f373814ed80 0x7f3738145c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:49.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.666+0000 7f373c96f700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f373814ed80 0x7f3738145c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60564/0 (socket says 172.21.15.3:60564) 2023-10-08T15:41:49.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.666+0000 7f373c96f700 1 -- 172.21.15.3:0/2390835313 learned_addr learned my addr 172.21.15.3:0/2390835313 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:49.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.666+0000 7f373d170700 1 --2- 172.21.15.3:0/2390835313 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f37380bd160 0x7f37381465f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:49.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.666+0000 7f3737fff700 1 --2- 172.21.15.3:0/2390835313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37380bc3c0 0x7f37381603c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:49.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.666+0000 7f373c96f700 1 -- 172.21.15.3:0/2390835313 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f37380bd160 msgr2=0x7f37381465f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:49.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.666+0000 7f373c96f700 1 --2- 172.21.15.3:0/2390835313 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f37380bd160 0x7f37381465f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:49.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.666+0000 7f373c96f700 1 -- 172.21.15.3:0/2390835313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37380bc3c0 msgr2=0x7f37381603c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:49.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.666+0000 7f373c96f700 1 --2- 172.21.15.3:0/2390835313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37380bc3c0 0x7f37381603c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:49.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.666+0000 7f373c96f700 1 -- 172.21.15.3:0/2390835313 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f373815fbc0 con 0x7f373814ed80 2023-10-08T15:41:49.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.666+0000 7f373c96f700 1 --2- 172.21.15.3:0/2390835313 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f373814ed80 0x7f3738145c40 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f37200116f0 tx=0x7f3720008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:49.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.666+0000 7f3734ff9700 1 -- 172.21.15.3:0/2390835313 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3720005c10 con 0x7f373814ed80 2023-10-08T15:41:49.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.666+0000 7f3734ff9700 1 -- 172.21.15.3:0/2390835313 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3720005d70 con 0x7f373814ed80 2023-10-08T15:41:49.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.666+0000 7f373ebd3700 1 -- 172.21.15.3:0/2390835313 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3738146180 con 0x7f373814ed80 2023-10-08T15:41:49.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.666+0000 7f3734ff9700 1 -- 172.21.15.3:0/2390835313 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3720006280 con 0x7f373814ed80 2023-10-08T15:41:49.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.666+0000 7f373ebd3700 1 -- 172.21.15.3:0/2390835313 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f373814f150 con 0x7f373814ed80 2023-10-08T15:41:49.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.666+0000 7f373ebd3700 1 -- 172.21.15.3:0/2390835313 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3738064530 con 0x7f373814ed80 2023-10-08T15:41:49.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.670+0000 7f3734ff9700 1 -- 172.21.15.3:0/2390835313 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f3720006630 con 0x7f373814ed80 2023-10-08T15:41:49.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.670+0000 7f3734ff9700 1 --2- 172.21.15.3:0/2390835313 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3718060550 0x7f3718062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:49.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.670+0000 7f3734ff9700 1 -- 172.21.15.3:0/2390835313 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f372007cb30 con 0x7f373814ed80 2023-10-08T15:41:49.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.670+0000 7f3737fff700 1 --2- 172.21.15.3:0/2390835313 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3718060550 0x7f3718062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:49.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.670+0000 7f3737fff700 1 --2- 172.21.15.3:0/2390835313 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3718060550 0x7f3718062a00 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f373805ec80 tx=0x7f3730015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:49.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.678+0000 7f3734ff9700 1 -- 172.21.15.3:0/2390835313 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f372004d080 con 0x7f373814ed80 2023-10-08T15:41:49.835 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.830+0000 7f373ebd3700 1 -- 172.21.15.3:0/2390835313 --> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f373815fa50 con 0x7f3718060550 2023-10-08T15:41:49.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.850+0000 7f3734ff9700 1 -- 172.21.15.3:0/2390835313 <== mgr.4102 v2:172.21.15.50:6832/33268 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287340 (secure 0 0 0) 0x7f373815fa50 con 0x7f3718060550 2023-10-08T15:41:49.858 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:41:49.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.854+0000 7f373ebd3700 1 -- 172.21.15.3:0/2390835313 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3718060550 msgr2=0x7f3718062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:49.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.854+0000 7f373ebd3700 1 --2- 172.21.15.3:0/2390835313 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3718060550 0x7f3718062a00 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f373805ec80 tx=0x7f3730015000 comp rx=0 tx=0).stop 2023-10-08T15:41:49.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.854+0000 7f373ebd3700 1 -- 172.21.15.3:0/2390835313 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f373814ed80 msgr2=0x7f3738145c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:49.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.854+0000 7f373ebd3700 1 --2- 172.21.15.3:0/2390835313 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f373814ed80 0x7f3738145c40 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f37200116f0 tx=0x7f3720008040 comp rx=0 tx=0).stop 2023-10-08T15:41:49.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.854+0000 7f373ebd3700 1 -- 172.21.15.3:0/2390835313 shutdown_connections 2023-10-08T15:41:49.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.854+0000 7f373ebd3700 1 --2- 172.21.15.3:0/2390835313 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3718060550 0x7f3718062a00 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:49.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.854+0000 7f373ebd3700 1 --2- 172.21.15.3:0/2390835313 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f37380bd160 0x7f37381465f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:49.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.854+0000 7f373ebd3700 1 --2- 172.21.15.3:0/2390835313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37380bc3c0 0x7f37381603c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:49.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.854+0000 7f373ebd3700 1 --2- 172.21.15.3:0/2390835313 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f373814ed80 0x7f3738145c40 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:49.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.854+0000 7f373ebd3700 1 -- 172.21.15.3:0/2390835313 >> 172.21.15.3:0/2390835313 conn(0x7f37380be640 msgr2=0x7f37381499f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:49.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.854+0000 7f373ebd3700 1 -- 172.21.15.3:0/2390835313 shutdown_connections 2023-10-08T15:41:49.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.854+0000 7f373ebd3700 1 -- 172.21.15.3:0/2390835313 wait complete. 2023-10-08T15:41:49.862 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2023-10-08T15:41:49.874 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":188,"stamp":"2023-10-08T15:41:48.608160+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":165,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2445464,"kb_used_data":5720,"kb_used_omap":0,"kb_used_meta":2439680,"kb_avail":752529256,"statfs":{"total":773094113280,"available":770589958144,"internally_reserved":0,"allocated":5857280,"data_stored":3541095,"data_compressed":66282,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":2498232320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.105070"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.540382+0000","last_change":"2023-10-08T15:41:46.538400+0000","last_active":"2023-10-08T15:41:46.540382+0000","last_peered":"2023-10-08T15:41:46.540382+0000","last_clean":"2023-10-08T15:41:46.540382+0000","last_became_active":"2023-10-08T15:41:46.538136+0000","last_became_peered":"2023-10-08T15:41:46.538136+0000","last_unstale":"2023-10-08T15:41:46.540382+0000","last_undegraded":"2023-10-08T15:41:46.540382+0000","last_fullsized":"2023-10-08T15:41:46.540382+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:47:08.832078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.564027+0000","last_change":"2023-10-08T15:41:46.554091+0000","last_active":"2023-10-08T15:41:46.564027+0000","last_peered":"2023-10-08T15:41:46.564027+0000","last_clean":"2023-10-08T15:41:46.564027+0000","last_became_active":"2023-10-08T15:41:46.553775+0000","last_became_peered":"2023-10-08T15:41:46.553775+0000","last_unstale":"2023-10-08T15:41:46.564027+0000","last_undegraded":"2023-10-08T15:41:46.564027+0000","last_fullsized":"2023-10-08T15:41:46.564027+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:35:17.568858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.552691+0000","last_change":"2023-10-08T15:41:46.545414+0000","last_active":"2023-10-08T15:41:46.552691+0000","last_peered":"2023-10-08T15:41:46.552691+0000","last_clean":"2023-10-08T15:41:46.552691+0000","last_became_active":"2023-10-08T15:41:46.545118+0000","last_became_peered":"2023-10-08T15:41:46.545118+0000","last_unstale":"2023-10-08T15:41:46.552691+0000","last_undegraded":"2023-10-08T15:41:46.552691+0000","last_fullsized":"2023-10-08T15:41:46.552691+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:21:19.421520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.562327+0000","last_change":"2023-10-08T15:41:46.559966+0000","last_active":"2023-10-08T15:41:46.562327+0000","last_peered":"2023-10-08T15:41:46.562327+0000","last_clean":"2023-10-08T15:41:46.562327+0000","last_became_active":"2023-10-08T15:41:46.559639+0000","last_became_peered":"2023-10-08T15:41:46.559639+0000","last_unstale":"2023-10-08T15:41:46.562327+0000","last_undegraded":"2023-10-08T15:41:46.562327+0000","last_fullsized":"2023-10-08T15:41:46.562327+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:14:06.171960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.555220+0000","last_change":"2023-10-08T15:41:46.537224+0000","last_active":"2023-10-08T15:41:46.555220+0000","last_peered":"2023-10-08T15:41:46.555220+0000","last_clean":"2023-10-08T15:41:46.555220+0000","last_became_active":"2023-10-08T15:41:46.536885+0000","last_became_peered":"2023-10-08T15:41:46.536885+0000","last_unstale":"2023-10-08T15:41:46.555220+0000","last_undegraded":"2023-10-08T15:41:46.555220+0000","last_fullsized":"2023-10-08T15:41:46.555220+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:54:56.222398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.563996+0000","last_change":"2023-10-08T15:41:46.554014+0000","last_active":"2023-10-08T15:41:46.563996+0000","last_peered":"2023-10-08T15:41:46.563996+0000","last_clean":"2023-10-08T15:41:46.563996+0000","last_became_active":"2023-10-08T15:41:46.553719+0000","last_became_peered":"2023-10-08T15:41:46.553719+0000","last_unstale":"2023-10-08T15:41:46.563996+0000","last_undegraded":"2023-10-08T15:41:46.563996+0000","last_fullsized":"2023-10-08T15:41:46.563996+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:18.165868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.545708+0000","last_change":"2023-10-08T15:41:46.545708+0000","last_active":"2023-10-08T15:41:46.545708+0000","last_peered":"2023-10-08T15:41:46.545708+0000","last_clean":"2023-10-08T15:41:46.545708+0000","last_became_active":"2023-10-08T15:41:46.544644+0000","last_became_peered":"2023-10-08T15:41:46.544644+0000","last_unstale":"2023-10-08T15:41:46.545708+0000","last_undegraded":"2023-10-08T15:41:46.545708+0000","last_fullsized":"2023-10-08T15:41:46.545708+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:20:18.458706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.554247+0000","last_change":"2023-10-08T15:41:46.537502+0000","last_active":"2023-10-08T15:41:46.554247+0000","last_peered":"2023-10-08T15:41:46.554247+0000","last_clean":"2023-10-08T15:41:46.554247+0000","last_became_active":"2023-10-08T15:41:46.536430+0000","last_became_peered":"2023-10-08T15:41:46.536430+0000","last_unstale":"2023-10-08T15:41:46.554247+0000","last_undegraded":"2023-10-08T15:41:46.554247+0000","last_fullsized":"2023-10-08T15:41:46.554247+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:26:35.732235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.560750+0000","last_change":"2023-10-08T15:41:46.553300+0000","last_active":"2023-10-08T15:41:46.560750+0000","last_peered":"2023-10-08T15:41:46.560750+0000","last_clean":"2023-10-08T15:41:46.560750+0000","last_became_active":"2023-10-08T15:41:46.549282+0000","last_became_peered":"2023-10-08T15:41:46.549282+0000","last_unstale":"2023-10-08T15:41:46.560750+0000","last_undegraded":"2023-10-08T15:41:46.560750+0000","last_fullsized":"2023-10-08T15:41:46.560750+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:55:18.668745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.564453+0000","last_change":"2023-10-08T15:41:46.563265+0000","last_active":"2023-10-08T15:41:46.564453+0000","last_peered":"2023-10-08T15:41:46.564453+0000","last_clean":"2023-10-08T15:41:46.564453+0000","last_became_active":"2023-10-08T15:41:46.562926+0000","last_became_peered":"2023-10-08T15:41:46.562926+0000","last_unstale":"2023-10-08T15:41:46.564453+0000","last_undegraded":"2023-10-08T15:41:46.564453+0000","last_fullsized":"2023-10-08T15:41:46.564453+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:04:01.710191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.559462+0000","last_change":"2023-10-08T15:41:46.552162+0000","last_active":"2023-10-08T15:41:46.559462+0000","last_peered":"2023-10-08T15:41:46.559462+0000","last_clean":"2023-10-08T15:41:46.559462+0000","last_became_active":"2023-10-08T15:41:46.551848+0000","last_became_peered":"2023-10-08T15:41:46.551848+0000","last_unstale":"2023-10-08T15:41:46.559462+0000","last_undegraded":"2023-10-08T15:41:46.559462+0000","last_fullsized":"2023-10-08T15:41:46.559462+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:24.319835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.558402+0000","last_change":"2023-10-08T15:41:46.556572+0000","last_active":"2023-10-08T15:41:46.558402+0000","last_peered":"2023-10-08T15:41:46.558402+0000","last_clean":"2023-10-08T15:41:46.558402+0000","last_became_active":"2023-10-08T15:41:46.556174+0000","last_became_peered":"2023-10-08T15:41:46.556174+0000","last_unstale":"2023-10-08T15:41:46.558402+0000","last_undegraded":"2023-10-08T15:41:46.558402+0000","last_fullsized":"2023-10-08T15:41:46.558402+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:28:10.770709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.557856+0000","last_change":"2023-10-08T15:41:46.554199+0000","last_active":"2023-10-08T15:41:46.557856+0000","last_peered":"2023-10-08T15:41:46.557856+0000","last_clean":"2023-10-08T15:41:46.557856+0000","last_became_active":"2023-10-08T15:41:46.553981+0000","last_became_peered":"2023-10-08T15:41:46.553981+0000","last_unstale":"2023-10-08T15:41:46.557856+0000","last_undegraded":"2023-10-08T15:41:46.557856+0000","last_fullsized":"2023-10-08T15:41:46.557856+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:02:26.963889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.560534+0000","last_change":"2023-10-08T15:41:46.549433+0000","last_active":"2023-10-08T15:41:46.560534+0000","last_peered":"2023-10-08T15:41:46.560534+0000","last_clean":"2023-10-08T15:41:46.560534+0000","last_became_active":"2023-10-08T15:41:46.548523+0000","last_became_peered":"2023-10-08T15:41:46.548523+0000","last_unstale":"2023-10-08T15:41:46.560534+0000","last_undegraded":"2023-10-08T15:41:46.560534+0000","last_fullsized":"2023-10-08T15:41:46.560534+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:34:57.376399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.558221+0000","last_change":"2023-10-08T15:41:46.556100+0000","last_active":"2023-10-08T15:41:46.558221+0000","last_peered":"2023-10-08T15:41:46.558221+0000","last_clean":"2023-10-08T15:41:46.558221+0000","last_became_active":"2023-10-08T15:41:46.555774+0000","last_became_peered":"2023-10-08T15:41:46.555774+0000","last_unstale":"2023-10-08T15:41:46.558221+0000","last_undegraded":"2023-10-08T15:41:46.558221+0000","last_fullsized":"2023-10-08T15:41:46.558221+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:44:52.733458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.564341+0000","last_change":"2023-10-08T15:41:46.561688+0000","last_active":"2023-10-08T15:41:46.564341+0000","last_peered":"2023-10-08T15:41:46.564341+0000","last_clean":"2023-10-08T15:41:46.564341+0000","last_became_active":"2023-10-08T15:41:46.561322+0000","last_became_peered":"2023-10-08T15:41:46.561322+0000","last_unstale":"2023-10-08T15:41:46.564341+0000","last_undegraded":"2023-10-08T15:41:46.564341+0000","last_fullsized":"2023-10-08T15:41:46.564341+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:05:03.836202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.560707+0000","last_change":"2023-10-08T15:41:46.549449+0000","last_active":"2023-10-08T15:41:46.560707+0000","last_peered":"2023-10-08T15:41:46.560707+0000","last_clean":"2023-10-08T15:41:46.560707+0000","last_became_active":"2023-10-08T15:41:46.548731+0000","last_became_peered":"2023-10-08T15:41:46.548731+0000","last_unstale":"2023-10-08T15:41:46.560707+0000","last_undegraded":"2023-10-08T15:41:46.560707+0000","last_fullsized":"2023-10-08T15:41:46.560707+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:36:21.980162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.553230+0000","last_change":"2023-10-08T15:41:46.552565+0000","last_active":"2023-10-08T15:41:46.553230+0000","last_peered":"2023-10-08T15:41:46.553230+0000","last_clean":"2023-10-08T15:41:46.553230+0000","last_became_active":"2023-10-08T15:41:46.552254+0000","last_became_peered":"2023-10-08T15:41:46.552254+0000","last_unstale":"2023-10-08T15:41:46.553230+0000","last_undegraded":"2023-10-08T15:41:46.553230+0000","last_fullsized":"2023-10-08T15:41:46.553230+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:40:44.627927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.560770+0000","last_change":"2023-10-08T15:41:46.544365+0000","last_active":"2023-10-08T15:41:46.560770+0000","last_peered":"2023-10-08T15:41:46.560770+0000","last_clean":"2023-10-08T15:41:46.560770+0000","last_became_active":"2023-10-08T15:41:46.544061+0000","last_became_peered":"2023-10-08T15:41:46.544061+0000","last_unstale":"2023-10-08T15:41:46.560770+0000","last_undegraded":"2023-10-08T15:41:46.560770+0000","last_fullsized":"2023-10-08T15:41:46.560770+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:48:50.737532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.545238+0000","last_change":"2023-10-08T15:41:46.540612+0000","last_active":"2023-10-08T15:41:46.545238+0000","last_peered":"2023-10-08T15:41:46.545238+0000","last_clean":"2023-10-08T15:41:46.545238+0000","last_became_active":"2023-10-08T15:41:46.540241+0000","last_became_peered":"2023-10-08T15:41:46.540241+0000","last_unstale":"2023-10-08T15:41:46.545238+0000","last_undegraded":"2023-10-08T15:41:46.545238+0000","last_fullsized":"2023-10-08T15:41:46.545238+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:59:01.320705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.557502+0000","last_change":"2023-10-08T15:41:46.553070+0000","last_active":"2023-10-08T15:41:46.557502+0000","last_peered":"2023-10-08T15:41:46.557502+0000","last_clean":"2023-10-08T15:41:46.557502+0000","last_became_active":"2023-10-08T15:41:46.552802+0000","last_became_peered":"2023-10-08T15:41:46.552802+0000","last_unstale":"2023-10-08T15:41:46.557502+0000","last_undegraded":"2023-10-08T15:41:46.557502+0000","last_fullsized":"2023-10-08T15:41:46.557502+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:37:34.388882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.564426+0000","last_change":"2023-10-08T15:41:46.563102+0000","last_active":"2023-10-08T15:41:46.564426+0000","last_peered":"2023-10-08T15:41:46.564426+0000","last_clean":"2023-10-08T15:41:46.564426+0000","last_became_active":"2023-10-08T15:41:46.562749+0000","last_became_peered":"2023-10-08T15:41:46.562749+0000","last_unstale":"2023-10-08T15:41:46.564426+0000","last_undegraded":"2023-10-08T15:41:46.564426+0000","last_fullsized":"2023-10-08T15:41:46.564426+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:20:18.458706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.556134+0000","last_change":"2023-10-08T15:41:46.540643+0000","last_active":"2023-10-08T15:41:46.556134+0000","last_peered":"2023-10-08T15:41:46.556134+0000","last_clean":"2023-10-08T15:41:46.556134+0000","last_became_active":"2023-10-08T15:41:46.540380+0000","last_became_peered":"2023-10-08T15:41:46.540380+0000","last_unstale":"2023-10-08T15:41:46.556134+0000","last_undegraded":"2023-10-08T15:41:46.556134+0000","last_fullsized":"2023-10-08T15:41:46.556134+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:21:06.414555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.536583+0000","last_change":"2023-10-08T15:41:46.534834+0000","last_active":"2023-10-08T15:41:46.536583+0000","last_peered":"2023-10-08T15:41:46.536583+0000","last_clean":"2023-10-08T15:41:46.536583+0000","last_became_active":"2023-10-08T15:41:46.534460+0000","last_became_peered":"2023-10-08T15:41:46.534460+0000","last_unstale":"2023-10-08T15:41:46.536583+0000","last_undegraded":"2023-10-08T15:41:46.536583+0000","last_fullsized":"2023-10-08T15:41:46.536583+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:29:41.636403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.561541+0000","last_change":"2023-10-08T15:41:46.559921+0000","last_active":"2023-10-08T15:41:46.561541+0000","last_peered":"2023-10-08T15:41:46.561541+0000","last_clean":"2023-10-08T15:41:46.561541+0000","last_became_active":"2023-10-08T15:41:46.559612+0000","last_became_peered":"2023-10-08T15:41:46.559612+0000","last_unstale":"2023-10-08T15:41:46.561541+0000","last_undegraded":"2023-10-08T15:41:46.561541+0000","last_fullsized":"2023-10-08T15:41:46.561541+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:39:08.813661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.561419+0000","last_change":"2023-10-08T15:41:46.561419+0000","last_active":"2023-10-08T15:41:46.561419+0000","last_peered":"2023-10-08T15:41:46.561419+0000","last_clean":"2023-10-08T15:41:46.561419+0000","last_became_active":"2023-10-08T15:41:46.561112+0000","last_became_peered":"2023-10-08T15:41:46.561112+0000","last_unstale":"2023-10-08T15:41:46.561419+0000","last_undegraded":"2023-10-08T15:41:46.561419+0000","last_fullsized":"2023-10-08T15:41:46.561419+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:05:03.836202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.558762+0000","last_change":"2023-10-08T15:41:46.555617+0000","last_active":"2023-10-08T15:41:46.558762+0000","last_peered":"2023-10-08T15:41:46.558762+0000","last_clean":"2023-10-08T15:41:46.558762+0000","last_became_active":"2023-10-08T15:41:46.555303+0000","last_became_peered":"2023-10-08T15:41:46.555303+0000","last_unstale":"2023-10-08T15:41:46.558762+0000","last_undegraded":"2023-10-08T15:41:46.558762+0000","last_fullsized":"2023-10-08T15:41:46.558762+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:41:43.333820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.564378+0000","last_change":"2023-10-08T15:41:46.562264+0000","last_active":"2023-10-08T15:41:46.564378+0000","last_peered":"2023-10-08T15:41:46.564378+0000","last_clean":"2023-10-08T15:41:46.564378+0000","last_became_active":"2023-10-08T15:41:46.561965+0000","last_became_peered":"2023-10-08T15:41:46.561965+0000","last_unstale":"2023-10-08T15:41:46.564378+0000","last_undegraded":"2023-10-08T15:41:46.564378+0000","last_fullsized":"2023-10-08T15:41:46.564378+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:10:09.285067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.544982+0000","last_change":"2023-10-08T15:41:46.539324+0000","last_active":"2023-10-08T15:41:46.544982+0000","last_peered":"2023-10-08T15:41:46.544982+0000","last_clean":"2023-10-08T15:41:46.544982+0000","last_became_active":"2023-10-08T15:41:46.539009+0000","last_became_peered":"2023-10-08T15:41:46.539009+0000","last_unstale":"2023-10-08T15:41:46.544982+0000","last_undegraded":"2023-10-08T15:41:46.544982+0000","last_fullsized":"2023-10-08T15:41:46.544982+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:27:11.503421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.553676+0000","last_change":"2023-10-08T15:41:46.553676+0000","last_active":"2023-10-08T15:41:46.553676+0000","last_peered":"2023-10-08T15:41:46.553676+0000","last_clean":"2023-10-08T15:41:46.553676+0000","last_became_active":"2023-10-08T15:41:46.553382+0000","last_became_peered":"2023-10-08T15:41:46.553382+0000","last_unstale":"2023-10-08T15:41:46.553676+0000","last_undegraded":"2023-10-08T15:41:46.553676+0000","last_fullsized":"2023-10-08T15:41:46.553676+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:04:01.710191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.557657+0000","last_change":"2023-10-08T15:41:46.557657+0000","last_active":"2023-10-08T15:41:46.557657+0000","last_peered":"2023-10-08T15:41:46.557657+0000","last_clean":"2023-10-08T15:41:46.557657+0000","last_became_active":"2023-10-08T15:41:46.557319+0000","last_became_peered":"2023-10-08T15:41:46.557319+0000","last_unstale":"2023-10-08T15:41:46.557657+0000","last_undegraded":"2023-10-08T15:41:46.557657+0000","last_fullsized":"2023-10-08T15:41:46.557657+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:42:43.045917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.560698+0000","last_change":"2023-10-08T15:41:46.541637+0000","last_active":"2023-10-08T15:41:46.560698+0000","last_peered":"2023-10-08T15:41:46.560698+0000","last_clean":"2023-10-08T15:41:46.560698+0000","last_became_active":"2023-10-08T15:41:46.541248+0000","last_became_peered":"2023-10-08T15:41:46.541248+0000","last_unstale":"2023-10-08T15:41:46.560698+0000","last_undegraded":"2023-10-08T15:41:46.560698+0000","last_fullsized":"2023-10-08T15:41:46.560698+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:21:22.647017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.559337+0000","last_change":"2023-10-08T15:41:46.553420+0000","last_active":"2023-10-08T15:41:46.559337+0000","last_peered":"2023-10-08T15:41:46.559337+0000","last_clean":"2023-10-08T15:41:46.559337+0000","last_became_active":"2023-10-08T15:41:46.553116+0000","last_became_peered":"2023-10-08T15:41:46.553116+0000","last_unstale":"2023-10-08T15:41:46.559337+0000","last_undegraded":"2023-10-08T15:41:46.559337+0000","last_fullsized":"2023-10-08T15:41:46.559337+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:31:56.388623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"58'4","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.556378+0000","last_change":"2023-10-08T15:41:45.539597+0000","last_active":"2023-10-08T15:41:46.556378+0000","last_peered":"2023-10-08T15:41:46.556378+0000","last_clean":"2023-10-08T15:41:46.556378+0000","last_became_active":"2023-10-08T15:41:45.539244+0000","last_became_peered":"2023-10-08T15:41:45.539244+0000","last_unstale":"2023-10-08T15:41:46.556378+0000","last_undegraded":"2023-10-08T15:41:46.556378+0000","last_fullsized":"2023-10-08T15:41:46.556378+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:37:16.854143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.560730+0000","last_change":"2023-10-08T15:41:46.553071+0000","last_active":"2023-10-08T15:41:46.560730+0000","last_peered":"2023-10-08T15:41:46.560730+0000","last_clean":"2023-10-08T15:41:46.560730+0000","last_became_active":"2023-10-08T15:41:46.548745+0000","last_became_peered":"2023-10-08T15:41:46.548745+0000","last_unstale":"2023-10-08T15:41:46.560730+0000","last_undegraded":"2023-10-08T15:41:46.560730+0000","last_fullsized":"2023-10-08T15:41:46.560730+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:44:41.018942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"58'1","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.559442+0000","last_change":"2023-10-08T15:41:45.544750+0000","last_active":"2023-10-08T15:41:46.559442+0000","last_peered":"2023-10-08T15:41:46.559442+0000","last_clean":"2023-10-08T15:41:46.559442+0000","last_became_active":"2023-10-08T15:41:45.544413+0000","last_became_peered":"2023-10-08T15:41:45.544413+0000","last_unstale":"2023-10-08T15:41:46.559442+0000","last_undegraded":"2023-10-08T15:41:46.559442+0000","last_fullsized":"2023-10-08T15:41:46.559442+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:09:34.814052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.553075+0000","last_change":"2023-10-08T15:41:46.534463+0000","last_active":"2023-10-08T15:41:46.553075+0000","last_peered":"2023-10-08T15:41:46.553075+0000","last_clean":"2023-10-08T15:41:46.553075+0000","last_became_active":"2023-10-08T15:41:46.534077+0000","last_became_peered":"2023-10-08T15:41:46.534077+0000","last_unstale":"2023-10-08T15:41:46.553075+0000","last_undegraded":"2023-10-08T15:41:46.553075+0000","last_fullsized":"2023-10-08T15:41:46.553075+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:40:44.627927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"58'2","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.561240+0000","last_change":"2023-10-08T15:41:45.542562+0000","last_active":"2023-10-08T15:41:46.561240+0000","last_peered":"2023-10-08T15:41:46.561240+0000","last_clean":"2023-10-08T15:41:46.561240+0000","last_became_active":"2023-10-08T15:41:45.542333+0000","last_became_peered":"2023-10-08T15:41:45.542333+0000","last_unstale":"2023-10-08T15:41:46.561240+0000","last_undegraded":"2023-10-08T15:41:46.561240+0000","last_fullsized":"2023-10-08T15:41:46.561240+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:21:11.582368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.551652+0000","last_change":"2023-10-08T15:41:46.539448+0000","last_active":"2023-10-08T15:41:46.551652+0000","last_peered":"2023-10-08T15:41:46.551652+0000","last_clean":"2023-10-08T15:41:46.551652+0000","last_became_active":"2023-10-08T15:41:46.539033+0000","last_became_peered":"2023-10-08T15:41:46.539033+0000","last_unstale":"2023-10-08T15:41:46.551652+0000","last_undegraded":"2023-10-08T15:41:46.551652+0000","last_fullsized":"2023-10-08T15:41:46.551652+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:31.685152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"58'2","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.555912+0000","last_change":"2023-10-08T15:41:45.545098+0000","last_active":"2023-10-08T15:41:46.555912+0000","last_peered":"2023-10-08T15:41:46.555912+0000","last_clean":"2023-10-08T15:41:46.555912+0000","last_became_active":"2023-10-08T15:41:45.544269+0000","last_became_peered":"2023-10-08T15:41:45.544269+0000","last_unstale":"2023-10-08T15:41:46.555912+0000","last_undegraded":"2023-10-08T15:41:46.555912+0000","last_fullsized":"2023-10-08T15:41:46.555912+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:58:15.964202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.548820+0000","last_change":"2023-10-08T15:41:46.548820+0000","last_active":"2023-10-08T15:41:46.548820+0000","last_peered":"2023-10-08T15:41:46.548820+0000","last_clean":"2023-10-08T15:41:46.548820+0000","last_became_active":"2023-10-08T15:41:46.548471+0000","last_became_peered":"2023-10-08T15:41:46.548471+0000","last_unstale":"2023-10-08T15:41:46.548820+0000","last_undegraded":"2023-10-08T15:41:46.548820+0000","last_fullsized":"2023-10-08T15:41:46.548820+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:37:34.388882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"58'1","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.546117+0000","last_change":"2023-10-08T15:41:45.536093+0000","last_active":"2023-10-08T15:41:46.546117+0000","last_peered":"2023-10-08T15:41:46.546117+0000","last_clean":"2023-10-08T15:41:46.546117+0000","last_became_active":"2023-10-08T15:41:45.535716+0000","last_became_peered":"2023-10-08T15:41:45.535716+0000","last_unstale":"2023-10-08T15:41:46.546117+0000","last_undegraded":"2023-10-08T15:41:46.546117+0000","last_fullsized":"2023-10-08T15:41:46.546117+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:02:25.950083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.558520+0000","last_change":"2023-10-08T15:41:46.557006+0000","last_active":"2023-10-08T15:41:46.558520+0000","last_peered":"2023-10-08T15:41:46.558520+0000","last_clean":"2023-10-08T15:41:46.558520+0000","last_became_active":"2023-10-08T15:41:46.556709+0000","last_became_peered":"2023-10-08T15:41:46.556709+0000","last_unstale":"2023-10-08T15:41:46.558520+0000","last_undegraded":"2023-10-08T15:41:46.558520+0000","last_fullsized":"2023-10-08T15:41:46.558520+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:09:35.827857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"58'1","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.560850+0000","last_change":"2023-10-08T15:41:45.544999+0000","last_active":"2023-10-08T15:41:46.560850+0000","last_peered":"2023-10-08T15:41:46.560850+0000","last_clean":"2023-10-08T15:41:46.560850+0000","last_became_active":"2023-10-08T15:41:45.544621+0000","last_became_peered":"2023-10-08T15:41:45.544621+0000","last_unstale":"2023-10-08T15:41:46.560850+0000","last_undegraded":"2023-10-08T15:41:46.560850+0000","last_fullsized":"2023-10-08T15:41:46.560850+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:40:11.035901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.560663+0000","last_change":"2023-10-08T15:41:46.553869+0000","last_active":"2023-10-08T15:41:46.560663+0000","last_peered":"2023-10-08T15:41:46.560663+0000","last_clean":"2023-10-08T15:41:46.560663+0000","last_became_active":"2023-10-08T15:41:46.553532+0000","last_became_peered":"2023-10-08T15:41:46.553532+0000","last_unstale":"2023-10-08T15:41:46.560663+0000","last_undegraded":"2023-10-08T15:41:46.560663+0000","last_fullsized":"2023-10-08T15:41:46.560663+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:31:13.382206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.529829+0000","last_change":"2023-10-08T15:41:45.534514+0000","last_active":"2023-10-08T15:41:46.529829+0000","last_peered":"2023-10-08T15:41:46.529829+0000","last_clean":"2023-10-08T15:41:46.529829+0000","last_became_active":"2023-10-08T15:41:45.534095+0000","last_became_peered":"2023-10-08T15:41:45.534095+0000","last_unstale":"2023-10-08T15:41:46.529829+0000","last_undegraded":"2023-10-08T15:41:46.529829+0000","last_fullsized":"2023-10-08T15:41:46.529829+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:38:42.846610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.545259+0000","last_change":"2023-10-08T15:41:46.540825+0000","last_active":"2023-10-08T15:41:46.545259+0000","last_peered":"2023-10-08T15:41:46.545259+0000","last_clean":"2023-10-08T15:41:46.545259+0000","last_became_active":"2023-10-08T15:41:46.540550+0000","last_became_peered":"2023-10-08T15:41:46.540550+0000","last_unstale":"2023-10-08T15:41:46.545259+0000","last_undegraded":"2023-10-08T15:41:46.545259+0000","last_fullsized":"2023-10-08T15:41:46.545259+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:04:01.710191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.521558+0000","last_change":"2023-10-08T15:41:45.544354+0000","last_active":"2023-10-08T15:41:46.521558+0000","last_peered":"2023-10-08T15:41:46.521558+0000","last_clean":"2023-10-08T15:41:46.521558+0000","last_became_active":"2023-10-08T15:41:45.544047+0000","last_became_peered":"2023-10-08T15:41:45.544047+0000","last_unstale":"2023-10-08T15:41:46.521558+0000","last_undegraded":"2023-10-08T15:41:46.521558+0000","last_fullsized":"2023-10-08T15:41:46.521558+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:45:17.598917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.540592+0000","last_change":"2023-10-08T15:41:46.540592+0000","last_active":"2023-10-08T15:41:46.540592+0000","last_peered":"2023-10-08T15:41:46.540592+0000","last_clean":"2023-10-08T15:41:46.540592+0000","last_became_active":"2023-10-08T15:41:46.540252+0000","last_became_peered":"2023-10-08T15:41:46.540252+0000","last_unstale":"2023-10-08T15:41:46.540592+0000","last_undegraded":"2023-10-08T15:41:46.540592+0000","last_fullsized":"2023-10-08T15:41:46.540592+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:55.453944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.547084+0000","last_change":"2023-10-08T15:41:45.532392+0000","last_active":"2023-10-08T15:41:46.547084+0000","last_peered":"2023-10-08T15:41:46.547084+0000","last_clean":"2023-10-08T15:41:46.547084+0000","last_became_active":"2023-10-08T15:41:45.532036+0000","last_became_peered":"2023-10-08T15:41:45.532036+0000","last_unstale":"2023-10-08T15:41:46.547084+0000","last_undegraded":"2023-10-08T15:41:46.547084+0000","last_fullsized":"2023-10-08T15:41:46.547084+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:50:49.335800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.559845+0000","last_change":"2023-10-08T15:41:46.553919+0000","last_active":"2023-10-08T15:41:46.559845+0000","last_peered":"2023-10-08T15:41:46.559845+0000","last_clean":"2023-10-08T15:41:46.559845+0000","last_became_active":"2023-10-08T15:41:46.552993+0000","last_became_peered":"2023-10-08T15:41:46.552993+0000","last_unstale":"2023-10-08T15:41:46.559845+0000","last_undegraded":"2023-10-08T15:41:46.559845+0000","last_fullsized":"2023-10-08T15:41:46.559845+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:38:02.448583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.527633+0000","last_change":"2023-10-08T15:41:45.544474+0000","last_active":"2023-10-08T15:41:46.527633+0000","last_peered":"2023-10-08T15:41:46.527633+0000","last_clean":"2023-10-08T15:41:46.527633+0000","last_became_active":"2023-10-08T15:41:45.541685+0000","last_became_peered":"2023-10-08T15:41:45.541685+0000","last_unstale":"2023-10-08T15:41:46.527633+0000","last_undegraded":"2023-10-08T15:41:46.527633+0000","last_fullsized":"2023-10-08T15:41:46.527633+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:49:59.317001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.564080+0000","last_change":"2023-10-08T15:41:46.554831+0000","last_active":"2023-10-08T15:41:46.564080+0000","last_peered":"2023-10-08T15:41:46.564080+0000","last_clean":"2023-10-08T15:41:46.564080+0000","last_became_active":"2023-10-08T15:41:46.554504+0000","last_became_peered":"2023-10-08T15:41:46.554504+0000","last_unstale":"2023-10-08T15:41:46.564080+0000","last_undegraded":"2023-10-08T15:41:46.564080+0000","last_fullsized":"2023-10-08T15:41:46.564080+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:38:48.207820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"58'3","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.550510+0000","last_change":"2023-10-08T15:41:45.540332+0000","last_active":"2023-10-08T15:41:46.550510+0000","last_peered":"2023-10-08T15:41:46.550510+0000","last_clean":"2023-10-08T15:41:46.550510+0000","last_became_active":"2023-10-08T15:41:45.540055+0000","last_became_peered":"2023-10-08T15:41:45.540055+0000","last_unstale":"2023-10-08T15:41:46.550510+0000","last_undegraded":"2023-10-08T15:41:46.550510+0000","last_fullsized":"2023-10-08T15:41:46.550510+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:59:00.306900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.555333+0000","last_change":"2023-10-08T15:41:46.546441+0000","last_active":"2023-10-08T15:41:46.555333+0000","last_peered":"2023-10-08T15:41:46.555333+0000","last_clean":"2023-10-08T15:41:46.555333+0000","last_became_active":"2023-10-08T15:41:46.546044+0000","last_became_peered":"2023-10-08T15:41:46.546044+0000","last_unstale":"2023-10-08T15:41:46.555333+0000","last_undegraded":"2023-10-08T15:41:46.555333+0000","last_fullsized":"2023-10-08T15:41:46.555333+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:06:27.535971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"58'6","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.566534+0000","last_change":"2023-10-08T15:41:45.536005+0000","last_active":"2023-10-08T15:41:46.566534+0000","last_peered":"2023-10-08T15:41:46.566534+0000","last_clean":"2023-10-08T15:41:46.566534+0000","last_became_active":"2023-10-08T15:41:45.534635+0000","last_became_peered":"2023-10-08T15:41:45.534635+0000","last_unstale":"2023-10-08T15:41:46.566534+0000","last_undegraded":"2023-10-08T15:41:46.566534+0000","last_fullsized":"2023-10-08T15:41:46.566534+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:26.333859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.560132+0000","last_change":"2023-10-08T15:41:46.556184+0000","last_active":"2023-10-08T15:41:46.560132+0000","last_peered":"2023-10-08T15:41:46.560132+0000","last_clean":"2023-10-08T15:41:46.560132+0000","last_became_active":"2023-10-08T15:41:46.555856+0000","last_became_peered":"2023-10-08T15:41:46.555856+0000","last_unstale":"2023-10-08T15:41:46.560132+0000","last_undegraded":"2023-10-08T15:41:46.560132+0000","last_fullsized":"2023-10-08T15:41:46.560132+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:40:59.740874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"58'2","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.554845+0000","last_change":"2023-10-08T15:41:45.528769+0000","last_active":"2023-10-08T15:41:46.554845+0000","last_peered":"2023-10-08T15:41:46.554845+0000","last_clean":"2023-10-08T15:41:46.554845+0000","last_became_active":"2023-10-08T15:41:45.528029+0000","last_became_peered":"2023-10-08T15:41:45.528029+0000","last_unstale":"2023-10-08T15:41:46.554845+0000","last_undegraded":"2023-10-08T15:41:46.554845+0000","last_fullsized":"2023-10-08T15:41:46.554845+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:18:38.886296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.554151+0000","last_change":"2023-10-08T15:41:46.554151+0000","last_active":"2023-10-08T15:41:46.554151+0000","last_peered":"2023-10-08T15:41:46.554151+0000","last_clean":"2023-10-08T15:41:46.554151+0000","last_became_active":"2023-10-08T15:41:46.553875+0000","last_became_peered":"2023-10-08T15:41:46.553875+0000","last_unstale":"2023-10-08T15:41:46.554151+0000","last_undegraded":"2023-10-08T15:41:46.554151+0000","last_fullsized":"2023-10-08T15:41:46.554151+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:24:58.644419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.526724+0000","last_change":"2023-10-08T15:41:45.547840+0000","last_active":"2023-10-08T15:41:46.526724+0000","last_peered":"2023-10-08T15:41:46.526724+0000","last_clean":"2023-10-08T15:41:46.526724+0000","last_became_active":"2023-10-08T15:41:45.547462+0000","last_became_peered":"2023-10-08T15:41:45.547462+0000","last_unstale":"2023-10-08T15:41:46.526724+0000","last_undegraded":"2023-10-08T15:41:46.526724+0000","last_fullsized":"2023-10-08T15:41:46.526724+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:19:17.815587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.562112+0000","last_change":"2023-10-08T15:41:46.560048+0000","last_active":"2023-10-08T15:41:46.562112+0000","last_peered":"2023-10-08T15:41:46.562112+0000","last_clean":"2023-10-08T15:41:46.562112+0000","last_became_active":"2023-10-08T15:41:46.559660+0000","last_became_peered":"2023-10-08T15:41:46.559660+0000","last_unstale":"2023-10-08T15:41:46.562112+0000","last_undegraded":"2023-10-08T15:41:46.562112+0000","last_fullsized":"2023-10-08T15:41:46.562112+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:49:48.086007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-08T15:41:45.543791+0000","last_change":"2023-10-08T15:41:45.542464+0000","last_active":"2023-10-08T15:41:45.543791+0000","last_peered":"2023-10-08T15:41:45.543791+0000","last_clean":"2023-10-08T15:41:45.543791+0000","last_became_active":"2023-10-08T15:41:45.542173+0000","last_became_peered":"2023-10-08T15:41:45.542173+0000","last_unstale":"2023-10-08T15:41:45.543791+0000","last_undegraded":"2023-10-08T15:41:45.543791+0000","last_fullsized":"2023-10-08T15:41:45.543791+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:50:49.335800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.560764+0000","last_change":"2023-10-08T15:41:46.549202+0000","last_active":"2023-10-08T15:41:46.560764+0000","last_peered":"2023-10-08T15:41:46.560764+0000","last_clean":"2023-10-08T15:41:46.560764+0000","last_became_active":"2023-10-08T15:41:46.548865+0000","last_became_peered":"2023-10-08T15:41:46.548865+0000","last_unstale":"2023-10-08T15:41:46.560764+0000","last_undegraded":"2023-10-08T15:41:46.560764+0000","last_fullsized":"2023-10-08T15:41:46.560764+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:36:18.441042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"58'8","reported_seq":18,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.560564+0000","last_change":"2023-10-08T15:41:45.532750+0000","last_active":"2023-10-08T15:41:46.560564+0000","last_peered":"2023-10-08T15:41:46.560564+0000","last_clean":"2023-10-08T15:41:46.560564+0000","last_became_active":"2023-10-08T15:41:45.532482+0000","last_became_peered":"2023-10-08T15:41:45.532482+0000","last_unstale":"2023-10-08T15:41:46.560564+0000","last_undegraded":"2023-10-08T15:41:46.560564+0000","last_fullsized":"2023-10-08T15:41:46.560564+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:55:13.132023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.555415+0000","last_change":"2023-10-08T15:41:46.549843+0000","last_active":"2023-10-08T15:41:46.555415+0000","last_peered":"2023-10-08T15:41:46.555415+0000","last_clean":"2023-10-08T15:41:46.555415+0000","last_became_active":"2023-10-08T15:41:46.549574+0000","last_became_peered":"2023-10-08T15:41:46.549574+0000","last_unstale":"2023-10-08T15:41:46.555415+0000","last_undegraded":"2023-10-08T15:41:46.555415+0000","last_fullsized":"2023-10-08T15:41:46.555415+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:42:43.045917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"58'1","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.553015+0000","last_change":"2023-10-08T15:41:45.541631+0000","last_active":"2023-10-08T15:41:46.553015+0000","last_peered":"2023-10-08T15:41:46.553015+0000","last_clean":"2023-10-08T15:41:46.553015+0000","last_became_active":"2023-10-08T15:41:45.541298+0000","last_became_peered":"2023-10-08T15:41:45.541298+0000","last_unstale":"2023-10-08T15:41:46.553015+0000","last_undegraded":"2023-10-08T15:41:46.553015+0000","last_fullsized":"2023-10-08T15:41:46.553015+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:38:42.846610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.537768+0000","last_change":"2023-10-08T15:41:46.535721+0000","last_active":"2023-10-08T15:41:46.537768+0000","last_peered":"2023-10-08T15:41:46.537768+0000","last_clean":"2023-10-08T15:41:46.537768+0000","last_became_active":"2023-10-08T15:41:46.535403+0000","last_became_peered":"2023-10-08T15:41:46.535403+0000","last_unstale":"2023-10-08T15:41:46.537768+0000","last_undegraded":"2023-10-08T15:41:46.537768+0000","last_fullsized":"2023-10-08T15:41:46.537768+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:39:25.192019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"58'2","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.561273+0000","last_change":"2023-10-08T15:41:45.541422+0000","last_active":"2023-10-08T15:41:46.561273+0000","last_peered":"2023-10-08T15:41:46.561273+0000","last_clean":"2023-10-08T15:41:46.561273+0000","last_became_active":"2023-10-08T15:41:45.541106+0000","last_became_peered":"2023-10-08T15:41:45.541106+0000","last_unstale":"2023-10-08T15:41:46.561273+0000","last_undegraded":"2023-10-08T15:41:46.561273+0000","last_fullsized":"2023-10-08T15:41:46.561273+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:16:55.171303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.558052+0000","last_change":"2023-10-08T15:41:46.556158+0000","last_active":"2023-10-08T15:41:46.558052+0000","last_peered":"2023-10-08T15:41:46.558052+0000","last_clean":"2023-10-08T15:41:46.558052+0000","last_became_active":"2023-10-08T15:41:46.555790+0000","last_became_peered":"2023-10-08T15:41:46.555790+0000","last_unstale":"2023-10-08T15:41:46.558052+0000","last_undegraded":"2023-10-08T15:41:46.558052+0000","last_fullsized":"2023-10-08T15:41:46.558052+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:51:16.745793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"58'1","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.553644+0000","last_change":"2023-10-08T15:41:45.541001+0000","last_active":"2023-10-08T15:41:46.553644+0000","last_peered":"2023-10-08T15:41:46.553644+0000","last_clean":"2023-10-08T15:41:46.553644+0000","last_became_active":"2023-10-08T15:41:45.540531+0000","last_became_peered":"2023-10-08T15:41:45.540531+0000","last_unstale":"2023-10-08T15:41:46.553644+0000","last_undegraded":"2023-10-08T15:41:46.553644+0000","last_fullsized":"2023-10-08T15:41:46.553644+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:46:59.067157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.560937+0000","last_change":"2023-10-08T15:41:46.553056+0000","last_active":"2023-10-08T15:41:46.560937+0000","last_peered":"2023-10-08T15:41:46.560937+0000","last_clean":"2023-10-08T15:41:46.560937+0000","last_became_active":"2023-10-08T15:41:46.549094+0000","last_became_peered":"2023-10-08T15:41:46.549094+0000","last_unstale":"2023-10-08T15:41:46.560937+0000","last_undegraded":"2023-10-08T15:41:46.560937+0000","last_fullsized":"2023-10-08T15:41:46.560937+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:32:08.063389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.526292+0000","last_change":"2023-10-08T15:41:45.533870+0000","last_active":"2023-10-08T15:41:46.526292+0000","last_peered":"2023-10-08T15:41:46.526292+0000","last_clean":"2023-10-08T15:41:46.526292+0000","last_became_active":"2023-10-08T15:41:45.533535+0000","last_became_peered":"2023-10-08T15:41:45.533535+0000","last_unstale":"2023-10-08T15:41:46.526292+0000","last_undegraded":"2023-10-08T15:41:46.526292+0000","last_fullsized":"2023-10-08T15:41:46.526292+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:16:44.684647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.550352+0000","last_change":"2023-10-08T15:41:46.542899+0000","last_active":"2023-10-08T15:41:46.550352+0000","last_peered":"2023-10-08T15:41:46.550352+0000","last_clean":"2023-10-08T15:41:46.550352+0000","last_became_active":"2023-10-08T15:41:46.542547+0000","last_became_peered":"2023-10-08T15:41:46.542547+0000","last_unstale":"2023-10-08T15:41:46.550352+0000","last_undegraded":"2023-10-08T15:41:46.550352+0000","last_fullsized":"2023-10-08T15:41:46.550352+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:44:20.020250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.526995+0000","last_change":"2023-10-08T15:41:45.545770+0000","last_active":"2023-10-08T15:41:46.526995+0000","last_peered":"2023-10-08T15:41:46.526995+0000","last_clean":"2023-10-08T15:41:46.526995+0000","last_became_active":"2023-10-08T15:41:45.545488+0000","last_became_peered":"2023-10-08T15:41:45.545488+0000","last_unstale":"2023-10-08T15:41:46.526995+0000","last_undegraded":"2023-10-08T15:41:46.526995+0000","last_fullsized":"2023-10-08T15:41:46.526995+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:25:13.996333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.561725+0000","last_change":"2023-10-08T15:41:46.560668+0000","last_active":"2023-10-08T15:41:46.561725+0000","last_peered":"2023-10-08T15:41:46.561725+0000","last_clean":"2023-10-08T15:41:46.561725+0000","last_became_active":"2023-10-08T15:41:46.560395+0000","last_became_peered":"2023-10-08T15:41:46.560395+0000","last_unstale":"2023-10-08T15:41:46.561725+0000","last_undegraded":"2023-10-08T15:41:46.561725+0000","last_fullsized":"2023-10-08T15:41:46.561725+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:25:37.509193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-08T15:41:45.538357+0000","last_change":"2023-10-08T15:41:45.535667+0000","last_active":"2023-10-08T15:41:45.538357+0000","last_peered":"2023-10-08T15:41:45.538357+0000","last_clean":"2023-10-08T15:41:45.538357+0000","last_became_active":"2023-10-08T15:41:45.534993+0000","last_became_peered":"2023-10-08T15:41:45.534993+0000","last_unstale":"2023-10-08T15:41:45.538357+0000","last_undegraded":"2023-10-08T15:41:45.538357+0000","last_fullsized":"2023-10-08T15:41:45.538357+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:28:35.111098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.561772+0000","last_change":"2023-10-08T15:41:46.560107+0000","last_active":"2023-10-08T15:41:46.561772+0000","last_peered":"2023-10-08T15:41:46.561772+0000","last_clean":"2023-10-08T15:41:46.561772+0000","last_became_active":"2023-10-08T15:41:46.559816+0000","last_became_peered":"2023-10-08T15:41:46.559816+0000","last_unstale":"2023-10-08T15:41:46.561772+0000","last_undegraded":"2023-10-08T15:41:46.561772+0000","last_fullsized":"2023-10-08T15:41:46.561772+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:36:45.614443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.535481+0000","last_change":"2023-10-08T15:41:45.544986+0000","last_active":"2023-10-08T15:41:46.535481+0000","last_peered":"2023-10-08T15:41:46.535481+0000","last_clean":"2023-10-08T15:41:46.535481+0000","last_became_active":"2023-10-08T15:41:45.544683+0000","last_became_peered":"2023-10-08T15:41:45.544683+0000","last_unstale":"2023-10-08T15:41:46.535481+0000","last_undegraded":"2023-10-08T15:41:46.535481+0000","last_fullsized":"2023-10-08T15:41:46.535481+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:39:07.799856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.563591+0000","last_change":"2023-10-08T15:41:46.560251+0000","last_active":"2023-10-08T15:41:46.563591+0000","last_peered":"2023-10-08T15:41:46.563591+0000","last_clean":"2023-10-08T15:41:46.563591+0000","last_became_active":"2023-10-08T15:41:46.559945+0000","last_became_peered":"2023-10-08T15:41:46.559945+0000","last_unstale":"2023-10-08T15:41:46.563591+0000","last_undegraded":"2023-10-08T15:41:46.563591+0000","last_fullsized":"2023-10-08T15:41:46.563591+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:37:23.844694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"58'2","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.560587+0000","last_change":"2023-10-08T15:41:45.541122+0000","last_active":"2023-10-08T15:41:46.560587+0000","last_peered":"2023-10-08T15:41:46.560587+0000","last_clean":"2023-10-08T15:41:46.560587+0000","last_became_active":"2023-10-08T15:41:45.540758+0000","last_became_peered":"2023-10-08T15:41:45.540758+0000","last_unstale":"2023-10-08T15:41:46.560587+0000","last_undegraded":"2023-10-08T15:41:46.560587+0000","last_fullsized":"2023-10-08T15:41:46.560587+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:18:38.886296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.546072+0000","last_change":"2023-10-08T15:41:46.546072+0000","last_active":"2023-10-08T15:41:46.546072+0000","last_peered":"2023-10-08T15:41:46.546072+0000","last_clean":"2023-10-08T15:41:46.546072+0000","last_became_active":"2023-10-08T15:41:46.544719+0000","last_became_peered":"2023-10-08T15:41:46.544719+0000","last_unstale":"2023-10-08T15:41:46.546072+0000","last_undegraded":"2023-10-08T15:41:46.546072+0000","last_fullsized":"2023-10-08T15:41:46.546072+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:10:09.285067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-08T15:41:45.543807+0000","last_change":"2023-10-08T15:41:45.542636+0000","last_active":"2023-10-08T15:41:45.543807+0000","last_peered":"2023-10-08T15:41:45.543807+0000","last_clean":"2023-10-08T15:41:45.543807+0000","last_became_active":"2023-10-08T15:41:45.542351+0000","last_became_peered":"2023-10-08T15:41:45.542351+0000","last_unstale":"2023-10-08T15:41:45.543807+0000","last_undegraded":"2023-10-08T15:41:45.543807+0000","last_fullsized":"2023-10-08T15:41:45.543807+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:16:55.171303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.559722+0000","last_change":"2023-10-08T15:41:46.554088+0000","last_active":"2023-10-08T15:41:46.559722+0000","last_peered":"2023-10-08T15:41:46.559722+0000","last_clean":"2023-10-08T15:41:46.559722+0000","last_became_active":"2023-10-08T15:41:46.553813+0000","last_became_peered":"2023-10-08T15:41:46.553813+0000","last_unstale":"2023-10-08T15:41:46.559722+0000","last_undegraded":"2023-10-08T15:41:46.559722+0000","last_fullsized":"2023-10-08T15:41:46.559722+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:29:41.497855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.523052+0000","last_change":"2023-10-08T15:41:45.537006+0000","last_active":"2023-10-08T15:41:46.523052+0000","last_peered":"2023-10-08T15:41:46.523052+0000","last_clean":"2023-10-08T15:41:46.523052+0000","last_became_active":"2023-10-08T15:41:45.536721+0000","last_became_peered":"2023-10-08T15:41:45.536721+0000","last_unstale":"2023-10-08T15:41:46.523052+0000","last_undegraded":"2023-10-08T15:41:46.523052+0000","last_fullsized":"2023-10-08T15:41:46.523052+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:06:29.806953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.556343+0000","last_change":"2023-10-08T15:41:46.541119+0000","last_active":"2023-10-08T15:41:46.556343+0000","last_peered":"2023-10-08T15:41:46.556343+0000","last_clean":"2023-10-08T15:41:46.556343+0000","last_became_active":"2023-10-08T15:41:46.540298+0000","last_became_peered":"2023-10-08T15:41:46.540298+0000","last_unstale":"2023-10-08T15:41:46.556343+0000","last_undegraded":"2023-10-08T15:41:46.556343+0000","last_fullsized":"2023-10-08T15:41:46.556343+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:08:39.068985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.535078+0000","last_change":"2023-10-08T15:41:45.540492+0000","last_active":"2023-10-08T15:41:46.535078+0000","last_peered":"2023-10-08T15:41:46.535078+0000","last_clean":"2023-10-08T15:41:46.535078+0000","last_became_active":"2023-10-08T15:41:45.539875+0000","last_became_peered":"2023-10-08T15:41:45.539875+0000","last_unstale":"2023-10-08T15:41:46.535078+0000","last_undegraded":"2023-10-08T15:41:46.535078+0000","last_fullsized":"2023-10-08T15:41:46.535078+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:42:13.770273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.560638+0000","last_change":"2023-10-08T15:41:46.553820+0000","last_active":"2023-10-08T15:41:46.560638+0000","last_peered":"2023-10-08T15:41:46.560638+0000","last_clean":"2023-10-08T15:41:46.560638+0000","last_became_active":"2023-10-08T15:41:46.548992+0000","last_became_peered":"2023-10-08T15:41:46.548992+0000","last_unstale":"2023-10-08T15:41:46.560638+0000","last_undegraded":"2023-10-08T15:41:46.560638+0000","last_fullsized":"2023-10-08T15:41:46.560638+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:37:03.757401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.522519+0000","last_change":"2023-10-08T15:41:45.538345+0000","last_active":"2023-10-08T15:41:46.522519+0000","last_peered":"2023-10-08T15:41:46.522519+0000","last_clean":"2023-10-08T15:41:46.522519+0000","last_became_active":"2023-10-08T15:41:45.538043+0000","last_became_peered":"2023-10-08T15:41:45.538043+0000","last_unstale":"2023-10-08T15:41:46.522519+0000","last_undegraded":"2023-10-08T15:41:46.522519+0000","last_fullsized":"2023-10-08T15:41:46.522519+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:23:39.557985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.555018+0000","last_change":"2023-10-08T15:41:46.537244+0000","last_active":"2023-10-08T15:41:46.555018+0000","last_peered":"2023-10-08T15:41:46.555018+0000","last_clean":"2023-10-08T15:41:46.555018+0000","last_became_active":"2023-10-08T15:41:46.535257+0000","last_became_peered":"2023-10-08T15:41:46.535257+0000","last_unstale":"2023-10-08T15:41:46.555018+0000","last_undegraded":"2023-10-08T15:41:46.555018+0000","last_fullsized":"2023-10-08T15:41:46.555018+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:14:06.171960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.529858+0000","last_change":"2023-10-08T15:41:45.534401+0000","last_active":"2023-10-08T15:41:46.529858+0000","last_peered":"2023-10-08T15:41:46.529858+0000","last_clean":"2023-10-08T15:41:46.529858+0000","last_became_active":"2023-10-08T15:41:45.534014+0000","last_became_peered":"2023-10-08T15:41:45.534014+0000","last_unstale":"2023-10-08T15:41:46.529858+0000","last_undegraded":"2023-10-08T15:41:46.529858+0000","last_fullsized":"2023-10-08T15:41:46.529858+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:19:17.815587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.550178+0000","last_change":"2023-10-08T15:41:46.546268+0000","last_active":"2023-10-08T15:41:46.550178+0000","last_peered":"2023-10-08T15:41:46.550178+0000","last_clean":"2023-10-08T15:41:46.550178+0000","last_became_active":"2023-10-08T15:41:46.546000+0000","last_became_peered":"2023-10-08T15:41:46.546000+0000","last_unstale":"2023-10-08T15:41:46.550178+0000","last_undegraded":"2023-10-08T15:41:46.550178+0000","last_fullsized":"2023-10-08T15:41:46.550178+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:00:55.449673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.545678+0000","last_change":"2023-10-08T15:41:45.532418+0000","last_active":"2023-10-08T15:41:46.545678+0000","last_peered":"2023-10-08T15:41:46.545678+0000","last_clean":"2023-10-08T15:41:46.545678+0000","last_became_active":"2023-10-08T15:41:45.532078+0000","last_became_peered":"2023-10-08T15:41:45.532078+0000","last_unstale":"2023-10-08T15:41:46.545678+0000","last_undegraded":"2023-10-08T15:41:46.545678+0000","last_fullsized":"2023-10-08T15:41:46.545678+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:23:30.867873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.560762+0000","last_change":"2023-10-08T15:41:46.541984+0000","last_active":"2023-10-08T15:41:46.560762+0000","last_peered":"2023-10-08T15:41:46.560762+0000","last_clean":"2023-10-08T15:41:46.560762+0000","last_became_active":"2023-10-08T15:41:46.541670+0000","last_became_peered":"2023-10-08T15:41:46.541670+0000","last_unstale":"2023-10-08T15:41:46.560762+0000","last_undegraded":"2023-10-08T15:41:46.560762+0000","last_fullsized":"2023-10-08T15:41:46.560762+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:24.687891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.527707+0000","last_change":"2023-10-08T15:41:45.544884+0000","last_active":"2023-10-08T15:41:46.527707+0000","last_peered":"2023-10-08T15:41:46.527707+0000","last_clean":"2023-10-08T15:41:46.527707+0000","last_became_active":"2023-10-08T15:41:45.544440+0000","last_became_peered":"2023-10-08T15:41:45.544440+0000","last_unstale":"2023-10-08T15:41:46.527707+0000","last_undegraded":"2023-10-08T15:41:46.527707+0000","last_fullsized":"2023-10-08T15:41:46.527707+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:44:02.052652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.561685+0000","last_change":"2023-10-08T15:41:46.560090+0000","last_active":"2023-10-08T15:41:46.561685+0000","last_peered":"2023-10-08T15:41:46.561685+0000","last_clean":"2023-10-08T15:41:46.561685+0000","last_became_active":"2023-10-08T15:41:46.559779+0000","last_became_peered":"2023-10-08T15:41:46.559779+0000","last_unstale":"2023-10-08T15:41:46.561685+0000","last_undegraded":"2023-10-08T15:41:46.561685+0000","last_fullsized":"2023-10-08T15:41:46.561685+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:45.500091+0000","last_clean_scrub_stamp":"2023-10-08T15:41:45.500091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:32:57.690304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"58'2","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.560770+0000","last_change":"2023-10-08T15:41:45.544718+0000","last_active":"2023-10-08T15:41:46.560770+0000","last_peered":"2023-10-08T15:41:46.560770+0000","last_clean":"2023-10-08T15:41:46.560770+0000","last_became_active":"2023-10-08T15:41:45.544219+0000","last_became_peered":"2023-10-08T15:41:45.544219+0000","last_unstale":"2023-10-08T15:41:46.560770+0000","last_undegraded":"2023-10-08T15:41:46.560770+0000","last_fullsized":"2023-10-08T15:41:46.560770+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:44.486286+0000","last_clean_scrub_stamp":"2023-10-08T15:41:44.486286+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:50:32.179768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":202,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-08T15:41:46.526553+0000","last_change":"2023-10-08T15:37:19.380955+0000","last_active":"2023-10-08T15:41:46.526553+0000","last_peered":"2023-10-08T15:41:46.526553+0000","last_clean":"2023-10-08T15:41:46.526553+0000","last_became_active":"2023-10-08T15:37:19.378277+0000","last_became_peered":"2023-10-08T15:37:19.378277+0000","last_unstale":"2023-10-08T15:41:46.526553+0000","last_undegraded":"2023-10-08T15:41:46.526553+0000","last_fullsized":"2023-10-08T15:41:46.526553+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:17.537726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:17.537726+0000","last_clean_scrub_stamp":"2023-10-08T15:37:17.537726+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:06:26.612046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66282,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542200,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306248,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065592,"statfs":{"total":96636764160,"available":96323166208,"internally_reserved":0,"allocated":786432,"data_stored":887853,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:41:27 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.92000000000000004,"15min":0.95199999999999996},"min":{"1min":0.57099999999999995,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.92400000000000004,"15min":0.92900000000000005},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.3600000000000001,"5min":1.758,"15min":1.758},"last":1.1499999999999999}]},{"osd":1,"last update":"Sun Oct 8 15:41:27 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.88200000000000001,"15min":0.88600000000000001},"min":{"1min":0.46600000000000003,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.1930000000000001,"5min":1.474,"15min":1.474},"last":1.034},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.94299999999999995,"15min":0.95499999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.2849999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.2010000000000001}]},{"osd":2,"last update":"Sun Oct 8 15:41:27 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.97099999999999997,"15min":1.016},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.381,"5min":1.623,"15min":1.623},"last":1.099},{"interface":"front","average":{"1min":1.038,"5min":1.0029999999999999,"15min":1.0069999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.93000000000000005}]},{"osd":3,"last update":"Sun Oct 8 15:41:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.012,"15min":0.98199999999999998},"min":{"1min":0.91900000000000004,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.8260000000000001,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.226},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.998,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.8129999999999999,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":1.3069999999999999}]},{"osd":4,"last update":"Sun Oct 8 15:41:27 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.0389999999999999,"15min":1.077},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":1.331},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0760000000000001,"15min":1.0940000000000001},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.393,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.4179999999999999}]},{"osd":5,"last update":"Sun Oct 8 15:41:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1799999999999999,"15min":1.248},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.6359999999999999,"5min":1.792,"15min":1.792},"last":1.454},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.2130000000000001,"15min":1.2410000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":1.532}]},{"osd":6,"last update":"Sun Oct 8 15:41:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.272,"15min":1.3080000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.6879999999999999,"5min":1.839,"15min":1.839},"last":1.7010000000000001},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.1950000000000001,"15min":1.2410000000000001},"min":{"1min":0.79900000000000004,"5min":0.627,"15min":0.627},"max":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":1.609}]}]},{"osd":6,"up_from":14,"seq":60129542201,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306184,"kb_used_data":704,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065656,"statfs":{"total":96636764160,"available":96323231744,"internally_reserved":0,"allocated":720896,"data_stored":296989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88600000000000001,"15min":0.83799999999999997},"min":{"1min":0.60199999999999998,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.3200000000000001,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":1.024},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98599999999999999,"15min":0.998},"min":{"1min":0.63500000000000001,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.3400000000000001,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":0.90400000000000003}]},{"osd":1,"last update":"Sun Oct 8 15:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96299999999999997,"15min":0.96099999999999997},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.98599999999999999,"15min":0.98999999999999999},"min":{"1min":0.60299999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.4179999999999999,"5min":1.853,"15min":1.853},"last":0.99199999999999999}]},{"osd":2,"last update":"Sun Oct 8 15:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.88700000000000001,"15min":0.85599999999999998},"min":{"1min":0.70199999999999996,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.347,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.0640000000000001,"15min":1.0760000000000001},"min":{"1min":0.58499999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.3740000000000001,"5min":1.518,"15min":1.518},"last":0.77000000000000002}]},{"osd":3,"last update":"Sun Oct 8 15:41:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.048,"15min":1.03},"min":{"1min":0.81100000000000005,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.421,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.95299999999999996,"5min":1.046,"15min":1.073},"min":{"1min":0.78900000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.2010000000000001,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":0.81299999999999994}]},{"osd":4,"last update":"Sun Oct 8 15:41:26 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.103,"15min":1.1180000000000001},"min":{"1min":0.71299999999999997,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.3959999999999999,"5min":1.7,"15min":1.7},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.161,"15min":1.1850000000000001},"min":{"1min":0.89700000000000002,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.343,"5min":1.623,"15min":1.623},"last":1.103}]},{"osd":5,"last update":"Sun Oct 8 15:41:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0900000000000001,"15min":1.1160000000000001},"min":{"1min":0.86299999999999999,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.325,"5min":1.581,"15min":1.581},"last":1.139},{"interface":"front","average":{"1min":1.21,"5min":1.2669999999999999,"15min":1.3029999999999999},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.458,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":1.2}]},{"osd":7,"last update":"Sun Oct 8 15:41:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.2709999999999999,"15min":1.2849999999999999},"min":{"1min":1.0860000000000001,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":1.665,"5min":1.74,"15min":1.74},"last":1.232},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.26,"15min":1.2989999999999999},"min":{"1min":0.96899999999999997,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":1.522,"5min":2.5630000000000002,"15min":2.5630000000000002},"last":1.262}]}]},{"osd":3,"up_from":14,"seq":60129542202,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310280,"kb_used_data":704,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061560,"statfs":{"total":96636764160,"available":96319037440,"internally_reserved":0,"allocated":720896,"data_stored":297009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69599999999999995,"15min":0.71499999999999997},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0369999999999999,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.77000000000000002,"15min":0.76300000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.143,"5min":1.179,"15min":1.179},"last":0.73399999999999999}]},{"osd":1,"last update":"Sun Oct 8 15:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.73299999999999998,"15min":0.71699999999999997},"min":{"1min":0.42499999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":1.052},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.84099999999999997,"15min":0.81799999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.155,"5min":1.353,"15min":1.353},"last":0.89200000000000002}]},{"osd":2,"last update":"Sun Oct 8 15:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.85399999999999998,"15min":0.85199999999999998},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.1870000000000001,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.92200000000000004,"15min":0.92600000000000005},"min":{"1min":0.56599999999999995,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.325,"5min":1.423,"15min":1.423},"last":0.94299999999999995}]},{"osd":4,"last update":"Sun Oct 8 15:41:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.079,"15min":1.0669999999999999},"min":{"1min":0.77300000000000002,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.583,"5min":1.585,"15min":1.585},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.101,"15min":1.141},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.3959999999999999,"5min":2.762,"15min":2.762},"last":1.2629999999999999}]},{"osd":5,"last update":"Sun Oct 8 15:41:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.139,"15min":1.1519999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.5409999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":1.147,"5min":1.2030000000000001,"15min":1.2250000000000001},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.508,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":1.093}]},{"osd":6,"last update":"Sun Oct 8 15:41:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.2529999999999999,"15min":1.292},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.583,"5min":2.6890000000000001,"15min":2.6890000000000001},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.218,"15min":1.22},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":1.6539999999999999,"5min":1.742,"15min":1.742},"last":1.0149999999999999}]},{"osd":7,"last update":"Sun Oct 8 15:41:25 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.26,"15min":1.2569999999999999},"min":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"max":{"1min":1.51,"5min":1.738,"15min":1.738},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.236,"5min":1.3129999999999999,"15min":1.349},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.6000000000000001,"5min":2.5840000000000001,"15min":2.5840000000000001},"last":1.4530000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542201,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306188,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065652,"statfs":{"total":96636764160,"available":96323227648,"internally_reserved":0,"allocated":724992,"data_stored":298433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.64700000000000002,"15min":0.628},"min":{"1min":0.499,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.72499999999999998,"15min":0.66700000000000004},"min":{"1min":0.47099999999999997,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.105,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.78000000000000003}]},{"osd":1,"last update":"Sun Oct 8 15:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.72199999999999998,"15min":0.68700000000000006},"min":{"1min":0.56299999999999994,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0860000000000001,"5min":1.236,"15min":1.236},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.77900000000000003,"15min":0.71299999999999997},"min":{"1min":0.502,"5min":0.307,"15min":0.307},"max":{"1min":1.226,"5min":1.399,"15min":1.399},"last":0.88600000000000001}]},{"osd":3,"last update":"Sun Oct 8 15:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.72099999999999997,"15min":0.66100000000000003},"min":{"1min":0.53100000000000003,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.85099999999999998},"min":{"1min":0.621,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.60999999999999999}]},{"osd":4,"last update":"Sun Oct 8 15:41:32 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.014,"15min":1.0029999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.329,"5min":1.371,"15min":1.371},"last":0.70899999999999996},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0369999999999999,"15min":1.0349999999999999},"min":{"1min":0.71799999999999997,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.544,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.2210000000000001}]},{"osd":5,"last update":"Sun Oct 8 15:41:32 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.056,"15min":1.056},"min":{"1min":0.75700000000000001,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.351,"5min":1.462,"15min":1.462},"last":0.73399999999999999},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0780000000000001,"15min":1.0640000000000001},"min":{"1min":0.77000000000000002,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.3919999999999999,"5min":1.452,"15min":1.452},"last":1.022}]},{"osd":6,"last update":"Sun Oct 8 15:41:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.133,"15min":1.1040000000000001},"min":{"1min":0.83799999999999997,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.137,"5min":1.141,"15min":1.113},"min":{"1min":0.74199999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":0.81699999999999995}]},{"osd":7,"last update":"Sun Oct 8 15:41:32 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.2110000000000001,"15min":1.167},"min":{"1min":0.85299999999999998,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.6419999999999999,"5min":1.72,"15min":1.72},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.153,"5min":1.1910000000000001,"15min":1.167},"min":{"1min":0.77800000000000002,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.647,"5min":1.804,"15min":1.804},"last":0.86199999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542202,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306196,"kb_used_data":716,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065644,"statfs":{"total":96636764160,"available":96323219456,"internally_reserved":0,"allocated":733184,"data_stored":299021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:41:23 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.73799999999999999,"15min":0.76600000000000001},"min":{"1min":0.44700000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.1739999999999999,"5min":1.734,"15min":1.734},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.85499999999999998,"15min":0.96399999999999997},"min":{"1min":0.502,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.077,"5min":5.7960000000000003,"15min":5.7960000000000003},"last":0.63300000000000001}]},{"osd":2,"last update":"Sun Oct 8 15:41:23 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.77300000000000002,"15min":0.82699999999999996},"min":{"1min":0.46999999999999997,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.95099999999999996,"5min":4.0119999999999996,"15min":4.0119999999999996},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88800000000000001,"15min":0.90400000000000003},"min":{"1min":0.60399999999999998,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.2629999999999999,"5min":1.853,"15min":1.853},"last":0.69399999999999995}]},{"osd":3,"last update":"Sun Oct 8 15:41:23 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":1.1259999999999999,"15min":1.0169999999999999},"min":{"1min":0.65800000000000003,"5min":0.435,"15min":0.435},"max":{"1min":1.2070000000000001,"5min":13.388,"15min":13.388},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.97899999999999998,"5min":1.1739999999999999,"15min":1.1559999999999999},"min":{"1min":0.65600000000000003,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.323,"5min":13.353,"15min":13.353},"last":0.77300000000000002}]},{"osd":4,"last update":"Sun Oct 8 15:41:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.105,"15min":1.212},"min":{"1min":0.69499999999999995,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.5349999999999999,"5min":5.859,"15min":5.859},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.091,"15min":1.1499999999999999},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.5469999999999999,"5min":4.2679999999999998,"15min":4.2679999999999998},"last":1.214}]},{"osd":5,"last update":"Sun Oct 8 15:41:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.099,"15min":1.1359999999999999},"min":{"1min":0.78700000000000003,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.446,"5min":4.3380000000000001,"15min":4.3380000000000001},"last":1.173},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.1679999999999999,"15min":1.1779999999999999},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.7709999999999999,"5min":2.085,"15min":2.085},"last":1.2709999999999999}]},{"osd":6,"last update":"Sun Oct 8 15:41:23 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.246,"15min":1.3540000000000001},"min":{"1min":0.746,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.431,"5min":5.8979999999999997,"15min":5.8979999999999997},"last":0.85299999999999998},{"interface":"front","average":{"1min":1.153,"5min":1.2190000000000001,"15min":1.2649999999999999},"min":{"1min":0.81499999999999995,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.5069999999999999,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":1.119}]},{"osd":7,"last update":"Sun Oct 8 15:41:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.24,"15min":1.246},"min":{"1min":0.77700000000000002,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.7010000000000001,"5min":2.3940000000000001,"15min":2.3940000000000001},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.3380000000000001,"15min":1.4590000000000001},"min":{"1min":0.93799999999999994,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.5649999999999999,"5min":5.9299999999999997,"15min":5.9299999999999997},"last":1.429}]}]},{"osd":0,"up_from":14,"seq":60129542202,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306240,"kb_used_data":760,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065600,"statfs":{"total":96636764160,"available":96323174400,"internally_reserved":0,"allocated":778240,"data_stored":887265,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 15:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.73299999999999998,"15min":0.81299999999999994},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.89500000000000002,"5min":1.514,"15min":1.514},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.79300000000000004,"15min":0.79900000000000004},"min":{"1min":0.45700000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0980000000000001,"5min":1.518,"15min":1.518},"last":0.621}]},{"osd":2,"last update":"Sun Oct 8 15:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.81699999999999995,"15min":0.85499999999999998},"min":{"1min":0.57799999999999996,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.4059999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.78100000000000003,"15min":0.78400000000000003},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.216,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.80000000000000004}]},{"osd":3,"last update":"Sun Oct 8 15:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.75,"15min":0.75800000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.95099999999999996,"15min":0.98399999999999999},"min":{"1min":0.66900000000000004,"5min":0.499,"15min":0.499},"max":{"1min":1.556,"5min":2.3290000000000002,"15min":2.3290000000000002},"last":0.70599999999999996}]},{"osd":4,"last update":"Sun Oct 8 15:41:24 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.0469999999999999,"15min":1.0820000000000001},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.3959999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.97299999999999998,"5min":1.04,"15min":1.0800000000000001},"min":{"1min":0.67800000000000005,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.4850000000000001,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.82899999999999996}]},{"osd":5,"last update":"Sun Oct 8 15:41:24 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.0349999999999999,"15min":1.083},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.3140000000000001,"5min":2.214,"15min":2.214},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.2270000000000001,"15min":1.3200000000000001},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.6879999999999999,"5min":3.4569999999999999,"15min":3.4569999999999999},"last":1.0720000000000001}]},{"osd":6,"last update":"Sun Oct 8 15:41:24 2023","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.218,"15min":1.284},"min":{"1min":0.94099999999999995,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.641,"5min":2.532,"15min":2.532},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.2090000000000001,"15min":1.2370000000000001},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.649,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":1.226}]},{"osd":7,"last update":"Sun Oct 8 15:41:24 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.2649999999999999,"15min":1.2909999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.726,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.163},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.202,"15min":1.226},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":1.111}]}]},{"osd":5,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306152,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065688,"statfs":{"total":96636764160,"available":96323264512,"internally_reserved":0,"allocated":688128,"data_stored":283846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.879,"15min":0.85599999999999998},"min":{"1min":0.55600000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.2829999999999999,"5min":1.528,"15min":1.528},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.90700000000000003,"15min":0.91000000000000003},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.96899999999999997}]},{"osd":1,"last update":"Sun Oct 8 15:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.91200000000000003,"15min":0.90800000000000003},"min":{"1min":0.52700000000000002,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.2909999999999999,"5min":1.448,"15min":1.448},"last":1.4219999999999999},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.92900000000000005,"15min":0.97599999999999998},"min":{"1min":0.58899999999999997,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1739999999999999,"5min":1.754,"15min":1.754},"last":1.1519999999999999}]},{"osd":2,"last update":"Sun Oct 8 15:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.94499999999999995,"15min":0.95199999999999996},"min":{"1min":0.63200000000000001,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.4750000000000001,"5min":1.869,"15min":1.869},"last":0.752},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98099999999999998,"15min":1.0069999999999999},"min":{"1min":0.66200000000000003,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.2250000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":1.1160000000000001}]},{"osd":3,"last update":"Sun Oct 8 15:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98599999999999999,"15min":0.998},"min":{"1min":0.69499999999999995,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.2470000000000001,"5min":1.929,"15min":1.929},"last":0.65100000000000002},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.05,"15min":1.097},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.589,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":1.0680000000000001}]},{"osd":4,"last update":"Sun Oct 8 15:41:24 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.002,"15min":1.0109999999999999},"min":{"1min":0.72899999999999998,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.5069999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0329999999999999,"15min":1.0680000000000001},"min":{"1min":0.65000000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.399,"5min":1.823,"15min":1.823},"last":1.306}]},{"osd":6,"last update":"Sun Oct 8 15:41:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.1679999999999999,"15min":1.196},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.6659999999999999,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":1.28},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.177,"15min":1.2230000000000001},"min":{"1min":0.72799999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.5,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.0329999999999999}]},{"osd":7,"last update":"Sun Oct 8 15:41:24 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.099,"15min":1.1479999999999999},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.4379999999999999,"5min":2.177,"15min":2.177},"last":1.25},{"interface":"front","average":{"1min":1.2,"5min":1.196,"15min":1.2130000000000001},"min":{"1min":0.72399999999999998,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.74,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.2}]}]},{"osd":4,"up_from":13,"seq":55834574905,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297976,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073864,"statfs":{"total":96636764160,"available":96331636736,"internally_reserved":0,"allocated":704512,"data_stored":290679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.82699999999999996,"15min":0.81100000000000005},"min":{"1min":0.57199999999999995,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.83099999999999996,"15min":0.80100000000000005},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":0.89500000000000002}]},{"osd":1,"last update":"Sun Oct 8 15:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.88200000000000001,"15min":0.84399999999999997},"min":{"1min":0.69099999999999995,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86099999999999999,"15min":0.83999999999999997},"min":{"1min":0.51200000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1240000000000001,"5min":1.383,"15min":1.383},"last":0.85599999999999998}]},{"osd":2,"last update":"Sun Oct 8 15:41:22 2023","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.054,"15min":1.036},"min":{"1min":0.79500000000000004,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0209999999999999,"15min":1.022},"min":{"1min":0.67300000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":1.0289999999999999}]},{"osd":3,"last update":"Sun Oct 8 15:41:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.012,"15min":1.0189999999999999},"min":{"1min":0.83299999999999996,"5min":0.626,"15min":0.626},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.101,"5min":1.056,"15min":1.04},"min":{"1min":0.77000000000000002,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.68700000000000006}]},{"osd":5,"last update":"Sun Oct 8 15:41:22 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.0049999999999999,"15min":0.97699999999999998},"min":{"1min":0.629,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":1.304},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.0920000000000001,"15min":1.0700000000000001},"min":{"1min":0.82399999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":1.202}]},{"osd":6,"last update":"Sun Oct 8 15:41:22 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.115,"15min":1.139},"min":{"1min":0.72399999999999998,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.45,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.97799999999999998},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.2070000000000001,"15min":1.1890000000000001},"min":{"1min":0.91600000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.92500000000000004}]},{"osd":7,"last update":"Sun Oct 8 15:41:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.1080000000000001,"15min":1.079},"min":{"1min":0.92900000000000005,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.103},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.218,"15min":1.198},"min":{"1min":0.97399999999999998,"5min":0.625,"15min":0.625},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":1.1479999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T15:41:49.879 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-08T15:41:49.880 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-08T15:41:50.004 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.998+0000 7f59c9b9c700 1 Processor -- start 2023-10-08T15:41:50.004 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:49.998+0000 7f59c9b9c700 1 -- start start 2023-10-08T15:41:50.006 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.002+0000 7f59c9b9c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f59c406ec30 0x7f59c414c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:50.007 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.002+0000 7f59c9b9c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f59c406d6e0 0x7f59c41487d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:50.007 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.002+0000 7f59c9b9c700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59c406f0c0 con 0x7f59c414bb60 2023-10-08T15:41:50.007 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.002+0000 7f59c9b9c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59c40b2b50 con 0x7f59c406ec30 2023-10-08T15:41:50.007 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.002+0000 7f59c9b9c700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c40b2770 con 0x7f59c406d6e0 2023-10-08T15:41:50.007 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.002+0000 7f59c37fe700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f59c414bb60 0x7f59c406cfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:60794/0 (socket says 172.21.15.3:60794) 2023-10-08T15:41:50.007 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.002+0000 7f59c37fe700 1 -- 172.21.15.3:0/9288839 learned_addr learned my addr 172.21.15.3:0/9288839 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:41:50.007 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.002+0000 7f59c3fff700 1 --2- 172.21.15.3:0/9288839 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f59c406d6e0 0x7f59c41487d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:50.007 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.002+0000 7f59baffd700 1 --2- 172.21.15.3:0/9288839 >> v2:172.21.15.50:3300/0 conn(0x7f59c406ec30 0x7f59c414c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:50.007 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.002+0000 7f59c2ffd700 1 -- 172.21.15.3:0/9288839 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3921546310 0 0) 0x7f59c406f0c0 con 0x7f59c414bb60 2023-10-08T15:41:50.007 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.002+0000 7f59c2ffd700 1 -- 172.21.15.3:0/9288839 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59b0003570 con 0x7f59c414bb60 2023-10-08T15:41:50.010 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.002+0000 7f59c2ffd700 1 -- 172.21.15.3:0/9288839 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1076409109 0 0) 0x7f59b0003570 con 0x7f59c414bb60 2023-10-08T15:41:50.010 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.002+0000 7f59c2ffd700 1 -- 172.21.15.3:0/9288839 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f59c406d6e0 msgr2=0x7f59c41487d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:50.010 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.002+0000 7f59c2ffd700 1 --2- 172.21.15.3:0/9288839 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f59c406d6e0 0x7f59c41487d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:50.010 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.002+0000 7f59c2ffd700 1 -- 172.21.15.3:0/9288839 >> v2:172.21.15.50:3300/0 conn(0x7f59c406ec30 msgr2=0x7f59c414c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:50.010 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.002+0000 7f59c2ffd700 1 --2- 172.21.15.3:0/9288839 >> v2:172.21.15.50:3300/0 conn(0x7f59c406ec30 0x7f59c414c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:50.010 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.002+0000 7f59c2ffd700 1 -- 172.21.15.3:0/9288839 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c406f570 con 0x7f59c414bb60 2023-10-08T15:41:50.010 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.002+0000 7f59c2ffd700 1 -- 172.21.15.3:0/9288839 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2285686191 0 0) 0x7f59b4001470 con 0x7f59c414bb60 2023-10-08T15:41:50.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.002+0000 7f59c2ffd700 1 -- 172.21.15.3:0/9288839 >> v1:172.21.15.3:6789/0 conn(0x7f59c414bb60 legacy=0x7f59c406cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:50.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.002+0000 7f59c2ffd700 1 --2- 172.21.15.3:0/9288839 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f59b0003ae0 0x7f59b0003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:50.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.002+0000 7f59c2ffd700 1 --2- 172.21.15.3:0/9288839 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f59c406d6e0 0x7f59b0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:50.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.002+0000 7f59c2ffd700 1 --2- 172.21.15.3:0/9288839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59b0004d50 0x7f59b00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:50.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.002+0000 7f59c2ffd700 1 -- 172.21.15.3:0/9288839 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c40b2b50 con 0x7f59b0003ae0 2023-10-08T15:41:50.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.002+0000 7f59c2ffd700 1 -- 172.21.15.3:0/9288839 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c40b2770 con 0x7f59b0004d50 2023-10-08T15:41:50.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.002+0000 7f59c2ffd700 1 -- 172.21.15.3:0/9288839 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59b000bb10 con 0x7f59c406d6e0 2023-10-08T15:41:50.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.002+0000 7f59c37fe700 1 --2- 172.21.15.3:0/9288839 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f59b0003ae0 0x7f59b0003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:50.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.002+0000 7f59c3fff700 1 --2- 172.21.15.3:0/9288839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59b0004d50 0x7f59b00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:50.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.002+0000 7f59c37fe700 1 -- 172.21.15.3:0/9288839 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f59c406d6e0 msgr2=0x7f59b0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:50.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.002+0000 7f59c37fe700 1 --2- 172.21.15.3:0/9288839 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f59c406d6e0 0x7f59b0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:50.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.002+0000 7f59c37fe700 1 -- 172.21.15.3:0/9288839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59b0004d50 msgr2=0x7f59b00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:50.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.002+0000 7f59c37fe700 1 --2- 172.21.15.3:0/9288839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59b0004d50 0x7f59b00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:50.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.002+0000 7f59c37fe700 1 -- 172.21.15.3:0/9288839 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b0003570 con 0x7f59b0003ae0 2023-10-08T15:41:50.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.002+0000 7f59c37fe700 1 --2- 172.21.15.3:0/9288839 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f59b0003ae0 0x7f59b0003ef0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f59b400c300 tx=0x7f59b4001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f262e7e92d470f1d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:50.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.002+0000 7f59c2ffd700 1 -- 172.21.15.3:0/9288839 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b400cb90 con 0x7f59b0003ae0 2023-10-08T15:41:50.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.002+0000 7f59c2ffd700 1 -- 172.21.15.3:0/9288839 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b400cd10 con 0x7f59b0003ae0 2023-10-08T15:41:50.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.002+0000 7f59c2ffd700 1 -- 172.21.15.3:0/9288839 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b4005b70 con 0x7f59b0003ae0 2023-10-08T15:41:50.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.006+0000 7f59c9b9c700 1 -- 172.21.15.3:0/9288839 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f59b0003ae0 msgr2=0x7f59b0003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:50.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.006+0000 7f59c9b9c700 1 --2- 172.21.15.3:0/9288839 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f59b0003ae0 0x7f59b0003ef0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f59b400c300 tx=0x7f59b4001dc0 comp rx=0 tx=0).stop 2023-10-08T15:41:50.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.006+0000 7f59c3fff700 1 -- 172.21.15.3:0/9288839 reap_dead start 2023-10-08T15:41:50.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.006+0000 7f59c9b9c700 1 -- 172.21.15.3:0/9288839 shutdown_connections 2023-10-08T15:41:50.013 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.006+0000 7f59c9b9c700 1 -- 172.21.15.3:0/9288839 >> 172.21.15.3:0/9288839 conn(0x7f59c40be4f0 msgr2=0x7f59c40be8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:50.013 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.006+0000 7f59c9b9c700 1 -- 172.21.15.3:0/9288839 shutdown_connections 2023-10-08T15:41:50.013 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.006+0000 7f59c9b9c700 1 -- 172.21.15.3:0/9288839 wait complete. 2023-10-08T15:41:50.014 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.006+0000 7f59c9b9c700 1 Processor -- start 2023-10-08T15:41:50.014 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.006+0000 7f59c9b9c700 1 -- start start 2023-10-08T15:41:50.014 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.010+0000 7f59c9b9c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f59c41440e0 0x7f59c4142790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:50.014 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.010+0000 7f59c9b9c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f59c414fea0 0x7f59c4142cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:50.014 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.010+0000 7f59c9b9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59c41591f0 0x7f59c4159690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:50.015 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.010+0000 7f59c9b9c700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c413d5b0 con 0x7f59c414fea0 2023-10-08T15:41:50.015 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.010+0000 7f59c9b9c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c40b5380 con 0x7f59c41591f0 2023-10-08T15:41:50.015 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.010+0000 7f59c9b9c700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c415d370 con 0x7f59c41440e0 2023-10-08T15:41:50.015 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.010+0000 7f59baffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f59c414fea0 0x7f59c4142cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:50.015 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.010+0000 7f59baffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f59c414fea0 0x7f59c4142cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60582/0 (socket says 172.21.15.3:60582) 2023-10-08T15:41:50.015 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.010+0000 7f59baffd700 1 -- 172.21.15.3:0/1399688738 learned_addr learned my addr 172.21.15.3:0/1399688738 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:50.015 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.010+0000 7f59c37fe700 1 --2- 172.21.15.3:0/1399688738 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f59c41440e0 0x7f59c4142790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:50.015 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.010+0000 7f59c3fff700 1 --2- 172.21.15.3:0/1399688738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59c41591f0 0x7f59c4159690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:50.016 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.010+0000 7f59c3fff700 1 -- 172.21.15.3:0/1399688738 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f59c41440e0 msgr2=0x7f59c4142790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:50.016 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.010+0000 7f59c3fff700 1 --2- 172.21.15.3:0/1399688738 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f59c41440e0 0x7f59c4142790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:50.016 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.010+0000 7f59c3fff700 1 -- 172.21.15.3:0/1399688738 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f59c414fea0 msgr2=0x7f59c4142cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:50.017 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.010+0000 7f59c3fff700 1 --2- 172.21.15.3:0/1399688738 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f59c414fea0 0x7f59c4142cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:50.017 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.010+0000 7f59c3fff700 1 -- 172.21.15.3:0/1399688738 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c415d040 con 0x7f59c41591f0 2023-10-08T15:41:50.017 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.010+0000 7f59c3fff700 1 --2- 172.21.15.3:0/1399688738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59c41591f0 0x7f59c4159690 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f59c406c6d0 tx=0x7f59bc00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:50.017 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.010+0000 7f59bbfff700 1 -- 172.21.15.3:0/1399688738 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59bc00e040 con 0x7f59c41591f0 2023-10-08T15:41:50.017 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.010+0000 7f59bbfff700 1 -- 172.21.15.3:0/1399688738 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59bc00f040 con 0x7f59c41591f0 2023-10-08T15:41:50.017 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.010+0000 7f59c9b9c700 1 -- 172.21.15.3:0/1399688738 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59c40b4a00 con 0x7f59c41591f0 2023-10-08T15:41:50.017 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.010+0000 7f59bbfff700 1 -- 172.21.15.3:0/1399688738 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59bc00fd70 con 0x7f59c41591f0 2023-10-08T15:41:50.017 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.010+0000 7f59c9b9c700 1 -- 172.21.15.3:0/1399688738 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59c41444b0 con 0x7f59c41591f0 2023-10-08T15:41:50.018 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.014+0000 7f59c9b9c700 1 -- 172.21.15.3:0/1399688738 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59c415d4e0 con 0x7f59c41591f0 2023-10-08T15:41:50.018 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.014+0000 7f59bbfff700 1 -- 172.21.15.3:0/1399688738 <== mon.1 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f59bc015640 con 0x7f59c41591f0 2023-10-08T15:41:50.018 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.014+0000 7f59bbfff700 1 --2- 172.21.15.3:0/1399688738 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f59a4060580 0x7f59a4062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:50.018 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.014+0000 7f59bbfff700 1 -- 172.21.15.3:0/1399688738 <== mon.1 v2:172.21.15.50:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f59bc07d480 con 0x7f59c41591f0 2023-10-08T15:41:50.019 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.014+0000 7f59c37fe700 1 --2- 172.21.15.3:0/1399688738 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f59a4060580 0x7f59a4062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:50.019 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.014+0000 7f59c37fe700 1 --2- 172.21.15.3:0/1399688738 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f59a4060580 0x7f59a4062a30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f59c404c6c0 tx=0x7f59b4012000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:50.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.022+0000 7f59bbfff700 1 -- 172.21.15.3:0/1399688738 <== mon.1 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f59bc04d9d0 con 0x7f59c41591f0 2023-10-08T15:41:50.250 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.246+0000 7f59c9b9c700 1 -- 172.21.15.3:0/1399688738 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f59c4064530 con 0x7f59c41591f0 2023-10-08T15:41:50.260 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.254+0000 7f59bbfff700 1 -- 172.21.15.3:0/1399688738 <== mon.1 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+0 (secure 0 0 0) 0x7f59bc050ff0 con 0x7f59c41591f0 2023-10-08T15:41:50.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.258+0000 7f59c9b9c700 1 -- 172.21.15.3:0/1399688738 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f59a4060580 msgr2=0x7f59a4062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:50.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.258+0000 7f59c9b9c700 1 --2- 172.21.15.3:0/1399688738 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f59a4060580 0x7f59a4062a30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f59c404c6c0 tx=0x7f59b4012000 comp rx=0 tx=0).stop 2023-10-08T15:41:50.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.258+0000 7f59c9b9c700 1 -- 172.21.15.3:0/1399688738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59c41591f0 msgr2=0x7f59c4159690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:50.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.258+0000 7f59c9b9c700 1 --2- 172.21.15.3:0/1399688738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59c41591f0 0x7f59c4159690 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f59c406c6d0 tx=0x7f59bc00b040 comp rx=0 tx=0).stop 2023-10-08T15:41:50.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.258+0000 7f59c9b9c700 1 -- 172.21.15.3:0/1399688738 shutdown_connections 2023-10-08T15:41:50.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.258+0000 7f59c9b9c700 1 --2- 172.21.15.3:0/1399688738 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f59a4060580 0x7f59a4062a30 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:50.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.258+0000 7f59c9b9c700 1 --2- 172.21.15.3:0/1399688738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59c41591f0 0x7f59c4159690 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:50.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.258+0000 7f59c9b9c700 1 --2- 172.21.15.3:0/1399688738 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f59c414fea0 0x7f59c4142cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:50.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.258+0000 7f59c9b9c700 1 --2- 172.21.15.3:0/1399688738 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f59c41440e0 0x7f59c4142790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:50.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.258+0000 7f59c9b9c700 1 -- 172.21.15.3:0/1399688738 >> 172.21.15.3:0/1399688738 conn(0x7f59c40be4f0 msgr2=0x7f59c40be8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:50.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.258+0000 7f59c9b9c700 1 -- 172.21.15.3:0/1399688738 shutdown_connections 2023-10-08T15:41:50.265 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.258+0000 7f59c9b9c700 1 -- 172.21.15.3:0/1399688738 wait complete. 2023-10-08T15:41:50.265 INFO:teuthology.orchestra.run.smithi003.stderr:updated caps for client.0 2023-10-08T15:41:50.278 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:41:50.384 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.378+0000 7fda0b58b700 1 Processor -- start 2023-10-08T15:41:50.384 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.378+0000 7fda0b58b700 1 -- start start 2023-10-08T15:41:50.386 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.382+0000 7fda0b58b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fda0414b020 0x7fda04155ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:50.386 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.382+0000 7fda0b58b700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda0414c6b0 con 0x7fda0406be60 2023-10-08T15:41:50.386 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.382+0000 7fda0b58b700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda0414dc50 con 0x7fda0414ac50 2023-10-08T15:41:50.386 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.382+0000 7fda0b58b700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda0406d350 con 0x7fda0414b020 2023-10-08T15:41:50.386 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.382+0000 7fda09d88700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fda0406be60 0x7fda0406cc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:60796/0 (socket says 172.21.15.3:60796) 2023-10-08T15:41:50.386 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.382+0000 7fda09d88700 1 -- 172.21.15.3:0/3916072141 learned_addr learned my addr 172.21.15.3:0/3916072141 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:41:50.387 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.382+0000 7fda0ad8a700 1 --2- 172.21.15.3:0/3916072141 >> v2:172.21.15.50:3300/0 conn(0x7fda0414b020 0x7fda04155ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:50.387 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.382+0000 7fda09587700 1 -- 172.21.15.3:0/3916072141 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2850159532 0 0) 0x7fda0414c6b0 con 0x7fda0406be60 2023-10-08T15:41:50.387 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.382+0000 7fda09587700 1 -- 172.21.15.3:0/3916072141 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9f0003570 con 0x7fda0406be60 2023-10-08T15:41:50.388 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.382+0000 7fda0ad8a700 1 -- 172.21.15.3:0/3916072141 >> v1:172.21.15.50:6789/0 conn(0x7fda0414ac50 legacy=0x7fda0406c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:50.388 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.382+0000 7fda09587700 1 -- 172.21.15.3:0/3916072141 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1312639362 0 0) 0x7fda0414dc50 con 0x7fda0414ac50 2023-10-08T15:41:50.388 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.382+0000 7fda0ad8a700 1 -- 172.21.15.3:0/3916072141 >> v1:172.21.15.3:6789/0 conn(0x7fda0406be60 legacy=0x7fda0406cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:50.388 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.382+0000 7fda0ad8a700 1 -- 172.21.15.3:0/3916072141 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda0414c060 con 0x7fda0414b020 2023-10-08T15:41:50.388 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.382+0000 7fda0ad8a700 1 --2- 172.21.15.3:0/3916072141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda0414b020 0x7fda04155ee0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc009e60 tx=0x7fd9fc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f90b07c3a22d5c40 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:50.388 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.382+0000 7fda09587700 1 -- 172.21.15.3:0/3916072141 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc00e070 con 0x7fda0414b020 2023-10-08T15:41:50.388 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.382+0000 7fda09587700 1 -- 172.21.15.3:0/3916072141 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9fc00b850 con 0x7fda0414b020 2023-10-08T15:41:50.388 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.382+0000 7fda09587700 1 -- 172.21.15.3:0/3916072141 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda00001470 con 0x7fda0414b020 2023-10-08T15:41:50.389 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.382+0000 7fda0b58b700 1 -- 172.21.15.3:0/3916072141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda0414b020 msgr2=0x7fda04155ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:50.389 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.382+0000 7fda0b58b700 1 --2- 172.21.15.3:0/3916072141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda0414b020 0x7fda04155ee0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc009e60 tx=0x7fd9fc009780 comp rx=0 tx=0).stop 2023-10-08T15:41:50.389 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.382+0000 7fda0b58b700 1 -- 172.21.15.3:0/3916072141 shutdown_connections 2023-10-08T15:41:50.389 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.382+0000 7fda0b58b700 1 --2- 172.21.15.3:0/3916072141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda0414b020 0x7fda04155ee0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:50.390 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.382+0000 7fda0b58b700 1 -- 172.21.15.3:0/3916072141 >> 172.21.15.3:0/3916072141 conn(0x7fda040c1df0 msgr2=0x7fda040c21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:50.390 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.382+0000 7fda0b58b700 1 -- 172.21.15.3:0/3916072141 shutdown_connections 2023-10-08T15:41:50.390 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.382+0000 7fda0b58b700 1 -- 172.21.15.3:0/3916072141 wait complete. 2023-10-08T15:41:50.390 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.386+0000 7fda0b58b700 1 Processor -- start 2023-10-08T15:41:50.390 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.386+0000 7fda0b58b700 1 -- start start 2023-10-08T15:41:50.393 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.386+0000 7fda0b58b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fda0406be60 0x7fda0414ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:50.393 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.386+0000 7fda0b58b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda0414ac50 0x7fda0415b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:50.393 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.386+0000 7fda0b58b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda0414b020 0x7fda0409fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:50.393 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.386+0000 7fda0b58b700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda0409f730 con 0x7fda0414ac50 2023-10-08T15:41:50.393 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.386+0000 7fda0b58b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda0414d3b0 con 0x7fda0414b020 2023-10-08T15:41:50.393 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.386+0000 7fda0b58b700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda0409f0e0 con 0x7fda0406be60 2023-10-08T15:41:50.393 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.386+0000 7fda09d88700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda0414ac50 0x7fda0415b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:50.393 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.386+0000 7fda09d88700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda0414ac50 0x7fda0415b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60584/0 (socket says 172.21.15.3:60584) 2023-10-08T15:41:50.394 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.386+0000 7fda09d88700 1 -- 172.21.15.3:0/162822778 learned_addr learned my addr 172.21.15.3:0/162822778 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:50.394 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.386+0000 7fda0a589700 1 --2- 172.21.15.3:0/162822778 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fda0406be60 0x7fda0414ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:50.394 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.386+0000 7fda0ad8a700 1 --2- 172.21.15.3:0/162822778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda0414b020 0x7fda0409fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:50.394 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.386+0000 7fda09d88700 1 -- 172.21.15.3:0/162822778 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fda0406be60 msgr2=0x7fda0414ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:50.394 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.386+0000 7fda09d88700 1 --2- 172.21.15.3:0/162822778 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fda0406be60 0x7fda0414ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:50.394 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.386+0000 7fda09d88700 1 -- 172.21.15.3:0/162822778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda0414b020 msgr2=0x7fda0409fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:50.394 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.386+0000 7fda09d88700 1 --2- 172.21.15.3:0/162822778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda0414b020 0x7fda0409fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:50.394 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.386+0000 7fda09d88700 1 -- 172.21.15.3:0/162822778 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9fc009a20 con 0x7fda0414ac50 2023-10-08T15:41:50.394 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.386+0000 7fda0ad8a700 1 --2- 172.21.15.3:0/162822778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda0414b020 0x7fda0409fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:50.394 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.386+0000 7fda09d88700 1 --2- 172.21.15.3:0/162822778 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda0414ac50 0x7fda0415b730 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fda000015a0 tx=0x7fda00001bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:50.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.390+0000 7fd9fa7fc700 1 -- 172.21.15.3:0/162822778 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda00007360 con 0x7fda0414ac50 2023-10-08T15:41:50.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.390+0000 7fd9fa7fc700 1 -- 172.21.15.3:0/162822778 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda000074e0 con 0x7fda0414ac50 2023-10-08T15:41:50.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.390+0000 7fd9fa7fc700 1 -- 172.21.15.3:0/162822778 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda00004830 con 0x7fda0414ac50 2023-10-08T15:41:50.396 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.390+0000 7fda0b58b700 1 -- 172.21.15.3:0/162822778 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda0409f3c0 con 0x7fda0414ac50 2023-10-08T15:41:50.396 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.390+0000 7fda0b58b700 1 -- 172.21.15.3:0/162822778 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda040a0100 con 0x7fda0414ac50 2023-10-08T15:41:50.396 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.390+0000 7fda0b58b700 1 -- 172.21.15.3:0/162822778 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda0409f8a0 con 0x7fda0414ac50 2023-10-08T15:41:50.396 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.390+0000 7fd9fa7fc700 1 -- 172.21.15.3:0/162822778 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fda00004bc0 con 0x7fda0414ac50 2023-10-08T15:41:50.397 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.390+0000 7fd9fa7fc700 1 --2- 172.21.15.3:0/162822778 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd9e8060550 0x7fd9e8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:50.397 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.390+0000 7fd9fa7fc700 1 -- 172.21.15.3:0/162822778 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fda0007bca0 con 0x7fda0414ac50 2023-10-08T15:41:50.397 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.394+0000 7fda0a589700 1 --2- 172.21.15.3:0/162822778 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd9e8060550 0x7fd9e8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:50.398 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.394+0000 7fda0a589700 1 --2- 172.21.15.3:0/162822778 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd9e8060550 0x7fd9e8062a00 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd9f4007fd0 tx=0x7fd9f4007d30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:50.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.398+0000 7fd9fa7fc700 1 -- 172.21.15.3:0/162822778 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fda0004c290 con 0x7fda0414ac50 2023-10-08T15:41:50.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.594+0000 7fda0b58b700 1 -- 172.21.15.3:0/162822778 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fda0405ecf0 con 0x7fda0414ac50 2023-10-08T15:41:50.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.598+0000 7fd9fa7fc700 1 -- 172.21.15.3:0/162822778 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+3082 (secure 0 0 0) 0x7fda00018090 con 0x7fda0414ac50 2023-10-08T15:41:50.602 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:41:50.602 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":33,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5480,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1007706158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1007706158},{"type":"v1","addr":"172.21.15.50:6835","nonce":1007706158}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:41:45.889781+0000","modified":"2023-10-08T15:41:48.541276+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6030},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6030":{"gid":6030,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.3:6833/1129612905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":1129612905},{"type":"v1","addr":"172.21.15.3:6833","nonce":1129612905}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-08T15:41:50.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.598+0000 7fda0b58b700 1 -- 172.21.15.3:0/162822778 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd9e8060550 msgr2=0x7fd9e8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:50.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.598+0000 7fda0b58b700 1 --2- 172.21.15.3:0/162822778 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd9e8060550 0x7fd9e8062a00 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd9f4007fd0 tx=0x7fd9f4007d30 comp rx=0 tx=0).stop 2023-10-08T15:41:50.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.598+0000 7fda0b58b700 1 -- 172.21.15.3:0/162822778 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda0414ac50 msgr2=0x7fda0415b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:50.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.598+0000 7fda0b58b700 1 --2- 172.21.15.3:0/162822778 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda0414ac50 0x7fda0415b730 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fda000015a0 tx=0x7fda00001bf0 comp rx=0 tx=0).stop 2023-10-08T15:41:50.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.598+0000 7fda0b58b700 1 -- 172.21.15.3:0/162822778 shutdown_connections 2023-10-08T15:41:50.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.598+0000 7fda0b58b700 1 --2- 172.21.15.3:0/162822778 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fd9e8060550 0x7fd9e8062a00 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:50.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.598+0000 7fda0b58b700 1 --2- 172.21.15.3:0/162822778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda0414b020 0x7fda0409fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:50.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.598+0000 7fda0b58b700 1 --2- 172.21.15.3:0/162822778 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda0414ac50 0x7fda0415b730 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:50.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.598+0000 7fda0b58b700 1 --2- 172.21.15.3:0/162822778 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fda0406be60 0x7fda0414ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:50.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.598+0000 7fda0b58b700 1 -- 172.21.15.3:0/162822778 >> 172.21.15.3:0/162822778 conn(0x7fda040c1df0 msgr2=0x7fda0406c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:50.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.598+0000 7fda0b58b700 1 -- 172.21.15.3:0/162822778 shutdown_connections 2023-10-08T15:41:50.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.598+0000 7fda0b58b700 1 -- 172.21.15.3:0/162822778 wait complete. 2023-10-08T15:41:50.605 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 33 2023-10-08T15:41:50.818 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 33, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-08T15:41:45.889781+0000', 'modified': '2023-10-08T15:41:48.541276+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6030}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6030': {'gid': 6030, 'name': 'a', 'rank': 0, 'incarnation': 31, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.3:6833/1129612905', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.3:6832', 'nonce': 1129612905}, {'type': 'v1', 'addr': '172.21.15.3:6833', 'nonce': 1129612905}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-08T15:41:50.818 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-08T15:41:50.819 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-08T15:41:50.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.930+0000 7f3a832a6700 1 Processor -- start 2023-10-08T15:41:50.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.930+0000 7f3a832a6700 1 -- start start 2023-10-08T15:41:50.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.934+0000 7f3a832a6700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3a7c14f170 0x7f3a7c0b9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:50.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.934+0000 7f3a832a6700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3a7c09cfb0 0x7f3a7c150390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:50.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.934+0000 7f3a832a6700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f3a7c0a0bc0 0x7f3a7c152f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:50.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.934+0000 7f3a832a6700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a7c09e770 con 0x7f3a7c0a0bc0 2023-10-08T15:41:50.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.934+0000 7f3a832a6700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a7c068b30 con 0x7f3a7c14f170 2023-10-08T15:41:50.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.934+0000 7f3a832a6700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7c0ba3e0 con 0x7f3a7c09cfb0 2023-10-08T15:41:50.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.934+0000 7f3a81843700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f3a7c0a0bc0 0x7f3a7c152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:50.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.934+0000 7f3a81843700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f3a7c0a0bc0 0x7f3a7c152f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60592/0 (socket says 172.21.15.3:60592) 2023-10-08T15:41:50.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.934+0000 7f3a81843700 1 -- 172.21.15.3:0/2136936375 learned_addr learned my addr 172.21.15.3:0/2136936375 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:50.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.934+0000 7f3a81042700 1 --2- 172.21.15.3:0/2136936375 >> v2:172.21.15.50:3300/0 conn(0x7f3a7c14f170 0x7f3a7c0b9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:50.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.934+0000 7f3a80841700 1 --2- 172.21.15.3:0/2136936375 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3a7c09cfb0 0x7f3a7c150390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:50.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.934+0000 7f3a81843700 1 -- 172.21.15.3:0/2136936375 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3a7c09cfb0 msgr2=0x7f3a7c150390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:50.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.934+0000 7f3a81843700 1 --2- 172.21.15.3:0/2136936375 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3a7c09cfb0 0x7f3a7c150390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:50.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.934+0000 7f3a81843700 1 -- 172.21.15.3:0/2136936375 >> v2:172.21.15.50:3300/0 conn(0x7f3a7c14f170 msgr2=0x7f3a7c0b9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:50.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.934+0000 7f3a81843700 1 --2- 172.21.15.3:0/2136936375 >> v2:172.21.15.50:3300/0 conn(0x7f3a7c14f170 0x7f3a7c0b9ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:50.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.934+0000 7f3a81843700 1 -- 172.21.15.3:0/2136936375 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a7c068d80 con 0x7f3a7c0a0bc0 2023-10-08T15:41:50.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.934+0000 7f3a81843700 1 --2- 172.21.15.3:0/2136936375 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3a7c0a0bc0 0x7f3a7c152f60 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c09d4c0 tx=0x7f3a74009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4544b988b0cfc89b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:50.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.934+0000 7f3a73fff700 1 -- 172.21.15.3:0/2136936375 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7400e070 con 0x7f3a7c0a0bc0 2023-10-08T15:41:50.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.934+0000 7f3a73fff700 1 -- 172.21.15.3:0/2136936375 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a7400b970 con 0x7f3a7c0a0bc0 2023-10-08T15:41:50.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.934+0000 7f3a73fff700 1 -- 172.21.15.3:0/2136936375 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a740092e0 con 0x7f3a7c0a0bc0 2023-10-08T15:41:50.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.934+0000 7f3a832a6700 1 -- 172.21.15.3:0/2136936375 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3a7c0a0bc0 msgr2=0x7f3a7c152f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:50.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.934+0000 7f3a832a6700 1 --2- 172.21.15.3:0/2136936375 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3a7c0a0bc0 0x7f3a7c152f60 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c09d4c0 tx=0x7f3a74009840 comp rx=0 tx=0).stop 2023-10-08T15:41:50.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.934+0000 7f3a832a6700 1 -- 172.21.15.3:0/2136936375 shutdown_connections 2023-10-08T15:41:50.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.934+0000 7f3a832a6700 1 --2- 172.21.15.3:0/2136936375 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3a7c09cfb0 0x7f3a7c150390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:50.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.934+0000 7f3a832a6700 1 --2- 172.21.15.3:0/2136936375 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3a7c0a0bc0 0x7f3a7c152f60 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:50.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.934+0000 7f3a832a6700 1 --2- 172.21.15.3:0/2136936375 >> v2:172.21.15.50:3300/0 conn(0x7f3a7c14f170 0x7f3a7c0b9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:50.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.934+0000 7f3a832a6700 1 -- 172.21.15.3:0/2136936375 >> 172.21.15.3:0/2136936375 conn(0x7f3a7c0bdb60 msgr2=0x7f3a7c0bdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:50.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.938+0000 7f3a832a6700 1 -- 172.21.15.3:0/2136936375 shutdown_connections 2023-10-08T15:41:50.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.938+0000 7f3a832a6700 1 -- 172.21.15.3:0/2136936375 wait complete. 2023-10-08T15:41:50.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.938+0000 7f3a832a6700 1 Processor -- start 2023-10-08T15:41:50.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.938+0000 7f3a832a6700 1 -- start start 2023-10-08T15:41:50.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.938+0000 7f3a832a6700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a7c09cfb0 0x7f3a7c0a1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:50.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.938+0000 7f3a832a6700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3a7c0a0bc0 0x7f3a7c162b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:50.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.938+0000 7f3a832a6700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3a7c14f170 0x7f3a7c1630c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:50.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.938+0000 7f3a832a6700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7c14bfe0 con 0x7f3a7c0a0bc0 2023-10-08T15:41:50.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.938+0000 7f3a832a6700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7c06cbd0 con 0x7f3a7c09cfb0 2023-10-08T15:41:50.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.938+0000 7f3a832a6700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7c06c8d0 con 0x7f3a7c14f170 2023-10-08T15:41:50.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.938+0000 7f3a80841700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3a7c0a0bc0 0x7f3a7c162b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:50.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.938+0000 7f3a80841700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3a7c0a0bc0 0x7f3a7c162b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60604/0 (socket says 172.21.15.3:60604) 2023-10-08T15:41:50.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.938+0000 7f3a80841700 1 -- 172.21.15.3:0/3930974843 learned_addr learned my addr 172.21.15.3:0/3930974843 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:50.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.938+0000 7f3a81042700 1 --2- 172.21.15.3:0/3930974843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a7c09cfb0 0x7f3a7c0a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:50.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.938+0000 7f3a81843700 1 --2- 172.21.15.3:0/3930974843 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3a7c14f170 0x7f3a7c1630c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:50.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.938+0000 7f3a80841700 1 -- 172.21.15.3:0/3930974843 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3a7c14f170 msgr2=0x7f3a7c1630c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:50.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.938+0000 7f3a80841700 1 --2- 172.21.15.3:0/3930974843 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3a7c14f170 0x7f3a7c1630c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:50.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.938+0000 7f3a80841700 1 -- 172.21.15.3:0/3930974843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a7c09cfb0 msgr2=0x7f3a7c0a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:50.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.938+0000 7f3a80841700 1 --2- 172.21.15.3:0/3930974843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a7c09cfb0 0x7f3a7c0a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:50.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.938+0000 7f3a80841700 1 -- 172.21.15.3:0/3930974843 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a74009ae0 con 0x7f3a7c0a0bc0 2023-10-08T15:41:50.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.938+0000 7f3a81843700 1 --2- 172.21.15.3:0/3930974843 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3a7c14f170 0x7f3a7c1630c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:41:50.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.938+0000 7f3a80841700 1 --2- 172.21.15.3:0/3930974843 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3a7c0a0bc0 0x7f3a7c162b80 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c00ec80 tx=0x7f3a6c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:50.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.938+0000 7f3a717fa700 1 -- 172.21.15.3:0/3930974843 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c00c9d0 con 0x7f3a7c0a0bc0 2023-10-08T15:41:50.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.938+0000 7f3a717fa700 1 -- 172.21.15.3:0/3930974843 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a6c00cb50 con 0x7f3a7c0a0bc0 2023-10-08T15:41:50.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.938+0000 7f3a832a6700 1 -- 172.21.15.3:0/3930974843 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a7c15f450 con 0x7f3a7c0a0bc0 2023-10-08T15:41:50.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.938+0000 7f3a717fa700 1 -- 172.21.15.3:0/3930974843 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c013470 con 0x7f3a7c0a0bc0 2023-10-08T15:41:50.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.942+0000 7f3a832a6700 1 -- 172.21.15.3:0/3930974843 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a7c06d540 con 0x7f3a7c0a0bc0 2023-10-08T15:41:50.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.942+0000 7f3a717fa700 1 -- 172.21.15.3:0/3930974843 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f3a6c013860 con 0x7f3a7c0a0bc0 2023-10-08T15:41:50.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.942+0000 7f3a717fa700 1 --2- 172.21.15.3:0/3930974843 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3a60060580 0x7f3a60062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:50.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.942+0000 7f3a8554f740 1 Processor -- start 2023-10-08T15:41:50.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.942+0000 7f3a8554f740 1 -- start start 2023-10-08T15:41:50.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.946+0000 7f3a717fa700 1 -- 172.21.15.3:0/3930974843 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3a6c07ce90 con 0x7f3a7c0a0bc0 2023-10-08T15:41:50.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.946+0000 7f3a81042700 1 --2- 172.21.15.3:0/3930974843 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3a60060580 0x7f3a60062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:50.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.946+0000 7f3a8554f740 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1c70ae0 0x1ea8460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:50.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.946+0000 7f3a8554f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1c70710 0x1ea89a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:50.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.946+0000 7f3a8554f740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1cbb790 0x1ea8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:50.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.946+0000 7f3a8554f740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e1bf30 con 0x1cbb790 2023-10-08T15:41:50.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.946+0000 7f3a8554f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e17ed0 con 0x1c70710 2023-10-08T15:41:50.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.946+0000 7f3a8554f740 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x1dde0b0 con 0x1c70ae0 2023-10-08T15:41:50.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.946+0000 7f3a81843700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1cbb790 0x1ea8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:50.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.946+0000 7f3a81843700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1cbb790 0x1ea8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60606/0 (socket says 172.21.15.3:60606) 2023-10-08T15:41:50.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.946+0000 7f3a81843700 1 -- 172.21.15.3:0/1888538010 learned_addr learned my addr 172.21.15.3:0/1888538010 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:50.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.946+0000 7f3a80841700 1 --2- 172.21.15.3:0/1888538010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1c70710 0x1ea89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:50.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.946+0000 7f3a81042700 1 --2- 172.21.15.3:0/3930974843 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3a60060580 0x7f3a60062a30 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3a78009ca0 tx=0x7f3a78008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:50.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.946+0000 7f3a81843700 1 -- 172.21.15.3:0/1888538010 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1c70ae0 msgr2=0x1ea8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:50.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.946+0000 7f3a81042700 1 --2- 172.21.15.3:0/1888538010 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1c70ae0 0x1ea8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:50.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.946+0000 7f3a81843700 1 --2- 172.21.15.3:0/1888538010 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1c70ae0 0x1ea8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:50.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.946+0000 7f3a81843700 1 -- 172.21.15.3:0/1888538010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1c70710 msgr2=0x1ea89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:50.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.946+0000 7f3a81843700 1 --2- 172.21.15.3:0/1888538010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1c70710 0x1ea89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:50.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.946+0000 7f3a81843700 1 -- 172.21.15.3:0/1888538010 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1cbc9e0 con 0x1cbb790 2023-10-08T15:41:50.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.946+0000 7f3a81042700 1 --2- 172.21.15.3:0/1888538010 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1c70ae0 0x1ea8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:41:50.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.946+0000 7f3a81843700 1 --2- 172.21.15.3:0/1888538010 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1cbb790 0x1ea8ee0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f3a74009ab0 tx=0x7f3a74018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3a094e9d8a23335 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:50.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.946+0000 7f3a667fc700 1 -- 172.21.15.3:0/1888538010 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a740032f0 con 0x1cbb790 2023-10-08T15:41:50.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.946+0000 7f3a667fc700 1 -- 172.21.15.3:0/1888538010 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a7400bae0 con 0x1cbb790 2023-10-08T15:41:50.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.946+0000 7f3a667fc700 1 -- 172.21.15.3:0/1888538010 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7401e660 con 0x1cbb790 2023-10-08T15:41:50.959 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.946+0000 7f3a8554f740 1 -- 172.21.15.3:0/1888538010 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1cbb790 msgr2=0x1ea8ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:50.959 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.946+0000 7f3a8554f740 1 --2- 172.21.15.3:0/1888538010 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1cbb790 0x1ea8ee0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f3a74009ab0 tx=0x7f3a74018000 comp rx=0 tx=0).stop 2023-10-08T15:41:50.959 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.946+0000 7f3a8554f740 1 -- 172.21.15.3:0/1888538010 shutdown_connections 2023-10-08T15:41:50.959 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.946+0000 7f3a8554f740 1 --2- 172.21.15.3:0/1888538010 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1cbb790 0x1ea8ee0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:50.959 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.946+0000 7f3a8554f740 1 --2- 172.21.15.3:0/1888538010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1c70710 0x1ea89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:50.959 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.946+0000 7f3a8554f740 1 --2- 172.21.15.3:0/1888538010 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1c70ae0 0x1ea8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:50.960 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.946+0000 7f3a8554f740 1 -- 172.21.15.3:0/1888538010 >> 172.21.15.3:0/1888538010 conn(0x1c70eb0 msgr2=0x1ea3810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:50.960 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.946+0000 7f3a8554f740 1 -- 172.21.15.3:0/1888538010 shutdown_connections 2023-10-08T15:41:50.960 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.946+0000 7f3a8554f740 1 -- 172.21.15.3:0/1888538010 wait complete. 2023-10-08T15:41:50.960 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.946+0000 7f3a8554f740 1 -- start start 2023-10-08T15:41:50.960 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.946+0000 7f3a8554f740 1 Processor -- start 2023-10-08T15:41:50.960 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.950+0000 7f3a8554f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1c70710 0x1ede570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:50.960 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.950+0000 7f3a8554f740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1c70ae0 0x1edeab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:50.960 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.950+0000 7f3a8554f740 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1cbb790 0x1edf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:50.960 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.950+0000 7f3a8554f740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x1dddd50 con 0x1c70ae0 2023-10-08T15:41:50.960 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.950+0000 7f3a8554f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x1db6970 con 0x1c70710 2023-10-08T15:41:50.961 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.950+0000 7f3a8554f740 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x1ddd420 con 0x1cbb790 2023-10-08T15:41:50.961 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.950+0000 7f3a8554f740 10 client.0 _ll_register_callbacks cb 0x1e616a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T15:41:50.961 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.950+0000 7f3a80841700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1c70ae0 0x1edeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:50.961 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.950+0000 7f3a80841700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1c70ae0 0x1edeab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60614/0 (socket says 172.21.15.3:60614) 2023-10-08T15:41:50.961 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.950+0000 7f3a80841700 1 -- 172.21.15.3:0/2029677802 learned_addr learned my addr 172.21.15.3:0/2029677802 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:50.961 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.950+0000 7f3a81042700 1 --2- 172.21.15.3:0/2029677802 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1c70710 0x1ede570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:50.961 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.950+0000 7f3a81843700 1 --2- 172.21.15.3:0/2029677802 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1cbb790 0x1edf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:50.961 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.950+0000 7f3a80841700 1 -- 172.21.15.3:0/2029677802 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1cbb790 msgr2=0x1edf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:50.961 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.950+0000 7f3a80841700 1 --2- 172.21.15.3:0/2029677802 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1cbb790 0x1edf5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:50.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.950+0000 7f3a80841700 1 -- 172.21.15.3:0/2029677802 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1c70710 msgr2=0x1ede570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:50.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.950+0000 7f3a80841700 1 --2- 172.21.15.3:0/2029677802 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1c70710 0x1ede570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:50.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.950+0000 7f3a80841700 1 -- 172.21.15.3:0/2029677802 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a7c068d80 con 0x1c70ae0 2023-10-08T15:41:50.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.950+0000 7f3a80841700 1 --2- 172.21.15.3:0/2029677802 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1c70ae0 0x1edeab0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c00ec50 tx=0x7f3a6c015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77ede0fe64e70854 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:50.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.950+0000 7f3a5b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2023-10-08T15:41:50.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.950+0000 7f3a5b7fe700 1 -- 172.21.15.3:0/2029677802 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c06b200 con 0x1c70ae0 2023-10-08T15:41:50.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.950+0000 7f3a8554f740 1 -- 172.21.15.3:0/2029677802 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1db6cc0 con 0x1c70ae0 2023-10-08T15:41:50.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.950+0000 7f3a5b7fe700 1 -- 172.21.15.3:0/2029677802 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(59..59 src has 1..59) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3a6c04f440 con 0x1c70ae0 2023-10-08T15:41:50.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.950+0000 7f3a5b7fe700 1 -- 172.21.15.3:0/2029677802 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3a6c051340 con 0x1c70ae0 2023-10-08T15:41:50.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.950+0000 7f3a8554f740 10 client.6156 fetch_fsmap learned FSMap version 33 2023-10-08T15:41:50.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.950+0000 7f3a8554f740 1 -- 172.21.15.3:0/2029677802 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x1de6370 con 0x1c70ae0 2023-10-08T15:41:50.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.950+0000 7f3a5b7fe700 1 -- 172.21.15.3:0/2029677802 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1db6cc0 con 0x1c70ae0 2023-10-08T15:41:50.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.950+0000 7f3a5b7fe700 1 -- 172.21.15.3:0/2029677802 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 33) v1 ==== 2010+0+0 (secure 0 0 0) 0x7f3a6c050590 con 0x1c70ae0 2023-10-08T15:41:50.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.950+0000 7f3a8554f740 10 client.6156 fetch_fsmap finished waiting for FSMap version 33 2023-10-08T15:41:50.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.950+0000 7f3a8554f740 10 client.6156 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-08T15:41:50.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.950+0000 7f3a8554f740 20 client.6156 populate_metadata read hostname 'smithi003' 2023-10-08T15:41:50.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.950+0000 7f3a8554f740 1 --2- 172.21.15.3:0/2029677802 >> [v2:172.21.15.3:6832/1129612905,v1:172.21.15.3:6833/1129612905] conn(0x1eeeb90 0x1ef0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:50.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.950+0000 7f3a8554f740 4 client.6156 mds_command: new command op to 6030 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-08T15:41:50.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.950+0000 7f3a8554f740 1 -- 172.21.15.3:0/2029677802 --> [v2:172.21.15.3:6832/1129612905,v1:172.21.15.3:6833/1129612905] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1dba3e0 con 0x1eeeb90 2023-10-08T15:41:50.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.950+0000 7f3a81042700 1 --2- 172.21.15.3:0/2029677802 >> [v2:172.21.15.3:6832/1129612905,v1:172.21.15.3:6833/1129612905] conn(0x1eeeb90 0x1ef0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:50.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.950+0000 7f3a81042700 1 --2- 172.21.15.3:0/2029677802 >> [v2:172.21.15.3:6832/1129612905,v1:172.21.15.3:6833/1129612905] conn(0x1eeeb90 0x1ef0f70 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=794edd286bf96be2 server_cookie=24de36acde36bc7a in_seq=0 out_seq=0 2023-10-08T15:41:50.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.950+0000 7f3a5b7fe700 10 client.6156 ms_handle_connect on v2:172.21.15.3:6832/1129612905 2023-10-08T15:41:50.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.954+0000 7f3a5b7fe700 1 -- 172.21.15.3:0/2029677802 <== mds.0 v2:172.21.15.3:6832/1129612905 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x1dba3e0 con 0x1eeeb90 2023-10-08T15:41:50.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.954+0000 7f3a5b7fe700 10 client.6156 handle_command_reply: tid=0 2023-10-08T15:41:50.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.954+0000 7f3a8554f740 1 client.6156 shutdown 2023-10-08T15:41:50.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.954+0000 7f3a8554f740 1 -- 172.21.15.3:0/2029677802 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1c70ae0 msgr2=0x1edeab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:50.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.954+0000 7f3a8554f740 1 --2- 172.21.15.3:0/2029677802 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1c70ae0 0x1edeab0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c00ec50 tx=0x7f3a6c015040 comp rx=0 tx=0).stop 2023-10-08T15:41:50.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.954+0000 7f3a8554f740 1 -- 172.21.15.3:0/2029677802 shutdown_connections 2023-10-08T15:41:50.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.954+0000 7f3a8554f740 1 --2- 172.21.15.3:0/2029677802 >> [v2:172.21.15.3:6832/1129612905,v1:172.21.15.3:6833/1129612905] conn(0x1eeeb90 0x1ef0f70 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:50.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.954+0000 7f3a8554f740 1 --2- 172.21.15.3:0/2029677802 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1cbb790 0x1edf5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:50.965 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.954+0000 7f3a8554f740 1 --2- 172.21.15.3:0/2029677802 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1c70ae0 0x1edeab0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:50.965 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.954+0000 7f3a8554f740 1 --2- 172.21.15.3:0/2029677802 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1c70710 0x1ede570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:50.965 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.954+0000 7f3a8554f740 1 -- 172.21.15.3:0/2029677802 >> 172.21.15.3:0/2029677802 conn(0x1c70eb0 msgr2=0x1ea2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:50.965 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.954+0000 7f3a5b7fe700 0 client.6156 ms_handle_reset on v2:172.21.15.3:6832/1129612905 2023-10-08T15:41:50.965 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.954+0000 7f3a8554f740 1 -- 172.21.15.3:0/2029677802 shutdown_connections 2023-10-08T15:41:50.965 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.954+0000 7f3a8554f740 1 -- 172.21.15.3:0/2029677802 wait complete. 2023-10-08T15:41:50.965 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.954+0000 7f3a8554f740 20 client.6156 trim_cache size 0 max 16384 2023-10-08T15:41:50.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.974+0000 7f3a8554f740 1 Processor -- start 2023-10-08T15:41:50.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.974+0000 7f3a8554f740 1 -- start start 2023-10-08T15:41:50.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.974+0000 7f3a8554f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1c70710 0x1eebe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:50.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.974+0000 7f3a8554f740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1c70ae0 0x1ea8060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:50.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.974+0000 7f3a8554f740 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1cbb790 0x1ea85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:50.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.974+0000 7f3a8554f740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c727f0 con 0x1c70ae0 2023-10-08T15:41:50.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.974+0000 7f3a8554f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x1debf40 con 0x1c70710 2023-10-08T15:41:50.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.974+0000 7f3a8554f740 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x1ced650 con 0x1cbb790 2023-10-08T15:41:50.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.974+0000 7f3a80841700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1c70ae0 0x1ea8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:50.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.974+0000 7f3a80841700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1c70ae0 0x1ea8060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60628/0 (socket says 172.21.15.3:60628) 2023-10-08T15:41:50.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.974+0000 7f3a80841700 1 -- 172.21.15.3:0/2039255778 learned_addr learned my addr 172.21.15.3:0/2039255778 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:50.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.974+0000 7f3a81042700 1 --2- 172.21.15.3:0/2039255778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1c70710 0x1eebe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:50.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.974+0000 7f3a81843700 1 --2- 172.21.15.3:0/2039255778 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1cbb790 0x1ea85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:50.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.974+0000 7f3a80841700 1 -- 172.21.15.3:0/2039255778 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1cbb790 msgr2=0x1ea85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:50.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.974+0000 7f3a80841700 1 --2- 172.21.15.3:0/2039255778 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1cbb790 0x1ea85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:50.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.974+0000 7f3a80841700 1 -- 172.21.15.3:0/2039255778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1c70710 msgr2=0x1eebe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:50.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.974+0000 7f3a80841700 1 --2- 172.21.15.3:0/2039255778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1c70710 0x1eebe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:50.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.974+0000 7f3a80841700 1 -- 172.21.15.3:0/2039255778 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1dccd80 con 0x1c70ae0 2023-10-08T15:41:50.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.974+0000 7f3a80841700 1 --2- 172.21.15.3:0/2039255778 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1c70ae0 0x1ea8060 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c0090e0 tx=0x7f3a6c066000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fbb1821a96f2480 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:50.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.974+0000 7f3a66ffd700 1 -- 172.21.15.3:0/2039255778 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c06b200 con 0x1c70ae0 2023-10-08T15:41:50.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.974+0000 7f3a66ffd700 1 -- 172.21.15.3:0/2039255778 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a6c050e70 con 0x1c70ae0 2023-10-08T15:41:50.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.974+0000 7f3a66ffd700 1 -- 172.21.15.3:0/2039255778 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c04f440 con 0x1c70ae0 2023-10-08T15:41:50.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.978+0000 7f3a8554f740 1 -- 172.21.15.3:0/2039255778 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1c70ae0 msgr2=0x1ea8060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:50.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.978+0000 7f3a8554f740 1 --2- 172.21.15.3:0/2039255778 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1c70ae0 0x1ea8060 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c0090e0 tx=0x7f3a6c066000 comp rx=0 tx=0).stop 2023-10-08T15:41:50.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.978+0000 7f3a8554f740 1 -- 172.21.15.3:0/2039255778 shutdown_connections 2023-10-08T15:41:50.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.978+0000 7f3a8554f740 1 --2- 172.21.15.3:0/2039255778 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1cbb790 0x1ea85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:50.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.978+0000 7f3a8554f740 1 --2- 172.21.15.3:0/2039255778 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1c70ae0 0x1ea8060 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:50.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.978+0000 7f3a8554f740 1 --2- 172.21.15.3:0/2039255778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1c70710 0x1eebe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:50.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.978+0000 7f3a8554f740 1 -- 172.21.15.3:0/2039255778 >> 172.21.15.3:0/2039255778 conn(0x1c70eb0 msgr2=0x1edec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:50.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.978+0000 7f3a8554f740 1 -- 172.21.15.3:0/2039255778 shutdown_connections 2023-10-08T15:41:50.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.978+0000 7f3a8554f740 1 -- 172.21.15.3:0/2039255778 wait complete. 2023-10-08T15:41:50.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.978+0000 7f3a8554f740 1 -- start start 2023-10-08T15:41:50.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.978+0000 7f3a8554f740 1 Processor -- start 2023-10-08T15:41:50.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.982+0000 7f3a8554f740 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1c70710 0x1f00e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:50.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.982+0000 7f3a8554f740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1c70ae0 0x1f013c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:50.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.982+0000 7f3a8554f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1cbb790 0x1f01900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:50.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.982+0000 7f3a8554f740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ce97c0 con 0x1c70ae0 2023-10-08T15:41:50.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.982+0000 7f3a8554f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x1d5b100 con 0x1cbb790 2023-10-08T15:41:50.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.982+0000 7f3a8554f740 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x1e1e400 con 0x1c70710 2023-10-08T15:41:50.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.982+0000 7f3a8554f740 10 client.0 _ll_register_callbacks cb 0x1d3fd00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T15:41:50.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.982+0000 7f3a80841700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1c70ae0 0x1f013c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:50.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.982+0000 7f3a80841700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1c70ae0 0x1f013c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60632/0 (socket says 172.21.15.3:60632) 2023-10-08T15:41:50.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.982+0000 7f3a80841700 1 -- 172.21.15.3:0/4047010030 learned_addr learned my addr 172.21.15.3:0/4047010030 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:50.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.982+0000 7f3a81843700 1 --2- 172.21.15.3:0/4047010030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1cbb790 0x1f01900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:50.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.982+0000 7f3a81042700 1 --2- 172.21.15.3:0/4047010030 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1c70710 0x1f00e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:50.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.982+0000 7f3a80841700 1 -- 172.21.15.3:0/4047010030 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1c70710 msgr2=0x1f00e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:50.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.982+0000 7f3a80841700 1 --2- 172.21.15.3:0/4047010030 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1c70710 0x1f00e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:50.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.982+0000 7f3a80841700 1 -- 172.21.15.3:0/4047010030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1cbb790 msgr2=0x1f01900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:50.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.982+0000 7f3a80841700 1 --2- 172.21.15.3:0/4047010030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1cbb790 0x1f01900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:50.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.982+0000 7f3a80841700 1 -- 172.21.15.3:0/4047010030 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1de6370 con 0x1c70ae0 2023-10-08T15:41:50.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.982+0000 7f3a80841700 1 --2- 172.21.15.3:0/4047010030 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1c70ae0 0x1f013c0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c050da0 tx=0x7f3a6c00e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf7f004c77e0a0f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:50.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.982+0000 7f3a5b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2023-10-08T15:41:50.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.982+0000 7f3a5b7fe700 1 -- 172.21.15.3:0/4047010030 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c06b200 con 0x1c70ae0 2023-10-08T15:41:50.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.982+0000 7f3a5b7fe700 1 -- 172.21.15.3:0/4047010030 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(59..59 src has 1..59) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3a6c04f440 con 0x1c70ae0 2023-10-08T15:41:50.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.982+0000 7f3a8554f740 1 -- 172.21.15.3:0/4047010030 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3a7400bae0 con 0x1c70ae0 2023-10-08T15:41:50.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.982+0000 7f3a5b7fe700 1 -- 172.21.15.3:0/4047010030 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3a6c058080 con 0x1c70ae0 2023-10-08T15:41:50.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.982+0000 7f3a8554f740 10 client.6162 fetch_fsmap learned FSMap version 33 2023-10-08T15:41:50.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.982+0000 7f3a8554f740 1 -- 172.21.15.3:0/4047010030 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x1dc1130 con 0x1c70ae0 2023-10-08T15:41:50.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.982+0000 7f3a5b7fe700 1 -- 172.21.15.3:0/4047010030 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a7400bae0 con 0x1c70ae0 2023-10-08T15:41:50.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.982+0000 7f3a5b7fe700 1 -- 172.21.15.3:0/4047010030 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 33) v1 ==== 2010+0+0 (secure 0 0 0) 0x7f3a6c057bf0 con 0x1c70ae0 2023-10-08T15:41:50.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.982+0000 7f3a8554f740 10 client.6162 fetch_fsmap finished waiting for FSMap version 33 2023-10-08T15:41:50.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.982+0000 7f3a8554f740 10 client.6162 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-08T15:41:50.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.982+0000 7f3a8554f740 20 client.6162 populate_metadata read hostname 'smithi003' 2023-10-08T15:41:50.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.982+0000 7f3a8554f740 1 --2- 172.21.15.3:0/4047010030 >> [v2:172.21.15.3:6832/1129612905,v1:172.21.15.3:6833/1129612905] conn(0x1f01e40 0x1f02210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:50.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.982+0000 7f3a8554f740 4 client.6162 mds_command: new command op to 6030 tid=0[{"prefix": "status"}] 2023-10-08T15:41:50.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.982+0000 7f3a8554f740 1 -- 172.21.15.3:0/4047010030 --> [v2:172.21.15.3:6832/1129612905,v1:172.21.15.3:6833/1129612905] -- command(tid 0: {"prefix": "status"}) v1 -- 0x1dec410 con 0x1f01e40 2023-10-08T15:41:50.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.982+0000 7f3a81042700 1 --2- 172.21.15.3:0/4047010030 >> [v2:172.21.15.3:6832/1129612905,v1:172.21.15.3:6833/1129612905] conn(0x1f01e40 0x1f02210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:50.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.982+0000 7f3a5b7fe700 10 client.6162 ms_handle_connect on v2:172.21.15.3:6832/1129612905 2023-10-08T15:41:50.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.986+0000 7f3a81042700 1 --2- 172.21.15.3:0/4047010030 >> [v2:172.21.15.3:6832/1129612905,v1:172.21.15.3:6833/1129612905] conn(0x1f01e40 0x1f02210 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fdd700cbe592757b server_cookie=8efafb8ac346f3bd in_seq=0 out_seq=0 2023-10-08T15:41:50.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.986+0000 7f3a5b7fe700 1 -- 172.21.15.3:0/4047010030 <== mds.0 v2:172.21.15.3:6832/1129612905 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x1dec410 con 0x1f01e40 2023-10-08T15:41:50.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.986+0000 7f3a5b7fe700 10 client.6162 handle_command_reply: tid=0 2023-10-08T15:41:50.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.986+0000 7f3a8554f740 1 client.6162 shutdown 2023-10-08T15:41:50.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.986+0000 7f3a8554f740 1 -- 172.21.15.3:0/4047010030 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1c70ae0 msgr2=0x1f013c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:50.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.986+0000 7f3a8554f740 1 --2- 172.21.15.3:0/4047010030 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1c70ae0 0x1f013c0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c050da0 tx=0x7f3a6c00e050 comp rx=0 tx=0).stop 2023-10-08T15:41:50.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.986+0000 7f3a8554f740 1 -- 172.21.15.3:0/4047010030 shutdown_connections 2023-10-08T15:41:50.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.986+0000 7f3a8554f740 1 --2- 172.21.15.3:0/4047010030 >> [v2:172.21.15.3:6832/1129612905,v1:172.21.15.3:6833/1129612905] conn(0x1f01e40 0x1f02210 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:50.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.986+0000 7f3a8554f740 1 --2- 172.21.15.3:0/4047010030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1cbb790 0x1f01900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:50.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.986+0000 7f3a5b7fe700 0 client.6162 ms_handle_reset on v2:172.21.15.3:6832/1129612905 2023-10-08T15:41:50.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.986+0000 7f3a8554f740 1 --2- 172.21.15.3:0/4047010030 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1c70ae0 0x1f013c0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:50.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.986+0000 7f3a8554f740 1 --2- 172.21.15.3:0/4047010030 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1c70710 0x1f00e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:50.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.986+0000 7f3a8554f740 1 -- 172.21.15.3:0/4047010030 >> 172.21.15.3:0/4047010030 conn(0x1c70eb0 msgr2=0x1ea8060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:50.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.986+0000 7f3a8554f740 1 -- 172.21.15.3:0/4047010030 shutdown_connections 2023-10-08T15:41:50.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.986+0000 7f3a8554f740 1 -- 172.21.15.3:0/4047010030 wait complete. 2023-10-08T15:41:50.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.986+0000 7f3a8554f740 20 client.6162 trim_cache size 0 max 16384 2023-10-08T15:41:50.994 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2023-10-08T15:41:50.994 INFO:teuthology.orchestra.run.smithi003.stdout: "cluster_fsid": "7635972e-cd66-4a8f-a231-378db8b3847a", 2023-10-08T15:41:50.994 INFO:teuthology.orchestra.run.smithi003.stdout: "whoami": 0, 2023-10-08T15:41:50.994 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 6030, 2023-10-08T15:41:50.994 INFO:teuthology.orchestra.run.smithi003.stdout: "want_state": "up:active", 2023-10-08T15:41:50.994 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "up:active", 2023-10-08T15:41:50.994 INFO:teuthology.orchestra.run.smithi003.stdout: "fs_name": "cephfs", 2023-10-08T15:41:50.995 INFO:teuthology.orchestra.run.smithi003.stdout: "rank_uptime": 4.4725645910000003, 2023-10-08T15:41:50.995 INFO:teuthology.orchestra.run.smithi003.stdout: "mdsmap_epoch": 33, 2023-10-08T15:41:50.995 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch": 59, 2023-10-08T15:41:50.995 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch_barrier": 59, 2023-10-08T15:41:50.995 INFO:teuthology.orchestra.run.smithi003.stdout: "uptime": 9.5839946690000009 2023-10-08T15:41:50.995 INFO:teuthology.orchestra.run.smithi003.stdout:} 2023-10-08T15:41:50.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.986+0000 7f3a832a6700 1 -- 172.21.15.3:0/3930974843 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3a60060580 msgr2=0x7f3a60062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:50.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.986+0000 7f3a832a6700 1 --2- 172.21.15.3:0/3930974843 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3a60060580 0x7f3a60062a30 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3a78009ca0 tx=0x7f3a78008040 comp rx=0 tx=0).stop 2023-10-08T15:41:50.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.986+0000 7f3a832a6700 1 -- 172.21.15.3:0/3930974843 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3a7c0a0bc0 msgr2=0x7f3a7c162b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:50.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.986+0000 7f3a832a6700 1 --2- 172.21.15.3:0/3930974843 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3a7c0a0bc0 0x7f3a7c162b80 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c00ec80 tx=0x7f3a6c0091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:50.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.986+0000 7f3a832a6700 1 -- 172.21.15.3:0/3930974843 shutdown_connections 2023-10-08T15:41:50.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.986+0000 7f3a832a6700 1 --2- 172.21.15.3:0/3930974843 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3a60060580 0x7f3a60062a30 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:50.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.986+0000 7f3a832a6700 1 --2- 172.21.15.3:0/3930974843 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3a7c14f170 0x7f3a7c1630c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:50.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.986+0000 7f3a832a6700 1 --2- 172.21.15.3:0/3930974843 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3a7c0a0bc0 0x7f3a7c162b80 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:50.997 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.986+0000 7f3a832a6700 1 --2- 172.21.15.3:0/3930974843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a7c09cfb0 0x7f3a7c0a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:50.997 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.986+0000 7f3a832a6700 1 -- 172.21.15.3:0/3930974843 >> 172.21.15.3:0/3930974843 conn(0x7f3a7c0bdb60 msgr2=0x7f3a7c14d760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:50.997 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.986+0000 7f3a832a6700 1 -- 172.21.15.3:0/3930974843 shutdown_connections 2023-10-08T15:41:50.997 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:50.986+0000 7f3a832a6700 1 -- 172.21.15.3:0/3930974843 wait complete. 2023-10-08T15:41:51.009 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T15:41:51.122 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.118+0000 7f5bd3715700 1 Processor -- start 2023-10-08T15:41:51.123 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.118+0000 7f5bd3715700 1 -- start start 2023-10-08T15:41:51.123 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.118+0000 7f5bd3715700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f5bcc0bafe0 0x7f5bcc068ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:51.124 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.118+0000 7f5bd3715700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5bcc153ad0 0x7f5bcc14ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:51.124 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.118+0000 7f5bd3715700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bcc09e490 con 0x7f5bcc06d080 2023-10-08T15:41:51.124 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.118+0000 7f5bd3715700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bcc06ce30 con 0x7f5bcc0bafe0 2023-10-08T15:41:51.124 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.118+0000 7f5bd3715700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bcc09e6e0 con 0x7f5bcc153ad0 2023-10-08T15:41:51.124 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.118+0000 7f5bd14b1700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f5bcc0bafe0 0x7f5bcc068ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:51.124 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.118+0000 7f5bd14b1700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f5bcc0bafe0 0x7f5bcc068ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60648/0 (socket says 172.21.15.3:60648) 2023-10-08T15:41:51.124 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.118+0000 7f5bd14b1700 1 -- 172.21.15.3:0/654577126 learned_addr learned my addr 172.21.15.3:0/654577126 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:51.124 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.118+0000 7f5bd1cb2700 1 --2- 172.21.15.3:0/654577126 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5bcc153ad0 0x7f5bcc14ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:51.125 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.118+0000 7f5bd14b1700 1 -- 172.21.15.3:0/654577126 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5bcc153ad0 msgr2=0x7f5bcc14ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:51.125 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.118+0000 7f5bd14b1700 1 --2- 172.21.15.3:0/654577126 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5bcc153ad0 0x7f5bcc14ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:51.125 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.118+0000 7f5bd14b1700 1 -- 172.21.15.3:0/654577126 >> v1:172.21.15.50:6789/0 conn(0x7f5bcc06d080 legacy=0x7f5bcc1533c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:51.125 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.118+0000 7f5bd14b1700 1 -- 172.21.15.3:0/654577126 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bcc153f50 con 0x7f5bcc0bafe0 2023-10-08T15:41:51.126 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.118+0000 7f5bc3fff700 1 -- 172.21.15.3:0/654577126 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 987512031 0 0) 0x7f5bcc09e490 con 0x7f5bcc06d080 2023-10-08T15:41:51.126 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.118+0000 7f5bd14b1700 1 --2- 172.21.15.3:0/654577126 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5bcc0bafe0 0x7f5bcc068ab0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc0099a0 tx=0x7f5bbc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5403753e8e003c57 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:51.126 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.118+0000 7f5bc3fff700 1 -- 172.21.15.3:0/654577126 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc009e90 con 0x7f5bcc0bafe0 2023-10-08T15:41:51.126 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.122+0000 7f5bc3fff700 1 -- 172.21.15.3:0/654577126 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bbc00b860 con 0x7f5bcc0bafe0 2023-10-08T15:41:51.126 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.122+0000 7f5bc3fff700 1 -- 172.21.15.3:0/654577126 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc00bc20 con 0x7f5bcc0bafe0 2023-10-08T15:41:51.127 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.122+0000 7f5bd3715700 1 -- 172.21.15.3:0/654577126 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5bcc0bafe0 msgr2=0x7f5bcc068ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:51.127 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.122+0000 7f5bd3715700 1 --2- 172.21.15.3:0/654577126 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5bcc0bafe0 0x7f5bcc068ab0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc0099a0 tx=0x7f5bbc009250 comp rx=0 tx=0).stop 2023-10-08T15:41:51.127 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.122+0000 7f5bd3715700 1 -- 172.21.15.3:0/654577126 shutdown_connections 2023-10-08T15:41:51.127 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.122+0000 7f5bd3715700 1 --2- 172.21.15.3:0/654577126 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5bcc153ad0 0x7f5bcc14ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:51.127 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.122+0000 7f5bd3715700 1 --2- 172.21.15.3:0/654577126 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5bcc0bafe0 0x7f5bcc068ab0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:51.127 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.122+0000 7f5bd3715700 1 -- 172.21.15.3:0/654577126 >> 172.21.15.3:0/654577126 conn(0x7f5bcc0be640 msgr2=0x7f5bcc0ba6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:51.127 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.122+0000 7f5bd3715700 1 -- 172.21.15.3:0/654577126 shutdown_connections 2023-10-08T15:41:51.127 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.122+0000 7f5bd3715700 1 -- 172.21.15.3:0/654577126 wait complete. 2023-10-08T15:41:51.128 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.122+0000 7f5bd3715700 1 Processor -- start 2023-10-08T15:41:51.128 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.122+0000 7f5bd3715700 1 -- start start 2023-10-08T15:41:51.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.122+0000 7f5bd3715700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5bcc06d080 0x7f5bcc151a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:51.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.122+0000 7f5bd3715700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5bcc0bafe0 0x7f5bcc148570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:51.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.122+0000 7f5bd3715700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5bcc153ad0 0x7f5bcc15fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:51.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.122+0000 7f5bd3715700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bcc0bbc90 con 0x7f5bcc06d080 2023-10-08T15:41:51.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.122+0000 7f5bd3715700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bcc15fa50 con 0x7f5bcc153ad0 2023-10-08T15:41:51.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.122+0000 7f5bd3715700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bcc151f50 con 0x7f5bcc0bafe0 2023-10-08T15:41:51.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.122+0000 7f5bd14b1700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5bcc06d080 0x7f5bcc151a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:51.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.122+0000 7f5bd14b1700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5bcc06d080 0x7f5bcc151a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60654/0 (socket says 172.21.15.3:60654) 2023-10-08T15:41:51.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.122+0000 7f5bd14b1700 1 -- 172.21.15.3:0/2785956890 learned_addr learned my addr 172.21.15.3:0/2785956890 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:41:51.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.122+0000 7f5bd1cb2700 1 --2- 172.21.15.3:0/2785956890 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5bcc153ad0 0x7f5bcc15fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:51.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.122+0000 7f5bd0cb0700 1 --2- 172.21.15.3:0/2785956890 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5bcc0bafe0 0x7f5bcc148570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:51.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.126+0000 7f5bd14b1700 1 -- 172.21.15.3:0/2785956890 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5bcc0bafe0 msgr2=0x7f5bcc148570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:51.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.126+0000 7f5bd14b1700 1 --2- 172.21.15.3:0/2785956890 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5bcc0bafe0 0x7f5bcc148570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:51.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.126+0000 7f5bd14b1700 1 -- 172.21.15.3:0/2785956890 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5bcc153ad0 msgr2=0x7f5bcc15fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:51.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.126+0000 7f5bd14b1700 1 --2- 172.21.15.3:0/2785956890 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5bcc153ad0 0x7f5bcc15fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:51.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.126+0000 7f5bd14b1700 1 -- 172.21.15.3:0/2785956890 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bbc009490 con 0x7f5bcc06d080 2023-10-08T15:41:51.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.126+0000 7f5bd14b1700 1 --2- 172.21.15.3:0/2785956890 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5bcc06d080 0x7f5bcc151a10 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc006fd0 tx=0x7f5bbc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:51.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.126+0000 7f5bc17fa700 1 -- 172.21.15.3:0/2785956890 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc01f070 con 0x7f5bcc06d080 2023-10-08T15:41:51.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.126+0000 7f5bc17fa700 1 -- 172.21.15.3:0/2785956890 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bbc00bbe0 con 0x7f5bcc06d080 2023-10-08T15:41:51.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.126+0000 7f5bc17fa700 1 -- 172.21.15.3:0/2785956890 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc011650 con 0x7f5bcc06d080 2023-10-08T15:41:51.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.126+0000 7f5bd3715700 1 -- 172.21.15.3:0/2785956890 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bcc0bb9b0 con 0x7f5bcc06d080 2023-10-08T15:41:51.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.126+0000 7f5bd3715700 1 -- 172.21.15.3:0/2785956890 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bcc148ab0 con 0x7f5bcc06d080 2023-10-08T15:41:51.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.126+0000 7f5bd3715700 1 -- 172.21.15.3:0/2785956890 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bcc064530 con 0x7f5bcc06d080 2023-10-08T15:41:51.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.126+0000 7f5bc17fa700 1 -- 172.21.15.3:0/2785956890 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5bbc011a40 con 0x7f5bcc06d080 2023-10-08T15:41:51.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.130+0000 7f5bc17fa700 1 --2- 172.21.15.3:0/2785956890 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5bb0060550 0x7f5bb0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:51.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.130+0000 7f5bc17fa700 1 -- 172.21.15.3:0/2785956890 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5bbc07db20 con 0x7f5bcc06d080 2023-10-08T15:41:51.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.130+0000 7f5bd0cb0700 1 --2- 172.21.15.3:0/2785956890 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5bb0060550 0x7f5bb0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:51.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.130+0000 7f5bd0cb0700 1 --2- 172.21.15.3:0/2785956890 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5bb0060550 0x7f5bb0062a00 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc14c270 tx=0x7f5bc8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:51.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.134+0000 7f5bc17fa700 1 -- 172.21.15.3:0/2785956890 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5bbc04e110 con 0x7f5bcc06d080 2023-10-08T15:41:51.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.330+0000 7f5bd3715700 1 -- 172.21.15.3:0/2785956890 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5bcc09ea50 con 0x7f5bcc06d080 2023-10-08T15:41:51.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.330+0000 7f5bc17fa700 1 -- 172.21.15.3:0/2785956890 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v33) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5bbc015060 con 0x7f5bcc06d080 2023-10-08T15:41:51.335 INFO:teuthology.orchestra.run.smithi003.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T15:41:51.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.330+0000 7f5bd3715700 1 -- 172.21.15.3:0/2785956890 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5bb0060550 msgr2=0x7f5bb0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:51.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.330+0000 7f5bd3715700 1 --2- 172.21.15.3:0/2785956890 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5bb0060550 0x7f5bb0062a00 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc14c270 tx=0x7f5bc8009040 comp rx=0 tx=0).stop 2023-10-08T15:41:51.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.330+0000 7f5bd3715700 1 -- 172.21.15.3:0/2785956890 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5bcc06d080 msgr2=0x7f5bcc151a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:51.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.330+0000 7f5bd3715700 1 --2- 172.21.15.3:0/2785956890 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5bcc06d080 0x7f5bcc151a10 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc006fd0 tx=0x7f5bbc017000 comp rx=0 tx=0).stop 2023-10-08T15:41:51.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.330+0000 7f5bd3715700 1 -- 172.21.15.3:0/2785956890 shutdown_connections 2023-10-08T15:41:51.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.330+0000 7f5bd3715700 1 --2- 172.21.15.3:0/2785956890 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5bb0060550 0x7f5bb0062a00 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:51.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.330+0000 7f5bd3715700 1 --2- 172.21.15.3:0/2785956890 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5bcc153ad0 0x7f5bcc15fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:51.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.330+0000 7f5bd3715700 1 --2- 172.21.15.3:0/2785956890 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5bcc0bafe0 0x7f5bcc148570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:51.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.330+0000 7f5bd3715700 1 --2- 172.21.15.3:0/2785956890 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5bcc06d080 0x7f5bcc151a10 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:51.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.330+0000 7f5bd3715700 1 -- 172.21.15.3:0/2785956890 >> 172.21.15.3:0/2785956890 conn(0x7f5bcc0be640 msgr2=0x7f5bcc068760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:51.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.334+0000 7f5bd3715700 1 -- 172.21.15.3:0/2785956890 shutdown_connections 2023-10-08T15:41:51.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:41:51.334+0000 7f5bd3715700 1 -- 172.21.15.3:0/2785956890 wait complete. 2023-10-08T15:41:51.348 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-08T15:41:51.349 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T15:41:51.349 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi089.front.sepia.ceph.com 2023-10-08T15:41:51.349 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-08T15:41:51.349 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T15:41:51.349 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-08T15:41:51.349 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-08T15:41:51.349 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T15:41:51.349 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T15:41:51.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:41:51.349 DEBUG:teuthology.orchestra.run.smithi089:> ip addr 2023-10-08T15:41:51.357 INFO:teuthology.orchestra.run.smithi089.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T15:41:51.358 INFO:teuthology.orchestra.run.smithi089.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T15:41:51.358 INFO:teuthology.orchestra.run.smithi089.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T15:41:51.358 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:41:51.358 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 ::1/128 scope host 2023-10-08T15:41:51.358 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:41:51.358 INFO:teuthology.orchestra.run.smithi089.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T15:41:51.358 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c6 brd ff:ff:ff:ff:ff:ff 2023-10-08T15:41:51.358 INFO:teuthology.orchestra.run.smithi089.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T15:41:51.358 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c7 brd ff:ff:ff:ff:ff:ff 2023-10-08T15:41:51.359 INFO:teuthology.orchestra.run.smithi089.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T15:41:51.359 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:00 brd ff:ff:ff:ff:ff:ff 2023-10-08T15:41:51.359 INFO:teuthology.orchestra.run.smithi089.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T15:41:51.359 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:01 brd ff:ff:ff:ff:ff:ff 2023-10-08T15:41:51.359 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.21.15.89/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-08T15:41:51.359 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft 42286sec preferred_lft 42286sec 2023-10-08T15:41:51.359 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::ec4:7aff:fe8f:d501/64 scope link 2023-10-08T15:41:51.359 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:41:51.359 INFO:teuthology.orchestra.run.smithi089.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-08T15:41:51.359 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 02:42:0d:de:29:b2 brd ff:ff:ff:ff:ff:ff 2023-10-08T15:41:51.359 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-08T15:41:51.359 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:41:51.360 INFO:teuthology.orchestra.run.smithi089.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T15:41:51.360 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 96:c9:6f:4e:3d:df brd ff:ff:ff:ff:ff:ff 2023-10-08T15:41:51.360 INFO:teuthology.orchestra.run.smithi089.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T15:41:51.360 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:41:51.360 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::6c37:4fff:fe02:5a19/64 scope link 2023-10-08T15:41:51.360 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:41:51.360 INFO:teuthology.orchestra.run.smithi089.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T15:41:51.360 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 96:c9:6f:4e:3d:df brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T15:41:51.360 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::94c9:6fff:fe4e:3ddf/64 scope link 2023-10-08T15:41:51.360 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:41:51.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:41:51.361 DEBUG:teuthology.orchestra.run.smithi089:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T15:41:51.376 INFO:teuthology.orchestra.run.smithi089.stdout:1 2023-10-08T15:41:51.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:41:51.379 DEBUG:teuthology.orchestra.run.smithi089:> route 2023-10-08T15:41:51.387 INFO:teuthology.orchestra.run.smithi089.stdout:Kernel IP routing table 2023-10-08T15:41:51.387 INFO:teuthology.orchestra.run.smithi089.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T15:41:51.387 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-08T15:41:51.387 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-08T15:41:51.387 INFO:teuthology.orchestra.run.smithi089.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-08T15:41:51.387 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-10-08T15:41:51.387 INFO:teuthology.orchestra.run.smithi089.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-08T15:41:51.388 INFO:teuthology.orchestra.run.smithi089.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T15:41:51.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:41:51.388 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-10-08T15:41:51.388 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-10-08T15:41:51.388 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-08T15:41:51.388 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-08T15:41:51.388 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-08T15:41:51.389 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-10-08T15:41:51.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:41:51.429 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2023-10-08T15:41:51.483 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T15:41:51.484 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T15:41:51.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:41:51.484 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set brx.0 up 2023-10-08T15:41:51.497 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-08T15:41:51.497 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T15:41:51.497 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-08T15:41:51.502 INFO:teuthology.orchestra.run.smithi089.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-08T15:41:51.502 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T15:41:51.503 DEBUG:teuthology.orchestra.run.smithi089:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-08T15:41:51.551 DEBUG:teuthology.orchestra.run.smithi089:> sudo modprobe fuse 2023-10-08T15:41:51.567 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-08T15:41:51.567 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-08T15:41:51.582 INFO:teuthology.orchestra.run.smithi089.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-08T15:41:51.583 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-08T15:41:51.583 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:41:51.583 DEBUG:teuthology.orchestra.run.smithi089:> ls /sys/fs/fuse/connections 2023-10-08T15:41:51.589 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-08T15:41:51.589 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-08T15:41:51.591 DEBUG:teuthology.orchestra.run.smithi089:> sudo modprobe fuse 2023-10-08T15:41:51.608 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-08T15:41:51.608 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-08T15:41:51.662 INFO:teuthology.orchestra.run.smithi089.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-08T15:41:51.663 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-08T15:41:51.663 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:41:51.663 DEBUG:teuthology.orchestra.run.smithi089:> ls /sys/fs/fuse/connections 2023-10-08T15:41:51.669 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi089.stderr:2023-10-08T15:41:51.669+0000 7f2f2dccf380 -1 init, newargv = 0x5617ca016260 newargc=15 2023-10-08T15:41:51.669 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi089.stderr:ceph-fuse[29198]: starting ceph client 2023-10-08T15:41:51.679 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi089.stderr:ceph-fuse[29198]: starting fuse 2023-10-08T15:41:51.801 INFO:tasks.ceph.mds.a.smithi003.stderr:2023-10-08T15:41:51.794+0000 7f648c0c2700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T15:41:52.769 DEBUG:teuthology.orchestra.run.smithi089:> sudo modprobe fuse 2023-10-08T15:41:52.788 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-08T15:41:52.788 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-08T15:41:52.802 INFO:teuthology.orchestra.run.smithi089.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-08T15:41:52.802 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-08T15:41:52.803 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:41:52.803 DEBUG:teuthology.orchestra.run.smithi089:> ls /sys/fs/fuse/connections 2023-10-08T15:41:52.851 INFO:teuthology.orchestra.run.smithi089.stdout:52 2023-10-08T15:41:52.851 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-10-08T15:41:52.852 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-08T15:41:52.852 DEBUG:teuthology.orchestra.run.smithi089:> import glob 2023-10-08T15:41:52.852 DEBUG:teuthology.orchestra.run.smithi089:> import re 2023-10-08T15:41:52.852 DEBUG:teuthology.orchestra.run.smithi089:> import os 2023-10-08T15:41:52.852 DEBUG:teuthology.orchestra.run.smithi089:> import subprocess 2023-10-08T15:41:52.852 DEBUG:teuthology.orchestra.run.smithi089:> 2023-10-08T15:41:52.852 DEBUG:teuthology.orchestra.run.smithi089:> def _find_admin_socket(client_name): 2023-10-08T15:41:52.852 DEBUG:teuthology.orchestra.run.smithi089:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-08T15:41:52.852 DEBUG:teuthology.orchestra.run.smithi089:> files = glob.glob(asok_path) 2023-10-08T15:41:52.852 DEBUG:teuthology.orchestra.run.smithi089:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-08T15:41:52.852 DEBUG:teuthology.orchestra.run.smithi089:> 2023-10-08T15:41:52.852 DEBUG:teuthology.orchestra.run.smithi089:> # Given a non-glob path, it better be there 2023-10-08T15:41:52.853 DEBUG:teuthology.orchestra.run.smithi089:> if "*" not in asok_path: 2023-10-08T15:41:52.853 DEBUG:teuthology.orchestra.run.smithi089:> assert(len(files) == 1) 2023-10-08T15:41:52.853 DEBUG:teuthology.orchestra.run.smithi089:> return files[0] 2023-10-08T15:41:52.853 DEBUG:teuthology.orchestra.run.smithi089:> 2023-10-08T15:41:52.853 DEBUG:teuthology.orchestra.run.smithi089:> for f in files: 2023-10-08T15:41:52.853 DEBUG:teuthology.orchestra.run.smithi089:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-08T15:41:52.853 DEBUG:teuthology.orchestra.run.smithi089:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-08T15:41:52.853 DEBUG:teuthology.orchestra.run.smithi089:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-08T15:41:52.853 DEBUG:teuthology.orchestra.run.smithi089:> contents = proc_f.read() 2023-10-08T15:41:52.853 DEBUG:teuthology.orchestra.run.smithi089:> if mountpoint in contents: 2023-10-08T15:41:52.853 DEBUG:teuthology.orchestra.run.smithi089:> return f 2023-10-08T15:41:52.853 DEBUG:teuthology.orchestra.run.smithi089:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-08T15:41:52.853 DEBUG:teuthology.orchestra.run.smithi089:> 2023-10-08T15:41:52.854 DEBUG:teuthology.orchestra.run.smithi089:> print(_find_admin_socket("client.0")) 2023-10-08T15:41:52.854 DEBUG:teuthology.orchestra.run.smithi089:> ' 2023-10-08T15:41:52.934 INFO:teuthology.orchestra.run.smithi089.stdout:/var/run/ceph/ceph-client.0.29198.asok 2023-10-08T15:41:53.118 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.29198.asok 2023-10-08T15:41:53.119 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:41:53.119 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.29198.asok status 2023-10-08T15:41:53.212 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2023-10-08T15:41:53.212 INFO:teuthology.orchestra.run.smithi089.stdout: "metadata": { 2023-10-08T15:41:53.212 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph_sha1": "08cac0187919fc3a247efdf445f652e2fb30a647", 2023-10-08T15:41:53.212 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph_version": "ceph version 17.2.6-1320-g08cac018 (08cac0187919fc3a247efdf445f652e2fb30a647) quincy (stable)", 2023-10-08T15:41:53.212 INFO:teuthology.orchestra.run.smithi089.stdout: "entity_id": "0", 2023-10-08T15:41:53.212 INFO:teuthology.orchestra.run.smithi089.stdout: "hostname": "smithi089", 2023-10-08T15:41:53.212 INFO:teuthology.orchestra.run.smithi089.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-08T15:41:53.212 INFO:teuthology.orchestra.run.smithi089.stdout: "pid": "29198", 2023-10-08T15:41:53.212 INFO:teuthology.orchestra.run.smithi089.stdout: "root": "/" 2023-10-08T15:41:53.212 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-10-08T15:41:53.213 INFO:teuthology.orchestra.run.smithi089.stdout: "dentry_count": 0, 2023-10-08T15:41:53.213 INFO:teuthology.orchestra.run.smithi089.stdout: "dentry_pinned_count": 0, 2023-10-08T15:41:53.213 INFO:teuthology.orchestra.run.smithi089.stdout: "id": 6115, 2023-10-08T15:41:53.213 INFO:teuthology.orchestra.run.smithi089.stdout: "inst": { 2023-10-08T15:41:53.213 INFO:teuthology.orchestra.run.smithi089.stdout: "name": { 2023-10-08T15:41:53.213 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "client", 2023-10-08T15:41:53.213 INFO:teuthology.orchestra.run.smithi089.stdout: "num": 6115 2023-10-08T15:41:53.213 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-10-08T15:41:53.213 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": { 2023-10-08T15:41:53.213 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2023-10-08T15:41:53.213 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:0", 2023-10-08T15:41:53.213 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1087155613 2023-10-08T15:41:53.214 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-10-08T15:41:53.214 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-10-08T15:41:53.214 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": { 2023-10-08T15:41:53.214 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2023-10-08T15:41:53.214 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:0", 2023-10-08T15:41:53.214 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1087155613 2023-10-08T15:41:53.214 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-10-08T15:41:53.214 INFO:teuthology.orchestra.run.smithi089.stdout: "inst_str": "client.6115 172.21.15.89:0/1087155613", 2023-10-08T15:41:53.214 INFO:teuthology.orchestra.run.smithi089.stdout: "addr_str": "172.21.15.89:0/1087155613", 2023-10-08T15:41:53.214 INFO:teuthology.orchestra.run.smithi089.stdout: "inode_count": 1, 2023-10-08T15:41:53.214 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_epoch": 33, 2023-10-08T15:41:53.214 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_epoch": 59, 2023-10-08T15:41:53.215 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_epoch_barrier": 0, 2023-10-08T15:41:53.215 INFO:teuthology.orchestra.run.smithi089.stdout: "blocklisted": false, 2023-10-08T15:41:53.215 INFO:teuthology.orchestra.run.smithi089.stdout: "fs_name": "cephfs" 2023-10-08T15:41:53.215 INFO:teuthology.orchestra.run.smithi089.stdout:} 2023-10-08T15:41:53.221 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:41:53.221 DEBUG:teuthology.orchestra.run.smithi089:> stat --file-system '--printf=%T 2023-10-08T15:41:53.221 DEBUG:teuthology.orchestra.run.smithi089:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-08T15:41:53.229 INFO:teuthology.orchestra.run.smithi089.stdout:fuseblk 2023-10-08T15:41:53.229 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-08T15:41:53.229 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:41:53.229 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-08T15:41:53.294 DEBUG:teuthology.orchestra.run.smithi089:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-08T15:41:53.294 DEBUG:teuthology.orchestra.run.smithi089:> import os 2023-10-08T15:41:53.294 DEBUG:teuthology.orchestra.run.smithi089:> import uuid 2023-10-08T15:41:53.294 DEBUG:teuthology.orchestra.run.smithi089:> 2023-10-08T15:41:53.294 DEBUG:teuthology.orchestra.run.smithi089:> n = 1000 2023-10-08T15:41:53.295 DEBUG:teuthology.orchestra.run.smithi089:> create_hard_links = False 2023-10-08T15:41:53.295 DEBUG:teuthology.orchestra.run.smithi089:> if 0 > 0: 2023-10-08T15:41:53.295 DEBUG:teuthology.orchestra.run.smithi089:> create_hard_links = True 2023-10-08T15:41:53.295 DEBUG:teuthology.orchestra.run.smithi089:> path = "/home/ubuntu/cephtest/mnt.0/dc-dir/dc-file" 2023-10-08T15:41:53.295 DEBUG:teuthology.orchestra.run.smithi089:> 2023-10-08T15:41:53.295 DEBUG:teuthology.orchestra.run.smithi089:> dpath = os.path.dirname(path) 2023-10-08T15:41:53.295 DEBUG:teuthology.orchestra.run.smithi089:> fnameprefix = os.path.basename(path) 2023-10-08T15:41:53.295 DEBUG:teuthology.orchestra.run.smithi089:> os.makedirs(dpath, exist_ok=True) 2023-10-08T15:41:53.295 DEBUG:teuthology.orchestra.run.smithi089:> 2023-10-08T15:41:53.295 DEBUG:teuthology.orchestra.run.smithi089:> try: 2023-10-08T15:41:53.296 DEBUG:teuthology.orchestra.run.smithi089:> dirfd = os.open(dpath, os.O_DIRECTORY) 2023-10-08T15:41:53.296 DEBUG:teuthology.orchestra.run.smithi089:> 2023-10-08T15:41:53.296 DEBUG:teuthology.orchestra.run.smithi089:> for i in range(n): 2023-10-08T15:41:53.296 DEBUG:teuthology.orchestra.run.smithi089:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2023-10-08T15:41:53.296 DEBUG:teuthology.orchestra.run.smithi089:> with open(fpath, '"'"'w'"'"') as f: 2023-10-08T15:41:53.296 DEBUG:teuthology.orchestra.run.smithi089:> f.write(f"{i}") 2023-10-08T15:41:53.296 DEBUG:teuthology.orchestra.run.smithi089:> if True: 2023-10-08T15:41:53.296 DEBUG:teuthology.orchestra.run.smithi089:> f.flush() 2023-10-08T15:41:53.296 DEBUG:teuthology.orchestra.run.smithi089:> os.fsync(f.fileno()) 2023-10-08T15:41:53.296 DEBUG:teuthology.orchestra.run.smithi089:> if False: 2023-10-08T15:41:53.296 DEBUG:teuthology.orchestra.run.smithi089:> os.unlink(fpath) 2023-10-08T15:41:53.296 DEBUG:teuthology.orchestra.run.smithi089:> if False: 2023-10-08T15:41:53.297 DEBUG:teuthology.orchestra.run.smithi089:> os.fsync(dirfd) 2023-10-08T15:41:53.297 DEBUG:teuthology.orchestra.run.smithi089:> if create_hard_links: 2023-10-08T15:41:53.297 DEBUG:teuthology.orchestra.run.smithi089:> for j in range(0): 2023-10-08T15:41:53.297 DEBUG:teuthology.orchestra.run.smithi089:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2023-10-08T15:41:53.297 DEBUG:teuthology.orchestra.run.smithi089:> if False: 2023-10-08T15:41:53.297 DEBUG:teuthology.orchestra.run.smithi089:> os.fsync(dirfd) 2023-10-08T15:41:53.297 DEBUG:teuthology.orchestra.run.smithi089:> finally: 2023-10-08T15:41:53.297 DEBUG:teuthology.orchestra.run.smithi089:> os.close(dirfd) 2023-10-08T15:41:53.297 DEBUG:teuthology.orchestra.run.smithi089:> ' 2023-10-08T15:42:03.765 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:42:03.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:03.866+0000 7f9452141700 1 Processor -- start 2023-10-08T15:42:03.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:03.866+0000 7f9452141700 1 -- start start 2023-10-08T15:42:03.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:03.866+0000 7f9452141700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f944c0670e0 0x7f944c14f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:03.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:03.866+0000 7f9452141700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f944c0674b0 0x7f944c068400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:03.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:03.866+0000 7f9452141700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f944c14bc60 con 0x7f944c069d50 2023-10-08T15:42:03.873 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:03.866+0000 7f9452141700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f944c14c800 con 0x7f944c0674b0 2023-10-08T15:42:03.873 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:03.866+0000 7f9452141700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f944c0678c0 con 0x7f944c0670e0 2023-10-08T15:42:03.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:03.866+0000 7f9451940700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f944c0674b0 0x7f944c068400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:03.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:03.866+0000 7f945093e700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f944c069d50 0x7f944c14c0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.3:52470/0 (socket says 172.21.15.3:52470) 2023-10-08T15:42:03.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:03.866+0000 7f945093e700 1 -- 172.21.15.3:0/3496734463 learned_addr learned my addr 172.21.15.3:0/3496734463 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:42:03.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:03.866+0000 7f9451940700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f944c0674b0 0x7f944c068400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.3:34124/0 (socket says 172.21.15.3:34124) 2023-10-08T15:42:03.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:03.866+0000 7f945113f700 1 --2- 172.21.15.3:0/3496734463 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f944c0670e0 0x7f944c14f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:03.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:03.870+0000 7f9451940700 1 -- 172.21.15.3:0/3496734463 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f944c0670e0 msgr2=0x7f944c14f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:03.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:03.870+0000 7f9451940700 1 --2- 172.21.15.3:0/3496734463 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f944c0670e0 0x7f944c14f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:03.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:03.870+0000 7f9451940700 1 -- 172.21.15.3:0/3496734463 >> v1:172.21.15.50:6789/0 conn(0x7f944c069d50 legacy=0x7f944c14c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:03.875 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:03.870+0000 7f9451940700 1 -- 172.21.15.3:0/3496734463 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f944c14b8f0 con 0x7f944c0674b0 2023-10-08T15:42:03.875 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:03.870+0000 7f9451940700 1 --2- 172.21.15.3:0/3496734463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f944c0674b0 0x7f944c068400 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9444009e60 tx=0x7f9444009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2971a3fca1c44a4c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:03.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:03.870+0000 7f9443fff700 1 -- 172.21.15.3:0/3496734463 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944400e070 con 0x7f944c0674b0 2023-10-08T15:42:03.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:03.870+0000 7f9443fff700 1 -- 172.21.15.3:0/3496734463 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f944400bb60 con 0x7f944c0674b0 2023-10-08T15:42:03.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:03.870+0000 7f9443fff700 1 -- 172.21.15.3:0/3496734463 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9444012430 con 0x7f944c0674b0 2023-10-08T15:42:03.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:03.870+0000 7f9452141700 1 -- 172.21.15.3:0/3496734463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f944c0674b0 msgr2=0x7f944c068400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:03.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:03.870+0000 7f9452141700 1 --2- 172.21.15.3:0/3496734463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f944c0674b0 0x7f944c068400 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9444009e60 tx=0x7f9444009780 comp rx=0 tx=0).stop 2023-10-08T15:42:03.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:03.870+0000 7f9452141700 1 -- 172.21.15.3:0/3496734463 shutdown_connections 2023-10-08T15:42:03.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:03.870+0000 7f9452141700 1 --2- 172.21.15.3:0/3496734463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f944c0674b0 0x7f944c068400 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:03.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:03.870+0000 7f9452141700 1 --2- 172.21.15.3:0/3496734463 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f944c0670e0 0x7f944c14f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:03.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:03.870+0000 7f9452141700 1 -- 172.21.15.3:0/3496734463 >> 172.21.15.3:0/3496734463 conn(0x7f944c06dfb0 msgr2=0x7f944c06e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:03.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:03.870+0000 7f9452141700 1 -- 172.21.15.3:0/3496734463 shutdown_connections 2023-10-08T15:42:03.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:03.870+0000 7f9452141700 1 -- 172.21.15.3:0/3496734463 wait complete. 2023-10-08T15:42:03.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:03.874+0000 7f9452141700 1 Processor -- start 2023-10-08T15:42:03.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:03.874+0000 7f9452141700 1 -- start start 2023-10-08T15:42:03.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:03.874+0000 7f9452141700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f944c0670e0 0x7f944c09b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:03.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:03.874+0000 7f9452141700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f944c0674b0 0x7f944c14e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:03.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:03.874+0000 7f9452141700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f944c069d50 0x7f944c15bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:03.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:03.874+0000 7f9452141700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f944c15b6b0 con 0x7f944c0670e0 2023-10-08T15:42:03.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:03.874+0000 7f9452141700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f944c14e630 con 0x7f944c0674b0 2023-10-08T15:42:03.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:03.874+0000 7f9452141700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f944c09a9c0 con 0x7f944c069d50 2023-10-08T15:42:03.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:03.874+0000 7f945113f700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f944c0670e0 0x7f944c09b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:03.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:03.874+0000 7f945113f700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f944c0670e0 0x7f944c09b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52722/0 (socket says 172.21.15.3:52722) 2023-10-08T15:42:03.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:03.874+0000 7f945113f700 1 -- 172.21.15.3:0/186969361 learned_addr learned my addr 172.21.15.3:0/186969361 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:03.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:03.874+0000 7f9451940700 1 --2- 172.21.15.3:0/186969361 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f944c069d50 0x7f944c15bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:03.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:03.874+0000 7f945093e700 1 --2- 172.21.15.3:0/186969361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f944c0674b0 0x7f944c14e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:03.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:03.874+0000 7f945113f700 1 -- 172.21.15.3:0/186969361 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f944c069d50 msgr2=0x7f944c15bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:03.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:03.874+0000 7f945113f700 1 --2- 172.21.15.3:0/186969361 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f944c069d50 0x7f944c15bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:03.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:03.874+0000 7f945113f700 1 -- 172.21.15.3:0/186969361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f944c0674b0 msgr2=0x7f944c14e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:03.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:03.874+0000 7f945113f700 1 --2- 172.21.15.3:0/186969361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f944c0674b0 0x7f944c14e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:03.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:03.874+0000 7f945113f700 1 -- 172.21.15.3:0/186969361 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9444009a20 con 0x7f944c0670e0 2023-10-08T15:42:03.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:03.874+0000 7f945113f700 1 --2- 172.21.15.3:0/186969361 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f944c0670e0 0x7f944c09b5d0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f943c00ec80 tx=0x7f943c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:03.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:03.874+0000 7f94417fa700 1 -- 172.21.15.3:0/186969361 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943c00c850 con 0x7f944c0670e0 2023-10-08T15:42:03.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:03.874+0000 7f94417fa700 1 -- 172.21.15.3:0/186969361 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f943c00c9b0 con 0x7f944c0670e0 2023-10-08T15:42:03.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:03.874+0000 7f9452141700 1 -- 172.21.15.3:0/186969361 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f944c09aca0 con 0x7f944c0670e0 2023-10-08T15:42:03.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:03.874+0000 7f94417fa700 1 -- 172.21.15.3:0/186969361 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943c00cd50 con 0x7f944c0670e0 2023-10-08T15:42:03.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:03.874+0000 7f9452141700 1 -- 172.21.15.3:0/186969361 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f944c09c320 con 0x7f944c0670e0 2023-10-08T15:42:03.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:03.878+0000 7f9452141700 1 -- 172.21.15.3:0/186969361 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f944c05ecf0 con 0x7f944c0670e0 2023-10-08T15:42:03.883 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:03.878+0000 7f94417fa700 1 -- 172.21.15.3:0/186969361 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f943c013680 con 0x7f944c0670e0 2023-10-08T15:42:03.883 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:03.878+0000 7f94417fa700 1 --2- 172.21.15.3:0/186969361 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f9430060550 0x7f9430062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:03.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:03.878+0000 7f94417fa700 1 -- 172.21.15.3:0/186969361 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f943c07caa0 con 0x7f944c0670e0 2023-10-08T15:42:03.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:03.878+0000 7f945093e700 1 --2- 172.21.15.3:0/186969361 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f9430060550 0x7f9430062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:03.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:03.878+0000 7f945093e700 1 --2- 172.21.15.3:0/186969361 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f9430060550 0x7f9430062a00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f944c09e6b0 tx=0x7f9448000bc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:03.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:03.886+0000 7f94417fa700 1 -- 172.21.15.3:0/186969361 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f943c04d090 con 0x7f944c0670e0 2023-10-08T15:42:04.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.086+0000 7f9452141700 1 -- 172.21.15.3:0/186969361 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f944c14f880 con 0x7f944c0670e0 2023-10-08T15:42:04.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.086+0000 7f94417fa700 1 -- 172.21.15.3:0/186969361 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+3082 (secure 0 0 0) 0x7f943c017c20 con 0x7f944c0670e0 2023-10-08T15:42:04.093 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:42:04.093 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":33,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5480,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1007706158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1007706158},{"type":"v1","addr":"172.21.15.50:6835","nonce":1007706158}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:41:45.889781+0000","modified":"2023-10-08T15:41:48.541276+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6030},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6030":{"gid":6030,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.3:6833/1129612905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":1129612905},{"type":"v1","addr":"172.21.15.3:6833","nonce":1129612905}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-08T15:42:04.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.090+0000 7f9452141700 1 -- 172.21.15.3:0/186969361 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f9430060550 msgr2=0x7f9430062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:04.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.090+0000 7f9452141700 1 --2- 172.21.15.3:0/186969361 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f9430060550 0x7f9430062a00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f944c09e6b0 tx=0x7f9448000bc0 comp rx=0 tx=0).stop 2023-10-08T15:42:04.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.090+0000 7f9452141700 1 -- 172.21.15.3:0/186969361 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f944c0670e0 msgr2=0x7f944c09b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:04.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.090+0000 7f9452141700 1 --2- 172.21.15.3:0/186969361 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f944c0670e0 0x7f944c09b5d0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f943c00ec80 tx=0x7f943c0091a0 comp rx=0 tx=0).stop 2023-10-08T15:42:04.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.090+0000 7f9452141700 1 -- 172.21.15.3:0/186969361 shutdown_connections 2023-10-08T15:42:04.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.090+0000 7f9452141700 1 --2- 172.21.15.3:0/186969361 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f9430060550 0x7f9430062a00 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:04.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.090+0000 7f9452141700 1 --2- 172.21.15.3:0/186969361 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f944c069d50 0x7f944c15bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:04.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.090+0000 7f9452141700 1 --2- 172.21.15.3:0/186969361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f944c0674b0 0x7f944c14e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:04.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.090+0000 7f9452141700 1 --2- 172.21.15.3:0/186969361 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f944c0670e0 0x7f944c09b5d0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:04.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.090+0000 7f9452141700 1 -- 172.21.15.3:0/186969361 >> 172.21.15.3:0/186969361 conn(0x7f944c06dfb0 msgr2=0x7f944c0a1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:04.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.090+0000 7f9452141700 1 -- 172.21.15.3:0/186969361 shutdown_connections 2023-10-08T15:42:04.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.090+0000 7f9452141700 1 -- 172.21.15.3:0/186969361 wait complete. 2023-10-08T15:42:04.097 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 33 2023-10-08T15:42:04.108 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_caps 20 2023-10-08T15:42:04.217 INFO:teuthology.orchestra.run.smithi003.stdout:{"success":"mds_recall_max_caps = '20' (not observed, change may require restart) "} 2023-10-08T15:42:04.218 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_caps = '20' (not observed, change may require restart) " } 2023-10-08T15:42:04.218 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:42:04.324 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.318+0000 7f7477301700 1 Processor -- start 2023-10-08T15:42:04.324 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.318+0000 7f7477301700 1 -- start start 2023-10-08T15:42:04.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.318+0000 7f7477301700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f747014ac50 0x7f747014b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:04.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.318+0000 7f7477301700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f747006be60 0x7f747006c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:04.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.318+0000 7f7477301700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f747006ca70 0x7f747006cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:04.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.318+0000 7f7477301700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f747014c6b0 con 0x7f747006be60 2023-10-08T15:42:04.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.318+0000 7f7477301700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f747014c060 con 0x7f747014ac50 2023-10-08T15:42:04.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.318+0000 7f7477301700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f747014c340 con 0x7f747006ca70 2023-10-08T15:42:04.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.318+0000 7f7475afe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f747006be60 0x7f747006c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:04.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.318+0000 7f7475afe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f747006be60 0x7f747006c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52730/0 (socket says 172.21.15.3:52730) 2023-10-08T15:42:04.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.318+0000 7f7475afe700 1 -- 172.21.15.3:0/4198944742 learned_addr learned my addr 172.21.15.3:0/4198944742 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:04.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.322+0000 7f7476b00700 1 --2- 172.21.15.3:0/4198944742 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f747006ca70 0x7f747006cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:04.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.322+0000 7f74762ff700 1 --2- 172.21.15.3:0/4198944742 >> v2:172.21.15.50:3300/0 conn(0x7f747014ac50 0x7f747014b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:04.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.322+0000 7f7475afe700 1 -- 172.21.15.3:0/4198944742 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f747006ca70 msgr2=0x7f747006cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:04.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.322+0000 7f7475afe700 1 --2- 172.21.15.3:0/4198944742 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f747006ca70 0x7f747006cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:04.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.322+0000 7f7475afe700 1 -- 172.21.15.3:0/4198944742 >> v2:172.21.15.50:3300/0 conn(0x7f747014ac50 msgr2=0x7f747014b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:04.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.322+0000 7f7475afe700 1 --2- 172.21.15.3:0/4198944742 >> v2:172.21.15.50:3300/0 conn(0x7f747014ac50 0x7f747014b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:04.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.322+0000 7f7475afe700 1 -- 172.21.15.3:0/4198944742 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f747014e860 con 0x7f747006be60 2023-10-08T15:42:04.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.322+0000 7f74762ff700 1 --2- 172.21.15.3:0/4198944742 >> v2:172.21.15.50:3300/0 conn(0x7f747014ac50 0x7f747014b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:42:04.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.322+0000 7f7475afe700 1 --2- 172.21.15.3:0/4198944742 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f747006be60 0x7f747006c530 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f7470069ed0 tx=0x7f7460009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef3395950a784391 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:04.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.322+0000 7f74752fd700 1 -- 172.21.15.3:0/4198944742 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746000b860 con 0x7f747006be60 2023-10-08T15:42:04.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.322+0000 7f74752fd700 1 -- 172.21.15.3:0/4198944742 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f746000b9c0 con 0x7f747006be60 2023-10-08T15:42:04.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.322+0000 7f74752fd700 1 -- 172.21.15.3:0/4198944742 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746000bd60 con 0x7f747006be60 2023-10-08T15:42:04.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.322+0000 7f7477301700 1 -- 172.21.15.3:0/4198944742 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f747006be60 msgr2=0x7f747006c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:04.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.322+0000 7f7477301700 1 --2- 172.21.15.3:0/4198944742 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f747006be60 0x7f747006c530 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f7470069ed0 tx=0x7f7460009250 comp rx=0 tx=0).stop 2023-10-08T15:42:04.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.322+0000 7f7477301700 1 -- 172.21.15.3:0/4198944742 shutdown_connections 2023-10-08T15:42:04.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.322+0000 7f7477301700 1 --2- 172.21.15.3:0/4198944742 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f747006ca70 0x7f747006cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:04.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.322+0000 7f7477301700 1 --2- 172.21.15.3:0/4198944742 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f747006be60 0x7f747006c530 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:04.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.322+0000 7f7477301700 1 --2- 172.21.15.3:0/4198944742 >> v2:172.21.15.50:3300/0 conn(0x7f747014ac50 0x7f747014b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:04.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.322+0000 7f7477301700 1 -- 172.21.15.3:0/4198944742 >> 172.21.15.3:0/4198944742 conn(0x7f74700c1df0 msgr2=0x7f74700c21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:04.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.322+0000 7f7477301700 1 -- 172.21.15.3:0/4198944742 shutdown_connections 2023-10-08T15:42:04.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.322+0000 7f7477301700 1 -- 172.21.15.3:0/4198944742 wait complete. 2023-10-08T15:42:04.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.322+0000 7f7477301700 1 Processor -- start 2023-10-08T15:42:04.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.322+0000 7f7477301700 1 -- start start 2023-10-08T15:42:04.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.326+0000 7f7477301700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f747006be60 0x7f747009f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:04.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.326+0000 7f7477301700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f747006ca70 0x7f747009e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:04.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.326+0000 7f7477301700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f747014ac50 0x7f747014a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:04.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.326+0000 7f7477301700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f747015bd30 con 0x7f747014ac50 2023-10-08T15:42:04.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.326+0000 7f7477301700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74701499e0 con 0x7f747006be60 2023-10-08T15:42:04.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.326+0000 7f7477301700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7470149cc0 con 0x7f747006ca70 2023-10-08T15:42:04.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.326+0000 7f7476b00700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f747014ac50 0x7f747014a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:04.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.326+0000 7f7476b00700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f747014ac50 0x7f747014a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52736/0 (socket says 172.21.15.3:52736) 2023-10-08T15:42:04.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.326+0000 7f7476b00700 1 -- 172.21.15.3:0/2939504434 learned_addr learned my addr 172.21.15.3:0/2939504434 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:04.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.326+0000 7f74762ff700 1 --2- 172.21.15.3:0/2939504434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f747006be60 0x7f747009f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:04.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.326+0000 7f7475afe700 1 --2- 172.21.15.3:0/2939504434 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f747006ca70 0x7f747009e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:04.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.326+0000 7f7476b00700 1 -- 172.21.15.3:0/2939504434 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f747006ca70 msgr2=0x7f747009e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:04.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.326+0000 7f7476b00700 1 --2- 172.21.15.3:0/2939504434 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f747006ca70 0x7f747009e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:04.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.326+0000 7f7476b00700 1 -- 172.21.15.3:0/2939504434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f747006be60 msgr2=0x7f747009f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:04.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.326+0000 7f7476b00700 1 --2- 172.21.15.3:0/2939504434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f747006be60 0x7f747009f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:04.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.326+0000 7f7476b00700 1 -- 172.21.15.3:0/2939504434 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74600094f0 con 0x7f747014ac50 2023-10-08T15:42:04.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.326+0000 7f74762ff700 1 --2- 172.21.15.3:0/2939504434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f747006be60 0x7f747009f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:42:04.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.326+0000 7f7476b00700 1 --2- 172.21.15.3:0/2939504434 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f747014ac50 0x7f747014a1e0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f7468009fa0 tx=0x7f7468009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:04.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.326+0000 7f74667fc700 1 -- 172.21.15.3:0/2939504434 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746800ed20 con 0x7f747014ac50 2023-10-08T15:42:04.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.326+0000 7f74667fc700 1 -- 172.21.15.3:0/2939504434 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f746800ee80 con 0x7f747014ac50 2023-10-08T15:42:04.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.326+0000 7f7477301700 1 -- 172.21.15.3:0/2939504434 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f747009f6d0 con 0x7f747014ac50 2023-10-08T15:42:04.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.326+0000 7f74667fc700 1 -- 172.21.15.3:0/2939504434 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7468014670 con 0x7f747014ac50 2023-10-08T15:42:04.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.326+0000 7f7477301700 1 -- 172.21.15.3:0/2939504434 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f747009d600 con 0x7f747014ac50 2023-10-08T15:42:04.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.330+0000 7f74667fc700 1 -- 172.21.15.3:0/2939504434 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f74680149e0 con 0x7f747014ac50 2023-10-08T15:42:04.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.330+0000 7f7477301700 1 -- 172.21.15.3:0/2939504434 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f747005ecf0 con 0x7f747014ac50 2023-10-08T15:42:04.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.330+0000 7f74667fc700 1 --2- 172.21.15.3:0/2939504434 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7454060550 0x7f7454062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:04.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.330+0000 7f74667fc700 1 -- 172.21.15.3:0/2939504434 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f746807cf80 con 0x7f747014ac50 2023-10-08T15:42:04.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.330+0000 7f74762ff700 1 --2- 172.21.15.3:0/2939504434 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7454060550 0x7f7454062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:04.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.330+0000 7f74762ff700 1 --2- 172.21.15.3:0/2939504434 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7454060550 0x7f7454062a00 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f746c006fd0 tx=0x7f746c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:04.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.338+0000 7f74667fc700 1 -- 172.21.15.3:0/2939504434 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f74680acbe0 con 0x7f747014ac50 2023-10-08T15:42:04.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.534+0000 7f7477301700 1 -- 172.21.15.3:0/2939504434 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f747014eb40 con 0x7f747014ac50 2023-10-08T15:42:04.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.534+0000 7f74667fc700 1 -- 172.21.15.3:0/2939504434 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+3082 (secure 0 0 0) 0x7f746804d570 con 0x7f747014ac50 2023-10-08T15:42:04.540 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:42:04.540 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":33,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5480,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1007706158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1007706158},{"type":"v1","addr":"172.21.15.50:6835","nonce":1007706158}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:41:45.889781+0000","modified":"2023-10-08T15:41:48.541276+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6030},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6030":{"gid":6030,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.3:6833/1129612905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":1129612905},{"type":"v1","addr":"172.21.15.3:6833","nonce":1129612905}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-08T15:42:04.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.538+0000 7f7477301700 1 -- 172.21.15.3:0/2939504434 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7454060550 msgr2=0x7f7454062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:04.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.538+0000 7f7477301700 1 --2- 172.21.15.3:0/2939504434 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7454060550 0x7f7454062a00 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f746c006fd0 tx=0x7f746c008040 comp rx=0 tx=0).stop 2023-10-08T15:42:04.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.538+0000 7f7477301700 1 -- 172.21.15.3:0/2939504434 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f747014ac50 msgr2=0x7f747014a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:04.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.538+0000 7f7477301700 1 --2- 172.21.15.3:0/2939504434 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f747014ac50 0x7f747014a1e0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f7468009fa0 tx=0x7f7468009900 comp rx=0 tx=0).stop 2023-10-08T15:42:04.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.538+0000 7f7477301700 1 -- 172.21.15.3:0/2939504434 shutdown_connections 2023-10-08T15:42:04.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.538+0000 7f7477301700 1 --2- 172.21.15.3:0/2939504434 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7454060550 0x7f7454062a00 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:04.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.538+0000 7f7477301700 1 --2- 172.21.15.3:0/2939504434 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f747014ac50 0x7f747014a1e0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:04.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.538+0000 7f7477301700 1 --2- 172.21.15.3:0/2939504434 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f747006ca70 0x7f747009e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:04.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.538+0000 7f7477301700 1 --2- 172.21.15.3:0/2939504434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f747006be60 0x7f747009f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:04.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.538+0000 7f7477301700 1 -- 172.21.15.3:0/2939504434 >> 172.21.15.3:0/2939504434 conn(0x7f74700c1df0 msgr2=0x7f74700670e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:04.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.538+0000 7f7477301700 1 -- 172.21.15.3:0/2939504434 shutdown_connections 2023-10-08T15:42:04.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.538+0000 7f7477301700 1 -- 172.21.15.3:0/2939504434 wait complete. 2023-10-08T15:42:04.544 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 33 2023-10-08T15:42:04.555 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_decay_threshold 400 2023-10-08T15:42:04.659 INFO:teuthology.orchestra.run.smithi003.stdout:{"success":"mds_recall_max_decay_threshold = '400' (not observed, change may require restart) "} 2023-10-08T15:42:04.659 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_decay_threshold = '400' (not observed, change may require restart) " } 2023-10-08T15:42:04.660 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 cache drop 10 2023-10-08T15:42:04.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.774+0000 7ff935f06700 1 Processor -- start 2023-10-08T15:42:04.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.774+0000 7ff935f06700 1 -- start start 2023-10-08T15:42:04.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.774+0000 7ff935f06700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7ff9300a0d30 0x7ff93014d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:04.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.774+0000 7ff935f06700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff930068d00 0x7ff9301482c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:04.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.774+0000 7ff935f06700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9300b22b0 con 0x7ff9300beb80 2023-10-08T15:42:04.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.774+0000 7ff935f06700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9300b28e0 con 0x7ff9300a0d30 2023-10-08T15:42:04.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.774+0000 7ff935f06700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff93006ac40 con 0x7ff930068d00 2023-10-08T15:42:04.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.774+0000 7ff92ffff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7ff9300a0d30 0x7ff93014d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:04.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.774+0000 7ff934f04700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7ff9300beb80 0x7ff93014c9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:44340/0 (socket says 172.21.15.3:44340) 2023-10-08T15:42:04.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.774+0000 7ff934f04700 1 -- 172.21.15.3:0/1251233946 learned_addr learned my addr 172.21.15.3:0/1251233946 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:42:04.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.774+0000 7ff92ffff700 1 -- 172.21.15.3:0/1251233946 >> v2:172.21.15.50:3300/0 conn(0x7ff930068d00 msgr2=0x7ff9301482c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:04.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.774+0000 7ff935705700 1 --2- 172.21.15.3:0/1251233946 >> v2:172.21.15.50:3300/0 conn(0x7ff930068d00 0x7ff9301482c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:04.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.774+0000 7ff92ffff700 1 --2- 172.21.15.3:0/1251233946 >> v2:172.21.15.50:3300/0 conn(0x7ff930068d00 0x7ff9301482c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:04.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.774+0000 7ff92f7fe700 1 -- 172.21.15.3:0/1251233946 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1905828006 0 0) 0x7ff9300b22b0 con 0x7ff9300beb80 2023-10-08T15:42:04.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.774+0000 7ff92ffff700 1 -- 172.21.15.3:0/1251233946 >> v1:172.21.15.3:6789/0 conn(0x7ff9300beb80 legacy=0x7ff93014c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:04.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.774+0000 7ff92ffff700 1 -- 172.21.15.3:0/1251233946 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff930069de0 con 0x7ff9300a0d30 2023-10-08T15:42:04.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.774+0000 7ff935705700 1 --2- 172.21.15.3:0/1251233946 >> v2:172.21.15.50:3300/0 conn(0x7ff930068d00 0x7ff9301482c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:42:04.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.774+0000 7ff92ffff700 1 --2- 172.21.15.3:0/1251233946 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff9300a0d30 0x7ff93014d0d0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7ff93006b3d0 tx=0x7ff91c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e41b0bf346f2895b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:04.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.774+0000 7ff92f7fe700 1 -- 172.21.15.3:0/1251233946 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91c00b6b0 con 0x7ff9300a0d30 2023-10-08T15:42:04.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.774+0000 7ff92f7fe700 1 -- 172.21.15.3:0/1251233946 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff91c00b810 con 0x7ff9300a0d30 2023-10-08T15:42:04.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.774+0000 7ff92f7fe700 1 -- 172.21.15.3:0/1251233946 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91c00bbb0 con 0x7ff9300a0d30 2023-10-08T15:42:04.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.774+0000 7ff935f06700 1 -- 172.21.15.3:0/1251233946 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff9300a0d30 msgr2=0x7ff93014d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:04.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.778+0000 7ff935f06700 1 --2- 172.21.15.3:0/1251233946 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff9300a0d30 0x7ff93014d0d0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7ff93006b3d0 tx=0x7ff91c0091a0 comp rx=0 tx=0).stop 2023-10-08T15:42:04.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.778+0000 7ff935f06700 1 -- 172.21.15.3:0/1251233946 shutdown_connections 2023-10-08T15:42:04.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.778+0000 7ff935f06700 1 --2- 172.21.15.3:0/1251233946 >> v2:172.21.15.50:3300/0 conn(0x7ff930068d00 0x7ff9301482c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:04.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.778+0000 7ff935f06700 1 --2- 172.21.15.3:0/1251233946 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff9300a0d30 0x7ff93014d0d0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:04.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.778+0000 7ff935f06700 1 -- 172.21.15.3:0/1251233946 >> 172.21.15.3:0/1251233946 conn(0x7ff930067b60 msgr2=0x7ff9300be240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:04.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.778+0000 7ff935f06700 1 -- 172.21.15.3:0/1251233946 shutdown_connections 2023-10-08T15:42:04.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.778+0000 7ff935f06700 1 -- 172.21.15.3:0/1251233946 wait complete. 2023-10-08T15:42:04.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.778+0000 7ff935f06700 1 Processor -- start 2023-10-08T15:42:04.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.778+0000 7ff935f06700 1 -- start start 2023-10-08T15:42:04.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.778+0000 7ff935f06700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff930068d00 0x7ff93014c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:04.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.778+0000 7ff935f06700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9300a0d30 0x7ff93015b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:04.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.778+0000 7ff935f06700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff9300beb80 0x7ff9300bd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:04.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.778+0000 7ff935f06700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9300baa70 con 0x7ff930068d00 2023-10-08T15:42:04.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.778+0000 7ff935f06700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff93015b9e0 con 0x7ff9300a0d30 2023-10-08T15:42:04.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.778+0000 7ff935f06700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9300bda30 con 0x7ff9300beb80 2023-10-08T15:42:04.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.778+0000 7ff934f04700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff930068d00 0x7ff93014c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:04.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.778+0000 7ff934f04700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff930068d00 0x7ff93014c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52740/0 (socket says 172.21.15.3:52740) 2023-10-08T15:42:04.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.778+0000 7ff934f04700 1 -- 172.21.15.3:0/853586453 learned_addr learned my addr 172.21.15.3:0/853586453 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:04.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.778+0000 7ff92ffff700 1 --2- 172.21.15.3:0/853586453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9300a0d30 0x7ff93015b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:04.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.778+0000 7ff935705700 1 --2- 172.21.15.3:0/853586453 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff9300beb80 0x7ff9300bd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:04.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.778+0000 7ff934f04700 1 -- 172.21.15.3:0/853586453 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff9300beb80 msgr2=0x7ff9300bd4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:04.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.778+0000 7ff934f04700 1 --2- 172.21.15.3:0/853586453 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff9300beb80 0x7ff9300bd4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:04.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.778+0000 7ff934f04700 1 -- 172.21.15.3:0/853586453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9300a0d30 msgr2=0x7ff93015b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:04.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.778+0000 7ff934f04700 1 --2- 172.21.15.3:0/853586453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9300a0d30 0x7ff93015b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:04.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.778+0000 7ff934f04700 1 -- 172.21.15.3:0/853586453 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff91c009420 con 0x7ff930068d00 2023-10-08T15:42:04.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.778+0000 7ff92ffff700 1 --2- 172.21.15.3:0/853586453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9300a0d30 0x7ff93015b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:42:04.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.778+0000 7ff935705700 1 --2- 172.21.15.3:0/853586453 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff9300beb80 0x7ff9300bd4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:42:04.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.778+0000 7ff934f04700 1 --2- 172.21.15.3:0/853586453 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff930068d00 0x7ff93014c1b0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7ff92400c810 tx=0x7ff924007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:04.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.778+0000 7ff92cff9700 1 -- 172.21.15.3:0/853586453 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff924005b30 con 0x7ff930068d00 2023-10-08T15:42:04.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.778+0000 7ff92cff9700 1 -- 172.21.15.3:0/853586453 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff924005c90 con 0x7ff930068d00 2023-10-08T15:42:04.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.778+0000 7ff935f06700 1 -- 172.21.15.3:0/853586453 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9300ba420 con 0x7ff930068d00 2023-10-08T15:42:04.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.778+0000 7ff92cff9700 1 -- 172.21.15.3:0/853586453 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff924007300 con 0x7ff930068d00 2023-10-08T15:42:04.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.778+0000 7ff935f06700 1 -- 172.21.15.3:0/853586453 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff93006e5d0 con 0x7ff930068d00 2023-10-08T15:42:04.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.782+0000 7ff939411740 1 Processor -- start 2023-10-08T15:42:04.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.782+0000 7ff92cff9700 1 -- 172.21.15.3:0/853586453 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff92401b400 con 0x7ff930068d00 2023-10-08T15:42:04.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.782+0000 7ff939411740 1 -- start start 2023-10-08T15:42:04.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.782+0000 7ff92cff9700 1 --2- 172.21.15.3:0/853586453 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff9140605d0 0x7ff914062a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:04.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.782+0000 7ff92cff9700 1 -- 172.21.15.3:0/853586453 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff92407c3c0 con 0x7ff930068d00 2023-10-08T15:42:04.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.782+0000 7ff939411740 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1de8c20 0x2020730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:04.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.782+0000 7ff939411740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1de8850 0x201db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:04.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.782+0000 7ff939411740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e338d0 0x201e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:04.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.782+0000 7ff939411740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f941b0 con 0x1de8850 2023-10-08T15:42:04.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.782+0000 7ff939411740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f90150 con 0x1e338d0 2023-10-08T15:42:04.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.782+0000 7ff939411740 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x1f56090 con 0x1de8c20 2023-10-08T15:42:04.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.782+0000 7ff935705700 1 --2- 172.21.15.3:0/853586453 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff9140605d0 0x7ff914062a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:04.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.782+0000 7ff92ffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1de8850 0x201db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:04.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.782+0000 7ff92ffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1de8850 0x201db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52742/0 (socket says 172.21.15.3:52742) 2023-10-08T15:42:04.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.782+0000 7ff92ffff700 1 -- 172.21.15.3:0/2712982806 learned_addr learned my addr 172.21.15.3:0/2712982806 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:04.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.782+0000 7ff935705700 1 --2- 172.21.15.3:0/2712982806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e338d0 0x201e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:04.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.782+0000 7ff934f04700 1 --2- 172.21.15.3:0/2712982806 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1de8c20 0x2020730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:04.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.782+0000 7ff92ffff700 1 -- 172.21.15.3:0/2712982806 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1de8c20 msgr2=0x2020730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:04.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.782+0000 7ff92ffff700 1 --2- 172.21.15.3:0/2712982806 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1de8c20 0x2020730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:04.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.782+0000 7ff92ffff700 1 -- 172.21.15.3:0/2712982806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e338d0 msgr2=0x201e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:04.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.782+0000 7ff92ffff700 1 --2- 172.21.15.3:0/2712982806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e338d0 0x201e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:04.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.782+0000 7ff92ffff700 1 -- 172.21.15.3:0/2712982806 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1e34b20 con 0x1de8850 2023-10-08T15:42:04.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.786+0000 7ff92ffff700 1 --2- 172.21.15.3:0/2712982806 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1de8850 0x201db70 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7ff91c013000 tx=0x7ff91c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e51818e28db6d61a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:04.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.786+0000 7ff935705700 1 --2- 172.21.15.3:0/853586453 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff9140605d0 0x7ff914062a80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff928011990 tx=0x7ff928007670 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:04.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.786+0000 7ff919ffb700 1 -- 172.21.15.3:0/2712982806 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91c000c40 con 0x1de8850 2023-10-08T15:42:04.794 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.786+0000 7ff919ffb700 1 -- 172.21.15.3:0/2712982806 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff91c00b980 con 0x1de8850 2023-10-08T15:42:04.794 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.786+0000 7ff919ffb700 1 -- 172.21.15.3:0/2712982806 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91c01a450 con 0x1de8850 2023-10-08T15:42:04.794 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.786+0000 7ff939411740 1 -- 172.21.15.3:0/2712982806 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1de8850 msgr2=0x201db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:04.794 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.786+0000 7ff939411740 1 --2- 172.21.15.3:0/2712982806 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1de8850 0x201db70 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7ff91c013000 tx=0x7ff91c017000 comp rx=0 tx=0).stop 2023-10-08T15:42:04.794 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.786+0000 7ff939411740 1 -- 172.21.15.3:0/2712982806 shutdown_connections 2023-10-08T15:42:04.794 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.786+0000 7ff939411740 1 --2- 172.21.15.3:0/2712982806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e338d0 0x201e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:04.794 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.786+0000 7ff939411740 1 --2- 172.21.15.3:0/2712982806 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1de8850 0x201db70 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:04.794 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.786+0000 7ff939411740 1 --2- 172.21.15.3:0/2712982806 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1de8c20 0x2020730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:04.794 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.786+0000 7ff939411740 1 -- 172.21.15.3:0/2712982806 >> 172.21.15.3:0/2712982806 conn(0x1de8ff0 msgr2=0x201c450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:04.794 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.786+0000 7ff939411740 1 -- 172.21.15.3:0/2712982806 shutdown_connections 2023-10-08T15:42:04.795 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.786+0000 7ff939411740 1 -- 172.21.15.3:0/2712982806 wait complete. 2023-10-08T15:42:04.795 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.786+0000 7ff939411740 1 -- start start 2023-10-08T15:42:04.795 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.786+0000 7ff939411740 1 Processor -- start 2023-10-08T15:42:04.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.786+0000 7ff939411740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1de8850 0x205b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:04.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.786+0000 7ff939411740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1de8c20 0x205b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:04.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.786+0000 7ff939411740 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1e338d0 0x205bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:04.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.786+0000 7ff939411740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f55d30 con 0x1de8850 2023-10-08T15:42:04.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.786+0000 7ff934f04700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1de8850 0x205b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:04.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.786+0000 7ff939411740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f2ebc0 con 0x1de8c20 2023-10-08T15:42:04.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.786+0000 7ff939411740 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x1f0eb70 con 0x1e338d0 2023-10-08T15:42:04.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.786+0000 7ff934f04700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1de8850 0x205b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52746/0 (socket says 172.21.15.3:52746) 2023-10-08T15:42:04.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.786+0000 7ff934f04700 1 -- 172.21.15.3:0/3658417477 learned_addr learned my addr 172.21.15.3:0/3658417477 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:04.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.786+0000 7ff939411740 10 client.0 _ll_register_callbacks cb 0x1f32ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T15:42:04.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.786+0000 7ff92ffff700 1 --2- 172.21.15.3:0/3658417477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1de8c20 0x205b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:04.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.786+0000 7ff935705700 1 --2- 172.21.15.3:0/3658417477 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1e338d0 0x205bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:04.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.786+0000 7ff934f04700 1 -- 172.21.15.3:0/3658417477 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1e338d0 msgr2=0x205bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:04.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.786+0000 7ff934f04700 1 --2- 172.21.15.3:0/3658417477 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1e338d0 0x205bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:04.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.786+0000 7ff934f04700 1 -- 172.21.15.3:0/3658417477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1de8c20 msgr2=0x205b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:04.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.786+0000 7ff934f04700 1 --2- 172.21.15.3:0/3658417477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1de8c20 0x205b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:04.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.786+0000 7ff934f04700 1 -- 172.21.15.3:0/3658417477 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff930069de0 con 0x1de8850 2023-10-08T15:42:04.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.786+0000 7ff934f04700 1 --2- 172.21.15.3:0/3658417477 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1de8850 0x205b160 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7ff92400cfd0 tx=0x7ff92407a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=902f0539bd464e8f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:04.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.786+0000 7ff90effd700 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2023-10-08T15:42:04.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.786+0000 7ff90effd700 1 -- 172.21.15.3:0/3658417477 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff924005e00 con 0x1de8850 2023-10-08T15:42:04.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.786+0000 7ff939411740 1 -- 172.21.15.3:0/3658417477 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1f52e20 con 0x1de8850 2023-10-08T15:42:04.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.786+0000 7ff90effd700 1 -- 172.21.15.3:0/3658417477 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(59..59 src has 1..59) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff9240076f0 con 0x1de8850 2023-10-08T15:42:04.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.790+0000 7ff90effd700 1 -- 172.21.15.3:0/3658417477 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff9240508f0 con 0x1de8850 2023-10-08T15:42:04.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.790+0000 7ff939411740 10 client.6198 fetch_fsmap learned FSMap version 33 2023-10-08T15:42:04.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.790+0000 7ff939411740 1 -- 172.21.15.3:0/3658417477 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x1f5e450 con 0x1de8850 2023-10-08T15:42:04.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.790+0000 7ff90effd700 1 -- 172.21.15.3:0/3658417477 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1f52e20 con 0x1de8850 2023-10-08T15:42:04.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.790+0000 7ff90effd700 1 -- 172.21.15.3:0/3658417477 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 33) v1 ==== 2010+0+0 (secure 0 0 0) 0x7ff92404fb40 con 0x1de8850 2023-10-08T15:42:04.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.790+0000 7ff939411740 10 client.6198 fetch_fsmap finished waiting for FSMap version 33 2023-10-08T15:42:04.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.790+0000 7ff939411740 10 client.6198 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2023-10-08T15:42:04.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.790+0000 7ff939411740 20 client.6198 populate_metadata read hostname 'smithi003' 2023-10-08T15:42:04.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.790+0000 7ff939411740 1 --2- 172.21.15.3:0/3658417477 >> [v2:172.21.15.3:6832/1129612905,v1:172.21.15.3:6833/1129612905] conn(0x2024590 0x2066cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:04.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.790+0000 7ff939411740 4 client.6198 mds_command: new command op to 6030 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-08T15:42:04.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.790+0000 7ff939411740 1 -- 172.21.15.3:0/3658417477 --> [v2:172.21.15.3:6832/1129612905,v1:172.21.15.3:6833/1129612905] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1f32700 con 0x2024590 2023-10-08T15:42:04.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.790+0000 7ff92ffff700 1 --2- 172.21.15.3:0/3658417477 >> [v2:172.21.15.3:6832/1129612905,v1:172.21.15.3:6833/1129612905] conn(0x2024590 0x2066cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:04.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.790+0000 7ff92ffff700 1 --2- 172.21.15.3:0/3658417477 >> [v2:172.21.15.3:6832/1129612905,v1:172.21.15.3:6833/1129612905] conn(0x2024590 0x2066cf0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7a28f60245f517c server_cookie=1b8d6751d2bf319e in_seq=0 out_seq=0 2023-10-08T15:42:04.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.790+0000 7ff90effd700 10 client.6198 ms_handle_connect on v2:172.21.15.3:6832/1129612905 2023-10-08T15:42:04.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.790+0000 7ff90effd700 1 -- 172.21.15.3:0/3658417477 <== mds.0 v2:172.21.15.3:6832/1129612905 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x1f32700 con 0x2024590 2023-10-08T15:42:04.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.790+0000 7ff90effd700 10 client.6198 handle_command_reply: tid=0 2023-10-08T15:42:04.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.790+0000 7ff939411740 1 client.6198 shutdown 2023-10-08T15:42:04.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.790+0000 7ff939411740 1 -- 172.21.15.3:0/3658417477 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1de8850 msgr2=0x205b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:04.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.790+0000 7ff939411740 1 --2- 172.21.15.3:0/3658417477 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1de8850 0x205b160 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7ff92400cfd0 tx=0x7ff92407a7a0 comp rx=0 tx=0).stop 2023-10-08T15:42:04.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.790+0000 7ff939411740 1 -- 172.21.15.3:0/3658417477 shutdown_connections 2023-10-08T15:42:04.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.790+0000 7ff939411740 1 --2- 172.21.15.3:0/3658417477 >> [v2:172.21.15.3:6832/1129612905,v1:172.21.15.3:6833/1129612905] conn(0x2024590 0x2066cf0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:04.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.790+0000 7ff939411740 1 --2- 172.21.15.3:0/3658417477 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1e338d0 0x205bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:04.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.790+0000 7ff90effd700 0 client.6198 ms_handle_reset on v2:172.21.15.3:6832/1129612905 2023-10-08T15:42:04.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.790+0000 7ff939411740 1 --2- 172.21.15.3:0/3658417477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1de8c20 0x205b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:04.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.790+0000 7ff939411740 1 --2- 172.21.15.3:0/3658417477 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1de8850 0x205b160 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:04.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.790+0000 7ff939411740 1 -- 172.21.15.3:0/3658417477 >> 172.21.15.3:0/3658417477 conn(0x1de8ff0 msgr2=0x201c450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:04.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.790+0000 7ff939411740 1 -- 172.21.15.3:0/3658417477 shutdown_connections 2023-10-08T15:42:04.804 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.790+0000 7ff939411740 1 -- 172.21.15.3:0/3658417477 wait complete. 2023-10-08T15:42:04.804 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.790+0000 7ff939411740 20 client.6198 trim_cache size 0 max 16384 2023-10-08T15:42:04.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.806+0000 7ff939411740 1 Processor -- start 2023-10-08T15:42:04.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.806+0000 7ff939411740 1 -- start start 2023-10-08T15:42:04.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.806+0000 7ff939411740 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1de8850 0x205f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:04.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.806+0000 7ff939411740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1de8c20 0x205fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:04.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.806+0000 7ff939411740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e338d0 0x2060240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:04.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.806+0000 7ff939411740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f633b0 con 0x1de8c20 2023-10-08T15:42:04.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.806+0000 7ff939411740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f8bdd0 con 0x1e338d0 2023-10-08T15:42:04.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.806+0000 7ff939411740 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x1f3d900 con 0x1de8850 2023-10-08T15:42:04.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.806+0000 7ff92ffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1de8c20 0x205fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:04.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.806+0000 7ff92ffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1de8c20 0x205fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52750/0 (socket says 172.21.15.3:52750) 2023-10-08T15:42:04.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.806+0000 7ff92ffff700 1 -- 172.21.15.3:0/880692228 learned_addr learned my addr 172.21.15.3:0/880692228 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:04.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.806+0000 7ff935705700 1 --2- 172.21.15.3:0/880692228 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e338d0 0x2060240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:04.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.806+0000 7ff934f04700 1 --2- 172.21.15.3:0/880692228 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1de8850 0x205f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:04.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.806+0000 7ff92ffff700 1 -- 172.21.15.3:0/880692228 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1de8850 msgr2=0x205f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:04.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.806+0000 7ff92ffff700 1 --2- 172.21.15.3:0/880692228 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1de8850 0x205f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:04.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.806+0000 7ff92ffff700 1 -- 172.21.15.3:0/880692228 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e338d0 msgr2=0x2060240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:04.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.806+0000 7ff92ffff700 1 --2- 172.21.15.3:0/880692228 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e338d0 0x2060240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:04.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.806+0000 7ff92ffff700 1 -- 172.21.15.3:0/880692228 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1f44e60 con 0x1de8c20 2023-10-08T15:42:04.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.806+0000 7ff92ffff700 1 --2- 172.21.15.3:0/880692228 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1de8c20 0x205fd00 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7ff91c003080 tx=0x7ff91c034250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46600b757da1bf40 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:04.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.806+0000 7ff91a7fc700 1 -- 172.21.15.3:0/880692228 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91c000bc0 con 0x1de8c20 2023-10-08T15:42:04.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.806+0000 7ff91a7fc700 1 -- 172.21.15.3:0/880692228 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff91c01a800 con 0x1de8c20 2023-10-08T15:42:04.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.806+0000 7ff91a7fc700 1 -- 172.21.15.3:0/880692228 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91c000d20 con 0x1de8c20 2023-10-08T15:42:04.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.806+0000 7ff939411740 1 -- 172.21.15.3:0/880692228 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1de8c20 msgr2=0x205fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:04.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.806+0000 7ff939411740 1 --2- 172.21.15.3:0/880692228 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1de8c20 0x205fd00 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7ff91c003080 tx=0x7ff91c034250 comp rx=0 tx=0).stop 2023-10-08T15:42:04.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.806+0000 7ff939411740 1 -- 172.21.15.3:0/880692228 shutdown_connections 2023-10-08T15:42:04.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.806+0000 7ff939411740 1 --2- 172.21.15.3:0/880692228 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e338d0 0x2060240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:04.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.806+0000 7ff939411740 1 --2- 172.21.15.3:0/880692228 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1de8c20 0x205fd00 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:04.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.806+0000 7ff939411740 1 --2- 172.21.15.3:0/880692228 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1de8850 0x205f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:04.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.806+0000 7ff939411740 1 -- 172.21.15.3:0/880692228 >> 172.21.15.3:0/880692228 conn(0x1de8ff0 msgr2=0x205b3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:04.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.806+0000 7ff939411740 1 -- 172.21.15.3:0/880692228 shutdown_connections 2023-10-08T15:42:04.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.806+0000 7ff939411740 1 -- 172.21.15.3:0/880692228 wait complete. 2023-10-08T15:42:04.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.810+0000 7ff939411740 1 -- start start 2023-10-08T15:42:04.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.810+0000 7ff939411740 1 Processor -- start 2023-10-08T15:42:04.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.810+0000 7ff939411740 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1de8850 0x20b0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:04.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.810+0000 7ff939411740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1de8c20 0x20b1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:04.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.810+0000 7ff939411740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1e338d0 0x2078b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:04.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.810+0000 7ff939411740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x1de6570 con 0x1e338d0 2023-10-08T15:42:04.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.810+0000 7ff939411740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f93380 con 0x1de8c20 2023-10-08T15:42:04.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.810+0000 7ff939411740 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x1f930f0 con 0x1de8850 2023-10-08T15:42:04.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.810+0000 7ff935705700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1e338d0 0x2078b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:04.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.810+0000 7ff939411740 10 client.0 _ll_register_callbacks cb 0x7ff91c009c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T15:42:04.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.810+0000 7ff935705700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1e338d0 0x2078b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52764/0 (socket says 172.21.15.3:52764) 2023-10-08T15:42:04.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.810+0000 7ff935705700 1 -- 172.21.15.3:0/2440719207 learned_addr learned my addr 172.21.15.3:0/2440719207 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:04.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.810+0000 7ff934f04700 1 --2- 172.21.15.3:0/2440719207 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1de8850 0x20b0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:04.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.810+0000 7ff92ffff700 1 --2- 172.21.15.3:0/2440719207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1de8c20 0x20b1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:04.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.810+0000 7ff935705700 1 -- 172.21.15.3:0/2440719207 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1de8850 msgr2=0x20b0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:04.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.810+0000 7ff935705700 1 --2- 172.21.15.3:0/2440719207 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1de8850 0x20b0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:04.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.810+0000 7ff935705700 1 -- 172.21.15.3:0/2440719207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1de8c20 msgr2=0x20b1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:04.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.810+0000 7ff935705700 1 --2- 172.21.15.3:0/2440719207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1de8c20 0x20b1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:04.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.810+0000 7ff935705700 1 -- 172.21.15.3:0/2440719207 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1e34b20 con 0x1e338d0 2023-10-08T15:42:04.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.810+0000 7ff92ffff700 1 --2- 172.21.15.3:0/2440719207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1de8c20 0x20b1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:42:04.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.810+0000 7ff935705700 1 --2- 172.21.15.3:0/2440719207 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1e338d0 0x2078b60 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7ff92800df90 tx=0x7ff928017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=670b63751d3150c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:04.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.810+0000 7ff90effd700 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2023-10-08T15:42:04.821 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.810+0000 7ff90effd700 1 -- 172.21.15.3:0/2440719207 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92800f610 con 0x1e338d0 2023-10-08T15:42:04.821 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.810+0000 7ff90effd700 1 -- 172.21.15.3:0/2440719207 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(59..59 src has 1..59) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff92800f770 con 0x1e338d0 2023-10-08T15:42:04.821 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.810+0000 7ff939411740 1 -- 172.21.15.3:0/2440719207 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff91c00b980 con 0x1e338d0 2023-10-08T15:42:04.821 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.810+0000 7ff90effd700 1 -- 172.21.15.3:0/2440719207 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff92800fb40 con 0x1e338d0 2023-10-08T15:42:04.821 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.810+0000 7ff939411740 10 client.6204 fetch_fsmap learned FSMap version 33 2023-10-08T15:42:04.821 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.810+0000 7ff939411740 1 -- 172.21.15.3:0/2440719207 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x1f39210 con 0x1e338d0 2023-10-08T15:42:04.821 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.810+0000 7ff90effd700 1 -- 172.21.15.3:0/2440719207 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff91c00b980 con 0x1e338d0 2023-10-08T15:42:04.821 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.810+0000 7ff90effd700 1 -- 172.21.15.3:0/2440719207 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 33) v1 ==== 2010+0+0 (secure 0 0 0) 0x7ff92800fca0 con 0x1e338d0 2023-10-08T15:42:04.821 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.810+0000 7ff939411740 10 client.6204 fetch_fsmap finished waiting for FSMap version 33 2023-10-08T15:42:04.821 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.810+0000 7ff939411740 10 client.6204 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2023-10-08T15:42:04.821 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.810+0000 7ff939411740 20 client.6204 populate_metadata read hostname 'smithi003' 2023-10-08T15:42:04.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.810+0000 7ff939411740 1 --2- 172.21.15.3:0/2440719207 >> [v2:172.21.15.3:6832/1129612905,v1:172.21.15.3:6833/1129612905] conn(0x2079a80 0x2079e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:04.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.810+0000 7ff939411740 4 client.6204 mds_command: new command op to 6030 tid=0[{"prefix": "cache drop", "timeout": 10}] 2023-10-08T15:42:04.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.810+0000 7ff939411740 1 -- 172.21.15.3:0/2440719207 --> [v2:172.21.15.3:6832/1129612905,v1:172.21.15.3:6833/1129612905] -- command(tid 0: {"prefix": "cache drop", "timeout": 10}) v1 -- 0x1f32420 con 0x2079a80 2023-10-08T15:42:04.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.810+0000 7ff934f04700 1 --2- 172.21.15.3:0/2440719207 >> [v2:172.21.15.3:6832/1129612905,v1:172.21.15.3:6833/1129612905] conn(0x2079a80 0x2079e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:04.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.814+0000 7ff934f04700 1 --2- 172.21.15.3:0/2440719207 >> [v2:172.21.15.3:6832/1129612905,v1:172.21.15.3:6833/1129612905] conn(0x2079a80 0x2079e80 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=daed9689dcb992f2 server_cookie=3d1319c96db852b1 in_seq=0 out_seq=0 2023-10-08T15:42:04.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:04.814+0000 7ff90effd700 10 client.6204 ms_handle_connect on v2:172.21.15.3:6832/1129612905 2023-10-08T15:42:07.416 DEBUG:teuthology.orchestra.run.smithi003:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:42:07.419 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:42:07.421 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:42:07.424 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:42:07.426 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:42:15.020 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.013+0000 7ff90effd700 1 -- 172.21.15.3:0/2440719207 <== mds.0 v2:172.21.15.3:6832/1129612905 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+400 (crc 0 0 0) 0x1f32420 con 0x2079a80 2023-10-08T15:42:15.021 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.013+0000 7ff90effd700 10 client.6204 handle_command_reply: tid=0 2023-10-08T15:42:15.021 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.013+0000 7ff939411740 1 client.6204 shutdown 2023-10-08T15:42:15.021 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.013+0000 7ff939411740 1 -- 172.21.15.3:0/2440719207 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1e338d0 msgr2=0x2078b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:15.021 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.013+0000 7ff939411740 1 --2- 172.21.15.3:0/2440719207 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1e338d0 0x2078b60 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7ff92800df90 tx=0x7ff928017000 comp rx=0 tx=0).stop 2023-10-08T15:42:15.021 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.013+0000 7ff939411740 1 -- 172.21.15.3:0/2440719207 shutdown_connections 2023-10-08T15:42:15.021 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.013+0000 7ff939411740 1 --2- 172.21.15.3:0/2440719207 >> [v2:172.21.15.3:6832/1129612905,v1:172.21.15.3:6833/1129612905] conn(0x2079a80 0x2079e80 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:15.021 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.013+0000 7ff939411740 1 --2- 172.21.15.3:0/2440719207 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x1e338d0 0x2078b60 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:15.021 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.013+0000 7ff939411740 1 --2- 172.21.15.3:0/2440719207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1de8c20 0x20b1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:15.021 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.013+0000 7ff939411740 1 --2- 172.21.15.3:0/2440719207 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x1de8850 0x20b0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:15.022 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.013+0000 7ff939411740 1 -- 172.21.15.3:0/2440719207 >> 172.21.15.3:0/2440719207 conn(0x1de8ff0 msgr2=0x205e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:15.022 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.013+0000 7ff90effd700 0 client.6204 ms_handle_reset on v2:172.21.15.3:6832/1129612905 2023-10-08T15:42:15.022 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.013+0000 7ff939411740 1 -- 172.21.15.3:0/2440719207 shutdown_connections 2023-10-08T15:42:15.022 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.013+0000 7ff939411740 1 -- 172.21.15.3:0/2440719207 wait complete. 2023-10-08T15:42:15.022 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.013+0000 7ff939411740 20 client.6204 trim_cache size 0 max 16384 2023-10-08T15:42:15.022 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2023-10-08T15:42:15.022 INFO:teuthology.orchestra.run.smithi003.stdout: "client_recall": { 2023-10-08T15:42:15.022 INFO:teuthology.orchestra.run.smithi003.stdout: "return_code": -110, 2023-10-08T15:42:15.023 INFO:teuthology.orchestra.run.smithi003.stdout: "message": "(110) Connection timed out", 2023-10-08T15:42:15.023 INFO:teuthology.orchestra.run.smithi003.stdout: "recalled": 240 2023-10-08T15:42:15.023 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:42:15.023 INFO:teuthology.orchestra.run.smithi003.stdout: "flush_journal": { 2023-10-08T15:42:15.023 INFO:teuthology.orchestra.run.smithi003.stdout: "return_code": 0, 2023-10-08T15:42:15.023 INFO:teuthology.orchestra.run.smithi003.stdout: "message": "" 2023-10-08T15:42:15.023 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:42:15.023 INFO:teuthology.orchestra.run.smithi003.stdout: "trim_cache": { 2023-10-08T15:42:15.023 INFO:teuthology.orchestra.run.smithi003.stdout: "trimmed": 100 2023-10-08T15:42:15.023 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:42:15.023 INFO:teuthology.orchestra.run.smithi003.stdout: "cache": { 2023-10-08T15:42:15.023 INFO:teuthology.orchestra.run.smithi003.stdout: "pool": { 2023-10-08T15:42:15.024 INFO:teuthology.orchestra.run.smithi003.stdout: "items": 18240, 2023-10-08T15:42:15.024 INFO:teuthology.orchestra.run.smithi003.stdout: "bytes": 2834640 2023-10-08T15:42:15.024 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:42:15.024 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:42:15.024 INFO:teuthology.orchestra.run.smithi003.stdout: "duration": 10.201896151 2023-10-08T15:42:15.024 INFO:teuthology.orchestra.run.smithi003.stdout:} 2023-10-08T15:42:15.025 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.013+0000 7ff935f06700 1 -- 172.21.15.3:0/853586453 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff9140605d0 msgr2=0x7ff914062a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:15.025 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.013+0000 7ff935f06700 1 --2- 172.21.15.3:0/853586453 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff9140605d0 0x7ff914062a80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff928011990 tx=0x7ff928007670 comp rx=0 tx=0).stop 2023-10-08T15:42:15.025 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.013+0000 7ff935f06700 1 -- 172.21.15.3:0/853586453 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff930068d00 msgr2=0x7ff93014c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:15.025 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.013+0000 7ff935f06700 1 --2- 172.21.15.3:0/853586453 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff930068d00 0x7ff93014c1b0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7ff92400c810 tx=0x7ff924007df0 comp rx=0 tx=0).stop 2023-10-08T15:42:15.025 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.013+0000 7ff935f06700 1 -- 172.21.15.3:0/853586453 shutdown_connections 2023-10-08T15:42:15.025 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.013+0000 7ff935f06700 1 --2- 172.21.15.3:0/853586453 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7ff9140605d0 0x7ff914062a80 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:15.025 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.013+0000 7ff935f06700 1 --2- 172.21.15.3:0/853586453 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff9300beb80 0x7ff9300bd4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:15.025 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.013+0000 7ff935f06700 1 --2- 172.21.15.3:0/853586453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9300a0d30 0x7ff93015b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:15.026 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.013+0000 7ff935f06700 1 --2- 172.21.15.3:0/853586453 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff930068d00 0x7ff93014c1b0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:15.026 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.013+0000 7ff935f06700 1 -- 172.21.15.3:0/853586453 >> 172.21.15.3:0/853586453 conn(0x7ff930067b60 msgr2=0x7ff930146f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:15.026 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.013+0000 7ff935f06700 1 -- 172.21.15.3:0/853586453 shutdown_connections 2023-10-08T15:42:15.026 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.017+0000 7ff935f06700 1 -- 172.21.15.3:0/853586453 wait complete. 2023-10-08T15:42:15.035 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T15:42:15.035 DEBUG:teuthology.orchestra.run.smithi003:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T15:42:15.049 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T15:42:15.069 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T15:42:15.090 DEBUG:teuthology.orchestra.run.smithi098:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T15:42:15.111 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T15:42:15.131 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T15:42:15.132 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi089.front.sepia.ceph.com... 2023-10-08T15:42:15.132 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T15:42:15.132 DEBUG:teuthology.orchestra.run.smithi089:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-08T15:42:15.147 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi089.stderr:ceph-fuse[29198]: fuse finished with error 0 and tester_r 0 2023-10-08T15:42:15.148 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi089.front.sepia.ceph.com 2023-10-08T15:42:15.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:42:15.148 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-08T15:42:15.270 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi098.front.sepia.ceph.com 2023-10-08T15:42:15.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:42:15.270 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-08T15:42:15.277 INFO:teuthology.orchestra.run.smithi098.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-10-08T15:42:15.277 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T15:42:15.278 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2023-10-08T15:42:15.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:42:15.278 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-08T15:42:15.285 INFO:teuthology.orchestra.run.smithi153.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-08T15:42:15.285 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T15:42:15.286 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:42:15.397 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.389+0000 7f31e8c2e700 1 Processor -- start 2023-10-08T15:42:15.397 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.389+0000 7f31e8c2e700 1 -- start start 2023-10-08T15:42:15.398 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.389+0000 7f31e8c2e700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f31e40bab50 0x7f31e40baf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:15.398 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.389+0000 7f31e8c2e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f31e406df30 0x7f31e4149970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:15.398 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.389+0000 7f31e8c2e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f31e4149eb0 0x7f31e414c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:15.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.389+0000 7f31e8c2e700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31e4146da0 con 0x7f31e40bab50 2023-10-08T15:42:15.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.389+0000 7f31e8c2e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31e414a330 con 0x7f31e4149eb0 2023-10-08T15:42:15.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.389+0000 7f31e8c2e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31e40b4710 con 0x7f31e406df30 2023-10-08T15:42:15.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.393+0000 7f31e37fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f31e40bab50 0x7f31e40baf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:15.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.393+0000 7f31e2ffd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f31e406df30 0x7f31e4149970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:15.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.393+0000 7f31e37fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f31e40bab50 0x7f31e40baf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45902/0 (socket says 172.21.15.3:45902) 2023-10-08T15:42:15.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.393+0000 7f31e3fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f31e4149eb0 0x7f31e414c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:15.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.393+0000 7f31e37fe700 1 -- 172.21.15.3:0/2225968839 learned_addr learned my addr 172.21.15.3:0/2225968839 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:15.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.393+0000 7f31e2ffd700 1 -- 172.21.15.3:0/2225968839 >> v2:172.21.15.50:3300/0 conn(0x7f31e4149eb0 msgr2=0x7f31e414c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:15.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.393+0000 7f31e2ffd700 1 --2- 172.21.15.3:0/2225968839 >> v2:172.21.15.50:3300/0 conn(0x7f31e4149eb0 0x7f31e414c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:15.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.393+0000 7f31e2ffd700 1 -- 172.21.15.3:0/2225968839 >> v2:172.21.15.3:3300/0 conn(0x7f31e40bab50 msgr2=0x7f31e40baf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:15.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.393+0000 7f31e2ffd700 1 --2- 172.21.15.3:0/2225968839 >> v2:172.21.15.3:3300/0 conn(0x7f31e40bab50 0x7f31e40baf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:15.400 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.393+0000 7f31e2ffd700 1 -- 172.21.15.3:0/2225968839 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e40b4050 con 0x7f31e406df30 2023-10-08T15:42:15.400 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.393+0000 7f31e37fe700 1 --2- 172.21.15.3:0/2225968839 >> v2:172.21.15.3:3300/0 conn(0x7f31e40bab50 0x7f31e40baf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:42:15.400 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.393+0000 7f31e2ffd700 1 --2- 172.21.15.3:0/2225968839 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f31e406df30 0x7f31e4149970 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f31e4069590 tx=0x7f31d400db90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=414a8a1a8438c4bb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:15.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.393+0000 7f31e27fc700 1 -- 172.21.15.3:0/2225968839 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d4012070 con 0x7f31e406df30 2023-10-08T15:42:15.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.393+0000 7f31e27fc700 1 -- 172.21.15.3:0/2225968839 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d400fe40 con 0x7f31e406df30 2023-10-08T15:42:15.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.393+0000 7f31e27fc700 1 -- 172.21.15.3:0/2225968839 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d400d320 con 0x7f31e406df30 2023-10-08T15:42:15.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.393+0000 7f31e8c2e700 1 -- 172.21.15.3:0/2225968839 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f31e406df30 msgr2=0x7f31e4149970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:15.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.393+0000 7f31e8c2e700 1 --2- 172.21.15.3:0/2225968839 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f31e406df30 0x7f31e4149970 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f31e4069590 tx=0x7f31d400db90 comp rx=0 tx=0).stop 2023-10-08T15:42:15.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.393+0000 7f31e8c2e700 1 -- 172.21.15.3:0/2225968839 shutdown_connections 2023-10-08T15:42:15.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.393+0000 7f31e8c2e700 1 --2- 172.21.15.3:0/2225968839 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f31e406df30 0x7f31e4149970 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:15.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.393+0000 7f31e8c2e700 1 --2- 172.21.15.3:0/2225968839 >> v2:172.21.15.50:3300/0 conn(0x7f31e4149eb0 0x7f31e414c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:15.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.393+0000 7f31e8c2e700 1 --2- 172.21.15.3:0/2225968839 >> v2:172.21.15.3:3300/0 conn(0x7f31e40bab50 0x7f31e40baf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:15.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.393+0000 7f31e8c2e700 1 -- 172.21.15.3:0/2225968839 >> 172.21.15.3:0/2225968839 conn(0x7f31e40be4a0 msgr2=0x7f31e40ba440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:15.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.393+0000 7f31e8c2e700 1 -- 172.21.15.3:0/2225968839 shutdown_connections 2023-10-08T15:42:15.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.393+0000 7f31e8c2e700 1 -- 172.21.15.3:0/2225968839 wait complete. 2023-10-08T15:42:15.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.393+0000 7f31e8c2e700 1 Processor -- start 2023-10-08T15:42:15.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.393+0000 7f31e8c2e700 1 -- start start 2023-10-08T15:42:15.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.397+0000 7f31e8c2e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f31e406df30 0x7f31e4096980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:15.405 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.397+0000 7f31e8c2e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f31e40bab50 0x7f31e40b8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:15.405 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.397+0000 7f31e8c2e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31e4149eb0 0x7f31e4144fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:15.405 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.397+0000 7f31e8c2e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e40b7ba0 con 0x7f31e40bab50 2023-10-08T15:42:15.405 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.397+0000 7f31e8c2e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e40b9070 con 0x7f31e4149eb0 2023-10-08T15:42:15.405 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.397+0000 7f31e8c2e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31e4095c20 con 0x7f31e406df30 2023-10-08T15:42:15.405 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.397+0000 7f31e2ffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f31e40bab50 0x7f31e40b8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:15.405 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.397+0000 7f31e2ffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f31e40bab50 0x7f31e40b8030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45912/0 (socket says 172.21.15.3:45912) 2023-10-08T15:42:15.405 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.397+0000 7f31e2ffd700 1 -- 172.21.15.3:0/595901810 learned_addr learned my addr 172.21.15.3:0/595901810 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:15.405 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.397+0000 7f31e37fe700 1 --2- 172.21.15.3:0/595901810 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f31e406df30 0x7f31e4096980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:15.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.397+0000 7f31e3fff700 1 --2- 172.21.15.3:0/595901810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31e4149eb0 0x7f31e4144fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:15.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.397+0000 7f31e2ffd700 1 -- 172.21.15.3:0/595901810 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f31e406df30 msgr2=0x7f31e4096980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:15.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.397+0000 7f31e2ffd700 1 --2- 172.21.15.3:0/595901810 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f31e406df30 0x7f31e4096980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:15.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.397+0000 7f31e2ffd700 1 -- 172.21.15.3:0/595901810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31e4149eb0 msgr2=0x7f31e4144fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:15.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.397+0000 7f31e2ffd700 1 --2- 172.21.15.3:0/595901810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31e4149eb0 0x7f31e4144fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:15.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.397+0000 7f31e2ffd700 1 -- 172.21.15.3:0/595901810 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d80094f0 con 0x7f31e40bab50 2023-10-08T15:42:15.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.397+0000 7f31e2ffd700 1 --2- 172.21.15.3:0/595901810 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f31e40bab50 0x7f31e40b8030 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f31d400dbd0 tx=0x7f31d401c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:15.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.397+0000 7f31cb7fe700 1 -- 172.21.15.3:0/595901810 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d400ccd0 con 0x7f31e40bab50 2023-10-08T15:42:15.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.397+0000 7f31cb7fe700 1 -- 172.21.15.3:0/595901810 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d400ce50 con 0x7f31e40bab50 2023-10-08T15:42:15.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.397+0000 7f31e8c2e700 1 -- 172.21.15.3:0/595901810 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31d400de30 con 0x7f31e40bab50 2023-10-08T15:42:15.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.397+0000 7f31cb7fe700 1 -- 172.21.15.3:0/595901810 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d402a6b0 con 0x7f31e40bab50 2023-10-08T15:42:15.407 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.397+0000 7f31e8c2e700 1 -- 172.21.15.3:0/595901810 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31e4095f70 con 0x7f31e40bab50 2023-10-08T15:42:15.407 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.397+0000 7f31e8c2e700 1 -- 172.21.15.3:0/595901810 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31e40b7d10 con 0x7f31e40bab50 2023-10-08T15:42:15.407 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.397+0000 7f31cb7fe700 1 -- 172.21.15.3:0/595901810 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f31d4003040 con 0x7f31e40bab50 2023-10-08T15:42:15.407 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.397+0000 7f31cb7fe700 1 --2- 172.21.15.3:0/595901810 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f31d0060580 0x7f31d0062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:15.407 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.397+0000 7f31cb7fe700 1 -- 172.21.15.3:0/595901810 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f31d40827f0 con 0x7f31e40bab50 2023-10-08T15:42:15.408 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.401+0000 7f31e37fe700 1 --2- 172.21.15.3:0/595901810 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f31d0060580 0x7f31d0062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:15.408 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.401+0000 7f31e37fe700 1 --2- 172.21.15.3:0/595901810 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f31d0060580 0x7f31d0062a30 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f31d8006fd0 tx=0x7f31d8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:15.413 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.405+0000 7f31cb7fe700 1 -- 172.21.15.3:0/595901810 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f31d4052da0 con 0x7f31e40bab50 2023-10-08T15:42:15.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.605+0000 7f31e8c2e700 1 -- 172.21.15.3:0/595901810 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f31e405ecf0 con 0x7f31e40bab50 2023-10-08T15:42:15.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.605+0000 7f31cb7fe700 1 -- 172.21.15.3:0/595901810 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+3082 (secure 0 0 0) 0x7f31d4025c20 con 0x7f31e40bab50 2023-10-08T15:42:15.612 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:42:15.612 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":33,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5480,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1007706158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1007706158},{"type":"v1","addr":"172.21.15.50:6835","nonce":1007706158}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:41:45.889781+0000","modified":"2023-10-08T15:41:48.541276+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6030},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6030":{"gid":6030,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.3:6833/1129612905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":1129612905},{"type":"v1","addr":"172.21.15.3:6833","nonce":1129612905}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-08T15:42:15.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.609+0000 7f31e8c2e700 1 -- 172.21.15.3:0/595901810 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f31d0060580 msgr2=0x7f31d0062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:15.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.609+0000 7f31e8c2e700 1 --2- 172.21.15.3:0/595901810 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f31d0060580 0x7f31d0062a30 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f31d8006fd0 tx=0x7f31d8008040 comp rx=0 tx=0).stop 2023-10-08T15:42:15.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.609+0000 7f31e8c2e700 1 -- 172.21.15.3:0/595901810 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f31e40bab50 msgr2=0x7f31e40b8030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:15.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.609+0000 7f31e8c2e700 1 --2- 172.21.15.3:0/595901810 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f31e40bab50 0x7f31e40b8030 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f31d400dbd0 tx=0x7f31d401c000 comp rx=0 tx=0).stop 2023-10-08T15:42:15.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.609+0000 7f31e8c2e700 1 -- 172.21.15.3:0/595901810 shutdown_connections 2023-10-08T15:42:15.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.609+0000 7f31e8c2e700 1 --2- 172.21.15.3:0/595901810 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f31d0060580 0x7f31d0062a30 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:15.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.609+0000 7f31e8c2e700 1 --2- 172.21.15.3:0/595901810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31e4149eb0 0x7f31e4144fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:15.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.609+0000 7f31e8c2e700 1 --2- 172.21.15.3:0/595901810 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f31e40bab50 0x7f31e40b8030 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:15.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.609+0000 7f31e8c2e700 1 --2- 172.21.15.3:0/595901810 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f31e406df30 0x7f31e4096980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:15.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.609+0000 7f31e8c2e700 1 -- 172.21.15.3:0/595901810 >> 172.21.15.3:0/595901810 conn(0x7f31e40be4a0 msgr2=0x7f31e406cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:15.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.609+0000 7f31e8c2e700 1 -- 172.21.15.3:0/595901810 shutdown_connections 2023-10-08T15:42:15.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.609+0000 7f31e8c2e700 1 -- 172.21.15.3:0/595901810 wait complete. 2023-10-08T15:42:15.618 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 33 2023-10-08T15:42:15.633 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:42:15.739 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.733+0000 7fab0cf44700 1 Processor -- start 2023-10-08T15:42:15.739 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.733+0000 7fab0cf44700 1 -- start start 2023-10-08T15:42:15.740 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.733+0000 7fab0cf44700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fab080bacf0 0x7fab0806dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:15.740 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.733+0000 7fab0cf44700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fab080bb0c0 0x7fab080b22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:15.740 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.733+0000 7fab0cf44700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab0806d9f0 con 0x7fab080b1c30 2023-10-08T15:42:15.741 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.733+0000 7fab0cf44700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab08148170 con 0x7fab080bacf0 2023-10-08T15:42:15.741 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.733+0000 7fab0cf44700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab0814c410 con 0x7fab080bb0c0 2023-10-08T15:42:15.741 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.733+0000 7fab077fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fab080bacf0 0x7fab0806dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:15.741 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.733+0000 7fab077fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fab080bacf0 0x7fab0806dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45922/0 (socket says 172.21.15.3:45922) 2023-10-08T15:42:15.741 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.733+0000 7fab077fe700 1 -- 172.21.15.3:0/601892922 learned_addr learned my addr 172.21.15.3:0/601892922 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:15.741 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.733+0000 7faafffff700 1 --2- 172.21.15.3:0/601892922 >> v2:172.21.15.50:3300/0 conn(0x7fab080bb0c0 0x7fab080b22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:15.741 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.733+0000 7fab077fe700 1 -- 172.21.15.3:0/601892922 >> v2:172.21.15.50:3300/0 conn(0x7fab080bb0c0 msgr2=0x7fab080b22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:15.741 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.733+0000 7fab077fe700 1 --2- 172.21.15.3:0/601892922 >> v2:172.21.15.50:3300/0 conn(0x7fab080bb0c0 0x7fab080b22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:15.741 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.733+0000 7fab077fe700 1 -- 172.21.15.3:0/601892922 >> v1:172.21.15.50:6789/0 conn(0x7fab080b1c30 legacy=0x7fab08148590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:15.742 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.733+0000 7fab077fe700 1 -- 172.21.15.3:0/601892922 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab0814c0e0 con 0x7fab080bacf0 2023-10-08T15:42:15.742 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.733+0000 7faafffff700 1 --2- 172.21.15.3:0/601892922 >> v2:172.21.15.50:3300/0 conn(0x7fab080bb0c0 0x7fab080b22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:42:15.742 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.733+0000 7fab077fe700 1 --2- 172.21.15.3:0/601892922 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fab080bacf0 0x7fab0806dc60 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fab0806be10 tx=0x7faaf0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=747d4545c6aa566 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:15.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.733+0000 7fab06ffd700 1 -- 172.21.15.3:0/601892922 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf000b860 con 0x7fab080bacf0 2023-10-08T15:42:15.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.733+0000 7fab06ffd700 1 -- 172.21.15.3:0/601892922 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf000b9c0 con 0x7fab080bacf0 2023-10-08T15:42:15.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.733+0000 7fab06ffd700 1 -- 172.21.15.3:0/601892922 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf000bd60 con 0x7fab080bacf0 2023-10-08T15:42:15.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.737+0000 7fab0cf44700 1 -- 172.21.15.3:0/601892922 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fab080bacf0 msgr2=0x7fab0806dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:15.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.737+0000 7fab0cf44700 1 --2- 172.21.15.3:0/601892922 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fab080bacf0 0x7fab0806dc60 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fab0806be10 tx=0x7faaf0009250 comp rx=0 tx=0).stop 2023-10-08T15:42:15.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.737+0000 7fab0cf44700 1 -- 172.21.15.3:0/601892922 shutdown_connections 2023-10-08T15:42:15.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.737+0000 7fab0cf44700 1 --2- 172.21.15.3:0/601892922 >> v2:172.21.15.50:3300/0 conn(0x7fab080bb0c0 0x7fab080b22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:15.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.737+0000 7fab0cf44700 1 --2- 172.21.15.3:0/601892922 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fab080bacf0 0x7fab0806dc60 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:15.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.737+0000 7fab0cf44700 1 -- 172.21.15.3:0/601892922 >> 172.21.15.3:0/601892922 conn(0x7fab080be4a0 msgr2=0x7fab080ba440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:15.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.737+0000 7fab0cf44700 1 -- 172.21.15.3:0/601892922 shutdown_connections 2023-10-08T15:42:15.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.737+0000 7fab0cf44700 1 -- 172.21.15.3:0/601892922 wait complete. 2023-10-08T15:42:15.746 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.737+0000 7fab0cf44700 1 Processor -- start 2023-10-08T15:42:15.746 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.737+0000 7fab0cf44700 1 -- start start 2023-10-08T15:42:15.746 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.737+0000 7fab0cf44700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fab080b1c30 0x7fab08145630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:15.746 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.737+0000 7fab0cf44700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fab080bacf0 0x7fab0806c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:15.746 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.737+0000 7fab0cf44700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab080bb0c0 0x7fab080b95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:15.746 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.737+0000 7fab0cf44700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab081452d0 con 0x7fab080bacf0 2023-10-08T15:42:15.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.737+0000 7fab0cf44700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab0806c5d0 con 0x7fab080bb0c0 2023-10-08T15:42:15.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.737+0000 7fab0cf44700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab08146050 con 0x7fab080b1c30 2023-10-08T15:42:15.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.737+0000 7faafffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fab080bacf0 0x7fab0806c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:15.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.737+0000 7faafffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fab080bacf0 0x7fab0806c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45932/0 (socket says 172.21.15.3:45932) 2023-10-08T15:42:15.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.737+0000 7faafffff700 1 -- 172.21.15.3:0/975541923 learned_addr learned my addr 172.21.15.3:0/975541923 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:15.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.737+0000 7fab07fff700 1 --2- 172.21.15.3:0/975541923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab080bb0c0 0x7fab080b95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:15.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.737+0000 7fab077fe700 1 --2- 172.21.15.3:0/975541923 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fab080b1c30 0x7fab08145630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:15.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.741+0000 7faafffff700 1 -- 172.21.15.3:0/975541923 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fab080b1c30 msgr2=0x7fab08145630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:15.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.741+0000 7faafffff700 1 --2- 172.21.15.3:0/975541923 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fab080b1c30 0x7fab08145630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:15.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.741+0000 7faafffff700 1 -- 172.21.15.3:0/975541923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab080bb0c0 msgr2=0x7fab080b95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:15.748 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.741+0000 7faafffff700 1 --2- 172.21.15.3:0/975541923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab080bb0c0 0x7fab080b95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:15.748 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.741+0000 7faafffff700 1 -- 172.21.15.3:0/975541923 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf00094f0 con 0x7fab080bacf0 2023-10-08T15:42:15.748 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.741+0000 7fab077fe700 1 --2- 172.21.15.3:0/975541923 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fab080b1c30 0x7fab08145630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:42:15.748 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.741+0000 7faafffff700 1 --2- 172.21.15.3:0/975541923 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fab080bacf0 0x7fab0806c090 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7faaf800d860 tx=0x7faaf8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:15.748 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.741+0000 7faaff7fe700 1 -- 172.21.15.3:0/975541923 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf80125f0 con 0x7fab080bacf0 2023-10-08T15:42:15.748 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.741+0000 7faaff7fe700 1 -- 172.21.15.3:0/975541923 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf8012750 con 0x7fab080bacf0 2023-10-08T15:42:15.748 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.741+0000 7fab0cf44700 1 -- 172.21.15.3:0/975541923 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab08146330 con 0x7fab080bacf0 2023-10-08T15:42:15.748 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.741+0000 7faaff7fe700 1 -- 172.21.15.3:0/975541923 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf8012af0 con 0x7fab080bacf0 2023-10-08T15:42:15.748 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.741+0000 7fab0cf44700 1 -- 172.21.15.3:0/975541923 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab080b8e70 con 0x7fab080bacf0 2023-10-08T15:42:15.749 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.741+0000 7fab0cf44700 1 -- 172.21.15.3:0/975541923 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab08145b70 con 0x7fab080bacf0 2023-10-08T15:42:15.749 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.741+0000 7faaff7fe700 1 -- 172.21.15.3:0/975541923 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7faaf8014430 con 0x7fab080bacf0 2023-10-08T15:42:15.749 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.741+0000 7faaff7fe700 1 --2- 172.21.15.3:0/975541923 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7faae8060550 0x7faae8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:15.749 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.741+0000 7faaff7fe700 1 -- 172.21.15.3:0/975541923 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5763+0+0 (secure 0 0 0) 0x7faaf807cb80 con 0x7fab080bacf0 2023-10-08T15:42:15.750 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.745+0000 7fab077fe700 1 --2- 172.21.15.3:0/975541923 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7faae8060550 0x7faae8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:15.750 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.745+0000 7fab077fe700 1 --2- 172.21.15.3:0/975541923 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7faae8060550 0x7faae8062a00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fab0806be10 tx=0x7faaf0017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:15.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.753+0000 7faaff7fe700 1 -- 172.21.15.3:0/975541923 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7faaf804d130 con 0x7fab080bacf0 2023-10-08T15:42:15.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.917+0000 7fab0cf44700 1 -- 172.21.15.3:0/975541923 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fab0805ecf0 con 0x7fab080bacf0 2023-10-08T15:42:15.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.917+0000 7faaff7fe700 1 -- 172.21.15.3:0/975541923 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+15355 (secure 0 0 0) 0x7faaf8050750 con 0x7fab080bacf0 2023-10-08T15:42:15.925 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:42:15.925 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":61,"fsid":"7635972e-cd66-4a8f-a231-378db8b3847a","created":"2023-10-08T15:37:08.234594+0000","modified":"2023-10-08T15:42:14.153650+0000","last_up_change":"2023-10-08T15:37:17.537726+0000","last_in_change":"2023-10-08T15:37:10.269178+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:37:16.581590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:41:44.126771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-08T15:41:44.881738+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"64fb1864-bfdd-4d75-9b41-03fb60085dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33363},{"type":"v1","addr":"172.21.15.3:6801","nonce":33363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33363},{"type":"v1","addr":"172.21.15.3:6803","nonce":33363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":33363},{"type":"v1","addr":"172.21.15.3:6807","nonce":33363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33363},{"type":"v1","addr":"172.21.15.3:6805","nonce":33363}]},"public_addr":"172.21.15.3:6801/33363","cluster_addr":"172.21.15.3:6803/33363","heartbeat_back_addr":"172.21.15.3:6807/33363","heartbeat_front_addr":"172.21.15.3:6805/33363","state":["exists","up"]},{"osd":1,"uuid":"3ca6bd3a-3e8a-4c65-af9c-46148b0c2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33364},{"type":"v1","addr":"172.21.15.3:6820","nonce":33364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33364},{"type":"v1","addr":"172.21.15.3:6824","nonce":33364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33364},{"type":"v1","addr":"172.21.15.3:6831","nonce":33364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33364},{"type":"v1","addr":"172.21.15.3:6828","nonce":33364}]},"public_addr":"172.21.15.3:6820/33364","cluster_addr":"172.21.15.3:6824/33364","heartbeat_back_addr":"172.21.15.3:6831/33364","heartbeat_front_addr":"172.21.15.3:6828/33364","state":["exists","up"]},{"osd":2,"uuid":"6eb9f757-58dd-442f-910d-32401454bce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33366},{"type":"v1","addr":"172.21.15.3:6817","nonce":33366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":33366},{"type":"v1","addr":"172.21.15.3:6821","nonce":33366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6827","nonce":33366},{"type":"v1","addr":"172.21.15.3:6829","nonce":33366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":33366},{"type":"v1","addr":"172.21.15.3:6825","nonce":33366}]},"public_addr":"172.21.15.3:6817/33366","cluster_addr":"172.21.15.3:6821/33366","heartbeat_back_addr":"172.21.15.3:6829/33366","heartbeat_front_addr":"172.21.15.3:6825/33366","state":["exists","up"]},{"osd":3,"uuid":"1c39866b-ac2e-4ea9-a69c-02b01ee4191d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33365},{"type":"v1","addr":"172.21.15.3:6809","nonce":33365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":33365},{"type":"v1","addr":"172.21.15.3:6811","nonce":33365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33365},{"type":"v1","addr":"172.21.15.3:6815","nonce":33365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":33365},{"type":"v1","addr":"172.21.15.3:6813","nonce":33365}]},"public_addr":"172.21.15.3:6809/33365","cluster_addr":"172.21.15.3:6811/33365","heartbeat_back_addr":"172.21.15.3:6815/33365","heartbeat_front_addr":"172.21.15.3:6813/33365","state":["exists","up"]},{"osd":4,"uuid":"15f86b61-b7f1-4780-ae00-9d80a68cb830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":33605},{"type":"v1","addr":"172.21.15.50:6809","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33605},{"type":"v1","addr":"172.21.15.50:6811","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33605},{"type":"v1","addr":"172.21.15.50:6815","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":33605},{"type":"v1","addr":"172.21.15.50:6813","nonce":33605}]},"public_addr":"172.21.15.50:6809/33605","cluster_addr":"172.21.15.50:6811/33605","heartbeat_back_addr":"172.21.15.50:6815/33605","heartbeat_front_addr":"172.21.15.50:6813/33605","state":["exists","up"]},{"osd":5,"uuid":"726c3003-34e6-4d5a-b6e2-f911e13c2118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33606},{"type":"v1","addr":"172.21.15.50:6801","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33606},{"type":"v1","addr":"172.21.15.50:6803","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33606},{"type":"v1","addr":"172.21.15.50:6807","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":33606},{"type":"v1","addr":"172.21.15.50:6805","nonce":33606}]},"public_addr":"172.21.15.50:6801/33606","cluster_addr":"172.21.15.50:6803/33606","heartbeat_back_addr":"172.21.15.50:6807/33606","heartbeat_front_addr":"172.21.15.50:6805/33606","state":["exists","up"]},{"osd":6,"uuid":"401122a4-9988-441f-a5a7-39164434ebcd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":33607},{"type":"v1","addr":"172.21.15.50:6819","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":33607},{"type":"v1","addr":"172.21.15.50:6823","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":33607},{"type":"v1","addr":"172.21.15.50:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":33607},{"type":"v1","addr":"172.21.15.50:6827","nonce":33607}]},"public_addr":"172.21.15.50:6819/33607","cluster_addr":"172.21.15.50:6823/33607","heartbeat_back_addr":"172.21.15.50:6831/33607","heartbeat_front_addr":"172.21.15.50:6827/33607","state":["exists","up"]},{"osd":7,"uuid":"6b3fa236-c9d0-4c4d-82ae-9af4daf6d699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33604},{"type":"v1","addr":"172.21.15.50:6818","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":33604},{"type":"v1","addr":"172.21.15.50:6822","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":33604},{"type":"v1","addr":"172.21.15.50:6830","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":33604},{"type":"v1","addr":"172.21.15.50:6826","nonce":33604}]},"public_addr":"172.21.15.50:6818/33604","cluster_addr":"172.21.15.50:6822/33604","heartbeat_back_addr":"172.21.15.50:6830/33604","heartbeat_front_addr":"172.21.15.50:6826/33604","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.497794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.529417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.873426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.325972+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.443971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.240795+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.739632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.643026+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.14","mappings":[{"from":6,"to":0}]},{"pgid":"11.30","mappings":[{"from":6,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:42:15.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.921+0000 7fab0cf44700 1 -- 172.21.15.3:0/975541923 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7faae8060550 msgr2=0x7faae8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:15.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.921+0000 7fab0cf44700 1 --2- 172.21.15.3:0/975541923 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7faae8060550 0x7faae8062a00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fab0806be10 tx=0x7faaf0017000 comp rx=0 tx=0).stop 2023-10-08T15:42:15.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.921+0000 7fab0cf44700 1 -- 172.21.15.3:0/975541923 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fab080bacf0 msgr2=0x7fab0806c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:15.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.921+0000 7fab0cf44700 1 --2- 172.21.15.3:0/975541923 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fab080bacf0 0x7fab0806c090 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7faaf800d860 tx=0x7faaf8008040 comp rx=0 tx=0).stop 2023-10-08T15:42:15.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.921+0000 7fab0cf44700 1 -- 172.21.15.3:0/975541923 shutdown_connections 2023-10-08T15:42:15.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.921+0000 7fab0cf44700 1 --2- 172.21.15.3:0/975541923 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7faae8060550 0x7faae8062a00 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:15.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.921+0000 7fab0cf44700 1 --2- 172.21.15.3:0/975541923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab080bb0c0 0x7fab080b95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:15.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.921+0000 7fab0cf44700 1 --2- 172.21.15.3:0/975541923 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fab080bacf0 0x7fab0806c090 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:15.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.921+0000 7fab0cf44700 1 --2- 172.21.15.3:0/975541923 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fab080b1c30 0x7fab08145630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:15.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.921+0000 7fab0cf44700 1 -- 172.21.15.3:0/975541923 >> 172.21.15.3:0/975541923 conn(0x7fab080be4a0 msgr2=0x7fab08141ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:15.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.921+0000 7fab0cf44700 1 -- 172.21.15.3:0/975541923 shutdown_connections 2023-10-08T15:42:15.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:15.921+0000 7fab0cf44700 1 -- 172.21.15.3:0/975541923 wait complete. 2023-10-08T15:42:15.939 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T15:37:16.581590+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T15:41:44.126771+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T15:41:44.881738+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T15:42:15.939 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T15:42:16.052 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.045+0000 7fda67c22700 1 Processor -- start 2023-10-08T15:42:16.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.045+0000 7fda67c22700 1 -- start start 2023-10-08T15:42:16.053 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.049+0000 7fda67c22700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fda60069ed0 0x7fda60147dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:16.054 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.049+0000 7fda67c22700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda601494f0 con 0x7fda60148300 2023-10-08T15:42:16.054 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.049+0000 7fda67c22700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda6006e3f0 con 0x7fda601479f0 2023-10-08T15:42:16.054 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.049+0000 7fda67c22700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda6006e6d0 con 0x7fda60069ed0 2023-10-08T15:42:16.054 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.049+0000 7fda661bf700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fda60148300 0x7fda6014bc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:43772/0 (socket says 172.21.15.3:43772) 2023-10-08T15:42:16.054 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.049+0000 7fda661bf700 1 -- 172.21.15.3:0/3133348421 learned_addr learned my addr 172.21.15.3:0/3133348421 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:42:16.054 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.049+0000 7fda651bd700 1 --2- 172.21.15.3:0/3133348421 >> v2:172.21.15.50:3300/0 conn(0x7fda60069ed0 0x7fda60147dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:16.056 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.049+0000 7fda649bc700 1 -- 172.21.15.3:0/3133348421 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3151198404 0 0) 0x7fda601494f0 con 0x7fda60148300 2023-10-08T15:42:16.056 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.049+0000 7fda649bc700 1 -- 172.21.15.3:0/3133348421 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda4c003570 con 0x7fda60148300 2023-10-08T15:42:16.056 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.049+0000 7fda649bc700 1 -- 172.21.15.3:0/3133348421 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3974810143 0 0) 0x7fda4c003570 con 0x7fda60148300 2023-10-08T15:42:16.056 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.049+0000 7fda649bc700 1 -- 172.21.15.3:0/3133348421 >> v2:172.21.15.50:3300/0 conn(0x7fda60069ed0 msgr2=0x7fda60147dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:16.057 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.049+0000 7fda649bc700 1 --2- 172.21.15.3:0/3133348421 >> v2:172.21.15.50:3300/0 conn(0x7fda60069ed0 0x7fda60147dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:16.057 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.049+0000 7fda649bc700 1 -- 172.21.15.3:0/3133348421 >> v1:172.21.15.50:6789/0 conn(0x7fda601479f0 legacy=0x7fda60067bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:16.057 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.049+0000 7fda649bc700 1 -- 172.21.15.3:0/3133348421 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda60068300 con 0x7fda60148300 2023-10-08T15:42:16.057 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.049+0000 7fda649bc700 1 -- 172.21.15.3:0/3133348421 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2285686191 0 0) 0x7fda580017f0 con 0x7fda60148300 2023-10-08T15:42:16.057 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.049+0000 7fda649bc700 1 -- 172.21.15.3:0/3133348421 >> v1:172.21.15.3:6789/0 conn(0x7fda60148300 legacy=0x7fda6014bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:16.057 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.049+0000 7fda649bc700 1 --2- 172.21.15.3:0/3133348421 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda4c003a60 0x7fda4c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:16.057 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.049+0000 7fda649bc700 1 --2- 172.21.15.3:0/3133348421 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda4c004810 0x7fda4c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:16.057 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.049+0000 7fda649bc700 1 --2- 172.21.15.3:0/3133348421 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fda4c0051c0 0x7fda4c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:16.057 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.049+0000 7fda649bc700 1 -- 172.21.15.3:0/3133348421 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6006e6d0 con 0x7fda4c004810 2023-10-08T15:42:16.057 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.049+0000 7fda649bc700 1 -- 172.21.15.3:0/3133348421 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda4c00c160 con 0x7fda4c003a60 2023-10-08T15:42:16.057 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.049+0000 7fda649bc700 1 -- 172.21.15.3:0/3133348421 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda4c00c320 con 0x7fda4c0051c0 2023-10-08T15:42:16.057 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.049+0000 7fda651bd700 1 --2- 172.21.15.3:0/3133348421 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda4c004810 0x7fda4c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:16.058 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.049+0000 7fda661bf700 1 --2- 172.21.15.3:0/3133348421 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fda4c0051c0 0x7fda4c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:16.058 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.049+0000 7fda659be700 1 --2- 172.21.15.3:0/3133348421 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda4c003a60 0x7fda4c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:16.058 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.049+0000 7fda651bd700 1 -- 172.21.15.3:0/3133348421 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fda4c0051c0 msgr2=0x7fda4c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:16.058 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.049+0000 7fda651bd700 1 --2- 172.21.15.3:0/3133348421 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fda4c0051c0 0x7fda4c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:16.058 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.049+0000 7fda651bd700 1 -- 172.21.15.3:0/3133348421 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda4c003a60 msgr2=0x7fda4c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:16.058 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.049+0000 7fda651bd700 1 --2- 172.21.15.3:0/3133348421 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda4c003a60 0x7fda4c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:16.058 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.049+0000 7fda651bd700 1 -- 172.21.15.3:0/3133348421 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda4c003570 con 0x7fda4c004810 2023-10-08T15:42:16.058 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.049+0000 7fda661bf700 1 -- 172.21.15.3:0/3133348421 reap_dead start 2023-10-08T15:42:16.058 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.049+0000 7fda651bd700 1 --2- 172.21.15.3:0/3133348421 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda4c004810 0x7fda4c004c80 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fda54009c00 tx=0x7fda540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac57fb22d6f43f17 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:16.058 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.049+0000 7fda649bc700 1 -- 172.21.15.3:0/3133348421 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5400e710 con 0x7fda4c004810 2023-10-08T15:42:16.058 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.049+0000 7fda649bc700 1 -- 172.21.15.3:0/3133348421 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda5400e870 con 0x7fda4c004810 2023-10-08T15:42:16.059 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.049+0000 7fda649bc700 1 -- 172.21.15.3:0/3133348421 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5400ec30 con 0x7fda4c004810 2023-10-08T15:42:16.060 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.049+0000 7fda67c22700 1 -- 172.21.15.3:0/3133348421 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda4c004810 msgr2=0x7fda4c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:16.060 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.049+0000 7fda67c22700 1 --2- 172.21.15.3:0/3133348421 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda4c004810 0x7fda4c004c80 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fda54009c00 tx=0x7fda540091a0 comp rx=0 tx=0).stop 2023-10-08T15:42:16.060 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.049+0000 7fda67c22700 1 -- 172.21.15.3:0/3133348421 shutdown_connections 2023-10-08T15:42:16.060 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.049+0000 7fda67c22700 1 --2- 172.21.15.3:0/3133348421 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda4c004810 0x7fda4c004c80 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:16.060 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.049+0000 7fda67c22700 1 -- 172.21.15.3:0/3133348421 >> 172.21.15.3:0/3133348421 conn(0x7fda600670e0 msgr2=0x7fda600674e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:16.060 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.049+0000 7fda67c22700 1 -- 172.21.15.3:0/3133348421 shutdown_connections 2023-10-08T15:42:16.060 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.049+0000 7fda67c22700 1 -- 172.21.15.3:0/3133348421 wait complete. 2023-10-08T15:42:16.060 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.053+0000 7fda67c22700 1 Processor -- start 2023-10-08T15:42:16.060 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.053+0000 7fda67c22700 1 -- start start 2023-10-08T15:42:16.062 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.053+0000 7fda67c22700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fda4c004810 0x7fda60140fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:16.062 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.053+0000 7fda67c22700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda6013cd10 0x7fda6013d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:16.062 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.053+0000 7fda67c22700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda600b6190 0x7fda600b6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:16.062 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.053+0000 7fda67c22700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda60141f40 con 0x7fda600b6190 2023-10-08T15:42:16.062 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.053+0000 7fda67c22700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda600b8450 con 0x7fda6013cd10 2023-10-08T15:42:16.062 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.053+0000 7fda67c22700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda600b7970 con 0x7fda4c004810 2023-10-08T15:42:16.062 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.053+0000 7fda661bf700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda600b6190 0x7fda600b6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:16.062 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.053+0000 7fda661bf700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda600b6190 0x7fda600b6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45944/0 (socket says 172.21.15.3:45944) 2023-10-08T15:42:16.063 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.053+0000 7fda661bf700 1 -- 172.21.15.3:0/234759614 learned_addr learned my addr 172.21.15.3:0/234759614 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:16.063 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.053+0000 7fda651bd700 1 --2- 172.21.15.3:0/234759614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda6013cd10 0x7fda6013d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:16.063 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.053+0000 7fda659be700 1 --2- 172.21.15.3:0/234759614 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fda4c004810 0x7fda60140fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:16.063 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.057+0000 7fda661bf700 1 -- 172.21.15.3:0/234759614 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fda4c004810 msgr2=0x7fda60140fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:16.063 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.057+0000 7fda661bf700 1 --2- 172.21.15.3:0/234759614 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fda4c004810 0x7fda60140fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:16.063 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.057+0000 7fda661bf700 1 -- 172.21.15.3:0/234759614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda6013cd10 msgr2=0x7fda6013d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:16.063 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.057+0000 7fda661bf700 1 --2- 172.21.15.3:0/234759614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda6013cd10 0x7fda6013d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:16.063 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.057+0000 7fda661bf700 1 -- 172.21.15.3:0/234759614 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda600b8730 con 0x7fda600b6190 2023-10-08T15:42:16.063 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.057+0000 7fda661bf700 1 --2- 172.21.15.3:0/234759614 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda600b6190 0x7fda600b6600 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fda58000f80 tx=0x7fda580021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:16.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.057+0000 7fda51ffb700 1 -- 172.21.15.3:0/234759614 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda58007b40 con 0x7fda600b6190 2023-10-08T15:42:16.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.057+0000 7fda51ffb700 1 -- 172.21.15.3:0/234759614 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda5800ac30 con 0x7fda600b6190 2023-10-08T15:42:16.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.057+0000 7fda67c22700 1 -- 172.21.15.3:0/234759614 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda600b9ab0 con 0x7fda600b6190 2023-10-08T15:42:16.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.057+0000 7fda51ffb700 1 -- 172.21.15.3:0/234759614 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda580133f0 con 0x7fda600b6190 2023-10-08T15:42:16.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.057+0000 7fda67c22700 1 -- 172.21.15.3:0/234759614 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda60141510 con 0x7fda600b6190 2023-10-08T15:42:16.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.057+0000 7fda67c22700 1 -- 172.21.15.3:0/234759614 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda600b97d0 con 0x7fda600b6190 2023-10-08T15:42:16.065 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.057+0000 7fda51ffb700 1 -- 172.21.15.3:0/234759614 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fda58013840 con 0x7fda600b6190 2023-10-08T15:42:16.066 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.061+0000 7fda51ffb700 1 --2- 172.21.15.3:0/234759614 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fda44060580 0x7fda44062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:16.066 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.061+0000 7fda51ffb700 1 -- 172.21.15.3:0/234759614 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fda5807d400 con 0x7fda600b6190 2023-10-08T15:42:16.066 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.061+0000 7fda659be700 1 --2- 172.21.15.3:0/234759614 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fda44060580 0x7fda44062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:16.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.061+0000 7fda659be700 1 --2- 172.21.15.3:0/234759614 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fda44060580 0x7fda44062a30 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fda5c007fd0 tx=0x7fda5c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:16.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.065+0000 7fda51ffb700 1 -- 172.21.15.3:0/234759614 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fda600b97d0 con 0x7fda600b6190 2023-10-08T15:42:16.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.233+0000 7fda67c22700 1 -- 172.21.15.3:0/234759614 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fda600b97b0 con 0x7fda600b6190 2023-10-08T15:42:16.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.233+0000 7fda51ffb700 1 -- 172.21.15.3:0/234759614 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v61) v1 ==== 93+0+10 (secure 0 0 0) 0x7fda580170a0 con 0x7fda600b6190 2023-10-08T15:42:16.239 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2023-10-08T15:42:16.241 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.233+0000 7fda67c22700 1 -- 172.21.15.3:0/234759614 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fda44060580 msgr2=0x7fda44062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:16.241 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.233+0000 7fda67c22700 1 --2- 172.21.15.3:0/234759614 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fda44060580 0x7fda44062a30 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fda5c007fd0 tx=0x7fda5c009040 comp rx=0 tx=0).stop 2023-10-08T15:42:16.242 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.233+0000 7fda67c22700 1 -- 172.21.15.3:0/234759614 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda600b6190 msgr2=0x7fda600b6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:16.242 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.233+0000 7fda67c22700 1 --2- 172.21.15.3:0/234759614 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda600b6190 0x7fda600b6600 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fda58000f80 tx=0x7fda580021d0 comp rx=0 tx=0).stop 2023-10-08T15:42:16.242 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.233+0000 7fda67c22700 1 -- 172.21.15.3:0/234759614 shutdown_connections 2023-10-08T15:42:16.242 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.233+0000 7fda67c22700 1 --2- 172.21.15.3:0/234759614 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fda44060580 0x7fda44062a30 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:16.242 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.233+0000 7fda67c22700 1 --2- 172.21.15.3:0/234759614 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda600b6190 0x7fda600b6600 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:16.242 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.233+0000 7fda67c22700 1 --2- 172.21.15.3:0/234759614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda6013cd10 0x7fda6013d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:16.242 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.233+0000 7fda67c22700 1 --2- 172.21.15.3:0/234759614 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fda4c004810 0x7fda60140fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:16.242 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.233+0000 7fda67c22700 1 -- 172.21.15.3:0/234759614 >> 172.21.15.3:0/234759614 conn(0x7fda600670e0 msgr2=0x7fda60069620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:16.242 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.233+0000 7fda67c22700 1 -- 172.21.15.3:0/234759614 shutdown_connections 2023-10-08T15:42:16.242 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.233+0000 7fda67c22700 1 -- 172.21.15.3:0/234759614 wait complete. 2023-10-08T15:42:16.253 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T15:42:16.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.365+0000 7fbf6cbe4700 1 Processor -- start 2023-10-08T15:42:16.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.365+0000 7fbf6cbe4700 1 -- start start 2023-10-08T15:42:16.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.365+0000 7fbf6cbe4700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbf6806c5c0 0x7fbf680be3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:16.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.365+0000 7fbf6cbe4700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbf680a7bc0 0x7fbf6814bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:16.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.365+0000 7fbf6cbe4700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf6806ced0 con 0x7fbf680a77f0 2023-10-08T15:42:16.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.365+0000 7fbf6cbe4700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf6806e770 con 0x7fbf6806c5c0 2023-10-08T15:42:16.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.365+0000 7fbf6cbe4700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf68069570 con 0x7fbf680a7bc0 2023-10-08T15:42:16.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.365+0000 7fbf677fe700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fbf680a77f0 0x7fbf680a2200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:43788/0 (socket says 172.21.15.3:43788) 2023-10-08T15:42:16.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.365+0000 7fbf677fe700 1 -- 172.21.15.3:0/87135885 learned_addr learned my addr 172.21.15.3:0/87135885 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:42:16.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.365+0000 7fbf66ffd700 1 --2- 172.21.15.3:0/87135885 >> v2:172.21.15.50:3300/0 conn(0x7fbf6806c5c0 0x7fbf680be3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:16.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.365+0000 7fbf67fff700 1 --2- 172.21.15.3:0/87135885 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbf680a7bc0 0x7fbf6814bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:16.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.369+0000 7fbf667fc700 1 -- 172.21.15.3:0/87135885 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 772008491 0 0) 0x7fbf6806ced0 con 0x7fbf680a77f0 2023-10-08T15:42:16.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.369+0000 7fbf667fc700 1 -- 172.21.15.3:0/87135885 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf50003570 con 0x7fbf680a77f0 2023-10-08T15:42:16.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.369+0000 7fbf66ffd700 1 -- 172.21.15.3:0/87135885 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbf680a7bc0 msgr2=0x7fbf6814bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:16.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.369+0000 7fbf66ffd700 1 --2- 172.21.15.3:0/87135885 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbf680a7bc0 0x7fbf6814bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:16.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.369+0000 7fbf66ffd700 1 -- 172.21.15.3:0/87135885 >> v1:172.21.15.3:6789/0 conn(0x7fbf680a77f0 legacy=0x7fbf680a2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:16.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.369+0000 7fbf66ffd700 1 -- 172.21.15.3:0/87135885 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf6814c620 con 0x7fbf6806c5c0 2023-10-08T15:42:16.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.369+0000 7fbf67fff700 1 --2- 172.21.15.3:0/87135885 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbf680a7bc0 0x7fbf6814bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:42:16.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.369+0000 7fbf66ffd700 1 --2- 172.21.15.3:0/87135885 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf6806c5c0 0x7fbf680be3d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fbf580098e0 tx=0x7fbf580091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2a3dc63bd284976 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:16.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.369+0000 7fbf667fc700 1 -- 172.21.15.3:0/87135885 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf58011630 con 0x7fbf6806c5c0 2023-10-08T15:42:16.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.369+0000 7fbf667fc700 1 -- 172.21.15.3:0/87135885 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf58011790 con 0x7fbf6806c5c0 2023-10-08T15:42:16.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.369+0000 7fbf667fc700 1 -- 172.21.15.3:0/87135885 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf58011b10 con 0x7fbf6806c5c0 2023-10-08T15:42:16.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.369+0000 7fbf6cbe4700 1 -- 172.21.15.3:0/87135885 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf6806c5c0 msgr2=0x7fbf680be3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:16.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.369+0000 7fbf6cbe4700 1 --2- 172.21.15.3:0/87135885 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf6806c5c0 0x7fbf680be3d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fbf580098e0 tx=0x7fbf580091a0 comp rx=0 tx=0).stop 2023-10-08T15:42:16.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.369+0000 7fbf6cbe4700 1 -- 172.21.15.3:0/87135885 shutdown_connections 2023-10-08T15:42:16.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.369+0000 7fbf6cbe4700 1 --2- 172.21.15.3:0/87135885 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbf680a7bc0 0x7fbf6814bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:16.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.369+0000 7fbf6cbe4700 1 --2- 172.21.15.3:0/87135885 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf6806c5c0 0x7fbf680be3d0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:16.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.369+0000 7fbf6cbe4700 1 -- 172.21.15.3:0/87135885 >> 172.21.15.3:0/87135885 conn(0x7fbf680c29f0 msgr2=0x7fbf680a1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:16.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.369+0000 7fbf6cbe4700 1 -- 172.21.15.3:0/87135885 shutdown_connections 2023-10-08T15:42:16.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.369+0000 7fbf6cbe4700 1 -- 172.21.15.3:0/87135885 wait complete. 2023-10-08T15:42:16.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.373+0000 7fbf6cbe4700 1 Processor -- start 2023-10-08T15:42:16.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.373+0000 7fbf6cbe4700 1 -- start start 2023-10-08T15:42:16.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.373+0000 7fbf6cbe4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf6806c5c0 0x7fbf681461a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:16.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.373+0000 7fbf6cbe4700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbf680a77f0 0x7fbf6814de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:16.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.373+0000 7fbf6cbe4700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbf680a7bc0 0x7fbf6814d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:16.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.373+0000 7fbf6cbe4700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6814d900 con 0x7fbf680a77f0 2023-10-08T15:42:16.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.373+0000 7fbf6cbe4700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf68147a10 con 0x7fbf6806c5c0 2023-10-08T15:42:16.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.373+0000 7fbf6cbe4700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf68143e70 con 0x7fbf680a7bc0 2023-10-08T15:42:16.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.373+0000 7fbf66ffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbf680a77f0 0x7fbf6814de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:16.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.373+0000 7fbf66ffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbf680a77f0 0x7fbf6814de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45958/0 (socket says 172.21.15.3:45958) 2023-10-08T15:42:16.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.373+0000 7fbf66ffd700 1 -- 172.21.15.3:0/1941585375 learned_addr learned my addr 172.21.15.3:0/1941585375 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:16.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.373+0000 7fbf677fe700 1 --2- 172.21.15.3:0/1941585375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf6806c5c0 0x7fbf681461a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:16.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.373+0000 7fbf67fff700 1 --2- 172.21.15.3:0/1941585375 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbf680a7bc0 0x7fbf6814d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:16.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.373+0000 7fbf66ffd700 1 -- 172.21.15.3:0/1941585375 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbf680a7bc0 msgr2=0x7fbf6814d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:16.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.373+0000 7fbf66ffd700 1 --2- 172.21.15.3:0/1941585375 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbf680a7bc0 0x7fbf6814d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:16.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.373+0000 7fbf66ffd700 1 -- 172.21.15.3:0/1941585375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf6806c5c0 msgr2=0x7fbf681461a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:16.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.373+0000 7fbf66ffd700 1 --2- 172.21.15.3:0/1941585375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf6806c5c0 0x7fbf681461a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:16.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.373+0000 7fbf66ffd700 1 -- 172.21.15.3:0/1941585375 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf60009a20 con 0x7fbf680a77f0 2023-10-08T15:42:16.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.373+0000 7fbf66ffd700 1 --2- 172.21.15.3:0/1941585375 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbf680a77f0 0x7fbf6814de40 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fbf58009ed0 tx=0x7fbf58017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:16.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.373+0000 7fbf4f7fe700 1 -- 172.21.15.3:0/1941585375 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf58011b10 con 0x7fbf680a77f0 2023-10-08T15:42:16.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.373+0000 7fbf4f7fe700 1 -- 172.21.15.3:0/1941585375 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf58000c90 con 0x7fbf680a77f0 2023-10-08T15:42:16.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.373+0000 7fbf6cbe4700 1 -- 172.21.15.3:0/1941585375 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf58009420 con 0x7fbf680a77f0 2023-10-08T15:42:16.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.373+0000 7fbf4f7fe700 1 -- 172.21.15.3:0/1941585375 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5801a660 con 0x7fbf680a77f0 2023-10-08T15:42:16.382 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.373+0000 7fbf6cbe4700 1 -- 172.21.15.3:0/1941585375 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf68144800 con 0x7fbf680a77f0 2023-10-08T15:42:16.382 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.373+0000 7fbf6cbe4700 1 -- 172.21.15.3:0/1941585375 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf68147ba0 con 0x7fbf680a77f0 2023-10-08T15:42:16.382 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.377+0000 7fbf4f7fe700 1 -- 172.21.15.3:0/1941585375 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fbf5801aa90 con 0x7fbf680a77f0 2023-10-08T15:42:16.383 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.377+0000 7fbf4f7fe700 1 --2- 172.21.15.3:0/1941585375 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbf54060550 0x7fbf54062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:16.383 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.377+0000 7fbf4f7fe700 1 -- 172.21.15.3:0/1941585375 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fbf5807e330 con 0x7fbf680a77f0 2023-10-08T15:42:16.383 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.377+0000 7fbf677fe700 1 --2- 172.21.15.3:0/1941585375 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbf54060550 0x7fbf54062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:16.384 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.377+0000 7fbf677fe700 1 --2- 172.21.15.3:0/1941585375 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbf54060550 0x7fbf54062a00 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c0058d0 tx=0x7fbf5c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:16.388 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.381+0000 7fbf4f7fe700 1 -- 172.21.15.3:0/1941585375 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbf5804e8e0 con 0x7fbf680a77f0 2023-10-08T15:42:16.549 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.541+0000 7fbf6cbe4700 1 -- 172.21.15.3:0/1941585375 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbf68144a50 con 0x7fbf680a77f0 2023-10-08T15:42:16.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.545+0000 7fbf4f7fe700 1 -- 172.21.15.3:0/1941585375 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v61) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbf58051f00 con 0x7fbf680a77f0 2023-10-08T15:42:16.550 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 32 2023-10-08T15:42:16.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.545+0000 7fbf6cbe4700 1 -- 172.21.15.3:0/1941585375 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbf54060550 msgr2=0x7fbf54062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:16.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.545+0000 7fbf6cbe4700 1 --2- 172.21.15.3:0/1941585375 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbf54060550 0x7fbf54062a00 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c0058d0 tx=0x7fbf5c009040 comp rx=0 tx=0).stop 2023-10-08T15:42:16.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.545+0000 7fbf6cbe4700 1 -- 172.21.15.3:0/1941585375 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbf680a77f0 msgr2=0x7fbf6814de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:16.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.545+0000 7fbf6cbe4700 1 --2- 172.21.15.3:0/1941585375 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbf680a77f0 0x7fbf6814de40 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fbf58009ed0 tx=0x7fbf58017000 comp rx=0 tx=0).stop 2023-10-08T15:42:16.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.545+0000 7fbf6cbe4700 1 -- 172.21.15.3:0/1941585375 shutdown_connections 2023-10-08T15:42:16.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.545+0000 7fbf6cbe4700 1 --2- 172.21.15.3:0/1941585375 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbf54060550 0x7fbf54062a00 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:16.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.545+0000 7fbf6cbe4700 1 --2- 172.21.15.3:0/1941585375 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbf680a7bc0 0x7fbf6814d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:16.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.545+0000 7fbf6cbe4700 1 --2- 172.21.15.3:0/1941585375 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbf680a77f0 0x7fbf6814de40 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:16.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.545+0000 7fbf6cbe4700 1 --2- 172.21.15.3:0/1941585375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf6806c5c0 0x7fbf681461a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:16.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.545+0000 7fbf6cbe4700 1 -- 172.21.15.3:0/1941585375 >> 172.21.15.3:0/1941585375 conn(0x7fbf680c29f0 msgr2=0x7fbf680bff40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:16.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.545+0000 7fbf6cbe4700 1 -- 172.21.15.3:0/1941585375 shutdown_connections 2023-10-08T15:42:16.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.545+0000 7fbf6cbe4700 1 -- 172.21.15.3:0/1941585375 wait complete. 2023-10-08T15:42:16.563 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T15:42:16.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.673+0000 7f910bfff700 1 Processor -- start 2023-10-08T15:42:16.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.673+0000 7f910bfff700 1 -- start start 2023-10-08T15:42:16.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.673+0000 7f910bfff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f910c0bf1f0 0x7f910c0bf5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:16.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.673+0000 7f910bfff700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f910c0b3b60 con 0x7f910c06f080 2023-10-08T15:42:16.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.673+0000 7f910bfff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f910c0b3860 con 0x7f910c0a2d50 2023-10-08T15:42:16.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.673+0000 7f910bfff700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f910c06daf0 con 0x7f910c0bf1f0 2023-10-08T15:42:16.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.673+0000 7f910affd700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f910c0bf1f0 0x7f910c0bf5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:16.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.673+0000 7f910affd700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f910c0bf1f0 0x7f910c0bf5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45960/0 (socket says 172.21.15.3:45960) 2023-10-08T15:42:16.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.673+0000 7f910affd700 1 -- 172.21.15.3:0/4113881722 learned_addr learned my addr 172.21.15.3:0/4113881722 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:16.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.673+0000 7f910affd700 1 -- 172.21.15.3:0/4113881722 >> v1:172.21.15.50:6789/0 conn(0x7f910c0a2d50 legacy=0x7f910c0b1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:16.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.673+0000 7f910affd700 1 -- 172.21.15.3:0/4113881722 >> v1:172.21.15.3:6789/0 conn(0x7f910c06f080 legacy=0x7f910c14ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:16.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.673+0000 7f910affd700 1 -- 172.21.15.3:0/4113881722 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f910c06f520 con 0x7f910c0bf1f0 2023-10-08T15:42:16.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.673+0000 7f910affd700 1 --2- 172.21.15.3:0/4113881722 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f910c0bf1f0 0x7f910c0bf5c0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f90fc0099b0 tx=0x7f90fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b90c048923ce7740 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:16.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.673+0000 7f910a7fc700 1 -- 172.21.15.3:0/4113881722 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90fc00b820 con 0x7f910c0bf1f0 2023-10-08T15:42:16.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.673+0000 7f910a7fc700 1 -- 172.21.15.3:0/4113881722 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90fc00b980 con 0x7f910c0bf1f0 2023-10-08T15:42:16.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.673+0000 7f910a7fc700 1 -- 172.21.15.3:0/4113881722 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90fc00bd20 con 0x7f910c0bf1f0 2023-10-08T15:42:16.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.677+0000 7f910bfff700 1 -- 172.21.15.3:0/4113881722 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f910c0bf1f0 msgr2=0x7f910c0bf5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:16.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.677+0000 7f910bfff700 1 --2- 172.21.15.3:0/4113881722 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f910c0bf1f0 0x7f910c0bf5c0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f90fc0099b0 tx=0x7f90fc009250 comp rx=0 tx=0).stop 2023-10-08T15:42:16.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.677+0000 7f910bfff700 1 -- 172.21.15.3:0/4113881722 shutdown_connections 2023-10-08T15:42:16.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.677+0000 7f910bfff700 1 --2- 172.21.15.3:0/4113881722 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f910c0bf1f0 0x7f910c0bf5c0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:16.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.677+0000 7f910bfff700 1 -- 172.21.15.3:0/4113881722 >> 172.21.15.3:0/4113881722 conn(0x7f910c068c80 msgr2=0x7f910c0beae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:16.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.677+0000 7f910bfff700 1 -- 172.21.15.3:0/4113881722 shutdown_connections 2023-10-08T15:42:16.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.677+0000 7f910bfff700 1 -- 172.21.15.3:0/4113881722 wait complete. 2023-10-08T15:42:16.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.677+0000 7f910bfff700 1 Processor -- start 2023-10-08T15:42:16.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.677+0000 7f910bfff700 1 -- start start 2023-10-08T15:42:16.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.677+0000 7f910bfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f910c06f080 0x7f910c0b9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:16.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.677+0000 7f910bfff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f910c0a2d50 0x7f910c143680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:16.686 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.677+0000 7f910bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f910c0bf1f0 0x7f910c143bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:16.686 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.677+0000 7f910bfff700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f910c15f930 con 0x7f910c06f080 2023-10-08T15:42:16.686 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.677+0000 7f910bfff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f910c14eab0 con 0x7f910c0bf1f0 2023-10-08T15:42:16.686 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.677+0000 7f910bfff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f910c0b9ea0 con 0x7f910c0a2d50 2023-10-08T15:42:16.686 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.677+0000 7f910affd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f910c06f080 0x7f910c0b9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:16.686 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.681+0000 7f910b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f910c0bf1f0 0x7f910c143bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:16.686 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.681+0000 7f910b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f910c0bf1f0 0x7f910c143bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.3:38912/0 (socket says 172.21.15.3:38912) 2023-10-08T15:42:16.686 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.681+0000 7f910b7fe700 1 -- 172.21.15.3:0/3725520907 learned_addr learned my addr 172.21.15.3:0/3725520907 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:16.686 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.681+0000 7f91027fc700 1 --2- 172.21.15.3:0/3725520907 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f910c0a2d50 0x7f910c143680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:16.687 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.681+0000 7f910b7fe700 1 -- 172.21.15.3:0/3725520907 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f910c0a2d50 msgr2=0x7f910c143680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:16.687 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.681+0000 7f910b7fe700 1 --2- 172.21.15.3:0/3725520907 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f910c0a2d50 0x7f910c143680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:16.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.681+0000 7f910b7fe700 1 -- 172.21.15.3:0/3725520907 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f910c06f080 msgr2=0x7f910c0b9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:16.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.681+0000 7f910b7fe700 1 --2- 172.21.15.3:0/3725520907 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f910c06f080 0x7f910c0b9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:16.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.681+0000 7f910b7fe700 1 -- 172.21.15.3:0/3725520907 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90fc0094f0 con 0x7f910c0bf1f0 2023-10-08T15:42:16.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.681+0000 7f910b7fe700 1 --2- 172.21.15.3:0/3725520907 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f910c0bf1f0 0x7f910c143bc0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f910400c840 tx=0x7f9104001670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:16.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.681+0000 7f91037fe700 1 -- 172.21.15.3:0/3725520907 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9104012630 con 0x7f910c0bf1f0 2023-10-08T15:42:16.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.681+0000 7f91037fe700 1 -- 172.21.15.3:0/3725520907 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91040127b0 con 0x7f910c0bf1f0 2023-10-08T15:42:16.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.681+0000 7f91037fe700 1 -- 172.21.15.3:0/3725520907 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9104012b70 con 0x7f910c0bf1f0 2023-10-08T15:42:16.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.681+0000 7f910bfff700 1 -- 172.21.15.3:0/3725520907 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f910c14e740 con 0x7f910c0bf1f0 2023-10-08T15:42:16.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.681+0000 7f910bfff700 1 -- 172.21.15.3:0/3725520907 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f910c15f3c0 con 0x7f910c0bf1f0 2023-10-08T15:42:16.689 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.681+0000 7f910bfff700 1 -- 172.21.15.3:0/3725520907 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f910c14c160 con 0x7f910c0bf1f0 2023-10-08T15:42:16.689 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.685+0000 7f91037fe700 1 -- 172.21.15.3:0/3725520907 <== mon.1 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f910401a3a0 con 0x7f910c0bf1f0 2023-10-08T15:42:16.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.685+0000 7f91037fe700 1 --2- 172.21.15.3:0/3725520907 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f90ec060550 0x7f90ec062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:16.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.685+0000 7f91037fe700 1 -- 172.21.15.3:0/3725520907 <== mon.1 v2:172.21.15.50:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f910407ca60 con 0x7f910c0bf1f0 2023-10-08T15:42:16.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.685+0000 7f910affd700 1 --2- 172.21.15.3:0/3725520907 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f90ec060550 0x7f90ec062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:16.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.685+0000 7f910affd700 1 --2- 172.21.15.3:0/3725520907 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f90ec060550 0x7f90ec062a00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f90fc0099b0 tx=0x7f90fc016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:16.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.693+0000 7f91037fe700 1 -- 172.21.15.3:0/3725520907 <== mon.1 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f910404cf70 con 0x7f910c0bf1f0 2023-10-08T15:42:16.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.853+0000 7f910bfff700 1 -- 172.21.15.3:0/3725520907 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f910c05ecf0 con 0x7f910c0bf1f0 2023-10-08T15:42:16.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.853+0000 7f91037fe700 1 -- 172.21.15.3:0/3725520907 <== mon.1 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v61) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9104050590 con 0x7f910c0bf1f0 2023-10-08T15:42:16.861 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 64 2023-10-08T15:42:16.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.857+0000 7f910bfff700 1 -- 172.21.15.3:0/3725520907 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f90ec060550 msgr2=0x7f90ec062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:16.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.857+0000 7f910bfff700 1 --2- 172.21.15.3:0/3725520907 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f90ec060550 0x7f90ec062a00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f90fc0099b0 tx=0x7f90fc016000 comp rx=0 tx=0).stop 2023-10-08T15:42:16.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.857+0000 7f910bfff700 1 -- 172.21.15.3:0/3725520907 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f910c0bf1f0 msgr2=0x7f910c143bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:16.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.857+0000 7f910bfff700 1 --2- 172.21.15.3:0/3725520907 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f910c0bf1f0 0x7f910c143bc0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f910400c840 tx=0x7f9104001670 comp rx=0 tx=0).stop 2023-10-08T15:42:16.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.857+0000 7f910bfff700 1 -- 172.21.15.3:0/3725520907 shutdown_connections 2023-10-08T15:42:16.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.857+0000 7f910bfff700 1 --2- 172.21.15.3:0/3725520907 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f90ec060550 0x7f90ec062a00 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:16.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.857+0000 7f910bfff700 1 --2- 172.21.15.3:0/3725520907 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f910c0bf1f0 0x7f910c143bc0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:16.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.857+0000 7f910bfff700 1 --2- 172.21.15.3:0/3725520907 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f910c0a2d50 0x7f910c143680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:16.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.857+0000 7f910bfff700 1 --2- 172.21.15.3:0/3725520907 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f910c06f080 0x7f910c0b9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:16.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.857+0000 7f910bfff700 1 -- 172.21.15.3:0/3725520907 >> 172.21.15.3:0/3725520907 conn(0x7f910c068c80 msgr2=0x7f910c0bdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:16.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.857+0000 7f910bfff700 1 -- 172.21.15.3:0/3725520907 shutdown_connections 2023-10-08T15:42:16.864 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.857+0000 7f910bfff700 1 -- 172.21.15.3:0/3725520907 wait complete. 2023-10-08T15:42:16.875 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:42:16.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.973+0000 7f93e142b700 1 Processor -- start 2023-10-08T15:42:16.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.973+0000 7f93e142b700 1 -- start start 2023-10-08T15:42:16.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.977+0000 7f93e142b700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f93dc14ac50 0x7f93dc14b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:16.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.977+0000 7f93e142b700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93dc14c6b0 con 0x7f93dc06cc40 2023-10-08T15:42:16.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.977+0000 7f93e142b700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93dc14c060 con 0x7f93dc06be60 2023-10-08T15:42:16.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.977+0000 7f93e142b700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93dc14c340 con 0x7f93dc14ac50 2023-10-08T15:42:16.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.977+0000 7f93dbfff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f93dc14ac50 0x7f93dc14b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:16.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.977+0000 7f93e0c2a700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f93dc06cc40 0x7f93dc14cc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:53460/0 (socket says 172.21.15.3:53460) 2023-10-08T15:42:16.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.977+0000 7f93e0c2a700 1 -- 172.21.15.3:0/1917121224 learned_addr learned my addr 172.21.15.3:0/1917121224 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:42:16.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.977+0000 7f93daffd700 1 -- 172.21.15.3:0/1917121224 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 865819097 0 0) 0x7f93dc14c6b0 con 0x7f93dc06cc40 2023-10-08T15:42:16.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.977+0000 7f93daffd700 1 -- 172.21.15.3:0/1917121224 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93bc003570 con 0x7f93dc06cc40 2023-10-08T15:42:16.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.977+0000 7f93dbfff700 1 -- 172.21.15.3:0/1917121224 >> v1:172.21.15.50:6789/0 conn(0x7f93dc06be60 legacy=0x7f93dc06c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:16.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.977+0000 7f93daffd700 1 -- 172.21.15.3:0/1917121224 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1110945803 0 0) 0x7f93dc14c060 con 0x7f93dc06be60 2023-10-08T15:42:16.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.977+0000 7f93dbfff700 1 -- 172.21.15.3:0/1917121224 >> v1:172.21.15.3:6789/0 conn(0x7f93dc06cc40 legacy=0x7f93dc14cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:16.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.977+0000 7f93dbfff700 1 -- 172.21.15.3:0/1917121224 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93dc14e860 con 0x7f93dc14ac50 2023-10-08T15:42:16.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.977+0000 7f93dbfff700 1 --2- 172.21.15.3:0/1917121224 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f93dc14ac50 0x7f93dc14b020 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f93cc0098e0 tx=0x7f93cc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8f163e85be9538b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:16.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.977+0000 7f93daffd700 1 -- 172.21.15.3:0/1917121224 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93cc00b640 con 0x7f93dc14ac50 2023-10-08T15:42:16.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.977+0000 7f93daffd700 1 -- 172.21.15.3:0/1917121224 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93cc00b7a0 con 0x7f93dc14ac50 2023-10-08T15:42:16.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.977+0000 7f93daffd700 1 -- 172.21.15.3:0/1917121224 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93cc00bb20 con 0x7f93dc14ac50 2023-10-08T15:42:16.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.977+0000 7f93e142b700 1 -- 172.21.15.3:0/1917121224 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f93dc14ac50 msgr2=0x7f93dc14b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:16.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.977+0000 7f93e142b700 1 --2- 172.21.15.3:0/1917121224 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f93dc14ac50 0x7f93dc14b020 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f93cc0098e0 tx=0x7f93cc0091a0 comp rx=0 tx=0).stop 2023-10-08T15:42:16.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.977+0000 7f93e142b700 1 -- 172.21.15.3:0/1917121224 shutdown_connections 2023-10-08T15:42:16.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.977+0000 7f93e142b700 1 --2- 172.21.15.3:0/1917121224 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f93dc14ac50 0x7f93dc14b020 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:16.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.977+0000 7f93e142b700 1 -- 172.21.15.3:0/1917121224 >> 172.21.15.3:0/1917121224 conn(0x7f93dc0c1df0 msgr2=0x7f93dc0c21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:16.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.977+0000 7f93e142b700 1 -- 172.21.15.3:0/1917121224 shutdown_connections 2023-10-08T15:42:16.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.977+0000 7f93e142b700 1 -- 172.21.15.3:0/1917121224 wait complete. 2023-10-08T15:42:16.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.981+0000 7f93e142b700 1 Processor -- start 2023-10-08T15:42:16.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.981+0000 7f93e142b700 1 -- start start 2023-10-08T15:42:16.990 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.981+0000 7f93e142b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f93dc06be60 0x7f93dc15e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:16.990 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.981+0000 7f93e142b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93dc06cc40 0x7f93dc151660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:16.990 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.981+0000 7f93e142b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f93dc14ac50 0x7f93dc151ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:16.990 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.981+0000 7f93e142b700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93dc14a3e0 con 0x7f93dc06be60 2023-10-08T15:42:16.990 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.981+0000 7f93e142b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93dc15f190 con 0x7f93dc06cc40 2023-10-08T15:42:16.990 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.981+0000 7f93e142b700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93dc09b4e0 con 0x7f93dc14ac50 2023-10-08T15:42:16.990 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.981+0000 7f93dbfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f93dc06be60 0x7f93dc15e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:16.990 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.981+0000 7f93dbfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f93dc06be60 0x7f93dc15e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53474/0 (socket says 172.21.15.3:53474) 2023-10-08T15:42:16.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.981+0000 7f93dbfff700 1 -- 172.21.15.3:0/1221879457 learned_addr learned my addr 172.21.15.3:0/1221879457 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:16.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.985+0000 7f93db7fe700 1 --2- 172.21.15.3:0/1221879457 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93dc06cc40 0x7f93dc151660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:16.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.985+0000 7f93e0c2a700 1 --2- 172.21.15.3:0/1221879457 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f93dc14ac50 0x7f93dc151ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:16.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.985+0000 7f93dbfff700 1 -- 172.21.15.3:0/1221879457 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f93dc14ac50 msgr2=0x7f93dc151ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:16.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.985+0000 7f93dbfff700 1 --2- 172.21.15.3:0/1221879457 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f93dc14ac50 0x7f93dc151ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:16.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.985+0000 7f93dbfff700 1 -- 172.21.15.3:0/1221879457 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93dc06cc40 msgr2=0x7f93dc151660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:16.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.985+0000 7f93dbfff700 1 --2- 172.21.15.3:0/1221879457 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93dc06cc40 0x7f93dc151660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:16.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.985+0000 7f93dbfff700 1 -- 172.21.15.3:0/1221879457 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93cc009420 con 0x7f93dc06be60 2023-10-08T15:42:16.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.985+0000 7f93db7fe700 1 --2- 172.21.15.3:0/1221879457 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93dc06cc40 0x7f93dc151660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:42:16.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.985+0000 7f93dbfff700 1 --2- 172.21.15.3:0/1221879457 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f93dc06be60 0x7f93dc15e470 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f93cc009f80 tx=0x7f93cc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:16.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.985+0000 7f93d3fff700 1 -- 172.21.15.3:0/1221879457 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93cc00bb20 con 0x7f93dc06be60 2023-10-08T15:42:16.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.985+0000 7f93d3fff700 1 -- 172.21.15.3:0/1221879457 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93cc01a430 con 0x7f93dc06be60 2023-10-08T15:42:16.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.985+0000 7f93e142b700 1 -- 172.21.15.3:0/1221879457 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93dc15eeb0 con 0x7f93dc06be60 2023-10-08T15:42:16.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.985+0000 7f93d3fff700 1 -- 172.21.15.3:0/1221879457 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93cc01a7f0 con 0x7f93dc06be60 2023-10-08T15:42:16.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.985+0000 7f93e142b700 1 -- 172.21.15.3:0/1221879457 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93dc146490 con 0x7f93dc06be60 2023-10-08T15:42:16.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.985+0000 7f93e142b700 1 -- 172.21.15.3:0/1221879457 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93dc146680 con 0x7f93dc06be60 2023-10-08T15:42:16.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.985+0000 7f93d3fff700 1 -- 172.21.15.3:0/1221879457 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f93cc01aba0 con 0x7f93dc06be60 2023-10-08T15:42:16.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.989+0000 7f93d3fff700 1 --2- 172.21.15.3:0/1221879457 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f93c0060550 0x7f93c0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:16.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.989+0000 7f93d3fff700 1 -- 172.21.15.3:0/1221879457 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f93cc07e5a0 con 0x7f93dc06be60 2023-10-08T15:42:16.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.989+0000 7f93db7fe700 1 --2- 172.21.15.3:0/1221879457 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f93c0060550 0x7f93c0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:16.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.989+0000 7f93db7fe700 1 --2- 172.21.15.3:0/1221879457 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f93c0060550 0x7f93c0062a00 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f93dc09ede0 tx=0x7f93c4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:17.002 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:16.997+0000 7f93d3fff700 1 -- 172.21.15.3:0/1221879457 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f93dc146680 con 0x7f93dc06be60 2023-10-08T15:42:17.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.193+0000 7f93e142b700 1 -- 172.21.15.3:0/1221879457 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f93dc146680 con 0x7f93dc06be60 2023-10-08T15:42:17.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.193+0000 7f93d3fff700 1 -- 172.21.15.3:0/1221879457 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+3082 (secure 0 0 0) 0x7f93cc015c20 con 0x7f93dc06be60 2023-10-08T15:42:17.200 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:42:17.200 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":33,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5480,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1007706158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1007706158},{"type":"v1","addr":"172.21.15.50:6835","nonce":1007706158}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:41:45.889781+0000","modified":"2023-10-08T15:41:48.541276+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6030},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6030":{"gid":6030,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.3:6833/1129612905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":1129612905},{"type":"v1","addr":"172.21.15.3:6833","nonce":1129612905}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-08T15:42:17.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.197+0000 7f93e142b700 1 -- 172.21.15.3:0/1221879457 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f93c0060550 msgr2=0x7f93c0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:17.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.197+0000 7f93e142b700 1 --2- 172.21.15.3:0/1221879457 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f93c0060550 0x7f93c0062a00 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f93dc09ede0 tx=0x7f93c4009040 comp rx=0 tx=0).stop 2023-10-08T15:42:17.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.197+0000 7f93e142b700 1 -- 172.21.15.3:0/1221879457 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f93dc06be60 msgr2=0x7f93dc15e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:17.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.197+0000 7f93e142b700 1 --2- 172.21.15.3:0/1221879457 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f93dc06be60 0x7f93dc15e470 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f93cc009f80 tx=0x7f93cc017000 comp rx=0 tx=0).stop 2023-10-08T15:42:17.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.197+0000 7f93e142b700 1 -- 172.21.15.3:0/1221879457 shutdown_connections 2023-10-08T15:42:17.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.197+0000 7f93e142b700 1 --2- 172.21.15.3:0/1221879457 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f93c0060550 0x7f93c0062a00 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:17.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.197+0000 7f93e142b700 1 --2- 172.21.15.3:0/1221879457 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f93dc14ac50 0x7f93dc151ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:17.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.197+0000 7f93e142b700 1 --2- 172.21.15.3:0/1221879457 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93dc06cc40 0x7f93dc151660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:17.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.197+0000 7f93e142b700 1 --2- 172.21.15.3:0/1221879457 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f93dc06be60 0x7f93dc15e470 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:17.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.197+0000 7f93e142b700 1 -- 172.21.15.3:0/1221879457 >> 172.21.15.3:0/1221879457 conn(0x7f93dc0c1df0 msgr2=0x7f93dc0682b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:17.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.197+0000 7f93e142b700 1 -- 172.21.15.3:0/1221879457 shutdown_connections 2023-10-08T15:42:17.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.197+0000 7f93e142b700 1 -- 172.21.15.3:0/1221879457 wait complete. 2023-10-08T15:42:17.204 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 33 2023-10-08T15:42:17.214 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:42:17.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.313+0000 7f48fb4cd700 1 Processor -- start 2023-10-08T15:42:17.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.313+0000 7f48fb4cd700 1 -- start start 2023-10-08T15:42:17.319 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.313+0000 7f48fb4cd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f48f40bbf00 0x7f48f40bd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:17.319 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.313+0000 7f48fb4cd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f48f40bd000 0x7f48f4150430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:17.319 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.313+0000 7f48fb4cd700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f48f409e490 0x7f48f4150970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:17.320 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.313+0000 7f48fb4cd700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48f4154210 con 0x7f48f409e490 2023-10-08T15:42:17.320 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.313+0000 7f48fb4cd700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48f4150eb0 con 0x7f48f40bd000 2023-10-08T15:42:17.320 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.313+0000 7f48fb4cd700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48f4153f30 con 0x7f48f40bbf00 2023-10-08T15:42:17.320 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.313+0000 7f48faccc700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f48f409e490 0x7f48f4150970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:17.320 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.313+0000 7f48f9cca700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f48f40bd000 0x7f48f4150430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:17.320 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.313+0000 7f48fa4cb700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f48f40bbf00 0x7f48f40bd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:17.320 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.313+0000 7f48faccc700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f48f409e490 0x7f48f4150970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53482/0 (socket says 172.21.15.3:53482) 2023-10-08T15:42:17.320 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.313+0000 7f48faccc700 1 -- 172.21.15.3:0/3787310298 learned_addr learned my addr 172.21.15.3:0/3787310298 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:17.322 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.313+0000 7f48faccc700 1 -- 172.21.15.3:0/3787310298 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f48f40bbf00 msgr2=0x7f48f40bd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:17.322 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.313+0000 7f48faccc700 1 --2- 172.21.15.3:0/3787310298 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f48f40bbf00 0x7f48f40bd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:17.322 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.313+0000 7f48faccc700 1 -- 172.21.15.3:0/3787310298 >> v2:172.21.15.50:3300/0 conn(0x7f48f40bd000 msgr2=0x7f48f4150430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:17.322 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.313+0000 7f48faccc700 1 --2- 172.21.15.3:0/3787310298 >> v2:172.21.15.50:3300/0 conn(0x7f48f40bd000 0x7f48f4150430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:17.322 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.313+0000 7f48faccc700 1 -- 172.21.15.3:0/3787310298 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f414ff10 con 0x7f48f409e490 2023-10-08T15:42:17.322 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.313+0000 7f48f9cca700 1 --2- 172.21.15.3:0/3787310298 >> v2:172.21.15.50:3300/0 conn(0x7f48f40bd000 0x7f48f4150430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:42:17.322 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.313+0000 7f48faccc700 1 --2- 172.21.15.3:0/3787310298 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f48f409e490 0x7f48f4150970 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f48f40bc690 tx=0x7f48ec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da9894a3c42e541f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:17.322 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.313+0000 7f48f94c9700 1 -- 172.21.15.3:0/3787310298 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ec00b640 con 0x7f48f409e490 2023-10-08T15:42:17.322 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.313+0000 7f48f94c9700 1 -- 172.21.15.3:0/3787310298 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48ec00b7a0 con 0x7f48f409e490 2023-10-08T15:42:17.322 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.313+0000 7f48f94c9700 1 -- 172.21.15.3:0/3787310298 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ec00bb60 con 0x7f48f409e490 2023-10-08T15:42:17.323 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.313+0000 7f48fb4cd700 1 -- 172.21.15.3:0/3787310298 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f48f409e490 msgr2=0x7f48f4150970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:17.323 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.313+0000 7f48fb4cd700 1 --2- 172.21.15.3:0/3787310298 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f48f409e490 0x7f48f4150970 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f48f40bc690 tx=0x7f48ec009250 comp rx=0 tx=0).stop 2023-10-08T15:42:17.323 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.317+0000 7f48fb4cd700 1 -- 172.21.15.3:0/3787310298 shutdown_connections 2023-10-08T15:42:17.323 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.317+0000 7f48fb4cd700 1 --2- 172.21.15.3:0/3787310298 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f48f409e490 0x7f48f4150970 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:17.323 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.317+0000 7f48fb4cd700 1 --2- 172.21.15.3:0/3787310298 >> v2:172.21.15.50:3300/0 conn(0x7f48f40bd000 0x7f48f4150430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:17.323 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.317+0000 7f48fb4cd700 1 --2- 172.21.15.3:0/3787310298 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f48f40bbf00 0x7f48f40bd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:17.323 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.317+0000 7f48fb4cd700 1 -- 172.21.15.3:0/3787310298 >> 172.21.15.3:0/3787310298 conn(0x7f48f40bf5e0 msgr2=0x7f48f40bb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:17.323 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.317+0000 7f48fb4cd700 1 -- 172.21.15.3:0/3787310298 shutdown_connections 2023-10-08T15:42:17.323 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.317+0000 7f48fb4cd700 1 -- 172.21.15.3:0/3787310298 wait complete. 2023-10-08T15:42:17.324 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.317+0000 7f48fb4cd700 1 Processor -- start 2023-10-08T15:42:17.324 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.317+0000 7f48fb4cd700 1 -- start start 2023-10-08T15:42:17.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.317+0000 7f48fb4cd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f48f409e490 0x7f48f4162530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:17.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.317+0000 7f48fb4cd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48f40bbf00 0x7f48f4162a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:17.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.317+0000 7f48fb4cd700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f48f40bd000 0x7f48f40a1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:17.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.317+0000 7f48fb4cd700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f40b2ca0 con 0x7f48f409e490 2023-10-08T15:42:17.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.317+0000 7f48fb4cd700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f40b3210 con 0x7f48f40bbf00 2023-10-08T15:42:17.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.317+0000 7f48fb4cd700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48f415ff10 con 0x7f48f40bd000 2023-10-08T15:42:17.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.317+0000 7f48fa4cb700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f48f409e490 0x7f48f4162530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:17.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.317+0000 7f48fa4cb700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f48f409e490 0x7f48f4162530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53490/0 (socket says 172.21.15.3:53490) 2023-10-08T15:42:17.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.317+0000 7f48fa4cb700 1 -- 172.21.15.3:0/1944747111 learned_addr learned my addr 172.21.15.3:0/1944747111 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:17.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.317+0000 7f48f9cca700 1 --2- 172.21.15.3:0/1944747111 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48f40bbf00 0x7f48f4162a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:17.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.317+0000 7f48faccc700 1 --2- 172.21.15.3:0/1944747111 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f48f40bd000 0x7f48f40a1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:17.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.321+0000 7f48fa4cb700 1 -- 172.21.15.3:0/1944747111 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f48f40bd000 msgr2=0x7f48f40a1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:17.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.321+0000 7f48fa4cb700 1 --2- 172.21.15.3:0/1944747111 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f48f40bd000 0x7f48f40a1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:17.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.321+0000 7f48fa4cb700 1 -- 172.21.15.3:0/1944747111 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48f40bbf00 msgr2=0x7f48f4162a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:17.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.321+0000 7f48fa4cb700 1 --2- 172.21.15.3:0/1944747111 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48f40bbf00 0x7f48f4162a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:17.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.321+0000 7f48fa4cb700 1 -- 172.21.15.3:0/1944747111 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e8009420 con 0x7f48f409e490 2023-10-08T15:42:17.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.321+0000 7f48fa4cb700 1 --2- 172.21.15.3:0/1944747111 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f48f409e490 0x7f48f4162530 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f48e4009f40 tx=0x7f48e400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:17.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.321+0000 7f48f27fc700 1 -- 172.21.15.3:0/1944747111 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e400cb70 con 0x7f48f409e490 2023-10-08T15:42:17.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.321+0000 7f48f27fc700 1 -- 172.21.15.3:0/1944747111 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48e400f040 con 0x7f48f409e490 2023-10-08T15:42:17.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.321+0000 7f48fb4cd700 1 -- 172.21.15.3:0/1944747111 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48ec0094f0 con 0x7f48f409e490 2023-10-08T15:42:17.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.321+0000 7f48f27fc700 1 -- 172.21.15.3:0/1944747111 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e4014480 con 0x7f48f409e490 2023-10-08T15:42:17.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.321+0000 7f48fb4cd700 1 -- 172.21.15.3:0/1944747111 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48f40b2f20 con 0x7f48f409e490 2023-10-08T15:42:17.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.321+0000 7f48fb4cd700 1 -- 172.21.15.3:0/1944747111 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48f405ecf0 con 0x7f48f409e490 2023-10-08T15:42:17.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.321+0000 7f48f27fc700 1 -- 172.21.15.3:0/1944747111 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f48e40147f0 con 0x7f48f409e490 2023-10-08T15:42:17.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.321+0000 7f48f27fc700 1 --2- 172.21.15.3:0/1944747111 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f48e0060580 0x7f48e0062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:17.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.325+0000 7f48f27fc700 1 -- 172.21.15.3:0/1944747111 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f48e407ced0 con 0x7f48f409e490 2023-10-08T15:42:17.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.325+0000 7f48f9cca700 1 --2- 172.21.15.3:0/1944747111 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f48e0060580 0x7f48e0062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:17.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.325+0000 7f48f9cca700 1 --2- 172.21.15.3:0/1944747111 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f48e0060580 0x7f48e0062a30 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f48f40b48a0 tx=0x7f48e80091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:17.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.329+0000 7f48f27fc700 1 -- 172.21.15.3:0/1944747111 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f48e404d480 con 0x7f48f409e490 2023-10-08T15:42:17.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.493+0000 7f48fb4cd700 1 -- 172.21.15.3:0/1944747111 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f48f4153c40 con 0x7f48f409e490 2023-10-08T15:42:17.501 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.493+0000 7f48f27fc700 1 -- 172.21.15.3:0/1944747111 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+15355 (secure 0 0 0) 0x7f48e4050aa0 con 0x7f48f409e490 2023-10-08T15:42:17.502 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:42:17.502 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":61,"fsid":"7635972e-cd66-4a8f-a231-378db8b3847a","created":"2023-10-08T15:37:08.234594+0000","modified":"2023-10-08T15:42:14.153650+0000","last_up_change":"2023-10-08T15:37:17.537726+0000","last_in_change":"2023-10-08T15:37:10.269178+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:37:16.581590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:41:44.126771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-08T15:41:44.881738+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"64fb1864-bfdd-4d75-9b41-03fb60085dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33363},{"type":"v1","addr":"172.21.15.3:6801","nonce":33363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33363},{"type":"v1","addr":"172.21.15.3:6803","nonce":33363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":33363},{"type":"v1","addr":"172.21.15.3:6807","nonce":33363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33363},{"type":"v1","addr":"172.21.15.3:6805","nonce":33363}]},"public_addr":"172.21.15.3:6801/33363","cluster_addr":"172.21.15.3:6803/33363","heartbeat_back_addr":"172.21.15.3:6807/33363","heartbeat_front_addr":"172.21.15.3:6805/33363","state":["exists","up"]},{"osd":1,"uuid":"3ca6bd3a-3e8a-4c65-af9c-46148b0c2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33364},{"type":"v1","addr":"172.21.15.3:6820","nonce":33364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33364},{"type":"v1","addr":"172.21.15.3:6824","nonce":33364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33364},{"type":"v1","addr":"172.21.15.3:6831","nonce":33364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33364},{"type":"v1","addr":"172.21.15.3:6828","nonce":33364}]},"public_addr":"172.21.15.3:6820/33364","cluster_addr":"172.21.15.3:6824/33364","heartbeat_back_addr":"172.21.15.3:6831/33364","heartbeat_front_addr":"172.21.15.3:6828/33364","state":["exists","up"]},{"osd":2,"uuid":"6eb9f757-58dd-442f-910d-32401454bce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33366},{"type":"v1","addr":"172.21.15.3:6817","nonce":33366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":33366},{"type":"v1","addr":"172.21.15.3:6821","nonce":33366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6827","nonce":33366},{"type":"v1","addr":"172.21.15.3:6829","nonce":33366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":33366},{"type":"v1","addr":"172.21.15.3:6825","nonce":33366}]},"public_addr":"172.21.15.3:6817/33366","cluster_addr":"172.21.15.3:6821/33366","heartbeat_back_addr":"172.21.15.3:6829/33366","heartbeat_front_addr":"172.21.15.3:6825/33366","state":["exists","up"]},{"osd":3,"uuid":"1c39866b-ac2e-4ea9-a69c-02b01ee4191d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33365},{"type":"v1","addr":"172.21.15.3:6809","nonce":33365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":33365},{"type":"v1","addr":"172.21.15.3:6811","nonce":33365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33365},{"type":"v1","addr":"172.21.15.3:6815","nonce":33365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":33365},{"type":"v1","addr":"172.21.15.3:6813","nonce":33365}]},"public_addr":"172.21.15.3:6809/33365","cluster_addr":"172.21.15.3:6811/33365","heartbeat_back_addr":"172.21.15.3:6815/33365","heartbeat_front_addr":"172.21.15.3:6813/33365","state":["exists","up"]},{"osd":4,"uuid":"15f86b61-b7f1-4780-ae00-9d80a68cb830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":33605},{"type":"v1","addr":"172.21.15.50:6809","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33605},{"type":"v1","addr":"172.21.15.50:6811","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33605},{"type":"v1","addr":"172.21.15.50:6815","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":33605},{"type":"v1","addr":"172.21.15.50:6813","nonce":33605}]},"public_addr":"172.21.15.50:6809/33605","cluster_addr":"172.21.15.50:6811/33605","heartbeat_back_addr":"172.21.15.50:6815/33605","heartbeat_front_addr":"172.21.15.50:6813/33605","state":["exists","up"]},{"osd":5,"uuid":"726c3003-34e6-4d5a-b6e2-f911e13c2118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33606},{"type":"v1","addr":"172.21.15.50:6801","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33606},{"type":"v1","addr":"172.21.15.50:6803","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33606},{"type":"v1","addr":"172.21.15.50:6807","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":33606},{"type":"v1","addr":"172.21.15.50:6805","nonce":33606}]},"public_addr":"172.21.15.50:6801/33606","cluster_addr":"172.21.15.50:6803/33606","heartbeat_back_addr":"172.21.15.50:6807/33606","heartbeat_front_addr":"172.21.15.50:6805/33606","state":["exists","up"]},{"osd":6,"uuid":"401122a4-9988-441f-a5a7-39164434ebcd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":33607},{"type":"v1","addr":"172.21.15.50:6819","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":33607},{"type":"v1","addr":"172.21.15.50:6823","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":33607},{"type":"v1","addr":"172.21.15.50:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":33607},{"type":"v1","addr":"172.21.15.50:6827","nonce":33607}]},"public_addr":"172.21.15.50:6819/33607","cluster_addr":"172.21.15.50:6823/33607","heartbeat_back_addr":"172.21.15.50:6831/33607","heartbeat_front_addr":"172.21.15.50:6827/33607","state":["exists","up"]},{"osd":7,"uuid":"6b3fa236-c9d0-4c4d-82ae-9af4daf6d699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33604},{"type":"v1","addr":"172.21.15.50:6818","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":33604},{"type":"v1","addr":"172.21.15.50:6822","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":33604},{"type":"v1","addr":"172.21.15.50:6830","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":33604},{"type":"v1","addr":"172.21.15.50:6826","nonce":33604}]},"public_addr":"172.21.15.50:6818/33604","cluster_addr":"172.21.15.50:6822/33604","heartbeat_back_addr":"172.21.15.50:6830/33604","heartbeat_front_addr":"172.21.15.50:6826/33604","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.497794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.529417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.873426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.325972+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.443971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.240795+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.739632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.643026+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.14","mappings":[{"from":6,"to":0}]},{"pgid":"11.30","mappings":[{"from":6,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:42:17.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.497+0000 7f48fb4cd700 1 -- 172.21.15.3:0/1944747111 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f48e0060580 msgr2=0x7f48e0062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:17.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.497+0000 7f48fb4cd700 1 --2- 172.21.15.3:0/1944747111 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f48e0060580 0x7f48e0062a30 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f48f40b48a0 tx=0x7f48e80091a0 comp rx=0 tx=0).stop 2023-10-08T15:42:17.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.497+0000 7f48fb4cd700 1 -- 172.21.15.3:0/1944747111 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f48f409e490 msgr2=0x7f48f4162530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:17.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.497+0000 7f48fb4cd700 1 --2- 172.21.15.3:0/1944747111 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f48f409e490 0x7f48f4162530 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f48e4009f40 tx=0x7f48e400b040 comp rx=0 tx=0).stop 2023-10-08T15:42:17.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.497+0000 7f48fb4cd700 1 -- 172.21.15.3:0/1944747111 shutdown_connections 2023-10-08T15:42:17.505 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.497+0000 7f48fb4cd700 1 --2- 172.21.15.3:0/1944747111 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f48e0060580 0x7f48e0062a30 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:17.505 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.497+0000 7f48fb4cd700 1 --2- 172.21.15.3:0/1944747111 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f48f40bd000 0x7f48f40a1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:17.505 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.497+0000 7f48fb4cd700 1 --2- 172.21.15.3:0/1944747111 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48f40bbf00 0x7f48f4162a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:17.505 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.497+0000 7f48fb4cd700 1 --2- 172.21.15.3:0/1944747111 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f48f409e490 0x7f48f4162530 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:17.505 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.497+0000 7f48fb4cd700 1 -- 172.21.15.3:0/1944747111 >> 172.21.15.3:0/1944747111 conn(0x7f48f40bf5e0 msgr2=0x7f48f414db60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:17.505 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.497+0000 7f48fb4cd700 1 -- 172.21.15.3:0/1944747111 shutdown_connections 2023-10-08T15:42:17.505 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.497+0000 7f48fb4cd700 1 -- 172.21.15.3:0/1944747111 wait complete. 2023-10-08T15:42:17.516 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T15:42:17.517 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:42:17.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.617+0000 7f8554847700 1 Processor -- start 2023-10-08T15:42:17.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.617+0000 7f8554847700 1 -- start start 2023-10-08T15:42:17.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.617+0000 7f8554847700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f855006d080 0x7f8550068ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:17.624 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.617+0000 7f8554847700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f8550153ad0 0x7f855014ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:17.624 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.617+0000 7f8554847700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f855009e490 con 0x7f85500bafe0 2023-10-08T15:42:17.624 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.617+0000 7f8554847700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f855006ce30 con 0x7f8550153ad0 2023-10-08T15:42:17.624 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.617+0000 7f8554847700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f855009e6e0 con 0x7f855006d080 2023-10-08T15:42:17.624 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.617+0000 7f854ed9d700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f8550153ad0 0x7f855014ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:17.624 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.617+0000 7f854ed9d700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f8550153ad0 0x7f855014ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53502/0 (socket says 172.21.15.3:53502) 2023-10-08T15:42:17.624 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.617+0000 7f854ed9d700 1 -- 172.21.15.3:0/4196594541 learned_addr learned my addr 172.21.15.3:0/4196594541 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:17.624 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.617+0000 7f854dd9b700 1 --2- 172.21.15.3:0/4196594541 >> v2:172.21.15.50:3300/0 conn(0x7f855006d080 0x7f8550068ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:17.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.617+0000 7f854ed9d700 1 -- 172.21.15.3:0/4196594541 >> v2:172.21.15.50:3300/0 conn(0x7f855006d080 msgr2=0x7f8550068ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:17.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.617+0000 7f854ed9d700 1 --2- 172.21.15.3:0/4196594541 >> v2:172.21.15.50:3300/0 conn(0x7f855006d080 0x7f8550068ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:17.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.617+0000 7f854ed9d700 1 -- 172.21.15.3:0/4196594541 >> v1:172.21.15.50:6789/0 conn(0x7f85500bafe0 legacy=0x7f85501533c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:17.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.617+0000 7f854ed9d700 1 -- 172.21.15.3:0/4196594541 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8550153f50 con 0x7f8550153ad0 2023-10-08T15:42:17.627 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.617+0000 7f854dd9b700 1 --2- 172.21.15.3:0/4196594541 >> v2:172.21.15.50:3300/0 conn(0x7f855006d080 0x7f8550068ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:42:17.627 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.617+0000 7f854ed9d700 1 --2- 172.21.15.3:0/4196594541 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8550153ad0 0x7f855014ef20 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f855009f7e0 tx=0x7f8538009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d991cb967f7a752 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:17.627 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.617+0000 7f854d59a700 1 -- 172.21.15.3:0/4196594541 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8538009e70 con 0x7f8550153ad0 2023-10-08T15:42:17.627 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.617+0000 7f854d59a700 1 -- 172.21.15.3:0/4196594541 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f853800b860 con 0x7f8550153ad0 2023-10-08T15:42:17.627 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.617+0000 7f854d59a700 1 -- 172.21.15.3:0/4196594541 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853800bc00 con 0x7f8550153ad0 2023-10-08T15:42:17.627 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.621+0000 7f8554847700 1 -- 172.21.15.3:0/4196594541 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8550153ad0 msgr2=0x7f855014ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:17.627 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.621+0000 7f8554847700 1 --2- 172.21.15.3:0/4196594541 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8550153ad0 0x7f855014ef20 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f855009f7e0 tx=0x7f8538009250 comp rx=0 tx=0).stop 2023-10-08T15:42:17.627 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.621+0000 7f8554847700 1 -- 172.21.15.3:0/4196594541 shutdown_connections 2023-10-08T15:42:17.627 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.621+0000 7f8554847700 1 --2- 172.21.15.3:0/4196594541 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8550153ad0 0x7f855014ef20 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:17.627 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.621+0000 7f8554847700 1 --2- 172.21.15.3:0/4196594541 >> v2:172.21.15.50:3300/0 conn(0x7f855006d080 0x7f8550068ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:17.627 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.621+0000 7f8554847700 1 -- 172.21.15.3:0/4196594541 >> 172.21.15.3:0/4196594541 conn(0x7f85500be640 msgr2=0x7f85500ba6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:17.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.621+0000 7f8554847700 1 -- 172.21.15.3:0/4196594541 shutdown_connections 2023-10-08T15:42:17.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.621+0000 7f8554847700 1 -- 172.21.15.3:0/4196594541 wait complete. 2023-10-08T15:42:17.630 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.621+0000 7f8554847700 1 Processor -- start 2023-10-08T15:42:17.630 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.621+0000 7f8554847700 1 -- start start 2023-10-08T15:42:17.630 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.621+0000 7f8554847700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f855006d080 0x7f85500680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:17.630 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.621+0000 7f8554847700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f85500bafe0 0x7f85500a2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:17.630 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.621+0000 7f8554847700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8550153ad0 0x7f8550162ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:17.630 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.621+0000 7f8554847700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8550146fd0 con 0x7f85500bafe0 2023-10-08T15:42:17.630 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.621+0000 7f8554847700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8550147880 con 0x7f855006d080 2023-10-08T15:42:17.631 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.621+0000 7f8554847700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8550147ed0 con 0x7f8550153ad0 2023-10-08T15:42:17.631 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.621+0000 7f854dd9b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f85500bafe0 0x7f85500a2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:17.631 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.621+0000 7f854dd9b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f85500bafe0 0x7f85500a2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53506/0 (socket says 172.21.15.3:53506) 2023-10-08T15:42:17.631 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.621+0000 7f854dd9b700 1 -- 172.21.15.3:0/2115239888 learned_addr learned my addr 172.21.15.3:0/2115239888 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:17.631 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.621+0000 7f854ed9d700 1 --2- 172.21.15.3:0/2115239888 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8550153ad0 0x7f8550162ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:17.631 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.621+0000 7f854e59c700 1 --2- 172.21.15.3:0/2115239888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f855006d080 0x7f85500680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:17.631 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.621+0000 7f854dd9b700 1 -- 172.21.15.3:0/2115239888 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8550153ad0 msgr2=0x7f8550162ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:17.631 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.621+0000 7f854dd9b700 1 --2- 172.21.15.3:0/2115239888 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8550153ad0 0x7f8550162ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:17.631 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.621+0000 7f854dd9b700 1 -- 172.21.15.3:0/2115239888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f855006d080 msgr2=0x7f85500680b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:17.631 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.621+0000 7f854dd9b700 1 --2- 172.21.15.3:0/2115239888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f855006d080 0x7f85500680b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:17.631 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.621+0000 7f854dd9b700 1 -- 172.21.15.3:0/2115239888 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8548009a20 con 0x7f85500bafe0 2023-10-08T15:42:17.632 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.621+0000 7f854e59c700 1 --2- 172.21.15.3:0/2115239888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f855006d080 0x7f85500680b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:42:17.632 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.621+0000 7f854ed9d700 1 --2- 172.21.15.3:0/2115239888 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8550153ad0 0x7f8550162ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:42:17.632 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.621+0000 7f854dd9b700 1 --2- 172.21.15.3:0/2115239888 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f85500bafe0 0x7f85500a2530 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f854800c0c0 tx=0x7f854800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:17.632 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.625+0000 7f85467fc700 1 -- 172.21.15.3:0/2115239888 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854800cd60 con 0x7f85500bafe0 2023-10-08T15:42:17.632 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.625+0000 7f85467fc700 1 -- 172.21.15.3:0/2115239888 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f854800f040 con 0x7f85500bafe0 2023-10-08T15:42:17.632 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.625+0000 7f8554847700 1 -- 172.21.15.3:0/2115239888 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85380094f0 con 0x7f85500bafe0 2023-10-08T15:42:17.632 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.625+0000 7f85467fc700 1 -- 172.21.15.3:0/2115239888 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85480146b0 con 0x7f85500bafe0 2023-10-08T15:42:17.632 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.625+0000 7f8554847700 1 -- 172.21.15.3:0/2115239888 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8550160740 con 0x7f85500bafe0 2023-10-08T15:42:17.633 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.625+0000 7f8554847700 1 -- 172.21.15.3:0/2115239888 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85501608d0 con 0x7f85500bafe0 2023-10-08T15:42:17.633 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.625+0000 7f85467fc700 1 -- 172.21.15.3:0/2115239888 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f8548014a20 con 0x7f85500bafe0 2023-10-08T15:42:17.633 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.625+0000 7f85467fc700 1 --2- 172.21.15.3:0/2115239888 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8530060550 0x7f8530062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:17.633 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.625+0000 7f85467fc700 1 -- 172.21.15.3:0/2115239888 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f854807d540 con 0x7f85500bafe0 2023-10-08T15:42:17.634 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.629+0000 7f854e59c700 1 --2- 172.21.15.3:0/2115239888 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8530060550 0x7f8530062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:17.634 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.629+0000 7f854e59c700 1 --2- 172.21.15.3:0/2115239888 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8530060550 0x7f8530062a00 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8540001870 tx=0x7f8540009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:17.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.633+0000 7f85467fc700 1 -- 172.21.15.3:0/2115239888 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f854804daf0 con 0x7f85500bafe0 2023-10-08T15:42:17.832 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.825+0000 7f8554847700 1 -- 172.21.15.3:0/2115239888 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8550064560 con 0x7f85500bafe0 2023-10-08T15:42:17.833 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.825+0000 7f85467fc700 1 -- 172.21.15.3:0/2115239888 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+3082 (secure 0 0 0) 0x7f8548051110 con 0x7f85500bafe0 2023-10-08T15:42:17.833 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:42:17.833 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":33,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5480,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1007706158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1007706158},{"type":"v1","addr":"172.21.15.50:6835","nonce":1007706158}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:41:45.889781+0000","modified":"2023-10-08T15:41:48.541276+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6030},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6030":{"gid":6030,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.3:6833/1129612905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":1129612905},{"type":"v1","addr":"172.21.15.3:6833","nonce":1129612905}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-08T15:42:17.836 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.829+0000 7f8554847700 1 -- 172.21.15.3:0/2115239888 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8530060550 msgr2=0x7f8530062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:17.836 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.829+0000 7f8554847700 1 --2- 172.21.15.3:0/2115239888 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8530060550 0x7f8530062a00 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8540001870 tx=0x7f8540009040 comp rx=0 tx=0).stop 2023-10-08T15:42:17.836 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.829+0000 7f8554847700 1 -- 172.21.15.3:0/2115239888 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f85500bafe0 msgr2=0x7f85500a2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:17.836 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.829+0000 7f8554847700 1 --2- 172.21.15.3:0/2115239888 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f85500bafe0 0x7f85500a2530 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f854800c0c0 tx=0x7f854800b040 comp rx=0 tx=0).stop 2023-10-08T15:42:17.836 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.829+0000 7f8554847700 1 -- 172.21.15.3:0/2115239888 shutdown_connections 2023-10-08T15:42:17.836 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.829+0000 7f8554847700 1 --2- 172.21.15.3:0/2115239888 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8530060550 0x7f8530062a00 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:17.836 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.829+0000 7f8554847700 1 --2- 172.21.15.3:0/2115239888 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8550153ad0 0x7f8550162ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:17.836 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.829+0000 7f8554847700 1 --2- 172.21.15.3:0/2115239888 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f85500bafe0 0x7f85500a2530 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:17.836 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.829+0000 7f8554847700 1 --2- 172.21.15.3:0/2115239888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f855006d080 0x7f85500680b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:17.837 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.829+0000 7f8554847700 1 -- 172.21.15.3:0/2115239888 >> 172.21.15.3:0/2115239888 conn(0x7f85500be640 msgr2=0x7f855014b790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:17.837 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.829+0000 7f8554847700 1 -- 172.21.15.3:0/2115239888 shutdown_connections 2023-10-08T15:42:17.837 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.829+0000 7f8554847700 1 -- 172.21.15.3:0/2115239888 wait complete. 2023-10-08T15:42:17.837 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 33 2023-10-08T15:42:17.847 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:42:17.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.945+0000 7f1835422700 1 Processor -- start 2023-10-08T15:42:17.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.945+0000 7f1835422700 1 -- start start 2023-10-08T15:42:17.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.949+0000 7f1835422700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f18300be150 0x7f18300be520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:17.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.949+0000 7f1835422700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f183006c3e0 0x7f183014b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:17.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.949+0000 7f1835422700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f183006cb60 con 0x7f183006be60 2023-10-08T15:42:17.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.949+0000 7f1835422700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f183014f8e0 con 0x7f18300be150 2023-10-08T15:42:17.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.949+0000 7f1835422700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f183014f5f0 con 0x7f183006c3e0 2023-10-08T15:42:17.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.949+0000 7f182e7fc700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f183006be60 0x7f18300c26a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:53468/0 (socket says 172.21.15.3:53468) 2023-10-08T15:42:17.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.949+0000 7f182e7fc700 1 -- 172.21.15.3:0/2958799694 learned_addr learned my addr 172.21.15.3:0/2958799694 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:42:17.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.949+0000 7f182effd700 1 --2- 172.21.15.3:0/2958799694 >> v2:172.21.15.3:3300/0 conn(0x7f18300be150 0x7f18300be520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:17.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.949+0000 7f182f7fe700 1 --2- 172.21.15.3:0/2958799694 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f183006c3e0 0x7f183014b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:17.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.949+0000 7f182dffb700 1 -- 172.21.15.3:0/2958799694 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2938607533 0 0) 0x7f183006cb60 con 0x7f183006be60 2023-10-08T15:42:17.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.949+0000 7f182dffb700 1 -- 172.21.15.3:0/2958799694 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1818003570 con 0x7f183006be60 2023-10-08T15:42:17.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.949+0000 7f182effd700 1 -- 172.21.15.3:0/2958799694 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f183006c3e0 msgr2=0x7f183014b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:17.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.949+0000 7f182effd700 1 --2- 172.21.15.3:0/2958799694 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f183006c3e0 0x7f183014b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:17.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.949+0000 7f182effd700 1 -- 172.21.15.3:0/2958799694 >> v1:172.21.15.3:6789/0 conn(0x7f183006be60 legacy=0x7f18300c26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:17.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.949+0000 7f182effd700 1 -- 172.21.15.3:0/2958799694 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18300c2db0 con 0x7f18300be150 2023-10-08T15:42:17.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.949+0000 7f182f7fe700 1 --2- 172.21.15.3:0/2958799694 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f183006c3e0 0x7f183014b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:42:17.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.949+0000 7f182effd700 1 --2- 172.21.15.3:0/2958799694 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f18300be150 0x7f18300be520 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f18240098e0 tx=0x7f18240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46c32ce5d465ba05 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:17.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.949+0000 7f182dffb700 1 -- 172.21.15.3:0/2958799694 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182400b640 con 0x7f18300be150 2023-10-08T15:42:17.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.949+0000 7f182dffb700 1 -- 172.21.15.3:0/2958799694 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f182400b7a0 con 0x7f18300be150 2023-10-08T15:42:17.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.949+0000 7f182dffb700 1 -- 172.21.15.3:0/2958799694 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182400bb40 con 0x7f18300be150 2023-10-08T15:42:17.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.949+0000 7f1835422700 1 -- 172.21.15.3:0/2958799694 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f18300be150 msgr2=0x7f18300be520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:17.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.949+0000 7f1835422700 1 --2- 172.21.15.3:0/2958799694 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f18300be150 0x7f18300be520 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f18240098e0 tx=0x7f18240091a0 comp rx=0 tx=0).stop 2023-10-08T15:42:17.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.949+0000 7f1835422700 1 -- 172.21.15.3:0/2958799694 shutdown_connections 2023-10-08T15:42:17.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.949+0000 7f1835422700 1 --2- 172.21.15.3:0/2958799694 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f183006c3e0 0x7f183014b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:17.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.949+0000 7f1835422700 1 --2- 172.21.15.3:0/2958799694 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f18300be150 0x7f18300be520 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:17.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.949+0000 7f1835422700 1 -- 172.21.15.3:0/2958799694 >> 172.21.15.3:0/2958799694 conn(0x7f183006e460 msgr2=0x7f18300c1f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:17.959 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.949+0000 7f1835422700 1 -- 172.21.15.3:0/2958799694 shutdown_connections 2023-10-08T15:42:17.959 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.949+0000 7f1835422700 1 -- 172.21.15.3:0/2958799694 wait complete. 2023-10-08T15:42:17.961 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.953+0000 7f1835422700 1 Processor -- start 2023-10-08T15:42:17.961 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.953+0000 7f1835422700 1 -- start start 2023-10-08T15:42:17.961 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.953+0000 7f1835422700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f183006be60 0x7f183015b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:17.961 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.953+0000 7f1835422700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f183006c3e0 0x7f183015f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:17.961 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.953+0000 7f1835422700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f18300be150 0x7f183014dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:17.961 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.953+0000 7f1835422700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f183015baa0 con 0x7f183006c3e0 2023-10-08T15:42:17.961 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.953+0000 7f1835422700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f183009b4d0 con 0x7f183006be60 2023-10-08T15:42:17.961 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.953+0000 7f1835422700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f183015fa90 con 0x7f18300be150 2023-10-08T15:42:17.961 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.953+0000 7f182e7fc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f183006c3e0 0x7f183015f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:17.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.953+0000 7f182e7fc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f183006c3e0 0x7f183015f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53512/0 (socket says 172.21.15.3:53512) 2023-10-08T15:42:17.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.953+0000 7f182e7fc700 1 -- 172.21.15.3:0/2907907073 learned_addr learned my addr 172.21.15.3:0/2907907073 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:17.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.953+0000 7f182effd700 1 --2- 172.21.15.3:0/2907907073 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f183006be60 0x7f183015b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:17.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.953+0000 7f182f7fe700 1 --2- 172.21.15.3:0/2907907073 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f18300be150 0x7f183014dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:17.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.953+0000 7f182e7fc700 1 -- 172.21.15.3:0/2907907073 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f18300be150 msgr2=0x7f183014dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:17.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.953+0000 7f182e7fc700 1 --2- 172.21.15.3:0/2907907073 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f18300be150 0x7f183014dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:17.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.953+0000 7f182e7fc700 1 -- 172.21.15.3:0/2907907073 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f183006be60 msgr2=0x7f183015b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:17.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.953+0000 7f182e7fc700 1 --2- 172.21.15.3:0/2907907073 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f183006be60 0x7f183015b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:17.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.953+0000 7f182e7fc700 1 -- 172.21.15.3:0/2907907073 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1824009420 con 0x7f183006c3e0 2023-10-08T15:42:17.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.953+0000 7f182effd700 1 --2- 172.21.15.3:0/2907907073 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f183006be60 0x7f183015b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:42:17.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.953+0000 7f182e7fc700 1 --2- 172.21.15.3:0/2907907073 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f183006c3e0 0x7f183015f550 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f182000cd60 tx=0x7f1820001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:17.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.953+0000 7f1816ffd700 1 -- 172.21.15.3:0/2907907073 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182000ab30 con 0x7f183006c3e0 2023-10-08T15:42:17.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.953+0000 7f1816ffd700 1 -- 172.21.15.3:0/2907907073 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f182000acb0 con 0x7f183006c3e0 2023-10-08T15:42:17.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.953+0000 7f1835422700 1 -- 172.21.15.3:0/2907907073 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f183009c9f0 con 0x7f183006c3e0 2023-10-08T15:42:17.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.953+0000 7f1816ffd700 1 -- 172.21.15.3:0/2907907073 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1820007340 con 0x7f183006c3e0 2023-10-08T15:42:17.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.953+0000 7f1835422700 1 -- 172.21.15.3:0/2907907073 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f183009ecd0 con 0x7f183006c3e0 2023-10-08T15:42:17.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.957+0000 7f1835422700 1 -- 172.21.15.3:0/2907907073 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f183009cd00 con 0x7f183006c3e0 2023-10-08T15:42:17.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.957+0000 7f1816ffd700 1 -- 172.21.15.3:0/2907907073 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f1820007730 con 0x7f183006c3e0 2023-10-08T15:42:17.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.957+0000 7f1816ffd700 1 --2- 172.21.15.3:0/2907907073 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f181c060550 0x7f181c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:17.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.957+0000 7f1816ffd700 1 -- 172.21.15.3:0/2907907073 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f182007cd80 con 0x7f183006c3e0 2023-10-08T15:42:17.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.957+0000 7f182effd700 1 --2- 172.21.15.3:0/2907907073 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f181c060550 0x7f181c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:17.965 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.957+0000 7f182effd700 1 --2- 172.21.15.3:0/2907907073 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f181c060550 0x7f181c062a00 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f18240093f0 tx=0x7f1824017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:17.973 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:17.965+0000 7f1816ffd700 1 -- 172.21.15.3:0/2907907073 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f182004d330 con 0x7f183006c3e0 2023-10-08T15:42:18.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.165+0000 7f1835422700 1 -- 172.21.15.3:0/2907907073 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1830064530 con 0x7f183006c3e0 2023-10-08T15:42:18.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.165+0000 7f1816ffd700 1 -- 172.21.15.3:0/2907907073 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+3082 (secure 0 0 0) 0x7f1820050950 con 0x7f183006c3e0 2023-10-08T15:42:18.173 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:42:18.173 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":33,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5480,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1007706158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1007706158},{"type":"v1","addr":"172.21.15.50:6835","nonce":1007706158}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:41:45.889781+0000","modified":"2023-10-08T15:41:48.541276+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6030},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6030":{"gid":6030,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.3:6833/1129612905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":1129612905},{"type":"v1","addr":"172.21.15.3:6833","nonce":1129612905}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-08T15:42:18.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.169+0000 7f1835422700 1 -- 172.21.15.3:0/2907907073 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f181c060550 msgr2=0x7f181c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:18.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.169+0000 7f1835422700 1 --2- 172.21.15.3:0/2907907073 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f181c060550 0x7f181c062a00 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f18240093f0 tx=0x7f1824017000 comp rx=0 tx=0).stop 2023-10-08T15:42:18.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.169+0000 7f1835422700 1 -- 172.21.15.3:0/2907907073 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f183006c3e0 msgr2=0x7f183015f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:18.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.169+0000 7f1835422700 1 --2- 172.21.15.3:0/2907907073 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f183006c3e0 0x7f183015f550 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f182000cd60 tx=0x7f1820001b10 comp rx=0 tx=0).stop 2023-10-08T15:42:18.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.169+0000 7f1835422700 1 -- 172.21.15.3:0/2907907073 shutdown_connections 2023-10-08T15:42:18.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.169+0000 7f1835422700 1 --2- 172.21.15.3:0/2907907073 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f181c060550 0x7f181c062a00 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:18.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.169+0000 7f1835422700 1 --2- 172.21.15.3:0/2907907073 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f18300be150 0x7f183014dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:18.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.169+0000 7f1835422700 1 --2- 172.21.15.3:0/2907907073 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f183006c3e0 0x7f183015f550 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:18.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.169+0000 7f1835422700 1 --2- 172.21.15.3:0/2907907073 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f183006be60 0x7f183015b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:18.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.169+0000 7f1835422700 1 -- 172.21.15.3:0/2907907073 >> 172.21.15.3:0/2907907073 conn(0x7f183006e460 msgr2=0x7f183014a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:18.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.169+0000 7f1835422700 1 -- 172.21.15.3:0/2907907073 shutdown_connections 2023-10-08T15:42:18.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.169+0000 7f1835422700 1 -- 172.21.15.3:0/2907907073 wait complete. 2023-10-08T15:42:18.177 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 33 2023-10-08T15:42:18.188 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:42:18.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.289+0000 7fcf9d5e7700 1 Processor -- start 2023-10-08T15:42:18.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.289+0000 7fcf9d5e7700 1 -- start start 2023-10-08T15:42:18.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.289+0000 7fcf9d5e7700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fcf980bb0c0 0x7fcf98153860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:18.297 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.289+0000 7fcf9d5e7700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf9814fe30 con 0x7fcf980bacf0 2023-10-08T15:42:18.297 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.289+0000 7fcf9d5e7700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf9814fac0 con 0x7fcf9809e520 2023-10-08T15:42:18.297 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.289+0000 7fcf9d5e7700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf9809f0e0 con 0x7fcf980bb0c0 2023-10-08T15:42:18.297 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.289+0000 7fcf8ffff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fcf980bb0c0 0x7fcf98153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:18.297 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.289+0000 7fcf97fff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fcf980bacf0 0x7fcf981502c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:53480/0 (socket says 172.21.15.3:53480) 2023-10-08T15:42:18.297 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.289+0000 7fcf97fff700 1 -- 172.21.15.3:0/1793199086 learned_addr learned my addr 172.21.15.3:0/1793199086 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:42:18.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.289+0000 7fcf8ffff700 1 -- 172.21.15.3:0/1793199086 >> v1:172.21.15.50:6789/0 conn(0x7fcf9809e520 legacy=0x7fcf9806c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:18.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.289+0000 7fcf8ffff700 1 -- 172.21.15.3:0/1793199086 >> v1:172.21.15.3:6789/0 conn(0x7fcf980bacf0 legacy=0x7fcf981502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:18.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.289+0000 7fcf977fe700 1 -- 172.21.15.3:0/1793199086 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2674364593 0 0) 0x7fcf9814fe30 con 0x7fcf980bacf0 2023-10-08T15:42:18.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.289+0000 7fcf8ffff700 1 -- 172.21.15.3:0/1793199086 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf9809eb80 con 0x7fcf980bb0c0 2023-10-08T15:42:18.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.293+0000 7fcf8ffff700 1 --2- 172.21.15.3:0/1793199086 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf980bb0c0 0x7fcf98153860 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fcf800098e0 tx=0x7fcf800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d14276fb80215db server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:18.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.293+0000 7fcf977fe700 1 -- 172.21.15.3:0/1793199086 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf80009e80 con 0x7fcf980bb0c0 2023-10-08T15:42:18.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.293+0000 7fcf977fe700 1 -- 172.21.15.3:0/1793199086 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf8000b860 con 0x7fcf980bb0c0 2023-10-08T15:42:18.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.293+0000 7fcf977fe700 1 -- 172.21.15.3:0/1793199086 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8000bbe0 con 0x7fcf980bb0c0 2023-10-08T15:42:18.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.293+0000 7fcf9d5e7700 1 -- 172.21.15.3:0/1793199086 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf980bb0c0 msgr2=0x7fcf98153860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:18.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.293+0000 7fcf9d5e7700 1 --2- 172.21.15.3:0/1793199086 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf980bb0c0 0x7fcf98153860 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fcf800098e0 tx=0x7fcf800091a0 comp rx=0 tx=0).stop 2023-10-08T15:42:18.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.293+0000 7fcf9d5e7700 1 -- 172.21.15.3:0/1793199086 shutdown_connections 2023-10-08T15:42:18.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.293+0000 7fcf9d5e7700 1 --2- 172.21.15.3:0/1793199086 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf980bb0c0 0x7fcf98153860 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:18.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.293+0000 7fcf9d5e7700 1 -- 172.21.15.3:0/1793199086 >> 172.21.15.3:0/1793199086 conn(0x7fcf980be4a0 msgr2=0x7fcf980ba440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:18.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.293+0000 7fcf9d5e7700 1 -- 172.21.15.3:0/1793199086 shutdown_connections 2023-10-08T15:42:18.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.293+0000 7fcf9d5e7700 1 -- 172.21.15.3:0/1793199086 wait complete. 2023-10-08T15:42:18.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.293+0000 7fcf9d5e7700 1 Processor -- start 2023-10-08T15:42:18.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.293+0000 7fcf9d5e7700 1 -- start start 2023-10-08T15:42:18.305 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.297+0000 7fcf9d5e7700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcf9809e520 0x7fcf980a2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:18.305 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.297+0000 7fcf9d5e7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf980bacf0 0x7fcf98162ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:18.305 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.297+0000 7fcf9d5e7700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf980bb0c0 0x7fcf981631e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:18.306 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.297+0000 7fcf9d5e7700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf980a0990 con 0x7fcf980bb0c0 2023-10-08T15:42:18.306 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.297+0000 7fcf9d5e7700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf980a0f50 con 0x7fcf980bacf0 2023-10-08T15:42:18.306 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.297+0000 7fcf9d5e7700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf980a2d90 con 0x7fcf9809e520 2023-10-08T15:42:18.306 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.297+0000 7fcf9cde6700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf980bb0c0 0x7fcf981631e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:18.306 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.297+0000 7fcf8ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf980bacf0 0x7fcf98162ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:18.306 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.297+0000 7fcf97fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcf9809e520 0x7fcf980a2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:18.306 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.297+0000 7fcf8ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf980bacf0 0x7fcf98162ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.3:33804/0 (socket says 172.21.15.3:33804) 2023-10-08T15:42:18.306 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.297+0000 7fcf8ffff700 1 -- 172.21.15.3:0/1295441949 learned_addr learned my addr 172.21.15.3:0/1295441949 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:18.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.297+0000 7fcf9cde6700 1 -- 172.21.15.3:0/1295441949 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcf9809e520 msgr2=0x7fcf980a2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:18.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.297+0000 7fcf9cde6700 1 --2- 172.21.15.3:0/1295441949 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcf9809e520 0x7fcf980a2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:18.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.297+0000 7fcf9cde6700 1 -- 172.21.15.3:0/1295441949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf980bacf0 msgr2=0x7fcf98162ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:18.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.297+0000 7fcf9cde6700 1 --2- 172.21.15.3:0/1295441949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf980bacf0 0x7fcf98162ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:18.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.297+0000 7fcf9cde6700 1 -- 172.21.15.3:0/1295441949 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf80009420 con 0x7fcf980bb0c0 2023-10-08T15:42:18.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.297+0000 7fcf9cde6700 1 --2- 172.21.15.3:0/1295441949 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf980bb0c0 0x7fcf981631e0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fcf9000c830 tx=0x7fcf90001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:18.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.297+0000 7fcf94ff9700 1 -- 172.21.15.3:0/1295441949 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf90012630 con 0x7fcf980bb0c0 2023-10-08T15:42:18.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.297+0000 7fcf94ff9700 1 -- 172.21.15.3:0/1295441949 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf90012790 con 0x7fcf980bb0c0 2023-10-08T15:42:18.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.297+0000 7fcf9d5e7700 1 -- 172.21.15.3:0/1295441949 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf980a0be0 con 0x7fcf980bb0c0 2023-10-08T15:42:18.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.297+0000 7fcf94ff9700 1 -- 172.21.15.3:0/1295441949 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf90012b50 con 0x7fcf980bb0c0 2023-10-08T15:42:18.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.297+0000 7fcf9d5e7700 1 -- 172.21.15.3:0/1295441949 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf981518c0 con 0x7fcf980bb0c0 2023-10-08T15:42:18.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.297+0000 7fcf9d5e7700 1 -- 172.21.15.3:0/1295441949 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf9805ecf0 con 0x7fcf980bb0c0 2023-10-08T15:42:18.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.301+0000 7fcf94ff9700 1 -- 172.21.15.3:0/1295441949 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fcf90011380 con 0x7fcf980bb0c0 2023-10-08T15:42:18.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.301+0000 7fcf94ff9700 1 --2- 172.21.15.3:0/1295441949 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fcf78060550 0x7fcf78062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:18.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.301+0000 7fcf94ff9700 1 -- 172.21.15.3:0/1295441949 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fcf9007c8c0 con 0x7fcf980bb0c0 2023-10-08T15:42:18.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.301+0000 7fcf97fff700 1 --2- 172.21.15.3:0/1295441949 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fcf78060550 0x7fcf78062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:18.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.301+0000 7fcf97fff700 1 --2- 172.21.15.3:0/1295441949 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fcf78060550 0x7fcf78062a00 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fcf88007fd0 tx=0x7fcf88007d10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:18.316 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.309+0000 7fcf94ff9700 1 -- 172.21.15.3:0/1295441949 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fcf9004ce70 con 0x7fcf980bb0c0 2023-10-08T15:42:18.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.469+0000 7fcf9d5e7700 1 -- 172.21.15.3:0/1295441949 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf980a0d70 con 0x7fcf980bb0c0 2023-10-08T15:42:18.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.473+0000 7fcf94ff9700 1 -- 172.21.15.3:0/1295441949 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+15355 (secure 0 0 0) 0x7fcf90050490 con 0x7fcf980bb0c0 2023-10-08T15:42:18.478 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:42:18.479 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":61,"fsid":"7635972e-cd66-4a8f-a231-378db8b3847a","created":"2023-10-08T15:37:08.234594+0000","modified":"2023-10-08T15:42:14.153650+0000","last_up_change":"2023-10-08T15:37:17.537726+0000","last_in_change":"2023-10-08T15:37:10.269178+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:37:16.581590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:41:44.126771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-08T15:41:44.881738+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"64fb1864-bfdd-4d75-9b41-03fb60085dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33363},{"type":"v1","addr":"172.21.15.3:6801","nonce":33363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33363},{"type":"v1","addr":"172.21.15.3:6803","nonce":33363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":33363},{"type":"v1","addr":"172.21.15.3:6807","nonce":33363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33363},{"type":"v1","addr":"172.21.15.3:6805","nonce":33363}]},"public_addr":"172.21.15.3:6801/33363","cluster_addr":"172.21.15.3:6803/33363","heartbeat_back_addr":"172.21.15.3:6807/33363","heartbeat_front_addr":"172.21.15.3:6805/33363","state":["exists","up"]},{"osd":1,"uuid":"3ca6bd3a-3e8a-4c65-af9c-46148b0c2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33364},{"type":"v1","addr":"172.21.15.3:6820","nonce":33364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33364},{"type":"v1","addr":"172.21.15.3:6824","nonce":33364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33364},{"type":"v1","addr":"172.21.15.3:6831","nonce":33364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33364},{"type":"v1","addr":"172.21.15.3:6828","nonce":33364}]},"public_addr":"172.21.15.3:6820/33364","cluster_addr":"172.21.15.3:6824/33364","heartbeat_back_addr":"172.21.15.3:6831/33364","heartbeat_front_addr":"172.21.15.3:6828/33364","state":["exists","up"]},{"osd":2,"uuid":"6eb9f757-58dd-442f-910d-32401454bce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33366},{"type":"v1","addr":"172.21.15.3:6817","nonce":33366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":33366},{"type":"v1","addr":"172.21.15.3:6821","nonce":33366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6827","nonce":33366},{"type":"v1","addr":"172.21.15.3:6829","nonce":33366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":33366},{"type":"v1","addr":"172.21.15.3:6825","nonce":33366}]},"public_addr":"172.21.15.3:6817/33366","cluster_addr":"172.21.15.3:6821/33366","heartbeat_back_addr":"172.21.15.3:6829/33366","heartbeat_front_addr":"172.21.15.3:6825/33366","state":["exists","up"]},{"osd":3,"uuid":"1c39866b-ac2e-4ea9-a69c-02b01ee4191d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33365},{"type":"v1","addr":"172.21.15.3:6809","nonce":33365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":33365},{"type":"v1","addr":"172.21.15.3:6811","nonce":33365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33365},{"type":"v1","addr":"172.21.15.3:6815","nonce":33365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":33365},{"type":"v1","addr":"172.21.15.3:6813","nonce":33365}]},"public_addr":"172.21.15.3:6809/33365","cluster_addr":"172.21.15.3:6811/33365","heartbeat_back_addr":"172.21.15.3:6815/33365","heartbeat_front_addr":"172.21.15.3:6813/33365","state":["exists","up"]},{"osd":4,"uuid":"15f86b61-b7f1-4780-ae00-9d80a68cb830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":33605},{"type":"v1","addr":"172.21.15.50:6809","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33605},{"type":"v1","addr":"172.21.15.50:6811","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33605},{"type":"v1","addr":"172.21.15.50:6815","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":33605},{"type":"v1","addr":"172.21.15.50:6813","nonce":33605}]},"public_addr":"172.21.15.50:6809/33605","cluster_addr":"172.21.15.50:6811/33605","heartbeat_back_addr":"172.21.15.50:6815/33605","heartbeat_front_addr":"172.21.15.50:6813/33605","state":["exists","up"]},{"osd":5,"uuid":"726c3003-34e6-4d5a-b6e2-f911e13c2118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33606},{"type":"v1","addr":"172.21.15.50:6801","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33606},{"type":"v1","addr":"172.21.15.50:6803","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33606},{"type":"v1","addr":"172.21.15.50:6807","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":33606},{"type":"v1","addr":"172.21.15.50:6805","nonce":33606}]},"public_addr":"172.21.15.50:6801/33606","cluster_addr":"172.21.15.50:6803/33606","heartbeat_back_addr":"172.21.15.50:6807/33606","heartbeat_front_addr":"172.21.15.50:6805/33606","state":["exists","up"]},{"osd":6,"uuid":"401122a4-9988-441f-a5a7-39164434ebcd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":33607},{"type":"v1","addr":"172.21.15.50:6819","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":33607},{"type":"v1","addr":"172.21.15.50:6823","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":33607},{"type":"v1","addr":"172.21.15.50:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":33607},{"type":"v1","addr":"172.21.15.50:6827","nonce":33607}]},"public_addr":"172.21.15.50:6819/33607","cluster_addr":"172.21.15.50:6823/33607","heartbeat_back_addr":"172.21.15.50:6831/33607","heartbeat_front_addr":"172.21.15.50:6827/33607","state":["exists","up"]},{"osd":7,"uuid":"6b3fa236-c9d0-4c4d-82ae-9af4daf6d699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33604},{"type":"v1","addr":"172.21.15.50:6818","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":33604},{"type":"v1","addr":"172.21.15.50:6822","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":33604},{"type":"v1","addr":"172.21.15.50:6830","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":33604},{"type":"v1","addr":"172.21.15.50:6826","nonce":33604}]},"public_addr":"172.21.15.50:6818/33604","cluster_addr":"172.21.15.50:6822/33604","heartbeat_back_addr":"172.21.15.50:6830/33604","heartbeat_front_addr":"172.21.15.50:6826/33604","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.497794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.529417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.873426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.325972+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.443971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.240795+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.739632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.643026+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.14","mappings":[{"from":6,"to":0}]},{"pgid":"11.30","mappings":[{"from":6,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:42:18.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.473+0000 7fcf9d5e7700 1 -- 172.21.15.3:0/1295441949 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fcf78060550 msgr2=0x7fcf78062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:18.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.473+0000 7fcf9d5e7700 1 --2- 172.21.15.3:0/1295441949 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fcf78060550 0x7fcf78062a00 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fcf88007fd0 tx=0x7fcf88007d10 comp rx=0 tx=0).stop 2023-10-08T15:42:18.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.473+0000 7fcf9d5e7700 1 -- 172.21.15.3:0/1295441949 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf980bb0c0 msgr2=0x7fcf981631e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:18.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.473+0000 7fcf9d5e7700 1 --2- 172.21.15.3:0/1295441949 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf980bb0c0 0x7fcf981631e0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fcf9000c830 tx=0x7fcf90001690 comp rx=0 tx=0).stop 2023-10-08T15:42:18.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.473+0000 7fcf9d5e7700 1 -- 172.21.15.3:0/1295441949 shutdown_connections 2023-10-08T15:42:18.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.473+0000 7fcf9d5e7700 1 --2- 172.21.15.3:0/1295441949 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fcf78060550 0x7fcf78062a00 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:18.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.473+0000 7fcf9d5e7700 1 --2- 172.21.15.3:0/1295441949 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf980bb0c0 0x7fcf981631e0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:18.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.473+0000 7fcf9d5e7700 1 --2- 172.21.15.3:0/1295441949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf980bacf0 0x7fcf98162ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:18.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.473+0000 7fcf9d5e7700 1 --2- 172.21.15.3:0/1295441949 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcf9809e520 0x7fcf980a2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:18.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.473+0000 7fcf9d5e7700 1 -- 172.21.15.3:0/1295441949 >> 172.21.15.3:0/1295441949 conn(0x7fcf980be4a0 msgr2=0x7fcf98153ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:18.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.473+0000 7fcf9d5e7700 1 -- 172.21.15.3:0/1295441949 shutdown_connections 2023-10-08T15:42:18.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.473+0000 7fcf9d5e7700 1 -- 172.21.15.3:0/1295441949 wait complete. 2023-10-08T15:42:18.493 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-08T15:42:18.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.601+0000 7faf53fff700 1 Processor -- start 2023-10-08T15:42:18.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.601+0000 7faf53fff700 1 -- start start 2023-10-08T15:42:18.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.605+0000 7faf53fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faf540beb80 0x7faf54149960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:18.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.605+0000 7faf53fff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7faf54070720 0x7faf541486d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:18.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.605+0000 7faf53fff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf540b2070 con 0x7faf540684c0 2023-10-08T15:42:18.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.605+0000 7faf53fff700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf540b2ba0 con 0x7faf54070720 2023-10-08T15:42:18.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.605+0000 7faf53fff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf540b2350 con 0x7faf540beb80 2023-10-08T15:42:18.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.605+0000 7faf537fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7faf54070720 0x7faf541486d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:18.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.605+0000 7faf537fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7faf54070720 0x7faf541486d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53540/0 (socket says 172.21.15.3:53540) 2023-10-08T15:42:18.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.605+0000 7faf537fe700 1 -- 172.21.15.3:0/464632684 learned_addr learned my addr 172.21.15.3:0/464632684 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:18.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.605+0000 7faf52ffd700 1 --2- 172.21.15.3:0/464632684 >> v2:172.21.15.50:3300/0 conn(0x7faf540beb80 0x7faf54149960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:18.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.605+0000 7faf537fe700 1 -- 172.21.15.3:0/464632684 >> v2:172.21.15.50:3300/0 conn(0x7faf540beb80 msgr2=0x7faf54149960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:18.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.605+0000 7faf537fe700 1 --2- 172.21.15.3:0/464632684 >> v2:172.21.15.50:3300/0 conn(0x7faf540beb80 0x7faf54149960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:18.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.605+0000 7faf537fe700 1 -- 172.21.15.3:0/464632684 >> v1:172.21.15.50:6789/0 conn(0x7faf540684c0 legacy=0x7faf54149ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:18.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.605+0000 7faf537fe700 1 -- 172.21.15.3:0/464632684 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf54069870 con 0x7faf54070720 2023-10-08T15:42:18.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.605+0000 7faf52ffd700 1 --2- 172.21.15.3:0/464632684 >> v2:172.21.15.50:3300/0 conn(0x7faf540beb80 0x7faf54149960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:42:18.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.605+0000 7faf537fe700 1 --2- 172.21.15.3:0/464632684 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faf54070720 0x7faf541486d0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7faf5406bf60 tx=0x7faf4c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=549efdf051e8d66b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:18.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.605+0000 7faf527fc700 1 -- 172.21.15.3:0/464632684 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4c00e070 con 0x7faf54070720 2023-10-08T15:42:18.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.605+0000 7faf527fc700 1 -- 172.21.15.3:0/464632684 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf4c00ba50 con 0x7faf54070720 2023-10-08T15:42:18.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.605+0000 7faf527fc700 1 -- 172.21.15.3:0/464632684 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4c0092e0 con 0x7faf54070720 2023-10-08T15:42:18.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.605+0000 7faf53fff700 1 -- 172.21.15.3:0/464632684 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faf54070720 msgr2=0x7faf541486d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:18.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.605+0000 7faf53fff700 1 --2- 172.21.15.3:0/464632684 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faf54070720 0x7faf541486d0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7faf5406bf60 tx=0x7faf4c009840 comp rx=0 tx=0).stop 2023-10-08T15:42:18.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.609+0000 7faf53fff700 1 -- 172.21.15.3:0/464632684 shutdown_connections 2023-10-08T15:42:18.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.609+0000 7faf53fff700 1 --2- 172.21.15.3:0/464632684 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faf54070720 0x7faf541486d0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:18.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.609+0000 7faf53fff700 1 --2- 172.21.15.3:0/464632684 >> v2:172.21.15.50:3300/0 conn(0x7faf540beb80 0x7faf54149960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:18.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.609+0000 7faf53fff700 1 -- 172.21.15.3:0/464632684 >> 172.21.15.3:0/464632684 conn(0x7faf54067bb0 msgr2=0x7faf540be240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:18.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.609+0000 7faf53fff700 1 -- 172.21.15.3:0/464632684 shutdown_connections 2023-10-08T15:42:18.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.609+0000 7faf53fff700 1 -- 172.21.15.3:0/464632684 wait complete. 2023-10-08T15:42:18.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.609+0000 7faf53fff700 1 Processor -- start 2023-10-08T15:42:18.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.609+0000 7faf53fff700 1 -- start start 2023-10-08T15:42:18.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.609+0000 7faf53fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faf540684c0 0x7faf54159060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:18.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.609+0000 7faf53fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf54070720 0x7faf541459a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:18.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.609+0000 7faf53fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faf540beb80 0x7faf540bb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:18.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.609+0000 7faf53fff700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf540b8760 con 0x7faf540684c0 2023-10-08T15:42:18.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.609+0000 7faf53fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf54145ee0 con 0x7faf54070720 2023-10-08T15:42:18.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.609+0000 7faf53fff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf541456e0 con 0x7faf540beb80 2023-10-08T15:42:18.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.609+0000 7faf52ffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faf540684c0 0x7faf54159060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:18.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.609+0000 7faf52ffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faf540684c0 0x7faf54159060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53550/0 (socket says 172.21.15.3:53550) 2023-10-08T15:42:18.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.609+0000 7faf52ffd700 1 -- 172.21.15.3:0/3354548199 learned_addr learned my addr 172.21.15.3:0/3354548199 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:18.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.609+0000 7faf4bfff700 1 --2- 172.21.15.3:0/3354548199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf54070720 0x7faf541459a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:18.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.613+0000 7faf537fe700 1 --2- 172.21.15.3:0/3354548199 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faf540beb80 0x7faf540bb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:18.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.613+0000 7faf52ffd700 1 -- 172.21.15.3:0/3354548199 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faf540beb80 msgr2=0x7faf540bb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:18.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.613+0000 7faf52ffd700 1 --2- 172.21.15.3:0/3354548199 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faf540beb80 0x7faf540bb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:18.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.613+0000 7faf52ffd700 1 -- 172.21.15.3:0/3354548199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf54070720 msgr2=0x7faf541459a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:18.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.613+0000 7faf52ffd700 1 --2- 172.21.15.3:0/3354548199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf54070720 0x7faf541459a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:18.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.613+0000 7faf52ffd700 1 -- 172.21.15.3:0/3354548199 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf4c009ae0 con 0x7faf540684c0 2023-10-08T15:42:18.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.613+0000 7faf52ffd700 1 --2- 172.21.15.3:0/3354548199 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faf540684c0 0x7faf54159060 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7faf4400d860 tx=0x7faf44008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:18.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.613+0000 7faf4affd700 1 -- 172.21.15.3:0/3354548199 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf440125f0 con 0x7faf540684c0 2023-10-08T15:42:18.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.613+0000 7faf4affd700 1 -- 172.21.15.3:0/3354548199 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf44012750 con 0x7faf540684c0 2023-10-08T15:42:18.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.613+0000 7faf53fff700 1 -- 172.21.15.3:0/3354548199 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf540b8150 con 0x7faf540684c0 2023-10-08T15:42:18.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.613+0000 7faf4affd700 1 -- 172.21.15.3:0/3354548199 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf44012af0 con 0x7faf540684c0 2023-10-08T15:42:18.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.613+0000 7faf53fff700 1 -- 172.21.15.3:0/3354548199 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf540bbb90 con 0x7faf540684c0 2023-10-08T15:42:18.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.613+0000 7faf4affd700 1 -- 172.21.15.3:0/3354548199 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7faf44013480 con 0x7faf540684c0 2023-10-08T15:42:18.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.613+0000 7faf53fff700 1 -- 172.21.15.3:0/3354548199 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf5405ecf0 con 0x7faf540684c0 2023-10-08T15:42:18.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.617+0000 7faf4affd700 1 --2- 172.21.15.3:0/3354548199 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7faf34060550 0x7faf34062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:18.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.617+0000 7faf4affd700 1 -- 172.21.15.3:0/3354548199 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5763+0+0 (secure 0 0 0) 0x7faf4407c9f0 con 0x7faf540684c0 2023-10-08T15:42:18.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.617+0000 7faf4bfff700 1 --2- 172.21.15.3:0/3354548199 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7faf34060550 0x7faf34062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:18.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.617+0000 7faf4bfff700 1 --2- 172.21.15.3:0/3354548199 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7faf34060550 0x7faf34062a00 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7faf540b76d0 tx=0x7faf3c007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:18.627 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.621+0000 7faf4affd700 1 -- 172.21.15.3:0/3354548199 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7faf4404cf00 con 0x7faf540684c0 2023-10-08T15:42:18.827 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.821+0000 7faf53fff700 1 -- 172.21.15.3:0/3354548199 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7faf540b26e0 con 0x7faf540684c0 2023-10-08T15:42:18.828 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-10-08T15:42:18.821+0000 7fd2c0727700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T15:42:18.838 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.833+0000 7faf4affd700 1 -- 172.21.15.3:0/3354548199 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v34) v1 ==== 161+0+0 (secure 0 0 0) 0x7faf44050520 con 0x7faf540684c0 2023-10-08T15:42:18.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.833+0000 7faf53fff700 1 -- 172.21.15.3:0/3354548199 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7faf34060550 msgr2=0x7faf34062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:18.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.833+0000 7faf53fff700 1 --2- 172.21.15.3:0/3354548199 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7faf34060550 0x7faf34062a00 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7faf540b76d0 tx=0x7faf3c007ec0 comp rx=0 tx=0).stop 2023-10-08T15:42:18.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.833+0000 7faf53fff700 1 -- 172.21.15.3:0/3354548199 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faf540684c0 msgr2=0x7faf54159060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:18.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.833+0000 7faf53fff700 1 --2- 172.21.15.3:0/3354548199 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faf540684c0 0x7faf54159060 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7faf4400d860 tx=0x7faf44008040 comp rx=0 tx=0).stop 2023-10-08T15:42:18.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.833+0000 7faf53fff700 1 -- 172.21.15.3:0/3354548199 shutdown_connections 2023-10-08T15:42:18.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.833+0000 7faf53fff700 1 --2- 172.21.15.3:0/3354548199 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7faf34060550 0x7faf34062a00 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:18.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.833+0000 7faf53fff700 1 --2- 172.21.15.3:0/3354548199 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faf540beb80 0x7faf540bb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:18.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.833+0000 7faf53fff700 1 --2- 172.21.15.3:0/3354548199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf54070720 0x7faf541459a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:18.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.833+0000 7faf53fff700 1 --2- 172.21.15.3:0/3354548199 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faf540684c0 0x7faf54159060 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:18.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.833+0000 7faf53fff700 1 -- 172.21.15.3:0/3354548199 >> 172.21.15.3:0/3354548199 conn(0x7faf54067bb0 msgr2=0x7faf540bcc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:18.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.833+0000 7faf53fff700 1 -- 172.21.15.3:0/3354548199 shutdown_connections 2023-10-08T15:42:18.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.833+0000 7faf53fff700 1 -- 172.21.15.3:0/3354548199 wait complete. 2023-10-08T15:42:18.843 INFO:teuthology.orchestra.run.smithi003.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-08T15:42:18.855 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-08T15:42:18.878 INFO:tasks.ceph.mds.a.smithi003.stdout:starting mds.a at 2023-10-08T15:42:18.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.961+0000 7f5649b43700 1 Processor -- start 2023-10-08T15:42:18.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.961+0000 7f5649b43700 1 -- start start 2023-10-08T15:42:18.969 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.961+0000 7f5649b43700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f564414ac30 0x7f564414bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:18.969 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.961+0000 7f5649b43700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f564406c7b0 con 0x7f564414b000 2023-10-08T15:42:18.969 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.961+0000 7f5649b43700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56440a7e60 con 0x7f564406d200 2023-10-08T15:42:18.969 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.961+0000 7f5649b43700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f564414c490 con 0x7f564414ac30 2023-10-08T15:42:18.969 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.961+0000 7f5643fff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f564414b000 0x7f5644068390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:53490/0 (socket says 172.21.15.3:53490) 2023-10-08T15:42:18.969 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.961+0000 7f5643fff700 1 -- 172.21.15.3:0/383279570 learned_addr learned my addr 172.21.15.3:0/383279570 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:42:18.969 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.961+0000 7f5648b41700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f564414ac30 0x7f564414bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:18.971 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.961+0000 7f56437fe700 1 -- 172.21.15.3:0/383279570 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3537944237 0 0) 0x7f564406c7b0 con 0x7f564414b000 2023-10-08T15:42:18.971 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.961+0000 7f56437fe700 1 -- 172.21.15.3:0/383279570 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f562c003570 con 0x7f564414b000 2023-10-08T15:42:18.971 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.965+0000 7f56437fe700 1 -- 172.21.15.3:0/383279570 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2415303208 0 0) 0x7f56440a7e60 con 0x7f564406d200 2023-10-08T15:42:18.971 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.965+0000 7f56437fe700 1 -- 172.21.15.3:0/383279570 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f564406c7b0 con 0x7f564406d200 2023-10-08T15:42:18.971 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.965+0000 7f56437fe700 1 -- 172.21.15.3:0/383279570 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 810156484 0 0) 0x7f562c003570 con 0x7f564414b000 2023-10-08T15:42:18.971 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.965+0000 7f5648b41700 1 -- 172.21.15.3:0/383279570 >> v1:172.21.15.50:6789/0 conn(0x7f564406d200 legacy=0x7f56440be240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:18.971 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.965+0000 7f5648b41700 1 -- 172.21.15.3:0/383279570 >> v1:172.21.15.3:6789/0 conn(0x7f564414b000 legacy=0x7f5644068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:18.972 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.965+0000 7f5648b41700 1 -- 172.21.15.3:0/383279570 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f564406ca00 con 0x7f564414ac30 2023-10-08T15:42:18.972 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.965+0000 7f5648b41700 1 --2- 172.21.15.3:0/383279570 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f564414ac30 0x7f564414bf50 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f56380098e0 tx=0x7f56380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42b97dc0b4f9262f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:18.972 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.965+0000 7f56437fe700 1 -- 172.21.15.3:0/383279570 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56340017f0 con 0x7f564414ac30 2023-10-08T15:42:18.972 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.965+0000 7f56437fe700 1 -- 172.21.15.3:0/383279570 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5638011420 con 0x7f564414ac30 2023-10-08T15:42:18.972 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.965+0000 7f56437fe700 1 -- 172.21.15.3:0/383279570 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56380117c0 con 0x7f564414ac30 2023-10-08T15:42:18.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.965+0000 7f5649b43700 1 -- 172.21.15.3:0/383279570 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f564414ac30 msgr2=0x7f564414bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:18.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.965+0000 7f5649b43700 1 --2- 172.21.15.3:0/383279570 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f564414ac30 0x7f564414bf50 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f56380098e0 tx=0x7f56380091a0 comp rx=0 tx=0).stop 2023-10-08T15:42:18.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.965+0000 7f5649b43700 1 -- 172.21.15.3:0/383279570 shutdown_connections 2023-10-08T15:42:18.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.965+0000 7f5649b43700 1 --2- 172.21.15.3:0/383279570 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f564414ac30 0x7f564414bf50 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:18.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.965+0000 7f5649b43700 1 -- 172.21.15.3:0/383279570 >> 172.21.15.3:0/383279570 conn(0x7f56440c1df0 msgr2=0x7f56440c21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:18.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.965+0000 7f5649b43700 1 -- 172.21.15.3:0/383279570 shutdown_connections 2023-10-08T15:42:18.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.965+0000 7f5649b43700 1 -- 172.21.15.3:0/383279570 wait complete. 2023-10-08T15:42:18.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.965+0000 7f5649b43700 1 Processor -- start 2023-10-08T15:42:18.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.965+0000 7f5649b43700 1 -- start start 2023-10-08T15:42:18.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.969+0000 7f5649b43700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f564406d200 0x7f56440a69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:18.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.969+0000 7f5649b43700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f564414ac30 0x7f5644140310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:18.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.969+0000 7f5649b43700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f564414b000 0x7f5644140850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:18.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.969+0000 7f5649b43700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56440a5920 con 0x7f564414ac30 2023-10-08T15:42:18.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.969+0000 7f5649b43700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5644141840 con 0x7f564406d200 2023-10-08T15:42:18.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.969+0000 7f5649b43700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5644141120 con 0x7f564414b000 2023-10-08T15:42:18.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.969+0000 7f5643fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f564414ac30 0x7f5644140310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:18.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.969+0000 7f5643fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f564414ac30 0x7f5644140310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53590/0 (socket says 172.21.15.3:53590) 2023-10-08T15:42:18.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.969+0000 7f5643fff700 1 -- 172.21.15.3:0/959907715 learned_addr learned my addr 172.21.15.3:0/959907715 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:18.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.969+0000 7f5648b41700 1 --2- 172.21.15.3:0/959907715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f564406d200 0x7f56440a69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:18.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.969+0000 7f5649342700 1 --2- 172.21.15.3:0/959907715 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f564414b000 0x7f5644140850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:18.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.969+0000 7f5643fff700 1 -- 172.21.15.3:0/959907715 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f564414b000 msgr2=0x7f5644140850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:18.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.969+0000 7f5643fff700 1 --2- 172.21.15.3:0/959907715 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f564414b000 0x7f5644140850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:18.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.969+0000 7f5643fff700 1 -- 172.21.15.3:0/959907715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f564406d200 msgr2=0x7f56440a69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:18.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.969+0000 7f5643fff700 1 --2- 172.21.15.3:0/959907715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f564406d200 0x7f56440a69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:18.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.969+0000 7f5643fff700 1 -- 172.21.15.3:0/959907715 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5638009420 con 0x7f564414ac30 2023-10-08T15:42:18.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.969+0000 7f5649342700 1 --2- 172.21.15.3:0/959907715 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f564414b000 0x7f5644140850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:42:18.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.969+0000 7f5643fff700 1 --2- 172.21.15.3:0/959907715 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f564414ac30 0x7f5644140310 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f563400cbe0 tx=0x7f5634007d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:18.978 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.969+0000 7f5640ff9700 1 -- 172.21.15.3:0/959907715 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5634004dc0 con 0x7f564414ac30 2023-10-08T15:42:18.978 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.969+0000 7f5640ff9700 1 -- 172.21.15.3:0/959907715 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f563400a620 con 0x7f564414ac30 2023-10-08T15:42:18.978 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.969+0000 7f5640ff9700 1 -- 172.21.15.3:0/959907715 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563400a9e0 con 0x7f564414ac30 2023-10-08T15:42:18.978 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.969+0000 7f5649b43700 1 -- 172.21.15.3:0/959907715 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5644140d90 con 0x7f564414ac30 2023-10-08T15:42:18.978 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.969+0000 7f5649b43700 1 -- 172.21.15.3:0/959907715 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5644141560 con 0x7f564414ac30 2023-10-08T15:42:18.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.969+0000 7f5640ff9700 1 -- 172.21.15.3:0/959907715 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5634007150 con 0x7f564414ac30 2023-10-08T15:42:18.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.973+0000 7f5640ff9700 1 --2- 172.21.15.3:0/959907715 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5630060580 0x7f5630062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:18.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.973+0000 7f5649b43700 1 -- 172.21.15.3:0/959907715 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f564405ecf0 con 0x7f564414ac30 2023-10-08T15:42:18.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.973+0000 7f5640ff9700 1 -- 172.21.15.3:0/959907715 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5849+0+0 (secure 0 0 0) 0x7f563407be90 con 0x7f564414ac30 2023-10-08T15:42:18.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.973+0000 7f5648b41700 1 --2- 172.21.15.3:0/959907715 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5630060580 0x7f5630062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:18.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.973+0000 7f5648b41700 1 --2- 172.21.15.3:0/959907715 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5630060580 0x7f5630062a30 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f56380093f0 tx=0x7f5638016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:18.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:18.977+0000 7f5640ff9700 1 -- 172.21.15.3:0/959907715 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f563404ff00 con 0x7f564414ac30 2023-10-08T15:42:19.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:19.181+0000 7f5649b43700 1 -- 172.21.15.3:0/959907715 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f5644141260 con 0x7f564414ac30 2023-10-08T15:42:19.839 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:19.833+0000 7f5640ff9700 1 -- 172.21.15.3:0/959907715 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v35) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5634065020 con 0x7f564414ac30 2023-10-08T15:42:19.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:19.837+0000 7f5649b43700 1 -- 172.21.15.3:0/959907715 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5630060580 msgr2=0x7f5630062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:19.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:19.837+0000 7f5649b43700 1 --2- 172.21.15.3:0/959907715 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5630060580 0x7f5630062a30 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f56380093f0 tx=0x7f5638016000 comp rx=0 tx=0).stop 2023-10-08T15:42:19.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:19.837+0000 7f5649b43700 1 -- 172.21.15.3:0/959907715 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f564414ac30 msgr2=0x7f5644140310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:19.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:19.837+0000 7f5649b43700 1 --2- 172.21.15.3:0/959907715 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f564414ac30 0x7f5644140310 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f563400cbe0 tx=0x7f5634007d20 comp rx=0 tx=0).stop 2023-10-08T15:42:19.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:19.837+0000 7f5649b43700 1 -- 172.21.15.3:0/959907715 shutdown_connections 2023-10-08T15:42:19.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:19.837+0000 7f5649b43700 1 --2- 172.21.15.3:0/959907715 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5630060580 0x7f5630062a30 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:19.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:19.837+0000 7f5649b43700 1 --2- 172.21.15.3:0/959907715 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f564414b000 0x7f5644140850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:19.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:19.837+0000 7f5649b43700 1 --2- 172.21.15.3:0/959907715 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f564414ac30 0x7f5644140310 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:19.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:19.837+0000 7f5649b43700 1 --2- 172.21.15.3:0/959907715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f564406d200 0x7f56440a69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:19.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:19.837+0000 7f5649b43700 1 -- 172.21.15.3:0/959907715 >> 172.21.15.3:0/959907715 conn(0x7f56440c1df0 msgr2=0x7f56440bfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:19.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:19.837+0000 7f5649b43700 1 -- 172.21.15.3:0/959907715 shutdown_connections 2023-10-08T15:42:19.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:19.837+0000 7f5649b43700 1 -- 172.21.15.3:0/959907715 wait complete. 2023-10-08T15:42:19.859 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-08T15:42:20.022 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.017+0000 7f66013f2700 1 Processor -- start 2023-10-08T15:42:20.022 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.017+0000 7f66013f2700 1 -- start start 2023-10-08T15:42:20.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.017+0000 7f66013f2700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f65fc06c830 0x7f65fc06d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:20.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.017+0000 7f66013f2700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f65fc14a9d0 0x7f65fc14ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:20.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.017+0000 7f66013f2700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65fc14c2f0 con 0x7f65fc0bf3a0 2023-10-08T15:42:20.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.017+0000 7f66013f2700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65fc0a2800 con 0x7f65fc06c830 2023-10-08T15:42:20.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.017+0000 7f66013f2700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65fc14bca0 con 0x7f65fc14a9d0 2023-10-08T15:42:20.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.017+0000 7f65fa7fc700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f65fc06c830 0x7f65fc06d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:20.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.017+0000 7f65fa7fc700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f65fc06c830 0x7f65fc06d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53598/0 (socket says 172.21.15.3:53598) 2023-10-08T15:42:20.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.017+0000 7f65fa7fc700 1 -- 172.21.15.3:0/459624067 learned_addr learned my addr 172.21.15.3:0/459624067 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:20.025 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.017+0000 7f65fb7fe700 1 --2- 172.21.15.3:0/459624067 >> v2:172.21.15.50:3300/0 conn(0x7f65fc14a9d0 0x7f65fc14ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:20.025 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.017+0000 7f65fa7fc700 1 -- 172.21.15.3:0/459624067 >> v2:172.21.15.50:3300/0 conn(0x7f65fc14a9d0 msgr2=0x7f65fc14ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:20.025 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.017+0000 7f65fa7fc700 1 --2- 172.21.15.3:0/459624067 >> v2:172.21.15.50:3300/0 conn(0x7f65fc14a9d0 0x7f65fc14ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:20.025 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.017+0000 7f65fa7fc700 1 -- 172.21.15.3:0/459624067 >> v1:172.21.15.50:6789/0 conn(0x7f65fc0bf3a0 legacy=0x7f65fc06d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:20.025 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.017+0000 7f65fa7fc700 1 -- 172.21.15.3:0/459624067 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65fc14bf80 con 0x7f65fc06c830 2023-10-08T15:42:20.025 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.017+0000 7f65fa7fc700 1 --2- 172.21.15.3:0/459624067 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f65fc06c830 0x7f65fc06d710 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f65fc0636f0 tx=0x7f65f0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f325ddd3a979252e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:20.026 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.017+0000 7f65f9ffb700 1 -- 172.21.15.3:0/459624067 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f000b820 con 0x7f65fc06c830 2023-10-08T15:42:20.026 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.017+0000 7f65f9ffb700 1 -- 172.21.15.3:0/459624067 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65f000b980 con 0x7f65fc06c830 2023-10-08T15:42:20.026 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.017+0000 7f65f9ffb700 1 -- 172.21.15.3:0/459624067 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f000bd20 con 0x7f65fc06c830 2023-10-08T15:42:20.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.017+0000 7f66013f2700 1 -- 172.21.15.3:0/459624067 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f65fc06c830 msgr2=0x7f65fc06d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:20.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.017+0000 7f66013f2700 1 --2- 172.21.15.3:0/459624067 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f65fc06c830 0x7f65fc06d710 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f65fc0636f0 tx=0x7f65f0009250 comp rx=0 tx=0).stop 2023-10-08T15:42:20.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.017+0000 7f66013f2700 1 -- 172.21.15.3:0/459624067 shutdown_connections 2023-10-08T15:42:20.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.017+0000 7f66013f2700 1 --2- 172.21.15.3:0/459624067 >> v2:172.21.15.50:3300/0 conn(0x7f65fc14a9d0 0x7f65fc14ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:20.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.017+0000 7f66013f2700 1 --2- 172.21.15.3:0/459624067 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f65fc06c830 0x7f65fc06d710 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:20.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.017+0000 7f66013f2700 1 -- 172.21.15.3:0/459624067 >> 172.21.15.3:0/459624067 conn(0x7f65fc0c2a80 msgr2=0x7f65fc0bea60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:20.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.017+0000 7f66013f2700 1 -- 172.21.15.3:0/459624067 shutdown_connections 2023-10-08T15:42:20.027 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.017+0000 7f66013f2700 1 -- 172.21.15.3:0/459624067 wait complete. 2023-10-08T15:42:20.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.021+0000 7f66013f2700 1 Processor -- start 2023-10-08T15:42:20.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.021+0000 7f66013f2700 1 -- start start 2023-10-08T15:42:20.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.021+0000 7f66013f2700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f65fc06c830 0x7f65fc14d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:20.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.021+0000 7f66013f2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65fc0bf3a0 0x7f65fc141120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:20.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.021+0000 7f66013f2700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f65fc14a9d0 0x7f65fc141660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:20.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.021+0000 7f66013f2700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65fc14e950 con 0x7f65fc06c830 2023-10-08T15:42:20.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.021+0000 7f66013f2700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65fc141ba0 con 0x7f65fc0bf3a0 2023-10-08T15:42:20.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.021+0000 7f66013f2700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65fc141d00 con 0x7f65fc14a9d0 2023-10-08T15:42:20.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.021+0000 7f65faffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f65fc06c830 0x7f65fc14d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:20.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.021+0000 7f65faffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f65fc06c830 0x7f65fc14d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53602/0 (socket says 172.21.15.3:53602) 2023-10-08T15:42:20.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.021+0000 7f65faffd700 1 -- 172.21.15.3:0/3030652098 learned_addr learned my addr 172.21.15.3:0/3030652098 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:20.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.021+0000 7f65fa7fc700 1 --2- 172.21.15.3:0/3030652098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65fc0bf3a0 0x7f65fc141120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:20.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.021+0000 7f65fb7fe700 1 --2- 172.21.15.3:0/3030652098 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f65fc14a9d0 0x7f65fc141660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:20.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.021+0000 7f65faffd700 1 -- 172.21.15.3:0/3030652098 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f65fc14a9d0 msgr2=0x7f65fc141660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:20.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.021+0000 7f65faffd700 1 --2- 172.21.15.3:0/3030652098 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f65fc14a9d0 0x7f65fc141660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:20.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.021+0000 7f65faffd700 1 -- 172.21.15.3:0/3030652098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65fc0bf3a0 msgr2=0x7f65fc141120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:20.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.021+0000 7f65faffd700 1 --2- 172.21.15.3:0/3030652098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65fc0bf3a0 0x7f65fc141120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:20.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.021+0000 7f65faffd700 1 -- 172.21.15.3:0/3030652098 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f00094f0 con 0x7f65fc06c830 2023-10-08T15:42:20.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.021+0000 7f65fb7fe700 1 --2- 172.21.15.3:0/3030652098 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f65fc14a9d0 0x7f65fc141660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:42:20.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.021+0000 7f65fa7fc700 1 --2- 172.21.15.3:0/3030652098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65fc0bf3a0 0x7f65fc141120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:42:20.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.025+0000 7f65faffd700 1 --2- 172.21.15.3:0/3030652098 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f65fc06c830 0x7f65fc14d4c0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f65ec00c600 tx=0x7f65ec007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:20.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.025+0000 7f65e2ffd700 1 -- 172.21.15.3:0/3030652098 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ec011590 con 0x7f65fc06c830 2023-10-08T15:42:20.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.025+0000 7f65e2ffd700 1 -- 172.21.15.3:0/3030652098 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65ec011710 con 0x7f65fc06c830 2023-10-08T15:42:20.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.025+0000 7f66013f2700 1 -- 172.21.15.3:0/3030652098 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65fc142390 con 0x7f65fc06c830 2023-10-08T15:42:20.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.025+0000 7f65e2ffd700 1 -- 172.21.15.3:0/3030652098 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ec011ad0 con 0x7f65fc06c830 2023-10-08T15:42:20.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.025+0000 7f66013f2700 1 -- 172.21.15.3:0/3030652098 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65fc148900 con 0x7f65fc06c830 2023-10-08T15:42:20.033 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.025+0000 7f66013f2700 1 -- 172.21.15.3:0/3030652098 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65fc142580 con 0x7f65fc06c830 2023-10-08T15:42:20.033 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.025+0000 7f65e2ffd700 1 -- 172.21.15.3:0/3030652098 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f65ec01c460 con 0x7f65fc06c830 2023-10-08T15:42:20.033 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.025+0000 7f65e2ffd700 1 --2- 172.21.15.3:0/3030652098 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f65e8060550 0x7f65e8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:20.034 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.025+0000 7f65e2ffd700 1 -- 172.21.15.3:0/3030652098 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5849+0+0 (secure 0 0 0) 0x7f65ec07c610 con 0x7f65fc06c830 2023-10-08T15:42:20.034 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.029+0000 7f65fa7fc700 1 --2- 172.21.15.3:0/3030652098 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f65e8060550 0x7f65e8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:20.034 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.029+0000 7f65fa7fc700 1 --2- 172.21.15.3:0/3030652098 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f65e8060550 0x7f65e8062a00 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f65fc0636f0 tx=0x7f65f0016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:20.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.033+0000 7f65e2ffd700 1 -- 172.21.15.3:0/3030652098 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f65ec04cb70 con 0x7f65fc06c830 2023-10-08T15:42:20.201 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.193+0000 7f66013f2700 1 -- 172.21.15.3:0/3030652098 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f65fc064530 con 0x7f65fc06c830 2023-10-08T15:42:20.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.841+0000 7f65e2ffd700 1 -- 172.21.15.3:0/3030652098 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v63) v1 ==== 181+0+0 (secure 0 0 0) 0x7f65ec050190 con 0x7f65fc06c830 2023-10-08T15:42:20.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.845+0000 7f66013f2700 1 -- 172.21.15.3:0/3030652098 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f65e8060550 msgr2=0x7f65e8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:20.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.845+0000 7f66013f2700 1 --2- 172.21.15.3:0/3030652098 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f65e8060550 0x7f65e8062a00 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f65fc0636f0 tx=0x7f65f0016000 comp rx=0 tx=0).stop 2023-10-08T15:42:20.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.845+0000 7f66013f2700 1 -- 172.21.15.3:0/3030652098 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f65fc06c830 msgr2=0x7f65fc14d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:20.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.845+0000 7f66013f2700 1 --2- 172.21.15.3:0/3030652098 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f65fc06c830 0x7f65fc14d4c0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f65ec00c600 tx=0x7f65ec007f60 comp rx=0 tx=0).stop 2023-10-08T15:42:20.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.845+0000 7f66013f2700 1 -- 172.21.15.3:0/3030652098 shutdown_connections 2023-10-08T15:42:20.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.845+0000 7f66013f2700 1 --2- 172.21.15.3:0/3030652098 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f65e8060550 0x7f65e8062a00 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:20.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.845+0000 7f66013f2700 1 --2- 172.21.15.3:0/3030652098 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f65fc14a9d0 0x7f65fc141660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:20.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.845+0000 7f66013f2700 1 --2- 172.21.15.3:0/3030652098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65fc0bf3a0 0x7f65fc141120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:20.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.845+0000 7f66013f2700 1 --2- 172.21.15.3:0/3030652098 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f65fc06c830 0x7f65fc14d4c0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:20.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.845+0000 7f66013f2700 1 -- 172.21.15.3:0/3030652098 >> 172.21.15.3:0/3030652098 conn(0x7f65fc0c2a80 msgr2=0x7f65fc147b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:20.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.845+0000 7f66013f2700 1 -- 172.21.15.3:0/3030652098 shutdown_connections 2023-10-08T15:42:20.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.849+0000 7f66013f2700 1 -- 172.21.15.3:0/3030652098 wait complete. 2023-10-08T15:42:20.855 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'cephfs_metadata' removed 2023-10-08T15:42:20.869 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-08T15:42:20.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.973+0000 7fa0fdabb700 1 Processor -- start 2023-10-08T15:42:20.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.977+0000 7fa0fdabb700 1 -- start start 2023-10-08T15:42:20.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.977+0000 7fa0fdabb700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fa0f814b6d0 0x7fa0f8068d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:20.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.977+0000 7fa0fdabb700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0f80692a0 con 0x7fa0f8069920 2023-10-08T15:42:20.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.977+0000 7fa0fdabb700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0f814bed0 con 0x7fa0f80a1200 2023-10-08T15:42:20.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.977+0000 7fa0fdabb700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0f80694d0 con 0x7fa0f814b6d0 2023-10-08T15:42:20.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.977+0000 7fa0fcab9700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fa0f814b6d0 0x7fa0f8068d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:20.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.977+0000 7fa0f7fff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fa0f8069920 0x7fa0f806c990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:53498/0 (socket says 172.21.15.3:53498) 2023-10-08T15:42:20.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.977+0000 7fa0f7fff700 1 -- 172.21.15.3:0/1673665069 learned_addr learned my addr 172.21.15.3:0/1673665069 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:42:20.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.977+0000 7fa0f77fe700 1 -- 172.21.15.3:0/1673665069 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2628184134 0 0) 0x7fa0f80692a0 con 0x7fa0f8069920 2023-10-08T15:42:20.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.977+0000 7fa0f77fe700 1 -- 172.21.15.3:0/1673665069 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0e0003570 con 0x7fa0f8069920 2023-10-08T15:42:20.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.977+0000 7fa0fcab9700 1 -- 172.21.15.3:0/1673665069 >> v1:172.21.15.50:6789/0 conn(0x7fa0f80a1200 legacy=0x7fa0f814a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:20.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.977+0000 7fa0f77fe700 1 -- 172.21.15.3:0/1673665069 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3565548051 0 0) 0x7fa0e0003570 con 0x7fa0f8069920 2023-10-08T15:42:20.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.977+0000 7fa0fcab9700 1 -- 172.21.15.3:0/1673665069 >> v1:172.21.15.3:6789/0 conn(0x7fa0f8069920 legacy=0x7fa0f806c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:20.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.977+0000 7fa0fcab9700 1 -- 172.21.15.3:0/1673665069 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f814c170 con 0x7fa0f814b6d0 2023-10-08T15:42:20.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.977+0000 7fa0fcab9700 1 --2- 172.21.15.3:0/1673665069 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa0f814b6d0 0x7fa0f8068d60 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fa0e80098e0 tx=0x7fa0e80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2205501e8d896a83 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:20.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.977+0000 7fa0f77fe700 1 -- 172.21.15.3:0/1673665069 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec001470 con 0x7fa0f814b6d0 2023-10-08T15:42:20.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.977+0000 7fa0f77fe700 1 -- 172.21.15.3:0/1673665069 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0e8011420 con 0x7fa0f814b6d0 2023-10-08T15:42:20.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.977+0000 7fa0f77fe700 1 -- 172.21.15.3:0/1673665069 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e80117c0 con 0x7fa0f814b6d0 2023-10-08T15:42:20.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.977+0000 7fa0fdabb700 1 -- 172.21.15.3:0/1673665069 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa0f814b6d0 msgr2=0x7fa0f8068d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:20.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.977+0000 7fa0fdabb700 1 --2- 172.21.15.3:0/1673665069 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa0f814b6d0 0x7fa0f8068d60 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fa0e80098e0 tx=0x7fa0e80091a0 comp rx=0 tx=0).stop 2023-10-08T15:42:20.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.977+0000 7fa0fdabb700 1 -- 172.21.15.3:0/1673665069 shutdown_connections 2023-10-08T15:42:20.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.977+0000 7fa0fdabb700 1 --2- 172.21.15.3:0/1673665069 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa0f814b6d0 0x7fa0f8068d60 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:20.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.981+0000 7fa0fdabb700 1 -- 172.21.15.3:0/1673665069 >> 172.21.15.3:0/1673665069 conn(0x7fa0f80a18a0 msgr2=0x7fa0f80a1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:20.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.981+0000 7fa0fdabb700 1 -- 172.21.15.3:0/1673665069 shutdown_connections 2023-10-08T15:42:20.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.981+0000 7fa0fdabb700 1 -- 172.21.15.3:0/1673665069 wait complete. 2023-10-08T15:42:20.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.981+0000 7fa0fdabb700 1 Processor -- start 2023-10-08T15:42:20.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.981+0000 7fa0fdabb700 1 -- start start 2023-10-08T15:42:20.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.985+0000 7fa0fdabb700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa0f8069920 0x7fa0f815e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:20.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.985+0000 7fa0fdabb700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa0f80a1200 0x7fa0f8142bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:20.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.985+0000 7fa0fdabb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0f814b6d0 0x7fa0f8148270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:20.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.985+0000 7fa0fdabb700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f80a80d0 con 0x7fa0f8069920 2023-10-08T15:42:20.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.985+0000 7fa0fdabb700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f815b660 con 0x7fa0f814b6d0 2023-10-08T15:42:20.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.985+0000 7fa0fdabb700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f814a8b0 con 0x7fa0f80a1200 2023-10-08T15:42:20.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.985+0000 7fa0fcab9700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa0f8069920 0x7fa0f815e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:20.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.985+0000 7fa0fcab9700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa0f8069920 0x7fa0f815e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53618/0 (socket says 172.21.15.3:53618) 2023-10-08T15:42:20.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.985+0000 7fa0fcab9700 1 -- 172.21.15.3:0/2078279188 learned_addr learned my addr 172.21.15.3:0/2078279188 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:20.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.985+0000 7fa0f7fff700 1 --2- 172.21.15.3:0/2078279188 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa0f80a1200 0x7fa0f8142bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:20.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.985+0000 7fa0fd2ba700 1 --2- 172.21.15.3:0/2078279188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0f814b6d0 0x7fa0f8148270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:20.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.985+0000 7fa0fcab9700 1 -- 172.21.15.3:0/2078279188 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa0f80a1200 msgr2=0x7fa0f8142bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:20.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.985+0000 7fa0fcab9700 1 --2- 172.21.15.3:0/2078279188 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa0f80a1200 0x7fa0f8142bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:20.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.985+0000 7fa0fcab9700 1 -- 172.21.15.3:0/2078279188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0f814b6d0 msgr2=0x7fa0f8148270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:20.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.985+0000 7fa0fcab9700 1 --2- 172.21.15.3:0/2078279188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0f814b6d0 0x7fa0f8148270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:20.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.985+0000 7fa0fcab9700 1 -- 172.21.15.3:0/2078279188 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e8009420 con 0x7fa0f8069920 2023-10-08T15:42:20.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.985+0000 7fa0fd2ba700 1 --2- 172.21.15.3:0/2078279188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0f814b6d0 0x7fa0f8148270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:42:20.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.985+0000 7fa0fcab9700 1 --2- 172.21.15.3:0/2078279188 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa0f8069920 0x7fa0f815e240 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fa0f80bfa30 tx=0x7fa0e8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:20.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.985+0000 7fa0f4ff9700 1 -- 172.21.15.3:0/2078279188 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e80091a0 con 0x7fa0f8069920 2023-10-08T15:42:20.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.985+0000 7fa0f4ff9700 1 -- 172.21.15.3:0/2078279188 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0e8010b70 con 0x7fa0f8069920 2023-10-08T15:42:20.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.985+0000 7fa0fdabb700 1 -- 172.21.15.3:0/2078279188 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0f814ab90 con 0x7fa0f8069920 2023-10-08T15:42:20.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.985+0000 7fa0f4ff9700 1 -- 172.21.15.3:0/2078279188 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e801d430 con 0x7fa0f8069920 2023-10-08T15:42:20.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.985+0000 7fa0fdabb700 1 -- 172.21.15.3:0/2078279188 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0f815e780 con 0x7fa0f8069920 2023-10-08T15:42:20.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.985+0000 7fa0fdabb700 1 -- 172.21.15.3:0/2078279188 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0f8069640 con 0x7fa0f8069920 2023-10-08T15:42:20.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.989+0000 7fa0f4ff9700 1 -- 172.21.15.3:0/2078279188 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa0e801d7e0 con 0x7fa0f8069920 2023-10-08T15:42:20.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.989+0000 7fa0f4ff9700 1 --2- 172.21.15.3:0/2078279188 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fa0e4060550 0x7fa0e4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:20.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.989+0000 7fa0f4ff9700 1 -- 172.21.15.3:0/2078279188 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5411+0+0 (secure 0 0 0) 0x7fa0e807e350 con 0x7fa0f8069920 2023-10-08T15:42:20.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.989+0000 7fa0f7fff700 1 --2- 172.21.15.3:0/2078279188 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fa0e4060550 0x7fa0e4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:20.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.989+0000 7fa0f7fff700 1 --2- 172.21.15.3:0/2078279188 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fa0e4060550 0x7fa0e4062a00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8147150 tx=0x7fa0ec001a20 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:21.003 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:20.997+0000 7fa0f4ff9700 1 -- 172.21.15.3:0/2078279188 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa0e804e9c0 con 0x7fa0f8069920 2023-10-08T15:42:21.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.161+0000 7fa0fdabb700 1 -- 172.21.15.3:0/2078279188 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa0f805ecf0 con 0x7fa0f8069920 2023-10-08T15:42:21.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.845+0000 7fa0f4ff9700 1 -- 172.21.15.3:0/2078279188 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v64) v1 ==== 169+0+0 (secure 0 0 0) 0x7fa0e801ae60 con 0x7fa0f8069920 2023-10-08T15:42:21.858 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.849+0000 7fa0fdabb700 1 -- 172.21.15.3:0/2078279188 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fa0e4060550 msgr2=0x7fa0e4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:21.858 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.849+0000 7fa0fdabb700 1 --2- 172.21.15.3:0/2078279188 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fa0e4060550 0x7fa0e4062a00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8147150 tx=0x7fa0ec001a20 comp rx=0 tx=0).stop 2023-10-08T15:42:21.858 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.849+0000 7fa0fdabb700 1 -- 172.21.15.3:0/2078279188 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa0f8069920 msgr2=0x7fa0f815e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:21.858 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.849+0000 7fa0fdabb700 1 --2- 172.21.15.3:0/2078279188 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa0f8069920 0x7fa0f815e240 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fa0f80bfa30 tx=0x7fa0e8017000 comp rx=0 tx=0).stop 2023-10-08T15:42:21.858 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.853+0000 7fa0fdabb700 1 -- 172.21.15.3:0/2078279188 shutdown_connections 2023-10-08T15:42:21.858 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.853+0000 7fa0fdabb700 1 --2- 172.21.15.3:0/2078279188 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fa0e4060550 0x7fa0e4062a00 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:21.858 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.853+0000 7fa0fdabb700 1 --2- 172.21.15.3:0/2078279188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0f814b6d0 0x7fa0f8148270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:21.858 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.853+0000 7fa0fdabb700 1 --2- 172.21.15.3:0/2078279188 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa0f80a1200 0x7fa0f8142bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:21.858 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.853+0000 7fa0fdabb700 1 --2- 172.21.15.3:0/2078279188 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa0f8069920 0x7fa0f815e240 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:21.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.853+0000 7fa0fdabb700 1 -- 172.21.15.3:0/2078279188 >> 172.21.15.3:0/2078279188 conn(0x7fa0f80a18a0 msgr2=0x7fa0f8151f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:21.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.853+0000 7fa0fdabb700 1 -- 172.21.15.3:0/2078279188 shutdown_connections 2023-10-08T15:42:21.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.853+0000 7fa0fdabb700 1 -- 172.21.15.3:0/2078279188 wait complete. 2023-10-08T15:42:21.860 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'cephfs_data' removed 2023-10-08T15:42:21.875 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-08T15:42:21.978 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.973+0000 7f3c04f01700 1 Processor -- start 2023-10-08T15:42:21.978 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.973+0000 7f3c04f01700 1 -- start start 2023-10-08T15:42:21.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.973+0000 7f3c04f01700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3c0014b9a0 0x7f3c00149670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:21.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.973+0000 7f3c04f01700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3c000685a0 0x7f3c000a1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:21.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.973+0000 7f3c04f01700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c000a1570 con 0x7f3c000a1f40 2023-10-08T15:42:21.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.973+0000 7f3c04f01700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c00149430 con 0x7f3c000685a0 2023-10-08T15:42:21.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.973+0000 7f3c04f01700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c00149bb0 con 0x7f3c0014b9a0 2023-10-08T15:42:21.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.973+0000 7f3bfffff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f3c000a1f40 0x7f3c001470d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:53510/0 (socket says 172.21.15.3:53510) 2023-10-08T15:42:21.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.973+0000 7f3bfffff700 1 -- 172.21.15.3:0/3789573481 learned_addr learned my addr 172.21.15.3:0/3789573481 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:42:21.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.973+0000 7f3bfeffd700 1 --2- 172.21.15.3:0/3789573481 >> v2:172.21.15.50:3300/0 conn(0x7f3c000685a0 0x7f3c000a1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:21.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.973+0000 7f3bff7fe700 1 --2- 172.21.15.3:0/3789573481 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3c0014b9a0 0x7f3c00149670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:21.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.973+0000 7f3bfe7fc700 1 -- 172.21.15.3:0/3789573481 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2615860589 0 0) 0x7f3c000a1570 con 0x7f3c000a1f40 2023-10-08T15:42:21.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.973+0000 7f3bfe7fc700 1 -- 172.21.15.3:0/3789573481 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3be8003570 con 0x7f3c000a1f40 2023-10-08T15:42:21.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.973+0000 7f3bfe7fc700 1 -- 172.21.15.3:0/3789573481 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2123546442 0 0) 0x7f3be8003570 con 0x7f3c000a1f40 2023-10-08T15:42:21.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.973+0000 7f3bfe7fc700 1 -- 172.21.15.3:0/3789573481 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3c0014b9a0 msgr2=0x7f3c00149670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:21.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.973+0000 7f3bfe7fc700 1 --2- 172.21.15.3:0/3789573481 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3c0014b9a0 0x7f3c00149670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:21.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.973+0000 7f3bfe7fc700 1 -- 172.21.15.3:0/3789573481 >> v2:172.21.15.50:3300/0 conn(0x7f3c000685a0 msgr2=0x7f3c000a1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:21.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.973+0000 7f3bfe7fc700 1 --2- 172.21.15.3:0/3789573481 >> v2:172.21.15.50:3300/0 conn(0x7f3c000685a0 0x7f3c000a1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:21.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.973+0000 7f3bfe7fc700 1 -- 172.21.15.3:0/3789573481 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c0014c310 con 0x7f3c000a1f40 2023-10-08T15:42:21.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.973+0000 7f3bfe7fc700 1 -- 172.21.15.3:0/3789573481 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2285686191 0 0) 0x7f3bf80017f0 con 0x7f3c000a1f40 2023-10-08T15:42:21.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.973+0000 7f3bfe7fc700 1 -- 172.21.15.3:0/3789573481 >> v1:172.21.15.3:6789/0 conn(0x7f3c000a1f40 legacy=0x7f3c001470d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:21.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.973+0000 7f3bfe7fc700 1 --2- 172.21.15.3:0/3789573481 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3be8003a60 0x7f3be8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:21.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.973+0000 7f3bfe7fc700 1 --2- 172.21.15.3:0/3789573481 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3c0014b9a0 0x7f3be8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:21.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.973+0000 7f3bfe7fc700 1 --2- 172.21.15.3:0/3789573481 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3be8004d50 0x7f3be80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:21.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.973+0000 7f3bfe7fc700 1 -- 172.21.15.3:0/3789573481 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c00149430 con 0x7f3be8004d50 2023-10-08T15:42:21.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.973+0000 7f3bfe7fc700 1 -- 172.21.15.3:0/3789573481 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c00149bb0 con 0x7f3be8003a60 2023-10-08T15:42:21.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.973+0000 7f3bfe7fc700 1 -- 172.21.15.3:0/3789573481 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3be800ba60 con 0x7f3c0014b9a0 2023-10-08T15:42:21.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.973+0000 7f3bfffff700 1 --2- 172.21.15.3:0/3789573481 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3be8004d50 0x7f3be80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:21.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.973+0000 7f3bff7fe700 1 --2- 172.21.15.3:0/3789573481 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3be8003a60 0x7f3be8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:21.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.973+0000 7f3bfeffd700 1 --2- 172.21.15.3:0/3789573481 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3c0014b9a0 0x7f3be8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:21.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.973+0000 7f3bfffff700 1 -- 172.21.15.3:0/3789573481 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3c0014b9a0 msgr2=0x7f3be8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:21.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.973+0000 7f3bfffff700 1 --2- 172.21.15.3:0/3789573481 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3c0014b9a0 0x7f3be8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:21.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.973+0000 7f3bfffff700 1 -- 172.21.15.3:0/3789573481 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3be8003a60 msgr2=0x7f3be8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:21.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.973+0000 7f3bfffff700 1 --2- 172.21.15.3:0/3789573481 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3be8003a60 0x7f3be8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:21.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.973+0000 7f3bfffff700 1 -- 172.21.15.3:0/3789573481 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be8003570 con 0x7f3be8004d50 2023-10-08T15:42:21.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.973+0000 7f3bfeffd700 1 --2- 172.21.15.3:0/3789573481 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3c0014b9a0 0x7f3be8004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:42:21.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.977+0000 7f3bfffff700 1 --2- 172.21.15.3:0/3789573481 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3be8004d50 0x7f3be80051c0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f3bf800a930 tx=0x7f3bf80021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=895129adb9cc2d0c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:21.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.977+0000 7f3bfe7fc700 1 -- 172.21.15.3:0/3789573481 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf80070d0 con 0x7f3be8004d50 2023-10-08T15:42:21.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.977+0000 7f3bfe7fc700 1 -- 172.21.15.3:0/3789573481 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bf8007230 con 0x7f3be8004d50 2023-10-08T15:42:21.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.977+0000 7f3bfe7fc700 1 -- 172.21.15.3:0/3789573481 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf80075d0 con 0x7f3be8004d50 2023-10-08T15:42:21.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.977+0000 7f3c04f01700 1 -- 172.21.15.3:0/3789573481 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3be8004d50 msgr2=0x7f3be80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:21.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.977+0000 7f3c04f01700 1 --2- 172.21.15.3:0/3789573481 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3be8004d50 0x7f3be80051c0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f3bf800a930 tx=0x7f3bf80021d0 comp rx=0 tx=0).stop 2023-10-08T15:42:21.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.977+0000 7f3bfffff700 1 -- 172.21.15.3:0/3789573481 reap_dead start 2023-10-08T15:42:21.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.977+0000 7f3c04f01700 1 -- 172.21.15.3:0/3789573481 shutdown_connections 2023-10-08T15:42:21.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.977+0000 7f3c04f01700 1 -- 172.21.15.3:0/3789573481 >> 172.21.15.3:0/3789573481 conn(0x7f3c000bd9c0 msgr2=0x7f3c000bdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:21.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.977+0000 7f3c04f01700 1 -- 172.21.15.3:0/3789573481 shutdown_connections 2023-10-08T15:42:21.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.977+0000 7f3c04f01700 1 -- 172.21.15.3:0/3789573481 wait complete. 2023-10-08T15:42:21.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.977+0000 7f3c04f01700 1 Processor -- start 2023-10-08T15:42:21.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.977+0000 7f3c04f01700 1 -- start start 2023-10-08T15:42:21.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.981+0000 7f3c04f01700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3be8004d50 0x7f3c00149f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:21.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.981+0000 7f3c04f01700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3c00147880 0x7f3c0013c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:21.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.981+0000 7f3c04f01700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3c0013cef0 0x7f3c00146560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:21.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.981+0000 7f3c04f01700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0006edf0 con 0x7f3c00147880 2023-10-08T15:42:21.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.981+0000 7f3c04f01700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0013d390 con 0x7f3be8004d50 2023-10-08T15:42:21.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.981+0000 7f3c04f01700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0006f040 con 0x7f3c0013cef0 2023-10-08T15:42:21.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.981+0000 7f3bfeffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3c00147880 0x7f3c0013c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:21.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.981+0000 7f3bff7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3be8004d50 0x7f3c00149f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:21.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.981+0000 7f3bfeffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3c00147880 0x7f3c0013c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53640/0 (socket says 172.21.15.3:53640) 2023-10-08T15:42:21.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.981+0000 7f3bfeffd700 1 -- 172.21.15.3:0/3824883307 learned_addr learned my addr 172.21.15.3:0/3824883307 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:21.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.981+0000 7f3bfffff700 1 --2- 172.21.15.3:0/3824883307 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3c0013cef0 0x7f3c00146560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:21.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.981+0000 7f3bfeffd700 1 -- 172.21.15.3:0/3824883307 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3c0013cef0 msgr2=0x7f3c00146560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:21.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.981+0000 7f3bfeffd700 1 --2- 172.21.15.3:0/3824883307 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3c0013cef0 0x7f3c00146560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:21.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.981+0000 7f3bfeffd700 1 -- 172.21.15.3:0/3824883307 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3be8004d50 msgr2=0x7f3c00149f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:21.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.981+0000 7f3bfeffd700 1 --2- 172.21.15.3:0/3824883307 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3be8004d50 0x7f3c00149f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:21.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.981+0000 7f3bfeffd700 1 -- 172.21.15.3:0/3824883307 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c0015b0f0 con 0x7f3c00147880 2023-10-08T15:42:21.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.981+0000 7f3bfeffd700 1 --2- 172.21.15.3:0/3824883307 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3c00147880 0x7f3c0013c9b0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4011990 tx=0x7f3bf4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:21.990 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.981+0000 7f3be77fe700 1 -- 172.21.15.3:0/3824883307 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf4015670 con 0x7f3c00147880 2023-10-08T15:42:21.990 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.981+0000 7f3be77fe700 1 -- 172.21.15.3:0/3824883307 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bf40157d0 con 0x7f3c00147880 2023-10-08T15:42:21.990 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.981+0000 7f3c04f01700 1 -- 172.21.15.3:0/3824883307 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c0014a460 con 0x7f3c00147880 2023-10-08T15:42:21.990 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.981+0000 7f3be77fe700 1 -- 172.21.15.3:0/3824883307 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf4015b50 con 0x7f3c00147880 2023-10-08T15:42:21.990 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.981+0000 7f3c04f01700 1 -- 172.21.15.3:0/3824883307 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c0014ade0 con 0x7f3c00147880 2023-10-08T15:42:21.990 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.985+0000 7f3c04f01700 1 -- 172.21.15.3:0/3824883307 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c0005ecf0 con 0x7f3c00147880 2023-10-08T15:42:21.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.985+0000 7f3be77fe700 1 -- 172.21.15.3:0/3824883307 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f3bf4013410 con 0x7f3c00147880 2023-10-08T15:42:21.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.985+0000 7f3be77fe700 1 --2- 172.21.15.3:0/3824883307 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3bec060550 0x7f3bec062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:21.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.985+0000 7f3be77fe700 1 -- 172.21.15.3:0/3824883307 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f3bf407cb10 con 0x7f3c00147880 2023-10-08T15:42:21.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.985+0000 7f3bff7fe700 1 --2- 172.21.15.3:0/3824883307 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3bec060550 0x7f3bec062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:21.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.985+0000 7f3bff7fe700 1 --2- 172.21.15.3:0/3824883307 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3bec060550 0x7f3bec062a00 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0006f00 tx=0x7f3bf00091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:21.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:21.993+0000 7f3be77fe700 1 -- 172.21.15.3:0/3824883307 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3bf404d400 con 0x7f3c00147880 2023-10-08T15:42:22.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.153+0000 7f3c04f01700 1 -- 172.21.15.3:0/3824883307 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f3c0015b280 con 0x7f3c00147880 2023-10-08T15:42:22.169 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.161+0000 7f3be77fe700 1 -- 172.21.15.3:0/3824883307 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3bf4050a20 con 0x7f3c00147880 2023-10-08T15:42:22.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.165+0000 7f3c04f01700 1 -- 172.21.15.3:0/3824883307 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3bec060550 msgr2=0x7f3bec062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:22.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.165+0000 7f3c04f01700 1 --2- 172.21.15.3:0/3824883307 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3bec060550 0x7f3bec062a00 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0006f00 tx=0x7f3bf00091a0 comp rx=0 tx=0).stop 2023-10-08T15:42:22.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.165+0000 7f3c04f01700 1 -- 172.21.15.3:0/3824883307 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3c00147880 msgr2=0x7f3c0013c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:22.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.165+0000 7f3c04f01700 1 --2- 172.21.15.3:0/3824883307 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3c00147880 0x7f3c0013c9b0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4011990 tx=0x7f3bf4008040 comp rx=0 tx=0).stop 2023-10-08T15:42:22.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.165+0000 7f3c04f01700 1 -- 172.21.15.3:0/3824883307 shutdown_connections 2023-10-08T15:42:22.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.165+0000 7f3c04f01700 1 --2- 172.21.15.3:0/3824883307 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3bec060550 0x7f3bec062a00 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:22.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.165+0000 7f3c04f01700 1 --2- 172.21.15.3:0/3824883307 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3c0013cef0 0x7f3c00146560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:22.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.165+0000 7f3c04f01700 1 --2- 172.21.15.3:0/3824883307 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3c00147880 0x7f3c0013c9b0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:22.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.165+0000 7f3c04f01700 1 --2- 172.21.15.3:0/3824883307 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3be8004d50 0x7f3c00149f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:22.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.165+0000 7f3c04f01700 1 -- 172.21.15.3:0/3824883307 >> 172.21.15.3:0/3824883307 conn(0x7f3c000bd9c0 msgr2=0x7f3c00144f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:22.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.165+0000 7f3c04f01700 1 -- 172.21.15.3:0/3824883307 shutdown_connections 2023-10-08T15:42:22.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.165+0000 7f3c04f01700 1 -- 172.21.15.3:0/3824883307 wait complete. 2023-10-08T15:42:22.186 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout' 2023-10-08T15:42:22.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.289+0000 7fee99e0c700 1 Processor -- start 2023-10-08T15:42:22.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.289+0000 7fee99e0c700 1 -- start start 2023-10-08T15:42:22.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.289+0000 7fee99e0c700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fee940a15e0 0x7fee9414eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:22.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.289+0000 7fee99e0c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fee9406cf60 0x7fee9414f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:22.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.289+0000 7fee99e0c700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee94069900 con 0x7fee94068630 2023-10-08T15:42:22.297 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.289+0000 7fee99e0c700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee9414c760 con 0x7fee940a15e0 2023-10-08T15:42:22.297 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.289+0000 7fee99e0c700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee94069620 con 0x7fee9406cf60 2023-10-08T15:42:22.297 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.289+0000 7fee98e0a700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fee940a15e0 0x7fee9414eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:22.297 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.289+0000 7fee9960b700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fee94068630 0x7fee9414a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:53524/0 (socket says 172.21.15.3:53524) 2023-10-08T15:42:22.297 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.289+0000 7fee9960b700 1 -- 172.21.15.3:0/4118697207 learned_addr learned my addr 172.21.15.3:0/4118697207 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:42:22.297 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.289+0000 7fee93fff700 1 --2- 172.21.15.3:0/4118697207 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fee9406cf60 0x7fee9414f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:22.297 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.289+0000 7fee98e0a700 1 -- 172.21.15.3:0/4118697207 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fee9406cf60 msgr2=0x7fee9414f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:22.297 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.289+0000 7fee98e0a700 1 --2- 172.21.15.3:0/4118697207 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fee9406cf60 0x7fee9414f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:22.297 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.289+0000 7fee98e0a700 1 -- 172.21.15.3:0/4118697207 >> v1:172.21.15.3:6789/0 conn(0x7fee94068630 legacy=0x7fee9414a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:22.297 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.289+0000 7fee937fe700 1 -- 172.21.15.3:0/4118697207 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2232444847 0 0) 0x7fee94069900 con 0x7fee94068630 2023-10-08T15:42:22.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.289+0000 7fee98e0a700 1 -- 172.21.15.3:0/4118697207 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee94068d10 con 0x7fee940a15e0 2023-10-08T15:42:22.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.289+0000 7fee93fff700 1 --2- 172.21.15.3:0/4118697207 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fee9406cf60 0x7fee9414f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:42:22.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.289+0000 7fee98e0a700 1 --2- 172.21.15.3:0/4118697207 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fee940a15e0 0x7fee9414eae0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fee8c009e60 tx=0x7fee8c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94a4b382bf7a50e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:22.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.289+0000 7fee937fe700 1 -- 172.21.15.3:0/4118697207 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8c00e070 con 0x7fee940a15e0 2023-10-08T15:42:22.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.289+0000 7fee937fe700 1 -- 172.21.15.3:0/4118697207 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee8c00bc30 con 0x7fee940a15e0 2023-10-08T15:42:22.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.289+0000 7fee937fe700 1 -- 172.21.15.3:0/4118697207 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8c012430 con 0x7fee940a15e0 2023-10-08T15:42:22.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.289+0000 7fee99e0c700 1 -- 172.21.15.3:0/4118697207 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fee940a15e0 msgr2=0x7fee9414eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:22.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.289+0000 7fee99e0c700 1 --2- 172.21.15.3:0/4118697207 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fee940a15e0 0x7fee9414eae0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fee8c009e60 tx=0x7fee8c009780 comp rx=0 tx=0).stop 2023-10-08T15:42:22.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.289+0000 7fee99e0c700 1 -- 172.21.15.3:0/4118697207 shutdown_connections 2023-10-08T15:42:22.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.289+0000 7fee99e0c700 1 --2- 172.21.15.3:0/4118697207 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fee9406cf60 0x7fee9414f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:22.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.289+0000 7fee99e0c700 1 --2- 172.21.15.3:0/4118697207 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fee940a15e0 0x7fee9414eae0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:22.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.289+0000 7fee99e0c700 1 -- 172.21.15.3:0/4118697207 >> 172.21.15.3:0/4118697207 conn(0x7fee940670e0 msgr2=0x7fee940674e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:22.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.289+0000 7fee99e0c700 1 -- 172.21.15.3:0/4118697207 shutdown_connections 2023-10-08T15:42:22.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.289+0000 7fee99e0c700 1 -- 172.21.15.3:0/4118697207 wait complete. 2023-10-08T15:42:22.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.293+0000 7fee99e0c700 1 Processor -- start 2023-10-08T15:42:22.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.293+0000 7fee99e0c700 1 -- start start 2023-10-08T15:42:22.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.293+0000 7fee99e0c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee94068630 0x7fee940bd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:22.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.293+0000 7fee99e0c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fee940a15e0 0x7fee9415e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:22.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.293+0000 7fee99e0c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fee940b6570 0x7fee940b8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:22.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.293+0000 7fee99e0c700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee940b9140 con 0x7fee940a15e0 2023-10-08T15:42:22.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.293+0000 7fee99e0c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee9415ede0 con 0x7fee94068630 2023-10-08T15:42:22.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.293+0000 7fee99e0c700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee940b6b80 con 0x7fee940b6570 2023-10-08T15:42:22.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.293+0000 7fee93fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fee940a15e0 0x7fee9415e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:22.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.293+0000 7fee98e0a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee94068630 0x7fee940bd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:22.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.293+0000 7fee93fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fee940a15e0 0x7fee9415e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53656/0 (socket says 172.21.15.3:53656) 2023-10-08T15:42:22.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.293+0000 7fee93fff700 1 -- 172.21.15.3:0/1781941575 learned_addr learned my addr 172.21.15.3:0/1781941575 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:22.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.293+0000 7fee9960b700 1 --2- 172.21.15.3:0/1781941575 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fee940b6570 0x7fee940b8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:22.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.293+0000 7fee93fff700 1 -- 172.21.15.3:0/1781941575 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fee940b6570 msgr2=0x7fee940b8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:22.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.293+0000 7fee93fff700 1 --2- 172.21.15.3:0/1781941575 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fee940b6570 0x7fee940b8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:22.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.293+0000 7fee93fff700 1 -- 172.21.15.3:0/1781941575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee94068630 msgr2=0x7fee940bd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:22.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.293+0000 7fee93fff700 1 --2- 172.21.15.3:0/1781941575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee94068630 0x7fee940bd2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:22.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.293+0000 7fee93fff700 1 -- 172.21.15.3:0/1781941575 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee8c009a20 con 0x7fee940a15e0 2023-10-08T15:42:22.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.293+0000 7fee98e0a700 1 --2- 172.21.15.3:0/1781941575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee94068630 0x7fee940bd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:42:22.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.293+0000 7fee93fff700 1 --2- 172.21.15.3:0/1781941575 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fee940a15e0 0x7fee9415e5f0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fee7c00e8d0 tx=0x7fee7c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:22.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.293+0000 7fee90ff9700 1 -- 172.21.15.3:0/1781941575 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7c013410 con 0x7fee940a15e0 2023-10-08T15:42:22.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.293+0000 7fee90ff9700 1 -- 172.21.15.3:0/1781941575 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee7c013570 con 0x7fee940a15e0 2023-10-08T15:42:22.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.293+0000 7fee99e0c700 1 -- 172.21.15.3:0/1781941575 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee9415eb30 con 0x7fee940a15e0 2023-10-08T15:42:22.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.293+0000 7fee90ff9700 1 -- 172.21.15.3:0/1781941575 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7c013910 con 0x7fee940a15e0 2023-10-08T15:42:22.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.293+0000 7fee99e0c700 1 -- 172.21.15.3:0/1781941575 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee940b88f0 con 0x7fee940a15e0 2023-10-08T15:42:22.305 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.297+0000 7fee99e0c700 1 -- 172.21.15.3:0/1781941575 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee940b69e0 con 0x7fee940a15e0 2023-10-08T15:42:22.305 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.297+0000 7fee90ff9700 1 -- 172.21.15.3:0/1781941575 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fee7c013d00 con 0x7fee940a15e0 2023-10-08T15:42:22.305 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.297+0000 7fee90ff9700 1 --2- 172.21.15.3:0/1781941575 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fee74060580 0x7fee74062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:22.305 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.297+0000 7fee90ff9700 1 -- 172.21.15.3:0/1781941575 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fee7c07c190 con 0x7fee940a15e0 2023-10-08T15:42:22.305 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.297+0000 7fee98e0a700 1 --2- 172.21.15.3:0/1781941575 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fee74060580 0x7fee74062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:22.305 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.297+0000 7fee98e0a700 1 --2- 172.21.15.3:0/1781941575 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fee74060580 0x7fee74062a30 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fee8c009e60 tx=0x7fee8c019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:22.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.305+0000 7fee90ff9700 1 -- 172.21.15.3:0/1781941575 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fee940b69e0 con 0x7fee940a15e0 2023-10-08T15:42:22.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:22.525+0000 7fee99e0c700 1 -- 172.21.15.3:0/1781941575 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout"]} v 0) v1 -- 0x7fee940b69e0 con 0x7fee940a15e0 2023-10-08T15:42:23.231 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.225+0000 7fee90ff9700 1 -- 172.21.15.3:0/1781941575 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout"]}]=0 v227) v1 ==== 147+0+0 (secure 0 0 0) 0x7fee940b69e0 con 0x7fee940a15e0 2023-10-08T15:42:23.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.229+0000 7fee99e0c700 1 -- 172.21.15.3:0/1781941575 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fee74060580 msgr2=0x7fee74062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:23.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.229+0000 7fee99e0c700 1 --2- 172.21.15.3:0/1781941575 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fee74060580 0x7fee74062a30 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fee8c009e60 tx=0x7fee8c019000 comp rx=0 tx=0).stop 2023-10-08T15:42:23.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.229+0000 7fee99e0c700 1 -- 172.21.15.3:0/1781941575 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fee940a15e0 msgr2=0x7fee9415e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:23.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.229+0000 7fee99e0c700 1 --2- 172.21.15.3:0/1781941575 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fee940a15e0 0x7fee9415e5f0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fee7c00e8d0 tx=0x7fee7c008040 comp rx=0 tx=0).stop 2023-10-08T15:42:23.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.229+0000 7fee99e0c700 1 -- 172.21.15.3:0/1781941575 shutdown_connections 2023-10-08T15:42:23.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.229+0000 7fee99e0c700 1 --2- 172.21.15.3:0/1781941575 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fee74060580 0x7fee74062a30 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:23.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.229+0000 7fee99e0c700 1 --2- 172.21.15.3:0/1781941575 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fee940b6570 0x7fee940b8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:23.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.229+0000 7fee99e0c700 1 --2- 172.21.15.3:0/1781941575 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fee940a15e0 0x7fee9415e5f0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:23.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.229+0000 7fee99e0c700 1 --2- 172.21.15.3:0/1781941575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee94068630 0x7fee940bd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:23.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.229+0000 7fee99e0c700 1 -- 172.21.15.3:0/1781941575 >> 172.21.15.3:0/1781941575 conn(0x7fee940670e0 msgr2=0x7fee9414bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:23.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.229+0000 7fee99e0c700 1 -- 172.21.15.3:0/1781941575 shutdown_connections 2023-10-08T15:42:23.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.229+0000 7fee99e0c700 1 -- 172.21.15.3:0/1781941575 wait complete. 2023-10-08T15:42:23.255 INFO:tasks.cephfs_test_runner:Basic test for checking drop cache command. ... ok 2023-10-08T15:42:23.255 INFO:tasks.cephfs_test_runner:Starting test: test_cap_revoke_nonresponder (tasks.cephfs.test_misc.TestMisc) Check that a client is evicted if it has not responded to cap revoke 2023-10-08T15:42:23.255 INFO:tasks.cephfs_test_runner:test_cap_revoke_nonresponder (tasks.cephfs.test_misc.TestMisc) 2023-10-08T15:42:23.255 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder' 2023-10-08T15:42:23.367 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.361+0000 7fc39ffff700 1 Processor -- start 2023-10-08T15:42:23.367 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.361+0000 7fc39ffff700 1 -- start start 2023-10-08T15:42:23.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.361+0000 7fc39ffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc3a014ac50 0x7fc3a014b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:23.369 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.361+0000 7fc39ffff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc3a006be60 0x7fc3a006c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:23.369 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.361+0000 7fc39ffff700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3a014c6b0 con 0x7fc3a006ca70 2023-10-08T15:42:23.369 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.361+0000 7fc39ffff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3a014dc50 con 0x7fc3a014ac50 2023-10-08T15:42:23.369 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.361+0000 7fc39ffff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a014c060 con 0x7fc3a006be60 2023-10-08T15:42:23.369 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.361+0000 7fc39f7fe700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fc3a006ca70 0x7fc3a014eb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:53540/0 (socket says 172.21.15.3:53540) 2023-10-08T15:42:23.369 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.361+0000 7fc39f7fe700 1 -- 172.21.15.3:0/984343247 learned_addr learned my addr 172.21.15.3:0/984343247 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:42:23.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.361+0000 7fc39e7fc700 1 --2- 172.21.15.3:0/984343247 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc3a006be60 0x7fc3a006c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:23.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.361+0000 7fc39effd700 1 --2- 172.21.15.3:0/984343247 >> v2:172.21.15.50:3300/0 conn(0x7fc3a014ac50 0x7fc3a014b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:23.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.365+0000 7fc39dffb700 1 -- 172.21.15.3:0/984343247 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3341795125 0 0) 0x7fc3a014c6b0 con 0x7fc3a006ca70 2023-10-08T15:42:23.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.365+0000 7fc39dffb700 1 -- 172.21.15.3:0/984343247 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc38c003570 con 0x7fc3a006ca70 2023-10-08T15:42:23.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.365+0000 7fc39effd700 1 -- 172.21.15.3:0/984343247 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc3a006be60 msgr2=0x7fc3a006c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:23.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.365+0000 7fc39effd700 1 --2- 172.21.15.3:0/984343247 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc3a006be60 0x7fc3a006c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:23.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.365+0000 7fc39effd700 1 -- 172.21.15.3:0/984343247 >> v1:172.21.15.3:6789/0 conn(0x7fc3a006ca70 legacy=0x7fc3a014eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:23.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.365+0000 7fc39dffb700 1 -- 172.21.15.3:0/984343247 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1780585610 0 0) 0x7fc38c003570 con 0x7fc3a006ca70 2023-10-08T15:42:23.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.365+0000 7fc39effd700 1 -- 172.21.15.3:0/984343247 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a014c340 con 0x7fc3a014ac50 2023-10-08T15:42:23.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.365+0000 7fc39effd700 1 --2- 172.21.15.3:0/984343247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3a014ac50 0x7fc3a014b020 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc3900098e0 tx=0x7fc3900091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51563616a09a3e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:23.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.365+0000 7fc39dffb700 1 -- 172.21.15.3:0/984343247 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3980017f0 con 0x7fc3a014ac50 2023-10-08T15:42:23.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.365+0000 7fc39dffb700 1 -- 172.21.15.3:0/984343247 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc390011420 con 0x7fc3a014ac50 2023-10-08T15:42:23.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.365+0000 7fc39dffb700 1 -- 172.21.15.3:0/984343247 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3900117c0 con 0x7fc3a014ac50 2023-10-08T15:42:23.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.365+0000 7fc39ffff700 1 -- 172.21.15.3:0/984343247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3a014ac50 msgr2=0x7fc3a014b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:23.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.365+0000 7fc39ffff700 1 --2- 172.21.15.3:0/984343247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3a014ac50 0x7fc3a014b020 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc3900098e0 tx=0x7fc3900091a0 comp rx=0 tx=0).stop 2023-10-08T15:42:23.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.365+0000 7fc39ffff700 1 -- 172.21.15.3:0/984343247 shutdown_connections 2023-10-08T15:42:23.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.365+0000 7fc39ffff700 1 --2- 172.21.15.3:0/984343247 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc3a006be60 0x7fc3a006c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:23.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.365+0000 7fc39ffff700 1 --2- 172.21.15.3:0/984343247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3a014ac50 0x7fc3a014b020 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:23.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.365+0000 7fc39ffff700 1 -- 172.21.15.3:0/984343247 >> 172.21.15.3:0/984343247 conn(0x7fc3a00c1df0 msgr2=0x7fc3a00c21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:23.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.365+0000 7fc39ffff700 1 -- 172.21.15.3:0/984343247 shutdown_connections 2023-10-08T15:42:23.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.365+0000 7fc39ffff700 1 -- 172.21.15.3:0/984343247 wait complete. 2023-10-08T15:42:23.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.369+0000 7fc39ffff700 1 Processor -- start 2023-10-08T15:42:23.375 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.369+0000 7fc39ffff700 1 -- start start 2023-10-08T15:42:23.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.369+0000 7fc39ffff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc3a006be60 0x7fc3a015e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:23.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.369+0000 7fc39ffff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3a006ca70 0x7fc3a0145e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:23.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.369+0000 7fc39ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3a014ac50 0x7fc3a0146370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:23.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.369+0000 7fc39ffff700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a00bf730 con 0x7fc3a006ca70 2023-10-08T15:42:23.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.369+0000 7fc39ffff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a015f160 con 0x7fc3a014ac50 2023-10-08T15:42:23.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.369+0000 7fc39ffff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a009f7c0 con 0x7fc3a006be60 2023-10-08T15:42:23.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.369+0000 7fc39e7fc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3a006ca70 0x7fc3a0145e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:23.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.369+0000 7fc39e7fc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3a006ca70 0x7fc3a0145e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53660/0 (socket says 172.21.15.3:53660) 2023-10-08T15:42:23.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.369+0000 7fc39f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3a014ac50 0x7fc3a0146370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:23.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.369+0000 7fc39e7fc700 1 -- 172.21.15.3:0/2122318645 learned_addr learned my addr 172.21.15.3:0/2122318645 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:23.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.369+0000 7fc39effd700 1 --2- 172.21.15.3:0/2122318645 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc3a006be60 0x7fc3a015e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:23.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.369+0000 7fc39e7fc700 1 -- 172.21.15.3:0/2122318645 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc3a006be60 msgr2=0x7fc3a015e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:23.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.369+0000 7fc39e7fc700 1 --2- 172.21.15.3:0/2122318645 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc3a006be60 0x7fc3a015e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:23.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.369+0000 7fc39e7fc700 1 -- 172.21.15.3:0/2122318645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3a014ac50 msgr2=0x7fc3a0146370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:23.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.369+0000 7fc39e7fc700 1 --2- 172.21.15.3:0/2122318645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3a014ac50 0x7fc3a0146370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:23.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.369+0000 7fc39e7fc700 1 -- 172.21.15.3:0/2122318645 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc390009420 con 0x7fc3a006ca70 2023-10-08T15:42:23.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.369+0000 7fc39e7fc700 1 --2- 172.21.15.3:0/2122318645 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3a006ca70 0x7fc3a0145e30 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fc38800ec80 tx=0x7fc3880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:23.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.373+0000 7fc396ffd700 1 -- 172.21.15.3:0/2122318645 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc388009690 con 0x7fc3a006ca70 2023-10-08T15:42:23.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.373+0000 7fc396ffd700 1 -- 172.21.15.3:0/2122318645 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc38800c850 con 0x7fc3a006ca70 2023-10-08T15:42:23.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.373+0000 7fc39ffff700 1 -- 172.21.15.3:0/2122318645 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3a009bfe0 con 0x7fc3a006ca70 2023-10-08T15:42:23.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.373+0000 7fc396ffd700 1 -- 172.21.15.3:0/2122318645 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38800cc10 con 0x7fc3a006ca70 2023-10-08T15:42:23.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.373+0000 7fc39ffff700 1 -- 172.21.15.3:0/2122318645 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3a009df20 con 0x7fc3a006ca70 2023-10-08T15:42:23.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.373+0000 7fc39ffff700 1 -- 172.21.15.3:0/2122318645 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3a005ecf0 con 0x7fc3a006ca70 2023-10-08T15:42:23.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.373+0000 7fc396ffd700 1 -- 172.21.15.3:0/2122318645 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc388013470 con 0x7fc3a006ca70 2023-10-08T15:42:23.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.373+0000 7fc396ffd700 1 --2- 172.21.15.3:0/2122318645 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc380060550 0x7fc380062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:23.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.377+0000 7fc396ffd700 1 -- 172.21.15.3:0/2122318645 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fc38807c700 con 0x7fc3a006ca70 2023-10-08T15:42:23.382 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.377+0000 7fc39effd700 1 --2- 172.21.15.3:0/2122318645 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc380060550 0x7fc380062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:23.382 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.377+0000 7fc39effd700 1 --2- 172.21.15.3:0/2122318645 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc380060550 0x7fc380062a00 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc3900093f0 tx=0x7fc390016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:23.391 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.385+0000 7fc396ffd700 1 -- 172.21.15.3:0/2122318645 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc38804cf50 con 0x7fc3a006ca70 2023-10-08T15:42:23.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:23.605+0000 7fc39ffff700 1 -- 172.21.15.3:0/2122318645 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder"]} v 0) v1 -- 0x7fc3a014c580 con 0x7fc3a006ca70 2023-10-08T15:42:24.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.229+0000 7fc396ffd700 1 -- 172.21.15.3:0/2122318645 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder"]}]=0 v228) v1 ==== 142+0+0 (secure 0 0 0) 0x7fc388050570 con 0x7fc3a006ca70 2023-10-08T15:42:24.239 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.233+0000 7fc39ffff700 1 -- 172.21.15.3:0/2122318645 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc380060550 msgr2=0x7fc380062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:24.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.233+0000 7fc39ffff700 1 --2- 172.21.15.3:0/2122318645 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc380060550 0x7fc380062a00 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc3900093f0 tx=0x7fc390016000 comp rx=0 tx=0).stop 2023-10-08T15:42:24.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.233+0000 7fc39ffff700 1 -- 172.21.15.3:0/2122318645 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3a006ca70 msgr2=0x7fc3a0145e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:24.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.233+0000 7fc39ffff700 1 --2- 172.21.15.3:0/2122318645 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3a006ca70 0x7fc3a0145e30 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fc38800ec80 tx=0x7fc3880091a0 comp rx=0 tx=0).stop 2023-10-08T15:42:24.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.233+0000 7fc39ffff700 1 -- 172.21.15.3:0/2122318645 shutdown_connections 2023-10-08T15:42:24.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.233+0000 7fc39ffff700 1 --2- 172.21.15.3:0/2122318645 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc380060550 0x7fc380062a00 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:24.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.233+0000 7fc39ffff700 1 --2- 172.21.15.3:0/2122318645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3a014ac50 0x7fc3a0146370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:24.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.233+0000 7fc39ffff700 1 --2- 172.21.15.3:0/2122318645 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3a006ca70 0x7fc3a0145e30 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:24.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.233+0000 7fc39ffff700 1 --2- 172.21.15.3:0/2122318645 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc3a006be60 0x7fc3a015e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:24.240 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.233+0000 7fc39ffff700 1 -- 172.21.15.3:0/2122318645 >> 172.21.15.3:0/2122318645 conn(0x7fc3a00c1df0 msgr2=0x7fc3a01496f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:24.241 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.233+0000 7fc39ffff700 1 -- 172.21.15.3:0/2122318645 shutdown_connections 2023-10-08T15:42:24.241 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.233+0000 7fc39ffff700 1 -- 172.21.15.3:0/2122318645 wait complete. 2023-10-08T15:42:24.256 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-08T15:42:24.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.365+0000 7fbdc1939700 1 Processor -- start 2023-10-08T15:42:24.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.365+0000 7fbdc1939700 1 -- start start 2023-10-08T15:42:24.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.369+0000 7fbdc1939700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbdbc153f60 0x7fbdbc156340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:24.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.369+0000 7fbdc1939700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdbc14c0e0 con 0x7fbdbc06c830 2023-10-08T15:42:24.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.369+0000 7fbdc1939700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdbc14c570 con 0x7fbdbc0bf3a0 2023-10-08T15:42:24.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.369+0000 7fbdc1939700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdbc14b8b0 con 0x7fbdbc153f60 2023-10-08T15:42:24.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.369+0000 7fbdba7fc700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fbdbc06c830 0x7fbdbc06d660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:53542/0 (socket says 172.21.15.3:53542) 2023-10-08T15:42:24.375 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.369+0000 7fbdba7fc700 1 -- 172.21.15.3:0/3287330484 learned_addr learned my addr 172.21.15.3:0/3287330484 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:42:24.375 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.369+0000 7fbdbb7fe700 1 --2- 172.21.15.3:0/3287330484 >> v2:172.21.15.50:3300/0 conn(0x7fbdbc153f60 0x7fbdbc156340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:24.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.369+0000 7fbdb9ffb700 1 -- 172.21.15.3:0/3287330484 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1814492559 0 0) 0x7fbdbc14c0e0 con 0x7fbdbc06c830 2023-10-08T15:42:24.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.369+0000 7fbdb9ffb700 1 -- 172.21.15.3:0/3287330484 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbda4003570 con 0x7fbdbc06c830 2023-10-08T15:42:24.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.369+0000 7fbdbb7fe700 1 -- 172.21.15.3:0/3287330484 >> v1:172.21.15.50:6789/0 conn(0x7fbdbc0bf3a0 legacy=0x7fbdbc06cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:24.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.369+0000 7fbdbb7fe700 1 -- 172.21.15.3:0/3287330484 >> v1:172.21.15.3:6789/0 conn(0x7fbdbc06c830 legacy=0x7fbdbc06d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:24.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.369+0000 7fbdbb7fe700 1 -- 172.21.15.3:0/3287330484 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdbc14ba90 con 0x7fbdbc153f60 2023-10-08T15:42:24.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.369+0000 7fbdbb7fe700 1 --2- 172.21.15.3:0/3287330484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbdbc153f60 0x7fbdbc156340 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fbdb40098e0 tx=0x7fbdb40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ddd46e1153be3997 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:24.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.369+0000 7fbdb9ffb700 1 -- 172.21.15.3:0/3287330484 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb400b640 con 0x7fbdbc153f60 2023-10-08T15:42:24.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.369+0000 7fbdb9ffb700 1 -- 172.21.15.3:0/3287330484 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb400b7a0 con 0x7fbdbc153f60 2023-10-08T15:42:24.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.369+0000 7fbdb9ffb700 1 -- 172.21.15.3:0/3287330484 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb400bb40 con 0x7fbdbc153f60 2023-10-08T15:42:24.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.369+0000 7fbdc1939700 1 -- 172.21.15.3:0/3287330484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbdbc153f60 msgr2=0x7fbdbc156340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:24.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.369+0000 7fbdc1939700 1 --2- 172.21.15.3:0/3287330484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbdbc153f60 0x7fbdbc156340 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fbdb40098e0 tx=0x7fbdb40091a0 comp rx=0 tx=0).stop 2023-10-08T15:42:24.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.369+0000 7fbdc1939700 1 -- 172.21.15.3:0/3287330484 shutdown_connections 2023-10-08T15:42:24.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.369+0000 7fbdc1939700 1 --2- 172.21.15.3:0/3287330484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbdbc153f60 0x7fbdbc156340 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:24.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.369+0000 7fbdc1939700 1 -- 172.21.15.3:0/3287330484 >> 172.21.15.3:0/3287330484 conn(0x7fbdbc0c2a40 msgr2=0x7fbdbc0bea60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:24.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.369+0000 7fbdc1939700 1 -- 172.21.15.3:0/3287330484 shutdown_connections 2023-10-08T15:42:24.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.369+0000 7fbdc1939700 1 -- 172.21.15.3:0/3287330484 wait complete. 2023-10-08T15:42:24.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.373+0000 7fbdc1939700 1 Processor -- start 2023-10-08T15:42:24.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.373+0000 7fbdc1939700 1 -- start start 2023-10-08T15:42:24.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.373+0000 7fbdc1939700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbdbc06c830 0x7fbdbc15f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:24.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.373+0000 7fbdc1939700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbdbc0bf3a0 0x7fbdbc140210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:24.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.373+0000 7fbdc1939700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbdbc153f60 0x7fbdbc141470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:24.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.373+0000 7fbdc1939700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdbc144d30 con 0x7fbdbc06c830 2023-10-08T15:42:24.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.373+0000 7fbdc1939700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdbc143050 con 0x7fbdbc153f60 2023-10-08T15:42:24.382 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.373+0000 7fbdc1939700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdbc15f5a0 con 0x7fbdbc0bf3a0 2023-10-08T15:42:24.382 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.373+0000 7fbdbaffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbdbc06c830 0x7fbdbc15f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:24.382 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.373+0000 7fbdbaffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbdbc06c830 0x7fbdbc15f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53676/0 (socket says 172.21.15.3:53676) 2023-10-08T15:42:24.382 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.373+0000 7fbdbaffd700 1 -- 172.21.15.3:0/2556138380 learned_addr learned my addr 172.21.15.3:0/2556138380 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:24.382 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.373+0000 7fbdbb7fe700 1 --2- 172.21.15.3:0/2556138380 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbdbc153f60 0x7fbdbc141470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:24.382 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.373+0000 7fbdba7fc700 1 --2- 172.21.15.3:0/2556138380 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbdbc0bf3a0 0x7fbdbc140210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:24.382 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.373+0000 7fbdbaffd700 1 -- 172.21.15.3:0/2556138380 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbdbc0bf3a0 msgr2=0x7fbdbc140210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:24.382 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.373+0000 7fbdbaffd700 1 --2- 172.21.15.3:0/2556138380 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbdbc0bf3a0 0x7fbdbc140210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:24.383 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.373+0000 7fbdbaffd700 1 -- 172.21.15.3:0/2556138380 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbdbc153f60 msgr2=0x7fbdbc141470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:24.383 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.373+0000 7fbdbaffd700 1 --2- 172.21.15.3:0/2556138380 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbdbc153f60 0x7fbdbc141470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:24.383 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.373+0000 7fbdbaffd700 1 -- 172.21.15.3:0/2556138380 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb4009420 con 0x7fbdbc06c830 2023-10-08T15:42:24.383 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.373+0000 7fbdbb7fe700 1 --2- 172.21.15.3:0/2556138380 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbdbc153f60 0x7fbdbc141470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:42:24.383 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.373+0000 7fbdba7fc700 1 --2- 172.21.15.3:0/2556138380 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbdbc0bf3a0 0x7fbdbc140210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:42:24.383 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.373+0000 7fbdbaffd700 1 --2- 172.21.15.3:0/2556138380 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbdbc06c830 0x7fbdbc15f060 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fbdb000c5c0 tx=0x7fbdb000c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:24.383 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.373+0000 7fbda2ffd700 1 -- 172.21.15.3:0/2556138380 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb0011590 con 0x7fbdbc06c830 2023-10-08T15:42:24.383 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.373+0000 7fbda2ffd700 1 -- 172.21.15.3:0/2556138380 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb0011710 con 0x7fbdbc06c830 2023-10-08T15:42:24.383 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.373+0000 7fbdc1939700 1 -- 172.21.15.3:0/2556138380 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdbc140750 con 0x7fbdbc06c830 2023-10-08T15:42:24.384 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.373+0000 7fbda2ffd700 1 -- 172.21.15.3:0/2556138380 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb0011ad0 con 0x7fbdbc06c830 2023-10-08T15:42:24.384 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.373+0000 7fbdc1939700 1 -- 172.21.15.3:0/2556138380 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdbc142ce0 con 0x7fbdbc06c830 2023-10-08T15:42:24.384 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.377+0000 7fbdc1939700 1 -- 172.21.15.3:0/2556138380 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdbc064530 con 0x7fbdbc06c830 2023-10-08T15:42:24.384 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.377+0000 7fbda2ffd700 1 -- 172.21.15.3:0/2556138380 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fbdb001b3b0 con 0x7fbdbc06c830 2023-10-08T15:42:24.385 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.377+0000 7fbda2ffd700 1 --2- 172.21.15.3:0/2556138380 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbda8060550 0x7fbda8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:24.385 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.377+0000 7fbda2ffd700 1 -- 172.21.15.3:0/2556138380 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fbdb007ba50 con 0x7fbdbc06c830 2023-10-08T15:42:24.385 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.377+0000 7fbdba7fc700 1 --2- 172.21.15.3:0/2556138380 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbda8060550 0x7fbda8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:24.385 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.381+0000 7fbdba7fc700 1 --2- 172.21.15.3:0/2556138380 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbda8060550 0x7fbda8062a00 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc14cc50 tx=0x7fbdac009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:24.392 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.385+0000 7fbda2ffd700 1 -- 172.21.15.3:0/2556138380 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbdb004c340 con 0x7fbdbc06c830 2023-10-08T15:42:24.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.549+0000 7fbdc1939700 1 -- 172.21.15.3:0/2556138380 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fbdbc04b600 con 0x7fbdbc06c830 2023-10-08T15:42:24.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.557+0000 7fbda2ffd700 1 -- 172.21.15.3:0/2556138380 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7fbdb0017020 con 0x7fbdbc06c830 2023-10-08T15:42:24.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.561+0000 7fbdc1939700 1 -- 172.21.15.3:0/2556138380 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbda8060550 msgr2=0x7fbda8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:24.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.561+0000 7fbdc1939700 1 --2- 172.21.15.3:0/2556138380 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbda8060550 0x7fbda8062a00 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc14cc50 tx=0x7fbdac009040 comp rx=0 tx=0).stop 2023-10-08T15:42:24.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.561+0000 7fbdc1939700 1 -- 172.21.15.3:0/2556138380 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbdbc06c830 msgr2=0x7fbdbc15f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:24.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.561+0000 7fbdc1939700 1 --2- 172.21.15.3:0/2556138380 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbdbc06c830 0x7fbdbc15f060 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fbdb000c5c0 tx=0x7fbdb000c980 comp rx=0 tx=0).stop 2023-10-08T15:42:24.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.561+0000 7fbdc1939700 1 -- 172.21.15.3:0/2556138380 shutdown_connections 2023-10-08T15:42:24.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.561+0000 7fbdc1939700 1 --2- 172.21.15.3:0/2556138380 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbda8060550 0x7fbda8062a00 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:24.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.561+0000 7fbdc1939700 1 --2- 172.21.15.3:0/2556138380 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbdbc153f60 0x7fbdbc141470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:24.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.561+0000 7fbdc1939700 1 --2- 172.21.15.3:0/2556138380 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbdbc0bf3a0 0x7fbdbc140210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:24.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.561+0000 7fbdc1939700 1 --2- 172.21.15.3:0/2556138380 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbdbc06c830 0x7fbdbc15f060 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:24.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.561+0000 7fbdc1939700 1 -- 172.21.15.3:0/2556138380 >> 172.21.15.3:0/2556138380 conn(0x7fbdbc0c2a40 msgr2=0x7fbdbc0670e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:24.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.565+0000 7fbdc1939700 1 -- 172.21.15.3:0/2556138380 shutdown_connections 2023-10-08T15:42:24.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.565+0000 7fbdc1939700 1 -- 172.21.15.3:0/2556138380 wait complete. 2023-10-08T15:42:24.584 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T15:42:24.584 DEBUG:teuthology.orchestra.run.smithi003:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T15:42:24.604 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T15:42:24.626 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T15:42:24.647 DEBUG:teuthology.orchestra.run.smithi098:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T15:42:24.667 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T15:42:24.688 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T15:42:24.688 INFO:tasks.cephfs.cephfs_test_case:[, , ] 2023-10-08T15:42:24.689 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:42:24.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.793+0000 7f333f59e700 1 Processor -- start 2023-10-08T15:42:24.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.793+0000 7f333f59e700 1 -- start start 2023-10-08T15:42:24.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.797+0000 7f333f59e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f334009ef40 0x7f33400c0590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:24.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.797+0000 7f333f59e700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f33400ba440 0x7f334014eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:24.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.797+0000 7f333f59e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3340153a70 con 0x7f3340067310 2023-10-08T15:42:24.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.797+0000 7f333f59e700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f334009f460 con 0x7f33400ba440 2023-10-08T15:42:24.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.797+0000 7f333f59e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3340153de0 con 0x7f334009ef40 2023-10-08T15:42:24.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.797+0000 7f333ed9d700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f33400ba440 0x7f334014eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:24.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.797+0000 7f333ed9d700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f33400ba440 0x7f334014eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53678/0 (socket says 172.21.15.3:53678) 2023-10-08T15:42:24.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.797+0000 7f333ed9d700 1 -- 172.21.15.3:0/705214083 learned_addr learned my addr 172.21.15.3:0/705214083 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:24.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.797+0000 7f333dd9b700 1 --2- 172.21.15.3:0/705214083 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f334009ef40 0x7f33400c0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:24.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.797+0000 7f333ed9d700 1 -- 172.21.15.3:0/705214083 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f334009ef40 msgr2=0x7f33400c0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:24.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.797+0000 7f333ed9d700 1 --2- 172.21.15.3:0/705214083 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f334009ef40 0x7f33400c0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:24.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.797+0000 7f333ed9d700 1 -- 172.21.15.3:0/705214083 >> v1:172.21.15.50:6789/0 conn(0x7f3340067310 legacy=0x7f33400bfe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:24.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.797+0000 7f333ed9d700 1 -- 172.21.15.3:0/705214083 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33400bc410 con 0x7f33400ba440 2023-10-08T15:42:24.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.797+0000 7f333ed9d700 1 --2- 172.21.15.3:0/705214083 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f33400ba440 0x7f334014eaa0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f3338009f20 tx=0x7f3338009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0f3712c594b9120 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:24.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.797+0000 7f333d59a700 1 -- 172.21.15.3:0/705214083 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333800e070 con 0x7f33400ba440 2023-10-08T15:42:24.806 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.797+0000 7f333d59a700 1 -- 172.21.15.3:0/705214083 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f333800b9d0 con 0x7f33400ba440 2023-10-08T15:42:24.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.797+0000 7f333d59a700 1 -- 172.21.15.3:0/705214083 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33380092e0 con 0x7f33400ba440 2023-10-08T15:42:24.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.797+0000 7f333f59e700 1 -- 172.21.15.3:0/705214083 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f33400ba440 msgr2=0x7f334014eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:24.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.797+0000 7f333f59e700 1 --2- 172.21.15.3:0/705214083 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f33400ba440 0x7f334014eaa0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f3338009f20 tx=0x7f3338009840 comp rx=0 tx=0).stop 2023-10-08T15:42:24.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.797+0000 7f333f59e700 1 -- 172.21.15.3:0/705214083 shutdown_connections 2023-10-08T15:42:24.807 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.797+0000 7f333f59e700 1 --2- 172.21.15.3:0/705214083 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f33400ba440 0x7f334014eaa0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:24.808 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.797+0000 7f333f59e700 1 --2- 172.21.15.3:0/705214083 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f334009ef40 0x7f33400c0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:24.808 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.797+0000 7f333f59e700 1 -- 172.21.15.3:0/705214083 >> 172.21.15.3:0/705214083 conn(0x7f334006dfb0 msgr2=0x7f334006e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:24.808 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.797+0000 7f333f59e700 1 -- 172.21.15.3:0/705214083 shutdown_connections 2023-10-08T15:42:24.808 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.797+0000 7f333f59e700 1 -- 172.21.15.3:0/705214083 wait complete. 2023-10-08T15:42:24.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.801+0000 7f333f59e700 1 Processor -- start 2023-10-08T15:42:24.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.801+0000 7f333f59e700 1 -- start start 2023-10-08T15:42:24.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.801+0000 7f333f59e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3340067310 0x7f33400a0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:24.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.801+0000 7f333f59e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f334009ef40 0x7f3340162910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:24.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.801+0000 7f333f59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33400ba440 0x7f3340162e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:24.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.801+0000 7f333f59e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33400a1dd0 con 0x7f3340067310 2023-10-08T15:42:24.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.801+0000 7f333f59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33400a0b70 con 0x7f33400ba440 2023-10-08T15:42:24.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.801+0000 7f333f59e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33400a1780 con 0x7f334009ef40 2023-10-08T15:42:24.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.801+0000 7f333e59c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3340067310 0x7f33400a0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:24.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.801+0000 7f333e59c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3340067310 0x7f33400a0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53692/0 (socket says 172.21.15.3:53692) 2023-10-08T15:42:24.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.801+0000 7f333e59c700 1 -- 172.21.15.3:0/2340824528 learned_addr learned my addr 172.21.15.3:0/2340824528 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:24.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.801+0000 7f333dd9b700 1 --2- 172.21.15.3:0/2340824528 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f334009ef40 0x7f3340162910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:24.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.801+0000 7f333ed9d700 1 --2- 172.21.15.3:0/2340824528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33400ba440 0x7f3340162e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:24.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.805+0000 7f333e59c700 1 -- 172.21.15.3:0/2340824528 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f334009ef40 msgr2=0x7f3340162910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:24.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.805+0000 7f333e59c700 1 --2- 172.21.15.3:0/2340824528 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f334009ef40 0x7f3340162910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:24.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.805+0000 7f333e59c700 1 -- 172.21.15.3:0/2340824528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33400ba440 msgr2=0x7f3340162e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:24.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.805+0000 7f333e59c700 1 --2- 172.21.15.3:0/2340824528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33400ba440 0x7f3340162e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:24.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.805+0000 7f333e59c700 1 -- 172.21.15.3:0/2340824528 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3338009ae0 con 0x7f3340067310 2023-10-08T15:42:24.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.805+0000 7f333e59c700 1 --2- 172.21.15.3:0/2340824528 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3340067310 0x7f33400a0630 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f333400c590 tx=0x7f3334007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:24.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.805+0000 7f332e7fc700 1 -- 172.21.15.3:0/2340824528 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3334011590 con 0x7f3340067310 2023-10-08T15:42:24.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.805+0000 7f332e7fc700 1 -- 172.21.15.3:0/2340824528 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3334011730 con 0x7f3340067310 2023-10-08T15:42:24.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.805+0000 7f333f59e700 1 -- 172.21.15.3:0/2340824528 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33400a1a60 con 0x7f3340067310 2023-10-08T15:42:24.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.805+0000 7f332e7fc700 1 -- 172.21.15.3:0/2340824528 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3334011af0 con 0x7f3340067310 2023-10-08T15:42:24.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.805+0000 7f333f59e700 1 -- 172.21.15.3:0/2340824528 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33400a12f0 con 0x7f3340067310 2023-10-08T15:42:24.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.805+0000 7f333f59e700 1 -- 172.21.15.3:0/2340824528 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f334005ecf0 con 0x7f3340067310 2023-10-08T15:42:24.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.805+0000 7f332e7fc700 1 -- 172.21.15.3:0/2340824528 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f3334012420 con 0x7f3340067310 2023-10-08T15:42:24.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.805+0000 7f332e7fc700 1 --2- 172.21.15.3:0/2340824528 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3320060550 0x7f3320062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:24.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.809+0000 7f332e7fc700 1 -- 172.21.15.3:0/2340824528 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f333407b7d0 con 0x7f3340067310 2023-10-08T15:42:24.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.809+0000 7f333dd9b700 1 --2- 172.21.15.3:0/2340824528 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3320060550 0x7f3320062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:24.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.809+0000 7f333dd9b700 1 --2- 172.21.15.3:0/2340824528 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3320060550 0x7f3320062a00 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3340069d40 tx=0x7f33300091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:24.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:24.817+0000 7f332e7fc700 1 -- 172.21.15.3:0/2340824528 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f333404c0d0 con 0x7f3340067310 2023-10-08T15:42:25.020 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.013+0000 7f333f59e700 1 -- 172.21.15.3:0/2340824528 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f33400a1540 con 0x7f3340067310 2023-10-08T15:42:25.021 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.013+0000 7f332e7fc700 1 -- 172.21.15.3:0/2340824528 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+2012 (secure 0 0 0) 0x7f3334017090 con 0x7f3340067310 2023-10-08T15:42:25.021 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:42:25.021 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":35,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5480,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1007706158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1007706158},{"type":"v1","addr":"172.21.15.50:6835","nonce":1007706158}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":6288,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6833/2485354898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":2485354898},{"type":"v1","addr":"172.21.15.3:6833","nonce":2485354898}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[]} 2023-10-08T15:42:25.023 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.017+0000 7f333f59e700 1 -- 172.21.15.3:0/2340824528 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3320060550 msgr2=0x7f3320062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:25.023 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.017+0000 7f333f59e700 1 --2- 172.21.15.3:0/2340824528 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3320060550 0x7f3320062a00 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3340069d40 tx=0x7f33300091a0 comp rx=0 tx=0).stop 2023-10-08T15:42:25.023 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.017+0000 7f333f59e700 1 -- 172.21.15.3:0/2340824528 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3340067310 msgr2=0x7f33400a0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:25.023 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.017+0000 7f333f59e700 1 --2- 172.21.15.3:0/2340824528 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3340067310 0x7f33400a0630 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f333400c590 tx=0x7f3334007f30 comp rx=0 tx=0).stop 2023-10-08T15:42:25.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.017+0000 7f333f59e700 1 -- 172.21.15.3:0/2340824528 shutdown_connections 2023-10-08T15:42:25.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.017+0000 7f333f59e700 1 --2- 172.21.15.3:0/2340824528 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3320060550 0x7f3320062a00 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:25.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.017+0000 7f333f59e700 1 --2- 172.21.15.3:0/2340824528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33400ba440 0x7f3340162e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:25.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.017+0000 7f333f59e700 1 --2- 172.21.15.3:0/2340824528 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f334009ef40 0x7f3340162910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:25.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.017+0000 7f333f59e700 1 --2- 172.21.15.3:0/2340824528 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3340067310 0x7f33400a0630 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:25.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.017+0000 7f333f59e700 1 -- 172.21.15.3:0/2340824528 >> 172.21.15.3:0/2340824528 conn(0x7f334006dfb0 msgr2=0x7f33400692c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:25.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.017+0000 7f333f59e700 1 -- 172.21.15.3:0/2340824528 shutdown_connections 2023-10-08T15:42:25.024 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.017+0000 7f333f59e700 1 -- 172.21.15.3:0/2340824528 wait complete. 2023-10-08T15:42:25.025 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 35 2023-10-08T15:42:25.035 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-08T15:42:25.036 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-08T15:42:25.036 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-08T15:42:25.036 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T15:42:25.036 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-08T15:42:25.036 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-08T15:42:25.036 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-08T15:42:25.037 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T15:42:25.046 INFO:tasks.ceph.mds.a:Stopped 2023-10-08T15:42:25.046 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-08T15:42:25.048 INFO:tasks.ceph.mds.a:Started 2023-10-08T15:42:25.048 DEBUG:teuthology.parallel:result is None 2023-10-08T15:42:25.051 INFO:tasks.ceph.mds.b:Stopped 2023-10-08T15:42:25.051 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-08T15:42:25.054 INFO:tasks.ceph.mds.b:Started 2023-10-08T15:42:25.054 DEBUG:teuthology.parallel:result is None 2023-10-08T15:42:25.054 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-08T15:42:25.127 INFO:tasks.ceph.mds.a.smithi003.stdout:starting mds.a at 2023-10-08T15:42:25.130 INFO:tasks.ceph.mds.b.smithi050.stdout:starting mds.b at 2023-10-08T15:42:25.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.141+0000 7f3d426c9700 1 Processor -- start 2023-10-08T15:42:25.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.141+0000 7f3d426c9700 1 -- start start 2023-10-08T15:42:25.150 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.141+0000 7f3d426c9700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3d3c067310 0x7f3d3c149ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:25.150 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.141+0000 7f3d426c9700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f3d3c0bcca0 0x7f3d3c1463b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:25.150 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.141+0000 7f3d426c9700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3d3c1468f0 0x7f3d3c14ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:25.150 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.141+0000 7f3d426c9700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d3c0a26a0 con 0x7f3d3c0bcca0 2023-10-08T15:42:25.150 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.141+0000 7f3d426c9700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d3c14a4b0 con 0x7f3d3c1468f0 2023-10-08T15:42:25.150 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.141+0000 7f3d426c9700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3c0a2210 con 0x7f3d3c067310 2023-10-08T15:42:25.150 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.141+0000 7f3d3b7fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f3d3c0bcca0 0x7f3d3c1463b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:25.150 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.145+0000 7f3d3b7fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f3d3c0bcca0 0x7f3d3c1463b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53718/0 (socket says 172.21.15.3:53718) 2023-10-08T15:42:25.150 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.145+0000 7f3d3b7fe700 1 -- 172.21.15.3:0/659051666 learned_addr learned my addr 172.21.15.3:0/659051666 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:25.151 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.145+0000 7f3d3bfff700 1 --2- 172.21.15.3:0/659051666 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3d3c067310 0x7f3d3c149ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:25.151 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.145+0000 7f3d40c66700 1 --2- 172.21.15.3:0/659051666 >> v2:172.21.15.50:3300/0 conn(0x7f3d3c1468f0 0x7f3d3c14ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:25.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.145+0000 7f3d3bfff700 1 -- 172.21.15.3:0/659051666 >> v2:172.21.15.50:3300/0 conn(0x7f3d3c1468f0 msgr2=0x7f3d3c14ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:25.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.145+0000 7f3d3bfff700 1 --2- 172.21.15.3:0/659051666 >> v2:172.21.15.50:3300/0 conn(0x7f3d3c1468f0 0x7f3d3c14ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:25.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.145+0000 7f3d3bfff700 1 -- 172.21.15.3:0/659051666 >> v2:172.21.15.3:3300/0 conn(0x7f3d3c0bcca0 msgr2=0x7f3d3c1463b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:25.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.145+0000 7f3d3bfff700 1 --2- 172.21.15.3:0/659051666 >> v2:172.21.15.3:3300/0 conn(0x7f3d3c0bcca0 0x7f3d3c1463b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:25.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.145+0000 7f3d3bfff700 1 -- 172.21.15.3:0/659051666 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d3c0a1ee0 con 0x7f3d3c067310 2023-10-08T15:42:25.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.145+0000 7f3d40c66700 1 --2- 172.21.15.3:0/659051666 >> v2:172.21.15.50:3300/0 conn(0x7f3d3c1468f0 0x7f3d3c14ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:42:25.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.145+0000 7f3d3b7fe700 1 --2- 172.21.15.3:0/659051666 >> v2:172.21.15.3:3300/0 conn(0x7f3d3c0bcca0 0x7f3d3c1463b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:42:25.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.145+0000 7f3d3bfff700 1 --2- 172.21.15.3:0/659051666 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3d3c067310 0x7f3d3c149ea0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c0bc9b0 tx=0x7f3d34009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d57954c5cb773eb2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:25.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.145+0000 7f3d3affd700 1 -- 172.21.15.3:0/659051666 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3400e070 con 0x7f3d3c067310 2023-10-08T15:42:25.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.145+0000 7f3d3affd700 1 -- 172.21.15.3:0/659051666 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d3400ba70 con 0x7f3d3c067310 2023-10-08T15:42:25.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.145+0000 7f3d3affd700 1 -- 172.21.15.3:0/659051666 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3400be30 con 0x7f3d3c067310 2023-10-08T15:42:25.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.145+0000 7f3d426c9700 1 -- 172.21.15.3:0/659051666 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3d3c067310 msgr2=0x7f3d3c149ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:25.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.145+0000 7f3d426c9700 1 --2- 172.21.15.3:0/659051666 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3d3c067310 0x7f3d3c149ea0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c0bc9b0 tx=0x7f3d34009780 comp rx=0 tx=0).stop 2023-10-08T15:42:25.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.145+0000 7f3d426c9700 1 -- 172.21.15.3:0/659051666 shutdown_connections 2023-10-08T15:42:25.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.145+0000 7f3d426c9700 1 --2- 172.21.15.3:0/659051666 >> v2:172.21.15.50:3300/0 conn(0x7f3d3c1468f0 0x7f3d3c14ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:25.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.145+0000 7f3d426c9700 1 --2- 172.21.15.3:0/659051666 >> v2:172.21.15.3:3300/0 conn(0x7f3d3c0bcca0 0x7f3d3c1463b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:25.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.145+0000 7f3d426c9700 1 --2- 172.21.15.3:0/659051666 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3d3c067310 0x7f3d3c149ea0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:25.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.145+0000 7f3d426c9700 1 -- 172.21.15.3:0/659051666 >> 172.21.15.3:0/659051666 conn(0x7f3d3c06b9b0 msgr2=0x7f3d3c0681f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:25.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.145+0000 7f3d426c9700 1 -- 172.21.15.3:0/659051666 shutdown_connections 2023-10-08T15:42:25.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.145+0000 7f3d426c9700 1 -- 172.21.15.3:0/659051666 wait complete. 2023-10-08T15:42:25.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.149+0000 7f3d426c9700 1 Processor -- start 2023-10-08T15:42:25.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.149+0000 7f3d426c9700 1 -- start start 2023-10-08T15:42:25.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.149+0000 7f3d426c9700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3d3c067310 0x7f3d3c06d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:25.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.149+0000 7f3d426c9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d3c0bcca0 0x7f3d3c15b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:25.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.149+0000 7f3d426c9700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3d3c1468f0 0x7f3d3c15bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:25.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.149+0000 7f3d426c9700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3c0b9a60 con 0x7f3d3c1468f0 2023-10-08T15:42:25.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.149+0000 7f3d426c9700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3c06de70 con 0x7f3d3c0bcca0 2023-10-08T15:42:25.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.149+0000 7f3d426c9700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3c0b3610 con 0x7f3d3c067310 2023-10-08T15:42:25.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.149+0000 7f3d40c66700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3d3c1468f0 0x7f3d3c15bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:25.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.149+0000 7f3d3bfff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3d3c067310 0x7f3d3c06d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:25.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.149+0000 7f3d40c66700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3d3c1468f0 0x7f3d3c15bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53734/0 (socket says 172.21.15.3:53734) 2023-10-08T15:42:25.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.149+0000 7f3d3b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d3c0bcca0 0x7f3d3c15b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:25.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.149+0000 7f3d40c66700 1 -- 172.21.15.3:0/3549955433 learned_addr learned my addr 172.21.15.3:0/3549955433 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:25.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.149+0000 7f3d3b7fe700 1 -- 172.21.15.3:0/3549955433 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3d3c067310 msgr2=0x7f3d3c06d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:25.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.149+0000 7f3d3b7fe700 1 --2- 172.21.15.3:0/3549955433 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3d3c067310 0x7f3d3c06d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:25.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.149+0000 7f3d3b7fe700 1 -- 172.21.15.3:0/3549955433 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3d3c1468f0 msgr2=0x7f3d3c15bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:25.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.149+0000 7f3d3b7fe700 1 --2- 172.21.15.3:0/3549955433 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3d3c1468f0 0x7f3d3c15bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:25.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.149+0000 7f3d3b7fe700 1 -- 172.21.15.3:0/3549955433 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d300094f0 con 0x7f3d3c0bcca0 2023-10-08T15:42:25.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.153+0000 7f3d40c66700 1 --2- 172.21.15.3:0/3549955433 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3d3c1468f0 0x7f3d3c15bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:42:25.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.153+0000 7f3d3b7fe700 1 --2- 172.21.15.3:0/3549955433 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d3c0bcca0 0x7f3d3c15b9a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c0bd0b0 tx=0x7f3d30009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:25.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.153+0000 7f3d23fff700 1 -- 172.21.15.3:0/3549955433 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3000c820 con 0x7f3d3c0bcca0 2023-10-08T15:42:25.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.153+0000 7f3d23fff700 1 -- 172.21.15.3:0/3549955433 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d3000c980 con 0x7f3d3c0bcca0 2023-10-08T15:42:25.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.153+0000 7f3d426c9700 1 -- 172.21.15.3:0/3549955433 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d2c009420 con 0x7f3d3c0bcca0 2023-10-08T15:42:25.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.153+0000 7f3d23fff700 1 -- 172.21.15.3:0/3549955433 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3000cd00 con 0x7f3d3c0bcca0 2023-10-08T15:42:25.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.153+0000 7f3d426c9700 1 -- 172.21.15.3:0/3549955433 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d34009a20 con 0x7f3d3c0bcca0 2023-10-08T15:42:25.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.153+0000 7f3d426c9700 1 -- 172.21.15.3:0/3549955433 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d3c064530 con 0x7f3d3c0bcca0 2023-10-08T15:42:25.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.153+0000 7f3d23fff700 1 -- 172.21.15.3:0/3549955433 <== mon.1 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f3d30013680 con 0x7f3d3c0bcca0 2023-10-08T15:42:25.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.153+0000 7f3d23fff700 1 --2- 172.21.15.3:0/3549955433 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3d28060580 0x7f3d28062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:25.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.153+0000 7f3d23fff700 1 -- 172.21.15.3:0/3549955433 <== mon.1 v2:172.21.15.50:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f3d3007c5e0 con 0x7f3d3c0bcca0 2023-10-08T15:42:25.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.157+0000 7f3d3bfff700 1 --2- 172.21.15.3:0/3549955433 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3d28060580 0x7f3d28062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:25.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.157+0000 7f3d3bfff700 1 --2- 172.21.15.3:0/3549955433 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3d28060580 0x7f3d28062a30 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f3d340099f0 tx=0x7f3d34019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:25.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.165+0000 7f3d23fff700 1 -- 172.21.15.3:0/3549955433 <== mon.1 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3d3004ced0 con 0x7f3d3c0bcca0 2023-10-08T15:42:25.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:25.345+0000 7f3d426c9700 1 -- 172.21.15.3:0/3549955433 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f3d3c0b3e40 con 0x7f3d3c0bcca0 2023-10-08T15:42:26.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.245+0000 7f3d23fff700 1 -- 172.21.15.3:0/3549955433 <== mon.1 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v67) v1 ==== 97+0+0 (secure 0 0 0) 0x7f3d3000ce60 con 0x7f3d3c0bcca0 2023-10-08T15:42:26.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.249+0000 7f3d426c9700 1 -- 172.21.15.3:0/3549955433 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3d28060580 msgr2=0x7f3d28062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:26.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.249+0000 7f3d426c9700 1 --2- 172.21.15.3:0/3549955433 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3d28060580 0x7f3d28062a30 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f3d340099f0 tx=0x7f3d34019000 comp rx=0 tx=0).stop 2023-10-08T15:42:26.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.249+0000 7f3d426c9700 1 -- 172.21.15.3:0/3549955433 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d3c0bcca0 msgr2=0x7f3d3c15b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:26.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.249+0000 7f3d426c9700 1 --2- 172.21.15.3:0/3549955433 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d3c0bcca0 0x7f3d3c15b9a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c0bd0b0 tx=0x7f3d30009250 comp rx=0 tx=0).stop 2023-10-08T15:42:26.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.249+0000 7f3d426c9700 1 -- 172.21.15.3:0/3549955433 shutdown_connections 2023-10-08T15:42:26.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.249+0000 7f3d426c9700 1 --2- 172.21.15.3:0/3549955433 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3d28060580 0x7f3d28062a30 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:26.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.249+0000 7f3d426c9700 1 --2- 172.21.15.3:0/3549955433 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3d3c1468f0 0x7f3d3c15bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:26.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.249+0000 7f3d426c9700 1 --2- 172.21.15.3:0/3549955433 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d3c0bcca0 0x7f3d3c15b9a0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:26.258 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.249+0000 7f3d426c9700 1 --2- 172.21.15.3:0/3549955433 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3d3c067310 0x7f3d3c06d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:26.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.253+0000 7f3d426c9700 1 -- 172.21.15.3:0/3549955433 >> 172.21.15.3:0/3549955433 conn(0x7f3d3c06b9b0 msgr2=0x7f3d3c145900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:26.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.253+0000 7f3d426c9700 1 -- 172.21.15.3:0/3549955433 shutdown_connections 2023-10-08T15:42:26.259 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.253+0000 7f3d426c9700 1 -- 172.21.15.3:0/3549955433 wait complete. 2023-10-08T15:42:26.260 INFO:teuthology.orchestra.run.smithi003.stderr: removed all blocklist entries 2023-10-08T15:42:26.274 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-08T15:42:26.387 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.381+0000 7f6ffb59e700 1 Processor -- start 2023-10-08T15:42:26.388 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.381+0000 7f6ffb59e700 1 -- start start 2023-10-08T15:42:26.388 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.381+0000 7f6ffb59e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6ffc0bce50 0x7f6ffc147d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:26.388 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.381+0000 7f6ffb59e700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ffc14bde0 con 0x7f6ffc0bca80 2023-10-08T15:42:26.388 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.381+0000 7f6ffb59e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ffc06d6f0 con 0x7f6ffc06cf60 2023-10-08T15:42:26.388 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.381+0000 7f6ffb59e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ffc14b920 con 0x7f6ffc0bce50 2023-10-08T15:42:26.389 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.381+0000 7f6ffa59c700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f6ffc0bca80 0x7f6ffc0b2340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:53556/0 (socket says 172.21.15.3:53556) 2023-10-08T15:42:26.389 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.381+0000 7f6ffa59c700 1 -- 172.21.15.3:0/1795888242 learned_addr learned my addr 172.21.15.3:0/1795888242 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:42:26.389 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.381+0000 7f6ff3fff700 1 --2- 172.21.15.3:0/1795888242 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6ffc0bce50 0x7f6ffc147d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:26.390 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.381+0000 7f6ff9d9b700 1 -- 172.21.15.3:0/1795888242 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1866336091 0 0) 0x7f6ffc14bde0 con 0x7f6ffc0bca80 2023-10-08T15:42:26.390 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.385+0000 7f6ff9d9b700 1 -- 172.21.15.3:0/1795888242 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fe8003570 con 0x7f6ffc0bca80 2023-10-08T15:42:26.390 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.385+0000 7f6ff3fff700 1 -- 172.21.15.3:0/1795888242 >> v1:172.21.15.50:6789/0 conn(0x7f6ffc06cf60 legacy=0x7f6ffc148250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:26.391 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.385+0000 7f6ff9d9b700 1 -- 172.21.15.3:0/1795888242 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3862387486 0 0) 0x7f6ffc06d6f0 con 0x7f6ffc06cf60 2023-10-08T15:42:26.391 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.385+0000 7f6ff3fff700 1 -- 172.21.15.3:0/1795888242 >> v1:172.21.15.3:6789/0 conn(0x7f6ffc0bca80 legacy=0x7f6ffc0b2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:26.391 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.385+0000 7f6ff3fff700 1 -- 172.21.15.3:0/1795888242 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ffc14bb00 con 0x7f6ffc0bce50 2023-10-08T15:42:26.391 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.385+0000 7f6ff3fff700 1 --2- 172.21.15.3:0/1795888242 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6ffc0bce50 0x7f6ffc147d10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6fe400aac0 tx=0x7f6fe400a330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dba802a4f7eea47f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:26.391 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.385+0000 7f6ff9d9b700 1 -- 172.21.15.3:0/1795888242 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe400c970 con 0x7f6ffc0bce50 2023-10-08T15:42:26.391 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.385+0000 7f6ff9d9b700 1 -- 172.21.15.3:0/1795888242 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fe400cad0 con 0x7f6ffc0bce50 2023-10-08T15:42:26.391 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.385+0000 7f6ff9d9b700 1 -- 172.21.15.3:0/1795888242 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe400ce70 con 0x7f6ffc0bce50 2023-10-08T15:42:26.392 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.385+0000 7f6ffb59e700 1 -- 172.21.15.3:0/1795888242 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6ffc0bce50 msgr2=0x7f6ffc147d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:26.392 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.385+0000 7f6ffb59e700 1 --2- 172.21.15.3:0/1795888242 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6ffc0bce50 0x7f6ffc147d10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6fe400aac0 tx=0x7f6fe400a330 comp rx=0 tx=0).stop 2023-10-08T15:42:26.392 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.385+0000 7f6ffb59e700 1 -- 172.21.15.3:0/1795888242 shutdown_connections 2023-10-08T15:42:26.392 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.385+0000 7f6ffb59e700 1 --2- 172.21.15.3:0/1795888242 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6ffc0bce50 0x7f6ffc147d10 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:26.392 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.385+0000 7f6ffb59e700 1 -- 172.21.15.3:0/1795888242 >> 172.21.15.3:0/1795888242 conn(0x7f6ffc0be4a0 msgr2=0x7f6ffc0ba440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:26.392 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.385+0000 7f6ffb59e700 1 -- 172.21.15.3:0/1795888242 shutdown_connections 2023-10-08T15:42:26.393 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.385+0000 7f6ffb59e700 1 -- 172.21.15.3:0/1795888242 wait complete. 2023-10-08T15:42:26.393 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.385+0000 7f6ffb59e700 1 Processor -- start 2023-10-08T15:42:26.393 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.385+0000 7f6ffb59e700 1 -- start start 2023-10-08T15:42:26.394 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.385+0000 7f6ffb59e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6ffc06cf60 0x7f6ffc140d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:26.394 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.385+0000 7f6ffb59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ffc0bca80 0x7f6ffc141260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:26.394 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.385+0000 7f6ffb59e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6ffc0bce50 0x7f6ffc1501f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:26.394 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.385+0000 7f6ffb59e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ffc15c060 con 0x7f6ffc06cf60 2023-10-08T15:42:26.394 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.385+0000 7f6ffb59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ffc14fd60 con 0x7f6ffc0bca80 2023-10-08T15:42:26.394 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.385+0000 7f6ffb59e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ffc15bd80 con 0x7f6ffc0bce50 2023-10-08T15:42:26.394 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.385+0000 7f6ffa59c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6ffc06cf60 0x7f6ffc140d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:26.394 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.385+0000 7f6ff3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ffc0bca80 0x7f6ffc141260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:26.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.385+0000 7f6ffad9d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6ffc0bce50 0x7f6ffc1501f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:26.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.385+0000 7f6ffa59c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6ffc06cf60 0x7f6ffc140d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53748/0 (socket says 172.21.15.3:53748) 2023-10-08T15:42:26.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.385+0000 7f6ffa59c700 1 -- 172.21.15.3:0/2601614507 learned_addr learned my addr 172.21.15.3:0/2601614507 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:26.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.389+0000 7f6ff3fff700 1 -- 172.21.15.3:0/2601614507 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6ffc0bce50 msgr2=0x7f6ffc1501f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:26.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.389+0000 7f6ff3fff700 1 --2- 172.21.15.3:0/2601614507 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6ffc0bce50 0x7f6ffc1501f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:26.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.389+0000 7f6ff3fff700 1 -- 172.21.15.3:0/2601614507 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6ffc06cf60 msgr2=0x7f6ffc140d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:26.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.389+0000 7f6ff3fff700 1 --2- 172.21.15.3:0/2601614507 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6ffc06cf60 0x7f6ffc140d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:26.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.389+0000 7f6ff3fff700 1 -- 172.21.15.3:0/2601614507 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe400a5d0 con 0x7f6ffc0bca80 2023-10-08T15:42:26.396 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.389+0000 7f6ff3fff700 1 --2- 172.21.15.3:0/2601614507 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ffc0bca80 0x7f6ffc141260 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4017000 tx=0x7f6fe401a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:26.396 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.389+0000 7f6ff27fc700 1 -- 172.21.15.3:0/2601614507 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe4018e20 con 0x7f6ffc0bca80 2023-10-08T15:42:26.396 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.389+0000 7f6ff27fc700 1 -- 172.21.15.3:0/2601614507 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fe4022400 con 0x7f6ffc0bca80 2023-10-08T15:42:26.396 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.389+0000 7f6ffb59e700 1 -- 172.21.15.3:0/2601614507 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ffc14f9f0 con 0x7f6ffc0bca80 2023-10-08T15:42:26.396 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.389+0000 7f6ff27fc700 1 -- 172.21.15.3:0/2601614507 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe40227e0 con 0x7f6ffc0bca80 2023-10-08T15:42:26.397 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.389+0000 7f6ffb59e700 1 -- 172.21.15.3:0/2601614507 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ffc1475b0 con 0x7f6ffc0bca80 2023-10-08T15:42:26.397 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.389+0000 7f6ffb59e700 1 -- 172.21.15.3:0/2601614507 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ffc147800 con 0x7f6ffc0bca80 2023-10-08T15:42:26.397 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.389+0000 7f6ff27fc700 1 -- 172.21.15.3:0/2601614507 <== mon.1 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6fe4022b50 con 0x7f6ffc0bca80 2023-10-08T15:42:26.398 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.393+0000 7f6ff27fc700 1 --2- 172.21.15.3:0/2601614507 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f6fdc060580 0x7f6fdc062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:26.398 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.393+0000 7f6ff27fc700 1 -- 172.21.15.3:0/2601614507 <== mon.1 v2:172.21.15.50:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f6fe407d8e0 con 0x7f6ffc0bca80 2023-10-08T15:42:26.398 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.393+0000 7f6ffa59c700 1 --2- 172.21.15.3:0/2601614507 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f6fdc060580 0x7f6fdc062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:26.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.393+0000 7f6ffa59c700 1 --2- 172.21.15.3:0/2601614507 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f6fdc060580 0x7f6fdc062a30 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6fec007fd0 tx=0x7f6fec000bc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:26.408 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.401+0000 7f6ff27fc700 1 -- 172.21.15.3:0/2601614507 <== mon.1 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6fe404e260 con 0x7f6ffc0bca80 2023-10-08T15:42:26.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.621+0000 7f6ffb59e700 1 -- 172.21.15.3:0/2601614507 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f6ffc05ecf0 con 0x7f6ffc0bca80 2023-10-08T15:42:26.627 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.621+0000 7f6ff27fc700 1 -- 172.21.15.3:0/2601614507 <== mon.1 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+4446 (secure 0 0 0) 0x7f6fe4051840 con 0x7f6ffc0bca80 2023-10-08T15:42:26.628 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:42:26.628 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2023-10-08T15:42:26.628 INFO:teuthology.orchestra.run.smithi003.stdout: "auth_dump": [ 2023-10-08T15:42:26.628 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:42:26.628 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "mds.a", 2023-10-08T15:42:26.628 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCGzCJlniy3BRAAQseQmhA2EOYYPCLL1hMj/g==", 2023-10-08T15:42:26.628 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:42:26.628 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow", 2023-10-08T15:42:26.628 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow *", 2023-10-08T15:42:26.629 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow *", 2023-10-08T15:42:26.629 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:42:26.629 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:42:26.629 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:42:26.629 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:42:26.629 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "mds.b", 2023-10-08T15:42:26.629 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCGzCJl1lNhCRAA/A3Dz/i7z2OM/Mwr00ZSFg==", 2023-10-08T15:42:26.629 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:42:26.629 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow", 2023-10-08T15:42:26.629 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow *", 2023-10-08T15:42:26.629 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow *", 2023-10-08T15:42:26.630 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:42:26.630 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:42:26.630 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:42:26.630 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:42:26.630 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.0", 2023-10-08T15:42:26.630 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCIzCJl5cInMhAAIWzN1t0FivwbJgXlK5WXCg==", 2023-10-08T15:42:26.630 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:42:26.630 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-10-08T15:42:26.630 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-10-08T15:42:26.630 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:42:26.631 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:42:26.631 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:42:26.631 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:42:26.631 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.1", 2023-10-08T15:42:26.631 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCMzCJlZQwWCBAAzzoTedkZwE7oFh4KXjrWZg==", 2023-10-08T15:42:26.631 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:42:26.631 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-10-08T15:42:26.631 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-10-08T15:42:26.631 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:42:26.631 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:42:26.631 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:42:26.631 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:42:26.632 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.2", 2023-10-08T15:42:26.632 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCPzCJlNZM0DRAAgBBNMGbDp8a6VU+mZCpMvQ==", 2023-10-08T15:42:26.632 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:42:26.632 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-10-08T15:42:26.632 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-10-08T15:42:26.632 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:42:26.632 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:42:26.632 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:42:26.632 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:42:26.632 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.3", 2023-10-08T15:42:26.632 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCSzCJltf1tERAAzUJYRvgmxgEtp/IkRsxqmg==", 2023-10-08T15:42:26.633 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:42:26.633 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-10-08T15:42:26.633 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-10-08T15:42:26.633 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:42:26.633 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:42:26.633 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:42:26.633 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:42:26.633 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.4", 2023-10-08T15:42:26.633 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCVzCJlJb2bOBAAZ4hEdc2vznsMuAZpBZlj6Q==", 2023-10-08T15:42:26.633 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:42:26.633 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-10-08T15:42:26.633 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-10-08T15:42:26.634 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:42:26.634 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:42:26.634 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:42:26.634 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:42:26.634 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.5", 2023-10-08T15:42:26.634 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCZzCJlRu4PAhAAgAt508VAQXQwI2L8QyJsag==", 2023-10-08T15:42:26.634 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:42:26.634 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-10-08T15:42:26.634 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-10-08T15:42:26.634 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:42:26.634 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:42:26.635 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:42:26.635 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:42:26.635 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.6", 2023-10-08T15:42:26.635 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCczCJl+1qsBBAArN1IsbopNLd43wJCb73a/A==", 2023-10-08T15:42:26.635 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:42:26.635 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-10-08T15:42:26.635 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-10-08T15:42:26.635 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:42:26.635 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:42:26.635 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:42:26.635 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:42:26.635 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "osd.7", 2023-10-08T15:42:26.636 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCfzCJlMwQhCRAAv/YJwsTJz1eOHFJA/34fDQ==", 2023-10-08T15:42:26.636 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:42:26.636 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow profile osd", 2023-10-08T15:42:26.636 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile osd", 2023-10-08T15:42:26.636 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:42:26.636 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:42:26.636 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:42:26.636 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:42:26.636 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "client.0", 2023-10-08T15:42:26.636 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCGzCJlsNS9DBAAAGWd2+fzzFMSRkr2JgMssw==", 2023-10-08T15:42:26.636 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:42:26.636 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow", 2023-10-08T15:42:26.637 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow r", 2023-10-08T15:42:26.637 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-08T15:42:26.637 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:42:26.637 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:42:26.637 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:42:26.637 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "client.1", 2023-10-08T15:42:26.637 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCGzCJlDRibDxAAgu6Q6umK/yUGAg4R/9Yj+w==", 2023-10-08T15:42:26.637 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:42:26.637 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow", 2023-10-08T15:42:26.637 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow r", 2023-10-08T15:42:26.637 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow rw", 2023-10-08T15:42:26.637 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow rwx" 2023-10-08T15:42:26.638 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:42:26.638 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:42:26.638 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:42:26.638 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "client.2", 2023-10-08T15:42:26.638 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCGzCJlqKuGEhAAUqGYxYztxx87maQJT2LL/g==", 2023-10-08T15:42:26.638 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:42:26.638 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow", 2023-10-08T15:42:26.638 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow r", 2023-10-08T15:42:26.638 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow rw", 2023-10-08T15:42:26.638 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow rwx" 2023-10-08T15:42:26.638 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:42:26.639 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:42:26.639 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:42:26.639 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "client.admin", 2023-10-08T15:42:26.639 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCFzCJltIgDJxAAwtl0Hr7oKzNBMOvXUUnshQ==", 2023-10-08T15:42:26.639 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:42:26.639 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow *", 2023-10-08T15:42:26.639 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": "allow *", 2023-10-08T15:42:26.639 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow *", 2023-10-08T15:42:26.639 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:42:26.639 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:42:26.639 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:42:26.640 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:42:26.640 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "mgr.x", 2023-10-08T15:42:26.640 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCGzCJlrnryAhAAe5CNtQTuBHbbPrdMxY2lqA==", 2023-10-08T15:42:26.640 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:42:26.640 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow *", 2023-10-08T15:42:26.640 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile mgr", 2023-10-08T15:42:26.640 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:42:26.640 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:42:26.640 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-10-08T15:42:26.640 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:42:26.640 INFO:teuthology.orchestra.run.smithi003.stdout: "entity": "mgr.y", 2023-10-08T15:42:26.641 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "AQCGzCJl8moPABAAjH5iVWRLyeITsMX/nAZoTQ==", 2023-10-08T15:42:26.641 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": { 2023-10-08T15:42:26.641 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": "allow *", 2023-10-08T15:42:26.641 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": "allow profile mgr", 2023-10-08T15:42:26.641 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": "allow *" 2023-10-08T15:42:26.641 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:42:26.641 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:42:26.641 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2023-10-08T15:42:26.641 INFO:teuthology.orchestra.run.smithi003.stdout:} 2023-10-08T15:42:26.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.625+0000 7f6ffb59e700 1 -- 172.21.15.3:0/2601614507 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f6fdc060580 msgr2=0x7f6fdc062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:26.643 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.625+0000 7f6ffb59e700 1 --2- 172.21.15.3:0/2601614507 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f6fdc060580 0x7f6fdc062a30 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6fec007fd0 tx=0x7f6fec000bc0 comp rx=0 tx=0).stop 2023-10-08T15:42:26.643 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.625+0000 7f6ffb59e700 1 -- 172.21.15.3:0/2601614507 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ffc0bca80 msgr2=0x7f6ffc141260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:26.643 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.625+0000 7f6ffb59e700 1 --2- 172.21.15.3:0/2601614507 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ffc0bca80 0x7f6ffc141260 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4017000 tx=0x7f6fe401a000 comp rx=0 tx=0).stop 2023-10-08T15:42:26.643 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.625+0000 7f6ffb59e700 1 -- 172.21.15.3:0/2601614507 shutdown_connections 2023-10-08T15:42:26.643 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.625+0000 7f6ffb59e700 1 --2- 172.21.15.3:0/2601614507 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f6fdc060580 0x7f6fdc062a30 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:26.643 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.625+0000 7f6ffb59e700 1 --2- 172.21.15.3:0/2601614507 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6ffc0bce50 0x7f6ffc1501f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:26.643 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.625+0000 7f6ffb59e700 1 --2- 172.21.15.3:0/2601614507 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ffc0bca80 0x7f6ffc141260 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:26.643 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.625+0000 7f6ffb59e700 1 --2- 172.21.15.3:0/2601614507 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6ffc06cf60 0x7f6ffc140d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:26.643 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.625+0000 7f6ffb59e700 1 -- 172.21.15.3:0/2601614507 >> 172.21.15.3:0/2601614507 conn(0x7f6ffc0be4a0 msgr2=0x7f6ffc06be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:26.643 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.625+0000 7f6ffb59e700 1 -- 172.21.15.3:0/2601614507 shutdown_connections 2023-10-08T15:42:26.644 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.625+0000 7f6ffb59e700 1 -- 172.21.15.3:0/2601614507 wait complete. 2023-10-08T15:42:26.644 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:42:26.749 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.741+0000 7f0ac9892700 1 Processor -- start 2023-10-08T15:42:26.749 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.741+0000 7f0ac9892700 1 -- start start 2023-10-08T15:42:26.750 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.745+0000 7f0ac9892700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0ac406be60 0x7f0ac414b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:26.750 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.745+0000 7f0ac9892700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ac414c6b0 con 0x7f0ac406cc40 2023-10-08T15:42:26.750 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.745+0000 7f0ac9892700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ac414c060 con 0x7f0ac414ac50 2023-10-08T15:42:26.750 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.745+0000 7f0ac9892700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ac414c340 con 0x7f0ac406be60 2023-10-08T15:42:26.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.745+0000 7f0ac9091700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f0ac406cc40 0x7f0ac414cc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:53564/0 (socket says 172.21.15.3:53564) 2023-10-08T15:42:26.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.745+0000 7f0ac9091700 1 -- 172.21.15.3:0/3857405563 learned_addr learned my addr 172.21.15.3:0/3857405563 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:42:26.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.745+0000 7f0abbfff700 1 --2- 172.21.15.3:0/3857405563 >> v2:172.21.15.50:3300/0 conn(0x7f0ac406be60 0x7f0ac414b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:26.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.745+0000 7f0abb7fe700 1 -- 172.21.15.3:0/3857405563 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3961700978 0 0) 0x7f0ac414c6b0 con 0x7f0ac406cc40 2023-10-08T15:42:26.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.745+0000 7f0abb7fe700 1 -- 172.21.15.3:0/3857405563 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0aac003570 con 0x7f0ac406cc40 2023-10-08T15:42:26.752 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.745+0000 7f0abb7fe700 1 -- 172.21.15.3:0/3857405563 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 148591469 0 0) 0x7f0aac003570 con 0x7f0ac406cc40 2023-10-08T15:42:26.752 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.745+0000 7f0abbfff700 1 -- 172.21.15.3:0/3857405563 >> v1:172.21.15.50:6789/0 conn(0x7f0ac414ac50 legacy=0x7f0ac406c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:26.752 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.745+0000 7f0abbfff700 1 -- 172.21.15.3:0/3857405563 >> v1:172.21.15.3:6789/0 conn(0x7f0ac406cc40 legacy=0x7f0ac414cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:26.752 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.745+0000 7f0abbfff700 1 -- 172.21.15.3:0/3857405563 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac414e860 con 0x7f0ac406be60 2023-10-08T15:42:26.752 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.745+0000 7f0abbfff700 1 --2- 172.21.15.3:0/3857405563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ac406be60 0x7f0ac414b020 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0ab40098e0 tx=0x7f0ab40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=769b7877d797fc98 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:26.752 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.745+0000 7f0abb7fe700 1 -- 172.21.15.3:0/3857405563 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0abc0017f0 con 0x7f0ac406be60 2023-10-08T15:42:26.752 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.745+0000 7f0abb7fe700 1 -- 172.21.15.3:0/3857405563 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab4011420 con 0x7f0ac406be60 2023-10-08T15:42:26.752 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.745+0000 7f0abb7fe700 1 -- 172.21.15.3:0/3857405563 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab40117a0 con 0x7f0ac406be60 2023-10-08T15:42:26.753 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.745+0000 7f0ac9892700 1 -- 172.21.15.3:0/3857405563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ac406be60 msgr2=0x7f0ac414b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:26.753 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.745+0000 7f0ac9892700 1 --2- 172.21.15.3:0/3857405563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ac406be60 0x7f0ac414b020 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0ab40098e0 tx=0x7f0ab40091a0 comp rx=0 tx=0).stop 2023-10-08T15:42:26.753 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.745+0000 7f0ac9892700 1 -- 172.21.15.3:0/3857405563 shutdown_connections 2023-10-08T15:42:26.753 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.745+0000 7f0ac9892700 1 --2- 172.21.15.3:0/3857405563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ac406be60 0x7f0ac414b020 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:26.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.745+0000 7f0ac9892700 1 -- 172.21.15.3:0/3857405563 >> 172.21.15.3:0/3857405563 conn(0x7f0ac40c1df0 msgr2=0x7f0ac40c21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:26.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.745+0000 7f0ac9892700 1 -- 172.21.15.3:0/3857405563 shutdown_connections 2023-10-08T15:42:26.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.745+0000 7f0ac9892700 1 -- 172.21.15.3:0/3857405563 wait complete. 2023-10-08T15:42:26.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.749+0000 7f0ac9892700 1 Processor -- start 2023-10-08T15:42:26.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.749+0000 7f0ac9892700 1 -- start start 2023-10-08T15:42:26.756 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.749+0000 7f0ac9892700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ac406be60 0x7f0ac414d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:26.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.749+0000 7f0ac9892700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ac406cc40 0x7f0ac4150b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:26.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.749+0000 7f0ac9892700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0ac414ac50 0x7f0ac409bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:26.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.749+0000 7f0ac9892700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac409dbf0 con 0x7f0ac406be60 2023-10-08T15:42:26.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.749+0000 7f0ac9892700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac41460d0 con 0x7f0ac406cc40 2023-10-08T15:42:26.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.749+0000 7f0ac9892700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac414d7f0 con 0x7f0ac414ac50 2023-10-08T15:42:26.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.749+0000 7f0ac8890700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ac406be60 0x7f0ac414d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:26.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.749+0000 7f0ac8890700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ac406be60 0x7f0ac414d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53762/0 (socket says 172.21.15.3:53762) 2023-10-08T15:42:26.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.749+0000 7f0ac8890700 1 -- 172.21.15.3:0/2529399425 learned_addr learned my addr 172.21.15.3:0/2529399425 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:26.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.749+0000 7f0abbfff700 1 --2- 172.21.15.3:0/2529399425 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ac406cc40 0x7f0ac4150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:26.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.749+0000 7f0ac9091700 1 --2- 172.21.15.3:0/2529399425 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0ac414ac50 0x7f0ac409bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:26.759 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.749+0000 7f0ac8890700 1 -- 172.21.15.3:0/2529399425 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0ac414ac50 msgr2=0x7f0ac409bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:26.759 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.749+0000 7f0ac8890700 1 --2- 172.21.15.3:0/2529399425 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0ac414ac50 0x7f0ac409bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:26.759 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.749+0000 7f0ac8890700 1 -- 172.21.15.3:0/2529399425 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ac406cc40 msgr2=0x7f0ac4150b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:26.759 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.749+0000 7f0ac8890700 1 --2- 172.21.15.3:0/2529399425 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ac406cc40 0x7f0ac4150b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:26.759 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.749+0000 7f0ac8890700 1 -- 172.21.15.3:0/2529399425 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab4009420 con 0x7f0ac406be60 2023-10-08T15:42:26.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.749+0000 7f0abbfff700 1 --2- 172.21.15.3:0/2529399425 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ac406cc40 0x7f0ac4150b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:42:26.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.749+0000 7f0ac8890700 1 --2- 172.21.15.3:0/2529399425 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ac406be60 0x7f0ac414d2b0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f0ac000c4e0 tx=0x7f0ac000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:26.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.753+0000 7f0ab8ff9700 1 -- 172.21.15.3:0/2529399425 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac0011590 con 0x7f0ac406be60 2023-10-08T15:42:26.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.753+0000 7f0ab8ff9700 1 -- 172.21.15.3:0/2529399425 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac0011710 con 0x7f0ac406be60 2023-10-08T15:42:26.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.753+0000 7f0ac9892700 1 -- 172.21.15.3:0/2529399425 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ac4146530 con 0x7f0ac406be60 2023-10-08T15:42:26.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.753+0000 7f0ab8ff9700 1 -- 172.21.15.3:0/2529399425 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac0011ad0 con 0x7f0ac406be60 2023-10-08T15:42:26.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.753+0000 7f0ac9892700 1 -- 172.21.15.3:0/2529399425 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ac4151b90 con 0x7f0ac406be60 2023-10-08T15:42:26.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.753+0000 7f0ab8ff9700 1 -- 172.21.15.3:0/2529399425 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f0ac0001020 con 0x7f0ac406be60 2023-10-08T15:42:26.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.753+0000 7f0ac9892700 1 -- 172.21.15.3:0/2529399425 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ac4146770 con 0x7f0ac406be60 2023-10-08T15:42:26.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.757+0000 7f0ab8ff9700 1 --2- 172.21.15.3:0/2529399425 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f0ab0060580 0x7f0ab0062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:26.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.757+0000 7f0ab8ff9700 1 -- 172.21.15.3:0/2529399425 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f0ac007b790 con 0x7f0ac406be60 2023-10-08T15:42:26.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.757+0000 7f0abbfff700 1 --2- 172.21.15.3:0/2529399425 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f0ab0060580 0x7f0ab0062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:26.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.757+0000 7f0abbfff700 1 --2- 172.21.15.3:0/2529399425 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f0ab0060580 0x7f0ab0062a30 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0ab4009fd0 tx=0x7f0ab4016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:26.769 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.761+0000 7f0ab8ff9700 1 -- 172.21.15.3:0/2529399425 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0ac4146770 con 0x7f0ac406be60 2023-10-08T15:42:26.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.925+0000 7f0ac9892700 1 -- 172.21.15.3:0/2529399425 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ac4145ea0 con 0x7f0ac406be60 2023-10-08T15:42:26.935 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.929+0000 7f0ab8ff9700 1 -- 172.21.15.3:0/2529399425 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+12039 (secure 0 0 0) 0x7f0ac4145ea0 con 0x7f0ac406be60 2023-10-08T15:42:26.935 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:42:26.935 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":67,"fsid":"7635972e-cd66-4a8f-a231-378db8b3847a","created":"2023-10-08T15:37:08.234594+0000","modified":"2023-10-08T15:42:26.242207+0000","last_up_change":"2023-10-08T15:37:17.537726+0000","last_in_change":"2023-10-08T15:37:10.269178+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:37:16.581590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"64fb1864-bfdd-4d75-9b41-03fb60085dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33363},{"type":"v1","addr":"172.21.15.3:6801","nonce":33363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33363},{"type":"v1","addr":"172.21.15.3:6803","nonce":33363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":33363},{"type":"v1","addr":"172.21.15.3:6807","nonce":33363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33363},{"type":"v1","addr":"172.21.15.3:6805","nonce":33363}]},"public_addr":"172.21.15.3:6801/33363","cluster_addr":"172.21.15.3:6803/33363","heartbeat_back_addr":"172.21.15.3:6807/33363","heartbeat_front_addr":"172.21.15.3:6805/33363","state":["exists","up"]},{"osd":1,"uuid":"3ca6bd3a-3e8a-4c65-af9c-46148b0c2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33364},{"type":"v1","addr":"172.21.15.3:6820","nonce":33364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33364},{"type":"v1","addr":"172.21.15.3:6824","nonce":33364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33364},{"type":"v1","addr":"172.21.15.3:6831","nonce":33364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33364},{"type":"v1","addr":"172.21.15.3:6828","nonce":33364}]},"public_addr":"172.21.15.3:6820/33364","cluster_addr":"172.21.15.3:6824/33364","heartbeat_back_addr":"172.21.15.3:6831/33364","heartbeat_front_addr":"172.21.15.3:6828/33364","state":["exists","up"]},{"osd":2,"uuid":"6eb9f757-58dd-442f-910d-32401454bce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33366},{"type":"v1","addr":"172.21.15.3:6817","nonce":33366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":33366},{"type":"v1","addr":"172.21.15.3:6821","nonce":33366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6827","nonce":33366},{"type":"v1","addr":"172.21.15.3:6829","nonce":33366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":33366},{"type":"v1","addr":"172.21.15.3:6825","nonce":33366}]},"public_addr":"172.21.15.3:6817/33366","cluster_addr":"172.21.15.3:6821/33366","heartbeat_back_addr":"172.21.15.3:6829/33366","heartbeat_front_addr":"172.21.15.3:6825/33366","state":["exists","up"]},{"osd":3,"uuid":"1c39866b-ac2e-4ea9-a69c-02b01ee4191d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33365},{"type":"v1","addr":"172.21.15.3:6809","nonce":33365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":33365},{"type":"v1","addr":"172.21.15.3:6811","nonce":33365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33365},{"type":"v1","addr":"172.21.15.3:6815","nonce":33365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":33365},{"type":"v1","addr":"172.21.15.3:6813","nonce":33365}]},"public_addr":"172.21.15.3:6809/33365","cluster_addr":"172.21.15.3:6811/33365","heartbeat_back_addr":"172.21.15.3:6815/33365","heartbeat_front_addr":"172.21.15.3:6813/33365","state":["exists","up"]},{"osd":4,"uuid":"15f86b61-b7f1-4780-ae00-9d80a68cb830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":33605},{"type":"v1","addr":"172.21.15.50:6809","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33605},{"type":"v1","addr":"172.21.15.50:6811","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33605},{"type":"v1","addr":"172.21.15.50:6815","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":33605},{"type":"v1","addr":"172.21.15.50:6813","nonce":33605}]},"public_addr":"172.21.15.50:6809/33605","cluster_addr":"172.21.15.50:6811/33605","heartbeat_back_addr":"172.21.15.50:6815/33605","heartbeat_front_addr":"172.21.15.50:6813/33605","state":["exists","up"]},{"osd":5,"uuid":"726c3003-34e6-4d5a-b6e2-f911e13c2118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33606},{"type":"v1","addr":"172.21.15.50:6801","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33606},{"type":"v1","addr":"172.21.15.50:6803","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33606},{"type":"v1","addr":"172.21.15.50:6807","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":33606},{"type":"v1","addr":"172.21.15.50:6805","nonce":33606}]},"public_addr":"172.21.15.50:6801/33606","cluster_addr":"172.21.15.50:6803/33606","heartbeat_back_addr":"172.21.15.50:6807/33606","heartbeat_front_addr":"172.21.15.50:6805/33606","state":["exists","up"]},{"osd":6,"uuid":"401122a4-9988-441f-a5a7-39164434ebcd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":33607},{"type":"v1","addr":"172.21.15.50:6819","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":33607},{"type":"v1","addr":"172.21.15.50:6823","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":33607},{"type":"v1","addr":"172.21.15.50:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":33607},{"type":"v1","addr":"172.21.15.50:6827","nonce":33607}]},"public_addr":"172.21.15.50:6819/33607","cluster_addr":"172.21.15.50:6823/33607","heartbeat_back_addr":"172.21.15.50:6831/33607","heartbeat_front_addr":"172.21.15.50:6827/33607","state":["exists","up"]},{"osd":7,"uuid":"6b3fa236-c9d0-4c4d-82ae-9af4daf6d699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33604},{"type":"v1","addr":"172.21.15.50:6818","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":33604},{"type":"v1","addr":"172.21.15.50:6822","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":33604},{"type":"v1","addr":"172.21.15.50:6830","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":33604},{"type":"v1","addr":"172.21.15.50:6826","nonce":33604}]},"public_addr":"172.21.15.50:6818/33604","cluster_addr":"172.21.15.50:6822/33604","heartbeat_back_addr":"172.21.15.50:6830/33604","heartbeat_front_addr":"172.21.15.50:6826/33604","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.497794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.529417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.873426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.325972+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.443971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.240795+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.739632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.643026+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:42:26.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.933+0000 7f0ac9892700 1 -- 172.21.15.3:0/2529399425 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f0ab0060580 msgr2=0x7f0ab0062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:26.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.933+0000 7f0ac9892700 1 --2- 172.21.15.3:0/2529399425 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f0ab0060580 0x7f0ab0062a30 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0ab4009fd0 tx=0x7f0ab4016000 comp rx=0 tx=0).stop 2023-10-08T15:42:26.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.933+0000 7f0ac9892700 1 -- 172.21.15.3:0/2529399425 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ac406be60 msgr2=0x7f0ac414d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:26.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.933+0000 7f0ac9892700 1 --2- 172.21.15.3:0/2529399425 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ac406be60 0x7f0ac414d2b0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f0ac000c4e0 tx=0x7f0ac000c7f0 comp rx=0 tx=0).stop 2023-10-08T15:42:26.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.933+0000 7f0ac9892700 1 -- 172.21.15.3:0/2529399425 shutdown_connections 2023-10-08T15:42:26.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.933+0000 7f0ac9892700 1 --2- 172.21.15.3:0/2529399425 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f0ab0060580 0x7f0ab0062a30 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:26.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.933+0000 7f0ac9892700 1 --2- 172.21.15.3:0/2529399425 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0ac414ac50 0x7f0ac409bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:26.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.933+0000 7f0ac9892700 1 --2- 172.21.15.3:0/2529399425 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ac406cc40 0x7f0ac4150b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:26.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.933+0000 7f0ac9892700 1 --2- 172.21.15.3:0/2529399425 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ac406be60 0x7f0ac414d2b0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:26.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.933+0000 7f0ac9892700 1 -- 172.21.15.3:0/2529399425 >> 172.21.15.3:0/2529399425 conn(0x7f0ac40c1df0 msgr2=0x7f0ac40685d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:26.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.933+0000 7f0ac9892700 1 -- 172.21.15.3:0/2529399425 shutdown_connections 2023-10-08T15:42:26.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:26.933+0000 7f0ac9892700 1 -- 172.21.15.3:0/2529399425 wait complete. 2023-10-08T15:42:26.951 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T15:37:16.581590+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-08T15:42:26.951 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T15:42:27.063 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.057+0000 7f8fafb67700 1 Processor -- start 2023-10-08T15:42:27.063 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.057+0000 7f8fafb67700 1 -- start start 2023-10-08T15:42:27.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.057+0000 7f8fafb67700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8fa806e4e0 0x7f8fa81456d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:27.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.057+0000 7f8fafb67700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f8fa806cb60 0x7f8fa806cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:27.065 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.057+0000 7f8fafb67700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fa814bed0 con 0x7f8fa80be130 2023-10-08T15:42:27.065 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.057+0000 7f8fafb67700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fa814b5c0 con 0x7f8fa806cb60 2023-10-08T15:42:27.065 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.057+0000 7f8fafb67700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa814b880 con 0x7f8fa806e4e0 2023-10-08T15:42:27.065 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.057+0000 7f8fae104700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f8fa806cb60 0x7f8fa806cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:27.065 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.057+0000 7f8fad903700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f8fa80be130 0x7f8fa8144fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:59186/0 (socket says 172.21.15.3:59186) 2023-10-08T15:42:27.065 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.057+0000 7f8fad903700 1 -- 172.21.15.3:0/1937063109 learned_addr learned my addr 172.21.15.3:0/1937063109 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:42:27.065 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.057+0000 7f8fad102700 1 --2- 172.21.15.3:0/1937063109 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8fa806e4e0 0x7f8fa81456d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:27.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.057+0000 7f8fac901700 1 -- 172.21.15.3:0/1937063109 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2972904083 0 0) 0x7f8fa814bed0 con 0x7f8fa80be130 2023-10-08T15:42:27.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.057+0000 7f8fac901700 1 -- 172.21.15.3:0/1937063109 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f94003570 con 0x7f8fa80be130 2023-10-08T15:42:27.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.057+0000 7f8fae104700 1 -- 172.21.15.3:0/1937063109 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8fa806e4e0 msgr2=0x7f8fa81456d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:27.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.057+0000 7f8fae104700 1 --2- 172.21.15.3:0/1937063109 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8fa806e4e0 0x7f8fa81456d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:27.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.057+0000 7f8fae104700 1 -- 172.21.15.3:0/1937063109 >> v1:172.21.15.3:6789/0 conn(0x7f8fa80be130 legacy=0x7f8fa8144fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:27.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.057+0000 7f8fae104700 1 -- 172.21.15.3:0/1937063109 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa814bb60 con 0x7f8fa806cb60 2023-10-08T15:42:27.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.057+0000 7f8fad102700 1 --2- 172.21.15.3:0/1937063109 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8fa806e4e0 0x7f8fa81456d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:42:27.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.057+0000 7f8fae104700 1 --2- 172.21.15.3:0/1937063109 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8fa806cb60 0x7f8fa806cfc0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0009e60 tx=0x7f8fa0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e85a93db83f0d7a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:27.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.061+0000 7f8fac901700 1 -- 172.21.15.3:0/1937063109 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa000e070 con 0x7f8fa806cb60 2023-10-08T15:42:27.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.061+0000 7f8fac901700 1 -- 172.21.15.3:0/1937063109 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa000bab0 con 0x7f8fa806cb60 2023-10-08T15:42:27.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.061+0000 7f8fac901700 1 -- 172.21.15.3:0/1937063109 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa000be70 con 0x7f8fa806cb60 2023-10-08T15:42:27.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.061+0000 7f8fafb67700 1 -- 172.21.15.3:0/1937063109 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8fa806cb60 msgr2=0x7f8fa806cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:27.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.061+0000 7f8fafb67700 1 --2- 172.21.15.3:0/1937063109 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8fa806cb60 0x7f8fa806cfc0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0009e60 tx=0x7f8fa0009780 comp rx=0 tx=0).stop 2023-10-08T15:42:27.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.061+0000 7f8fafb67700 1 -- 172.21.15.3:0/1937063109 shutdown_connections 2023-10-08T15:42:27.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.061+0000 7f8fafb67700 1 --2- 172.21.15.3:0/1937063109 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8fa806cb60 0x7f8fa806cfc0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:27.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.061+0000 7f8fafb67700 1 --2- 172.21.15.3:0/1937063109 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8fa806e4e0 0x7f8fa81456d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:27.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.061+0000 7f8fafb67700 1 -- 172.21.15.3:0/1937063109 >> 172.21.15.3:0/1937063109 conn(0x7f8fa80c2a80 msgr2=0x7f8fa80bea60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:27.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.061+0000 7f8fafb67700 1 -- 172.21.15.3:0/1937063109 shutdown_connections 2023-10-08T15:42:27.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.061+0000 7f8fafb67700 1 -- 172.21.15.3:0/1937063109 wait complete. 2023-10-08T15:42:27.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.061+0000 7f8fafb67700 1 Processor -- start 2023-10-08T15:42:27.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.061+0000 7f8fafb67700 1 -- start start 2023-10-08T15:42:27.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.061+0000 7f8fafb67700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fa806cb60 0x7f8fa815e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:27.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.061+0000 7f8fafb67700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8fa806e4e0 0x7f8fa814f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:27.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.061+0000 7f8fafb67700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8fa80be130 0x7f8fa814f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:27.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.061+0000 7f8fafb67700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa8147670 con 0x7f8fa806e4e0 2023-10-08T15:42:27.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.061+0000 7f8fafb67700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa815f0f0 con 0x7f8fa806cb60 2023-10-08T15:42:27.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.061+0000 7f8fafb67700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa815c530 con 0x7f8fa80be130 2023-10-08T15:42:27.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.061+0000 7f8fad102700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8fa806e4e0 0x7f8fa814f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:27.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.061+0000 7f8fad102700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8fa806e4e0 0x7f8fa814f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57048/0 (socket says 172.21.15.3:57048) 2023-10-08T15:42:27.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.061+0000 7f8fad102700 1 -- 172.21.15.3:0/165027953 learned_addr learned my addr 172.21.15.3:0/165027953 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:27.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.061+0000 7f8fae104700 1 --2- 172.21.15.3:0/165027953 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8fa80be130 0x7f8fa814f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:27.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.061+0000 7f8fad903700 1 --2- 172.21.15.3:0/165027953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fa806cb60 0x7f8fa815e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:27.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.065+0000 7f8fad102700 1 -- 172.21.15.3:0/165027953 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8fa80be130 msgr2=0x7f8fa814f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:27.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.065+0000 7f8fad102700 1 --2- 172.21.15.3:0/165027953 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8fa80be130 0x7f8fa814f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:27.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.065+0000 7f8fad102700 1 -- 172.21.15.3:0/165027953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fa806cb60 msgr2=0x7f8fa815e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:27.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.065+0000 7f8fad102700 1 --2- 172.21.15.3:0/165027953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fa806cb60 0x7f8fa815e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:27.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.065+0000 7f8fad102700 1 -- 172.21.15.3:0/165027953 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa4009420 con 0x7f8fa806e4e0 2023-10-08T15:42:27.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.065+0000 7f8fad102700 1 --2- 172.21.15.3:0/165027953 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8fa806e4e0 0x7f8fa814f300 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f8fa400ec80 tx=0x7f8fa40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:27.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.065+0000 7f8f9dffb700 1 -- 172.21.15.3:0/165027953 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa400c920 con 0x7f8fa806e4e0 2023-10-08T15:42:27.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.065+0000 7f8f9dffb700 1 -- 172.21.15.3:0/165027953 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa400ca80 con 0x7f8fa806e4e0 2023-10-08T15:42:27.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.065+0000 7f8fafb67700 1 -- 172.21.15.3:0/165027953 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fa0009a20 con 0x7f8fa806e4e0 2023-10-08T15:42:27.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.065+0000 7f8f9dffb700 1 -- 172.21.15.3:0/165027953 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa400ce00 con 0x7f8fa806e4e0 2023-10-08T15:42:27.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.065+0000 7f8fafb67700 1 -- 172.21.15.3:0/165027953 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fa815eeb0 con 0x7f8fa806e4e0 2023-10-08T15:42:27.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.065+0000 7f8fafb67700 1 -- 172.21.15.3:0/165027953 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fa814f150 con 0x7f8fa806e4e0 2023-10-08T15:42:27.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.069+0000 7f8f9dffb700 1 -- 172.21.15.3:0/165027953 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f8fa4013680 con 0x7f8fa806e4e0 2023-10-08T15:42:27.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.069+0000 7f8f9dffb700 1 --2- 172.21.15.3:0/165027953 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8f8c060550 0x7f8f8c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:27.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.069+0000 7f8f9dffb700 1 -- 172.21.15.3:0/165027953 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f8fa407c6a0 con 0x7f8fa806e4e0 2023-10-08T15:42:27.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.069+0000 7f8fad903700 1 --2- 172.21.15.3:0/165027953 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8f8c060550 0x7f8f8c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:27.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.069+0000 7f8fad903700 1 --2- 172.21.15.3:0/165027953 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8f8c060550 0x7f8f8c062a00 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8f98007fd0 tx=0x7f8f98009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:27.083 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.077+0000 7f8f9dffb700 1 -- 172.21.15.3:0/165027953 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8fa404cf40 con 0x7f8fa806e4e0 2023-10-08T15:42:27.243 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.237+0000 7f8fafb67700 1 -- 172.21.15.3:0/165027953 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8fa815eeb0 con 0x7f8fa806e4e0 2023-10-08T15:42:27.243 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.237+0000 7f8f9dffb700 1 -- 172.21.15.3:0/165027953 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v67) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8fa815eeb0 con 0x7f8fa806e4e0 2023-10-08T15:42:27.244 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2023-10-08T15:42:27.246 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.241+0000 7f8fafb67700 1 -- 172.21.15.3:0/165027953 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8f8c060550 msgr2=0x7f8f8c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:27.246 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.241+0000 7f8fafb67700 1 --2- 172.21.15.3:0/165027953 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8f8c060550 0x7f8f8c062a00 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8f98007fd0 tx=0x7f8f98009040 comp rx=0 tx=0).stop 2023-10-08T15:42:27.247 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.241+0000 7f8fafb67700 1 -- 172.21.15.3:0/165027953 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8fa806e4e0 msgr2=0x7f8fa814f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:27.247 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.241+0000 7f8fafb67700 1 --2- 172.21.15.3:0/165027953 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8fa806e4e0 0x7f8fa814f300 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f8fa400ec80 tx=0x7f8fa40091a0 comp rx=0 tx=0).stop 2023-10-08T15:42:27.247 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.241+0000 7f8fafb67700 1 -- 172.21.15.3:0/165027953 shutdown_connections 2023-10-08T15:42:27.247 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.241+0000 7f8fafb67700 1 --2- 172.21.15.3:0/165027953 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f8f8c060550 0x7f8f8c062a00 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:27.247 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.241+0000 7f8fafb67700 1 --2- 172.21.15.3:0/165027953 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8fa80be130 0x7f8fa814f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:27.247 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.241+0000 7f8fafb67700 1 --2- 172.21.15.3:0/165027953 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8fa806e4e0 0x7f8fa814f300 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:27.247 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.241+0000 7f8fafb67700 1 --2- 172.21.15.3:0/165027953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fa806cb60 0x7f8fa815e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:27.247 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.241+0000 7f8fafb67700 1 -- 172.21.15.3:0/165027953 >> 172.21.15.3:0/165027953 conn(0x7f8fa80c2a80 msgr2=0x7f8fa80c0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:27.247 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.241+0000 7f8fafb67700 1 -- 172.21.15.3:0/165027953 shutdown_connections 2023-10-08T15:42:27.247 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.241+0000 7f8fafb67700 1 -- 172.21.15.3:0/165027953 wait complete. 2023-10-08T15:42:27.263 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T15:42:27.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.353+0000 7fbaf131c700 1 Processor -- start 2023-10-08T15:42:27.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.353+0000 7fbaf131c700 1 -- start start 2023-10-08T15:42:27.363 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.357+0000 7fbaf131c700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fbaec147c10 0x7fbaec06d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:27.363 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.357+0000 7fbaf131c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbaec06c820 0x7fbaec14c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:27.363 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.357+0000 7fbaf131c700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaec14bcc0 con 0x7fbaec0badb0 2023-10-08T15:42:27.363 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.357+0000 7fbaf131c700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaec06cc80 con 0x7fbaec147c10 2023-10-08T15:42:27.363 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.357+0000 7fbaf131c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaec06dd00 con 0x7fbaec06c820 2023-10-08T15:42:27.363 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.357+0000 7fbaeaffd700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fbaec147c10 0x7fbaec06d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:27.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.357+0000 7fbaeaffd700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fbaec147c10 0x7fbaec06d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57050/0 (socket says 172.21.15.3:57050) 2023-10-08T15:42:27.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.357+0000 7fbaeaffd700 1 -- 172.21.15.3:0/462427423 learned_addr learned my addr 172.21.15.3:0/462427423 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:27.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.357+0000 7fbaea7fc700 1 --2- 172.21.15.3:0/462427423 >> v2:172.21.15.50:3300/0 conn(0x7fbaec06c820 0x7fbaec14c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:27.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.357+0000 7fbaeaffd700 1 -- 172.21.15.3:0/462427423 >> v2:172.21.15.50:3300/0 conn(0x7fbaec06c820 msgr2=0x7fbaec14c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:27.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.357+0000 7fbaeaffd700 1 --2- 172.21.15.3:0/462427423 >> v2:172.21.15.50:3300/0 conn(0x7fbaec06c820 0x7fbaec14c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:27.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.357+0000 7fbaeaffd700 1 -- 172.21.15.3:0/462427423 >> v1:172.21.15.50:6789/0 conn(0x7fbaec0badb0 legacy=0x7fbaec147fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:27.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.357+0000 7fbaeaffd700 1 -- 172.21.15.3:0/462427423 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaec14b950 con 0x7fbaec147c10 2023-10-08T15:42:27.365 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.357+0000 7fbaeaffd700 1 --2- 172.21.15.3:0/462427423 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbaec147c10 0x7fbaec06d6e0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fbae00099a0 tx=0x7fbae0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b1a8c664b861b1e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:27.365 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.357+0000 7fbae9ffb700 1 -- 172.21.15.3:0/462427423 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae000b820 con 0x7fbaec147c10 2023-10-08T15:42:27.365 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.357+0000 7fbae9ffb700 1 -- 172.21.15.3:0/462427423 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbae000b980 con 0x7fbaec147c10 2023-10-08T15:42:27.365 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.357+0000 7fbae9ffb700 1 -- 172.21.15.3:0/462427423 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae000bd20 con 0x7fbaec147c10 2023-10-08T15:42:27.365 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.357+0000 7fbaf131c700 1 -- 172.21.15.3:0/462427423 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbaec147c10 msgr2=0x7fbaec06d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:27.366 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.357+0000 7fbaf131c700 1 --2- 172.21.15.3:0/462427423 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbaec147c10 0x7fbaec06d6e0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fbae00099a0 tx=0x7fbae0009250 comp rx=0 tx=0).stop 2023-10-08T15:42:27.366 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.357+0000 7fbaf131c700 1 -- 172.21.15.3:0/462427423 shutdown_connections 2023-10-08T15:42:27.366 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.357+0000 7fbaf131c700 1 --2- 172.21.15.3:0/462427423 >> v2:172.21.15.50:3300/0 conn(0x7fbaec06c820 0x7fbaec14c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:27.366 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.357+0000 7fbaf131c700 1 --2- 172.21.15.3:0/462427423 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbaec147c10 0x7fbaec06d6e0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:27.366 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.357+0000 7fbaf131c700 1 -- 172.21.15.3:0/462427423 >> 172.21.15.3:0/462427423 conn(0x7fbaec0be640 msgr2=0x7fbaec0ba6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:27.366 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.357+0000 7fbaf131c700 1 -- 172.21.15.3:0/462427423 shutdown_connections 2023-10-08T15:42:27.366 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.357+0000 7fbaf131c700 1 -- 172.21.15.3:0/462427423 wait complete. 2023-10-08T15:42:27.369 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.361+0000 7fbaf131c700 1 Processor -- start 2023-10-08T15:42:27.369 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.361+0000 7fbaf131c700 1 -- start start 2023-10-08T15:42:27.369 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.361+0000 7fbaf131c700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbaec06c820 0x7fbaec13fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:27.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.361+0000 7fbaf131c700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbaec0badb0 0x7fbaec068390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:27.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.361+0000 7fbaf131c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbaec147c10 0x7fbaec159880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:27.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.361+0000 7fbaf131c700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaec141410 con 0x7fbaec06c820 2023-10-08T15:42:27.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.361+0000 7fbaf131c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaec13e070 con 0x7fbaec147c10 2023-10-08T15:42:27.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.361+0000 7fbaf131c700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaec159180 con 0x7fbaec0badb0 2023-10-08T15:42:27.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.361+0000 7fbaeaffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbaec06c820 0x7fbaec13fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:27.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.361+0000 7fbaeaffd700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbaec06c820 0x7fbaec13fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57058/0 (socket says 172.21.15.3:57058) 2023-10-08T15:42:27.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.361+0000 7fbaeaffd700 1 -- 172.21.15.3:0/469627382 learned_addr learned my addr 172.21.15.3:0/469627382 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:27.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.361+0000 7fbaea7fc700 1 --2- 172.21.15.3:0/469627382 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbaec0badb0 0x7fbaec068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:27.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.361+0000 7fbaeb7fe700 1 --2- 172.21.15.3:0/469627382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbaec147c10 0x7fbaec159880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:27.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.361+0000 7fbaeaffd700 1 -- 172.21.15.3:0/469627382 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbaec0badb0 msgr2=0x7fbaec068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:27.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.361+0000 7fbaeaffd700 1 --2- 172.21.15.3:0/469627382 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbaec0badb0 0x7fbaec068390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:27.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.361+0000 7fbaeaffd700 1 -- 172.21.15.3:0/469627382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbaec147c10 msgr2=0x7fbaec159880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:27.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.361+0000 7fbaeaffd700 1 --2- 172.21.15.3:0/469627382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbaec147c10 0x7fbaec159880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:27.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.361+0000 7fbaeaffd700 1 -- 172.21.15.3:0/469627382 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae0009490 con 0x7fbaec06c820 2023-10-08T15:42:27.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.361+0000 7fbaeaffd700 1 --2- 172.21.15.3:0/469627382 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbaec06c820 0x7fbaec13fae0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fbaec06bad0 tx=0x7fbae0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:27.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.361+0000 7fbad2ffd700 1 -- 172.21.15.3:0/469627382 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae000bd00 con 0x7fbaec06c820 2023-10-08T15:42:27.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.361+0000 7fbad2ffd700 1 -- 172.21.15.3:0/469627382 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbae001a420 con 0x7fbaec06c820 2023-10-08T15:42:27.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.361+0000 7fbaf131c700 1 -- 172.21.15.3:0/469627382 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaec0688d0 con 0x7fbaec06c820 2023-10-08T15:42:27.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.361+0000 7fbad2ffd700 1 -- 172.21.15.3:0/469627382 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae001a7a0 con 0x7fbaec06c820 2023-10-08T15:42:27.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.361+0000 7fbaf131c700 1 -- 172.21.15.3:0/469627382 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaec13f0a0 con 0x7fbaec06c820 2023-10-08T15:42:27.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.365+0000 7fbaf131c700 1 -- 172.21.15.3:0/469627382 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaec064530 con 0x7fbaec06c820 2023-10-08T15:42:27.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.365+0000 7fbad2ffd700 1 -- 172.21.15.3:0/469627382 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fbae001abd0 con 0x7fbaec06c820 2023-10-08T15:42:27.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.365+0000 7fbad2ffd700 1 --2- 172.21.15.3:0/469627382 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbad8060580 0x7fbad8062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:27.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.365+0000 7fbad2ffd700 1 -- 172.21.15.3:0/469627382 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fbae007dd60 con 0x7fbaec06c820 2023-10-08T15:42:27.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.365+0000 7fbaea7fc700 1 --2- 172.21.15.3:0/469627382 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbad8060580 0x7fbad8062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:27.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.365+0000 7fbaea7fc700 1 --2- 172.21.15.3:0/469627382 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbad8060580 0x7fbad8062a30 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fbaec14b920 tx=0x7fbadc009880 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:27.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.373+0000 7fbad2ffd700 1 -- 172.21.15.3:0/469627382 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbae004e600 con 0x7fbaec06c820 2023-10-08T15:42:27.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.533+0000 7fbaf131c700 1 -- 172.21.15.3:0/469627382 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fbaec0bb4f0 con 0x7fbaec06c820 2023-10-08T15:42:27.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.533+0000 7fbad2ffd700 1 -- 172.21.15.3:0/469627382 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v67) v1 ==== 84+0+65 (secure 0 0 0) 0x7fbae0015020 con 0x7fbaec06c820 2023-10-08T15:42:27.542 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:42:27.542 INFO:teuthology.orchestra.run.smithi003.stdout:[ 2023-10-08T15:42:27.542 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-10-08T15:42:27.542 INFO:teuthology.orchestra.run.smithi003.stdout: "poolnum": 1, 2023-10-08T15:42:27.542 INFO:teuthology.orchestra.run.smithi003.stdout: "poolname": ".mgr" 2023-10-08T15:42:27.542 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-10-08T15:42:27.542 INFO:teuthology.orchestra.run.smithi003.stdout:] 2023-10-08T15:42:27.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.537+0000 7fbaf131c700 1 -- 172.21.15.3:0/469627382 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbad8060580 msgr2=0x7fbad8062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:27.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.537+0000 7fbaf131c700 1 --2- 172.21.15.3:0/469627382 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbad8060580 0x7fbad8062a30 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fbaec14b920 tx=0x7fbadc009880 comp rx=0 tx=0).stop 2023-10-08T15:42:27.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.537+0000 7fbaf131c700 1 -- 172.21.15.3:0/469627382 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbaec06c820 msgr2=0x7fbaec13fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:27.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.537+0000 7fbaf131c700 1 --2- 172.21.15.3:0/469627382 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbaec06c820 0x7fbaec13fae0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fbaec06bad0 tx=0x7fbae0017000 comp rx=0 tx=0).stop 2023-10-08T15:42:27.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.537+0000 7fbaf131c700 1 -- 172.21.15.3:0/469627382 shutdown_connections 2023-10-08T15:42:27.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.537+0000 7fbaf131c700 1 --2- 172.21.15.3:0/469627382 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbad8060580 0x7fbad8062a30 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:27.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.537+0000 7fbaf131c700 1 --2- 172.21.15.3:0/469627382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbaec147c10 0x7fbaec159880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:27.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.537+0000 7fbaf131c700 1 --2- 172.21.15.3:0/469627382 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbaec0badb0 0x7fbaec068390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:27.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.537+0000 7fbaf131c700 1 --2- 172.21.15.3:0/469627382 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbaec06c820 0x7fbaec13fae0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:27.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.537+0000 7fbaf131c700 1 -- 172.21.15.3:0/469627382 >> 172.21.15.3:0/469627382 conn(0x7fbaec0be640 msgr2=0x7fbaec06bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:27.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.537+0000 7fbaf131c700 1 -- 172.21.15.3:0/469627382 shutdown_connections 2023-10-08T15:42:27.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.537+0000 7fbaf131c700 1 -- 172.21.15.3:0/469627382 wait complete. 2023-10-08T15:42:27.556 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T15:42:27.556 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T15:42:27.669 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.661+0000 7fe678c9e700 1 Processor -- start 2023-10-08T15:42:27.669 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.661+0000 7fe678c9e700 1 -- start start 2023-10-08T15:42:27.670 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.665+0000 7fe678c9e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe67414b6d0 0x7fe674068d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:27.670 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.665+0000 7fe678c9e700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fe674069920 0x7fe67406c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:27.670 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.665+0000 7fe678c9e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6740692a0 con 0x7fe6740a1200 2023-10-08T15:42:27.670 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.665+0000 7fe678c9e700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6740694d0 con 0x7fe674069920 2023-10-08T15:42:27.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.665+0000 7fe678c9e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe67414bed0 con 0x7fe67414b6d0 2023-10-08T15:42:27.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.665+0000 7fe672ffd700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fe674069920 0x7fe67406c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:27.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.665+0000 7fe672ffd700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fe674069920 0x7fe67406c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57070/0 (socket says 172.21.15.3:57070) 2023-10-08T15:42:27.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.665+0000 7fe672ffd700 1 -- 172.21.15.3:0/1097932022 learned_addr learned my addr 172.21.15.3:0/1097932022 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:27.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.665+0000 7fe6737fe700 1 --2- 172.21.15.3:0/1097932022 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe67414b6d0 0x7fe674068d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:27.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.665+0000 7fe672ffd700 1 -- 172.21.15.3:0/1097932022 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe67414b6d0 msgr2=0x7fe674068d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:27.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.665+0000 7fe672ffd700 1 --2- 172.21.15.3:0/1097932022 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe67414b6d0 0x7fe674068d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:27.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.665+0000 7fe672ffd700 1 -- 172.21.15.3:0/1097932022 >> v1:172.21.15.50:6789/0 conn(0x7fe6740a1200 legacy=0x7fe67406ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:27.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.665+0000 7fe672ffd700 1 -- 172.21.15.3:0/1097932022 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe67414c170 con 0x7fe674069920 2023-10-08T15:42:27.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.665+0000 7fe672ffd700 1 --2- 172.21.15.3:0/1097932022 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe674069920 0x7fe67406c990 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fe6640099b0 tx=0x7fe664009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e030f0f4d9767c46 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:27.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.665+0000 7fe6727fc700 1 -- 172.21.15.3:0/1097932022 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe664009ea0 con 0x7fe674069920 2023-10-08T15:42:27.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.665+0000 7fe6727fc700 1 -- 172.21.15.3:0/1097932022 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe66400b860 con 0x7fe674069920 2023-10-08T15:42:27.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.665+0000 7fe6727fc700 1 -- 172.21.15.3:0/1097932022 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66400bc00 con 0x7fe674069920 2023-10-08T15:42:27.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.665+0000 7fe678c9e700 1 -- 172.21.15.3:0/1097932022 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe674069920 msgr2=0x7fe67406c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:27.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.665+0000 7fe678c9e700 1 --2- 172.21.15.3:0/1097932022 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe674069920 0x7fe67406c990 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fe6640099b0 tx=0x7fe664009250 comp rx=0 tx=0).stop 2023-10-08T15:42:27.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.665+0000 7fe678c9e700 1 -- 172.21.15.3:0/1097932022 shutdown_connections 2023-10-08T15:42:27.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.665+0000 7fe678c9e700 1 --2- 172.21.15.3:0/1097932022 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe674069920 0x7fe67406c990 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:27.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.665+0000 7fe678c9e700 1 --2- 172.21.15.3:0/1097932022 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe67414b6d0 0x7fe674068d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:27.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.665+0000 7fe678c9e700 1 -- 172.21.15.3:0/1097932022 >> 172.21.15.3:0/1097932022 conn(0x7fe6740a18a0 msgr2=0x7fe6740a1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:27.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.665+0000 7fe678c9e700 1 -- 172.21.15.3:0/1097932022 shutdown_connections 2023-10-08T15:42:27.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.665+0000 7fe678c9e700 1 -- 172.21.15.3:0/1097932022 wait complete. 2023-10-08T15:42:27.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.669+0000 7fe678c9e700 1 Processor -- start 2023-10-08T15:42:27.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.669+0000 7fe678c9e700 1 -- start start 2023-10-08T15:42:27.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.669+0000 7fe678c9e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe674069920 0x7fe67415e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:27.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.669+0000 7fe678c9e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6740a1200 0x7fe674141f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:27.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.669+0000 7fe678c9e700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe67414b6d0 0x7fe674142450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:27.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.669+0000 7fe678c9e700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe67414ef00 con 0x7fe67414b6d0 2023-10-08T15:42:27.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.669+0000 7fe678c9e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe67415f440 con 0x7fe6740a1200 2023-10-08T15:42:27.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.669+0000 7fe678c9e700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe67414ac70 con 0x7fe674069920 2023-10-08T15:42:27.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.669+0000 7fe6737fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe674069920 0x7fe67415e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:27.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.669+0000 7fe673fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe67414b6d0 0x7fe674142450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:27.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.669+0000 7fe6737fe700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe674069920 0x7fe67415e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.3:51994/0 (socket says 172.21.15.3:51994) 2023-10-08T15:42:27.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.669+0000 7fe6737fe700 1 -- 172.21.15.3:0/3694409894 learned_addr learned my addr 172.21.15.3:0/3694409894 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:27.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.669+0000 7fe672ffd700 1 --2- 172.21.15.3:0/3694409894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6740a1200 0x7fe674141f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:27.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.669+0000 7fe6737fe700 1 -- 172.21.15.3:0/3694409894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6740a1200 msgr2=0x7fe674141f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:27.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.669+0000 7fe6737fe700 1 --2- 172.21.15.3:0/3694409894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6740a1200 0x7fe674141f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:27.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.669+0000 7fe6737fe700 1 -- 172.21.15.3:0/3694409894 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe67414b6d0 msgr2=0x7fe674142450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:27.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.669+0000 7fe6737fe700 1 --2- 172.21.15.3:0/3694409894 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe67414b6d0 0x7fe674142450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:27.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.669+0000 7fe6737fe700 1 -- 172.21.15.3:0/3694409894 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6640094f0 con 0x7fe674069920 2023-10-08T15:42:27.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.669+0000 7fe673fff700 1 --2- 172.21.15.3:0/3694409894 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe67414b6d0 0x7fe674142450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:42:27.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.669+0000 7fe6737fe700 1 --2- 172.21.15.3:0/3694409894 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe674069920 0x7fe67415e720 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe65c00e960 tx=0x7fe65c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:27.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.669+0000 7fe66b7fe700 1 -- 172.21.15.3:0/3694409894 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65c013680 con 0x7fe674069920 2023-10-08T15:42:27.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.669+0000 7fe66b7fe700 1 -- 172.21.15.3:0/3694409894 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe65c0137e0 con 0x7fe674069920 2023-10-08T15:42:27.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.669+0000 7fe678c9e700 1 -- 172.21.15.3:0/3694409894 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe67414fa50 con 0x7fe674069920 2023-10-08T15:42:27.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.669+0000 7fe66b7fe700 1 -- 172.21.15.3:0/3694409894 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65c013b80 con 0x7fe674069920 2023-10-08T15:42:27.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.673+0000 7fe678c9e700 1 -- 172.21.15.3:0/3694409894 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe67414b180 con 0x7fe674069920 2023-10-08T15:42:27.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.673+0000 7fe678c9e700 1 -- 172.21.15.3:0/3694409894 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe67405ecf0 con 0x7fe674069920 2023-10-08T15:42:27.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.673+0000 7fe66b7fe700 1 -- 172.21.15.3:0/3694409894 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe65c0253d0 con 0x7fe674069920 2023-10-08T15:42:27.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.673+0000 7fe66b7fe700 1 --2- 172.21.15.3:0/3694409894 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe654060550 0x7fe654062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:27.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.673+0000 7fe66b7fe700 1 -- 172.21.15.3:0/3694409894 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fe65c07cd50 con 0x7fe674069920 2023-10-08T15:42:27.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.673+0000 7fe672ffd700 1 --2- 172.21.15.3:0/3694409894 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe654060550 0x7fe654062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:27.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.677+0000 7fe672ffd700 1 --2- 172.21.15.3:0/3694409894 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe654060550 0x7fe654062a00 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fe6640099b0 tx=0x7fe664017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:27.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.685+0000 7fe66b7fe700 1 -- 172.21.15.3:0/3694409894 <== mon.2 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe65c04d670 con 0x7fe674069920 2023-10-08T15:42:27.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:27.845+0000 7fe678c9e700 1 -- 172.21.15.3:0/3694409894 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fe674147980 con 0x7fe674069920 2023-10-08T15:42:28.269 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.261+0000 7fe66b7fe700 1 -- 172.21.15.3:0/3694409894 <== mon.2 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v68) v1 ==== 138+0+0 (secure 0 0 0) 0x7fe65c0170b0 con 0x7fe674069920 2023-10-08T15:42:28.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.273+0000 7fe678c9e700 1 -- 172.21.15.3:0/3694409894 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe654060550 msgr2=0x7fe654062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:28.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.273+0000 7fe678c9e700 1 --2- 172.21.15.3:0/3694409894 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe654060550 0x7fe654062a00 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fe6640099b0 tx=0x7fe664017000 comp rx=0 tx=0).stop 2023-10-08T15:42:28.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.273+0000 7fe678c9e700 1 -- 172.21.15.3:0/3694409894 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe674069920 msgr2=0x7fe67415e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:28.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.273+0000 7fe678c9e700 1 --2- 172.21.15.3:0/3694409894 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe674069920 0x7fe67415e720 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe65c00e960 tx=0x7fe65c0091a0 comp rx=0 tx=0).stop 2023-10-08T15:42:28.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.273+0000 7fe678c9e700 1 -- 172.21.15.3:0/3694409894 shutdown_connections 2023-10-08T15:42:28.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.273+0000 7fe678c9e700 1 --2- 172.21.15.3:0/3694409894 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fe654060550 0x7fe654062a00 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:28.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.273+0000 7fe678c9e700 1 --2- 172.21.15.3:0/3694409894 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe67414b6d0 0x7fe674142450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:28.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.273+0000 7fe678c9e700 1 --2- 172.21.15.3:0/3694409894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6740a1200 0x7fe674141f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:28.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.273+0000 7fe678c9e700 1 --2- 172.21.15.3:0/3694409894 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe674069920 0x7fe67415e720 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:28.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.273+0000 7fe678c9e700 1 -- 172.21.15.3:0/3694409894 >> 172.21.15.3:0/3694409894 conn(0x7fe6740a18a0 msgr2=0x7fe674144840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:28.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.273+0000 7fe678c9e700 1 -- 172.21.15.3:0/3694409894 shutdown_connections 2023-10-08T15:42:28.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.273+0000 7fe678c9e700 1 -- 172.21.15.3:0/3694409894 wait complete. 2023-10-08T15:42:28.280 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'cephfs_metadata' created 2023-10-08T15:42:28.292 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T15:42:28.407 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.401+0000 7f4bb711b700 1 Processor -- start 2023-10-08T15:42:28.408 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.401+0000 7f4bb711b700 1 -- start start 2023-10-08T15:42:28.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.401+0000 7f4bb711b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4bb014b6d0 0x7f4bb0068d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:28.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.401+0000 7f4bb711b700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f4bb0069920 0x7f4bb006c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:28.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.401+0000 7f4bb711b700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bb00692a0 con 0x7f4bb00a1200 2023-10-08T15:42:28.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.401+0000 7f4bb711b700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bb00694d0 con 0x7f4bb0069920 2023-10-08T15:42:28.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.401+0000 7f4bb711b700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb014bed0 con 0x7f4bb014b6d0 2023-10-08T15:42:28.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.401+0000 7f4bb5918700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f4bb0069920 0x7f4bb006c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:28.410 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.401+0000 7f4bb5918700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f4bb0069920 0x7f4bb006c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57078/0 (socket says 172.21.15.3:57078) 2023-10-08T15:42:28.410 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.401+0000 7f4bb5918700 1 -- 172.21.15.3:0/859601473 learned_addr learned my addr 172.21.15.3:0/859601473 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:28.410 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.401+0000 7f4bb6119700 1 --2- 172.21.15.3:0/859601473 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4bb014b6d0 0x7f4bb0068d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:28.411 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.401+0000 7f4bb5918700 1 -- 172.21.15.3:0/859601473 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4bb014b6d0 msgr2=0x7f4bb0068d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:28.411 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.401+0000 7f4bb5918700 1 --2- 172.21.15.3:0/859601473 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4bb014b6d0 0x7f4bb0068d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:28.412 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.405+0000 7f4bb5918700 1 -- 172.21.15.3:0/859601473 >> v1:172.21.15.50:6789/0 conn(0x7f4bb00a1200 legacy=0x7f4bb006ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:28.412 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.405+0000 7f4bb5918700 1 -- 172.21.15.3:0/859601473 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb014c170 con 0x7f4bb0069920 2023-10-08T15:42:28.412 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.405+0000 7f4bb5918700 1 --2- 172.21.15.3:0/859601473 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4bb0069920 0x7f4bb006c990 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f4bac0099b0 tx=0x7f4bac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7440ef42d53631dc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:28.412 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.405+0000 7f4bb5117700 1 -- 172.21.15.3:0/859601473 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bac009ea0 con 0x7f4bb0069920 2023-10-08T15:42:28.412 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.405+0000 7f4bb5117700 1 -- 172.21.15.3:0/859601473 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bac00b860 con 0x7f4bb0069920 2023-10-08T15:42:28.412 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.405+0000 7f4bb5117700 1 -- 172.21.15.3:0/859601473 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bac00bc00 con 0x7f4bb0069920 2023-10-08T15:42:28.412 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.405+0000 7f4bb711b700 1 -- 172.21.15.3:0/859601473 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4bb0069920 msgr2=0x7f4bb006c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:28.412 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.405+0000 7f4bb711b700 1 --2- 172.21.15.3:0/859601473 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4bb0069920 0x7f4bb006c990 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f4bac0099b0 tx=0x7f4bac009250 comp rx=0 tx=0).stop 2023-10-08T15:42:28.412 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.405+0000 7f4bb711b700 1 -- 172.21.15.3:0/859601473 shutdown_connections 2023-10-08T15:42:28.412 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.405+0000 7f4bb711b700 1 --2- 172.21.15.3:0/859601473 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4bb0069920 0x7f4bb006c990 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:28.413 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.405+0000 7f4bb711b700 1 --2- 172.21.15.3:0/859601473 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4bb014b6d0 0x7f4bb0068d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:28.413 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.405+0000 7f4bb711b700 1 -- 172.21.15.3:0/859601473 >> 172.21.15.3:0/859601473 conn(0x7f4bb00a18a0 msgr2=0x7f4bb00a1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:28.413 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.405+0000 7f4bb711b700 1 -- 172.21.15.3:0/859601473 shutdown_connections 2023-10-08T15:42:28.413 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.405+0000 7f4bb711b700 1 -- 172.21.15.3:0/859601473 wait complete. 2023-10-08T15:42:28.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.405+0000 7f4bb711b700 1 Processor -- start 2023-10-08T15:42:28.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.405+0000 7f4bb711b700 1 -- start start 2023-10-08T15:42:28.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.405+0000 7f4bb711b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bb0069920 0x7f4bb0149da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:28.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.405+0000 7f4bb711b700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4bb00a1200 0x7f4bb0148bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:28.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.405+0000 7f4bb711b700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4bb014b6d0 0x7f4bb015bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:28.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.405+0000 7f4bb711b700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb014a7a0 con 0x7f4bb014b6d0 2023-10-08T15:42:28.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.405+0000 7f4bb711b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb013eee0 con 0x7f4bb0069920 2023-10-08T15:42:28.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.405+0000 7f4bb711b700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb0145680 con 0x7f4bb00a1200 2023-10-08T15:42:28.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.405+0000 7f4bb691a700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4bb014b6d0 0x7f4bb015bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:28.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.405+0000 7f4bb691a700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4bb014b6d0 0x7f4bb015bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57092/0 (socket says 172.21.15.3:57092) 2023-10-08T15:42:28.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.405+0000 7f4bb691a700 1 -- 172.21.15.3:0/927408485 learned_addr learned my addr 172.21.15.3:0/927408485 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:28.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.405+0000 7f4bb5918700 1 --2- 172.21.15.3:0/927408485 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4bb00a1200 0x7f4bb0148bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:28.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.405+0000 7f4bb6119700 1 --2- 172.21.15.3:0/927408485 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bb0069920 0x7f4bb0149da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:28.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.409+0000 7f4bb691a700 1 -- 172.21.15.3:0/927408485 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4bb00a1200 msgr2=0x7f4bb0148bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:28.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.409+0000 7f4bb691a700 1 --2- 172.21.15.3:0/927408485 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4bb00a1200 0x7f4bb0148bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:28.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.409+0000 7f4bb691a700 1 -- 172.21.15.3:0/927408485 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bb0069920 msgr2=0x7f4bb0149da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:28.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.409+0000 7f4bb691a700 1 --2- 172.21.15.3:0/927408485 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bb0069920 0x7f4bb0149da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:28.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.409+0000 7f4bb691a700 1 -- 172.21.15.3:0/927408485 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bac0094f0 con 0x7f4bb014b6d0 2023-10-08T15:42:28.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.409+0000 7f4bb6119700 1 --2- 172.21.15.3:0/927408485 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bb0069920 0x7f4bb0149da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:42:28.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.409+0000 7f4bb691a700 1 --2- 172.21.15.3:0/927408485 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4bb014b6d0 0x7f4bb015bc60 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f4ba800c910 tx=0x7f4ba80016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:28.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.409+0000 7f4ba27fc700 1 -- 172.21.15.3:0/927408485 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba8012630 con 0x7f4bb014b6d0 2023-10-08T15:42:28.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.409+0000 7f4ba27fc700 1 -- 172.21.15.3:0/927408485 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ba80127b0 con 0x7f4bb014b6d0 2023-10-08T15:42:28.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.409+0000 7f4bb711b700 1 -- 172.21.15.3:0/927408485 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bb013f1a0 con 0x7f4bb014b6d0 2023-10-08T15:42:28.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.409+0000 7f4ba27fc700 1 -- 172.21.15.3:0/927408485 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba8012b70 con 0x7f4bb014b6d0 2023-10-08T15:42:28.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.409+0000 7f4bb711b700 1 -- 172.21.15.3:0/927408485 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bb0149100 con 0x7f4bb014b6d0 2023-10-08T15:42:28.419 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.409+0000 7f4bb711b700 1 -- 172.21.15.3:0/927408485 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bb014a8e0 con 0x7f4bb014b6d0 2023-10-08T15:42:28.419 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.413+0000 7f4ba27fc700 1 -- 172.21.15.3:0/927408485 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4ba800a3b0 con 0x7f4bb014b6d0 2023-10-08T15:42:28.419 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.413+0000 7f4ba27fc700 1 --2- 172.21.15.3:0/927408485 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4b94060550 0x7f4b94062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:28.419 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.413+0000 7f4ba27fc700 1 -- 172.21.15.3:0/927408485 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f4ba807c820 con 0x7f4bb014b6d0 2023-10-08T15:42:28.419 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.413+0000 7f4bb6119700 1 --2- 172.21.15.3:0/927408485 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4b94060550 0x7f4b94062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:28.420 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.413+0000 7f4bb6119700 1 --2- 172.21.15.3:0/927408485 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4b94060550 0x7f4b94062a00 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4ba4009ce0 tx=0x7f4ba4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:28.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.421+0000 7f4ba27fc700 1 -- 172.21.15.3:0/927408485 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4bb014a8e0 con 0x7f4bb014b6d0 2023-10-08T15:42:28.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:28.585+0000 7f4bb711b700 1 -- 172.21.15.3:0/927408485 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f4bb014a8e0 con 0x7f4bb014b6d0 2023-10-08T15:42:29.273 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.265+0000 7f4ba27fc700 1 -- 172.21.15.3:0/927408485 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v69) v1 ==== 170+0+0 (secure 0 0 0) 0x7f4bb014a8e0 con 0x7f4bb014b6d0 2023-10-08T15:42:29.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.281+0000 7f4bb711b700 1 -- 172.21.15.3:0/927408485 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4b94060550 msgr2=0x7f4b94062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:29.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.281+0000 7f4bb711b700 1 --2- 172.21.15.3:0/927408485 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4b94060550 0x7f4b94062a00 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4ba4009ce0 tx=0x7f4ba4008040 comp rx=0 tx=0).stop 2023-10-08T15:42:29.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.281+0000 7f4bb711b700 1 -- 172.21.15.3:0/927408485 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4bb014b6d0 msgr2=0x7f4bb015bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:29.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.281+0000 7f4bb711b700 1 --2- 172.21.15.3:0/927408485 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4bb014b6d0 0x7f4bb015bc60 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f4ba800c910 tx=0x7f4ba80016f0 comp rx=0 tx=0).stop 2023-10-08T15:42:29.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.285+0000 7f4bb711b700 1 -- 172.21.15.3:0/927408485 shutdown_connections 2023-10-08T15:42:29.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.285+0000 7f4bb711b700 1 --2- 172.21.15.3:0/927408485 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f4b94060550 0x7f4b94062a00 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:29.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.285+0000 7f4bb711b700 1 --2- 172.21.15.3:0/927408485 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4bb014b6d0 0x7f4bb015bc60 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:29.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.285+0000 7f4bb711b700 1 --2- 172.21.15.3:0/927408485 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4bb00a1200 0x7f4bb0148bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:29.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.285+0000 7f4bb711b700 1 --2- 172.21.15.3:0/927408485 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bb0069920 0x7f4bb0149da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:29.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.285+0000 7f4bb711b700 1 -- 172.21.15.3:0/927408485 >> 172.21.15.3:0/927408485 conn(0x7f4bb00a18a0 msgr2=0x7f4bb014de60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:29.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.285+0000 7f4bb711b700 1 -- 172.21.15.3:0/927408485 shutdown_connections 2023-10-08T15:42:29.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.285+0000 7f4bb711b700 1 -- 172.21.15.3:0/927408485 wait complete. 2023-10-08T15:42:29.299 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'cephfs_data' created 2023-10-08T15:42:29.312 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T15:42:29.427 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.421+0000 7f391a086700 1 Processor -- start 2023-10-08T15:42:29.427 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.421+0000 7f391a086700 1 -- start start 2023-10-08T15:42:29.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.421+0000 7f391a086700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f391414c570 0x7f39140bc370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:29.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.421+0000 7f391a086700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39140b2370 con 0x7f39140bbfa0 2023-10-08T15:42:29.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.421+0000 7f391a086700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39140b2f10 con 0x7f391406ed20 2023-10-08T15:42:29.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.421+0000 7f391a086700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f391414ca00 con 0x7f391414c570 2023-10-08T15:42:29.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.421+0000 7f39137fe700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f39140bbfa0 0x7f39140b2800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:59190/0 (socket says 172.21.15.3:59190) 2023-10-08T15:42:29.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.421+0000 7f39137fe700 1 -- 172.21.15.3:0/1789630925 learned_addr learned my addr 172.21.15.3:0/1789630925 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:42:29.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.421+0000 7f390bfff700 1 --2- 172.21.15.3:0/1789630925 >> v2:172.21.15.50:3300/0 conn(0x7f391414c570 0x7f39140bc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:29.430 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.421+0000 7f3912ffd700 1 -- 172.21.15.3:0/1789630925 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2380320505 0 0) 0x7f39140b2370 con 0x7f39140bbfa0 2023-10-08T15:42:29.430 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.421+0000 7f3912ffd700 1 -- 172.21.15.3:0/1789630925 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3900003570 con 0x7f39140bbfa0 2023-10-08T15:42:29.431 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.425+0000 7f390bfff700 1 -- 172.21.15.3:0/1789630925 >> v1:172.21.15.50:6789/0 conn(0x7f391406ed20 legacy=0x7f3914147ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:29.431 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.425+0000 7f390bfff700 1 -- 172.21.15.3:0/1789630925 >> v1:172.21.15.3:6789/0 conn(0x7f39140bbfa0 legacy=0x7f39140b2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:29.431 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.425+0000 7f390bfff700 1 -- 172.21.15.3:0/1789630925 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39140b2000 con 0x7f391414c570 2023-10-08T15:42:29.431 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.425+0000 7f390bfff700 1 --2- 172.21.15.3:0/1789630925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f391414c570 0x7f39140bc370 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f38fc0098e0 tx=0x7f38fc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d0f70670cfc365a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:29.431 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.425+0000 7f3912ffd700 1 -- 172.21.15.3:0/1789630925 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38fc00f6b0 con 0x7f391414c570 2023-10-08T15:42:29.431 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.425+0000 7f3912ffd700 1 -- 172.21.15.3:0/1789630925 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38fc00f810 con 0x7f391414c570 2023-10-08T15:42:29.431 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.425+0000 7f3912ffd700 1 -- 172.21.15.3:0/1789630925 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38fc00fbb0 con 0x7f391414c570 2023-10-08T15:42:29.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.425+0000 7f391a086700 1 -- 172.21.15.3:0/1789630925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f391414c570 msgr2=0x7f39140bc370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:29.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.425+0000 7f391a086700 1 --2- 172.21.15.3:0/1789630925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f391414c570 0x7f39140bc370 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f38fc0098e0 tx=0x7f38fc0091a0 comp rx=0 tx=0).stop 2023-10-08T15:42:29.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.425+0000 7f391a086700 1 -- 172.21.15.3:0/1789630925 shutdown_connections 2023-10-08T15:42:29.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.425+0000 7f391a086700 1 --2- 172.21.15.3:0/1789630925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f391414c570 0x7f39140bc370 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:29.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.425+0000 7f391a086700 1 -- 172.21.15.3:0/1789630925 >> 172.21.15.3:0/1789630925 conn(0x7f39140bf870 msgr2=0x7f39140bb890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:29.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.425+0000 7f391a086700 1 -- 172.21.15.3:0/1789630925 shutdown_connections 2023-10-08T15:42:29.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.425+0000 7f391a086700 1 -- 172.21.15.3:0/1789630925 wait complete. 2023-10-08T15:42:29.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.425+0000 7f391a086700 1 Processor -- start 2023-10-08T15:42:29.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.425+0000 7f391a086700 1 -- start start 2023-10-08T15:42:29.435 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.429+0000 7f391a086700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f391406ed20 0x7f39140ba810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:29.435 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.429+0000 7f391a086700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f39140bbfa0 0x7f3914144450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:29.435 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.429+0000 7f391a086700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f391414c570 0x7f391413bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:29.435 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.429+0000 7f391a086700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3914144990 con 0x7f391406ed20 2023-10-08T15:42:29.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.429+0000 7f391a086700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f391415c340 con 0x7f391414c570 2023-10-08T15:42:29.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.429+0000 7f391a086700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f391415c030 con 0x7f39140bbfa0 2023-10-08T15:42:29.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.429+0000 7f39137fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f391406ed20 0x7f39140ba810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:29.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.429+0000 7f39137fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f391406ed20 0x7f39140ba810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57104/0 (socket says 172.21.15.3:57104) 2023-10-08T15:42:29.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.429+0000 7f39137fe700 1 -- 172.21.15.3:0/1206358921 learned_addr learned my addr 172.21.15.3:0/1206358921 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:29.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.429+0000 7f390bfff700 1 --2- 172.21.15.3:0/1206358921 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f39140bbfa0 0x7f3914144450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:29.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.429+0000 7f3913fff700 1 --2- 172.21.15.3:0/1206358921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f391414c570 0x7f391413bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:29.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.429+0000 7f39137fe700 1 -- 172.21.15.3:0/1206358921 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f39140bbfa0 msgr2=0x7f3914144450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:29.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.429+0000 7f39137fe700 1 --2- 172.21.15.3:0/1206358921 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f39140bbfa0 0x7f3914144450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:29.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.429+0000 7f39137fe700 1 -- 172.21.15.3:0/1206358921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f391414c570 msgr2=0x7f391413bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:29.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.429+0000 7f39137fe700 1 --2- 172.21.15.3:0/1206358921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f391414c570 0x7f391413bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:29.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.429+0000 7f39137fe700 1 -- 172.21.15.3:0/1206358921 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38fc009420 con 0x7f391406ed20 2023-10-08T15:42:29.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.429+0000 7f39137fe700 1 --2- 172.21.15.3:0/1206358921 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f391406ed20 0x7f39140ba810 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f390400c7c0 tx=0x7f3904007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:29.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.429+0000 7f390b7fe700 1 -- 172.21.15.3:0/1206358921 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3904005cd0 con 0x7f391406ed20 2023-10-08T15:42:29.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.429+0000 7f390b7fe700 1 -- 172.21.15.3:0/1206358921 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3904005e30 con 0x7f391406ed20 2023-10-08T15:42:29.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.429+0000 7f391a086700 1 -- 172.21.15.3:0/1206358921 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39141451c0 con 0x7f391406ed20 2023-10-08T15:42:29.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.429+0000 7f390b7fe700 1 -- 172.21.15.3:0/1206358921 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3904007320 con 0x7f391406ed20 2023-10-08T15:42:29.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.429+0000 7f391a086700 1 -- 172.21.15.3:0/1206358921 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f391413cda0 con 0x7f391406ed20 2023-10-08T15:42:29.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.433+0000 7f391a086700 1 -- 172.21.15.3:0/1206358921 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3914064530 con 0x7f391406ed20 2023-10-08T15:42:29.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.433+0000 7f390b7fe700 1 -- 172.21.15.3:0/1206358921 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f390401b3b0 con 0x7f391406ed20 2023-10-08T15:42:29.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.433+0000 7f390b7fe700 1 --2- 172.21.15.3:0/1206358921 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f38f4060580 0x7f38f4062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:29.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.437+0000 7f390b7fe700 1 -- 172.21.15.3:0/1206358921 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f390407c1e0 con 0x7f391406ed20 2023-10-08T15:42:29.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.437+0000 7f390bfff700 1 --2- 172.21.15.3:0/1206358921 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f38f4060580 0x7f38f4062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:29.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.437+0000 7f390bfff700 1 --2- 172.21.15.3:0/1206358921 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f38f4060580 0x7f38f4062a30 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f38fc0093f0 tx=0x7f38fc019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:29.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.441+0000 7f390b7fe700 1 -- 172.21.15.3:0/1206358921 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f390404c890 con 0x7f391406ed20 2023-10-08T15:42:29.647 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:29.641+0000 7f391a086700 1 -- 172.21.15.3:0/1206358921 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f39140ba430 con 0x7f391406ed20 2023-10-08T15:42:30.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.325+0000 7f390b7fe700 1 -- 172.21.15.3:0/1206358921 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v37) v1 ==== 174+0+0 (secure 0 0 0) 0x7f39040170c0 con 0x7f391406ed20 2023-10-08T15:42:30.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.337+0000 7f391a086700 1 -- 172.21.15.3:0/1206358921 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f38f4060580 msgr2=0x7f38f4062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:30.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.337+0000 7f391a086700 1 --2- 172.21.15.3:0/1206358921 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f38f4060580 0x7f38f4062a30 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f38fc0093f0 tx=0x7f38fc019000 comp rx=0 tx=0).stop 2023-10-08T15:42:30.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.341+0000 7f391a086700 1 -- 172.21.15.3:0/1206358921 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f391406ed20 msgr2=0x7f39140ba810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:30.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.345+0000 7f391a086700 1 --2- 172.21.15.3:0/1206358921 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f391406ed20 0x7f39140ba810 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f390400c7c0 tx=0x7f3904007e00 comp rx=0 tx=0).stop 2023-10-08T15:42:30.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.345+0000 7f391a086700 1 -- 172.21.15.3:0/1206358921 shutdown_connections 2023-10-08T15:42:30.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.345+0000 7f391a086700 1 --2- 172.21.15.3:0/1206358921 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f38f4060580 0x7f38f4062a30 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:30.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.345+0000 7f391a086700 1 --2- 172.21.15.3:0/1206358921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f391414c570 0x7f391413bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:30.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.345+0000 7f391a086700 1 --2- 172.21.15.3:0/1206358921 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f39140bbfa0 0x7f3914144450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:30.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.345+0000 7f391a086700 1 --2- 172.21.15.3:0/1206358921 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f391406ed20 0x7f39140ba810 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:30.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.345+0000 7f391a086700 1 -- 172.21.15.3:0/1206358921 >> 172.21.15.3:0/1206358921 conn(0x7f39140bf870 msgr2=0x7f3914148640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:30.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.345+0000 7f391a086700 1 -- 172.21.15.3:0/1206358921 shutdown_connections 2023-10-08T15:42:30.352 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.345+0000 7f391a086700 1 -- 172.21.15.3:0/1206358921 wait complete. 2023-10-08T15:42:30.356 INFO:teuthology.orchestra.run.smithi003.stderr:new fs with metadata pool 12 and data pool 13 2023-10-08T15:42:30.369 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:42:30.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.457+0000 7f5758dd8700 1 Processor -- start 2023-10-08T15:42:30.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.457+0000 7f5758dd8700 1 -- start start 2023-10-08T15:42:30.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.457+0000 7f5758dd8700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f575406be60 0x7f575414b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:30.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.457+0000 7f5758dd8700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f575406cc40 0x7f575414cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:30.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.457+0000 7f5758dd8700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f575414c6b0 con 0x7f575414ac50 2023-10-08T15:42:30.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.457+0000 7f5758dd8700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f575414c060 con 0x7f575406cc40 2023-10-08T15:42:30.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.457+0000 7f5758dd8700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f575414c340 con 0x7f575406be60 2023-10-08T15:42:30.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.461+0000 7f5753fff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f575406cc40 0x7f575414cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:30.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.461+0000 7f5753fff700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f575406cc40 0x7f575414cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57120/0 (socket says 172.21.15.3:57120) 2023-10-08T15:42:30.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.461+0000 7f5752ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f575406be60 0x7f575414b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:30.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.461+0000 7f5753fff700 1 -- 172.21.15.3:0/2362073568 learned_addr learned my addr 172.21.15.3:0/2362073568 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:30.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.461+0000 7f5752ffd700 1 -- 172.21.15.3:0/2362073568 >> v2:172.21.15.3:3300/0 conn(0x7f575406cc40 msgr2=0x7f575414cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:30.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.461+0000 7f5752ffd700 1 --2- 172.21.15.3:0/2362073568 >> v2:172.21.15.3:3300/0 conn(0x7f575406cc40 0x7f575414cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:30.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.461+0000 7f5752ffd700 1 -- 172.21.15.3:0/2362073568 >> v1:172.21.15.50:6789/0 conn(0x7f575414ac50 legacy=0x7f575406c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:30.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.461+0000 7f5752ffd700 1 -- 172.21.15.3:0/2362073568 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f575414e860 con 0x7f575406be60 2023-10-08T15:42:30.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.461+0000 7f57527fc700 1 -- 172.21.15.3:0/2362073568 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2968250344 0 0) 0x7f575414c6b0 con 0x7f575414ac50 2023-10-08T15:42:30.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.461+0000 7f5752ffd700 1 --2- 172.21.15.3:0/2362073568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f575406be60 0x7f575414b020 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f5754064280 tx=0x7f57480091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1fb94672fa9b986f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:30.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.461+0000 7f57527fc700 1 -- 172.21.15.3:0/2362073568 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5748011630 con 0x7f575406be60 2023-10-08T15:42:30.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.461+0000 7f57527fc700 1 -- 172.21.15.3:0/2362073568 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5748011790 con 0x7f575406be60 2023-10-08T15:42:30.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.461+0000 7f57527fc700 1 -- 172.21.15.3:0/2362073568 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5748011b30 con 0x7f575406be60 2023-10-08T15:42:30.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.461+0000 7f5758dd8700 1 -- 172.21.15.3:0/2362073568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f575406be60 msgr2=0x7f575414b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:30.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.461+0000 7f5758dd8700 1 --2- 172.21.15.3:0/2362073568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f575406be60 0x7f575414b020 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f5754064280 tx=0x7f57480091a0 comp rx=0 tx=0).stop 2023-10-08T15:42:30.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.461+0000 7f5758dd8700 1 -- 172.21.15.3:0/2362073568 shutdown_connections 2023-10-08T15:42:30.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.461+0000 7f5758dd8700 1 --2- 172.21.15.3:0/2362073568 >> v2:172.21.15.3:3300/0 conn(0x7f575406cc40 0x7f575414cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:30.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.461+0000 7f5758dd8700 1 --2- 172.21.15.3:0/2362073568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f575406be60 0x7f575414b020 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:30.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.461+0000 7f5758dd8700 1 -- 172.21.15.3:0/2362073568 >> 172.21.15.3:0/2362073568 conn(0x7f57540c1df0 msgr2=0x7f57540c21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:30.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.461+0000 7f5758dd8700 1 -- 172.21.15.3:0/2362073568 shutdown_connections 2023-10-08T15:42:30.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.461+0000 7f5758dd8700 1 -- 172.21.15.3:0/2362073568 wait complete. 2023-10-08T15:42:30.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.461+0000 7f5758dd8700 1 Processor -- start 2023-10-08T15:42:30.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.461+0000 7f5758dd8700 1 -- start start 2023-10-08T15:42:30.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.465+0000 7f5758dd8700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f575406be60 0x7f575415df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:30.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.465+0000 7f5758dd8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f575406cc40 0x7f575409b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:30.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.465+0000 7f5758dd8700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f575414ac50 0x7f57540bdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:30.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.465+0000 7f5758dd8700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f575409e4e0 con 0x7f575406be60 2023-10-08T15:42:30.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.465+0000 7f5758dd8700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f575409dd30 con 0x7f575406cc40 2023-10-08T15:42:30.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.465+0000 7f5758dd8700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f575415e760 con 0x7f575414ac50 2023-10-08T15:42:30.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.465+0000 7f5752ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f575406cc40 0x7f575409b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:30.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.465+0000 7f57537fe700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f575406be60 0x7f575415df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:30.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.465+0000 7f5752ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f575406cc40 0x7f575409b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.3:34724/0 (socket says 172.21.15.3:34724) 2023-10-08T15:42:30.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.465+0000 7f5752ffd700 1 -- 172.21.15.3:0/1994849780 learned_addr learned my addr 172.21.15.3:0/1994849780 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:30.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.465+0000 7f5753fff700 1 --2- 172.21.15.3:0/1994849780 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f575414ac50 0x7f57540bdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:30.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.465+0000 7f5752ffd700 1 -- 172.21.15.3:0/1994849780 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f575414ac50 msgr2=0x7f57540bdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:30.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.465+0000 7f5752ffd700 1 --2- 172.21.15.3:0/1994849780 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f575414ac50 0x7f57540bdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:30.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.465+0000 7f5752ffd700 1 -- 172.21.15.3:0/1994849780 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f575406be60 msgr2=0x7f575415df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:30.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.465+0000 7f5752ffd700 1 --2- 172.21.15.3:0/1994849780 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f575406be60 0x7f575415df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:30.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.465+0000 7f5752ffd700 1 -- 172.21.15.3:0/1994849780 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5748009420 con 0x7f575406cc40 2023-10-08T15:42:30.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.465+0000 7f57537fe700 1 --2- 172.21.15.3:0/1994849780 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f575406be60 0x7f575415df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:42:30.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.465+0000 7f5752ffd700 1 --2- 172.21.15.3:0/1994849780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f575406cc40 0x7f575409b8f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f574801af50 tx=0x7f5748017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:30.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.465+0000 7f573b7fe700 1 -- 172.21.15.3:0/1994849780 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f574801f070 con 0x7f575406cc40 2023-10-08T15:42:30.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.465+0000 7f573b7fe700 1 -- 172.21.15.3:0/1994849780 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5748000bc0 con 0x7f575406cc40 2023-10-08T15:42:30.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.465+0000 7f5758dd8700 1 -- 172.21.15.3:0/1994849780 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f575415e4a0 con 0x7f575406cc40 2023-10-08T15:42:30.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.465+0000 7f573b7fe700 1 -- 172.21.15.3:0/1994849780 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5748025420 con 0x7f575406cc40 2023-10-08T15:42:30.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.465+0000 7f5758dd8700 1 -- 172.21.15.3:0/1994849780 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5754152750 con 0x7f575406cc40 2023-10-08T15:42:30.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.469+0000 7f5758dd8700 1 -- 172.21.15.3:0/1994849780 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f575409d280 con 0x7f575406cc40 2023-10-08T15:42:30.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.469+0000 7f573b7fe700 1 -- 172.21.15.3:0/1994849780 <== mon.1 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5748023070 con 0x7f575406cc40 2023-10-08T15:42:30.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.469+0000 7f573b7fe700 1 --2- 172.21.15.3:0/1994849780 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5740060550 0x7f5740062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:30.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.469+0000 7f573b7fe700 1 -- 172.21.15.3:0/1994849780 <== mon.1 v2:172.21.15.50:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f574807db50 con 0x7f575406cc40 2023-10-08T15:42:30.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.469+0000 7f57537fe700 1 --2- 172.21.15.3:0/1994849780 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5740060550 0x7f5740062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:30.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.469+0000 7f57537fe700 1 --2- 172.21.15.3:0/1994849780 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5740060550 0x7f5740062a00 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f5744001d80 tx=0x7f5744009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:30.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.477+0000 7f573b7fe700 1 -- 172.21.15.3:0/1994849780 <== mon.1 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f574804e0e0 con 0x7f575406cc40 2023-10-08T15:42:30.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.641+0000 7f5758dd8700 1 -- 172.21.15.3:0/1994849780 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f575415e8a0 con 0x7f575406cc40 2023-10-08T15:42:30.650 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.649+0000 7f573b7fe700 1 -- 172.21.15.3:0/1994849780 <== mon.1 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) v1 ==== 74+0+15270 (secure 0 0 0) 0x7f575415e8a0 con 0x7f575406cc40 2023-10-08T15:42:30.651 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:42:30.651 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":70,"fsid":"7635972e-cd66-4a8f-a231-378db8b3847a","created":"2023-10-08T15:37:08.234594+0000","modified":"2023-10-08T15:42:29.646978+0000","last_up_change":"2023-10-08T15:37:17.537726+0000","last_in_change":"2023-10-08T15:37:10.269178+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:37:16.581590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:42:27.890694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-08T15:42:28.634350+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"64fb1864-bfdd-4d75-9b41-03fb60085dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33363},{"type":"v1","addr":"172.21.15.3:6801","nonce":33363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33363},{"type":"v1","addr":"172.21.15.3:6803","nonce":33363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":33363},{"type":"v1","addr":"172.21.15.3:6807","nonce":33363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33363},{"type":"v1","addr":"172.21.15.3:6805","nonce":33363}]},"public_addr":"172.21.15.3:6801/33363","cluster_addr":"172.21.15.3:6803/33363","heartbeat_back_addr":"172.21.15.3:6807/33363","heartbeat_front_addr":"172.21.15.3:6805/33363","state":["exists","up"]},{"osd":1,"uuid":"3ca6bd3a-3e8a-4c65-af9c-46148b0c2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33364},{"type":"v1","addr":"172.21.15.3:6820","nonce":33364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33364},{"type":"v1","addr":"172.21.15.3:6824","nonce":33364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33364},{"type":"v1","addr":"172.21.15.3:6831","nonce":33364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33364},{"type":"v1","addr":"172.21.15.3:6828","nonce":33364}]},"public_addr":"172.21.15.3:6820/33364","cluster_addr":"172.21.15.3:6824/33364","heartbeat_back_addr":"172.21.15.3:6831/33364","heartbeat_front_addr":"172.21.15.3:6828/33364","state":["exists","up"]},{"osd":2,"uuid":"6eb9f757-58dd-442f-910d-32401454bce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33366},{"type":"v1","addr":"172.21.15.3:6817","nonce":33366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":33366},{"type":"v1","addr":"172.21.15.3:6821","nonce":33366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6827","nonce":33366},{"type":"v1","addr":"172.21.15.3:6829","nonce":33366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":33366},{"type":"v1","addr":"172.21.15.3:6825","nonce":33366}]},"public_addr":"172.21.15.3:6817/33366","cluster_addr":"172.21.15.3:6821/33366","heartbeat_back_addr":"172.21.15.3:6829/33366","heartbeat_front_addr":"172.21.15.3:6825/33366","state":["exists","up"]},{"osd":3,"uuid":"1c39866b-ac2e-4ea9-a69c-02b01ee4191d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33365},{"type":"v1","addr":"172.21.15.3:6809","nonce":33365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":33365},{"type":"v1","addr":"172.21.15.3:6811","nonce":33365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33365},{"type":"v1","addr":"172.21.15.3:6815","nonce":33365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":33365},{"type":"v1","addr":"172.21.15.3:6813","nonce":33365}]},"public_addr":"172.21.15.3:6809/33365","cluster_addr":"172.21.15.3:6811/33365","heartbeat_back_addr":"172.21.15.3:6815/33365","heartbeat_front_addr":"172.21.15.3:6813/33365","state":["exists","up"]},{"osd":4,"uuid":"15f86b61-b7f1-4780-ae00-9d80a68cb830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":33605},{"type":"v1","addr":"172.21.15.50:6809","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33605},{"type":"v1","addr":"172.21.15.50:6811","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33605},{"type":"v1","addr":"172.21.15.50:6815","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":33605},{"type":"v1","addr":"172.21.15.50:6813","nonce":33605}]},"public_addr":"172.21.15.50:6809/33605","cluster_addr":"172.21.15.50:6811/33605","heartbeat_back_addr":"172.21.15.50:6815/33605","heartbeat_front_addr":"172.21.15.50:6813/33605","state":["exists","up"]},{"osd":5,"uuid":"726c3003-34e6-4d5a-b6e2-f911e13c2118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33606},{"type":"v1","addr":"172.21.15.50:6801","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33606},{"type":"v1","addr":"172.21.15.50:6803","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33606},{"type":"v1","addr":"172.21.15.50:6807","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":33606},{"type":"v1","addr":"172.21.15.50:6805","nonce":33606}]},"public_addr":"172.21.15.50:6801/33606","cluster_addr":"172.21.15.50:6803/33606","heartbeat_back_addr":"172.21.15.50:6807/33606","heartbeat_front_addr":"172.21.15.50:6805/33606","state":["exists","up"]},{"osd":6,"uuid":"401122a4-9988-441f-a5a7-39164434ebcd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":33607},{"type":"v1","addr":"172.21.15.50:6819","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":33607},{"type":"v1","addr":"172.21.15.50:6823","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":33607},{"type":"v1","addr":"172.21.15.50:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":33607},{"type":"v1","addr":"172.21.15.50:6827","nonce":33607}]},"public_addr":"172.21.15.50:6819/33607","cluster_addr":"172.21.15.50:6823/33607","heartbeat_back_addr":"172.21.15.50:6831/33607","heartbeat_front_addr":"172.21.15.50:6827/33607","state":["exists","up"]},{"osd":7,"uuid":"6b3fa236-c9d0-4c4d-82ae-9af4daf6d699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33604},{"type":"v1","addr":"172.21.15.50:6818","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":33604},{"type":"v1","addr":"172.21.15.50:6822","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":33604},{"type":"v1","addr":"172.21.15.50:6830","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":33604},{"type":"v1","addr":"172.21.15.50:6826","nonce":33604}]},"public_addr":"172.21.15.50:6818/33604","cluster_addr":"172.21.15.50:6822/33604","heartbeat_back_addr":"172.21.15.50:6830/33604","heartbeat_front_addr":"172.21.15.50:6826/33604","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.497794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.529417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.873426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.325972+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.443971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.240795+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.739632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.643026+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:42:30.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.649+0000 7f5758dd8700 1 -- 172.21.15.3:0/1994849780 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5740060550 msgr2=0x7f5740062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:30.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.649+0000 7f5758dd8700 1 --2- 172.21.15.3:0/1994849780 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5740060550 0x7f5740062a00 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f5744001d80 tx=0x7f5744009040 comp rx=0 tx=0).stop 2023-10-08T15:42:30.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.649+0000 7f5758dd8700 1 -- 172.21.15.3:0/1994849780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f575406cc40 msgr2=0x7f575409b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:30.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.649+0000 7f5758dd8700 1 --2- 172.21.15.3:0/1994849780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f575406cc40 0x7f575409b8f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f574801af50 tx=0x7f5748017000 comp rx=0 tx=0).stop 2023-10-08T15:42:30.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.649+0000 7f5758dd8700 1 -- 172.21.15.3:0/1994849780 shutdown_connections 2023-10-08T15:42:30.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.649+0000 7f5758dd8700 1 --2- 172.21.15.3:0/1994849780 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f5740060550 0x7f5740062a00 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:30.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.649+0000 7f5758dd8700 1 --2- 172.21.15.3:0/1994849780 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f575414ac50 0x7f57540bdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:30.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.649+0000 7f5758dd8700 1 --2- 172.21.15.3:0/1994849780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f575406cc40 0x7f575409b8f0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:30.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.649+0000 7f5758dd8700 1 --2- 172.21.15.3:0/1994849780 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f575406be60 0x7f575415df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:30.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.649+0000 7f5758dd8700 1 -- 172.21.15.3:0/1994849780 >> 172.21.15.3:0/1994849780 conn(0x7f57540c1df0 msgr2=0x7f575406ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:30.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.649+0000 7f5758dd8700 1 -- 172.21.15.3:0/1994849780 shutdown_connections 2023-10-08T15:42:30.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.649+0000 7f5758dd8700 1 -- 172.21.15.3:0/1994849780 wait complete. 2023-10-08T15:42:30.666 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:42:30.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.769+0000 7f2648ce4700 1 Processor -- start 2023-10-08T15:42:30.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.769+0000 7f2648ce4700 1 -- start start 2023-10-08T15:42:30.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.769+0000 7f2648ce4700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f26440bca80 0x7f26440b2340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:30.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.769+0000 7f2648ce4700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f264406cf60 0x7f2644148420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:30.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.769+0000 7f2648ce4700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f264414bde0 con 0x7f26440bce50 2023-10-08T15:42:30.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.769+0000 7f2648ce4700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f264414b920 con 0x7f26440bca80 2023-10-08T15:42:30.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.769+0000 7f2648ce4700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f264406d6f0 con 0x7f264406cf60 2023-10-08T15:42:30.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.769+0000 7f263bfff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f26440bce50 0x7f2644147d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:59194/0 (socket says 172.21.15.3:59194) 2023-10-08T15:42:30.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.769+0000 7f263bfff700 1 -- 172.21.15.3:0/3262788374 learned_addr learned my addr 172.21.15.3:0/3262788374 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:42:30.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.769+0000 7f2643fff700 1 --2- 172.21.15.3:0/3262788374 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f264406cf60 0x7f2644148420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:30.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.769+0000 7f2642ffd700 1 -- 172.21.15.3:0/3262788374 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3233740659 0 0) 0x7f264414bde0 con 0x7f26440bce50 2023-10-08T15:42:30.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.769+0000 7f26437fe700 1 --2- 172.21.15.3:0/3262788374 >> v2:172.21.15.50:3300/0 conn(0x7f26440bca80 0x7f26440b2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:30.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.769+0000 7f2642ffd700 1 -- 172.21.15.3:0/3262788374 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2630003570 con 0x7f26440bce50 2023-10-08T15:42:30.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.769+0000 7f2642ffd700 1 -- 172.21.15.3:0/3262788374 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2656344344 0 0) 0x7f2630003570 con 0x7f26440bce50 2023-10-08T15:42:30.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.769+0000 7f2642ffd700 1 -- 172.21.15.3:0/3262788374 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f264406cf60 msgr2=0x7f2644148420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:30.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.769+0000 7f2642ffd700 1 --2- 172.21.15.3:0/3262788374 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f264406cf60 0x7f2644148420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:30.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.769+0000 7f2642ffd700 1 -- 172.21.15.3:0/3262788374 >> v2:172.21.15.50:3300/0 conn(0x7f26440bca80 msgr2=0x7f26440b2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:30.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.769+0000 7f2642ffd700 1 --2- 172.21.15.3:0/3262788374 >> v2:172.21.15.50:3300/0 conn(0x7f26440bca80 0x7f26440b2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:30.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.773+0000 7f2642ffd700 1 -- 172.21.15.3:0/3262788374 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f264414bb00 con 0x7f26440bce50 2023-10-08T15:42:30.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.773+0000 7f2642ffd700 1 -- 172.21.15.3:0/3262788374 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2285686191 0 0) 0x7f262c001470 con 0x7f26440bce50 2023-10-08T15:42:30.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.773+0000 7f2642ffd700 1 -- 172.21.15.3:0/3262788374 >> v1:172.21.15.3:6789/0 conn(0x7f26440bce50 legacy=0x7f2644147d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:30.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.773+0000 7f2642ffd700 1 --2- 172.21.15.3:0/3262788374 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2630003a60 0x7f2630003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:30.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.773+0000 7f2642ffd700 1 --2- 172.21.15.3:0/3262788374 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2630004810 0x7f2630004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:30.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.773+0000 7f2642ffd700 1 --2- 172.21.15.3:0/3262788374 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f264406cf60 0x7f26300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:30.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.773+0000 7f2642ffd700 1 -- 172.21.15.3:0/3262788374 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264414b920 con 0x7f2630004810 2023-10-08T15:42:30.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.773+0000 7f2642ffd700 1 -- 172.21.15.3:0/3262788374 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264406d6f0 con 0x7f2630003a60 2023-10-08T15:42:30.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.773+0000 7f2642ffd700 1 -- 172.21.15.3:0/3262788374 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f263000bae0 con 0x7f264406cf60 2023-10-08T15:42:30.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.773+0000 7f26437fe700 1 --2- 172.21.15.3:0/3262788374 >> v2:172.21.15.50:3300/0 conn(0x7f26440bca80 0x7f26440b2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:42:30.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.773+0000 7f263bfff700 1 --2- 172.21.15.3:0/3262788374 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2630004810 0x7f2630004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:30.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.773+0000 7f2643fff700 1 --2- 172.21.15.3:0/3262788374 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f264406cf60 0x7f26300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:30.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.773+0000 7f26437fe700 1 --2- 172.21.15.3:0/3262788374 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2630003a60 0x7f2630003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:30.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.773+0000 7f263bfff700 1 -- 172.21.15.3:0/3262788374 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f264406cf60 msgr2=0x7f26300051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:30.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.773+0000 7f263bfff700 1 --2- 172.21.15.3:0/3262788374 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f264406cf60 0x7f26300051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:30.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.773+0000 7f263bfff700 1 -- 172.21.15.3:0/3262788374 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2630003a60 msgr2=0x7f2630003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:30.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.773+0000 7f263bfff700 1 --2- 172.21.15.3:0/3262788374 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2630003a60 0x7f2630003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:30.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.773+0000 7f263bfff700 1 -- 172.21.15.3:0/3262788374 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2630003570 con 0x7f2630004810 2023-10-08T15:42:30.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.773+0000 7f263bfff700 1 --2- 172.21.15.3:0/3262788374 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2630004810 0x7f2630004c80 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f2644070b60 tx=0x7f262c001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9044cb62e825b3a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:30.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.773+0000 7f2642ffd700 1 -- 172.21.15.3:0/3262788374 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262c00cc30 con 0x7f2630004810 2023-10-08T15:42:30.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.773+0000 7f2642ffd700 1 -- 172.21.15.3:0/3262788374 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f262c00cdd0 con 0x7f2630004810 2023-10-08T15:42:30.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.773+0000 7f2642ffd700 1 -- 172.21.15.3:0/3262788374 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262c005b70 con 0x7f2630004810 2023-10-08T15:42:30.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.773+0000 7f2648ce4700 1 -- 172.21.15.3:0/3262788374 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2630004810 msgr2=0x7f2630004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:30.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.773+0000 7f2648ce4700 1 --2- 172.21.15.3:0/3262788374 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2630004810 0x7f2630004c80 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f2644070b60 tx=0x7f262c001e90 comp rx=0 tx=0).stop 2023-10-08T15:42:30.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.773+0000 7f2643fff700 1 -- 172.21.15.3:0/3262788374 reap_dead start 2023-10-08T15:42:30.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.773+0000 7f2648ce4700 1 -- 172.21.15.3:0/3262788374 shutdown_connections 2023-10-08T15:42:30.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.773+0000 7f2648ce4700 1 -- 172.21.15.3:0/3262788374 >> 172.21.15.3:0/3262788374 conn(0x7f26440be4a0 msgr2=0x7f26440ba440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:30.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.773+0000 7f2648ce4700 1 -- 172.21.15.3:0/3262788374 shutdown_connections 2023-10-08T15:42:30.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.773+0000 7f2648ce4700 1 -- 172.21.15.3:0/3262788374 wait complete. 2023-10-08T15:42:30.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.777+0000 7f2648ce4700 1 Processor -- start 2023-10-08T15:42:30.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.777+0000 7f2648ce4700 1 -- start start 2023-10-08T15:42:30.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.777+0000 7f2648ce4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2630004810 0x7f2644144050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:30.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.777+0000 7f2648ce4700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f264415ab10 0x7f2644141610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:30.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.777+0000 7f2648ce4700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f26441432d0 0x7f26441573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:30.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.777+0000 7f2648ce4700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2644156f30 con 0x7f264415ab10 2023-10-08T15:42:30.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.777+0000 7f2648ce4700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264415afb0 con 0x7f2630004810 2023-10-08T15:42:30.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.777+0000 7f2648ce4700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2644141b50 con 0x7f26441432d0 2023-10-08T15:42:30.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.777+0000 7f263bfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f264415ab10 0x7f2644141610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:30.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.777+0000 7f26437fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2630004810 0x7f2644144050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:30.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.777+0000 7f26437fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2630004810 0x7f2644144050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.3:34748/0 (socket says 172.21.15.3:34748) 2023-10-08T15:42:30.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.777+0000 7f263bfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f264415ab10 0x7f2644141610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57148/0 (socket says 172.21.15.3:57148) 2023-10-08T15:42:30.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.777+0000 7f26437fe700 1 -- 172.21.15.3:0/1123595031 learned_addr learned my addr 172.21.15.3:0/1123595031 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:30.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.777+0000 7f2643fff700 1 --2- 172.21.15.3:0/1123595031 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f26441432d0 0x7f26441573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:30.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.781+0000 7f263bfff700 1 -- 172.21.15.3:0/1123595031 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f26441432d0 msgr2=0x7f26441573c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:30.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.781+0000 7f263bfff700 1 --2- 172.21.15.3:0/1123595031 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f26441432d0 0x7f26441573c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:30.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.781+0000 7f263bfff700 1 -- 172.21.15.3:0/1123595031 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2630004810 msgr2=0x7f2644144050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:30.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.781+0000 7f263bfff700 1 --2- 172.21.15.3:0/1123595031 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2630004810 0x7f2644144050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:30.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.781+0000 7f263bfff700 1 -- 172.21.15.3:0/1123595031 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26441438c0 con 0x7f264415ab10 2023-10-08T15:42:30.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.781+0000 7f263bfff700 1 --2- 172.21.15.3:0/1123595031 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f264415ab10 0x7f2644141610 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f262c007fd0 tx=0x7f262c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:30.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.781+0000 7f263b7fe700 1 -- 172.21.15.3:0/1123595031 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262c00cc30 con 0x7f264415ab10 2023-10-08T15:42:30.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.781+0000 7f263b7fe700 1 -- 172.21.15.3:0/1123595031 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f262c000f50 con 0x7f264415ab10 2023-10-08T15:42:30.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.781+0000 7f263b7fe700 1 -- 172.21.15.3:0/1123595031 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262c0072e0 con 0x7f264415ab10 2023-10-08T15:42:30.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.781+0000 7f2648ce4700 1 -- 172.21.15.3:0/1123595031 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2644156af0 con 0x7f264415ab10 2023-10-08T15:42:30.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.781+0000 7f2648ce4700 1 -- 172.21.15.3:0/1123595031 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2644157aa0 con 0x7f264415ab10 2023-10-08T15:42:30.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.781+0000 7f263b7fe700 1 -- 172.21.15.3:0/1123595031 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f262c019070 con 0x7f264415ab10 2023-10-08T15:42:30.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.781+0000 7f2648ce4700 1 -- 172.21.15.3:0/1123595031 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f264405ecf0 con 0x7f264415ab10 2023-10-08T15:42:30.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.781+0000 7f263b7fe700 1 --2- 172.21.15.3:0/1123595031 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f2624060580 0x7f2624062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:30.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.785+0000 7f263b7fe700 1 -- 172.21.15.3:0/1123595031 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f262c07d660 con 0x7f264415ab10 2023-10-08T15:42:30.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.785+0000 7f26437fe700 1 --2- 172.21.15.3:0/1123595031 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f2624060580 0x7f2624062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:30.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.785+0000 7f26437fe700 1 --2- 172.21.15.3:0/1123595031 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f2624060580 0x7f2624062a30 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f2634014440 tx=0x7f263400a6c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:30.797 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.789+0000 7f263b7fe700 1 -- 172.21.15.3:0/1123595031 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f262c04dc50 con 0x7f264415ab10 2023-10-08T15:42:30.960 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.953+0000 7f2648ce4700 1 -- 172.21.15.3:0/1123595031 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f264406d8d0 con 0x7f264415ab10 2023-10-08T15:42:30.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.957+0000 7f263b7fe700 1 -- 172.21.15.3:0/1123595031 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) v1 ==== 74+0+15270 (secure 0 0 0) 0x7f262c051270 con 0x7f264415ab10 2023-10-08T15:42:30.963 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:42:30.963 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":70,"fsid":"7635972e-cd66-4a8f-a231-378db8b3847a","created":"2023-10-08T15:37:08.234594+0000","modified":"2023-10-08T15:42:29.646978+0000","last_up_change":"2023-10-08T15:37:17.537726+0000","last_in_change":"2023-10-08T15:37:10.269178+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:37:16.581590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:42:27.890694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-08T15:42:28.634350+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"64fb1864-bfdd-4d75-9b41-03fb60085dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33363},{"type":"v1","addr":"172.21.15.3:6801","nonce":33363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33363},{"type":"v1","addr":"172.21.15.3:6803","nonce":33363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":33363},{"type":"v1","addr":"172.21.15.3:6807","nonce":33363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33363},{"type":"v1","addr":"172.21.15.3:6805","nonce":33363}]},"public_addr":"172.21.15.3:6801/33363","cluster_addr":"172.21.15.3:6803/33363","heartbeat_back_addr":"172.21.15.3:6807/33363","heartbeat_front_addr":"172.21.15.3:6805/33363","state":["exists","up"]},{"osd":1,"uuid":"3ca6bd3a-3e8a-4c65-af9c-46148b0c2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33364},{"type":"v1","addr":"172.21.15.3:6820","nonce":33364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33364},{"type":"v1","addr":"172.21.15.3:6824","nonce":33364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33364},{"type":"v1","addr":"172.21.15.3:6831","nonce":33364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33364},{"type":"v1","addr":"172.21.15.3:6828","nonce":33364}]},"public_addr":"172.21.15.3:6820/33364","cluster_addr":"172.21.15.3:6824/33364","heartbeat_back_addr":"172.21.15.3:6831/33364","heartbeat_front_addr":"172.21.15.3:6828/33364","state":["exists","up"]},{"osd":2,"uuid":"6eb9f757-58dd-442f-910d-32401454bce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33366},{"type":"v1","addr":"172.21.15.3:6817","nonce":33366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":33366},{"type":"v1","addr":"172.21.15.3:6821","nonce":33366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6827","nonce":33366},{"type":"v1","addr":"172.21.15.3:6829","nonce":33366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":33366},{"type":"v1","addr":"172.21.15.3:6825","nonce":33366}]},"public_addr":"172.21.15.3:6817/33366","cluster_addr":"172.21.15.3:6821/33366","heartbeat_back_addr":"172.21.15.3:6829/33366","heartbeat_front_addr":"172.21.15.3:6825/33366","state":["exists","up"]},{"osd":3,"uuid":"1c39866b-ac2e-4ea9-a69c-02b01ee4191d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33365},{"type":"v1","addr":"172.21.15.3:6809","nonce":33365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":33365},{"type":"v1","addr":"172.21.15.3:6811","nonce":33365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33365},{"type":"v1","addr":"172.21.15.3:6815","nonce":33365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":33365},{"type":"v1","addr":"172.21.15.3:6813","nonce":33365}]},"public_addr":"172.21.15.3:6809/33365","cluster_addr":"172.21.15.3:6811/33365","heartbeat_back_addr":"172.21.15.3:6815/33365","heartbeat_front_addr":"172.21.15.3:6813/33365","state":["exists","up"]},{"osd":4,"uuid":"15f86b61-b7f1-4780-ae00-9d80a68cb830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":33605},{"type":"v1","addr":"172.21.15.50:6809","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33605},{"type":"v1","addr":"172.21.15.50:6811","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33605},{"type":"v1","addr":"172.21.15.50:6815","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":33605},{"type":"v1","addr":"172.21.15.50:6813","nonce":33605}]},"public_addr":"172.21.15.50:6809/33605","cluster_addr":"172.21.15.50:6811/33605","heartbeat_back_addr":"172.21.15.50:6815/33605","heartbeat_front_addr":"172.21.15.50:6813/33605","state":["exists","up"]},{"osd":5,"uuid":"726c3003-34e6-4d5a-b6e2-f911e13c2118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33606},{"type":"v1","addr":"172.21.15.50:6801","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33606},{"type":"v1","addr":"172.21.15.50:6803","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33606},{"type":"v1","addr":"172.21.15.50:6807","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":33606},{"type":"v1","addr":"172.21.15.50:6805","nonce":33606}]},"public_addr":"172.21.15.50:6801/33606","cluster_addr":"172.21.15.50:6803/33606","heartbeat_back_addr":"172.21.15.50:6807/33606","heartbeat_front_addr":"172.21.15.50:6805/33606","state":["exists","up"]},{"osd":6,"uuid":"401122a4-9988-441f-a5a7-39164434ebcd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":33607},{"type":"v1","addr":"172.21.15.50:6819","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":33607},{"type":"v1","addr":"172.21.15.50:6823","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":33607},{"type":"v1","addr":"172.21.15.50:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":33607},{"type":"v1","addr":"172.21.15.50:6827","nonce":33607}]},"public_addr":"172.21.15.50:6819/33607","cluster_addr":"172.21.15.50:6823/33607","heartbeat_back_addr":"172.21.15.50:6831/33607","heartbeat_front_addr":"172.21.15.50:6827/33607","state":["exists","up"]},{"osd":7,"uuid":"6b3fa236-c9d0-4c4d-82ae-9af4daf6d699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33604},{"type":"v1","addr":"172.21.15.50:6818","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":33604},{"type":"v1","addr":"172.21.15.50:6822","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":33604},{"type":"v1","addr":"172.21.15.50:6830","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":33604},{"type":"v1","addr":"172.21.15.50:6826","nonce":33604}]},"public_addr":"172.21.15.50:6818/33604","cluster_addr":"172.21.15.50:6822/33604","heartbeat_back_addr":"172.21.15.50:6830/33604","heartbeat_front_addr":"172.21.15.50:6826/33604","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.497794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.529417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.873426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.325972+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.443971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.240795+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.739632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.643026+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:42:30.965 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.957+0000 7f2648ce4700 1 -- 172.21.15.3:0/1123595031 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f2624060580 msgr2=0x7f2624062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:30.965 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.957+0000 7f2648ce4700 1 --2- 172.21.15.3:0/1123595031 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f2624060580 0x7f2624062a30 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f2634014440 tx=0x7f263400a6c0 comp rx=0 tx=0).stop 2023-10-08T15:42:30.965 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.957+0000 7f2648ce4700 1 -- 172.21.15.3:0/1123595031 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f264415ab10 msgr2=0x7f2644141610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:30.965 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.957+0000 7f2648ce4700 1 --2- 172.21.15.3:0/1123595031 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f264415ab10 0x7f2644141610 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f262c007fd0 tx=0x7f262c015000 comp rx=0 tx=0).stop 2023-10-08T15:42:30.966 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.957+0000 7f2648ce4700 1 -- 172.21.15.3:0/1123595031 shutdown_connections 2023-10-08T15:42:30.966 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.957+0000 7f2648ce4700 1 --2- 172.21.15.3:0/1123595031 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f2624060580 0x7f2624062a30 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:30.966 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.957+0000 7f2648ce4700 1 --2- 172.21.15.3:0/1123595031 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f26441432d0 0x7f26441573c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:30.966 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.957+0000 7f2648ce4700 1 --2- 172.21.15.3:0/1123595031 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f264415ab10 0x7f2644141610 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:30.966 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.957+0000 7f2648ce4700 1 --2- 172.21.15.3:0/1123595031 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2630004810 0x7f2644144050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:30.966 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.957+0000 7f2648ce4700 1 -- 172.21.15.3:0/1123595031 >> 172.21.15.3:0/1123595031 conn(0x7f26440be4a0 msgr2=0x7f264414af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:30.966 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.957+0000 7f2648ce4700 1 -- 172.21.15.3:0/1123595031 shutdown_connections 2023-10-08T15:42:30.966 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:30.957+0000 7f2648ce4700 1 -- 172.21.15.3:0/1123595031 wait complete. 2023-10-08T15:42:30.978 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T15:42:31.087 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.081+0000 7fc3c6311700 1 Processor -- start 2023-10-08T15:42:31.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.081+0000 7fc3c6311700 1 -- start start 2023-10-08T15:42:31.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.081+0000 7fc3c6311700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc3c00bb130 0x7fc3c0147070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:31.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.081+0000 7fc3c6311700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3c014b7f0 con 0x7fc3c00bad60 2023-10-08T15:42:31.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.081+0000 7fc3c6311700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3c00a05f0 con 0x7fc3c00a1ce0 2023-10-08T15:42:31.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.081+0000 7fc3c6311700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3c00a2b60 con 0x7fc3c00bb130 2023-10-08T15:42:31.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.081+0000 7fc3c530f700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fc3c00bad60 0x7fc3c009fee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:59206/0 (socket says 172.21.15.3:59206) 2023-10-08T15:42:31.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.081+0000 7fc3c530f700 1 -- 172.21.15.3:0/3885293994 learned_addr learned my addr 172.21.15.3:0/3885293994 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:42:31.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.081+0000 7fc3c5b10700 1 --2- 172.21.15.3:0/3885293994 >> v2:172.21.15.50:3300/0 conn(0x7fc3c00bb130 0x7fc3c0147070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:31.091 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.081+0000 7fc3b7fff700 1 -- 172.21.15.3:0/3885293994 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 168111011 0 0) 0x7fc3c014b7f0 con 0x7fc3c00bad60 2023-10-08T15:42:31.091 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.081+0000 7fc3b7fff700 1 -- 172.21.15.3:0/3885293994 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3ac003570 con 0x7fc3c00bad60 2023-10-08T15:42:31.091 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.085+0000 7fc3c5b10700 1 -- 172.21.15.3:0/3885293994 >> v1:172.21.15.50:6789/0 conn(0x7fc3c00a1ce0 legacy=0x7fc3c0146960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:31.091 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.085+0000 7fc3c5b10700 1 -- 172.21.15.3:0/3885293994 >> v1:172.21.15.3:6789/0 conn(0x7fc3c00bad60 legacy=0x7fc3c009fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:31.091 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.085+0000 7fc3c5b10700 1 -- 172.21.15.3:0/3885293994 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c00a2880 con 0x7fc3c00bb130 2023-10-08T15:42:31.091 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.085+0000 7fc3c5b10700 1 --2- 172.21.15.3:0/3885293994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3c00bb130 0x7fc3c0147070 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc3b8009e60 tx=0x7fc3b8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9350a750daf13311 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:31.091 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.085+0000 7fc3b7fff700 1 -- 172.21.15.3:0/3885293994 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b800e070 con 0x7fc3c00bb130 2023-10-08T15:42:31.091 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.085+0000 7fc3b7fff700 1 -- 172.21.15.3:0/3885293994 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b800bb60 con 0x7fc3c00bb130 2023-10-08T15:42:31.091 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.085+0000 7fc3b7fff700 1 -- 172.21.15.3:0/3885293994 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b8012430 con 0x7fc3c00bb130 2023-10-08T15:42:31.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.085+0000 7fc3c6311700 1 -- 172.21.15.3:0/3885293994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3c00bb130 msgr2=0x7fc3c0147070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:31.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.085+0000 7fc3c6311700 1 --2- 172.21.15.3:0/3885293994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3c00bb130 0x7fc3c0147070 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc3b8009e60 tx=0x7fc3b8009780 comp rx=0 tx=0).stop 2023-10-08T15:42:31.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.085+0000 7fc3c6311700 1 -- 172.21.15.3:0/3885293994 shutdown_connections 2023-10-08T15:42:31.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.085+0000 7fc3c6311700 1 --2- 172.21.15.3:0/3885293994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3c00bb130 0x7fc3c0147070 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:31.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.085+0000 7fc3c6311700 1 -- 172.21.15.3:0/3885293994 >> 172.21.15.3:0/3885293994 conn(0x7fc3c0067b70 msgr2=0x7fc3c00ba650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:31.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.085+0000 7fc3c6311700 1 -- 172.21.15.3:0/3885293994 shutdown_connections 2023-10-08T15:42:31.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.085+0000 7fc3c6311700 1 -- 172.21.15.3:0/3885293994 wait complete. 2023-10-08T15:42:31.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.085+0000 7fc3c6311700 1 Processor -- start 2023-10-08T15:42:31.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.085+0000 7fc3c6311700 1 -- start start 2023-10-08T15:42:31.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.089+0000 7fc3c6311700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3c00a1ce0 0x7fc3c0099220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:31.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.089+0000 7fc3c6311700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc3c00bad60 0x7fc3c009d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:31.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.089+0000 7fc3c6311700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3c00bb130 0x7fc3c009d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:31.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.089+0000 7fc3c6311700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c015a660 con 0x7fc3c00bb130 2023-10-08T15:42:31.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.089+0000 7fc3c6311700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c015a010 con 0x7fc3c00a1ce0 2023-10-08T15:42:31.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.089+0000 7fc3c6311700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c015a2f0 con 0x7fc3c00bad60 2023-10-08T15:42:31.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.089+0000 7fc3c5b10700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3c00bb130 0x7fc3c009d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:31.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.089+0000 7fc3c5b10700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3c00bb130 0x7fc3c009d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57162/0 (socket says 172.21.15.3:57162) 2023-10-08T15:42:31.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.089+0000 7fc3c5b10700 1 -- 172.21.15.3:0/1342532833 learned_addr learned my addr 172.21.15.3:0/1342532833 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:31.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.089+0000 7fc3c530f700 1 --2- 172.21.15.3:0/1342532833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3c00a1ce0 0x7fc3c0099220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:31.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.089+0000 7fc3c4b0e700 1 --2- 172.21.15.3:0/1342532833 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc3c00bad60 0x7fc3c009d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:31.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.089+0000 7fc3c5b10700 1 -- 172.21.15.3:0/1342532833 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc3c00bad60 msgr2=0x7fc3c009d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:31.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.089+0000 7fc3c5b10700 1 --2- 172.21.15.3:0/1342532833 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc3c00bad60 0x7fc3c009d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:31.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.089+0000 7fc3c5b10700 1 -- 172.21.15.3:0/1342532833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3c00a1ce0 msgr2=0x7fc3c0099220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:31.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.089+0000 7fc3c5b10700 1 --2- 172.21.15.3:0/1342532833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3c00a1ce0 0x7fc3c0099220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:31.097 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.089+0000 7fc3c5b10700 1 -- 172.21.15.3:0/1342532833 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b8009a20 con 0x7fc3c00bb130 2023-10-08T15:42:31.097 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.089+0000 7fc3c5b10700 1 --2- 172.21.15.3:0/1342532833 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3c00bb130 0x7fc3c009d7b0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fc3c006b9a0 tx=0x7fc3b8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:31.097 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.089+0000 7fc3b57fa700 1 -- 172.21.15.3:0/1342532833 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b8027470 con 0x7fc3c00bb130 2023-10-08T15:42:31.098 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.089+0000 7fc3b57fa700 1 -- 172.21.15.3:0/1342532833 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b80275f0 con 0x7fc3c00bb130 2023-10-08T15:42:31.098 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.089+0000 7fc3c6311700 1 -- 172.21.15.3:0/1342532833 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3c0159cc0 con 0x7fc3c00bb130 2023-10-08T15:42:31.098 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.089+0000 7fc3b57fa700 1 -- 172.21.15.3:0/1342532833 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b80279b0 con 0x7fc3c00bb130 2023-10-08T15:42:31.098 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.089+0000 7fc3c6311700 1 -- 172.21.15.3:0/1342532833 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3c0098580 con 0x7fc3c00bb130 2023-10-08T15:42:31.098 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.093+0000 7fc3c6311700 1 -- 172.21.15.3:0/1342532833 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3c015a4b0 con 0x7fc3c00bb130 2023-10-08T15:42:31.099 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.093+0000 7fc3b57fa700 1 -- 172.21.15.3:0/1342532833 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc3b8024070 con 0x7fc3c00bb130 2023-10-08T15:42:31.100 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.093+0000 7fc3b57fa700 1 --2- 172.21.15.3:0/1342532833 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc3a4060550 0x7fc3a4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:31.100 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.093+0000 7fc3b57fa700 1 -- 172.21.15.3:0/1342532833 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc3b807f1a0 con 0x7fc3c00bb130 2023-10-08T15:42:31.100 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.093+0000 7fc3c530f700 1 --2- 172.21.15.3:0/1342532833 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc3a4060550 0x7fc3a4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:31.101 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.093+0000 7fc3c530f700 1 --2- 172.21.15.3:0/1342532833 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc3a4060550 0x7fc3a4062a00 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc3b0007fd0 tx=0x7fc3b0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:31.107 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.101+0000 7fc3b57fa700 1 -- 172.21.15.3:0/1342532833 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc3b804f790 con 0x7fc3c00bb130 2023-10-08T15:42:31.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.305+0000 7fc3c6311700 1 -- 172.21.15.3:0/1342532833 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc3c005ecf0 con 0x7fc3c00bb130 2023-10-08T15:42:31.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.325+0000 7fc3b57fa700 1 -- 172.21.15.3:0/1342532833 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v38) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc3b8052db0 con 0x7fc3c00bb130 2023-10-08T15:42:31.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.329+0000 7fc3c6311700 1 -- 172.21.15.3:0/1342532833 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc3a4060550 msgr2=0x7fc3a4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:31.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.329+0000 7fc3c6311700 1 --2- 172.21.15.3:0/1342532833 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc3a4060550 0x7fc3a4062a00 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc3b0007fd0 tx=0x7fc3b0009040 comp rx=0 tx=0).stop 2023-10-08T15:42:31.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.329+0000 7fc3c6311700 1 -- 172.21.15.3:0/1342532833 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3c00bb130 msgr2=0x7fc3c009d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:31.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.329+0000 7fc3c6311700 1 --2- 172.21.15.3:0/1342532833 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3c00bb130 0x7fc3c009d7b0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fc3c006b9a0 tx=0x7fc3b8019000 comp rx=0 tx=0).stop 2023-10-08T15:42:31.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.329+0000 7fc3c6311700 1 -- 172.21.15.3:0/1342532833 shutdown_connections 2023-10-08T15:42:31.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.329+0000 7fc3c6311700 1 --2- 172.21.15.3:0/1342532833 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fc3a4060550 0x7fc3a4062a00 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:31.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.329+0000 7fc3c6311700 1 --2- 172.21.15.3:0/1342532833 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3c00bb130 0x7fc3c009d7b0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:31.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.329+0000 7fc3c6311700 1 --2- 172.21.15.3:0/1342532833 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc3c00bad60 0x7fc3c009d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:31.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.329+0000 7fc3c6311700 1 --2- 172.21.15.3:0/1342532833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3c00a1ce0 0x7fc3c0099220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:31.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.329+0000 7fc3c6311700 1 -- 172.21.15.3:0/1342532833 >> 172.21.15.3:0/1342532833 conn(0x7fc3c0067b70 msgr2=0x7fc3c00ba630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:31.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.329+0000 7fc3c6311700 1 -- 172.21.15.3:0/1342532833 shutdown_connections 2023-10-08T15:42:31.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.329+0000 7fc3c6311700 1 -- 172.21.15.3:0/1342532833 wait complete. 2023-10-08T15:42:31.349 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-08T15:42:31.455 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.449+0000 7f31a406a700 1 Processor -- start 2023-10-08T15:42:31.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.449+0000 7f31a406a700 1 -- start start 2023-10-08T15:42:31.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.449+0000 7f31a406a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f319c06eb60 0x7f319c06ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:31.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.449+0000 7f31a406a700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f319c0a2c60 0x7f319c14ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:31.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.449+0000 7f31a406a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f319c14b090 0x7f319c14ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:31.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.449+0000 7f31a406a700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f319c0b6d00 con 0x7f319c0a2c60 2023-10-08T15:42:31.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.449+0000 7f31a406a700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f319c14c520 con 0x7f319c06eb60 2023-10-08T15:42:31.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.449+0000 7f31a406a700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f319c14b510 con 0x7f319c14b090 2023-10-08T15:42:31.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.449+0000 7f31a1605700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f319c0a2c60 0x7f319c14ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:31.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.449+0000 7f31a1605700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f319c0a2c60 0x7f319c14ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57164/0 (socket says 172.21.15.3:57164) 2023-10-08T15:42:31.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.449+0000 7f31a1605700 1 -- 172.21.15.3:0/2182268471 learned_addr learned my addr 172.21.15.3:0/2182268471 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:31.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.449+0000 7f31a1e06700 1 --2- 172.21.15.3:0/2182268471 >> v2:172.21.15.50:3300/0 conn(0x7f319c06eb60 0x7f319c06ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:31.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.449+0000 7f31a2607700 1 --2- 172.21.15.3:0/2182268471 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f319c14b090 0x7f319c14ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:31.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.449+0000 7f31a1605700 1 -- 172.21.15.3:0/2182268471 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f319c14b090 msgr2=0x7f319c14ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:31.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.449+0000 7f31a1605700 1 --2- 172.21.15.3:0/2182268471 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f319c14b090 0x7f319c14ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:31.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.449+0000 7f31a1605700 1 -- 172.21.15.3:0/2182268471 >> v2:172.21.15.50:3300/0 conn(0x7f319c06eb60 msgr2=0x7f319c06ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:31.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.449+0000 7f31a1605700 1 --2- 172.21.15.3:0/2182268471 >> v2:172.21.15.50:3300/0 conn(0x7f319c06eb60 0x7f319c06ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:31.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.449+0000 7f31a1605700 1 -- 172.21.15.3:0/2182268471 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f319c14c1d0 con 0x7f319c0a2c60 2023-10-08T15:42:31.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.449+0000 7f31a1e06700 1 --2- 172.21.15.3:0/2182268471 >> v2:172.21.15.50:3300/0 conn(0x7f319c06eb60 0x7f319c06ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:42:31.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.449+0000 7f31a1605700 1 --2- 172.21.15.3:0/2182268471 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f319c0a2c60 0x7f319c14ab50 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f319c06cdd0 tx=0x7f318c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=779cf15462ddc2dd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:31.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.453+0000 7f31a0e04700 1 -- 172.21.15.3:0/2182268471 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318c00b860 con 0x7f319c0a2c60 2023-10-08T15:42:31.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.453+0000 7f31a0e04700 1 -- 172.21.15.3:0/2182268471 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f318c00b9c0 con 0x7f319c0a2c60 2023-10-08T15:42:31.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.453+0000 7f31a0e04700 1 -- 172.21.15.3:0/2182268471 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318c00bd60 con 0x7f319c0a2c60 2023-10-08T15:42:31.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.453+0000 7f31a406a700 1 -- 172.21.15.3:0/2182268471 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f319c0a2c60 msgr2=0x7f319c14ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:31.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.453+0000 7f31a406a700 1 --2- 172.21.15.3:0/2182268471 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f319c0a2c60 0x7f319c14ab50 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f319c06cdd0 tx=0x7f318c009250 comp rx=0 tx=0).stop 2023-10-08T15:42:31.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.453+0000 7f31a406a700 1 -- 172.21.15.3:0/2182268471 shutdown_connections 2023-10-08T15:42:31.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.453+0000 7f31a406a700 1 --2- 172.21.15.3:0/2182268471 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f319c14b090 0x7f319c14ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:31.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.453+0000 7f31a406a700 1 --2- 172.21.15.3:0/2182268471 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f319c0a2c60 0x7f319c14ab50 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:31.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.453+0000 7f31a406a700 1 --2- 172.21.15.3:0/2182268471 >> v2:172.21.15.50:3300/0 conn(0x7f319c06eb60 0x7f319c06ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:31.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.453+0000 7f31a406a700 1 -- 172.21.15.3:0/2182268471 >> 172.21.15.3:0/2182268471 conn(0x7f319c0be4f0 msgr2=0x7f319c0be8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:31.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.453+0000 7f31a406a700 1 -- 172.21.15.3:0/2182268471 shutdown_connections 2023-10-08T15:42:31.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.453+0000 7f31a406a700 1 -- 172.21.15.3:0/2182268471 wait complete. 2023-10-08T15:42:31.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.457+0000 7f31a406a700 1 Processor -- start 2023-10-08T15:42:31.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.457+0000 7f31a406a700 1 -- start start 2023-10-08T15:42:31.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.457+0000 7f31a406a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f319c06eb60 0x7f319c0bdaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:31.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.457+0000 7f31a406a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f319c0a2c60 0x7f319c1404b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:31.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.457+0000 7f31a406a700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f319c14b090 0x7f319c15e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:31.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.457+0000 7f31a406a700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319c0be030 con 0x7f319c14b090 2023-10-08T15:42:31.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.457+0000 7f31a406a700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319c14d850 con 0x7f319c06eb60 2023-10-08T15:42:31.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.457+0000 7f31a406a700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f319c14db30 con 0x7f319c0a2c60 2023-10-08T15:42:31.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.457+0000 7f31a2607700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f319c14b090 0x7f319c15e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:31.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.457+0000 7f31a2607700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f319c14b090 0x7f319c15e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57170/0 (socket says 172.21.15.3:57170) 2023-10-08T15:42:31.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.457+0000 7f31a2607700 1 -- 172.21.15.3:0/1218789355 learned_addr learned my addr 172.21.15.3:0/1218789355 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:31.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.457+0000 7f31a1e06700 1 --2- 172.21.15.3:0/1218789355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f319c06eb60 0x7f319c0bdaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:31.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.457+0000 7f31a1605700 1 --2- 172.21.15.3:0/1218789355 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f319c0a2c60 0x7f319c1404b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:31.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.457+0000 7f31a2607700 1 -- 172.21.15.3:0/1218789355 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f319c0a2c60 msgr2=0x7f319c1404b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:31.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.457+0000 7f31a2607700 1 --2- 172.21.15.3:0/1218789355 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f319c0a2c60 0x7f319c1404b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:31.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.457+0000 7f31a2607700 1 -- 172.21.15.3:0/1218789355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f319c06eb60 msgr2=0x7f319c0bdaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:31.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.457+0000 7f31a2607700 1 --2- 172.21.15.3:0/1218789355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f319c06eb60 0x7f319c0bdaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:31.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.457+0000 7f31a2607700 1 -- 172.21.15.3:0/1218789355 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f318c0094f0 con 0x7f319c14b090 2023-10-08T15:42:31.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.457+0000 7f31a2607700 1 --2- 172.21.15.3:0/1218789355 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f319c14b090 0x7f319c15e3e0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f3194007f20 tx=0x7f3194009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:31.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.457+0000 7f3191ffb700 1 -- 172.21.15.3:0/1218789355 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319400eb90 con 0x7f319c14b090 2023-10-08T15:42:31.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.457+0000 7f3191ffb700 1 -- 172.21.15.3:0/1218789355 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f319400ed10 con 0x7f319c14b090 2023-10-08T15:42:31.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.457+0000 7f31a406a700 1 -- 172.21.15.3:0/1218789355 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f319c1409f0 con 0x7f319c14b090 2023-10-08T15:42:31.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.457+0000 7f3191ffb700 1 -- 172.21.15.3:0/1218789355 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3194014670 con 0x7f319c14b090 2023-10-08T15:42:31.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.457+0000 7f31a406a700 1 -- 172.21.15.3:0/1218789355 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f319c14e050 con 0x7f319c14b090 2023-10-08T15:42:31.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.461+0000 7f31a406a700 1 -- 172.21.15.3:0/1218789355 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f319c14e240 con 0x7f319c14b090 2023-10-08T15:42:31.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.461+0000 7f3191ffb700 1 -- 172.21.15.3:0/1218789355 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f31940149e0 con 0x7f319c14b090 2023-10-08T15:42:31.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.461+0000 7f3191ffb700 1 --2- 172.21.15.3:0/1218789355 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3180060550 0x7f3180062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:31.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.461+0000 7f3191ffb700 1 -- 172.21.15.3:0/1218789355 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f319407cea0 con 0x7f319c14b090 2023-10-08T15:42:31.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.461+0000 7f31a1e06700 1 --2- 172.21.15.3:0/1218789355 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3180060550 0x7f3180062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:31.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.461+0000 7f31a1e06700 1 --2- 172.21.15.3:0/1218789355 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3180060550 0x7f3180062a00 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f3198006f00 tx=0x7f3198008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:31.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.469+0000 7f3191ffb700 1 -- 172.21.15.3:0/1218789355 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f319404d3f0 con 0x7f319c14b090 2023-10-08T15:42:31.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:31.665+0000 7f31a406a700 1 -- 172.21.15.3:0/1218789355 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f319c064530 con 0x7f319c14b090 2023-10-08T15:42:32.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.333+0000 7f3191ffb700 1 -- 172.21.15.3:0/1218789355 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v39) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3194050a10 con 0x7f319c14b090 2023-10-08T15:42:32.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.337+0000 7f31a406a700 1 -- 172.21.15.3:0/1218789355 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3180060550 msgr2=0x7f3180062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:32.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.337+0000 7f31a406a700 1 --2- 172.21.15.3:0/1218789355 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3180060550 0x7f3180062a00 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f3198006f00 tx=0x7f3198008040 comp rx=0 tx=0).stop 2023-10-08T15:42:32.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.337+0000 7f31a406a700 1 -- 172.21.15.3:0/1218789355 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f319c14b090 msgr2=0x7f319c15e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:32.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.337+0000 7f31a406a700 1 --2- 172.21.15.3:0/1218789355 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f319c14b090 0x7f319c15e3e0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f3194007f20 tx=0x7f3194009860 comp rx=0 tx=0).stop 2023-10-08T15:42:32.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.337+0000 7f31a406a700 1 -- 172.21.15.3:0/1218789355 shutdown_connections 2023-10-08T15:42:32.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.341+0000 7f31a406a700 1 --2- 172.21.15.3:0/1218789355 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f3180060550 0x7f3180062a00 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:32.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.341+0000 7f31a406a700 1 --2- 172.21.15.3:0/1218789355 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f319c14b090 0x7f319c15e3e0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:32.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.341+0000 7f31a406a700 1 --2- 172.21.15.3:0/1218789355 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f319c0a2c60 0x7f319c1404b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:32.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.341+0000 7f31a406a700 1 --2- 172.21.15.3:0/1218789355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f319c06eb60 0x7f319c0bdaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:32.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.341+0000 7f31a406a700 1 -- 172.21.15.3:0/1218789355 >> 172.21.15.3:0/1218789355 conn(0x7f319c0be4f0 msgr2=0x7f319c147300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:32.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.341+0000 7f31a406a700 1 -- 172.21.15.3:0/1218789355 shutdown_connections 2023-10-08T15:42:32.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.341+0000 7f31a406a700 1 -- 172.21.15.3:0/1218789355 wait complete. 2023-10-08T15:42:32.363 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:42:32.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.469+0000 7fcd80eb0700 1 Processor -- start 2023-10-08T15:42:32.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.469+0000 7fcd80eb0700 1 -- start start 2023-10-08T15:42:32.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.469+0000 7fcd80eb0700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fcd7c0a15e0 0x7fcd7c14eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:32.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.469+0000 7fcd80eb0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcd7c06cf60 0x7fcd7c14f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:32.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.469+0000 7fcd80eb0700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd7c069900 con 0x7fcd7c068630 2023-10-08T15:42:32.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.469+0000 7fcd80eb0700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd7c14c760 con 0x7fcd7c0a15e0 2023-10-08T15:42:32.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.469+0000 7fcd80eb0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd7c069620 con 0x7fcd7c06cf60 2023-10-08T15:42:32.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.469+0000 7fcd7b7fe700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fcd7c0a15e0 0x7fcd7c14eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:32.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.469+0000 7fcd7bfff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fcd7c068630 0x7fcd7c14a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:59212/0 (socket says 172.21.15.3:59212) 2023-10-08T15:42:32.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.469+0000 7fcd7bfff700 1 -- 172.21.15.3:0/2002870413 learned_addr learned my addr 172.21.15.3:0/2002870413 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:42:32.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.473+0000 7fcd7affd700 1 --2- 172.21.15.3:0/2002870413 >> v2:172.21.15.50:3300/0 conn(0x7fcd7c06cf60 0x7fcd7c14f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:32.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.473+0000 7fcd7a7fc700 1 -- 172.21.15.3:0/2002870413 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3243582915 0 0) 0x7fcd7c069900 con 0x7fcd7c068630 2023-10-08T15:42:32.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.473+0000 7fcd7a7fc700 1 -- 172.21.15.3:0/2002870413 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd64003570 con 0x7fcd7c068630 2023-10-08T15:42:32.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.473+0000 7fcd7b7fe700 1 -- 172.21.15.3:0/2002870413 >> v2:172.21.15.50:3300/0 conn(0x7fcd7c06cf60 msgr2=0x7fcd7c14f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:32.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.473+0000 7fcd7b7fe700 1 --2- 172.21.15.3:0/2002870413 >> v2:172.21.15.50:3300/0 conn(0x7fcd7c06cf60 0x7fcd7c14f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:32.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.473+0000 7fcd7b7fe700 1 -- 172.21.15.3:0/2002870413 >> v1:172.21.15.3:6789/0 conn(0x7fcd7c068630 legacy=0x7fcd7c14a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:32.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.473+0000 7fcd7b7fe700 1 -- 172.21.15.3:0/2002870413 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd7c068d10 con 0x7fcd7c0a15e0 2023-10-08T15:42:32.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.473+0000 7fcd7b7fe700 1 --2- 172.21.15.3:0/2002870413 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcd7c0a15e0 0x7fcd7c14eae0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c14b5e0 tx=0x7fcd700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c33a76f7d9ca62c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:32.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.473+0000 7fcd7a7fc700 1 -- 172.21.15.3:0/2002870413 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd70011630 con 0x7fcd7c0a15e0 2023-10-08T15:42:32.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.473+0000 7fcd7a7fc700 1 -- 172.21.15.3:0/2002870413 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd700117b0 con 0x7fcd7c0a15e0 2023-10-08T15:42:32.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.473+0000 7fcd7a7fc700 1 -- 172.21.15.3:0/2002870413 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd70011b70 con 0x7fcd7c0a15e0 2023-10-08T15:42:32.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.473+0000 7fcd80eb0700 1 -- 172.21.15.3:0/2002870413 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcd7c0a15e0 msgr2=0x7fcd7c14eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:32.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.473+0000 7fcd80eb0700 1 --2- 172.21.15.3:0/2002870413 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcd7c0a15e0 0x7fcd7c14eae0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c14b5e0 tx=0x7fcd700091a0 comp rx=0 tx=0).stop 2023-10-08T15:42:32.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.473+0000 7fcd80eb0700 1 -- 172.21.15.3:0/2002870413 shutdown_connections 2023-10-08T15:42:32.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.473+0000 7fcd80eb0700 1 --2- 172.21.15.3:0/2002870413 >> v2:172.21.15.50:3300/0 conn(0x7fcd7c06cf60 0x7fcd7c14f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:32.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.473+0000 7fcd80eb0700 1 --2- 172.21.15.3:0/2002870413 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcd7c0a15e0 0x7fcd7c14eae0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:32.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.473+0000 7fcd80eb0700 1 -- 172.21.15.3:0/2002870413 >> 172.21.15.3:0/2002870413 conn(0x7fcd7c0670e0 msgr2=0x7fcd7c0674e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:32.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.473+0000 7fcd80eb0700 1 -- 172.21.15.3:0/2002870413 shutdown_connections 2023-10-08T15:42:32.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.473+0000 7fcd80eb0700 1 -- 172.21.15.3:0/2002870413 wait complete. 2023-10-08T15:42:32.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.477+0000 7fcd80eb0700 1 Processor -- start 2023-10-08T15:42:32.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.477+0000 7fcd80eb0700 1 -- start start 2023-10-08T15:42:32.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.477+0000 7fcd80eb0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd7c068630 0x7fcd7c15b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:32.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.477+0000 7fcd80eb0700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcd7c0a15e0 0x7fcd7c144980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:32.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.477+0000 7fcd80eb0700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcd7c14dae0 0x7fcd7c15bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:32.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.477+0000 7fcd80eb0700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c143620 con 0x7fcd7c14dae0 2023-10-08T15:42:32.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.477+0000 7fcd80eb0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c15ea30 con 0x7fcd7c068630 2023-10-08T15:42:32.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.477+0000 7fcd80eb0700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c14f2e0 con 0x7fcd7c0a15e0 2023-10-08T15:42:32.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.477+0000 7fcd7bfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcd7c14dae0 0x7fcd7c15bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:32.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.477+0000 7fcd7bfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcd7c14dae0 0x7fcd7c15bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57184/0 (socket says 172.21.15.3:57184) 2023-10-08T15:42:32.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.477+0000 7fcd7bfff700 1 -- 172.21.15.3:0/897875206 learned_addr learned my addr 172.21.15.3:0/897875206 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:32.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.477+0000 7fcd7affd700 1 --2- 172.21.15.3:0/897875206 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcd7c0a15e0 0x7fcd7c144980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:32.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.477+0000 7fcd7b7fe700 1 --2- 172.21.15.3:0/897875206 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd7c068630 0x7fcd7c15b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:32.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.477+0000 7fcd7bfff700 1 -- 172.21.15.3:0/897875206 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcd7c0a15e0 msgr2=0x7fcd7c144980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:32.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.477+0000 7fcd7bfff700 1 --2- 172.21.15.3:0/897875206 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcd7c0a15e0 0x7fcd7c144980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:32.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.477+0000 7fcd7bfff700 1 -- 172.21.15.3:0/897875206 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd7c068630 msgr2=0x7fcd7c15b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:32.486 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.477+0000 7fcd7bfff700 1 --2- 172.21.15.3:0/897875206 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd7c068630 0x7fcd7c15b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:32.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.477+0000 7fcd7bfff700 1 -- 172.21.15.3:0/897875206 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd70009420 con 0x7fcd7c14dae0 2023-10-08T15:42:32.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.477+0000 7fcd7bfff700 1 --2- 172.21.15.3:0/897875206 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcd7c14dae0 0x7fcd7c15bbd0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fcd74001460 tx=0x7fcd74001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:32.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.477+0000 7fcd637fe700 1 -- 172.21.15.3:0/897875206 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7400a890 con 0x7fcd7c14dae0 2023-10-08T15:42:32.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.477+0000 7fcd637fe700 1 -- 172.21.15.3:0/897875206 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd7400a9f0 con 0x7fcd7c14dae0 2023-10-08T15:42:32.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.477+0000 7fcd80eb0700 1 -- 172.21.15.3:0/897875206 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd7c144ec0 con 0x7fcd7c14dae0 2023-10-08T15:42:32.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.477+0000 7fcd637fe700 1 -- 172.21.15.3:0/897875206 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7400ad70 con 0x7fcd7c14dae0 2023-10-08T15:42:32.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.477+0000 7fcd80eb0700 1 -- 172.21.15.3:0/897875206 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd7c149d10 con 0x7fcd7c14dae0 2023-10-08T15:42:32.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.481+0000 7fcd80eb0700 1 -- 172.21.15.3:0/897875206 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd7c15ebc0 con 0x7fcd7c14dae0 2023-10-08T15:42:32.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.481+0000 7fcd637fe700 1 -- 172.21.15.3:0/897875206 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fcd74007300 con 0x7fcd7c14dae0 2023-10-08T15:42:32.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.481+0000 7fcd637fe700 1 --2- 172.21.15.3:0/897875206 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fcd68060550 0x7fcd68062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:32.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.481+0000 7fcd637fe700 1 -- 172.21.15.3:0/897875206 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcd7407cba0 con 0x7fcd7c14dae0 2023-10-08T15:42:32.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.481+0000 7fcd7b7fe700 1 --2- 172.21.15.3:0/897875206 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fcd68060550 0x7fcd68062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:32.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.481+0000 7fcd7b7fe700 1 --2- 172.21.15.3:0/897875206 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fcd68060550 0x7fcd68062a00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c14b5e0 tx=0x7fcd70017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:32.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.493+0000 7fcd637fe700 1 -- 172.21.15.3:0/897875206 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fcd7404d180 con 0x7fcd7c14dae0 2023-10-08T15:42:32.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.685+0000 7fcd80eb0700 1 -- 172.21.15.3:0/897875206 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcd7c05ecf0 con 0x7fcd7c14dae0 2023-10-08T15:42:32.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.685+0000 7fcd637fe700 1 -- 172.21.15.3:0/897875206 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+3079 (secure 0 0 0) 0x7fcd740507a0 con 0x7fcd7c14dae0 2023-10-08T15:42:32.691 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:42:32.691 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":39,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1820463299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1820463299},{"type":"v1","addr":"172.21.15.50:6835","nonce":1820463299}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:42:29.647713+0000","modified":"2023-10-08T15:42:32.333034+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6357},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6357":{"gid":6357,"name":"a","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.3:6833/937798310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":937798310},{"type":"v1","addr":"172.21.15.3:6833","nonce":937798310}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-08T15:42:32.693 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.685+0000 7fcd80eb0700 1 -- 172.21.15.3:0/897875206 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fcd68060550 msgr2=0x7fcd68062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:32.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.685+0000 7fcd80eb0700 1 --2- 172.21.15.3:0/897875206 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fcd68060550 0x7fcd68062a00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c14b5e0 tx=0x7fcd70017000 comp rx=0 tx=0).stop 2023-10-08T15:42:32.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.685+0000 7fcd80eb0700 1 -- 172.21.15.3:0/897875206 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcd7c14dae0 msgr2=0x7fcd7c15bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:32.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.685+0000 7fcd80eb0700 1 --2- 172.21.15.3:0/897875206 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcd7c14dae0 0x7fcd7c15bbd0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fcd74001460 tx=0x7fcd74001ae0 comp rx=0 tx=0).stop 2023-10-08T15:42:32.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.685+0000 7fcd80eb0700 1 -- 172.21.15.3:0/897875206 shutdown_connections 2023-10-08T15:42:32.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.685+0000 7fcd80eb0700 1 --2- 172.21.15.3:0/897875206 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fcd68060550 0x7fcd68062a00 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:32.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.685+0000 7fcd80eb0700 1 --2- 172.21.15.3:0/897875206 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcd7c14dae0 0x7fcd7c15bbd0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:32.695 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.685+0000 7fcd80eb0700 1 --2- 172.21.15.3:0/897875206 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcd7c0a15e0 0x7fcd7c144980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:32.695 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.685+0000 7fcd80eb0700 1 --2- 172.21.15.3:0/897875206 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd7c068630 0x7fcd7c15b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:32.695 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.685+0000 7fcd80eb0700 1 -- 172.21.15.3:0/897875206 >> 172.21.15.3:0/897875206 conn(0x7fcd7c0670e0 msgr2=0x7fcd7c1464e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:32.695 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.685+0000 7fcd80eb0700 1 -- 172.21.15.3:0/897875206 shutdown_connections 2023-10-08T15:42:32.695 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.685+0000 7fcd80eb0700 1 -- 172.21.15.3:0/897875206 wait complete. 2023-10-08T15:42:32.695 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 39 2023-10-08T15:42:32.705 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:42:32.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.805+0000 7f7d7504a700 1 Processor -- start 2023-10-08T15:42:32.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.805+0000 7f7d7504a700 1 -- start start 2023-10-08T15:42:32.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.805+0000 7f7d7504a700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f7d7006dd20 0x7f7d700badb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:32.811 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.805+0000 7f7d7504a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7d700bb2f0 0x7f7d700680f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:32.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.805+0000 7f7d7504a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7d7006ca80 0x7f7d70068630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:32.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.805+0000 7f7d7504a700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d7014f840 con 0x7f7d7006dd20 2023-10-08T15:42:32.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.805+0000 7f7d7504a700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d70148ff0 con 0x7f7d700bb2f0 2023-10-08T15:42:32.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.805+0000 7f7d7504a700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7006d0e0 con 0x7f7d7006ca80 2023-10-08T15:42:32.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.805+0000 7f7d6ed9d700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f7d7006dd20 0x7f7d700badb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:32.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.805+0000 7f7d6f59e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7d7006ca80 0x7f7d70068630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:32.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.805+0000 7f7d6e59c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7d700bb2f0 0x7f7d700680f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:32.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.805+0000 7f7d6ed9d700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f7d7006dd20 0x7f7d700badb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57186/0 (socket says 172.21.15.3:57186) 2023-10-08T15:42:32.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.805+0000 7f7d6e59c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7d700bb2f0 0x7f7d700680f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.3:34800/0 (socket says 172.21.15.3:34800) 2023-10-08T15:42:32.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.805+0000 7f7d6f59e700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7d7006ca80 0x7f7d70068630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.3:52086/0 (socket says 172.21.15.3:52086) 2023-10-08T15:42:32.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.805+0000 7f7d6e59c700 1 -- 172.21.15.3:0/3331949778 learned_addr learned my addr 172.21.15.3:0/3331949778 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:32.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.805+0000 7f7d6e59c700 1 -- 172.21.15.3:0/3331949778 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7d7006ca80 msgr2=0x7f7d70068630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:32.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.805+0000 7f7d6e59c700 1 --2- 172.21.15.3:0/3331949778 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7d7006ca80 0x7f7d70068630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:32.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.805+0000 7f7d6e59c700 1 -- 172.21.15.3:0/3331949778 >> v2:172.21.15.3:3300/0 conn(0x7f7d7006dd20 msgr2=0x7f7d700badb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:32.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.805+0000 7f7d6e59c700 1 --2- 172.21.15.3:0/3331949778 >> v2:172.21.15.3:3300/0 conn(0x7f7d7006dd20 0x7f7d700badb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:32.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.805+0000 7f7d6e59c700 1 -- 172.21.15.3:0/3331949778 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d7014f1f0 con 0x7f7d700bb2f0 2023-10-08T15:42:32.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.805+0000 7f7d6f59e700 1 --2- 172.21.15.3:0/3331949778 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7d7006ca80 0x7f7d70068630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:42:32.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.805+0000 7f7d6e59c700 1 --2- 172.21.15.3:0/3331949778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d700bb2f0 0x7f7d700680f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f7d700b7880 tx=0x7f7d60009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ddbeea3ccb199bf server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:32.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.805+0000 7f7d6dd9b700 1 -- 172.21.15.3:0/3331949778 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6000b640 con 0x7f7d700bb2f0 2023-10-08T15:42:32.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.805+0000 7f7d6dd9b700 1 -- 172.21.15.3:0/3331949778 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d6000b7a0 con 0x7f7d700bb2f0 2023-10-08T15:42:32.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.805+0000 7f7d6dd9b700 1 -- 172.21.15.3:0/3331949778 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6000bb60 con 0x7f7d700bb2f0 2023-10-08T15:42:32.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.805+0000 7f7d7504a700 1 -- 172.21.15.3:0/3331949778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d700bb2f0 msgr2=0x7f7d700680f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:32.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.805+0000 7f7d7504a700 1 --2- 172.21.15.3:0/3331949778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d700bb2f0 0x7f7d700680f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f7d700b7880 tx=0x7f7d60009250 comp rx=0 tx=0).stop 2023-10-08T15:42:32.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.805+0000 7f7d7504a700 1 -- 172.21.15.3:0/3331949778 shutdown_connections 2023-10-08T15:42:32.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.805+0000 7f7d7504a700 1 --2- 172.21.15.3:0/3331949778 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7d7006ca80 0x7f7d70068630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:32.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.805+0000 7f7d7504a700 1 --2- 172.21.15.3:0/3331949778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d700bb2f0 0x7f7d700680f0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:32.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.805+0000 7f7d7504a700 1 --2- 172.21.15.3:0/3331949778 >> v2:172.21.15.3:3300/0 conn(0x7f7d7006dd20 0x7f7d700badb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:32.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.805+0000 7f7d7504a700 1 -- 172.21.15.3:0/3331949778 >> 172.21.15.3:0/3331949778 conn(0x7f7d700be640 msgr2=0x7f7d700ba6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:32.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.805+0000 7f7d7504a700 1 -- 172.21.15.3:0/3331949778 shutdown_connections 2023-10-08T15:42:32.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.805+0000 7f7d7504a700 1 -- 172.21.15.3:0/3331949778 wait complete. 2023-10-08T15:42:32.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.809+0000 7f7d7504a700 1 Processor -- start 2023-10-08T15:42:32.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.809+0000 7f7d7504a700 1 -- start start 2023-10-08T15:42:32.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.809+0000 7f7d7504a700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7d7006ca80 0x7f7d7015bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:32.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.809+0000 7f7d7504a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d7006dd20 0x7f7d7015e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:32.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.809+0000 7f7d7504a700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7d700bb2f0 0x7f7d7015ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:32.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.809+0000 7f7d7504a700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7013fb00 con 0x7f7d7006ca80 2023-10-08T15:42:32.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.809+0000 7f7d7504a700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7015f540 con 0x7f7d7006dd20 2023-10-08T15:42:32.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.809+0000 7f7d7504a700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d70140c10 con 0x7f7d700bb2f0 2023-10-08T15:42:32.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.809+0000 7f7d6ed9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7d7006ca80 0x7f7d7015bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:32.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.809+0000 7f7d6ed9d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7d7006ca80 0x7f7d7015bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57196/0 (socket says 172.21.15.3:57196) 2023-10-08T15:42:32.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.809+0000 7f7d6ed9d700 1 -- 172.21.15.3:0/1070556808 learned_addr learned my addr 172.21.15.3:0/1070556808 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:32.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.809+0000 7f7d6e59c700 1 --2- 172.21.15.3:0/1070556808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d7006dd20 0x7f7d7015e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:32.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.809+0000 7f7d6f59e700 1 --2- 172.21.15.3:0/1070556808 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7d700bb2f0 0x7f7d7015ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:32.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.809+0000 7f7d6ed9d700 1 -- 172.21.15.3:0/1070556808 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7d700bb2f0 msgr2=0x7f7d7015ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:32.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.809+0000 7f7d6ed9d700 1 --2- 172.21.15.3:0/1070556808 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7d700bb2f0 0x7f7d7015ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:32.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.809+0000 7f7d6ed9d700 1 -- 172.21.15.3:0/1070556808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d7006dd20 msgr2=0x7f7d7015e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:32.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.809+0000 7f7d6ed9d700 1 --2- 172.21.15.3:0/1070556808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d7006dd20 0x7f7d7015e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:32.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.809+0000 7f7d6ed9d700 1 -- 172.21.15.3:0/1070556808 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d68009a20 con 0x7f7d7006ca80 2023-10-08T15:42:32.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.813+0000 7f7d6ed9d700 1 --2- 172.21.15.3:0/1070556808 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7d7006ca80 0x7f7d7015bda0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f7d6400ec80 tx=0x7f7d64009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:32.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.813+0000 7f7d56ffd700 1 -- 172.21.15.3:0/1070556808 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d64009680 con 0x7f7d7006ca80 2023-10-08T15:42:32.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.813+0000 7f7d56ffd700 1 -- 172.21.15.3:0/1070556808 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d6400c850 con 0x7f7d7006ca80 2023-10-08T15:42:32.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.813+0000 7f7d7504a700 1 -- 172.21.15.3:0/1070556808 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d600094f0 con 0x7f7d7006ca80 2023-10-08T15:42:32.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.813+0000 7f7d56ffd700 1 -- 172.21.15.3:0/1070556808 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6400cbd0 con 0x7f7d7006ca80 2023-10-08T15:42:32.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.813+0000 7f7d7504a700 1 -- 172.21.15.3:0/1070556808 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d70068db0 con 0x7f7d7006ca80 2023-10-08T15:42:32.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.813+0000 7f7d7504a700 1 -- 172.21.15.3:0/1070556808 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d70064530 con 0x7f7d7006ca80 2023-10-08T15:42:32.821 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.813+0000 7f7d56ffd700 1 -- 172.21.15.3:0/1070556808 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f7d64013470 con 0x7f7d7006ca80 2023-10-08T15:42:32.821 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.813+0000 7f7d56ffd700 1 --2- 172.21.15.3:0/1070556808 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7d5c060550 0x7f7d5c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:32.821 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.813+0000 7f7d56ffd700 1 -- 172.21.15.3:0/1070556808 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7d6407ccf0 con 0x7f7d7006ca80 2023-10-08T15:42:32.821 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.813+0000 7f7d6e59c700 1 --2- 172.21.15.3:0/1070556808 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7d5c060550 0x7f7d5c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:32.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.817+0000 7f7d6e59c700 1 --2- 172.21.15.3:0/1070556808 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7d5c060550 0x7f7d5c062a00 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7d700b7880 tx=0x7f7d60017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:32.827 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.821+0000 7f7d56ffd700 1 -- 172.21.15.3:0/1070556808 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7d64081070 con 0x7f7d7006ca80 2023-10-08T15:42:32.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.981+0000 7f7d7504a700 1 -- 172.21.15.3:0/1070556808 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7d7004b600 con 0x7f7d7006ca80 2023-10-08T15:42:32.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.985+0000 7f7d56ffd700 1 -- 172.21.15.3:0/1070556808 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+15257 (secure 0 0 0) 0x7f7d6404d2e0 con 0x7f7d7006ca80 2023-10-08T15:42:32.991 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:42:32.991 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":71,"fsid":"7635972e-cd66-4a8f-a231-378db8b3847a","created":"2023-10-08T15:37:08.234594+0000","modified":"2023-10-08T15:42:31.324760+0000","last_up_change":"2023-10-08T15:37:17.537726+0000","last_in_change":"2023-10-08T15:37:10.269178+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:37:16.581590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:42:27.890694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-08T15:42:28.634350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"64fb1864-bfdd-4d75-9b41-03fb60085dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":33363},{"type":"v1","addr":"172.21.15.3:6801","nonce":33363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":33363},{"type":"v1","addr":"172.21.15.3:6803","nonce":33363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":33363},{"type":"v1","addr":"172.21.15.3:6807","nonce":33363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":33363},{"type":"v1","addr":"172.21.15.3:6805","nonce":33363}]},"public_addr":"172.21.15.3:6801/33363","cluster_addr":"172.21.15.3:6803/33363","heartbeat_back_addr":"172.21.15.3:6807/33363","heartbeat_front_addr":"172.21.15.3:6805/33363","state":["exists","up"]},{"osd":1,"uuid":"3ca6bd3a-3e8a-4c65-af9c-46148b0c2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":33364},{"type":"v1","addr":"172.21.15.3:6820","nonce":33364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":33364},{"type":"v1","addr":"172.21.15.3:6824","nonce":33364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":33364},{"type":"v1","addr":"172.21.15.3:6831","nonce":33364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":33364},{"type":"v1","addr":"172.21.15.3:6828","nonce":33364}]},"public_addr":"172.21.15.3:6820/33364","cluster_addr":"172.21.15.3:6824/33364","heartbeat_back_addr":"172.21.15.3:6831/33364","heartbeat_front_addr":"172.21.15.3:6828/33364","state":["exists","up"]},{"osd":2,"uuid":"6eb9f757-58dd-442f-910d-32401454bce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":33366},{"type":"v1","addr":"172.21.15.3:6817","nonce":33366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6819","nonce":33366},{"type":"v1","addr":"172.21.15.3:6821","nonce":33366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6827","nonce":33366},{"type":"v1","addr":"172.21.15.3:6829","nonce":33366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":33366},{"type":"v1","addr":"172.21.15.3:6825","nonce":33366}]},"public_addr":"172.21.15.3:6817/33366","cluster_addr":"172.21.15.3:6821/33366","heartbeat_back_addr":"172.21.15.3:6829/33366","heartbeat_front_addr":"172.21.15.3:6825/33366","state":["exists","up"]},{"osd":3,"uuid":"1c39866b-ac2e-4ea9-a69c-02b01ee4191d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":33365},{"type":"v1","addr":"172.21.15.3:6809","nonce":33365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":33365},{"type":"v1","addr":"172.21.15.3:6811","nonce":33365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":33365},{"type":"v1","addr":"172.21.15.3:6815","nonce":33365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":33365},{"type":"v1","addr":"172.21.15.3:6813","nonce":33365}]},"public_addr":"172.21.15.3:6809/33365","cluster_addr":"172.21.15.3:6811/33365","heartbeat_back_addr":"172.21.15.3:6815/33365","heartbeat_front_addr":"172.21.15.3:6813/33365","state":["exists","up"]},{"osd":4,"uuid":"15f86b61-b7f1-4780-ae00-9d80a68cb830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":33605},{"type":"v1","addr":"172.21.15.50:6809","nonce":33605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":33605},{"type":"v1","addr":"172.21.15.50:6811","nonce":33605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":33605},{"type":"v1","addr":"172.21.15.50:6815","nonce":33605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":33605},{"type":"v1","addr":"172.21.15.50:6813","nonce":33605}]},"public_addr":"172.21.15.50:6809/33605","cluster_addr":"172.21.15.50:6811/33605","heartbeat_back_addr":"172.21.15.50:6815/33605","heartbeat_front_addr":"172.21.15.50:6813/33605","state":["exists","up"]},{"osd":5,"uuid":"726c3003-34e6-4d5a-b6e2-f911e13c2118","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":33606},{"type":"v1","addr":"172.21.15.50:6801","nonce":33606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":33606},{"type":"v1","addr":"172.21.15.50:6803","nonce":33606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":33606},{"type":"v1","addr":"172.21.15.50:6807","nonce":33606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":33606},{"type":"v1","addr":"172.21.15.50:6805","nonce":33606}]},"public_addr":"172.21.15.50:6801/33606","cluster_addr":"172.21.15.50:6803/33606","heartbeat_back_addr":"172.21.15.50:6807/33606","heartbeat_front_addr":"172.21.15.50:6805/33606","state":["exists","up"]},{"osd":6,"uuid":"401122a4-9988-441f-a5a7-39164434ebcd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":33607},{"type":"v1","addr":"172.21.15.50:6819","nonce":33607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":33607},{"type":"v1","addr":"172.21.15.50:6823","nonce":33607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6829","nonce":33607},{"type":"v1","addr":"172.21.15.50:6831","nonce":33607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":33607},{"type":"v1","addr":"172.21.15.50:6827","nonce":33607}]},"public_addr":"172.21.15.50:6819/33607","cluster_addr":"172.21.15.50:6823/33607","heartbeat_back_addr":"172.21.15.50:6831/33607","heartbeat_front_addr":"172.21.15.50:6827/33607","state":["exists","up"]},{"osd":7,"uuid":"6b3fa236-c9d0-4c4d-82ae-9af4daf6d699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":33604},{"type":"v1","addr":"172.21.15.50:6818","nonce":33604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":33604},{"type":"v1","addr":"172.21.15.50:6822","nonce":33604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":33604},{"type":"v1","addr":"172.21.15.50:6830","nonce":33604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":33604},{"type":"v1","addr":"172.21.15.50:6826","nonce":33604}]},"public_addr":"172.21.15.50:6818/33604","cluster_addr":"172.21.15.50:6822/33604","heartbeat_back_addr":"172.21.15.50:6830/33604","heartbeat_front_addr":"172.21.15.50:6826/33604","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.497794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.529417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.873426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.325972+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.443971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.240795+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.739632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:37:15.643026+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:42:32.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.985+0000 7f7d7504a700 1 -- 172.21.15.3:0/1070556808 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7d5c060550 msgr2=0x7f7d5c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:32.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.985+0000 7f7d7504a700 1 --2- 172.21.15.3:0/1070556808 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7d5c060550 0x7f7d5c062a00 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7d700b7880 tx=0x7f7d60017000 comp rx=0 tx=0).stop 2023-10-08T15:42:32.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.985+0000 7f7d7504a700 1 -- 172.21.15.3:0/1070556808 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7d7006ca80 msgr2=0x7f7d7015bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:32.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.985+0000 7f7d7504a700 1 --2- 172.21.15.3:0/1070556808 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7d7006ca80 0x7f7d7015bda0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f7d6400ec80 tx=0x7f7d64009120 comp rx=0 tx=0).stop 2023-10-08T15:42:32.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.985+0000 7f7d7504a700 1 -- 172.21.15.3:0/1070556808 shutdown_connections 2023-10-08T15:42:32.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.985+0000 7f7d7504a700 1 --2- 172.21.15.3:0/1070556808 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7d5c060550 0x7f7d5c062a00 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:32.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.985+0000 7f7d7504a700 1 --2- 172.21.15.3:0/1070556808 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7d700bb2f0 0x7f7d7015ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:32.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.985+0000 7f7d7504a700 1 --2- 172.21.15.3:0/1070556808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d7006dd20 0x7f7d7015e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:32.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.985+0000 7f7d7504a700 1 --2- 172.21.15.3:0/1070556808 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7d7006ca80 0x7f7d7015bda0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:32.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.985+0000 7f7d7504a700 1 -- 172.21.15.3:0/1070556808 >> 172.21.15.3:0/1070556808 conn(0x7f7d700be640 msgr2=0x7f7d701465f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:32.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.985+0000 7f7d7504a700 1 -- 172.21.15.3:0/1070556808 shutdown_connections 2023-10-08T15:42:32.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:32.989+0000 7f7d7504a700 1 -- 172.21.15.3:0/1070556808 wait complete. 2023-10-08T15:42:33.007 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T15:42:33.007 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T15:42:33.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.109+0000 7feed1f80700 1 Processor -- start 2023-10-08T15:42:33.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.109+0000 7feed1f80700 1 -- start start 2023-10-08T15:42:33.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.109+0000 7feed1f80700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7feecc0a15e0 0x7feecc14b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:33.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.109+0000 7feed1f80700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feecc147e00 0x7feecc148280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:33.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.109+0000 7feed1f80700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feecc147970 con 0x7feecc146b70 2023-10-08T15:42:33.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.109+0000 7feed1f80700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feecc06de00 con 0x7feecc0a15e0 2023-10-08T15:42:33.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.109+0000 7feed1f80700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feecc14bd90 con 0x7feecc147e00 2023-10-08T15:42:33.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.113+0000 7feecbfff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7feecc146b70 0x7feecc146fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:59226/0 (socket says 172.21.15.3:59226) 2023-10-08T15:42:33.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.113+0000 7feecbfff700 1 -- 172.21.15.3:0/2232816976 learned_addr learned my addr 172.21.15.3:0/2232816976 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:42:33.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.113+0000 7feed0f7e700 1 --2- 172.21.15.3:0/2232816976 >> v2:172.21.15.3:3300/0 conn(0x7feecc0a15e0 0x7feecc14b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:33.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.113+0000 7feed177f700 1 --2- 172.21.15.3:0/2232816976 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feecc147e00 0x7feecc148280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:33.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.113+0000 7feed0f7e700 1 -- 172.21.15.3:0/2232816976 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feecc147e00 msgr2=0x7feecc148280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:33.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.113+0000 7feed0f7e700 1 --2- 172.21.15.3:0/2232816976 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feecc147e00 0x7feecc148280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:33.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.113+0000 7feed0f7e700 1 -- 172.21.15.3:0/2232816976 >> v1:172.21.15.3:6789/0 conn(0x7feecc146b70 legacy=0x7feecc146fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:33.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.113+0000 7feecb7fe700 1 -- 172.21.15.3:0/2232816976 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3531643260 0 0) 0x7feecc147970 con 0x7feecc146b70 2023-10-08T15:42:33.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.113+0000 7feed0f7e700 1 -- 172.21.15.3:0/2232816976 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feecc069770 con 0x7feecc0a15e0 2023-10-08T15:42:33.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.113+0000 7feed0f7e700 1 --2- 172.21.15.3:0/2232816976 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feecc0a15e0 0x7feecc14b850 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7feec000a990 tx=0x7feec00080e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60f9997fc1b44912 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:33.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.113+0000 7feecb7fe700 1 -- 172.21.15.3:0/2232816976 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec000ae80 con 0x7feecc0a15e0 2023-10-08T15:42:33.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.113+0000 7feecb7fe700 1 -- 172.21.15.3:0/2232816976 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec000b750 con 0x7feecc0a15e0 2023-10-08T15:42:33.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.113+0000 7feecb7fe700 1 -- 172.21.15.3:0/2232816976 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec000bad0 con 0x7feecc0a15e0 2023-10-08T15:42:33.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.113+0000 7feed1f80700 1 -- 172.21.15.3:0/2232816976 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feecc0a15e0 msgr2=0x7feecc14b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:33.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.113+0000 7feed1f80700 1 --2- 172.21.15.3:0/2232816976 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feecc0a15e0 0x7feecc14b850 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7feec000a990 tx=0x7feec00080e0 comp rx=0 tx=0).stop 2023-10-08T15:42:33.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.113+0000 7feed1f80700 1 -- 172.21.15.3:0/2232816976 shutdown_connections 2023-10-08T15:42:33.122 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.113+0000 7feed1f80700 1 --2- 172.21.15.3:0/2232816976 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feecc147e00 0x7feecc148280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:33.122 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.113+0000 7feed1f80700 1 --2- 172.21.15.3:0/2232816976 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feecc0a15e0 0x7feecc14b850 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:33.122 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.113+0000 7feed1f80700 1 -- 172.21.15.3:0/2232816976 >> 172.21.15.3:0/2232816976 conn(0x7feecc0670e0 msgr2=0x7feecc0674e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:33.122 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.113+0000 7feed1f80700 1 -- 172.21.15.3:0/2232816976 shutdown_connections 2023-10-08T15:42:33.122 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.113+0000 7feed1f80700 1 -- 172.21.15.3:0/2232816976 wait complete. 2023-10-08T15:42:33.123 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.117+0000 7feed1f80700 1 Processor -- start 2023-10-08T15:42:33.123 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.117+0000 7feed1f80700 1 -- start start 2023-10-08T15:42:33.125 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.117+0000 7feed1f80700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feecc0a15e0 0x7feecc149f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:33.125 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.117+0000 7feed1f80700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feecc146b70 0x7feecc1403b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:33.125 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.117+0000 7feed1f80700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feecc147e00 0x7feecc1408f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:33.125 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.117+0000 7feed1f80700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feecc0b5c70 con 0x7feecc146b70 2023-10-08T15:42:33.125 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.117+0000 7feed1f80700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feecc14a890 con 0x7feecc0a15e0 2023-10-08T15:42:33.125 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.117+0000 7feed1f80700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feecc0b52d0 con 0x7feecc147e00 2023-10-08T15:42:33.126 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.117+0000 7feecbfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feecc146b70 0x7feecc1403b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:33.126 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.117+0000 7feecbfff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feecc146b70 0x7feecc1403b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57214/0 (socket says 172.21.15.3:57214) 2023-10-08T15:42:33.126 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.117+0000 7feecbfff700 1 -- 172.21.15.3:0/2189118721 learned_addr learned my addr 172.21.15.3:0/2189118721 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:33.126 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.117+0000 7feed0f7e700 1 --2- 172.21.15.3:0/2189118721 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feecc0a15e0 0x7feecc149f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:33.126 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.117+0000 7feed177f700 1 --2- 172.21.15.3:0/2189118721 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feecc147e00 0x7feecc1408f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:33.126 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.117+0000 7feecbfff700 1 -- 172.21.15.3:0/2189118721 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feecc147e00 msgr2=0x7feecc1408f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:33.126 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.117+0000 7feecbfff700 1 --2- 172.21.15.3:0/2189118721 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feecc147e00 0x7feecc1408f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:33.126 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.117+0000 7feecbfff700 1 -- 172.21.15.3:0/2189118721 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feecc0a15e0 msgr2=0x7feecc149f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:33.126 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.117+0000 7feecbfff700 1 --2- 172.21.15.3:0/2189118721 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feecc0a15e0 0x7feecc149f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:33.126 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.117+0000 7feecbfff700 1 -- 172.21.15.3:0/2189118721 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec000a4d0 con 0x7feecc146b70 2023-10-08T15:42:33.127 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.117+0000 7feecbfff700 1 --2- 172.21.15.3:0/2189118721 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feecc146b70 0x7feecc1403b0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7feeb800c7e0 tx=0x7feeb8007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:33.127 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.121+0000 7feec8ff9700 1 -- 172.21.15.3:0/2189118721 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb8005b30 con 0x7feecc146b70 2023-10-08T15:42:33.127 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.121+0000 7feec8ff9700 1 -- 172.21.15.3:0/2189118721 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb8005c90 con 0x7feecc146b70 2023-10-08T15:42:33.127 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.121+0000 7feed1f80700 1 -- 172.21.15.3:0/2189118721 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feecc0b55b0 con 0x7feecc146b70 2023-10-08T15:42:33.128 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.121+0000 7feec8ff9700 1 -- 172.21.15.3:0/2189118721 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb8007300 con 0x7feecc146b70 2023-10-08T15:42:33.128 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.121+0000 7feed1f80700 1 -- 172.21.15.3:0/2189118721 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feecc15b130 con 0x7feecc146b70 2023-10-08T15:42:33.128 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.121+0000 7feed1f80700 1 -- 172.21.15.3:0/2189118721 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feecc05ecf0 con 0x7feecc146b70 2023-10-08T15:42:33.128 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.121+0000 7feec8ff9700 1 -- 172.21.15.3:0/2189118721 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7feeb8007670 con 0x7feecc146b70 2023-10-08T15:42:33.129 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.121+0000 7feec8ff9700 1 --2- 172.21.15.3:0/2189118721 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7feeb0060580 0x7feeb0062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:33.129 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.121+0000 7feec8ff9700 1 -- 172.21.15.3:0/2189118721 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5705+0+0 (secure 0 0 0) 0x7feeb807c2e0 con 0x7feecc146b70 2023-10-08T15:42:33.129 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.121+0000 7feed0f7e700 1 --2- 172.21.15.3:0/2189118721 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7feeb0060580 0x7feeb0062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:33.129 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.125+0000 7feed0f7e700 1 --2- 172.21.15.3:0/2189118721 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7feeb0060580 0x7feeb0062a30 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7feec000a450 tx=0x7feec0019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:33.138 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.133+0000 7feec8ff9700 1 -- 172.21.15.3:0/2189118721 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7feeb804c8d0 con 0x7feecc146b70 2023-10-08T15:42:33.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.293+0000 7feed1f80700 1 -- 172.21.15.3:0/2189118721 --> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7feecc068c60 con 0x7feeb0060580 2023-10-08T15:42:33.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.313+0000 7feec8ff9700 1 -- 172.21.15.3:0/2189118721 <== mgr.4102 v2:172.21.15.50:6832/33268 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+279287 (secure 0 0 0) 0x7feecc068c60 con 0x7feeb0060580 2023-10-08T15:42:33.319 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:42:33.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.313+0000 7feed1f80700 1 -- 172.21.15.3:0/2189118721 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7feeb0060580 msgr2=0x7feeb0062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:33.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.313+0000 7feed1f80700 1 --2- 172.21.15.3:0/2189118721 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7feeb0060580 0x7feeb0062a30 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7feec000a450 tx=0x7feec0019000 comp rx=0 tx=0).stop 2023-10-08T15:42:33.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.313+0000 7feed1f80700 1 -- 172.21.15.3:0/2189118721 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feecc146b70 msgr2=0x7feecc1403b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:33.322 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.313+0000 7feed1f80700 1 --2- 172.21.15.3:0/2189118721 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feecc146b70 0x7feecc1403b0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7feeb800c7e0 tx=0x7feeb8007df0 comp rx=0 tx=0).stop 2023-10-08T15:42:33.322 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.313+0000 7feed1f80700 1 -- 172.21.15.3:0/2189118721 shutdown_connections 2023-10-08T15:42:33.322 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.313+0000 7feed1f80700 1 --2- 172.21.15.3:0/2189118721 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7feeb0060580 0x7feeb0062a30 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:33.322 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.313+0000 7feed1f80700 1 --2- 172.21.15.3:0/2189118721 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feecc147e00 0x7feecc1408f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:33.322 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.313+0000 7feed1f80700 1 --2- 172.21.15.3:0/2189118721 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feecc146b70 0x7feecc1403b0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:33.322 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.313+0000 7feed1f80700 1 --2- 172.21.15.3:0/2189118721 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feecc0a15e0 0x7feecc149f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:33.322 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.313+0000 7feed1f80700 1 -- 172.21.15.3:0/2189118721 >> 172.21.15.3:0/2189118721 conn(0x7feecc0670e0 msgr2=0x7feecc0bcfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:33.322 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.313+0000 7feed1f80700 1 -- 172.21.15.3:0/2189118721 shutdown_connections 2023-10-08T15:42:33.322 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.313+0000 7feed1f80700 1 -- 172.21.15.3:0/2189118721 wait complete. 2023-10-08T15:42:33.323 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2023-10-08T15:42:33.334 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":222,"stamp":"2023-10-08T15:42:32.623817+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591904,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":165,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":102,"acting":102,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2470972,"kb_used_data":6652,"kb_used_omap":0,"kb_used_meta":2464256,"kb_avail":752503748,"statfs":{"total":773094113280,"available":770563837952,"internally_reserved":0,"allocated":6811648,"data_stored":3974022,"data_compressed":66282,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":2523398144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.360394"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.338290+0000","last_change":"2023-10-08T15:42:30.333246+0000","last_active":"2023-10-08T15:42:30.338290+0000","last_peered":"2023-10-08T15:42:30.338290+0000","last_clean":"2023-10-08T15:42:30.338290+0000","last_became_active":"2023-10-08T15:42:30.332961+0000","last_became_peered":"2023-10-08T15:42:30.332961+0000","last_unstale":"2023-10-08T15:42:30.338290+0000","last_undegraded":"2023-10-08T15:42:30.338290+0000","last_fullsized":"2023-10-08T15:42:30.338290+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:37:47.231005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.352621+0000","last_change":"2023-10-08T15:42:30.352621+0000","last_active":"2023-10-08T15:42:30.352621+0000","last_peered":"2023-10-08T15:42:30.352621+0000","last_clean":"2023-10-08T15:42:30.352621+0000","last_became_active":"2023-10-08T15:42:30.352272+0000","last_became_peered":"2023-10-08T15:42:30.352272+0000","last_unstale":"2023-10-08T15:42:30.352621+0000","last_undegraded":"2023-10-08T15:42:30.352621+0000","last_fullsized":"2023-10-08T15:42:30.352621+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:03:06.159027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.331850+0000","last_change":"2023-10-08T15:42:30.331850+0000","last_active":"2023-10-08T15:42:30.331850+0000","last_peered":"2023-10-08T15:42:30.331850+0000","last_clean":"2023-10-08T15:42:30.331850+0000","last_became_active":"2023-10-08T15:42:30.331530+0000","last_became_peered":"2023-10-08T15:42:30.331530+0000","last_unstale":"2023-10-08T15:42:30.331850+0000","last_undegraded":"2023-10-08T15:42:30.331850+0000","last_fullsized":"2023-10-08T15:42:30.331850+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:56.410736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.351375+0000","last_change":"2023-10-08T15:42:30.351375+0000","last_active":"2023-10-08T15:42:30.351375+0000","last_peered":"2023-10-08T15:42:30.351375+0000","last_clean":"2023-10-08T15:42:30.351375+0000","last_became_active":"2023-10-08T15:42:30.351044+0000","last_became_peered":"2023-10-08T15:42:30.351044+0000","last_unstale":"2023-10-08T15:42:30.351375+0000","last_undegraded":"2023-10-08T15:42:30.351375+0000","last_fullsized":"2023-10-08T15:42:30.351375+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:13:37.084139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.341197+0000","last_change":"2023-10-08T15:42:30.336763+0000","last_active":"2023-10-08T15:42:30.341197+0000","last_peered":"2023-10-08T15:42:30.341197+0000","last_clean":"2023-10-08T15:42:30.341197+0000","last_became_active":"2023-10-08T15:42:30.336407+0000","last_became_peered":"2023-10-08T15:42:30.336407+0000","last_unstale":"2023-10-08T15:42:30.341197+0000","last_undegraded":"2023-10-08T15:42:30.341197+0000","last_fullsized":"2023-10-08T15:42:30.341197+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:57:24.891115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.348876+0000","last_change":"2023-10-08T15:42:30.347286+0000","last_active":"2023-10-08T15:42:30.348876+0000","last_peered":"2023-10-08T15:42:30.348876+0000","last_clean":"2023-10-08T15:42:30.348876+0000","last_became_active":"2023-10-08T15:42:30.346996+0000","last_became_peered":"2023-10-08T15:42:30.346996+0000","last_unstale":"2023-10-08T15:42:30.348876+0000","last_undegraded":"2023-10-08T15:42:30.348876+0000","last_fullsized":"2023-10-08T15:42:30.348876+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:16:28.709078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.335048+0000","last_change":"2023-10-08T15:42:30.328725+0000","last_active":"2023-10-08T15:42:30.335048+0000","last_peered":"2023-10-08T15:42:30.335048+0000","last_clean":"2023-10-08T15:42:30.335048+0000","last_became_active":"2023-10-08T15:42:30.328426+0000","last_became_peered":"2023-10-08T15:42:30.328426+0000","last_unstale":"2023-10-08T15:42:30.335048+0000","last_undegraded":"2023-10-08T15:42:30.335048+0000","last_fullsized":"2023-10-08T15:42:30.335048+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:45:25.945569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.348251+0000","last_change":"2023-10-08T15:42:30.345432+0000","last_active":"2023-10-08T15:42:30.348251+0000","last_peered":"2023-10-08T15:42:30.348251+0000","last_clean":"2023-10-08T15:42:30.348251+0000","last_became_active":"2023-10-08T15:42:30.345101+0000","last_became_peered":"2023-10-08T15:42:30.345101+0000","last_unstale":"2023-10-08T15:42:30.348251+0000","last_undegraded":"2023-10-08T15:42:30.348251+0000","last_fullsized":"2023-10-08T15:42:30.348251+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:58:41.138214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.346146+0000","last_change":"2023-10-08T15:42:30.343874+0000","last_active":"2023-10-08T15:42:30.346146+0000","last_peered":"2023-10-08T15:42:30.346146+0000","last_clean":"2023-10-08T15:42:30.346146+0000","last_became_active":"2023-10-08T15:42:30.343472+0000","last_became_peered":"2023-10-08T15:42:30.343472+0000","last_unstale":"2023-10-08T15:42:30.346146+0000","last_undegraded":"2023-10-08T15:42:30.346146+0000","last_fullsized":"2023-10-08T15:42:30.346146+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:59:36.731597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.274213+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:44:16.491355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"70'1","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.341212+0000","last_change":"2023-10-08T15:42:29.290673+0000","last_active":"2023-10-08T15:42:30.341212+0000","last_peered":"2023-10-08T15:42:30.341212+0000","last_clean":"2023-10-08T15:42:30.341212+0000","last_became_active":"2023-10-08T15:42:29.290131+0000","last_became_peered":"2023-10-08T15:42:29.290131+0000","last_unstale":"2023-10-08T15:42:30.341212+0000","last_undegraded":"2023-10-08T15:42:30.341212+0000","last_fullsized":"2023-10-08T15:42:30.341212+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:49:41.274172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.270030+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:35:17.371964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.271991+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:13:36.080229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"70'1","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.347037+0000","last_change":"2023-10-08T15:42:29.291620+0000","last_active":"2023-10-08T15:42:30.347037+0000","last_peered":"2023-10-08T15:42:30.347037+0000","last_clean":"2023-10-08T15:42:30.347037+0000","last_became_active":"2023-10-08T15:42:29.291298+0000","last_became_peered":"2023-10-08T15:42:29.291298+0000","last_unstale":"2023-10-08T15:42:30.347037+0000","last_undegraded":"2023-10-08T15:42:30.347037+0000","last_fullsized":"2023-10-08T15:42:30.347037+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:35:17.371964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.353385+0000","last_change":"2023-10-08T15:42:30.352385+0000","last_active":"2023-10-08T15:42:30.353385+0000","last_peered":"2023-10-08T15:42:30.353385+0000","last_clean":"2023-10-08T15:42:30.353385+0000","last_became_active":"2023-10-08T15:42:30.351949+0000","last_became_peered":"2023-10-08T15:42:30.351949+0000","last_unstale":"2023-10-08T15:42:30.353385+0000","last_undegraded":"2023-10-08T15:42:30.353385+0000","last_fullsized":"2023-10-08T15:42:30.353385+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:06:28.263822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"70'1","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.341264+0000","last_change":"2023-10-08T15:42:29.290424+0000","last_active":"2023-10-08T15:42:30.341264+0000","last_peered":"2023-10-08T15:42:30.341264+0000","last_clean":"2023-10-08T15:42:30.341264+0000","last_became_active":"2023-10-08T15:42:29.289913+0000","last_became_peered":"2023-10-08T15:42:29.289913+0000","last_unstale":"2023-10-08T15:42:30.341264+0000","last_undegraded":"2023-10-08T15:42:30.341264+0000","last_fullsized":"2023-10-08T15:42:30.341264+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:10:34.911060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.274727+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:38:52.335948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.270553+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:24:55.362713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.273239+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:40.888869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.347548+0000","last_change":"2023-10-08T15:42:30.347548+0000","last_active":"2023-10-08T15:42:30.347548+0000","last_peered":"2023-10-08T15:42:30.347548+0000","last_clean":"2023-10-08T15:42:30.347548+0000","last_became_active":"2023-10-08T15:42:30.347209+0000","last_became_peered":"2023-10-08T15:42:30.347209+0000","last_unstale":"2023-10-08T15:42:30.347548+0000","last_undegraded":"2023-10-08T15:42:30.347548+0000","last_fullsized":"2023-10-08T15:42:30.347548+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:46:26.270646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.272483+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:09:24.762917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.274079+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:18:15.067702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.359495+0000","last_change":"2023-10-08T15:42:30.358813+0000","last_active":"2023-10-08T15:42:30.359495+0000","last_peered":"2023-10-08T15:42:30.359495+0000","last_clean":"2023-10-08T15:42:30.359495+0000","last_became_active":"2023-10-08T15:42:30.358527+0000","last_became_peered":"2023-10-08T15:42:30.358527+0000","last_unstale":"2023-10-08T15:42:30.359495+0000","last_undegraded":"2023-10-08T15:42:30.359495+0000","last_fullsized":"2023-10-08T15:42:30.359495+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:54:13.937795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"70'6","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.342186+0000","last_change":"2023-10-08T15:42:29.291159+0000","last_active":"2023-10-08T15:42:30.342186+0000","last_peered":"2023-10-08T15:42:30.342186+0000","last_clean":"2023-10-08T15:42:30.342186+0000","last_became_active":"2023-10-08T15:42:29.290812+0000","last_became_peered":"2023-10-08T15:42:29.290812+0000","last_unstale":"2023-10-08T15:42:30.342186+0000","last_undegraded":"2023-10-08T15:42:30.342186+0000","last_fullsized":"2023-10-08T15:42:30.342186+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:26:01.548146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.272281+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:54:24.309030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.270713+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:48:23.733193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-10-08T15:42:29.290271+0000","last_change":"2023-10-08T15:42:29.288141+0000","last_active":"2023-10-08T15:42:29.290271+0000","last_peered":"2023-10-08T15:42:29.290271+0000","last_clean":"2023-10-08T15:42:29.290271+0000","last_became_active":"2023-10-08T15:42:29.287228+0000","last_became_peered":"2023-10-08T15:42:29.287228+0000","last_unstale":"2023-10-08T15:42:29.290271+0000","last_undegraded":"2023-10-08T15:42:29.290271+0000","last_fullsized":"2023-10-08T15:42:29.290271+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:44:16.551176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.271533+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:49:41.274172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.272372+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:45:28.837814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.272303+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:47:39.065529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.342433+0000","last_change":"2023-10-08T15:42:30.336936+0000","last_active":"2023-10-08T15:42:30.342433+0000","last_peered":"2023-10-08T15:42:30.342433+0000","last_clean":"2023-10-08T15:42:30.342433+0000","last_became_active":"2023-10-08T15:42:30.336624+0000","last_became_peered":"2023-10-08T15:42:30.336624+0000","last_unstale":"2023-10-08T15:42:30.342433+0000","last_undegraded":"2023-10-08T15:42:30.342433+0000","last_fullsized":"2023-10-08T15:42:30.342433+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:16:35.166421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.271204+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:10:34.911060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.273187+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:27:26.579698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.330839+0000","last_change":"2023-10-08T15:42:30.330839+0000","last_active":"2023-10-08T15:42:30.330839+0000","last_peered":"2023-10-08T15:42:30.330839+0000","last_clean":"2023-10-08T15:42:30.330839+0000","last_became_active":"2023-10-08T15:42:30.330544+0000","last_became_peered":"2023-10-08T15:42:30.330544+0000","last_unstale":"2023-10-08T15:42:30.330839+0000","last_undegraded":"2023-10-08T15:42:30.330839+0000","last_fullsized":"2023-10-08T15:42:30.330839+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:02:31.620217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.266182+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:41:42.495720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.266206+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:39:07.074681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.354803+0000","last_change":"2023-10-08T15:42:30.354803+0000","last_active":"2023-10-08T15:42:30.354803+0000","last_peered":"2023-10-08T15:42:30.354803+0000","last_clean":"2023-10-08T15:42:30.354803+0000","last_became_active":"2023-10-08T15:42:30.354575+0000","last_became_peered":"2023-10-08T15:42:30.354575+0000","last_unstale":"2023-10-08T15:42:30.354803+0000","last_undegraded":"2023-10-08T15:42:30.354803+0000","last_fullsized":"2023-10-08T15:42:30.354803+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:38:53.339858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.270896+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:41:39.525248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.335085+0000","last_change":"2023-10-08T15:42:30.328430+0000","last_active":"2023-10-08T15:42:30.335085+0000","last_peered":"2023-10-08T15:42:30.335085+0000","last_clean":"2023-10-08T15:42:30.335085+0000","last_became_active":"2023-10-08T15:42:30.328093+0000","last_became_peered":"2023-10-08T15:42:30.328093+0000","last_unstale":"2023-10-08T15:42:30.335085+0000","last_undegraded":"2023-10-08T15:42:30.335085+0000","last_fullsized":"2023-10-08T15:42:30.335085+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:25:03.880884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.270618+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:26:23.323002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.271500+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:22:35.054661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.273029+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:37:51.634617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.359048+0000","last_change":"2023-10-08T15:42:30.358100+0000","last_active":"2023-10-08T15:42:30.359048+0000","last_peered":"2023-10-08T15:42:30.359048+0000","last_clean":"2023-10-08T15:42:30.359048+0000","last_became_active":"2023-10-08T15:42:30.357781+0000","last_became_peered":"2023-10-08T15:42:30.357781+0000","last_unstale":"2023-10-08T15:42:30.359048+0000","last_undegraded":"2023-10-08T15:42:30.359048+0000","last_fullsized":"2023-10-08T15:42:30.359048+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:15.362329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.271631+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:57:32.840050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.330833+0000","last_change":"2023-10-08T15:42:30.330833+0000","last_active":"2023-10-08T15:42:30.330833+0000","last_peered":"2023-10-08T15:42:30.330833+0000","last_clean":"2023-10-08T15:42:30.330833+0000","last_became_active":"2023-10-08T15:42:30.330506+0000","last_became_peered":"2023-10-08T15:42:30.330506+0000","last_unstale":"2023-10-08T15:42:30.330833+0000","last_undegraded":"2023-10-08T15:42:30.330833+0000","last_fullsized":"2023-10-08T15:42:30.330833+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:29:47.019147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.270472+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:32:51.033691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.323086+0000","last_change":"2023-10-08T15:42:29.290448+0000","last_active":"2023-10-08T15:42:30.323086+0000","last_peered":"2023-10-08T15:42:30.323086+0000","last_clean":"2023-10-08T15:42:30.323086+0000","last_became_active":"2023-10-08T15:42:29.289907+0000","last_became_peered":"2023-10-08T15:42:29.289907+0000","last_unstale":"2023-10-08T15:42:30.323086+0000","last_undegraded":"2023-10-08T15:42:30.323086+0000","last_fullsized":"2023-10-08T15:42:30.323086+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:32:51.033691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.271831+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:55.498305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.322824+0000","last_change":"2023-10-08T15:42:29.286199+0000","last_active":"2023-10-08T15:42:30.322824+0000","last_peered":"2023-10-08T15:42:30.322824+0000","last_clean":"2023-10-08T15:42:30.322824+0000","last_became_active":"2023-10-08T15:42:29.285228+0000","last_became_peered":"2023-10-08T15:42:29.285228+0000","last_unstale":"2023-10-08T15:42:30.322824+0000","last_undegraded":"2023-10-08T15:42:30.322824+0000","last_fullsized":"2023-10-08T15:42:30.322824+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:03:22.866811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.268588+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:58:59.888585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":211,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T15:42:26.252167+0000","last_change":"2023-10-08T15:37:19.380955+0000","last_active":"2023-10-08T15:42:26.252167+0000","last_peered":"2023-10-08T15:42:26.252167+0000","last_clean":"2023-10-08T15:42:26.252167+0000","last_became_active":"2023-10-08T15:37:19.378277+0000","last_became_peered":"2023-10-08T15:37:19.378277+0000","last_unstale":"2023-10-08T15:42:26.252167+0000","last_undegraded":"2023-10-08T15:42:26.252167+0000","last_fullsized":"2023-10-08T15:42:26.252167+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:17.537726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:17.537726+0000","last_clean_scrub_stamp":"2023-10-08T15:37:17.537726+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:06:26.612046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":36,"acting":36,"num_store_stats":2},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66282,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542208,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310440,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061400,"statfs":{"total":96636764160,"available":96318873600,"internally_reserved":0,"allocated":884736,"data_stored":932389,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:41:27 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.92000000000000004,"15min":0.95199999999999996},"min":{"1min":0.57099999999999995,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":1.196},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.92400000000000004,"15min":0.92900000000000005},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.3600000000000001,"5min":1.758,"15min":1.758},"last":0.81799999999999995}]},{"osd":1,"last update":"Sun Oct 8 15:41:27 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.88200000000000001,"15min":0.88600000000000001},"min":{"1min":0.46600000000000003,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.1930000000000001,"5min":1.474,"15min":1.474},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.94299999999999995,"15min":0.95499999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.2849999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.0129999999999999}]},{"osd":2,"last update":"Sun Oct 8 15:41:27 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.97099999999999997,"15min":1.016},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.381,"5min":1.623,"15min":1.623},"last":1.4219999999999999},{"interface":"front","average":{"1min":1.038,"5min":1.0029999999999999,"15min":1.0069999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.68300000000000005}]},{"osd":3,"last update":"Sun Oct 8 15:41:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.012,"15min":0.98199999999999998},"min":{"1min":0.91900000000000004,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.8260000000000001,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.998,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.8129999999999999,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":1.3149999999999999}]},{"osd":4,"last update":"Sun Oct 8 15:41:27 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.0389999999999999,"15min":1.077},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0760000000000001,"15min":1.0940000000000001},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.393,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.228}]},{"osd":5,"last update":"Sun Oct 8 15:41:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1799999999999999,"15min":1.248},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.6359999999999999,"5min":1.792,"15min":1.792},"last":1.381},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.2130000000000001,"15min":1.2410000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":1.288}]},{"osd":6,"last update":"Sun Oct 8 15:41:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.272,"15min":1.3080000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.6879999999999999,"5min":1.839,"15min":1.839},"last":1.145},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.1950000000000001,"15min":1.2410000000000001},"min":{"1min":0.79900000000000004,"5min":0.627,"15min":0.627},"max":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":1.0860000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542209,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306280,"kb_used_data":800,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065560,"statfs":{"total":96636764160,"available":96323133440,"internally_reserved":0,"allocated":819200,"data_stored":342021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.90700000000000003,"15min":0.84499999999999997},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.2889999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97999999999999998,"15min":0.996},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.3899999999999999,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.0920000000000001}]},{"osd":1,"last update":"Sun Oct 8 15:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.96599999999999997,"15min":0.96199999999999997},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.385,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":1.1870000000000001},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.97499999999999998,"15min":0.98699999999999999},"min":{"1min":0.66500000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.5149999999999999,"5min":1.853,"15min":1.853},"last":0.66500000000000004}]},{"osd":2,"last update":"Sun Oct 8 15:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.89700000000000002,"15min":0.85899999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.333,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.046,"5min":1.0569999999999999,"15min":1.073},"min":{"1min":0.65500000000000003,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.325,"5min":1.518,"15min":1.518},"last":1.038}]},{"osd":3,"last update":"Sun Oct 8 15:42:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0449999999999999,"15min":1.0289999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.456,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.95799999999999996,"5min":1.02,"15min":1.0640000000000001},"min":{"1min":0.67100000000000004,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.202,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":1.143}]},{"osd":4,"last update":"Sun Oct 8 15:42:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.0960000000000001,"15min":1.1160000000000001},"min":{"1min":0.69899999999999995,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.405,"5min":1.7,"15min":1.7},"last":1.284},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.151,"15min":1.181},"min":{"1min":0.86899999999999999,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.5720000000000001,"5min":1.623,"15min":1.623},"last":1.2470000000000001}]},{"osd":5,"last update":"Sun Oct 8 15:42:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0760000000000001,"15min":1.1120000000000001},"min":{"1min":0.755,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.3939999999999999,"5min":1.581,"15min":1.581},"last":1.3939999999999999},{"interface":"front","average":{"1min":1.254,"5min":1.2529999999999999,"15min":1.298},"min":{"1min":0.85899999999999999,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.554,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":1.3380000000000001}]},{"osd":7,"last update":"Sun Oct 8 15:42:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.264,"15min":1.282},"min":{"1min":0.93999999999999995,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":1.631,"5min":1.74,"15min":1.74},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.2410000000000001,"15min":1.2929999999999999},"min":{"1min":0.99199999999999999,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":1.5920000000000001,"5min":2.5630000000000002,"15min":2.5630000000000002},"last":1.45}]}]},{"osd":3,"up_from":14,"seq":60129542210,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310376,"kb_used_data":800,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061464,"statfs":{"total":96636764160,"available":96318939136,"internally_reserved":0,"allocated":819200,"data_stored":342021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.67600000000000005,"15min":0.70799999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.84199999999999997,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.748,"5min":0.76700000000000002,"15min":0.76200000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.98399999999999999,"5min":1.179,"15min":1.179},"last":0.98399999999999999}]},{"osd":1,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.73199999999999998,"15min":0.71699999999999997},"min":{"1min":0.42199999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.052,"5min":1.365,"15min":1.365},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.745,"5min":0.82899999999999996,"15min":0.81399999999999995},"min":{"1min":0.52700000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93799999999999994,"5min":1.353,"15min":1.353},"last":0.67200000000000004}]},{"osd":2,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.83799999999999997,"15min":0.84699999999999998},"min":{"1min":0.58699999999999997,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.244,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.90000000000000002,"15min":0.91900000000000004},"min":{"1min":0.47599999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.2350000000000001,"5min":1.423,"15min":1.423},"last":0.628}]},{"osd":4,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.069,"15min":1.0640000000000001},"min":{"1min":0.73899999999999999,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.3129999999999999,"5min":1.585,"15min":1.585},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.024,"5min":1.073,"15min":1.131},"min":{"1min":0.72999999999999998,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.339,"5min":2.762,"15min":2.762},"last":0.95099999999999996}]},{"osd":5,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.1100000000000001,"15min":1.1419999999999999},"min":{"1min":0.755,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.3400000000000001,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.143,"5min":1.1850000000000001,"15min":1.2190000000000001},"min":{"1min":0.78500000000000003,"5min":0.755,"15min":0.755},"max":{"1min":1.625,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":1.0629999999999999}]},{"osd":6,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.212,"15min":1.278},"min":{"1min":0.82199999999999995,"5min":0.746,"15min":0.746},"max":{"1min":1.504,"5min":2.6890000000000001,"15min":2.6890000000000001},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.103,"5min":1.194,"15min":1.212},"min":{"1min":0.86899999999999999,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":1.409,"5min":1.742,"15min":1.742},"last":1.141}]},{"osd":7,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2490000000000001,"15min":1.2529999999999999},"min":{"1min":0.93200000000000005,"5min":0.91600000000000004,"15min":0.91600000000000004},"max":{"1min":1.673,"5min":1.738,"15min":1.738},"last":1.117},{"interface":"front","average":{"1min":1.206,"5min":1.2809999999999999,"15min":1.3380000000000001},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.585,"5min":2.5840000000000001,"15min":2.5840000000000001},"last":1.1910000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542209,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":314472,"kb_used_data":800,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94057368,"statfs":{"total":96636764160,"available":96314744832,"internally_reserved":0,"allocated":819200,"data_stored":342021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.64700000000000002,"15min":0.628},"min":{"1min":0.499,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.72499999999999998,"15min":0.66700000000000004},"min":{"1min":0.47099999999999997,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.105,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.74199999999999999}]},{"osd":1,"last update":"Sun Oct 8 15:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.72199999999999998,"15min":0.68700000000000006},"min":{"1min":0.56299999999999994,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0860000000000001,"5min":1.236,"15min":1.236},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.77900000000000003,"15min":0.71299999999999997},"min":{"1min":0.502,"5min":0.307,"15min":0.307},"max":{"1min":1.226,"5min":1.399,"15min":1.399},"last":0.94499999999999995}]},{"osd":3,"last update":"Sun Oct 8 15:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.72099999999999997,"15min":0.66100000000000003},"min":{"1min":0.53100000000000003,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.85099999999999998},"min":{"1min":0.621,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.90400000000000003}]},{"osd":4,"last update":"Sun Oct 8 15:41:32 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.014,"15min":1.0029999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.329,"5min":1.371,"15min":1.371},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0369999999999999,"15min":1.0349999999999999},"min":{"1min":0.71799999999999997,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.544,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.085}]},{"osd":5,"last update":"Sun Oct 8 15:41:32 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.056,"15min":1.056},"min":{"1min":0.75700000000000001,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.351,"5min":1.462,"15min":1.462},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0780000000000001,"15min":1.0640000000000001},"min":{"1min":0.77000000000000002,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.3919999999999999,"5min":1.452,"15min":1.452},"last":1.1759999999999999}]},{"osd":6,"last update":"Sun Oct 8 15:41:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.133,"15min":1.1040000000000001},"min":{"1min":0.83799999999999997,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.036},{"interface":"front","average":{"1min":1.137,"5min":1.141,"15min":1.113},"min":{"1min":0.74199999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":1.3520000000000001}]},{"osd":7,"last update":"Sun Oct 8 15:41:32 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.2110000000000001,"15min":1.167},"min":{"1min":0.85299999999999998,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.6419999999999999,"5min":1.72,"15min":1.72},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.153,"5min":1.1910000000000001,"15min":1.167},"min":{"1min":0.77800000000000002,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.647,"5min":1.804,"15min":1.804},"last":1.486}]}]},{"osd":1,"up_from":14,"seq":60129542210,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":314484,"kb_used_data":812,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94057356,"statfs":{"total":96636764160,"available":96314732544,"internally_reserved":0,"allocated":831488,"data_stored":347826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.72099999999999997,"15min":0.76100000000000001},"min":{"1min":0.42099999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.343,"5min":1.734,"15min":1.734},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.79000000000000004,"15min":0.94199999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.381,"5min":5.7960000000000003,"15min":5.7960000000000003},"last":0.71199999999999997}]},{"osd":2,"last update":"Sun Oct 8 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.749,"15min":0.81899999999999995},"min":{"1min":0.50900000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.147,"5min":4.0119999999999996,"15min":4.0119999999999996},"last":1},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.879,"15min":0.90100000000000002},"min":{"1min":0.56599999999999995,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.4670000000000001,"5min":1.853,"15min":1.853},"last":0.872}]},{"osd":3,"last update":"Sun Oct 8 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":1.1180000000000001,"15min":1.014},"min":{"1min":0.48099999999999998,"5min":0.435,"15min":0.435},"max":{"1min":1.413,"5min":13.388,"15min":13.388},"last":1.0840000000000001},{"interface":"front","average":{"1min":0.91800000000000004,"5min":1.129,"15min":1.141},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.405,"5min":13.353,"15min":13.353},"last":1.0449999999999999}]},{"osd":4,"last update":"Sun Oct 8 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":1.048,"15min":1.1930000000000001},"min":{"1min":0.75800000000000001,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.4359999999999999,"5min":5.859,"15min":5.859},"last":0.93200000000000005},{"interface":"front","average":{"1min":1.115,"5min":1.0780000000000001,"15min":1.1459999999999999},"min":{"1min":0.76000000000000001,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.7450000000000001,"5min":4.2679999999999998,"15min":4.2679999999999998},"last":1.2}]},{"osd":5,"last update":"Sun Oct 8 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.0880000000000001,"15min":1.1319999999999999},"min":{"1min":0.82499999999999996,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.512,"5min":4.3380000000000001,"15min":4.3380000000000001},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.169,"15min":1.1779999999999999},"min":{"1min":0.77600000000000002,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.607,"5min":2.085,"15min":2.085},"last":0.96999999999999997}]},{"osd":6,"last update":"Sun Oct 8 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.2030000000000001,"15min":1.3400000000000001},"min":{"1min":0.80500000000000005,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.712,"5min":5.8979999999999997,"15min":5.8979999999999997},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.234,"5min":1.208,"15min":1.262},"min":{"1min":0.81599999999999995,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.9419999999999999,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":1.6279999999999999}]},{"osd":7,"last update":"Sun Oct 8 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.242,"15min":1.2470000000000001},"min":{"1min":0.71099999999999997,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.8109999999999999,"5min":2.3940000000000001,"15min":2.3940000000000001},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.2849999999999999,"15min":1.4410000000000001},"min":{"1min":0.94199999999999995,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.752,"5min":5.9299999999999997,"15min":5.9299999999999997},"last":1.141}]}]},{"osd":0,"up_from":14,"seq":60129542210,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310452,"kb_used_data":876,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061388,"statfs":{"total":96636764160,"available":96318861312,"internally_reserved":0,"allocated":897024,"data_stored":938194,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.70999999999999996,"15min":0.80600000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.127,"5min":1.514,"15min":1.514},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.77900000000000003,"15min":0.79400000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.1180000000000001,"5min":1.518,"15min":1.518},"last":1.0780000000000001}]},{"osd":2,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.79600000000000004,"15min":0.84799999999999998},"min":{"1min":0.499,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.054,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78000000000000003,"15min":0.78400000000000003},"min":{"1min":0.497,"5min":0.434,"15min":0.434},"max":{"1min":1.198,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":1.198}]},{"osd":3,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.74299999999999999,"15min":0.755},"min":{"1min":0.50700000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":1.0620000000000001,"5min":0.96399999999999997,"15min":0.98799999999999999},"min":{"1min":0.52900000000000003,"5min":0.499,"15min":0.499},"max":{"1min":4.5069999999999997,"5min":4.5069999999999997,"15min":4.5069999999999997},"last":0.86099999999999999}]},{"osd":4,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.0469999999999999,"15min":1.0820000000000001},"min":{"1min":0.73099999999999998,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.6479999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.2470000000000001},{"interface":"front","average":{"1min":1,"5min":1.02,"15min":1.0740000000000001},"min":{"1min":0.70599999999999996,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.429,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.93999999999999995}]},{"osd":5,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.024,"15min":1.079},"min":{"1min":0.76500000000000001,"5min":0.626,"15min":0.626},"max":{"1min":1.385,"5min":2.214,"15min":2.214},"last":1.05},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1850000000000001,"15min":1.306},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.605,"5min":3.4569999999999999,"15min":3.4569999999999999},"last":1.2569999999999999}]},{"osd":6,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.1890000000000001,"15min":1.274},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.677,"5min":2.532,"15min":2.532},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.244,"5min":1.2070000000000001,"15min":1.2370000000000001},"min":{"1min":0.86299999999999999,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.704,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":1.478}]},{"osd":7,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.2490000000000001,"15min":1.2849999999999999},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.607,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.391},{"interface":"front","average":{"1min":1.151,"5min":1.1839999999999999,"15min":1.22},"min":{"1min":0.82699999999999996,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.4870000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.98199999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574914,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306332,"kb_used_data":852,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065508,"statfs":{"total":96636764160,"available":96323080192,"internally_reserved":0,"allocated":872448,"data_stored":362410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.878,"15min":0.85599999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":1.1639999999999999},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.90100000000000002,"15min":0.90800000000000003},"min":{"1min":0.57199999999999995,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.67700000000000005}]},{"osd":1,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91300000000000003,"15min":0.90900000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.4219999999999999,"5min":1.448,"15min":1.448},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.92000000000000004,"15min":0.97299999999999998},"min":{"1min":0.59699999999999998,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.641,"5min":1.754,"15min":1.754},"last":0.78000000000000003}]},{"osd":2,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.93899999999999995,"15min":0.94999999999999996},"min":{"1min":0.59199999999999997,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.044,"5min":2.044,"15min":2.044},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.1000000000000001,"5min":0.997,"15min":1.012},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.609,"5min":1.609,"15min":1.609},"last":1.2829999999999999}]},{"osd":3,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.96799999999999997,"15min":0.99199999999999999},"min":{"1min":0.61099999999999999,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.5800000000000001,"5min":1.929,"15min":1.929},"last":0.871},{"interface":"front","average":{"1min":1.044,"5min":1.034,"15min":1.0920000000000001},"min":{"1min":0.71599999999999997,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.53,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.71599999999999997}]},{"osd":4,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.0069999999999999,"15min":1.0129999999999999},"min":{"1min":0.68300000000000005,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":2.2189999999999999,"5min":2.2189999999999999,"15min":2.2189999999999999},"last":1.375},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.042,"15min":1.071},"min":{"1min":0.58399999999999996,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":2.129,"5min":2.129,"15min":2.129},"last":1.3460000000000001}]},{"osd":6,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.153,"15min":1.1910000000000001},"min":{"1min":0.876,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.4079999999999999,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":1.008},{"interface":"front","average":{"1min":1.165,"5min":1.161,"15min":1.2170000000000001},"min":{"1min":0.77400000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.6539999999999999,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.0449999999999999}]},{"osd":7,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.087,"15min":1.1439999999999999},"min":{"1min":0.69299999999999995,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.7470000000000001,"5min":2.177,"15min":2.177},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.1970000000000001,"15min":1.2130000000000001},"min":{"1min":0.85099999999999998,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.6579999999999999,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.234}]}]},{"osd":4,"up_from":13,"seq":55834574914,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298136,"kb_used_data":848,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073704,"statfs":{"total":96636764160,"available":96331472896,"internally_reserved":0,"allocated":868352,"data_stored":367140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.82799999999999996,"15min":0.81200000000000006},"min":{"1min":0.503,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.248,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":1.3029999999999999},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84399999999999997,"15min":0.80500000000000005},"min":{"1min":0.54300000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.147,"5min":1.474,"15min":1.474},"last":0.873}]},{"osd":1,"last update":"Sun Oct 8 15:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.89300000000000002,"15min":0.84799999999999998},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1359999999999999,"5min":1.456,"15min":1.456},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.89300000000000002,"15min":0.85099999999999998},"min":{"1min":0.65500000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.327,"5min":2.327,"15min":2.327},"last":0.90800000000000003}]},{"osd":2,"last update":"Sun Oct 8 15:42:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0640000000000001,"15min":1.0389999999999999},"min":{"1min":0.63600000000000001,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.401,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":1.024,"5min":1.0209999999999999,"15min":1.022},"min":{"1min":0.79400000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.4059999999999999,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":1.0329999999999999}]},{"osd":3,"last update":"Sun Oct 8 15:42:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0189999999999999,"15min":1.0209999999999999},"min":{"1min":0.76900000000000002,"5min":0.626,"15min":0.626},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0620000000000001,"15min":1.042},"min":{"1min":0.68700000000000006,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2809999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":1.1379999999999999}]},{"osd":5,"last update":"Sun Oct 8 15:42:22 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.018,"15min":0.98199999999999998},"min":{"1min":0.72599999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.304,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":1.246},{"interface":"front","average":{"1min":1.226,"5min":1.125,"15min":1.081},"min":{"1min":0.60099999999999998,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":3.0259999999999998,"5min":3.0259999999999998,"15min":3.0259999999999998},"last":1.468}]},{"osd":6,"last update":"Sun Oct 8 15:42:22 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.1180000000000001,"15min":1.1399999999999999},"min":{"1min":0.86599999999999999,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":2.4550000000000001,"5min":2.4550000000000001,"15min":2.4550000000000001},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.232,"5min":1.2170000000000001,"15min":1.1930000000000001},"min":{"1min":0.69199999999999995,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.8159999999999998,"5min":2.8159999999999998,"15min":2.8159999999999998},"last":1.391}]},{"osd":7,"last update":"Sun Oct 8 15:42:22 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.1240000000000001,"15min":1.0840000000000001},"min":{"1min":0.64300000000000002,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":2.1949999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":1.282},{"interface":"front","average":{"1min":1.331,"5min":1.246,"15min":1.208},"min":{"1min":0.79100000000000004,"5min":0.625,"15min":0.625},"max":{"1min":2.7450000000000001,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":1.337}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T15:42:33.340 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T15:42:33.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.445+0000 7fbdee28d700 1 Processor -- start 2023-10-08T15:42:33.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.445+0000 7fbdee28d700 1 -- start start 2023-10-08T15:42:33.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.445+0000 7fbdee28d700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fbde80bb180 0x7fbde80b2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:33.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.445+0000 7fbdee28d700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbde8149ba0 con 0x7fbde80badb0 2023-10-08T15:42:33.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.445+0000 7fbdee28d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbde8149550 con 0x7fbde80b43a0 2023-10-08T15:42:33.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.445+0000 7fbdee28d700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbde80bb5c0 con 0x7fbde80bb180 2023-10-08T15:42:33.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.445+0000 7fbde7fff700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fbde80badb0 0x7fbde814d450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:59236/0 (socket says 172.21.15.3:59236) 2023-10-08T15:42:33.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.445+0000 7fbde7fff700 1 -- 172.21.15.3:0/336226172 learned_addr learned my addr 172.21.15.3:0/336226172 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:42:33.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.445+0000 7fbdec82a700 1 --2- 172.21.15.3:0/336226172 >> v2:172.21.15.3:3300/0 conn(0x7fbde80bb180 0x7fbde80b2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:33.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.445+0000 7fbde6ffd700 1 -- 172.21.15.3:0/336226172 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3945910750 0 0) 0x7fbde8149ba0 con 0x7fbde80badb0 2023-10-08T15:42:33.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.445+0000 7fbde6ffd700 1 -- 172.21.15.3:0/336226172 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdd0003570 con 0x7fbde80badb0 2023-10-08T15:42:33.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.445+0000 7fbdec82a700 1 -- 172.21.15.3:0/336226172 >> v1:172.21.15.50:6789/0 conn(0x7fbde80b43a0 legacy=0x7fbde814a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:33.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.445+0000 7fbdec82a700 1 -- 172.21.15.3:0/336226172 >> v1:172.21.15.3:6789/0 conn(0x7fbde80badb0 legacy=0x7fbde814d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:33.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.445+0000 7fbdec82a700 1 -- 172.21.15.3:0/336226172 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde8149830 con 0x7fbde80bb180 2023-10-08T15:42:33.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.445+0000 7fbdec82a700 1 --2- 172.21.15.3:0/336226172 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbde80bb180 0x7fbde80b2960 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fbde00098e0 tx=0x7fbde00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f2b0ae829079956 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:33.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.445+0000 7fbde6ffd700 1 -- 172.21.15.3:0/336226172 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde000b640 con 0x7fbde80bb180 2023-10-08T15:42:33.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.445+0000 7fbde6ffd700 1 -- 172.21.15.3:0/336226172 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde000b7a0 con 0x7fbde80bb180 2023-10-08T15:42:33.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.445+0000 7fbde6ffd700 1 -- 172.21.15.3:0/336226172 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde000bb40 con 0x7fbde80bb180 2023-10-08T15:42:33.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.445+0000 7fbdee28d700 1 -- 172.21.15.3:0/336226172 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbde80bb180 msgr2=0x7fbde80b2960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:33.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.445+0000 7fbdee28d700 1 --2- 172.21.15.3:0/336226172 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbde80bb180 0x7fbde80b2960 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fbde00098e0 tx=0x7fbde00091a0 comp rx=0 tx=0).stop 2023-10-08T15:42:33.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.445+0000 7fbdee28d700 1 -- 172.21.15.3:0/336226172 shutdown_connections 2023-10-08T15:42:33.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.445+0000 7fbdee28d700 1 --2- 172.21.15.3:0/336226172 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbde80bb180 0x7fbde80b2960 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:33.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.445+0000 7fbdee28d700 1 -- 172.21.15.3:0/336226172 >> 172.21.15.3:0/336226172 conn(0x7fbde80be640 msgr2=0x7fbde80ba6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:33.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.445+0000 7fbdee28d700 1 -- 172.21.15.3:0/336226172 shutdown_connections 2023-10-08T15:42:33.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.445+0000 7fbdee28d700 1 -- 172.21.15.3:0/336226172 wait complete. 2023-10-08T15:42:33.455 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.449+0000 7fbdee28d700 1 Processor -- start 2023-10-08T15:42:33.455 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.449+0000 7fbdee28d700 1 -- start start 2023-10-08T15:42:33.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.449+0000 7fbdee28d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbde80b43a0 0x7fbde8159af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:33.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.449+0000 7fbdee28d700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbde80badb0 0x7fbde81591e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:33.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.449+0000 7fbdee28d700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbde80bb180 0x7fbde8096420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:33.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.449+0000 7fbdee28d700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde8097530 con 0x7fbde80bb180 2023-10-08T15:42:33.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.449+0000 7fbdee28d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde8145660 con 0x7fbde80b43a0 2023-10-08T15:42:33.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.449+0000 7fbdee28d700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbde8159720 con 0x7fbde80badb0 2023-10-08T15:42:33.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.449+0000 7fbdec82a700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbde80bb180 0x7fbde8096420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:33.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.449+0000 7fbdec82a700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbde80bb180 0x7fbde8096420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57234/0 (socket says 172.21.15.3:57234) 2023-10-08T15:42:33.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.449+0000 7fbdec82a700 1 -- 172.21.15.3:0/1054050960 learned_addr learned my addr 172.21.15.3:0/1054050960 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:33.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.449+0000 7fbde7fff700 1 --2- 172.21.15.3:0/1054050960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbde80b43a0 0x7fbde8159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:33.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.449+0000 7fbde77fe700 1 --2- 172.21.15.3:0/1054050960 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbde80badb0 0x7fbde81591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:33.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.453+0000 7fbdec82a700 1 -- 172.21.15.3:0/1054050960 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbde80badb0 msgr2=0x7fbde81591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:33.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.453+0000 7fbdec82a700 1 --2- 172.21.15.3:0/1054050960 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbde80badb0 0x7fbde81591e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:33.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.453+0000 7fbdec82a700 1 -- 172.21.15.3:0/1054050960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbde80b43a0 msgr2=0x7fbde8159af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:33.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.453+0000 7fbdec82a700 1 --2- 172.21.15.3:0/1054050960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbde80b43a0 0x7fbde8159af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:33.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.453+0000 7fbdec82a700 1 -- 172.21.15.3:0/1054050960 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde0009420 con 0x7fbde80bb180 2023-10-08T15:42:33.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.453+0000 7fbdec82a700 1 --2- 172.21.15.3:0/1054050960 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbde80bb180 0x7fbde8096420 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fbde00093f0 tx=0x7fbde0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:33.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.453+0000 7fbdcffff700 1 -- 172.21.15.3:0/1054050960 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde0006af0 con 0x7fbde80bb180 2023-10-08T15:42:33.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.453+0000 7fbdcffff700 1 -- 172.21.15.3:0/1054050960 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde000bb20 con 0x7fbde80bb180 2023-10-08T15:42:33.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.453+0000 7fbdee28d700 1 -- 172.21.15.3:0/1054050960 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbde8097250 con 0x7fbde80bb180 2023-10-08T15:42:33.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.453+0000 7fbdcffff700 1 -- 172.21.15.3:0/1054050960 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde0011670 con 0x7fbde80bb180 2023-10-08T15:42:33.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.453+0000 7fbdee28d700 1 -- 172.21.15.3:0/1054050960 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbde8096960 con 0x7fbde80bb180 2023-10-08T15:42:33.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.453+0000 7fbdee28d700 1 -- 172.21.15.3:0/1054050960 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbde81457a0 con 0x7fbde80bb180 2023-10-08T15:42:33.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.453+0000 7fbdcffff700 1 -- 172.21.15.3:0/1054050960 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fbde0011a60 con 0x7fbde80bb180 2023-10-08T15:42:33.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.457+0000 7fbdcffff700 1 --2- 172.21.15.3:0/1054050960 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbdd4060550 0x7fbdd4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:33.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.457+0000 7fbdcffff700 1 -- 172.21.15.3:0/1054050960 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbde007e310 con 0x7fbde80bb180 2023-10-08T15:42:33.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.457+0000 7fbde7fff700 1 --2- 172.21.15.3:0/1054050960 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbdd4060550 0x7fbdd4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:33.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.457+0000 7fbde7fff700 1 --2- 172.21.15.3:0/1054050960 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbdd4060550 0x7fbdd4062a00 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fbdd8007fd0 tx=0x7fbdd8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:33.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.461+0000 7fbdcffff700 1 -- 172.21.15.3:0/1054050960 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbde004e8e0 con 0x7fbde80bb180 2023-10-08T15:42:33.624 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.617+0000 7fbdee28d700 1 -- 172.21.15.3:0/1054050960 --> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbde81457a0 con 0x7fbdd4060550 2023-10-08T15:42:33.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.637+0000 7fbdcffff700 1 -- 172.21.15.3:0/1054050960 <== mgr.4102 v2:172.21.15.50:6832/33268 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+279287 (secure 0 0 0) 0x7fbde81457a0 con 0x7fbdd4060550 2023-10-08T15:42:33.646 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:42:33.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.641+0000 7fbdee28d700 1 -- 172.21.15.3:0/1054050960 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbdd4060550 msgr2=0x7fbdd4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:33.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.641+0000 7fbdee28d700 1 --2- 172.21.15.3:0/1054050960 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbdd4060550 0x7fbdd4062a00 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fbdd8007fd0 tx=0x7fbdd8009040 comp rx=0 tx=0).stop 2023-10-08T15:42:33.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.641+0000 7fbdee28d700 1 -- 172.21.15.3:0/1054050960 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbde80bb180 msgr2=0x7fbde8096420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:33.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.641+0000 7fbdee28d700 1 --2- 172.21.15.3:0/1054050960 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbde80bb180 0x7fbde8096420 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fbde00093f0 tx=0x7fbde0017000 comp rx=0 tx=0).stop 2023-10-08T15:42:33.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.641+0000 7fbdee28d700 1 -- 172.21.15.3:0/1054050960 shutdown_connections 2023-10-08T15:42:33.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.641+0000 7fbdee28d700 1 --2- 172.21.15.3:0/1054050960 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7fbdd4060550 0x7fbdd4062a00 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:33.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.641+0000 7fbdee28d700 1 --2- 172.21.15.3:0/1054050960 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbde80bb180 0x7fbde8096420 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:33.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.641+0000 7fbdee28d700 1 --2- 172.21.15.3:0/1054050960 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbde80badb0 0x7fbde81591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:33.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.641+0000 7fbdee28d700 1 --2- 172.21.15.3:0/1054050960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbde80b43a0 0x7fbde8159af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:33.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.641+0000 7fbdee28d700 1 -- 172.21.15.3:0/1054050960 >> 172.21.15.3:0/1054050960 conn(0x7fbde80be640 msgr2=0x7fbde8146360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:33.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.641+0000 7fbdee28d700 1 -- 172.21.15.3:0/1054050960 shutdown_connections 2023-10-08T15:42:33.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.641+0000 7fbdee28d700 1 -- 172.21.15.3:0/1054050960 wait complete. 2023-10-08T15:42:33.650 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2023-10-08T15:42:33.663 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":222,"stamp":"2023-10-08T15:42:32.623817+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591904,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":165,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":102,"acting":102,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2470972,"kb_used_data":6652,"kb_used_omap":0,"kb_used_meta":2464256,"kb_avail":752503748,"statfs":{"total":773094113280,"available":770563837952,"internally_reserved":0,"allocated":6811648,"data_stored":3974022,"data_compressed":66282,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":2523398144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.360394"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.338290+0000","last_change":"2023-10-08T15:42:30.333246+0000","last_active":"2023-10-08T15:42:30.338290+0000","last_peered":"2023-10-08T15:42:30.338290+0000","last_clean":"2023-10-08T15:42:30.338290+0000","last_became_active":"2023-10-08T15:42:30.332961+0000","last_became_peered":"2023-10-08T15:42:30.332961+0000","last_unstale":"2023-10-08T15:42:30.338290+0000","last_undegraded":"2023-10-08T15:42:30.338290+0000","last_fullsized":"2023-10-08T15:42:30.338290+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:37:47.231005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.352621+0000","last_change":"2023-10-08T15:42:30.352621+0000","last_active":"2023-10-08T15:42:30.352621+0000","last_peered":"2023-10-08T15:42:30.352621+0000","last_clean":"2023-10-08T15:42:30.352621+0000","last_became_active":"2023-10-08T15:42:30.352272+0000","last_became_peered":"2023-10-08T15:42:30.352272+0000","last_unstale":"2023-10-08T15:42:30.352621+0000","last_undegraded":"2023-10-08T15:42:30.352621+0000","last_fullsized":"2023-10-08T15:42:30.352621+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:03:06.159027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.331850+0000","last_change":"2023-10-08T15:42:30.331850+0000","last_active":"2023-10-08T15:42:30.331850+0000","last_peered":"2023-10-08T15:42:30.331850+0000","last_clean":"2023-10-08T15:42:30.331850+0000","last_became_active":"2023-10-08T15:42:30.331530+0000","last_became_peered":"2023-10-08T15:42:30.331530+0000","last_unstale":"2023-10-08T15:42:30.331850+0000","last_undegraded":"2023-10-08T15:42:30.331850+0000","last_fullsized":"2023-10-08T15:42:30.331850+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:56.410736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.351375+0000","last_change":"2023-10-08T15:42:30.351375+0000","last_active":"2023-10-08T15:42:30.351375+0000","last_peered":"2023-10-08T15:42:30.351375+0000","last_clean":"2023-10-08T15:42:30.351375+0000","last_became_active":"2023-10-08T15:42:30.351044+0000","last_became_peered":"2023-10-08T15:42:30.351044+0000","last_unstale":"2023-10-08T15:42:30.351375+0000","last_undegraded":"2023-10-08T15:42:30.351375+0000","last_fullsized":"2023-10-08T15:42:30.351375+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:13:37.084139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.341197+0000","last_change":"2023-10-08T15:42:30.336763+0000","last_active":"2023-10-08T15:42:30.341197+0000","last_peered":"2023-10-08T15:42:30.341197+0000","last_clean":"2023-10-08T15:42:30.341197+0000","last_became_active":"2023-10-08T15:42:30.336407+0000","last_became_peered":"2023-10-08T15:42:30.336407+0000","last_unstale":"2023-10-08T15:42:30.341197+0000","last_undegraded":"2023-10-08T15:42:30.341197+0000","last_fullsized":"2023-10-08T15:42:30.341197+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:57:24.891115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.348876+0000","last_change":"2023-10-08T15:42:30.347286+0000","last_active":"2023-10-08T15:42:30.348876+0000","last_peered":"2023-10-08T15:42:30.348876+0000","last_clean":"2023-10-08T15:42:30.348876+0000","last_became_active":"2023-10-08T15:42:30.346996+0000","last_became_peered":"2023-10-08T15:42:30.346996+0000","last_unstale":"2023-10-08T15:42:30.348876+0000","last_undegraded":"2023-10-08T15:42:30.348876+0000","last_fullsized":"2023-10-08T15:42:30.348876+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:16:28.709078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.335048+0000","last_change":"2023-10-08T15:42:30.328725+0000","last_active":"2023-10-08T15:42:30.335048+0000","last_peered":"2023-10-08T15:42:30.335048+0000","last_clean":"2023-10-08T15:42:30.335048+0000","last_became_active":"2023-10-08T15:42:30.328426+0000","last_became_peered":"2023-10-08T15:42:30.328426+0000","last_unstale":"2023-10-08T15:42:30.335048+0000","last_undegraded":"2023-10-08T15:42:30.335048+0000","last_fullsized":"2023-10-08T15:42:30.335048+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:45:25.945569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.348251+0000","last_change":"2023-10-08T15:42:30.345432+0000","last_active":"2023-10-08T15:42:30.348251+0000","last_peered":"2023-10-08T15:42:30.348251+0000","last_clean":"2023-10-08T15:42:30.348251+0000","last_became_active":"2023-10-08T15:42:30.345101+0000","last_became_peered":"2023-10-08T15:42:30.345101+0000","last_unstale":"2023-10-08T15:42:30.348251+0000","last_undegraded":"2023-10-08T15:42:30.348251+0000","last_fullsized":"2023-10-08T15:42:30.348251+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:58:41.138214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.346146+0000","last_change":"2023-10-08T15:42:30.343874+0000","last_active":"2023-10-08T15:42:30.346146+0000","last_peered":"2023-10-08T15:42:30.346146+0000","last_clean":"2023-10-08T15:42:30.346146+0000","last_became_active":"2023-10-08T15:42:30.343472+0000","last_became_peered":"2023-10-08T15:42:30.343472+0000","last_unstale":"2023-10-08T15:42:30.346146+0000","last_undegraded":"2023-10-08T15:42:30.346146+0000","last_fullsized":"2023-10-08T15:42:30.346146+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:59:36.731597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.274213+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:44:16.491355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"70'1","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.341212+0000","last_change":"2023-10-08T15:42:29.290673+0000","last_active":"2023-10-08T15:42:30.341212+0000","last_peered":"2023-10-08T15:42:30.341212+0000","last_clean":"2023-10-08T15:42:30.341212+0000","last_became_active":"2023-10-08T15:42:29.290131+0000","last_became_peered":"2023-10-08T15:42:29.290131+0000","last_unstale":"2023-10-08T15:42:30.341212+0000","last_undegraded":"2023-10-08T15:42:30.341212+0000","last_fullsized":"2023-10-08T15:42:30.341212+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:49:41.274172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.270030+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:35:17.371964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.271991+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:13:36.080229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"70'1","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.347037+0000","last_change":"2023-10-08T15:42:29.291620+0000","last_active":"2023-10-08T15:42:30.347037+0000","last_peered":"2023-10-08T15:42:30.347037+0000","last_clean":"2023-10-08T15:42:30.347037+0000","last_became_active":"2023-10-08T15:42:29.291298+0000","last_became_peered":"2023-10-08T15:42:29.291298+0000","last_unstale":"2023-10-08T15:42:30.347037+0000","last_undegraded":"2023-10-08T15:42:30.347037+0000","last_fullsized":"2023-10-08T15:42:30.347037+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:35:17.371964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.353385+0000","last_change":"2023-10-08T15:42:30.352385+0000","last_active":"2023-10-08T15:42:30.353385+0000","last_peered":"2023-10-08T15:42:30.353385+0000","last_clean":"2023-10-08T15:42:30.353385+0000","last_became_active":"2023-10-08T15:42:30.351949+0000","last_became_peered":"2023-10-08T15:42:30.351949+0000","last_unstale":"2023-10-08T15:42:30.353385+0000","last_undegraded":"2023-10-08T15:42:30.353385+0000","last_fullsized":"2023-10-08T15:42:30.353385+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:06:28.263822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"70'1","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.341264+0000","last_change":"2023-10-08T15:42:29.290424+0000","last_active":"2023-10-08T15:42:30.341264+0000","last_peered":"2023-10-08T15:42:30.341264+0000","last_clean":"2023-10-08T15:42:30.341264+0000","last_became_active":"2023-10-08T15:42:29.289913+0000","last_became_peered":"2023-10-08T15:42:29.289913+0000","last_unstale":"2023-10-08T15:42:30.341264+0000","last_undegraded":"2023-10-08T15:42:30.341264+0000","last_fullsized":"2023-10-08T15:42:30.341264+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:10:34.911060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.274727+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:38:52.335948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.270553+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:24:55.362713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.273239+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:40.888869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.347548+0000","last_change":"2023-10-08T15:42:30.347548+0000","last_active":"2023-10-08T15:42:30.347548+0000","last_peered":"2023-10-08T15:42:30.347548+0000","last_clean":"2023-10-08T15:42:30.347548+0000","last_became_active":"2023-10-08T15:42:30.347209+0000","last_became_peered":"2023-10-08T15:42:30.347209+0000","last_unstale":"2023-10-08T15:42:30.347548+0000","last_undegraded":"2023-10-08T15:42:30.347548+0000","last_fullsized":"2023-10-08T15:42:30.347548+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:46:26.270646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.272483+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:09:24.762917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.274079+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:18:15.067702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.359495+0000","last_change":"2023-10-08T15:42:30.358813+0000","last_active":"2023-10-08T15:42:30.359495+0000","last_peered":"2023-10-08T15:42:30.359495+0000","last_clean":"2023-10-08T15:42:30.359495+0000","last_became_active":"2023-10-08T15:42:30.358527+0000","last_became_peered":"2023-10-08T15:42:30.358527+0000","last_unstale":"2023-10-08T15:42:30.359495+0000","last_undegraded":"2023-10-08T15:42:30.359495+0000","last_fullsized":"2023-10-08T15:42:30.359495+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:54:13.937795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"70'6","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.342186+0000","last_change":"2023-10-08T15:42:29.291159+0000","last_active":"2023-10-08T15:42:30.342186+0000","last_peered":"2023-10-08T15:42:30.342186+0000","last_clean":"2023-10-08T15:42:30.342186+0000","last_became_active":"2023-10-08T15:42:29.290812+0000","last_became_peered":"2023-10-08T15:42:29.290812+0000","last_unstale":"2023-10-08T15:42:30.342186+0000","last_undegraded":"2023-10-08T15:42:30.342186+0000","last_fullsized":"2023-10-08T15:42:30.342186+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:26:01.548146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.272281+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:54:24.309030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.270713+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:48:23.733193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-10-08T15:42:29.290271+0000","last_change":"2023-10-08T15:42:29.288141+0000","last_active":"2023-10-08T15:42:29.290271+0000","last_peered":"2023-10-08T15:42:29.290271+0000","last_clean":"2023-10-08T15:42:29.290271+0000","last_became_active":"2023-10-08T15:42:29.287228+0000","last_became_peered":"2023-10-08T15:42:29.287228+0000","last_unstale":"2023-10-08T15:42:29.290271+0000","last_undegraded":"2023-10-08T15:42:29.290271+0000","last_fullsized":"2023-10-08T15:42:29.290271+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:44:16.551176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.271533+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:49:41.274172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.272372+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:45:28.837814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.272303+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:47:39.065529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.342433+0000","last_change":"2023-10-08T15:42:30.336936+0000","last_active":"2023-10-08T15:42:30.342433+0000","last_peered":"2023-10-08T15:42:30.342433+0000","last_clean":"2023-10-08T15:42:30.342433+0000","last_became_active":"2023-10-08T15:42:30.336624+0000","last_became_peered":"2023-10-08T15:42:30.336624+0000","last_unstale":"2023-10-08T15:42:30.342433+0000","last_undegraded":"2023-10-08T15:42:30.342433+0000","last_fullsized":"2023-10-08T15:42:30.342433+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:16:35.166421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.271204+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:10:34.911060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.273187+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:27:26.579698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.330839+0000","last_change":"2023-10-08T15:42:30.330839+0000","last_active":"2023-10-08T15:42:30.330839+0000","last_peered":"2023-10-08T15:42:30.330839+0000","last_clean":"2023-10-08T15:42:30.330839+0000","last_became_active":"2023-10-08T15:42:30.330544+0000","last_became_peered":"2023-10-08T15:42:30.330544+0000","last_unstale":"2023-10-08T15:42:30.330839+0000","last_undegraded":"2023-10-08T15:42:30.330839+0000","last_fullsized":"2023-10-08T15:42:30.330839+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:02:31.620217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.266182+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:41:42.495720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.266206+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:39:07.074681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.354803+0000","last_change":"2023-10-08T15:42:30.354803+0000","last_active":"2023-10-08T15:42:30.354803+0000","last_peered":"2023-10-08T15:42:30.354803+0000","last_clean":"2023-10-08T15:42:30.354803+0000","last_became_active":"2023-10-08T15:42:30.354575+0000","last_became_peered":"2023-10-08T15:42:30.354575+0000","last_unstale":"2023-10-08T15:42:30.354803+0000","last_undegraded":"2023-10-08T15:42:30.354803+0000","last_fullsized":"2023-10-08T15:42:30.354803+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:38:53.339858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.270896+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:41:39.525248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.335085+0000","last_change":"2023-10-08T15:42:30.328430+0000","last_active":"2023-10-08T15:42:30.335085+0000","last_peered":"2023-10-08T15:42:30.335085+0000","last_clean":"2023-10-08T15:42:30.335085+0000","last_became_active":"2023-10-08T15:42:30.328093+0000","last_became_peered":"2023-10-08T15:42:30.328093+0000","last_unstale":"2023-10-08T15:42:30.335085+0000","last_undegraded":"2023-10-08T15:42:30.335085+0000","last_fullsized":"2023-10-08T15:42:30.335085+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:25:03.880884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.270618+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:26:23.323002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.271500+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:22:35.054661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.273029+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:37:51.634617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.359048+0000","last_change":"2023-10-08T15:42:30.358100+0000","last_active":"2023-10-08T15:42:30.359048+0000","last_peered":"2023-10-08T15:42:30.359048+0000","last_clean":"2023-10-08T15:42:30.359048+0000","last_became_active":"2023-10-08T15:42:30.357781+0000","last_became_peered":"2023-10-08T15:42:30.357781+0000","last_unstale":"2023-10-08T15:42:30.359048+0000","last_undegraded":"2023-10-08T15:42:30.359048+0000","last_fullsized":"2023-10-08T15:42:30.359048+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:15.362329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.271631+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:57:32.840050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.330833+0000","last_change":"2023-10-08T15:42:30.330833+0000","last_active":"2023-10-08T15:42:30.330833+0000","last_peered":"2023-10-08T15:42:30.330833+0000","last_clean":"2023-10-08T15:42:30.330833+0000","last_became_active":"2023-10-08T15:42:30.330506+0000","last_became_peered":"2023-10-08T15:42:30.330506+0000","last_unstale":"2023-10-08T15:42:30.330833+0000","last_undegraded":"2023-10-08T15:42:30.330833+0000","last_fullsized":"2023-10-08T15:42:30.330833+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:29:47.019147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.270472+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:32:51.033691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.323086+0000","last_change":"2023-10-08T15:42:29.290448+0000","last_active":"2023-10-08T15:42:30.323086+0000","last_peered":"2023-10-08T15:42:30.323086+0000","last_clean":"2023-10-08T15:42:30.323086+0000","last_became_active":"2023-10-08T15:42:29.289907+0000","last_became_peered":"2023-10-08T15:42:29.289907+0000","last_unstale":"2023-10-08T15:42:30.323086+0000","last_undegraded":"2023-10-08T15:42:30.323086+0000","last_fullsized":"2023-10-08T15:42:30.323086+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:32:51.033691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.271831+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:55.498305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.322824+0000","last_change":"2023-10-08T15:42:29.286199+0000","last_active":"2023-10-08T15:42:30.322824+0000","last_peered":"2023-10-08T15:42:30.322824+0000","last_clean":"2023-10-08T15:42:30.322824+0000","last_became_active":"2023-10-08T15:42:29.285228+0000","last_became_peered":"2023-10-08T15:42:29.285228+0000","last_unstale":"2023-10-08T15:42:30.322824+0000","last_undegraded":"2023-10-08T15:42:30.322824+0000","last_fullsized":"2023-10-08T15:42:30.322824+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:03:22.866811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.268588+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:58:59.888585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":211,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T15:42:26.252167+0000","last_change":"2023-10-08T15:37:19.380955+0000","last_active":"2023-10-08T15:42:26.252167+0000","last_peered":"2023-10-08T15:42:26.252167+0000","last_clean":"2023-10-08T15:42:26.252167+0000","last_became_active":"2023-10-08T15:37:19.378277+0000","last_became_peered":"2023-10-08T15:37:19.378277+0000","last_unstale":"2023-10-08T15:42:26.252167+0000","last_undegraded":"2023-10-08T15:42:26.252167+0000","last_fullsized":"2023-10-08T15:42:26.252167+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:17.537726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:17.537726+0000","last_clean_scrub_stamp":"2023-10-08T15:37:17.537726+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:06:26.612046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":36,"acting":36,"num_store_stats":2},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66282,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542208,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310440,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061400,"statfs":{"total":96636764160,"available":96318873600,"internally_reserved":0,"allocated":884736,"data_stored":932389,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:41:27 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.92000000000000004,"15min":0.95199999999999996},"min":{"1min":0.57099999999999995,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":1.196},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.92400000000000004,"15min":0.92900000000000005},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.3600000000000001,"5min":1.758,"15min":1.758},"last":0.81799999999999995}]},{"osd":1,"last update":"Sun Oct 8 15:41:27 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.88200000000000001,"15min":0.88600000000000001},"min":{"1min":0.46600000000000003,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.1930000000000001,"5min":1.474,"15min":1.474},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.94299999999999995,"15min":0.95499999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.2849999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.0129999999999999}]},{"osd":2,"last update":"Sun Oct 8 15:41:27 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.97099999999999997,"15min":1.016},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.381,"5min":1.623,"15min":1.623},"last":1.4219999999999999},{"interface":"front","average":{"1min":1.038,"5min":1.0029999999999999,"15min":1.0069999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.68300000000000005}]},{"osd":3,"last update":"Sun Oct 8 15:41:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.012,"15min":0.98199999999999998},"min":{"1min":0.91900000000000004,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.8260000000000001,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.998,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.8129999999999999,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":1.3149999999999999}]},{"osd":4,"last update":"Sun Oct 8 15:41:27 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.0389999999999999,"15min":1.077},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0760000000000001,"15min":1.0940000000000001},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.393,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.228}]},{"osd":5,"last update":"Sun Oct 8 15:41:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1799999999999999,"15min":1.248},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.6359999999999999,"5min":1.792,"15min":1.792},"last":1.381},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.2130000000000001,"15min":1.2410000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":1.288}]},{"osd":6,"last update":"Sun Oct 8 15:41:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.272,"15min":1.3080000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.6879999999999999,"5min":1.839,"15min":1.839},"last":1.145},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.1950000000000001,"15min":1.2410000000000001},"min":{"1min":0.79900000000000004,"5min":0.627,"15min":0.627},"max":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":1.0860000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542209,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306280,"kb_used_data":800,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065560,"statfs":{"total":96636764160,"available":96323133440,"internally_reserved":0,"allocated":819200,"data_stored":342021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.90700000000000003,"15min":0.84499999999999997},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.2889999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97999999999999998,"15min":0.996},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.3899999999999999,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.0920000000000001}]},{"osd":1,"last update":"Sun Oct 8 15:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.96599999999999997,"15min":0.96199999999999997},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.385,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":1.1870000000000001},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.97499999999999998,"15min":0.98699999999999999},"min":{"1min":0.66500000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.5149999999999999,"5min":1.853,"15min":1.853},"last":0.66500000000000004}]},{"osd":2,"last update":"Sun Oct 8 15:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.89700000000000002,"15min":0.85899999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.333,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.046,"5min":1.0569999999999999,"15min":1.073},"min":{"1min":0.65500000000000003,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.325,"5min":1.518,"15min":1.518},"last":1.038}]},{"osd":3,"last update":"Sun Oct 8 15:42:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0449999999999999,"15min":1.0289999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.456,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.95799999999999996,"5min":1.02,"15min":1.0640000000000001},"min":{"1min":0.67100000000000004,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.202,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":1.143}]},{"osd":4,"last update":"Sun Oct 8 15:42:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.0960000000000001,"15min":1.1160000000000001},"min":{"1min":0.69899999999999995,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.405,"5min":1.7,"15min":1.7},"last":1.284},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.151,"15min":1.181},"min":{"1min":0.86899999999999999,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.5720000000000001,"5min":1.623,"15min":1.623},"last":1.2470000000000001}]},{"osd":5,"last update":"Sun Oct 8 15:42:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0760000000000001,"15min":1.1120000000000001},"min":{"1min":0.755,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.3939999999999999,"5min":1.581,"15min":1.581},"last":1.3939999999999999},{"interface":"front","average":{"1min":1.254,"5min":1.2529999999999999,"15min":1.298},"min":{"1min":0.85899999999999999,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.554,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":1.3380000000000001}]},{"osd":7,"last update":"Sun Oct 8 15:42:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.264,"15min":1.282},"min":{"1min":0.93999999999999995,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":1.631,"5min":1.74,"15min":1.74},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.2410000000000001,"15min":1.2929999999999999},"min":{"1min":0.99199999999999999,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":1.5920000000000001,"5min":2.5630000000000002,"15min":2.5630000000000002},"last":1.45}]}]},{"osd":3,"up_from":14,"seq":60129542210,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310376,"kb_used_data":800,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061464,"statfs":{"total":96636764160,"available":96318939136,"internally_reserved":0,"allocated":819200,"data_stored":342021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.67600000000000005,"15min":0.70799999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.84199999999999997,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.748,"5min":0.76700000000000002,"15min":0.76200000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.98399999999999999,"5min":1.179,"15min":1.179},"last":0.98399999999999999}]},{"osd":1,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.73199999999999998,"15min":0.71699999999999997},"min":{"1min":0.42199999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.052,"5min":1.365,"15min":1.365},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.745,"5min":0.82899999999999996,"15min":0.81399999999999995},"min":{"1min":0.52700000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93799999999999994,"5min":1.353,"15min":1.353},"last":0.67200000000000004}]},{"osd":2,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.83799999999999997,"15min":0.84699999999999998},"min":{"1min":0.58699999999999997,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.244,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.90000000000000002,"15min":0.91900000000000004},"min":{"1min":0.47599999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.2350000000000001,"5min":1.423,"15min":1.423},"last":0.628}]},{"osd":4,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.069,"15min":1.0640000000000001},"min":{"1min":0.73899999999999999,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.3129999999999999,"5min":1.585,"15min":1.585},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.024,"5min":1.073,"15min":1.131},"min":{"1min":0.72999999999999998,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.339,"5min":2.762,"15min":2.762},"last":0.95099999999999996}]},{"osd":5,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.1100000000000001,"15min":1.1419999999999999},"min":{"1min":0.755,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.3400000000000001,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.143,"5min":1.1850000000000001,"15min":1.2190000000000001},"min":{"1min":0.78500000000000003,"5min":0.755,"15min":0.755},"max":{"1min":1.625,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":1.0629999999999999}]},{"osd":6,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.212,"15min":1.278},"min":{"1min":0.82199999999999995,"5min":0.746,"15min":0.746},"max":{"1min":1.504,"5min":2.6890000000000001,"15min":2.6890000000000001},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.103,"5min":1.194,"15min":1.212},"min":{"1min":0.86899999999999999,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":1.409,"5min":1.742,"15min":1.742},"last":1.141}]},{"osd":7,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2490000000000001,"15min":1.2529999999999999},"min":{"1min":0.93200000000000005,"5min":0.91600000000000004,"15min":0.91600000000000004},"max":{"1min":1.673,"5min":1.738,"15min":1.738},"last":1.117},{"interface":"front","average":{"1min":1.206,"5min":1.2809999999999999,"15min":1.3380000000000001},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.585,"5min":2.5840000000000001,"15min":2.5840000000000001},"last":1.1910000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542209,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":314472,"kb_used_data":800,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94057368,"statfs":{"total":96636764160,"available":96314744832,"internally_reserved":0,"allocated":819200,"data_stored":342021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.64700000000000002,"15min":0.628},"min":{"1min":0.499,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.72499999999999998,"15min":0.66700000000000004},"min":{"1min":0.47099999999999997,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.105,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.74199999999999999}]},{"osd":1,"last update":"Sun Oct 8 15:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.72199999999999998,"15min":0.68700000000000006},"min":{"1min":0.56299999999999994,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0860000000000001,"5min":1.236,"15min":1.236},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.77900000000000003,"15min":0.71299999999999997},"min":{"1min":0.502,"5min":0.307,"15min":0.307},"max":{"1min":1.226,"5min":1.399,"15min":1.399},"last":0.94499999999999995}]},{"osd":3,"last update":"Sun Oct 8 15:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.72099999999999997,"15min":0.66100000000000003},"min":{"1min":0.53100000000000003,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.85099999999999998},"min":{"1min":0.621,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.90400000000000003}]},{"osd":4,"last update":"Sun Oct 8 15:41:32 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.014,"15min":1.0029999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.329,"5min":1.371,"15min":1.371},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0369999999999999,"15min":1.0349999999999999},"min":{"1min":0.71799999999999997,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.544,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.085}]},{"osd":5,"last update":"Sun Oct 8 15:41:32 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.056,"15min":1.056},"min":{"1min":0.75700000000000001,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.351,"5min":1.462,"15min":1.462},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0780000000000001,"15min":1.0640000000000001},"min":{"1min":0.77000000000000002,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.3919999999999999,"5min":1.452,"15min":1.452},"last":1.1759999999999999}]},{"osd":6,"last update":"Sun Oct 8 15:41:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.133,"15min":1.1040000000000001},"min":{"1min":0.83799999999999997,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.036},{"interface":"front","average":{"1min":1.137,"5min":1.141,"15min":1.113},"min":{"1min":0.74199999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":1.3520000000000001}]},{"osd":7,"last update":"Sun Oct 8 15:41:32 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.2110000000000001,"15min":1.167},"min":{"1min":0.85299999999999998,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.6419999999999999,"5min":1.72,"15min":1.72},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.153,"5min":1.1910000000000001,"15min":1.167},"min":{"1min":0.77800000000000002,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.647,"5min":1.804,"15min":1.804},"last":1.486}]}]},{"osd":1,"up_from":14,"seq":60129542210,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":314484,"kb_used_data":812,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94057356,"statfs":{"total":96636764160,"available":96314732544,"internally_reserved":0,"allocated":831488,"data_stored":347826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.72099999999999997,"15min":0.76100000000000001},"min":{"1min":0.42099999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.343,"5min":1.734,"15min":1.734},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.79000000000000004,"15min":0.94199999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.381,"5min":5.7960000000000003,"15min":5.7960000000000003},"last":0.71199999999999997}]},{"osd":2,"last update":"Sun Oct 8 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.749,"15min":0.81899999999999995},"min":{"1min":0.50900000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.147,"5min":4.0119999999999996,"15min":4.0119999999999996},"last":1},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.879,"15min":0.90100000000000002},"min":{"1min":0.56599999999999995,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.4670000000000001,"5min":1.853,"15min":1.853},"last":0.872}]},{"osd":3,"last update":"Sun Oct 8 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":1.1180000000000001,"15min":1.014},"min":{"1min":0.48099999999999998,"5min":0.435,"15min":0.435},"max":{"1min":1.413,"5min":13.388,"15min":13.388},"last":1.0840000000000001},{"interface":"front","average":{"1min":0.91800000000000004,"5min":1.129,"15min":1.141},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.405,"5min":13.353,"15min":13.353},"last":1.0449999999999999}]},{"osd":4,"last update":"Sun Oct 8 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":1.048,"15min":1.1930000000000001},"min":{"1min":0.75800000000000001,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.4359999999999999,"5min":5.859,"15min":5.859},"last":0.93200000000000005},{"interface":"front","average":{"1min":1.115,"5min":1.0780000000000001,"15min":1.1459999999999999},"min":{"1min":0.76000000000000001,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.7450000000000001,"5min":4.2679999999999998,"15min":4.2679999999999998},"last":1.2}]},{"osd":5,"last update":"Sun Oct 8 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.0880000000000001,"15min":1.1319999999999999},"min":{"1min":0.82499999999999996,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.512,"5min":4.3380000000000001,"15min":4.3380000000000001},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.169,"15min":1.1779999999999999},"min":{"1min":0.77600000000000002,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.607,"5min":2.085,"15min":2.085},"last":0.96999999999999997}]},{"osd":6,"last update":"Sun Oct 8 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.2030000000000001,"15min":1.3400000000000001},"min":{"1min":0.80500000000000005,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.712,"5min":5.8979999999999997,"15min":5.8979999999999997},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.234,"5min":1.208,"15min":1.262},"min":{"1min":0.81599999999999995,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.9419999999999999,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":1.6279999999999999}]},{"osd":7,"last update":"Sun Oct 8 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.242,"15min":1.2470000000000001},"min":{"1min":0.71099999999999997,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.8109999999999999,"5min":2.3940000000000001,"15min":2.3940000000000001},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.2849999999999999,"15min":1.4410000000000001},"min":{"1min":0.94199999999999995,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.752,"5min":5.9299999999999997,"15min":5.9299999999999997},"last":1.141}]}]},{"osd":0,"up_from":14,"seq":60129542210,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310452,"kb_used_data":876,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061388,"statfs":{"total":96636764160,"available":96318861312,"internally_reserved":0,"allocated":897024,"data_stored":938194,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.70999999999999996,"15min":0.80600000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.127,"5min":1.514,"15min":1.514},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.77900000000000003,"15min":0.79400000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.1180000000000001,"5min":1.518,"15min":1.518},"last":1.0780000000000001}]},{"osd":2,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.79600000000000004,"15min":0.84799999999999998},"min":{"1min":0.499,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.054,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78000000000000003,"15min":0.78400000000000003},"min":{"1min":0.497,"5min":0.434,"15min":0.434},"max":{"1min":1.198,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":1.198}]},{"osd":3,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.74299999999999999,"15min":0.755},"min":{"1min":0.50700000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":1.0620000000000001,"5min":0.96399999999999997,"15min":0.98799999999999999},"min":{"1min":0.52900000000000003,"5min":0.499,"15min":0.499},"max":{"1min":4.5069999999999997,"5min":4.5069999999999997,"15min":4.5069999999999997},"last":0.86099999999999999}]},{"osd":4,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.0469999999999999,"15min":1.0820000000000001},"min":{"1min":0.73099999999999998,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.6479999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.2470000000000001},{"interface":"front","average":{"1min":1,"5min":1.02,"15min":1.0740000000000001},"min":{"1min":0.70599999999999996,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.429,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.93999999999999995}]},{"osd":5,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.024,"15min":1.079},"min":{"1min":0.76500000000000001,"5min":0.626,"15min":0.626},"max":{"1min":1.385,"5min":2.214,"15min":2.214},"last":1.05},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1850000000000001,"15min":1.306},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.605,"5min":3.4569999999999999,"15min":3.4569999999999999},"last":1.2569999999999999}]},{"osd":6,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.1890000000000001,"15min":1.274},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.677,"5min":2.532,"15min":2.532},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.244,"5min":1.2070000000000001,"15min":1.2370000000000001},"min":{"1min":0.86299999999999999,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.704,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":1.478}]},{"osd":7,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.2490000000000001,"15min":1.2849999999999999},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.607,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.391},{"interface":"front","average":{"1min":1.151,"5min":1.1839999999999999,"15min":1.22},"min":{"1min":0.82699999999999996,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.4870000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.98199999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574914,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306332,"kb_used_data":852,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065508,"statfs":{"total":96636764160,"available":96323080192,"internally_reserved":0,"allocated":872448,"data_stored":362410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.878,"15min":0.85599999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":1.1639999999999999},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.90100000000000002,"15min":0.90800000000000003},"min":{"1min":0.57199999999999995,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.67700000000000005}]},{"osd":1,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91300000000000003,"15min":0.90900000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.4219999999999999,"5min":1.448,"15min":1.448},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.92000000000000004,"15min":0.97299999999999998},"min":{"1min":0.59699999999999998,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.641,"5min":1.754,"15min":1.754},"last":0.78000000000000003}]},{"osd":2,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.93899999999999995,"15min":0.94999999999999996},"min":{"1min":0.59199999999999997,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.044,"5min":2.044,"15min":2.044},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.1000000000000001,"5min":0.997,"15min":1.012},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.609,"5min":1.609,"15min":1.609},"last":1.2829999999999999}]},{"osd":3,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.96799999999999997,"15min":0.99199999999999999},"min":{"1min":0.61099999999999999,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.5800000000000001,"5min":1.929,"15min":1.929},"last":0.871},{"interface":"front","average":{"1min":1.044,"5min":1.034,"15min":1.0920000000000001},"min":{"1min":0.71599999999999997,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.53,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.71599999999999997}]},{"osd":4,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.0069999999999999,"15min":1.0129999999999999},"min":{"1min":0.68300000000000005,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":2.2189999999999999,"5min":2.2189999999999999,"15min":2.2189999999999999},"last":1.375},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.042,"15min":1.071},"min":{"1min":0.58399999999999996,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":2.129,"5min":2.129,"15min":2.129},"last":1.3460000000000001}]},{"osd":6,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.153,"15min":1.1910000000000001},"min":{"1min":0.876,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.4079999999999999,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":1.008},{"interface":"front","average":{"1min":1.165,"5min":1.161,"15min":1.2170000000000001},"min":{"1min":0.77400000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.6539999999999999,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.0449999999999999}]},{"osd":7,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.087,"15min":1.1439999999999999},"min":{"1min":0.69299999999999995,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.7470000000000001,"5min":2.177,"15min":2.177},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.1970000000000001,"15min":1.2130000000000001},"min":{"1min":0.85099999999999998,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.6579999999999999,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.234}]}]},{"osd":4,"up_from":13,"seq":55834574914,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298136,"kb_used_data":848,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073704,"statfs":{"total":96636764160,"available":96331472896,"internally_reserved":0,"allocated":868352,"data_stored":367140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.82799999999999996,"15min":0.81200000000000006},"min":{"1min":0.503,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.248,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":1.3029999999999999},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84399999999999997,"15min":0.80500000000000005},"min":{"1min":0.54300000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.147,"5min":1.474,"15min":1.474},"last":0.873}]},{"osd":1,"last update":"Sun Oct 8 15:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.89300000000000002,"15min":0.84799999999999998},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1359999999999999,"5min":1.456,"15min":1.456},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.89300000000000002,"15min":0.85099999999999998},"min":{"1min":0.65500000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.327,"5min":2.327,"15min":2.327},"last":0.90800000000000003}]},{"osd":2,"last update":"Sun Oct 8 15:42:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0640000000000001,"15min":1.0389999999999999},"min":{"1min":0.63600000000000001,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.401,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":1.024,"5min":1.0209999999999999,"15min":1.022},"min":{"1min":0.79400000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.4059999999999999,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":1.0329999999999999}]},{"osd":3,"last update":"Sun Oct 8 15:42:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0189999999999999,"15min":1.0209999999999999},"min":{"1min":0.76900000000000002,"5min":0.626,"15min":0.626},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0620000000000001,"15min":1.042},"min":{"1min":0.68700000000000006,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2809999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":1.1379999999999999}]},{"osd":5,"last update":"Sun Oct 8 15:42:22 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.018,"15min":0.98199999999999998},"min":{"1min":0.72599999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.304,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":1.246},{"interface":"front","average":{"1min":1.226,"5min":1.125,"15min":1.081},"min":{"1min":0.60099999999999998,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":3.0259999999999998,"5min":3.0259999999999998,"15min":3.0259999999999998},"last":1.468}]},{"osd":6,"last update":"Sun Oct 8 15:42:22 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.1180000000000001,"15min":1.1399999999999999},"min":{"1min":0.86599999999999999,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":2.4550000000000001,"5min":2.4550000000000001,"15min":2.4550000000000001},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.232,"5min":1.2170000000000001,"15min":1.1930000000000001},"min":{"1min":0.69199999999999995,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.8159999999999998,"5min":2.8159999999999998,"15min":2.8159999999999998},"last":1.391}]},{"osd":7,"last update":"Sun Oct 8 15:42:22 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.1240000000000001,"15min":1.0840000000000001},"min":{"1min":0.64300000000000002,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":2.1949999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":1.282},{"interface":"front","average":{"1min":1.331,"5min":1.246,"15min":1.208},"min":{"1min":0.79100000000000004,"5min":0.625,"15min":0.625},"max":{"1min":2.7450000000000001,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":1.337}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T15:42:33.670 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T15:42:33.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.773+0000 7f7547fff700 1 Processor -- start 2023-10-08T15:42:33.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.773+0000 7f7547fff700 1 -- start start 2023-10-08T15:42:33.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.773+0000 7f7547fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f754814a080 0x7f75480baf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:33.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.773+0000 7f7547fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f754806df30 0x7f754814c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:33.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.773+0000 7f7547fff700 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75480b4050 con 0x7f75480bab50 2023-10-08T15:42:33.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.773+0000 7f7547fff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7548146da0 con 0x7f754806df30 2023-10-08T15:42:33.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.773+0000 7f7547fff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75480b4710 con 0x7f754814a080 2023-10-08T15:42:33.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.773+0000 7f7546ffd700 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f75480bab50 0x7f7548149970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:59242/0 (socket says 172.21.15.3:59242) 2023-10-08T15:42:33.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.773+0000 7f7546ffd700 1 -- 172.21.15.3:0/675699341 learned_addr learned my addr 172.21.15.3:0/675699341 (peer_addr_for_me v1:172.21.15.3:0/0) 2023-10-08T15:42:33.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.773+0000 7f75477fe700 1 --2- 172.21.15.3:0/675699341 >> v2:172.21.15.50:3300/0 conn(0x7f754806df30 0x7f754814c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:33.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.773+0000 7f75467fc700 1 --2- 172.21.15.3:0/675699341 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f754814a080 0x7f75480baf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:33.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.773+0000 7f7545ffb700 1 -- 172.21.15.3:0/675699341 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4003694436 0 0) 0x7f75480b4050 con 0x7f75480bab50 2023-10-08T15:42:33.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.777+0000 7f7545ffb700 1 -- 172.21.15.3:0/675699341 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7530003570 con 0x7f75480bab50 2023-10-08T15:42:33.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.777+0000 7f75467fc700 1 -- 172.21.15.3:0/675699341 >> v2:172.21.15.50:3300/0 conn(0x7f754806df30 msgr2=0x7f754814c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:33.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.777+0000 7f75467fc700 1 --2- 172.21.15.3:0/675699341 >> v2:172.21.15.50:3300/0 conn(0x7f754806df30 0x7f754814c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:33.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.777+0000 7f75467fc700 1 -- 172.21.15.3:0/675699341 >> v1:172.21.15.3:6789/0 conn(0x7f75480bab50 legacy=0x7f7548149970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:33.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.777+0000 7f7545ffb700 1 -- 172.21.15.3:0/675699341 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1527129441 0 0) 0x7f7530003570 con 0x7f75480bab50 2023-10-08T15:42:33.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.777+0000 7f75467fc700 1 -- 172.21.15.3:0/675699341 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75480b4330 con 0x7f754814a080 2023-10-08T15:42:33.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.777+0000 7f75467fc700 1 --2- 172.21.15.3:0/675699341 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f754814a080 0x7f75480baf20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7538009e60 tx=0x7f7538009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e79af99b40a086f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:33.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.777+0000 7f7545ffb700 1 -- 172.21.15.3:0/675699341 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753800e070 con 0x7f754814a080 2023-10-08T15:42:33.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.777+0000 7f7545ffb700 1 -- 172.21.15.3:0/675699341 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f753800b7a0 con 0x7f754814a080 2023-10-08T15:42:33.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.777+0000 7f7545ffb700 1 -- 172.21.15.3:0/675699341 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753c001470 con 0x7f754814a080 2023-10-08T15:42:33.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.777+0000 7f7547fff700 1 -- 172.21.15.3:0/675699341 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f754814a080 msgr2=0x7f75480baf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:33.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.777+0000 7f7547fff700 1 --2- 172.21.15.3:0/675699341 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f754814a080 0x7f75480baf20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7538009e60 tx=0x7f7538009780 comp rx=0 tx=0).stop 2023-10-08T15:42:33.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.777+0000 7f7547fff700 1 -- 172.21.15.3:0/675699341 shutdown_connections 2023-10-08T15:42:33.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.777+0000 7f7547fff700 1 --2- 172.21.15.3:0/675699341 >> v2:172.21.15.50:3300/0 conn(0x7f754806df30 0x7f754814c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:33.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.777+0000 7f7547fff700 1 --2- 172.21.15.3:0/675699341 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f754814a080 0x7f75480baf20 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:33.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.777+0000 7f7547fff700 1 -- 172.21.15.3:0/675699341 >> 172.21.15.3:0/675699341 conn(0x7f75480be4a0 msgr2=0x7f75480ba440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:33.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.777+0000 7f7547fff700 1 -- 172.21.15.3:0/675699341 shutdown_connections 2023-10-08T15:42:33.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.777+0000 7f7547fff700 1 -- 172.21.15.3:0/675699341 wait complete. 2023-10-08T15:42:33.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.777+0000 7f7547fff700 1 Processor -- start 2023-10-08T15:42:33.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.777+0000 7f7547fff700 1 -- start start 2023-10-08T15:42:33.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.781+0000 7f7547fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f754806df30 0x7f75481473b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:33.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.781+0000 7f7547fff700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f75480bab50 0x7f754815c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:33.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.781+0000 7f7547fff700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f754814a080 0x7f754815c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:33.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.781+0000 7f7547fff700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75480b6b60 con 0x7f75480bab50 2023-10-08T15:42:33.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.781+0000 7f7547fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75480b7db0 con 0x7f754806df30 2023-10-08T15:42:33.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.781+0000 7f7547fff700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75481478f0 con 0x7f754814a080 2023-10-08T15:42:33.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.781+0000 7f75467fc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f75480bab50 0x7f754815c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:33.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.781+0000 7f75467fc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f75480bab50 0x7f754815c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57248/0 (socket says 172.21.15.3:57248) 2023-10-08T15:42:33.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.781+0000 7f75467fc700 1 -- 172.21.15.3:0/1995434927 learned_addr learned my addr 172.21.15.3:0/1995434927 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:33.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.781+0000 7f7546ffd700 1 --2- 172.21.15.3:0/1995434927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f754806df30 0x7f75481473b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:33.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.781+0000 7f75477fe700 1 --2- 172.21.15.3:0/1995434927 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f754814a080 0x7f754815c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:33.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.781+0000 7f75467fc700 1 -- 172.21.15.3:0/1995434927 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f754814a080 msgr2=0x7f754815c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:33.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.781+0000 7f75467fc700 1 --2- 172.21.15.3:0/1995434927 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f754814a080 0x7f754815c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:33.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.781+0000 7f75467fc700 1 -- 172.21.15.3:0/1995434927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f754806df30 msgr2=0x7f75481473b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:33.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.781+0000 7f75467fc700 1 --2- 172.21.15.3:0/1995434927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f754806df30 0x7f75481473b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:33.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.781+0000 7f75467fc700 1 -- 172.21.15.3:0/1995434927 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7538009a20 con 0x7f75480bab50 2023-10-08T15:42:33.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.781+0000 7f7546ffd700 1 --2- 172.21.15.3:0/1995434927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f754806df30 0x7f75481473b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:42:33.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.781+0000 7f75467fc700 1 --2- 172.21.15.3:0/1995434927 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f75480bab50 0x7f754815c240 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f753800b610 tx=0x7f7538018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:33.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.781+0000 7f752effd700 1 -- 172.21.15.3:0/1995434927 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753800be80 con 0x7f75480bab50 2023-10-08T15:42:33.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.781+0000 7f752effd700 1 -- 172.21.15.3:0/1995434927 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7538012c80 con 0x7f75480bab50 2023-10-08T15:42:33.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.781+0000 7f7547fff700 1 -- 172.21.15.3:0/1995434927 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75480b6880 con 0x7f75480bab50 2023-10-08T15:42:33.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.781+0000 7f752effd700 1 -- 172.21.15.3:0/1995434927 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7538026460 con 0x7f75480bab50 2023-10-08T15:42:33.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.781+0000 7f7547fff700 1 -- 172.21.15.3:0/1995434927 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7548148060 con 0x7f75480bab50 2023-10-08T15:42:33.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.781+0000 7f7547fff700 1 -- 172.21.15.3:0/1995434927 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7548148250 con 0x7f75480bab50 2023-10-08T15:42:33.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.785+0000 7f752effd700 1 -- 172.21.15.3:0/1995434927 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f753801d420 con 0x7f75480bab50 2023-10-08T15:42:33.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.785+0000 7f752effd700 1 --2- 172.21.15.3:0/1995434927 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7534060550 0x7f7534062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:33.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.785+0000 7f752effd700 1 -- 172.21.15.3:0/1995434927 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f753807e870 con 0x7f75480bab50 2023-10-08T15:42:33.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.785+0000 7f7546ffd700 1 --2- 172.21.15.3:0/1995434927 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7534060550 0x7f7534062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:33.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.785+0000 7f7546ffd700 1 --2- 172.21.15.3:0/1995434927 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7534060550 0x7f7534062a00 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f753c005d40 tx=0x7f753c001580 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:33.796 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.789+0000 7f752effd700 1 -- 172.21.15.3:0/1995434927 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f753804ee60 con 0x7f75480bab50 2023-10-08T15:42:33.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.953+0000 7f7547fff700 1 -- 172.21.15.3:0/1995434927 --> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f75480b7b80 con 0x7f7534060550 2023-10-08T15:42:33.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.969+0000 7f752effd700 1 -- 172.21.15.3:0/1995434927 <== mgr.4102 v2:172.21.15.50:6832/33268 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+279287 (secure 0 0 0) 0x7f75480b7b80 con 0x7f7534060550 2023-10-08T15:42:33.981 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:42:33.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.977+0000 7f7547fff700 1 -- 172.21.15.3:0/1995434927 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7534060550 msgr2=0x7f7534062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:33.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.977+0000 7f7547fff700 1 --2- 172.21.15.3:0/1995434927 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7534060550 0x7f7534062a00 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f753c005d40 tx=0x7f753c001580 comp rx=0 tx=0).stop 2023-10-08T15:42:33.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.977+0000 7f7547fff700 1 -- 172.21.15.3:0/1995434927 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f75480bab50 msgr2=0x7f754815c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:33.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.977+0000 7f7547fff700 1 --2- 172.21.15.3:0/1995434927 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f75480bab50 0x7f754815c240 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f753800b610 tx=0x7f7538018000 comp rx=0 tx=0).stop 2023-10-08T15:42:33.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.977+0000 7f7547fff700 1 -- 172.21.15.3:0/1995434927 shutdown_connections 2023-10-08T15:42:33.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.977+0000 7f7547fff700 1 --2- 172.21.15.3:0/1995434927 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f7534060550 0x7f7534062a00 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:33.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.977+0000 7f7547fff700 1 --2- 172.21.15.3:0/1995434927 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f754814a080 0x7f754815c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:33.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.977+0000 7f7547fff700 1 --2- 172.21.15.3:0/1995434927 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f75480bab50 0x7f754815c240 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:33.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.977+0000 7f7547fff700 1 --2- 172.21.15.3:0/1995434927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f754806df30 0x7f75481473b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:33.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.977+0000 7f7547fff700 1 -- 172.21.15.3:0/1995434927 >> 172.21.15.3:0/1995434927 conn(0x7f75480be4a0 msgr2=0x7f754814bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:33.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.977+0000 7f7547fff700 1 -- 172.21.15.3:0/1995434927 shutdown_connections 2023-10-08T15:42:33.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:33.977+0000 7f7547fff700 1 -- 172.21.15.3:0/1995434927 wait complete. 2023-10-08T15:42:33.985 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2023-10-08T15:42:33.998 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":222,"stamp":"2023-10-08T15:42:32.623817+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591904,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":165,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":102,"acting":102,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2470972,"kb_used_data":6652,"kb_used_omap":0,"kb_used_meta":2464256,"kb_avail":752503748,"statfs":{"total":773094113280,"available":770563837952,"internally_reserved":0,"allocated":6811648,"data_stored":3974022,"data_compressed":66282,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":2523398144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.360394"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.338290+0000","last_change":"2023-10-08T15:42:30.333246+0000","last_active":"2023-10-08T15:42:30.338290+0000","last_peered":"2023-10-08T15:42:30.338290+0000","last_clean":"2023-10-08T15:42:30.338290+0000","last_became_active":"2023-10-08T15:42:30.332961+0000","last_became_peered":"2023-10-08T15:42:30.332961+0000","last_unstale":"2023-10-08T15:42:30.338290+0000","last_undegraded":"2023-10-08T15:42:30.338290+0000","last_fullsized":"2023-10-08T15:42:30.338290+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:37:47.231005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.352621+0000","last_change":"2023-10-08T15:42:30.352621+0000","last_active":"2023-10-08T15:42:30.352621+0000","last_peered":"2023-10-08T15:42:30.352621+0000","last_clean":"2023-10-08T15:42:30.352621+0000","last_became_active":"2023-10-08T15:42:30.352272+0000","last_became_peered":"2023-10-08T15:42:30.352272+0000","last_unstale":"2023-10-08T15:42:30.352621+0000","last_undegraded":"2023-10-08T15:42:30.352621+0000","last_fullsized":"2023-10-08T15:42:30.352621+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:03:06.159027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.331850+0000","last_change":"2023-10-08T15:42:30.331850+0000","last_active":"2023-10-08T15:42:30.331850+0000","last_peered":"2023-10-08T15:42:30.331850+0000","last_clean":"2023-10-08T15:42:30.331850+0000","last_became_active":"2023-10-08T15:42:30.331530+0000","last_became_peered":"2023-10-08T15:42:30.331530+0000","last_unstale":"2023-10-08T15:42:30.331850+0000","last_undegraded":"2023-10-08T15:42:30.331850+0000","last_fullsized":"2023-10-08T15:42:30.331850+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:56.410736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.351375+0000","last_change":"2023-10-08T15:42:30.351375+0000","last_active":"2023-10-08T15:42:30.351375+0000","last_peered":"2023-10-08T15:42:30.351375+0000","last_clean":"2023-10-08T15:42:30.351375+0000","last_became_active":"2023-10-08T15:42:30.351044+0000","last_became_peered":"2023-10-08T15:42:30.351044+0000","last_unstale":"2023-10-08T15:42:30.351375+0000","last_undegraded":"2023-10-08T15:42:30.351375+0000","last_fullsized":"2023-10-08T15:42:30.351375+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:13:37.084139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.341197+0000","last_change":"2023-10-08T15:42:30.336763+0000","last_active":"2023-10-08T15:42:30.341197+0000","last_peered":"2023-10-08T15:42:30.341197+0000","last_clean":"2023-10-08T15:42:30.341197+0000","last_became_active":"2023-10-08T15:42:30.336407+0000","last_became_peered":"2023-10-08T15:42:30.336407+0000","last_unstale":"2023-10-08T15:42:30.341197+0000","last_undegraded":"2023-10-08T15:42:30.341197+0000","last_fullsized":"2023-10-08T15:42:30.341197+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:57:24.891115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.348876+0000","last_change":"2023-10-08T15:42:30.347286+0000","last_active":"2023-10-08T15:42:30.348876+0000","last_peered":"2023-10-08T15:42:30.348876+0000","last_clean":"2023-10-08T15:42:30.348876+0000","last_became_active":"2023-10-08T15:42:30.346996+0000","last_became_peered":"2023-10-08T15:42:30.346996+0000","last_unstale":"2023-10-08T15:42:30.348876+0000","last_undegraded":"2023-10-08T15:42:30.348876+0000","last_fullsized":"2023-10-08T15:42:30.348876+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:16:28.709078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.335048+0000","last_change":"2023-10-08T15:42:30.328725+0000","last_active":"2023-10-08T15:42:30.335048+0000","last_peered":"2023-10-08T15:42:30.335048+0000","last_clean":"2023-10-08T15:42:30.335048+0000","last_became_active":"2023-10-08T15:42:30.328426+0000","last_became_peered":"2023-10-08T15:42:30.328426+0000","last_unstale":"2023-10-08T15:42:30.335048+0000","last_undegraded":"2023-10-08T15:42:30.335048+0000","last_fullsized":"2023-10-08T15:42:30.335048+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:45:25.945569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.348251+0000","last_change":"2023-10-08T15:42:30.345432+0000","last_active":"2023-10-08T15:42:30.348251+0000","last_peered":"2023-10-08T15:42:30.348251+0000","last_clean":"2023-10-08T15:42:30.348251+0000","last_became_active":"2023-10-08T15:42:30.345101+0000","last_became_peered":"2023-10-08T15:42:30.345101+0000","last_unstale":"2023-10-08T15:42:30.348251+0000","last_undegraded":"2023-10-08T15:42:30.348251+0000","last_fullsized":"2023-10-08T15:42:30.348251+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:58:41.138214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.346146+0000","last_change":"2023-10-08T15:42:30.343874+0000","last_active":"2023-10-08T15:42:30.346146+0000","last_peered":"2023-10-08T15:42:30.346146+0000","last_clean":"2023-10-08T15:42:30.346146+0000","last_became_active":"2023-10-08T15:42:30.343472+0000","last_became_peered":"2023-10-08T15:42:30.343472+0000","last_unstale":"2023-10-08T15:42:30.346146+0000","last_undegraded":"2023-10-08T15:42:30.346146+0000","last_fullsized":"2023-10-08T15:42:30.346146+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:59:36.731597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.274213+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:44:16.491355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"70'1","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.341212+0000","last_change":"2023-10-08T15:42:29.290673+0000","last_active":"2023-10-08T15:42:30.341212+0000","last_peered":"2023-10-08T15:42:30.341212+0000","last_clean":"2023-10-08T15:42:30.341212+0000","last_became_active":"2023-10-08T15:42:29.290131+0000","last_became_peered":"2023-10-08T15:42:29.290131+0000","last_unstale":"2023-10-08T15:42:30.341212+0000","last_undegraded":"2023-10-08T15:42:30.341212+0000","last_fullsized":"2023-10-08T15:42:30.341212+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:49:41.274172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.270030+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:35:17.371964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.271991+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:13:36.080229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"70'1","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.347037+0000","last_change":"2023-10-08T15:42:29.291620+0000","last_active":"2023-10-08T15:42:30.347037+0000","last_peered":"2023-10-08T15:42:30.347037+0000","last_clean":"2023-10-08T15:42:30.347037+0000","last_became_active":"2023-10-08T15:42:29.291298+0000","last_became_peered":"2023-10-08T15:42:29.291298+0000","last_unstale":"2023-10-08T15:42:30.347037+0000","last_undegraded":"2023-10-08T15:42:30.347037+0000","last_fullsized":"2023-10-08T15:42:30.347037+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:35:17.371964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.353385+0000","last_change":"2023-10-08T15:42:30.352385+0000","last_active":"2023-10-08T15:42:30.353385+0000","last_peered":"2023-10-08T15:42:30.353385+0000","last_clean":"2023-10-08T15:42:30.353385+0000","last_became_active":"2023-10-08T15:42:30.351949+0000","last_became_peered":"2023-10-08T15:42:30.351949+0000","last_unstale":"2023-10-08T15:42:30.353385+0000","last_undegraded":"2023-10-08T15:42:30.353385+0000","last_fullsized":"2023-10-08T15:42:30.353385+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:06:28.263822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"70'1","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.341264+0000","last_change":"2023-10-08T15:42:29.290424+0000","last_active":"2023-10-08T15:42:30.341264+0000","last_peered":"2023-10-08T15:42:30.341264+0000","last_clean":"2023-10-08T15:42:30.341264+0000","last_became_active":"2023-10-08T15:42:29.289913+0000","last_became_peered":"2023-10-08T15:42:29.289913+0000","last_unstale":"2023-10-08T15:42:30.341264+0000","last_undegraded":"2023-10-08T15:42:30.341264+0000","last_fullsized":"2023-10-08T15:42:30.341264+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:10:34.911060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.274727+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:38:52.335948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.270553+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:24:55.362713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.273239+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:40.888869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.347548+0000","last_change":"2023-10-08T15:42:30.347548+0000","last_active":"2023-10-08T15:42:30.347548+0000","last_peered":"2023-10-08T15:42:30.347548+0000","last_clean":"2023-10-08T15:42:30.347548+0000","last_became_active":"2023-10-08T15:42:30.347209+0000","last_became_peered":"2023-10-08T15:42:30.347209+0000","last_unstale":"2023-10-08T15:42:30.347548+0000","last_undegraded":"2023-10-08T15:42:30.347548+0000","last_fullsized":"2023-10-08T15:42:30.347548+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:46:26.270646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.272483+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:09:24.762917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.274079+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:18:15.067702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.359495+0000","last_change":"2023-10-08T15:42:30.358813+0000","last_active":"2023-10-08T15:42:30.359495+0000","last_peered":"2023-10-08T15:42:30.359495+0000","last_clean":"2023-10-08T15:42:30.359495+0000","last_became_active":"2023-10-08T15:42:30.358527+0000","last_became_peered":"2023-10-08T15:42:30.358527+0000","last_unstale":"2023-10-08T15:42:30.359495+0000","last_undegraded":"2023-10-08T15:42:30.359495+0000","last_fullsized":"2023-10-08T15:42:30.359495+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:54:13.937795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"70'6","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.342186+0000","last_change":"2023-10-08T15:42:29.291159+0000","last_active":"2023-10-08T15:42:30.342186+0000","last_peered":"2023-10-08T15:42:30.342186+0000","last_clean":"2023-10-08T15:42:30.342186+0000","last_became_active":"2023-10-08T15:42:29.290812+0000","last_became_peered":"2023-10-08T15:42:29.290812+0000","last_unstale":"2023-10-08T15:42:30.342186+0000","last_undegraded":"2023-10-08T15:42:30.342186+0000","last_fullsized":"2023-10-08T15:42:30.342186+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:26:01.548146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.272281+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:54:24.309030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.270713+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:48:23.733193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-10-08T15:42:29.290271+0000","last_change":"2023-10-08T15:42:29.288141+0000","last_active":"2023-10-08T15:42:29.290271+0000","last_peered":"2023-10-08T15:42:29.290271+0000","last_clean":"2023-10-08T15:42:29.290271+0000","last_became_active":"2023-10-08T15:42:29.287228+0000","last_became_peered":"2023-10-08T15:42:29.287228+0000","last_unstale":"2023-10-08T15:42:29.290271+0000","last_undegraded":"2023-10-08T15:42:29.290271+0000","last_fullsized":"2023-10-08T15:42:29.290271+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:44:16.551176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.271533+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:49:41.274172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.272372+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:45:28.837814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.272303+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:47:39.065529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.342433+0000","last_change":"2023-10-08T15:42:30.336936+0000","last_active":"2023-10-08T15:42:30.342433+0000","last_peered":"2023-10-08T15:42:30.342433+0000","last_clean":"2023-10-08T15:42:30.342433+0000","last_became_active":"2023-10-08T15:42:30.336624+0000","last_became_peered":"2023-10-08T15:42:30.336624+0000","last_unstale":"2023-10-08T15:42:30.342433+0000","last_undegraded":"2023-10-08T15:42:30.342433+0000","last_fullsized":"2023-10-08T15:42:30.342433+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:16:35.166421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.271204+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:10:34.911060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.273187+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:27:26.579698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.330839+0000","last_change":"2023-10-08T15:42:30.330839+0000","last_active":"2023-10-08T15:42:30.330839+0000","last_peered":"2023-10-08T15:42:30.330839+0000","last_clean":"2023-10-08T15:42:30.330839+0000","last_became_active":"2023-10-08T15:42:30.330544+0000","last_became_peered":"2023-10-08T15:42:30.330544+0000","last_unstale":"2023-10-08T15:42:30.330839+0000","last_undegraded":"2023-10-08T15:42:30.330839+0000","last_fullsized":"2023-10-08T15:42:30.330839+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:02:31.620217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.266182+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:41:42.495720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.266206+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:39:07.074681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.354803+0000","last_change":"2023-10-08T15:42:30.354803+0000","last_active":"2023-10-08T15:42:30.354803+0000","last_peered":"2023-10-08T15:42:30.354803+0000","last_clean":"2023-10-08T15:42:30.354803+0000","last_became_active":"2023-10-08T15:42:30.354575+0000","last_became_peered":"2023-10-08T15:42:30.354575+0000","last_unstale":"2023-10-08T15:42:30.354803+0000","last_undegraded":"2023-10-08T15:42:30.354803+0000","last_fullsized":"2023-10-08T15:42:30.354803+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:38:53.339858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.270896+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:41:39.525248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.335085+0000","last_change":"2023-10-08T15:42:30.328430+0000","last_active":"2023-10-08T15:42:30.335085+0000","last_peered":"2023-10-08T15:42:30.335085+0000","last_clean":"2023-10-08T15:42:30.335085+0000","last_became_active":"2023-10-08T15:42:30.328093+0000","last_became_peered":"2023-10-08T15:42:30.328093+0000","last_unstale":"2023-10-08T15:42:30.335085+0000","last_undegraded":"2023-10-08T15:42:30.335085+0000","last_fullsized":"2023-10-08T15:42:30.335085+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:25:03.880884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.270618+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:26:23.323002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.271500+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:22:35.054661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.273029+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:37:51.634617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.359048+0000","last_change":"2023-10-08T15:42:30.358100+0000","last_active":"2023-10-08T15:42:30.359048+0000","last_peered":"2023-10-08T15:42:30.359048+0000","last_clean":"2023-10-08T15:42:30.359048+0000","last_became_active":"2023-10-08T15:42:30.357781+0000","last_became_peered":"2023-10-08T15:42:30.357781+0000","last_unstale":"2023-10-08T15:42:30.359048+0000","last_undegraded":"2023-10-08T15:42:30.359048+0000","last_fullsized":"2023-10-08T15:42:30.359048+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:15.362329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.271631+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:57:32.840050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.330833+0000","last_change":"2023-10-08T15:42:30.330833+0000","last_active":"2023-10-08T15:42:30.330833+0000","last_peered":"2023-10-08T15:42:30.330833+0000","last_clean":"2023-10-08T15:42:30.330833+0000","last_became_active":"2023-10-08T15:42:30.330506+0000","last_became_peered":"2023-10-08T15:42:30.330506+0000","last_unstale":"2023-10-08T15:42:30.330833+0000","last_undegraded":"2023-10-08T15:42:30.330833+0000","last_fullsized":"2023-10-08T15:42:30.330833+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:29:47.019147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.270472+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:32:51.033691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.323086+0000","last_change":"2023-10-08T15:42:29.290448+0000","last_active":"2023-10-08T15:42:30.323086+0000","last_peered":"2023-10-08T15:42:30.323086+0000","last_clean":"2023-10-08T15:42:30.323086+0000","last_became_active":"2023-10-08T15:42:29.289907+0000","last_became_peered":"2023-10-08T15:42:29.289907+0000","last_unstale":"2023-10-08T15:42:30.323086+0000","last_undegraded":"2023-10-08T15:42:30.323086+0000","last_fullsized":"2023-10-08T15:42:30.323086+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:32:51.033691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.271831+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:55.498305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.322824+0000","last_change":"2023-10-08T15:42:29.286199+0000","last_active":"2023-10-08T15:42:30.322824+0000","last_peered":"2023-10-08T15:42:30.322824+0000","last_clean":"2023-10-08T15:42:30.322824+0000","last_became_active":"2023-10-08T15:42:29.285228+0000","last_became_peered":"2023-10-08T15:42:29.285228+0000","last_unstale":"2023-10-08T15:42:30.322824+0000","last_undegraded":"2023-10-08T15:42:30.322824+0000","last_fullsized":"2023-10-08T15:42:30.322824+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:03:22.866811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T15:42:29.258847+0000","last_change":"2023-10-08T15:42:29.258847+0000","last_active":"2023-10-08T15:42:29.258847+0000","last_peered":"2023-10-08T15:42:29.258847+0000","last_clean":"2023-10-08T15:42:29.258847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:29.258847+0000","last_undegraded":"2023-10-08T15:42:29.258847+0000","last_fullsized":"2023-10-08T15:42:29.258847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:28.254937+0000","last_change":"2023-10-08T15:42:28.268588+0000","last_active":"2023-10-08T15:42:28.254937+0000","last_peered":"2023-10-08T15:42:28.254937+0000","last_clean":"2023-10-08T15:42:28.254937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:28.254937+0000","last_undegraded":"2023-10-08T15:42:28.254937+0000","last_fullsized":"2023-10-08T15:42:28.254937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:58:59.888585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":211,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T15:42:26.252167+0000","last_change":"2023-10-08T15:37:19.380955+0000","last_active":"2023-10-08T15:42:26.252167+0000","last_peered":"2023-10-08T15:42:26.252167+0000","last_clean":"2023-10-08T15:42:26.252167+0000","last_became_active":"2023-10-08T15:37:19.378277+0000","last_became_peered":"2023-10-08T15:37:19.378277+0000","last_unstale":"2023-10-08T15:42:26.252167+0000","last_undegraded":"2023-10-08T15:42:26.252167+0000","last_fullsized":"2023-10-08T15:42:26.252167+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:17.537726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:17.537726+0000","last_clean_scrub_stamp":"2023-10-08T15:37:17.537726+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:06:26.612046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":36,"acting":36,"num_store_stats":2},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66282,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542208,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310440,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061400,"statfs":{"total":96636764160,"available":96318873600,"internally_reserved":0,"allocated":884736,"data_stored":932389,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:41:27 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.92000000000000004,"15min":0.95199999999999996},"min":{"1min":0.57099999999999995,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":1.196},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.92400000000000004,"15min":0.92900000000000005},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.3600000000000001,"5min":1.758,"15min":1.758},"last":0.81799999999999995}]},{"osd":1,"last update":"Sun Oct 8 15:41:27 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.88200000000000001,"15min":0.88600000000000001},"min":{"1min":0.46600000000000003,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.1930000000000001,"5min":1.474,"15min":1.474},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.94299999999999995,"15min":0.95499999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.2849999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.0129999999999999}]},{"osd":2,"last update":"Sun Oct 8 15:41:27 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.97099999999999997,"15min":1.016},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.381,"5min":1.623,"15min":1.623},"last":1.4219999999999999},{"interface":"front","average":{"1min":1.038,"5min":1.0029999999999999,"15min":1.0069999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.68300000000000005}]},{"osd":3,"last update":"Sun Oct 8 15:41:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.012,"15min":0.98199999999999998},"min":{"1min":0.91900000000000004,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.8260000000000001,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.998,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.8129999999999999,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":1.3149999999999999}]},{"osd":4,"last update":"Sun Oct 8 15:41:27 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.0389999999999999,"15min":1.077},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0760000000000001,"15min":1.0940000000000001},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.393,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.228}]},{"osd":5,"last update":"Sun Oct 8 15:41:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1799999999999999,"15min":1.248},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.6359999999999999,"5min":1.792,"15min":1.792},"last":1.381},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.2130000000000001,"15min":1.2410000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":1.288}]},{"osd":6,"last update":"Sun Oct 8 15:41:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.272,"15min":1.3080000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.6879999999999999,"5min":1.839,"15min":1.839},"last":1.145},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.1950000000000001,"15min":1.2410000000000001},"min":{"1min":0.79900000000000004,"5min":0.627,"15min":0.627},"max":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":1.0860000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542209,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306280,"kb_used_data":800,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065560,"statfs":{"total":96636764160,"available":96323133440,"internally_reserved":0,"allocated":819200,"data_stored":342021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.90700000000000003,"15min":0.84499999999999997},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.2889999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97999999999999998,"15min":0.996},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.3899999999999999,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.0920000000000001}]},{"osd":1,"last update":"Sun Oct 8 15:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.96599999999999997,"15min":0.96199999999999997},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.385,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":1.1870000000000001},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.97499999999999998,"15min":0.98699999999999999},"min":{"1min":0.66500000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.5149999999999999,"5min":1.853,"15min":1.853},"last":0.66500000000000004}]},{"osd":2,"last update":"Sun Oct 8 15:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.89700000000000002,"15min":0.85899999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.333,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.046,"5min":1.0569999999999999,"15min":1.073},"min":{"1min":0.65500000000000003,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.325,"5min":1.518,"15min":1.518},"last":1.038}]},{"osd":3,"last update":"Sun Oct 8 15:42:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0449999999999999,"15min":1.0289999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.456,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.95799999999999996,"5min":1.02,"15min":1.0640000000000001},"min":{"1min":0.67100000000000004,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.202,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":1.143}]},{"osd":4,"last update":"Sun Oct 8 15:42:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.0960000000000001,"15min":1.1160000000000001},"min":{"1min":0.69899999999999995,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.405,"5min":1.7,"15min":1.7},"last":1.284},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.151,"15min":1.181},"min":{"1min":0.86899999999999999,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.5720000000000001,"5min":1.623,"15min":1.623},"last":1.2470000000000001}]},{"osd":5,"last update":"Sun Oct 8 15:42:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0760000000000001,"15min":1.1120000000000001},"min":{"1min":0.755,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.3939999999999999,"5min":1.581,"15min":1.581},"last":1.3939999999999999},{"interface":"front","average":{"1min":1.254,"5min":1.2529999999999999,"15min":1.298},"min":{"1min":0.85899999999999999,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.554,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":1.3380000000000001}]},{"osd":7,"last update":"Sun Oct 8 15:42:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.264,"15min":1.282},"min":{"1min":0.93999999999999995,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":1.631,"5min":1.74,"15min":1.74},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.2410000000000001,"15min":1.2929999999999999},"min":{"1min":0.99199999999999999,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":1.5920000000000001,"5min":2.5630000000000002,"15min":2.5630000000000002},"last":1.45}]}]},{"osd":3,"up_from":14,"seq":60129542210,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310376,"kb_used_data":800,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061464,"statfs":{"total":96636764160,"available":96318939136,"internally_reserved":0,"allocated":819200,"data_stored":342021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.67600000000000005,"15min":0.70799999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.84199999999999997,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.748,"5min":0.76700000000000002,"15min":0.76200000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.98399999999999999,"5min":1.179,"15min":1.179},"last":0.98399999999999999}]},{"osd":1,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.73199999999999998,"15min":0.71699999999999997},"min":{"1min":0.42199999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.052,"5min":1.365,"15min":1.365},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.745,"5min":0.82899999999999996,"15min":0.81399999999999995},"min":{"1min":0.52700000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93799999999999994,"5min":1.353,"15min":1.353},"last":0.67200000000000004}]},{"osd":2,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.83799999999999997,"15min":0.84699999999999998},"min":{"1min":0.58699999999999997,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.244,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.90000000000000002,"15min":0.91900000000000004},"min":{"1min":0.47599999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.2350000000000001,"5min":1.423,"15min":1.423},"last":0.628}]},{"osd":4,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.069,"15min":1.0640000000000001},"min":{"1min":0.73899999999999999,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.3129999999999999,"5min":1.585,"15min":1.585},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.024,"5min":1.073,"15min":1.131},"min":{"1min":0.72999999999999998,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.339,"5min":2.762,"15min":2.762},"last":0.95099999999999996}]},{"osd":5,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.1100000000000001,"15min":1.1419999999999999},"min":{"1min":0.755,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.3400000000000001,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.143,"5min":1.1850000000000001,"15min":1.2190000000000001},"min":{"1min":0.78500000000000003,"5min":0.755,"15min":0.755},"max":{"1min":1.625,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":1.0629999999999999}]},{"osd":6,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.212,"15min":1.278},"min":{"1min":0.82199999999999995,"5min":0.746,"15min":0.746},"max":{"1min":1.504,"5min":2.6890000000000001,"15min":2.6890000000000001},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.103,"5min":1.194,"15min":1.212},"min":{"1min":0.86899999999999999,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":1.409,"5min":1.742,"15min":1.742},"last":1.141}]},{"osd":7,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2490000000000001,"15min":1.2529999999999999},"min":{"1min":0.93200000000000005,"5min":0.91600000000000004,"15min":0.91600000000000004},"max":{"1min":1.673,"5min":1.738,"15min":1.738},"last":1.117},{"interface":"front","average":{"1min":1.206,"5min":1.2809999999999999,"15min":1.3380000000000001},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.585,"5min":2.5840000000000001,"15min":2.5840000000000001},"last":1.1910000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542209,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":314472,"kb_used_data":800,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94057368,"statfs":{"total":96636764160,"available":96314744832,"internally_reserved":0,"allocated":819200,"data_stored":342021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.64700000000000002,"15min":0.628},"min":{"1min":0.499,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.72499999999999998,"15min":0.66700000000000004},"min":{"1min":0.47099999999999997,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.105,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.74199999999999999}]},{"osd":1,"last update":"Sun Oct 8 15:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.72199999999999998,"15min":0.68700000000000006},"min":{"1min":0.56299999999999994,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0860000000000001,"5min":1.236,"15min":1.236},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.77900000000000003,"15min":0.71299999999999997},"min":{"1min":0.502,"5min":0.307,"15min":0.307},"max":{"1min":1.226,"5min":1.399,"15min":1.399},"last":0.94499999999999995}]},{"osd":3,"last update":"Sun Oct 8 15:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.72099999999999997,"15min":0.66100000000000003},"min":{"1min":0.53100000000000003,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.85099999999999998},"min":{"1min":0.621,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.90400000000000003}]},{"osd":4,"last update":"Sun Oct 8 15:41:32 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.014,"15min":1.0029999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.329,"5min":1.371,"15min":1.371},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0369999999999999,"15min":1.0349999999999999},"min":{"1min":0.71799999999999997,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.544,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.085}]},{"osd":5,"last update":"Sun Oct 8 15:41:32 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.056,"15min":1.056},"min":{"1min":0.75700000000000001,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.351,"5min":1.462,"15min":1.462},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0780000000000001,"15min":1.0640000000000001},"min":{"1min":0.77000000000000002,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.3919999999999999,"5min":1.452,"15min":1.452},"last":1.1759999999999999}]},{"osd":6,"last update":"Sun Oct 8 15:41:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.133,"15min":1.1040000000000001},"min":{"1min":0.83799999999999997,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.036},{"interface":"front","average":{"1min":1.137,"5min":1.141,"15min":1.113},"min":{"1min":0.74199999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":1.3520000000000001}]},{"osd":7,"last update":"Sun Oct 8 15:41:32 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.2110000000000001,"15min":1.167},"min":{"1min":0.85299999999999998,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.6419999999999999,"5min":1.72,"15min":1.72},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.153,"5min":1.1910000000000001,"15min":1.167},"min":{"1min":0.77800000000000002,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.647,"5min":1.804,"15min":1.804},"last":1.486}]}]},{"osd":1,"up_from":14,"seq":60129542210,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":314484,"kb_used_data":812,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94057356,"statfs":{"total":96636764160,"available":96314732544,"internally_reserved":0,"allocated":831488,"data_stored":347826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.72099999999999997,"15min":0.76100000000000001},"min":{"1min":0.42099999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.343,"5min":1.734,"15min":1.734},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.79000000000000004,"15min":0.94199999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.381,"5min":5.7960000000000003,"15min":5.7960000000000003},"last":0.71199999999999997}]},{"osd":2,"last update":"Sun Oct 8 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.749,"15min":0.81899999999999995},"min":{"1min":0.50900000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.147,"5min":4.0119999999999996,"15min":4.0119999999999996},"last":1},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.879,"15min":0.90100000000000002},"min":{"1min":0.56599999999999995,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.4670000000000001,"5min":1.853,"15min":1.853},"last":0.872}]},{"osd":3,"last update":"Sun Oct 8 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":1.1180000000000001,"15min":1.014},"min":{"1min":0.48099999999999998,"5min":0.435,"15min":0.435},"max":{"1min":1.413,"5min":13.388,"15min":13.388},"last":1.0840000000000001},{"interface":"front","average":{"1min":0.91800000000000004,"5min":1.129,"15min":1.141},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.405,"5min":13.353,"15min":13.353},"last":1.0449999999999999}]},{"osd":4,"last update":"Sun Oct 8 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":1.048,"15min":1.1930000000000001},"min":{"1min":0.75800000000000001,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.4359999999999999,"5min":5.859,"15min":5.859},"last":0.93200000000000005},{"interface":"front","average":{"1min":1.115,"5min":1.0780000000000001,"15min":1.1459999999999999},"min":{"1min":0.76000000000000001,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.7450000000000001,"5min":4.2679999999999998,"15min":4.2679999999999998},"last":1.2}]},{"osd":5,"last update":"Sun Oct 8 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.0880000000000001,"15min":1.1319999999999999},"min":{"1min":0.82499999999999996,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.512,"5min":4.3380000000000001,"15min":4.3380000000000001},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.169,"15min":1.1779999999999999},"min":{"1min":0.77600000000000002,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.607,"5min":2.085,"15min":2.085},"last":0.96999999999999997}]},{"osd":6,"last update":"Sun Oct 8 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.2030000000000001,"15min":1.3400000000000001},"min":{"1min":0.80500000000000005,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.712,"5min":5.8979999999999997,"15min":5.8979999999999997},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.234,"5min":1.208,"15min":1.262},"min":{"1min":0.81599999999999995,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.9419999999999999,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":1.6279999999999999}]},{"osd":7,"last update":"Sun Oct 8 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.242,"15min":1.2470000000000001},"min":{"1min":0.71099999999999997,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.8109999999999999,"5min":2.3940000000000001,"15min":2.3940000000000001},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.2849999999999999,"15min":1.4410000000000001},"min":{"1min":0.94199999999999995,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.752,"5min":5.9299999999999997,"15min":5.9299999999999997},"last":1.141}]}]},{"osd":0,"up_from":14,"seq":60129542210,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310452,"kb_used_data":876,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061388,"statfs":{"total":96636764160,"available":96318861312,"internally_reserved":0,"allocated":897024,"data_stored":938194,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.70999999999999996,"15min":0.80600000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.127,"5min":1.514,"15min":1.514},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.77900000000000003,"15min":0.79400000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.1180000000000001,"5min":1.518,"15min":1.518},"last":1.0780000000000001}]},{"osd":2,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.79600000000000004,"15min":0.84799999999999998},"min":{"1min":0.499,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.054,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78000000000000003,"15min":0.78400000000000003},"min":{"1min":0.497,"5min":0.434,"15min":0.434},"max":{"1min":1.198,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":1.198}]},{"osd":3,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.74299999999999999,"15min":0.755},"min":{"1min":0.50700000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":1.0620000000000001,"5min":0.96399999999999997,"15min":0.98799999999999999},"min":{"1min":0.52900000000000003,"5min":0.499,"15min":0.499},"max":{"1min":4.5069999999999997,"5min":4.5069999999999997,"15min":4.5069999999999997},"last":0.86099999999999999}]},{"osd":4,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.0469999999999999,"15min":1.0820000000000001},"min":{"1min":0.73099999999999998,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.6479999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.2470000000000001},{"interface":"front","average":{"1min":1,"5min":1.02,"15min":1.0740000000000001},"min":{"1min":0.70599999999999996,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.429,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.93999999999999995}]},{"osd":5,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.024,"15min":1.079},"min":{"1min":0.76500000000000001,"5min":0.626,"15min":0.626},"max":{"1min":1.385,"5min":2.214,"15min":2.214},"last":1.05},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1850000000000001,"15min":1.306},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.605,"5min":3.4569999999999999,"15min":3.4569999999999999},"last":1.2569999999999999}]},{"osd":6,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.1890000000000001,"15min":1.274},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.677,"5min":2.532,"15min":2.532},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.244,"5min":1.2070000000000001,"15min":1.2370000000000001},"min":{"1min":0.86299999999999999,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.704,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":1.478}]},{"osd":7,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.2490000000000001,"15min":1.2849999999999999},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.607,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.391},{"interface":"front","average":{"1min":1.151,"5min":1.1839999999999999,"15min":1.22},"min":{"1min":0.82699999999999996,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.4870000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.98199999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574914,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306332,"kb_used_data":852,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065508,"statfs":{"total":96636764160,"available":96323080192,"internally_reserved":0,"allocated":872448,"data_stored":362410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.878,"15min":0.85599999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":1.1639999999999999},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.90100000000000002,"15min":0.90800000000000003},"min":{"1min":0.57199999999999995,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.67700000000000005}]},{"osd":1,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91300000000000003,"15min":0.90900000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.4219999999999999,"5min":1.448,"15min":1.448},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.92000000000000004,"15min":0.97299999999999998},"min":{"1min":0.59699999999999998,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.641,"5min":1.754,"15min":1.754},"last":0.78000000000000003}]},{"osd":2,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.93899999999999995,"15min":0.94999999999999996},"min":{"1min":0.59199999999999997,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.044,"5min":2.044,"15min":2.044},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.1000000000000001,"5min":0.997,"15min":1.012},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.609,"5min":1.609,"15min":1.609},"last":1.2829999999999999}]},{"osd":3,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.96799999999999997,"15min":0.99199999999999999},"min":{"1min":0.61099999999999999,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.5800000000000001,"5min":1.929,"15min":1.929},"last":0.871},{"interface":"front","average":{"1min":1.044,"5min":1.034,"15min":1.0920000000000001},"min":{"1min":0.71599999999999997,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.53,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.71599999999999997}]},{"osd":4,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.0069999999999999,"15min":1.0129999999999999},"min":{"1min":0.68300000000000005,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":2.2189999999999999,"5min":2.2189999999999999,"15min":2.2189999999999999},"last":1.375},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.042,"15min":1.071},"min":{"1min":0.58399999999999996,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":2.129,"5min":2.129,"15min":2.129},"last":1.3460000000000001}]},{"osd":6,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.153,"15min":1.1910000000000001},"min":{"1min":0.876,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.4079999999999999,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":1.008},{"interface":"front","average":{"1min":1.165,"5min":1.161,"15min":1.2170000000000001},"min":{"1min":0.77400000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.6539999999999999,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.0449999999999999}]},{"osd":7,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.087,"15min":1.1439999999999999},"min":{"1min":0.69299999999999995,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.7470000000000001,"5min":2.177,"15min":2.177},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.1970000000000001,"15min":1.2130000000000001},"min":{"1min":0.85099999999999998,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.6579999999999999,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.234}]}]},{"osd":4,"up_from":13,"seq":55834574914,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298136,"kb_used_data":848,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073704,"statfs":{"total":96636764160,"available":96331472896,"internally_reserved":0,"allocated":868352,"data_stored":367140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.82799999999999996,"15min":0.81200000000000006},"min":{"1min":0.503,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.248,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":1.3029999999999999},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84399999999999997,"15min":0.80500000000000005},"min":{"1min":0.54300000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.147,"5min":1.474,"15min":1.474},"last":0.873}]},{"osd":1,"last update":"Sun Oct 8 15:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.89300000000000002,"15min":0.84799999999999998},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1359999999999999,"5min":1.456,"15min":1.456},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.89300000000000002,"15min":0.85099999999999998},"min":{"1min":0.65500000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.327,"5min":2.327,"15min":2.327},"last":0.90800000000000003}]},{"osd":2,"last update":"Sun Oct 8 15:42:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0640000000000001,"15min":1.0389999999999999},"min":{"1min":0.63600000000000001,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.401,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":1.024,"5min":1.0209999999999999,"15min":1.022},"min":{"1min":0.79400000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.4059999999999999,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":1.0329999999999999}]},{"osd":3,"last update":"Sun Oct 8 15:42:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0189999999999999,"15min":1.0209999999999999},"min":{"1min":0.76900000000000002,"5min":0.626,"15min":0.626},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0620000000000001,"15min":1.042},"min":{"1min":0.68700000000000006,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2809999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":1.1379999999999999}]},{"osd":5,"last update":"Sun Oct 8 15:42:22 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.018,"15min":0.98199999999999998},"min":{"1min":0.72599999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.304,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":1.246},{"interface":"front","average":{"1min":1.226,"5min":1.125,"15min":1.081},"min":{"1min":0.60099999999999998,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":3.0259999999999998,"5min":3.0259999999999998,"15min":3.0259999999999998},"last":1.468}]},{"osd":6,"last update":"Sun Oct 8 15:42:22 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.1180000000000001,"15min":1.1399999999999999},"min":{"1min":0.86599999999999999,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":2.4550000000000001,"5min":2.4550000000000001,"15min":2.4550000000000001},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.232,"5min":1.2170000000000001,"15min":1.1930000000000001},"min":{"1min":0.69199999999999995,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.8159999999999998,"5min":2.8159999999999998,"15min":2.8159999999999998},"last":1.391}]},{"osd":7,"last update":"Sun Oct 8 15:42:22 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.1240000000000001,"15min":1.0840000000000001},"min":{"1min":0.64300000000000002,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":2.1949999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":1.282},{"interface":"front","average":{"1min":1.331,"5min":1.246,"15min":1.208},"min":{"1min":0.79100000000000004,"5min":0.625,"15min":0.625},"max":{"1min":2.7450000000000001,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":1.337}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T15:42:34.004 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3f is not active+clean 2023-10-08T15:42:34.004 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:42:29.258847+0000', 'last_change': '2023-10-08T15:42:29.258847+0000', 'last_active': '2023-10-08T15:42:29.258847+0000', 'last_peered': '2023-10-08T15:42:29.258847+0000', 'last_clean': '2023-10-08T15:42:29.258847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:29.258847+0000', 'last_undegraded': '2023-10-08T15:42:29.258847+0000', 'last_fullsized': '2023-10-08T15:42:29.258847+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:42:34.004 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3e is not active+clean 2023-10-08T15:42:34.004 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:42:29.258847+0000', 'last_change': '2023-10-08T15:42:29.258847+0000', 'last_active': '2023-10-08T15:42:29.258847+0000', 'last_peered': '2023-10-08T15:42:29.258847+0000', 'last_clean': '2023-10-08T15:42:29.258847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:29.258847+0000', 'last_undegraded': '2023-10-08T15:42:29.258847+0000', 'last_fullsized': '2023-10-08T15:42:29.258847+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:42:34.005 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3d is not active+clean 2023-10-08T15:42:34.005 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:42:29.258847+0000', 'last_change': '2023-10-08T15:42:29.258847+0000', 'last_active': '2023-10-08T15:42:29.258847+0000', 'last_peered': '2023-10-08T15:42:29.258847+0000', 'last_clean': '2023-10-08T15:42:29.258847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:29.258847+0000', 'last_undegraded': '2023-10-08T15:42:29.258847+0000', 'last_fullsized': '2023-10-08T15:42:29.258847+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:42:34.005 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3c is not active+clean 2023-10-08T15:42:34.005 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:42:29.258847+0000', 'last_change': '2023-10-08T15:42:29.258847+0000', 'last_active': '2023-10-08T15:42:29.258847+0000', 'last_peered': '2023-10-08T15:42:29.258847+0000', 'last_clean': '2023-10-08T15:42:29.258847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:29.258847+0000', 'last_undegraded': '2023-10-08T15:42:29.258847+0000', 'last_fullsized': '2023-10-08T15:42:29.258847+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:42:34.005 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.39 is not active+clean 2023-10-08T15:42:34.005 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:42:29.258847+0000', 'last_change': '2023-10-08T15:42:29.258847+0000', 'last_active': '2023-10-08T15:42:29.258847+0000', 'last_peered': '2023-10-08T15:42:29.258847+0000', 'last_clean': '2023-10-08T15:42:29.258847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:29.258847+0000', 'last_undegraded': '2023-10-08T15:42:29.258847+0000', 'last_fullsized': '2023-10-08T15:42:29.258847+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:42:34.005 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.36 is not active+clean 2023-10-08T15:42:34.005 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:42:29.258847+0000', 'last_change': '2023-10-08T15:42:29.258847+0000', 'last_active': '2023-10-08T15:42:29.258847+0000', 'last_peered': '2023-10-08T15:42:29.258847+0000', 'last_clean': '2023-10-08T15:42:29.258847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:29.258847+0000', 'last_undegraded': '2023-10-08T15:42:29.258847+0000', 'last_fullsized': '2023-10-08T15:42:29.258847+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:42:34.005 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.35 is not active+clean 2023-10-08T15:42:34.006 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:42:29.258847+0000', 'last_change': '2023-10-08T15:42:29.258847+0000', 'last_active': '2023-10-08T15:42:29.258847+0000', 'last_peered': '2023-10-08T15:42:29.258847+0000', 'last_clean': '2023-10-08T15:42:29.258847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:29.258847+0000', 'last_undegraded': '2023-10-08T15:42:29.258847+0000', 'last_fullsized': '2023-10-08T15:42:29.258847+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:42:34.006 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.34 is not active+clean 2023-10-08T15:42:34.006 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:42:29.258847+0000', 'last_change': '2023-10-08T15:42:29.258847+0000', 'last_active': '2023-10-08T15:42:29.258847+0000', 'last_peered': '2023-10-08T15:42:29.258847+0000', 'last_clean': '2023-10-08T15:42:29.258847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:29.258847+0000', 'last_undegraded': '2023-10-08T15:42:29.258847+0000', 'last_fullsized': '2023-10-08T15:42:29.258847+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:42:34.006 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.33 is not active+clean 2023-10-08T15:42:34.006 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:42:29.258847+0000', 'last_change': '2023-10-08T15:42:29.258847+0000', 'last_active': '2023-10-08T15:42:29.258847+0000', 'last_peered': '2023-10-08T15:42:29.258847+0000', 'last_clean': '2023-10-08T15:42:29.258847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:29.258847+0000', 'last_undegraded': '2023-10-08T15:42:29.258847+0000', 'last_fullsized': '2023-10-08T15:42:29.258847+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:42:34.006 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.32 is not active+clean 2023-10-08T15:42:34.006 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:42:29.258847+0000', 'last_change': '2023-10-08T15:42:29.258847+0000', 'last_active': '2023-10-08T15:42:29.258847+0000', 'last_peered': '2023-10-08T15:42:29.258847+0000', 'last_clean': '2023-10-08T15:42:29.258847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:29.258847+0000', 'last_undegraded': '2023-10-08T15:42:29.258847+0000', 'last_fullsized': '2023-10-08T15:42:29.258847+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:42:34.006 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.31 is not active+clean 2023-10-08T15:42:34.006 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:42:29.258847+0000', 'last_change': '2023-10-08T15:42:29.258847+0000', 'last_active': '2023-10-08T15:42:29.258847+0000', 'last_peered': '2023-10-08T15:42:29.258847+0000', 'last_clean': '2023-10-08T15:42:29.258847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:29.258847+0000', 'last_undegraded': '2023-10-08T15:42:29.258847+0000', 'last_fullsized': '2023-10-08T15:42:29.258847+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:42:34.007 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2e is not active+clean 2023-10-08T15:42:34.007 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:42:29.258847+0000', 'last_change': '2023-10-08T15:42:29.258847+0000', 'last_active': '2023-10-08T15:42:29.258847+0000', 'last_peered': '2023-10-08T15:42:29.258847+0000', 'last_clean': '2023-10-08T15:42:29.258847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:29.258847+0000', 'last_undegraded': '2023-10-08T15:42:29.258847+0000', 'last_fullsized': '2023-10-08T15:42:29.258847+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:42:34.007 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2d is not active+clean 2023-10-08T15:42:34.007 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:42:29.258847+0000', 'last_change': '2023-10-08T15:42:29.258847+0000', 'last_active': '2023-10-08T15:42:29.258847+0000', 'last_peered': '2023-10-08T15:42:29.258847+0000', 'last_clean': '2023-10-08T15:42:29.258847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:29.258847+0000', 'last_undegraded': '2023-10-08T15:42:29.258847+0000', 'last_fullsized': '2023-10-08T15:42:29.258847+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:42:34.007 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2c is not active+clean 2023-10-08T15:42:34.007 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:42:29.258847+0000', 'last_change': '2023-10-08T15:42:29.258847+0000', 'last_active': '2023-10-08T15:42:29.258847+0000', 'last_peered': '2023-10-08T15:42:29.258847+0000', 'last_clean': '2023-10-08T15:42:29.258847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:29.258847+0000', 'last_undegraded': '2023-10-08T15:42:29.258847+0000', 'last_fullsized': '2023-10-08T15:42:29.258847+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:42:34.007 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2b is not active+clean 2023-10-08T15:42:34.007 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:42:29.258847+0000', 'last_change': '2023-10-08T15:42:29.258847+0000', 'last_active': '2023-10-08T15:42:29.258847+0000', 'last_peered': '2023-10-08T15:42:29.258847+0000', 'last_clean': '2023-10-08T15:42:29.258847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:29.258847+0000', 'last_undegraded': '2023-10-08T15:42:29.258847+0000', 'last_fullsized': '2023-10-08T15:42:29.258847+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:42:34.007 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2a is not active+clean 2023-10-08T15:42:34.008 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:42:29.258847+0000', 'last_change': '2023-10-08T15:42:29.258847+0000', 'last_active': '2023-10-08T15:42:29.258847+0000', 'last_peered': '2023-10-08T15:42:29.258847+0000', 'last_clean': '2023-10-08T15:42:29.258847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:29.258847+0000', 'last_undegraded': '2023-10-08T15:42:29.258847+0000', 'last_fullsized': '2023-10-08T15:42:29.258847+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:42:34.008 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.29 is not active+clean 2023-10-08T15:42:34.008 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:42:29.258847+0000', 'last_change': '2023-10-08T15:42:29.258847+0000', 'last_active': '2023-10-08T15:42:29.258847+0000', 'last_peered': '2023-10-08T15:42:29.258847+0000', 'last_clean': '2023-10-08T15:42:29.258847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:29.258847+0000', 'last_undegraded': '2023-10-08T15:42:29.258847+0000', 'last_fullsized': '2023-10-08T15:42:29.258847+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:42:34.008 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.28 is not active+clean 2023-10-08T15:42:34.008 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:42:29.258847+0000', 'last_change': '2023-10-08T15:42:29.258847+0000', 'last_active': '2023-10-08T15:42:29.258847+0000', 'last_peered': '2023-10-08T15:42:29.258847+0000', 'last_clean': '2023-10-08T15:42:29.258847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:29.258847+0000', 'last_undegraded': '2023-10-08T15:42:29.258847+0000', 'last_fullsized': '2023-10-08T15:42:29.258847+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:42:34.008 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.27 is not active+clean 2023-10-08T15:42:34.008 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:42:29.258847+0000', 'last_change': '2023-10-08T15:42:29.258847+0000', 'last_active': '2023-10-08T15:42:29.258847+0000', 'last_peered': '2023-10-08T15:42:29.258847+0000', 'last_clean': '2023-10-08T15:42:29.258847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:29.258847+0000', 'last_undegraded': '2023-10-08T15:42:29.258847+0000', 'last_fullsized': '2023-10-08T15:42:29.258847+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:42:34.008 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.26 is not active+clean 2023-10-08T15:42:34.008 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:42:29.258847+0000', 'last_change': '2023-10-08T15:42:29.258847+0000', 'last_active': '2023-10-08T15:42:29.258847+0000', 'last_peered': '2023-10-08T15:42:29.258847+0000', 'last_clean': '2023-10-08T15:42:29.258847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:29.258847+0000', 'last_undegraded': '2023-10-08T15:42:29.258847+0000', 'last_fullsized': '2023-10-08T15:42:29.258847+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:42:34.009 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.24 is not active+clean 2023-10-08T15:42:34.009 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:42:29.258847+0000', 'last_change': '2023-10-08T15:42:29.258847+0000', 'last_active': '2023-10-08T15:42:29.258847+0000', 'last_peered': '2023-10-08T15:42:29.258847+0000', 'last_clean': '2023-10-08T15:42:29.258847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:29.258847+0000', 'last_undegraded': '2023-10-08T15:42:29.258847+0000', 'last_fullsized': '2023-10-08T15:42:29.258847+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:42:34.009 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.23 is not active+clean 2023-10-08T15:42:34.009 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:42:29.258847+0000', 'last_change': '2023-10-08T15:42:29.258847+0000', 'last_active': '2023-10-08T15:42:29.258847+0000', 'last_peered': '2023-10-08T15:42:29.258847+0000', 'last_clean': '2023-10-08T15:42:29.258847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:29.258847+0000', 'last_undegraded': '2023-10-08T15:42:29.258847+0000', 'last_fullsized': '2023-10-08T15:42:29.258847+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:42:34.009 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.22 is not active+clean 2023-10-08T15:42:34.009 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:42:29.258847+0000', 'last_change': '2023-10-08T15:42:29.258847+0000', 'last_active': '2023-10-08T15:42:29.258847+0000', 'last_peered': '2023-10-08T15:42:29.258847+0000', 'last_clean': '2023-10-08T15:42:29.258847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:29.258847+0000', 'last_undegraded': '2023-10-08T15:42:29.258847+0000', 'last_fullsized': '2023-10-08T15:42:29.258847+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:42:34.009 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.20 is not active+clean 2023-10-08T15:42:34.009 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:42:29.258847+0000', 'last_change': '2023-10-08T15:42:29.258847+0000', 'last_active': '2023-10-08T15:42:29.258847+0000', 'last_peered': '2023-10-08T15:42:29.258847+0000', 'last_clean': '2023-10-08T15:42:29.258847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:29.258847+0000', 'last_undegraded': '2023-10-08T15:42:29.258847+0000', 'last_fullsized': '2023-10-08T15:42:29.258847+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:42:34.009 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1f is not active+clean 2023-10-08T15:42:34.009 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:28.254937+0000', 'last_change': '2023-10-08T15:42:28.274213+0000', 'last_active': '2023-10-08T15:42:28.254937+0000', 'last_peered': '2023-10-08T15:42:28.254937+0000', 'last_clean': '2023-10-08T15:42:28.254937+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:28.254937+0000', 'last_undegraded': '2023-10-08T15:42:28.254937+0000', 'last_fullsized': '2023-10-08T15:42:28.254937+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T21:44:16.491355+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T15:42:34.010 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1f is not active+clean 2023-10-08T15:42:34.010 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:42:29.258847+0000', 'last_change': '2023-10-08T15:42:29.258847+0000', 'last_active': '2023-10-08T15:42:29.258847+0000', 'last_peered': '2023-10-08T15:42:29.258847+0000', 'last_clean': '2023-10-08T15:42:29.258847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:29.258847+0000', 'last_undegraded': '2023-10-08T15:42:29.258847+0000', 'last_fullsized': '2023-10-08T15:42:29.258847+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:42:34.010 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1c is not active+clean 2023-10-08T15:42:34.010 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:42:29.258847+0000', 'last_change': '2023-10-08T15:42:29.258847+0000', 'last_active': '2023-10-08T15:42:29.258847+0000', 'last_peered': '2023-10-08T15:42:29.258847+0000', 'last_clean': '2023-10-08T15:42:29.258847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:29.258847+0000', 'last_undegraded': '2023-10-08T15:42:29.258847+0000', 'last_fullsized': '2023-10-08T15:42:29.258847+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:42:34.010 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1d is not active+clean 2023-10-08T15:42:34.010 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:28.254937+0000', 'last_change': '2023-10-08T15:42:28.270030+0000', 'last_active': '2023-10-08T15:42:28.254937+0000', 'last_peered': '2023-10-08T15:42:28.254937+0000', 'last_clean': '2023-10-08T15:42:28.254937+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:28.254937+0000', 'last_undegraded': '2023-10-08T15:42:28.254937+0000', 'last_fullsized': '2023-10-08T15:42:28.254937+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T18:35:17.371964+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T15:42:34.010 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1d is not active+clean 2023-10-08T15:42:34.010 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:42:29.258847+0000', 'last_change': '2023-10-08T15:42:29.258847+0000', 'last_active': '2023-10-08T15:42:29.258847+0000', 'last_peered': '2023-10-08T15:42:29.258847+0000', 'last_clean': '2023-10-08T15:42:29.258847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:29.258847+0000', 'last_undegraded': '2023-10-08T15:42:29.258847+0000', 'last_fullsized': '2023-10-08T15:42:29.258847+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:42:34.010 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1c is not active+clean 2023-10-08T15:42:34.011 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:28.254937+0000', 'last_change': '2023-10-08T15:42:28.271991+0000', 'last_active': '2023-10-08T15:42:28.254937+0000', 'last_peered': '2023-10-08T15:42:28.254937+0000', 'last_clean': '2023-10-08T15:42:28.254937+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:28.254937+0000', 'last_undegraded': '2023-10-08T15:42:28.254937+0000', 'last_fullsized': '2023-10-08T15:42:28.254937+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T18:13:36.080229+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T15:42:34.011 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1a is not active+clean 2023-10-08T15:42:34.011 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:42:29.258847+0000', 'last_change': '2023-10-08T15:42:29.258847+0000', 'last_active': '2023-10-08T15:42:29.258847+0000', 'last_peered': '2023-10-08T15:42:29.258847+0000', 'last_clean': '2023-10-08T15:42:29.258847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:29.258847+0000', 'last_undegraded': '2023-10-08T15:42:29.258847+0000', 'last_fullsized': '2023-10-08T15:42:29.258847+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:42:34.011 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.18 is not active+clean 2023-10-08T15:42:34.011 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:42:29.258847+0000', 'last_change': '2023-10-08T15:42:29.258847+0000', 'last_active': '2023-10-08T15:42:29.258847+0000', 'last_peered': '2023-10-08T15:42:29.258847+0000', 'last_clean': '2023-10-08T15:42:29.258847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:29.258847+0000', 'last_undegraded': '2023-10-08T15:42:29.258847+0000', 'last_fullsized': '2023-10-08T15:42:29.258847+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:42:34.011 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.19 is not active+clean 2023-10-08T15:42:34.011 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:28.254937+0000', 'last_change': '2023-10-08T15:42:28.274727+0000', 'last_active': '2023-10-08T15:42:28.254937+0000', 'last_peered': '2023-10-08T15:42:28.254937+0000', 'last_clean': '2023-10-08T15:42:28.254937+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:28.254937+0000', 'last_undegraded': '2023-10-08T15:42:28.254937+0000', 'last_fullsized': '2023-10-08T15:42:28.254937+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T17:38:52.335948+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T15:42:34.011 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.19 is not active+clean 2023-10-08T15:42:34.011 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:42:29.258847+0000', 'last_change': '2023-10-08T15:42:29.258847+0000', 'last_active': '2023-10-08T15:42:29.258847+0000', 'last_peered': '2023-10-08T15:42:29.258847+0000', 'last_clean': '2023-10-08T15:42:29.258847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:29.258847+0000', 'last_undegraded': '2023-10-08T15:42:29.258847+0000', 'last_fullsized': '2023-10-08T15:42:29.258847+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:42:34.012 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.18 is not active+clean 2023-10-08T15:42:34.012 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:28.254937+0000', 'last_change': '2023-10-08T15:42:28.270553+0000', 'last_active': '2023-10-08T15:42:28.254937+0000', 'last_peered': '2023-10-08T15:42:28.254937+0000', 'last_clean': '2023-10-08T15:42:28.254937+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:28.254937+0000', 'last_undegraded': '2023-10-08T15:42:28.254937+0000', 'last_fullsized': '2023-10-08T15:42:28.254937+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T19:24:55.362713+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T15:42:34.012 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.16 is not active+clean 2023-10-08T15:42:34.012 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:42:29.258847+0000', 'last_change': '2023-10-08T15:42:29.258847+0000', 'last_active': '2023-10-08T15:42:29.258847+0000', 'last_peered': '2023-10-08T15:42:29.258847+0000', 'last_clean': '2023-10-08T15:42:29.258847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:29.258847+0000', 'last_undegraded': '2023-10-08T15:42:29.258847+0000', 'last_fullsized': '2023-10-08T15:42:29.258847+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:42:34.012 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.17 is not active+clean 2023-10-08T15:42:34.012 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:28.254937+0000', 'last_change': '2023-10-08T15:42:28.273239+0000', 'last_active': '2023-10-08T15:42:28.254937+0000', 'last_peered': '2023-10-08T15:42:28.254937+0000', 'last_clean': '2023-10-08T15:42:28.254937+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:28.254937+0000', 'last_undegraded': '2023-10-08T15:42:28.254937+0000', 'last_fullsized': '2023-10-08T15:42:28.254937+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T17:06:40.888869+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T15:42:34.012 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.16 is not active+clean 2023-10-08T15:42:34.012 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:28.254937+0000', 'last_change': '2023-10-08T15:42:28.272483+0000', 'last_active': '2023-10-08T15:42:28.254937+0000', 'last_peered': '2023-10-08T15:42:28.254937+0000', 'last_clean': '2023-10-08T15:42:28.254937+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:28.254937+0000', 'last_undegraded': '2023-10-08T15:42:28.254937+0000', 'last_fullsized': '2023-10-08T15:42:28.254937+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T22:09:24.762917+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T15:42:34.012 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.14 is not active+clean 2023-10-08T15:42:34.012 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:42:29.258847+0000', 'last_change': '2023-10-08T15:42:29.258847+0000', 'last_active': '2023-10-08T15:42:29.258847+0000', 'last_peered': '2023-10-08T15:42:29.258847+0000', 'last_clean': '2023-10-08T15:42:29.258847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:29.258847+0000', 'last_undegraded': '2023-10-08T15:42:29.258847+0000', 'last_fullsized': '2023-10-08T15:42:29.258847+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:42:34.013 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.15 is not active+clean 2023-10-08T15:42:34.013 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:28.254937+0000', 'last_change': '2023-10-08T15:42:28.274079+0000', 'last_active': '2023-10-08T15:42:28.254937+0000', 'last_peered': '2023-10-08T15:42:28.254937+0000', 'last_clean': '2023-10-08T15:42:28.254937+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:28.254937+0000', 'last_undegraded': '2023-10-08T15:42:28.254937+0000', 'last_fullsized': '2023-10-08T15:42:28.254937+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T00:18:15.067702+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T15:42:34.013 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.12 is not active+clean 2023-10-08T15:42:34.013 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:42:29.258847+0000', 'last_change': '2023-10-08T15:42:29.258847+0000', 'last_active': '2023-10-08T15:42:29.258847+0000', 'last_peered': '2023-10-08T15:42:29.258847+0000', 'last_clean': '2023-10-08T15:42:29.258847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:29.258847+0000', 'last_undegraded': '2023-10-08T15:42:29.258847+0000', 'last_fullsized': '2023-10-08T15:42:29.258847+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:42:34.013 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.13 is not active+clean 2023-10-08T15:42:34.013 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:28.254937+0000', 'last_change': '2023-10-08T15:42:28.272281+0000', 'last_active': '2023-10-08T15:42:28.254937+0000', 'last_peered': '2023-10-08T15:42:28.254937+0000', 'last_clean': '2023-10-08T15:42:28.254937+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:28.254937+0000', 'last_undegraded': '2023-10-08T15:42:28.254937+0000', 'last_fullsized': '2023-10-08T15:42:28.254937+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T15:54:24.309030+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T15:42:34.013 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.13 is not active+clean 2023-10-08T15:42:34.013 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:42:29.258847+0000', 'last_change': '2023-10-08T15:42:29.258847+0000', 'last_active': '2023-10-08T15:42:29.258847+0000', 'last_peered': '2023-10-08T15:42:29.258847+0000', 'last_clean': '2023-10-08T15:42:29.258847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:29.258847+0000', 'last_undegraded': '2023-10-08T15:42:29.258847+0000', 'last_fullsized': '2023-10-08T15:42:29.258847+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:42:34.013 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.12 is not active+clean 2023-10-08T15:42:34.014 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:28.254937+0000', 'last_change': '2023-10-08T15:42:28.270713+0000', 'last_active': '2023-10-08T15:42:28.254937+0000', 'last_peered': '2023-10-08T15:42:28.254937+0000', 'last_clean': '2023-10-08T15:42:28.254937+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:28.254937+0000', 'last_undegraded': '2023-10-08T15:42:28.254937+0000', 'last_fullsized': '2023-10-08T15:42:28.254937+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T22:48:23.733193+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T15:42:34.014 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.10 is not active+clean 2023-10-08T15:42:34.014 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:42:29.258847+0000', 'last_change': '2023-10-08T15:42:29.258847+0000', 'last_active': '2023-10-08T15:42:29.258847+0000', 'last_peered': '2023-10-08T15:42:29.258847+0000', 'last_clean': '2023-10-08T15:42:29.258847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:29.258847+0000', 'last_undegraded': '2023-10-08T15:42:29.258847+0000', 'last_fullsized': '2023-10-08T15:42:29.258847+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:42:34.014 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.11 is not active+clean 2023-10-08T15:42:34.014 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:42:29.258847+0000', 'last_change': '2023-10-08T15:42:29.258847+0000', 'last_active': '2023-10-08T15:42:29.258847+0000', 'last_peered': '2023-10-08T15:42:29.258847+0000', 'last_clean': '2023-10-08T15:42:29.258847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:29.258847+0000', 'last_undegraded': '2023-10-08T15:42:29.258847+0000', 'last_fullsized': '2023-10-08T15:42:29.258847+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:42:34.014 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.10 is not active+clean 2023-10-08T15:42:34.014 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:28.254937+0000', 'last_change': '2023-10-08T15:42:28.271533+0000', 'last_active': '2023-10-08T15:42:28.254937+0000', 'last_peered': '2023-10-08T15:42:28.254937+0000', 'last_clean': '2023-10-08T15:42:28.254937+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:28.254937+0000', 'last_undegraded': '2023-10-08T15:42:28.254937+0000', 'last_fullsized': '2023-10-08T15:42:28.254937+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T22:49:41.274172+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T15:42:34.014 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.e is not active+clean 2023-10-08T15:42:34.014 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:42:29.258847+0000', 'last_change': '2023-10-08T15:42:29.258847+0000', 'last_active': '2023-10-08T15:42:29.258847+0000', 'last_peered': '2023-10-08T15:42:29.258847+0000', 'last_clean': '2023-10-08T15:42:29.258847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:29.258847+0000', 'last_undegraded': '2023-10-08T15:42:29.258847+0000', 'last_fullsized': '2023-10-08T15:42:29.258847+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:42:34.015 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.f is not active+clean 2023-10-08T15:42:34.015 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:28.254937+0000', 'last_change': '2023-10-08T15:42:28.272372+0000', 'last_active': '2023-10-08T15:42:28.254937+0000', 'last_peered': '2023-10-08T15:42:28.254937+0000', 'last_clean': '2023-10-08T15:42:28.254937+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:28.254937+0000', 'last_undegraded': '2023-10-08T15:42:28.254937+0000', 'last_fullsized': '2023-10-08T15:42:28.254937+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T21:45:28.837814+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T15:42:34.015 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.f is not active+clean 2023-10-08T15:42:34.015 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:42:29.258847+0000', 'last_change': '2023-10-08T15:42:29.258847+0000', 'last_active': '2023-10-08T15:42:29.258847+0000', 'last_peered': '2023-10-08T15:42:29.258847+0000', 'last_clean': '2023-10-08T15:42:29.258847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:29.258847+0000', 'last_undegraded': '2023-10-08T15:42:29.258847+0000', 'last_fullsized': '2023-10-08T15:42:29.258847+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:42:34.015 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.e is not active+clean 2023-10-08T15:42:34.015 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:28.254937+0000', 'last_change': '2023-10-08T15:42:28.272303+0000', 'last_active': '2023-10-08T15:42:28.254937+0000', 'last_peered': '2023-10-08T15:42:28.254937+0000', 'last_clean': '2023-10-08T15:42:28.254937+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:28.254937+0000', 'last_undegraded': '2023-10-08T15:42:28.254937+0000', 'last_fullsized': '2023-10-08T15:42:28.254937+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T23:47:39.065529+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T15:42:34.015 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.c is not active+clean 2023-10-08T15:42:34.015 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:28.254937+0000', 'last_change': '2023-10-08T15:42:28.271204+0000', 'last_active': '2023-10-08T15:42:28.254937+0000', 'last_peered': '2023-10-08T15:42:28.254937+0000', 'last_clean': '2023-10-08T15:42:28.254937+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:28.254937+0000', 'last_undegraded': '2023-10-08T15:42:28.254937+0000', 'last_fullsized': '2023-10-08T15:42:28.254937+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T03:10:34.911060+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T15:42:34.015 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.a is not active+clean 2023-10-08T15:42:34.016 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:42:29.258847+0000', 'last_change': '2023-10-08T15:42:29.258847+0000', 'last_active': '2023-10-08T15:42:29.258847+0000', 'last_peered': '2023-10-08T15:42:29.258847+0000', 'last_clean': '2023-10-08T15:42:29.258847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:29.258847+0000', 'last_undegraded': '2023-10-08T15:42:29.258847+0000', 'last_fullsized': '2023-10-08T15:42:29.258847+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:42:34.016 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.b is not active+clean 2023-10-08T15:42:34.016 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:28.254937+0000', 'last_change': '2023-10-08T15:42:28.273187+0000', 'last_active': '2023-10-08T15:42:28.254937+0000', 'last_peered': '2023-10-08T15:42:28.254937+0000', 'last_clean': '2023-10-08T15:42:28.254937+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:28.254937+0000', 'last_undegraded': '2023-10-08T15:42:28.254937+0000', 'last_fullsized': '2023-10-08T15:42:28.254937+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T00:27:26.579698+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T15:42:34.016 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.a is not active+clean 2023-10-08T15:42:34.016 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:28.254937+0000', 'last_change': '2023-10-08T15:42:28.266182+0000', 'last_active': '2023-10-08T15:42:28.254937+0000', 'last_peered': '2023-10-08T15:42:28.254937+0000', 'last_clean': '2023-10-08T15:42:28.254937+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:28.254937+0000', 'last_undegraded': '2023-10-08T15:42:28.254937+0000', 'last_fullsized': '2023-10-08T15:42:28.254937+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T03:41:42.495720+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T15:42:34.016 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.8 is not active+clean 2023-10-08T15:42:34.016 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:42:29.258847+0000', 'last_change': '2023-10-08T15:42:29.258847+0000', 'last_active': '2023-10-08T15:42:29.258847+0000', 'last_peered': '2023-10-08T15:42:29.258847+0000', 'last_clean': '2023-10-08T15:42:29.258847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:29.258847+0000', 'last_undegraded': '2023-10-08T15:42:29.258847+0000', 'last_fullsized': '2023-10-08T15:42:29.258847+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:42:34.016 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.9 is not active+clean 2023-10-08T15:42:34.016 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:28.254937+0000', 'last_change': '2023-10-08T15:42:28.266206+0000', 'last_active': '2023-10-08T15:42:28.254937+0000', 'last_peered': '2023-10-08T15:42:28.254937+0000', 'last_clean': '2023-10-08T15:42:28.254937+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:28.254937+0000', 'last_undegraded': '2023-10-08T15:42:28.254937+0000', 'last_fullsized': '2023-10-08T15:42:28.254937+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T18:39:07.074681+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T15:42:34.017 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.8 is not active+clean 2023-10-08T15:42:34.017 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:28.254937+0000', 'last_change': '2023-10-08T15:42:28.270896+0000', 'last_active': '2023-10-08T15:42:28.254937+0000', 'last_peered': '2023-10-08T15:42:28.254937+0000', 'last_clean': '2023-10-08T15:42:28.254937+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:28.254937+0000', 'last_undegraded': '2023-10-08T15:42:28.254937+0000', 'last_fullsized': '2023-10-08T15:42:28.254937+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T03:41:39.525248+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T15:42:34.017 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.7 is not active+clean 2023-10-08T15:42:34.017 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:28.254937+0000', 'last_change': '2023-10-08T15:42:28.270618+0000', 'last_active': '2023-10-08T15:42:28.254937+0000', 'last_peered': '2023-10-08T15:42:28.254937+0000', 'last_clean': '2023-10-08T15:42:28.254937+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:28.254937+0000', 'last_undegraded': '2023-10-08T15:42:28.254937+0000', 'last_fullsized': '2023-10-08T15:42:28.254937+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T23:26:23.323002+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T15:42:34.017 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.7 is not active+clean 2023-10-08T15:42:34.017 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:42:29.258847+0000', 'last_change': '2023-10-08T15:42:29.258847+0000', 'last_active': '2023-10-08T15:42:29.258847+0000', 'last_peered': '2023-10-08T15:42:29.258847+0000', 'last_clean': '2023-10-08T15:42:29.258847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:29.258847+0000', 'last_undegraded': '2023-10-08T15:42:29.258847+0000', 'last_fullsized': '2023-10-08T15:42:29.258847+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:42:34.017 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.6 is not active+clean 2023-10-08T15:42:34.017 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:28.254937+0000', 'last_change': '2023-10-08T15:42:28.271500+0000', 'last_active': '2023-10-08T15:42:28.254937+0000', 'last_peered': '2023-10-08T15:42:28.254937+0000', 'last_clean': '2023-10-08T15:42:28.254937+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:28.254937+0000', 'last_undegraded': '2023-10-08T15:42:28.254937+0000', 'last_fullsized': '2023-10-08T15:42:28.254937+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T02:22:35.054661+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T15:42:34.017 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.4 is not active+clean 2023-10-08T15:42:34.017 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:42:29.258847+0000', 'last_change': '2023-10-08T15:42:29.258847+0000', 'last_active': '2023-10-08T15:42:29.258847+0000', 'last_peered': '2023-10-08T15:42:29.258847+0000', 'last_clean': '2023-10-08T15:42:29.258847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:29.258847+0000', 'last_undegraded': '2023-10-08T15:42:29.258847+0000', 'last_fullsized': '2023-10-08T15:42:29.258847+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:42:34.018 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.5 is not active+clean 2023-10-08T15:42:34.018 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:28.254937+0000', 'last_change': '2023-10-08T15:42:28.273029+0000', 'last_active': '2023-10-08T15:42:28.254937+0000', 'last_peered': '2023-10-08T15:42:28.254937+0000', 'last_clean': '2023-10-08T15:42:28.254937+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:28.254937+0000', 'last_undegraded': '2023-10-08T15:42:28.254937+0000', 'last_fullsized': '2023-10-08T15:42:28.254937+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T23:37:51.634617+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T15:42:34.018 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.4 is not active+clean 2023-10-08T15:42:34.018 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:28.254937+0000', 'last_change': '2023-10-08T15:42:28.271631+0000', 'last_active': '2023-10-08T15:42:28.254937+0000', 'last_peered': '2023-10-08T15:42:28.254937+0000', 'last_clean': '2023-10-08T15:42:28.254937+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:28.254937+0000', 'last_undegraded': '2023-10-08T15:42:28.254937+0000', 'last_fullsized': '2023-10-08T15:42:28.254937+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T17:57:32.840050+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T15:42:34.018 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3 is not active+clean 2023-10-08T15:42:34.018 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:28.254937+0000', 'last_change': '2023-10-08T15:42:28.270472+0000', 'last_active': '2023-10-08T15:42:28.254937+0000', 'last_peered': '2023-10-08T15:42:28.254937+0000', 'last_clean': '2023-10-08T15:42:28.254937+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:28.254937+0000', 'last_undegraded': '2023-10-08T15:42:28.254937+0000', 'last_fullsized': '2023-10-08T15:42:28.254937+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T18:32:51.033691+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T15:42:34.018 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3 is not active+clean 2023-10-08T15:42:34.018 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:42:29.258847+0000', 'last_change': '2023-10-08T15:42:29.258847+0000', 'last_active': '2023-10-08T15:42:29.258847+0000', 'last_peered': '2023-10-08T15:42:29.258847+0000', 'last_clean': '2023-10-08T15:42:29.258847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:29.258847+0000', 'last_undegraded': '2023-10-08T15:42:29.258847+0000', 'last_fullsized': '2023-10-08T15:42:29.258847+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:42:34.019 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.0 is not active+clean 2023-10-08T15:42:34.019 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:42:29.258847+0000', 'last_change': '2023-10-08T15:42:29.258847+0000', 'last_active': '2023-10-08T15:42:29.258847+0000', 'last_peered': '2023-10-08T15:42:29.258847+0000', 'last_clean': '2023-10-08T15:42:29.258847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:29.258847+0000', 'last_undegraded': '2023-10-08T15:42:29.258847+0000', 'last_fullsized': '2023-10-08T15:42:29.258847+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:42:34.019 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1 is not active+clean 2023-10-08T15:42:34.019 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:28.254937+0000', 'last_change': '2023-10-08T15:42:28.271831+0000', 'last_active': '2023-10-08T15:42:28.254937+0000', 'last_peered': '2023-10-08T15:42:28.254937+0000', 'last_clean': '2023-10-08T15:42:28.254937+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:28.254937+0000', 'last_undegraded': '2023-10-08T15:42:28.254937+0000', 'last_fullsized': '2023-10-08T15:42:28.254937+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T16:49:55.498305+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T15:42:34.019 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1 is not active+clean 2023-10-08T15:42:34.019 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:42:29.258847+0000', 'last_change': '2023-10-08T15:42:29.258847+0000', 'last_active': '2023-10-08T15:42:29.258847+0000', 'last_peered': '2023-10-08T15:42:29.258847+0000', 'last_clean': '2023-10-08T15:42:29.258847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:29.258847+0000', 'last_undegraded': '2023-10-08T15:42:29.258847+0000', 'last_fullsized': '2023-10-08T15:42:29.258847+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:42:34.019 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.c is not active+clean 2023-10-08T15:42:34.019 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T15:42:29.258847+0000', 'last_change': '2023-10-08T15:42:29.258847+0000', 'last_active': '2023-10-08T15:42:29.258847+0000', 'last_peered': '2023-10-08T15:42:29.258847+0000', 'last_clean': '2023-10-08T15:42:29.258847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:29.258847+0000', 'last_undegraded': '2023-10-08T15:42:29.258847+0000', 'last_fullsized': '2023-10-08T15:42:29.258847+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:29.258847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T15:42:34.019 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.d is not active+clean 2023-10-08T15:42:34.020 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:28.254937+0000', 'last_change': '2023-10-08T15:42:28.268588+0000', 'last_active': '2023-10-08T15:42:28.254937+0000', 'last_peered': '2023-10-08T15:42:28.254937+0000', 'last_clean': '2023-10-08T15:42:28.254937+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:28.254937+0000', 'last_undegraded': '2023-10-08T15:42:28.254937+0000', 'last_fullsized': '2023-10-08T15:42:28.254937+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:28.254937+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T15:58:59.888585+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T15:42:34.020 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-08T15:42:34.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.141+0000 7f9fd6814700 1 Processor -- start 2023-10-08T15:42:34.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.141+0000 7f9fd6814700 1 -- start start 2023-10-08T15:42:34.151 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.145+0000 7f9fd6814700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9fd014ac50 0x7f9fd014b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:34.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.145+0000 7f9fd6814700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f9fd006cc40 0x7f9fd014cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:34.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.145+0000 7f9fd6814700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fd014c6b0 con 0x7f9fd006be60 2023-10-08T15:42:34.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.145+0000 7f9fd6814700 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fd014c060 con 0x7f9fd006cc40 2023-10-08T15:42:34.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.145+0000 7f9fd6814700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fd014c340 con 0x7f9fd014ac50 2023-10-08T15:42:34.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.145+0000 7f9fd6013700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f9fd006cc40 0x7f9fd014cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:34.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.145+0000 7f9fd6013700 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f9fd006cc40 0x7f9fd014cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57264/0 (socket says 172.21.15.3:57264) 2023-10-08T15:42:34.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.145+0000 7f9fd6013700 1 -- 172.21.15.3:0/4040041686 learned_addr learned my addr 172.21.15.3:0/4040041686 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:34.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.145+0000 7f9fd5812700 1 --2- 172.21.15.3:0/4040041686 >> v2:172.21.15.50:3300/0 conn(0x7f9fd014ac50 0x7f9fd014b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:34.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.145+0000 7f9fd6013700 1 -- 172.21.15.3:0/4040041686 >> v2:172.21.15.50:3300/0 conn(0x7f9fd014ac50 msgr2=0x7f9fd014b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:34.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.145+0000 7f9fd6013700 1 --2- 172.21.15.3:0/4040041686 >> v2:172.21.15.50:3300/0 conn(0x7f9fd014ac50 0x7f9fd014b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:34.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.145+0000 7f9fd6013700 1 -- 172.21.15.3:0/4040041686 >> v1:172.21.15.50:6789/0 conn(0x7f9fd006be60 legacy=0x7f9fd006c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:34.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.145+0000 7f9fd6013700 1 -- 172.21.15.3:0/4040041686 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd014e860 con 0x7f9fd006cc40 2023-10-08T15:42:34.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.145+0000 7f9fd6013700 1 --2- 172.21.15.3:0/4040041686 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9fd006cc40 0x7f9fd014cc40 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0069ed0 tx=0x7f9fc8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=318846228d48a394 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:34.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.145+0000 7f9fd4810700 1 -- 172.21.15.3:0/4040041686 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc800e070 con 0x7f9fd006cc40 2023-10-08T15:42:34.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.145+0000 7f9fd4810700 1 -- 172.21.15.3:0/4040041686 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fc800ba10 con 0x7f9fd006cc40 2023-10-08T15:42:34.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.145+0000 7f9fd4810700 1 -- 172.21.15.3:0/4040041686 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc80092e0 con 0x7f9fd006cc40 2023-10-08T15:42:34.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.145+0000 7f9fd6814700 1 -- 172.21.15.3:0/4040041686 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9fd006cc40 msgr2=0x7f9fd014cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:34.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.145+0000 7f9fd6814700 1 --2- 172.21.15.3:0/4040041686 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9fd006cc40 0x7f9fd014cc40 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0069ed0 tx=0x7f9fc8009840 comp rx=0 tx=0).stop 2023-10-08T15:42:34.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.145+0000 7f9fd6814700 1 -- 172.21.15.3:0/4040041686 shutdown_connections 2023-10-08T15:42:34.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.145+0000 7f9fd6814700 1 --2- 172.21.15.3:0/4040041686 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9fd006cc40 0x7f9fd014cc40 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:34.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.145+0000 7f9fd6814700 1 --2- 172.21.15.3:0/4040041686 >> v2:172.21.15.50:3300/0 conn(0x7f9fd014ac50 0x7f9fd014b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:34.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.145+0000 7f9fd6814700 1 -- 172.21.15.3:0/4040041686 >> 172.21.15.3:0/4040041686 conn(0x7f9fd00c1df0 msgr2=0x7f9fd00c21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:34.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.145+0000 7f9fd6814700 1 -- 172.21.15.3:0/4040041686 shutdown_connections 2023-10-08T15:42:34.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.145+0000 7f9fd6814700 1 -- 172.21.15.3:0/4040041686 wait complete. 2023-10-08T15:42:34.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.149+0000 7f9fd6814700 1 Processor -- start 2023-10-08T15:42:34.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.149+0000 7f9fd6814700 1 -- start start 2023-10-08T15:42:34.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.149+0000 7f9fd6814700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fd006be60 0x7f9fd00bfe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:34.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.149+0000 7f9fd6814700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9fd006cc40 0x7f9fd0147070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:34.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.149+0000 7f9fd6814700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9fd014ac50 0x7f9fd01475b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:34.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.149+0000 7f9fd6814700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd015a980 con 0x7f9fd014ac50 2023-10-08T15:42:34.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.149+0000 7f9fd6814700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd0147af0 con 0x7f9fd006be60 2023-10-08T15:42:34.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.149+0000 7f9fd6814700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd00c0a90 con 0x7f9fd006cc40 2023-10-08T15:42:34.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.149+0000 7f9fd6013700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9fd014ac50 0x7f9fd01475b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:34.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.149+0000 7f9fd6013700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9fd014ac50 0x7f9fd01475b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57270/0 (socket says 172.21.15.3:57270) 2023-10-08T15:42:34.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.149+0000 7f9fd6013700 1 -- 172.21.15.3:0/1475354707 learned_addr learned my addr 172.21.15.3:0/1475354707 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:34.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.149+0000 7f9fd5011700 1 --2- 172.21.15.3:0/1475354707 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9fd006cc40 0x7f9fd0147070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:34.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.149+0000 7f9fd5812700 1 --2- 172.21.15.3:0/1475354707 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fd006be60 0x7f9fd00bfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:34.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.149+0000 7f9fd6013700 1 -- 172.21.15.3:0/1475354707 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9fd006cc40 msgr2=0x7f9fd0147070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:34.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.149+0000 7f9fd6013700 1 --2- 172.21.15.3:0/1475354707 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9fd006cc40 0x7f9fd0147070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:34.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.149+0000 7f9fd6013700 1 -- 172.21.15.3:0/1475354707 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fd006be60 msgr2=0x7f9fd00bfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:34.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.149+0000 7f9fd6013700 1 --2- 172.21.15.3:0/1475354707 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fd006be60 0x7f9fd00bfe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:34.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.149+0000 7f9fd6013700 1 -- 172.21.15.3:0/1475354707 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc8009ae0 con 0x7f9fd014ac50 2023-10-08T15:42:34.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.149+0000 7f9fd5011700 1 --2- 172.21.15.3:0/1475354707 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9fd006cc40 0x7f9fd0147070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:42:34.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.149+0000 7f9fd6013700 1 --2- 172.21.15.3:0/1475354707 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9fd014ac50 0x7f9fd01475b0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0070be0 tx=0x7f9fc8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:34.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.149+0000 7f9fc5ffb700 1 -- 172.21.15.3:0/1475354707 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc80092e0 con 0x7f9fd014ac50 2023-10-08T15:42:34.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.149+0000 7f9fc5ffb700 1 -- 172.21.15.3:0/1475354707 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fc800be80 con 0x7f9fd014ac50 2023-10-08T15:42:34.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.149+0000 7f9fd6814700 1 -- 172.21.15.3:0/1475354707 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fd00c0360 con 0x7f9fd014ac50 2023-10-08T15:42:34.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.149+0000 7f9fc5ffb700 1 -- 172.21.15.3:0/1475354707 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc801e430 con 0x7f9fd014ac50 2023-10-08T15:42:34.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.149+0000 7f9fd6814700 1 -- 172.21.15.3:0/1475354707 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fd015aba0 con 0x7f9fd014ac50 2023-10-08T15:42:34.163 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.153+0000 7f9fd6814700 1 -- 172.21.15.3:0/1475354707 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fd015e280 con 0x7f9fd014ac50 2023-10-08T15:42:34.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.153+0000 7f9fc5ffb700 1 -- 172.21.15.3:0/1475354707 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f9fc801e820 con 0x7f9fd014ac50 2023-10-08T15:42:34.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.153+0000 7f9fc5ffb700 1 --2- 172.21.15.3:0/1475354707 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f9fb4060550 0x7f9fb4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:34.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.153+0000 7f9fc5ffb700 1 -- 172.21.15.3:0/1475354707 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9fc807e450 con 0x7f9fd014ac50 2023-10-08T15:42:34.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.153+0000 7f9fd5812700 1 --2- 172.21.15.3:0/1475354707 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f9fb4060550 0x7f9fb4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:34.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.153+0000 7f9fd5812700 1 --2- 172.21.15.3:0/1475354707 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f9fb4060550 0x7f9fb4062a00 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc006fd0 tx=0x7f9fcc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:34.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.161+0000 7f9fc5ffb700 1 -- 172.21.15.3:0/1475354707 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9fd015e280 con 0x7f9fd014ac50 2023-10-08T15:42:34.386 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.381+0000 7f9fd6814700 1 -- 172.21.15.3:0/1475354707 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f9fd015e280 con 0x7f9fd014ac50 2023-10-08T15:42:34.387 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.381+0000 7f9fc5ffb700 1 -- 172.21.15.3:0/1475354707 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1175 (secure 0 0 0) 0x7f9fd015e280 con 0x7f9fd014ac50 2023-10-08T15:42:34.387 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:42:34.388 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"7635972e-cd66-4a8f-a231-378db8b3847a","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":326,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":71,"num_osds":8,"num_up_osds":8,"osd_up_since":1696779437,"num_in_osds":8,"osd_in_since":1696779430,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":46},{"state_name":"active+clean","count":26},{"state_name":"creating+peering","count":25}],"num_pgs":97,"num_pools":3,"num_objects":6,"data_bytes":591904,"bytes_used":2530275328,"bytes_avail":770563837952,"bytes_total":773094113280,"unknown_pgs_ratio":0.47422680258750916,"inactive_pgs_ratio":0.25773194432258606,"write_bytes_sec":704,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":39,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":6357}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-10-08T15:39:16.555736+0000","services":{}},"progress_events":{}} 2023-10-08T15:42:34.390 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.385+0000 7f9fd6814700 1 -- 172.21.15.3:0/1475354707 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f9fb4060550 msgr2=0x7f9fb4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:34.390 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.385+0000 7f9fd6814700 1 --2- 172.21.15.3:0/1475354707 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f9fb4060550 0x7f9fb4062a00 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc006fd0 tx=0x7f9fcc008040 comp rx=0 tx=0).stop 2023-10-08T15:42:34.390 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.385+0000 7f9fd6814700 1 -- 172.21.15.3:0/1475354707 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9fd014ac50 msgr2=0x7f9fd01475b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:34.390 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.385+0000 7f9fd6814700 1 --2- 172.21.15.3:0/1475354707 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9fd014ac50 0x7f9fd01475b0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0070be0 tx=0x7f9fc8017000 comp rx=0 tx=0).stop 2023-10-08T15:42:34.390 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.385+0000 7f9fd6814700 1 -- 172.21.15.3:0/1475354707 shutdown_connections 2023-10-08T15:42:34.391 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.385+0000 7f9fd6814700 1 --2- 172.21.15.3:0/1475354707 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f9fb4060550 0x7f9fb4062a00 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:34.391 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.385+0000 7f9fd6814700 1 --2- 172.21.15.3:0/1475354707 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9fd014ac50 0x7f9fd01475b0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:34.391 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.385+0000 7f9fd6814700 1 --2- 172.21.15.3:0/1475354707 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9fd006cc40 0x7f9fd0147070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:34.391 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.385+0000 7f9fd6814700 1 --2- 172.21.15.3:0/1475354707 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fd006be60 0x7f9fd00bfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:34.391 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.385+0000 7f9fd6814700 1 -- 172.21.15.3:0/1475354707 >> 172.21.15.3:0/1475354707 conn(0x7f9fd00c1df0 msgr2=0x7f9fd0149520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:34.391 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.385+0000 7f9fd6814700 1 -- 172.21.15.3:0/1475354707 shutdown_connections 2023-10-08T15:42:34.391 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.385+0000 7f9fd6814700 1 -- 172.21.15.3:0/1475354707 wait complete. 2023-10-08T15:42:34.402 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-08T15:42:34.402 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T15:42:34.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.501+0000 7f85a54aa700 1 Processor -- start 2023-10-08T15:42:34.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.501+0000 7f85a54aa700 1 -- start start 2023-10-08T15:42:34.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.501+0000 7f85a54aa700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f85a0067310 0x7f85a006de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:34.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.501+0000 7f85a54aa700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f85a00676e0 0x7f85a0147700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:34.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.501+0000 7f85a54aa700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85a00bbf60 con 0x7f85a0067b30 2023-10-08T15:42:34.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.501+0000 7f85a54aa700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85a014c390 con 0x7f85a0067310 2023-10-08T15:42:34.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.501+0000 7f85a54aa700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85a01497e0 con 0x7f85a00676e0 2023-10-08T15:42:34.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.501+0000 7f859e7fc700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f85a00676e0 0x7f85a0147700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:34.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.501+0000 7f859effd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f85a0067310 0x7f85a006de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:34.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.501+0000 7f859e7fc700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f85a00676e0 0x7f85a0147700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.3:52136/0 (socket says 172.21.15.3:52136) 2023-10-08T15:42:34.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.501+0000 7f859e7fc700 1 -- 172.21.15.3:0/4279963785 learned_addr learned my addr 172.21.15.3:0/4279963785 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:34.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.501+0000 7f859effd700 1 -- 172.21.15.3:0/4279963785 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f85a00676e0 msgr2=0x7f85a0147700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:34.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.501+0000 7f859effd700 1 --2- 172.21.15.3:0/4279963785 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f85a00676e0 0x7f85a0147700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:34.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.501+0000 7f859effd700 1 -- 172.21.15.3:0/4279963785 >> v1:172.21.15.50:6789/0 conn(0x7f85a0067b30 legacy=0x7f85a0147c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:34.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.501+0000 7f859effd700 1 -- 172.21.15.3:0/4279963785 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a014c630 con 0x7f85a0067310 2023-10-08T15:42:34.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.501+0000 7f859e7fc700 1 --2- 172.21.15.3:0/4279963785 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f85a00676e0 0x7f85a0147700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:42:34.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.501+0000 7f859effd700 1 --2- 172.21.15.3:0/4279963785 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85a0067310 0x7f85a006de30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f85940098e0 tx=0x7f85940091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c17a34bf766df80 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:34.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.501+0000 7f859dffb700 1 -- 172.21.15.3:0/4279963785 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859400b640 con 0x7f85a0067310 2023-10-08T15:42:34.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.501+0000 7f859dffb700 1 -- 172.21.15.3:0/4279963785 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f859400b7a0 con 0x7f85a0067310 2023-10-08T15:42:34.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.501+0000 7f859dffb700 1 -- 172.21.15.3:0/4279963785 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859400bb40 con 0x7f85a0067310 2023-10-08T15:42:34.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.501+0000 7f85a54aa700 1 -- 172.21.15.3:0/4279963785 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85a0067310 msgr2=0x7f85a006de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:34.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.501+0000 7f85a54aa700 1 --2- 172.21.15.3:0/4279963785 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85a0067310 0x7f85a006de30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f85940098e0 tx=0x7f85940091a0 comp rx=0 tx=0).stop 2023-10-08T15:42:34.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.505+0000 7f85a54aa700 1 -- 172.21.15.3:0/4279963785 shutdown_connections 2023-10-08T15:42:34.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.505+0000 7f85a54aa700 1 --2- 172.21.15.3:0/4279963785 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f85a00676e0 0x7f85a0147700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:34.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.505+0000 7f85a54aa700 1 --2- 172.21.15.3:0/4279963785 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85a0067310 0x7f85a006de30 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:34.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.505+0000 7f85a54aa700 1 -- 172.21.15.3:0/4279963785 >> 172.21.15.3:0/4279963785 conn(0x7f85a0068720 msgr2=0x7f85a0068b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:34.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.505+0000 7f85a54aa700 1 -- 172.21.15.3:0/4279963785 shutdown_connections 2023-10-08T15:42:34.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.505+0000 7f85a54aa700 1 -- 172.21.15.3:0/4279963785 wait complete. 2023-10-08T15:42:34.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.505+0000 7f85a54aa700 1 Processor -- start 2023-10-08T15:42:34.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.505+0000 7f85a54aa700 1 -- start start 2023-10-08T15:42:34.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.509+0000 7f85a54aa700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85a0067310 0x7f85a00bcb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:34.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.509+0000 7f85a54aa700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f85a00676e0 0x7f85a014acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:34.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.509+0000 7f85a54aa700 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f85a0067b30 0x7f85a015c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:34.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.509+0000 7f85a54aa700 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a00bd0a0 con 0x7f85a00676e0 2023-10-08T15:42:34.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.509+0000 7f85a54aa700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a014b210 con 0x7f85a0067310 2023-10-08T15:42:34.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.509+0000 7f85a54aa700 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85a00bdc60 con 0x7f85a0067b30 2023-10-08T15:42:34.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.509+0000 7f859e7fc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f85a00676e0 0x7f85a014acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:34.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.509+0000 7f859e7fc700 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f85a00676e0 0x7f85a014acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57286/0 (socket says 172.21.15.3:57286) 2023-10-08T15:42:34.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.509+0000 7f859e7fc700 1 -- 172.21.15.3:0/937033826 learned_addr learned my addr 172.21.15.3:0/937033826 (peer_addr_for_me v2:172.21.15.3:0/0) 2023-10-08T15:42:34.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.509+0000 7f859effd700 1 --2- 172.21.15.3:0/937033826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85a0067310 0x7f85a00bcb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:34.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.509+0000 7f859f7fe700 1 --2- 172.21.15.3:0/937033826 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f85a0067b30 0x7f85a015c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:34.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.509+0000 7f859e7fc700 1 -- 172.21.15.3:0/937033826 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f85a0067b30 msgr2=0x7f85a015c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:34.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.509+0000 7f859e7fc700 1 --2- 172.21.15.3:0/937033826 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f85a0067b30 0x7f85a015c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:34.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.509+0000 7f859e7fc700 1 -- 172.21.15.3:0/937033826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85a0067310 msgr2=0x7f85a00bcb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:34.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.509+0000 7f859e7fc700 1 --2- 172.21.15.3:0/937033826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85a0067310 0x7f85a00bcb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:34.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.509+0000 7f859e7fc700 1 -- 172.21.15.3:0/937033826 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8598009ae0 con 0x7f85a00676e0 2023-10-08T15:42:34.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.509+0000 7f859e7fc700 1 --2- 172.21.15.3:0/937033826 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f85a00676e0 0x7f85a014acd0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f859800c170 tx=0x7f859800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:34.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.509+0000 7f8586ffd700 1 -- 172.21.15.3:0/937033826 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859800caa0 con 0x7f85a00676e0 2023-10-08T15:42:34.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.509+0000 7f8586ffd700 1 -- 172.21.15.3:0/937033826 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f859800f040 con 0x7f85a00676e0 2023-10-08T15:42:34.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.509+0000 7f85a54aa700 1 -- 172.21.15.3:0/937033826 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8594009420 con 0x7f85a00676e0 2023-10-08T15:42:34.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.509+0000 7f8586ffd700 1 -- 172.21.15.3:0/937033826 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859800ce30 con 0x7f85a00676e0 2023-10-08T15:42:34.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.509+0000 7f85a54aa700 1 -- 172.21.15.3:0/937033826 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85a00be220 con 0x7f85a00676e0 2023-10-08T15:42:34.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.509+0000 7f85a54aa700 1 -- 172.21.15.3:0/937033826 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85a0064530 con 0x7f85a00676e0 2023-10-08T15:42:34.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.513+0000 7f8586ffd700 1 -- 172.21.15.3:0/937033826 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f8598014690 con 0x7f85a00676e0 2023-10-08T15:42:34.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.513+0000 7f8586ffd700 1 --2- 172.21.15.3:0/937033826 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f858c060550 0x7f858c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:34.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.513+0000 7f8586ffd700 1 -- 172.21.15.3:0/937033826 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f859807ce50 con 0x7f85a00676e0 2023-10-08T15:42:34.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.513+0000 7f859effd700 1 --2- 172.21.15.3:0/937033826 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f858c060550 0x7f858c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:34.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.513+0000 7f859effd700 1 --2- 172.21.15.3:0/937033826 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f858c060550 0x7f858c062a00 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f85940093f0 tx=0x7f8594017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:34.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.521+0000 7f8586ffd700 1 -- 172.21.15.3:0/937033826 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f859804d440 con 0x7f85a00676e0 2023-10-08T15:42:34.687 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.681+0000 7f85a54aa700 1 -- 172.21.15.3:0/937033826 --> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f85a004b600 con 0x7f858c060550 2023-10-08T15:42:34.705 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.697+0000 7f8586ffd700 1 -- 172.21.15.3:0/937033826 <== mgr.4102 v2:172.21.15.50:6832/33268 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286930 (secure 0 0 0) 0x7f85a004b600 con 0x7f858c060550 2023-10-08T15:42:34.709 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-08T15:42:34.712 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.705+0000 7f85a54aa700 1 -- 172.21.15.3:0/937033826 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f858c060550 msgr2=0x7f858c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:34.712 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.705+0000 7f85a54aa700 1 --2- 172.21.15.3:0/937033826 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f858c060550 0x7f858c062a00 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f85940093f0 tx=0x7f8594017000 comp rx=0 tx=0).stop 2023-10-08T15:42:34.712 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.705+0000 7f85a54aa700 1 -- 172.21.15.3:0/937033826 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f85a00676e0 msgr2=0x7f85a014acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:34.712 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.705+0000 7f85a54aa700 1 --2- 172.21.15.3:0/937033826 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f85a00676e0 0x7f85a014acd0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f859800c170 tx=0x7f859800b040 comp rx=0 tx=0).stop 2023-10-08T15:42:34.712 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.705+0000 7f85a54aa700 1 -- 172.21.15.3:0/937033826 shutdown_connections 2023-10-08T15:42:34.712 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.705+0000 7f85a54aa700 1 --2- 172.21.15.3:0/937033826 >> [v2:172.21.15.50:6832/33268,v1:172.21.15.50:6833/33268] conn(0x7f858c060550 0x7f858c062a00 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:34.712 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.705+0000 7f85a54aa700 1 --2- 172.21.15.3:0/937033826 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f85a0067b30 0x7f85a015c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:34.712 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.705+0000 7f85a54aa700 1 --2- 172.21.15.3:0/937033826 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f85a00676e0 0x7f85a014acd0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:34.713 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.705+0000 7f85a54aa700 1 --2- 172.21.15.3:0/937033826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85a0067310 0x7f85a00bcb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:34.713 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.705+0000 7f85a54aa700 1 -- 172.21.15.3:0/937033826 >> 172.21.15.3:0/937033826 conn(0x7f85a0068720 msgr2=0x7f85a0144970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:34.713 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.705+0000 7f85a54aa700 1 -- 172.21.15.3:0/937033826 shutdown_connections 2023-10-08T15:42:34.713 INFO:teuthology.orchestra.run.smithi003.stderr:2023-10-08T15:42:34.705+0000 7f85a54aa700 1 -- 172.21.15.3:0/937033826 wait complete. 2023-10-08T15:42:34.713 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2023-10-08T15:42:34.724 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":223,"stamp":"2023-10-08T15:42:34.624491+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":173,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2471284,"kb_used_data":6964,"kb_used_omap":0,"kb_used_meta":2464256,"kb_avail":752503436,"statfs":{"total":773094113280,"available":770563518464,"internally_reserved":0,"allocated":7131136,"data_stored":4116180,"data_compressed":66282,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":2523398144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001968"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.346964+0000","last_change":"2023-10-08T15:42:30.343633+0000","last_active":"2023-10-08T15:42:30.346964+0000","last_peered":"2023-10-08T15:42:30.346964+0000","last_clean":"2023-10-08T15:42:30.346964+0000","last_became_active":"2023-10-08T15:42:30.343302+0000","last_became_peered":"2023-10-08T15:42:30.343302+0000","last_unstale":"2023-10-08T15:42:30.346964+0000","last_undegraded":"2023-10-08T15:42:30.346964+0000","last_fullsized":"2023-10-08T15:42:30.346964+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:03:56.495105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.344875+0000","last_change":"2023-10-08T15:42:30.342073+0000","last_active":"2023-10-08T15:42:30.344875+0000","last_peered":"2023-10-08T15:42:30.344875+0000","last_clean":"2023-10-08T15:42:30.344875+0000","last_became_active":"2023-10-08T15:42:30.341735+0000","last_became_peered":"2023-10-08T15:42:30.341735+0000","last_unstale":"2023-10-08T15:42:30.344875+0000","last_undegraded":"2023-10-08T15:42:30.344875+0000","last_fullsized":"2023-10-08T15:42:30.344875+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:13:33.192421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.342199+0000","last_change":"2023-10-08T15:42:30.336617+0000","last_active":"2023-10-08T15:42:30.342199+0000","last_peered":"2023-10-08T15:42:30.342199+0000","last_clean":"2023-10-08T15:42:30.342199+0000","last_became_active":"2023-10-08T15:42:30.336213+0000","last_became_peered":"2023-10-08T15:42:30.336213+0000","last_unstale":"2023-10-08T15:42:30.342199+0000","last_undegraded":"2023-10-08T15:42:30.342199+0000","last_fullsized":"2023-10-08T15:42:30.342199+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:51:04.848284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.351720+0000","last_change":"2023-10-08T15:42:30.344822+0000","last_active":"2023-10-08T15:42:30.351720+0000","last_peered":"2023-10-08T15:42:30.351720+0000","last_clean":"2023-10-08T15:42:30.351720+0000","last_became_active":"2023-10-08T15:42:30.344503+0000","last_became_peered":"2023-10-08T15:42:30.344503+0000","last_unstale":"2023-10-08T15:42:30.351720+0000","last_undegraded":"2023-10-08T15:42:30.351720+0000","last_fullsized":"2023-10-08T15:42:30.351720+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:18:24.326333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.338290+0000","last_change":"2023-10-08T15:42:30.333246+0000","last_active":"2023-10-08T15:42:30.338290+0000","last_peered":"2023-10-08T15:42:30.338290+0000","last_clean":"2023-10-08T15:42:30.338290+0000","last_became_active":"2023-10-08T15:42:30.332961+0000","last_became_peered":"2023-10-08T15:42:30.332961+0000","last_unstale":"2023-10-08T15:42:30.338290+0000","last_undegraded":"2023-10-08T15:42:30.338290+0000","last_fullsized":"2023-10-08T15:42:30.338290+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:37:47.231005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.352621+0000","last_change":"2023-10-08T15:42:30.352621+0000","last_active":"2023-10-08T15:42:30.352621+0000","last_peered":"2023-10-08T15:42:30.352621+0000","last_clean":"2023-10-08T15:42:30.352621+0000","last_became_active":"2023-10-08T15:42:30.352272+0000","last_became_peered":"2023-10-08T15:42:30.352272+0000","last_unstale":"2023-10-08T15:42:30.352621+0000","last_undegraded":"2023-10-08T15:42:30.352621+0000","last_fullsized":"2023-10-08T15:42:30.352621+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:03:06.159027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.352637+0000","last_change":"2023-10-08T15:42:30.350393+0000","last_active":"2023-10-08T15:42:30.352637+0000","last_peered":"2023-10-08T15:42:30.352637+0000","last_clean":"2023-10-08T15:42:30.352637+0000","last_became_active":"2023-10-08T15:42:30.349971+0000","last_became_peered":"2023-10-08T15:42:30.349971+0000","last_unstale":"2023-10-08T15:42:30.352637+0000","last_undegraded":"2023-10-08T15:42:30.352637+0000","last_fullsized":"2023-10-08T15:42:30.352637+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:25:35.539662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.331850+0000","last_change":"2023-10-08T15:42:30.331850+0000","last_active":"2023-10-08T15:42:30.331850+0000","last_peered":"2023-10-08T15:42:30.331850+0000","last_clean":"2023-10-08T15:42:30.331850+0000","last_became_active":"2023-10-08T15:42:30.331530+0000","last_became_peered":"2023-10-08T15:42:30.331530+0000","last_unstale":"2023-10-08T15:42:30.331850+0000","last_undegraded":"2023-10-08T15:42:30.331850+0000","last_fullsized":"2023-10-08T15:42:30.331850+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:56.410736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.351375+0000","last_change":"2023-10-08T15:42:30.351375+0000","last_active":"2023-10-08T15:42:30.351375+0000","last_peered":"2023-10-08T15:42:30.351375+0000","last_clean":"2023-10-08T15:42:30.351375+0000","last_became_active":"2023-10-08T15:42:30.351044+0000","last_became_peered":"2023-10-08T15:42:30.351044+0000","last_unstale":"2023-10-08T15:42:30.351375+0000","last_undegraded":"2023-10-08T15:42:30.351375+0000","last_fullsized":"2023-10-08T15:42:30.351375+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:13:37.084139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.344314+0000","last_change":"2023-10-08T15:42:30.336355+0000","last_active":"2023-10-08T15:42:30.344314+0000","last_peered":"2023-10-08T15:42:30.344314+0000","last_clean":"2023-10-08T15:42:30.344314+0000","last_became_active":"2023-10-08T15:42:30.336057+0000","last_became_peered":"2023-10-08T15:42:30.336057+0000","last_unstale":"2023-10-08T15:42:30.344314+0000","last_undegraded":"2023-10-08T15:42:30.344314+0000","last_fullsized":"2023-10-08T15:42:30.344314+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:59:00.892495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.341137+0000","last_change":"2023-10-08T15:42:30.335109+0000","last_active":"2023-10-08T15:42:30.341137+0000","last_peered":"2023-10-08T15:42:30.341137+0000","last_clean":"2023-10-08T15:42:30.341137+0000","last_became_active":"2023-10-08T15:42:30.333756+0000","last_became_peered":"2023-10-08T15:42:30.333756+0000","last_unstale":"2023-10-08T15:42:30.341137+0000","last_undegraded":"2023-10-08T15:42:30.341137+0000","last_fullsized":"2023-10-08T15:42:30.341137+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:24:48.428646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.347833+0000","last_change":"2023-10-08T15:42:30.342732+0000","last_active":"2023-10-08T15:42:30.347833+0000","last_peered":"2023-10-08T15:42:30.347833+0000","last_clean":"2023-10-08T15:42:30.347833+0000","last_became_active":"2023-10-08T15:42:30.342340+0000","last_became_peered":"2023-10-08T15:42:30.342340+0000","last_unstale":"2023-10-08T15:42:30.347833+0000","last_undegraded":"2023-10-08T15:42:30.347833+0000","last_fullsized":"2023-10-08T15:42:30.347833+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:03:39.751942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.342153+0000","last_change":"2023-10-08T15:42:30.335893+0000","last_active":"2023-10-08T15:42:30.342153+0000","last_peered":"2023-10-08T15:42:30.342153+0000","last_clean":"2023-10-08T15:42:30.342153+0000","last_became_active":"2023-10-08T15:42:30.335535+0000","last_became_peered":"2023-10-08T15:42:30.335535+0000","last_unstale":"2023-10-08T15:42:30.342153+0000","last_undegraded":"2023-10-08T15:42:30.342153+0000","last_fullsized":"2023-10-08T15:42:30.342153+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:44:58.137967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.352706+0000","last_change":"2023-10-08T15:42:30.351080+0000","last_active":"2023-10-08T15:42:30.352706+0000","last_peered":"2023-10-08T15:42:30.352706+0000","last_clean":"2023-10-08T15:42:30.352706+0000","last_became_active":"2023-10-08T15:42:30.350660+0000","last_became_peered":"2023-10-08T15:42:30.350660+0000","last_unstale":"2023-10-08T15:42:30.352706+0000","last_undegraded":"2023-10-08T15:42:30.352706+0000","last_fullsized":"2023-10-08T15:42:30.352706+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:48.124754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.338531+0000","last_change":"2023-10-08T15:42:30.336113+0000","last_active":"2023-10-08T15:42:30.338531+0000","last_peered":"2023-10-08T15:42:30.338531+0000","last_clean":"2023-10-08T15:42:30.338531+0000","last_became_active":"2023-10-08T15:42:30.334518+0000","last_became_peered":"2023-10-08T15:42:30.334518+0000","last_unstale":"2023-10-08T15:42:30.338531+0000","last_undegraded":"2023-10-08T15:42:30.338531+0000","last_fullsized":"2023-10-08T15:42:30.338531+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:54:13.937795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.341197+0000","last_change":"2023-10-08T15:42:30.336763+0000","last_active":"2023-10-08T15:42:30.341197+0000","last_peered":"2023-10-08T15:42:30.341197+0000","last_clean":"2023-10-08T15:42:30.341197+0000","last_became_active":"2023-10-08T15:42:30.336407+0000","last_became_peered":"2023-10-08T15:42:30.336407+0000","last_unstale":"2023-10-08T15:42:30.341197+0000","last_undegraded":"2023-10-08T15:42:30.341197+0000","last_fullsized":"2023-10-08T15:42:30.341197+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:57:24.891115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.348876+0000","last_change":"2023-10-08T15:42:30.347286+0000","last_active":"2023-10-08T15:42:30.348876+0000","last_peered":"2023-10-08T15:42:30.348876+0000","last_clean":"2023-10-08T15:42:30.348876+0000","last_became_active":"2023-10-08T15:42:30.346996+0000","last_became_peered":"2023-10-08T15:42:30.346996+0000","last_unstale":"2023-10-08T15:42:30.348876+0000","last_undegraded":"2023-10-08T15:42:30.348876+0000","last_fullsized":"2023-10-08T15:42:30.348876+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:16:28.709078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.350537+0000","last_change":"2023-10-08T15:42:30.340526+0000","last_active":"2023-10-08T15:42:30.350537+0000","last_peered":"2023-10-08T15:42:30.350537+0000","last_clean":"2023-10-08T15:42:30.350537+0000","last_became_active":"2023-10-08T15:42:30.340215+0000","last_became_peered":"2023-10-08T15:42:30.340215+0000","last_unstale":"2023-10-08T15:42:30.350537+0000","last_undegraded":"2023-10-08T15:42:30.350537+0000","last_fullsized":"2023-10-08T15:42:30.350537+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:29:55.600960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.359948+0000","last_change":"2023-10-08T15:42:30.352144+0000","last_active":"2023-10-08T15:42:30.359948+0000","last_peered":"2023-10-08T15:42:30.359948+0000","last_clean":"2023-10-08T15:42:30.359948+0000","last_became_active":"2023-10-08T15:42:30.351816+0000","last_became_peered":"2023-10-08T15:42:30.351816+0000","last_unstale":"2023-10-08T15:42:30.359948+0000","last_undegraded":"2023-10-08T15:42:30.359948+0000","last_fullsized":"2023-10-08T15:42:30.359948+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:59:36.731597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.358705+0000","last_change":"2023-10-08T15:42:30.358248+0000","last_active":"2023-10-08T15:42:30.358705+0000","last_peered":"2023-10-08T15:42:30.358705+0000","last_clean":"2023-10-08T15:42:30.358705+0000","last_became_active":"2023-10-08T15:42:30.357892+0000","last_became_peered":"2023-10-08T15:42:30.357892+0000","last_unstale":"2023-10-08T15:42:30.358705+0000","last_undegraded":"2023-10-08T15:42:30.358705+0000","last_fullsized":"2023-10-08T15:42:30.358705+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:31:14.022603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.356713+0000","last_change":"2023-10-08T15:42:30.354829+0000","last_active":"2023-10-08T15:42:30.356713+0000","last_peered":"2023-10-08T15:42:30.356713+0000","last_clean":"2023-10-08T15:42:30.356713+0000","last_became_active":"2023-10-08T15:42:30.354559+0000","last_became_peered":"2023-10-08T15:42:30.354559+0000","last_unstale":"2023-10-08T15:42:30.356713+0000","last_undegraded":"2023-10-08T15:42:30.356713+0000","last_fullsized":"2023-10-08T15:42:30.356713+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:07:42.209827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.349819+0000","last_change":"2023-10-08T15:42:30.348342+0000","last_active":"2023-10-08T15:42:30.349819+0000","last_peered":"2023-10-08T15:42:30.349819+0000","last_clean":"2023-10-08T15:42:30.349819+0000","last_became_active":"2023-10-08T15:42:30.347988+0000","last_became_peered":"2023-10-08T15:42:30.347988+0000","last_unstale":"2023-10-08T15:42:30.349819+0000","last_undegraded":"2023-10-08T15:42:30.349819+0000","last_fullsized":"2023-10-08T15:42:30.349819+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:05:47.304356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.349232+0000","last_change":"2023-10-08T15:42:30.345472+0000","last_active":"2023-10-08T15:42:30.349232+0000","last_peered":"2023-10-08T15:42:30.349232+0000","last_clean":"2023-10-08T15:42:30.349232+0000","last_became_active":"2023-10-08T15:42:30.345163+0000","last_became_peered":"2023-10-08T15:42:30.345163+0000","last_unstale":"2023-10-08T15:42:30.349232+0000","last_undegraded":"2023-10-08T15:42:30.349232+0000","last_fullsized":"2023-10-08T15:42:30.349232+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:47:50.597619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.356781+0000","last_change":"2023-10-08T15:42:30.355030+0000","last_active":"2023-10-08T15:42:30.356781+0000","last_peered":"2023-10-08T15:42:30.356781+0000","last_clean":"2023-10-08T15:42:30.356781+0000","last_became_active":"2023-10-08T15:42:30.354575+0000","last_became_peered":"2023-10-08T15:42:30.354575+0000","last_unstale":"2023-10-08T15:42:30.356781+0000","last_undegraded":"2023-10-08T15:42:30.356781+0000","last_fullsized":"2023-10-08T15:42:30.356781+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:34:27.327083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.341928+0000","last_change":"2023-10-08T15:42:30.339499+0000","last_active":"2023-10-08T15:42:30.341928+0000","last_peered":"2023-10-08T15:42:30.341928+0000","last_clean":"2023-10-08T15:42:30.341928+0000","last_became_active":"2023-10-08T15:42:30.339124+0000","last_became_peered":"2023-10-08T15:42:30.339124+0000","last_unstale":"2023-10-08T15:42:30.341928+0000","last_undegraded":"2023-10-08T15:42:30.341928+0000","last_fullsized":"2023-10-08T15:42:30.341928+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:09.164676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.342180+0000","last_change":"2023-10-08T15:42:30.335259+0000","last_active":"2023-10-08T15:42:30.342180+0000","last_peered":"2023-10-08T15:42:30.342180+0000","last_clean":"2023-10-08T15:42:30.342180+0000","last_became_active":"2023-10-08T15:42:30.334964+0000","last_became_peered":"2023-10-08T15:42:30.334964+0000","last_unstale":"2023-10-08T15:42:30.342180+0000","last_undegraded":"2023-10-08T15:42:30.342180+0000","last_fullsized":"2023-10-08T15:42:30.342180+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:28:29.592455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.335048+0000","last_change":"2023-10-08T15:42:30.328725+0000","last_active":"2023-10-08T15:42:30.335048+0000","last_peered":"2023-10-08T15:42:30.335048+0000","last_clean":"2023-10-08T15:42:30.335048+0000","last_became_active":"2023-10-08T15:42:30.328426+0000","last_became_peered":"2023-10-08T15:42:30.328426+0000","last_unstale":"2023-10-08T15:42:30.335048+0000","last_undegraded":"2023-10-08T15:42:30.335048+0000","last_fullsized":"2023-10-08T15:42:30.335048+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:45:25.945569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.344279+0000","last_change":"2023-10-08T15:42:30.337138+0000","last_active":"2023-10-08T15:42:30.344279+0000","last_peered":"2023-10-08T15:42:30.344279+0000","last_clean":"2023-10-08T15:42:30.344279+0000","last_became_active":"2023-10-08T15:42:30.336682+0000","last_became_peered":"2023-10-08T15:42:30.336682+0000","last_unstale":"2023-10-08T15:42:30.344279+0000","last_undegraded":"2023-10-08T15:42:30.344279+0000","last_fullsized":"2023-10-08T15:42:30.344279+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:01:51.515544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.331846+0000","last_change":"2023-10-08T15:42:30.329237+0000","last_active":"2023-10-08T15:42:30.331846+0000","last_peered":"2023-10-08T15:42:30.331846+0000","last_clean":"2023-10-08T15:42:30.331846+0000","last_became_active":"2023-10-08T15:42:30.328514+0000","last_became_peered":"2023-10-08T15:42:30.328514+0000","last_unstale":"2023-10-08T15:42:30.331846+0000","last_undegraded":"2023-10-08T15:42:30.331846+0000","last_fullsized":"2023-10-08T15:42:30.331846+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:43:14.097210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.354283+0000","last_change":"2023-10-08T15:42:30.352861+0000","last_active":"2023-10-08T15:42:30.354283+0000","last_peered":"2023-10-08T15:42:30.354283+0000","last_clean":"2023-10-08T15:42:30.354283+0000","last_became_active":"2023-10-08T15:42:30.352322+0000","last_became_peered":"2023-10-08T15:42:30.352322+0000","last_unstale":"2023-10-08T15:42:30.354283+0000","last_undegraded":"2023-10-08T15:42:30.354283+0000","last_fullsized":"2023-10-08T15:42:30.354283+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:31:37.404415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.348251+0000","last_change":"2023-10-08T15:42:30.345432+0000","last_active":"2023-10-08T15:42:30.348251+0000","last_peered":"2023-10-08T15:42:30.348251+0000","last_clean":"2023-10-08T15:42:30.348251+0000","last_became_active":"2023-10-08T15:42:30.345101+0000","last_became_peered":"2023-10-08T15:42:30.345101+0000","last_unstale":"2023-10-08T15:42:30.348251+0000","last_undegraded":"2023-10-08T15:42:30.348251+0000","last_fullsized":"2023-10-08T15:42:30.348251+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:58:41.138214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.341801+0000","last_change":"2023-10-08T15:42:30.334129+0000","last_active":"2023-10-08T15:42:30.341801+0000","last_peered":"2023-10-08T15:42:30.341801+0000","last_clean":"2023-10-08T15:42:30.341801+0000","last_became_active":"2023-10-08T15:42:30.333840+0000","last_became_peered":"2023-10-08T15:42:30.333840+0000","last_unstale":"2023-10-08T15:42:30.341801+0000","last_undegraded":"2023-10-08T15:42:30.341801+0000","last_fullsized":"2023-10-08T15:42:30.341801+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:43:18.893595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.346146+0000","last_change":"2023-10-08T15:42:30.343874+0000","last_active":"2023-10-08T15:42:30.346146+0000","last_peered":"2023-10-08T15:42:30.346146+0000","last_clean":"2023-10-08T15:42:30.346146+0000","last_became_active":"2023-10-08T15:42:30.343472+0000","last_became_peered":"2023-10-08T15:42:30.343472+0000","last_unstale":"2023-10-08T15:42:30.346146+0000","last_undegraded":"2023-10-08T15:42:30.346146+0000","last_fullsized":"2023-10-08T15:42:30.346146+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:59:36.731597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"70'4","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.358242+0000","last_change":"2023-10-08T15:42:29.297111+0000","last_active":"2023-10-08T15:42:30.358242+0000","last_peered":"2023-10-08T15:42:30.358242+0000","last_clean":"2023-10-08T15:42:30.358242+0000","last_became_active":"2023-10-08T15:42:29.296662+0000","last_became_peered":"2023-10-08T15:42:29.296662+0000","last_unstale":"2023-10-08T15:42:30.358242+0000","last_undegraded":"2023-10-08T15:42:30.358242+0000","last_fullsized":"2023-10-08T15:42:30.358242+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:37:21.082622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.358623+0000","last_change":"2023-10-08T15:42:30.357788+0000","last_active":"2023-10-08T15:42:30.358623+0000","last_peered":"2023-10-08T15:42:30.358623+0000","last_clean":"2023-10-08T15:42:30.358623+0000","last_became_active":"2023-10-08T15:42:30.357434+0000","last_became_peered":"2023-10-08T15:42:30.357434+0000","last_unstale":"2023-10-08T15:42:30.358623+0000","last_undegraded":"2023-10-08T15:42:30.358623+0000","last_fullsized":"2023-10-08T15:42:30.358623+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:39:43.861173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"70'1","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.341212+0000","last_change":"2023-10-08T15:42:29.290673+0000","last_active":"2023-10-08T15:42:30.341212+0000","last_peered":"2023-10-08T15:42:30.341212+0000","last_clean":"2023-10-08T15:42:30.341212+0000","last_became_active":"2023-10-08T15:42:29.290131+0000","last_became_peered":"2023-10-08T15:42:29.290131+0000","last_unstale":"2023-10-08T15:42:30.341212+0000","last_undegraded":"2023-10-08T15:42:30.341212+0000","last_fullsized":"2023-10-08T15:42:30.341212+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:49:41.274172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.344298+0000","last_change":"2023-10-08T15:42:30.337509+0000","last_active":"2023-10-08T15:42:30.344298+0000","last_peered":"2023-10-08T15:42:30.344298+0000","last_clean":"2023-10-08T15:42:30.344298+0000","last_became_active":"2023-10-08T15:42:30.336040+0000","last_became_peered":"2023-10-08T15:42:30.336040+0000","last_unstale":"2023-10-08T15:42:30.344298+0000","last_undegraded":"2023-10-08T15:42:30.344298+0000","last_fullsized":"2023-10-08T15:42:30.344298+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:19:05.706339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"70'2","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.362077+0000","last_change":"2023-10-08T15:42:29.296970+0000","last_active":"2023-10-08T15:42:30.362077+0000","last_peered":"2023-10-08T15:42:30.362077+0000","last_clean":"2023-10-08T15:42:30.362077+0000","last_became_active":"2023-10-08T15:42:29.296636+0000","last_became_peered":"2023-10-08T15:42:29.296636+0000","last_unstale":"2023-10-08T15:42:30.362077+0000","last_undegraded":"2023-10-08T15:42:30.362077+0000","last_fullsized":"2023-10-08T15:42:30.362077+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:41:39.525248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.349147+0000","last_change":"2023-10-08T15:42:30.348114+0000","last_active":"2023-10-08T15:42:30.349147+0000","last_peered":"2023-10-08T15:42:30.349147+0000","last_clean":"2023-10-08T15:42:30.349147+0000","last_became_active":"2023-10-08T15:42:30.347715+0000","last_became_peered":"2023-10-08T15:42:30.347715+0000","last_unstale":"2023-10-08T15:42:30.349147+0000","last_undegraded":"2023-10-08T15:42:30.349147+0000","last_fullsized":"2023-10-08T15:42:30.349147+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:42:18.078158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"70'2","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.362113+0000","last_change":"2023-10-08T15:42:29.298233+0000","last_active":"2023-10-08T15:42:30.362113+0000","last_peered":"2023-10-08T15:42:30.362113+0000","last_clean":"2023-10-08T15:42:30.362113+0000","last_became_active":"2023-10-08T15:42:29.297921+0000","last_became_peered":"2023-10-08T15:42:29.297921+0000","last_unstale":"2023-10-08T15:42:30.362113+0000","last_undegraded":"2023-10-08T15:42:30.362113+0000","last_fullsized":"2023-10-08T15:42:30.362113+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:29:46.015237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.353818+0000","last_change":"2023-10-08T15:42:30.350915+0000","last_active":"2023-10-08T15:42:30.353818+0000","last_peered":"2023-10-08T15:42:30.353818+0000","last_clean":"2023-10-08T15:42:30.353818+0000","last_became_active":"2023-10-08T15:42:30.350643+0000","last_became_peered":"2023-10-08T15:42:30.350643+0000","last_unstale":"2023-10-08T15:42:30.353818+0000","last_undegraded":"2023-10-08T15:42:30.353818+0000","last_fullsized":"2023-10-08T15:42:30.353818+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:13:27.826245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"70'1","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.347037+0000","last_change":"2023-10-08T15:42:29.291620+0000","last_active":"2023-10-08T15:42:30.347037+0000","last_peered":"2023-10-08T15:42:30.347037+0000","last_clean":"2023-10-08T15:42:30.347037+0000","last_became_active":"2023-10-08T15:42:29.291298+0000","last_became_peered":"2023-10-08T15:42:29.291298+0000","last_unstale":"2023-10-08T15:42:30.347037+0000","last_undegraded":"2023-10-08T15:42:30.347037+0000","last_fullsized":"2023-10-08T15:42:30.347037+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:35:17.371964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.353385+0000","last_change":"2023-10-08T15:42:30.352385+0000","last_active":"2023-10-08T15:42:30.353385+0000","last_peered":"2023-10-08T15:42:30.353385+0000","last_clean":"2023-10-08T15:42:30.353385+0000","last_became_active":"2023-10-08T15:42:30.351949+0000","last_became_peered":"2023-10-08T15:42:30.351949+0000","last_unstale":"2023-10-08T15:42:30.353385+0000","last_undegraded":"2023-10-08T15:42:30.353385+0000","last_fullsized":"2023-10-08T15:42:30.353385+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:06:28.263822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"70'1","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.341264+0000","last_change":"2023-10-08T15:42:29.290424+0000","last_active":"2023-10-08T15:42:30.341264+0000","last_peered":"2023-10-08T15:42:30.341264+0000","last_clean":"2023-10-08T15:42:30.341264+0000","last_became_active":"2023-10-08T15:42:29.289913+0000","last_became_peered":"2023-10-08T15:42:29.289913+0000","last_unstale":"2023-10-08T15:42:30.341264+0000","last_undegraded":"2023-10-08T15:42:30.341264+0000","last_fullsized":"2023-10-08T15:42:30.341264+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:10:34.911060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.351678+0000","last_change":"2023-10-08T15:42:30.350476+0000","last_active":"2023-10-08T15:42:30.351678+0000","last_peered":"2023-10-08T15:42:30.351678+0000","last_clean":"2023-10-08T15:42:30.351678+0000","last_became_active":"2023-10-08T15:42:30.350136+0000","last_became_peered":"2023-10-08T15:42:30.350136+0000","last_unstale":"2023-10-08T15:42:30.351678+0000","last_undegraded":"2023-10-08T15:42:30.351678+0000","last_fullsized":"2023-10-08T15:42:30.351678+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:52:55.039479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.348347+0000","last_change":"2023-10-08T15:42:29.284669+0000","last_active":"2023-10-08T15:42:30.348347+0000","last_peered":"2023-10-08T15:42:30.348347+0000","last_clean":"2023-10-08T15:42:30.348347+0000","last_became_active":"2023-10-08T15:42:29.284245+0000","last_became_peered":"2023-10-08T15:42:29.284245+0000","last_unstale":"2023-10-08T15:42:30.348347+0000","last_undegraded":"2023-10-08T15:42:30.348347+0000","last_fullsized":"2023-10-08T15:42:30.348347+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:03:05.155117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.338552+0000","last_change":"2023-10-08T15:42:30.336340+0000","last_active":"2023-10-08T15:42:30.338552+0000","last_peered":"2023-10-08T15:42:30.338552+0000","last_clean":"2023-10-08T15:42:30.338552+0000","last_became_active":"2023-10-08T15:42:30.334482+0000","last_became_peered":"2023-10-08T15:42:30.334482+0000","last_unstale":"2023-10-08T15:42:30.338552+0000","last_undegraded":"2023-10-08T15:42:30.338552+0000","last_fullsized":"2023-10-08T15:42:30.338552+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:15.362329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.313671+0000","last_change":"2023-10-08T15:42:29.294948+0000","last_active":"2023-10-08T15:42:30.313671+0000","last_peered":"2023-10-08T15:42:30.313671+0000","last_clean":"2023-10-08T15:42:30.313671+0000","last_became_active":"2023-10-08T15:42:29.294599+0000","last_became_peered":"2023-10-08T15:42:29.294599+0000","last_unstale":"2023-10-08T15:42:30.313671+0000","last_undegraded":"2023-10-08T15:42:30.313671+0000","last_fullsized":"2023-10-08T15:42:30.313671+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:52:09.508083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.336553+0000","last_change":"2023-10-08T15:42:30.332248+0000","last_active":"2023-10-08T15:42:30.336553+0000","last_peered":"2023-10-08T15:42:30.336553+0000","last_clean":"2023-10-08T15:42:30.336553+0000","last_became_active":"2023-10-08T15:42:30.331908+0000","last_became_peered":"2023-10-08T15:42:30.331908+0000","last_unstale":"2023-10-08T15:42:30.336553+0000","last_undegraded":"2023-10-08T15:42:30.336553+0000","last_fullsized":"2023-10-08T15:42:30.336553+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:45:25.945569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.333470+0000","last_change":"2023-10-08T15:42:29.296927+0000","last_active":"2023-10-08T15:42:30.333470+0000","last_peered":"2023-10-08T15:42:30.333470+0000","last_clean":"2023-10-08T15:42:30.333470+0000","last_became_active":"2023-10-08T15:42:29.296334+0000","last_became_peered":"2023-10-08T15:42:29.296334+0000","last_unstale":"2023-10-08T15:42:30.333470+0000","last_undegraded":"2023-10-08T15:42:30.333470+0000","last_fullsized":"2023-10-08T15:42:30.333470+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:40:33.349467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.347548+0000","last_change":"2023-10-08T15:42:30.347548+0000","last_active":"2023-10-08T15:42:30.347548+0000","last_peered":"2023-10-08T15:42:30.347548+0000","last_clean":"2023-10-08T15:42:30.347548+0000","last_became_active":"2023-10-08T15:42:30.347209+0000","last_became_peered":"2023-10-08T15:42:30.347209+0000","last_unstale":"2023-10-08T15:42:30.347548+0000","last_undegraded":"2023-10-08T15:42:30.347548+0000","last_fullsized":"2023-10-08T15:42:30.347548+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:46:26.270646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.333292+0000","last_change":"2023-10-08T15:42:29.296151+0000","last_active":"2023-10-08T15:42:30.333292+0000","last_peered":"2023-10-08T15:42:30.333292+0000","last_clean":"2023-10-08T15:42:30.333292+0000","last_became_active":"2023-10-08T15:42:29.295771+0000","last_became_peered":"2023-10-08T15:42:29.295771+0000","last_unstale":"2023-10-08T15:42:30.333292+0000","last_undegraded":"2023-10-08T15:42:30.333292+0000","last_fullsized":"2023-10-08T15:42:30.333292+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:25:41.546433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.357097+0000","last_change":"2023-10-08T15:42:30.347505+0000","last_active":"2023-10-08T15:42:30.357097+0000","last_peered":"2023-10-08T15:42:30.357097+0000","last_clean":"2023-10-08T15:42:30.357097+0000","last_became_active":"2023-10-08T15:42:30.344070+0000","last_became_peered":"2023-10-08T15:42:30.344070+0000","last_unstale":"2023-10-08T15:42:30.357097+0000","last_undegraded":"2023-10-08T15:42:30.357097+0000","last_fullsized":"2023-10-08T15:42:30.357097+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:15.362329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"70'3","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.347566+0000","last_change":"2023-10-08T15:42:29.296730+0000","last_active":"2023-10-08T15:42:30.347566+0000","last_peered":"2023-10-08T15:42:30.347566+0000","last_clean":"2023-10-08T15:42:30.347566+0000","last_became_active":"2023-10-08T15:42:29.296054+0000","last_became_peered":"2023-10-08T15:42:29.296054+0000","last_unstale":"2023-10-08T15:42:30.347566+0000","last_undegraded":"2023-10-08T15:42:30.347566+0000","last_fullsized":"2023-10-08T15:42:30.347566+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:43:13.093299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.359495+0000","last_change":"2023-10-08T15:42:30.358813+0000","last_active":"2023-10-08T15:42:30.359495+0000","last_peered":"2023-10-08T15:42:30.359495+0000","last_clean":"2023-10-08T15:42:30.359495+0000","last_became_active":"2023-10-08T15:42:30.358527+0000","last_became_peered":"2023-10-08T15:42:30.358527+0000","last_unstale":"2023-10-08T15:42:30.359495+0000","last_undegraded":"2023-10-08T15:42:30.359495+0000","last_fullsized":"2023-10-08T15:42:30.359495+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:54:13.937795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"70'6","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.342186+0000","last_change":"2023-10-08T15:42:29.291159+0000","last_active":"2023-10-08T15:42:30.342186+0000","last_peered":"2023-10-08T15:42:30.342186+0000","last_clean":"2023-10-08T15:42:30.342186+0000","last_became_active":"2023-10-08T15:42:29.290812+0000","last_became_peered":"2023-10-08T15:42:29.290812+0000","last_unstale":"2023-10-08T15:42:30.342186+0000","last_undegraded":"2023-10-08T15:42:30.342186+0000","last_fullsized":"2023-10-08T15:42:30.342186+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:26:01.548146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.354756+0000","last_change":"2023-10-08T15:42:30.344152+0000","last_active":"2023-10-08T15:42:30.354756+0000","last_peered":"2023-10-08T15:42:30.354756+0000","last_clean":"2023-10-08T15:42:30.354756+0000","last_became_active":"2023-10-08T15:42:30.343180+0000","last_became_peered":"2023-10-08T15:42:30.343180+0000","last_unstale":"2023-10-08T15:42:30.354756+0000","last_undegraded":"2023-10-08T15:42:30.354756+0000","last_fullsized":"2023-10-08T15:42:30.354756+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:57:24.891115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"70'2","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.359976+0000","last_change":"2023-10-08T15:42:29.297594+0000","last_active":"2023-10-08T15:42:30.359976+0000","last_peered":"2023-10-08T15:42:30.359976+0000","last_clean":"2023-10-08T15:42:30.359976+0000","last_became_active":"2023-10-08T15:42:29.297257+0000","last_became_peered":"2023-10-08T15:42:29.297257+0000","last_unstale":"2023-10-08T15:42:30.359976+0000","last_undegraded":"2023-10-08T15:42:30.359976+0000","last_fullsized":"2023-10-08T15:42:30.359976+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:19:13.874385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.339690+0000","last_change":"2023-10-08T15:42:30.333603+0000","last_active":"2023-10-08T15:42:30.339690+0000","last_peered":"2023-10-08T15:42:30.339690+0000","last_clean":"2023-10-08T15:42:30.339690+0000","last_became_active":"2023-10-08T15:42:30.333267+0000","last_became_peered":"2023-10-08T15:42:30.333267+0000","last_unstale":"2023-10-08T15:42:30.339690+0000","last_undegraded":"2023-10-08T15:42:30.339690+0000","last_fullsized":"2023-10-08T15:42:30.339690+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:51:49.686627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.320223+0000","last_change":"2023-10-08T15:42:29.292723+0000","last_active":"2023-10-08T15:42:30.320223+0000","last_peered":"2023-10-08T15:42:30.320223+0000","last_clean":"2023-10-08T15:42:30.320223+0000","last_became_active":"2023-10-08T15:42:29.292457+0000","last_became_peered":"2023-10-08T15:42:29.292457+0000","last_unstale":"2023-10-08T15:42:30.320223+0000","last_undegraded":"2023-10-08T15:42:30.320223+0000","last_fullsized":"2023-10-08T15:42:30.320223+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:21:21.014380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.353814+0000","last_change":"2023-10-08T15:42:30.350180+0000","last_active":"2023-10-08T15:42:30.353814+0000","last_peered":"2023-10-08T15:42:30.353814+0000","last_clean":"2023-10-08T15:42:30.353814+0000","last_became_active":"2023-10-08T15:42:30.349868+0000","last_became_peered":"2023-10-08T15:42:30.349868+0000","last_unstale":"2023-10-08T15:42:30.353814+0000","last_undegraded":"2023-10-08T15:42:30.353814+0000","last_fullsized":"2023-10-08T15:42:30.353814+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:50:52.058328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-10-08T15:42:29.290271+0000","last_change":"2023-10-08T15:42:29.288141+0000","last_active":"2023-10-08T15:42:29.290271+0000","last_peered":"2023-10-08T15:42:29.290271+0000","last_clean":"2023-10-08T15:42:29.290271+0000","last_became_active":"2023-10-08T15:42:29.287228+0000","last_became_peered":"2023-10-08T15:42:29.287228+0000","last_unstale":"2023-10-08T15:42:29.290271+0000","last_undegraded":"2023-10-08T15:42:29.290271+0000","last_fullsized":"2023-10-08T15:42:29.290271+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:44:16.551176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.342221+0000","last_change":"2023-10-08T15:42:30.336298+0000","last_active":"2023-10-08T15:42:30.342221+0000","last_peered":"2023-10-08T15:42:30.342221+0000","last_clean":"2023-10-08T15:42:30.342221+0000","last_became_active":"2023-10-08T15:42:30.335922+0000","last_became_peered":"2023-10-08T15:42:30.335922+0000","last_unstale":"2023-10-08T15:42:30.342221+0000","last_undegraded":"2023-10-08T15:42:30.342221+0000","last_fullsized":"2023-10-08T15:42:30.342221+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:27:03.250834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"70'8","reported_seq":18,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.362564+0000","last_change":"2023-10-08T15:42:29.290170+0000","last_active":"2023-10-08T15:42:30.362564+0000","last_peered":"2023-10-08T15:42:30.362564+0000","last_clean":"2023-10-08T15:42:30.362564+0000","last_became_active":"2023-10-08T15:42:29.289063+0000","last_became_peered":"2023-10-08T15:42:29.289063+0000","last_unstale":"2023-10-08T15:42:30.362564+0000","last_undegraded":"2023-10-08T15:42:30.362564+0000","last_fullsized":"2023-10-08T15:42:30.362564+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:55.406826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.339721+0000","last_change":"2023-10-08T15:42:30.333012+0000","last_active":"2023-10-08T15:42:30.339721+0000","last_peered":"2023-10-08T15:42:30.339721+0000","last_clean":"2023-10-08T15:42:30.339721+0000","last_became_active":"2023-10-08T15:42:30.332629+0000","last_became_peered":"2023-10-08T15:42:30.332629+0000","last_unstale":"2023-10-08T15:42:30.339721+0000","last_undegraded":"2023-10-08T15:42:30.339721+0000","last_fullsized":"2023-10-08T15:42:30.339721+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:10:35.869681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"70'1","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.346895+0000","last_change":"2023-10-08T15:42:29.295740+0000","last_active":"2023-10-08T15:42:30.346895+0000","last_peered":"2023-10-08T15:42:30.346895+0000","last_clean":"2023-10-08T15:42:30.346895+0000","last_became_active":"2023-10-08T15:42:29.293774+0000","last_became_peered":"2023-10-08T15:42:29.293774+0000","last_unstale":"2023-10-08T15:42:30.346895+0000","last_undegraded":"2023-10-08T15:42:30.346895+0000","last_fullsized":"2023-10-08T15:42:30.346895+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:05:40.626756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.345640+0000","last_change":"2023-10-08T15:42:30.340323+0000","last_active":"2023-10-08T15:42:30.345640+0000","last_peered":"2023-10-08T15:42:30.345640+0000","last_clean":"2023-10-08T15:42:30.345640+0000","last_became_active":"2023-10-08T15:42:30.336977+0000","last_became_peered":"2023-10-08T15:42:30.336977+0000","last_unstale":"2023-10-08T15:42:30.345640+0000","last_undegraded":"2023-10-08T15:42:30.345640+0000","last_fullsized":"2023-10-08T15:42:30.345640+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:40:18.310738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"70'2","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.362074+0000","last_change":"2023-10-08T15:42:29.290715+0000","last_active":"2023-10-08T15:42:30.362074+0000","last_peered":"2023-10-08T15:42:30.362074+0000","last_clean":"2023-10-08T15:42:30.362074+0000","last_became_active":"2023-10-08T15:42:29.289626+0000","last_became_peered":"2023-10-08T15:42:29.289626+0000","last_unstale":"2023-10-08T15:42:30.362074+0000","last_undegraded":"2023-10-08T15:42:30.362074+0000","last_fullsized":"2023-10-08T15:42:30.362074+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:48:23.733193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.342433+0000","last_change":"2023-10-08T15:42:30.336936+0000","last_active":"2023-10-08T15:42:30.342433+0000","last_peered":"2023-10-08T15:42:30.342433+0000","last_clean":"2023-10-08T15:42:30.342433+0000","last_became_active":"2023-10-08T15:42:30.336624+0000","last_became_peered":"2023-10-08T15:42:30.336624+0000","last_unstale":"2023-10-08T15:42:30.342433+0000","last_undegraded":"2023-10-08T15:42:30.342433+0000","last_fullsized":"2023-10-08T15:42:30.342433+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:16:35.166421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.348572+0000","last_change":"2023-10-08T15:42:29.290519+0000","last_active":"2023-10-08T15:42:30.348572+0000","last_peered":"2023-10-08T15:42:30.348572+0000","last_clean":"2023-10-08T15:42:30.348572+0000","last_became_active":"2023-10-08T15:42:29.290159+0000","last_became_peered":"2023-10-08T15:42:29.290159+0000","last_unstale":"2023-10-08T15:42:30.348572+0000","last_undegraded":"2023-10-08T15:42:30.348572+0000","last_fullsized":"2023-10-08T15:42:30.348572+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:46:25.266736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.352211+0000","last_change":"2023-10-08T15:42:30.349715+0000","last_active":"2023-10-08T15:42:30.352211+0000","last_peered":"2023-10-08T15:42:30.352211+0000","last_clean":"2023-10-08T15:42:30.352211+0000","last_became_active":"2023-10-08T15:42:30.349375+0000","last_became_peered":"2023-10-08T15:42:30.349375+0000","last_unstale":"2023-10-08T15:42:30.352211+0000","last_undegraded":"2023-10-08T15:42:30.352211+0000","last_fullsized":"2023-10-08T15:42:30.352211+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:03:45.205325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"70'2","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.351796+0000","last_change":"2023-10-08T15:42:29.287042+0000","last_active":"2023-10-08T15:42:30.351796+0000","last_peered":"2023-10-08T15:42:30.351796+0000","last_clean":"2023-10-08T15:42:30.351796+0000","last_became_active":"2023-10-08T15:42:29.286557+0000","last_became_peered":"2023-10-08T15:42:29.286557+0000","last_unstale":"2023-10-08T15:42:30.351796+0000","last_undegraded":"2023-10-08T15:42:30.351796+0000","last_fullsized":"2023-10-08T15:42:30.351796+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:16:27.705168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.330839+0000","last_change":"2023-10-08T15:42:30.330839+0000","last_active":"2023-10-08T15:42:30.330839+0000","last_peered":"2023-10-08T15:42:30.330839+0000","last_clean":"2023-10-08T15:42:30.330839+0000","last_became_active":"2023-10-08T15:42:30.330544+0000","last_became_peered":"2023-10-08T15:42:30.330544+0000","last_unstale":"2023-10-08T15:42:30.330839+0000","last_undegraded":"2023-10-08T15:42:30.330839+0000","last_fullsized":"2023-10-08T15:42:30.330839+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:02:31.620217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.341137+0000","last_change":"2023-10-08T15:42:29.292367+0000","last_active":"2023-10-08T15:42:30.341137+0000","last_peered":"2023-10-08T15:42:30.341137+0000","last_clean":"2023-10-08T15:42:30.341137+0000","last_became_active":"2023-10-08T15:42:29.288342+0000","last_became_peered":"2023-10-08T15:42:29.288342+0000","last_unstale":"2023-10-08T15:42:30.341137+0000","last_undegraded":"2023-10-08T15:42:30.341137+0000","last_fullsized":"2023-10-08T15:42:30.341137+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:38:45.203429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.351819+0000","last_change":"2023-10-08T15:42:30.345313+0000","last_active":"2023-10-08T15:42:30.351819+0000","last_peered":"2023-10-08T15:42:30.351819+0000","last_clean":"2023-10-08T15:42:30.351819+0000","last_became_active":"2023-10-08T15:42:30.344950+0000","last_became_peered":"2023-10-08T15:42:30.344950+0000","last_unstale":"2023-10-08T15:42:30.351819+0000","last_undegraded":"2023-10-08T15:42:30.351819+0000","last_fullsized":"2023-10-08T15:42:30.351819+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:57:21.061881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.344011+0000","last_change":"2023-10-08T15:42:29.288283+0000","last_active":"2023-10-08T15:42:30.344011+0000","last_peered":"2023-10-08T15:42:30.344011+0000","last_clean":"2023-10-08T15:42:30.344011+0000","last_became_active":"2023-10-08T15:42:29.287986+0000","last_became_peered":"2023-10-08T15:42:29.287986+0000","last_unstale":"2023-10-08T15:42:30.344011+0000","last_undegraded":"2023-10-08T15:42:30.344011+0000","last_fullsized":"2023-10-08T15:42:30.344011+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:47:51.586924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.354803+0000","last_change":"2023-10-08T15:42:30.354803+0000","last_active":"2023-10-08T15:42:30.354803+0000","last_peered":"2023-10-08T15:42:30.354803+0000","last_clean":"2023-10-08T15:42:30.354803+0000","last_became_active":"2023-10-08T15:42:30.354575+0000","last_became_peered":"2023-10-08T15:42:30.354575+0000","last_unstale":"2023-10-08T15:42:30.354803+0000","last_undegraded":"2023-10-08T15:42:30.354803+0000","last_fullsized":"2023-10-08T15:42:30.354803+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:38:53.339858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.319948+0000","last_change":"2023-10-08T15:42:29.287927+0000","last_active":"2023-10-08T15:42:30.319948+0000","last_peered":"2023-10-08T15:42:30.319948+0000","last_clean":"2023-10-08T15:42:30.319948+0000","last_became_active":"2023-10-08T15:42:29.287615+0000","last_became_peered":"2023-10-08T15:42:29.287615+0000","last_unstale":"2023-10-08T15:42:30.319948+0000","last_undegraded":"2023-10-08T15:42:30.319948+0000","last_fullsized":"2023-10-08T15:42:30.319948+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:25:02.876973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.335085+0000","last_change":"2023-10-08T15:42:30.328430+0000","last_active":"2023-10-08T15:42:30.335085+0000","last_peered":"2023-10-08T15:42:30.335085+0000","last_clean":"2023-10-08T15:42:30.335085+0000","last_became_active":"2023-10-08T15:42:30.328093+0000","last_became_peered":"2023-10-08T15:42:30.328093+0000","last_unstale":"2023-10-08T15:42:30.335085+0000","last_undegraded":"2023-10-08T15:42:30.335085+0000","last_fullsized":"2023-10-08T15:42:30.335085+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:25:03.880884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"70'2","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.347609+0000","last_change":"2023-10-08T15:42:29.294678+0000","last_active":"2023-10-08T15:42:30.347609+0000","last_peered":"2023-10-08T15:42:30.347609+0000","last_clean":"2023-10-08T15:42:30.347609+0000","last_became_active":"2023-10-08T15:42:29.293721+0000","last_became_peered":"2023-10-08T15:42:29.293721+0000","last_unstale":"2023-10-08T15:42:30.347609+0000","last_undegraded":"2023-10-08T15:42:30.347609+0000","last_fullsized":"2023-10-08T15:42:30.347609+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:57:32.840050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.346041+0000","last_change":"2023-10-08T15:42:30.344203+0000","last_active":"2023-10-08T15:42:30.346041+0000","last_peered":"2023-10-08T15:42:30.346041+0000","last_clean":"2023-10-08T15:42:30.346041+0000","last_became_active":"2023-10-08T15:42:30.343911+0000","last_became_peered":"2023-10-08T15:42:30.343911+0000","last_unstale":"2023-10-08T15:42:30.346041+0000","last_undegraded":"2023-10-08T15:42:30.346041+0000","last_fullsized":"2023-10-08T15:42:30.346041+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:08:16.183455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.315400+0000","last_change":"2023-10-08T15:42:29.297609+0000","last_active":"2023-10-08T15:42:30.315400+0000","last_peered":"2023-10-08T15:42:30.315400+0000","last_clean":"2023-10-08T15:42:30.315400+0000","last_became_active":"2023-10-08T15:42:29.297259+0000","last_became_peered":"2023-10-08T15:42:29.297259+0000","last_unstale":"2023-10-08T15:42:30.315400+0000","last_undegraded":"2023-10-08T15:42:30.315400+0000","last_fullsized":"2023-10-08T15:42:30.315400+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:53:38.549793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.349545+0000","last_change":"2023-10-08T15:42:30.347728+0000","last_active":"2023-10-08T15:42:30.349545+0000","last_peered":"2023-10-08T15:42:30.349545+0000","last_clean":"2023-10-08T15:42:30.349545+0000","last_became_active":"2023-10-08T15:42:30.346901+0000","last_became_peered":"2023-10-08T15:42:30.346901+0000","last_unstale":"2023-10-08T15:42:30.349545+0000","last_undegraded":"2023-10-08T15:42:30.349545+0000","last_fullsized":"2023-10-08T15:42:30.349545+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:28.135864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.332878+0000","last_change":"2023-10-08T15:42:29.297402+0000","last_active":"2023-10-08T15:42:30.332878+0000","last_peered":"2023-10-08T15:42:30.332878+0000","last_clean":"2023-10-08T15:42:30.332878+0000","last_became_active":"2023-10-08T15:42:29.296307+0000","last_became_peered":"2023-10-08T15:42:29.296307+0000","last_unstale":"2023-10-08T15:42:30.332878+0000","last_undegraded":"2023-10-08T15:42:30.332878+0000","last_fullsized":"2023-10-08T15:42:30.332878+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:54:14.801828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.359048+0000","last_change":"2023-10-08T15:42:30.358100+0000","last_active":"2023-10-08T15:42:30.359048+0000","last_peered":"2023-10-08T15:42:30.359048+0000","last_clean":"2023-10-08T15:42:30.359048+0000","last_became_active":"2023-10-08T15:42:30.357781+0000","last_became_peered":"2023-10-08T15:42:30.357781+0000","last_unstale":"2023-10-08T15:42:30.359048+0000","last_undegraded":"2023-10-08T15:42:30.359048+0000","last_fullsized":"2023-10-08T15:42:30.359048+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:15.362329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.332751+0000","last_change":"2023-10-08T15:42:29.296537+0000","last_active":"2023-10-08T15:42:30.332751+0000","last_peered":"2023-10-08T15:42:30.332751+0000","last_clean":"2023-10-08T15:42:30.332751+0000","last_became_active":"2023-10-08T15:42:29.294099+0000","last_became_peered":"2023-10-08T15:42:29.294099+0000","last_unstale":"2023-10-08T15:42:30.332751+0000","last_undegraded":"2023-10-08T15:42:30.332751+0000","last_fullsized":"2023-10-08T15:42:30.332751+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:24:47.424735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.330833+0000","last_change":"2023-10-08T15:42:30.330833+0000","last_active":"2023-10-08T15:42:30.330833+0000","last_peered":"2023-10-08T15:42:30.330833+0000","last_clean":"2023-10-08T15:42:30.330833+0000","last_became_active":"2023-10-08T15:42:30.330506+0000","last_became_peered":"2023-10-08T15:42:30.330506+0000","last_unstale":"2023-10-08T15:42:30.330833+0000","last_undegraded":"2023-10-08T15:42:30.330833+0000","last_fullsized":"2023-10-08T15:42:30.330833+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:29:47.019147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.351151+0000","last_change":"2023-10-08T15:42:29.295892+0000","last_active":"2023-10-08T15:42:30.351151+0000","last_peered":"2023-10-08T15:42:30.351151+0000","last_clean":"2023-10-08T15:42:30.351151+0000","last_became_active":"2023-10-08T15:42:29.289493+0000","last_became_peered":"2023-10-08T15:42:29.289493+0000","last_unstale":"2023-10-08T15:42:30.351151+0000","last_undegraded":"2023-10-08T15:42:30.351151+0000","last_fullsized":"2023-10-08T15:42:30.351151+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:02:30.616306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.354485+0000","last_change":"2023-10-08T15:42:30.343881+0000","last_active":"2023-10-08T15:42:30.354485+0000","last_peered":"2023-10-08T15:42:30.354485+0000","last_clean":"2023-10-08T15:42:30.354485+0000","last_became_active":"2023-10-08T15:42:30.342782+0000","last_became_peered":"2023-10-08T15:42:30.342782+0000","last_unstale":"2023-10-08T15:42:30.354485+0000","last_undegraded":"2023-10-08T15:42:30.354485+0000","last_fullsized":"2023-10-08T15:42:30.354485+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:58:41.138214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.323086+0000","last_change":"2023-10-08T15:42:29.290448+0000","last_active":"2023-10-08T15:42:30.323086+0000","last_peered":"2023-10-08T15:42:30.323086+0000","last_clean":"2023-10-08T15:42:30.323086+0000","last_became_active":"2023-10-08T15:42:29.289907+0000","last_became_peered":"2023-10-08T15:42:29.289907+0000","last_unstale":"2023-10-08T15:42:30.323086+0000","last_undegraded":"2023-10-08T15:42:30.323086+0000","last_fullsized":"2023-10-08T15:42:30.323086+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:32:51.033691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.342117+0000","last_change":"2023-10-08T15:42:30.334627+0000","last_active":"2023-10-08T15:42:30.342117+0000","last_peered":"2023-10-08T15:42:30.342117+0000","last_clean":"2023-10-08T15:42:30.342117+0000","last_became_active":"2023-10-08T15:42:30.334319+0000","last_became_peered":"2023-10-08T15:42:30.334319+0000","last_unstale":"2023-10-08T15:42:30.342117+0000","last_undegraded":"2023-10-08T15:42:30.342117+0000","last_fullsized":"2023-10-08T15:42:30.342117+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:23:58.973033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.333390+0000","last_change":"2023-10-08T15:42:29.296028+0000","last_active":"2023-10-08T15:42:30.333390+0000","last_peered":"2023-10-08T15:42:30.333390+0000","last_clean":"2023-10-08T15:42:30.333390+0000","last_became_active":"2023-10-08T15:42:29.293701+0000","last_became_peered":"2023-10-08T15:42:29.293701+0000","last_unstale":"2023-10-08T15:42:30.333390+0000","last_undegraded":"2023-10-08T15:42:30.333390+0000","last_fullsized":"2023-10-08T15:42:30.333390+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:51:15.025043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.353740+0000","last_change":"2023-10-08T15:42:30.352664+0000","last_active":"2023-10-08T15:42:30.353740+0000","last_peered":"2023-10-08T15:42:30.353740+0000","last_clean":"2023-10-08T15:42:30.353740+0000","last_became_active":"2023-10-08T15:42:30.352329+0000","last_became_peered":"2023-10-08T15:42:30.352329+0000","last_unstale":"2023-10-08T15:42:30.353740+0000","last_undegraded":"2023-10-08T15:42:30.353740+0000","last_fullsized":"2023-10-08T15:42:30.353740+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:55:54.934021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.322824+0000","last_change":"2023-10-08T15:42:29.286199+0000","last_active":"2023-10-08T15:42:30.322824+0000","last_peered":"2023-10-08T15:42:30.322824+0000","last_clean":"2023-10-08T15:42:30.322824+0000","last_became_active":"2023-10-08T15:42:29.285228+0000","last_became_peered":"2023-10-08T15:42:29.285228+0000","last_unstale":"2023-10-08T15:42:30.322824+0000","last_undegraded":"2023-10-08T15:42:30.322824+0000","last_fullsized":"2023-10-08T15:42:30.322824+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:03:22.866811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.331879+0000","last_change":"2023-10-08T15:42:30.330383+0000","last_active":"2023-10-08T15:42:30.331879+0000","last_peered":"2023-10-08T15:42:30.331879+0000","last_clean":"2023-10-08T15:42:30.331879+0000","last_became_active":"2023-10-08T15:42:30.329473+0000","last_became_peered":"2023-10-08T15:42:30.329473+0000","last_unstale":"2023-10-08T15:42:30.331879+0000","last_undegraded":"2023-10-08T15:42:30.331879+0000","last_fullsized":"2023-10-08T15:42:30.331879+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:29.258847+0000","last_clean_scrub_stamp":"2023-10-08T15:42:29.258847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:25:42.550343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"70'1","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.347317+0000","last_change":"2023-10-08T15:42:29.292864+0000","last_active":"2023-10-08T15:42:30.347317+0000","last_peered":"2023-10-08T15:42:30.347317+0000","last_clean":"2023-10-08T15:42:30.347317+0000","last_became_active":"2023-10-08T15:42:29.292542+0000","last_became_peered":"2023-10-08T15:42:29.292542+0000","last_unstale":"2023-10-08T15:42:30.347317+0000","last_undegraded":"2023-10-08T15:42:30.347317+0000","last_fullsized":"2023-10-08T15:42:30.347317+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:28.254937+0000","last_clean_scrub_stamp":"2023-10-08T15:42:28.254937+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:12:46.349283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":214,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-08T15:42:30.326423+0000","last_change":"2023-10-08T15:37:19.380955+0000","last_active":"2023-10-08T15:42:30.326423+0000","last_peered":"2023-10-08T15:42:30.326423+0000","last_clean":"2023-10-08T15:42:30.326423+0000","last_became_active":"2023-10-08T15:37:19.378277+0000","last_became_peered":"2023-10-08T15:37:19.378277+0000","last_unstale":"2023-10-08T15:42:30.326423+0000","last_undegraded":"2023-10-08T15:42:30.326423+0000","last_fullsized":"2023-10-08T15:42:30.326423+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:37:17.537726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:37:17.537726+0000","last_clean_scrub_stamp":"2023-10-08T15:37:17.537726+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:06:26.612046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66282,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542209,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310492,"kb_used_data":916,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061348,"statfs":{"total":96636764160,"available":96318820352,"internally_reserved":0,"allocated":937984,"data_stored":957578,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:42:30 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.91600000000000004,"15min":0.94999999999999996},"min":{"1min":0.60999999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.4910000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.91500000000000004,"15min":0.92600000000000005},"min":{"1min":0.59499999999999997,"5min":0.309,"15min":0.309},"max":{"1min":1.2090000000000001,"5min":1.758,"15min":1.758},"last":1.2090000000000001}]},{"osd":1,"last update":"Sun Oct 8 15:42:30 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.86499999999999999,"15min":0.88},"min":{"1min":0.505,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.1599999999999999,"5min":1.474,"15min":1.474},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.006,"5min":0.95199999999999996,"15min":0.95799999999999996},"min":{"1min":0.51900000000000002,"5min":0.371,"15min":0.371},"max":{"1min":1.3720000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.0760000000000001}]},{"osd":2,"last update":"Sun Oct 8 15:42:30 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":0.97499999999999998,"15min":1.0169999999999999},"min":{"1min":0.66900000000000004,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.4319999999999999,"5min":1.623,"15min":1.623},"last":0.99199999999999999},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.98699999999999999,"15min":1.0009999999999999},"min":{"1min":0.60799999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":1.0049999999999999}]},{"osd":3,"last update":"Sun Oct 8 15:42:30 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.026,"15min":0.98699999999999999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.3240000000000001,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.232,"5min":1.214,"15min":1.21},"min":{"1min":0.96199999999999997,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.548,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":1.1799999999999999}]},{"osd":4,"last update":"Sun Oct 8 15:42:30 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.0189999999999999,"15min":1.071},"min":{"1min":0.68799999999999994,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.331,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.093,"5min":1.0740000000000001,"15min":1.093},"min":{"1min":0.79000000000000004,"5min":0.505,"15min":0.505},"max":{"1min":1.4179999999999999,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.96999999999999997}]},{"osd":5,"last update":"Sun Oct 8 15:42:30 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.165,"15min":1.2430000000000001},"min":{"1min":0.82499999999999996,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.548,"5min":1.792,"15min":1.792},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.222,"5min":1.206,"15min":1.238},"min":{"1min":0.76400000000000001,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.532,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":1.272}]},{"osd":6,"last update":"Sun Oct 8 15:42:30 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.2529999999999999,"15min":1.302},"min":{"1min":0.85599999999999998,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.7010000000000001,"5min":1.839,"15min":1.839},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.1830000000000001,"15min":1.2370000000000001},"min":{"1min":0.91200000000000003,"5min":0.627,"15min":0.627},"max":{"1min":1.609,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":1.1499999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542210,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306340,"kb_used_data":860,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065500,"statfs":{"total":96636764160,"available":96323072000,"internally_reserved":0,"allocated":880640,"data_stored":367806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.90700000000000003,"15min":0.84499999999999997},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.2889999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97999999999999998,"15min":0.996},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.3899999999999999,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":0.96199999999999997}]},{"osd":1,"last update":"Sun Oct 8 15:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.96599999999999997,"15min":0.96199999999999997},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.385,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.97499999999999998,"15min":0.98699999999999999},"min":{"1min":0.66500000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.5149999999999999,"5min":1.853,"15min":1.853},"last":0.68899999999999995}]},{"osd":2,"last update":"Sun Oct 8 15:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.89700000000000002,"15min":0.85899999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.333,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.153},{"interface":"front","average":{"1min":1.046,"5min":1.0569999999999999,"15min":1.073},"min":{"1min":0.65500000000000003,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.325,"5min":1.518,"15min":1.518},"last":1.091}]},{"osd":3,"last update":"Sun Oct 8 15:42:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0449999999999999,"15min":1.0289999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.456,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.123},{"interface":"front","average":{"1min":0.95799999999999996,"5min":1.02,"15min":1.0640000000000001},"min":{"1min":0.67100000000000004,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.202,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":1.048}]},{"osd":4,"last update":"Sun Oct 8 15:42:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.0960000000000001,"15min":1.1160000000000001},"min":{"1min":0.69899999999999995,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.405,"5min":1.7,"15min":1.7},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.151,"15min":1.181},"min":{"1min":0.86899999999999999,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.5720000000000001,"5min":1.623,"15min":1.623},"last":1.2809999999999999}]},{"osd":5,"last update":"Sun Oct 8 15:42:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0760000000000001,"15min":1.1120000000000001},"min":{"1min":0.755,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.3939999999999999,"5min":1.581,"15min":1.581},"last":1.244},{"interface":"front","average":{"1min":1.254,"5min":1.2529999999999999,"15min":1.298},"min":{"1min":0.85899999999999999,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.554,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":1.323}]},{"osd":7,"last update":"Sun Oct 8 15:42:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.264,"15min":1.282},"min":{"1min":0.93999999999999995,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":1.631,"5min":1.74,"15min":1.74},"last":1.373},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.2410000000000001,"15min":1.2929999999999999},"min":{"1min":0.99199999999999999,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":1.5920000000000001,"5min":2.5630000000000002,"15min":2.5630000000000002},"last":1.5960000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542211,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310436,"kb_used_data":860,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061404,"statfs":{"total":96636764160,"available":96318877696,"internally_reserved":0,"allocated":880640,"data_stored":368676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.67600000000000005,"15min":0.70799999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.84199999999999997,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.748,"5min":0.76700000000000002,"15min":0.76200000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.98399999999999999,"5min":1.179,"15min":1.179},"last":0.85799999999999998}]},{"osd":1,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.73199999999999998,"15min":0.71699999999999997},"min":{"1min":0.42199999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.052,"5min":1.365,"15min":1.365},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.745,"5min":0.82899999999999996,"15min":0.81399999999999995},"min":{"1min":0.52700000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93799999999999994,"5min":1.353,"15min":1.353},"last":0.69399999999999995}]},{"osd":2,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.83799999999999997,"15min":0.84699999999999998},"min":{"1min":0.58699999999999997,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.244,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.90000000000000002,"15min":0.91900000000000004},"min":{"1min":0.47599999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.2350000000000001,"5min":1.423,"15min":1.423},"last":0.73899999999999999}]},{"osd":4,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.069,"15min":1.0640000000000001},"min":{"1min":0.73899999999999999,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.3129999999999999,"5min":1.585,"15min":1.585},"last":0.997},{"interface":"front","average":{"1min":1.024,"5min":1.073,"15min":1.131},"min":{"1min":0.72999999999999998,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.339,"5min":2.762,"15min":2.762},"last":1.3720000000000001}]},{"osd":5,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.1100000000000001,"15min":1.1419999999999999},"min":{"1min":0.755,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.3400000000000001,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.143,"5min":1.1850000000000001,"15min":1.2190000000000001},"min":{"1min":0.78500000000000003,"5min":0.755,"15min":0.755},"max":{"1min":1.625,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":1.093}]},{"osd":6,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.212,"15min":1.278},"min":{"1min":0.82199999999999995,"5min":0.746,"15min":0.746},"max":{"1min":1.504,"5min":2.6890000000000001,"15min":2.6890000000000001},"last":1.163},{"interface":"front","average":{"1min":1.103,"5min":1.194,"15min":1.212},"min":{"1min":0.86899999999999999,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":1.409,"5min":1.742,"15min":1.742},"last":1.429}]},{"osd":7,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2490000000000001,"15min":1.2529999999999999},"min":{"1min":0.93200000000000005,"5min":0.91600000000000004,"15min":0.91600000000000004},"max":{"1min":1.673,"5min":1.738,"15min":1.738},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.206,"5min":1.2809999999999999,"15min":1.3380000000000001},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.585,"5min":2.5840000000000001,"15min":2.5840000000000001},"last":1.47}]}]},{"osd":2,"up_from":14,"seq":60129542210,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":314524,"kb_used_data":852,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94057316,"statfs":{"total":96636764160,"available":96314691584,"internally_reserved":0,"allocated":872448,"data_stored":367694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.64700000000000002,"15min":0.628},"min":{"1min":0.499,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.72499999999999998,"15min":0.66700000000000004},"min":{"1min":0.47099999999999997,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.105,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.998}]},{"osd":1,"last update":"Sun Oct 8 15:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.72199999999999998,"15min":0.68700000000000006},"min":{"1min":0.56299999999999994,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0860000000000001,"5min":1.236,"15min":1.236},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.77900000000000003,"15min":0.71299999999999997},"min":{"1min":0.502,"5min":0.307,"15min":0.307},"max":{"1min":1.226,"5min":1.399,"15min":1.399},"last":0.79400000000000004}]},{"osd":3,"last update":"Sun Oct 8 15:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.72099999999999997,"15min":0.66100000000000003},"min":{"1min":0.53100000000000003,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":1.1339999999999999},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.85099999999999998},"min":{"1min":0.621,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":1.0309999999999999}]},{"osd":4,"last update":"Sun Oct 8 15:41:32 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.014,"15min":1.0029999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.329,"5min":1.371,"15min":1.371},"last":1.3680000000000001},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0369999999999999,"15min":1.0349999999999999},"min":{"1min":0.71799999999999997,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.544,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.1100000000000001}]},{"osd":5,"last update":"Sun Oct 8 15:41:32 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.056,"15min":1.056},"min":{"1min":0.75700000000000001,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.351,"5min":1.462,"15min":1.462},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0780000000000001,"15min":1.0640000000000001},"min":{"1min":0.77000000000000002,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.3919999999999999,"5min":1.452,"15min":1.452},"last":1.2150000000000001}]},{"osd":6,"last update":"Sun Oct 8 15:41:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.133,"15min":1.1040000000000001},"min":{"1min":0.83799999999999997,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.137,"5min":1.141,"15min":1.113},"min":{"1min":0.74199999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":1.196}]},{"osd":7,"last update":"Sun Oct 8 15:41:32 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.2110000000000001,"15min":1.167},"min":{"1min":0.85299999999999998,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.6419999999999999,"5min":1.72,"15min":1.72},"last":1.4590000000000001},{"interface":"front","average":{"1min":1.153,"5min":1.1910000000000001,"15min":1.167},"min":{"1min":0.77800000000000002,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.647,"5min":1.804,"15min":1.804},"last":1.397}]}]},{"osd":1,"up_from":14,"seq":60129542211,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":314532,"kb_used_data":860,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94057308,"statfs":{"total":96636764160,"available":96314683392,"internally_reserved":0,"allocated":880640,"data_stored":367334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.72099999999999997,"15min":0.76100000000000001},"min":{"1min":0.42099999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.343,"5min":1.734,"15min":1.734},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.79000000000000004,"15min":0.94199999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.381,"5min":5.7960000000000003,"15min":5.7960000000000003},"last":0.68999999999999995}]},{"osd":2,"last update":"Sun Oct 8 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.749,"15min":0.81899999999999995},"min":{"1min":0.50900000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.147,"5min":4.0119999999999996,"15min":4.0119999999999996},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.879,"15min":0.90100000000000002},"min":{"1min":0.56599999999999995,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.4670000000000001,"5min":1.853,"15min":1.853},"last":1.024}]},{"osd":3,"last update":"Sun Oct 8 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":1.1180000000000001,"15min":1.014},"min":{"1min":0.48099999999999998,"5min":0.435,"15min":0.435},"max":{"1min":1.413,"5min":13.388,"15min":13.388},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.91800000000000004,"5min":1.129,"15min":1.141},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.405,"5min":13.353,"15min":13.353},"last":0.98299999999999998}]},{"osd":4,"last update":"Sun Oct 8 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":1.048,"15min":1.1930000000000001},"min":{"1min":0.75800000000000001,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.4359999999999999,"5min":5.859,"15min":5.859},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.115,"5min":1.0780000000000001,"15min":1.1459999999999999},"min":{"1min":0.76000000000000001,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.7450000000000001,"5min":4.2679999999999998,"15min":4.2679999999999998},"last":0.94299999999999995}]},{"osd":5,"last update":"Sun Oct 8 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.0880000000000001,"15min":1.1319999999999999},"min":{"1min":0.82499999999999996,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.512,"5min":4.3380000000000001,"15min":4.3380000000000001},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.169,"15min":1.1779999999999999},"min":{"1min":0.77600000000000002,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.607,"5min":2.085,"15min":2.085},"last":1.52}]},{"osd":6,"last update":"Sun Oct 8 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.2030000000000001,"15min":1.3400000000000001},"min":{"1min":0.80500000000000005,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.712,"5min":5.8979999999999997,"15min":5.8979999999999997},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.234,"5min":1.208,"15min":1.262},"min":{"1min":0.81599999999999995,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.9419999999999999,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":1.1930000000000001}]},{"osd":7,"last update":"Sun Oct 8 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.242,"15min":1.2470000000000001},"min":{"1min":0.71099999999999997,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.8109999999999999,"5min":2.3940000000000001,"15min":2.3940000000000001},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.2849999999999999,"15min":1.4410000000000001},"min":{"1min":0.94199999999999995,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.752,"5min":5.9299999999999997,"15min":5.9299999999999997},"last":1.3100000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542211,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310492,"kb_used_data":916,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061348,"statfs":{"total":96636764160,"available":96318820352,"internally_reserved":0,"allocated":937984,"data_stored":957542,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.70999999999999996,"15min":0.80600000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.127,"5min":1.514,"15min":1.514},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.77900000000000003,"15min":0.79400000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.1180000000000001,"5min":1.518,"15min":1.518},"last":0.80400000000000005}]},{"osd":2,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.79600000000000004,"15min":0.84799999999999998},"min":{"1min":0.499,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.054,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78000000000000003,"15min":0.78400000000000003},"min":{"1min":0.497,"5min":0.434,"15min":0.434},"max":{"1min":1.198,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":1.0449999999999999}]},{"osd":3,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.74299999999999999,"15min":0.755},"min":{"1min":0.50700000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.626},{"interface":"front","average":{"1min":1.0620000000000001,"5min":0.96399999999999997,"15min":0.98799999999999999},"min":{"1min":0.52900000000000003,"5min":0.499,"15min":0.499},"max":{"1min":4.5069999999999997,"5min":4.5069999999999997,"15min":4.5069999999999997},"last":0.998}]},{"osd":4,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.0469999999999999,"15min":1.0820000000000001},"min":{"1min":0.73099999999999998,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.6479999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.1859999999999999},{"interface":"front","average":{"1min":1,"5min":1.02,"15min":1.0740000000000001},"min":{"1min":0.70599999999999996,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.429,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.88200000000000001}]},{"osd":5,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.024,"15min":1.079},"min":{"1min":0.76500000000000001,"5min":0.626,"15min":0.626},"max":{"1min":1.385,"5min":2.214,"15min":2.214},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1850000000000001,"15min":1.306},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.605,"5min":3.4569999999999999,"15min":3.4569999999999999},"last":1.1579999999999999}]},{"osd":6,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.1890000000000001,"15min":1.274},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.677,"5min":2.532,"15min":2.532},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.244,"5min":1.2070000000000001,"15min":1.2370000000000001},"min":{"1min":0.86299999999999999,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.704,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":1.264}]},{"osd":7,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.2490000000000001,"15min":1.2849999999999999},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.607,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.343},{"interface":"front","average":{"1min":1.151,"5min":1.1839999999999999,"15min":1.22},"min":{"1min":0.82699999999999996,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.4870000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":1.298}]}]},{"osd":5,"up_from":13,"seq":55834574914,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306332,"kb_used_data":852,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065508,"statfs":{"total":96636764160,"available":96323080192,"internally_reserved":0,"allocated":872448,"data_stored":362410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.878,"15min":0.85599999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":1.1639999999999999},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.90100000000000002,"15min":0.90800000000000003},"min":{"1min":0.57199999999999995,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.67700000000000005}]},{"osd":1,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91300000000000003,"15min":0.90900000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.4219999999999999,"5min":1.448,"15min":1.448},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.92000000000000004,"15min":0.97299999999999998},"min":{"1min":0.59699999999999998,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.641,"5min":1.754,"15min":1.754},"last":0.78000000000000003}]},{"osd":2,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.93899999999999995,"15min":0.94999999999999996},"min":{"1min":0.59199999999999997,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.044,"5min":2.044,"15min":2.044},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.1000000000000001,"5min":0.997,"15min":1.012},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.609,"5min":1.609,"15min":1.609},"last":1.2829999999999999}]},{"osd":3,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.96799999999999997,"15min":0.99199999999999999},"min":{"1min":0.61099999999999999,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.5800000000000001,"5min":1.929,"15min":1.929},"last":0.871},{"interface":"front","average":{"1min":1.044,"5min":1.034,"15min":1.0920000000000001},"min":{"1min":0.71599999999999997,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.53,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.71599999999999997}]},{"osd":4,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.0069999999999999,"15min":1.0129999999999999},"min":{"1min":0.68300000000000005,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":2.2189999999999999,"5min":2.2189999999999999,"15min":2.2189999999999999},"last":1.375},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.042,"15min":1.071},"min":{"1min":0.58399999999999996,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":2.129,"5min":2.129,"15min":2.129},"last":1.3460000000000001}]},{"osd":6,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.153,"15min":1.1910000000000001},"min":{"1min":0.876,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.4079999999999999,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":1.008},{"interface":"front","average":{"1min":1.165,"5min":1.161,"15min":1.2170000000000001},"min":{"1min":0.77400000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.6539999999999999,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.0449999999999999}]},{"osd":7,"last update":"Sun Oct 8 15:42:26 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.087,"15min":1.1439999999999999},"min":{"1min":0.69299999999999995,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.7470000000000001,"5min":2.177,"15min":2.177},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.1970000000000001,"15min":1.2130000000000001},"min":{"1min":0.85099999999999998,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.6579999999999999,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.234}]}]},{"osd":4,"up_from":13,"seq":55834574914,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298136,"kb_used_data":848,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073704,"statfs":{"total":96636764160,"available":96331472896,"internally_reserved":0,"allocated":868352,"data_stored":367140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.82799999999999996,"15min":0.81200000000000006},"min":{"1min":0.503,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.248,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":1.3029999999999999},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84399999999999997,"15min":0.80500000000000005},"min":{"1min":0.54300000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.147,"5min":1.474,"15min":1.474},"last":0.873}]},{"osd":1,"last update":"Sun Oct 8 15:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.89300000000000002,"15min":0.84799999999999998},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1359999999999999,"5min":1.456,"15min":1.456},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.89300000000000002,"15min":0.85099999999999998},"min":{"1min":0.65500000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.327,"5min":2.327,"15min":2.327},"last":0.90800000000000003}]},{"osd":2,"last update":"Sun Oct 8 15:42:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0640000000000001,"15min":1.0389999999999999},"min":{"1min":0.63600000000000001,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.401,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":1.024,"5min":1.0209999999999999,"15min":1.022},"min":{"1min":0.79400000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.4059999999999999,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":1.0329999999999999}]},{"osd":3,"last update":"Sun Oct 8 15:42:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0189999999999999,"15min":1.0209999999999999},"min":{"1min":0.76900000000000002,"5min":0.626,"15min":0.626},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0620000000000001,"15min":1.042},"min":{"1min":0.68700000000000006,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2809999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":1.1379999999999999}]},{"osd":5,"last update":"Sun Oct 8 15:42:22 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.018,"15min":0.98199999999999998},"min":{"1min":0.72599999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.304,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":1.246},{"interface":"front","average":{"1min":1.226,"5min":1.125,"15min":1.081},"min":{"1min":0.60099999999999998,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":3.0259999999999998,"5min":3.0259999999999998,"15min":3.0259999999999998},"last":1.468}]},{"osd":6,"last update":"Sun Oct 8 15:42:22 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.1180000000000001,"15min":1.1399999999999999},"min":{"1min":0.86599999999999999,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":2.4550000000000001,"5min":2.4550000000000001,"15min":2.4550000000000001},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.232,"5min":1.2170000000000001,"15min":1.1930000000000001},"min":{"1min":0.69199999999999995,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.8159999999999998,"5min":2.8159999999999998,"15min":2.8159999999999998},"last":1.391}]},{"osd":7,"last update":"Sun Oct 8 15:42:22 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.1240000000000001,"15min":1.0840000000000001},"min":{"1min":0.64300000000000002,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":2.1949999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":1.282},{"interface":"front","average":{"1min":1.331,"5min":1.246,"15min":1.208},"min":{"1min":0.79100000000000004,"5min":0.625,"15min":0.625},"max":{"1min":2.7450000000000001,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":1.337}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33141,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T15:42:35.373 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-10-08T15:42:35.373 DEBUG:teuthology.task.console_log:Killing console logger for smithi003 2023-10-08T15:42:35.374 DEBUG:teuthology.task.console_log:Killing console logger for smithi050 2023-10-08T15:42:35.374 DEBUG:teuthology.task.console_log:Killing console logger for smithi089 2023-10-08T15:42:35.374 DEBUG:teuthology.task.console_log:Killing console logger for smithi098 2023-10-08T15:42:35.374 DEBUG:teuthology.task.console_log:Killing console logger for smithi153 2023-10-08T15:42:35.375 DEBUG:teuthology.exit:Finished running handlers